2024-04-16T17:31:46.197 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-16T17:31:46.198 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453 --owner scheduled_smanjara@teuthology --description rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi} --name smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi --verbose -- /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/orig.config.yaml 2024-04-16T17:31:46.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T17:31:46.329 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453 branch: main description: rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi} email: null first_in_suite: false job_id: '7658453' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw lifecycle: 20 debug rgw notification: 20 debug rgw sync: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw data sync poll interval: 5 rgw md log max shards: 4 rgw meta sync poll interval: 5 rgw sync data inject err probability: 0.1 rgw sync log trim interval: 0 rgw sync meta inject err probability: 0.1 rgw sync obj etag verify: true setgroup: ceph setuser: ceph client.0: rgw data notify interval msec: 0 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 rocksdb delete range threshold: 0 osd.0: osd_max_omap_entries_per_request: 10 osd.1: osd_max_omap_entries_per_request: 1000 osd.2: osd_max_omap_entries_per_request: 10000 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: b0c7b917267c471208541fdeb652f5e897d00086 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: b0c7b917267c471208541fdeb652f5e897d00086 rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - enabled_features: - resharding - notification_v2 endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 rgw-multisite-tests: args: - tests.py - -a - '!fails_on_rgw' selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-shilpa-multisite-tests sha1: 9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b owner: scheduled_smanjara@teuthology priority: 49 repo: https://git.ceph.com/ceph-ci.git roles: - - c1.mon.a - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c1.mgr.x - c1.osd.3 - c1.osd.4 - c1.osd.5 - c1.client.1 - - c2.mon.a - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - - c2.mgr.x - c2.osd.3 - c2.osd.4 - c2.osd.5 - c2.client.1 sha1: b0c7b917267c471208541fdeb652f5e897d00086 sleep_before_teardown: 0 suite: rgw:multisite suite_branch: wip-shilpa-multisite-tests suite_path: /home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa suite_relpath: qa suite_repo: https://github.com/smanjara/ceph.git suite_sha1: 9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbhFbfUsKQldVun2nyGgdUcxSnkO0dWqgM/8o0lch1swrFSDpkiNLHoyQ8jxNuLso55iNbZL9yHW2F90mt4jQQ= smithi023.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETZAltJ2haRKB4RlEtM1MtPT+J4723FrQyUMS0cu+dC1jkEAEg1AAEI8ysymgZCpJbSe7qHlg7SwKqTMZDCLA8= smithi139.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXA/cgWiNXvC2RpsWgXcNglJBHLTfHxwCoHukkjJ7i1n3zkwrq0Nx89+pfrE0YXL75R19B3TbtAv9p80WLLRAo= smithi163.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFP0QhDxCGQBJtiU86raG03uAHphji0IvPattOmP2ns/ZRTymOGSWzExkAuXkT7f6SOsBHlYulXlQvBVjsn+Ypw= tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - rgw: c1.client.0: port: 8000 c1.client.1: port: 8001 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 90 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-16_17:24:34 tube: smithi user: smanjara verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-16T17:31:46.329 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa; will attempt to use it 2024-04-16T17:31:46.342 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks 2024-04-16T17:31:46.342 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-16T17:31:46.344 INFO:teuthology.task.internal:Checking packages... 2024-04-16T17:31:46.507 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0c7b917267c471208541fdeb652f5e897d00086' 2024-04-16T17:31:46.507 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-16T17:31:46.507 INFO:teuthology.packaging:ref: None 2024-04-16T17:31:46.507 INFO:teuthology.packaging:tag: None 2024-04-16T17:31:46.508 INFO:teuthology.packaging:branch: main 2024-04-16T17:31:46.508 INFO:teuthology.packaging:sha1: b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:31:46.508 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-04-16T17:31:46.717 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3113.g117f85be 2024-04-16T17:31:46.718 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-16T17:31:46.724 INFO:teuthology.task.internal:no buildpackages task found 2024-04-16T17:31:46.724 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-16T17:31:46.730 INFO:teuthology.task.internal:Saving configuration 2024-04-16T17:31:46.744 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-16T17:31:46.750 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T17:31:46.776 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.906673', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbhFbfUsKQldVun2nyGgdUcxSnkO0dWqgM/8o0lch1swrFSDpkiNLHoyQ8jxNuLso55iNbZL9yHW2F90mt4jQQ='} 2024-04-16T17:31:46.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.904750', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETZAltJ2haRKB4RlEtM1MtPT+J4723FrQyUMS0cu+dC1jkEAEg1AAEI8ysymgZCpJbSe7qHlg7SwKqTMZDCLA8='} 2024-04-16T17:31:46.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.908155', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXA/cgWiNXvC2RpsWgXcNglJBHLTfHxwCoHukkjJ7i1n3zkwrq0Nx89+pfrE0YXL75R19B3TbtAv9p80WLLRAo='} 2024-04-16T17:31:46.847 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.909683', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFP0QhDxCGQBJtiU86raG03uAHphji0IvPattOmP2ns/ZRTymOGSWzExkAuXkT7f6SOsBHlYulXlQvBVjsn+Ypw='} 2024-04-16T17:31:46.847 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-16T17:31:46.853 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2024-04-16T17:31:46.854 INFO:teuthology.task.internal:roles: ubuntu@smithi023.front.sepia.ceph.com - ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'] 2024-04-16T17:31:46.854 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'] 2024-04-16T17:31:46.854 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1'] 2024-04-16T17:31:46.854 INFO:teuthology.run_tasks:Running task console_log... 2024-04-16T17:31:46.988 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f42da2510d0>, signals=[15]) 2024-04-16T17:31:46.989 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-16T17:31:46.994 INFO:teuthology.task.internal:Opening connections... 2024-04-16T17:31:46.994 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T17:31:46.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:31:47.102 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T17:31:47.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:31:47.208 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T17:31:47.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:31:47.293 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T17:31:47.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:31:47.379 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-16T17:31:47.386 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2024-04-16T17:31:47.406 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2024-04-16T17:31:47.406 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2024-04-16T17:31:47.464 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream" 2024-04-16T17:31:47.464 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="9" 2024-04-16T17:31:47.464 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos" 2024-04-16T17:31:47.464 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="9" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el9" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:LOGO="fedora-logo-icon" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T17:31:47.465 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T17:31:47.466 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2024-04-16T17:31:47.494 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2024-04-16T17:31:47.512 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2024-04-16T17:31:47.512 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2024-04-16T17:31:47.570 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2024-04-16T17:31:47.570 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9" 2024-04-16T17:31:47.570 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2024-04-16T17:31:47.570 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T17:31:47.571 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T17:31:47.571 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2024-04-16T17:31:47.593 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2024-04-16T17:31:47.611 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2024-04-16T17:31:47.611 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2024-04-16T17:31:47.667 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="CentOS Stream" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="9" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:ID="centos" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE="rhel fedora" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="9" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:PLATFORM_ID="platform:el9" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:ANSI_COLOR="0;31" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:LOGO="fedora-logo-icon" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://centos.org/" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T17:31:47.668 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T17:31:47.669 INFO:teuthology.orchestra.run.smithi139.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T17:31:47.669 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2024-04-16T17:31:47.693 DEBUG:teuthology.orchestra.run.smithi163:> uname -m 2024-04-16T17:31:47.710 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2024-04-16T17:31:47.711 DEBUG:teuthology.orchestra.run.smithi163:> cat /etc/os-release 2024-04-16T17:31:47.767 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="9" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="9" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el9" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:LOGO="fedora-logo-icon" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-16T17:31:47.768 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-16T17:31:47.769 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2024-04-16T17:31:47.793 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-16T17:31:47.802 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-16T17:31:47.808 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-16T17:31:47.808 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2024-04-16T17:31:47.810 DEBUG:teuthology.orchestra.run.smithi023:> test '!' -e /home/ubuntu/cephtest 2024-04-16T17:31:47.813 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2024-04-16T17:31:47.815 DEBUG:teuthology.orchestra.run.smithi163:> test '!' -e /home/ubuntu/cephtest 2024-04-16T17:31:47.831 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-16T17:31:47.837 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-16T17:31:47.837 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2024-04-16T17:31:47.868 DEBUG:teuthology.orchestra.run.smithi023:> test -z $(ls -A /var/lib/ceph) 2024-04-16T17:31:47.870 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2024-04-16T17:31:47.872 DEBUG:teuthology.orchestra.run.smithi163:> test -z $(ls -A /var/lib/ceph) 2024-04-16T17:31:47.902 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-16T17:31:48.007 INFO:teuthology.run_tasks:Running task kernel... 2024-04-16T17:31:48.024 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-16T17:31:48.024 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-16T17:31:48.024 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T17:31:48.024 DEBUG:teuthology.orchestra.run.smithi023:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T17:31:48.025 DEBUG:teuthology.orchestra.run.smithi139:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T17:31:48.025 DEBUG:teuthology.orchestra.run.smithi163:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-16T17:31:48.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:31:48.042 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-04-16T17:31:48.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:31:48.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:31:48.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:31:48.044 DEBUG:teuthology.orchestra.run.smithi023:> uname -r 2024-04-16T17:31:48.045 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-16T17:31:48.045 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-04-16T17:31:48.099 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-361.el9.x86_64 2024-04-16T17:31:48.099 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.14.0-361.el9.x86_64 2024-04-16T17:31:48.099 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum install -y kernel 2024-04-16T17:31:48.101 INFO:teuthology.orchestra.run.smithi023.stdout:5.14.0-361.el9.x86_64 2024-04-16T17:31:48.101 INFO:teuthology.task.kernel:Running kernel on smithi023: 5.14.0-361.el9.x86_64 2024-04-16T17:31:48.102 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum install -y kernel 2024-04-16T17:31:48.103 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-361.el9.x86_64 2024-04-16T17:31:48.103 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-361.el9.x86_64 2024-04-16T17:31:48.103 INFO:teuthology.task.kernel:Running kernel on smithi016: 5.14.0-361.el9.x86_64 2024-04-16T17:31:48.104 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum install -y kernel 2024-04-16T17:31:48.104 INFO:teuthology.task.kernel:Running kernel on smithi163: 5.14.0-361.el9.x86_64 2024-04-16T17:31:48.104 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum install -y kernel 2024-04-16T17:31:50.553 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - AppStream 8.2 MB/s | 6.7 MB 00:00 2024-04-16T17:31:50.596 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - AppStream 8.1 MB/s | 6.7 MB 00:00 2024-04-16T17:31:50.599 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-9 - AppStream 8.7 MB/s | 6.7 MB 00:00 2024-04-16T17:31:50.686 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - AppStream 7.3 MB/s | 6.7 MB 00:00 2024-04-16T17:31:52.145 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2024-04-16T17:31:52.150 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-04-16T17:31:52.170 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-04-16T17:31:52.255 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2024-04-16T17:31:53.090 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T17:31:53.102 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-16T17:31:53.161 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-16T17:31:54.937 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-16T17:31:56.342 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 19 MB 00:02 2024-04-16T17:31:59.588 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 6.2 MB 00:01 2024-04-16T17:32:00.526 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-16T17:32:01.271 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-04-16T17:32:01.794 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 897 kB/s | 8.0 MB 00:09 2024-04-16T17:32:02.243 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-16T17:32:03.056 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-16T17:32:03.761 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-16T17:32:04.954 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 21 MB 00:02 2024-04-16T17:32:08.156 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-16T17:32:08.295 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 6.2 MB 00:00 2024-04-16T17:32:09.687 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 16 kB 00:00 2024-04-16T17:32:10.095 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-04-16T17:32:10.471 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T17:32:10.471 INFO:teuthology.orchestra.run.smithi163.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T17:32:10.555 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 29 MB/s | 21 MB 00:00 2024-04-16T17:32:10.556 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:32:10.566 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:32:10.566 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:32:10.566 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout:Install 4 Packages 2024-04-16T17:32:10.567 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:32:10.568 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 77 M 2024-04-16T17:32:10.568 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 123 M 2024-04-16T17:32:10.568 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:32:10.732 INFO:teuthology.orchestra.run.smithi163.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.7 MB/s | 277 kB 00:00 2024-04-16T17:32:11.224 INFO:teuthology.orchestra.run.smithi163.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 23 MB/s | 15 MB 00:00 2024-04-16T17:32:11.973 INFO:teuthology.orchestra.run.smithi163.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 24 MB/s | 34 MB 00:01 2024-04-16T17:32:12.299 INFO:teuthology.orchestra.run.smithi163.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 18 MB/s | 28 MB 00:01 2024-04-16T17:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:32:12.302 INFO:teuthology.orchestra.run.smithi163.stdout:Total 44 MB/s | 77 MB 00:01 2024-04-16T17:32:12.303 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:32:12.568 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T17:32:12.568 INFO:teuthology.orchestra.run.smithi016.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T17:32:12.655 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:32:12.665 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:32:12.665 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:32:12.665 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:32:12.665 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:32:12.665 INFO:teuthology.orchestra.run.smithi016.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T17:32:12.665 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout:Install 4 Packages 2024-04-16T17:32:12.666 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:32:12.667 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 77 M 2024-04-16T17:32:12.667 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 123 M 2024-04-16T17:32:12.667 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:32:12.669 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:32:12.669 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:32:12.837 INFO:teuthology.orchestra.run.smithi016.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.6 MB/s | 277 kB 00:00 2024-04-16T17:32:13.463 INFO:teuthology.orchestra.run.smithi016.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 19 MB/s | 15 MB 00:00 2024-04-16T17:32:13.514 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:32:13.515 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:32:14.263 INFO:teuthology.orchestra.run.smithi016.stdout:(3/4): kernel-modules-core-5.14.0-438.el9.x86_6 19 MB/s | 28 MB 00:01 2024-04-16T17:32:14.563 INFO:teuthology.orchestra.run.smithi016.stdout:(4/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 18 MB/s | 34 MB 00:01 2024-04-16T17:32:14.566 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:32:14.566 INFO:teuthology.orchestra.run.smithi016.stdout:Total 40 MB/s | 77 MB 00:01 2024-04-16T17:32:14.567 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:32:15.031 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:32:15.031 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:32:15.563 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-04-16T17:32:15.593 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - AppStream 915 kB/s | 19 MB 00:21 2024-04-16T17:32:15.811 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:32:15.876 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:32:15.876 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:32:16.410 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:32:16.490 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:17.946 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T17:32:17.946 INFO:teuthology.orchestra.run.smithi139.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T17:32:18.023 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:32:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:32:18.035 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:32:18.035 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout:Install 4 Packages 2024-04-16T17:32:18.036 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:32:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 77 M 2024-04-16T17:32:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 123 M 2024-04-16T17:32:18.037 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:32:18.298 INFO:teuthology.orchestra.run.smithi139.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.0 MB/s | 277 kB 00:00 2024-04-16T17:32:18.313 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:32:18.958 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:32:19.047 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:19.073 INFO:teuthology.orchestra.run.smithi139.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 15 MB/s | 15 MB 00:01 2024-04-16T17:32:19.224 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:19.368 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:19.721 INFO:teuthology.orchestra.run.smithi139.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 20 MB/s | 34 MB 00:01 2024-04-16T17:32:20.540 INFO:teuthology.orchestra.run.smithi139.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 12 MB/s | 28 MB 00:02 2024-04-16T17:32:20.543 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:32:20.543 INFO:teuthology.orchestra.run.smithi139.stdout:Total 31 MB/s | 77 MB 00:02 2024-04-16T17:32:20.543 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:32:20.886 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:32:20.886 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:32:21.735 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:32:21.736 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:32:21.920 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:22.059 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:24.024 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:32:24.110 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:24.226 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:24.651 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:32:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:27.141 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:27.184 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:27.469 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:27.609 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:27.851 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - CRB 738 kB/s | 6.2 MB 00:08 2024-04-16T17:32:28.985 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:29.693 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-16T17:32:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 21 MB 00:02 2024-04-16T17:32:32.281 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:32.312 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:32.415 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:37.132 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:37.436 INFO:teuthology.orchestra.run.smithi023.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-04-16T17:32:39.893 INFO:teuthology.orchestra.run.smithi023.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-16T17:32:39.893 INFO:teuthology.orchestra.run.smithi023.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-16T17:32:39.985 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout: kernel x86_64 5.14.0-438.el9 CentOS-BaseOS 277 k 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout: kernel-core x86_64 5.14.0-438.el9 CentOS-BaseOS 15 M 2024-04-16T17:32:39.992 INFO:teuthology.orchestra.run.smithi023.stdout: kernel-modules x86_64 5.14.0-438.el9 CentOS-BaseOS 34 M 2024-04-16T17:32:39.993 INFO:teuthology.orchestra.run.smithi023.stdout: kernel-modules-core x86_64 5.14.0-438.el9 CentOS-BaseOS 28 M 2024-04-16T17:32:39.993 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:32:39.993 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:32:39.993 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:32:39.993 INFO:teuthology.orchestra.run.smithi023.stdout:Install 4 Packages 2024-04-16T17:32:39.993 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:32:39.994 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 77 M 2024-04-16T17:32:39.994 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 123 M 2024-04-16T17:32:39.994 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:32:40.171 INFO:teuthology.orchestra.run.smithi023.stdout:(1/4): kernel-5.14.0-438.el9.x86_64.rpm 1.5 MB/s | 277 kB 00:00 2024-04-16T17:32:40.779 INFO:teuthology.orchestra.run.smithi023.stdout:(2/4): kernel-core-5.14.0-438.el9.x86_64.rpm 19 MB/s | 15 MB 00:00 2024-04-16T17:32:41.421 INFO:teuthology.orchestra.run.smithi023.stdout:(3/4): kernel-modules-5.14.0-438.el9.x86_64.rpm 24 MB/s | 34 MB 00:01 2024-04-16T17:32:41.863 INFO:teuthology.orchestra.run.smithi023.stdout:(4/4): kernel-modules-core-5.14.0-438.el9.x86_6 16 MB/s | 28 MB 00:01 2024-04-16T17:32:41.866 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:32:41.866 INFO:teuthology.orchestra.run.smithi023.stdout:Total 41 MB/s | 77 MB 00:01 2024-04-16T17:32:41.867 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:32:42.333 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:32:42.334 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:32:43.206 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:32:43.207 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:32:45.655 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:32:46.282 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : kernel-modules-core-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:32:46.380 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:49.270 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:49.508 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:54.581 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:54.624 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:58.228 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:58.229 INFO:teuthology.orchestra.run.smithi163.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T17:32:58.229 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:32:58.273 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:32:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:32:58.713 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:32:59.104 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:32:59.446 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:32:59.591 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:32:59.591 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:32:59.591 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T17:32:59.591 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T17:32:59.591 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T17:32:59.592 INFO:teuthology.task.kernel:Installing distro kernel on c2.mgr.x... 2024-04-16T17:32:59.592 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi163.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T17:32:59.592 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:32:59.672 INFO:teuthology.orchestra.run.smithi163.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:32:59.672 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:32:59.672 DEBUG:teuthology.orchestra.run.smithi163:> sudo rpm -qi grub2-tools 2024-04-16T17:32:59.710 INFO:teuthology.orchestra.run.smithi163.stdout:Name : grub2-tools 2024-04-16T17:32:59.710 INFO:teuthology.orchestra.run.smithi163.stdout:Epoch : 1 2024-04-16T17:32:59.710 INFO:teuthology.orchestra.run.smithi163.stdout:Version : 2.06 2024-04-16T17:32:59.710 INFO:teuthology.orchestra.run.smithi163.stdout:Release : 68.el9 2024-04-16T17:32:59.710 INFO:teuthology.orchestra.run.smithi163.stdout:Architecture: x86_64 2024-04-16T17:32:59.710 INFO:teuthology.orchestra.run.smithi163.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Group : Unspecified 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Size : 8264254 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:License : GPLv3+ 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Packager : builder@centos.org 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Vendor : CentOS 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Summary : Support tools for GRUB. 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:Description : 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T17:32:59.711 INFO:teuthology.orchestra.run.smithi163.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T17:32:59.712 INFO:teuthology.orchestra.run.smithi163.stdout:hardware devices. 2024-04-16T17:32:59.712 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:32:59.712 INFO:teuthology.orchestra.run.smithi163.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T17:32:59.712 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T17:32:59.712 INFO:teuthology.task.kernel:Updating grub on smithi163 to boot 5.14.0-438.el9.x86_64 2024-04-16T17:32:59.712 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T17:32:59.725 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:00.322 INFO:teuthology.orchestra.run.smithi163.stderr:Generating grub configuration file ... 2024-04-16T17:33:01.801 INFO:teuthology.orchestra.run.smithi163.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T17:33:01.822 INFO:teuthology.orchestra.run.smithi163.stderr:done 2024-04-16T17:33:01.824 DEBUG:teuthology.orchestra.run.smithi163:> mktemp 2024-04-16T17:33:01.839 INFO:teuthology.orchestra.run.smithi163.stdout:/tmp/tmp.4V8cCUbH9q 2024-04-16T17:33:01.840 DEBUG:teuthology.orchestra.run.smithi163:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4V8cCUbH9q 2024-04-16T17:33:01.909 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0666 /tmp/tmp.4V8cCUbH9q 2024-04-16T17:33:02.060 DEBUG:teuthology.orchestra.remote:smithi163:/tmp/tmp.4V8cCUbH9q is 6KB 2024-04-16T17:33:02.108 DEBUG:teuthology.orchestra.run.smithi163:> rm -fr /tmp/tmp.4V8cCUbH9q 2024-04-16T17:33:02.122 DEBUG:teuthology.orchestra.run.smithi163:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T17:33:02.190 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T17:33:02.190 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T17:33:02.190 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T17:33:02.190 INFO:teuthology.orchestra.run.smithi163.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T17:33:02.192 DEBUG:teuthology.orchestra.run.smithi163:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T17:33:02.357 DEBUG:teuthology.orchestra.run.smithi163:> sudo shutdown -r now 2024-04-16T17:33:03.281 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:03.282 INFO:teuthology.orchestra.run.smithi016.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T17:33:03.282 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:33:03.326 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:03.671 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:33:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:33:03.672 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:33:04.073 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:33:04.405 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:33:04.504 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:04.504 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:33:04.504 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T17:33:04.505 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T17:33:04.505 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T17:33:04.505 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2024-04-16T17:33:04.505 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi016.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T17:33:04.505 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:33:04.587 INFO:teuthology.orchestra.run.smithi016.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:04.588 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:33:04.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo rpm -qi grub2-tools 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Name : grub2-tools 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Epoch : 1 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Version : 2.06 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Release : 68.el9 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Architecture: x86_64 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Group : Unspecified 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:Size : 8264254 2024-04-16T17:33:04.625 INFO:teuthology.orchestra.run.smithi016.stdout:License : GPLv3+ 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Packager : builder@centos.org 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Vendor : CentOS 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Summary : Support tools for GRUB. 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:Description : 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T17:33:04.626 INFO:teuthology.orchestra.run.smithi016.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T17:33:04.627 INFO:teuthology.orchestra.run.smithi016.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T17:33:04.627 INFO:teuthology.orchestra.run.smithi016.stdout:hardware devices. 2024-04-16T17:33:04.627 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:33:04.627 INFO:teuthology.orchestra.run.smithi016.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T17:33:04.627 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T17:33:04.628 INFO:teuthology.task.kernel:Updating grub on smithi016 to boot 5.14.0-438.el9.x86_64 2024-04-16T17:33:04.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T17:33:05.222 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2024-04-16T17:33:06.622 INFO:teuthology.orchestra.run.smithi016.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T17:33:06.667 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:06.667 INFO:teuthology.orchestra.run.smithi139.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T17:33:06.667 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:33:06.670 INFO:teuthology.orchestra.run.smithi016.stderr:done 2024-04-16T17:33:06.673 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-16T17:33:06.688 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.IUZxFPMlse 2024-04-16T17:33:06.688 DEBUG:teuthology.orchestra.run.smithi016:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IUZxFPMlse 2024-04-16T17:33:06.710 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:06.762 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.IUZxFPMlse 2024-04-16T17:33:06.908 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.IUZxFPMlse is 6KB 2024-04-16T17:33:06.956 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.IUZxFPMlse 2024-04-16T17:33:06.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T17:33:07.038 INFO:teuthology.orchestra.run.smithi016.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T17:33:07.038 INFO:teuthology.orchestra.run.smithi016.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T17:33:07.038 INFO:teuthology.orchestra.run.smithi016.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T17:33:07.038 INFO:teuthology.orchestra.run.smithi016.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T17:33:07.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T17:33:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:33:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:33:07.110 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:33:07.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo shutdown -r now 2024-04-16T17:33:07.523 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:07.523 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:33:07.523 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:33:07.523 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:07.523 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T17:33:07.523 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T17:33:07.523 INFO:teuthology.orchestra.run.smithi139.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T17:33:07.524 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:33:07.524 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:33:07.852 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:33:07.991 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:07.991 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:33:07.992 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T17:33:07.992 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T17:33:07.992 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T17:33:07.992 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2024-04-16T17:33:07.992 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T17:33:07.992 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:33:08.072 INFO:teuthology.orchestra.run.smithi139.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:08.072 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:33:08.072 DEBUG:teuthology.orchestra.run.smithi139:> sudo rpm -qi grub2-tools 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Name : grub2-tools 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Epoch : 1 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Version : 2.06 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Release : 68.el9 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: x86_64 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Group : Unspecified 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Size : 8264254 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:License : GPLv3+ 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T17:33:08.117 INFO:teuthology.orchestra.run.smithi139.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:Packager : builder@centos.org 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:Vendor : CentOS 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:Summary : Support tools for GRUB. 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:Description : 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T17:33:08.118 INFO:teuthology.orchestra.run.smithi139.stdout:hardware devices. 2024-04-16T17:33:08.119 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:33:08.119 INFO:teuthology.orchestra.run.smithi139.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T17:33:08.119 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T17:33:08.119 INFO:teuthology.task.kernel:Updating grub on smithi139 to boot 5.14.0-438.el9.x86_64 2024-04-16T17:33:08.120 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T17:33:08.698 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2024-04-16T17:33:10.081 INFO:teuthology.orchestra.run.smithi139.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T17:33:10.128 INFO:teuthology.orchestra.run.smithi139.stderr:done 2024-04-16T17:33:10.131 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-04-16T17:33:10.146 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.0c5T4cgXzz 2024-04-16T17:33:10.146 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0c5T4cgXzz 2024-04-16T17:33:10.232 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.0c5T4cgXzz 2024-04-16T17:33:10.336 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.0c5T4cgXzz is 6KB 2024-04-16T17:33:10.356 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.0c5T4cgXzz 2024-04-16T17:33:10.370 DEBUG:teuthology.orchestra.run.smithi139:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T17:33:10.434 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T17:33:10.434 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T17:33:10.434 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T17:33:10.434 INFO:teuthology.orchestra.run.smithi139.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T17:33:10.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T17:33:10.595 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2024-04-16T17:33:30.706 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: kernel-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:30.706 INFO:teuthology.orchestra.run.smithi023.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-16T17:33:30.707 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:33:30.756 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: kernel-modules-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:31.178 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: kernel-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:31.178 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : kernel-5.14.0-438.el9.x86_64 1/4 2024-04-16T17:33:31.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : kernel-core-5.14.0-438.el9.x86_64 2/4 2024-04-16T17:33:31.179 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : kernel-modules-5.14.0-438.el9.x86_64 3/4 2024-04-16T17:33:31.630 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : kernel-modules-core-5.14.0-438.el9.x86_64 4/4 2024-04-16T17:33:31.630 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:33:31.630 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:33:31.630 INFO:teuthology.orchestra.run.smithi023.stdout: kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:31.630 INFO:teuthology.orchestra.run.smithi023.stdout: kernel-core-5.14.0-438.el9.x86_64 2024-04-16T17:33:31.630 INFO:teuthology.orchestra.run.smithi023.stdout: kernel-modules-5.14.0-438.el9.x86_64 2024-04-16T17:33:31.630 INFO:teuthology.orchestra.run.smithi023.stdout: kernel-modules-core-5.14.0-438.el9.x86_64 2024-04-16T17:33:31.631 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:33:31.631 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:33:31.949 DEBUG:teuthology.orchestra.run.smithi023:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:33:32.049 INFO:teuthology.orchestra.run.smithi023.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:32.049 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:33:32.049 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-438.el9.x86_64 2024-04-16T17:33:32.049 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-16T17:33:32.049 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-16T17:33:32.049 INFO:teuthology.task.kernel:Installing distro kernel on c1.mgr.x... 2024-04-16T17:33:32.050 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi023.front.sepia.ceph.com, path=None, version=distro) 2024-04-16T17:33:32.050 DEBUG:teuthology.orchestra.run.smithi023:> rpm -q kernel | sort -rV | head -n 1 2024-04-16T17:33:32.132 INFO:teuthology.orchestra.run.smithi023.stdout:kernel-5.14.0-438.el9.x86_64 2024-04-16T17:33:32.133 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-438.el9.x86_64 2024-04-16T17:33:32.133 DEBUG:teuthology.orchestra.run.smithi023:> sudo rpm -qi grub2-tools 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Name : grub2-tools 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Epoch : 1 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Version : 2.06 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Release : 68.el9 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Architecture: x86_64 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Group : Unspecified 2024-04-16T17:33:32.171 INFO:teuthology.orchestra.run.smithi023.stdout:Size : 8264254 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:License : GPLv3+ 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Packager : builder@centos.org 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Vendor : CentOS 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Summary : Support tools for GRUB. 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:Description : 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-16T17:33:32.172 INFO:teuthology.orchestra.run.smithi023.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-16T17:33:32.173 INFO:teuthology.orchestra.run.smithi023.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-16T17:33:32.173 INFO:teuthology.orchestra.run.smithi023.stdout:hardware devices. 2024-04-16T17:33:32.173 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:33:32.173 INFO:teuthology.orchestra.run.smithi023.stdout:This subpackage provides tools for support of all platforms. 2024-04-16T17:33:32.174 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-16T17:33:32.174 INFO:teuthology.task.kernel:Updating grub on smithi023 to boot 5.14.0-438.el9.x86_64 2024-04-16T17:33:32.174 DEBUG:teuthology.orchestra.run.smithi023:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-16T17:33:32.360 INFO:teuthology.task.kernel:Checking client c2.mgr.x for new kernel version... 2024-04-16T17:33:32.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:33:32.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:33:32.745 INFO:teuthology.orchestra.run.smithi023.stderr:Generating grub configuration file ... 2024-04-16T17:33:34.275 INFO:teuthology.orchestra.run.smithi023.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-16T17:33:34.303 INFO:teuthology.orchestra.run.smithi023.stderr:done 2024-04-16T17:33:34.305 DEBUG:teuthology.orchestra.run.smithi023:> mktemp 2024-04-16T17:33:34.361 INFO:teuthology.orchestra.run.smithi023.stdout:/tmp/tmp.rkpfUn5kAW 2024-04-16T17:33:34.362 DEBUG:teuthology.orchestra.run.smithi023:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.rkpfUn5kAW 2024-04-16T17:33:34.434 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 0666 /tmp/tmp.rkpfUn5kAW 2024-04-16T17:33:34.576 DEBUG:teuthology.orchestra.remote:smithi023:/tmp/tmp.rkpfUn5kAW is 6KB 2024-04-16T17:33:34.624 DEBUG:teuthology.orchestra.run.smithi023:> rm -fr /tmp/tmp.rkpfUn5kAW 2024-04-16T17:33:34.639 DEBUG:teuthology.orchestra.run.smithi023:> sudo /bin/ls /boot/loader/entries || true 2024-04-16T17:33:34.707 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-16T17:33:34.707 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-16T17:33:34.707 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-16T17:33:34.708 INFO:teuthology.orchestra.run.smithi023.stdout:15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64.conf 2024-04-16T17:33:34.709 DEBUG:teuthology.orchestra.run.smithi023:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-438.el9.x86_64 2024-04-16T17:33:34.864 DEBUG:teuthology.orchestra.run.smithi023:> sudo shutdown -r now 2024-04-16T17:33:37.179 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2024-04-16T17:33:37.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-16T17:33:37.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:33:40.599 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2024-04-16T17:33:40.600 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-16T17:33:40.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:33:50.751 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-04-16T17:33:55.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2024-04-16T17:33:58.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-16T17:33:59.753 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:33:59.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:02.814 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-04-16T17:34:04.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-16T17:34:04.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:04.867 INFO:teuthology.task.kernel:Checking client c1.mgr.x for new kernel version... 2024-04-16T17:34:04.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:34:04.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:07.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-16T17:34:07.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:11.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.139 2024-04-16T17:34:14.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:34:14.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:17.886 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.163 2024-04-16T17:34:23.010 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-16T17:34:23.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:23.266 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-16T17:34:32.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:34:32.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:32.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:34:32.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:35.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-16T17:34:47.332 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:34:47.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:34:50.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-16T17:34:54.833 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-16T17:34:55.229 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-16T17:34:55.229 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "5.14.0-438.el9.x86_64"... 2024-04-16T17:34:55.229 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2024-04-16T17:34:55.244 INFO:teuthology.orchestra.run.smithi139.stdout:5.14.0-438.el9.x86_64 2024-04-16T17:34:55.245 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T17:34:55.245 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T17:34:55.245 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T17:34:56.246 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2024-04-16T17:34:56.247 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T17:34:56.316 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2024-04-16T17:34:56.353 DEBUG:teuthology.parallel:result is None 2024-04-16T17:35:04.619 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T17:35:05.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:35:05.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:35:08.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-16T17:35:16.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-16T17:35:16.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:35:16.956 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-16T17:35:17.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-16T17:35:17.355 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "5.14.0-438.el9.x86_64"... 2024-04-16T17:35:17.355 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2024-04-16T17:35:17.371 INFO:teuthology.orchestra.run.smithi016.stdout:5.14.0-438.el9.x86_64 2024-04-16T17:35:17.371 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T17:35:17.371 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T17:35:17.371 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T17:35:18.372 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2024-04-16T17:35:18.372 DEBUG:teuthology.orchestra.run.smithi016:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T17:35:18.476 INFO:teuthology.orchestra.run.smithi016.stdout:ttyS1 2024-04-16T17:35:18.517 DEBUG:teuthology.parallel:result is None 2024-04-16T17:35:26.480 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:35:26.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:35:32.890 DEBUG:teuthology.orchestra.remote:timed out 2024-04-16T17:35:44.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.23 2024-04-16T17:35:50.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:35:50.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:35:51.206 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-04-16T17:35:51.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:35:51.577 INFO:teuthology.task.kernel:Checking kernel version of c2.mgr.x, want "5.14.0-438.el9.x86_64"... 2024-04-16T17:35:51.577 DEBUG:teuthology.orchestra.run.smithi163:> uname -r 2024-04-16T17:35:51.592 INFO:teuthology.orchestra.run.smithi163.stdout:5.14.0-438.el9.x86_64 2024-04-16T17:35:51.593 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T17:35:51.593 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T17:35:51.593 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T17:35:52.594 INFO:teuthology.task.kernel:Enabling kdb on c2.mgr.x... 2024-04-16T17:35:52.595 DEBUG:teuthology.orchestra.run.smithi163:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T17:35:52.675 INFO:teuthology.orchestra.run.smithi163.stdout:ttyS1 2024-04-16T17:35:52.708 DEBUG:teuthology.parallel:result is None 2024-04-16T17:36:05.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:36:05.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:36:06.179 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-04-16T17:36:06.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:36:06.556 INFO:teuthology.task.kernel:Checking kernel version of c1.mgr.x, want "5.14.0-438.el9.x86_64"... 2024-04-16T17:36:06.556 DEBUG:teuthology.orchestra.run.smithi023:> uname -r 2024-04-16T17:36:06.573 INFO:teuthology.orchestra.run.smithi023.stdout:5.14.0-438.el9.x86_64 2024-04-16T17:36:06.573 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-438.el9.x86_64 vs 5.14.0-438.el9.x86_64 2024-04-16T17:36:06.573 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-16T17:36:06.573 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-16T17:36:07.574 INFO:teuthology.task.kernel:Enabling kdb on c1.mgr.x... 2024-04-16T17:36:07.574 DEBUG:teuthology.orchestra.run.smithi023:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-16T17:36:07.656 INFO:teuthology.orchestra.run.smithi023.stdout:ttyS1 2024-04-16T17:36:07.689 DEBUG:teuthology.parallel:result is None 2024-04-16T17:36:07.690 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-16T17:36:07.698 INFO:teuthology.task.internal:Creating test directory... 2024-04-16T17:36:07.699 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T17:36:07.702 DEBUG:teuthology.orchestra.run.smithi023:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T17:36:07.705 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T17:36:07.708 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-16T17:36:07.728 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-16T17:36:07.734 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-16T17:36:07.741 INFO:teuthology.task.internal:Creating archive directory... 2024-04-16T17:36:07.741 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T17:36:07.761 DEBUG:teuthology.orchestra.run.smithi023:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T17:36:07.764 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T17:36:07.768 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-16T17:36:07.806 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-16T17:36:07.813 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-16T17:36:07.813 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T17:36:07.827 DEBUG:teuthology.orchestra.run.smithi023:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T17:36:07.843 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T17:36:07.846 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-16T17:36:07.864 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.875 INFO:teuthology.orchestra.run.smithi023.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.879 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.882 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.889 INFO:teuthology.orchestra.run.smithi023.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.897 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.908 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.923 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-16T17:36:07.925 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-16T17:36:07.933 INFO:teuthology.task.internal:Configuring sudo... 2024-04-16T17:36:07.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T17:36:07.936 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T17:36:07.938 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T17:36:07.941 DEBUG:teuthology.orchestra.run.smithi163:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-16T17:36:07.972 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-16T17:36:07.998 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-16T17:36:07.998 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T17:36:08.007 DEBUG:teuthology.orchestra.run.smithi023:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T17:36:08.010 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T17:36:08.013 DEBUG:teuthology.orchestra.run.smithi163:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-16T17:36:08.030 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:08.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:08.160 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:08.246 DEBUG:teuthology.orchestra.run.smithi016:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:08.290 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:36:08.290 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T17:36:08.360 DEBUG:teuthology.orchestra.run.smithi023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:08.404 DEBUG:teuthology.orchestra.run.smithi023:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:08.457 DEBUG:teuthology.orchestra.run.smithi023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:08.541 DEBUG:teuthology.orchestra.run.smithi023:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:08.587 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:36:08.587 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T17:36:08.657 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:08.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:08.766 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:08.813 DEBUG:teuthology.orchestra.run.smithi139:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:08.855 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:36:08.855 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T17:36:08.925 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:08.968 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-16T17:36:09.038 DEBUG:teuthology.orchestra.run.smithi163:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:09.080 DEBUG:teuthology.orchestra.run.smithi163:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-16T17:36:09.128 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:36:09.129 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-16T17:36:09.198 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2024-04-16T17:36:09.201 DEBUG:teuthology.orchestra.run.smithi023:> sudo service rsyslog restart 2024-04-16T17:36:09.204 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2024-04-16T17:36:09.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo service rsyslog restart 2024-04-16T17:36:09.247 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T17:36:09.252 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T17:36:09.253 INFO:teuthology.orchestra.run.smithi023.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T17:36:09.285 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T17:36:09.763 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-16T17:36:09.804 INFO:teuthology.task.internal:Starting timer... 2024-04-16T17:36:09.804 INFO:teuthology.run_tasks:Running task pcp... 2024-04-16T17:36:09.817 INFO:teuthology.run_tasks:Running task selinux... 2024-04-16T17:36:09.827 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-16T17:36:09.828 DEBUG:teuthology.orchestra.run.smithi016:> sudo service auditd rotate 2024-04-16T17:36:09.882 INFO:teuthology.orchestra.run.smithi016.stdout:Rotating logs: 2024-04-16T17:36:09.884 DEBUG:teuthology.orchestra.run.smithi023:> sudo service auditd rotate 2024-04-16T17:36:09.957 INFO:teuthology.orchestra.run.smithi023.stdout:Rotating logs: 2024-04-16T17:36:09.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo service auditd rotate 2024-04-16T17:36:10.017 INFO:teuthology.orchestra.run.smithi139.stdout:Rotating logs: 2024-04-16T17:36:10.019 DEBUG:teuthology.orchestra.run.smithi163:> sudo service auditd rotate 2024-04-16T17:36:10.099 INFO:teuthology.orchestra.run.smithi163.stdout:Rotating logs: 2024-04-16T17:36:10.100 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-16T17:36:10.101 DEBUG:teuthology.orchestra.run.smithi016:> /usr/sbin/getenforce 2024-04-16T17:36:10.127 INFO:teuthology.orchestra.run.smithi016.stdout:Permissive 2024-04-16T17:36:10.128 DEBUG:teuthology.orchestra.run.smithi023:> /usr/sbin/getenforce 2024-04-16T17:36:10.151 INFO:teuthology.orchestra.run.smithi023.stdout:Permissive 2024-04-16T17:36:10.152 DEBUG:teuthology.orchestra.run.smithi139:> /usr/sbin/getenforce 2024-04-16T17:36:10.179 INFO:teuthology.orchestra.run.smithi139.stdout:Permissive 2024-04-16T17:36:10.179 DEBUG:teuthology.orchestra.run.smithi163:> /usr/sbin/getenforce 2024-04-16T17:36:10.199 INFO:teuthology.orchestra.run.smithi163.stdout:Permissive 2024-04-16T17:36:10.199 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi016.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi023.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi139.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi163.front.sepia.ceph.com': 'permissive'} 2024-04-16T17:36:10.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T17:36:10.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:36:10.229 DEBUG:teuthology.orchestra.run.smithi023:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T17:36:10.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:36:10.259 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T17:36:10.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:36:10.291 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T17:36:10.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T17:36:10.320 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-16T17:36:10.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo /usr/sbin/setenforce permissive 2024-04-16T17:36:10.354 DEBUG:teuthology.orchestra.run.smithi023:> sudo /usr/sbin/setenforce permissive 2024-04-16T17:36:10.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo /usr/sbin/setenforce permissive 2024-04-16T17:36:10.433 DEBUG:teuthology.orchestra.run.smithi163:> sudo /usr/sbin/setenforce permissive 2024-04-16T17:36:10.467 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-16T17:36:10.562 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-16T17:36:10.756 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-16T17:36:16.247 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-16T17:36:17.384 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-16T17:36:17.413 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi023.front.sepia.ceph.com,smithi139.front.sepia.ceph.com,smithi163.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-16T17:41:09.010 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi023.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi163.front.sepia.ceph.com')] 2024-04-16T17:41:09.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-16T17:41:09.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:41:09.103 DEBUG:teuthology.orchestra.run.smithi016:> true 2024-04-16T17:41:09.188 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2024-04-16T17:41:09.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:41:09.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:41:09.277 DEBUG:teuthology.orchestra.run.smithi023:> true 2024-04-16T17:41:09.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2024-04-16T17:41:09.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-16T17:41:09.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:41:09.442 DEBUG:teuthology.orchestra.run.smithi139:> true 2024-04-16T17:41:09.522 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2024-04-16T17:41:09.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:41:09.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi163.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-16T17:41:09.608 DEBUG:teuthology.orchestra.run.smithi163:> true 2024-04-16T17:41:09.699 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi163.front.sepia.ceph.com' 2024-04-16T17:41:09.700 INFO:teuthology.run_tasks:Running task clock... 2024-04-16T17:41:09.735 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-16T17:41:09.736 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T17:41:09.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T17:41:09.739 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T17:41:09.739 DEBUG:teuthology.orchestra.run.smithi023:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T17:41:09.741 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T17:41:09.741 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T17:41:09.744 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-16T17:41:09.744 DEBUG:teuthology.orchestra.run.smithi163:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T17:41:09.774 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T17:41:09.775 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T17:41:09.776 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T17:41:09.778 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-16T17:41:09.793 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T17:41:09.794 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T17:41:09.796 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T17:41:09.797 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-16T17:41:09.826 INFO:teuthology.orchestra.run.smithi139.stderr:sudo: ntpd: command not found 2024-04-16T17:41:09.826 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: ntpd: command not found 2024-04-16T17:41:09.828 INFO:teuthology.orchestra.run.smithi163.stderr:sudo: ntpd: command not found 2024-04-16T17:41:09.829 INFO:teuthology.orchestra.run.smithi023.stderr:sudo: ntpd: command not found 2024-04-16T17:41:09.840 INFO:teuthology.orchestra.run.smithi139.stdout:506 Cannot talk to daemon 2024-04-16T17:41:09.841 INFO:teuthology.orchestra.run.smithi016.stdout:506 Cannot talk to daemon 2024-04-16T17:41:09.843 INFO:teuthology.orchestra.run.smithi163.stdout:506 Cannot talk to daemon 2024-04-16T17:41:09.844 INFO:teuthology.orchestra.run.smithi023.stdout:506 Cannot talk to daemon 2024-04-16T17:41:09.857 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T17:41:09.859 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T17:41:09.861 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T17:41:09.862 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-16T17:41:09.875 INFO:teuthology.orchestra.run.smithi139.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T17:41:09.877 INFO:teuthology.orchestra.run.smithi016.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T17:41:09.878 INFO:teuthology.orchestra.run.smithi163.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T17:41:09.879 INFO:teuthology.orchestra.run.smithi023.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-16T17:41:09.928 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-16T17:41:09.931 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T17:41:09.931 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-16T17:41:09.931 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.931 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.931 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.931 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.932 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-04-16T17:41:09.934 INFO:teuthology.orchestra.run.smithi023.stderr:bash: line 1: ntpq: command not found 2024-04-16T17:41:09.935 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-04-16T17:41:09.936 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T17:41:09.936 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-04-16T17:41:09.936 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.936 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.936 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.936 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.938 INFO:teuthology.orchestra.run.smithi023.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T17:41:09.938 INFO:teuthology.orchestra.run.smithi023.stdout:=============================================================================== 2024-04-16T17:41:09.938 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.939 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.939 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.939 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.940 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T17:41:09.940 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-04-16T17:41:09.940 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.940 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.940 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.940 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T17:41:09.940 INFO:teuthology.run_tasks:Running task install... 2024-04-16T17:41:09.949 DEBUG:teuthology.task.install:project ceph 2024-04-16T17:41:09.949 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}} 2024-04-16T17:41:09.949 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'} 2024-04-16T17:41:09.949 INFO:teuthology.task.install:Using flavor: default 2024-04-16T17:41:09.978 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-16T17:41:09.978 INFO:teuthology.task.install:extra packages: [] 2024-04-16T17:41:09.979 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086', 'tag': None, 'wait_for_package': False} 2024-04-16T17:41:09.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:41:09.982 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086', 'tag': None, 'wait_for_package': False} 2024-04-16T17:41:09.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:41:09.983 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086', 'tag': None, 'wait_for_package': False} 2024-04-16T17:41:09.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:41:09.984 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086', 'tag': None, 'wait_for_package': False} 2024-04-16T17:41:09.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:41:10.129 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/ 2024-04-16T17:41:10.129 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3089.gb0c7b917 2024-04-16T17:41:10.132 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/ 2024-04-16T17:41:10.132 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3089.gb0c7b917 2024-04-16T17:41:10.206 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/ 2024-04-16T17:41:10.206 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3089.gb0c7b917 2024-04-16T17:41:10.224 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/ 2024-04-16T17:41:10.224 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3089.gb0c7b917 2024-04-16T17:41:10.239 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T17:41:10.240 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:41:10.240 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T17:41:10.244 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T17:41:10.244 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:41:10.244 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T17:41:10.272 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-16T17:41:10.273 DEBUG:teuthology.orchestra.run.smithi023:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0c7b917267c471208541fdeb652f5e897d00086/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T17:41:10.274 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-16T17:41:10.274 DEBUG:teuthology.orchestra.run.smithi139:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0c7b917267c471208541fdeb652f5e897d00086/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T17:41:10.342 DEBUG:teuthology.orchestra.run.smithi023:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T17:41:10.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T17:41:10.394 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T17:41:10.394 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:41:10.394 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T17:41:10.424 DEBUG:teuthology.orchestra.run.smithi023:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T17:41:10.425 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-16T17:41:10.425 DEBUG:teuthology.orchestra.run.smithi163:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0c7b917267c471208541fdeb652f5e897d00086/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T17:41:10.426 DEBUG:teuthology.orchestra.run.smithi139:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T17:41:10.491 INFO:teuthology.orchestra.run.smithi023.stdout:check_obsoletes = 1 2024-04-16T17:41:10.492 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum clean all 2024-04-16T17:41:10.495 DEBUG:teuthology.orchestra.run.smithi163:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T17:41:10.496 INFO:teuthology.orchestra.run.smithi139.stdout:check_obsoletes = 1 2024-04-16T17:41:10.496 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum clean all 2024-04-16T17:41:10.577 DEBUG:teuthology.orchestra.run.smithi163:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T17:41:10.645 INFO:teuthology.orchestra.run.smithi163.stdout:check_obsoletes = 1 2024-04-16T17:41:10.647 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum clean all 2024-04-16T17:41:10.745 INFO:teuthology.orchestra.run.smithi139.stdout:74 files removed 2024-04-16T17:41:10.749 INFO:teuthology.orchestra.run.smithi023.stdout:74 files removed 2024-04-16T17:41:10.773 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-radosgw 2024-04-16T17:41:10.776 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-radosgw 2024-04-16T17:41:10.916 INFO:teuthology.orchestra.run.smithi163.stdout:74 files removed 2024-04-16T17:41:10.946 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-radosgw 2024-04-16T17:41:11.429 INFO:teuthology.orchestra.run.smithi023.stdout:ceph packages for x86_64 243 kB/s | 83 kB 00:00 2024-04-16T17:41:11.464 INFO:teuthology.orchestra.run.smithi139.stdout:ceph packages for x86_64 216 kB/s | 83 kB 00:00 2024-04-16T17:41:11.648 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-shilpa-multisite-tests/b0c7b917267c471208541fdeb652f5e897d00086/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-16T17:41:11.648 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:41:11.648 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-16T17:41:11.682 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-16T17:41:11.682 DEBUG:teuthology.orchestra.run.smithi016:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0c7b917267c471208541fdeb652f5e897d00086/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-16T17:41:11.699 INFO:teuthology.orchestra.run.smithi163.stdout:ceph packages for x86_64 185 kB/s | 83 kB 00:00 2024-04-16T17:41:11.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-16T17:41:11.818 INFO:teuthology.orchestra.run.smithi023.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-04-16T17:41:11.842 DEBUG:teuthology.orchestra.run.smithi016:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-16T17:41:11.870 INFO:teuthology.orchestra.run.smithi016.stdout:check_obsoletes = 1 2024-04-16T17:41:11.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum clean all 2024-04-16T17:41:12.008 INFO:teuthology.orchestra.run.smithi163.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-04-16T17:41:12.129 INFO:teuthology.orchestra.run.smithi016.stdout:74 files removed 2024-04-16T17:41:12.156 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-radosgw 2024-04-16T17:41:12.350 INFO:teuthology.orchestra.run.smithi163.stdout:ceph source packages 6.3 kB/s | 1.9 kB 00:00 2024-04-16T17:41:12.453 INFO:teuthology.orchestra.run.smithi023.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2024-04-16T17:41:12.818 INFO:teuthology.orchestra.run.smithi016.stdout:ceph packages for x86_64 237 kB/s | 83 kB 00:00 2024-04-16T17:41:13.013 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-16T17:41:13.027 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-04-16T17:41:13.252 INFO:teuthology.orchestra.run.smithi016.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-04-16T17:41:13.332 INFO:teuthology.orchestra.run.smithi139.stdout:ceph noarch packages 6.3 kB/s | 12 kB 00:01 2024-04-16T17:41:13.628 INFO:teuthology.orchestra.run.smithi016.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-04-16T17:41:13.915 INFO:teuthology.orchestra.run.smithi139.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2024-04-16T17:41:14.197 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-04-16T17:41:14.342 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-04-16T17:41:14.547 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2024-04-16T17:41:14.803 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2024-04-16T17:41:15.751 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2024-04-16T17:41:15.772 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-04-16T17:41:16.754 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-04-16T17:41:17.004 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.0 MB 00:02 2024-04-16T17:41:18.639 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-16T17:41:19.623 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-04-16T17:41:24.000 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - BaseOS 929 kB/s | 8.0 MB 00:08 2024-04-16T17:41:24.514 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-04-16T17:41:25.057 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - BaseOS 917 kB/s | 8.0 MB 00:08 2024-04-16T17:41:26.357 INFO:teuthology.orchestra.run.smithi023.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 16 kB 00:00 2024-04-16T17:41:26.866 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-04-16T17:41:28.101 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:02 2024-04-16T17:41:30.255 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - CRB 808 kB/s | 6.2 MB 00:07 2024-04-16T17:41:30.442 INFO:teuthology.orchestra.run.smithi023.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 21 MB 00:03 2024-04-16T17:41:31.126 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.2 MB 00:00 2024-04-16T17:41:31.840 INFO:teuthology.orchestra.run.smithi016.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 16 kB 00:00 2024-04-16T17:41:32.835 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.2 MB 00:01 2024-04-16T17:41:33.102 INFO:teuthology.orchestra.run.smithi139.stdout:CentOS Stream 9 - Extras packages 25 kB/s | 16 kB 00:00 2024-04-16T17:41:33.827 INFO:teuthology.orchestra.run.smithi016.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-16T17:41:34.419 INFO:teuthology.orchestra.run.smithi163.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 16 kB 00:00 2024-04-16T17:41:35.205 INFO:teuthology.orchestra.run.smithi139.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-16T17:41:35.725 INFO:teuthology.orchestra.run.smithi023.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-16T17:41:36.473 INFO:teuthology.orchestra.run.smithi163.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-16T17:41:38.565 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:41:38.569 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:41:38.569 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:41:38.569 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:41:38.569 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:41:38.569 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-radosgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 11 M 2024-04-16T17:41:38.569 INFO:teuthology.orchestra.run.smithi023.stdout:Upgrading: 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: librados2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.4 M 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: librbd1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: boost-program-options 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-base x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 21 M 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-selinux x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 25 k 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T17:41:38.570 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 746 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: libradosstriper1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 501 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: librgw2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-argparse 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 45 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 135 k 2024-04-16T17:41:38.571 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cephfs x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 162 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rados x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 321 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 298 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 99 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout:Installing weak dependencies: 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:41:38.572 INFO:teuthology.orchestra.run.smithi023.stdout:Install 30 Packages 2024-04-16T17:41:38.573 INFO:teuthology.orchestra.run.smithi023.stdout:Upgrade 2 Packages 2024-04-16T17:41:38.573 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:41:38.573 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 60 M 2024-04-16T17:41:38.573 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:41:39.199 INFO:teuthology.orchestra.run.smithi016.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-04-16T17:41:39.276 INFO:teuthology.orchestra.run.smithi023.stdout:(1/32): ceph-base-19.0.0-3089.gb0c7b917.el9.x86 9.9 MB/s | 5.4 MB 00:00 2024-04-16T17:41:39.318 INFO:teuthology.orchestra.run.smithi023.stdout:(2/32): ceph-selinux-19.0.0-3089.gb0c7b917.el9. 605 kB/s | 25 kB 00:00 2024-04-16T17:41:39.418 INFO:teuthology.orchestra.run.smithi023.stdout:(3/32): libcephfs2-19.0.0-3089.gb0c7b917.el9.x8 7.3 MB/s | 746 kB 00:00 2024-04-16T17:41:39.535 INFO:teuthology.orchestra.run.smithi023.stdout:(4/32): libradosstriper1-19.0.0-3089.gb0c7b917. 4.2 MB/s | 501 kB 00:00 2024-04-16T17:41:39.885 INFO:teuthology.orchestra.run.smithi023.stdout:(5/32): librgw2-19.0.0-3089.gb0c7b917.el9.x86_6 15 MB/s | 5.4 MB 00:00 2024-04-16T17:41:39.935 INFO:teuthology.orchestra.run.smithi023.stdout:(6/32): python3-ceph-argparse-19.0.0-3089.gb0c7 902 kB/s | 45 kB 00:00 2024-04-16T17:41:39.986 INFO:teuthology.orchestra.run.smithi023.stdout:(7/32): python3-ceph-common-19.0.0-3089.gb0c7b9 2.6 MB/s | 135 kB 00:00 2024-04-16T17:41:40.111 INFO:teuthology.orchestra.run.smithi023.stdout:(8/32): python3-cephfs-19.0.0-3089.gb0c7b917.el 1.3 MB/s | 162 kB 00:00 2024-04-16T17:41:40.186 INFO:teuthology.orchestra.run.smithi023.stdout:(9/32): python3-rados-19.0.0-3089.gb0c7b917.el9 4.2 MB/s | 321 kB 00:00 2024-04-16T17:41:40.253 INFO:teuthology.orchestra.run.smithi023.stdout:(10/32): python3-rbd-19.0.0-3089.gb0c7b917.el9. 4.4 MB/s | 298 kB 00:00 2024-04-16T17:41:40.303 INFO:teuthology.orchestra.run.smithi023.stdout:(11/32): python3-rgw-19.0.0-3089.gb0c7b917.el9. 1.9 MB/s | 99 kB 00:00 2024-04-16T17:41:40.310 INFO:teuthology.orchestra.run.smithi139.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-16T17:41:40.412 INFO:teuthology.orchestra.run.smithi023.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 977 kB/s | 106 kB 00:00 2024-04-16T17:41:40.462 INFO:teuthology.orchestra.run.smithi023.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-04-16T17:41:40.496 INFO:teuthology.orchestra.run.smithi023.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-04-16T17:41:40.555 INFO:teuthology.orchestra.run.smithi023.stdout:(15/32): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-04-16T17:41:40.597 INFO:teuthology.orchestra.run.smithi023.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2024-04-16T17:41:40.630 INFO:teuthology.orchestra.run.smithi023.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.2 MB/s | 41 kB 00:00 2024-04-16T17:41:40.672 INFO:teuthology.orchestra.run.smithi023.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2024-04-16T17:41:40.697 INFO:teuthology.orchestra.run.smithi023.stdout:(19/32): qatlib-service-24.02.0-1.el9.x86_64.rp 1.4 MB/s | 35 kB 00:00 2024-04-16T17:41:40.731 INFO:teuthology.orchestra.run.smithi023.stdout:(20/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.3 MB/s | 46 kB 00:00 2024-04-16T17:41:41.173 INFO:teuthology.orchestra.run.smithi023.stdout:(21/32): ceph-common-19.0.0-3089.gb0c7b917.el9. 8.7 MB/s | 21 MB 00:02 2024-04-16T17:41:41.341 INFO:teuthology.orchestra.run.smithi023.stdout:(22/32): ceph-radosgw-19.0.0-3089.gb0c7b917.el9 4.1 MB/s | 11 MB 00:02 2024-04-16T17:41:41.391 INFO:teuthology.orchestra.run.smithi023.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 469 kB/s | 309 kB 00:00 2024-04-16T17:41:41.474 INFO:teuthology.orchestra.run.smithi023.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 582 kB/s | 49 kB 00:00 2024-04-16T17:41:41.523 INFO:teuthology.orchestra.run.smithi163.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-04-16T17:41:41.574 INFO:teuthology.orchestra.run.smithi023.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 675 kB/s | 67 kB 00:00 2024-04-16T17:41:41.625 INFO:teuthology.orchestra.run.smithi023.stdout:(26/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 101 kB/s | 26 kB 00:00 2024-04-16T17:41:41.800 INFO:teuthology.orchestra.run.smithi023.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-04-16T17:41:41.858 INFO:teuthology.orchestra.run.smithi023.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 821 kB/s | 192 kB 00:00 2024-04-16T17:41:42.034 INFO:teuthology.orchestra.run.smithi023.stdout:(29/32): libarrow-9.0.0-10.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2024-04-16T17:41:42.074 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:41:42.076 INFO:teuthology.orchestra.run.smithi023.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 5.7 MB/s | 1.6 MB 00:00 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 11 M 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrading: 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: librados2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.4 M 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:42.083 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 21 M 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 25 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 746 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 501 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:42.084 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 45 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 135 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 162 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 321 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 298 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 99 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T17:41:42.085 INFO:teuthology.orchestra.run.smithi016.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout:Installing weak dependencies: 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout:Install 30 Packages 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout:Upgrade 2 Packages 2024-04-16T17:41:42.086 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:41:42.087 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 60 M 2024-04-16T17:41:42.087 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:41:42.243 INFO:teuthology.orchestra.run.smithi023.stdout:(31/32): librados2-19.0.0-3089.gb0c7b917.el9.x8 8.8 MB/s | 3.4 MB 00:00 2024-04-16T17:41:42.435 INFO:teuthology.orchestra.run.smithi023.stdout:(32/32): librbd1-19.0.0-3089.gb0c7b917.el9.x86_ 7.9 MB/s | 3.1 MB 00:00 2024-04-16T17:41:42.440 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:41:42.440 INFO:teuthology.orchestra.run.smithi023.stdout:Total 16 MB/s | 60 MB 00:03 2024-04-16T17:41:42.441 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:41:42.478 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:41:42.478 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:41:42.994 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:41:42.999 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:41:43.001 INFO:teuthology.orchestra.run.smithi016.stdout:(1/32): ceph-base-19.0.0-3089.gb0c7b917.el9.x86 7.2 MB/s | 5.4 MB 00:00 2024-04-16T17:41:43.074 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:41:43.086 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:41:43.086 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:41:43.086 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 11 M 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrading: 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.4 M 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 21 M 2024-04-16T17:41:43.087 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 25 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 746 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 501 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:43.088 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 45 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 135 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 162 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 321 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 298 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 99 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T17:41:43.089 INFO:teuthology.orchestra.run.smithi139.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout:Installing weak dependencies: 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout:Install 30 Packages 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout:Upgrade 2 Packages 2024-04-16T17:41:43.090 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:41:43.091 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 60 M 2024-04-16T17:41:43.091 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:41:43.601 INFO:teuthology.orchestra.run.smithi016.stdout:(2/32): ceph-selinux-19.0.0-3089.gb0c7b917.el9. 42 kB/s | 25 kB 00:00 2024-04-16T17:41:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:(3/32): ceph-common-19.0.0-3089.gb0c7b917.el9.x 14 MB/s | 21 MB 00:01 2024-04-16T17:41:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:(4/32): libcephfs2-19.0.0-3089.gb0c7b917.el9.x8 3.0 MB/s | 746 kB 00:00 2024-04-16T17:41:44.273 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 11 M 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrading: 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: librados2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.4 M 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:41:44.286 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 21 M 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 25 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 746 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 501 k 2024-04-16T17:41:44.287 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2 x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 5.4 M 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 45 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 135 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 162 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 321 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 298 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 99 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib x86_64 24.02.0-1.el9 CentOS-AppStream 220 k 2024-04-16T17:41:44.288 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs x86_64 1.2.0-1.el9 CentOS-AppStream 46 k 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout:Installing weak dependencies: 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service x86_64 24.02.0-1.el9 CentOS-AppStream 35 k 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout:Install 30 Packages 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout:Upgrade 2 Packages 2024-04-16T17:41:44.289 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:41:44.290 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 60 M 2024-04-16T17:41:44.290 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:41:44.666 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:41:44.668 INFO:teuthology.orchestra.run.smithi016.stdout:(5/32): librgw2-19.0.0-3089.gb0c7b917.el9.x86_6 6.5 MB/s | 5.4 MB 00:00 2024-04-16T17:41:44.710 INFO:teuthology.orchestra.run.smithi016.stdout:(6/32): libradosstriper1-19.0.0-3089.gb0c7b917. 556 kB/s | 501 kB 00:00 2024-04-16T17:41:44.744 INFO:teuthology.orchestra.run.smithi016.stdout:(7/32): python3-ceph-argparse-19.0.0-3089.gb0c7 601 kB/s | 45 kB 00:00 2024-04-16T17:41:44.753 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-16T17:41:44.781 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-16T17:41:44.794 INFO:teuthology.orchestra.run.smithi016.stdout:(8/32): python3-ceph-common-19.0.0-3089.gb0c7b9 1.6 MB/s | 135 kB 00:00 2024-04-16T17:41:44.806 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-16T17:41:44.828 INFO:teuthology.orchestra.run.smithi016.stdout:(9/32): python3-cephfs-19.0.0-3089.gb0c7b917.el 1.9 MB/s | 162 kB 00:00 2024-04-16T17:41:44.829 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:44.847 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:44.878 INFO:teuthology.orchestra.run.smithi016.stdout:(10/32): python3-rados-19.0.0-3089.gb0c7b917.el 3.7 MB/s | 321 kB 00:00 2024-04-16T17:41:44.920 INFO:teuthology.orchestra.run.smithi016.stdout:(11/32): python3-rbd-19.0.0-3089.gb0c7b917.el9. 3.2 MB/s | 298 kB 00:00 2024-04-16T17:41:44.945 INFO:teuthology.orchestra.run.smithi016.stdout:(12/32): python3-rgw-19.0.0-3089.gb0c7b917.el9. 1.5 MB/s | 99 kB 00:00 2024-04-16T17:41:44.953 INFO:teuthology.orchestra.run.smithi139.stdout:(1/32): ceph-radosgw-19.0.0-3089.gb0c7b917.el9. 6.2 MB/s | 11 MB 00:01 2024-04-16T17:41:45.020 INFO:teuthology.orchestra.run.smithi139.stdout:(2/32): ceph-selinux-19.0.0-3089.gb0c7b917.el9. 379 kB/s | 25 kB 00:00 2024-04-16T17:41:45.032 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:45.071 INFO:teuthology.orchestra.run.smithi016.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 705 kB/s | 106 kB 00:00 2024-04-16T17:41:45.096 INFO:teuthology.orchestra.run.smithi016.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 159 kB 00:00 2024-04-16T17:41:45.102 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:45.121 INFO:teuthology.orchestra.run.smithi016.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 879 kB/s | 44 kB 00:00 2024-04-16T17:41:45.179 INFO:teuthology.orchestra.run.smithi139.stdout:(3/32): libcephfs2-19.0.0-3089.gb0c7b917.el9.x8 4.6 MB/s | 746 kB 00:00 2024-04-16T17:41:45.180 INFO:teuthology.orchestra.run.smithi016.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 661 kB 00:00 2024-04-16T17:41:45.205 INFO:teuthology.orchestra.run.smithi016.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-04-16T17:41:45.230 INFO:teuthology.orchestra.run.smithi016.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 825 kB/s | 41 kB 00:00 2024-04-16T17:41:45.256 INFO:teuthology.orchestra.run.smithi016.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2024-04-16T17:41:45.281 INFO:teuthology.orchestra.run.smithi016.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 700 kB/s | 35 kB 00:00 2024-04-16T17:41:45.306 INFO:teuthology.orchestra.run.smithi016.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 927 kB/s | 46 kB 00:00 2024-04-16T17:41:45.329 INFO:teuthology.orchestra.run.smithi139.stdout:(4/32): libradosstriper1-19.0.0-3089.gb0c7b917. 3.3 MB/s | 501 kB 00:00 2024-04-16T17:41:45.446 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-16T17:41:45.517 INFO:teuthology.orchestra.run.smithi023.stdout: Upgrading : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:45.604 INFO:teuthology.orchestra.run.smithi139.stdout:(5/32): ceph-common-19.0.0-3089.gb0c7b917.el9.x 9.0 MB/s | 21 MB 00:02 2024-04-16T17:41:45.609 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:45.688 INFO:teuthology.orchestra.run.smithi139.stdout:(6/32): python3-ceph-argparse-19.0.0-3089.gb0c7 543 kB/s | 45 kB 00:00 2024-04-16T17:41:45.698 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 8/34 2024-04-16T17:41:45.763 INFO:teuthology.orchestra.run.smithi139.stdout:(7/32): python3-ceph-common-19.0.0-3089.gb0c7b9 1.8 MB/s | 135 kB 00:00 2024-04-16T17:41:45.814 INFO:teuthology.orchestra.run.smithi139.stdout:(8/32): python3-cephfs-19.0.0-3089.gb0c7b917.el 3.2 MB/s | 162 kB 00:00 2024-04-16T17:41:45.843 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:45.872 INFO:teuthology.orchestra.run.smithi139.stdout:(9/32): python3-rados-19.0.0-3089.gb0c7b917.el9 5.4 MB/s | 321 kB 00:00 2024-04-16T17:41:45.906 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:45.934 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-16T17:41:45.937 INFO:teuthology.orchestra.run.smithi163.stdout:(1/32): ceph-radosgw-19.0.0-3089.gb0c7b917.el9. 7.2 MB/s | 11 MB 00:01 2024-04-16T17:41:45.947 INFO:teuthology.orchestra.run.smithi139.stdout:(10/32): python3-rbd-19.0.0-3089.gb0c7b917.el9. 3.9 MB/s | 298 kB 00:00 2024-04-16T17:41:45.979 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 11/34 2024-04-16T17:41:45.979 INFO:teuthology.orchestra.run.smithi163.stdout:(2/32): ceph-selinux-19.0.0-3089.gb0c7b917.el9. 604 kB/s | 25 kB 00:00 2024-04-16T17:41:46.049 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:41:46.056 INFO:teuthology.orchestra.run.smithi139.stdout:(11/32): librgw2-19.0.0-3089.gb0c7b917.el9.x86_ 7.4 MB/s | 5.4 MB 00:00 2024-04-16T17:41:46.070 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:46.079 INFO:teuthology.orchestra.run.smithi163.stdout:(3/32): libcephfs2-19.0.0-3089.gb0c7b917.el9.x8 7.3 MB/s | 746 kB 00:00 2024-04-16T17:41:46.081 INFO:teuthology.orchestra.run.smithi139.stdout:(12/32): python3-rgw-19.0.0-3089.gb0c7b917.el9. 744 kB/s | 99 kB 00:00 2024-04-16T17:41:46.117 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:46.146 INFO:teuthology.orchestra.run.smithi163.stdout:(4/32): libradosstriper1-19.0.0-3089.gb0c7b917. 7.4 MB/s | 501 kB 00:00 2024-04-16T17:41:46.152 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-16T17:41:46.165 INFO:teuthology.orchestra.run.smithi016.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 350 kB/s | 309 kB 00:00 2024-04-16T17:41:46.215 INFO:teuthology.orchestra.run.smithi139.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2024-04-16T17:41:46.240 INFO:teuthology.orchestra.run.smithi139.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 576 kB/s | 106 kB 00:00 2024-04-16T17:41:46.257 INFO:teuthology.orchestra.run.smithi139.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-04-16T17:41:46.263 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-16T17:41:46.307 INFO:teuthology.orchestra.run.smithi139.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-04-16T17:41:46.320 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-16T17:41:46.332 INFO:teuthology.orchestra.run.smithi016.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 156 kB/s | 26 kB 00:00 2024-04-16T17:41:46.332 INFO:teuthology.orchestra.run.smithi139.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-04-16T17:41:46.369 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-16T17:41:46.374 INFO:teuthology.orchestra.run.smithi139.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 618 kB/s | 41 kB 00:00 2024-04-16T17:41:46.400 INFO:teuthology.orchestra.run.smithi139.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2024-04-16T17:41:46.410 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-16T17:41:46.425 INFO:teuthology.orchestra.run.smithi139.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 696 kB/s | 35 kB 00:00 2024-04-16T17:41:46.450 INFO:teuthology.orchestra.run.smithi139.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 922 kB/s | 46 kB 00:00 2024-04-16T17:41:46.455 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-16T17:41:46.497 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-16T17:41:46.499 INFO:teuthology.orchestra.run.smithi016.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 291 kB/s | 49 kB 00:00 2024-04-16T17:41:46.580 INFO:teuthology.orchestra.run.smithi163.stdout:(5/32): librgw2-19.0.0-3089.gb0c7b917.el9.x86_6 12 MB/s | 5.4 MB 00:00 2024-04-16T17:41:46.617 INFO:teuthology.orchestra.run.smithi139.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.6 MB/s | 309 kB 00:00 2024-04-16T17:41:46.657 INFO:teuthology.orchestra.run.smithi016.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 425 kB/s | 67 kB 00:00 2024-04-16T17:41:46.709 INFO:teuthology.orchestra.run.smithi139.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2024-04-16T17:41:46.724 INFO:teuthology.orchestra.run.smithi016.stdout:(26/32): libarrow-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 4.4 MB 00:01 2024-04-16T17:41:46.739 INFO:teuthology.orchestra.run.smithi163.stdout:(6/32): python3-ceph-argparse-19.0.0-3089.gb0c7 285 kB/s | 45 kB 00:00 2024-04-16T17:41:46.751 INFO:teuthology.orchestra.run.smithi139.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-04-16T17:41:46.789 INFO:teuthology.orchestra.run.smithi163.stdout:(7/32): python3-ceph-common-19.0.0-3089.gb0c7b9 2.6 MB/s | 135 kB 00:00 2024-04-16T17:41:46.837 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-16T17:41:46.856 INFO:teuthology.orchestra.run.smithi163.stdout:(8/32): python3-cephfs-19.0.0-3089.gb0c7b917.el 2.4 MB/s | 162 kB 00:00 2024-04-16T17:41:46.860 INFO:teuthology.orchestra.run.smithi139.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 622 kB/s | 67 kB 00:00 2024-04-16T17:41:46.868 INFO:teuthology.orchestra.run.smithi023.stdout: Upgrading : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:46.916 INFO:teuthology.orchestra.run.smithi016.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 1.0 MB/s | 192 kB 00:00 2024-04-16T17:41:46.931 INFO:teuthology.orchestra.run.smithi163.stdout:(9/32): python3-rados-19.0.0-3089.gb0c7b917.el9 4.2 MB/s | 321 kB 00:00 2024-04-16T17:41:46.958 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:46.989 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 23/34 2024-04-16T17:41:46.998 INFO:teuthology.orchestra.run.smithi163.stdout:(10/32): ceph-base-19.0.0-3089.gb0c7b917.el9.x8 2.1 MB/s | 5.4 MB 00:02 2024-04-16T17:41:47.016 INFO:teuthology.orchestra.run.smithi016.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.3 MB/s | 838 kB 00:00 2024-04-16T17:41:47.023 INFO:teuthology.orchestra.run.smithi163.stdout:(11/32): python3-rbd-19.0.0-3089.gb0c7b917.el9. 3.2 MB/s | 298 kB 00:00 2024-04-16T17:41:47.030 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-16T17:41:47.135 INFO:teuthology.orchestra.run.smithi139.stdout:(26/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 838 kB 00:00 2024-04-16T17:41:47.177 INFO:teuthology.orchestra.run.smithi139.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-04-16T17:41:47.324 INFO:teuthology.orchestra.run.smithi163.stdout:(12/32): ceph-common-19.0.0-3089.gb0c7b917.el9. 7.4 MB/s | 21 MB 00:02 2024-04-16T17:41:47.449 INFO:teuthology.orchestra.run.smithi163.stdout:(13/32): python3-rgw-19.0.0-3089.gb0c7b917.el9. 221 kB/s | 99 kB 00:00 2024-04-16T17:41:47.474 INFO:teuthology.orchestra.run.smithi163.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 235 kB/s | 106 kB 00:00 2024-04-16T17:41:47.508 INFO:teuthology.orchestra.run.smithi163.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 873 kB/s | 159 kB 00:00 2024-04-16T17:41:47.533 INFO:teuthology.orchestra.run.smithi163.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 527 kB/s | 44 kB 00:00 2024-04-16T17:41:47.539 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-16T17:41:47.570 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:47.583 INFO:teuthology.orchestra.run.smithi163.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 661 kB 00:00 2024-04-16T17:41:47.617 INFO:teuthology.orchestra.run.smithi163.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 282 kB 00:00 2024-04-16T17:41:47.625 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:47.642 INFO:teuthology.orchestra.run.smithi163.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 381 kB/s | 41 kB 00:00 2024-04-16T17:41:47.678 INFO:teuthology.orchestra.run.smithi139.stdout:(28/32): thrift-0.15.0-2.el9.x86_64.rpm 3.2 MB/s | 1.6 MB 00:00 2024-04-16T17:41:47.689 INFO:teuthology.orchestra.run.smithi163.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2024-04-16T17:41:47.695 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 27/34 2024-04-16T17:41:47.709 INFO:teuthology.orchestra.run.smithi163.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 524 kB/s | 35 kB 00:00 2024-04-16T17:41:47.726 INFO:teuthology.orchestra.run.smithi163.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 557 kB/s | 46 kB 00:00 2024-04-16T17:41:47.731 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 28/34 2024-04-16T17:41:47.786 INFO:teuthology.orchestra.run.smithi139.stdout:(29/32): ceph-base-19.0.0-3089.gb0c7b917.el9.x8 1.2 MB/s | 5.4 MB 00:04 2024-04-16T17:41:48.002 INFO:teuthology.orchestra.run.smithi163.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 94 kB/s | 26 kB 00:00 2024-04-16T17:41:48.003 INFO:teuthology.orchestra.run.smithi139.stdout:(30/32): librados2-19.0.0-3089.gb0c7b917.el9.x8 10 MB/s | 3.4 MB 00:00 2024-04-16T17:41:48.175 INFO:teuthology.orchestra.run.smithi016.stdout:(29/32): ceph-radosgw-19.0.0-3089.gb0c7b917.el9 1.8 MB/s | 11 MB 00:05 2024-04-16T17:41:48.227 INFO:teuthology.orchestra.run.smithi163.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 575 kB/s | 309 kB 00:00 2024-04-16T17:41:48.270 INFO:teuthology.orchestra.run.smithi139.stdout:(31/32): libarrow-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 4.4 MB 00:01 2024-04-16T17:41:48.352 INFO:teuthology.orchestra.run.smithi163.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 139 kB/s | 49 kB 00:00 2024-04-16T17:41:48.417 INFO:teuthology.orchestra.run.smithi016.stdout:(30/32): librados2-19.0.0-3089.gb0c7b917.el9.x8 2.4 MB/s | 3.4 MB 00:01 2024-04-16T17:41:48.577 INFO:teuthology.orchestra.run.smithi163.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 192 kB/s | 67 kB 00:00 2024-04-16T17:41:48.626 INFO:teuthology.orchestra.run.smithi016.stdout:(31/32): librbd1-19.0.0-3089.gb0c7b917.el9.x86_ 7.0 MB/s | 3.1 MB 00:00 2024-04-16T17:41:48.786 INFO:teuthology.orchestra.run.smithi163.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-04-16T17:41:49.003 INFO:teuthology.orchestra.run.smithi163.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 451 kB/s | 192 kB 00:00 2024-04-16T17:41:49.028 INFO:teuthology.orchestra.run.smithi163.stdout:(29/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2024-04-16T17:41:49.051 INFO:teuthology.orchestra.run.smithi016.stdout:(32/32): thrift-0.15.0-2.el9.x86_64.rpm 759 kB/s | 1.6 MB 00:02 2024-04-16T17:41:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:41:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:Total 8.6 MB/s | 60 MB 00:06 2024-04-16T17:41:49.055 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:41:49.097 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:41:49.097 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:41:49.411 INFO:teuthology.orchestra.run.smithi163.stdout:(30/32): librbd1-19.0.0-3089.gb0c7b917.el9.x86_ 8.2 MB/s | 3.1 MB 00:00 2024-04-16T17:41:49.470 INFO:teuthology.orchestra.run.smithi163.stdout:(31/32): thrift-0.15.0-2.el9.x86_64.rpm 2.3 MB/s | 1.6 MB 00:00 2024-04-16T17:41:49.587 INFO:teuthology.orchestra.run.smithi139.stdout:(32/32): librbd1-19.0.0-3089.gb0c7b917.el9.x86_ 1.7 MB/s | 3.1 MB 00:01 2024-04-16T17:41:49.591 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:41:49.591 INFO:teuthology.orchestra.run.smithi139.stdout:Total 9.3 MB/s | 60 MB 00:06 2024-04-16T17:41:49.592 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:41:49.602 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:41:49.602 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:41:49.630 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:41:49.631 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:41:49.737 INFO:teuthology.orchestra.run.smithi163.stdout:(32/32): librados2-19.0.0-3089.gb0c7b917.el9.x8 4.6 MB/s | 3.4 MB 00:00 2024-04-16T17:41:49.742 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:41:49.742 INFO:teuthology.orchestra.run.smithi163.stdout:Total 11 MB/s | 60 MB 00:05 2024-04-16T17:41:49.742 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:41:49.780 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:41:49.781 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:41:50.125 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:41:50.126 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:41:50.265 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:41:50.265 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:41:50.265 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:50.303 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:50.887 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:51.015 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:51.107 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:51.107 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T17:41:51.107 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T17:41:51.107 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:41:51.149 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:41:51.250 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:41:51.328 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-16T17:41:51.364 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-16T17:41:51.389 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-16T17:41:51.412 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:51.430 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:51.580 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:51.625 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:41:51.635 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:51.693 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-16T17:41:51.724 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-16T17:41:51.747 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:41:51.757 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-16T17:41:51.781 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:51.798 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:51.838 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-16T17:41:51.867 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-16T17:41:51.892 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-16T17:41:51.923 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:51.941 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-16T17:41:51.990 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:52.040 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-16T17:41:52.044 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:52.074 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:52.150 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:52.166 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:52.204 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-16T17:41:52.256 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 8/34 2024-04-16T17:41:52.284 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:52.346 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:52.364 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-16T17:41:52.375 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-16T17:41:52.420 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 11/34 2024-04-16T17:41:52.426 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:52.498 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:41:52.518 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:52.520 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:52.549 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-16T17:41:52.583 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:52.607 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 8/34 2024-04-16T17:41:52.618 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-16T17:41:52.635 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:52.636 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:52.699 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:52.726 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:41:52.728 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-16T17:41:52.737 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-16T17:41:52.769 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-16T17:41:52.772 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 11/34 2024-04-16T17:41:52.810 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-16T17:41:52.813 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 8/34 2024-04-16T17:41:52.836 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:52.851 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-16T17:41:52.851 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:41:52.880 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-16T17:41:52.880 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:52.890 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 9/34 2024-04-16T17:41:52.912 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-16T17:41:52.919 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-16T17:41:52.927 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:52.963 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-16T17:41:52.963 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 11/34 2024-04-16T17:41:53.034 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:41:53.055 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:53.073 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-16T17:41:53.113 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-16T17:41:53.118 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 13/34 2024-04-16T17:41:53.153 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-16T17:41:53.162 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-16T17:41:53.194 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-16T17:41:53.223 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-16T17:41:53.256 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-16T17:41:53.257 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-16T17:41:53.260 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-16T17:41:53.292 INFO:teuthology.orchestra.run.smithi016.stdout: Upgrading : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:53.305 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-16T17:41:53.345 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-16T17:41:53.377 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-16T17:41:53.390 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:53.406 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-16T17:41:53.422 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 23/34 2024-04-16T17:41:53.442 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-16T17:41:53.461 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-16T17:41:53.591 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-16T17:41:53.619 INFO:teuthology.orchestra.run.smithi139.stdout: Upgrading : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:53.709 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:53.741 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 23/34 2024-04-16T17:41:53.751 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-16T17:41:53.777 INFO:teuthology.orchestra.run.smithi163.stdout: Upgrading : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:53.786 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-16T17:41:53.850 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 22/34 2024-04-16T17:41:53.882 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 23/34 2024-04-16T17:41:53.922 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-16T17:41:53.967 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-16T17:41:53.995 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:54.066 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:54.137 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 27/34 2024-04-16T17:41:54.172 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 28/34 2024-04-16T17:41:54.265 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-16T17:41:54.297 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:54.352 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:54.406 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-16T17:41:54.419 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 27/34 2024-04-16T17:41:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:54.449 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 28/34 2024-04-16T17:41:54.501 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 26/34 2024-04-16T17:41:54.570 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 27/34 2024-04-16T17:41:54.599 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 28/34 2024-04-16T17:41:56.530 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:56.577 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:56.678 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:56.712 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:56.878 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:56.945 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:57.282 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T17:41:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T17:41:57.318 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:41:57.318 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:57.357 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:41:57.385 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:57.385 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T17:41:57.386 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T17:41:57.386 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:41:57.425 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:41:57.522 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 29/34 2024-04-16T17:41:57.581 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:57.666 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 30/34 2024-04-16T17:41:57.666 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-16T17:41:57.667 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-16T17:41:57.667 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:41:57.708 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:01.067 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:01.067 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /sys 2024-04-16T17:42:01.067 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /proc 2024-04-16T17:42:01.067 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /mnt 2024-04-16T17:42:01.067 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /var/tmp 2024-04-16T17:42:01.068 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /home 2024-04-16T17:42:01.068 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /root 2024-04-16T17:42:01.068 INFO:teuthology.orchestra.run.smithi023.stdout:skipping the directory /tmp 2024-04-16T17:42:01.068 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:02.066 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:02.093 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:02.093 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:02.093 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T17:42:02.093 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:02.093 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:02.093 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:02.095 INFO:teuthology.orchestra.run.smithi023.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:02.178 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:02.178 INFO:teuthology.orchestra.run.smithi023.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 6/34 2024-04-16T17:42:03.286 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 8/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 9/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 10/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 11/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 13/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-16T17:42:03.287 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-16T17:42:03.288 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-16T17:42:03.289 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:03.289 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-16T17:42:03.289 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/34 2024-04-16T17:42:04.614 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout:Upgraded: 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.615 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T17:42:04.616 INFO:teuthology.orchestra.run.smithi023.stdout: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:04.617 INFO:teuthology.orchestra.run.smithi023.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T17:42:04.618 INFO:teuthology.orchestra.run.smithi023.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T17:42:04.618 INFO:teuthology.orchestra.run.smithi023.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T17:42:04.618 INFO:teuthology.orchestra.run.smithi023.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T17:42:04.618 INFO:teuthology.orchestra.run.smithi023.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T17:42:04.618 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:04.618 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:04.920 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-test 2024-04-16T17:42:05.515 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:00:30 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:05.675 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:05.676 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:05.676 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:42:05.676 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:05.676 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:42:05.676 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-test x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 49 M 2024-04-16T17:42:05.676 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout: libcephsqlite x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 164 k 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout:Install 6 Packages 2024-04-16T17:42:05.677 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:05.678 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 50 M 2024-04-16T17:42:05.678 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 212 M 2024-04-16T17:42:05.678 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:42:05.925 INFO:teuthology.orchestra.run.smithi023.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2024-04-16T17:42:05.975 INFO:teuthology.orchestra.run.smithi023.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2024-04-16T17:42:06.009 INFO:teuthology.orchestra.run.smithi023.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-16T17:42:06.134 INFO:teuthology.orchestra.run.smithi023.stdout:(4/6): libcephsqlite-19.0.0-3089.gb0c7b917.el9. 430 kB/s | 164 kB 00:00 2024-04-16T17:42:06.861 INFO:teuthology.orchestra.run.smithi023.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 222 kB/s | 187 kB 00:00 2024-04-16T17:42:07.056 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:07.056 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /sys 2024-04-16T17:42:07.056 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /proc 2024-04-16T17:42:07.057 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /mnt 2024-04-16T17:42:07.057 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /var/tmp 2024-04-16T17:42:07.057 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /home 2024-04-16T17:42:07.057 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /root 2024-04-16T17:42:07.057 INFO:teuthology.orchestra.run.smithi139.stdout:skipping the directory /tmp 2024-04-16T17:42:07.057 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /sys 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /proc 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /mnt 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /var/tmp 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /home 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /root 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout:skipping the directory /tmp 2024-04-16T17:42:07.197 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:07.478 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /sys 2024-04-16T17:42:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /proc 2024-04-16T17:42:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /mnt 2024-04-16T17:42:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /var/tmp 2024-04-16T17:42:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /home 2024-04-16T17:42:07.478 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /root 2024-04-16T17:42:07.479 INFO:teuthology.orchestra.run.smithi016.stdout:skipping the directory /tmp 2024-04-16T17:42:07.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:08.046 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:08.072 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:08.072 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:08.072 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T17:42:08.072 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:08.072 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:08.073 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:08.074 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:08.147 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:08.172 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:08.172 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:08.173 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T17:42:08.173 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:08.173 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:08.173 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:08.173 INFO:teuthology.orchestra.run.smithi139.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:08.174 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:08.249 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:08.249 INFO:teuthology.orchestra.run.smithi163.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:08.479 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:08.504 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/34 2024-04-16T17:42:08.504 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:08.504 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-16T17:42:08.505 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:08.505 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-16T17:42:08.505 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:08.506 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:08.590 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-16T17:42:08.590 INFO:teuthology.orchestra.run.smithi016.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:09.237 INFO:teuthology.orchestra.run.smithi023.stdout:(6/6): ceph-test-19.0.0-3089.gb0c7b917.el9.x86_ 14 MB/s | 49 MB 00:03 2024-04-16T17:42:09.240 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:09.240 INFO:teuthology.orchestra.run.smithi023.stdout:Total 14 MB/s | 50 MB 00:03 2024-04-16T17:42:09.255 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:42:09.279 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:42:09.279 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:42:09.324 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:09.324 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/34 2024-04-16T17:42:09.324 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/34 2024-04-16T17:42:09.324 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/34 2024-04-16T17:42:09.324 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/34 2024-04-16T17:42:09.324 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/34 2024-04-16T17:42:09.324 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 6/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 8/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 9/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 10/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 11/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 13/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-16T17:42:09.325 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-16T17:42:09.326 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-16T17:42:09.326 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-16T17:42:09.326 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-16T17:42:09.326 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-16T17:42:09.326 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-16T17:42:09.326 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-16T17:42:09.326 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-16T17:42:09.327 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-16T17:42:09.327 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-16T17:42:09.327 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-16T17:42:09.327 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:09.327 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-16T17:42:09.327 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/34 2024-04-16T17:42:09.460 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 6/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 8/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 9/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 10/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 11/34 2024-04-16T17:42:09.461 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 13/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-16T17:42:09.462 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-16T17:42:09.463 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-16T17:42:09.463 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-16T17:42:09.463 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-16T17:42:09.463 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-16T17:42:09.463 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-16T17:42:09.463 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:09.463 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-16T17:42:09.464 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/34 2024-04-16T17:42:09.683 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:42:09.683 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_6 6/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 7/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9. 8/34 2024-04-16T17:42:09.720 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x8 9/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 10/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 11/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 12/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 13/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-16T17:42:09.721 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 31/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-16T17:42:09.722 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/34 2024-04-16T17:42:10.289 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:42:10.380 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-16T17:42:10.396 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:10.396 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout:Upgraded: 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T17:42:10.397 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T17:42:10.398 INFO:teuthology.orchestra.run.smithi139.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T17:42:10.399 INFO:teuthology.orchestra.run.smithi139.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T17:42:10.400 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:10.400 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:10.413 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-16T17:42:10.444 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:10.487 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:10.487 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout:Upgraded: 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.488 INFO:teuthology.orchestra.run.smithi163.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.489 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:10.490 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:10.492 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-16T17:42:10.523 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:10.753 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-test 2024-04-16T17:42:10.779 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout:Upgraded: 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-radosgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-selinux-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.780 INFO:teuthology.orchestra.run.smithi016.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: librgw2-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-common-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.781 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: re2-1:20211101-3.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:10.782 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:10.786 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-test 2024-04-16T17:42:11.119 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-test 2024-04-16T17:42:11.340 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:30 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:11.375 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:31 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:42:11.495 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:11.496 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:11.496 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:42:11.496 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 49 M 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 164 k 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout:Install 6 Packages 2024-04-16T17:42:11.497 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:11.498 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 50 M 2024-04-16T17:42:11.498 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 212 M 2024-04-16T17:42:11.498 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:42:11.527 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:42:11.528 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:11.528 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 49 M 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 164 k 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout:Install 6 Packages 2024-04-16T17:42:11.529 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:11.530 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 50 M 2024-04-16T17:42:11.530 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 212 M 2024-04-16T17:42:11.530 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:42:11.725 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:32 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:11.732 INFO:teuthology.orchestra.run.smithi163.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2024-04-16T17:42:11.774 INFO:teuthology.orchestra.run.smithi163.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2024-04-16T17:42:11.801 INFO:teuthology.orchestra.run.smithi139.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2024-04-16T17:42:11.810 INFO:teuthology.orchestra.run.smithi163.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-16T17:42:11.843 INFO:teuthology.orchestra.run.smithi139.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.0 MB/s | 300 kB 00:00 2024-04-16T17:42:11.877 INFO:teuthology.orchestra.run.smithi139.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.8 MB/s | 63 kB 00:00 2024-04-16T17:42:11.894 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 49 M 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 164 k 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-04-16T17:42:11.895 INFO:teuthology.orchestra.run.smithi016.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-04-16T17:42:11.896 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-04-16T17:42:11.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:11.896 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:42:11.896 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:11.896 INFO:teuthology.orchestra.run.smithi016.stdout:Install 6 Packages 2024-04-16T17:42:11.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:11.896 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 50 M 2024-04-16T17:42:11.897 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 212 M 2024-04-16T17:42:11.897 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:42:11.941 INFO:teuthology.orchestra.run.smithi163.stdout:(4/6): libcephsqlite-19.0.0-3089.gb0c7b917.el9. 436 kB/s | 164 kB 00:00 2024-04-16T17:42:11.975 INFO:teuthology.orchestra.run.smithi163.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-04-16T17:42:12.010 INFO:teuthology.orchestra.run.smithi139.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-04-16T17:42:12.061 INFO:teuthology.orchestra.run.smithi139.stdout:(5/6): libcephsqlite-19.0.0-3089.gb0c7b917.el9. 395 kB/s | 164 kB 00:00 2024-04-16T17:42:12.370 INFO:teuthology.orchestra.run.smithi016.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.5 MB/s | 217 kB 00:00 2024-04-16T17:42:12.412 INFO:teuthology.orchestra.run.smithi016.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2024-04-16T17:42:12.437 INFO:teuthology.orchestra.run.smithi016.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2024-04-16T17:42:12.570 INFO:teuthology.orchestra.run.smithi016.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2024-04-16T17:42:12.962 INFO:teuthology.orchestra.run.smithi016.stdout:(5/6): libcephsqlite-19.0.0-3089.gb0c7b917.el9. 224 kB/s | 164 kB 00:00 2024-04-16T17:42:14.311 INFO:teuthology.orchestra.run.smithi163.stdout:(6/6): ceph-test-19.0.0-3089.gb0c7b917.el9.x86_ 18 MB/s | 49 MB 00:02 2024-04-16T17:42:14.314 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:14.314 INFO:teuthology.orchestra.run.smithi163.stdout:Total 18 MB/s | 50 MB 00:02 2024-04-16T17:42:14.329 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:42:14.350 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:42:14.351 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:42:14.738 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:42:14.738 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:42:15.319 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:42:15.393 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-16T17:42:15.412 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:15.426 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-16T17:42:15.457 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:15.500 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:15.509 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-16T17:42:15.537 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:16.429 INFO:teuthology.orchestra.run.smithi016.stdout:(6/6): ceph-test-19.0.0-3089.gb0c7b917.el9.x86_ 12 MB/s | 49 MB 00:04 2024-04-16T17:42:16.432 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:16.433 INFO:teuthology.orchestra.run.smithi016.stdout:Total 11 MB/s | 50 MB 00:04 2024-04-16T17:42:16.447 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:42:16.470 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:42:16.470 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:42:16.878 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:42:16.878 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:42:17.481 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:42:17.572 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-16T17:42:17.605 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-16T17:42:17.637 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:17.684 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-16T17:42:17.707 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:18.054 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:18.054 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/6 2024-04-16T17:42:18.054 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/6 2024-04-16T17:42:18.054 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:18.054 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-16T17:42:18.054 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-16T17:42:18.457 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: jq-1.6-16.el9.x86_64 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:18.458 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:18.804 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph 2024-04-16T17:42:19.412 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:00:44 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:19.576 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:19.578 INFO:teuthology.orchestra.run.smithi023.stdout:========================================================================================= 2024-04-16T17:42:19.578 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:42:19.578 INFO:teuthology.orchestra.run.smithi023.stdout:========================================================================================= 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: ceph x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 6.6 k 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mds x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 2.4 M 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 1.5 M 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 249 k 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mon x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 4.7 M 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-osd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 17 M 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T17:42:19.579 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T17:42:19.580 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:42:19.581 INFO:teuthology.orchestra.run.smithi023.stdout:========================================================================================= 2024-04-16T17:42:19.582 INFO:teuthology.orchestra.run.smithi023.stdout:Install 36 Packages 2024-04-16T17:42:19.582 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:19.582 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 30 M 2024-04-16T17:42:19.582 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 107 M 2024-04-16T17:42:19.582 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:42:20.177 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:20.260 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:20.281 INFO:teuthology.orchestra.run.smithi023.stdout:(1/36): ceph-19.0.0-3089.gb0c7b917.el9.x86_64.r 35 kB/s | 6.6 kB 00:00 2024-04-16T17:42:20.481 INFO:teuthology.orchestra.run.smithi023.stdout:(2/36): ceph-mgr-19.0.0-3089.gb0c7b917.el9.x86_ 3.9 MB/s | 1.5 MB 00:00 2024-04-16T17:42:21.257 INFO:teuthology.orchestra.run.smithi023.stdout:(3/36): ceph-mon-19.0.0-3089.gb0c7b917.el9.x86_ 4.8 MB/s | 4.7 MB 00:00 2024-04-16T17:42:21.357 INFO:teuthology.orchestra.run.smithi023.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3089.gb0c7 2.4 MB/s | 249 kB 00:00 2024-04-16T17:42:21.474 INFO:teuthology.orchestra.run.smithi023.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-04-16T17:42:21.532 INFO:teuthology.orchestra.run.smithi023.stdout:(6/36): ceph-mds-19.0.0-3089.gb0c7b917.el9.x86_ 1.6 MB/s | 2.4 MB 00:01 2024-04-16T17:42:21.558 INFO:teuthology.orchestra.run.smithi023.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2024-04-16T17:42:21.583 INFO:teuthology.orchestra.run.smithi023.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 634 kB/s | 32 kB 00:00 2024-04-16T17:42:21.608 INFO:teuthology.orchestra.run.smithi023.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 949 kB/s | 47 kB 00:00 2024-04-16T17:42:21.633 INFO:teuthology.orchestra.run.smithi023.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 771 kB/s | 39 kB 00:00 2024-04-16T17:42:21.667 INFO:teuthology.orchestra.run.smithi023.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-04-16T17:42:21.734 INFO:teuthology.orchestra.run.smithi023.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 11 MB/s | 1.1 MB 00:00 2024-04-16T17:42:21.759 INFO:teuthology.orchestra.run.smithi023.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-04-16T17:42:21.784 INFO:teuthology.orchestra.run.smithi023.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-04-16T17:42:21.814 INFO:teuthology.orchestra.run.smithi023.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-04-16T17:42:21.927 INFO:teuthology.orchestra.run.smithi023.stdout:(16/36): python3-requests-2.25.1-8.el9.noarch.r 880 kB/s | 125 kB 00:00 2024-04-16T17:42:22.186 INFO:teuthology.orchestra.run.smithi023.stdout:(17/36): ceph-osd-19.0.0-3089.gb0c7b917.el9.x86 9.9 MB/s | 17 MB 00:01 2024-04-16T17:42:22.319 INFO:teuthology.orchestra.run.smithi023.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 386 kB/s | 151 kB 00:00 2024-04-16T17:42:22.361 INFO:teuthology.orchestra.run.smithi023.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 294 kB/s | 43 kB 00:00 2024-04-16T17:42:22.511 INFO:teuthology.orchestra.run.smithi023.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2024-04-16T17:42:22.553 INFO:teuthology.orchestra.run.smithi023.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 735 kB/s | 172 kB 00:00 2024-04-16T17:42:22.579 INFO:teuthology.orchestra.run.smithi023.stdout:(22/36): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-04-16T17:42:22.603 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:22.604 INFO:teuthology.orchestra.run.smithi023.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-04-16T17:42:22.629 INFO:teuthology.orchestra.run.smithi023.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 237 kB/s | 18 kB 00:00 2024-04-16T17:42:22.654 INFO:teuthology.orchestra.run.smithi023.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-04-16T17:42:22.684 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:22.696 INFO:teuthology.orchestra.run.smithi023.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 294 kB/s | 20 kB 00:00 2024-04-16T17:42:22.722 INFO:teuthology.orchestra.run.smithi023.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 693 kB/s | 46 kB 00:00 2024-04-16T17:42:22.747 INFO:teuthology.orchestra.run.smithi023.stdout:(28/36): python3-jaraco-functools-3.5.0-2.el9.n 136 kB/s | 19 kB 00:00 2024-04-16T17:42:22.792 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:22.793 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/6 2024-04-16T17:42:22.793 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/6 2024-04-16T17:42:22.793 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:22.793 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-16T17:42:22.793 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-16T17:42:22.805 INFO:teuthology.orchestra.run.smithi023.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-16T17:42:22.831 INFO:teuthology.orchestra.run.smithi023.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-04-16T17:42:22.864 INFO:teuthology.orchestra.run.smithi023.stdout:(31/36): python3-more-itertools-8.12.0-2.el9.no 470 kB/s | 79 kB 00:00 2024-04-16T17:42:22.890 INFO:teuthology.orchestra.run.smithi023.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.0 MB/s | 90 kB 00:00 2024-04-16T17:42:22.923 INFO:teuthology.orchestra.run.smithi023.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 388 kB/s | 36 kB 00:00 2024-04-16T17:42:22.965 INFO:teuthology.orchestra.run.smithi023.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-04-16T17:42:22.999 INFO:teuthology.orchestra.run.smithi023.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 266 kB/s | 20 kB 00:00 2024-04-16T17:42:23.032 INFO:teuthology.orchestra.run.smithi023.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-04-16T17:42:23.036 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:23.036 INFO:teuthology.orchestra.run.smithi023.stdout:Total 8.7 MB/s | 30 MB 00:03 2024-04-16T17:42:23.062 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:42:23.108 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:42:23.108 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:42:23.173 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: jq-1.6-16.el9.x86_64 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:23.174 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:23.477 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph 2024-04-16T17:42:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:42:23.547 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:42:23.576 INFO:teuthology.orchestra.run.smithi139.stdout:(6/6): ceph-test-19.0.0-3089.gb0c7b917.el9.x86_ 4.1 MB/s | 49 MB 00:11 2024-04-16T17:42:23.578 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:23.579 INFO:teuthology.orchestra.run.smithi139.stdout:Total 4.1 MB/s | 50 MB 00:12 2024-04-16T17:42:23.592 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:42:23.611 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:42:23.611 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:42:24.004 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:42:24.004 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:42:24.097 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:43 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:24.269 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:24.271 INFO:teuthology.orchestra.run.smithi163.stdout:========================================================================================= 2024-04-16T17:42:24.271 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:42:24.271 INFO:teuthology.orchestra.run.smithi163.stdout:========================================================================================= 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 6.6 k 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 2.4 M 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 1.5 M 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 249 k 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 4.7 M 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 17 M 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T17:42:24.272 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T17:42:24.273 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T17:42:24.274 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:24.275 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:42:24.275 INFO:teuthology.orchestra.run.smithi163.stdout:========================================================================================= 2024-04-16T17:42:24.275 INFO:teuthology.orchestra.run.smithi163.stdout:Install 36 Packages 2024-04-16T17:42:24.275 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:24.275 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 30 M 2024-04-16T17:42:24.275 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 107 M 2024-04-16T17:42:24.276 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:42:24.595 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:42:24.660 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-04-16T17:42:24.704 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-04-16T17:42:24.713 INFO:teuthology.orchestra.run.smithi163.stdout:(1/36): ceph-19.0.0-3089.gb0c7b917.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-04-16T17:42:24.736 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:24.789 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-04-16T17:42:24.815 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:24.893 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:42:24.969 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-16T17:42:25.009 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-16T17:42:25.038 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-16T17:42:25.102 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:25.102 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/6 2024-04-16T17:42:25.102 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/6 2024-04-16T17:42:25.102 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:25.102 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-16T17:42:25.102 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-16T17:42:25.111 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-16T17:42:25.171 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-16T17:42:25.203 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-16T17:42:25.238 INFO:teuthology.orchestra.run.smithi163.stdout:(2/36): ceph-mon-19.0.0-3089.gb0c7b917.el9.x86_ 8.9 MB/s | 4.7 MB 00:00 2024-04-16T17:42:25.299 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-16T17:42:25.384 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-16T17:42:25.431 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-16T17:42:25.472 INFO:teuthology.orchestra.run.smithi163.stdout:(3/36): ceph-mgr-19.0.0-3089.gb0c7b917.el9.x86_ 1.7 MB/s | 1.5 MB 00:00 2024-04-16T17:42:25.486 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-16T17:42:25.486 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:25.486 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:42:25.489 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:25.489 INFO:teuthology.orchestra.run.smithi016.stdout: jq-1.6-16.el9.x86_64 2024-04-16T17:42:25.489 INFO:teuthology.orchestra.run.smithi016.stdout: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:25.489 INFO:teuthology.orchestra.run.smithi016.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T17:42:25.489 INFO:teuthology.orchestra.run.smithi016.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T17:42:25.490 INFO:teuthology.orchestra.run.smithi016.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T17:42:25.490 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:25.490 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:25.506 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-16T17:42:25.558 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-16T17:42:25.580 INFO:teuthology.orchestra.run.smithi163.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3089.gb0c7 2.2 MB/s | 249 kB 00:00 2024-04-16T17:42:25.603 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-16T17:42:25.670 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-16T17:42:25.706 INFO:teuthology.orchestra.run.smithi163.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2024-04-16T17:42:25.748 INFO:teuthology.orchestra.run.smithi163.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-04-16T17:42:25.750 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-16T17:42:25.782 INFO:teuthology.orchestra.run.smithi163.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 944 kB/s | 32 kB 00:00 2024-04-16T17:42:25.815 INFO:teuthology.orchestra.run.smithi163.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-04-16T17:42:25.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph 2024-04-16T17:42:25.849 INFO:teuthology.orchestra.run.smithi163.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-04-16T17:42:25.891 INFO:teuthology.orchestra.run.smithi163.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-04-16T17:42:25.953 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-16T17:42:25.966 INFO:teuthology.orchestra.run.smithi163.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 15 MB/s | 1.1 MB 00:00 2024-04-16T17:42:26.008 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-16T17:42:26.046 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-16T17:42:26.089 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-16T17:42:26.127 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-16T17:42:26.133 INFO:teuthology.orchestra.run.smithi163.stdout:(12/36): ceph-osd-19.0.0-3089.gb0c7b917.el9.x86 19 MB/s | 17 MB 00:00 2024-04-16T17:42:26.158 INFO:teuthology.orchestra.run.smithi163.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 535 kB/s | 103 kB 00:00 2024-04-16T17:42:26.192 INFO:teuthology.orchestra.run.smithi163.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.1 MB/s | 124 kB 00:00 2024-04-16T17:42:26.206 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-16T17:42:26.217 INFO:teuthology.orchestra.run.smithi163.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 187 kB 00:00 2024-04-16T17:42:26.237 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:26.270 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-16T17:42:26.284 INFO:teuthology.orchestra.run.smithi163.stdout:(16/36): ceph-mds-19.0.0-3089.gb0c7b917.el9.x86 1.4 MB/s | 2.4 MB 00:01 2024-04-16T17:42:26.310 INFO:teuthology.orchestra.run.smithi163.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-04-16T17:42:26.311 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-16T17:42:26.355 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-16T17:42:26.389 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-16T17:42:26.427 INFO:teuthology.orchestra.run.smithi163.stdout:(18/36): python3-requests-2.25.1-8.el9.noarch.r 534 kB/s | 125 kB 00:00 2024-04-16T17:42:26.440 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:00:47 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:26.482 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-16T17:42:26.519 INFO:teuthology.orchestra.run.smithi163.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 208 kB/s | 43 kB 00:00 2024-04-16T17:42:26.529 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-16T17:42:26.586 INFO:teuthology.orchestra.run.smithi163.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 502 kB/s | 151 kB 00:00 2024-04-16T17:42:26.605 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:26.608 INFO:teuthology.orchestra.run.smithi016.stdout:========================================================================================= 2024-04-16T17:42:26.608 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:42:26.608 INFO:teuthology.orchestra.run.smithi016.stdout:========================================================================================= 2024-04-16T17:42:26.608 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: ceph x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 6.6 k 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 2.4 M 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 1.5 M 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 249 k 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 4.7 M 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 17 M 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T17:42:26.609 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T17:42:26.610 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T17:42:26.611 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout:========================================================================================= 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout:Install 36 Packages 2024-04-16T17:42:26.612 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:26.613 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-16T17:42:26.614 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 30 M 2024-04-16T17:42:26.614 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 107 M 2024-04-16T17:42:26.614 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:42:26.661 INFO:teuthology.orchestra.run.smithi163.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 142 kB/s | 11 kB 00:00 2024-04-16T17:42:26.729 INFO:teuthology.orchestra.run.smithi163.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 570 kB/s | 172 kB 00:00 2024-04-16T17:42:26.753 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-16T17:42:26.753 INFO:teuthology.orchestra.run.smithi163.stdout:(23/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.5 MB/s | 358 kB 00:00 2024-04-16T17:42:26.779 INFO:teuthology.orchestra.run.smithi163.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 150 kB/s | 18 kB 00:00 2024-04-16T17:42:26.804 INFO:teuthology.orchestra.run.smithi163.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 307 kB/s | 23 kB 00:00 2024-04-16T17:42:26.838 INFO:teuthology.orchestra.run.smithi163.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 231 kB/s | 19 kB 00:00 2024-04-16T17:42:26.863 INFO:teuthology.orchestra.run.smithi163.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 234 kB/s | 20 kB 00:00 2024-04-16T17:42:26.884 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:26.888 INFO:teuthology.orchestra.run.smithi163.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-04-16T17:42:26.914 INFO:teuthology.orchestra.run.smithi163.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-16T17:42:26.964 INFO:teuthology.orchestra.run.smithi163.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 218 kB/s | 16 kB 00:00 2024-04-16T17:42:26.989 INFO:teuthology.orchestra.run.smithi163.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-04-16T17:42:27.015 INFO:teuthology.orchestra.run.smithi163.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 894 kB/s | 90 kB 00:00 2024-04-16T17:42:27.040 INFO:teuthology.orchestra.run.smithi163.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 472 kB/s | 36 kB 00:00 2024-04-16T17:42:27.070 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 31/36 2024-04-16T17:42:27.082 INFO:teuthology.orchestra.run.smithi163.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-16T17:42:27.107 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:27.123 INFO:teuthology.orchestra.run.smithi163.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 239 kB/s | 20 kB 00:00 2024-04-16T17:42:27.133 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:27.134 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:27.134 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T17:42:27.134 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:27.134 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:27.134 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:27.251 INFO:teuthology.orchestra.run.smithi016.stdout:(1/36): ceph-19.0.0-3089.gb0c7b917.el9.x86_64.r 32 kB/s | 6.6 kB 00:00 2024-04-16T17:42:27.257 INFO:teuthology.orchestra.run.smithi163.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.7 MB/s | 427 kB 00:00 2024-04-16T17:42:27.260 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:27.260 INFO:teuthology.orchestra.run.smithi163.stdout:Total 10 MB/s | 30 MB 00:02 2024-04-16T17:42:27.286 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:42:27.329 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:42:27.329 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:42:27.685 INFO:teuthology.orchestra.run.smithi016.stdout:(2/36): ceph-mgr-19.0.0-3089.gb0c7b917.el9.x86_ 2.3 MB/s | 1.5 MB 00:00 2024-04-16T17:42:27.735 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:42:27.735 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:42:27.802 INFO:teuthology.orchestra.run.smithi016.stdout:(3/36): ceph-mds-19.0.0-3089.gb0c7b917.el9.x86_ 3.1 MB/s | 2.4 MB 00:00 2024-04-16T17:42:27.868 INFO:teuthology.orchestra.run.smithi016.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3089.gb0c7 3.6 MB/s | 249 kB 00:00 2024-04-16T17:42:27.986 INFO:teuthology.orchestra.run.smithi016.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-04-16T17:42:28.027 INFO:teuthology.orchestra.run.smithi016.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-04-16T17:42:28.053 INFO:teuthology.orchestra.run.smithi016.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2024-04-16T17:42:28.128 INFO:teuthology.orchestra.run.smithi016.stdout:(8/36): ceph-mon-19.0.0-3089.gb0c7b917.el9.x86_ 5.4 MB/s | 4.7 MB 00:00 2024-04-16T17:42:28.146 INFO:teuthology.orchestra.run.smithi016.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 514 kB/s | 47 kB 00:00 2024-04-16T17:42:28.162 INFO:teuthology.orchestra.run.smithi016.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-04-16T17:42:28.187 INFO:teuthology.orchestra.run.smithi016.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-04-16T17:42:28.238 INFO:teuthology.orchestra.run.smithi016.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 15 MB/s | 1.1 MB 00:00 2024-04-16T17:42:28.263 INFO:teuthology.orchestra.run.smithi016.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2024-04-16T17:42:28.288 INFO:teuthology.orchestra.run.smithi016.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-04-16T17:42:28.313 INFO:teuthology.orchestra.run.smithi016.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-04-16T17:42:28.397 INFO:teuthology.orchestra.run.smithi016.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-04-16T17:42:28.464 INFO:teuthology.orchestra.run.smithi016.stdout:(17/36): python3-requests-2.25.1-8.el9.noarch.r 712 kB/s | 125 kB 00:00 2024-04-16T17:42:28.639 INFO:teuthology.orchestra.run.smithi016.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 248 kB/s | 43 kB 00:00 2024-04-16T17:42:28.658 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:28.665 INFO:teuthology.orchestra.run.smithi016.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 565 kB/s | 151 kB 00:00 2024-04-16T17:42:28.686 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:28.686 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:28.686 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T17:42:28.686 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:28.686 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:28.686 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:28.782 INFO:teuthology.orchestra.run.smithi016.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 3.0 MB/s | 358 kB 00:00 2024-04-16T17:42:28.807 INFO:teuthology.orchestra.run.smithi016.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-04-16T17:42:28.849 INFO:teuthology.orchestra.run.smithi016.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 159 kB/s | 11 kB 00:00 2024-04-16T17:42:28.875 INFO:teuthology.orchestra.run.smithi016.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 263 kB/s | 18 kB 00:00 2024-04-16T17:42:28.908 INFO:teuthology.orchestra.run.smithi016.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 395 kB/s | 23 kB 00:00 2024-04-16T17:42:28.933 INFO:teuthology.orchestra.run.smithi016.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 331 kB/s | 19 kB 00:00 2024-04-16T17:42:28.967 INFO:teuthology.orchestra.run.smithi016.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 336 kB/s | 20 kB 00:00 2024-04-16T17:42:29.001 INFO:teuthology.orchestra.run.smithi016.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 690 kB/s | 46 kB 00:00 2024-04-16T17:42:29.034 INFO:teuthology.orchestra.run.smithi016.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.1 MB/s | 79 kB 00:00 2024-04-16T17:42:29.061 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:42:29.101 INFO:teuthology.orchestra.run.smithi016.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-16T17:42:29.126 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-16T17:42:29.127 INFO:teuthology.orchestra.run.smithi016.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 179 kB/s | 16 kB 00:00 2024-04-16T17:42:29.151 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:29.167 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-16T17:42:29.175 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:29.175 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:29.175 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T17:42:29.175 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:29.175 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:29.175 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:29.195 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-16T17:42:29.266 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-16T17:42:29.294 INFO:teuthology.orchestra.run.smithi016.stdout:(31/36): ceph-osd-19.0.0-3089.gb0c7b917.el9.x86 10 MB/s | 17 MB 00:01 2024-04-16T17:42:29.311 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-16T17:42:29.319 INFO:teuthology.orchestra.run.smithi016.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 186 kB/s | 36 kB 00:00 2024-04-16T17:42:29.344 INFO:teuthology.orchestra.run.smithi016.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 371 kB/s | 90 kB 00:00 2024-04-16T17:42:29.345 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-16T17:42:29.410 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:29.411 INFO:teuthology.orchestra.run.smithi016.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 299 kB/s | 20 kB 00:00 2024-04-16T17:42:29.422 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/6 2024-04-16T17:42:29.433 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:29.434 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:29.434 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T17:42:29.434 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:29.434 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:29.434 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:29.435 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-16T17:42:29.436 INFO:teuthology.orchestra.run.smithi016.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-04-16T17:42:29.496 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:29.522 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-16T17:42:29.561 INFO:teuthology.orchestra.run.smithi016.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 859 kB/s | 230 kB 00:00 2024-04-16T17:42:29.563 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-16T17:42:29.564 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:29.564 INFO:teuthology.orchestra.run.smithi016.stdout:Total 10 MB/s | 30 MB 00:02 2024-04-16T17:42:29.590 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:42:29.626 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:29.635 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-16T17:42:29.635 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:42:29.635 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:42:29.689 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-16T17:42:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-16T17:42:29.776 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-16T17:42:29.832 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-16T17:42:30.033 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-16T17:42:30.068 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:42:30.068 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:42:30.082 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-16T17:42:30.113 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-16T17:42:30.148 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-16T17:42:30.178 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-16T17:42:30.254 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-16T17:42:30.288 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:30.321 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-16T17:42:30.362 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-16T17:42:30.397 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-16T17:42:30.440 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-16T17:42:30.529 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-16T17:42:30.562 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-16T17:42:30.634 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-16T17:42:30.780 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-16T17:42:30.922 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:31.100 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 31/36 2024-04-16T17:42:31.135 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:31.161 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:31.162 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:31.162 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T17:42:31.162 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:31.162 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:31.162 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:31.404 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/36 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/36 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/36 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/36 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/36 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 6/36 2024-04-16T17:42:31.428 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-16T17:42:31.429 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:31.430 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-16T17:42:31.430 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-16T17:42:31.430 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-16T17:42:31.430 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-16T17:42:31.430 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-16T17:42:31.430 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-16T17:42:31.431 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-16T17:42:31.431 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-16T17:42:31.431 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:31.431 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-16T17:42:31.431 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-16T17:42:31.431 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-16T17:42:31.431 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-16T17:42:31.432 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-16T17:42:31.464 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-16T17:42:31.497 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-16T17:42:31.525 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-16T17:42:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-16T17:42:31.633 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-16T17:42:31.665 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-16T17:42:31.768 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-16T17:42:31.854 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-16T17:42:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 6/6 2024-04-16T17:42:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/6 2024-04-16T17:42:31.873 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/6 2024-04-16T17:42:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-04-16T17:42:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-04-16T17:42:31.874 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-04-16T17:42:31.902 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-16T17:42:31.975 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-16T17:42:32.031 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-16T17:42:32.066 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-16T17:42:32.116 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-16T17:42:32.171 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-16T17:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-04-16T17:42:32.223 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-test-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: jq-1.6-16.el9.x86_64 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: libcephsqlite-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:32.224 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:32.368 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-16T17:42:32.391 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-16T17:42:32.391 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T17:42:32.392 INFO:teuthology.orchestra.run.smithi023.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T17:42:32.393 INFO:teuthology.orchestra.run.smithi023.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T17:42:32.394 INFO:teuthology.orchestra.run.smithi023.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T17:42:32.394 INFO:teuthology.orchestra.run.smithi023.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T17:42:32.394 INFO:teuthology.orchestra.run.smithi023.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T17:42:32.394 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T17:42:32.394 INFO:teuthology.orchestra.run.smithi023.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T17:42:32.394 INFO:teuthology.orchestra.run.smithi023.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T17:42:32.394 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T17:42:32.395 INFO:teuthology.orchestra.run.smithi023.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T17:42:32.396 INFO:teuthology.orchestra.run.smithi023.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T17:42:32.396 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:32.396 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:32.412 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-16T17:42:32.451 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-16T17:42:32.485 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-16T17:42:32.515 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-16T17:42:32.517 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph 2024-04-16T17:42:32.586 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:32.593 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-16T17:42:32.615 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:32.615 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:32.615 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T17:42:32.615 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:32.615 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:32.615 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:32.634 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:32.667 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-16T17:42:32.708 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-16T17:42:32.743 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-16T17:42:32.745 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-base 2024-04-16T17:42:32.777 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-16T17:42:32.870 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-16T17:42:32.908 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-16T17:42:32.983 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-16T17:42:33.062 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:33.087 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:33.087 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T17:42:33.087 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:33.087 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:33.087 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:33.117 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:00:53 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:42:33.123 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-16T17:42:33.255 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:33.279 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout:========================================================================================= 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout:========================================================================================= 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout: ceph x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 6.6 k 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 2.4 M 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 1.5 M 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 249 k 2024-04-16T17:42:33.282 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 4.7 M 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 17 M 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-16T17:42:33.283 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-04-16T17:42:33.284 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout:========================================================================================= 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout:Install 36 Packages 2024-04-16T17:42:33.285 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:33.286 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 30 M 2024-04-16T17:42:33.286 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 107 M 2024-04-16T17:42:33.286 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:42:33.312 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:33.337 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:33.337 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:33.337 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T17:42:33.337 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:33.337 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:33.337 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:33.349 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:00:58 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:33.402 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:33.429 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 31/36 2024-04-16T17:42:33.454 INFO:teuthology.orchestra.run.smithi023.stdout:Package ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:33.455 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:33.481 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:33.481 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:33.481 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T17:42:33.481 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:33.481 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:33.481 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:33.509 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:33.511 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:42:33.511 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:33.571 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install cephadm 2024-04-16T17:42:34.088 INFO:teuthology.orchestra.run.smithi139.stdout:(1/36): ceph-19.0.0-3089.gb0c7b917.el9.x86_64.r 32 kB/s | 6.6 kB 00:00 2024-04-16T17:42:34.174 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:00:59 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:34.334 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:34.335 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:34.335 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:42:34.335 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:34.335 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:42:34.335 INFO:teuthology.orchestra.run.smithi023.stdout: cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 762 k 2024-04-16T17:42:34.335 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:34.335 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:42:34.336 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:34.336 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-04-16T17:42:34.336 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:34.336 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 762 k 2024-04-16T17:42:34.336 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 769 k 2024-04-16T17:42:34.336 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:42:34.438 INFO:teuthology.orchestra.run.smithi139.stdout:(2/36): ceph-mds-19.0.0-3089.gb0c7b917.el9.x86_ 4.3 MB/s | 2.4 MB 00:00 2024-04-16T17:42:34.472 INFO:teuthology.orchestra.run.smithi139.stdout:(3/36): ceph-mgr-19.0.0-3089.gb0c7b917.el9.x86_ 2.5 MB/s | 1.5 MB 00:00 2024-04-16T17:42:34.556 INFO:teuthology.orchestra.run.smithi139.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3089.gb0c7 2.9 MB/s | 249 kB 00:00 2024-04-16T17:42:34.673 INFO:teuthology.orchestra.run.smithi139.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-04-16T17:42:34.714 INFO:teuthology.orchestra.run.smithi139.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-04-16T17:42:34.740 INFO:teuthology.orchestra.run.smithi139.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2024-04-16T17:42:34.798 INFO:teuthology.orchestra.run.smithi139.stdout:(8/36): ceph-mon-19.0.0-3089.gb0c7b917.el9.x86_ 6.6 MB/s | 4.7 MB 00:00 2024-04-16T17:42:34.815 INFO:teuthology.orchestra.run.smithi139.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 628 kB/s | 47 kB 00:00 2024-04-16T17:42:34.832 INFO:teuthology.orchestra.run.smithi139.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-04-16T17:42:34.857 INFO:teuthology.orchestra.run.smithi139.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2024-04-16T17:42:34.929 INFO:teuthology.orchestra.run.smithi139.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 12 MB/s | 1.1 MB 00:00 2024-04-16T17:42:34.950 INFO:teuthology.orchestra.run.smithi139.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-04-16T17:42:34.975 INFO:teuthology.orchestra.run.smithi139.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.6 MB/s | 124 kB 00:00 2024-04-16T17:42:35.000 INFO:teuthology.orchestra.run.smithi139.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.7 MB/s | 187 kB 00:00 2024-04-16T17:42:35.006 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:35.033 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:35.033 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:35.033 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T17:42:35.033 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:35.033 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:35.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:35.050 INFO:teuthology.orchestra.run.smithi023.stdout:cephadm-19.0.0-3089.gb0c7b917.el9.noarch.rpm 1.0 MB/s | 762 kB 00:00 2024-04-16T17:42:35.050 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:35.051 INFO:teuthology.orchestra.run.smithi023.stdout:Total 1.0 MB/s | 762 kB 00:00 2024-04-16T17:42:35.051 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:42:35.057 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:42:35.057 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:42:35.063 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:42:35.063 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:42:35.076 INFO:teuthology.orchestra.run.smithi139.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-04-16T17:42:35.142 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:42:35.143 INFO:teuthology.orchestra.run.smithi139.stdout:(17/36): python3-requests-2.25.1-8.el9.noarch.r 749 kB/s | 125 kB 00:00 2024-04-16T17:42:35.212 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:35.212 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/36 2024-04-16T17:42:35.212 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/36 2024-04-16T17:42:35.212 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/36 2024-04-16T17:42:35.212 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/36 2024-04-16T17:42:35.212 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/36 2024-04-16T17:42:35.212 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 6/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-16T17:42:35.213 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-16T17:42:35.214 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-16T17:42:35.401 INFO:teuthology.orchestra.run.smithi139.stdout:(18/36): ceph-osd-19.0.0-3089.gb0c7b917.el9.x86 17 MB/s | 17 MB 00:00 2024-04-16T17:42:35.498 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:35.523 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:35.523 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:35.523 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T17:42:35.523 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:35.523 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:35.523 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:35.543 INFO:teuthology.orchestra.run.smithi139.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 323 kB/s | 151 kB 00:00 2024-04-16T17:42:35.560 INFO:teuthology.orchestra.run.smithi139.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 110 kB/s | 43 kB 00:00 2024-04-16T17:42:35.569 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:35.674 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:35.693 INFO:teuthology.orchestra.run.smithi139.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 592 kB/s | 172 kB 00:00 2024-04-16T17:42:35.757 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:35.781 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:35.781 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T17:42:35.781 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:35.781 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:35.781 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:35.850 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:35.919 INFO:teuthology.orchestra.run.smithi139.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 955 kB/s | 358 kB 00:00 2024-04-16T17:42:35.936 INFO:teuthology.orchestra.run.smithi139.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 28 kB/s | 11 kB 00:00 2024-04-16T17:42:35.952 INFO:teuthology.orchestra.run.smithi139.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 68 kB/s | 18 kB 00:00 2024-04-16T17:42:35.994 INFO:teuthology.orchestra.run.smithi139.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 308 kB/s | 23 kB 00:00 2024-04-16T17:42:36.020 INFO:teuthology.orchestra.run.smithi139.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 292 kB/s | 19 kB 00:00 2024-04-16T17:42:36.037 INFO:teuthology.orchestra.run.smithi139.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 235 kB/s | 20 kB 00:00 2024-04-16T17:42:36.079 INFO:teuthology.orchestra.run.smithi139.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-04-16T17:42:36.082 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-16T17:42:36.082 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T17:42:36.083 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T17:42:36.084 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:36.085 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:36.117 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:36.121 INFO:teuthology.orchestra.run.smithi139.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 784 kB/s | 79 kB 00:00 2024-04-16T17:42:36.229 INFO:teuthology.orchestra.run.smithi139.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-04-16T17:42:36.246 INFO:teuthology.orchestra.run.smithi139.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 98 kB/s | 16 kB 00:00 2024-04-16T17:42:36.271 INFO:teuthology.orchestra.run.smithi139.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 598 kB/s | 90 kB 00:00 2024-04-16T17:42:36.305 INFO:teuthology.orchestra.run.smithi139.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 476 kB/s | 36 kB 00:00 2024-04-16T17:42:36.328 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-base 2024-04-16T17:42:36.380 INFO:teuthology.orchestra.run.smithi139.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-04-16T17:42:36.485 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:36.485 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:36.485 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:42:36.485 INFO:teuthology.orchestra.run.smithi023.stdout: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:36.485 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:36.485 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:36.497 INFO:teuthology.orchestra.run.smithi139.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2024-04-16T17:42:36.522 INFO:teuthology.orchestra.run.smithi139.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 92 kB/s | 20 kB 00:00 2024-04-16T17:42:36.528 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:36.529 INFO:teuthology.orchestra.run.smithi139.stdout:Total 9.2 MB/s | 30 MB 00:03 2024-04-16T17:42:36.555 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:42:36.598 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:42:36.598 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:42:36.727 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-immutable-object-cache 2024-04-16T17:42:36.921 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:55 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:36.989 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:42:36.989 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:42:37.023 INFO:teuthology.orchestra.run.smithi163.stdout:Package ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:37.075 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:37.076 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:42:37.076 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:37.150 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install cephadm 2024-04-16T17:42:37.329 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:02 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:37.488 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:37.488 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repo Size 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 145 k 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 145 k 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 435 k 2024-04-16T17:42:37.489 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:42:37.543 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:37.543 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 6/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-16T17:42:37.544 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-16T17:42:37.545 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-16T17:42:37.547 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-16T17:42:37.723 INFO:teuthology.orchestra.run.smithi023.stdout:ceph-immutable-object-cache-19.0.0-3089.gb0c7b9 621 kB/s | 145 kB 00:00 2024-04-16T17:42:37.724 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:37.724 INFO:teuthology.orchestra.run.smithi023.stdout:Total 617 kB/s | 145 kB 00:00 2024-04-16T17:42:37.724 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:42:37.732 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:42:37.732 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:42:37.734 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:56 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:37.787 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:42:37.787 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:42:37.886 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 762 k 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout:Install 1 Package 2024-04-16T17:42:37.887 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:37.888 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 762 k 2024-04-16T17:42:37.888 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 769 k 2024-04-16T17:42:37.888 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:42:38.050 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:42:38.115 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:38.141 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:38.141 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:38.141 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T17:42:38.141 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:38.312 INFO:teuthology.orchestra.run.smithi163.stdout:cephadm-19.0.0-3089.gb0c7b917.el9.noarch.rpm 1.8 MB/s | 762 kB 00:00 2024-04-16T17:42:38.312 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:38.313 INFO:teuthology.orchestra.run.smithi163.stdout:Total 1.8 MB/s | 762 kB 00:00 2024-04-16T17:42:38.313 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:42:38.318 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:42:38.318 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:42:38.320 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:42:38.324 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:42:38.324 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:42:38.375 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-16T17:42:38.398 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:42:38.407 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-16T17:42:38.435 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-16T17:42:38.505 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-16T17:42:38.559 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-16T17:42:38.592 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-16T17:42:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-16T17:42:38.648 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T17:42:38.649 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T17:42:38.650 INFO:teuthology.orchestra.run.smithi016.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:38.651 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:38.683 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-16T17:42:38.761 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-16T17:42:38.803 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-16T17:42:38.805 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:38.874 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-16T17:42:38.900 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:38.928 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-04-16T17:42:38.983 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-04-16T17:42:39.021 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-base 2024-04-16T17:42:39.032 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-04-16T17:42:39.087 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-04-16T17:42:39.190 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:39.190 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:39.190 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:42:39.190 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:39.191 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:39.191 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:39.259 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:39.275 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-04-16T17:42:39.329 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-04-16T17:42:39.359 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-04-16T17:42:39.394 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-04-16T17:42:39.424 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-04-16T17:42:39.451 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr 2024-04-16T17:42:39.499 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-04-16T17:42:39.534 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:39.548 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:39.548 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:39.548 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:42:39.548 INFO:teuthology.orchestra.run.smithi163.stdout: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:39.548 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:39.548 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:39.568 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-04-16T17:42:39.608 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-04-16T17:42:39.624 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:00 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:39.643 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-04-16T17:42:39.678 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-04-16T17:42:39.731 INFO:teuthology.orchestra.run.smithi016.stdout:Package ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:39.758 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-immutable-object-cache 2024-04-16T17:42:39.765 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-04-16T17:42:39.786 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:42:39.787 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:39.808 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-04-16T17:42:39.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install cephadm 2024-04-16T17:42:39.880 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-04-16T17:42:40.017 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-04-16T17:42:40.060 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:05 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:40.142 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:40.165 INFO:teuthology.orchestra.run.smithi023.stdout:Package ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:40.221 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:40.222 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:42:40.222 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:40.309 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-dashboard 2024-04-16T17:42:40.327 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 31/36 2024-04-16T17:42:40.355 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:40.361 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:00:59 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:40.381 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 32/36 2024-04-16T17:42:40.381 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:40.381 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-16T17:42:40.381 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:40.381 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-16T17:42:40.381 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:40.448 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:01 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:40.518 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repo Size 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 145 k 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:42:40.519 INFO:teuthology.orchestra.run.smithi163.stdout:Install 1 Package 2024-04-16T17:42:40.520 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:40.520 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 145 k 2024-04-16T17:42:40.520 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 435 k 2024-04-16T17:42:40.520 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:40.610 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 762 k 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 762 k 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 769 k 2024-04-16T17:42:40.611 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:42:40.913 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:05 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:40.986 INFO:teuthology.orchestra.run.smithi163.stdout:ceph-immutable-object-cache-19.0.0-3089.gb0c7b9 311 kB/s | 145 kB 00:00 2024-04-16T17:42:40.986 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:40.987 INFO:teuthology.orchestra.run.smithi163.stdout:Total 310 kB/s | 145 kB 00:00 2024-04-16T17:42:40.987 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:42:40.995 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:42:40.995 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:42:41.048 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:42:41.049 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:42:41.062 INFO:teuthology.orchestra.run.smithi016.stdout:cephadm-19.0.0-3089.gb0c7b917.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-16T17:42:41.062 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:41.062 INFO:teuthology.orchestra.run.smithi016.stdout:Total 1.6 MB/s | 762 kB 00:00 2024-04-16T17:42:41.063 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:42:41.068 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:42:41.068 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:42:41.074 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:41.075 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:42:41.075 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:42:41.075 INFO:teuthology.orchestra.run.smithi023.stdout:====================================================================================== 2024-04-16T17:42:41.075 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout:====================================================================================== 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 3.5 M 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 34 k 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 16 k 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T17:42:41.076 INFO:teuthology.orchestra.run.smithi023.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T17:42:41.077 INFO:teuthology.orchestra.run.smithi023.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T17:42:41.077 INFO:teuthology.orchestra.run.smithi023.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T17:42:41.077 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:41.077 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:42:41.077 INFO:teuthology.orchestra.run.smithi023.stdout:====================================================================================== 2024-04-16T17:42:41.077 INFO:teuthology.orchestra.run.smithi023.stdout:Install 12 Packages 2024-04-16T17:42:41.077 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:41.078 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 8.6 M 2024-04-16T17:42:41.078 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 104 M 2024-04-16T17:42:41.078 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:42:41.154 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:42:41.188 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:42:41.254 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:41.279 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:41.279 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:41.279 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T17:42:41.279 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:41.623 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:41.659 INFO:teuthology.orchestra.run.smithi023.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3089.gb0 176 kB/s | 34 kB 00:00 2024-04-16T17:42:41.711 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:41.743 INFO:teuthology.orchestra.run.smithi023.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3089.gb0c 59 kB/s | 16 kB 00:00 2024-04-16T17:42:41.801 INFO:teuthology.orchestra.run.smithi023.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-04-16T17:42:41.827 INFO:teuthology.orchestra.run.smithi023.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.8 MB/s | 238 kB 00:00 2024-04-16T17:42:41.830 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:41.858 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 33/36 2024-04-16T17:42:41.859 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:41.859 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-16T17:42:41.859 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:41.859 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-16T17:42:41.859 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:42.010 INFO:teuthology.orchestra.run.smithi023.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.9 MB/s | 548 kB 00:00 2024-04-16T17:42:42.060 INFO:teuthology.orchestra.run.smithi023.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-04-16T17:42:42.086 INFO:teuthology.orchestra.run.smithi023.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.0 MB/s | 863 kB 00:00 2024-04-16T17:42:42.091 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:42.153 INFO:teuthology.orchestra.run.smithi023.stdout:(8/12): ceph-mgr-dashboard-19.0.0-3089.gb0c7b91 5.1 MB/s | 3.5 MB 00:00 2024-04-16T17:42:42.204 INFO:teuthology.orchestra.run.smithi023.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-04-16T17:42:42.229 INFO:teuthology.orchestra.run.smithi023.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 409 kB/s | 31 kB 00:00 2024-04-16T17:42:42.254 INFO:teuthology.orchestra.run.smithi023.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-04-16T17:42:42.279 INFO:teuthology.orchestra.run.smithi023.stdout:(12/12): python3-grpcio-tools-1.46.7-10.el9.x86 751 kB/s | 144 kB 00:00 2024-04-16T17:42:42.282 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:42.282 INFO:teuthology.orchestra.run.smithi023.stdout:Total 7.2 MB/s | 8.6 MB 00:01 2024-04-16T17:42:42.300 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:42:42.314 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:42.318 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:42:42.318 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:42:42.328 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:42.328 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:42.328 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:42:42.328 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:42.328 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:42.329 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 34/36 2024-04-16T17:42:42.339 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:42.339 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-16T17:42:42.339 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:42.339 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-16T17:42:42.339 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:42.395 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:42.395 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:42.395 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:42:42.395 INFO:teuthology.orchestra.run.smithi016.stdout: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:42.395 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:42.395 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:42.507 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:42:42.508 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:42:42.565 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:42.574 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-mgr 2024-04-16T17:42:42.589 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 35/36 2024-04-16T17:42:42.589 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:42.589 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-16T17:42:42.589 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:42.589 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-16T17:42:42.589 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:42.643 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-immutable-object-cache 2024-04-16T17:42:42.654 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:43.050 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:42:43.138 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-16T17:42:43.182 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-16T17:42:43.182 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:02 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:43.229 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-16T17:42:43.245 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:04 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:43.259 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-16T17:42:43.286 INFO:teuthology.orchestra.run.smithi163.stdout:Package ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:43.337 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:43.339 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:42:43.339 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:43.366 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-16T17:42:43.402 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:43.403 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-04-16T17:42:43.403 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:43.403 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:42:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 145 k 2024-04-16T17:42:43.403 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:43.403 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:42:43.404 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:42:43.404 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-04-16T17:42:43.404 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:43.404 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 145 k 2024-04-16T17:42:43.404 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 435 k 2024-04-16T17:42:43.404 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:42:43.408 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-mgr-dashboard 2024-04-16T17:42:43.497 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-16T17:42:43.588 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-16T17:42:43.647 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-16T17:42:43.683 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:43.716 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 10/12 2024-04-16T17:42:43.752 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-immutable-object-cache-19.0.0-3089.gb0c7b9 416 kB/s | 145 kB 00:00 2024-04-16T17:42:43.753 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:43.753 INFO:teuthology.orchestra.run.smithi016.stdout:Total 415 kB/s | 145 kB 00:00 2024-04-16T17:42:43.754 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:42:43.961 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:42:44.006 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:03 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:44.028 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:44.053 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:44.053 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:44.053 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T17:42:44.053 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:44.159 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:44.160 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================== 2024-04-16T17:42:44.160 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:42:44.160 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================== 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 3.5 M 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 34 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 16 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T17:42:44.161 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T17:42:44.162 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:44.162 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:42:44.162 INFO:teuthology.orchestra.run.smithi163.stdout:====================================================================================== 2024-04-16T17:42:44.162 INFO:teuthology.orchestra.run.smithi163.stdout:Install 12 Packages 2024-04-16T17:42:44.162 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:44.162 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 8.6 M 2024-04-16T17:42:44.163 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 104 M 2024-04-16T17:42:44.163 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:42:44.424 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 36/36 2024-04-16T17:42:44.424 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/36 2024-04-16T17:42:44.424 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 3/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 4/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 5/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9. 6/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-04-16T17:42:44.425 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-16T17:42:44.426 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-16T17:42:44.427 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-16T17:42:44.427 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-16T17:42:44.427 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-16T17:42:44.427 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-16T17:42:44.427 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-16T17:42:44.427 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-16T17:42:44.813 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 11/12 2024-04-16T17:42:44.849 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:44.966 INFO:teuthology.orchestra.run.smithi163.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3089.gb0 203 kB/s | 34 kB 00:00 2024-04-16T17:42:44.995 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:44.995 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:44.995 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:42:44.995 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:44.995 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:44.996 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:45.116 INFO:teuthology.orchestra.run.smithi163.stdout:(2/12): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-04-16T17:42:45.158 INFO:teuthology.orchestra.run.smithi163.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 5.6 MB/s | 238 kB 00:00 2024-04-16T17:42:45.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr 2024-04-16T17:42:45.267 INFO:teuthology.orchestra.run.smithi163.stdout:(4/12): ceph-mgr-dashboard-19.0.0-3089.gb0c7b91 7.5 MB/s | 3.5 MB 00:00 2024-04-16T17:42:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-16T17:42:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:45.340 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:42:45.340 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mds-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-modules-core-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-osd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: lua-5.4.4-4.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-16T17:42:45.341 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ply-3.11-14.el9.noarch 2024-04-16T17:42:45.342 INFO:teuthology.orchestra.run.smithi139.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:45.343 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:45.367 INFO:teuthology.orchestra.run.smithi163.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.4 MB/s | 548 kB 00:00 2024-04-16T17:42:45.392 INFO:teuthology.orchestra.run.smithi163.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-04-16T17:42:45.417 INFO:teuthology.orchestra.run.smithi163.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.3 MB/s | 863 kB 00:00 2024-04-16T17:42:45.476 INFO:teuthology.orchestra.run.smithi163.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 24 MB/s | 2.0 MB 00:00 2024-04-16T17:42:45.502 INFO:teuthology.orchestra.run.smithi163.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-04-16T17:42:45.527 INFO:teuthology.orchestra.run.smithi163.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.3 MB/s | 144 kB 00:00 2024-04-16T17:42:45.552 INFO:teuthology.orchestra.run.smithi163.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-04-16T17:42:45.693 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-base 2024-04-16T17:42:45.844 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:06 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:45.951 INFO:teuthology.orchestra.run.smithi016.stdout:Package ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:46.007 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:46.008 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:42:46.008 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:46.044 INFO:teuthology.orchestra.run.smithi163.stdout:(12/12): ceph-prometheus-alerts-19.0.0-3089.gb0 13 kB/s | 16 kB 00:01 2024-04-16T17:42:46.046 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:46.047 INFO:teuthology.orchestra.run.smithi163.stdout:Total 4.6 MB/s | 8.6 MB 00:01 2024-04-16T17:42:46.065 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:42:46.068 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-dashboard 2024-04-16T17:42:46.083 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:42:46.083 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:42:46.249 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:46.249 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 1/12 2024-04-16T17:42:46.249 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 2/12 2024-04-16T17:42:46.249 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 3/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-16T17:42:46.250 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-16T17:42:46.272 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:42:46.273 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:42:46.295 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:06 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:42:46.397 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-base-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:46.452 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:42:46.453 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:46.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install cephadm 2024-04-16T17:42:46.608 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-16T17:42:46.608 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:46.608 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:42:46.608 INFO:teuthology.orchestra.run.smithi023.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T17:42:46.608 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:46.609 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:46.672 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:07 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:46.805 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:42:46.831 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout:====================================================================================== 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout:====================================================================================== 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 3.5 M 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T17:42:46.833 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 34 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 16 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout:====================================================================================== 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout:Install 12 Packages 2024-04-16T17:42:46.834 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:46.835 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 8.6 M 2024-04-16T17:42:46.835 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 104 M 2024-04-16T17:42:46.835 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:42:46.863 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-16T17:42:46.878 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-16T17:42:46.913 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-16T17:42:46.960 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-16T17:42:46.991 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-16T17:42:47.094 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-16T17:42:47.106 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:07 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:42:47.217 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-16T17:42:47.259 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 762 k 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-04-16T17:42:47.260 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:47.261 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 762 k 2024-04-16T17:42:47.261 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 769 k 2024-04-16T17:42:47.261 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:42:47.302 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-16T17:42:47.340 INFO:teuthology.orchestra.run.smithi016.stdout:(1/12): ceph-prometheus-alerts-19.0.0-3089.gb0c 67 kB/s | 16 kB 00:00 2024-04-16T17:42:47.354 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-16T17:42:47.357 INFO:teuthology.orchestra.run.smithi016.stdout:(2/12): ceph-grafana-dashboards-19.0.0-3089.gb0 130 kB/s | 34 kB 00:00 2024-04-16T17:42:47.382 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:47.415 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 10/12 2024-04-16T17:42:47.463 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:12 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:47.499 INFO:teuthology.orchestra.run.smithi016.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 238 kB 00:00 2024-04-16T17:42:47.533 INFO:teuthology.orchestra.run.smithi016.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-04-16T17:42:47.579 INFO:teuthology.orchestra.run.smithi139.stdout:cephadm-19.0.0-3089.gb0c7b917.el9.noarch.rpm 2.3 MB/s | 762 kB 00:00 2024-04-16T17:42:47.580 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:47.580 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.3 MB/s | 762 kB 00:00 2024-04-16T17:42:47.580 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:42:47.585 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:42:47.585 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:42:47.591 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:42:47.591 INFO:teuthology.orchestra.run.smithi016.stdout:(5/12): ceph-mgr-dashboard-19.0.0-3089.gb0c7b91 7.1 MB/s | 3.5 MB 00:00 2024-04-16T17:42:47.591 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:42:47.625 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout:============================================================================================ 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout:============================================================================================ 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 7.4 M 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T17:42:47.627 INFO:teuthology.orchestra.run.smithi023.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout:============================================================================================ 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout:Install 12 Packages 2024-04-16T17:42:47.628 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:47.629 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 37 M 2024-04-16T17:42:47.629 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 209 M 2024-04-16T17:42:47.629 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:42:47.666 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:42:47.741 INFO:teuthology.orchestra.run.smithi016.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.5 MB/s | 863 kB 00:00 2024-04-16T17:42:47.850 INFO:teuthology.orchestra.run.smithi016.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 75 kB/s | 19 kB 00:00 2024-04-16T17:42:48.122 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:48.125 INFO:teuthology.orchestra.run.smithi016.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 925 kB/s | 548 kB 00:00 2024-04-16T17:42:48.163 INFO:teuthology.orchestra.run.smithi023.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 216 kB/s | 32 kB 00:00 2024-04-16T17:42:48.196 INFO:teuthology.orchestra.run.smithi023.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 535 kB/s | 17 kB 00:00 2024-04-16T17:42:48.216 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:48.238 INFO:teuthology.orchestra.run.smithi023.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 844 kB/s | 34 kB 00:00 2024-04-16T17:42:48.284 INFO:teuthology.orchestra.run.smithi016.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 333 kB/s | 144 kB 00:00 2024-04-16T17:42:48.297 INFO:teuthology.orchestra.run.smithi023.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-04-16T17:42:48.384 INFO:teuthology.orchestra.run.smithi016.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 119 kB/s | 31 kB 00:00 2024-04-16T17:42:48.456 INFO:teuthology.orchestra.run.smithi023.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2024-04-16T17:42:48.463 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 11/12 2024-04-16T17:42:48.490 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:48.510 INFO:teuthology.orchestra.run.smithi016.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.7 MB/s | 2.0 MB 00:00 2024-04-16T17:42:48.531 INFO:teuthology.orchestra.run.smithi023.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-04-16T17:42:48.556 INFO:teuthology.orchestra.run.smithi023.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-04-16T17:42:48.591 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:48.710 INFO:teuthology.orchestra.run.smithi016.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 443 kB/s | 188 kB 00:00 2024-04-16T17:42:48.715 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:48.715 INFO:teuthology.orchestra.run.smithi016.stdout:Total 4.6 MB/s | 8.6 MB 00:01 2024-04-16T17:42:48.736 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:42:48.757 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:42:48.757 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:42:48.865 INFO:teuthology.orchestra.run.smithi023.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-04-16T17:42:48.884 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/1 2024-04-16T17:42:48.884 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:48.884 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:42:48.884 INFO:teuthology.orchestra.run.smithi139.stdout: cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:48.884 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:48.884 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:48.938 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:42:48.938 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:42:48.998 INFO:teuthology.orchestra.run.smithi023.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-30 7.5 MB/s | 7.4 MB 00:00 2024-04-16T17:42:49.032 INFO:teuthology.orchestra.run.smithi023.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-04-16T17:42:49.092 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-immutable-object-cache 2024-04-16T17:42:49.132 INFO:teuthology.orchestra.run.smithi023.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 732 kB/s | 195 kB 00:00 2024-04-16T17:42:49.157 INFO:teuthology.orchestra.run.smithi023.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-04-16T17:42:49.160 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:49.160 INFO:teuthology.orchestra.run.smithi023.stdout:Total 24 MB/s | 37 MB 00:01 2024-04-16T17:42:49.203 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:42:49.228 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:42:49.228 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:42:49.469 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:42:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-16T17:42:49.596 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-16T17:42:49.616 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:42:49.616 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:42:49.644 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-16T17:42:49.673 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-16T17:42:49.691 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:09 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:42:49.784 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-16T17:42:49.817 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:49.817 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 1/12 2024-04-16T17:42:49.817 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 2/12 2024-04-16T17:42:49.817 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 3/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-16T17:42:49.818 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-16T17:42:49.845 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:42:49.845 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:49.845 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 145 k 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-04-16T17:42:49.846 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:49.847 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 145 k 2024-04-16T17:42:49.847 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 435 k 2024-04-16T17:42:49.847 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:42:49.920 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-16T17:42:50.021 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-16T17:42:50.070 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-16T17:42:50.099 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:50.131 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 10/12 2024-04-16T17:42:50.164 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T17:42:50.165 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:50.166 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:42:50.185 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-immutable-object-cache-19.0.0-3089.gb0c7b9 429 kB/s | 145 kB 00:00 2024-04-16T17:42:50.185 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:50.185 INFO:teuthology.orchestra.run.smithi139.stdout:Total 427 kB/s | 145 kB 00:00 2024-04-16T17:42:50.185 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:42:50.193 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:42:50.193 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:42:50.246 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:42:50.246 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:42:50.342 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:42:50.380 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:42:50.422 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-16T17:42:50.427 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:50.437 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-16T17:42:50.453 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-16T17:42:50.453 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:50.454 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:42:50.454 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-16T17:42:50.454 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:50.553 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:42:50.590 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-16T17:42:50.775 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:42:50.814 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:42:50.893 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-16T17:42:51.029 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:10 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:42:51.183 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================================ 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================================ 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 7.4 M 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T17:42:51.184 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout:============================================================================================ 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout:Install 12 Packages 2024-04-16T17:42:51.185 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:42:51.186 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 37 M 2024-04-16T17:42:51.186 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 209 M 2024-04-16T17:42:51.186 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:42:51.227 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 11/12 2024-04-16T17:42:51.272 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:51.477 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917. 1/1 2024-04-16T17:42:51.477 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:51.477 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:42:51.477 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-immutable-object-cache-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:42:51.477 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:51.477 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:51.576 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-16T17:42:51.687 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-16T17:42:51.718 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr 2024-04-16T17:42:51.737 INFO:teuthology.orchestra.run.smithi163.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 234 kB/s | 32 kB 00:00 2024-04-16T17:42:51.770 INFO:teuthology.orchestra.run.smithi163.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 533 kB/s | 17 kB 00:00 2024-04-16T17:42:51.812 INFO:teuthology.orchestra.run.smithi163.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 848 kB/s | 34 kB 00:00 2024-04-16T17:42:51.871 INFO:teuthology.orchestra.run.smithi163.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-04-16T17:42:52.088 INFO:teuthology.orchestra.run.smithi163.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2024-04-16T17:42:52.163 INFO:teuthology.orchestra.run.smithi163.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2024-04-16T17:42:52.188 INFO:teuthology.orchestra.run.smithi163.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 217 kB 00:00 2024-04-16T17:42:52.327 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:12 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:42:52.429 INFO:teuthology.orchestra.run.smithi139.stdout:Package ceph-mgr-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:42:52.481 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:42:52.482 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:42:52.482 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:52.531 INFO:teuthology.orchestra.run.smithi163.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-04-16T17:42:52.547 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-dashboard 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 1/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 2/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 3/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-16T17:42:52.608 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-16T17:42:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-16T17:42:52.609 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-16T17:42:52.614 INFO:teuthology.orchestra.run.smithi163.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-30 7.3 MB/s | 7.4 MB 00:01 2024-04-16T17:42:52.639 INFO:teuthology.orchestra.run.smithi163.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 803 kB 00:00 2024-04-16T17:42:52.740 INFO:teuthology.orchestra.run.smithi163.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 937 kB/s | 195 kB 00:00 2024-04-16T17:42:52.815 INFO:teuthology.orchestra.run.smithi163.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-04-16T17:42:52.817 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:52.818 INFO:teuthology.orchestra.run.smithi163.stdout:Total 23 MB/s | 37 MB 00:01 2024-04-16T17:42:52.863 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:42:52.890 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:42:52.890 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T17:42:52.961 INFO:teuthology.orchestra.run.smithi016.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T17:42:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T17:42:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T17:42:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T17:42:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T17:42:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T17:42:52.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:52.962 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:42:52.981 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-16T17:42:53.164 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:13 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:42:53.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-16T17:42:53.263 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:42:53.263 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:42:53.331 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:42:53.332 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-04-16T17:42:53.332 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 3.5 M 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 34 k 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 16 k 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-16T17:42:53.333 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout:====================================================================================== 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout:Install 12 Packages 2024-04-16T17:42:53.334 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:53.335 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 8.6 M 2024-04-16T17:42:53.335 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 104 M 2024-04-16T17:42:53.335 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:42:53.823 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:14 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:42:53.967 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:42:53.989 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:42:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================================ 2024-04-16T17:42:53.990 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:42:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================================ 2024-04-16T17:42:53.990 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 7.4 M 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T17:42:53.991 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:53.992 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:42:53.992 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================================ 2024-04-16T17:42:53.992 INFO:teuthology.orchestra.run.smithi016.stdout:Install 12 Packages 2024-04-16T17:42:53.992 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:42:53.992 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 37 M 2024-04-16T17:42:53.992 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 209 M 2024-04-16T17:42:53.992 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:42:54.038 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-16T17:42:54.040 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-16T17:42:54.069 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-16T17:42:54.071 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:42:54.171 INFO:teuthology.orchestra.run.smithi139.stdout:(1/12): ceph-grafana-dashboards-19.0.0-3089.gb0 165 kB/s | 34 kB 00:00 2024-04-16T17:42:54.175 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:42:54.196 INFO:teuthology.orchestra.run.smithi139.stdout:(2/12): ceph-prometheus-alerts-19.0.0-3089.gb0c 71 kB/s | 16 kB 00:00 2024-04-16T17:42:54.234 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-16T17:42:54.278 INFO:teuthology.orchestra.run.smithi016.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 224 kB/s | 32 kB 00:00 2024-04-16T17:42:54.315 INFO:teuthology.orchestra.run.smithi016.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 537 kB/s | 17 kB 00:00 2024-04-16T17:42:54.347 INFO:teuthology.orchestra.run.smithi139.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 238 kB 00:00 2024-04-16T17:42:54.354 INFO:teuthology.orchestra.run.smithi016.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 849 kB/s | 34 kB 00:00 2024-04-16T17:42:54.381 INFO:teuthology.orchestra.run.smithi139.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.8 MB/s | 1.0 MB 00:00 2024-04-16T17:42:54.408 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:42:54.433 INFO:teuthology.orchestra.run.smithi016.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-04-16T17:42:54.438 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:42:54.514 INFO:teuthology.orchestra.run.smithi139.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.0 MB/s | 548 kB 00:00 2024-04-16T17:42:54.515 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-16T17:42:54.596 INFO:teuthology.orchestra.run.smithi016.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-04-16T17:42:54.606 INFO:teuthology.orchestra.run.smithi139.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.3 MB/s | 863 kB 00:00 2024-04-16T17:42:54.631 INFO:teuthology.orchestra.run.smithi139.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 166 kB/s | 19 kB 00:00 2024-04-16T17:42:54.663 INFO:teuthology.orchestra.run.smithi016.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2024-04-16T17:42:54.688 INFO:teuthology.orchestra.run.smithi016.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-04-16T17:42:54.790 INFO:teuthology.orchestra.run.smithi139.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 913 kB/s | 144 kB 00:00 2024-04-16T17:42:54.915 INFO:teuthology.orchestra.run.smithi139.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 246 kB/s | 31 kB 00:00 2024-04-16T17:42:54.957 INFO:teuthology.orchestra.run.smithi139.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 5.8 MB/s | 2.0 MB 00:00 2024-04-16T17:42:54.980 INFO:teuthology.orchestra.run.smithi016.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-04-16T17:42:54.991 INFO:teuthology.orchestra.run.smithi139.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2024-04-16T17:42:55.072 INFO:teuthology.orchestra.run.smithi016.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-30 7.9 MB/s | 7.4 MB 00:00 2024-04-16T17:42:55.078 INFO:teuthology.orchestra.run.smithi139.stdout:(12/12): ceph-mgr-dashboard-19.0.0-3089.gb0c7b9 3.2 MB/s | 3.5 MB 00:01 2024-04-16T17:42:55.081 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:55.081 INFO:teuthology.orchestra.run.smithi139.stdout:Total 4.9 MB/s | 8.6 MB 00:01 2024-04-16T17:42:55.100 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:42:55.116 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:42:55.117 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:42:55.177 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-16T17:42:55.247 INFO:teuthology.orchestra.run.smithi016.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-04-16T17:42:55.300 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:42:55.300 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:42:55.304 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-16T17:42:55.826 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:42:55.881 INFO:teuthology.orchestra.run.smithi016.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 217 kB/s | 195 kB 00:00 2024-04-16T17:42:55.899 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-16T17:42:55.935 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-16T17:42:55.981 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-16T17:42:56.020 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-16T17:42:56.121 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-16T17:42:56.268 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-16T17:42:56.355 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-16T17:42:56.407 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-16T17:42:56.436 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:56.456 INFO:teuthology.orchestra.run.smithi016.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 455 kB/s | 803 kB 00:01 2024-04-16T17:42:56.459 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:42:56.459 INFO:teuthology.orchestra.run.smithi016.stdout:Total 15 MB/s | 37 MB 00:02 2024-04-16T17:42:56.468 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 10/12 2024-04-16T17:42:56.505 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:42:56.531 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:42:56.532 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:42:56.545 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-16T17:42:56.623 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:42:56.623 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 1/12 2024-04-16T17:42:56.623 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-16T17:42:56.624 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-16T17:42:56.908 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:42:56.908 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:42:57.086 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-16T17:42:57.086 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:57.086 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:57.087 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:42:57.451 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-rook 2024-04-16T17:42:57.510 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 11/12 2024-04-16T17:42:57.552 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:57.574 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-16T17:42:57.607 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:42:57.630 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:42:57.696 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-16T17:42:57.727 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-16T17:42:57.826 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:42:57.864 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-16T17:42:58.039 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:42:58.055 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:23 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:42:58.071 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:42:58.150 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-16T17:42:58.217 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:42:58.218 INFO:teuthology.orchestra.run.smithi023.stdout:======================================================================================== 2024-04-16T17:42:58.218 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:42:58.218 INFO:teuthology.orchestra.run.smithi023.stdout:======================================================================================== 2024-04-16T17:42:58.218 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:42:58.218 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-rook noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 49 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T17:42:58.219 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:58.220 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:42:58.220 INFO:teuthology.orchestra.run.smithi023.stdout:======================================================================================== 2024-04-16T17:42:58.220 INFO:teuthology.orchestra.run.smithi023.stdout:Install 13 Packages 2024-04-16T17:42:58.220 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:42:58.220 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 2.0 M 2024-04-16T17:42:58.220 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 26 M 2024-04-16T17:42:58.220 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:42:58.488 INFO:teuthology.orchestra.run.smithi023.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 149 kB/s | 18 kB 00:00 2024-04-16T17:42:58.513 INFO:teuthology.orchestra.run.smithi023.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 167 kB/s | 24 kB 00:00 2024-04-16T17:42:58.563 INFO:teuthology.orchestra.run.smithi023.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-04-16T17:42:58.589 INFO:teuthology.orchestra.run.smithi023.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-16T17:42:58.614 INFO:teuthology.orchestra.run.smithi023.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-04-16T17:42:58.631 INFO:teuthology.orchestra.run.smithi023.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 43 kB 00:00 2024-04-16T17:42:58.648 INFO:teuthology.orchestra.run.smithi023.stdout:(7/13): ceph-mgr-rook-19.0.0-3089.gb0c7b917.el9 175 kB/s | 49 kB 00:00 2024-04-16T17:42:58.835 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-16T17:42:58.839 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 12/12 2024-04-16T17:42:58.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el 1/12 2024-04-16T17:42:58.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noa 2/12 2024-04-16T17:42:58.839 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9 3/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-16T17:42:58.840 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-16T17:42:58.956 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-16T17:42:59.073 INFO:teuthology.orchestra.run.smithi023.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 70 kB/s | 32 kB 00:00 2024-04-16T17:42:59.098 INFO:teuthology.orchestra.run.smithi023.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 32 kB/s | 15 kB 00:00 2024-04-16T17:42:59.201 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-16T17:42:59.201 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:59.201 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:42:59.201 INFO:teuthology.orchestra.run.smithi139.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-16T17:42:59.201 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-grafana-dashboards-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-prometheus-alerts-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:42:59.202 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:42:59.357 INFO:teuthology.orchestra.run.smithi023.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 229 kB/s | 59 kB 00:00 2024-04-16T17:42:59.447 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-16T17:42:59.449 INFO:teuthology.orchestra.run.smithi023.stdout:(11/13): python3-google-auth-2.28.2-1.el9.noarc 253 kB/s | 203 kB 00:00 2024-04-16T17:42:59.549 INFO:teuthology.orchestra.run.smithi023.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 467 kB/s | 90 kB 00:00 2024-04-16T17:43:00.062 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:20 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:00.226 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:00.227 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================ 2024-04-16T17:43:00.227 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:43:00.227 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================ 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 7.4 M 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-16T17:43:00.228 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-04-16T17:43:00.229 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-04-16T17:43:00.229 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-04-16T17:43:00.229 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:00.229 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:00.229 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================================ 2024-04-16T17:43:00.229 INFO:teuthology.orchestra.run.smithi139.stdout:Install 12 Packages 2024-04-16T17:43:00.229 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:00.230 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 37 M 2024-04-16T17:43:00.230 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 209 M 2024-04-16T17:43:00.230 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:43:00.271 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 1/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-16T17:43:00.272 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-16T17:43:00.274 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-16T17:43:00.441 INFO:teuthology.orchestra.run.smithi023.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 764 kB/s | 1.0 MB 00:01 2024-04-16T17:43:00.446 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:00.446 INFO:teuthology.orchestra.run.smithi023.stdout:Total 941 kB/s | 2.0 MB 00:02 2024-04-16T17:43:00.447 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:00.463 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:00.463 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:00.567 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:00.568 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:00.707 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-16T17:43:00.707 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:00.707 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:00.707 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:00.707 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:00.708 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:00.765 INFO:teuthology.orchestra.run.smithi139.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 231 kB/s | 32 kB 00:00 2024-04-16T17:43:00.790 INFO:teuthology.orchestra.run.smithi139.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 726 kB/s | 17 kB 00:00 2024-04-16T17:43:00.815 INFO:teuthology.orchestra.run.smithi139.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2024-04-16T17:43:00.882 INFO:teuthology.orchestra.run.smithi139.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 12 MB/s | 3.0 MB 00:00 2024-04-16T17:43:01.049 INFO:teuthology.orchestra.run.smithi139.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-04-16T17:43:01.074 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-mgr-rook 2024-04-16T17:43:01.094 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:01.125 INFO:teuthology.orchestra.run.smithi139.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 4.8 MB 00:00 2024-04-16T17:43:01.150 INFO:teuthology.orchestra.run.smithi139.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-04-16T17:43:01.278 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-16T17:43:01.334 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-16T17:43:01.339 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-16T17:43:01.355 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:43:01.398 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-16T17:43:01.425 INFO:teuthology.orchestra.run.smithi139.stdout:(8/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 52 MB/s | 16 MB 00:00 2024-04-16T17:43:01.435 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-16T17:43:01.476 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-16T17:43:01.517 INFO:teuthology.orchestra.run.smithi139.stdout:(9/12): ceph-mgr-diskprediction-local-19.0.0-30 8.3 MB/s | 7.4 MB 00:00 2024-04-16T17:43:01.589 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-16T17:43:01.674 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:20 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:01.693 INFO:teuthology.orchestra.run.smithi139.stdout:(10/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-04-16T17:43:01.699 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-16T17:43:01.762 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-16T17:43:01.831 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================== 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================== 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 49 k 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T17:43:01.832 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:01.833 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================== 2024-04-16T17:43:01.834 INFO:teuthology.orchestra.run.smithi163.stdout:Install 13 Packages 2024-04-16T17:43:01.834 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:01.834 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 2.0 M 2024-04-16T17:43:01.834 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 26 M 2024-04-16T17:43:01.834 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:02.327 INFO:teuthology.orchestra.run.smithi163.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 185 kB/s | 24 kB 00:00 2024-04-16T17:43:02.334 INFO:teuthology.orchestra.run.smithi139.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 215 kB/s | 195 kB 00:00 2024-04-16T17:43:02.352 INFO:teuthology.orchestra.run.smithi163.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 115 kB/s | 18 kB 00:00 2024-04-16T17:43:02.394 INFO:teuthology.orchestra.run.smithi163.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-04-16T17:43:02.419 INFO:teuthology.orchestra.run.smithi163.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-04-16T17:43:02.445 INFO:teuthology.orchestra.run.smithi163.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-04-16T17:43:02.470 INFO:teuthology.orchestra.run.smithi163.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 853 kB/s | 43 kB 00:00 2024-04-16T17:43:02.495 INFO:teuthology.orchestra.run.smithi163.stdout:(7/13): ceph-mgr-rook-19.0.0-3089.gb0c7b917.el9 164 kB/s | 49 kB 00:00 2024-04-16T17:43:02.515 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-16T17:43:02.567 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-16T17:43:02.601 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-16T17:43:02.649 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-16T17:43:02.678 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:02.696 INFO:teuthology.orchestra.run.smithi163.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 66 kB/s | 15 kB 00:00 2024-04-16T17:43:02.729 INFO:teuthology.orchestra.run.smithi163.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 113 kB/s | 32 kB 00:00 2024-04-16T17:43:02.834 INFO:teuthology.orchestra.run.smithi139.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 477 kB/s | 803 kB 00:01 2024-04-16T17:43:02.837 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:02.838 INFO:teuthology.orchestra.run.smithi139.stdout:Total 14 MB/s | 37 MB 00:02 2024-04-16T17:43:02.883 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:02.888 INFO:teuthology.orchestra.run.smithi163.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 517 kB/s | 203 kB 00:00 2024-04-16T17:43:02.905 INFO:teuthology.orchestra.run.smithi163.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 337 kB/s | 59 kB 00:00 2024-04-16T17:43:02.909 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:02.909 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:03.005 INFO:teuthology.orchestra.run.smithi163.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.3 MB/s | 1.0 MB 00:00 2024-04-16T17:43:03.030 INFO:teuthology.orchestra.run.smithi163.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 632 kB/s | 90 kB 00:00 2024-04-16T17:43:03.035 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:03.035 INFO:teuthology.orchestra.run.smithi163.stdout:Total 1.7 MB/s | 2.0 MB 00:01 2024-04-16T17:43:03.035 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:03.049 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:03.049 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:03.140 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:03.140 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:03.265 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:03.266 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 1/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-16T17:43:03.463 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-16T17:43:03.464 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-16T17:43:03.672 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:03.831 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-16T17:43:03.831 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T17:43:03.832 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:03.833 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:03.834 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-16T17:43:03.890 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-16T17:43:03.945 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-16T17:43:03.964 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:03.983 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-16T17:43:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:43:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 1/12 2024-04-16T17:43:04.001 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-16T17:43:04.002 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-16T17:43:04.024 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-04-16T17:43:04.024 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-16T17:43:04.055 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-16T17:43:04.097 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-mgr-cephadm 2024-04-16T17:43:04.117 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-16T17:43:04.149 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:43:04.192 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-04-16T17:43:04.236 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-16T17:43:04.293 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-16T17:43:04.370 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:43:04.407 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T17:43:04.461 INFO:teuthology.orchestra.run.smithi016.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:04.462 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:04.493 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-16T17:43:04.697 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:29 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:04.849 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-rook 2024-04-16T17:43:04.857 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:04.858 INFO:teuthology.orchestra.run.smithi023.stdout:======================================================================================== 2024-04-16T17:43:04.858 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:43:04.858 INFO:teuthology.orchestra.run.smithi023.stdout:======================================================================================== 2024-04-16T17:43:04.858 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 142 k 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout:======================================================================================== 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout:Install 6 Packages 2024-04-16T17:43:04.859 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:04.860 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 6.8 M 2024-04-16T17:43:04.860 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 33 M 2024-04-16T17:43:04.860 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:05.017 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-16T17:43:05.074 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-16T17:43:05.108 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-16T17:43:05.133 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-16T17:43:05.155 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-16T17:43:05.178 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:05.236 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-16T17:43:05.454 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:26 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:05.464 INFO:teuthology.orchestra.run.smithi023.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-04-16T17:43:05.493 INFO:teuthology.orchestra.run.smithi023.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 796 kB/s | 248 kB 00:00 2024-04-16T17:43:05.518 INFO:teuthology.orchestra.run.smithi023.stdout:(3/6): ceph-mgr-cephadm-19.0.0-3089.gb0c7b917.e 422 kB/s | 142 kB 00:00 2024-04-16T17:43:05.616 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:05.617 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================== 2024-04-16T17:43:05.617 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:43:05.617 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================== 2024-04-16T17:43:05.617 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:05.617 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 49 k 2024-04-16T17:43:05.617 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:43:05.617 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T17:43:05.618 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T17:43:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T17:43:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T17:43:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:05.619 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:05.619 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================== 2024-04-16T17:43:05.619 INFO:teuthology.orchestra.run.smithi016.stdout:Install 13 Packages 2024-04-16T17:43:05.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:05.620 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 2.0 M 2024-04-16T17:43:05.620 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 26 M 2024-04-16T17:43:05.620 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:05.660 INFO:teuthology.orchestra.run.smithi023.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 345 kB/s | 58 kB 00:00 2024-04-16T17:43:05.685 INFO:teuthology.orchestra.run.smithi023.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 306 kB/s | 51 kB 00:00 2024-04-16T17:43:05.711 INFO:teuthology.orchestra.run.smithi023.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.2 MB/s | 548 kB 00:00 2024-04-16T17:43:05.713 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:05.714 INFO:teuthology.orchestra.run.smithi023.stdout:Total 8.0 MB/s | 6.8 MB 00:00 2024-04-16T17:43:05.727 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:05.737 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:05.737 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:05.830 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:05.831 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:05.931 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:05.931 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 1/13 2024-04-16T17:43:05.931 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-16T17:43:05.931 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-16T17:43:05.931 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-16T17:43:05.932 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-16T17:43:06.089 INFO:teuthology.orchestra.run.smithi016.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 149 kB/s | 18 kB 00:00 2024-04-16T17:43:06.114 INFO:teuthology.orchestra.run.smithi016.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 167 kB/s | 24 kB 00:00 2024-04-16T17:43:06.134 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:06.164 INFO:teuthology.orchestra.run.smithi016.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-04-16T17:43:06.190 INFO:teuthology.orchestra.run.smithi016.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-04-16T17:43:06.223 INFO:teuthology.orchestra.run.smithi016.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2024-04-16T17:43:06.240 INFO:teuthology.orchestra.run.smithi016.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 854 kB/s | 43 kB 00:00 2024-04-16T17:43:06.257 INFO:teuthology.orchestra.run.smithi016.stdout:(7/13): ceph-mgr-rook-19.0.0-3089.gb0c7b917.el9 170 kB/s | 49 kB 00:00 2024-04-16T17:43:06.302 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-16T17:43:06.302 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T17:43:06.303 INFO:teuthology.orchestra.run.smithi163.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T17:43:06.304 INFO:teuthology.orchestra.run.smithi163.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T17:43:06.304 INFO:teuthology.orchestra.run.smithi163.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T17:43:06.304 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:06.304 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:06.308 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-16T17:43:06.357 INFO:teuthology.orchestra.run.smithi016.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 128 kB/s | 15 kB 00:00 2024-04-16T17:43:06.363 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-16T17:43:06.375 INFO:teuthology.orchestra.run.smithi016.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 213 kB/s | 32 kB 00:00 2024-04-16T17:43:06.469 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-16T17:43:06.492 INFO:teuthology.orchestra.run.smithi016.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 866 kB/s | 203 kB 00:00 2024-04-16T17:43:06.509 INFO:teuthology.orchestra.run.smithi016.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 441 kB/s | 59 kB 00:00 2024-04-16T17:43:06.561 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-mgr-cephadm 2024-04-16T17:43:06.584 INFO:teuthology.orchestra.run.smithi016.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 974 kB/s | 90 kB 00:00 2024-04-16T17:43:06.643 INFO:teuthology.orchestra.run.smithi016.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.6 MB/s | 1.0 MB 00:00 2024-04-16T17:43:06.645 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:06.645 INFO:teuthology.orchestra.run.smithi016.stdout:Total 2.0 MB/s | 2.0 MB 00:01 2024-04-16T17:43:06.645 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:06.660 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:06.661 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:06.760 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:06.761 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:06.924 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-16T17:43:07.009 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-16T17:43:07.080 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-16T17:43:07.108 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:07.149 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:26 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:07.285 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:07.304 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:07.305 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================== 2024-04-16T17:43:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:43:07.305 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================== 2024-04-16T17:43:07.305 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 142 k 2024-04-16T17:43:07.305 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:43:07.305 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout:======================================================================================== 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout:Install 6 Packages 2024-04-16T17:43:07.306 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:07.307 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 6.8 M 2024-04-16T17:43:07.307 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 33 M 2024-04-16T17:43:07.307 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:07.466 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-16T17:43:07.504 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-16T17:43:07.521 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-16T17:43:07.531 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:43:07.576 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-16T17:43:07.612 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-16T17:43:07.654 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-16T17:43:07.711 INFO:teuthology.orchestra.run.smithi163.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-04-16T17:43:07.751 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-16T17:43:07.786 INFO:teuthology.orchestra.run.smithi163.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-04-16T17:43:07.869 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-16T17:43:07.891 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:07.891 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/6 2024-04-16T17:43:07.891 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-16T17:43:07.892 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-16T17:43:07.892 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-16T17:43:07.892 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-16T17:43:07.931 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-16T17:43:08.112 INFO:teuthology.orchestra.run.smithi163.stdout:(3/6): ceph-mgr-cephadm-19.0.0-3089.gb0c7b917.e 243 kB/s | 142 kB 00:00 2024-04-16T17:43:08.197 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-16T17:43:08.197 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:08.197 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:08.198 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:08.253 INFO:teuthology.orchestra.run.smithi163.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 124 kB/s | 58 kB 00:00 2024-04-16T17:43:08.429 INFO:teuthology.orchestra.run.smithi163.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 766 kB/s | 548 kB 00:00 2024-04-16T17:43:08.446 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-fuse 2024-04-16T17:43:08.579 INFO:teuthology.orchestra.run.smithi163.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 109 kB/s | 51 kB 00:00 2024-04-16T17:43:08.583 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:08.583 INFO:teuthology.orchestra.run.smithi163.stdout:Total 5.3 MB/s | 6.8 MB 00:01 2024-04-16T17:43:08.597 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:08.607 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:08.607 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:08.688 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-16T17:43:08.701 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:08.702 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:08.736 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-16T17:43:08.769 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-16T17:43:08.819 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-16T17:43:08.847 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:09.018 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:09.059 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:34 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:09.176 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-16T17:43:09.220 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:09.221 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:09.221 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:43:09.221 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:09.221 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:09.221 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 890 k 2024-04-16T17:43:09.221 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:43:09.221 INFO:teuthology.orchestra.run.smithi023.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T17:43:09.222 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:09.222 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:09.222 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:09.222 INFO:teuthology.orchestra.run.smithi023.stdout:Install 2 Packages 2024-04-16T17:43:09.222 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:09.222 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 968 k 2024-04-16T17:43:09.223 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 2.8 M 2024-04-16T17:43:09.223 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:09.223 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-16T17:43:09.354 INFO:teuthology.orchestra.run.smithi023.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 598 kB/s | 79 kB 00:00 2024-04-16T17:43:09.562 INFO:teuthology.orchestra.run.smithi023.stdout:(2/2): ceph-fuse-19.0.0-3089.gb0c7b917.el9.x86_ 2.6 MB/s | 890 kB 00:00 2024-04-16T17:43:09.563 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:09.564 INFO:teuthology.orchestra.run.smithi023.stdout:Total 2.8 MB/s | 968 kB 00:00 2024-04-16T17:43:09.564 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:09.585 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:09.586 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:09.666 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:09.666 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 1/13 2024-04-16T17:43:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-16T17:43:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-16T17:43:09.713 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-16T17:43:09.714 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-16T17:43:09.741 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-16T17:43:09.826 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-16T17:43:09.853 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:09.889 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-16T17:43:09.919 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:09.993 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-16T17:43:10.029 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 12/12 2024-04-16T17:43:10.029 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b 1/12 2024-04-16T17:43:10.029 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-04-16T17:43:10.029 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-04-16T17:43:10.030 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-04-16T17:43:10.064 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T17:43:10.092 INFO:teuthology.orchestra.run.smithi016.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:10.093 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:10.323 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-mgr-cephadm 2024-04-16T17:43:10.445 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-16T17:43:10.446 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-16T17:43:10.447 INFO:teuthology.orchestra.run.smithi139.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-16T17:43:10.447 INFO:teuthology.orchestra.run.smithi139.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-16T17:43:10.447 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:10.447 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:10.721 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:10.721 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/2 2024-04-16T17:43:10.755 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:10.755 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/6 2024-04-16T17:43:10.755 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-16T17:43:10.756 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-16T17:43:10.756 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-16T17:43:10.756 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-16T17:43:10.799 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-rook 2024-04-16T17:43:10.922 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:31 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:11.046 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-16T17:43:11.046 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:11.046 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:11.046 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-16T17:43:11.046 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:11.046 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:11.058 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:11.059 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:11.084 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:11.084 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================== 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================== 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 142 k 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:11.085 INFO:teuthology.orchestra.run.smithi016.stdout:======================================================================================== 2024-04-16T17:43:11.086 INFO:teuthology.orchestra.run.smithi016.stdout:Install 6 Packages 2024-04-16T17:43:11.086 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:11.086 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 6.8 M 2024-04-16T17:43:11.086 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 33 M 2024-04-16T17:43:11.086 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:11.314 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-fuse 2024-04-16T17:43:11.337 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install ceph-volume 2024-04-16T17:43:11.396 INFO:teuthology.orchestra.run.smithi016.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-04-16T17:43:11.405 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:31 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:11.505 INFO:teuthology.orchestra.run.smithi016.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2024-04-16T17:43:11.530 INFO:teuthology.orchestra.run.smithi016.stdout:(3/6): ceph-mgr-cephadm-19.0.0-3089.gb0c7b917.e 482 kB/s | 142 kB 00:00 2024-04-16T17:43:11.560 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 49 k 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-16T17:43:11.562 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-04-16T17:43:11.563 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-16T17:43:11.564 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-16T17:43:11.564 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:11.564 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:11.564 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2024-04-16T17:43:11.564 INFO:teuthology.orchestra.run.smithi139.stdout:Install 13 Packages 2024-04-16T17:43:11.564 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:11.565 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 2.0 M 2024-04-16T17:43:11.565 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 26 M 2024-04-16T17:43:11.565 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:11.738 INFO:teuthology.orchestra.run.smithi016.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 247 kB/s | 58 kB 00:00 2024-04-16T17:43:11.763 INFO:teuthology.orchestra.run.smithi139.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 209 kB/s | 24 kB 00:00 2024-04-16T17:43:11.763 INFO:teuthology.orchestra.run.smithi016.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 218 kB/s | 51 kB 00:00 2024-04-16T17:43:11.788 INFO:teuthology.orchestra.run.smithi139.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 127 kB/s | 18 kB 00:00 2024-04-16T17:43:11.830 INFO:teuthology.orchestra.run.smithi139.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 174 kB 00:00 2024-04-16T17:43:11.855 INFO:teuthology.orchestra.run.smithi139.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-04-16T17:43:11.880 INFO:teuthology.orchestra.run.smithi016.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-04-16T17:43:11.880 INFO:teuthology.orchestra.run.smithi139.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-04-16T17:43:11.881 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:11.882 INFO:teuthology.orchestra.run.smithi016.stdout:Total 8.5 MB/s | 6.8 MB 00:00 2024-04-16T17:43:11.896 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:11.905 INFO:teuthology.orchestra.run.smithi139.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 858 kB/s | 43 kB 00:00 2024-04-16T17:43:11.906 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:11.906 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:11.913 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:30 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:11.931 INFO:teuthology.orchestra.run.smithi139.stdout:(7/13): ceph-mgr-rook-19.0.0-3089.gb0c7b917.el9 173 kB/s | 49 kB 00:00 2024-04-16T17:43:11.977 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:36 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:11.999 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:11.999 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:12.066 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:12.067 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:43:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:12.067 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 890 k 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:Install 2 Packages 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 968 k 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 2.8 M 2024-04-16T17:43:12.068 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:12.138 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:12.139 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:12.139 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repository Size 2024-04-16T17:43:12.139 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:12.139 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:12.139 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-volume noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 264 k 2024-04-16T17:43:12.139 INFO:teuthology.orchestra.run.smithi023.stdout:Installing dependencies: 2024-04-16T17:43:12.139 INFO:teuthology.orchestra.run.smithi023.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T17:43:12.140 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:12.140 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:12.140 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:12.140 INFO:teuthology.orchestra.run.smithi023.stdout:Install 2 Packages 2024-04-16T17:43:12.140 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:12.140 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 332 k 2024-04-16T17:43:12.140 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 1.5 M 2024-04-16T17:43:12.141 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:12.156 INFO:teuthology.orchestra.run.smithi139.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 117 kB/s | 32 kB 00:00 2024-04-16T17:43:12.181 INFO:teuthology.orchestra.run.smithi139.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 54 kB/s | 15 kB 00:00 2024-04-16T17:43:12.190 INFO:teuthology.orchestra.run.smithi163.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 646 kB/s | 79 kB 00:00 2024-04-16T17:43:12.269 INFO:teuthology.orchestra.run.smithi023.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 536 kB/s | 69 kB 00:00 2024-04-16T17:43:12.303 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:12.332 INFO:teuthology.orchestra.run.smithi139.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 506 kB/s | 203 kB 00:00 2024-04-16T17:43:12.357 INFO:teuthology.orchestra.run.smithi139.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 337 kB/s | 59 kB 00:00 2024-04-16T17:43:12.457 INFO:teuthology.orchestra.run.smithi139.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.4 MB/s | 1.0 MB 00:00 2024-04-16T17:43:12.470 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-16T17:43:12.482 INFO:teuthology.orchestra.run.smithi139.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 597 kB/s | 90 kB 00:00 2024-04-16T17:43:12.486 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:12.486 INFO:teuthology.orchestra.run.smithi139.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2024-04-16T17:43:12.486 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:12.499 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:12.499 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:12.507 INFO:teuthology.orchestra.run.smithi163.stdout:(2/2): ceph-fuse-19.0.0-3089.gb0c7b917.el9.x86_ 2.0 MB/s | 890 kB 00:00 2024-04-16T17:43:12.509 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:12.509 INFO:teuthology.orchestra.run.smithi163.stdout:Total 2.1 MB/s | 968 kB 00:00 2024-04-16T17:43:12.509 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:12.525 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-16T17:43:12.530 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:12.530 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:12.569 INFO:teuthology.orchestra.run.smithi023.stdout:(2/2): ceph-volume-19.0.0-3089.gb0c7b917.el9.no 616 kB/s | 264 kB 00:00 2024-04-16T17:43:12.570 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:12.571 INFO:teuthology.orchestra.run.smithi023.stdout:Total 772 kB/s | 332 kB 00:00 2024-04-16T17:43:12.571 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:12.580 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:12.580 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:12.589 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:12.590 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:12.602 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:12.603 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:12.633 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:12.634 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:12.791 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:12.800 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:12.925 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-16T17:43:12.990 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:12.993 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-16T17:43:13.039 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:13.055 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:13.055 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:13.055 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T17:43:13.055 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:13.075 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-16T17:43:13.107 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:13.163 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-16T17:43:13.234 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-16T17:43:13.261 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:13.268 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-16T17:43:13.333 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-16T17:43:13.388 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-16T17:43:13.426 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-16T17:43:13.466 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-16T17:43:13.568 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-16T17:43:13.678 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-04-16T17:43:13.726 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-16T17:43:13.762 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:13.763 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/2 2024-04-16T17:43:13.873 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 1/2 2024-04-16T17:43:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/6 2024-04-16T17:43:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-16T17:43:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-16T17:43:14.054 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-16T17:43:14.055 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-16T17:43:14.078 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-16T17:43:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:14.079 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-16T17:43:14.079 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:14.079 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:14.195 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-16T17:43:14.195 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:14.195 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:14.195 INFO:teuthology.orchestra.run.smithi023.stdout: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:14.195 INFO:teuthology.orchestra.run.smithi023.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T17:43:14.195 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:14.195 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:14.366 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:14.367 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:14.411 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install ceph-volume 2024-04-16T17:43:14.443 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-16T17:43:14.498 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-16T17:43:14.533 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-16T17:43:14.559 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install librados-devel 2024-04-16T17:43:14.580 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-16T17:43:14.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-fuse 2024-04-16T17:43:14.602 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:15.015 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:34 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:15.164 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:40 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:15.171 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:15.171 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repository Size 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 264 k 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout:Installing dependencies: 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout:Install 2 Packages 2024-04-16T17:43:15.172 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:15.173 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 332 k 2024-04-16T17:43:15.173 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 1.5 M 2024-04-16T17:43:15.173 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:15.206 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:36 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:15.297 INFO:teuthology.orchestra.run.smithi163.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 555 kB/s | 69 kB 00:00 2024-04-16T17:43:15.324 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repo Size 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout: librados-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 127 k 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:15.325 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-04-16T17:43:15.326 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:15.326 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 127 k 2024-04-16T17:43:15.326 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 456 k 2024-04-16T17:43:15.326 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:15.366 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:15.366 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:15.366 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:43:15.366 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 890 k 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout:Install 2 Packages 2024-04-16T17:43:15.367 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:15.368 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 968 k 2024-04-16T17:43:15.368 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 2.8 M 2024-04-16T17:43:15.368 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:15.416 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 13/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 1/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-16T17:43:15.417 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-16T17:43:15.499 INFO:teuthology.orchestra.run.smithi016.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 600 kB/s | 79 kB 00:00 2024-04-16T17:43:15.539 INFO:teuthology.orchestra.run.smithi163.stdout:(2/2): ceph-volume-19.0.0-3089.gb0c7b917.el9.no 721 kB/s | 264 kB 00:00 2024-04-16T17:43:15.540 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:15.540 INFO:teuthology.orchestra.run.smithi163.stdout:Total 904 kB/s | 332 kB 00:00 2024-04-16T17:43:15.540 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:15.548 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:15.549 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:15.566 INFO:teuthology.orchestra.run.smithi023.stdout:librados-devel-19.0.0-3089.gb0c7b917.el9.x86_64 527 kB/s | 127 kB 00:00 2024-04-16T17:43:15.567 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:15.568 INFO:teuthology.orchestra.run.smithi023.stdout:Total 523 kB/s | 127 kB 00:00 2024-04-16T17:43:15.568 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:15.574 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:15.574 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:15.589 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:15.589 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:15.632 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:15.632 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:15.734 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:15.780 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-rook-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-16T17:43:15.783 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-16T17:43:15.784 INFO:teuthology.orchestra.run.smithi139.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-16T17:43:15.784 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-16T17:43:15.784 INFO:teuthology.orchestra.run.smithi139.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-16T17:43:15.784 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:15.784 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:15.894 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:15.920 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-16T17:43:15.967 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:15.983 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:15.983 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:15.983 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T17:43:15.983 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:16.057 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-mgr-cephadm 2024-04-16T17:43:16.183 INFO:teuthology.orchestra.run.smithi016.stdout:(2/2): ceph-fuse-19.0.0-3089.gb0c7b917.el9.x86_ 1.1 MB/s | 890 kB 00:00 2024-04-16T17:43:16.186 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:16.186 INFO:teuthology.orchestra.run.smithi016.stdout:Total 1.2 MB/s | 968 kB 00:00 2024-04-16T17:43:16.203 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:16.209 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:16.209 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:16.288 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:16.288 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:16.437 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:16.489 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:16.638 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-16T17:43:16.648 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:36 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:16.720 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:16.754 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:16.754 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:16.754 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:16.754 INFO:teuthology.orchestra.run.smithi023.stdout: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:16.754 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:16.755 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:16.781 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 1/2 2024-04-16T17:43:16.803 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 142 k 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-16T17:43:16.805 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout:======================================================================================== 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout:Install 6 Packages 2024-04-16T17:43:16.806 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:16.807 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 6.8 M 2024-04-16T17:43:16.807 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 33 M 2024-04-16T17:43:16.807 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:17.007 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install libcephfs2 2024-04-16T17:43:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-16T17:43:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:17.133 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T17:43:17.133 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:17.133 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:17.292 INFO:teuthology.orchestra.run.smithi139.stdout:(1/6): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-04-16T17:43:17.325 INFO:teuthology.orchestra.run.smithi139.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 842 kB/s | 248 kB 00:00 2024-04-16T17:43:17.434 INFO:teuthology.orchestra.run.smithi139.stdout:(3/6): ceph-mgr-cephadm-19.0.0-3089.gb0c7b917.e 353 kB/s | 142 kB 00:00 2024-04-16T17:43:17.452 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:17.452 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/2 2024-04-16T17:43:17.472 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install librados-devel 2024-04-16T17:43:17.517 INFO:teuthology.orchestra.run.smithi139.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 300 kB/s | 58 kB 00:00 2024-04-16T17:43:17.559 INFO:teuthology.orchestra.run.smithi139.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.0 MB/s | 548 kB 00:00 2024-04-16T17:43:17.584 INFO:teuthology.orchestra.run.smithi139.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 341 kB/s | 51 kB 00:00 2024-04-16T17:43:17.586 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:17.587 INFO:teuthology.orchestra.run.smithi139.stdout:Total 8.7 MB/s | 6.8 MB 00:00 2024-04-16T17:43:17.599 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:17.609 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:17.609 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:17.621 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:42 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:17.698 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:17.699 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:17.728 INFO:teuthology.orchestra.run.smithi023.stdout:Package libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:17.756 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-16T17:43:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:17.757 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-16T17:43:17.757 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:17.757 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:17.785 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:17.786 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:43:17.786 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:17.874 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install libcephfs-devel 2024-04-16T17:43:18.002 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:18.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install ceph-volume 2024-04-16T17:43:18.077 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:37 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:18.176 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-16T17:43:18.227 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-16T17:43:18.231 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repo Size 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 127 k 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout:Install 1 Package 2024-04-16T17:43:18.232 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:18.233 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 127 k 2024-04-16T17:43:18.233 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 456 k 2024-04-16T17:43:18.233 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:18.473 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:43 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:18.634 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:18.635 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:18.635 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repo Size 2024-04-16T17:43:18.635 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 32 k 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:18.636 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 32 k 2024-04-16T17:43:18.637 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 142 k 2024-04-16T17:43:18.637 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:18.663 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:39 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:18.746 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-16T17:43:18.821 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-16T17:43:18.824 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:18.825 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repository Size 2024-04-16T17:43:18.825 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:18.825 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 264 k 2024-04-16T17:43:18.826 INFO:teuthology.orchestra.run.smithi016.stdout:Installing dependencies: 2024-04-16T17:43:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T17:43:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:18.826 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:18.826 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:18.826 INFO:teuthology.orchestra.run.smithi016.stdout:Install 2 Packages 2024-04-16T17:43:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:18.827 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 332 k 2024-04-16T17:43:18.827 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 1.5 M 2024-04-16T17:43:18.827 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:18.885 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-16T17:43:18.915 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:18.956 INFO:teuthology.orchestra.run.smithi016.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 532 kB/s | 69 kB 00:00 2024-04-16T17:43:19.020 INFO:teuthology.orchestra.run.smithi163.stdout:librados-devel-19.0.0-3089.gb0c7b917.el9.x86_64 161 kB/s | 127 kB 00:00 2024-04-16T17:43:19.021 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:19.021 INFO:teuthology.orchestra.run.smithi163.stdout:Total 161 kB/s | 127 kB 00:00 2024-04-16T17:43:19.021 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:19.028 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:19.028 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:19.088 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:19.088 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:19.231 INFO:teuthology.orchestra.run.smithi016.stdout:(2/2): ceph-volume-19.0.0-3089.gb0c7b917.el9.no 652 kB/s | 264 kB 00:00 2024-04-16T17:43:19.232 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:19.233 INFO:teuthology.orchestra.run.smithi016.stdout:Total 817 kB/s | 332 kB 00:00 2024-04-16T17:43:19.233 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:19.233 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:19.243 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:19.243 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:19.284 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:19.284 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:19.344 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:19.612 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-16T17:43:19.651 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:19.668 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:19.668 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:19.668 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T17:43:19.668 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 6/6 2024-04-16T17:43:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 1/6 2024-04-16T17:43:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-16T17:43:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-16T17:43:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-16T17:43:19.712 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-16T17:43:19.817 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-16T17:43:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:20.004 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-cephadm-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-16T17:43:20.004 INFO:teuthology.orchestra.run.smithi139.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-16T17:43:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-16T17:43:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-16T17:43:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-16T17:43:20.005 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:20.005 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:20.108 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:20.109 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:20.109 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:20.110 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:20.110 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:20.231 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-fuse 2024-04-16T17:43:20.296 INFO:teuthology.orchestra.run.smithi023.stdout:libcephfs-devel-19.0.0-3089.gb0c7b917.el9.x86_6 19 kB/s | 32 kB 00:01 2024-04-16T17:43:20.296 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:20.297 INFO:teuthology.orchestra.run.smithi023.stdout:Total 19 kB/s | 32 kB 00:01 2024-04-16T17:43:20.297 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:20.302 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:20.303 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:20.329 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:20.329 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:20.339 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install libcephfs2 2024-04-16T17:43:20.358 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 1/2 2024-04-16T17:43:20.466 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:20.581 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-16T17:43:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:20.665 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T17:43:20.665 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:20.666 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:20.873 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:40 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:20.944 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:20.946 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:39 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:21.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install librados-devel 2024-04-16T17:43:21.028 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 890 k 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout:Install 2 Packages 2024-04-16T17:43:21.029 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:21.030 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 968 k 2024-04-16T17:43:21.030 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 2.8 M 2024-04-16T17:43:21.030 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:21.053 INFO:teuthology.orchestra.run.smithi163.stdout:Package libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:21.106 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:21.107 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:43:21.107 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:21.169 INFO:teuthology.orchestra.run.smithi139.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 567 kB/s | 79 kB 00:00 2024-04-16T17:43:21.180 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install libcephfs-devel 2024-04-16T17:43:21.220 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:21.220 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:21.220 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:21.220 INFO:teuthology.orchestra.run.smithi023.stdout: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:21.220 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:21.220 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:21.385 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install librados2 2024-04-16T17:43:21.611 INFO:teuthology.orchestra.run.smithi139.stdout:(2/2): ceph-fuse-19.0.0-3089.gb0c7b917.el9.x86_ 1.5 MB/s | 890 kB 00:00 2024-04-16T17:43:21.612 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:21.612 INFO:teuthology.orchestra.run.smithi139.stdout:Total 1.6 MB/s | 968 kB 00:00 2024-04-16T17:43:21.612 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:21.632 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:42 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:21.633 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:21.633 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:21.708 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:21.708 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:21.772 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:40 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:21.792 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:21.793 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:21.793 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-04-16T17:43:21.793 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 127 k 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 127 k 2024-04-16T17:43:21.794 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 456 k 2024-04-16T17:43:21.795 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:21.901 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:21.926 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:21.927 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:21.927 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repo Size 2024-04-16T17:43:21.927 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:21.927 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:21.927 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 32 k 2024-04-16T17:43:21.927 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:21.927 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:21.928 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:21.928 INFO:teuthology.orchestra.run.smithi163.stdout:Install 1 Package 2024-04-16T17:43:21.928 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:21.928 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 32 k 2024-04-16T17:43:21.928 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 142 k 2024-04-16T17:43:21.928 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:21.998 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:47 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:22.014 INFO:teuthology.orchestra.run.smithi016.stdout:librados-devel-19.0.0-3089.gb0c7b917.el9.x86_64 579 kB/s | 127 kB 00:00 2024-04-16T17:43:22.015 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:22.015 INFO:teuthology.orchestra.run.smithi016.stdout:Total 575 kB/s | 127 kB 00:00 2024-04-16T17:43:22.015 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:22.020 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:22.020 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:22.045 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-16T17:43:22.078 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:22.078 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:22.092 INFO:teuthology.orchestra.run.smithi163.stdout:libcephfs-devel-19.0.0-3089.gb0c7b917.el9.x86_6 194 kB/s | 32 kB 00:00 2024-04-16T17:43:22.092 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:22.092 INFO:teuthology.orchestra.run.smithi163.stdout:Total 192 kB/s | 32 kB 00:00 2024-04-16T17:43:22.093 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:22.096 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:22.096 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:22.103 INFO:teuthology.orchestra.run.smithi023.stdout:Package librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:22.127 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:22.127 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:22.127 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:22.157 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:22.158 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:43:22.158 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:22.209 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install librbd1 2024-04-16T17:43:22.231 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:22.261 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:22.340 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:22.348 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:22.741 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:22.788 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:22.807 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2/2 2024-04-16T17:43:22.807 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/2 2024-04-16T17:43:22.822 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:47 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:22.927 INFO:teuthology.orchestra.run.smithi023.stdout:Package librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:22.982 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:22.983 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:43:22.983 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:23.013 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:23.014 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:23.014 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:23.014 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:23.030 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-rados 2024-04-16T17:43:23.048 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:23.048 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:23.048 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:23.048 INFO:teuthology.orchestra.run.smithi016.stdout: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:23.048 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:23.048 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-16T17:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-16T17:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:23.106 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:23.176 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install librados2 2024-04-16T17:43:23.282 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install libcephfs2 2024-04-16T17:43:23.393 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install ceph-volume 2024-04-16T17:43:23.638 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:48 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:23.742 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:23.773 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:42 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:23.797 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:23.798 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:43:23.799 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:23.848 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-rgw 2024-04-16T17:43:23.873 INFO:teuthology.orchestra.run.smithi163.stdout:Package librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:23.895 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:44 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:23.926 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:23.927 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:43:23.927 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:23.992 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install librbd1 2024-04-16T17:43:24.007 INFO:teuthology.orchestra.run.smithi016.stdout:Package libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:24.020 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:44 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:24.063 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:24.065 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:43:24.065 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:24.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install libcephfs-devel 2024-04-16T17:43:24.179 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:24.179 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repository Size 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume noarch 2:19.0.0-3089.gb0c7b917.el9 ceph-noarch 264 k 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout:Installing dependencies: 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout:Install 2 Packages 2024-04-16T17:43:24.180 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:24.181 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 332 k 2024-04-16T17:43:24.181 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 1.5 M 2024-04-16T17:43:24.181 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:24.306 INFO:teuthology.orchestra.run.smithi139.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 549 kB/s | 69 kB 00:00 2024-04-16T17:43:24.456 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:49 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:24.561 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:24.588 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:43 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:24.616 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:24.617 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:43:24.617 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:24.673 INFO:teuthology.orchestra.run.smithi139.stdout:(2/2): ceph-volume-19.0.0-3089.gb0c7b917.el9.no 536 kB/s | 264 kB 00:00 2024-04-16T17:43:24.674 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-cephfs 2024-04-16T17:43:24.675 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:24.675 INFO:teuthology.orchestra.run.smithi139.stdout:Total 672 kB/s | 332 kB 00:00 2024-04-16T17:43:24.675 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:24.684 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:24.684 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:24.690 INFO:teuthology.orchestra.run.smithi163.stdout:Package librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:24.719 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:24.720 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:24.737 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:45 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:24.742 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:24.743 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:43:24.743 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:24.801 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install python3-rados 2024-04-16T17:43:24.869 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:24.906 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 32 k 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:24.907 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:24.908 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-04-16T17:43:24.908 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:24.908 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 32 k 2024-04-16T17:43:24.908 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 142 k 2024-04-16T17:43:24.908 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:25.048 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-16T17:43:25.084 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:25.084 INFO:teuthology.orchestra.run.smithi016.stdout:libcephfs-devel-19.0.0-3089.gb0c7b917.el9.x86_6 179 kB/s | 32 kB 00:00 2024-04-16T17:43:25.085 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:25.085 INFO:teuthology.orchestra.run.smithi016.stdout:Total 178 kB/s | 32 kB 00:00 2024-04-16T17:43:25.085 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:25.089 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:25.089 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2/2 2024-04-16T17:43:25.101 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:25.101 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-16T17:43:25.101 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:25.126 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:25.126 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:25.248 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:25.272 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:50 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:25.375 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:25.403 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:44 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:25.430 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:25.432 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:43:25.432 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:25.483 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install python3-rbd 2024-04-16T17:43:25.504 INFO:teuthology.orchestra.run.smithi163.stdout:Package python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:25.556 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:25.557 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:43:25.558 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:25.621 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install python3-rgw 2024-04-16T17:43:25.718 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:25.802 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 1/2 2024-04-16T17:43:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:25.997 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:25.997 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:25.998 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:25.998 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:26.090 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:51 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:26.126 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-16T17:43:26.126 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:26.126 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:26.126 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-volume-2:19.0.0-3089.gb0c7b917.el9.noarch 2024-04-16T17:43:26.126 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-16T17:43:26.126 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:26.126 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:26.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install librados2 2024-04-16T17:43:26.198 INFO:teuthology.orchestra.run.smithi023.stdout:Package python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:26.217 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:45 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:26.253 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:26.255 INFO:teuthology.orchestra.run.smithi023.stdout:Nothing to do. 2024-04-16T17:43:26.255 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:26.309 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install rbd-fuse 2024-04-16T17:43:26.319 INFO:teuthology.orchestra.run.smithi163.stdout:Package python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:26.370 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:26.372 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:43:26.372 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:26.437 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install python3-cephfs 2024-04-16T17:43:26.440 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados-devel 2024-04-16T17:43:26.774 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:47 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:26.878 INFO:teuthology.orchestra.run.smithi016.stdout:Package librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:26.923 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:51 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:26.933 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:26.934 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:43:26.934 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:26.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install librbd1 2024-04-16T17:43:27.025 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:46 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:27.043 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:47 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:27.083 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 85 k 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:27.084 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-04-16T17:43:27.085 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:27.085 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 85 k 2024-04-16T17:43:27.085 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 231 k 2024-04-16T17:43:27.085 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:27.125 INFO:teuthology.orchestra.run.smithi163.stdout:Package python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:27.177 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:27.178 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:43:27.178 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:27.197 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 127 k 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-04-16T17:43:27.198 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 127 k 2024-04-16T17:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 456 k 2024-04-16T17:43:27.199 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:27.230 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install python3-rbd 2024-04-16T17:43:27.405 INFO:teuthology.orchestra.run.smithi139.stdout:librados-devel-19.0.0-3089.gb0c7b917.el9.x86_64 615 kB/s | 127 kB 00:00 2024-04-16T17:43:27.406 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:27.407 INFO:teuthology.orchestra.run.smithi139.stdout:Total 609 kB/s | 127 kB 00:00 2024-04-16T17:43:27.407 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:27.412 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:27.412 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:27.415 INFO:teuthology.orchestra.run.smithi023.stdout:rbd-fuse-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 258 kB/s | 85 kB 00:00 2024-04-16T17:43:27.415 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:27.416 INFO:teuthology.orchestra.run.smithi023.stdout:Total 257 kB/s | 85 kB 00:00 2024-04-16T17:43:27.416 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:27.423 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:27.423 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:27.467 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:27.468 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:27.481 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:27.482 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:27.587 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:48 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:27.621 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:27.630 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:27.692 INFO:teuthology.orchestra.run.smithi016.stdout:Package librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:27.733 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:27.737 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:27.746 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:27.748 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:43:27.748 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:27.799 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-rados 2024-04-16T17:43:27.843 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:46 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:27.951 INFO:teuthology.orchestra.run.smithi163.stdout:Package python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:28.005 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:28.006 INFO:teuthology.orchestra.run.smithi163.stdout:Nothing to do. 2024-04-16T17:43:28.007 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:28.069 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install rbd-fuse 2024-04-16T17:43:28.147 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:28.211 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:28.402 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:49 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:28.445 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:28.445 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:28.445 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:28.445 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:28.445 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:28.445 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:28.506 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:28.508 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: librados-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:28.508 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:28.508 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:28.561 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:28.562 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:43:28.562 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:28.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-rgw 2024-04-16T17:43:28.701 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install rbd-mirror 2024-04-16T17:43:28.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs2 2024-04-16T17:43:28.743 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:47 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:28.901 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 85 k 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:28.902 INFO:teuthology.orchestra.run.smithi163.stdout:Install 1 Package 2024-04-16T17:43:28.903 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:28.903 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 85 k 2024-04-16T17:43:28.903 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 231 k 2024-04-16T17:43:28.903 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:29.187 INFO:teuthology.orchestra.run.smithi163.stdout:rbd-fuse-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 300 kB/s | 85 kB 00:00 2024-04-16T17:43:29.267 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:50 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:Total 298 kB/s | 85 kB 00:00 2024-04-16T17:43:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:29.268 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:29.309 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:54 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:29.333 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:29.350 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:49 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:29.387 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:29.388 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:43:29.389 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:29.399 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:29.439 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-cephfs 2024-04-16T17:43:29.460 INFO:teuthology.orchestra.run.smithi139.stdout:Package libcephfs2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:29.469 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:29.470 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:29.470 INFO:teuthology.orchestra.run.smithi023.stdout: Package Arch Version Repo Size 2024-04-16T17:43:29.470 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:29.470 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:29.470 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-mirror x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:43:29.470 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:29.471 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:29.471 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:29.471 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-04-16T17:43:29.471 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:29.471 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 3.1 M 2024-04-16T17:43:29.471 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 13 M 2024-04-16T17:43:29.471 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:29.510 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:29.516 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:29.518 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:43:29.518 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:29.581 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install libcephfs-devel 2024-04-16T17:43:29.939 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:30.044 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:51 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:30.076 INFO:teuthology.orchestra.run.smithi023.stdout:rbd-mirror-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 5.1 MB/s | 3.1 MB 00:00 2024-04-16T17:43:30.076 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:30.077 INFO:teuthology.orchestra.run.smithi023.stdout:Total 5.1 MB/s | 3.1 MB 00:00 2024-04-16T17:43:30.077 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:30.087 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:30.087 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:30.148 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:30.167 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:30.167 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:30.198 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:50 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:30.203 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:30.205 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:43:30.205 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:30.217 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:30.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:30.217 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:30.217 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:30.217 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:30.217 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:30.256 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install python3-rbd 2024-04-16T17:43:30.356 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:30.356 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:30.356 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-04-16T17:43:30.356 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:30.356 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:30.357 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 32 k 2024-04-16T17:43:30.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:30.357 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:30.357 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:30.357 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-04-16T17:43:30.357 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:30.357 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 32 k 2024-04-16T17:43:30.358 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 142 k 2024-04-16T17:43:30.358 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:30.447 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install rbd-mirror 2024-04-16T17:43:30.609 INFO:teuthology.orchestra.run.smithi139.stdout:libcephfs-devel-19.0.0-3089.gb0c7b917.el9.x86_6 126 kB/s | 32 kB 00:00 2024-04-16T17:43:30.609 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:30.610 INFO:teuthology.orchestra.run.smithi139.stdout:Total 126 kB/s | 32 kB 00:00 2024-04-16T17:43:30.610 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:30.613 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:30.613 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:30.615 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:30.646 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:30.646 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:30.677 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:30.702 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:30.702 INFO:teuthology.orchestra.run.smithi023.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:30.702 INFO:teuthology.orchestra.run.smithi023.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T17:43:30.702 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:30.702 INFO:teuthology.orchestra.run.smithi023.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:30.702 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:30.769 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:30.865 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:30.866 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:51 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:30.971 INFO:teuthology.orchestra.run.smithi016.stdout:Package python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:31.026 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:31.027 INFO:teuthology.orchestra.run.smithi016.stdout:Nothing to do. 2024-04-16T17:43:31.028 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:31.054 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:50 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:31.089 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install rbd-fuse 2024-04-16T17:43:31.213 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: Package Arch Version Repo Size 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:Install 1 Package 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:31.214 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 3.1 M 2024-04-16T17:43:31.215 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 13 M 2024-04-16T17:43:31.215 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:31.239 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:31.493 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:31.493 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:31.493 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:31.493 INFO:teuthology.orchestra.run.smithi139.stdout: libcephfs-devel-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:31.493 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:31.493 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:31.655 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librados2 2024-04-16T17:43:31.699 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:52 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:31.856 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:31.856 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:31.856 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:31.856 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:31.856 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:31.857 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:31.858 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:31.859 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:31.859 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:31.859 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:31.859 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:31.859 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 85 k 2024-04-16T17:43:31.860 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:31.860 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:31.860 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:31.860 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-04-16T17:43:31.860 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:31.860 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 85 k 2024-04-16T17:43:31.860 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 231 k 2024-04-16T17:43:31.861 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:32.135 DEBUG:teuthology.orchestra.run.smithi023:> sudo yum -y install rbd-nbd 2024-04-16T17:43:32.158 INFO:teuthology.orchestra.run.smithi163.stdout:rbd-mirror-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 3.3 MB/s | 3.1 MB 00:00 2024-04-16T17:43:32.159 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:32.159 INFO:teuthology.orchestra.run.smithi163.stdout:Total 3.3 MB/s | 3.1 MB 00:00 2024-04-16T17:43:32.159 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:32.168 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:32.168 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:32.242 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:32.243 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:32.252 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:52 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:32.297 INFO:teuthology.orchestra.run.smithi016.stdout:rbd-fuse-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 195 kB/s | 85 kB 00:00 2024-04-16T17:43:32.298 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:32.298 INFO:teuthology.orchestra.run.smithi016.stdout:Total 195 kB/s | 85 kB 00:00 2024-04-16T17:43:32.298 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:32.306 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:32.306 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:32.353 INFO:teuthology.orchestra.run.smithi139.stdout:Package librados2-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:32.367 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:32.367 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:32.405 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:32.406 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:43:32.406 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:32.455 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install librbd1 2024-04-16T17:43:32.516 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:32.607 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:32.665 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:32.742 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:32.747 INFO:teuthology.orchestra.run.smithi023.stdout:Last metadata expiration check: 0:01:57 ago on Tue 16 Apr 2024 05:41:35 PM UTC. 2024-04-16T17:43:32.769 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:32.769 INFO:teuthology.orchestra.run.smithi163.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:32.769 INFO:teuthology.orchestra.run.smithi163.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T17:43:32.769 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:32.769 INFO:teuthology.orchestra.run.smithi163.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:32.769 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:32.905 INFO:teuthology.orchestra.run.smithi023.stdout:Dependencies resolved. 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout:Installing: 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-nbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 170 k 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction Summary 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout:================================================================================ 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout:Install 1 Package 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:32.906 INFO:teuthology.orchestra.run.smithi023.stdout:Total download size: 170 k 2024-04-16T17:43:32.907 INFO:teuthology.orchestra.run.smithi023.stdout:Installed size: 494 k 2024-04-16T17:43:32.907 INFO:teuthology.orchestra.run.smithi023.stdout:Downloading Packages: 2024-04-16T17:43:33.003 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:33.054 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:53 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:33.138 INFO:teuthology.orchestra.run.smithi023.stdout:rbd-nbd-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 736 kB/s | 170 kB 00:00 2024-04-16T17:43:33.138 INFO:teuthology.orchestra.run.smithi023.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:33.139 INFO:teuthology.orchestra.run.smithi023.stdout:Total 732 kB/s | 170 kB 00:00 2024-04-16T17:43:33.139 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction check 2024-04-16T17:43:33.147 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction check succeeded. 2024-04-16T17:43:33.147 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction test 2024-04-16T17:43:33.154 INFO:teuthology.orchestra.run.smithi139.stdout:Package librbd1-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:33.205 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:33.205 INFO:teuthology.orchestra.run.smithi023.stdout:Transaction test succeeded. 2024-04-16T17:43:33.206 INFO:teuthology.orchestra.run.smithi023.stdout:Running transaction 2024-04-16T17:43:33.206 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:43:33.207 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:33.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rados 2024-04-16T17:43:33.304 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:33.304 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:33.304 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:33.305 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:33.305 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:33.305 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:33.359 INFO:teuthology.orchestra.run.smithi023.stdout: Preparing : 1/1 2024-04-16T17:43:33.464 INFO:teuthology.orchestra.run.smithi023.stdout: Installing : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:33.584 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install rbd-mirror 2024-04-16T17:43:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:33.858 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:33.858 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:33.859 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:33.859 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:33.861 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:53 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:33.940 INFO:teuthology.orchestra.run.smithi023.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:33.964 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rados-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:34.015 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:34.016 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:43:34.016 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:34.073 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rgw 2024-04-16T17:43:34.087 DEBUG:teuthology.orchestra.run.smithi163:> sudo yum -y install rbd-nbd 2024-04-16T17:43:34.196 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:55 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:34.277 INFO:teuthology.orchestra.run.smithi023.stdout: Verifying : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:34.277 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:34.278 INFO:teuthology.orchestra.run.smithi023.stdout:Installed: 2024-04-16T17:43:34.278 INFO:teuthology.orchestra.run.smithi023.stdout: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:34.278 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:34.278 INFO:teuthology.orchestra.run.smithi023.stdout:Complete! 2024-04-16T17:43:34.357 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:34.357 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout: Package Arch Version Repo Size 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-04-16T17:43:34.358 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:34.359 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 3.1 M 2024-04-16T17:43:34.359 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 13 M 2024-04-16T17:43:34.359 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:34.549 DEBUG:teuthology.parallel:result is None 2024-04-16T17:43:34.670 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:54 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:34.707 INFO:teuthology.orchestra.run.smithi163.stdout:Last metadata expiration check: 0:01:53 ago on Tue 16 Apr 2024 05:41:41 PM UTC. 2024-04-16T17:43:34.771 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rgw-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:34.823 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:34.825 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:43:34.825 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:34.860 INFO:teuthology.orchestra.run.smithi163.stdout:Dependencies resolved. 2024-04-16T17:43:34.861 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:34.861 INFO:teuthology.orchestra.run.smithi163.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:34.861 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:34.861 INFO:teuthology.orchestra.run.smithi163.stdout:Installing: 2024-04-16T17:43:34.861 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 170 k 2024-04-16T17:43:34.861 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:34.862 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction Summary 2024-04-16T17:43:34.862 INFO:teuthology.orchestra.run.smithi163.stdout:================================================================================ 2024-04-16T17:43:34.862 INFO:teuthology.orchestra.run.smithi163.stdout:Install 1 Package 2024-04-16T17:43:34.862 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:34.862 INFO:teuthology.orchestra.run.smithi163.stdout:Total download size: 170 k 2024-04-16T17:43:34.863 INFO:teuthology.orchestra.run.smithi163.stdout:Installed size: 494 k 2024-04-16T17:43:34.863 INFO:teuthology.orchestra.run.smithi163.stdout:Downloading Packages: 2024-04-16T17:43:34.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-cephfs 2024-04-16T17:43:35.171 INFO:teuthology.orchestra.run.smithi163.stdout:rbd-nbd-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 553 kB/s | 170 kB 00:00 2024-04-16T17:43:35.172 INFO:teuthology.orchestra.run.smithi163.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:35.172 INFO:teuthology.orchestra.run.smithi163.stdout:Total 550 kB/s | 170 kB 00:00 2024-04-16T17:43:35.172 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction check 2024-04-16T17:43:35.180 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction check succeeded. 2024-04-16T17:43:35.180 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction test 2024-04-16T17:43:35.226 INFO:teuthology.orchestra.run.smithi016.stdout:rbd-mirror-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 3.6 MB/s | 3.1 MB 00:00 2024-04-16T17:43:35.226 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:35.227 INFO:teuthology.orchestra.run.smithi016.stdout:Total 3.6 MB/s | 3.1 MB 00:00 2024-04-16T17:43:35.227 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:35.235 INFO:teuthology.orchestra.run.smithi163.stdout:Transaction test succeeded. 2024-04-16T17:43:35.236 INFO:teuthology.orchestra.run.smithi163.stdout:Running transaction 2024-04-16T17:43:35.237 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:35.237 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:35.312 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:35.313 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:35.382 INFO:teuthology.orchestra.run.smithi163.stdout: Preparing : 1/1 2024-04-16T17:43:35.494 INFO:teuthology.orchestra.run.smithi163.stdout: Installing : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:35.513 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:55 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:35.613 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-cephfs-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:35.664 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:35.665 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:43:35.665 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:35.718 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install python3-rbd 2024-04-16T17:43:35.750 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:35.801 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:35.826 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:35.827 INFO:teuthology.orchestra.run.smithi016.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:35.827 INFO:teuthology.orchestra.run.smithi016.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T17:43:35.827 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:35.827 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:35.827 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:35.957 INFO:teuthology.orchestra.run.smithi163.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:36.263 INFO:teuthology.orchestra.run.smithi163.stdout: Verifying : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:36.263 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:36.263 INFO:teuthology.orchestra.run.smithi163.stdout:Installed: 2024-04-16T17:43:36.263 INFO:teuthology.orchestra.run.smithi163.stdout: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:36.263 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:36.263 INFO:teuthology.orchestra.run.smithi163.stdout:Complete! 2024-04-16T17:43:36.315 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:56 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:36.416 INFO:teuthology.orchestra.run.smithi139.stdout:Package python3-rbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 is already installed. 2024-04-16T17:43:36.468 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:36.469 INFO:teuthology.orchestra.run.smithi139.stdout:Nothing to do. 2024-04-16T17:43:36.469 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:36.509 DEBUG:teuthology.parallel:result is None 2024-04-16T17:43:36.521 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-fuse 2024-04-16T17:43:36.929 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:36.929 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:36.929 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:36.929 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:36.929 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:36.929 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:37.123 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:57 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:37.199 DEBUG:teuthology.orchestra.run.smithi016:> sudo yum -y install rbd-nbd 2024-04-16T17:43:37.277 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 85 k 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 85 k 2024-04-16T17:43:37.278 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 231 k 2024-04-16T17:43:37.279 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:37.511 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-fuse-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 367 kB/s | 85 kB 00:00 2024-04-16T17:43:37.512 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:37.512 INFO:teuthology.orchestra.run.smithi139.stdout:Total 364 kB/s | 85 kB 00:00 2024-04-16T17:43:37.512 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:37.519 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:37.519 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:37.576 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:37.576 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:37.711 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:37.810 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:37.820 INFO:teuthology.orchestra.run.smithi016.stdout:Last metadata expiration check: 0:01:58 ago on Tue 16 Apr 2024 05:41:39 PM UTC. 2024-04-16T17:43:37.980 INFO:teuthology.orchestra.run.smithi016.stdout:Dependencies resolved. 2024-04-16T17:43:37.981 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:37.981 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout:Installing: 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 170 k 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction Summary 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout:================================================================================ 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout:Install 1 Package 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout:Total download size: 170 k 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout:Installed size: 494 k 2024-04-16T17:43:37.982 INFO:teuthology.orchestra.run.smithi016.stdout:Downloading Packages: 2024-04-16T17:43:38.196 INFO:teuthology.orchestra.run.smithi016.stdout:rbd-nbd-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 796 kB/s | 170 kB 00:00 2024-04-16T17:43:38.197 INFO:teuthology.orchestra.run.smithi016.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:38.197 INFO:teuthology.orchestra.run.smithi016.stdout:Total 792 kB/s | 170 kB 00:00 2024-04-16T17:43:38.197 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction check 2024-04-16T17:43:38.206 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction check succeeded. 2024-04-16T17:43:38.206 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction test 2024-04-16T17:43:38.225 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:38.264 INFO:teuthology.orchestra.run.smithi016.stdout:Transaction test succeeded. 2024-04-16T17:43:38.265 INFO:teuthology.orchestra.run.smithi016.stdout:Running transaction 2024-04-16T17:43:38.412 INFO:teuthology.orchestra.run.smithi016.stdout: Preparing : 1/1 2024-04-16T17:43:38.509 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:38.510 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:38.510 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:38.510 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-fuse-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:38.510 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:38.510 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:38.514 INFO:teuthology.orchestra.run.smithi016.stdout: Installing : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:38.821 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-mirror 2024-04-16T17:43:38.953 INFO:teuthology.orchestra.run.smithi016.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: Verifying : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:39.245 INFO:teuthology.orchestra.run.smithi016.stdout:Installed: 2024-04-16T17:43:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:39.245 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:39.245 INFO:teuthology.orchestra.run.smithi016.stdout:Complete! 2024-04-16T17:43:39.429 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:01:59 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:39.520 DEBUG:teuthology.parallel:result is None 2024-04-16T17:43:39.592 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:39.592 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:39.592 INFO:teuthology.orchestra.run.smithi139.stdout: Package Arch Version Repo Size 2024-04-16T17:43:39.592 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 3.1 M 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 3.1 M 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 13 M 2024-04-16T17:43:39.593 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:40.122 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-mirror-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 5.8 MB/s | 3.1 MB 00:00 2024-04-16T17:43:40.123 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:40.123 INFO:teuthology.orchestra.run.smithi139.stdout:Total 5.8 MB/s | 3.1 MB 00:00 2024-04-16T17:43:40.123 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:40.133 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:40.133 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:40.206 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:40.207 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:40.632 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:40.689 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:40.715 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:40.715 INFO:teuthology.orchestra.run.smithi139.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-16T17:43:40.715 INFO:teuthology.orchestra.run.smithi139.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-16T17:43:40.715 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:40.715 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-16T17:43:40.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:41.906 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:41.906 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:41.907 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:41.907 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-mirror-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:41.907 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:41.907 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:42.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo yum -y install rbd-nbd 2024-04-16T17:43:42.733 INFO:teuthology.orchestra.run.smithi139.stdout:Last metadata expiration check: 0:02:02 ago on Tue 16 Apr 2024 05:41:40 PM UTC. 2024-04-16T17:43:42.887 INFO:teuthology.orchestra.run.smithi139.stdout:Dependencies resolved. 2024-04-16T17:43:42.888 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: Package Architecture Version Repository Size 2024-04-16T17:43:42.888 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:42.888 INFO:teuthology.orchestra.run.smithi139.stdout:Installing: 2024-04-16T17:43:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd x86_64 2:19.0.0-3089.gb0c7b917.el9 ceph 170 k 2024-04-16T17:43:42.888 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:42.889 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction Summary 2024-04-16T17:43:42.889 INFO:teuthology.orchestra.run.smithi139.stdout:================================================================================ 2024-04-16T17:43:42.889 INFO:teuthology.orchestra.run.smithi139.stdout:Install 1 Package 2024-04-16T17:43:42.889 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:42.889 INFO:teuthology.orchestra.run.smithi139.stdout:Total download size: 170 k 2024-04-16T17:43:42.889 INFO:teuthology.orchestra.run.smithi139.stdout:Installed size: 494 k 2024-04-16T17:43:42.889 INFO:teuthology.orchestra.run.smithi139.stdout:Downloading Packages: 2024-04-16T17:43:43.109 INFO:teuthology.orchestra.run.smithi139.stdout:rbd-nbd-19.0.0-3089.gb0c7b917.el9.x86_64.rpm 776 kB/s | 170 kB 00:00 2024-04-16T17:43:43.109 INFO:teuthology.orchestra.run.smithi139.stdout:-------------------------------------------------------------------------------- 2024-04-16T17:43:43.109 INFO:teuthology.orchestra.run.smithi139.stdout:Total 771 kB/s | 170 kB 00:00 2024-04-16T17:43:43.110 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction check 2024-04-16T17:43:43.117 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction check succeeded. 2024-04-16T17:43:43.118 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction test 2024-04-16T17:43:43.174 INFO:teuthology.orchestra.run.smithi139.stdout:Transaction test succeeded. 2024-04-16T17:43:43.174 INFO:teuthology.orchestra.run.smithi139.stdout:Running transaction 2024-04-16T17:43:43.321 INFO:teuthology.orchestra.run.smithi139.stdout: Preparing : 1/1 2024-04-16T17:43:43.425 INFO:teuthology.orchestra.run.smithi139.stdout: Installing : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:43.883 INFO:teuthology.orchestra.run.smithi139.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:44.175 INFO:teuthology.orchestra.run.smithi139.stdout: Verifying : rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 1/1 2024-04-16T17:43:44.175 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:44.176 INFO:teuthology.orchestra.run.smithi139.stdout:Installed: 2024-04-16T17:43:44.176 INFO:teuthology.orchestra.run.smithi139.stdout: rbd-nbd-2:19.0.0-3089.gb0c7b917.el9.x86_64 2024-04-16T17:43:44.176 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:44.176 INFO:teuthology.orchestra.run.smithi139.stdout:Complete! 2024-04-16T17:43:44.404 DEBUG:teuthology.parallel:result is None 2024-04-16T17:43:44.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:43:44.553 DEBUG:teuthology.orchestra.run.smithi016:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T17:43:44.579 INFO:teuthology.orchestra.run.smithi016.stdout:19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:44.579 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:44.580 INFO:teuthology.task.install:The correct ceph version 19.0.0-3089.gb0c7b917 is installed. 2024-04-16T17:43:44.581 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:43:44.794 DEBUG:teuthology.orchestra.run.smithi023:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T17:43:44.819 INFO:teuthology.orchestra.run.smithi023.stdout:19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:44.820 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:44.820 INFO:teuthology.task.install:The correct ceph version 19.0.0-3089.gb0c7b917 is installed. 2024-04-16T17:43:44.822 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:43:45.035 DEBUG:teuthology.orchestra.run.smithi139:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T17:43:45.057 INFO:teuthology.orchestra.run.smithi139.stdout:19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:45.058 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:45.058 INFO:teuthology.task.install:The correct ceph version 19.0.0-3089.gb0c7b917 is installed. 2024-04-16T17:43:45.060 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b0c7b917267c471208541fdeb652f5e897d00086 2024-04-16T17:43:45.198 DEBUG:teuthology.orchestra.run.smithi163:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-16T17:43:45.223 INFO:teuthology.orchestra.run.smithi163.stdout:19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:45.223 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3089.gb0c7b917.el9 2024-04-16T17:43:45.223 INFO:teuthology.task.install:The correct ceph version 19.0.0-3089.gb0c7b917 is installed. 2024-04-16T17:43:45.225 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-16T17:43:45.227 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:45.228 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T17:43:45.261 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:43:45.261 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T17:43:45.295 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:43:45.295 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T17:43:45.327 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:43:45.327 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-16T17:43:45.360 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-16T17:43:45.362 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:45.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T17:43:45.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T17:43:45.464 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:43:45.464 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T17:43:45.494 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T17:43:45.562 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:43:45.562 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T17:43:45.593 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T17:43:45.665 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:43:45.665 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/daemon-helper 2024-04-16T17:43:45.698 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-16T17:43:45.770 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-16T17:43:45.770 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:45.770 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T17:43:45.804 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T17:43:45.875 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:43:45.875 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T17:43:45.904 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T17:43:45.972 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:43:45.972 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T17:43:46.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T17:43:46.076 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:43:46.077 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-16T17:43:46.110 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-16T17:43:46.180 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-16T17:43:46.180 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:46.180 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T17:43:46.213 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T17:43:46.285 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:43:46.285 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T17:43:46.314 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T17:43:46.381 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:43:46.381 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T17:43:46.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T17:43:46.486 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:43:46.486 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/usr/bin/stdin-killer 2024-04-16T17:43:46.520 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-16T17:43:46.591 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T17:43:47.338 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-16T17:43:47.338 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2024-04-16T17:43:47.341 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 777 /var/log/ceph 2024-04-16T17:43:47.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2024-04-16T17:43:47.346 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 777 /var/log/ceph 2024-04-16T17:43:47.378 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-16T17:43:47.379 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T17:43:47.414 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T17:43:47.416 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T17:43:47.418 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-16T17:43:47.450 INFO:tasks.ceph:Creating extra log directories... 2024-04-16T17:43:47.450 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T17:43:47.485 DEBUG:teuthology.orchestra.run.smithi023:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T17:43:47.487 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T17:43:47.490 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-16T17:43:47.534 INFO:tasks.ceph:Creating ceph cluster c1... 2024-04-16T17:43:47.534 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T17:43:47.534 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'branch': 'main', 'description': 'rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi}', 'email': None, 'first_in_suite': False, 'job_id': '7658453', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'enabled_features': ['resharding', 'notification_v2'], 'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', '-a', '!fails_on_rgw']}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-shilpa-multisite-tests', 'sha1': '9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b'}}, 'owner': 'scheduled_smanjara@teuthology', 'priority': 49, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'], ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'], ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1']], 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086', 'sleep_before_teardown': 0, 'suite': 'rgw:multisite', 'suite_branch': 'wip-shilpa-multisite-tests', 'suite_path': '/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/smanjara/ceph.git', 'suite_sha1': '9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b', 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbhFbfUsKQldVun2nyGgdUcxSnkO0dWqgM/8o0lch1swrFSDpkiNLHoyQ8jxNuLso55iNbZL9yHW2F90mt4jQQ=', 'smithi023.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETZAltJ2haRKB4RlEtM1MtPT+J4723FrQyUMS0cu+dC1jkEAEg1AAEI8ysymgZCpJbSe7qHlg7SwKqTMZDCLA8=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXA/cgWiNXvC2RpsWgXcNglJBHLTfHxwCoHukkjJ7i1n3zkwrq0Nx89+pfrE0YXL75R19B3TbtAv9p80WLLRAo=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFP0QhDxCGQBJtiU86raG03uAHphji0IvPattOmP2ns/ZRTymOGSWzExkAuXkT7f6SOsBHlYulXlQvBVjsn+Ypw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}}, {'ceph': {'cluster': 'c2'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 90}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_17:24:34', 'tube': 'smithi', 'user': 'smanjara', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T17:43:47.535 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-16T17:43:47.555 DEBUG:teuthology.orchestra.run.smithi023:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-16T17:43:47.557 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-16T17:43:47.561 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2024-04-16T17:43:47.578 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:43:47.610 DEBUG:teuthology.orchestra.run.smithi023:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:43:47.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:43:47.618 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:43:47.648 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:47.648 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T17:43:47.694 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T17:43:47.694 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2024-04-16T17:43:47.750 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T17:43:47.750 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:47.751 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-16T17:43:47.751 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:47.751 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:47.751 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-16 17:43:36.070162907 +0000 2024-04-16T17:43:47.751 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-16 17:40:35.972879581 +0000 2024-04-16T17:43:47.751 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-16 17:40:35.972879581 +0000 2024-04-16T17:43:47.751 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-16 17:40:35.972879581 +0000 2024-04-16T17:43:47.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T17:43:47.818 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-16T17:43:47.819 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-16T17:43:47.819 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 9.5815e-05 s, 5.3 MB/s 2024-04-16T17:43:47.820 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T17:43:47.877 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2024-04-16T17:43:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T17:43:47.933 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:47.933 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-16T17:43:47.933 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:47.933 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:47.933 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-16 17:43:36.070162907 +0000 2024-04-16T17:43:47.933 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-16 17:40:36.322873957 +0000 2024-04-16T17:43:47.934 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-16 17:40:36.322873957 +0000 2024-04-16T17:43:47.934 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-16 17:40:36.322873957 +0000 2024-04-16T17:43:47.934 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T17:43:48.000 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-16T17:43:48.001 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-16T17:43:48.001 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 8.0529e-05 s, 6.4 MB/s 2024-04-16T17:43:48.002 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T17:43:48.058 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2024-04-16T17:43:48.114 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T17:43:48.114 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:48.114 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-16T17:43:48.114 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:48.114 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:48.114 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-16 17:43:36.071162891 +0000 2024-04-16T17:43:48.114 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-16 17:40:36.658868560 +0000 2024-04-16T17:43:48.115 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-16 17:40:36.658868560 +0000 2024-04-16T17:43:48.115 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-16 17:40:36.658868560 +0000 2024-04-16T17:43:48.115 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T17:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-16T17:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-16T17:43:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 9.8589e-05 s, 5.2 MB/s 2024-04-16T17:43:48.182 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T17:43:48.238 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2024-04-16T17:43:48.293 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T17:43:48.293 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:48.293 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-16T17:43:48.293 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:48.293 INFO:teuthology.orchestra.run.smithi016.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:48.294 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2024-04-16 17:43:36.071162891 +0000 2024-04-16T17:43:48.294 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2024-04-16 17:40:36.985863306 +0000 2024-04-16T17:43:48.294 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2024-04-16 17:40:36.985863306 +0000 2024-04-16T17:43:48.294 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2024-04-16 17:40:36.985863306 +0000 2024-04-16T17:43:48.294 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T17:43:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2024-04-16T17:43:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2024-04-16T17:43:48.359 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 9.2499e-05 s, 5.5 MB/s 2024-04-16T17:43:48.360 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T17:43:48.416 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:43:48.416 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:43:48.416 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T17:43:48.435 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T17:43:48.435 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_1 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-04-16 17:43:30.966372779 +0000 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-04-16 17:40:46.247802461 +0000 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-04-16 17:40:46.247802461 +0000 2024-04-16T17:43:48.493 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-04-16 17:40:46.247802461 +0000 2024-04-16T17:43:48.494 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T17:43:48.563 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-04-16T17:43:48.564 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-04-16T17:43:48.564 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.000295074 s, 1.7 MB/s 2024-04-16T17:43:48.565 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T17:43:48.623 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_2 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-04-16 17:43:30.966372779 +0000 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-04-16 17:40:46.617800123 +0000 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-04-16 17:40:46.617800123 +0000 2024-04-16T17:43:48.680 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-04-16 17:40:46.617800123 +0000 2024-04-16T17:43:48.681 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T17:43:48.751 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-04-16T17:43:48.751 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-04-16T17:43:48.751 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.000265727 s, 1.9 MB/s 2024-04-16T17:43:48.752 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T17:43:48.826 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_3 2024-04-16T17:43:48.888 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T17:43:48.888 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:48.888 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-16T17:43:48.888 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:48.888 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:48.888 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-04-16 17:43:30.967372772 +0000 2024-04-16T17:43:48.889 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-04-16 17:40:46.960797957 +0000 2024-04-16T17:43:48.889 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-04-16 17:40:46.960797957 +0000 2024-04-16T17:43:48.889 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-04-16 17:40:46.960797957 +0000 2024-04-16T17:43:48.889 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T17:43:48.959 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-04-16T17:43:48.960 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-04-16T17:43:48.960 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.000270295 s, 1.9 MB/s 2024-04-16T17:43:48.961 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T17:43:49.020 DEBUG:teuthology.orchestra.run.smithi023:> stat /dev/vg_nvme/lv_4 2024-04-16T17:43:49.081 INFO:teuthology.orchestra.run.smithi023.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T17:43:49.081 INFO:teuthology.orchestra.run.smithi023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:43:49.081 INFO:teuthology.orchestra.run.smithi023.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-16T17:43:49.081 INFO:teuthology.orchestra.run.smithi023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:43:49.081 INFO:teuthology.orchestra.run.smithi023.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:43:49.081 INFO:teuthology.orchestra.run.smithi023.stdout:Access: 2024-04-16 17:43:30.967372772 +0000 2024-04-16T17:43:49.081 INFO:teuthology.orchestra.run.smithi023.stdout:Modify: 2024-04-16 17:40:47.316795708 +0000 2024-04-16T17:43:49.082 INFO:teuthology.orchestra.run.smithi023.stdout:Change: 2024-04-16 17:40:47.316795708 +0000 2024-04-16T17:43:49.082 INFO:teuthology.orchestra.run.smithi023.stdout: Birth: 2024-04-16 17:40:47.316795708 +0000 2024-04-16T17:43:49.082 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T17:43:49.150 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records in 2024-04-16T17:43:49.150 INFO:teuthology.orchestra.run.smithi023.stderr:1+0 records out 2024-04-16T17:43:49.150 INFO:teuthology.orchestra.run.smithi023.stderr:512 bytes copied, 0.00028581 s, 1.8 MB/s 2024-04-16T17:43:49.151 DEBUG:teuthology.orchestra.run.smithi023:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T17:43:49.207 INFO:tasks.ceph:osd dev map: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:43:49.208 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi023.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-16T17:43:49.208 INFO:tasks.ceph:Generating config... 2024-04-16T17:43:49.222 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-16T17:43:49.222 INFO:tasks.ceph:[client] debug rgw lifecycle = 20 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] debug rgw sync = 20 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw data log num shards = 4 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw data sync poll interval = 5 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw md log max shards = 4 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw meta sync poll interval = 5 2024-04-16T17:43:49.223 INFO:tasks.ceph:[client] rgw sync data inject err probability = 0.1 2024-04-16T17:43:49.224 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2024-04-16T17:43:49.224 INFO:tasks.ceph:[client] rgw sync meta inject err probability = 0.1 2024-04-16T17:43:49.224 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2024-04-16T17:43:49.224 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-16T17:43:49.224 INFO:tasks.ceph:[client] setuser = ceph 2024-04-16T17:43:49.224 INFO:tasks.ceph:[client.0] rgw data notify interval msec = 0 2024-04-16T17:43:49.224 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T17:43:49.224 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T17:43:49.224 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T17:43:49.224 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T17:43:49.224 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T17:43:49.225 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T17:43:49.225 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T17:43:49.225 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2024-04-16T17:43:49.225 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2024-04-16T17:43:49.225 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2024-04-16T17:43:49.225 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2024-04-16T17:43:49.225 INFO:tasks.ceph:Setting up c1.mon.a... 2024-04-16T17:43:49.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2024-04-16T17:43:49.282 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/c1.keyring 2024-04-16T17:43:49.285 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2024-04-16T17:43:49.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-16T17:43:49.363 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.16')] 2024-04-16T17:43:49.364 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'client.0': {'rgw data notify interval msec': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2024-04-16T17:43:49.365 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:49.365 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T17:43:49.419 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --print /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:49.499 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:43:49.499 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 5a17fdec-f013-46d8-9b9d-5b1671d92bcc 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = quincy 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 5a17fdec-f013-46d8-9b9d-5b1671d92bcc 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2024-04-16T17:43:49.502240+0000 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:created 2024-04-16T17:43:49.502240+0000 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 17 (quincy) 2024-04-16T17:43:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2024-04-16T17:43:49.501 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2024-04-16T17:43:49.501 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2024-04-16T17:43:49.502 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T17:43:49.557 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 5a17fdec-f013-46d8-9b9d-5b1671d92bcc... 2024-04-16T17:43:49.558 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-16T17:43:49.600 DEBUG:teuthology.orchestra.run.smithi023:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-16T17:43:49.602 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-16T17:43:49.604 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.651 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.652 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.653 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = 172.21.15.16 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 5a17fdec-f013-46d8-9b9d-5b1671d92bcc 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.654 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-16T17:43:49.655 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: rocksdb delete range threshold = 0 2024-04-16T17:43:49.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-16T17:43:49.657 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:43:49.658 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw = 20 2024-04-16T17:43:49.659 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw lifecycle = 20 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw notification = 20 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw sync = 20 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt require ssl = False 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw curl low speed time = 300 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw data log num shards = 4 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw data sync poll interval = 5 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw md log max shards = 4 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw meta sync poll interval = 5 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync log trim interval = 0 2024-04-16T17:43:49.660 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync obj etag verify = True 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: setgroup = ceph 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: setuser = ceph 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: rgw data notify interval msec = 0 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-16T17:43:49.661 INFO:teuthology.orchestra.run.smithi016.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout:[global] 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: chdir = "" 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: auth supported = cephx 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: filestore xattr use omap = true 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: mon clock drift allowed = 1.000 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.662 INFO:teuthology.orchestra.run.smithi023.stdout: osd crush chooseleaf type = 0 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: auth debug = true 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: ms die on old message = true 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: ms die on bug = true 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: mon pg warn max object skew = 0 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: osd pool default size = 2 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.663 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd allow primary affinity = true 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd allow pg remap = true 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on no sortbitwise = false 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on too few osds = false 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: mon_allow_pool_size_one = true 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.664 INFO:teuthology.orchestra.run.smithi023.stdout: osd default data pool replay window = 5 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: mon allow pool delete = true 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: mon cluster log file level = debug 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: debug asserts on shutdown = true 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: mon health detail to clog = false 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: mon host = 172.21.15.16 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: fsid = 5a17fdec-f013-46d8-9b9d-5b1671d92bcc 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout:[osd] 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: osd journal size = 100 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: osd scrub load threshold = 5.0 2024-04-16T17:43:49.665 INFO:teuthology.orchestra.run.smithi023.stdout: osd scrub max interval = 600 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd recover clone overlap = true 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd recovery max chunk = 1048576 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug shutdown = true 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug op order = true 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug verify stray on activate = true 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug trim objects = true 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd open classes on start = true 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug pg log writeout = true 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.666 INFO:teuthology.orchestra.run.smithi023.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: osd map max advance = 10 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: journal zero on create = true 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: filestore apply finisher threads = 3 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: bdev debug aio = true 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug misdirected ops = true 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: debug ms = 1 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: debug osd = 20 2024-04-16T17:43:49.667 INFO:teuthology.orchestra.run.smithi023.stdout: rocksdb delete range threshold = 0 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout:[mgr] 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: debug ms = 1 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: debug mgr = 20 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: debug mon = 20 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: debug auth = 20 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: mgr/telemetry/nag = false 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.668 INFO:teuthology.orchestra.run.smithi023.stdout:[mon] 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: debug ms = 1 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: debug mon = 20 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: debug paxos = 20 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: debug auth = 20 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: mon data avail warn = 5 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: mon mgr mkfs grace = 240 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd reporter subtree level = osd 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd prime pg temp = true 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:43:49.669 INFO:teuthology.orchestra.run.smithi023.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: # 1m isn't quite enough 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout:[client] 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: rgw cache enabled = true 2024-04-16T17:43:49.670 INFO:teuthology.orchestra.run.smithi023.stdout: rgw enable ops log = true 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw enable usage log = true 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw = 20 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw lifecycle = 20 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw notification = 20 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw sync = 20 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw crypt require ssl = False 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw curl low speed time = 300 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw data log num shards = 4 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw data sync poll interval = 5 2024-04-16T17:43:49.671 INFO:teuthology.orchestra.run.smithi023.stdout: rgw md log max shards = 4 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: rgw meta sync poll interval = 5 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync log trim interval = 0 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync obj etag verify = True 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: setgroup = ceph 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: setuser = ceph 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout:[mon.a] 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout:[client.0] 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: rgw data notify interval msec = 0 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout:[osd.0] 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout:[osd.1] 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:43:49.672 INFO:teuthology.orchestra.run.smithi023.stdout:[osd.2] 2024-04-16T17:43:49.673 INFO:teuthology.orchestra.run.smithi023.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:43:49.673 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-04-16T17:43:49.673 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-04-16T17:43:49.674 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:43:49.675 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-04-16T17:43:49.676 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = 172.21.15.16 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 5a17fdec-f013-46d8-9b9d-5b1671d92bcc 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-04-16T17:43:49.677 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug trim objects = true 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-04-16T17:43:49.678 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: rocksdb delete range threshold = 0 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-04-16T17:43:49.679 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-04-16T17:43:49.680 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:43:49.681 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw = 20 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw lifecycle = 20 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw notification = 20 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw sync = 20 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: rgw crypt require ssl = False 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:43:49.682 INFO:teuthology.orchestra.run.smithi163.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw curl low speed time = 300 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw data log num shards = 4 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw data sync poll interval = 5 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw md log max shards = 4 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw meta sync poll interval = 5 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync log trim interval = 0 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync obj etag verify = True 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: setgroup = ceph 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: setuser = ceph 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout: rgw data notify interval msec = 0 2024-04-16T17:43:49.683 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi163.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi163.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi163.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-04-16T17:43:49.684 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:43:49.685 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:43:49.686 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-04-16T17:43:49.687 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = 172.21.15.16 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 5a17fdec-f013-46d8-9b9d-5b1671d92bcc 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-04-16T17:43:49.688 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.689 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: rocksdb delete range threshold = 0 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-16T17:43:49.690 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-04-16T17:43:49.691 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-04-16T17:43:49.692 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw = 20 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw lifecycle = 20 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw notification = 20 2024-04-16T17:43:49.693 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw sync = 20 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw crypt require ssl = False 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw curl low speed time = 300 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw data log num shards = 4 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw data sync poll interval = 5 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw md log max shards = 4 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw meta sync poll interval = 5 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync log trim interval = 0 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync obj etag verify = True 2024-04-16T17:43:49.694 INFO:teuthology.orchestra.run.smithi139.stdout: setgroup = ceph 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: setuser = ceph 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: rgw data notify interval msec = 0 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-04-16T17:43:49.695 INFO:teuthology.orchestra.run.smithi139.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:43:49.697 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2024-04-16T17:43:49.698 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2024-04-16T17:43:49.794 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T17:43:49.794 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:49.794 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2024-04-16T17:43:49.809 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:49.809 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2024-04-16T17:43:49.864 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T17:43:49.864 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:49.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/c1.keyring 2024-04-16T17:43:49.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-16T17:43:49.945 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:43:49.945 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:50.001 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T17:43:50.001 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:43:50.001 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/ceph/c1.keyring 2024-04-16T17:43:50.001 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-16T17:43:50.044 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:43:50.044 DEBUG:teuthology.orchestra.run.smithi023:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:50.100 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T17:43:50.100 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:43:50.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/c1.keyring 2024-04-16T17:43:50.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-16T17:43:50.147 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:43:50.147 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:50.206 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T17:43:50.206 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:43:50.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/c1.keyring 2024-04-16T17:43:50.206 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/c1.keyring 2024-04-16T17:43:50.254 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:43:50.254 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:50.311 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T17:43:50.311 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T17:43:50.312 DEBUG:teuthology.orchestra.run.smithi023:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2024-04-16T17:43:50.382 INFO:teuthology.orchestra.run.smithi023.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2024-04-16T17:43:50.385 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T17:43:50.385 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T17:43:50.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2024-04-16T17:43:50.429 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/c1.client.0.keyring 2024-04-16T17:43:50.446 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c1.client.1.keyring && sudo chmod 0644 /etc/ceph/c1.client.1.keyring 2024-04-16T17:43:50.490 INFO:teuthology.orchestra.run.smithi023.stdout:creating /etc/ceph/c1.client.1.keyring 2024-04-16T17:43:50.506 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T17:43:50.506 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi023.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-16T17:43:50.506 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2024-04-16T17:43:50.534 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:43:50.534 INFO:tasks.ceph:role: c1.osd.0 2024-04-16T17:43:50.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T17:43:50.534 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T17:43:50.602 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:43:50.602 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:43:50.602 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:43:50.603 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:43:50.603 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:43:50.603 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:43:50.603 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:43:50.603 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:43:50.603 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:43:50.603 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:43:50.644 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-16T17:43:50.646 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-16T17:43:50.647 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2024-04-16T17:43:50.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2024-04-16T17:43:50.792 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2024-04-16T17:43:50.861 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:43:50.861 INFO:tasks.ceph:role: c1.osd.1 2024-04-16T17:43:50.861 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T17:43:50.861 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:43:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:43:50.968 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-16T17:43:50.970 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-16T17:43:50.970 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2024-04-16T17:43:51.043 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2024-04-16T17:43:51.116 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2024-04-16T17:43:51.184 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:43:51.184 INFO:tasks.ceph:role: c1.osd.2 2024-04-16T17:43:51.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T17:43:51.185 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T17:43:51.252 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:43:51.253 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:43:51.291 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2024-04-16T17:43:51.293 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2024-04-16T17:43:51.293 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2024-04-16T17:43:51.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2024-04-16T17:43:51.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:51.542+0000 7f8788210640 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2024-04-16T17:43:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:51.542+0000 7f8788210640 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2024-04-16T17:43:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:51.542+0000 7f8788210640 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2024-04-16T17:43:51.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:51.542+0000 7f8788210640 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2024-04-16T17:43:51.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:51.542+0000 7f8788210640 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2024-04-16T17:43:51.543 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:51.543+0000 7f8788210640 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2024-04-16T17:43:53.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2024-04-16T17:43:53.660 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:53.753+0000 7f9a6d49b640 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2024-04-16T17:43:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:53.754+0000 7f9a6d49b640 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2024-04-16T17:43:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:53.754+0000 7f9a6d49b640 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2024-04-16T17:43:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:53.754+0000 7f9a6d49b640 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2024-04-16T17:43:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:53.754+0000 7f9a6d49b640 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2024-04-16T17:43:53.754 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:53.754+0000 7f9a6d49b640 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2024-04-16T17:43:55.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2024-04-16T17:43:55.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:43:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:55.958+0000 7fc8cfbac640 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2024-04-16T17:43:55.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:55.958+0000 7fc8cfbac640 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2024-04-16T17:43:55.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:55.958+0000 7fc8cfbac640 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2024-04-16T17:43:55.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:55.958+0000 7fc8cfbac640 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2024-04-16T17:43:55.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:55.958+0000 7fc8cfbac640 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2024-04-16T17:43:55.958 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:43:55.959+0000 7fc8cfbac640 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2024-04-16T17:43:58.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2024-04-16T17:43:58.071 DEBUG:teuthology.orchestra.run.smithi023:> sudo mkdir -p /var/lib/ceph/osd/c1-3 2024-04-16T17:43:58.105 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:43:58.105 INFO:tasks.ceph:role: c1.osd.3 2024-04-16T17:43:58.105 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T17:43:58.105 DEBUG:teuthology.orchestra.run.smithi023:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T17:43:58.204 INFO:teuthology.orchestra.run.smithi023.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:43:58.204 INFO:teuthology.orchestra.run.smithi023.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:43:58.204 INFO:teuthology.orchestra.run.smithi023.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:43:58.205 INFO:teuthology.orchestra.run.smithi023.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:43:58.205 INFO:teuthology.orchestra.run.smithi023.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:43:58.205 INFO:teuthology.orchestra.run.smithi023.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:43:58.205 INFO:teuthology.orchestra.run.smithi023.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:43:58.205 INFO:teuthology.orchestra.run.smithi023.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:43:58.205 INFO:teuthology.orchestra.run.smithi023.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:43:58.205 INFO:teuthology.orchestra.run.smithi023.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:43:59.526 INFO:teuthology.orchestra.run.smithi023.stdout:Discarding blocks...Done. 2024-04-16T17:43:59.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi023.front.sepia.ceph.com -o noatime 2024-04-16T17:43:59.528 DEBUG:teuthology.orchestra.run.smithi023:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-3 2024-04-16T17:43:59.568 DEBUG:teuthology.orchestra.run.smithi023:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-3 2024-04-16T17:43:59.644 DEBUG:teuthology.orchestra.run.smithi023:> sudo mkdir -p /var/lib/ceph/osd/c1-4 2024-04-16T17:43:59.715 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:43:59.715 INFO:tasks.ceph:role: c1.osd.4 2024-04-16T17:43:59.715 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T17:43:59.715 DEBUG:teuthology.orchestra.run.smithi023:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T17:43:59.813 INFO:teuthology.orchestra.run.smithi023.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:43:59.813 INFO:teuthology.orchestra.run.smithi023.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:43:59.813 INFO:teuthology.orchestra.run.smithi023.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:43:59.813 INFO:teuthology.orchestra.run.smithi023.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:43:59.813 INFO:teuthology.orchestra.run.smithi023.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:43:59.814 INFO:teuthology.orchestra.run.smithi023.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:43:59.814 INFO:teuthology.orchestra.run.smithi023.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:43:59.814 INFO:teuthology.orchestra.run.smithi023.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:43:59.814 INFO:teuthology.orchestra.run.smithi023.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:43:59.814 INFO:teuthology.orchestra.run.smithi023.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:01.130 INFO:teuthology.orchestra.run.smithi023.stdout:Discarding blocks...Done. 2024-04-16T17:44:01.132 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi023.front.sepia.ceph.com -o noatime 2024-04-16T17:44:01.132 DEBUG:teuthology.orchestra.run.smithi023:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-4 2024-04-16T17:44:01.175 DEBUG:teuthology.orchestra.run.smithi023:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-4 2024-04-16T17:44:01.248 DEBUG:teuthology.orchestra.run.smithi023:> sudo mkdir -p /var/lib/ceph/osd/c1-5 2024-04-16T17:44:01.316 INFO:tasks.ceph:roles_to_devs: {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:01.316 INFO:tasks.ceph:role: c1.osd.5 2024-04-16T17:44:01.316 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T17:44:01.316 DEBUG:teuthology.orchestra.run.smithi023:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:44:01.412 INFO:teuthology.orchestra.run.smithi023.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:02.752 INFO:teuthology.orchestra.run.smithi023.stdout:Discarding blocks...Done. 2024-04-16T17:44:02.755 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi023.front.sepia.ceph.com -o noatime 2024-04-16T17:44:02.755 DEBUG:teuthology.orchestra.run.smithi023:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-5 2024-04-16T17:44:02.793 DEBUG:teuthology.orchestra.run.smithi023:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-5 2024-04-16T17:44:02.869 DEBUG:teuthology.orchestra.run.smithi023:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:44:02.976 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:02.978+0000 7f5d20547640 -1 auth: error reading file: /var/lib/ceph/osd/c1-3/keyring: can't open /var/lib/ceph/osd/c1-3/keyring: (2) No such file or directory 2024-04-16T17:44:02.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:02.978+0000 7f5d20547640 -1 created new key in keyring /var/lib/ceph/osd/c1-3/keyring 2024-04-16T17:44:02.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:02.978+0000 7f5d20547640 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2024-04-16T17:44:02.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:02.978+0000 7f5d20547640 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2024-04-16T17:44:02.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:02.978+0000 7f5d20547640 -1 bluestore(/var/lib/ceph/osd/c1-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-3/block: (2) No such file or directory 2024-04-16T17:44:02.977 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:02.979+0000 7f5d20547640 -1 bluestore(/var/lib/ceph/osd/c1-3) _read_fsid unparsable uuid 2024-04-16T17:44:05.078 DEBUG:teuthology.orchestra.run.smithi023:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-3 2024-04-16T17:44:05.111 DEBUG:teuthology.orchestra.run.smithi023:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:44:05.205 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:05.207+0000 7fe441a15640 -1 auth: error reading file: /var/lib/ceph/osd/c1-4/keyring: can't open /var/lib/ceph/osd/c1-4/keyring: (2) No such file or directory 2024-04-16T17:44:05.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:05.207+0000 7fe441a15640 -1 created new key in keyring /var/lib/ceph/osd/c1-4/keyring 2024-04-16T17:44:05.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:05.207+0000 7fe441a15640 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2024-04-16T17:44:05.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:05.207+0000 7fe441a15640 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2024-04-16T17:44:05.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:05.207+0000 7fe441a15640 -1 bluestore(/var/lib/ceph/osd/c1-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-4/block: (2) No such file or directory 2024-04-16T17:44:05.206 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:05.208+0000 7fe441a15640 -1 bluestore(/var/lib/ceph/osd/c1-4) _read_fsid unparsable uuid 2024-04-16T17:44:07.314 DEBUG:teuthology.orchestra.run.smithi023:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-4 2024-04-16T17:44:07.346 DEBUG:teuthology.orchestra.run.smithi023:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:44:07.439 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:07.441+0000 7fa611611640 -1 auth: error reading file: /var/lib/ceph/osd/c1-5/keyring: can't open /var/lib/ceph/osd/c1-5/keyring: (2) No such file or directory 2024-04-16T17:44:07.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:07.442+0000 7fa611611640 -1 created new key in keyring /var/lib/ceph/osd/c1-5/keyring 2024-04-16T17:44:07.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:07.442+0000 7fa611611640 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2024-04-16T17:44:07.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:07.442+0000 7fa611611640 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2024-04-16T17:44:07.440 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:07.442+0000 7fa611611640 -1 bluestore(/var/lib/ceph/osd/c1-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-5/block: (2) No such file or directory 2024-04-16T17:44:07.441 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:44:07.443+0000 7fa611611640 -1 bluestore(/var/lib/ceph/osd/c1-5) _read_fsid unparsable uuid 2024-04-16T17:44:09.542 DEBUG:teuthology.orchestra.run.smithi023:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-5 2024-04-16T17:44:09.575 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T17:44:09.575 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:09.575 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2024-04-16T17:44:09.609 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:09.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2024-04-16T17:44:09.681 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:09.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2024-04-16T17:44:09.752 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:09.752 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2024-04-16T17:44:09.785 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:09.785 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/osd/c1-3/keyring of=/dev/stdout 2024-04-16T17:44:09.858 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:09.858 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/osd/c1-4/keyring of=/dev/stdout 2024-04-16T17:44:09.930 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:09.930 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/osd/c1-5/keyring of=/dev/stdout 2024-04-16T17:44:10.001 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:10.001 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2024-04-16T17:44:10.019 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:10.019 DEBUG:teuthology.orchestra.run.smithi023:> dd if=/etc/ceph/c1.client.1.keyring of=/dev/stdout 2024-04-16T17:44:10.058 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T17:44:10.058 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/c1.keyring 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDXuB5mblpxIBAASLzkoDue3VdnjBmA3e7AJQ== 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDZuB5mGawMLRAAYVOWcaRjzeuWn7GJjrq8dw== 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDbuB5m8nkxORAAzyCBoZXtaE+Y1gWBhZlLjw== 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDWuB5mG6TtFhAAXj2dVd/ZpWl0bDkfxwDbqg== 2024-04-16T17:44:10.090 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDiuB5mtKRUOhAAZHBIy0xQY7GU3CFq106+9A== 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDluB5mPNpiDBAA5e8aFZ+S2Zahgm+LPDv+cA== 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDnuB5mqSxcGhAA6U+gyEqPoCpWA95UzCwD3A== 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDWuB5mNC7CGRAA+RQfrLtEXLSUKp7kZ3kZ6A== 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2024-04-16T17:44:10.091 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQDWuB5mczZhHRAAtHFXDm7uulwiC25lBMAxQQ== 2024-04-16T17:44:10.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:10.190 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:10.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:10.299 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T17:44:10.353 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:10.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:10.458 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:10.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T17:44:10.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T17:44:10.625 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T17:44:10.625 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2024-04-16T17:44:10.652 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2024-04-16T17:44:10.750 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2024-04-16T17:44:10.778 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/c1.monmap 2024-04-16T17:44:10.833 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2024-04-16T17:44:10.834 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2024-04-16T17:44:10.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2024-04-16T17:44:10.876 INFO:tasks.ceph.c1.mon.a:Started 2024-04-16T17:44:10.876 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2024-04-16T17:44:10.876 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2024-04-16T17:44:10.876 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2024-04-16T17:44:10.878 INFO:tasks.ceph.c1.mgr.x:Started 2024-04-16T17:44:10.879 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T17:44:10.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster c1 osd crush tunables default 2024-04-16T17:44:11.057 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2024-04-16T17:44:11.068 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T17:44:11.068 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2024-04-16T17:44:11.069 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:11.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2024-04-16T17:44:11.096 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:11.096 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2024-04-16T17:44:11.164 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:11.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2024-04-16T17:44:11.232 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:11.232 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/osd/c1-3/fsid of=/dev/stdout 2024-04-16T17:44:11.260 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:11.260 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/osd/c1-4/fsid of=/dev/stdout 2024-04-16T17:44:11.328 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:11.328 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd if=/var/lib/ceph/osd/c1-5/fsid of=/dev/stdout 2024-04-16T17:44:11.396 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph --cluster c1 osd new b9330710-cd51-41be-a800-9a62853fcbef 0 2024-04-16T17:44:11.466 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:11.468+0000 7f7978852040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T17:44:11.523 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:11.524+0000 7f7978852040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T17:44:11.621 INFO:teuthology.orchestra.run.smithi023.stdout:0 2024-04-16T17:44:11.633 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph --cluster c1 osd new fff6601f-7171-4f90-96fa-7797fd3cbf1b 1 2024-04-16T17:44:11.859 INFO:teuthology.orchestra.run.smithi023.stdout:1 2024-04-16T17:44:11.871 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph --cluster c1 osd new 05b27816-aed9-4771-90a5-7cccae7f5301 2 2024-04-16T17:44:12.057 INFO:teuthology.orchestra.run.smithi023.stdout:2 2024-04-16T17:44:12.068 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph --cluster c1 osd new 624812b4-4b0d-47d9-a062-2fca11a9094b 3 2024-04-16T17:44:12.085 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.087+0000 7f7978852040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T17:44:12.144 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.145+0000 7f7978852040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T17:44:12.191 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.193+0000 7f7978852040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T17:44:12.247 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.249+0000 7f7978852040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T17:44:12.254 INFO:teuthology.orchestra.run.smithi023.stdout:3 2024-04-16T17:44:12.265 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph --cluster c1 osd new 66f06127-813c-4e57-bf5d-994dc1afcd1e 4 2024-04-16T17:44:12.292 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.294+0000 7f7978852040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T17:44:12.417 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.419+0000 7f7978852040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T17:44:12.477 INFO:teuthology.orchestra.run.smithi023.stdout:4 2024-04-16T17:44:12.489 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph --cluster c1 osd new 29d6da0e-9853-43c9-a4ef-21e94efb9723 5 2024-04-16T17:44:12.492 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.493+0000 7f7978852040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T17:44:12.540 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.542+0000 7f7978852040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T17:44:12.596 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.598+0000 7f7978852040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T17:44:12.646 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:12.648+0000 7f7978852040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T17:44:12.674 INFO:teuthology.orchestra.run.smithi023.stdout:5 2024-04-16T17:44:12.685 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2024-04-16T17:44:12.686 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2024-04-16T17:44:12.688 INFO:tasks.ceph.c1.osd.0:Started 2024-04-16T17:44:12.689 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2024-04-16T17:44:12.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2024-04-16T17:44:12.691 INFO:tasks.ceph.c1.osd.1:Started 2024-04-16T17:44:12.692 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2024-04-16T17:44:12.692 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2024-04-16T17:44:12.694 INFO:tasks.ceph.c1.osd.2:Started 2024-04-16T17:44:12.694 INFO:tasks.ceph.c1.osd.3:Restarting daemon 2024-04-16T17:44:12.694 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 3 2024-04-16T17:44:12.696 INFO:tasks.ceph.c1.osd.3:Started 2024-04-16T17:44:12.696 INFO:tasks.ceph.c1.osd.4:Restarting daemon 2024-04-16T17:44:12.696 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 4 2024-04-16T17:44:12.698 INFO:tasks.ceph.c1.osd.4:Started 2024-04-16T17:44:12.699 INFO:tasks.ceph.c1.osd.5:Restarting daemon 2024-04-16T17:44:12.699 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 5 2024-04-16T17:44:12.701 INFO:tasks.ceph.c1.osd.5:Started 2024-04-16T17:44:12.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-16T17:44:12.888 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:12.889 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"fsid":"5a17fdec-f013-46d8-9b9d-5b1671d92bcc","created":"2024-04-16T17:44:10.966929+0000","modified":"2024-04-16T17:44:12.675987+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T17:44:12.675987+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b9330710-cd51-41be-a800-9a62853fcbef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fff6601f-7171-4f90-96fa-7797fd3cbf1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"05b27816-aed9-4771-90a5-7cccae7f5301","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"624812b4-4b0d-47d9-a062-2fca11a9094b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"66f06127-813c-4e57-bf5d-994dc1afcd1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"29d6da0e-9853-43c9-a4ef-21e94efb9723","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:12.900 INFO:tasks.ceph.ceph_manager.c1:[] 2024-04-16T17:44:12.900 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T17:44:13.049 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.050+0000 7f7978852040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T17:44:13.189 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.191+0000 7f7978852040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T17:44:13.292 INFO:tasks.ceph.c1.osd.3.smithi023.stderr:2024-04-16T17:44:13.294+0000 7f951b20f640 -1 Falling back to public interface 2024-04-16T17:44:13.296 INFO:tasks.ceph.c1.osd.4.smithi023.stderr:2024-04-16T17:44:13.298+0000 7f0480822640 -1 Falling back to public interface 2024-04-16T17:44:13.297 INFO:tasks.ceph.c1.osd.0.smithi016.stderr:2024-04-16T17:44:13.298+0000 7effa6210640 -1 Falling back to public interface 2024-04-16T17:44:13.298 INFO:tasks.ceph.c1.osd.1.smithi016.stderr:2024-04-16T17:44:13.299+0000 7f563c8c8640 -1 Falling back to public interface 2024-04-16T17:44:13.300 INFO:tasks.ceph.c1.osd.2.smithi016.stderr:2024-04-16T17:44:13.301+0000 7fc211615640 -1 Falling back to public interface 2024-04-16T17:44:13.302 INFO:tasks.ceph.c1.osd.5.smithi023.stderr:2024-04-16T17:44:13.303+0000 7fe2bea24640 -1 Falling back to public interface 2024-04-16T17:44:13.313 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.315+0000 7f7978852040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T17:44:13.361 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.362+0000 7f7978852040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T17:44:13.479 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.480+0000 7f7978852040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T17:44:13.504 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2024-04-16T17:44:13.577 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.579+0000 7f7978852040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T17:44:13.673 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-16T17:44:13.673 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":8,"fsid":"5a17fdec-f013-46d8-9b9d-5b1671d92bcc","created":"2024-04-16T17:44:10.966929+0000","modified":"2024-04-16T17:44:12.675987+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T17:44:12.675987+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b9330710-cd51-41be-a800-9a62853fcbef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fff6601f-7171-4f90-96fa-7797fd3cbf1b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"05b27816-aed9-4771-90a5-7cccae7f5301","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"624812b4-4b0d-47d9-a062-2fca11a9094b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"66f06127-813c-4e57-bf5d-994dc1afcd1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"29d6da0e-9853-43c9-a4ef-21e94efb9723","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:13.683 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-04-16T17:44:13.739 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.741+0000 7f7978852040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T17:44:13.783 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.785+0000 7f7978852040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T17:44:13.946 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:13.948+0000 7f7978852040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T17:44:14.787 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:14.789+0000 7f7978852040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T17:44:15.073 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:15.075+0000 7f7978852040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T17:44:15.126 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:15.128+0000 7f7978852040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T17:44:15.247 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:15.249+0000 7f7978852040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T17:44:15.962 INFO:tasks.ceph.c1.osd.0.smithi016.stderr:2024-04-16T17:44:15.963+0000 7effa6210640 -1 osd.0 0 log_to_monitors true 2024-04-16T17:44:15.999 INFO:tasks.ceph.c1.osd.4.smithi023.stderr:2024-04-16T17:44:16.000+0000 7f0480822640 -1 osd.4 0 log_to_monitors true 2024-04-16T17:44:16.009 INFO:tasks.ceph.c1.osd.1.smithi016.stderr:2024-04-16T17:44:16.010+0000 7f563c8c8640 -1 osd.1 0 log_to_monitors true 2024-04-16T17:44:16.011 INFO:tasks.ceph.c1.osd.2.smithi016.stderr:2024-04-16T17:44:16.012+0000 7fc211615640 -1 osd.2 0 log_to_monitors true 2024-04-16T17:44:16.020 INFO:tasks.ceph.c1.osd.5.smithi023.stderr:2024-04-16T17:44:16.022+0000 7fe2bea24640 -1 osd.5 0 log_to_monitors true 2024-04-16T17:44:16.030 INFO:tasks.ceph.c1.osd.3.smithi023.stderr:2024-04-16T17:44:16.032+0000 7f951b20f640 -1 osd.3 0 log_to_monitors true 2024-04-16T17:44:16.256 INFO:tasks.ceph.c1.mgr.x.smithi023.stderr:2024-04-16T17:44:16.257+0000 7f7919551640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-16T17:44:18.113 INFO:tasks.ceph.c1.osd.0.smithi016.stderr:2024-04-16T17:44:18.114+0000 7effa1ac6640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T17:44:18.151 INFO:tasks.ceph.c1.osd.1.smithi016.stderr:2024-04-16T17:44:18.153+0000 7f563885e640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T17:44:18.231 INFO:tasks.ceph.c1.osd.0.smithi016.stderr:2024-04-16T17:44:18.233+0000 7eff998e6640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:18.255 INFO:tasks.ceph.c1.osd.1.smithi016.stderr:2024-04-16T17:44:18.257+0000 7f563067e640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:18.460 INFO:tasks.ceph.c1.osd.4.smithi023.stderr:2024-04-16T17:44:18.462+0000 7f047c21a640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T17:44:18.464 INFO:tasks.ceph.c1.osd.5.smithi023.stderr:2024-04-16T17:44:18.466+0000 7fe2ba2fb640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T17:44:18.474 INFO:tasks.ceph.c1.osd.4.smithi023.stderr:2024-04-16T17:44:18.476+0000 7f047403a640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:18.474 INFO:tasks.ceph.c1.osd.5.smithi023.stderr:2024-04-16T17:44:18.476+0000 7fe2b211b640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:18.481 INFO:tasks.ceph.c1.osd.3.smithi023.stderr:2024-04-16T17:44:18.482+0000 7f9517391640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T17:44:18.497 INFO:tasks.ceph.c1.osd.3.smithi023.stderr:2024-04-16T17:44:18.499+0000 7f950e99d640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:19.025 INFO:tasks.ceph.c1.osd.2.smithi016.stderr:2024-04-16T17:44:19.026+0000 7fc20d7dc640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T17:44:19.034 INFO:tasks.ceph.c1.osd.2.smithi016.stderr:2024-04-16T17:44:19.036+0000 7fc204de8640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:20.288 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2024-04-16T17:44:20.589 INFO:teuthology.misc.health.smithi016.stdout: 2024-04-16T17:44:20.589 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":12,"fsid":"5a17fdec-f013-46d8-9b9d-5b1671d92bcc","created":"2024-04-16T17:44:10.966929+0000","modified":"2024-04-16T17:44:20.155639+0000","last_up_change":"2024-04-16T17:44:19.154954+0000","last_in_change":"2024-04-16T17:44:12.675987+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T17:44:19.269588+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9330710-cd51-41be-a800-9a62853fcbef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6801","nonce":4036709287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6803","nonce":4036709287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6807","nonce":4036709287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6805","nonce":4036709287}]},"public_addr":"172.21.15.16:6801/4036709287","cluster_addr":"172.21.15.16:6803/4036709287","heartbeat_back_addr":"172.21.15.16:6807/4036709287","heartbeat_front_addr":"172.21.15.16:6805/4036709287","state":["exists","up"]},{"osd":1,"uuid":"fff6601f-7171-4f90-96fa-7797fd3cbf1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6809","nonce":2385164393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6811","nonce":2385164393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6815","nonce":2385164393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6813","nonce":2385164393}]},"public_addr":"172.21.15.16:6809/2385164393","cluster_addr":"172.21.15.16:6811/2385164393","heartbeat_back_addr":"172.21.15.16:6815/2385164393","heartbeat_front_addr":"172.21.15.16:6813/2385164393","state":["exists","up"]},{"osd":2,"uuid":"05b27816-aed9-4771-90a5-7cccae7f5301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6817","nonce":1917968682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6819","nonce":1917968682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6823","nonce":1917968682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6821","nonce":1917968682}]},"public_addr":"172.21.15.16:6817/1917968682","cluster_addr":"172.21.15.16:6819/1917968682","heartbeat_back_addr":"172.21.15.16:6823/1917968682","heartbeat_front_addr":"172.21.15.16:6821/1917968682","state":["exists","up"]},{"osd":3,"uuid":"624812b4-4b0d-47d9-a062-2fca11a9094b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6800","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6801","nonce":519987536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6803","nonce":519987536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6807","nonce":519987536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6805","nonce":519987536}]},"public_addr":"172.21.15.23:6801/519987536","cluster_addr":"172.21.15.23:6803/519987536","heartbeat_back_addr":"172.21.15.23:6807/519987536","heartbeat_front_addr":"172.21.15.23:6805/519987536","state":["exists","up"]},{"osd":4,"uuid":"66f06127-813c-4e57-bf5d-994dc1afcd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6809","nonce":446546393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6811","nonce":446546393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6815","nonce":446546393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6813","nonce":446546393}]},"public_addr":"172.21.15.23:6809/446546393","cluster_addr":"172.21.15.23:6811/446546393","heartbeat_back_addr":"172.21.15.23:6815/446546393","heartbeat_front_addr":"172.21.15.23:6813/446546393","state":["exists","up"]},{"osd":5,"uuid":"29d6da0e-9853-43c9-a4ef-21e94efb9723","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6817","nonce":2284545740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6819","nonce":2284545740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6823","nonce":2284545740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6821","nonce":2284545740}]},"public_addr":"172.21.15.23:6817/2284545740","cluster_addr":"172.21.15.23:6819/2284545740","heartbeat_back_addr":"172.21.15.23:6823/2284545740","heartbeat_front_addr":"172.21.15.23:6821/2284545740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.937779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.043968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.056051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.035710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.985059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.981088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:20.601 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-04-16T17:44:20.601 INFO:tasks.ceph:Creating RBD pool 2024-04-16T17:44:20.601 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster c1 osd pool create rbd 8 2024-04-16T17:44:21.155 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'rbd' created 2024-04-16T17:44:21.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-16T17:44:22.158 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-16T17:44:22.175 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2024-04-16T17:44:22.176 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2024-04-16T17:44:22.176 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2024-04-16T17:44:22.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2024-04-16T17:44:22.177 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T17:44:22.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:22.547 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6824","nonce":3221560356},{"type":"v1","addr":"172.21.15.23:6825","nonce":3221560356}]},"active_addr":"172.21.15.23:6825/3221560356","active_change":"2024-04-16T17:44:15.250787+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":611964969}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":2826478767}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":3781435051}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.23:0","nonce":1097213357}]}]} 2024-04-16T17:44:22.549 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2024-04-16T17:44:22.549 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2024-04-16T17:44:22.549 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-16T17:44:22.850 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:22.851 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":14,"fsid":"5a17fdec-f013-46d8-9b9d-5b1671d92bcc","created":"2024-04-16T17:44:10.966929+0000","modified":"2024-04-16T17:44:22.157793+0000","last_up_change":"2024-04-16T17:44:19.154954+0000","last_in_change":"2024-04-16T17:44:12.675987+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T17:44:19.269588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-16T17:44:20.904428+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9330710-cd51-41be-a800-9a62853fcbef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6801","nonce":4036709287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6803","nonce":4036709287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6807","nonce":4036709287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6805","nonce":4036709287}]},"public_addr":"172.21.15.16:6801/4036709287","cluster_addr":"172.21.15.16:6803/4036709287","heartbeat_back_addr":"172.21.15.16:6807/4036709287","heartbeat_front_addr":"172.21.15.16:6805/4036709287","state":["exists","up"]},{"osd":1,"uuid":"fff6601f-7171-4f90-96fa-7797fd3cbf1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6809","nonce":2385164393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6811","nonce":2385164393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6815","nonce":2385164393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6813","nonce":2385164393}]},"public_addr":"172.21.15.16:6809/2385164393","cluster_addr":"172.21.15.16:6811/2385164393","heartbeat_back_addr":"172.21.15.16:6815/2385164393","heartbeat_front_addr":"172.21.15.16:6813/2385164393","state":["exists","up"]},{"osd":2,"uuid":"05b27816-aed9-4771-90a5-7cccae7f5301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6817","nonce":1917968682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6819","nonce":1917968682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6823","nonce":1917968682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6821","nonce":1917968682}]},"public_addr":"172.21.15.16:6817/1917968682","cluster_addr":"172.21.15.16:6819/1917968682","heartbeat_back_addr":"172.21.15.16:6823/1917968682","heartbeat_front_addr":"172.21.15.16:6821/1917968682","state":["exists","up"]},{"osd":3,"uuid":"624812b4-4b0d-47d9-a062-2fca11a9094b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6800","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6801","nonce":519987536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6803","nonce":519987536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6807","nonce":519987536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6805","nonce":519987536}]},"public_addr":"172.21.15.23:6801/519987536","cluster_addr":"172.21.15.23:6803/519987536","heartbeat_back_addr":"172.21.15.23:6807/519987536","heartbeat_front_addr":"172.21.15.23:6805/519987536","state":["exists","up"]},{"osd":4,"uuid":"66f06127-813c-4e57-bf5d-994dc1afcd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6809","nonce":446546393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6811","nonce":446546393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6815","nonce":446546393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6813","nonce":446546393}]},"public_addr":"172.21.15.23:6809/446546393","cluster_addr":"172.21.15.23:6811/446546393","heartbeat_back_addr":"172.21.15.23:6815/446546393","heartbeat_front_addr":"172.21.15.23:6813/446546393","state":["exists","up"]},{"osd":5,"uuid":"29d6da0e-9853-43c9-a4ef-21e94efb9723","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6817","nonce":2284545740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6819","nonce":2284545740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6823","nonce":2284545740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6821","nonce":2284545740}]},"public_addr":"172.21.15.23:6817/2284545740","cluster_addr":"172.21.15.23:6819/2284545740","heartbeat_back_addr":"172.21.15.23:6823/2284545740","heartbeat_front_addr":"172.21.15.23:6821/2284545740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.937779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.043968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.056051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.035710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.985059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.981088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:22.863 INFO:tasks.ceph.ceph_manager.c1:all up! 2024-04-16T17:44:22.863 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-16T17:44:23.162 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:23.162 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":15,"fsid":"5a17fdec-f013-46d8-9b9d-5b1671d92bcc","created":"2024-04-16T17:44:10.966929+0000","modified":"2024-04-16T17:44:23.160153+0000","last_up_change":"2024-04-16T17:44:19.154954+0000","last_in_change":"2024-04-16T17:44:12.675987+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T17:44:19.269588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-16T17:44:20.904428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9330710-cd51-41be-a800-9a62853fcbef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6801","nonce":4036709287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6803","nonce":4036709287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6807","nonce":4036709287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6805","nonce":4036709287}]},"public_addr":"172.21.15.16:6801/4036709287","cluster_addr":"172.21.15.16:6803/4036709287","heartbeat_back_addr":"172.21.15.16:6807/4036709287","heartbeat_front_addr":"172.21.15.16:6805/4036709287","state":["exists","up"]},{"osd":1,"uuid":"fff6601f-7171-4f90-96fa-7797fd3cbf1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6809","nonce":2385164393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6811","nonce":2385164393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6815","nonce":2385164393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6813","nonce":2385164393}]},"public_addr":"172.21.15.16:6809/2385164393","cluster_addr":"172.21.15.16:6811/2385164393","heartbeat_back_addr":"172.21.15.16:6815/2385164393","heartbeat_front_addr":"172.21.15.16:6813/2385164393","state":["exists","up"]},{"osd":2,"uuid":"05b27816-aed9-4771-90a5-7cccae7f5301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6817","nonce":1917968682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6819","nonce":1917968682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6823","nonce":1917968682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6821","nonce":1917968682}]},"public_addr":"172.21.15.16:6817/1917968682","cluster_addr":"172.21.15.16:6819/1917968682","heartbeat_back_addr":"172.21.15.16:6823/1917968682","heartbeat_front_addr":"172.21.15.16:6821/1917968682","state":["exists","up"]},{"osd":3,"uuid":"624812b4-4b0d-47d9-a062-2fca11a9094b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6800","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6801","nonce":519987536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6803","nonce":519987536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6807","nonce":519987536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6805","nonce":519987536}]},"public_addr":"172.21.15.23:6801/519987536","cluster_addr":"172.21.15.23:6803/519987536","heartbeat_back_addr":"172.21.15.23:6807/519987536","heartbeat_front_addr":"172.21.15.23:6805/519987536","state":["exists","up"]},{"osd":4,"uuid":"66f06127-813c-4e57-bf5d-994dc1afcd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6809","nonce":446546393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6811","nonce":446546393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6815","nonce":446546393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6813","nonce":446546393}]},"public_addr":"172.21.15.23:6809/446546393","cluster_addr":"172.21.15.23:6811/446546393","heartbeat_back_addr":"172.21.15.23:6815/446546393","heartbeat_front_addr":"172.21.15.23:6813/446546393","state":["exists","up"]},{"osd":5,"uuid":"29d6da0e-9853-43c9-a4ef-21e94efb9723","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6817","nonce":2284545740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6819","nonce":2284545740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6823","nonce":2284545740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6821","nonce":2284545740}]},"public_addr":"172.21.15.23:6817/2284545740","cluster_addr":"172.21.15.23:6819/2284545740","heartbeat_back_addr":"172.21.15.23:6823/2284545740","heartbeat_front_addr":"172.21.15.23:6821/2284545740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.937779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.043968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.056051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.035710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.985059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.981088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:23.175 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2024-04-16T17:44:23.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2024-04-16T17:44:23.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2024-04-16T17:44:23.176 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.3 flush_pg_stats 2024-04-16T17:44:23.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.4 flush_pg_stats 2024-04-16T17:44:23.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.5 flush_pg_stats 2024-04-16T17:44:23.357 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:23.357 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2024-04-16T17:44:23.361 INFO:teuthology.orchestra.run.smithi016.stdout:47244640259 2024-04-16T17:44:23.361 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2024-04-16T17:44:23.387 INFO:teuthology.orchestra.run.smithi016.stdout:47244640259 2024-04-16T17:44:23.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2024-04-16T17:44:23.390 INFO:teuthology.orchestra.run.smithi016.stdout:47244640259 2024-04-16T17:44:23.390 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2024-04-16T17:44:23.408 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:23.409 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2024-04-16T17:44:23.412 INFO:teuthology.orchestra.run.smithi016.stdout:47244640259 2024-04-16T17:44:23.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2024-04-16T17:44:23.736 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:23.750 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.3 2024-04-16T17:44:23.774 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:23.786 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.5 2024-04-16T17:44:23.817 INFO:teuthology.orchestra.run.smithi016.stdout:47244640257 2024-04-16T17:44:23.832 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640258 got 47244640257 for osd.4 2024-04-16T17:44:23.894 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:23.907 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.0 2024-04-16T17:44:23.923 INFO:teuthology.orchestra.run.smithi016.stdout:47244640257 2024-04-16T17:44:23.936 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640258 got 47244640257 for osd.1 2024-04-16T17:44:23.947 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:23.960 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.2 2024-04-16T17:44:24.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2024-04-16T17:44:24.787 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2024-04-16T17:44:24.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2024-04-16T17:44:24.908 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2024-04-16T17:44:24.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2024-04-16T17:44:24.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2024-04-16T17:44:25.154 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:25.173 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.3 2024-04-16T17:44:25.195 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:25.200 INFO:teuthology.orchestra.run.smithi016.stdout:47244640257 2024-04-16T17:44:25.210 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.5 2024-04-16T17:44:25.214 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640258 got 47244640257 for osd.4 2024-04-16T17:44:25.302 INFO:teuthology.orchestra.run.smithi016.stdout:47244640258 2024-04-16T17:44:25.315 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640258 for osd.0 2024-04-16T17:44:25.370 INFO:teuthology.orchestra.run.smithi016.stdout:47244640260 2024-04-16T17:44:25.383 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640260 for osd.2 2024-04-16T17:44:25.383 DEBUG:teuthology.parallel:result is None 2024-04-16T17:44:25.385 INFO:teuthology.orchestra.run.smithi016.stdout:47244640259 2024-04-16T17:44:25.398 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640258 got 47244640259 for osd.1 2024-04-16T17:44:25.398 DEBUG:teuthology.parallel:result is None 2024-04-16T17:44:26.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.3 2024-04-16T17:44:26.211 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.5 2024-04-16T17:44:26.215 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.4 2024-04-16T17:44:26.316 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2024-04-16T17:44:26.552 INFO:teuthology.orchestra.run.smithi016.stdout:47244640260 2024-04-16T17:44:26.567 INFO:teuthology.orchestra.run.smithi016.stdout:47244640260 2024-04-16T17:44:26.570 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640260 for osd.5 2024-04-16T17:44:26.570 DEBUG:teuthology.parallel:result is None 2024-04-16T17:44:26.581 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640260 for osd.3 2024-04-16T17:44:26.581 DEBUG:teuthology.parallel:result is None 2024-04-16T17:44:26.596 INFO:teuthology.orchestra.run.smithi016.stdout:47244640259 2024-04-16T17:44:26.609 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640258 got 47244640259 for osd.4 2024-04-16T17:44:26.609 DEBUG:teuthology.parallel:result is None 2024-04-16T17:44:26.630 INFO:teuthology.orchestra.run.smithi016.stdout:47244640260 2024-04-16T17:44:26.643 INFO:tasks.ceph.ceph_manager.c1:need seq 47244640259 got 47244640260 for osd.0 2024-04-16T17:44:26.643 DEBUG:teuthology.parallel:result is None 2024-04-16T17:44:26.643 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2024-04-16T17:44:26.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T17:44:26.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:26.980 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T17:44:26.991 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-04-16T17:44:25.256467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":164128,"kb_used_data":1976,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628981472,"statfs":{"total":644245094400,"available":644077027328,"internally_reserved":0,"allocated":2023424,"data_stored":1431578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.436881+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T17:44:23.436881+0000","last_peered":"2024-04-16T17:44:23.436881+0000","last_clean":"2024-04-16T17:44:23.436881+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T17:44:23.436881+0000","last_undegraded":"2024-04-16T17:44:23.436881+0000","last_fullsized":"2024-04-16T17:44:23.436881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:37.225695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:44:22.168621+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T17:44:22.168621+0000","last_peered":"2024-04-16T17:44:22.168621+0000","last_clean":"2024-04-16T17:44:22.168621+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T17:44:22.168621+0000","last_undegraded":"2024-04-16T17:44:22.168621+0000","last_fullsized":"2024-04-16T17:44:22.168621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:55:23.182121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.436842+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T17:44:23.436842+0000","last_peered":"2024-04-16T17:44:23.436842+0000","last_clean":"2024-04-16T17:44:23.436842+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T17:44:23.436842+0000","last_undegraded":"2024-04-16T17:44:23.436842+0000","last_fullsized":"2024-04-16T17:44:23.436842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:22.591585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:44:22.327902+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T17:44:22.327902+0000","last_peered":"2024-04-16T17:44:22.327902+0000","last_clean":"2024-04-16T17:44:22.327902+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T17:44:22.327902+0000","last_undegraded":"2024-04-16T17:44:22.327902+0000","last_fullsized":"2024-04-16T17:44:22.327902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:45.345103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.162438+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T17:44:23.162438+0000","last_peered":"2024-04-16T17:44:23.162438+0000","last_clean":"2024-04-16T17:44:23.162438+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T17:44:23.162438+0000","last_undegraded":"2024-04-16T17:44:23.162438+0000","last_fullsized":"2024-04-16T17:44:23.162438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:24.216578+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T17:44:24.216578+0000","last_peered":"2024-04-16T17:44:24.216578+0000","last_clean":"2024-04-16T17:44:24.216578+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T17:44:24.216578+0000","last_undegraded":"2024-04-16T17:44:24.216578+0000","last_fullsized":"2024-04-16T17:44:24.216578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:57.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.437013+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T17:44:23.437013+0000","last_peered":"2024-04-16T17:44:23.437013+0000","last_clean":"2024-04-16T17:44:23.437013+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T17:44:23.437013+0000","last_undegraded":"2024-04-16T17:44:23.437013+0000","last_fullsized":"2024-04-16T17:44:23.437013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:33.735299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.162449+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T17:44:23.162449+0000","last_peered":"2024-04-16T17:44:23.162449+0000","last_clean":"2024-04-16T17:44:23.162449+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T17:44:23.162449+0000","last_undegraded":"2024-04-16T17:44:23.162449+0000","last_fullsized":"2024-04-16T17:44:23.162449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.436992+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T17:44:23.436992+0000","last_peered":"2024-04-16T17:44:23.436992+0000","last_clean":"2024-04-16T17:44:23.436992+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T17:44:23.436992+0000","last_undegraded":"2024-04-16T17:44:23.436992+0000","last_fullsized":"2024-04-16T17:44:23.436992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:56.418777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":43435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":43435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829856,"statfs":{"total":107374182400,"available":107345772544,"internally_reserved":0,"allocated":737280,"data_stored":633803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":38551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":38551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829856,"statfs":{"total":107374182400,"available":107345772544,"internally_reserved":0,"allocated":737280,"data_stored":633803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T17:44:26.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T17:44:27.288 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:27.288 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T17:44:27.300 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-16T17:44:27.256850+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":164128,"kb_used_data":1976,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628981472,"statfs":{"total":644245094400,"available":644077027328,"internally_reserved":0,"allocated":2023424,"data_stored":1431578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000382"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.436881+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T17:44:23.436881+0000","last_peered":"2024-04-16T17:44:23.436881+0000","last_clean":"2024-04-16T17:44:23.436881+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T17:44:23.436881+0000","last_undegraded":"2024-04-16T17:44:23.436881+0000","last_fullsized":"2024-04-16T17:44:23.436881+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:37.225695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:44:22.168621+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T17:44:22.168621+0000","last_peered":"2024-04-16T17:44:22.168621+0000","last_clean":"2024-04-16T17:44:22.168621+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T17:44:22.168621+0000","last_undegraded":"2024-04-16T17:44:22.168621+0000","last_fullsized":"2024-04-16T17:44:22.168621+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:55:23.182121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.436842+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T17:44:23.436842+0000","last_peered":"2024-04-16T17:44:23.436842+0000","last_clean":"2024-04-16T17:44:23.436842+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T17:44:23.436842+0000","last_undegraded":"2024-04-16T17:44:23.436842+0000","last_fullsized":"2024-04-16T17:44:23.436842+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:22.591585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:44:22.327902+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T17:44:22.327902+0000","last_peered":"2024-04-16T17:44:22.327902+0000","last_clean":"2024-04-16T17:44:22.327902+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T17:44:22.327902+0000","last_undegraded":"2024-04-16T17:44:22.327902+0000","last_fullsized":"2024-04-16T17:44:22.327902+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:45.345103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.162438+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T17:44:23.162438+0000","last_peered":"2024-04-16T17:44:23.162438+0000","last_clean":"2024-04-16T17:44:23.162438+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T17:44:23.162438+0000","last_undegraded":"2024-04-16T17:44:23.162438+0000","last_fullsized":"2024-04-16T17:44:23.162438+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:24.216578+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T17:44:24.216578+0000","last_peered":"2024-04-16T17:44:24.216578+0000","last_clean":"2024-04-16T17:44:24.216578+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T17:44:24.216578+0000","last_undegraded":"2024-04-16T17:44:24.216578+0000","last_fullsized":"2024-04-16T17:44:24.216578+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:57.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.437013+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T17:44:23.437013+0000","last_peered":"2024-04-16T17:44:23.437013+0000","last_clean":"2024-04-16T17:44:23.437013+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T17:44:23.437013+0000","last_undegraded":"2024-04-16T17:44:23.437013+0000","last_fullsized":"2024-04-16T17:44:23.437013+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:33.735299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.162449+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T17:44:23.162449+0000","last_peered":"2024-04-16T17:44:23.162449+0000","last_clean":"2024-04-16T17:44:23.162449+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T17:44:23.162449+0000","last_undegraded":"2024-04-16T17:44:23.162449+0000","last_fullsized":"2024-04-16T17:44:23.162449+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":164,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:44:23.436992+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T17:44:23.436992+0000","last_peered":"2024-04-16T17:44:23.436992+0000","last_clean":"2024-04-16T17:44:23.436992+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T17:44:23.436992+0000","last_undegraded":"2024-04-16T17:44:23.436992+0000","last_fullsized":"2024-04-16T17:44:23.436992+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:56.418777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":43435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":43435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829856,"statfs":{"total":107374182400,"available":107345772544,"internally_reserved":0,"allocated":737280,"data_stored":633803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":38551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":38551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829856,"statfs":{"total":107374182400,"available":107345772544,"internally_reserved":0,"allocated":737280,"data_stored":633803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T17:44:27.301 INFO:tasks.ceph.ceph_manager.c1:clean! 2024-04-16T17:44:27.301 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2024-04-16T17:44:27.301 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2024-04-16T17:44:27.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2024-04-16T17:44:27.643 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:27.643 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T17:44:27.656 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2024-04-16T17:44:27.657 INFO:teuthology.run_tasks:Running task ceph... 2024-04-16T17:44:27.667 INFO:tasks.ceph:Creating ceph cluster c2... 2024-04-16T17:44:27.667 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-16T17:44:27.667 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'branch': 'main', 'description': 'rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi}', 'email': None, 'first_in_suite': False, 'job_id': '7658453', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'enabled_features': ['resharding', 'notification_v2'], 'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', '-a', '!fails_on_rgw']}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'wip-shilpa-multisite-tests', 'sha1': '9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b'}}, 'owner': 'scheduled_smanjara@teuthology', 'priority': 49, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c1.mgr.x', 'c1.osd.3', 'c1.osd.4', 'c1.osd.5', 'c1.client.1'], ['c2.mon.a', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0'], ['c2.mgr.x', 'c2.osd.3', 'c2.osd.4', 'c2.osd.5', 'c2.client.1']], 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086', 'sleep_before_teardown': 0, 'suite': 'rgw:multisite', 'suite_branch': 'wip-shilpa-multisite-tests', 'suite_path': '/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/smanjara/ceph.git', 'suite_sha1': '9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b', 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbhFbfUsKQldVun2nyGgdUcxSnkO0dWqgM/8o0lch1swrFSDpkiNLHoyQ8jxNuLso55iNbZL9yHW2F90mt4jQQ=', 'smithi023.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETZAltJ2haRKB4RlEtM1MtPT+J4723FrQyUMS0cu+dC1jkEAEg1AAEI8ysymgZCpJbSe7qHlg7SwKqTMZDCLA8=', 'smithi139.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXA/cgWiNXvC2RpsWgXcNglJBHLTfHxwCoHukkjJ7i1n3zkwrq0Nx89+pfrE0YXL75R19B3TbtAv9p80WLLRAo=', 'smithi163.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFP0QhDxCGQBJtiU86raG03uAHphji0IvPattOmP2ns/ZRTymOGSWzExkAuXkT7f6SOsBHlYulXlQvBVjsn+Ypw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'client.0': {'rgw data notify interval msec': 0}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b0c7b917267c471208541fdeb652f5e897d00086'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 90}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-16_17:24:34', 'tube': 'smithi', 'user': 'smanjara', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-16T17:44:27.668 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-16T17:44:27.670 DEBUG:teuthology.orchestra.run.smithi023:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-16T17:44:27.673 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-16T17:44:27.675 DEBUG:teuthology.orchestra.run.smithi163:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2024-04-16T17:44:27.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:44:27.726 DEBUG:teuthology.orchestra.run.smithi023:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:44:27.731 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:44:27.735 DEBUG:teuthology.orchestra.run.smithi163:> sudo install -d -m0777 -- /var/run/ceph 2024-04-16T17:44:27.767 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:27.767 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T17:44:27.822 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T17:44:27.822 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_1 2024-04-16T17:44:27.879 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T17:44:27.879 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:27.879 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 661 Links: 1 2024-04-16T17:44:27.879 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:27.879 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:27.879 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-16 17:43:40.999904664 +0000 2024-04-16T17:44:27.880 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-16 17:40:42.549822665 +0000 2024-04-16T17:44:27.880 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-16 17:40:42.549822665 +0000 2024-04-16T17:44:27.880 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-16 17:40:42.549822665 +0000 2024-04-16T17:44:27.880 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T17:44:27.948 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-16T17:44:27.948 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-16T17:44:27.948 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000269418 s, 1.9 MB/s 2024-04-16T17:44:27.949 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T17:44:28.007 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_2 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-16 17:43:40.999904664 +0000 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-16 17:40:42.916814860 +0000 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-16 17:40:42.916814860 +0000 2024-04-16T17:44:28.065 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-16 17:40:42.916814860 +0000 2024-04-16T17:44:28.065 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T17:44:28.134 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-16T17:44:28.134 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-16T17:44:28.134 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000221748 s, 2.3 MB/s 2024-04-16T17:44:28.136 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T17:44:28.193 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_3 2024-04-16T17:44:28.248 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T17:44:28.248 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:28.248 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 698 Links: 1 2024-04-16T17:44:28.249 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:28.249 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:28.249 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-16 17:43:41.000904643 +0000 2024-04-16T17:44:28.249 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-16 17:40:43.268807374 +0000 2024-04-16T17:44:28.249 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-16 17:40:43.268807374 +0000 2024-04-16T17:44:28.249 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-16 17:40:43.268807374 +0000 2024-04-16T17:44:28.249 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T17:44:28.315 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-16T17:44:28.315 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-16T17:44:28.315 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000180881 s, 2.8 MB/s 2024-04-16T17:44:28.317 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T17:44:28.373 DEBUG:teuthology.orchestra.run.smithi139:> stat /dev/vg_nvme/lv_4 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout:Device: 5h/5d Inode: 716 Links: 1 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout:Access: 2024-04-16 17:43:41.000904643 +0000 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout:Modify: 2024-04-16 17:40:43.601800292 +0000 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout:Change: 2024-04-16 17:40:43.601800292 +0000 2024-04-16T17:44:28.429 INFO:teuthology.orchestra.run.smithi139.stdout: Birth: 2024-04-16 17:40:43.601800292 +0000 2024-04-16T17:44:28.429 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T17:44:28.497 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records in 2024-04-16T17:44:28.497 INFO:teuthology.orchestra.run.smithi139.stderr:1+0 records out 2024-04-16T17:44:28.497 INFO:teuthology.orchestra.run.smithi139.stderr:512 bytes copied, 0.000235571 s, 2.2 MB/s 2024-04-16T17:44:28.499 DEBUG:teuthology.orchestra.run.smithi139:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T17:44:28.555 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:28.555 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:28.555 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/scratch_devs of=/dev/stdout 2024-04-16T17:44:28.572 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-16T17:44:28.572 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_1 2024-04-16T17:44:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-16T17:44:28.628 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:28.628 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-16T17:44:28.629 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:28.629 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:28.629 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-16 17:43:33.011164102 +0000 2024-04-16T17:44:28.629 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-16 17:40:44.867217545 +0000 2024-04-16T17:44:28.629 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-16 17:40:44.867217545 +0000 2024-04-16T17:44:28.629 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-16 17:40:44.867217545 +0000 2024-04-16T17:44:28.629 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-16T17:44:28.696 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-16T17:44:28.696 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-16T17:44:28.696 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000261998 s, 2.0 MB/s 2024-04-16T17:44:28.697 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-16T17:44:28.754 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_2 2024-04-16T17:44:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-16T17:44:28.810 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:28.810 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-16T17:44:28.810 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:28.810 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:28.810 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-16 17:43:33.011164102 +0000 2024-04-16T17:44:28.810 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-16 17:40:45.196209858 +0000 2024-04-16T17:44:28.811 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-16 17:40:45.196209858 +0000 2024-04-16T17:44:28.811 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-16 17:40:45.196209858 +0000 2024-04-16T17:44:28.811 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-16T17:44:28.878 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-16T17:44:28.878 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-16T17:44:28.878 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000209525 s, 2.4 MB/s 2024-04-16T17:44:28.879 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-16T17:44:28.935 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_3 2024-04-16T17:44:28.991 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-16T17:44:28.991 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:28.991 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-16T17:44:28.991 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:28.992 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:28.992 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-16 17:43:33.011164102 +0000 2024-04-16T17:44:28.992 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-16 17:40:45.543201749 +0000 2024-04-16T17:44:28.992 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-16 17:40:45.543201749 +0000 2024-04-16T17:44:28.992 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-16 17:40:45.543201749 +0000 2024-04-16T17:44:28.992 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-16T17:44:29.058 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-16T17:44:29.058 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-16T17:44:29.058 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000169288 s, 3.0 MB/s 2024-04-16T17:44:29.059 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-16T17:44:29.115 DEBUG:teuthology.orchestra.run.smithi163:> stat /dev/vg_nvme/lv_4 2024-04-16T17:44:29.171 INFO:teuthology.orchestra.run.smithi163.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-16T17:44:29.171 INFO:teuthology.orchestra.run.smithi163.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-16T17:44:29.171 INFO:teuthology.orchestra.run.smithi163.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-16T17:44:29.172 INFO:teuthology.orchestra.run.smithi163.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-16T17:44:29.172 INFO:teuthology.orchestra.run.smithi163.stdout:Context: system_u:object_r:device_t:s0 2024-04-16T17:44:29.172 INFO:teuthology.orchestra.run.smithi163.stdout:Access: 2024-04-16 17:43:33.012164078 +0000 2024-04-16T17:44:29.172 INFO:teuthology.orchestra.run.smithi163.stdout:Modify: 2024-04-16 17:40:45.892193594 +0000 2024-04-16T17:44:29.172 INFO:teuthology.orchestra.run.smithi163.stdout:Change: 2024-04-16 17:40:45.892193594 +0000 2024-04-16T17:44:29.172 INFO:teuthology.orchestra.run.smithi163.stdout: Birth: 2024-04-16 17:40:45.892193594 +0000 2024-04-16T17:44:29.172 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-16T17:44:29.238 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records in 2024-04-16T17:44:29.238 INFO:teuthology.orchestra.run.smithi163.stderr:1+0 records out 2024-04-16T17:44:29.238 INFO:teuthology.orchestra.run.smithi163.stderr:512 bytes copied, 0.000228421 s, 2.2 MB/s 2024-04-16T17:44:29.240 DEBUG:teuthology.orchestra.run.smithi163:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-16T17:44:29.295 INFO:tasks.ceph:osd dev map: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:29.295 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-16T17:44:29.296 INFO:tasks.ceph:Generating config... 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] debug rgw lifecycle = 20 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] debug rgw sync = 20 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw data log num shards = 4 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw data sync poll interval = 5 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw md log max shards = 4 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw meta sync poll interval = 5 2024-04-16T17:44:29.297 INFO:tasks.ceph:[client] rgw sync data inject err probability = 0.1 2024-04-16T17:44:29.298 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2024-04-16T17:44:29.298 INFO:tasks.ceph:[client] rgw sync meta inject err probability = 0.1 2024-04-16T17:44:29.298 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2024-04-16T17:44:29.298 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-16T17:44:29.298 INFO:tasks.ceph:[client] setuser = ceph 2024-04-16T17:44:29.298 INFO:tasks.ceph:[client.0] rgw data notify interval msec = 0 2024-04-16T17:44:29.298 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-16T17:44:29.298 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-16T17:44:29.298 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-16T17:44:29.298 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-16T17:44:29.298 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-16T17:44:29.298 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-16T17:44:29.298 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-16T17:44:29.298 INFO:tasks.ceph:[osd] rocksdb delete range threshold = 0 2024-04-16T17:44:29.299 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2024-04-16T17:44:29.299 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2024-04-16T17:44:29.299 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2024-04-16T17:44:29.299 INFO:tasks.ceph:Setting up c2.mon.a... 2024-04-16T17:44:29.299 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2024-04-16T17:44:29.353 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/c2.keyring 2024-04-16T17:44:29.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2024-04-16T17:44:29.401 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-16T17:44:29.429 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.139')] 2024-04-16T17:44:29.429 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.139'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20, 'rocksdb delete range threshold': 0}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw lifecycle': 20, 'debug rgw notification': 20, 'debug rgw sync': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw data sync poll interval': 5, 'rgw md log max shards': 4, 'rgw meta sync poll interval': 5, 'rgw sync data inject err probability': 0.1, 'rgw sync log trim interval': 0, 'rgw sync meta inject err probability': 0.1, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'client.0': {'rgw data notify interval msec': 0}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}} 2024-04-16T17:44:29.430 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:29.430 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T17:44:29.484 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.139 --print /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:44:29.564 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: generated fsid 5d0c0a7c-617e-4057-9ede-145cc534fec0 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:setting min_mon_release = quincy 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:epoch 0 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:fsid 5d0c0a7c-617e-4057-9ede-145cc534fec0 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:last_changed 2024-04-16T17:44:29.567267+0000 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:created 2024-04-16T17:44:29.567267+0000 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:min_mon_release 17 (quincy) 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:election_strategy: 1 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:0: [v2:172.21.15.139:3300/0,v1:172.21.15.139:6789/0] mon.a 2024-04-16T17:44:29.565 INFO:teuthology.orchestra.run.smithi139.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2024-04-16T17:44:29.566 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-16T17:44:29.621 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 5d0c0a7c-617e-4057-9ede-145cc534fec0... 2024-04-16T17:44:29.621 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-16T17:44:29.624 DEBUG:teuthology.orchestra.run.smithi023:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-16T17:44:29.626 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-16T17:44:29.663 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2024-04-16T17:44:29.682 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2024-04-16T17:44:29.682 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2024-04-16T17:44:29.682 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:44:29.682 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2024-04-16T17:44:29.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.682 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2024-04-16T17:44:29.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:44:29.683 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.684 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = 172.21.15.139 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 5d0c0a7c-617e-4057-9ede-145cc534fec0 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2024-04-16T17:44:29.685 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.686 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-16T17:44:29.687 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: rocksdb delete range threshold = 0 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2024-04-16T17:44:29.688 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.689 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw = 20 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw lifecycle = 20 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw notification = 20 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: debug rgw sync = 20 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt require ssl = False 2024-04-16T17:44:29.690 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw curl low speed time = 300 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw data log num shards = 4 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw data sync poll interval = 5 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw md log max shards = 4 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw meta sync poll interval = 5 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync log trim interval = 0 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw sync obj etag verify = True 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: setgroup = ceph 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: setuser = ceph 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout: rgw data notify interval msec = 0 2024-04-16T17:44:29.691 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi016.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi023.stdout:[global] 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi023.stdout: chdir = "" 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi023.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi023.stdout: auth supported = cephx 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.692 INFO:teuthology.orchestra.run.smithi023.stdout: filestore xattr use omap = true 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: mon clock drift allowed = 1.000 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: osd crush chooseleaf type = 0 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: auth debug = true 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: ms die on old message = true 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: ms die on bug = true 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: mon pg warn max object skew = 0 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:44:29.693 INFO:teuthology.orchestra.run.smithi023.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: osd pool default size = 2 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd allow primary affinity = true 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd allow pg remap = true 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on no sortbitwise = false 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon warn on too few osds = false 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: mon_allow_pool_size_one = true 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.694 INFO:teuthology.orchestra.run.smithi023.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: osd default data pool replay window = 5 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: mon allow pool delete = true 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: mon cluster log file level = debug 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: debug asserts on shutdown = true 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: mon health detail to clog = false 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: mon host = 172.21.15.139 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: fsid = 5d0c0a7c-617e-4057-9ede-145cc534fec0 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout:[osd] 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: osd journal size = 100 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: osd scrub load threshold = 5.0 2024-04-16T17:44:29.695 INFO:teuthology.orchestra.run.smithi023.stdout: osd scrub max interval = 600 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd recover clone overlap = true 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd recovery max chunk = 1048576 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug shutdown = true 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug op order = true 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug verify stray on activate = true 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug trim objects = true 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd open classes on start = true 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug pg log writeout = true 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:44:29.696 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: osd map max advance = 10 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: journal zero on create = true 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: filestore apply finisher threads = 3 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: bdev debug aio = true 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: osd debug misdirected ops = true 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: debug ms = 1 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: debug osd = 20 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: rocksdb delete range threshold = 0 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout:[mgr] 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: debug ms = 1 2024-04-16T17:44:29.697 INFO:teuthology.orchestra.run.smithi023.stdout: debug mgr = 20 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: debug mon = 20 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: debug auth = 20 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mgr/telemetry/nag = false 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout:[mon] 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: debug ms = 1 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: debug mon = 20 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: debug paxos = 20 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: debug auth = 20 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mon data avail warn = 5 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mon mgr mkfs grace = 240 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd reporter subtree level = osd 2024-04-16T17:44:29.698 INFO:teuthology.orchestra.run.smithi023.stdout: mon osd prime pg temp = true 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: # 1m isn't quite enough 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout: 2024-04-16T17:44:29.699 INFO:teuthology.orchestra.run.smithi023.stdout:[client] 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw cache enabled = true 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw enable ops log = true 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw enable usage log = true 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw = 20 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw lifecycle = 20 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw notification = 20 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: debug rgw sync = 20 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw crypt require ssl = False 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw curl low speed time = 300 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw data log num shards = 4 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw data sync poll interval = 5 2024-04-16T17:44:29.700 INFO:teuthology.orchestra.run.smithi023.stdout: rgw md log max shards = 4 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: rgw meta sync poll interval = 5 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync log trim interval = 0 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: rgw sync obj etag verify = True 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: setgroup = ceph 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: setuser = ceph 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout:[mon.a] 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout:[client.0] 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: rgw data notify interval msec = 0 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout:[osd.0] 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout:[osd.1] 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:44:29.701 INFO:teuthology.orchestra.run.smithi023.stdout:[osd.2] 2024-04-16T17:44:29.702 INFO:teuthology.orchestra.run.smithi023.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:44:29.713 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.714 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:44:29.715 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon_allow_pool_size_one = true 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2024-04-16T17:44:29.716 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = 172.21.15.139 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 5d0c0a7c-617e-4057-9ede-145cc534fec0 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.717 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug trim objects = true 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.718 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: rocksdb delete range threshold = 0 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-16T17:44:29.719 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2024-04-16T17:44:29.720 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: # 1m isn't quite enough 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:29.721 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw = 20 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw lifecycle = 20 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw notification = 20 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: debug rgw sync = 20 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw crypt require ssl = False 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw curl low speed time = 300 2024-04-16T17:44:29.722 INFO:teuthology.orchestra.run.smithi139.stdout: rgw data log num shards = 4 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw data sync poll interval = 5 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw md log max shards = 4 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw meta sync poll interval = 5 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync log trim interval = 0 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw sync obj etag verify = True 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: setgroup = ceph 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: setuser = ceph 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: rgw data notify interval msec = 0 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-04-16T17:44:29.723 INFO:teuthology.orchestra.run.smithi139.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi139.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout:[global] 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: chdir = "" 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: auth supported = cephx 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: filestore xattr use omap = true 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: mon clock drift allowed = 1.000 2024-04-16T17:44:29.724 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: osd crush chooseleaf type = 0 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: auth debug = true 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on old message = true 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: ms die on bug = true 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: mon pg warn max object skew = 0 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: # disable pg_autoscaler by default for new pools 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default size = 2 2024-04-16T17:44:29.725 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow primary affinity = true 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd allow pg remap = true 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on legacy crush tunables = false 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on crush straw calc version zero = false 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on no sortbitwise = false 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on osd down out interval zero = false 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon warn on too few osds = false 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: mon_allow_pool_size_one = true 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.726 INFO:teuthology.orchestra.run.smithi163.stdout: osd default data pool replay window = 5 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: mon allow pool delete = true 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: mon cluster log file level = debug 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: debug asserts on shutdown = true 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: mon health detail to clog = false 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: mon host = 172.21.15.139 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: fsid = 5d0c0a7c-617e-4057-9ede-145cc534fec0 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout:[osd] 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: osd journal size = 100 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub load threshold = 5.0 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: osd scrub max interval = 600 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: osd mclock profile = high_recovery_ops 2024-04-16T17:44:29.727 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd recover clone overlap = true 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd recovery max chunk = 1048576 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug shutdown = true 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug op order = true 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug verify stray on activate = true 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug trim objects = true 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd open classes on start = true 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug pg log writeout = true 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd deep scrub update digest min age = 30 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: osd map max advance = 10 2024-04-16T17:44:29.728 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: journal zero on create = true 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: filestore ondisk finisher threads = 3 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: filestore apply finisher threads = 3 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: bdev debug aio = true 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: osd debug misdirected ops = true 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: debug osd = 20 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: rocksdb delete range threshold = 0 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout:[mgr] 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: debug mgr = 20 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-04-16T17:44:29.729 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mgr/telemetry/nag = false 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout:[mon] 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: debug ms = 1 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: debug mon = 20 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: debug paxos = 20 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: debug auth = 20 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon data avail warn = 5 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon mgr mkfs grace = 240 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min pgs per osd = 4 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd reporter subtree level = osd 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon osd prime pg temp = true 2024-04-16T17:44:29.730 INFO:teuthology.orchestra.run.smithi163.stdout: mon reweight min bytes per osd = 10 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: auth mon ticket ttl = 660 # 11m 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: auth service ticket ttl = 240 # 4m 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: # don't complain about insecure global_id in the test suite 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: # 1m isn't quite enough 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: mon_down_mkfs_grace = 2m 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: mon_warn_on_filestore_osds = false 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout: 2024-04-16T17:44:29.731 INFO:teuthology.orchestra.run.smithi163.stdout:[client] 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw cache enabled = true 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable ops log = true 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw enable usage log = true 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw = 20 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw lifecycle = 20 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw notification = 20 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: debug rgw sync = 20 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw crypt require ssl = False 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw crypt s3 kms backend = testing 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw curl low speed time = 300 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw data log num shards = 4 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw data sync poll interval = 5 2024-04-16T17:44:29.732 INFO:teuthology.orchestra.run.smithi163.stdout: rgw md log max shards = 4 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: rgw meta sync poll interval = 5 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync data inject err probability = 0.1 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync log trim interval = 0 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync meta inject err probability = 0.1 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: rgw sync obj etag verify = True 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: setgroup = ceph 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: setuser = ceph 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout:[mon.a] 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout:[client.0] 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: rgw data notify interval msec = 0 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.0] 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: osd_max_omap_entries_per_request = 10 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.1] 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: osd_max_omap_entries_per_request = 1000 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout:[osd.2] 2024-04-16T17:44:29.733 INFO:teuthology.orchestra.run.smithi163.stdout: osd_max_omap_entries_per_request = 10000 2024-04-16T17:44:29.735 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2024-04-16T17:44:29.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2024-04-16T17:44:29.833 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-16T17:44:29.833 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:29.833 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2024-04-16T17:44:29.848 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:29.848 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2024-04-16T17:44:29.903 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T17:44:29.903 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:29.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/c2.keyring 2024-04-16T17:44:29.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-16T17:44:29.949 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2024-04-16T17:44:29.949 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:30.006 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T17:44:30.006 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:30.006 DEBUG:teuthology.orchestra.run.smithi023:> sudo dd of=/etc/ceph/c2.keyring 2024-04-16T17:44:30.006 DEBUG:teuthology.orchestra.run.smithi023:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-16T17:44:30.053 DEBUG:teuthology.orchestra.run.smithi023:> set -ex 2024-04-16T17:44:30.053 DEBUG:teuthology.orchestra.run.smithi023:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:30.110 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T17:44:30.111 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:30.111 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/c2.keyring 2024-04-16T17:44:30.111 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-16T17:44:30.152 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:30.152 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:30.208 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T17:44:30.208 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:30.208 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd of=/etc/ceph/c2.keyring 2024-04-16T17:44:30.208 DEBUG:teuthology.orchestra.run.smithi163:> sudo chmod 0644 /etc/ceph/c2.keyring 2024-04-16T17:44:30.251 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:30.251 DEBUG:teuthology.orchestra.run.smithi163:> dd of=/home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:30.307 INFO:tasks.ceph:Setting up mon nodes... 2024-04-16T17:44:30.308 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-16T17:44:30.308 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2024-04-16T17:44:30.411 INFO:teuthology.orchestra.run.smithi163.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2024-04-16T17:44:30.413 INFO:tasks.ceph:Setting up mds nodes... 2024-04-16T17:44:30.413 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-16T17:44:30.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2024-04-16T17:44:30.458 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/c2.client.0.keyring 2024-04-16T17:44:30.474 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2024-04-16T17:44:30.518 INFO:teuthology.orchestra.run.smithi163.stdout:creating /etc/ceph/c2.client.1.keyring 2024-04-16T17:44:30.534 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-16T17:44:30.534 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi023.front.sepia.ceph.com'): {'c1.osd.3': '/dev/vg_nvme/lv_1', 'c1.osd.4': '/dev/vg_nvme/lv_2', 'c1.osd.5': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi139.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi163.front.sepia.ceph.com'): {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-16T17:44:30.534 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2024-04-16T17:44:30.562 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:30.562 INFO:tasks.ceph:role: c2.osd.0 2024-04-16T17:44:30.562 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T17:44:30.562 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T17:44:30.637 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:44:30.637 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:44:30.637 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:44:30.638 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:44:30.638 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:44:30.638 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:44:30.638 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:44:30.638 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:44:30.638 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:44:30.638 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:31.139 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-16T17:44:31.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-16T17:44:31.141 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2024-04-16T17:44:31.291 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2024-04-16T17:44:31.327 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2024-04-16T17:44:31.396 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:31.396 INFO:tasks.ceph:role: c2.osd.1 2024-04-16T17:44:31.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T17:44:31.397 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T17:44:31.473 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:44:31.473 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:44:31.473 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:44:31.473 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:44:31.473 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:44:31.474 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:44:31.474 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:44:31.474 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:44:31.474 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:44:31.474 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:31.920 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-16T17:44:31.921 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-16T17:44:31.922 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2024-04-16T17:44:32.024 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2024-04-16T17:44:32.056 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2024-04-16T17:44:32.126 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:32.126 INFO:tasks.ceph:role: c2.osd.2 2024-04-16T17:44:32.126 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T17:44:32.126 DEBUG:teuthology.orchestra.run.smithi139:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T17:44:32.201 INFO:teuthology.orchestra.run.smithi139.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:44:32.201 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:44:32.201 INFO:teuthology.orchestra.run.smithi139.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:44:32.202 INFO:teuthology.orchestra.run.smithi139.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:44:32.202 INFO:teuthology.orchestra.run.smithi139.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:44:32.202 INFO:teuthology.orchestra.run.smithi139.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:44:32.202 INFO:teuthology.orchestra.run.smithi139.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:44:32.202 INFO:teuthology.orchestra.run.smithi139.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:44:32.202 INFO:teuthology.orchestra.run.smithi139.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:44:32.202 INFO:teuthology.orchestra.run.smithi139.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:32.689 INFO:teuthology.orchestra.run.smithi139.stdout:Discarding blocks...Done. 2024-04-16T17:44:32.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi139.front.sepia.ceph.com -o noatime 2024-04-16T17:44:32.691 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2024-04-16T17:44:32.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2024-04-16T17:44:32.875 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:32.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:32.974+0000 7f973879e640 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2024-04-16T17:44:32.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:32.975+0000 7f973879e640 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2024-04-16T17:44:32.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:32.975+0000 7f973879e640 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2024-04-16T17:44:32.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:32.975+0000 7f973879e640 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2024-04-16T17:44:32.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:32.975+0000 7f973879e640 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2024-04-16T17:44:32.982 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:32.983+0000 7f973879e640 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2024-04-16T17:44:35.060 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2024-04-16T17:44:35.092 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:35.186+0000 7f9b3661c640 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2024-04-16T17:44:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:35.187+0000 7f9b3661c640 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2024-04-16T17:44:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:35.187+0000 7f9b3661c640 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2024-04-16T17:44:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:35.187+0000 7f9b3661c640 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2024-04-16T17:44:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:35.187+0000 7f9b3661c640 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2024-04-16T17:44:35.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:35.187+0000 7f9b3661c640 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2024-04-16T17:44:37.265 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2024-04-16T17:44:37.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:37.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:37.395+0000 7fbfddc0d640 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2024-04-16T17:44:37.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:37.396+0000 7fbfddc0d640 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2024-04-16T17:44:37.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:37.396+0000 7fbfddc0d640 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2024-04-16T17:44:37.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:37.396+0000 7fbfddc0d640 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2024-04-16T17:44:37.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:37.396+0000 7fbfddc0d640 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2024-04-16T17:44:37.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:44:37.396+0000 7fbfddc0d640 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2024-04-16T17:44:39.486 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2024-04-16T17:44:39.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/c2-3 2024-04-16T17:44:39.552 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:39.552 INFO:tasks.ceph:role: c2.osd.3 2024-04-16T17:44:39.552 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T17:44:39.552 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-16T17:44:39.629 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:44:39.630 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:40.136 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-04-16T17:44:40.138 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-04-16T17:44:40.138 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-3 2024-04-16T17:44:40.275 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-3 2024-04-16T17:44:40.314 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/c2-4 2024-04-16T17:44:40.385 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:40.385 INFO:tasks.ceph:role: c2.osd.4 2024-04-16T17:44:40.385 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T17:44:40.385 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-16T17:44:40.462 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:44:40.463 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:40.909 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-04-16T17:44:40.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-04-16T17:44:40.911 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-4 2024-04-16T17:44:41.008 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-4 2024-04-16T17:44:41.043 DEBUG:teuthology.orchestra.run.smithi163:> sudo mkdir -p /var/lib/ceph/osd/c2-5 2024-04-16T17:44:41.113 INFO:tasks.ceph:roles_to_devs: {'c2.osd.3': '/dev/vg_nvme/lv_1', 'c2.osd.4': '/dev/vg_nvme/lv_2', 'c2.osd.5': '/dev/vg_nvme/lv_3'} 2024-04-16T17:44:41.113 INFO:tasks.ceph:role: c2.osd.5 2024-04-16T17:44:41.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T17:44:41.113 DEBUG:teuthology.orchestra.run.smithi163:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-16T17:44:41.190 INFO:teuthology.orchestra.run.smithi163.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-16T17:44:41.190 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-16T17:44:41.190 INFO:teuthology.orchestra.run.smithi163.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-16T17:44:41.190 INFO:teuthology.orchestra.run.smithi163.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-16T17:44:41.190 INFO:teuthology.orchestra.run.smithi163.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-16T17:44:41.190 INFO:teuthology.orchestra.run.smithi163.stdout: = sunit=0 swidth=0 blks 2024-04-16T17:44:41.190 INFO:teuthology.orchestra.run.smithi163.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-16T17:44:41.191 INFO:teuthology.orchestra.run.smithi163.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-16T17:44:41.191 INFO:teuthology.orchestra.run.smithi163.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-16T17:44:41.191 INFO:teuthology.orchestra.run.smithi163.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-16T17:44:41.684 INFO:teuthology.orchestra.run.smithi163.stdout:Discarding blocks...Done. 2024-04-16T17:44:41.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi163.front.sepia.ceph.com -o noatime 2024-04-16T17:44:41.686 DEBUG:teuthology.orchestra.run.smithi163:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-5 2024-04-16T17:44:41.830 DEBUG:teuthology.orchestra.run.smithi163:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-5 2024-04-16T17:44:41.867 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:41.982 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:41.984+0000 7f655e2a0640 -1 auth: error reading file: /var/lib/ceph/osd/c2-3/keyring: can't open /var/lib/ceph/osd/c2-3/keyring: (2) No such file or directory 2024-04-16T17:44:41.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:41.989+0000 7f655e2a0640 -1 created new key in keyring /var/lib/ceph/osd/c2-3/keyring 2024-04-16T17:44:41.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:41.989+0000 7f655e2a0640 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2024-04-16T17:44:41.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:41.989+0000 7f655e2a0640 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2024-04-16T17:44:41.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:41.989+0000 7f655e2a0640 -1 bluestore(/var/lib/ceph/osd/c2-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-3/block: (2) No such file or directory 2024-04-16T17:44:41.989 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:41.990+0000 7f655e2a0640 -1 bluestore(/var/lib/ceph/osd/c2-3) _read_fsid unparsable uuid 2024-04-16T17:44:44.073 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-3 2024-04-16T17:44:44.106 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:44.200 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:44.201+0000 7fce67fac640 -1 auth: error reading file: /var/lib/ceph/osd/c2-4/keyring: can't open /var/lib/ceph/osd/c2-4/keyring: (2) No such file or directory 2024-04-16T17:44:44.200 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:44.201+0000 7fce67fac640 -1 created new key in keyring /var/lib/ceph/osd/c2-4/keyring 2024-04-16T17:44:44.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:44.202+0000 7fce67fac640 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2024-04-16T17:44:44.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:44.202+0000 7fce67fac640 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2024-04-16T17:44:44.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:44.202+0000 7fce67fac640 -1 bluestore(/var/lib/ceph/osd/c2-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-4/block: (2) No such file or directory 2024-04-16T17:44:44.201 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:44.202+0000 7fce67fac640 -1 bluestore(/var/lib/ceph/osd/c2-4) _read_fsid unparsable uuid 2024-04-16T17:44:46.282 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-4 2024-04-16T17:44:46.315 DEBUG:teuthology.orchestra.run.smithi163:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:46.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:46.410+0000 7f65682b5640 -1 auth: error reading file: /var/lib/ceph/osd/c2-5/keyring: can't open /var/lib/ceph/osd/c2-5/keyring: (2) No such file or directory 2024-04-16T17:44:46.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:46.411+0000 7f65682b5640 -1 created new key in keyring /var/lib/ceph/osd/c2-5/keyring 2024-04-16T17:44:46.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:46.411+0000 7f65682b5640 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2024-04-16T17:44:46.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:46.411+0000 7f65682b5640 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2024-04-16T17:44:46.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:46.411+0000 7f65682b5640 -1 bluestore(/var/lib/ceph/osd/c2-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-5/block: (2) No such file or directory 2024-04-16T17:44:46.410 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:44:46.411+0000 7f65682b5640 -1 bluestore(/var/lib/ceph/osd/c2-5) _read_fsid unparsable uuid 2024-04-16T17:44:48.501 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-5 2024-04-16T17:44:48.533 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-16T17:44:48.534 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:48.534 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2024-04-16T17:44:48.567 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:48.567 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2024-04-16T17:44:48.638 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:48.638 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2024-04-16T17:44:48.709 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:48.709 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2024-04-16T17:44:48.741 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:48.741 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/c2-3/keyring of=/dev/stdout 2024-04-16T17:44:48.814 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:48.814 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/c2-4/keyring of=/dev/stdout 2024-04-16T17:44:48.885 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:48.885 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/c2-5/keyring of=/dev/stdout 2024-04-16T17:44:48.954 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:48.954 DEBUG:teuthology.orchestra.run.smithi139:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2024-04-16T17:44:48.972 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:48.972 DEBUG:teuthology.orchestra.run.smithi163:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2024-04-16T17:44:49.010 INFO:tasks.ceph:Adding keys to all mons... 2024-04-16T17:44:49.010 DEBUG:teuthology.orchestra.run.smithi139:> sudo tee -a /etc/ceph/c2.keyring 2024-04-16T17:44:49.041 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.0] 2024-04-16T17:44:49.041 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAAuR5m9RMtOhAAX5brY6Cx5b86cqMFPbyoyQ== 2024-04-16T17:44:49.041 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.1] 2024-04-16T17:44:49.041 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQADuR5m/X85CxAAyFiRqvLjtnLPkeOlYOjugw== 2024-04-16T17:44:49.041 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.2] 2024-04-16T17:44:49.041 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAFuR5mrw6qFxAAYAIaPvp3kmbkfmyP62rIHQ== 2024-04-16T17:44:49.041 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr.x] 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD+uB5mNRCjGBAAj02l5ZY3nnPTk/0pYv1/9g== 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.3] 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAJuR5me/+1OhAAw/IFJgfcSdUH8LYnv9TB1w== 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.4] 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAMuR5mHjATDBAAzUhR198V+9wC5oJiJ3LK9A== 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout:[osd.5] 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQAOuR5mu9KLGBAAY8azcMHN6IRm1p8TysJsPA== 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout:[client.0] 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD+uB5m5zdwGxAAEkCNb7vFKqTOziF+ZYDz7g== 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout:[client.1] 2024-04-16T17:44:49.042 INFO:teuthology.orchestra.run.smithi139.stdout: key = AQD+uB5mxk4JHxAAx2DVlHhsoh6+w1zCX0iRYA== 2024-04-16T17:44:49.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:49.140 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:49.195 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:49.249 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-16T17:44:49.303 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:49.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:49.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-16T17:44:49.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T17:44:49.520 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-16T17:44:49.577 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-16T17:44:49.577 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2024-04-16T17:44:49.605 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2024-04-16T17:44:49.706 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2024-04-16T17:44:49.734 DEBUG:teuthology.orchestra.run.smithi139:> rm -- /home/ubuntu/cephtest/c2.monmap 2024-04-16T17:44:49.789 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2024-04-16T17:44:49.789 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2024-04-16T17:44:49.789 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2024-04-16T17:44:49.831 INFO:tasks.ceph.c2.mon.a:Started 2024-04-16T17:44:49.831 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2024-04-16T17:44:49.831 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2024-04-16T17:44:49.832 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2024-04-16T17:44:49.834 INFO:tasks.ceph.c2.mgr.x:Started 2024-04-16T17:44:49.834 INFO:tasks.ceph:Setting crush tunables to default 2024-04-16T17:44:49.834 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster c2 osd crush tunables default 2024-04-16T17:44:50.011 INFO:teuthology.orchestra.run.smithi139.stderr:adjusted tunables profile to default 2024-04-16T17:44:50.020 INFO:tasks.ceph:check_enable_crimson: False 2024-04-16T17:44:50.020 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2024-04-16T17:44:50.020 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:50.021 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2024-04-16T17:44:50.048 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:50.049 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2024-04-16T17:44:50.117 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2024-04-16T17:44:50.117 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2024-04-16T17:44:50.185 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:50.185 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/c2-3/fsid of=/dev/stdout 2024-04-16T17:44:50.215 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:50.215 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/c2-4/fsid of=/dev/stdout 2024-04-16T17:44:50.285 DEBUG:teuthology.orchestra.run.smithi163:> set -ex 2024-04-16T17:44:50.285 DEBUG:teuthology.orchestra.run.smithi163:> sudo dd if=/var/lib/ceph/osd/c2-5/fsid of=/dev/stdout 2024-04-16T17:44:50.354 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster c2 osd new 237593df-581e-4fa8-a50b-b9c171d852ce 0 2024-04-16T17:44:50.394 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:50.395+0000 7fcf98442040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-16T17:44:50.451 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:50.452+0000 7fcf98442040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-16T17:44:50.577 INFO:teuthology.orchestra.run.smithi163.stdout:0 2024-04-16T17:44:50.589 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster c2 osd new 0aed9f4b-a5ae-49b2-8f12-4f4cfa9d9063 1 2024-04-16T17:44:50.770 INFO:teuthology.orchestra.run.smithi163.stdout:1 2024-04-16T17:44:50.782 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster c2 osd new 8b7e0c75-f524-4d1c-a5e5-6084888da40f 2 2024-04-16T17:44:50.966 INFO:teuthology.orchestra.run.smithi163.stdout:2 2024-04-16T17:44:50.977 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster c2 osd new 6d2d5b4a-dedd-4daa-bef2-b79a0dcb521a 3 2024-04-16T17:44:51.009 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.010+0000 7fcf98442040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-16T17:44:51.066 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.068+0000 7fcf98442040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-16T17:44:51.114 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.115+0000 7fcf98442040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-16T17:44:51.162 INFO:teuthology.orchestra.run.smithi163.stdout:3 2024-04-16T17:44:51.170 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.171+0000 7fcf98442040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-16T17:44:51.173 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster c2 osd new 5f14ff96-72e2-4c78-9826-1235b794ea1c 4 2024-04-16T17:44:51.214 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.216+0000 7fcf98442040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-16T17:44:51.338 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.339+0000 7fcf98442040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-16T17:44:51.400 INFO:teuthology.orchestra.run.smithi163.stdout:4 2024-04-16T17:44:51.411 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.412+0000 7fcf98442040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-16T17:44:51.412 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph --cluster c2 osd new 31a7bbe1-ec74-4826-aa5c-eaa536794037 5 2024-04-16T17:44:51.460 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.462+0000 7fcf98442040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-16T17:44:51.516 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.517+0000 7fcf98442040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-16T17:44:51.565 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.567+0000 7fcf98442040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-16T17:44:51.598 INFO:teuthology.orchestra.run.smithi163.stdout:5 2024-04-16T17:44:51.610 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2024-04-16T17:44:51.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2024-04-16T17:44:51.612 INFO:tasks.ceph.c2.osd.0:Started 2024-04-16T17:44:51.612 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2024-04-16T17:44:51.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2024-04-16T17:44:51.614 INFO:tasks.ceph.c2.osd.1:Started 2024-04-16T17:44:51.615 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2024-04-16T17:44:51.615 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2024-04-16T17:44:51.617 INFO:tasks.ceph.c2.osd.2:Started 2024-04-16T17:44:51.617 INFO:tasks.ceph.c2.osd.3:Restarting daemon 2024-04-16T17:44:51.617 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 3 2024-04-16T17:44:51.619 INFO:tasks.ceph.c2.osd.3:Started 2024-04-16T17:44:51.619 INFO:tasks.ceph.c2.osd.4:Restarting daemon 2024-04-16T17:44:51.620 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 4 2024-04-16T17:44:51.622 INFO:tasks.ceph.c2.osd.4:Started 2024-04-16T17:44:51.622 INFO:tasks.ceph.c2.osd.5:Restarting daemon 2024-04-16T17:44:51.622 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 5 2024-04-16T17:44:51.624 INFO:tasks.ceph.c2.osd.5:Started 2024-04-16T17:44:51.624 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2024-04-16T17:44:51.800 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:44:51.800 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":8,"fsid":"5d0c0a7c-617e-4057-9ede-145cc534fec0","created":"2024-04-16T17:44:49.922825+0000","modified":"2024-04-16T17:44:51.597519+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T17:44:51.597519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"237593df-581e-4fa8-a50b-b9c171d852ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0aed9f4b-a5ae-49b2-8f12-4f4cfa9d9063","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8b7e0c75-f524-4d1c-a5e5-6084888da40f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6d2d5b4a-dedd-4daa-bef2-b79a0dcb521a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f14ff96-72e2-4c78-9826-1235b794ea1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"31a7bbe1-ec74-4826-aa5c-eaa536794037","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:51.811 INFO:tasks.ceph.ceph_manager.c2:[] 2024-04-16T17:44:51.811 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-16T17:44:51.962 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:51.963+0000 7fcf98442040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-16T17:44:52.100 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.101+0000 7fcf98442040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-16T17:44:52.210 INFO:tasks.ceph.c2.osd.0.smithi139.stderr:2024-04-16T17:44:52.211+0000 7fbbdebac640 -1 Falling back to public interface 2024-04-16T17:44:52.211 INFO:tasks.ceph.c2.osd.1.smithi139.stderr:2024-04-16T17:44:52.212+0000 7f8246e24640 -1 Falling back to public interface 2024-04-16T17:44:52.215 INFO:tasks.ceph.c2.osd.2.smithi139.stderr:2024-04-16T17:44:52.216+0000 7f962cb9a640 -1 Falling back to public interface 2024-04-16T17:44:52.217 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.218+0000 7fcf98442040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-16T17:44:52.220 INFO:tasks.ceph.c2.osd.5.smithi163.stderr:2024-04-16T17:44:52.221+0000 7f148a7ac640 -1 Falling back to public interface 2024-04-16T17:44:52.228 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T17:44:52.229+0000 7fe4189fa640 -1 Falling back to public interface 2024-04-16T17:44:52.228 INFO:tasks.ceph.c2.osd.3.smithi163.stderr:2024-04-16T17:44:52.230+0000 7fe4bf60b640 -1 Falling back to public interface 2024-04-16T17:44:52.229 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T17:44:52.230+0000 7fe4179a9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6814/0: (98) Address already in use 2024-04-16T17:44:52.268 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.269+0000 7fcf98442040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-16T17:44:52.380 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.381+0000 7fcf98442040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-16T17:44:52.416 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2024-04-16T17:44:52.475 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.476+0000 7fcf98442040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-16T17:44:52.576 INFO:teuthology.misc.health.smithi139.stdout: 2024-04-16T17:44:52.576 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":8,"fsid":"5d0c0a7c-617e-4057-9ede-145cc534fec0","created":"2024-04-16T17:44:49.922825+0000","modified":"2024-04-16T17:44:51.597519+0000","last_up_change":"0.000000","last_in_change":"2024-04-16T17:44:51.597519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"237593df-581e-4fa8-a50b-b9c171d852ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0aed9f4b-a5ae-49b2-8f12-4f4cfa9d9063","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8b7e0c75-f524-4d1c-a5e5-6084888da40f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6d2d5b4a-dedd-4daa-bef2-b79a0dcb521a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f14ff96-72e2-4c78-9826-1235b794ea1c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"31a7bbe1-ec74-4826-aa5c-eaa536794037","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:52.585 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-04-16T17:44:52.633 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.634+0000 7fcf98442040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-16T17:44:52.675 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.677+0000 7fcf98442040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-16T17:44:52.833 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:52.834+0000 7fcf98442040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-16T17:44:53.658 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:53.660+0000 7fcf98442040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-16T17:44:53.934 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:53.935+0000 7fcf98442040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-16T17:44:53.985 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:53.986+0000 7fcf98442040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-16T17:44:54.102 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:54.103+0000 7fcf98442040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-16T17:44:54.886 INFO:tasks.ceph.c2.osd.0.smithi139.stderr:2024-04-16T17:44:54.886+0000 7fbbdebac640 -1 osd.0 0 log_to_monitors true 2024-04-16T17:44:54.935 INFO:tasks.ceph.c2.osd.1.smithi139.stderr:2024-04-16T17:44:54.936+0000 7f8246e24640 -1 osd.1 0 log_to_monitors true 2024-04-16T17:44:54.955 INFO:tasks.ceph.c2.osd.2.smithi139.stderr:2024-04-16T17:44:54.956+0000 7f962cb9a640 -1 osd.2 0 log_to_monitors true 2024-04-16T17:44:54.986 INFO:tasks.ceph.c2.osd.3.smithi163.stderr:2024-04-16T17:44:54.987+0000 7fe4bf60b640 -1 osd.3 0 log_to_monitors true 2024-04-16T17:44:54.991 INFO:tasks.ceph.c2.osd.5.smithi163.stderr:2024-04-16T17:44:54.992+0000 7f148a7ac640 -1 osd.5 0 log_to_monitors true 2024-04-16T17:44:54.991 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T17:44:54.993+0000 7fe4189fa640 -1 osd.4 0 log_to_monitors true 2024-04-16T17:44:55.110 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T17:44:55.112+0000 7fcf39010640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-16T17:44:57.389 INFO:tasks.ceph.c2.osd.3.smithi163.stderr:2024-04-16T17:44:57.390+0000 7fe4bb5a1640 -1 osd.3 0 waiting for initial osdmap 2024-04-16T17:44:57.397 INFO:tasks.ceph.c2.osd.2.smithi139.stderr:2024-04-16T17:44:57.398+0000 7f9629344640 -1 osd.2 0 waiting for initial osdmap 2024-04-16T17:44:57.400 INFO:tasks.ceph.c2.osd.1.smithi139.stderr:2024-04-16T17:44:57.402+0000 7f8242dba640 -1 osd.1 0 waiting for initial osdmap 2024-04-16T17:44:57.401 INFO:tasks.ceph.c2.osd.3.smithi163.stderr:2024-04-16T17:44:57.402+0000 7fe4b33c1640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:57.403 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T17:44:57.405+0000 7fe414990640 -1 osd.4 0 waiting for initial osdmap 2024-04-16T17:44:57.404 INFO:tasks.ceph.c2.osd.0.smithi139.stderr:2024-04-16T17:44:57.406+0000 7fbbdab42640 -1 osd.0 0 waiting for initial osdmap 2024-04-16T17:44:57.406 INFO:tasks.ceph.c2.osd.2.smithi139.stderr:2024-04-16T17:44:57.408+0000 7f9620950640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:57.411 INFO:tasks.ceph.c2.osd.1.smithi139.stderr:2024-04-16T17:44:57.413+0000 7f823abda640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:57.429 INFO:tasks.ceph.c2.osd.0.smithi139.stderr:2024-04-16T17:44:57.420+0000 7fbbd2962640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:57.430 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T17:44:57.419+0000 7fe40c7b0640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:57.440 INFO:tasks.ceph.c2.osd.5.smithi163.stderr:2024-04-16T17:44:57.441+0000 7f1486742640 -1 osd.5 0 waiting for initial osdmap 2024-04-16T17:44:57.452 INFO:tasks.ceph.c2.osd.5.smithi163.stderr:2024-04-16T17:44:57.452+0000 7f147e562640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-16T17:44:59.191 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2024-04-16T17:44:59.480 INFO:teuthology.misc.health.smithi139.stdout: 2024-04-16T17:44:59.480 INFO:teuthology.misc.health.smithi139.stdout:{"epoch":12,"fsid":"5d0c0a7c-617e-4057-9ede-145cc534fec0","created":"2024-04-16T17:44:49.922825+0000","modified":"2024-04-16T17:44:59.404805+0000","last_up_change":"2024-04-16T17:44:58.404008+0000","last_in_change":"2024-04-16T17:44:51.597519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"237593df-581e-4fa8-a50b-b9c171d852ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6801","nonce":3826731840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6803","nonce":3826731840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6807","nonce":3826731840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6805","nonce":3826731840}]},"public_addr":"172.21.15.139:6801/3826731840","cluster_addr":"172.21.15.139:6803/3826731840","heartbeat_back_addr":"172.21.15.139:6807/3826731840","heartbeat_front_addr":"172.21.15.139:6805/3826731840","state":["exists","up"]},{"osd":1,"uuid":"0aed9f4b-a5ae-49b2-8f12-4f4cfa9d9063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6809","nonce":4211966141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6811","nonce":4211966141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6815","nonce":4211966141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6813","nonce":4211966141}]},"public_addr":"172.21.15.139:6809/4211966141","cluster_addr":"172.21.15.139:6811/4211966141","heartbeat_back_addr":"172.21.15.139:6815/4211966141","heartbeat_front_addr":"172.21.15.139:6813/4211966141","state":["exists","up"]},{"osd":2,"uuid":"8b7e0c75-f524-4d1c-a5e5-6084888da40f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6817","nonce":2605942647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6819","nonce":2605942647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6823","nonce":2605942647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6821","nonce":2605942647}]},"public_addr":"172.21.15.139:6817/2605942647","cluster_addr":"172.21.15.139:6819/2605942647","heartbeat_back_addr":"172.21.15.139:6823/2605942647","heartbeat_front_addr":"172.21.15.139:6821/2605942647","state":["exists","up"]},{"osd":3,"uuid":"6d2d5b4a-dedd-4daa-bef2-b79a0dcb521a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6812","nonce":4051195518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6816","nonce":4051195518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6823","nonce":4051195518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6821","nonce":4051195518}]},"public_addr":"172.21.15.163:6812/4051195518","cluster_addr":"172.21.15.163:6816/4051195518","heartbeat_back_addr":"172.21.15.163:6823/4051195518","heartbeat_front_addr":"172.21.15.163:6821/4051195518","state":["exists","up"]},{"osd":4,"uuid":"5f14ff96-72e2-4c78-9826-1235b794ea1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6809","nonce":3573299152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6811","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6813","nonce":3573299152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6820","nonce":3573299152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6815","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6817","nonce":3573299152}]},"public_addr":"172.21.15.163:6809/3573299152","cluster_addr":"172.21.15.163:6813/3573299152","heartbeat_back_addr":"172.21.15.163:6820/3573299152","heartbeat_front_addr":"172.21.15.163:6817/3573299152","state":["exists","up"]},{"osd":5,"uuid":"31a7bbe1-ec74-4826-aa5c-eaa536794037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6801","nonce":1393540922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6803","nonce":1393540922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6807","nonce":1393540922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6805","nonce":1393540922}]},"public_addr":"172.21.15.163:6801/1393540922","cluster_addr":"172.21.15.163:6803/1393540922","heartbeat_back_addr":"172.21.15.163:6807/1393540922","heartbeat_front_addr":"172.21.15.163:6805/1393540922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.916837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.948994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.943534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:56.002356+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.952023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:56.003403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:44:59.491 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-04-16T17:44:59.491 INFO:tasks.ceph:Creating RBD pool 2024-04-16T17:44:59.491 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster c2 osd pool create rbd 8 2024-04-16T17:45:00.419 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'rbd' created 2024-04-16T17:45:00.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-16T17:45:01.419 INFO:teuthology.orchestra.run.smithi139.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-16T17:45:01.435 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2024-04-16T17:45:01.435 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2024-04-16T17:45:01.435 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2024-04-16T17:45:01.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2024-04-16T17:45:01.436 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-16T17:45:01.796 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:45:01.808 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":4,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6824","nonce":3759016943},{"type":"v1","addr":"172.21.15.163:6825","nonce":3759016943}]},"active_addr":"172.21.15.163:6825/3759016943","active_change":"2024-04-16T17:44:54.105887+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":4256417115}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":1642409919}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.163:0","nonce":2507551509}]}]} 2024-04-16T17:45:01.810 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2024-04-16T17:45:01.810 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2024-04-16T17:45:01.810 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2024-04-16T17:45:02.109 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:45:02.109 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":14,"fsid":"5d0c0a7c-617e-4057-9ede-145cc534fec0","created":"2024-04-16T17:44:49.922825+0000","modified":"2024-04-16T17:45:01.421350+0000","last_up_change":"2024-04-16T17:44:58.404008+0000","last_in_change":"2024-04-16T17:44:51.597519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-16T17:44:59.786390+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-16T17:45:00.125651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"237593df-581e-4fa8-a50b-b9c171d852ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6801","nonce":3826731840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6803","nonce":3826731840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6807","nonce":3826731840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6805","nonce":3826731840}]},"public_addr":"172.21.15.139:6801/3826731840","cluster_addr":"172.21.15.139:6803/3826731840","heartbeat_back_addr":"172.21.15.139:6807/3826731840","heartbeat_front_addr":"172.21.15.139:6805/3826731840","state":["exists","up"]},{"osd":1,"uuid":"0aed9f4b-a5ae-49b2-8f12-4f4cfa9d9063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6809","nonce":4211966141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6811","nonce":4211966141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6815","nonce":4211966141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6813","nonce":4211966141}]},"public_addr":"172.21.15.139:6809/4211966141","cluster_addr":"172.21.15.139:6811/4211966141","heartbeat_back_addr":"172.21.15.139:6815/4211966141","heartbeat_front_addr":"172.21.15.139:6813/4211966141","state":["exists","up"]},{"osd":2,"uuid":"8b7e0c75-f524-4d1c-a5e5-6084888da40f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6817","nonce":2605942647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6819","nonce":2605942647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6823","nonce":2605942647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6821","nonce":2605942647}]},"public_addr":"172.21.15.139:6817/2605942647","cluster_addr":"172.21.15.139:6819/2605942647","heartbeat_back_addr":"172.21.15.139:6823/2605942647","heartbeat_front_addr":"172.21.15.139:6821/2605942647","state":["exists","up"]},{"osd":3,"uuid":"6d2d5b4a-dedd-4daa-bef2-b79a0dcb521a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6812","nonce":4051195518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6816","nonce":4051195518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6823","nonce":4051195518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6821","nonce":4051195518}]},"public_addr":"172.21.15.163:6812/4051195518","cluster_addr":"172.21.15.163:6816/4051195518","heartbeat_back_addr":"172.21.15.163:6823/4051195518","heartbeat_front_addr":"172.21.15.163:6821/4051195518","state":["exists","up"]},{"osd":4,"uuid":"5f14ff96-72e2-4c78-9826-1235b794ea1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6809","nonce":3573299152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6811","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6813","nonce":3573299152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6820","nonce":3573299152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6815","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6817","nonce":3573299152}]},"public_addr":"172.21.15.163:6809/3573299152","cluster_addr":"172.21.15.163:6813/3573299152","heartbeat_back_addr":"172.21.15.163:6820/3573299152","heartbeat_front_addr":"172.21.15.163:6817/3573299152","state":["exists","up"]},{"osd":5,"uuid":"31a7bbe1-ec74-4826-aa5c-eaa536794037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6801","nonce":1393540922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6803","nonce":1393540922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6807","nonce":1393540922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6805","nonce":1393540922}]},"public_addr":"172.21.15.163:6801/1393540922","cluster_addr":"172.21.15.163:6803/1393540922","heartbeat_back_addr":"172.21.15.163:6807/1393540922","heartbeat_front_addr":"172.21.15.163:6805/1393540922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.916837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.948994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.943534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:56.002356+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.952023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:56.003403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:45:02.122 INFO:tasks.ceph.ceph_manager.c2:all up! 2024-04-16T17:45:02.123 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2024-04-16T17:45:02.412 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:45:02.413 INFO:teuthology.orchestra.run.smithi139.stdout:{"epoch":14,"fsid":"5d0c0a7c-617e-4057-9ede-145cc534fec0","created":"2024-04-16T17:44:49.922825+0000","modified":"2024-04-16T17:45:01.421350+0000","last_up_change":"2024-04-16T17:44:58.404008+0000","last_in_change":"2024-04-16T17:44:51.597519+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-16T17:44:59.786390+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-16T17:45:00.125651+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"237593df-581e-4fa8-a50b-b9c171d852ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6800","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6801","nonce":3826731840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6802","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6803","nonce":3826731840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6806","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6807","nonce":3826731840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6804","nonce":3826731840},{"type":"v1","addr":"172.21.15.139:6805","nonce":3826731840}]},"public_addr":"172.21.15.139:6801/3826731840","cluster_addr":"172.21.15.139:6803/3826731840","heartbeat_back_addr":"172.21.15.139:6807/3826731840","heartbeat_front_addr":"172.21.15.139:6805/3826731840","state":["exists","up"]},{"osd":1,"uuid":"0aed9f4b-a5ae-49b2-8f12-4f4cfa9d9063","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6808","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6809","nonce":4211966141}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6810","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6811","nonce":4211966141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6814","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6815","nonce":4211966141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6812","nonce":4211966141},{"type":"v1","addr":"172.21.15.139:6813","nonce":4211966141}]},"public_addr":"172.21.15.139:6809/4211966141","cluster_addr":"172.21.15.139:6811/4211966141","heartbeat_back_addr":"172.21.15.139:6815/4211966141","heartbeat_front_addr":"172.21.15.139:6813/4211966141","state":["exists","up"]},{"osd":2,"uuid":"8b7e0c75-f524-4d1c-a5e5-6084888da40f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6816","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6817","nonce":2605942647}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6818","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6819","nonce":2605942647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6822","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6823","nonce":2605942647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.139:6820","nonce":2605942647},{"type":"v1","addr":"172.21.15.139:6821","nonce":2605942647}]},"public_addr":"172.21.15.139:6817/2605942647","cluster_addr":"172.21.15.139:6819/2605942647","heartbeat_back_addr":"172.21.15.139:6823/2605942647","heartbeat_front_addr":"172.21.15.139:6821/2605942647","state":["exists","up"]},{"osd":3,"uuid":"6d2d5b4a-dedd-4daa-bef2-b79a0dcb521a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6810","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6812","nonce":4051195518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6814","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6816","nonce":4051195518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6822","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6823","nonce":4051195518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6818","nonce":4051195518},{"type":"v1","addr":"172.21.15.163:6821","nonce":4051195518}]},"public_addr":"172.21.15.163:6812/4051195518","cluster_addr":"172.21.15.163:6816/4051195518","heartbeat_back_addr":"172.21.15.163:6823/4051195518","heartbeat_front_addr":"172.21.15.163:6821/4051195518","state":["exists","up"]},{"osd":4,"uuid":"5f14ff96-72e2-4c78-9826-1235b794ea1c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6808","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6809","nonce":3573299152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6811","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6813","nonce":3573299152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6819","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6820","nonce":3573299152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6815","nonce":3573299152},{"type":"v1","addr":"172.21.15.163:6817","nonce":3573299152}]},"public_addr":"172.21.15.163:6809/3573299152","cluster_addr":"172.21.15.163:6813/3573299152","heartbeat_back_addr":"172.21.15.163:6820/3573299152","heartbeat_front_addr":"172.21.15.163:6817/3573299152","state":["exists","up"]},{"osd":5,"uuid":"31a7bbe1-ec74-4826-aa5c-eaa536794037","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6800","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6801","nonce":1393540922}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6802","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6803","nonce":1393540922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6806","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6807","nonce":1393540922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.163:6804","nonce":1393540922},{"type":"v1","addr":"172.21.15.163:6805","nonce":1393540922}]},"public_addr":"172.21.15.163:6801/1393540922","cluster_addr":"172.21.15.163:6803/1393540922","heartbeat_back_addr":"172.21.15.163:6807/1393540922","heartbeat_front_addr":"172.21.15.163:6805/1393540922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.916837+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.948994+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.943534+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:56.002356+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:55.952023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:56.003403+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T17:45:02.425 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2024-04-16T17:45:02.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2024-04-16T17:45:02.426 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2024-04-16T17:45:02.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.3 flush_pg_stats 2024-04-16T17:45:02.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.4 flush_pg_stats 2024-04-16T17:45:02.427 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.5 flush_pg_stats 2024-04-16T17:45:02.608 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:02.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.5 2024-04-16T17:45:02.610 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-04-16T17:45:02.610 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2024-04-16T17:45:02.631 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:02.631 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.4 2024-04-16T17:45:02.637 INFO:teuthology.orchestra.run.smithi139.stdout:47244640261 2024-04-16T17:45:02.637 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2024-04-16T17:45:02.654 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:02.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.3 2024-04-16T17:45:02.655 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:02.655 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2024-04-16T17:45:03.007 INFO:teuthology.orchestra.run.smithi139.stdout:47244640258 2024-04-16T17:45:03.008 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-04-16T17:45:03.025 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640259 got 47244640258 for osd.2 2024-04-16T17:45:03.026 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.3 2024-04-16T17:45:03.102 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-04-16T17:45:03.115 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.5 2024-04-16T17:45:03.119 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-04-16T17:45:03.132 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.4 2024-04-16T17:45:03.137 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-04-16T17:45:03.151 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640259 for osd.1 2024-04-16T17:45:03.152 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:03.165 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640260 for osd.0 2024-04-16T17:45:04.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2024-04-16T17:45:04.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.3 2024-04-16T17:45:04.115 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.5 2024-04-16T17:45:04.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.4 2024-04-16T17:45:04.152 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2024-04-16T17:45:04.165 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2024-04-16T17:45:04.429 INFO:teuthology.orchestra.run.smithi139.stdout:47244640258 2024-04-16T17:45:04.444 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640259 got 47244640258 for osd.2 2024-04-16T17:45:04.458 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:04.476 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640260 for osd.3 2024-04-16T17:45:04.477 DEBUG:teuthology.parallel:result is None 2024-04-16T17:45:04.499 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:04.506 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:04.514 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640260 for osd.4 2024-04-16T17:45:04.514 DEBUG:teuthology.parallel:result is None 2024-04-16T17:45:04.520 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640260 for osd.5 2024-04-16T17:45:04.520 DEBUG:teuthology.parallel:result is None 2024-04-16T17:45:04.579 INFO:teuthology.orchestra.run.smithi139.stdout:47244640260 2024-04-16T17:45:04.592 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640260 got 47244640260 for osd.1 2024-04-16T17:45:04.592 DEBUG:teuthology.parallel:result is None 2024-04-16T17:45:04.605 INFO:teuthology.orchestra.run.smithi139.stdout:47244640261 2024-04-16T17:45:04.618 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640261 got 47244640261 for osd.0 2024-04-16T17:45:04.618 DEBUG:teuthology.parallel:result is None 2024-04-16T17:45:05.445 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2024-04-16T17:45:05.742 INFO:teuthology.orchestra.run.smithi139.stdout:47244640259 2024-04-16T17:45:05.754 INFO:tasks.ceph.ceph_manager.c2:need seq 47244640259 got 47244640259 for osd.2 2024-04-16T17:45:05.754 DEBUG:teuthology.parallel:result is None 2024-04-16T17:45:05.755 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2024-04-16T17:45:05.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-16T17:45:06.042 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:45:06.043 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-16T17:45:06.055 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-04-16T17:45:04.110988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":164656,"kb_used_data":1904,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628980944,"statfs":{"total":644245094400,"available":644076486656,"internally_reserved":0,"allocated":1949696,"data_stored":1396886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.429993+0000","last_change":"2024-04-16T17:45:02.081706+0000","last_active":"2024-04-16T17:45:02.429993+0000","last_peered":"2024-04-16T17:45:02.429993+0000","last_clean":"2024-04-16T17:45:02.429993+0000","last_became_active":"2024-04-16T17:45:02.081407+0000","last_became_peered":"2024-04-16T17:45:02.081407+0000","last_unstale":"2024-04-16T17:45:02.429993+0000","last_undegraded":"2024-04-16T17:45:02.429993+0000","last_fullsized":"2024-04-16T17:45:02.429993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:27.475365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.851390+0000","last_change":"2024-04-16T17:45:01.850858+0000","last_active":"2024-04-16T17:45:01.851390+0000","last_peered":"2024-04-16T17:45:01.851390+0000","last_clean":"2024-04-16T17:45:01.851390+0000","last_became_active":"2024-04-16T17:45:01.850234+0000","last_became_peered":"2024-04-16T17:45:01.850234+0000","last_unstale":"2024-04-16T17:45:01.851390+0000","last_undegraded":"2024-04-16T17:45:01.851390+0000","last_fullsized":"2024-04-16T17:45:01.851390+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:52.864653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.082694+0000","last_change":"2024-04-16T17:45:02.081649+0000","last_active":"2024-04-16T17:45:02.082694+0000","last_peered":"2024-04-16T17:45:02.082694+0000","last_clean":"2024-04-16T17:45:02.082694+0000","last_became_active":"2024-04-16T17:45:02.081348+0000","last_became_peered":"2024-04-16T17:45:02.081348+0000","last_unstale":"2024-04-16T17:45:02.082694+0000","last_undegraded":"2024-04-16T17:45:02.082694+0000","last_fullsized":"2024-04-16T17:45:02.082694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:52.864653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.430240+0000","last_change":"2024-04-16T17:45:01.429672+0000","last_active":"2024-04-16T17:45:01.430240+0000","last_peered":"2024-04-16T17:45:01.430240+0000","last_clean":"2024-04-16T17:45:01.430240+0000","last_became_active":"2024-04-16T17:45:01.429457+0000","last_became_peered":"2024-04-16T17:45:01.429457+0000","last_unstale":"2024-04-16T17:45:01.430240+0000","last_undegraded":"2024-04-16T17:45:01.430240+0000","last_fullsized":"2024-04-16T17:45:01.430240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:32.303022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":159,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.091250+0000","last_change":"2024-04-16T17:45:01.429553+0000","last_active":"2024-04-16T17:45:02.091250+0000","last_peered":"2024-04-16T17:45:02.091250+0000","last_clean":"2024-04-16T17:45:02.091250+0000","last_became_active":"2024-04-16T17:45:01.429316+0000","last_became_peered":"2024-04-16T17:45:01.429316+0000","last_unstale":"2024-04-16T17:45:02.091250+0000","last_undegraded":"2024-04-16T17:45:02.091250+0000","last_fullsized":"2024-04-16T17:45:02.091250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:32.303022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.430678+0000","last_change":"2024-04-16T17:45:01.430178+0000","last_active":"2024-04-16T17:45:01.430678+0000","last_peered":"2024-04-16T17:45:01.430678+0000","last_clean":"2024-04-16T17:45:01.430678+0000","last_became_active":"2024-04-16T17:45:01.429935+0000","last_became_peered":"2024-04-16T17:45:01.429935+0000","last_unstale":"2024-04-16T17:45:01.430678+0000","last_undegraded":"2024-04-16T17:45:01.430678+0000","last_fullsized":"2024-04-16T17:45:01.430678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:52.864653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.850823+0000","last_change":"2024-04-16T17:45:01.850173+0000","last_active":"2024-04-16T17:45:01.850823+0000","last_peered":"2024-04-16T17:45:01.850823+0000","last_clean":"2024-04-16T17:45:01.850823+0000","last_became_active":"2024-04-16T17:45:01.849922+0000","last_became_peered":"2024-04-16T17:45:01.849922+0000","last_unstale":"2024-04-16T17:45:01.850823+0000","last_undegraded":"2024-04-16T17:45:01.850823+0000","last_fullsized":"2024-04-16T17:45:01.850823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:32.303022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.429975+0000","last_change":"2024-04-16T17:45:01.850173+0000","last_active":"2024-04-16T17:45:02.429975+0000","last_peered":"2024-04-16T17:45:02.429975+0000","last_clean":"2024-04-16T17:45:02.429975+0000","last_became_active":"2024-04-16T17:45:01.849924+0000","last_became_peered":"2024-04-16T17:45:01.849924+0000","last_unstale":"2024-04-16T17:45:02.429975+0000","last_undegraded":"2024-04-16T17:45:02.429975+0000","last_fullsized":"2024-04-16T17:45:02.429975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:18.784165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.851545+0000","last_change":"2024-04-16T17:45:01.851175+0000","last_active":"2024-04-16T17:45:01.851545+0000","last_peered":"2024-04-16T17:45:01.851545+0000","last_clean":"2024-04-16T17:45:01.851545+0000","last_became_active":"2024-04-16T17:45:01.850846+0000","last_became_peered":"2024-04-16T17:45:01.850846+0000","last_unstale":"2024-04-16T17:45:01.851545+0000","last_undegraded":"2024-04-16T17:45:01.851545+0000","last_fullsized":"2024-04-16T17:45:01.851545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:18.784165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":37787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":37787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28040,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829560,"statfs":{"total":107374182400,"available":107345469440,"internally_reserved":0,"allocated":724992,"data_stored":628155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27136,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830464,"statfs":{"total":107374182400,"available":107346395136,"internally_reserved":0,"allocated":118784,"data_stored":32501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28040,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829560,"statfs":{"total":107374182400,"available":107345469440,"internally_reserved":0,"allocated":724992,"data_stored":628155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27136,"kb_used_data":116,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830464,"statfs":{"total":107374182400,"available":107346395136,"internally_reserved":0,"allocated":118784,"data_stored":32501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T17:45:06.055 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-16T17:45:06.339 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:45:06.339 INFO:teuthology.orchestra.run.smithi139.stderr:dumped all 2024-04-16T17:45:06.354 INFO:teuthology.orchestra.run.smithi139.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-16T17:45:06.111380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":165208,"kb_used_data":1952,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":628980392,"statfs":{"total":644245094400,"available":644075921408,"internally_reserved":0,"allocated":1998848,"data_stored":1417966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":165927585},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000392"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.429993+0000","last_change":"2024-04-16T17:45:02.081706+0000","last_active":"2024-04-16T17:45:02.429993+0000","last_peered":"2024-04-16T17:45:02.429993+0000","last_clean":"2024-04-16T17:45:02.429993+0000","last_became_active":"2024-04-16T17:45:02.081407+0000","last_became_peered":"2024-04-16T17:45:02.081407+0000","last_unstale":"2024-04-16T17:45:02.429993+0000","last_undegraded":"2024-04-16T17:45:02.429993+0000","last_fullsized":"2024-04-16T17:45:02.429993+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:27.475365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.851390+0000","last_change":"2024-04-16T17:45:01.850858+0000","last_active":"2024-04-16T17:45:01.851390+0000","last_peered":"2024-04-16T17:45:01.851390+0000","last_clean":"2024-04-16T17:45:01.851390+0000","last_became_active":"2024-04-16T17:45:01.850234+0000","last_became_peered":"2024-04-16T17:45:01.850234+0000","last_unstale":"2024-04-16T17:45:01.851390+0000","last_undegraded":"2024-04-16T17:45:01.851390+0000","last_fullsized":"2024-04-16T17:45:01.851390+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:52.864653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.082694+0000","last_change":"2024-04-16T17:45:02.081649+0000","last_active":"2024-04-16T17:45:02.082694+0000","last_peered":"2024-04-16T17:45:02.082694+0000","last_clean":"2024-04-16T17:45:02.082694+0000","last_became_active":"2024-04-16T17:45:02.081348+0000","last_became_peered":"2024-04-16T17:45:02.081348+0000","last_unstale":"2024-04-16T17:45:02.082694+0000","last_undegraded":"2024-04-16T17:45:02.082694+0000","last_fullsized":"2024-04-16T17:45:02.082694+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:52.864653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.430240+0000","last_change":"2024-04-16T17:45:01.429672+0000","last_active":"2024-04-16T17:45:01.430240+0000","last_peered":"2024-04-16T17:45:01.430240+0000","last_clean":"2024-04-16T17:45:01.430240+0000","last_became_active":"2024-04-16T17:45:01.429457+0000","last_became_peered":"2024-04-16T17:45:01.429457+0000","last_unstale":"2024-04-16T17:45:01.430240+0000","last_undegraded":"2024-04-16T17:45:01.430240+0000","last_fullsized":"2024-04-16T17:45:01.430240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:32.303022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'117","reported_seq":159,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.091250+0000","last_change":"2024-04-16T17:45:01.429553+0000","last_active":"2024-04-16T17:45:02.091250+0000","last_peered":"2024-04-16T17:45:02.091250+0000","last_clean":"2024-04-16T17:45:02.091250+0000","last_became_active":"2024-04-16T17:45:01.429316+0000","last_became_peered":"2024-04-16T17:45:01.429316+0000","last_unstale":"2024-04-16T17:45:02.091250+0000","last_undegraded":"2024-04-16T17:45:02.091250+0000","last_fullsized":"2024-04-16T17:45:02.091250+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:32.303022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.430678+0000","last_change":"2024-04-16T17:45:01.430178+0000","last_active":"2024-04-16T17:45:01.430678+0000","last_peered":"2024-04-16T17:45:01.430678+0000","last_clean":"2024-04-16T17:45:01.430678+0000","last_became_active":"2024-04-16T17:45:01.429935+0000","last_became_peered":"2024-04-16T17:45:01.429935+0000","last_unstale":"2024-04-16T17:45:01.430678+0000","last_undegraded":"2024-04-16T17:45:01.430678+0000","last_fullsized":"2024-04-16T17:45:01.430678+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:52.864653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.850823+0000","last_change":"2024-04-16T17:45:01.850173+0000","last_active":"2024-04-16T17:45:01.850823+0000","last_peered":"2024-04-16T17:45:01.850823+0000","last_clean":"2024-04-16T17:45:01.850823+0000","last_became_active":"2024-04-16T17:45:01.849922+0000","last_became_peered":"2024-04-16T17:45:01.849922+0000","last_unstale":"2024-04-16T17:45:01.850823+0000","last_undegraded":"2024-04-16T17:45:01.850823+0000","last_fullsized":"2024-04-16T17:45:01.850823+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:32.303022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-16T17:45:02.429975+0000","last_change":"2024-04-16T17:45:01.850173+0000","last_active":"2024-04-16T17:45:02.429975+0000","last_peered":"2024-04-16T17:45:02.429975+0000","last_clean":"2024-04-16T17:45:02.429975+0000","last_became_active":"2024-04-16T17:45:01.849924+0000","last_became_peered":"2024-04-16T17:45:01.849924+0000","last_unstale":"2024-04-16T17:45:02.429975+0000","last_undegraded":"2024-04-16T17:45:02.429975+0000","last_fullsized":"2024-04-16T17:45:02.429975+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:18.784165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-16T17:45:01.851545+0000","last_change":"2024-04-16T17:45:01.851175+0000","last_active":"2024-04-16T17:45:01.851545+0000","last_peered":"2024-04-16T17:45:01.851545+0000","last_clean":"2024-04-16T17:45:01.851545+0000","last_became_active":"2024-04-16T17:45:01.850846+0000","last_became_peered":"2024-04-16T17:45:01.850846+0000","last_unstale":"2024-04-16T17:45:01.851545+0000","last_undegraded":"2024-04-16T17:45:01.851545+0000","last_fullsized":"2024-04-16T17:45:01.851545+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:00.415425+0000","last_clean_scrub_stamp":"2024-04-16T17:45:00.415425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:30:18.784165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27168,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830432,"statfs":{"total":107374182400,"available":107346362368,"internally_reserved":0,"allocated":143360,"data_stored":43041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":37787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28288,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829312,"statfs":{"total":107374182400,"available":107345215488,"internally_reserved":0,"allocated":724992,"data_stored":628155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27152,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830448,"statfs":{"total":107374182400,"available":107346378752,"internally_reserved":0,"allocated":131072,"data_stored":37787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":28288,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104829312,"statfs":{"total":107374182400,"available":107345215488,"internally_reserved":0,"allocated":724992,"data_stored":628155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":27160,"kb_used_data":140,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":104830440,"statfs":{"total":107374182400,"available":107346370560,"internally_reserved":0,"allocated":143360,"data_stored":43041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T17:45:06.354 INFO:tasks.ceph.ceph_manager.c2:clean! 2024-04-16T17:45:06.355 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2024-04-16T17:45:06.355 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2024-04-16T17:45:06.355 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2024-04-16T17:45:06.680 INFO:teuthology.orchestra.run.smithi139.stdout: 2024-04-16T17:45:06.680 INFO:teuthology.orchestra.run.smithi139.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-16T17:45:06.693 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2024-04-16T17:45:06.693 INFO:teuthology.run_tasks:Running task rgw... 2024-04-16T17:45:06.750 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2024-04-16T17:45:06.751 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c1.client.1', 'c2.client.0', 'c2.client.1']) 2024-04-16T17:45:06.751 INFO:tasks.rgw:Creating data pools 2024-04-16T17:45:06.751 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2024-04-16T17:45:06.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2024-04-16T17:45:07.367 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.data' created 2024-04-16T17:45:07.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2024-04-16T17:45:08.368 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-16T17:45:08.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2024-04-16T17:45:09.374 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'default.rgw.buckets.index' created 2024-04-16T17:45:09.394 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2024-04-16T17:45:10.378 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-16T17:45:10.409 DEBUG:tasks.rgw:Obtaining remote for client c1.client.1 2024-04-16T17:45:10.410 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2024-04-16T17:45:10.718 INFO:teuthology.orchestra.run.smithi023.stderr:pool 'default.rgw.buckets.data' already exists 2024-04-16T17:45:10.730 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2024-04-16T17:45:11.380 INFO:teuthology.orchestra.run.smithi023.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-16T17:45:11.394 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2024-04-16T17:45:11.696 INFO:teuthology.orchestra.run.smithi023.stderr:pool 'default.rgw.buckets.index' already exists 2024-04-16T17:45:11.708 DEBUG:teuthology.orchestra.run.smithi023:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2024-04-16T17:45:12.384 INFO:teuthology.orchestra.run.smithi023.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-16T17:45:12.397 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2024-04-16T17:45:12.397 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2024-04-16T17:45:13.491 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'default.rgw.buckets.data' created 2024-04-16T17:45:13.512 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2024-04-16T17:45:14.494 INFO:teuthology.orchestra.run.smithi139.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-16T17:45:14.523 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2024-04-16T17:45:15.498 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'default.rgw.buckets.index' created 2024-04-16T17:45:15.521 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2024-04-16T17:45:16.504 INFO:teuthology.orchestra.run.smithi139.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-16T17:45:16.528 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2024-04-16T17:45:16.528 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2024-04-16T17:45:16.826 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'default.rgw.buckets.data' already exists 2024-04-16T17:45:16.838 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2024-04-16T17:45:17.513 INFO:teuthology.orchestra.run.smithi163.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-16T17:45:17.526 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2024-04-16T17:45:17.818 INFO:teuthology.orchestra.run.smithi163.stderr:pool 'default.rgw.buckets.index' already exists 2024-04-16T17:45:17.831 DEBUG:teuthology.orchestra.run.smithi163:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2024-04-16T17:45:18.516 INFO:teuthology.orchestra.run.smithi163.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-16T17:45:18.529 DEBUG:tasks.rgw:Pools created 2024-04-16T17:45:18.530 INFO:tasks.rgw:Configuring compression type = random 2024-04-16T17:45:18.530 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2024-04-16T17:45:18.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2024-04-16T17:45:18.530 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2024-04-16T17:45:18.626 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:18.627 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:20.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.443+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.444+0000 7f7c8071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.444+0000 7f7c8071f800 20 realm 2024-04-16T17:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.444+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.444+0000 7f7c8071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.444+0000 7f7c8071f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-16T17:45:20.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.444+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.445+0000 7f7c8071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.445+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.446+0000 7f7c8071f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:20.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.446+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.447+0000 7f7c8071f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-16T17:45:20.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.447+0000 7f7c8071f800 20 searching for the correct realm 2024-04-16T17:45:20.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.457+0000 7f7c8071f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-16T17:45:20.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.457+0000 7f7c8071f800 20 RGWRados::pool_iterate: got zonegroup_info.094c2520-ec1e-493c-ae18-851c59b8fffa 2024-04-16T17:45:20.456 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.457+0000 7f7c8071f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-16T17:45:20.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.457+0000 7f7c8071f800 20 RGWRados::pool_iterate: got zone_info.40f9b535-6f08-4845-bdb4-34a1f41d23a8 2024-04-16T17:45:20.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.457+0000 7f7c8071f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-16T17:45:20.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.457+0000 7f7c8071f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-16T17:45:20.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.457+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.458+0000 7f7c8071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:20.457 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.458+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.458+0000 7f7c8071f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.458+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 20 zone default found 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 4 Realm: () 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 4 ZoneGroup: default (094c2520-ec1e-493c-ae18-851c59b8fffa) 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 4 Zone: default (40f9b535-6f08-4845-bdb4-34a1f41d23a8) 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 20 zonegroup default 2024-04-16T17:45:20.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:20.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:20.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:20.459+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:22.414 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:22.415+0000 7f7c8071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:22.415 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:22.415+0000 7f7c8071f800 20 rados->read ofs=0 len=0 2024-04-16T17:45:22.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:22.421+0000 7f7c8071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:22.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:22.421+0000 7f7c8071f800 20 started sync module instance, tier type = 2024-04-16T17:45:22.420 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:22.421+0000 7f7c8071f800 20 started zone id=40f9b535-6f08-4845-bdb4-34a1f41d23a8 (name=default) with tier type = 2024-04-16T17:45:24.441 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.442+0000 7f7c8071f800 20 add_watcher() i=0 2024-04-16T17:45:24.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.442+0000 7f7c8071f800 20 add_watcher() i=1 2024-04-16T17:45:24.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.442+0000 7f7c8071f800 20 add_watcher() i=2 2024-04-16T17:45:24.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.442+0000 7f7c8071f800 20 add_watcher() i=3 2024-04-16T17:45:24.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.442+0000 7f7c8071f800 20 add_watcher() i=4 2024-04-16T17:45:24.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.442+0000 7f7c8071f800 20 add_watcher() i=5 2024-04-16T17:45:24.442 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.442+0000 7f7c8071f800 20 add_watcher() i=6 2024-04-16T17:45:24.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.443+0000 7f7c8071f800 20 add_watcher() i=7 2024-04-16T17:45:24.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.443+0000 7f7c8071f800 2 all 8 watchers are set, enabling cache 2024-04-16T17:45:24.443 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.444+0000 7f7c8071f800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.444+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.444+0000 7f7c8071f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.444+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.444+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.444+0000 7f7c8071f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-04-16T17:45:24.444 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:24.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-04-16T17:45:24.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.445+0000 7f7c8071f800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-04-16T17:45:24.445 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.447+0000 7f7c8071f800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:24.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.451+0000 7f7b2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:24.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.451+0000 7f7c8071f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:24.450 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:24.451+0000 7f7c8071f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:27.424 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.425+0000 7f7c8071f800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-04-16T17:45:27.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.425+0000 7f7c8071f800 5 note: GC not initialized 2024-04-16T17:45:27.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.426+0000 7f7b2dfe3640 20 reqs_thread_entry: start 2024-04-16T17:45:27.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.426+0000 7f7c8071f800 20 init_complete bucket index max shards: 11 2024-04-16T17:45:27.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.426+0000 7f7c8071f800 20 Filter name: none 2024-04-16T17:45:27.425 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.426+0000 7f7b26ffd640 20 reqs_thread_entry: start 2024-04-16T17:45:27.451 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.452+0000 7f7b2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:27.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.460+0000 7f7c8071f800 20 remove_watcher() i=0 2024-04-16T17:45:27.458 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.460+0000 7f7c8071f800 2 removed watcher, disabling cache 2024-04-16T17:45:27.459 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.461+0000 7f7c8071f800 20 remove_watcher() i=1 2024-04-16T17:45:27.461 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.462+0000 7f7c8071f800 20 remove_watcher() i=2 2024-04-16T17:45:27.465 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.466+0000 7f7c8071f800 20 remove_watcher() i=3 2024-04-16T17:45:27.466 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.468+0000 7f7c8071f800 20 remove_watcher() i=4 2024-04-16T17:45:27.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.469+0000 7f7c8071f800 20 remove_watcher() i=5 2024-04-16T17:45:27.468 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.470+0000 7f7c8071f800 20 remove_watcher() i=6 2024-04-16T17:45:27.470 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.471+0000 7f7c8071f800 20 remove_watcher() i=7 2024-04-16T17:45:27.487 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T17:45:27.488 DEBUG:tasks.util.rgw: json result: [] 2024-04-16T17:45:27.488 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:27.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:27.488 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-16T17:45:27.540 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:27.541 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:27.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.569+0000 7f819b531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:27.568 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.569+0000 7f819b531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:27.570 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:27.572+0000 7f8015ffb640 20 reqs_thread_entry: start 2024-04-16T17:45:27.588 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"40f9b535-6f08-4845-bdb4-34a1f41d23a8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-16T17:45:27.588 DEBUG:tasks.util.rgw: json result: {'id': '40f9b535-6f08-4845-bdb4-34a1f41d23a8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-16T17:45:27.588 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['user', 'list'] 2024-04-16T17:45:27.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'user', 'list'] 2024-04-16T17:45:27.588 DEBUG:teuthology.orchestra.run.smithi023:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 user list 2024-04-16T17:45:27.684 INFO:teuthology.orchestra.run.smithi023.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:27.684 INFO:teuthology.orchestra.run.smithi023.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:27.722 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.722+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.723+0000 7f3971011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:27.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.723+0000 7f3971011800 20 realm 2024-04-16T17:45:27.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.723+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.723 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.723+0000 7f3971011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:27.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.723+0000 7f3971011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-16T17:45:27.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.723+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.724+0000 7f3971011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:27.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.724+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.724+0000 7f3971011800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:27.724 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.724+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.725+0000 7f3971011800 20 rados_obj.operate() r=0 bl.length=1009 2024-04-16T17:45:27.725 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.725+0000 7f3971011800 20 searching for the correct realm 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 RGWRados::pool_iterate: got zonegroup_info.094c2520-ec1e-493c-ae18-851c59b8fffa 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 RGWRados::pool_iterate: got default.zone. 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 RGWRados::pool_iterate: got zone_info.40f9b535-6f08-4845-bdb4-34a1f41d23a8 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:27.735 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.735+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.736 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 rados_obj.operate() r=0 bl.length=436 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 zone default found 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 4 Realm: () 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 4 ZoneGroup: default (094c2520-ec1e-493c-ae18-851c59b8fffa) 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 4 Zone: default (40f9b535-6f08-4845-bdb4-34a1f41d23a8) 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 zonegroup default 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.736+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.737+0000 7f3971011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.737+0000 7f3971011800 20 rados->read ofs=0 len=0 2024-04-16T17:45:27.737 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.737+0000 7f3971011800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:27.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.737+0000 7f3971011800 20 started sync module instance, tier type = 2024-04-16T17:45:27.738 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.737+0000 7f3971011800 20 started zone id=40f9b535-6f08-4845-bdb4-34a1f41d23a8 (name=default) with tier type = 2024-04-16T17:45:27.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.750+0000 7f3971011800 20 add_watcher() i=0 2024-04-16T17:45:27.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.750+0000 7f3971011800 20 add_watcher() i=1 2024-04-16T17:45:27.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.750+0000 7f3971011800 20 add_watcher() i=2 2024-04-16T17:45:27.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.750+0000 7f3971011800 20 add_watcher() i=3 2024-04-16T17:45:27.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.750+0000 7f3971011800 20 add_watcher() i=4 2024-04-16T17:45:27.750 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.750+0000 7f3971011800 20 add_watcher() i=5 2024-04-16T17:45:27.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.750+0000 7f3971011800 20 add_watcher() i=6 2024-04-16T17:45:27.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.751+0000 7f3971011800 20 add_watcher() i=7 2024-04-16T17:45:27.751 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.751+0000 7f3971011800 2 all 8 watchers are set, enabling cache 2024-04-16T17:45:27.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.753+0000 7f38257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:27.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.753+0000 7f3971011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:27.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.753+0000 7f3971011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:27.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.753+0000 7f3971011800 5 note: GC not initialized 2024-04-16T17:45:27.753 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.754+0000 7f379ffff640 20 reqs_thread_entry: start 2024-04-16T17:45:27.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.754+0000 7f3971011800 20 init_complete bucket index max shards: 11 2024-04-16T17:45:27.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.754+0000 7f3971011800 20 Filter name: none 2024-04-16T17:45:27.754 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.754+0000 7f379dffb640 20 reqs_thread_entry: start 2024-04-16T17:45:27.762 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.763+0000 7f38257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:27.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.765+0000 7f3971011800 20 remove_watcher() i=0 2024-04-16T17:45:27.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.765+0000 7f3971011800 2 removed watcher, disabling cache 2024-04-16T17:45:27.765 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.766+0000 7f3971011800 20 remove_watcher() i=1 2024-04-16T17:45:27.766 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.767+0000 7f3971011800 20 remove_watcher() i=2 2024-04-16T17:45:27.770 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.771+0000 7f3971011800 20 remove_watcher() i=3 2024-04-16T17:45:27.771 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.772+0000 7f3971011800 20 remove_watcher() i=4 2024-04-16T17:45:27.772 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.773+0000 7f3971011800 20 remove_watcher() i=5 2024-04-16T17:45:27.773 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.774+0000 7f3971011800 20 remove_watcher() i=6 2024-04-16T17:45:27.775 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.775+0000 7f3971011800 20 remove_watcher() i=7 2024-04-16T17:45:27.795 INFO:teuthology.orchestra.run.smithi023.stdout:[] 2024-04-16T17:45:27.796 DEBUG:tasks.util.rgw: json result: [] 2024-04-16T17:45:27.796 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:27.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:27.796 DEBUG:teuthology.orchestra.run.smithi023:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-16T17:45:27.845 INFO:teuthology.orchestra.run.smithi023.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:27.846 INFO:teuthology.orchestra.run.smithi023.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:27.871 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.872+0000 7f144bd31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:27.872 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.872+0000 7f144bd31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:27.874 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T17:45:27.875+0000 7f12bdffb640 20 reqs_thread_entry: start 2024-04-16T17:45:27.889 INFO:teuthology.orchestra.run.smithi023.stdout:{"id":"40f9b535-6f08-4845-bdb4-34a1f41d23a8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-16T17:45:27.889 DEBUG:tasks.util.rgw: json result: {'id': '40f9b535-6f08-4845-bdb4-34a1f41d23a8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-16T17:45:27.889 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2024-04-16T17:45:27.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2024-04-16T17:45:27.890 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2024-04-16T17:45:28.002 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:28.003 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:29.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.575+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.576+0000 7f7312814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.576+0000 7f7312814800 20 realm 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.576+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.577+0000 7f7312814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.577+0000 7f7312814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.577+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.577+0000 7f7312814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.577+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.578+0000 7f7312814800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:29.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.578+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.578+0000 7f7312814800 20 rados_obj.operate() r=0 bl.length=993 2024-04-16T17:45:29.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.579+0000 7f7312814800 20 searching for the correct realm 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 RGWRados::pool_iterate: got zonegroup_info.c44d36b6-b405-4218-bf07-7423257847bc 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 RGWRados::pool_iterate: got default.zone. 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 RGWRados::pool_iterate: got zone_info.d9fb641b-a2d3-469b-9a40-d7fe78513ede 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:29.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.590+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.591+0000 7f7312814800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:29.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.591+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 20 rados_obj.operate() r=0 bl.length=436 2024-04-16T17:45:29.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 20 zone default found 2024-04-16T17:45:29.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 4 Realm: () 2024-04-16T17:45:29.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 4 ZoneGroup: default (c44d36b6-b405-4218-bf07-7423257847bc) 2024-04-16T17:45:29.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 4 Zone: default (d9fb641b-a2d3-469b-9a40-d7fe78513ede) 2024-04-16T17:45:29.591 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-16T17:45:29.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 20 zonegroup default 2024-04-16T17:45:29.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:29.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:29.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:29.592+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:31.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:31.553+0000 7f7312814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:31.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:31.553+0000 7f7312814800 20 rados->read ofs=0 len=0 2024-04-16T17:45:31.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:31.559+0000 7f7312814800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:31.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:31.559+0000 7f7312814800 20 started sync module instance, tier type = 2024-04-16T17:45:31.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:31.559+0000 7f7312814800 20 started zone id=d9fb641b-a2d3-469b-9a40-d7fe78513ede (name=default) with tier type = 2024-04-16T17:45:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.587+0000 7f7312814800 20 add_watcher() i=0 2024-04-16T17:45:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.587+0000 7f7312814800 20 add_watcher() i=1 2024-04-16T17:45:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.587+0000 7f7312814800 20 add_watcher() i=2 2024-04-16T17:45:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.587+0000 7f7312814800 20 add_watcher() i=3 2024-04-16T17:45:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.587+0000 7f7312814800 20 add_watcher() i=4 2024-04-16T17:45:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.587+0000 7f7312814800 20 add_watcher() i=5 2024-04-16T17:45:33.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.587+0000 7f7312814800 20 add_watcher() i=6 2024-04-16T17:45:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.588+0000 7f7312814800 20 add_watcher() i=7 2024-04-16T17:45:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.588+0000 7f7312814800 2 all 8 watchers are set, enabling cache 2024-04-16T17:45:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-04-16T17:45:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-04-16T17:45:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-04-16T17:45:33.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-04-16T17:45:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-04-16T17:45:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-04-16T17:45:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.589+0000 7f7312814800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.590+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-04-16T17:45:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.590+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-04-16T17:45:33.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.590+0000 7f7312814800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.590+0000 7f7312814800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-04-16T17:45:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.590+0000 7f7312814800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-04-16T17:45:33.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.591+0000 7f7312814800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-04-16T17:45:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.598+0000 7f71bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.598+0000 7f7312814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:33.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:33.598+0000 7f7312814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:36.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.565+0000 7f7312814800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-04-16T17:45:36.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.565+0000 7f7312814800 5 note: GC not initialized 2024-04-16T17:45:36.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.565+0000 7f71ba7fc640 20 reqs_thread_entry: start 2024-04-16T17:45:36.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.565+0000 7f7312814800 20 init_complete bucket index max shards: 11 2024-04-16T17:45:36.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.565+0000 7f7312814800 20 Filter name: none 2024-04-16T17:45:36.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.566+0000 7f711bfff640 20 reqs_thread_entry: start 2024-04-16T17:45:36.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.594+0000 7f71bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:36.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.597+0000 7f7312814800 20 remove_watcher() i=0 2024-04-16T17:45:36.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.597+0000 7f7312814800 2 removed watcher, disabling cache 2024-04-16T17:45:36.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.598+0000 7f7312814800 20 remove_watcher() i=1 2024-04-16T17:45:36.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.601+0000 7f7312814800 20 remove_watcher() i=2 2024-04-16T17:45:36.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.605+0000 7f7312814800 20 remove_watcher() i=3 2024-04-16T17:45:36.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.606+0000 7f7312814800 20 remove_watcher() i=4 2024-04-16T17:45:36.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.607+0000 7f7312814800 20 remove_watcher() i=5 2024-04-16T17:45:36.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.610+0000 7f7312814800 20 remove_watcher() i=6 2024-04-16T17:45:36.610 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.611+0000 7f7312814800 20 remove_watcher() i=7 2024-04-16T17:45:36.637 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2024-04-16T17:45:36.637 DEBUG:tasks.util.rgw: json result: [] 2024-04-16T17:45:36.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:36.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:36.638 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-16T17:45:36.689 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:36.690 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:36.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.716+0000 7ff531d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:36.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.716+0000 7ff531d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:36.718 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:45:36.719+0000 7ff363fff640 20 reqs_thread_entry: start 2024-04-16T17:45:36.735 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"d9fb641b-a2d3-469b-9a40-d7fe78513ede","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-16T17:45:36.736 DEBUG:tasks.util.rgw: json result: {'id': 'd9fb641b-a2d3-469b-9a40-d7fe78513ede', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-16T17:45:36.736 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2024-04-16T17:45:36.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2024-04-16T17:45:36.736 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2024-04-16T17:45:36.934 INFO:teuthology.orchestra.run.smithi163.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:36.934 INFO:teuthology.orchestra.run.smithi163.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:36.972 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.973+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:36.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 20 realm 2024-04-16T17:45:36.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:36.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-16T17:45:36.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.973 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:36.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.974+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.975+0000 7efff5b45800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:36.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.975+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.975+0000 7efff5b45800 20 rados_obj.operate() r=0 bl.length=1009 2024-04-16T17:45:36.974 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.975+0000 7efff5b45800 20 searching for the correct realm 2024-04-16T17:45:36.984 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 RGWRados::pool_iterate: got zonegroup_info.c44d36b6-b405-4218-bf07-7423257847bc 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 RGWRados::pool_iterate: got default.zone. 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 RGWRados::pool_iterate: got zone_info.d9fb641b-a2d3-469b-9a40-d7fe78513ede 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:36.985 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.986 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.986+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 rados_obj.operate() r=0 bl.length=436 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 zone default found 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 4 Realm: () 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 4 ZoneGroup: default (c44d36b6-b405-4218-bf07-7423257847bc) 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 4 Zone: default (d9fb641b-a2d3-469b-9a40-d7fe78513ede) 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 zonegroup default 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:36.987 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 rados->read ofs=0 len=0 2024-04-16T17:45:36.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T17:45:36.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 started sync module instance, tier type = 2024-04-16T17:45:36.988 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:36.987+0000 7efff5b45800 20 started zone id=d9fb641b-a2d3-469b-9a40-d7fe78513ede (name=default) with tier type = 2024-04-16T17:45:37.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.007+0000 7efff5b45800 20 add_watcher() i=0 2024-04-16T17:45:37.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.007+0000 7efff5b45800 20 add_watcher() i=1 2024-04-16T17:45:37.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.007+0000 7efff5b45800 20 add_watcher() i=2 2024-04-16T17:45:37.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.007+0000 7efff5b45800 20 add_watcher() i=3 2024-04-16T17:45:37.005 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.007+0000 7efff5b45800 20 add_watcher() i=4 2024-04-16T17:45:37.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.007+0000 7efff5b45800 20 add_watcher() i=5 2024-04-16T17:45:37.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.007+0000 7efff5b45800 20 add_watcher() i=6 2024-04-16T17:45:37.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.008+0000 7efff5b45800 20 add_watcher() i=7 2024-04-16T17:45:37.006 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.008+0000 7efff5b45800 2 all 8 watchers are set, enabling cache 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.009+0000 7efea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.009+0000 7efff5b45800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.009+0000 7efff5b45800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.009+0000 7efff5b45800 5 note: GC not initialized 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.010+0000 7efea8fe1640 20 reqs_thread_entry: start 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.010+0000 7efff5b45800 20 init_complete bucket index max shards: 11 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.010+0000 7efff5b45800 20 Filter name: none 2024-04-16T17:45:37.009 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.010+0000 7efe227fc640 20 reqs_thread_entry: start 2024-04-16T17:45:37.019 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.020+0000 7efea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T17:45:37.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.022+0000 7efff5b45800 20 remove_watcher() i=0 2024-04-16T17:45:37.020 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.022+0000 7efff5b45800 2 removed watcher, disabling cache 2024-04-16T17:45:37.021 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.022+0000 7efff5b45800 20 remove_watcher() i=1 2024-04-16T17:45:37.022 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.023+0000 7efff5b45800 20 remove_watcher() i=2 2024-04-16T17:45:37.023 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.025+0000 7efff5b45800 20 remove_watcher() i=3 2024-04-16T17:45:37.024 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.026+0000 7efff5b45800 20 remove_watcher() i=4 2024-04-16T17:45:37.025 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.026+0000 7efff5b45800 20 remove_watcher() i=5 2024-04-16T17:45:37.026 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.027+0000 7efff5b45800 20 remove_watcher() i=6 2024-04-16T17:45:37.027 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.028+0000 7efff5b45800 20 remove_watcher() i=7 2024-04-16T17:45:37.039 INFO:teuthology.orchestra.run.smithi163.stdout:[] 2024-04-16T17:45:37.039 DEBUG:tasks.util.rgw: json result: [] 2024-04-16T17:45:37.039 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:37.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-04-16T17:45:37.040 DEBUG:teuthology.orchestra.run.smithi163:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-04-16T17:45:37.089 INFO:teuthology.orchestra.run.smithi163.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:37.090 INFO:teuthology.orchestra.run.smithi163.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:37.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.116+0000 7f4f86b3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T17:45:37.115 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.116+0000 7f4f86b3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T17:45:37.118 INFO:teuthology.orchestra.run.smithi163.stderr:2024-04-16T17:45:37.119+0000 7f4e40ff9640 20 reqs_thread_entry: start 2024-04-16T17:45:37.132 INFO:teuthology.orchestra.run.smithi163.stdout:{"id":"d9fb641b-a2d3-469b-9a40-d7fe78513ede","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-16T17:45:37.132 DEBUG:tasks.util.rgw: json result: {'id': 'd9fb641b-a2d3-469b-9a40-d7fe78513ede', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-16T17:45:37.133 INFO:tasks.rgw:Starting rgw... 2024-04-16T17:45:37.133 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2024-04-16T17:45:37.133 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-16T17:45:37.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo echo -n http://smithi016.front.sepia.ceph.com:8000 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.168 INFO:teuthology.orchestra.run.smithi016.stdout:http://smithi016.front.sepia.ceph.com:8000 2024-04-16T17:45:37.169 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.242 INFO:tasks.rgw.c1.client.0:Restarting daemon 2024-04-16T17:45:37.242 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2024-04-16T17:45:37.284 INFO:tasks.rgw.c1.client.0:Started 2024-04-16T17:45:37.284 INFO:tasks.rgw:rgw c1.client.1 config is {'port': 8001} 2024-04-16T17:45:37.284 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-16T17:45:37.285 DEBUG:teuthology.orchestra.run.smithi023:> sudo echo -n http://smithi023.front.sepia.ceph.com:8001 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.320 INFO:teuthology.orchestra.run.smithi023.stdout:http://smithi023.front.sepia.ceph.com:8001 2024-04-16T17:45:37.320 DEBUG:teuthology.orchestra.run.smithi023:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.392 INFO:tasks.rgw.c1.client.1:Restarting daemon 2024-04-16T17:45:37.392 DEBUG:teuthology.orchestra.run.smithi023:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2024-04-16T17:45:37.435 INFO:tasks.rgw.c1.client.1:Started 2024-04-16T17:45:37.435 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2024-04-16T17:45:37.435 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-16T17:45:37.435 DEBUG:teuthology.orchestra.run.smithi139:> sudo echo -n http://smithi139.front.sepia.ceph.com:8000 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.465 INFO:teuthology.orchestra.run.smithi139.stdout:http://smithi139.front.sepia.ceph.com:8000 2024-04-16T17:45:37.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.476 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T17:45:37.478+0000 7f7c31230880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T17:45:37.533 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T17:45:37.533 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T17:45:37.575 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T17:45:37.576 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2024-04-16T17:45:37.576 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-16T17:45:37.576 DEBUG:teuthology.orchestra.run.smithi163:> sudo echo -n http://smithi163.front.sepia.ceph.com:8001 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.607 INFO:teuthology.orchestra.run.smithi163.stdout:http://smithi163.front.sepia.ceph.com:8001 2024-04-16T17:45:37.608 DEBUG:teuthology.orchestra.run.smithi163:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-16T17:45:37.629 INFO:tasks.rgw.c1.client.1.smithi023.stdout:2024-04-16T17:45:37.630+0000 7f7f36a2f880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T17:45:37.677 INFO:tasks.rgw.c2.client.1:Restarting daemon 2024-04-16T17:45:37.677 DEBUG:teuthology.orchestra.run.smithi163:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2024-04-16T17:45:37.720 INFO:tasks.rgw.c2.client.1:Started 2024-04-16T17:45:37.720 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi016.front.sepia.ceph.com:8000/ 2024-04-16T17:45:37.720 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:8000/ 2024-04-16T17:45:37.756 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:45:37.757 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:45:37.757 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T17:45:37.758 INFO:teuthology.orchestra.run.smithi016.stdout:anonymous 2024-04-16T17:45:37.758 INFO:tasks.rgw:Polling c1.client.1 until it starts accepting connections on http://smithi023.front.sepia.ceph.com:8001/ 2024-04-16T17:45:37.758 DEBUG:teuthology.orchestra.run.smithi023:> curl http://smithi023.front.sepia.ceph.com:8001/ 2024-04-16T17:45:37.759 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T17:45:37.758+0000 7fcaa602d880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T17:45:37.788 INFO:teuthology.orchestra.run.smithi023.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:45:37.788 INFO:teuthology.orchestra.run.smithi023.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:45:37.789 INFO:teuthology.orchestra.run.smithi023.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T17:45:37.790 INFO:teuthology.orchestra.run.smithi023.stdout:anonymous 2024-04-16T17:45:37.790 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi139.front.sepia.ceph.com:8000/ 2024-04-16T17:45:37.791 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000/ 2024-04-16T17:45:37.816 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:45:37.816 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:45:37.818 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T17:45:37.818 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T17:45:37.818 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi163.front.sepia.ceph.com:8001/ 2024-04-16T17:45:37.818 DEBUG:teuthology.orchestra.run.smithi163:> curl http://smithi163.front.sepia.ceph.com:8001/ 2024-04-16T17:45:37.854 INFO:teuthology.orchestra.run.smithi163.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:45:37.854 INFO:teuthology.orchestra.run.smithi163.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:45:37.854 INFO:teuthology.orchestra.run.smithi163.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T17:45:37.855 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T17:45:37.855 INFO:teuthology.orchestra.run.smithi163.stderr:curl: (7) Failed to connect to smithi163.front.sepia.ceph.com port 8001: Connection refused 2024-04-16T17:45:37.981 INFO:tasks.rgw.c2.client.1.smithi163.stdout:2024-04-16T17:45:37.982+0000 7fbdc9d08880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T17:45:38.858 DEBUG:teuthology.orchestra.run.smithi163:> curl http://smithi163.front.sepia.ceph.com:8001/ 2024-04-16T17:45:38.880 INFO:teuthology.orchestra.run.smithi163.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:45:38.880 INFO:teuthology.orchestra.run.smithi163.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:45:38.881 INFO:teuthology.orchestra.run.smithi163.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T17:45:38.882 INFO:teuthology.orchestra.run.smithi163.stdout:anonymous 2024-04-16T17:45:38.882 INFO:teuthology.run_tasks:Running task rgw-multisite... 2024-04-16T17:45:42.807 INFO:tasks.rgw_multisite:creating realm.. 2024-04-16T17:45:42.807 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:42.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:42.807 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:45:42.859 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:42.860 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:42.919 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"c3c61b36-e722-463c-9f73-5156628a053b","name":"test-realm","current_period":"16a6013d-6130-415e-b546-915bfb3780b6","epoch":1} 2024-04-16T17:45:42.919 INFO:tasks.rgw_multisite:creating master zonegroup.. 2024-04-16T17:45:42.919 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:42.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:42.920 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:45:42.966 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:42.967 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:42.996 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:42.997+0000 7f3f37c13800 -1 old format 2024-04-16T17:45:43.017 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":[]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-16T17:45:43.017 INFO:tasks.rgw_multisite:creating master zone.. 2024-04-16T17:45:43.017 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--endpoints', 'http://smithi016.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:43.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--endpoints', 'http://smithi016.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:43.018 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key UE802SBVX3HXAUMK --secret jXpFaSqV9ms87CpECKjGhckmyG9kDw37 --endpoints http://smithi016.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:45:43.112 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:43.112 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:43.142 INFO:teuthology.orchestra.run.smithi016.stderr:NOTICE: set zone's realm_id=c3c61b36-e722-463c-9f73-5156628a053b 2024-04-16T17:45:43.169 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","notif_pool":"test-zone1.rgw.log:notif","topics_pool":"test-zone1.rgw.meta:topics","account_pool":"test-zone1.rgw.meta:accounts","group_pool":"test-zone1.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T17:45:43.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2024-04-16T17:45:44.436 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'test-zone1.rgw.buckets.data' created 2024-04-16T17:45:44.457 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2024-04-16T17:45:45.438 INFO:teuthology.orchestra.run.smithi016.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2024-04-16T17:45:45.467 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:45.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:45.468 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:45:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:45.567 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","notif_pool":"test-zone1.rgw.log:notif","topics_pool":"test-zone1.rgw.meta:topics","account_pool":"test-zone1.rgw.meta:accounts","group_pool":"test-zone1.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T17:45:45.567 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:45.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:45.567 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:45:45.614 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:45.614 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:45.651 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:45:45.652+0000 7f7e0800f800 0 period (16a6013d-6130-415e-b546-915bfb3780b6 does not have zone 9ba59572-f51c-4bce-9578-e6350e822996 configured 2024-04-16T17:45:52.547 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":1,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T17:45:52.548 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2024-04-16T17:45:52.548 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T17:45:52.549 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T17:45:52.549+0000 7f7c2b0f1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 38020) UID: 0 2024-04-16T17:45:52.549 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T17:45:52.549+0000 7f7c31230880 -1 shutting down 2024-04-16T17:45:56.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2024-04-16T17:45:58.650 INFO:tasks.rgw.c1.client.0:Stopped 2024-04-16T17:45:58.651 INFO:tasks.rgw.c1.client.0:Restarting daemon 2024-04-16T17:45:58.651 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2024-04-16T17:45:58.654 INFO:tasks.rgw.c1.client.0:Started 2024-04-16T17:45:58.654 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:8000 2024-04-16T17:45:58.676 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T17:45:58.677 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:45:58.677 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:45:58.677 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T17:45:58.677 INFO:teuthology.orchestra.run.smithi016.stderr:curl: (7) Failed to connect to smithi016.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T17:45:58.854 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T17:45:58.854+0000 7f032c5f4880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T17:45:59.678 DEBUG:teuthology.orchestra.run.smithi016:> curl http://smithi016.front.sepia.ceph.com:8000 2024-04-16T17:45:59.699 INFO:teuthology.orchestra.run.smithi016.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:45:59.699 INFO:teuthology.orchestra.run.smithi016.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:45:59.700 INFO:teuthology.orchestra.run.smithi016.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T17:45:59.701 INFO:teuthology.orchestra.run.smithi016.stdout:anonymous 2024-04-16T17:45:59.701 INFO:tasks.rgw_multisite:creating admin user.. 2024-04-16T17:45:59.701 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:59.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:59.702 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key UE802SBVX3HXAUMK --secret jXpFaSqV9ms87CpECKjGhckmyG9kDw37 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:45:59.799 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:59.800 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:45:59.855 INFO:teuthology.orchestra.run.smithi016.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37","active":true,"create_date":"2024-04-16T17:45:59.853960Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-16T17:45:59.853949Z","tags":[],"group_ids":[]} 2024-04-16T17:45:59.875 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2024-04-16T17:45:59.876 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi016.front.sepia.ceph.com:8000', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:59.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi016.front.sepia.ceph.com:8000', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:45:59.876 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi016.front.sepia.ceph.com:8000 --access-key UE802SBVX3HXAUMK --secret jXpFaSqV9ms87CpECKjGhckmyG9kDw37 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T17:45:59.936 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:45:59.936 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:00.002 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"c3c61b36-e722-463c-9f73-5156628a053b","name":"test-realm","current_period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":2} 2024-04-16T17:46:00.003 INFO:tasks.rgw_multisite:creating zone.. 2024-04-16T17:46:00.003 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--endpoints', 'http://smithi139.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:00.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--endpoints', 'http://smithi139.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:00.003 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key UE802SBVX3HXAUMK --secret jXpFaSqV9ms87CpECKjGhckmyG9kDw37 --endpoints http://smithi139.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T17:46:00.057 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:00.057 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:00.086 INFO:teuthology.orchestra.run.smithi139.stderr:NOTICE: set zone's realm_id=c3c61b36-e722-463c-9f73-5156628a053b 2024-04-16T17:46:00.113 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","account_pool":"test-zone2.rgw.meta:accounts","group_pool":"test-zone2.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T17:46:00.113 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2024-04-16T17:46:00.603 INFO:teuthology.orchestra.run.smithi139.stderr:pool 'test-zone2.rgw.buckets.data' created 2024-04-16T17:46:00.620 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2024-04-16T17:46:01.611 INFO:teuthology.orchestra.run.smithi139.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2024-04-16T17:46:02.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:02.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:02.221 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T17:46:02.278 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:02.279 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:02.325 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","account_pool":"test-zone2.rgw.meta:accounts","group_pool":"test-zone2.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T17:46:02.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:02.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:02.325 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T17:46:02.373 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:02.373 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:02.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:02.410+0000 7f0147824800 0 period (224d2f86-f40f-4dbd-9d55-5b22f2e34bfe does not have zone 316ebd79-1e8f-459c-be24-e6b3e0dc08e5 configured 2024-04-16T17:46:03.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2024-04-16T17:46:08.697 INFO:teuthology.orchestra.run.smithi139.stderr:Sending period to new master zone 9ba59572-f51c-4bce-9578-e6350e822996 2024-04-16T17:46:08.762 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":2,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T17:46:08.762 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T17:46:08.763 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T17:46:08.763 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T17:46:08.764+0000 7fca9ff7a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 38161) UID: 0 2024-04-16T17:46:08.763 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T17:46:08.764+0000 7fcaa602d880 -1 shutting down 2024-04-16T17:46:14.339 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T17:46:14.864 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T17:46:14.864 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T17:46:14.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T17:46:14.867 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T17:46:14.867 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:14.890 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T17:46:14.890 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:46:14.890 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:46:14.890 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T17:46:14.891 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T17:46:15.100 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T17:46:15.100+0000 7f5c1e0e5880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T17:46:15.891 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:15.911 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T17:46:15.911 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T17:46:15.912 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T17:46:15.913 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T17:46:15.914 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2024-04-16T17:46:15.914 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2024-04-16T17:46:15.927 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi 2024-04-16T17:46:16.025 INFO:tasks.rgw_multisite_tests:creating test user.. 2024-04-16T17:46:16.025 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['account', 'create', '--account-id', 'RGW11111111111111111', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:16.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'account', 'create', '--account-id', 'RGW11111111111111111', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:16.025 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 account create --account-id RGW11111111111111111 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:16.078 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:16.159 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"RGW11111111111111111","tenant":"","name":"","email":"","quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"max_users":1000,"max_roles":1000,"max_groups":1000,"max_buckets":1000,"max_access_keys":4} 2024-04-16T17:46:16.159 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--account-id', 'RGW11111111111111111', '--account-root', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'TestUser', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:16.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--account-id', 'RGW11111111111111111', '--account-root', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'TestUser', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:46:16.159 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --account-id RGW11111111111111111 --account-root --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name TestUser --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:46:16.214 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:16.215 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:16.274 INFO:teuthology.orchestra.run.smithi016.stdout:{"user_id":"rgw-multisite-test-user","display_name":"TestUser","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"51CH7DEF4C5TK3K8FIQL","secret_key":"UG2YW7t20glXijDylHtEudVbphWQ3RGiQD4abxJK","active":true,"create_date":"2024-04-16T17:46:16.268274Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"root","mfa_ids":[],"account_id":"RGW11111111111111111","path":"/","create_date":"2024-04-16T17:46:16.267983Z","tags":[],"group_ids":[]} 2024-04-16T17:46:16.295 INFO:rgw_multi.tests:meta checkpoint 2024-04-16T17:46:16.295 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:16.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:16.296 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:16.342 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:16.342 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:16.391 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:16.413 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2024-04-16T17:46:16.414 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:16.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:16.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:16.414 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:16.470 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:16.470 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:16.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:16.533+0000 7f4036335800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:16.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:16.534+0000 7f4036335800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:16.555 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"building-full-sync-maps","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":1,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":2,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}},{"key":3,"val":{"state":0,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":0}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T17:46:16Z"} 2024-04-16T17:46:16.556 WARNING:rgw_multi.tests:zone test-zone2 has not started sync yet, state=building-full-sync-maps 2024-04-16T17:46:20.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T17:46:21.557 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:21.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:21.557 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:21.612 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:21.612 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:21.679 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:21.680+0000 7fca9cb2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:21.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:21.682+0000 7fca9cb2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:21.709 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:21Z"} 2024-04-16T17:46:21.709 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:21.709 INFO:rgw_multi.tests:meta checkpoint 2024-04-16T17:46:21.710 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:21.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:21.710 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:21.763 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:21.821 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:21.843 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2024-04-16T17:46:21.843 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:21.844 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:21.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:21.844 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:21.892 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:21.893 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:21.956 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:21.957+0000 7f910c824800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:21.957 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:21.958+0000 7f910c824800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:21.981 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:21Z"} 2024-04-16T17:46:21.981 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:21.981 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi' with args=['tests.py', '-a', '!fails_on_rgw'] 2024-04-16T17:46:22.323 DEBUG:boto:Using access key provided by client. 2024-04-16T17:46:22.324 DEBUG:boto:Using secret key provided by client. 2024-04-16T17:46:22.325 DEBUG:botocore.hooks:Changing event name from creating-client-class.iot-data to creating-client-class.iot-data-plane 2024-04-16T17:46:22.326 DEBUG:botocore.hooks:Changing event name from before-call.apigateway to before-call.api-gateway 2024-04-16T17:46:22.327 DEBUG:botocore.hooks:Changing event name from request-created.machinelearning.Predict to request-created.machine-learning.Predict 2024-04-16T17:46:22.328 DEBUG:botocore.hooks:Changing event name from before-parameter-build.autoscaling.CreateLaunchConfiguration to before-parameter-build.auto-scaling.CreateLaunchConfiguration 2024-04-16T17:46:22.329 DEBUG:botocore.hooks:Changing event name from before-parameter-build.route53 to before-parameter-build.route-53 2024-04-16T17:46:22.329 DEBUG:botocore.hooks:Changing event name from request-created.cloudsearchdomain.Search to request-created.cloudsearch-domain.Search 2024-04-16T17:46:22.330 DEBUG:botocore.hooks:Changing event name from docs.*.autoscaling.CreateLaunchConfiguration.complete-section to docs.*.auto-scaling.CreateLaunchConfiguration.complete-section 2024-04-16T17:46:22.332 DEBUG:botocore.hooks:Changing event name from before-parameter-build.logs.CreateExportTask to before-parameter-build.cloudwatch-logs.CreateExportTask 2024-04-16T17:46:22.332 DEBUG:botocore.hooks:Changing event name from docs.*.logs.CreateExportTask.complete-section to docs.*.cloudwatch-logs.CreateExportTask.complete-section 2024-04-16T17:46:22.333 DEBUG:botocore.hooks:Changing event name from before-parameter-build.cloudsearchdomain.Search to before-parameter-build.cloudsearch-domain.Search 2024-04-16T17:46:22.333 DEBUG:botocore.hooks:Changing event name from docs.*.cloudsearchdomain.Search.complete-section to docs.*.cloudsearch-domain.Search.complete-section 2024-04-16T17:46:22.532 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/endpoints.json 2024-04-16T17:46:22.569 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/sdk-default-configuration.json 2024-04-16T17:46:22.569 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-16T17:46:23.672 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/iam/2010-05-08/service-2.json.gz 2024-04-16T17:46:23.741 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/iam/2010-05-08/endpoint-rule-set-1.json.gz 2024-04-16T17:46:23.752 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/partitions.json 2024-04-16T17:46:23.755 DEBUG:botocore.hooks:Event creating-client-class.iam: calling handler 2024-04-16T17:46:23.757 DEBUG:botocore.regions:Using partition endpoint for iam, test-zonegroup: aws-global 2024-04-16T17:46:23.759 DEBUG:botocore.endpoint:Setting iam timeout as (60, 60) 2024-04-16T17:46:23.769 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/_retry.json 2024-04-16T17:46:23.770 DEBUG:botocore.client:Registering retry handlers for service: iam 2024-04-16T17:46:23.770 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-16T17:46:23.802 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/s3/2006-03-01/service-2.json.gz 2024-04-16T17:46:23.880 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/s3/2006-03-01/endpoint-rule-set-1.json.gz 2024-04-16T17:46:23.887 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-16T17:46:23.887 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler ._handler at 0x7f42d78a14c0> 2024-04-16T17:46:24.240 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-16T17:46:24.241 DEBUG:botocore.regions:Creating a regex based endpoint for s3, test-zonegroup 2024-04-16T17:46:24.242 DEBUG:botocore.endpoint:Setting s3 timeout as (60, 60) 2024-04-16T17:46:24.245 DEBUG:botocore.client:Registering retry handlers for service: s3 2024-04-16T17:46:24.245 DEBUG:botocore.utils:Registering S3 region redirector handler 2024-04-16T17:46:24.246 DEBUG:botocore.utils:Registering S3Express Identity Resolver 2024-04-16T17:46:24.246 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-16T17:46:24.251 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/sns/2010-03-31/service-2.json.gz 2024-04-16T17:46:24.257 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/sns/2010-03-31/endpoint-rule-set-1.json.gz 2024-04-16T17:46:24.258 DEBUG:botocore.hooks:Event creating-client-class.sns: calling handler 2024-04-16T17:46:24.258 DEBUG:botocore.regions:Creating a regex based endpoint for sns, test-zonegroup 2024-04-16T17:46:24.260 DEBUG:botocore.endpoint:Setting sns timeout as (60, 60) 2024-04-16T17:46:24.261 DEBUG:botocore.client:Registering retry handlers for service: sns 2024-04-16T17:46:24.262 DEBUG:boto:Using access key provided by client. 2024-04-16T17:46:24.262 DEBUG:boto:Using secret key provided by client. 2024-04-16T17:46:24.262 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-16T17:46:24.264 DEBUG:botocore.hooks:Event creating-client-class.iam: calling handler 2024-04-16T17:46:24.265 DEBUG:botocore.regions:Using partition endpoint for iam, test-zonegroup: aws-global 2024-04-16T17:46:24.267 DEBUG:botocore.endpoint:Setting iam timeout as (60, 60) 2024-04-16T17:46:24.268 DEBUG:botocore.client:Registering retry handlers for service: iam 2024-04-16T17:46:24.269 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-16T17:46:24.270 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-16T17:46:24.270 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler ._handler at 0x7f42d78a14c0> 2024-04-16T17:46:24.270 DEBUG:botocore.hooks:Event creating-client-class.s3: calling handler 2024-04-16T17:46:24.271 DEBUG:botocore.regions:Creating a regex based endpoint for s3, test-zonegroup 2024-04-16T17:46:24.272 DEBUG:botocore.endpoint:Setting s3 timeout as (60, 60) 2024-04-16T17:46:24.274 DEBUG:botocore.client:Registering retry handlers for service: s3 2024-04-16T17:46:24.274 DEBUG:botocore.utils:Registering S3 region redirector handler 2024-04-16T17:46:24.275 DEBUG:botocore.utils:Registering S3Express Identity Resolver 2024-04-16T17:46:24.275 DEBUG:botocore.hooks:Event choose-service-name: calling handler 2024-04-16T17:46:24.276 DEBUG:botocore.hooks:Event creating-client-class.sns: calling handler 2024-04-16T17:46:24.276 DEBUG:botocore.regions:Creating a regex based endpoint for sns, test-zonegroup 2024-04-16T17:46:24.277 DEBUG:botocore.endpoint:Setting sns timeout as (60, 60) 2024-04-16T17:46:24.278 DEBUG:botocore.client:Registering retry handlers for service: sns 2024-04-16T17:46:24.279 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-1 2024-04-16T17:46:24.279 DEBUG:boto:path=/cjqttm-1/ 2024-04-16T17:46:24.279 DEBUG:boto:auth_path=/cjqttm-1/ 2024-04-16T17:46:24.279 DEBUG:boto:Method: PUT 2024-04-16T17:46:24.279 DEBUG:boto:Path: /cjqttm-1/ 2024-04-16T17:46:24.279 DEBUG:boto:Data: 2024-04-16T17:46:24.279 DEBUG:boto:Headers: {} 2024-04-16T17:46:24.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:24.279 DEBUG:boto:Port: 8000 2024-04-16T17:46:24.280 DEBUG:boto:Params: {} 2024-04-16T17:46:24.280 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:46:24.280 DEBUG:boto:Token: None 2024-04-16T17:46:24.280 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:24 GMT /cjqttm-1/ 2024-04-16T17:46:24.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PB2Hae/7hmKNZoNDRpmX+2z5Eqo= 2024-04-16T17:46:24.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PB2Hae/7hmKNZoNDRpmX+2z5Eqo=', 'Content-Length': '0'} 2024-04-16T17:46:26.535 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000003794ed414678a7e-00661eb970-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:26.536 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-2 2024-04-16T17:46:26.536 DEBUG:boto:path=/cjqttm-2/ 2024-04-16T17:46:26.536 DEBUG:boto:auth_path=/cjqttm-2/ 2024-04-16T17:46:26.536 DEBUG:boto:Method: PUT 2024-04-16T17:46:26.536 DEBUG:boto:Path: /cjqttm-2/ 2024-04-16T17:46:26.536 DEBUG:boto:Data: 2024-04-16T17:46:26.536 DEBUG:boto:Headers: {} 2024-04-16T17:46:26.537 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:26.537 DEBUG:boto:Port: 8000 2024-04-16T17:46:26.537 DEBUG:boto:Params: {} 2024-04-16T17:46:26.537 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:46:26.537 DEBUG:boto:Token: None 2024-04-16T17:46:26.537 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:26 GMT /cjqttm-2/ 2024-04-16T17:46:26.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6jNAlTG5CyrtBpSQFlxwuY7goTo= 2024-04-16T17:46:26.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6jNAlTG5CyrtBpSQFlxwuY7goTo=', 'Content-Length': '0'} 2024-04-16T17:46:28.703 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000fc093c491488de68-00661eb972-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:28.704 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:28.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:28.704 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:28.758 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:28.758 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:28.817 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:28.839 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289586.560675_27.1","last_update":"2024-04-16T17:46:26.560675Z"}] 2024-04-16T17:46:28.840 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289586.560675_27.1'} 2024-04-16T17:46:28.840 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:28.840 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:28.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:28.840 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:28.895 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:28.895 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:28.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:28.961+0000 7f7018a9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:28.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:28.963+0000 7f7018a9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:28.984 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:28Z"} 2024-04-16T17:46:28.985 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:28Z"} 2024-04-16T17:46:28.985 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}] 2024-04-16T17:46:28.985 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289586.560675_27.1'} 2024-04-16T17:46:28.985 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: ''} 2024-04-16T17:46:28.985 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1713289586.560675_27.1 target= 2024-04-16T17:46:33.986 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:33.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:33.987 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:34.042 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:34.043 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:34.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:34.100+0000 7f4078b4b800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:34.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:34.102+0000 7f4078b4b800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:34.121 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289586.560675_27.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:26.560675Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:34Z"} 2024-04-16T17:46:34.122 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289586.560675_27.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:26.560675Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:34Z"} 2024-04-16T17:46:34.122 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289586.560675_27.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:26.560675Z', 'realm_epoch': 2}}] 2024-04-16T17:46:34.122 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289586.560675_27.1'} 2024-04-16T17:46:34.122 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289586.560675_27.1'} 2024-04-16T17:46:34.122 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:34.123 DEBUG:boto:path=/cjqttm-1/ 2024-04-16T17:46:34.123 DEBUG:boto:auth_path=/cjqttm-1/ 2024-04-16T17:46:34.123 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.123 DEBUG:boto:Path: /cjqttm-1/ 2024-04-16T17:46:34.123 DEBUG:boto:Data: 2024-04-16T17:46:34.123 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.123 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.123 DEBUG:boto:Params: {} 2024-04-16T17:46:34.123 DEBUG:boto:Token: None 2024-04-16T17:46:34.124 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-1/ 2024-04-16T17:46:34.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:drBDGMADUUBPfXW0NDXSiJ4klss= 2024-04-16T17:46:34.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:drBDGMADUUBPfXW0NDXSiJ4klss=', 'Content-Length': '0'} 2024-04-16T17:46:34.126 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ce1078fffed4c15-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.126 DEBUG:boto:path=/cjqttm-2/ 2024-04-16T17:46:34.127 DEBUG:boto:auth_path=/cjqttm-2/ 2024-04-16T17:46:34.127 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.127 DEBUG:boto:Path: /cjqttm-2/ 2024-04-16T17:46:34.127 DEBUG:boto:Data: 2024-04-16T17:46:34.127 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.127 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.127 DEBUG:boto:Params: {} 2024-04-16T17:46:34.127 DEBUG:boto:Token: None 2024-04-16T17:46:34.127 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-2/ 2024-04-16T17:46:34.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u7W+dZpgmrmVFD1AED4i0ruGNzo= 2024-04-16T17:46:34.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u7W+dZpgmrmVFD1AED4i0ruGNzo=', 'Content-Length': '0'} 2024-04-16T17:46:34.130 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c5ed0ef1852f41d1-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.130 DEBUG:boto:path=/cjqttm-1/ 2024-04-16T17:46:34.130 DEBUG:boto:auth_path=/cjqttm-1/ 2024-04-16T17:46:34.130 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.130 DEBUG:boto:Path: /cjqttm-1/ 2024-04-16T17:46:34.130 DEBUG:boto:Data: 2024-04-16T17:46:34.131 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.131 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.131 DEBUG:boto:Params: {} 2024-04-16T17:46:34.131 DEBUG:boto:Token: None 2024-04-16T17:46:34.131 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-1/ 2024-04-16T17:46:34.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:drBDGMADUUBPfXW0NDXSiJ4klss= 2024-04-16T17:46:34.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:drBDGMADUUBPfXW0NDXSiJ4klss=', 'Content-Length': '0'} 2024-04-16T17:46:34.133 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dcc34ad5bfc296cb-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.134 DEBUG:boto:path=/cjqttm-2/ 2024-04-16T17:46:34.134 DEBUG:boto:auth_path=/cjqttm-2/ 2024-04-16T17:46:34.134 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.134 DEBUG:boto:Path: /cjqttm-2/ 2024-04-16T17:46:34.134 DEBUG:boto:Data: 2024-04-16T17:46:34.134 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.134 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.134 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.134 DEBUG:boto:Params: {} 2024-04-16T17:46:34.134 DEBUG:boto:Token: None 2024-04-16T17:46:34.135 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-2/ 2024-04-16T17:46:34.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u7W+dZpgmrmVFD1AED4i0ruGNzo= 2024-04-16T17:46:34.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u7W+dZpgmrmVFD1AED4i0ruGNzo=', 'Content-Length': '0'} 2024-04-16T17:46:34.137 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e4e58d3621a13088-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.137 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2024-04-16T17:46:34.138 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-3 2024-04-16T17:46:34.138 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:34.138 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:34.138 DEBUG:boto:Method: PUT 2024-04-16T17:46:34.138 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:34.138 DEBUG:boto:Data: 2024-04-16T17:46:34.138 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.138 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.139 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.139 DEBUG:boto:Params: {} 2024-04-16T17:46:34.139 DEBUG:boto:Token: None 2024-04-16T17:46:34.139 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-3/ 2024-04-16T17:46:34.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7FtMvuf6/ts9jrHuPHqnEYsyzOE= 2024-04-16T17:46:34.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7FtMvuf6/ts9jrHuPHqnEYsyzOE=', 'Content-Length': '0'} 2024-04-16T17:46:34.156 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008f0501f967779cdd-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.156 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-4 2024-04-16T17:46:34.156 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:34.156 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:34.156 DEBUG:boto:Method: PUT 2024-04-16T17:46:34.156 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:34.156 DEBUG:boto:Data: 2024-04-16T17:46:34.156 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.156 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.156 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.157 DEBUG:boto:Params: {} 2024-04-16T17:46:34.157 DEBUG:boto:Token: None 2024-04-16T17:46:34.157 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-4/ 2024-04-16T17:46:34.157 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aWwU1jzbI/OSvf+sXC16tpCV090= 2024-04-16T17:46:34.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aWwU1jzbI/OSvf+sXC16tpCV090=', 'Content-Length': '0'} 2024-04-16T17:46:34.188 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a1a69789f9b61ee4-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.188 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.188 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:34.242 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:34.243 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:34.293 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:34.315 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289594.174403_41.1","last_update":"2024-04-16T17:46:34.174403Z"}] 2024-04-16T17:46:34.316 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.174403_41.1'} 2024-04-16T17:46:34.316 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:34.316 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.316 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.316 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:34.365 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:34.365 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:34.428 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:34.430+0000 7f8000f33800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:34.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:34.431+0000 7f8000f33800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:34.449 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289594.174403_41.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:34.174403Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:34Z"} 2024-04-16T17:46:34.450 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289594.174403_41.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:34.174403Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:34Z"} 2024-04-16T17:46:34.450 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289594.174403_41.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:34.174403Z', 'realm_epoch': 2}}] 2024-04-16T17:46:34.450 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.174403_41.1'} 2024-04-16T17:46:34.450 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.174403_41.1'} 2024-04-16T17:46:34.450 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:34.450 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:34.450 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:34.450 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.451 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:34.451 DEBUG:boto:Data: 2024-04-16T17:46:34.451 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.451 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.451 DEBUG:boto:Params: {} 2024-04-16T17:46:34.451 DEBUG:boto:Token: None 2024-04-16T17:46:34.451 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-3/ 2024-04-16T17:46:34.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw= 2024-04-16T17:46:34.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw=', 'Content-Length': '0'} 2024-04-16T17:46:34.454 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000071b655b52c922233-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.454 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:34.454 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:34.454 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.454 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:34.454 DEBUG:boto:Data: 2024-04-16T17:46:34.454 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.455 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.455 DEBUG:boto:Params: {} 2024-04-16T17:46:34.455 DEBUG:boto:Token: None 2024-04-16T17:46:34.455 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-4/ 2024-04-16T17:46:34.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g= 2024-04-16T17:46:34.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g=', 'Content-Length': '0'} 2024-04-16T17:46:34.457 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000086894c12a59fca63-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.457 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:34.457 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:34.457 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.457 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:34.457 DEBUG:boto:Data: 2024-04-16T17:46:34.458 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.458 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.458 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.458 DEBUG:boto:Params: {} 2024-04-16T17:46:34.458 DEBUG:boto:Token: None 2024-04-16T17:46:34.458 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-3/ 2024-04-16T17:46:34.458 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw= 2024-04-16T17:46:34.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw=', 'Content-Length': '0'} 2024-04-16T17:46:34.460 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000098d2003922d3e56b-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.461 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:34.461 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:34.461 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.461 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:34.461 DEBUG:boto:Data: 2024-04-16T17:46:34.461 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.461 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.461 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.461 DEBUG:boto:Params: {} 2024-04-16T17:46:34.461 DEBUG:boto:Token: None 2024-04-16T17:46:34.461 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-4/ 2024-04-16T17:46:34.462 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g= 2024-04-16T17:46:34.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g=', 'Content-Length': '0'} 2024-04-16T17:46:34.463 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ab4d35ec07120b1-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.463 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:34.463 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:34.463 DEBUG:boto:Method: PUT 2024-04-16T17:46:34.464 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:34.464 DEBUG:boto:Data: 2024-04-16T17:46:34.464 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.464 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.464 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.464 DEBUG:boto:Params: {} 2024-04-16T17:46:34.464 DEBUG:boto:Token: None 2024-04-16T17:46:34.464 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-3/ 2024-04-16T17:46:34.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7FtMvuf6/ts9jrHuPHqnEYsyzOE= 2024-04-16T17:46:34.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7FtMvuf6/ts9jrHuPHqnEYsyzOE=', 'Content-Length': '0'} 2024-04-16T17:46:34.481 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000faaf485428b1f933-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.481 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:34.481 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:34.481 DEBUG:boto:Method: PUT 2024-04-16T17:46:34.481 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:34.481 DEBUG:boto:Data: 2024-04-16T17:46:34.481 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.482 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.482 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.482 DEBUG:boto:Params: {} 2024-04-16T17:46:34.482 DEBUG:boto:Token: None 2024-04-16T17:46:34.482 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-4/ 2024-04-16T17:46:34.482 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aWwU1jzbI/OSvf+sXC16tpCV090= 2024-04-16T17:46:34.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aWwU1jzbI/OSvf+sXC16tpCV090=', 'Content-Length': '0'} 2024-04-16T17:46:34.498 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002ca6e1a44db51826-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.498 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:34.498 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:34.498 DEBUG:boto:Method: PUT 2024-04-16T17:46:34.498 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:34.498 DEBUG:boto:Data: 2024-04-16T17:46:34.498 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.498 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.499 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.499 DEBUG:boto:Params: {} 2024-04-16T17:46:34.499 DEBUG:boto:Token: None 2024-04-16T17:46:34.499 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-3/ 2024-04-16T17:46:34.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7FtMvuf6/ts9jrHuPHqnEYsyzOE= 2024-04-16T17:46:34.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7FtMvuf6/ts9jrHuPHqnEYsyzOE=', 'Content-Length': '0'} 2024-04-16T17:46:34.527 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d4679062e4d5cffa-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.527 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:34.527 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:34.528 DEBUG:boto:Method: PUT 2024-04-16T17:46:34.528 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:34.528 DEBUG:boto:Data: 2024-04-16T17:46:34.528 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.528 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.528 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.528 DEBUG:boto:Params: {} 2024-04-16T17:46:34.528 DEBUG:boto:Token: None 2024-04-16T17:46:34.528 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-4/ 2024-04-16T17:46:34.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aWwU1jzbI/OSvf+sXC16tpCV090= 2024-04-16T17:46:34.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aWwU1jzbI/OSvf+sXC16tpCV090=', 'Content-Length': '0'} 2024-04-16T17:46:34.597 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000900d607f7c4182a8-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.597 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:34.597 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:34.598 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.598 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:34.598 DEBUG:boto:Data: 2024-04-16T17:46:34.598 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.598 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.598 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.598 DEBUG:boto:Params: {} 2024-04-16T17:46:34.598 DEBUG:boto:Token: None 2024-04-16T17:46:34.598 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-3/ 2024-04-16T17:46:34.598 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw= 2024-04-16T17:46:34.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw=', 'Content-Length': '0'} 2024-04-16T17:46:34.601 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000025b078dab2db689d-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.601 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:34.601 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:34.602 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.602 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:34.602 DEBUG:boto:Data: 2024-04-16T17:46:34.602 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.602 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:34.602 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.602 DEBUG:boto:Params: {} 2024-04-16T17:46:34.602 DEBUG:boto:Token: None 2024-04-16T17:46:34.602 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-4/ 2024-04-16T17:46:34.602 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g= 2024-04-16T17:46:34.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g=', 'Content-Length': '0'} 2024-04-16T17:46:34.605 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008aca71f5b6d7eb5e-00661eb97a-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.605 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:34.605 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:34.605 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.605 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:34.605 DEBUG:boto:Data: 2024-04-16T17:46:34.605 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.606 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.606 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.606 DEBUG:boto:Params: {} 2024-04-16T17:46:34.606 DEBUG:boto:Token: None 2024-04-16T17:46:34.606 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-3/ 2024-04-16T17:46:34.606 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw= 2024-04-16T17:46:34.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RRm+aJD0U2/5xPTSivo4qPX9sSw=', 'Content-Length': '0'} 2024-04-16T17:46:34.609 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000070d07d07cc40f846-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.609 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:34.609 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:34.609 DEBUG:boto:Method: HEAD 2024-04-16T17:46:34.609 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:34.609 DEBUG:boto:Data: 2024-04-16T17:46:34.609 DEBUG:boto:Headers: {} 2024-04-16T17:46:34.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:34.609 DEBUG:boto:Port: 8000 2024-04-16T17:46:34.610 DEBUG:boto:Params: {} 2024-04-16T17:46:34.610 DEBUG:boto:Token: None 2024-04-16T17:46:34.610 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:34 GMT /cjqttm-4/ 2024-04-16T17:46:34.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g= 2024-04-16T17:46:34.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRk8T0bwT8faA2YJfPWJAVH3+6g=', 'Content-Length': '0'} 2024-04-16T17:46:34.612 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000b5b366c75378e29-00661eb97a-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:34.613 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.613 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:34.659 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:34.659 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:34.711 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:34.732 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289594.542556_57.1","last_update":"2024-04-16T17:46:34.542556Z"}] 2024-04-16T17:46:34.732 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.542556_57.1'} 2024-04-16T17:46:34.733 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:34.733 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.733 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:34.733 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:34.780 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:34.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:34.831+0000 7f1f94e42800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:34.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:34.832+0000 7f1f94e42800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:34.855 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289594.509749_51.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:34.509749Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:34Z"} 2024-04-16T17:46:34.855 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289594.509749_51.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:34.509749Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:34Z"} 2024-04-16T17:46:34.855 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289594.509749_51.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:34.509749Z', 'realm_epoch': 2}}] 2024-04-16T17:46:34.856 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.542556_57.1'} 2024-04-16T17:46:34.856 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.509749_51.1'} 2024-04-16T17:46:34.856 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1713289594.542556_57.1 target=1_1713289594.509749_51.1 2024-04-16T17:46:39.857 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:39.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:39.857 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:39.913 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:39.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:39.975+0000 7f89c5547800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:39.974 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:39.976+0000 7f89c5547800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:39.998 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289594.542556_57.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:34.542556Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:39Z"} 2024-04-16T17:46:39.998 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289594.542556_57.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:34.542556Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:39Z"} 2024-04-16T17:46:39.999 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289594.542556_57.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:34.542556Z', 'realm_epoch': 2}}] 2024-04-16T17:46:39.999 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.542556_57.1'} 2024-04-16T17:46:39.999 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289594.542556_57.1'} 2024-04-16T17:46:39.999 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:39.999 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:39.999 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:39.999 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.000 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:40.000 DEBUG:boto:Data: 2024-04-16T17:46:40.000 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.000 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:40.000 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.000 DEBUG:boto:Params: {} 2024-04-16T17:46:40.000 DEBUG:boto:Token: None 2024-04-16T17:46:40.000 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-3/ 2024-04-16T17:46:40.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iVIKnIJf8iXf/ohtAr40eksuYbI= 2024-04-16T17:46:40.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iVIKnIJf8iXf/ohtAr40eksuYbI=', 'Content-Length': '0'} 2024-04-16T17:46:40.003 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d93f22441ad0c0a-00661eb980-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.003 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:40.003 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:40.003 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.004 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:40.004 DEBUG:boto:Data: 2024-04-16T17:46:40.004 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:40.004 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.004 DEBUG:boto:Params: {} 2024-04-16T17:46:40.004 DEBUG:boto:Token: None 2024-04-16T17:46:40.004 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-4/ 2024-04-16T17:46:40.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BIOmsYGaBlXjL1BaTmfL3zTkmsE= 2024-04-16T17:46:40.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BIOmsYGaBlXjL1BaTmfL3zTkmsE=', 'Content-Length': '0'} 2024-04-16T17:46:40.006 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007cc43cfbfbf05d10-00661eb980-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.006 DEBUG:boto:path=/cjqttm-3/ 2024-04-16T17:46:40.006 DEBUG:boto:auth_path=/cjqttm-3/ 2024-04-16T17:46:40.007 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.007 DEBUG:boto:Path: /cjqttm-3/ 2024-04-16T17:46:40.007 DEBUG:boto:Data: 2024-04-16T17:46:40.007 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.007 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:40.007 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.007 DEBUG:boto:Params: {} 2024-04-16T17:46:40.007 DEBUG:boto:Token: None 2024-04-16T17:46:40.007 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-3/ 2024-04-16T17:46:40.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iVIKnIJf8iXf/ohtAr40eksuYbI= 2024-04-16T17:46:40.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iVIKnIJf8iXf/ohtAr40eksuYbI=', 'Content-Length': '0'} 2024-04-16T17:46:40.010 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d2099df1a2a38a2-00661eb980-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.010 DEBUG:boto:path=/cjqttm-4/ 2024-04-16T17:46:40.010 DEBUG:boto:auth_path=/cjqttm-4/ 2024-04-16T17:46:40.010 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.010 DEBUG:boto:Path: /cjqttm-4/ 2024-04-16T17:46:40.010 DEBUG:boto:Data: 2024-04-16T17:46:40.010 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.010 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:40.010 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.011 DEBUG:boto:Params: {} 2024-04-16T17:46:40.011 DEBUG:boto:Token: None 2024-04-16T17:46:40.011 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-4/ 2024-04-16T17:46:40.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BIOmsYGaBlXjL1BaTmfL3zTkmsE= 2024-04-16T17:46:40.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BIOmsYGaBlXjL1BaTmfL3zTkmsE=', 'Content-Length': '0'} 2024-04-16T17:46:40.013 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000333885a9babd58fa-00661eb980-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.013 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2024-04-16T17:46:40.014 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-5 2024-04-16T17:46:40.014 DEBUG:boto:path=/cjqttm-5/ 2024-04-16T17:46:40.014 DEBUG:boto:auth_path=/cjqttm-5/ 2024-04-16T17:46:40.015 DEBUG:boto:Method: PUT 2024-04-16T17:46:40.015 DEBUG:boto:Path: /cjqttm-5/ 2024-04-16T17:46:40.015 DEBUG:boto:Data: 2024-04-16T17:46:40.015 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.015 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:40.015 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.015 DEBUG:boto:Params: {} 2024-04-16T17:46:40.015 DEBUG:boto:Token: None 2024-04-16T17:46:40.015 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-5/ 2024-04-16T17:46:40.015 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JPLUSxly4GFHBVcyNL/zYg2DEPc= 2024-04-16T17:46:40.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JPLUSxly4GFHBVcyNL/zYg2DEPc=', 'Content-Length': '0'} 2024-04-16T17:46:40.031 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005dc561bd1c13a00f-00661eb980-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.031 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-6 2024-04-16T17:46:40.031 DEBUG:boto:path=/cjqttm-6/ 2024-04-16T17:46:40.031 DEBUG:boto:auth_path=/cjqttm-6/ 2024-04-16T17:46:40.031 DEBUG:boto:Method: PUT 2024-04-16T17:46:40.031 DEBUG:boto:Path: /cjqttm-6/ 2024-04-16T17:46:40.032 DEBUG:boto:Data: 2024-04-16T17:46:40.032 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.032 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:40.032 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.032 DEBUG:boto:Params: {} 2024-04-16T17:46:40.032 DEBUG:boto:Token: None 2024-04-16T17:46:40.032 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-6/ 2024-04-16T17:46:40.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7KUk/evmibDK1KLX8Jt25XSGwJs= 2024-04-16T17:46:40.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7KUk/evmibDK1KLX8Jt25XSGwJs=', 'Content-Length': '0'} 2024-04-16T17:46:40.060 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e1e6f5fd7ca78da1-00661eb980-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.060 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.060 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:40.112 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:40.112 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:40.169 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:40.191 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289600.049950_65.1","last_update":"2024-04-16T17:46:40.049950Z"}] 2024-04-16T17:46:40.191 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.049950_65.1'} 2024-04-16T17:46:40.191 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:40.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.192 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:40.240 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:40.240 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:40.295 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:40.297+0000 7fb629432800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:40.296 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:40.298+0000 7fb629432800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:40.316 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289600.049950_65.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:40.049950Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:40Z"} 2024-04-16T17:46:40.317 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289600.049950_65.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:40.049950Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:40Z"} 2024-04-16T17:46:40.317 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289600.049950_65.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:40.049950Z', 'realm_epoch': 2}}] 2024-04-16T17:46:40.317 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.049950_65.1'} 2024-04-16T17:46:40.317 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.049950_65.1'} 2024-04-16T17:46:40.317 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:40.317 DEBUG:boto:path=/cjqttm-5/ 2024-04-16T17:46:40.317 DEBUG:boto:auth_path=/cjqttm-5/ 2024-04-16T17:46:40.318 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.318 DEBUG:boto:Path: /cjqttm-5/ 2024-04-16T17:46:40.318 DEBUG:boto:Data: 2024-04-16T17:46:40.318 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.318 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:40.318 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.318 DEBUG:boto:Params: {} 2024-04-16T17:46:40.318 DEBUG:boto:Token: None 2024-04-16T17:46:40.318 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-5/ 2024-04-16T17:46:40.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qjcs6xfPd1qKJ/fiIUxkpCSNdjo= 2024-04-16T17:46:40.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qjcs6xfPd1qKJ/fiIUxkpCSNdjo=', 'Content-Length': '0'} 2024-04-16T17:46:40.321 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009e281bba3dcae12e-00661eb980-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.321 DEBUG:boto:path=/cjqttm-6/ 2024-04-16T17:46:40.321 DEBUG:boto:auth_path=/cjqttm-6/ 2024-04-16T17:46:40.321 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.321 DEBUG:boto:Path: /cjqttm-6/ 2024-04-16T17:46:40.321 DEBUG:boto:Data: 2024-04-16T17:46:40.321 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.322 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:40.322 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.322 DEBUG:boto:Params: {} 2024-04-16T17:46:40.322 DEBUG:boto:Token: None 2024-04-16T17:46:40.322 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-6/ 2024-04-16T17:46:40.322 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QRxZUVr4Wm0rmaBmwqnjPvJjJHM= 2024-04-16T17:46:40.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QRxZUVr4Wm0rmaBmwqnjPvJjJHM=', 'Content-Length': '0'} 2024-04-16T17:46:40.324 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d01eb7ce60f33328-00661eb980-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.324 DEBUG:boto:path=/cjqttm-5/ 2024-04-16T17:46:40.325 DEBUG:boto:auth_path=/cjqttm-5/ 2024-04-16T17:46:40.325 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.325 DEBUG:boto:Path: /cjqttm-5/ 2024-04-16T17:46:40.325 DEBUG:boto:Data: 2024-04-16T17:46:40.325 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.325 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:40.325 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.325 DEBUG:boto:Params: {} 2024-04-16T17:46:40.325 DEBUG:boto:Token: None 2024-04-16T17:46:40.325 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-5/ 2024-04-16T17:46:40.326 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qjcs6xfPd1qKJ/fiIUxkpCSNdjo= 2024-04-16T17:46:40.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qjcs6xfPd1qKJ/fiIUxkpCSNdjo=', 'Content-Length': '0'} 2024-04-16T17:46:40.328 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ecbb8bb0e6b5b920-00661eb980-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.328 DEBUG:boto:path=/cjqttm-6/ 2024-04-16T17:46:40.328 DEBUG:boto:auth_path=/cjqttm-6/ 2024-04-16T17:46:40.328 DEBUG:boto:Method: HEAD 2024-04-16T17:46:40.329 DEBUG:boto:Path: /cjqttm-6/ 2024-04-16T17:46:40.329 DEBUG:boto:Data: 2024-04-16T17:46:40.329 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.329 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:40.329 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.329 DEBUG:boto:Params: {} 2024-04-16T17:46:40.329 DEBUG:boto:Token: None 2024-04-16T17:46:40.329 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-6/ 2024-04-16T17:46:40.329 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QRxZUVr4Wm0rmaBmwqnjPvJjJHM= 2024-04-16T17:46:40.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QRxZUVr4Wm0rmaBmwqnjPvJjJHM=', 'Content-Length': '0'} 2024-04-16T17:46:40.331 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000003c17da219387c54-00661eb980-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.332 DEBUG:boto:path=/cjqttm-5/ 2024-04-16T17:46:40.332 DEBUG:boto:auth_path=/cjqttm-5/ 2024-04-16T17:46:40.332 DEBUG:boto:Method: DELETE 2024-04-16T17:46:40.332 DEBUG:boto:Path: /cjqttm-5/ 2024-04-16T17:46:40.332 DEBUG:boto:Data: 2024-04-16T17:46:40.332 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.332 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:40.332 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.332 DEBUG:boto:Params: {} 2024-04-16T17:46:40.332 DEBUG:boto:Token: None 2024-04-16T17:46:40.333 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-5/ 2024-04-16T17:46:40.333 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ipQl0QAw4XkdpsdrmBN3UwjNY9c= 2024-04-16T17:46:40.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ipQl0QAw4XkdpsdrmBN3UwjNY9c=', 'Content-Length': '0'} 2024-04-16T17:46:40.356 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000fc0415a4f0458555-00661eb980-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.357 DEBUG:boto:path=/cjqttm-6/ 2024-04-16T17:46:40.357 DEBUG:boto:auth_path=/cjqttm-6/ 2024-04-16T17:46:40.357 DEBUG:boto:Method: DELETE 2024-04-16T17:46:40.357 DEBUG:boto:Path: /cjqttm-6/ 2024-04-16T17:46:40.357 DEBUG:boto:Data: 2024-04-16T17:46:40.357 DEBUG:boto:Headers: {} 2024-04-16T17:46:40.357 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:40.357 DEBUG:boto:Port: 8000 2024-04-16T17:46:40.357 DEBUG:boto:Params: {} 2024-04-16T17:46:40.357 DEBUG:boto:Token: None 2024-04-16T17:46:40.358 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:46:40 GMT /cjqttm-6/ 2024-04-16T17:46:40.358 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7grzfuySuF2FxnlBDr1gcgYJqkM= 2024-04-16T17:46:40.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7grzfuySuF2FxnlBDr1gcgYJqkM=', 'Content-Length': '0'} 2024-04-16T17:46:40.413 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000009f8ab13116c5fc00-00661eb980-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:40.413 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.413 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:40.459 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:40.459 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:40.508 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:40.529 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289600.389038_69.1","last_update":"2024-04-16T17:46:40.389038Z"}] 2024-04-16T17:46:40.530 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.389038_69.1'} 2024-04-16T17:46:40.530 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:40.530 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:40.530 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:40.579 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:40.580 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:40.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:40.641+0000 7fc7c77af800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:40.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:40.642+0000 7fc7c77af800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:40.660 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289600.353550_66.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:40.353550Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:40Z"} 2024-04-16T17:46:40.661 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289600.353550_66.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:40.353550Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:40Z"} 2024-04-16T17:46:40.661 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289600.353550_66.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:40.353550Z', 'realm_epoch': 2}}] 2024-04-16T17:46:40.661 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.389038_69.1'} 2024-04-16T17:46:40.661 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.353550_66.1'} 2024-04-16T17:46:40.661 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1713289600.389038_69.1 target=1_1713289600.353550_66.1 2024-04-16T17:46:45.662 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:45.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:45.663 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:45.719 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:45.719 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:45.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:45.780+0000 7f493b51f800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:45.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:45.782+0000 7f493b51f800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:45.801 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289600.389038_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:40.389038Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:45Z"} 2024-04-16T17:46:45.801 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289600.389038_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:40.389038Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:45Z"} 2024-04-16T17:46:45.801 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289600.389038_69.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:40.389038Z', 'realm_epoch': 2}}] 2024-04-16T17:46:45.802 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.389038_69.1'} 2024-04-16T17:46:45.802 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289600.389038_69.1'} 2024-04-16T17:46:45.802 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:45.802 DEBUG:boto:path=/cjqttm-5/ 2024-04-16T17:46:45.802 DEBUG:boto:auth_path=/cjqttm-5/ 2024-04-16T17:46:45.803 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.803 DEBUG:boto:Path: /cjqttm-5/ 2024-04-16T17:46:45.803 DEBUG:boto:Data: 2024-04-16T17:46:45.803 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.803 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.803 DEBUG:boto:Params: {} 2024-04-16T17:46:45.803 DEBUG:boto:Token: None 2024-04-16T17:46:45.804 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-5/ 2024-04-16T17:46:45.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1hQwMp7ywlLrSrbShS5WHOZeItw= 2024-04-16T17:46:45.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1hQwMp7ywlLrSrbShS5WHOZeItw=', 'Content-Length': '0'} 2024-04-16T17:46:45.805 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx00000f0b36212df0ddb86-00661eb985-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.806 DEBUG:boto:path=/cjqttm-6/ 2024-04-16T17:46:45.806 DEBUG:boto:auth_path=/cjqttm-6/ 2024-04-16T17:46:45.806 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.806 DEBUG:boto:Path: /cjqttm-6/ 2024-04-16T17:46:45.806 DEBUG:boto:Data: 2024-04-16T17:46:45.806 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.806 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.806 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.806 DEBUG:boto:Params: {} 2024-04-16T17:46:45.807 DEBUG:boto:Token: None 2024-04-16T17:46:45.807 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-6/ 2024-04-16T17:46:45.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jXXabIDkHZvSTie7OBawrh0DNzo= 2024-04-16T17:46:45.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jXXabIDkHZvSTie7OBawrh0DNzo=', 'Content-Length': '0'} 2024-04-16T17:46:45.808 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx00000f57d861331e88a15-00661eb985-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.808 DEBUG:boto:path=/cjqttm-5/ 2024-04-16T17:46:45.808 DEBUG:boto:auth_path=/cjqttm-5/ 2024-04-16T17:46:45.808 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.808 DEBUG:boto:Path: /cjqttm-5/ 2024-04-16T17:46:45.808 DEBUG:boto:Data: 2024-04-16T17:46:45.809 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.809 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:45.809 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.809 DEBUG:boto:Params: {} 2024-04-16T17:46:45.809 DEBUG:boto:Token: None 2024-04-16T17:46:45.809 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-5/ 2024-04-16T17:46:45.809 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1hQwMp7ywlLrSrbShS5WHOZeItw= 2024-04-16T17:46:45.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1hQwMp7ywlLrSrbShS5WHOZeItw=', 'Content-Length': '0'} 2024-04-16T17:46:45.810 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx0000057f5cccfb4dd04f2-00661eb985-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.811 DEBUG:boto:path=/cjqttm-6/ 2024-04-16T17:46:45.811 DEBUG:boto:auth_path=/cjqttm-6/ 2024-04-16T17:46:45.811 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.811 DEBUG:boto:Path: /cjqttm-6/ 2024-04-16T17:46:45.811 DEBUG:boto:Data: 2024-04-16T17:46:45.811 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:45.811 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.811 DEBUG:boto:Params: {} 2024-04-16T17:46:45.812 DEBUG:boto:Token: None 2024-04-16T17:46:45.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-6/ 2024-04-16T17:46:45.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jXXabIDkHZvSTie7OBawrh0DNzo= 2024-04-16T17:46:45.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jXXabIDkHZvSTie7OBawrh0DNzo=', 'Content-Length': '0'} 2024-04-16T17:46:45.813 DEBUG:boto:Response headers: [('Content-Length', '250'), ('x-amz-request-id', 'tx00000047309cca744c0d3-00661eb985-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.813 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2024-04-16T17:46:45.814 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-7 2024-04-16T17:46:45.814 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:45.814 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:45.814 DEBUG:boto:Method: PUT 2024-04-16T17:46:45.814 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:45.814 DEBUG:boto:Data: 2024-04-16T17:46:45.814 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.814 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.815 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.815 DEBUG:boto:Params: {} 2024-04-16T17:46:45.815 DEBUG:boto:Token: None 2024-04-16T17:46:45.815 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/ 2024-04-16T17:46:45.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:88JaCysghg//oEEP+ShHcfq7lEM= 2024-04-16T17:46:45.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:88JaCysghg//oEEP+ShHcfq7lEM=', 'Content-Length': '0'} 2024-04-16T17:46:45.835 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000093f4a85776dfd319-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.835 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-8 2024-04-16T17:46:45.835 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:45.835 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:45.835 DEBUG:boto:Method: PUT 2024-04-16T17:46:45.835 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:45.835 DEBUG:boto:Data: 2024-04-16T17:46:45.835 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:45.836 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.836 DEBUG:boto:Params: {} 2024-04-16T17:46:45.836 DEBUG:boto:Token: None 2024-04-16T17:46:45.836 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-8/ 2024-04-16T17:46:45.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xGMaKTg+5aFC7YbBAx9seNU6OVA= 2024-04-16T17:46:45.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xGMaKTg+5aFC7YbBAx9seNU6OVA=', 'Content-Length': '0'} 2024-04-16T17:46:45.867 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000811fa72105ae8287-00661eb985-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.867 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:45.867 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:45.867 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.867 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:45.867 DEBUG:boto:Data: 2024-04-16T17:46:45.867 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.867 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.867 DEBUG:boto:Params: {} 2024-04-16T17:46:45.868 DEBUG:boto:Token: None 2024-04-16T17:46:45.868 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/ 2024-04-16T17:46:45.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M= 2024-04-16T17:46:45.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M=', 'Content-Length': '0'} 2024-04-16T17:46:45.870 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f208ccfb7773bd99-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.870 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:45.871 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:45.871 DEBUG:boto:Method: PUT 2024-04-16T17:46:45.871 DEBUG:boto:Path: /cjqttm-7/myobj 2024-04-16T17:46:45.871 DEBUG:boto:Data: 2024-04-16T17:46:45.871 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:45.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.871 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.871 DEBUG:boto:Params: {} 2024-04-16T17:46:45.871 DEBUG:boto:Token: None 2024-04-16T17:46:45.871 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/myobj 2024-04-16T17:46:45.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMUnXtXoXH/czMzcGI1383vF3hQ= 2024-04-16T17:46:45.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMUnXtXoXH/czMzcGI1383vF3hQ='} 2024-04-16T17:46:45.883 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000022f0bbdc49b888ba-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.883 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:45.884 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:45.884 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.884 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:45.884 DEBUG:boto:Data: 2024-04-16T17:46:45.884 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.884 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.884 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.884 DEBUG:boto:Params: {} 2024-04-16T17:46:45.884 DEBUG:boto:Token: None 2024-04-16T17:46:45.884 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/ 2024-04-16T17:46:45.885 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M= 2024-04-16T17:46:45.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M=', 'Content-Length': '0'} 2024-04-16T17:46:45.887 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ab2e4494287a4b8e-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.887 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:45.887 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:45.887 DEBUG:boto:Method: PUT 2024-04-16T17:46:45.887 DEBUG:boto:Path: /cjqttm-7/_myobj 2024-04-16T17:46:45.887 DEBUG:boto:Data: 2024-04-16T17:46:45.887 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:45.888 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.888 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.888 DEBUG:boto:Params: {} 2024-04-16T17:46:45.888 DEBUG:boto:Token: None 2024-04-16T17:46:45.888 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/_myobj 2024-04-16T17:46:45.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RjvinJQt+rwNR24tl3zwFx22RjE= 2024-04-16T17:46:45.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RjvinJQt+rwNR24tl3zwFx22RjE='} 2024-04-16T17:46:45.930 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d355559041771688-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.931 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:45.931 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:45.931 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.931 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:45.931 DEBUG:boto:Data: 2024-04-16T17:46:45.931 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.931 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.931 DEBUG:boto:Params: {} 2024-04-16T17:46:45.932 DEBUG:boto:Token: None 2024-04-16T17:46:45.932 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/ 2024-04-16T17:46:45.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M= 2024-04-16T17:46:45.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M=', 'Content-Length': '0'} 2024-04-16T17:46:45.934 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dd15f0c82291a6b9-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.934 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:45.934 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:45.935 DEBUG:boto:Method: PUT 2024-04-16T17:46:45.935 DEBUG:boto:Path: /cjqttm-7/%3A 2024-04-16T17:46:45.935 DEBUG:boto:Data: 2024-04-16T17:46:45.935 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:45.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.935 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.935 DEBUG:boto:Params: {} 2024-04-16T17:46:45.935 DEBUG:boto:Token: None 2024-04-16T17:46:45.935 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/%3A 2024-04-16T17:46:45.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mj3enD7HehrXkNwqngeME/Z+HF0= 2024-04-16T17:46:45.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mj3enD7HehrXkNwqngeME/Z+HF0='} 2024-04-16T17:46:45.945 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e5dcb842e41b08a2-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.945 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:45.945 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:45.945 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.945 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:45.945 DEBUG:boto:Data: 2024-04-16T17:46:45.945 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.945 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.946 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.946 DEBUG:boto:Params: {} 2024-04-16T17:46:45.946 DEBUG:boto:Token: None 2024-04-16T17:46:45.946 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/ 2024-04-16T17:46:45.946 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M= 2024-04-16T17:46:45.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M=', 'Content-Length': '0'} 2024-04-16T17:46:45.948 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000192c94a516f3c22a-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.948 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:45.949 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:45.949 DEBUG:boto:Method: PUT 2024-04-16T17:46:45.949 DEBUG:boto:Path: /cjqttm-7/%26 2024-04-16T17:46:45.949 DEBUG:boto:Data: 2024-04-16T17:46:45.949 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:45.949 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.949 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.949 DEBUG:boto:Params: {} 2024-04-16T17:46:45.949 DEBUG:boto:Token: None 2024-04-16T17:46:45.950 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/%26 2024-04-16T17:46:45.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q3H36IgtYrdO8EsLSjd1pjJVilM= 2024-04-16T17:46:45.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q3H36IgtYrdO8EsLSjd1pjJVilM='} 2024-04-16T17:46:45.956 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000448d4bc91ea11003-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.956 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:45.956 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:45.957 DEBUG:boto:Method: HEAD 2024-04-16T17:46:45.957 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:45.957 DEBUG:boto:Data: 2024-04-16T17:46:45.957 DEBUG:boto:Headers: {} 2024-04-16T17:46:45.957 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.957 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.957 DEBUG:boto:Params: {} 2024-04-16T17:46:45.957 DEBUG:boto:Token: None 2024-04-16T17:46:45.957 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/ 2024-04-16T17:46:45.958 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M= 2024-04-16T17:46:45.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LUBsvQ5vV55UXr6u7Gw4dwvA2M=', 'Content-Length': '0'} 2024-04-16T17:46:45.960 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000555dc301a7e58117-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:45.960 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:45.960 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:45.960 DEBUG:boto:Method: PUT 2024-04-16T17:46:45.960 DEBUG:boto:Path: /cjqttm-7/. 2024-04-16T17:46:45.960 DEBUG:boto:Data: 2024-04-16T17:46:45.960 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:45.961 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:45.961 DEBUG:boto:Port: 8000 2024-04-16T17:46:45.961 DEBUG:boto:Params: {} 2024-04-16T17:46:45.961 DEBUG:boto:Token: None 2024-04-16T17:46:45.961 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:45 GMT /cjqttm-7/. 2024-04-16T17:46:45.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IokzDewmK/VNX8LicVZIITNmkco= 2024-04-16T17:46:45.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IokzDewmK/VNX8LicVZIITNmkco='} 2024-04-16T17:46:46.006 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008cf6ec8b1a6ddd50-00661eb985-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.007 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:46.007 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:46.007 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.007 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:46.007 DEBUG:boto:Data: 2024-04-16T17:46:46.007 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.007 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.007 DEBUG:boto:Params: {} 2024-04-16T17:46:46.008 DEBUG:boto:Token: None 2024-04-16T17:46:46.008 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/ 2024-04-16T17:46:46.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs= 2024-04-16T17:46:46.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs=', 'Content-Length': '0'} 2024-04-16T17:46:46.010 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cb64b541d3e08c32-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.010 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:46.011 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:46.011 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.011 DEBUG:boto:Path: /cjqttm-7/.. 2024-04-16T17:46:46.011 DEBUG:boto:Data: 2024-04-16T17:46:46.011 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.011 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.011 DEBUG:boto:Params: {} 2024-04-16T17:46:46.011 DEBUG:boto:Token: None 2024-04-16T17:46:46.011 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/.. 2024-04-16T17:46:46.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:31glP6k2zWum0O/lcyYPc8rZuyQ= 2024-04-16T17:46:46.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:31glP6k2zWum0O/lcyYPc8rZuyQ='} 2024-04-16T17:46:46.018 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dc39f0374eaf48ed-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.018 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:46.019 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:46.019 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.019 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:46.019 DEBUG:boto:Data: 2024-04-16T17:46:46.019 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.019 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.019 DEBUG:boto:Params: {} 2024-04-16T17:46:46.019 DEBUG:boto:Token: None 2024-04-16T17:46:46.019 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/ 2024-04-16T17:46:46.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs= 2024-04-16T17:46:46.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs=', 'Content-Length': '0'} 2024-04-16T17:46:46.022 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000057b859ad312f153a-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.022 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:46.022 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:46.022 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.022 DEBUG:boto:Path: /cjqttm-7/... 2024-04-16T17:46:46.022 DEBUG:boto:Data: 2024-04-16T17:46:46.022 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.023 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.023 DEBUG:boto:Params: {} 2024-04-16T17:46:46.023 DEBUG:boto:Token: None 2024-04-16T17:46:46.023 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/... 2024-04-16T17:46:46.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvQMF/che8RmBwT8/xxEOFn+HIM= 2024-04-16T17:46:46.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvQMF/che8RmBwT8/xxEOFn+HIM='} 2024-04-16T17:46:46.028 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008842cbb91190e5c9-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.028 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:46.028 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:46.028 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.028 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:46.028 DEBUG:boto:Data: 2024-04-16T17:46:46.028 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.028 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.028 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.028 DEBUG:boto:Params: {} 2024-04-16T17:46:46.029 DEBUG:boto:Token: None 2024-04-16T17:46:46.029 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/ 2024-04-16T17:46:46.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs= 2024-04-16T17:46:46.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs=', 'Content-Length': '0'} 2024-04-16T17:46:46.031 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000533ad7daab7890a0-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.031 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:46.031 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:46.031 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.031 DEBUG:boto:Path: /cjqttm-7/.o 2024-04-16T17:46:46.031 DEBUG:boto:Data: 2024-04-16T17:46:46.032 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.032 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.032 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.032 DEBUG:boto:Params: {} 2024-04-16T17:46:46.032 DEBUG:boto:Token: None 2024-04-16T17:46:46.032 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/.o 2024-04-16T17:46:46.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9q1FzrD1XmcalgMqJnIL7g4KMGU= 2024-04-16T17:46:46.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9q1FzrD1XmcalgMqJnIL7g4KMGU='} 2024-04-16T17:46:46.074 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001ec52e524bb3fc8f-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.075 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:46.075 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:46.075 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.075 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:46.075 DEBUG:boto:Data: 2024-04-16T17:46:46.076 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.076 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.076 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.076 DEBUG:boto:Params: {} 2024-04-16T17:46:46.076 DEBUG:boto:Token: None 2024-04-16T17:46:46.076 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/ 2024-04-16T17:46:46.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs= 2024-04-16T17:46:46.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XshM2Yv47GgkSxS0kRhSlTi7oRs=', 'Content-Length': '0'} 2024-04-16T17:46:46.078 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ef348fcc8acafe1c-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.079 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:46.079 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:46.079 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.079 DEBUG:boto:Path: /cjqttm-7/.o. 2024-04-16T17:46:46.079 DEBUG:boto:Data: 2024-04-16T17:46:46.079 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:46.079 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.080 DEBUG:boto:Params: {} 2024-04-16T17:46:46.080 DEBUG:boto:Token: None 2024-04-16T17:46:46.080 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-7/.o. 2024-04-16T17:46:46.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nzMhcq1ycd/u2Cxec3WQW/v5hTo= 2024-04-16T17:46:46.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nzMhcq1ycd/u2Cxec3WQW/v5hTo='} 2024-04-16T17:46:46.086 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bb7466143fe4cce5-00661eb986-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.086 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.086 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.086 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.086 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.086 DEBUG:boto:Data: 2024-04-16T17:46:46.086 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.086 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.086 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.087 DEBUG:boto:Params: {} 2024-04-16T17:46:46.087 DEBUG:boto:Token: None 2024-04-16T17:46:46.087 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.089 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000b21c4357f2a6508-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.090 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:46:46.090 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:46:46.090 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.090 DEBUG:boto:Path: /cjqttm-8/myobj 2024-04-16T17:46:46.090 DEBUG:boto:Data: 2024-04-16T17:46:46.090 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.090 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.090 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.090 DEBUG:boto:Params: {} 2024-04-16T17:46:46.091 DEBUG:boto:Token: None 2024-04-16T17:46:46.091 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/myobj 2024-04-16T17:46:46.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PX6nm0ZwsDRDXvv4uZwFXIijriE= 2024-04-16T17:46:46.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PX6nm0ZwsDRDXvv4uZwFXIijriE='} 2024-04-16T17:46:46.102 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008935721982d86027-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.102 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.102 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.103 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.103 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.103 DEBUG:boto:Data: 2024-04-16T17:46:46.103 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.103 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.103 DEBUG:boto:Params: {} 2024-04-16T17:46:46.103 DEBUG:boto:Token: None 2024-04-16T17:46:46.103 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.106 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000047c30cd60df48810-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.106 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:46:46.106 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:46:46.106 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.106 DEBUG:boto:Path: /cjqttm-8/_myobj 2024-04-16T17:46:46.106 DEBUG:boto:Data: 2024-04-16T17:46:46.107 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.107 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.107 DEBUG:boto:Params: {} 2024-04-16T17:46:46.107 DEBUG:boto:Token: None 2024-04-16T17:46:46.107 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/_myobj 2024-04-16T17:46:46.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o+93VWztqLUfK9HT4K422UjMX4k= 2024-04-16T17:46:46.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o+93VWztqLUfK9HT4K422UjMX4k='} 2024-04-16T17:46:46.151 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000050c1c3f0ff485018-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.151 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.151 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.151 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.151 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.151 DEBUG:boto:Data: 2024-04-16T17:46:46.152 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.152 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.152 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.152 DEBUG:boto:Params: {} 2024-04-16T17:46:46.152 DEBUG:boto:Token: None 2024-04-16T17:46:46.152 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.153 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.155 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a25db58362fb3499-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.156 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:46:46.156 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:46:46.156 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.156 DEBUG:boto:Path: /cjqttm-8/%3A 2024-04-16T17:46:46.156 DEBUG:boto:Data: 2024-04-16T17:46:46.156 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.156 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.156 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.156 DEBUG:boto:Params: {} 2024-04-16T17:46:46.156 DEBUG:boto:Token: None 2024-04-16T17:46:46.157 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/%3A 2024-04-16T17:46:46.157 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:54cF8x1svA9hI+vn3D+UTIVzps8= 2024-04-16T17:46:46.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:54cF8x1svA9hI+vn3D+UTIVzps8='} 2024-04-16T17:46:46.166 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001f66f18bc15cd854-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.166 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.166 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.166 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.166 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.166 DEBUG:boto:Data: 2024-04-16T17:46:46.166 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.166 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.167 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.167 DEBUG:boto:Params: {} 2024-04-16T17:46:46.167 DEBUG:boto:Token: None 2024-04-16T17:46:46.167 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.169 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004de479f5ee75799a-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.169 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:46:46.169 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:46:46.170 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.170 DEBUG:boto:Path: /cjqttm-8/%26 2024-04-16T17:46:46.170 DEBUG:boto:Data: 2024-04-16T17:46:46.170 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.170 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.170 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.170 DEBUG:boto:Params: {} 2024-04-16T17:46:46.170 DEBUG:boto:Token: None 2024-04-16T17:46:46.170 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/%26 2024-04-16T17:46:46.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:doZCsC0blysbQ7ecCriMjmbFU+I= 2024-04-16T17:46:46.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:doZCsC0blysbQ7ecCriMjmbFU+I='} 2024-04-16T17:46:46.214 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000033b5074b15103503-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.215 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.215 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.215 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.215 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.215 DEBUG:boto:Data: 2024-04-16T17:46:46.215 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.215 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.215 DEBUG:boto:Params: {} 2024-04-16T17:46:46.216 DEBUG:boto:Token: None 2024-04-16T17:46:46.216 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.218 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002dc36aafba155777-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.218 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:46:46.218 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:46:46.219 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.219 DEBUG:boto:Path: /cjqttm-8/. 2024-04-16T17:46:46.219 DEBUG:boto:Data: 2024-04-16T17:46:46.219 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.219 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.219 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.219 DEBUG:boto:Params: {} 2024-04-16T17:46:46.219 DEBUG:boto:Token: None 2024-04-16T17:46:46.219 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/. 2024-04-16T17:46:46.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gKPxvnfCUAmZ5A32HYLMD6T9R7M= 2024-04-16T17:46:46.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gKPxvnfCUAmZ5A32HYLMD6T9R7M='} 2024-04-16T17:46:46.229 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a3ac6df28c1d94ac-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.229 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.229 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.229 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.230 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.230 DEBUG:boto:Data: 2024-04-16T17:46:46.230 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.230 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.230 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.230 DEBUG:boto:Params: {} 2024-04-16T17:46:46.230 DEBUG:boto:Token: None 2024-04-16T17:46:46.230 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.233 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000084ad3aad7f1c1249-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.233 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:46:46.233 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:46:46.233 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.233 DEBUG:boto:Path: /cjqttm-8/.. 2024-04-16T17:46:46.233 DEBUG:boto:Data: 2024-04-16T17:46:46.234 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.234 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.234 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.234 DEBUG:boto:Params: {} 2024-04-16T17:46:46.234 DEBUG:boto:Token: None 2024-04-16T17:46:46.234 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/.. 2024-04-16T17:46:46.234 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zhuc0k+MPWfcEGyaOhshxysJvmY= 2024-04-16T17:46:46.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zhuc0k+MPWfcEGyaOhshxysJvmY='} 2024-04-16T17:46:46.240 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a03a46e42321db72-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.240 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.240 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.240 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.240 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.240 DEBUG:boto:Data: 2024-04-16T17:46:46.240 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.240 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.241 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.241 DEBUG:boto:Params: {} 2024-04-16T17:46:46.241 DEBUG:boto:Token: None 2024-04-16T17:46:46.241 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.241 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.243 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000504ee5639631923b-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.244 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:46:46.244 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:46:46.244 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.244 DEBUG:boto:Path: /cjqttm-8/... 2024-04-16T17:46:46.244 DEBUG:boto:Data: 2024-04-16T17:46:46.244 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.244 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.244 DEBUG:boto:Params: {} 2024-04-16T17:46:46.244 DEBUG:boto:Token: None 2024-04-16T17:46:46.245 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/... 2024-04-16T17:46:46.245 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uuhchzv3P2MJiKGa3e0Iq9njWaU= 2024-04-16T17:46:46.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uuhchzv3P2MJiKGa3e0Iq9njWaU='} 2024-04-16T17:46:46.286 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007bc7118ba5877dad-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.287 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.287 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.287 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.287 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.287 DEBUG:boto:Data: 2024-04-16T17:46:46.287 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.287 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.287 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.287 DEBUG:boto:Params: {} 2024-04-16T17:46:46.287 DEBUG:boto:Token: None 2024-04-16T17:46:46.288 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.290 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002c9a032bb424de1e-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.290 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:46:46.290 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:46:46.290 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.290 DEBUG:boto:Path: /cjqttm-8/.o 2024-04-16T17:46:46.291 DEBUG:boto:Data: 2024-04-16T17:46:46.291 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.291 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.291 DEBUG:boto:Params: {} 2024-04-16T17:46:46.291 DEBUG:boto:Token: None 2024-04-16T17:46:46.291 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/.o 2024-04-16T17:46:46.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cAxUy9IDzptJKDOv6EvvAq6F/y0= 2024-04-16T17:46:46.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cAxUy9IDzptJKDOv6EvvAq6F/y0='} 2024-04-16T17:46:46.296 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000063858a3a1a591ca-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.296 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:46:46.296 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:46:46.297 DEBUG:boto:Method: HEAD 2024-04-16T17:46:46.297 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:46:46.297 DEBUG:boto:Data: 2024-04-16T17:46:46.297 DEBUG:boto:Headers: {} 2024-04-16T17:46:46.297 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.297 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.297 DEBUG:boto:Params: {} 2024-04-16T17:46:46.297 DEBUG:boto:Token: None 2024-04-16T17:46:46.297 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/ 2024-04-16T17:46:46.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU= 2024-04-16T17:46:46.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4c7TJFFtC34V+GsYxW811VaFhKU=', 'Content-Length': '0'} 2024-04-16T17:46:46.299 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a1c4fd23907d09e2-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.300 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:46:46.300 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:46:46.300 DEBUG:boto:Method: PUT 2024-04-16T17:46:46.300 DEBUG:boto:Path: /cjqttm-8/.o. 2024-04-16T17:46:46.300 DEBUG:boto:Data: 2024-04-16T17:46:46.300 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:46:46.300 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:46.300 DEBUG:boto:Port: 8000 2024-04-16T17:46:46.300 DEBUG:boto:Params: {} 2024-04-16T17:46:46.300 DEBUG:boto:Token: None 2024-04-16T17:46:46.301 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:46:46 GMT /cjqttm-8/.o. 2024-04-16T17:46:46.301 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lRZxODjsDWdexO3pj+MZzgOKKKU= 2024-04-16T17:46:46.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:46:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lRZxODjsDWdexO3pj+MZzgOKKKU='} 2024-04-16T17:46:46.342 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a59d70d2f0414d0f-00661eb986-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:46.343 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:46.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:46.343 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:46.396 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:46.396 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:46.450 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:46:46.472 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289605.853197_77.1","last_update":"2024-04-16T17:46:45.853197Z"}] 2024-04-16T17:46:46.472 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289605.853197_77.1'} 2024-04-16T17:46:46.472 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:46:46.472 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:46.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:46:46.473 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:46:46.520 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:46.521 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:46.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:46.571+0000 7fd528233800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:46.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:46.572+0000 7fd528233800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:46:46.591 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289605.853197_77.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:45.853197Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:46Z"} 2024-04-16T17:46:46.591 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289605.853197_77.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:46:45.853197Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:46:46Z"} 2024-04-16T17:46:46.591 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289605.853197_77.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:46:45.853197Z', 'realm_epoch': 2}}] 2024-04-16T17:46:46.592 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289605.853197_77.1'} 2024-04-16T17:46:46.592 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '', 3: '1_1713289605.853197_77.1'} 2024-04-16T17:46:46.592 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:46:46.592 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:46:46.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-7', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:46:46.592 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-7 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:46:46.646 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:46.646 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:46.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:46.701+0000 7fe8dfa9d800 1 waiting to reach incremental sync.. 2024-04-16T17:46:51.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:51.703+0000 7fe8dfa9d800 1 bucket sync caught up with source: 2024-04-16T17:46:51.703 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000002.10.6, , 00000000001.11.6, , 00000000001.8.6, 00000000002.9.6, 00000000001.7.6, 00000000001.10.6, 00000000001.13.6, ] 2024-04-16T17:46:51.703 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000002.10.6, , 00000000001.11.6, , 00000000001.8.6, 00000000002.9.6, 00000000001.7.6, 00000000001.10.6, 00000000001.13.6, ] 2024-04-16T17:46:51.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:46:51.703+0000 7fe8dfa9d800 0 bucket checkpoint complete 2024-04-16T17:46:51.726 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-7 zones={test-zone2, test-zone1} 2024-04-16T17:46:51.726 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.726 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.727 DEBUG:boto:Method: HEAD 2024-04-16T17:46:51.727 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:51.727 DEBUG:boto:Data: 2024-04-16T17:46:51.727 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.727 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.727 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.727 DEBUG:boto:Params: {} 2024-04-16T17:46:51.727 DEBUG:boto:Token: None 2024-04-16T17:46:51.727 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/ 2024-04-16T17:46:51.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4ETGj9yNPHPP9DfK3JYjEY+Bfik= 2024-04-16T17:46:51.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4ETGj9yNPHPP9DfK3JYjEY+Bfik=', 'Content-Length': '0'} 2024-04-16T17:46:51.730 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000038cb9c039bb1a110-00661eb98b-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.731 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.731 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.731 DEBUG:boto:Method: HEAD 2024-04-16T17:46:51.731 DEBUG:boto:Path: /cjqttm-7/ 2024-04-16T17:46:51.731 DEBUG:boto:Data: 2024-04-16T17:46:51.731 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.731 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.731 DEBUG:boto:Params: {} 2024-04-16T17:46:51.731 DEBUG:boto:Token: None 2024-04-16T17:46:51.732 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/ 2024-04-16T17:46:51.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4ETGj9yNPHPP9DfK3JYjEY+Bfik= 2024-04-16T17:46:51.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4ETGj9yNPHPP9DfK3JYjEY+Bfik=', 'Content-Length': '0'} 2024-04-16T17:46:51.734 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000db6b6b7be510f766-00661eb98b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.734 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:46:51.735 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.735 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.735 DEBUG:boto:path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.735 DEBUG:boto:auth_path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.735 DEBUG:boto:Method: GET 2024-04-16T17:46:51.735 DEBUG:boto:Path: /cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.735 DEBUG:boto:Data: 2024-04-16T17:46:51.735 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.735 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.735 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.735 DEBUG:boto:Params: {} 2024-04-16T17:46:51.736 DEBUG:boto:Token: None 2024-04-16T17:46:51.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/?versions 2024-04-16T17:46:51.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY= 2024-04-16T17:46:51.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY=', 'Content-Length': '0'} 2024-04-16T17:46:51.739 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014b99a41f796b3fc-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.739 DEBUG:boto:b'cjqttm-7999false&nulltrue2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.755 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-16T17:46:51.755 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-16T17:46:51.755 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-16T17:46:51.755 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-16T17:46:51.755 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-16T17:46:51.755 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-16T17:46:51.756 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-16T17:46:51.756 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-16T17:46:51.756 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:46:51.756 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:46:51.756 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.756 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.756 DEBUG:boto:path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.756 DEBUG:boto:auth_path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.756 DEBUG:boto:Method: GET 2024-04-16T17:46:51.756 DEBUG:boto:Path: /cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.756 DEBUG:boto:Data: 2024-04-16T17:46:51.757 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.757 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.757 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.757 DEBUG:boto:Params: {} 2024-04-16T17:46:51.757 DEBUG:boto:Token: None 2024-04-16T17:46:51.757 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/?versions 2024-04-16T17:46:51.757 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY= 2024-04-16T17:46:51.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY=', 'Content-Length': '0'} 2024-04-16T17:46:51.760 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039c17b48b404bca4-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.760 DEBUG:boto:b'cjqttm-7999false&nulltrue2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.760 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-16T17:46:51.760 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-16T17:46:51.761 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-16T17:46:51.761 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-16T17:46:51.761 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-16T17:46:51.761 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-16T17:46:51.761 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-16T17:46:51.761 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-16T17:46:51.761 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:46:51.761 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.761 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.761 DEBUG:boto:path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.762 DEBUG:boto:auth_path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.762 DEBUG:boto:Method: GET 2024-04-16T17:46:51.762 DEBUG:boto:Path: /cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.762 DEBUG:boto:Data: 2024-04-16T17:46:51.762 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.762 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.762 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.762 DEBUG:boto:Params: {} 2024-04-16T17:46:51.762 DEBUG:boto:Token: None 2024-04-16T17:46:51.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/?versions 2024-04-16T17:46:51.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY= 2024-04-16T17:46:51.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY=', 'Content-Length': '0'} 2024-04-16T17:46:51.765 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074bc0200f360d745-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.765 DEBUG:boto:b'cjqttm-7999false&nulltrue2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.766 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.766 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.766 DEBUG:boto:path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.766 DEBUG:boto:auth_path=/cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.766 DEBUG:boto:Method: GET 2024-04-16T17:46:51.767 DEBUG:boto:Path: /cjqttm-7/?versions&max-keys=999 2024-04-16T17:46:51.767 DEBUG:boto:Data: 2024-04-16T17:46:51.767 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.767 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.767 DEBUG:boto:Params: {} 2024-04-16T17:46:51.767 DEBUG:boto:Token: None 2024-04-16T17:46:51.767 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/?versions 2024-04-16T17:46:51.767 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY= 2024-04-16T17:46:51.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ZE1OlyYgr21o4Os9NEsCmG4RLY=', 'Content-Length': '0'} 2024-04-16T17:46:51.770 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c76ac7cf49200bdf-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.770 DEBUG:boto:b'cjqttm-7999false&nulltrue2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-16T17:46:51.771 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.771 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.771 DEBUG:boto:path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.771 DEBUG:boto:auth_path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.772 DEBUG:boto:Method: GET 2024-04-16T17:46:51.772 DEBUG:boto:Path: /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.772 DEBUG:boto:Data: 2024-04-16T17:46:51.772 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.772 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.772 DEBUG:boto:Params: {} 2024-04-16T17:46:51.772 DEBUG:boto:Token: None 2024-04-16T17:46:51.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU= 2024-04-16T17:46:51.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU=', 'Content-Length': '0'} 2024-04-16T17:46:51.775 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a8eb489d3a441c9-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.775 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.775 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.775 DEBUG:boto:path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.775 DEBUG:boto:auth_path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.776 DEBUG:boto:Method: GET 2024-04-16T17:46:51.776 DEBUG:boto:Path: /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.776 DEBUG:boto:Data: 2024-04-16T17:46:51.776 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.776 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.776 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.776 DEBUG:boto:Params: {} 2024-04-16T17:46:51.776 DEBUG:boto:Token: None 2024-04-16T17:46:51.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU= 2024-04-16T17:46:51.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU=', 'Content-Length': '0'} 2024-04-16T17:46:51.778 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bc4b17675ab188bf-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.822 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.823 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.823 DEBUG:boto:path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.823 DEBUG:boto:auth_path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.823 DEBUG:boto:Method: HEAD 2024-04-16T17:46:51.823 DEBUG:boto:Path: /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.823 DEBUG:boto:Data: 2024-04-16T17:46:51.823 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.823 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.823 DEBUG:boto:Params: {} 2024-04-16T17:46:51.824 DEBUG:boto:Token: None 2024-04-16T17:46:51.824 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sle0U62IYDvh9sZhjdUTIZ1bBdc= 2024-04-16T17:46:51.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sle0U62IYDvh9sZhjdUTIZ1bBdc=', 'Content-Length': '0'} 2024-04-16T17:46:51.826 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000220ebb7be2330a6d-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.826 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.826 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.826 DEBUG:boto:path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.826 DEBUG:boto:auth_path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.827 DEBUG:boto:Method: HEAD 2024-04-16T17:46:51.827 DEBUG:boto:Path: /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.827 DEBUG:boto:Data: 2024-04-16T17:46:51.827 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.827 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.827 DEBUG:boto:Params: {} 2024-04-16T17:46:51.827 DEBUG:boto:Token: None 2024-04-16T17:46:51.828 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sle0U62IYDvh9sZhjdUTIZ1bBdc= 2024-04-16T17:46:51.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sle0U62IYDvh9sZhjdUTIZ1bBdc=', 'Content-Length': '0'} 2024-04-16T17:46:51.829 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002781643521aec223-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.830 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-16T17:46:51.830 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.830 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.830 DEBUG:boto:path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.830 DEBUG:boto:auth_path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.830 DEBUG:boto:Method: GET 2024-04-16T17:46:51.830 DEBUG:boto:Path: /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.830 DEBUG:boto:Data: 2024-04-16T17:46:51.831 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.831 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.831 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.831 DEBUG:boto:Params: {} 2024-04-16T17:46:51.831 DEBUG:boto:Token: None 2024-04-16T17:46:51.831 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU= 2024-04-16T17:46:51.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU=', 'Content-Length': '0'} 2024-04-16T17:46:51.833 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e0f14fc98198e59d-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.833 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.833 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.833 DEBUG:boto:path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.834 DEBUG:boto:auth_path=/cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.834 DEBUG:boto:Method: GET 2024-04-16T17:46:51.834 DEBUG:boto:Path: /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.834 DEBUG:boto:Data: 2024-04-16T17:46:51.834 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.834 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.834 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.834 DEBUG:boto:Params: {} 2024-04-16T17:46:51.834 DEBUG:boto:Token: None 2024-04-16T17:46:51.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26?versionId=null 2024-04-16T17:46:51.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU= 2024-04-16T17:46:51.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jZid0CN+8qMNzWt/lqJbyRUSsvU=', 'Content-Length': '0'} 2024-04-16T17:46:51.837 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008dfc2a2a147a0b52-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.837 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.837 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.837 DEBUG:boto:path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.837 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.837 DEBUG:boto:Method: GET 2024-04-16T17:46:51.837 DEBUG:boto:Path: /cjqttm-7/?prefix=%26 2024-04-16T17:46:51.838 DEBUG:boto:Data: 2024-04-16T17:46:51.838 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.838 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.838 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.838 DEBUG:boto:Params: {} 2024-04-16T17:46:51.838 DEBUG:boto:Token: None 2024-04-16T17:46:51.838 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/ 2024-04-16T17:46:51.838 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI= 2024-04-16T17:46:51.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI=', 'Content-Length': '0'} 2024-04-16T17:46:51.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a975422bfcdaf0c-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.841 DEBUG:boto:b'cjqttm-7&1000false&2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.842 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.842 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.842 DEBUG:boto:path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.842 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.842 DEBUG:boto:Method: GET 2024-04-16T17:46:51.842 DEBUG:boto:Path: /cjqttm-7/?prefix=%26 2024-04-16T17:46:51.843 DEBUG:boto:Data: 2024-04-16T17:46:51.843 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.843 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.843 DEBUG:boto:Params: {} 2024-04-16T17:46:51.843 DEBUG:boto:Token: None 2024-04-16T17:46:51.843 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/ 2024-04-16T17:46:51.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI= 2024-04-16T17:46:51.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI=', 'Content-Length': '0'} 2024-04-16T17:46:51.846 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e29ac7c0b51ff44-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.846 DEBUG:boto:b'cjqttm-7&1000false&2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.846 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.846 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.846 DEBUG:boto:Method: HEAD 2024-04-16T17:46:51.846 DEBUG:boto:Path: /cjqttm-7/%26 2024-04-16T17:46:51.847 DEBUG:boto:Data: 2024-04-16T17:46:51.847 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.847 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.847 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.847 DEBUG:boto:Params: {} 2024-04-16T17:46:51.847 DEBUG:boto:Token: None 2024-04-16T17:46:51.847 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26 2024-04-16T17:46:51.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IxuhnADLo482ZoWyklMFdiF4cro= 2024-04-16T17:46:51.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IxuhnADLo482ZoWyklMFdiF4cro=', 'Content-Length': '0'} 2024-04-16T17:46:51.849 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000099a2bb912f0815b1-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.849 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.849 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.849 DEBUG:boto:Method: HEAD 2024-04-16T17:46:51.850 DEBUG:boto:Path: /cjqttm-7/%26 2024-04-16T17:46:51.850 DEBUG:boto:Data: 2024-04-16T17:46:51.850 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.850 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.850 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.850 DEBUG:boto:Params: {} 2024-04-16T17:46:51.850 DEBUG:boto:Token: None 2024-04-16T17:46:51.850 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26 2024-04-16T17:46:51.850 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IxuhnADLo482ZoWyklMFdiF4cro= 2024-04-16T17:46:51.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IxuhnADLo482ZoWyklMFdiF4cro=', 'Content-Length': '0'} 2024-04-16T17:46:51.852 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000025764ae7dc86c723-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.852 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-16T17:46:51.852 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.853 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.853 DEBUG:boto:Method: GET 2024-04-16T17:46:51.853 DEBUG:boto:Path: /cjqttm-7/%26 2024-04-16T17:46:51.853 DEBUG:boto:Data: 2024-04-16T17:46:51.853 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.853 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.853 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.853 DEBUG:boto:Params: {} 2024-04-16T17:46:51.853 DEBUG:boto:Token: None 2024-04-16T17:46:51.853 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26 2024-04-16T17:46:51.854 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w7jyw7yQxSlK/CJ0nxzNbfGH5BU= 2024-04-16T17:46:51.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w7jyw7yQxSlK/CJ0nxzNbfGH5BU=', 'Content-Length': '0'} 2024-04-16T17:46:51.855 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b35debf668e81ded-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.898 DEBUG:boto:path=/cjqttm-7/%26 2024-04-16T17:46:51.898 DEBUG:boto:auth_path=/cjqttm-7/%26 2024-04-16T17:46:51.898 DEBUG:boto:Method: GET 2024-04-16T17:46:51.899 DEBUG:boto:Path: /cjqttm-7/%26 2024-04-16T17:46:51.899 DEBUG:boto:Data: 2024-04-16T17:46:51.899 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.899 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.899 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.899 DEBUG:boto:Params: {} 2024-04-16T17:46:51.899 DEBUG:boto:Token: None 2024-04-16T17:46:51.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/%26 2024-04-16T17:46:51.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w7jyw7yQxSlK/CJ0nxzNbfGH5BU= 2024-04-16T17:46:51.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w7jyw7yQxSlK/CJ0nxzNbfGH5BU=', 'Content-Length': '0'} 2024-04-16T17:46:51.901 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c3b01ee2b0ba2e2f-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.902 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.902 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.902 DEBUG:boto:path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.902 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.902 DEBUG:boto:Method: GET 2024-04-16T17:46:51.902 DEBUG:boto:Path: /cjqttm-7/?prefix=%26 2024-04-16T17:46:51.902 DEBUG:boto:Data: 2024-04-16T17:46:51.902 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.902 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.903 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.903 DEBUG:boto:Params: {} 2024-04-16T17:46:51.903 DEBUG:boto:Token: None 2024-04-16T17:46:51.903 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/ 2024-04-16T17:46:51.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI= 2024-04-16T17:46:51.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI=', 'Content-Length': '0'} 2024-04-16T17:46:51.905 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c28141ac5dfb57b7-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.946 DEBUG:boto:b'cjqttm-7&1000false&2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.947 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:51.947 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:51.947 DEBUG:boto:path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.947 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%26 2024-04-16T17:46:51.947 DEBUG:boto:Method: GET 2024-04-16T17:46:51.947 DEBUG:boto:Path: /cjqttm-7/?prefix=%26 2024-04-16T17:46:51.947 DEBUG:boto:Data: 2024-04-16T17:46:51.947 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:51.947 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.948 DEBUG:boto:Params: {} 2024-04-16T17:46:51.948 DEBUG:boto:Token: None 2024-04-16T17:46:51.948 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/ 2024-04-16T17:46:51.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI= 2024-04-16T17:46:51.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YB3va1LmUwitgO04oi57NlWBlhI=', 'Content-Length': '0'} 2024-04-16T17:46:51.950 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004040e07ac5a0db69-00661eb98b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.950 DEBUG:boto:b'cjqttm-7&1000false&2024-04-16T17:46:45.954Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:51.951 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-16T17:46:51.951 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:51.951 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:51.951 DEBUG:boto:path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:51.951 DEBUG:boto:auth_path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:51.951 DEBUG:boto:Method: GET 2024-04-16T17:46:51.951 DEBUG:boto:Path: /cjqttm-7/.?versionId=null 2024-04-16T17:46:51.951 DEBUG:boto:Data: 2024-04-16T17:46:51.951 DEBUG:boto:Headers: {} 2024-04-16T17:46:51.952 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:51.952 DEBUG:boto:Port: 8000 2024-04-16T17:46:51.952 DEBUG:boto:Params: {} 2024-04-16T17:46:51.952 DEBUG:boto:Token: None 2024-04-16T17:46:51.952 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:51 GMT /cjqttm-7/.?versionId=null 2024-04-16T17:46:51.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g6B2B//IhOr8XbhnjQXYz4KrRyc= 2024-04-16T17:46:51.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g6B2B//IhOr8XbhnjQXYz4KrRyc=', 'Content-Length': '0'} 2024-04-16T17:46:51.955 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e20f8bbc4d03525b-00661eb98b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:51.998 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:51.998 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:51.999 DEBUG:boto:path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:51.999 DEBUG:boto:auth_path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:51.999 DEBUG:boto:Method: GET 2024-04-16T17:46:51.999 DEBUG:boto:Path: /cjqttm-7/.?versionId=null 2024-04-16T17:46:51.999 DEBUG:boto:Data: 2024-04-16T17:46:52.001 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.002 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.002 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.002 DEBUG:boto:Params: {} 2024-04-16T17:46:52.002 DEBUG:boto:Token: None 2024-04-16T17:46:52.002 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.002 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:blFKyxeod+TlSreOFAywg9ZNXT0= 2024-04-16T17:46:52.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:blFKyxeod+TlSreOFAywg9ZNXT0=', 'Content-Length': '0'} 2024-04-16T17:46:52.004 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f2ef905c5022db90-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.005 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.005 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.005 DEBUG:boto:path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.005 DEBUG:boto:auth_path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.005 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.005 DEBUG:boto:Path: /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.005 DEBUG:boto:Data: 2024-04-16T17:46:52.005 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.005 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.006 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.006 DEBUG:boto:Params: {} 2024-04-16T17:46:52.006 DEBUG:boto:Token: None 2024-04-16T17:46:52.006 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.006 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xl7CfNLVgxBjvruYKnj0vCgsUd0= 2024-04-16T17:46:52.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xl7CfNLVgxBjvruYKnj0vCgsUd0=', 'Content-Length': '0'} 2024-04-16T17:46:52.008 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000698f9b12ffdf4103-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.009 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.009 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.009 DEBUG:boto:path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.009 DEBUG:boto:auth_path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.009 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.009 DEBUG:boto:Path: /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.009 DEBUG:boto:Data: 2024-04-16T17:46:52.009 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.009 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.009 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.010 DEBUG:boto:Params: {} 2024-04-16T17:46:52.010 DEBUG:boto:Token: None 2024-04-16T17:46:52.010 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.010 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xl7CfNLVgxBjvruYKnj0vCgsUd0= 2024-04-16T17:46:52.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xl7CfNLVgxBjvruYKnj0vCgsUd0=', 'Content-Length': '0'} 2024-04-16T17:46:52.012 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b7ca8bbfc62c140-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.013 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-16T17:46:52.013 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.013 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.013 DEBUG:boto:path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.013 DEBUG:boto:auth_path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.013 DEBUG:boto:Method: GET 2024-04-16T17:46:52.013 DEBUG:boto:Path: /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.013 DEBUG:boto:Data: 2024-04-16T17:46:52.013 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.013 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.013 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.013 DEBUG:boto:Params: {} 2024-04-16T17:46:52.014 DEBUG:boto:Token: None 2024-04-16T17:46:52.014 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.014 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:blFKyxeod+TlSreOFAywg9ZNXT0= 2024-04-16T17:46:52.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:blFKyxeod+TlSreOFAywg9ZNXT0=', 'Content-Length': '0'} 2024-04-16T17:46:52.016 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cdcc0543e3aeb53d-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.017 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.017 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.017 DEBUG:boto:path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.017 DEBUG:boto:auth_path=/cjqttm-7/.?versionId=null 2024-04-16T17:46:52.017 DEBUG:boto:Method: GET 2024-04-16T17:46:52.017 DEBUG:boto:Path: /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.017 DEBUG:boto:Data: 2024-04-16T17:46:52.017 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.017 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.017 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.017 DEBUG:boto:Params: {} 2024-04-16T17:46:52.018 DEBUG:boto:Token: None 2024-04-16T17:46:52.018 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.?versionId=null 2024-04-16T17:46:52.018 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:blFKyxeod+TlSreOFAywg9ZNXT0= 2024-04-16T17:46:52.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:blFKyxeod+TlSreOFAywg9ZNXT0=', 'Content-Length': '0'} 2024-04-16T17:46:52.020 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a6aa530d55be60e6-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.020 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.020 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.020 DEBUG:boto:path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.020 DEBUG:boto:auth_path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.021 DEBUG:boto:Method: GET 2024-04-16T17:46:52.021 DEBUG:boto:Path: /cjqttm-7/?prefix=. 2024-04-16T17:46:52.021 DEBUG:boto:Data: 2024-04-16T17:46:52.021 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.021 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.021 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.021 DEBUG:boto:Params: {} 2024-04-16T17:46:52.021 DEBUG:boto:Token: None 2024-04-16T17:46:52.021 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.021 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.024 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e83587c383f60955-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.024 DEBUG:boto:b'cjqttm-7.1000false.2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.025 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.025 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.025 DEBUG:boto:path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.025 DEBUG:boto:auth_path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.025 DEBUG:boto:Method: GET 2024-04-16T17:46:52.025 DEBUG:boto:Path: /cjqttm-7/?prefix=. 2024-04-16T17:46:52.025 DEBUG:boto:Data: 2024-04-16T17:46:52.025 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.025 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.026 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.026 DEBUG:boto:Params: {} 2024-04-16T17:46:52.026 DEBUG:boto:Token: None 2024-04-16T17:46:52.026 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.026 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068e1bd1255029106-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.029 DEBUG:boto:b'cjqttm-7.1000false.2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.029 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.029 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.030 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.030 DEBUG:boto:Path: /cjqttm-7/. 2024-04-16T17:46:52.030 DEBUG:boto:Data: 2024-04-16T17:46:52.030 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.030 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.030 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.030 DEBUG:boto:Params: {} 2024-04-16T17:46:52.030 DEBUG:boto:Token: None 2024-04-16T17:46:52.030 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/. 2024-04-16T17:46:52.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gKQgESCjB5c1maScVvP2JC10hKg= 2024-04-16T17:46:52.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gKQgESCjB5c1maScVvP2JC10hKg=', 'Content-Length': '0'} 2024-04-16T17:46:52.032 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ce934f9418512129-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.033 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.033 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.033 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.033 DEBUG:boto:Path: /cjqttm-7/. 2024-04-16T17:46:52.033 DEBUG:boto:Data: 2024-04-16T17:46:52.033 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.033 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.033 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.034 DEBUG:boto:Params: {} 2024-04-16T17:46:52.034 DEBUG:boto:Token: None 2024-04-16T17:46:52.034 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/. 2024-04-16T17:46:52.034 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gKQgESCjB5c1maScVvP2JC10hKg= 2024-04-16T17:46:52.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gKQgESCjB5c1maScVvP2JC10hKg=', 'Content-Length': '0'} 2024-04-16T17:46:52.036 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000040774325a9d6e20f-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.036 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-16T17:46:52.036 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.036 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.037 DEBUG:boto:Method: GET 2024-04-16T17:46:52.037 DEBUG:boto:Path: /cjqttm-7/. 2024-04-16T17:46:52.037 DEBUG:boto:Data: 2024-04-16T17:46:52.037 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.037 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.037 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.037 DEBUG:boto:Params: {} 2024-04-16T17:46:52.037 DEBUG:boto:Token: None 2024-04-16T17:46:52.037 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/. 2024-04-16T17:46:52.037 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FJhbJg6EscITwkrrI3lM8CAJ6Hs= 2024-04-16T17:46:52.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FJhbJg6EscITwkrrI3lM8CAJ6Hs=', 'Content-Length': '0'} 2024-04-16T17:46:52.039 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009792dcd4f7773b96-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.082 DEBUG:boto:path=/cjqttm-7/. 2024-04-16T17:46:52.083 DEBUG:boto:auth_path=/cjqttm-7/. 2024-04-16T17:46:52.083 DEBUG:boto:Method: GET 2024-04-16T17:46:52.083 DEBUG:boto:Path: /cjqttm-7/. 2024-04-16T17:46:52.083 DEBUG:boto:Data: 2024-04-16T17:46:52.083 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.083 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.083 DEBUG:boto:Params: {} 2024-04-16T17:46:52.083 DEBUG:boto:Token: None 2024-04-16T17:46:52.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/. 2024-04-16T17:46:52.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FJhbJg6EscITwkrrI3lM8CAJ6Hs= 2024-04-16T17:46:52.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FJhbJg6EscITwkrrI3lM8CAJ6Hs=', 'Content-Length': '0'} 2024-04-16T17:46:52.086 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e2c26764071dc9a3-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.086 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.086 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.086 DEBUG:boto:path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.086 DEBUG:boto:auth_path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.086 DEBUG:boto:Method: GET 2024-04-16T17:46:52.087 DEBUG:boto:Path: /cjqttm-7/?prefix=. 2024-04-16T17:46:52.087 DEBUG:boto:Data: 2024-04-16T17:46:52.087 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.087 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.087 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.087 DEBUG:boto:Params: {} 2024-04-16T17:46:52.087 DEBUG:boto:Token: None 2024-04-16T17:46:52.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.090 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042b582ac2a5714bd-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.090 DEBUG:boto:b'cjqttm-7.1000false.2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.090 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.091 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.091 DEBUG:boto:path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.091 DEBUG:boto:auth_path=/cjqttm-7/?prefix=. 2024-04-16T17:46:52.091 DEBUG:boto:Method: GET 2024-04-16T17:46:52.091 DEBUG:boto:Path: /cjqttm-7/?prefix=. 2024-04-16T17:46:52.091 DEBUG:boto:Data: 2024-04-16T17:46:52.091 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.091 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.091 DEBUG:boto:Params: {} 2024-04-16T17:46:52.092 DEBUG:boto:Token: None 2024-04-16T17:46:52.092 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000935a0bd32c16c6ad-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.094 DEBUG:boto:b'cjqttm-7.1000false.2024-04-16T17:46:45.965Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.095 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-16T17:46:52.095 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.095 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.095 DEBUG:boto:path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.095 DEBUG:boto:auth_path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.095 DEBUG:boto:Method: GET 2024-04-16T17:46:52.096 DEBUG:boto:Path: /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.096 DEBUG:boto:Data: 2024-04-16T17:46:52.096 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.096 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.096 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.096 DEBUG:boto:Params: {} 2024-04-16T17:46:52.096 DEBUG:boto:Token: None 2024-04-16T17:46:52.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA= 2024-04-16T17:46:52.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA=', 'Content-Length': '0'} 2024-04-16T17:46:52.099 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006f2b49f1c95bf03a-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.099 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.099 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.099 DEBUG:boto:path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.099 DEBUG:boto:auth_path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.099 DEBUG:boto:Method: GET 2024-04-16T17:46:52.100 DEBUG:boto:Path: /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.100 DEBUG:boto:Data: 2024-04-16T17:46:52.100 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.100 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.100 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.100 DEBUG:boto:Params: {} 2024-04-16T17:46:52.100 DEBUG:boto:Token: None 2024-04-16T17:46:52.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA= 2024-04-16T17:46:52.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA=', 'Content-Length': '0'} 2024-04-16T17:46:52.102 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c29420060b37abcf-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.102 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.103 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.103 DEBUG:boto:path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.103 DEBUG:boto:auth_path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.103 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.103 DEBUG:boto:Path: /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.103 DEBUG:boto:Data: 2024-04-16T17:46:52.103 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.103 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.103 DEBUG:boto:Params: {} 2024-04-16T17:46:52.104 DEBUG:boto:Token: None 2024-04-16T17:46:52.104 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZerWzplhh/orFn8LZyQ9vst6U2o= 2024-04-16T17:46:52.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZerWzplhh/orFn8LZyQ9vst6U2o=', 'Content-Length': '0'} 2024-04-16T17:46:52.105 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000f3c3e873b69794c-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.106 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.106 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.106 DEBUG:boto:path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.106 DEBUG:boto:auth_path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.106 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.106 DEBUG:boto:Path: /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.106 DEBUG:boto:Data: 2024-04-16T17:46:52.106 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.107 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.107 DEBUG:boto:Params: {} 2024-04-16T17:46:52.107 DEBUG:boto:Token: None 2024-04-16T17:46:52.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZerWzplhh/orFn8LZyQ9vst6U2o= 2024-04-16T17:46:52.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZerWzplhh/orFn8LZyQ9vst6U2o=', 'Content-Length': '0'} 2024-04-16T17:46:52.109 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009fa21a5098557db3-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-16T17:46:52.109 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.109 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.109 DEBUG:boto:path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.109 DEBUG:boto:auth_path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.110 DEBUG:boto:Method: GET 2024-04-16T17:46:52.110 DEBUG:boto:Path: /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.110 DEBUG:boto:Data: 2024-04-16T17:46:52.110 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.110 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.110 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.110 DEBUG:boto:Params: {} 2024-04-16T17:46:52.110 DEBUG:boto:Token: None 2024-04-16T17:46:52.110 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.110 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA= 2024-04-16T17:46:52.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA=', 'Content-Length': '0'} 2024-04-16T17:46:52.112 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a5d0ccca472947a9-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.113 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.113 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.113 DEBUG:boto:path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.113 DEBUG:boto:auth_path=/cjqttm-7/..?versionId=null 2024-04-16T17:46:52.113 DEBUG:boto:Method: GET 2024-04-16T17:46:52.113 DEBUG:boto:Path: /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.113 DEBUG:boto:Data: 2024-04-16T17:46:52.113 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.113 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.113 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.113 DEBUG:boto:Params: {} 2024-04-16T17:46:52.113 DEBUG:boto:Token: None 2024-04-16T17:46:52.114 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/..?versionId=null 2024-04-16T17:46:52.114 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA= 2024-04-16T17:46:52.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gZk+w1uarbvXzjZ+mhztkztYEeA=', 'Content-Length': '0'} 2024-04-16T17:46:52.115 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005aee899c5960409b-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.158 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.159 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.159 DEBUG:boto:path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.159 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.159 DEBUG:boto:Method: GET 2024-04-16T17:46:52.159 DEBUG:boto:Path: /cjqttm-7/?prefix=.. 2024-04-16T17:46:52.159 DEBUG:boto:Data: 2024-04-16T17:46:52.159 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.159 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.159 DEBUG:boto:Params: {} 2024-04-16T17:46:52.159 DEBUG:boto:Token: None 2024-04-16T17:46:52.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef778a1ee43f91ba-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.162 DEBUG:boto:b'cjqttm-7..1000false..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.163 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.163 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.163 DEBUG:boto:path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.163 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.163 DEBUG:boto:Method: GET 2024-04-16T17:46:52.163 DEBUG:boto:Path: /cjqttm-7/?prefix=.. 2024-04-16T17:46:52.163 DEBUG:boto:Data: 2024-04-16T17:46:52.163 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.163 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.164 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.164 DEBUG:boto:Params: {} 2024-04-16T17:46:52.164 DEBUG:boto:Token: None 2024-04-16T17:46:52.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bef2a5acdcee3c0f-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.166 DEBUG:boto:b'cjqttm-7..1000false..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.167 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.167 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.167 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.167 DEBUG:boto:Path: /cjqttm-7/.. 2024-04-16T17:46:52.167 DEBUG:boto:Data: 2024-04-16T17:46:52.167 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.167 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.168 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.168 DEBUG:boto:Params: {} 2024-04-16T17:46:52.168 DEBUG:boto:Token: None 2024-04-16T17:46:52.168 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.. 2024-04-16T17:46:52.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dTmOu5wFT6hda9rQa3czPmdBEkM= 2024-04-16T17:46:52.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dTmOu5wFT6hda9rQa3czPmdBEkM=', 'Content-Length': '0'} 2024-04-16T17:46:52.170 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a7d475563b80e18-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.170 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.170 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.170 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.170 DEBUG:boto:Path: /cjqttm-7/.. 2024-04-16T17:46:52.170 DEBUG:boto:Data: 2024-04-16T17:46:52.170 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.171 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.171 DEBUG:boto:Params: {} 2024-04-16T17:46:52.171 DEBUG:boto:Token: None 2024-04-16T17:46:52.171 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.. 2024-04-16T17:46:52.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dTmOu5wFT6hda9rQa3czPmdBEkM= 2024-04-16T17:46:52.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dTmOu5wFT6hda9rQa3czPmdBEkM=', 'Content-Length': '0'} 2024-04-16T17:46:52.173 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005c55d0509a690fb9-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.173 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-16T17:46:52.173 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.173 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.174 DEBUG:boto:Method: GET 2024-04-16T17:46:52.174 DEBUG:boto:Path: /cjqttm-7/.. 2024-04-16T17:46:52.174 DEBUG:boto:Data: 2024-04-16T17:46:52.174 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.174 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.174 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.174 DEBUG:boto:Params: {} 2024-04-16T17:46:52.174 DEBUG:boto:Token: None 2024-04-16T17:46:52.174 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.. 2024-04-16T17:46:52.174 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E0+pVPS/Gj9fynkyf3edvL27kDo= 2024-04-16T17:46:52.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E0+pVPS/Gj9fynkyf3edvL27kDo=', 'Content-Length': '0'} 2024-04-16T17:46:52.176 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007618cf75d5571b7d-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.218 DEBUG:boto:path=/cjqttm-7/.. 2024-04-16T17:46:52.219 DEBUG:boto:auth_path=/cjqttm-7/.. 2024-04-16T17:46:52.219 DEBUG:boto:Method: GET 2024-04-16T17:46:52.219 DEBUG:boto:Path: /cjqttm-7/.. 2024-04-16T17:46:52.219 DEBUG:boto:Data: 2024-04-16T17:46:52.219 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.219 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.219 DEBUG:boto:Params: {} 2024-04-16T17:46:52.219 DEBUG:boto:Token: None 2024-04-16T17:46:52.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.. 2024-04-16T17:46:52.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E0+pVPS/Gj9fynkyf3edvL27kDo= 2024-04-16T17:46:52.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E0+pVPS/Gj9fynkyf3edvL27kDo=', 'Content-Length': '0'} 2024-04-16T17:46:52.222 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000422294534fe6a36c-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.222 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.222 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.222 DEBUG:boto:path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.222 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.222 DEBUG:boto:Method: GET 2024-04-16T17:46:52.223 DEBUG:boto:Path: /cjqttm-7/?prefix=.. 2024-04-16T17:46:52.223 DEBUG:boto:Data: 2024-04-16T17:46:52.223 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.223 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.223 DEBUG:boto:Params: {} 2024-04-16T17:46:52.223 DEBUG:boto:Token: None 2024-04-16T17:46:52.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.226 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005f43818314cc6b1-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.226 DEBUG:boto:b'cjqttm-7..1000false..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.227 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.227 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.227 DEBUG:boto:path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.227 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.. 2024-04-16T17:46:52.227 DEBUG:boto:Method: GET 2024-04-16T17:46:52.227 DEBUG:boto:Path: /cjqttm-7/?prefix=.. 2024-04-16T17:46:52.227 DEBUG:boto:Data: 2024-04-16T17:46:52.227 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.227 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.228 DEBUG:boto:Params: {} 2024-04-16T17:46:52.228 DEBUG:boto:Token: None 2024-04-16T17:46:52.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.230 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000748e5d9f0b112cc2-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.230 DEBUG:boto:b'cjqttm-7..1000false..2024-04-16T17:46:46.016Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.231 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-16T17:46:52.231 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.231 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.231 DEBUG:boto:path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.231 DEBUG:boto:auth_path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.231 DEBUG:boto:Method: GET 2024-04-16T17:46:52.231 DEBUG:boto:Path: /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.231 DEBUG:boto:Data: 2024-04-16T17:46:52.231 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.232 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.232 DEBUG:boto:Params: {} 2024-04-16T17:46:52.232 DEBUG:boto:Token: None 2024-04-16T17:46:52.232 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo= 2024-04-16T17:46:52.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo=', 'Content-Length': '0'} 2024-04-16T17:46:52.234 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000293d550ece41af49-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.235 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.235 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.235 DEBUG:boto:path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.235 DEBUG:boto:auth_path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.235 DEBUG:boto:Method: GET 2024-04-16T17:46:52.235 DEBUG:boto:Path: /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.235 DEBUG:boto:Data: 2024-04-16T17:46:52.235 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.235 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.236 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.236 DEBUG:boto:Params: {} 2024-04-16T17:46:52.236 DEBUG:boto:Token: None 2024-04-16T17:46:52.236 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo= 2024-04-16T17:46:52.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo=', 'Content-Length': '0'} 2024-04-16T17:46:52.238 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009b07daec554eb86d-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.278 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.278 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.278 DEBUG:boto:path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.279 DEBUG:boto:auth_path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.279 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.279 DEBUG:boto:Path: /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.279 DEBUG:boto:Data: 2024-04-16T17:46:52.279 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.279 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.279 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.279 DEBUG:boto:Params: {} 2024-04-16T17:46:52.279 DEBUG:boto:Token: None 2024-04-16T17:46:52.279 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FROh5rYfNrN4DdOwC2QavuA6f+Q= 2024-04-16T17:46:52.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FROh5rYfNrN4DdOwC2QavuA6f+Q=', 'Content-Length': '0'} 2024-04-16T17:46:52.281 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a413bc0406ed1aa5-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.282 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.282 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.282 DEBUG:boto:path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.282 DEBUG:boto:auth_path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.282 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.282 DEBUG:boto:Path: /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.282 DEBUG:boto:Data: 2024-04-16T17:46:52.282 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.283 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.283 DEBUG:boto:Params: {} 2024-04-16T17:46:52.283 DEBUG:boto:Token: None 2024-04-16T17:46:52.283 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FROh5rYfNrN4DdOwC2QavuA6f+Q= 2024-04-16T17:46:52.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FROh5rYfNrN4DdOwC2QavuA6f+Q=', 'Content-Length': '0'} 2024-04-16T17:46:52.285 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008af234de1b133c3c-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-16T17:46:52.286 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.286 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.286 DEBUG:boto:path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.286 DEBUG:boto:auth_path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.286 DEBUG:boto:Method: GET 2024-04-16T17:46:52.286 DEBUG:boto:Path: /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.286 DEBUG:boto:Data: 2024-04-16T17:46:52.286 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.286 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.286 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.286 DEBUG:boto:Params: {} 2024-04-16T17:46:52.287 DEBUG:boto:Token: None 2024-04-16T17:46:52.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo= 2024-04-16T17:46:52.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo=', 'Content-Length': '0'} 2024-04-16T17:46:52.289 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002bba8bc9997534e5-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.289 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.289 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.289 DEBUG:boto:path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.289 DEBUG:boto:auth_path=/cjqttm-7/...?versionId=null 2024-04-16T17:46:52.289 DEBUG:boto:Method: GET 2024-04-16T17:46:52.289 DEBUG:boto:Path: /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.290 DEBUG:boto:Data: 2024-04-16T17:46:52.290 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.290 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.290 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.290 DEBUG:boto:Params: {} 2024-04-16T17:46:52.290 DEBUG:boto:Token: None 2024-04-16T17:46:52.290 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/...?versionId=null 2024-04-16T17:46:52.290 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo= 2024-04-16T17:46:52.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5XpuCJpZYrZNb1sC5mVOeHyQBo=', 'Content-Length': '0'} 2024-04-16T17:46:52.292 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cbd8687a2a0802d8-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.293 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.293 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.293 DEBUG:boto:path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.293 DEBUG:boto:auth_path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.293 DEBUG:boto:Method: GET 2024-04-16T17:46:52.293 DEBUG:boto:Path: /cjqttm-7/?prefix=... 2024-04-16T17:46:52.293 DEBUG:boto:Data: 2024-04-16T17:46:52.293 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.293 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.293 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.293 DEBUG:boto:Params: {} 2024-04-16T17:46:52.294 DEBUG:boto:Token: None 2024-04-16T17:46:52.294 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.294 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025e69a7f75b89187-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.297 DEBUG:boto:b'cjqttm-7...1000false...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.297 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.297 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.297 DEBUG:boto:path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.297 DEBUG:boto:auth_path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.297 DEBUG:boto:Method: GET 2024-04-16T17:46:52.297 DEBUG:boto:Path: /cjqttm-7/?prefix=... 2024-04-16T17:46:52.297 DEBUG:boto:Data: 2024-04-16T17:46:52.298 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.298 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.298 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.298 DEBUG:boto:Params: {} 2024-04-16T17:46:52.298 DEBUG:boto:Token: None 2024-04-16T17:46:52.298 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.298 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.300 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8f09a96f4aaaf20-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.301 DEBUG:boto:b'cjqttm-7...1000false...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.301 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.301 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.301 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.301 DEBUG:boto:Path: /cjqttm-7/... 2024-04-16T17:46:52.301 DEBUG:boto:Data: 2024-04-16T17:46:52.302 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.302 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.302 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.302 DEBUG:boto:Params: {} 2024-04-16T17:46:52.302 DEBUG:boto:Token: None 2024-04-16T17:46:52.302 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/... 2024-04-16T17:46:52.302 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aBXUbdg7L3KWSl3afMc8Kju7eYM= 2024-04-16T17:46:52.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aBXUbdg7L3KWSl3afMc8Kju7eYM=', 'Content-Length': '0'} 2024-04-16T17:46:52.304 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e6ee8e6bd3d9ec95-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.304 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.304 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.304 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.305 DEBUG:boto:Path: /cjqttm-7/... 2024-04-16T17:46:52.305 DEBUG:boto:Data: 2024-04-16T17:46:52.305 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.305 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.305 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.305 DEBUG:boto:Params: {} 2024-04-16T17:46:52.305 DEBUG:boto:Token: None 2024-04-16T17:46:52.305 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/... 2024-04-16T17:46:52.305 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aBXUbdg7L3KWSl3afMc8Kju7eYM= 2024-04-16T17:46:52.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aBXUbdg7L3KWSl3afMc8Kju7eYM=', 'Content-Length': '0'} 2024-04-16T17:46:52.307 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e3f8d540bb11621e-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.307 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-16T17:46:52.307 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.307 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.307 DEBUG:boto:Method: GET 2024-04-16T17:46:52.308 DEBUG:boto:Path: /cjqttm-7/... 2024-04-16T17:46:52.308 DEBUG:boto:Data: 2024-04-16T17:46:52.308 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.308 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.308 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.308 DEBUG:boto:Params: {} 2024-04-16T17:46:52.308 DEBUG:boto:Token: None 2024-04-16T17:46:52.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/... 2024-04-16T17:46:52.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HFd3JRaPQVl9X3TnBlmw+8BXad8= 2024-04-16T17:46:52.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HFd3JRaPQVl9X3TnBlmw+8BXad8=', 'Content-Length': '0'} 2024-04-16T17:46:52.310 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dda0d1ee5bed2e43-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.310 DEBUG:boto:path=/cjqttm-7/... 2024-04-16T17:46:52.311 DEBUG:boto:auth_path=/cjqttm-7/... 2024-04-16T17:46:52.311 DEBUG:boto:Method: GET 2024-04-16T17:46:52.311 DEBUG:boto:Path: /cjqttm-7/... 2024-04-16T17:46:52.311 DEBUG:boto:Data: 2024-04-16T17:46:52.311 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.311 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.311 DEBUG:boto:Params: {} 2024-04-16T17:46:52.311 DEBUG:boto:Token: None 2024-04-16T17:46:52.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/... 2024-04-16T17:46:52.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HFd3JRaPQVl9X3TnBlmw+8BXad8= 2024-04-16T17:46:52.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HFd3JRaPQVl9X3TnBlmw+8BXad8=', 'Content-Length': '0'} 2024-04-16T17:46:52.313 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e4c9340a97ce2758-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.314 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.314 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.314 DEBUG:boto:path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.314 DEBUG:boto:auth_path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.314 DEBUG:boto:Method: GET 2024-04-16T17:46:52.314 DEBUG:boto:Path: /cjqttm-7/?prefix=... 2024-04-16T17:46:52.314 DEBUG:boto:Data: 2024-04-16T17:46:52.314 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.315 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.315 DEBUG:boto:Params: {} 2024-04-16T17:46:52.315 DEBUG:boto:Token: None 2024-04-16T17:46:52.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c449707b51ccce61-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.318 DEBUG:boto:b'cjqttm-7...1000false...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.318 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.318 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.318 DEBUG:boto:path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.318 DEBUG:boto:auth_path=/cjqttm-7/?prefix=... 2024-04-16T17:46:52.318 DEBUG:boto:Method: GET 2024-04-16T17:46:52.319 DEBUG:boto:Path: /cjqttm-7/?prefix=... 2024-04-16T17:46:52.319 DEBUG:boto:Data: 2024-04-16T17:46:52.319 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.319 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.319 DEBUG:boto:Params: {} 2024-04-16T17:46:52.319 DEBUG:boto:Token: None 2024-04-16T17:46:52.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.321 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec502b03d5333fb0-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.322 DEBUG:boto:b'cjqttm-7...1000false...2024-04-16T17:46:46.027Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.322 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-16T17:46:52.322 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.322 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.322 DEBUG:boto:path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.323 DEBUG:boto:auth_path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.323 DEBUG:boto:Method: GET 2024-04-16T17:46:52.323 DEBUG:boto:Path: /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.323 DEBUG:boto:Data: 2024-04-16T17:46:52.323 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.323 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.323 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.323 DEBUG:boto:Params: {} 2024-04-16T17:46:52.323 DEBUG:boto:Token: None 2024-04-16T17:46:52.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI= 2024-04-16T17:46:52.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI=', 'Content-Length': '0'} 2024-04-16T17:46:52.326 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009c136f480f926e72-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.326 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.326 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.326 DEBUG:boto:path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.326 DEBUG:boto:auth_path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.326 DEBUG:boto:Method: GET 2024-04-16T17:46:52.326 DEBUG:boto:Path: /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.327 DEBUG:boto:Data: 2024-04-16T17:46:52.327 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.327 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.327 DEBUG:boto:Params: {} 2024-04-16T17:46:52.327 DEBUG:boto:Token: None 2024-04-16T17:46:52.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI= 2024-04-16T17:46:52.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI=', 'Content-Length': '0'} 2024-04-16T17:46:52.329 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cf5ef0098649a471-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.330 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.330 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.330 DEBUG:boto:path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.330 DEBUG:boto:auth_path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.330 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.330 DEBUG:boto:Path: /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.330 DEBUG:boto:Data: 2024-04-16T17:46:52.330 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.330 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.330 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.331 DEBUG:boto:Params: {} 2024-04-16T17:46:52.331 DEBUG:boto:Token: None 2024-04-16T17:46:52.331 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TvM4fU3L9ILHq+rU04+dVZXQzdU= 2024-04-16T17:46:52.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TvM4fU3L9ILHq+rU04+dVZXQzdU=', 'Content-Length': '0'} 2024-04-16T17:46:52.333 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e55cb7753eb1a438-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.333 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.333 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.334 DEBUG:boto:path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.334 DEBUG:boto:auth_path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.334 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.334 DEBUG:boto:Path: /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.334 DEBUG:boto:Data: 2024-04-16T17:46:52.334 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.334 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.334 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.334 DEBUG:boto:Params: {} 2024-04-16T17:46:52.334 DEBUG:boto:Token: None 2024-04-16T17:46:52.334 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TvM4fU3L9ILHq+rU04+dVZXQzdU= 2024-04-16T17:46:52.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TvM4fU3L9ILHq+rU04+dVZXQzdU=', 'Content-Length': '0'} 2024-04-16T17:46:52.336 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000054d6acbae072fcac-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-16T17:46:52.337 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.337 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.337 DEBUG:boto:path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.337 DEBUG:boto:auth_path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.337 DEBUG:boto:Method: GET 2024-04-16T17:46:52.337 DEBUG:boto:Path: /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.337 DEBUG:boto:Data: 2024-04-16T17:46:52.337 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.337 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.337 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.337 DEBUG:boto:Params: {} 2024-04-16T17:46:52.337 DEBUG:boto:Token: None 2024-04-16T17:46:52.338 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.338 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI= 2024-04-16T17:46:52.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI=', 'Content-Length': '0'} 2024-04-16T17:46:52.340 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e1ed7fbbd7125dc-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.340 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.340 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.340 DEBUG:boto:path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.341 DEBUG:boto:auth_path=/cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.341 DEBUG:boto:Method: GET 2024-04-16T17:46:52.341 DEBUG:boto:Path: /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.341 DEBUG:boto:Data: 2024-04-16T17:46:52.341 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.341 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.341 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.341 DEBUG:boto:Params: {} 2024-04-16T17:46:52.341 DEBUG:boto:Token: None 2024-04-16T17:46:52.342 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o?versionId=null 2024-04-16T17:46:52.342 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI= 2024-04-16T17:46:52.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FBBBzVCzzh7kJKtc0/T5UocUGvI=', 'Content-Length': '0'} 2024-04-16T17:46:52.344 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000015dca1da3899f0bc-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.344 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.344 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.344 DEBUG:boto:path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.344 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.345 DEBUG:boto:Method: GET 2024-04-16T17:46:52.345 DEBUG:boto:Path: /cjqttm-7/?prefix=.o 2024-04-16T17:46:52.345 DEBUG:boto:Data: 2024-04-16T17:46:52.345 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.345 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.345 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.345 DEBUG:boto:Params: {} 2024-04-16T17:46:52.345 DEBUG:boto:Token: None 2024-04-16T17:46:52.345 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.345 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008202cab9828dd705-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.348 DEBUG:boto:b'cjqttm-7.o1000false.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.349 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.349 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.349 DEBUG:boto:path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.349 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.349 DEBUG:boto:Method: GET 2024-04-16T17:46:52.349 DEBUG:boto:Path: /cjqttm-7/?prefix=.o 2024-04-16T17:46:52.349 DEBUG:boto:Data: 2024-04-16T17:46:52.349 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.349 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.349 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.349 DEBUG:boto:Params: {} 2024-04-16T17:46:52.350 DEBUG:boto:Token: None 2024-04-16T17:46:52.350 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.352 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bb60b668a7719fa-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.353 DEBUG:boto:b'cjqttm-7.o1000false.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.353 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.353 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.353 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.353 DEBUG:boto:Path: /cjqttm-7/.o 2024-04-16T17:46:52.353 DEBUG:boto:Data: 2024-04-16T17:46:52.353 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.354 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.354 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.354 DEBUG:boto:Params: {} 2024-04-16T17:46:52.354 DEBUG:boto:Token: None 2024-04-16T17:46:52.354 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o 2024-04-16T17:46:52.354 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a/y0+GtW3tt6Es665AGmHSVbc90= 2024-04-16T17:46:52.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a/y0+GtW3tt6Es665AGmHSVbc90=', 'Content-Length': '0'} 2024-04-16T17:46:52.356 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000081fc00cc0742efd7-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.356 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.356 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.356 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.356 DEBUG:boto:Path: /cjqttm-7/.o 2024-04-16T17:46:52.356 DEBUG:boto:Data: 2024-04-16T17:46:52.357 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.357 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.357 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.357 DEBUG:boto:Params: {} 2024-04-16T17:46:52.357 DEBUG:boto:Token: None 2024-04-16T17:46:52.357 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o 2024-04-16T17:46:52.357 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a/y0+GtW3tt6Es665AGmHSVbc90= 2024-04-16T17:46:52.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a/y0+GtW3tt6Es665AGmHSVbc90=', 'Content-Length': '0'} 2024-04-16T17:46:52.359 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dfd40f153707d2cb-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.359 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-16T17:46:52.359 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.359 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.360 DEBUG:boto:Method: GET 2024-04-16T17:46:52.360 DEBUG:boto:Path: /cjqttm-7/.o 2024-04-16T17:46:52.360 DEBUG:boto:Data: 2024-04-16T17:46:52.360 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.360 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.360 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.360 DEBUG:boto:Params: {} 2024-04-16T17:46:52.360 DEBUG:boto:Token: None 2024-04-16T17:46:52.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o 2024-04-16T17:46:52.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OqzaRdX4aASaDYT3vtgrZNKQPE4= 2024-04-16T17:46:52.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OqzaRdX4aASaDYT3vtgrZNKQPE4=', 'Content-Length': '0'} 2024-04-16T17:46:52.362 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d0e6ee490eb3a2de-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.410 DEBUG:boto:path=/cjqttm-7/.o 2024-04-16T17:46:52.414 DEBUG:boto:auth_path=/cjqttm-7/.o 2024-04-16T17:46:52.414 DEBUG:boto:Method: GET 2024-04-16T17:46:52.414 DEBUG:boto:Path: /cjqttm-7/.o 2024-04-16T17:46:52.414 DEBUG:boto:Data: 2024-04-16T17:46:52.414 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.414 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.414 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.414 DEBUG:boto:Params: {} 2024-04-16T17:46:52.415 DEBUG:boto:Token: None 2024-04-16T17:46:52.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o 2024-04-16T17:46:52.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OqzaRdX4aASaDYT3vtgrZNKQPE4= 2024-04-16T17:46:52.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OqzaRdX4aASaDYT3vtgrZNKQPE4=', 'Content-Length': '0'} 2024-04-16T17:46:52.416 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005523d42ff1f143cd-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.417 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.417 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.417 DEBUG:boto:path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.417 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.417 DEBUG:boto:Method: GET 2024-04-16T17:46:52.417 DEBUG:boto:Path: /cjqttm-7/?prefix=.o 2024-04-16T17:46:52.417 DEBUG:boto:Data: 2024-04-16T17:46:52.418 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.418 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.418 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.418 DEBUG:boto:Params: {} 2024-04-16T17:46:52.418 DEBUG:boto:Token: None 2024-04-16T17:46:52.418 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.418 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f73f8846fb30c4e-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.421 DEBUG:boto:b'cjqttm-7.o1000false.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.421 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.422 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.422 DEBUG:boto:path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.422 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o 2024-04-16T17:46:52.422 DEBUG:boto:Method: GET 2024-04-16T17:46:52.422 DEBUG:boto:Path: /cjqttm-7/?prefix=.o 2024-04-16T17:46:52.422 DEBUG:boto:Data: 2024-04-16T17:46:52.422 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.422 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.422 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.422 DEBUG:boto:Params: {} 2024-04-16T17:46:52.423 DEBUG:boto:Token: None 2024-04-16T17:46:52.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f19bc2050b526e68-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.426 DEBUG:boto:b'cjqttm-7.o1000false.o2024-04-16T17:46:46.036Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.426 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-16T17:46:52.426 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.426 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.426 DEBUG:boto:path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.426 DEBUG:boto:auth_path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.427 DEBUG:boto:Method: GET 2024-04-16T17:46:52.427 DEBUG:boto:Path: /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.427 DEBUG:boto:Data: 2024-04-16T17:46:52.427 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.427 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.427 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.427 DEBUG:boto:Params: {} 2024-04-16T17:46:52.427 DEBUG:boto:Token: None 2024-04-16T17:46:52.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc= 2024-04-16T17:46:52.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc=', 'Content-Length': '0'} 2024-04-16T17:46:52.430 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f826562b59514b7-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.430 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.430 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.431 DEBUG:boto:path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.431 DEBUG:boto:auth_path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.431 DEBUG:boto:Method: GET 2024-04-16T17:46:52.431 DEBUG:boto:Path: /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.431 DEBUG:boto:Data: 2024-04-16T17:46:52.431 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.431 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.431 DEBUG:boto:Params: {} 2024-04-16T17:46:52.431 DEBUG:boto:Token: None 2024-04-16T17:46:52.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc= 2024-04-16T17:46:52.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc=', 'Content-Length': '0'} 2024-04-16T17:46:52.434 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e5525ec67052b63d-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.434 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.434 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.434 DEBUG:boto:path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.434 DEBUG:boto:auth_path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.434 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.435 DEBUG:boto:Path: /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.435 DEBUG:boto:Data: 2024-04-16T17:46:52.435 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.435 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.435 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.435 DEBUG:boto:Params: {} 2024-04-16T17:46:52.435 DEBUG:boto:Token: None 2024-04-16T17:46:52.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aVSGuUzTVtLG79aB8pWv87JuoF8= 2024-04-16T17:46:52.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aVSGuUzTVtLG79aB8pWv87JuoF8=', 'Content-Length': '0'} 2024-04-16T17:46:52.437 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008caaa55a7bf3777d-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.438 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.438 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.438 DEBUG:boto:path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.438 DEBUG:boto:auth_path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.438 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.438 DEBUG:boto:Path: /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.438 DEBUG:boto:Data: 2024-04-16T17:46:52.438 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.438 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.439 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.439 DEBUG:boto:Params: {} 2024-04-16T17:46:52.439 DEBUG:boto:Token: None 2024-04-16T17:46:52.439 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aVSGuUzTVtLG79aB8pWv87JuoF8= 2024-04-16T17:46:52.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aVSGuUzTVtLG79aB8pWv87JuoF8=', 'Content-Length': '0'} 2024-04-16T17:46:52.441 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000063e00109ff4a1994-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.441 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-16T17:46:52.441 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.441 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.442 DEBUG:boto:path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.442 DEBUG:boto:auth_path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.442 DEBUG:boto:Method: GET 2024-04-16T17:46:52.442 DEBUG:boto:Path: /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.442 DEBUG:boto:Data: 2024-04-16T17:46:52.442 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.442 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.442 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.442 DEBUG:boto:Params: {} 2024-04-16T17:46:52.442 DEBUG:boto:Token: None 2024-04-16T17:46:52.442 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc= 2024-04-16T17:46:52.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc=', 'Content-Length': '0'} 2024-04-16T17:46:52.445 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d83b51e15c0f7df8-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.445 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.445 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.445 DEBUG:boto:path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.445 DEBUG:boto:auth_path=/cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.445 DEBUG:boto:Method: GET 2024-04-16T17:46:52.446 DEBUG:boto:Path: /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.446 DEBUG:boto:Data: 2024-04-16T17:46:52.446 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.446 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.446 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.446 DEBUG:boto:Params: {} 2024-04-16T17:46:52.446 DEBUG:boto:Token: None 2024-04-16T17:46:52.446 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o.?versionId=null 2024-04-16T17:46:52.446 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc= 2024-04-16T17:46:52.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jfieoSDl0QtWLvC8vPdAhj55OAc=', 'Content-Length': '0'} 2024-04-16T17:46:52.448 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b1575c77f794e5c8-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.448 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.448 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.449 DEBUG:boto:path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.449 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.449 DEBUG:boto:Method: GET 2024-04-16T17:46:52.449 DEBUG:boto:Path: /cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.449 DEBUG:boto:Data: 2024-04-16T17:46:52.449 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.449 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.449 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.449 DEBUG:boto:Params: {} 2024-04-16T17:46:52.449 DEBUG:boto:Token: None 2024-04-16T17:46:52.449 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.450 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.452 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bca038c48380565-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.453 DEBUG:boto:b'cjqttm-7.o.1000false.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.453 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.453 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.453 DEBUG:boto:path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.453 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.453 DEBUG:boto:Method: GET 2024-04-16T17:46:52.453 DEBUG:boto:Path: /cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.454 DEBUG:boto:Data: 2024-04-16T17:46:52.454 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.454 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.454 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.454 DEBUG:boto:Params: {} 2024-04-16T17:46:52.454 DEBUG:boto:Token: None 2024-04-16T17:46:52.454 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.454 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.457 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b09c400c81f3ab75-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.457 DEBUG:boto:b'cjqttm-7.o.1000false.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.457 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.457 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.457 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.457 DEBUG:boto:Path: /cjqttm-7/.o. 2024-04-16T17:46:52.458 DEBUG:boto:Data: 2024-04-16T17:46:52.458 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.458 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.458 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.458 DEBUG:boto:Params: {} 2024-04-16T17:46:52.458 DEBUG:boto:Token: None 2024-04-16T17:46:52.458 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o. 2024-04-16T17:46:52.458 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nycCoDBxgLwWISw/uEWMjL5ldXg= 2024-04-16T17:46:52.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nycCoDBxgLwWISw/uEWMjL5ldXg=', 'Content-Length': '0'} 2024-04-16T17:46:52.460 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008b2977c8f24ad563-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.461 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.461 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.461 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.461 DEBUG:boto:Path: /cjqttm-7/.o. 2024-04-16T17:46:52.461 DEBUG:boto:Data: 2024-04-16T17:46:52.461 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.461 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.461 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.461 DEBUG:boto:Params: {} 2024-04-16T17:46:52.461 DEBUG:boto:Token: None 2024-04-16T17:46:52.462 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o. 2024-04-16T17:46:52.462 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nycCoDBxgLwWISw/uEWMjL5ldXg= 2024-04-16T17:46:52.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nycCoDBxgLwWISw/uEWMjL5ldXg=', 'Content-Length': '0'} 2024-04-16T17:46:52.464 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eeeba1ada3dc4bdb-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.464 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-16T17:46:52.464 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.464 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.464 DEBUG:boto:Method: GET 2024-04-16T17:46:52.464 DEBUG:boto:Path: /cjqttm-7/.o. 2024-04-16T17:46:52.464 DEBUG:boto:Data: 2024-04-16T17:46:52.464 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.464 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.465 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.465 DEBUG:boto:Params: {} 2024-04-16T17:46:52.465 DEBUG:boto:Token: None 2024-04-16T17:46:52.465 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o. 2024-04-16T17:46:52.465 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hb44SlE8doIqiEzjT7B+6AX/2Ds= 2024-04-16T17:46:52.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hb44SlE8doIqiEzjT7B+6AX/2Ds=', 'Content-Length': '0'} 2024-04-16T17:46:52.467 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006b8d0cedc464fbb6-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.468 DEBUG:boto:path=/cjqttm-7/.o. 2024-04-16T17:46:52.468 DEBUG:boto:auth_path=/cjqttm-7/.o. 2024-04-16T17:46:52.468 DEBUG:boto:Method: GET 2024-04-16T17:46:52.468 DEBUG:boto:Path: /cjqttm-7/.o. 2024-04-16T17:46:52.468 DEBUG:boto:Data: 2024-04-16T17:46:52.468 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.468 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.468 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.468 DEBUG:boto:Params: {} 2024-04-16T17:46:52.468 DEBUG:boto:Token: None 2024-04-16T17:46:52.469 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/.o. 2024-04-16T17:46:52.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hb44SlE8doIqiEzjT7B+6AX/2Ds= 2024-04-16T17:46:52.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hb44SlE8doIqiEzjT7B+6AX/2Ds=', 'Content-Length': '0'} 2024-04-16T17:46:52.471 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000031e83b184362aa8-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.471 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.471 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.471 DEBUG:boto:path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.471 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.472 DEBUG:boto:Method: GET 2024-04-16T17:46:52.472 DEBUG:boto:Path: /cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.472 DEBUG:boto:Data: 2024-04-16T17:46:52.472 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.472 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.472 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.472 DEBUG:boto:Params: {} 2024-04-16T17:46:52.472 DEBUG:boto:Token: None 2024-04-16T17:46:52.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.475 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000056c4fa1160e89d28-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.518 DEBUG:boto:b'cjqttm-7.o.1000false.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.519 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.519 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.519 DEBUG:boto:path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.519 DEBUG:boto:auth_path=/cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.519 DEBUG:boto:Method: GET 2024-04-16T17:46:52.519 DEBUG:boto:Path: /cjqttm-7/?prefix=.o. 2024-04-16T17:46:52.519 DEBUG:boto:Data: 2024-04-16T17:46:52.519 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.519 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.519 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.519 DEBUG:boto:Params: {} 2024-04-16T17:46:52.520 DEBUG:boto:Token: None 2024-04-16T17:46:52.520 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd511eac3c28f956-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.523 DEBUG:boto:b'cjqttm-7.o.1000false.o.2024-04-16T17:46:46.084Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-16T17:46:52.523 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.523 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.523 DEBUG:boto:path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.523 DEBUG:boto:auth_path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.523 DEBUG:boto:Method: GET 2024-04-16T17:46:52.524 DEBUG:boto:Path: /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.524 DEBUG:boto:Data: 2024-04-16T17:46:52.524 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.524 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.524 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.524 DEBUG:boto:Params: {} 2024-04-16T17:46:52.524 DEBUG:boto:Token: None 2024-04-16T17:46:52.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk= 2024-04-16T17:46:52.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk=', 'Content-Length': '0'} 2024-04-16T17:46:52.526 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008664d981f476baf9-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.527 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.527 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.527 DEBUG:boto:path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.527 DEBUG:boto:auth_path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.527 DEBUG:boto:Method: GET 2024-04-16T17:46:52.527 DEBUG:boto:Path: /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.527 DEBUG:boto:Data: 2024-04-16T17:46:52.528 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.528 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.528 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.528 DEBUG:boto:Params: {} 2024-04-16T17:46:52.528 DEBUG:boto:Token: None 2024-04-16T17:46:52.528 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk= 2024-04-16T17:46:52.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk=', 'Content-Length': '0'} 2024-04-16T17:46:52.530 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e2845d98b62bd210-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.570 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.570 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.571 DEBUG:boto:path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.571 DEBUG:boto:auth_path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.571 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.571 DEBUG:boto:Path: /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.571 DEBUG:boto:Data: 2024-04-16T17:46:52.571 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.571 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.571 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.571 DEBUG:boto:Params: {} 2024-04-16T17:46:52.571 DEBUG:boto:Token: None 2024-04-16T17:46:52.571 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BEFgkzNRu2ecEcuw2oZpjy584Pg= 2024-04-16T17:46:52.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BEFgkzNRu2ecEcuw2oZpjy584Pg=', 'Content-Length': '0'} 2024-04-16T17:46:52.574 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8101d6373b639d8-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.574 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.574 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.575 DEBUG:boto:path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.575 DEBUG:boto:auth_path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.575 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.575 DEBUG:boto:Path: /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.575 DEBUG:boto:Data: 2024-04-16T17:46:52.575 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.575 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.575 DEBUG:boto:Params: {} 2024-04-16T17:46:52.575 DEBUG:boto:Token: None 2024-04-16T17:46:52.575 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BEFgkzNRu2ecEcuw2oZpjy584Pg= 2024-04-16T17:46:52.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BEFgkzNRu2ecEcuw2oZpjy584Pg=', 'Content-Length': '0'} 2024-04-16T17:46:52.578 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005c26def787567f29-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.578 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-16T17:46:52.578 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.578 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.579 DEBUG:boto:path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.579 DEBUG:boto:auth_path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.579 DEBUG:boto:Method: GET 2024-04-16T17:46:52.579 DEBUG:boto:Path: /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.579 DEBUG:boto:Data: 2024-04-16T17:46:52.579 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.579 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.579 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.579 DEBUG:boto:Params: {} 2024-04-16T17:46:52.579 DEBUG:boto:Token: None 2024-04-16T17:46:52.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk= 2024-04-16T17:46:52.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk=', 'Content-Length': '0'} 2024-04-16T17:46:52.582 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000097cc6a05fb5a1efb-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.582 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.582 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.582 DEBUG:boto:path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.582 DEBUG:boto:auth_path=/cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.582 DEBUG:boto:Method: GET 2024-04-16T17:46:52.582 DEBUG:boto:Path: /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.582 DEBUG:boto:Data: 2024-04-16T17:46:52.583 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.583 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.583 DEBUG:boto:Params: {} 2024-04-16T17:46:52.583 DEBUG:boto:Token: None 2024-04-16T17:46:52.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A?versionId=null 2024-04-16T17:46:52.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk= 2024-04-16T17:46:52.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8tol9kEKCovWqzNHS5fChla8wWk=', 'Content-Length': '0'} 2024-04-16T17:46:52.585 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006813bf7cb0b3c27c-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.586 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.586 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.586 DEBUG:boto:path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.586 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.586 DEBUG:boto:Method: GET 2024-04-16T17:46:52.586 DEBUG:boto:Path: /cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.586 DEBUG:boto:Data: 2024-04-16T17:46:52.586 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.586 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.587 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.587 DEBUG:boto:Params: {} 2024-04-16T17:46:52.587 DEBUG:boto:Token: None 2024-04-16T17:46:52.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb4e354489e136cc-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.590 DEBUG:boto:b'cjqttm-7:1000false:2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.590 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.590 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.590 DEBUG:boto:path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.590 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.591 DEBUG:boto:Method: GET 2024-04-16T17:46:52.591 DEBUG:boto:Path: /cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.591 DEBUG:boto:Data: 2024-04-16T17:46:52.591 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.591 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.591 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.591 DEBUG:boto:Params: {} 2024-04-16T17:46:52.591 DEBUG:boto:Token: None 2024-04-16T17:46:52.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e72bbc48340352e-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.594 DEBUG:boto:b'cjqttm-7:1000false:2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.595 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.595 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.595 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.595 DEBUG:boto:Path: /cjqttm-7/%3A 2024-04-16T17:46:52.595 DEBUG:boto:Data: 2024-04-16T17:46:52.595 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.595 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.595 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.595 DEBUG:boto:Params: {} 2024-04-16T17:46:52.595 DEBUG:boto:Token: None 2024-04-16T17:46:52.596 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A 2024-04-16T17:46:52.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:00B17rM6MswCSqLtI2H4s6D6Gos= 2024-04-16T17:46:52.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:00B17rM6MswCSqLtI2H4s6D6Gos=', 'Content-Length': '0'} 2024-04-16T17:46:52.597 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000140da6cac84c6de6-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.598 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.598 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.598 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.598 DEBUG:boto:Path: /cjqttm-7/%3A 2024-04-16T17:46:52.598 DEBUG:boto:Data: 2024-04-16T17:46:52.598 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.598 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.598 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.598 DEBUG:boto:Params: {} 2024-04-16T17:46:52.599 DEBUG:boto:Token: None 2024-04-16T17:46:52.599 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A 2024-04-16T17:46:52.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:00B17rM6MswCSqLtI2H4s6D6Gos= 2024-04-16T17:46:52.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:00B17rM6MswCSqLtI2H4s6D6Gos=', 'Content-Length': '0'} 2024-04-16T17:46:52.600 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000596e0a69a924a2f8-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.601 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-16T17:46:52.601 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.601 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.601 DEBUG:boto:Method: GET 2024-04-16T17:46:52.601 DEBUG:boto:Path: /cjqttm-7/%3A 2024-04-16T17:46:52.601 DEBUG:boto:Data: 2024-04-16T17:46:52.601 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.601 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.602 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.602 DEBUG:boto:Params: {} 2024-04-16T17:46:52.602 DEBUG:boto:Token: None 2024-04-16T17:46:52.602 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A 2024-04-16T17:46:52.602 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BUUGkY7htl4MGZfY1RaitWCu6I= 2024-04-16T17:46:52.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BUUGkY7htl4MGZfY1RaitWCu6I=', 'Content-Length': '0'} 2024-04-16T17:46:52.604 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d1f2317a9f5764bf-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.604 DEBUG:boto:path=/cjqttm-7/%3A 2024-04-16T17:46:52.604 DEBUG:boto:auth_path=/cjqttm-7/%3A 2024-04-16T17:46:52.604 DEBUG:boto:Method: GET 2024-04-16T17:46:52.604 DEBUG:boto:Path: /cjqttm-7/%3A 2024-04-16T17:46:52.605 DEBUG:boto:Data: 2024-04-16T17:46:52.605 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.605 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.605 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.605 DEBUG:boto:Params: {} 2024-04-16T17:46:52.605 DEBUG:boto:Token: None 2024-04-16T17:46:52.605 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/%3A 2024-04-16T17:46:52.605 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BUUGkY7htl4MGZfY1RaitWCu6I= 2024-04-16T17:46:52.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BUUGkY7htl4MGZfY1RaitWCu6I=', 'Content-Length': '0'} 2024-04-16T17:46:52.607 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a7db0f919e541db-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.608 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.608 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.608 DEBUG:boto:path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.608 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.608 DEBUG:boto:Method: GET 2024-04-16T17:46:52.608 DEBUG:boto:Path: /cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.608 DEBUG:boto:Data: 2024-04-16T17:46:52.609 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.609 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.609 DEBUG:boto:Params: {} 2024-04-16T17:46:52.609 DEBUG:boto:Token: None 2024-04-16T17:46:52.609 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.609 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.612 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005fac3f714c42d40a-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.612 DEBUG:boto:b'cjqttm-7:1000false:2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.612 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.613 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.613 DEBUG:boto:path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.613 DEBUG:boto:auth_path=/cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.613 DEBUG:boto:Method: GET 2024-04-16T17:46:52.613 DEBUG:boto:Path: /cjqttm-7/?prefix=%3A 2024-04-16T17:46:52.613 DEBUG:boto:Data: 2024-04-16T17:46:52.613 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.613 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.613 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.613 DEBUG:boto:Params: {} 2024-04-16T17:46:52.613 DEBUG:boto:Token: None 2024-04-16T17:46:52.614 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.614 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f6181478757362e5-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.658 DEBUG:boto:b'cjqttm-7:1000false:2024-04-16T17:46:45.939Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.659 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-16T17:46:52.659 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.659 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.659 DEBUG:boto:path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.659 DEBUG:boto:auth_path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.659 DEBUG:boto:Method: GET 2024-04-16T17:46:52.659 DEBUG:boto:Path: /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.659 DEBUG:boto:Data: 2024-04-16T17:46:52.660 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.660 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.660 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.660 DEBUG:boto:Params: {} 2024-04-16T17:46:52.660 DEBUG:boto:Token: None 2024-04-16T17:46:52.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg= 2024-04-16T17:46:52.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg=', 'Content-Length': '0'} 2024-04-16T17:46:52.663 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a6453a987d01b152-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.663 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.663 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.664 DEBUG:boto:path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.664 DEBUG:boto:auth_path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.664 DEBUG:boto:Method: GET 2024-04-16T17:46:52.664 DEBUG:boto:Path: /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.664 DEBUG:boto:Data: 2024-04-16T17:46:52.664 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.664 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.664 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.664 DEBUG:boto:Params: {} 2024-04-16T17:46:52.664 DEBUG:boto:Token: None 2024-04-16T17:46:52.664 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.665 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg= 2024-04-16T17:46:52.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg=', 'Content-Length': '0'} 2024-04-16T17:46:52.667 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e659b81e7f2a92bb-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.667 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.667 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.667 DEBUG:boto:path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.667 DEBUG:boto:auth_path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.667 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.668 DEBUG:boto:Path: /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.668 DEBUG:boto:Data: 2024-04-16T17:46:52.668 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.668 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.668 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.668 DEBUG:boto:Params: {} 2024-04-16T17:46:52.668 DEBUG:boto:Token: None 2024-04-16T17:46:52.668 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j1wXrfdWD7M9NEJmHarX3Cxst3o= 2024-04-16T17:46:52.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j1wXrfdWD7M9NEJmHarX3Cxst3o=', 'Content-Length': '0'} 2024-04-16T17:46:52.670 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000016ef1b9dfc402ed8-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.671 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.671 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.671 DEBUG:boto:path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.671 DEBUG:boto:auth_path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.671 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.671 DEBUG:boto:Path: /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.671 DEBUG:boto:Data: 2024-04-16T17:46:52.671 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.671 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.672 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.672 DEBUG:boto:Params: {} 2024-04-16T17:46:52.672 DEBUG:boto:Token: None 2024-04-16T17:46:52.672 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.672 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j1wXrfdWD7M9NEJmHarX3Cxst3o= 2024-04-16T17:46:52.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j1wXrfdWD7M9NEJmHarX3Cxst3o=', 'Content-Length': '0'} 2024-04-16T17:46:52.674 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a2a7e4d06ea14827-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-16T17:46:52.675 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.675 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.675 DEBUG:boto:path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.675 DEBUG:boto:auth_path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.675 DEBUG:boto:Method: GET 2024-04-16T17:46:52.675 DEBUG:boto:Path: /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.675 DEBUG:boto:Data: 2024-04-16T17:46:52.675 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.675 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.675 DEBUG:boto:Params: {} 2024-04-16T17:46:52.676 DEBUG:boto:Token: None 2024-04-16T17:46:52.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg= 2024-04-16T17:46:52.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg=', 'Content-Length': '0'} 2024-04-16T17:46:52.678 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f61bc0fb57ca49c7-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.718 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.718 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.718 DEBUG:boto:path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.719 DEBUG:boto:auth_path=/cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.719 DEBUG:boto:Method: GET 2024-04-16T17:46:52.719 DEBUG:boto:Path: /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.719 DEBUG:boto:Data: 2024-04-16T17:46:52.719 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.719 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.719 DEBUG:boto:Params: {} 2024-04-16T17:46:52.719 DEBUG:boto:Token: None 2024-04-16T17:46:52.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj?versionId=null 2024-04-16T17:46:52.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg= 2024-04-16T17:46:52.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WJf9CEwbUu3vqhFJ/EvP76H/kmg=', 'Content-Length': '0'} 2024-04-16T17:46:52.722 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000166855fbde29277a-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.722 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.722 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.722 DEBUG:boto:path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.722 DEBUG:boto:auth_path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.723 DEBUG:boto:Method: GET 2024-04-16T17:46:52.723 DEBUG:boto:Path: /cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.723 DEBUG:boto:Data: 2024-04-16T17:46:52.723 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.723 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.723 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.723 DEBUG:boto:Params: {} 2024-04-16T17:46:52.723 DEBUG:boto:Token: None 2024-04-16T17:46:52.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000476c4a7c0f6c4bb3-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.726 DEBUG:boto:b'cjqttm-7_myobj1000false_myobj2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.726 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.726 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.727 DEBUG:boto:path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.727 DEBUG:boto:auth_path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.727 DEBUG:boto:Method: GET 2024-04-16T17:46:52.727 DEBUG:boto:Path: /cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.727 DEBUG:boto:Data: 2024-04-16T17:46:52.727 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.727 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.727 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.727 DEBUG:boto:Params: {} 2024-04-16T17:46:52.727 DEBUG:boto:Token: None 2024-04-16T17:46:52.727 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.730 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022a4dced60b5ca56-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.730 DEBUG:boto:b'cjqttm-7_myobj1000false_myobj2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.730 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.731 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.731 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.731 DEBUG:boto:Path: /cjqttm-7/_myobj 2024-04-16T17:46:52.731 DEBUG:boto:Data: 2024-04-16T17:46:52.731 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.731 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.731 DEBUG:boto:Params: {} 2024-04-16T17:46:52.731 DEBUG:boto:Token: None 2024-04-16T17:46:52.731 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj 2024-04-16T17:46:52.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rQ37yavKjqqMJqPIFu53aIp3oA8= 2024-04-16T17:46:52.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rQ37yavKjqqMJqPIFu53aIp3oA8=', 'Content-Length': '0'} 2024-04-16T17:46:52.734 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e523b78b0342ec5a-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.734 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.734 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.734 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.734 DEBUG:boto:Path: /cjqttm-7/_myobj 2024-04-16T17:46:52.734 DEBUG:boto:Data: 2024-04-16T17:46:52.734 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.734 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.734 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.735 DEBUG:boto:Params: {} 2024-04-16T17:46:52.735 DEBUG:boto:Token: None 2024-04-16T17:46:52.735 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj 2024-04-16T17:46:52.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rQ37yavKjqqMJqPIFu53aIp3oA8= 2024-04-16T17:46:52.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rQ37yavKjqqMJqPIFu53aIp3oA8=', 'Content-Length': '0'} 2024-04-16T17:46:52.737 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fb4206d3ea984924-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.737 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-16T17:46:52.738 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.738 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.738 DEBUG:boto:Method: GET 2024-04-16T17:46:52.738 DEBUG:boto:Path: /cjqttm-7/_myobj 2024-04-16T17:46:52.738 DEBUG:boto:Data: 2024-04-16T17:46:52.738 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.738 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.738 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.738 DEBUG:boto:Params: {} 2024-04-16T17:46:52.738 DEBUG:boto:Token: None 2024-04-16T17:46:52.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj 2024-04-16T17:46:52.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QboB30jXhIVqTu2bHfoZOGw1fP8= 2024-04-16T17:46:52.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QboB30jXhIVqTu2bHfoZOGw1fP8=', 'Content-Length': '0'} 2024-04-16T17:46:52.741 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007d44e88678ed6a3-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.741 DEBUG:boto:path=/cjqttm-7/_myobj 2024-04-16T17:46:52.741 DEBUG:boto:auth_path=/cjqttm-7/_myobj 2024-04-16T17:46:52.741 DEBUG:boto:Method: GET 2024-04-16T17:46:52.741 DEBUG:boto:Path: /cjqttm-7/_myobj 2024-04-16T17:46:52.741 DEBUG:boto:Data: 2024-04-16T17:46:52.741 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.741 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.742 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.742 DEBUG:boto:Params: {} 2024-04-16T17:46:52.742 DEBUG:boto:Token: None 2024-04-16T17:46:52.742 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/_myobj 2024-04-16T17:46:52.742 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QboB30jXhIVqTu2bHfoZOGw1fP8= 2024-04-16T17:46:52.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QboB30jXhIVqTu2bHfoZOGw1fP8=', 'Content-Length': '0'} 2024-04-16T17:46:52.744 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ee8b351cb06eb68e-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.744 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.744 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.744 DEBUG:boto:path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.744 DEBUG:boto:auth_path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.744 DEBUG:boto:Method: GET 2024-04-16T17:46:52.744 DEBUG:boto:Path: /cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.744 DEBUG:boto:Data: 2024-04-16T17:46:52.744 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.745 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.745 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.745 DEBUG:boto:Params: {} 2024-04-16T17:46:52.745 DEBUG:boto:Token: None 2024-04-16T17:46:52.745 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.745 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.748 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085b563aff8743591-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.748 DEBUG:boto:b'cjqttm-7_myobj1000false_myobj2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.748 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.749 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.749 DEBUG:boto:path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.749 DEBUG:boto:auth_path=/cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.749 DEBUG:boto:Method: GET 2024-04-16T17:46:52.749 DEBUG:boto:Path: /cjqttm-7/?prefix=_myobj 2024-04-16T17:46:52.749 DEBUG:boto:Data: 2024-04-16T17:46:52.749 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.749 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.749 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.749 DEBUG:boto:Params: {} 2024-04-16T17:46:52.749 DEBUG:boto:Token: None 2024-04-16T17:46:52.750 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.750 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.752 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb8297bf2769fb72-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.752 DEBUG:boto:b'cjqttm-7_myobj1000false_myobj2024-04-16T17:46:45.892Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.753 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:46:52.753 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.753 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.753 DEBUG:boto:path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.753 DEBUG:boto:auth_path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.753 DEBUG:boto:Method: GET 2024-04-16T17:46:52.753 DEBUG:boto:Path: /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.754 DEBUG:boto:Data: 2024-04-16T17:46:52.754 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.754 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.754 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.754 DEBUG:boto:Params: {} 2024-04-16T17:46:52.754 DEBUG:boto:Token: None 2024-04-16T17:46:52.754 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.754 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ= 2024-04-16T17:46:52.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ=', 'Content-Length': '0'} 2024-04-16T17:46:52.756 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000079b50b3a5315f37e-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.757 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.757 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.757 DEBUG:boto:path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.757 DEBUG:boto:auth_path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.757 DEBUG:boto:Method: GET 2024-04-16T17:46:52.757 DEBUG:boto:Path: /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.757 DEBUG:boto:Data: 2024-04-16T17:46:52.757 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.757 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.758 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.758 DEBUG:boto:Params: {} 2024-04-16T17:46:52.758 DEBUG:boto:Token: None 2024-04-16T17:46:52.758 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.758 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ= 2024-04-16T17:46:52.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ=', 'Content-Length': '0'} 2024-04-16T17:46:52.760 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d83935f447292474-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.761 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.761 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.761 DEBUG:boto:path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.761 DEBUG:boto:auth_path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.761 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.761 DEBUG:boto:Path: /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.761 DEBUG:boto:Data: 2024-04-16T17:46:52.761 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.761 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.761 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.762 DEBUG:boto:Params: {} 2024-04-16T17:46:52.762 DEBUG:boto:Token: None 2024-04-16T17:46:52.762 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.762 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T5pBIMcqfZz9VysdRv0+JVRHKdE= 2024-04-16T17:46:52.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T5pBIMcqfZz9VysdRv0+JVRHKdE=', 'Content-Length': '0'} 2024-04-16T17:46:52.764 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000080b1ab541e09d1d4-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.765 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.765 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.765 DEBUG:boto:path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.765 DEBUG:boto:auth_path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.765 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.765 DEBUG:boto:Path: /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.765 DEBUG:boto:Data: 2024-04-16T17:46:52.765 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.765 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.765 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.765 DEBUG:boto:Params: {} 2024-04-16T17:46:52.766 DEBUG:boto:Token: None 2024-04-16T17:46:52.766 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T5pBIMcqfZz9VysdRv0+JVRHKdE= 2024-04-16T17:46:52.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T5pBIMcqfZz9VysdRv0+JVRHKdE=', 'Content-Length': '0'} 2024-04-16T17:46:52.768 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fad4fc65febcfae8-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.768 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:46:52.768 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.768 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.768 DEBUG:boto:path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.768 DEBUG:boto:auth_path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.769 DEBUG:boto:Method: GET 2024-04-16T17:46:52.769 DEBUG:boto:Path: /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.769 DEBUG:boto:Data: 2024-04-16T17:46:52.769 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.769 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.769 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.769 DEBUG:boto:Params: {} 2024-04-16T17:46:52.769 DEBUG:boto:Token: None 2024-04-16T17:46:52.769 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ= 2024-04-16T17:46:52.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ=', 'Content-Length': '0'} 2024-04-16T17:46:52.772 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4270f19300781ea-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.772 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.772 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.772 DEBUG:boto:path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.772 DEBUG:boto:auth_path=/cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.772 DEBUG:boto:Method: GET 2024-04-16T17:46:52.773 DEBUG:boto:Path: /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.773 DEBUG:boto:Data: 2024-04-16T17:46:52.773 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.773 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.773 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.773 DEBUG:boto:Params: {} 2024-04-16T17:46:52.773 DEBUG:boto:Token: None 2024-04-16T17:46:52.773 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj?versionId=null 2024-04-16T17:46:52.773 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ= 2024-04-16T17:46:52.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1ScDLmb0VFtx6qjc2ini04HqxQ=', 'Content-Length': '0'} 2024-04-16T17:46:52.775 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000742979f74d68a770-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.776 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.776 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.776 DEBUG:boto:path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.776 DEBUG:boto:auth_path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.776 DEBUG:boto:Method: GET 2024-04-16T17:46:52.776 DEBUG:boto:Path: /cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.776 DEBUG:boto:Data: 2024-04-16T17:46:52.776 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.777 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.777 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.777 DEBUG:boto:Params: {} 2024-04-16T17:46:52.777 DEBUG:boto:Token: None 2024-04-16T17:46:52.777 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.780 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba9a64c8f236c9b2-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.822 DEBUG:boto:b'cjqttm-7myobj1000falsemyobj2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.823 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.823 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.823 DEBUG:boto:path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.823 DEBUG:boto:auth_path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.823 DEBUG:boto:Method: GET 2024-04-16T17:46:52.823 DEBUG:boto:Path: /cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.823 DEBUG:boto:Data: 2024-04-16T17:46:52.823 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.823 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.824 DEBUG:boto:Params: {} 2024-04-16T17:46:52.824 DEBUG:boto:Token: None 2024-04-16T17:46:52.824 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002add573027997323-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.827 DEBUG:boto:b'cjqttm-7myobj1000falsemyobj2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.827 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.827 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.827 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.827 DEBUG:boto:Path: /cjqttm-7/myobj 2024-04-16T17:46:52.827 DEBUG:boto:Data: 2024-04-16T17:46:52.828 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.828 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.828 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.828 DEBUG:boto:Params: {} 2024-04-16T17:46:52.828 DEBUG:boto:Token: None 2024-04-16T17:46:52.828 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj 2024-04-16T17:46:52.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:greL604pxlYv63oyLnDeJQWkvdg= 2024-04-16T17:46:52.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:greL604pxlYv63oyLnDeJQWkvdg=', 'Content-Length': '0'} 2024-04-16T17:46:52.830 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000622aa5f9b344538e-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.830 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.831 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.831 DEBUG:boto:Method: HEAD 2024-04-16T17:46:52.831 DEBUG:boto:Path: /cjqttm-7/myobj 2024-04-16T17:46:52.831 DEBUG:boto:Data: 2024-04-16T17:46:52.831 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.831 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.831 DEBUG:boto:Params: {} 2024-04-16T17:46:52.831 DEBUG:boto:Token: None 2024-04-16T17:46:52.831 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj 2024-04-16T17:46:52.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:greL604pxlYv63oyLnDeJQWkvdg= 2024-04-16T17:46:52.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:greL604pxlYv63oyLnDeJQWkvdg=', 'Content-Length': '0'} 2024-04-16T17:46:52.834 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002875d1fb7c8311ff-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:46:52.834 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.834 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.834 DEBUG:boto:Method: GET 2024-04-16T17:46:52.834 DEBUG:boto:Path: /cjqttm-7/myobj 2024-04-16T17:46:52.834 DEBUG:boto:Data: 2024-04-16T17:46:52.834 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.835 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.835 DEBUG:boto:Params: {} 2024-04-16T17:46:52.835 DEBUG:boto:Token: None 2024-04-16T17:46:52.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj 2024-04-16T17:46:52.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BSOjYR/2Bnr4Wze7xqvdpqYnTCU= 2024-04-16T17:46:52.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BSOjYR/2Bnr4Wze7xqvdpqYnTCU=', 'Content-Length': '0'} 2024-04-16T17:46:52.837 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:50 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ba407841542f13ab-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.838 DEBUG:boto:path=/cjqttm-7/myobj 2024-04-16T17:46:52.838 DEBUG:boto:auth_path=/cjqttm-7/myobj 2024-04-16T17:46:52.838 DEBUG:boto:Method: GET 2024-04-16T17:46:52.838 DEBUG:boto:Path: /cjqttm-7/myobj 2024-04-16T17:46:52.838 DEBUG:boto:Data: 2024-04-16T17:46:52.838 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.838 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.838 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.838 DEBUG:boto:Params: {} 2024-04-16T17:46:52.838 DEBUG:boto:Token: None 2024-04-16T17:46:52.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/myobj 2024-04-16T17:46:52.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BSOjYR/2Bnr4Wze7xqvdpqYnTCU= 2024-04-16T17:46:52.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BSOjYR/2Bnr4Wze7xqvdpqYnTCU=', 'Content-Length': '0'} 2024-04-16T17:46:52.841 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006684a71f03dedd5c-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.882 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.882 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.883 DEBUG:boto:path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.883 DEBUG:boto:auth_path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.883 DEBUG:boto:Method: GET 2024-04-16T17:46:52.883 DEBUG:boto:Path: /cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.883 DEBUG:boto:Data: 2024-04-16T17:46:52.883 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:46:52.883 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.883 DEBUG:boto:Params: {} 2024-04-16T17:46:52.883 DEBUG:boto:Token: None 2024-04-16T17:46:52.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c6f00ba457666b2-00661eb98c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.886 DEBUG:boto:b'cjqttm-7myobj1000falsemyobj2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.887 DEBUG:boto:path=/cjqttm-7/ 2024-04-16T17:46:52.887 DEBUG:boto:auth_path=/cjqttm-7/ 2024-04-16T17:46:52.887 DEBUG:boto:path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.887 DEBUG:boto:auth_path=/cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.887 DEBUG:boto:Method: GET 2024-04-16T17:46:52.887 DEBUG:boto:Path: /cjqttm-7/?prefix=myobj 2024-04-16T17:46:52.887 DEBUG:boto:Data: 2024-04-16T17:46:52.887 DEBUG:boto:Headers: {} 2024-04-16T17:46:52.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:46:52.887 DEBUG:boto:Port: 8000 2024-04-16T17:46:52.887 DEBUG:boto:Params: {} 2024-04-16T17:46:52.888 DEBUG:boto:Token: None 2024-04-16T17:46:52.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:46:52 GMT /cjqttm-7/ 2024-04-16T17:46:52.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA= 2024-04-16T17:46:52.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:46:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:86DzH2fTrPw3G1h8lhZ8l428rnA=', 'Content-Length': '0'} 2024-04-16T17:46:52.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9ab6ea5e530c037-00661eb98c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:46:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:46:52.891 DEBUG:boto:b'cjqttm-7myobj1000falsemyobj2024-04-16T17:46:45.876Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:46:52.891 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-7 zones={test-zone2, test-zone1} 2024-04-16T17:46:52.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:46:52.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-8', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:46:52.892 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-8 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:46:52.953 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:46:52.954 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:46:53.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:46:53.015+0000 7fef91c3c800 1 waiting to reach incremental sync.. 2024-04-16T17:46:58.014 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:46:58.014+0000 7fef91c3c800 1 waiting to reach incremental sync.. 2024-04-16T17:47:03.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:03.016+0000 7fef91c3c800 1 bucket sync caught up with source: 2024-04-16T17:47:03.016 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.18.6, , 00000000001.6.6, , 00000000001.16.6, 00000000002.13.6, 00000000001.9.6, 00000000001.6.6, 00000000001.9.6, ] 2024-04-16T17:47:03.016 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.18.6, , 00000000001.6.6, , 00000000001.16.6, 00000000002.13.6, 00000000001.9.6, 00000000001.6.6, 00000000001.9.6, ] 2024-04-16T17:47:03.017 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:03.016+0000 7fef91c3c800 0 bucket checkpoint complete 2024-04-16T17:47:03.041 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-8 zones={test-zone1, test-zone2} 2024-04-16T17:47:03.042 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.042 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.042 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.042 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:47:03.042 DEBUG:boto:Data: 2024-04-16T17:47:03.042 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.042 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.043 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.043 DEBUG:boto:Params: {} 2024-04-16T17:47:03.043 DEBUG:boto:Token: None 2024-04-16T17:47:03.043 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:in1OluBDM9PHjnWG9r9xUtLpwZU= 2024-04-16T17:47:03.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:in1OluBDM9PHjnWG9r9xUtLpwZU=', 'Content-Length': '0'} 2024-04-16T17:47:03.046 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f2fba787837c8f0a-00661eb997-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.046 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.046 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.047 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.047 DEBUG:boto:Path: /cjqttm-8/ 2024-04-16T17:47:03.047 DEBUG:boto:Data: 2024-04-16T17:47:03.047 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.047 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.047 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.047 DEBUG:boto:Params: {} 2024-04-16T17:47:03.047 DEBUG:boto:Token: None 2024-04-16T17:47:03.048 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:in1OluBDM9PHjnWG9r9xUtLpwZU= 2024-04-16T17:47:03.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:in1OluBDM9PHjnWG9r9xUtLpwZU=', 'Content-Length': '0'} 2024-04-16T17:47:03.050 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000183719c5b21e1fb9-00661eb997-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.050 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:47:03.051 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.051 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.051 DEBUG:boto:path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.051 DEBUG:boto:auth_path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.051 DEBUG:boto:Method: GET 2024-04-16T17:47:03.051 DEBUG:boto:Path: /cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.051 DEBUG:boto:Data: 2024-04-16T17:47:03.051 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.051 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.052 DEBUG:boto:Params: {} 2024-04-16T17:47:03.052 DEBUG:boto:Token: None 2024-04-16T17:47:03.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/?versions 2024-04-16T17:47:03.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU= 2024-04-16T17:47:03.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU=', 'Content-Length': '0'} 2024-04-16T17:47:03.055 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca224f17fc6784c3-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.055 DEBUG:boto:b'cjqttm-8999false&nulltrue2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.056 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-16T17:47:03.056 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-16T17:47:03.056 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-16T17:47:03.057 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-16T17:47:03.057 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-16T17:47:03.057 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-16T17:47:03.057 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-16T17:47:03.057 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-16T17:47:03.057 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:47:03.057 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:47:03.058 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.058 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.058 DEBUG:boto:path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.058 DEBUG:boto:auth_path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.058 DEBUG:boto:Method: GET 2024-04-16T17:47:03.058 DEBUG:boto:Path: /cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.058 DEBUG:boto:Data: 2024-04-16T17:47:03.059 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.059 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.059 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.059 DEBUG:boto:Params: {} 2024-04-16T17:47:03.059 DEBUG:boto:Token: None 2024-04-16T17:47:03.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/?versions 2024-04-16T17:47:03.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU= 2024-04-16T17:47:03.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU=', 'Content-Length': '0'} 2024-04-16T17:47:03.062 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015e8702f4699145a-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.062 DEBUG:boto:b'cjqttm-8999false&nulltrue2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=& 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=. 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=.. 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=... 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=.o 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=.o. 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=: 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2024-04-16T17:47:03.063 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:47:03.063 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.064 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.064 DEBUG:boto:path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.064 DEBUG:boto:auth_path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.064 DEBUG:boto:Method: GET 2024-04-16T17:47:03.064 DEBUG:boto:Path: /cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.064 DEBUG:boto:Data: 2024-04-16T17:47:03.064 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.064 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.064 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.064 DEBUG:boto:Params: {} 2024-04-16T17:47:03.064 DEBUG:boto:Token: None 2024-04-16T17:47:03.065 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/?versions 2024-04-16T17:47:03.065 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU= 2024-04-16T17:47:03.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU=', 'Content-Length': '0'} 2024-04-16T17:47:03.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000053d38a3d7ae50c8-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.067 DEBUG:boto:b'cjqttm-8999false&nulltrue2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.068 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.068 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.068 DEBUG:boto:path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.068 DEBUG:boto:auth_path=/cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.068 DEBUG:boto:Method: GET 2024-04-16T17:47:03.068 DEBUG:boto:Path: /cjqttm-8/?versions&max-keys=999 2024-04-16T17:47:03.068 DEBUG:boto:Data: 2024-04-16T17:47:03.069 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.069 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.069 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.069 DEBUG:boto:Params: {} 2024-04-16T17:47:03.069 DEBUG:boto:Token: None 2024-04-16T17:47:03.069 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/?versions 2024-04-16T17:47:03.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU= 2024-04-16T17:47:03.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KnOyIvdZZrdrmgXFx4lRAuWP+yU=', 'Content-Length': '0'} 2024-04-16T17:47:03.072 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d39bebe9f4d5040-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.072 DEBUG:boto:b'cjqttm-8999false&nulltrue2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.nulltrue2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..nulltrue2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...nulltrue2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.onulltrue2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.nulltrue2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal:nulltrue2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal_myobjnulltrue2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalmyobjnulltrue2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-16T17:47:03.073 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.073 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.073 DEBUG:boto:path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.073 DEBUG:boto:auth_path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.073 DEBUG:boto:Method: GET 2024-04-16T17:47:03.073 DEBUG:boto:Path: /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.073 DEBUG:boto:Data: 2024-04-16T17:47:03.073 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.073 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.074 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.074 DEBUG:boto:Params: {} 2024-04-16T17:47:03.074 DEBUG:boto:Token: None 2024-04-16T17:47:03.074 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.074 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw= 2024-04-16T17:47:03.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw=', 'Content-Length': '0'} 2024-04-16T17:47:03.076 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f77326d3742b4397-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.122 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.122 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.123 DEBUG:boto:path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.123 DEBUG:boto:auth_path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.123 DEBUG:boto:Method: GET 2024-04-16T17:47:03.123 DEBUG:boto:Path: /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.123 DEBUG:boto:Data: 2024-04-16T17:47:03.123 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.124 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.124 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.124 DEBUG:boto:Params: {} 2024-04-16T17:47:03.124 DEBUG:boto:Token: None 2024-04-16T17:47:03.124 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw= 2024-04-16T17:47:03.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw=', 'Content-Length': '0'} 2024-04-16T17:47:03.126 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f54b1ff059131ac3-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.127 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.127 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.127 DEBUG:boto:path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.127 DEBUG:boto:auth_path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.127 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.128 DEBUG:boto:Path: /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.128 DEBUG:boto:Data: 2024-04-16T17:47:03.128 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.128 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.128 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.128 DEBUG:boto:Params: {} 2024-04-16T17:47:03.128 DEBUG:boto:Token: None 2024-04-16T17:47:03.129 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.129 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DAWM1zBC0IKjH9ZEw69DNzxjL+4= 2024-04-16T17:47:03.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DAWM1zBC0IKjH9ZEw69DNzxjL+4=', 'Content-Length': '0'} 2024-04-16T17:47:03.131 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bc82f1faffb0321b-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.131 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.131 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.131 DEBUG:boto:path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.132 DEBUG:boto:auth_path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.132 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.132 DEBUG:boto:Path: /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.132 DEBUG:boto:Data: 2024-04-16T17:47:03.132 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.132 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.132 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.132 DEBUG:boto:Params: {} 2024-04-16T17:47:03.132 DEBUG:boto:Token: None 2024-04-16T17:47:03.133 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.133 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DAWM1zBC0IKjH9ZEw69DNzxjL+4= 2024-04-16T17:47:03.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DAWM1zBC0IKjH9ZEw69DNzxjL+4=', 'Content-Length': '0'} 2024-04-16T17:47:03.135 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f30e955e38aa5444-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-16T17:47:03.135 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.135 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.135 DEBUG:boto:path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.135 DEBUG:boto:auth_path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.135 DEBUG:boto:Method: GET 2024-04-16T17:47:03.136 DEBUG:boto:Path: /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.136 DEBUG:boto:Data: 2024-04-16T17:47:03.136 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.136 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.136 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.136 DEBUG:boto:Params: {} 2024-04-16T17:47:03.136 DEBUG:boto:Token: None 2024-04-16T17:47:03.136 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw= 2024-04-16T17:47:03.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw=', 'Content-Length': '0'} 2024-04-16T17:47:03.138 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b8f05a2c73a1a140-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.186 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.187 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.187 DEBUG:boto:path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.187 DEBUG:boto:auth_path=/cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.187 DEBUG:boto:Method: GET 2024-04-16T17:47:03.187 DEBUG:boto:Path: /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.187 DEBUG:boto:Data: 2024-04-16T17:47:03.187 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.187 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.187 DEBUG:boto:Params: {} 2024-04-16T17:47:03.188 DEBUG:boto:Token: None 2024-04-16T17:47:03.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26?versionId=null 2024-04-16T17:47:03.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw= 2024-04-16T17:47:03.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMyqJqxNDqnYmBMtb5GLcpdV7Zw=', 'Content-Length': '0'} 2024-04-16T17:47:03.190 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004959abaf16c77f6b-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.191 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.191 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.191 DEBUG:boto:path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.191 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.191 DEBUG:boto:Method: GET 2024-04-16T17:47:03.191 DEBUG:boto:Path: /cjqttm-8/?prefix=%26 2024-04-16T17:47:03.191 DEBUG:boto:Data: 2024-04-16T17:47:03.191 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.191 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.192 DEBUG:boto:Params: {} 2024-04-16T17:47:03.192 DEBUG:boto:Token: None 2024-04-16T17:47:03.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012a5087657096a87-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.238 DEBUG:boto:b'cjqttm-8&1000false&2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.239 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.239 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.239 DEBUG:boto:path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.239 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.239 DEBUG:boto:Method: GET 2024-04-16T17:47:03.239 DEBUG:boto:Path: /cjqttm-8/?prefix=%26 2024-04-16T17:47:03.239 DEBUG:boto:Data: 2024-04-16T17:47:03.239 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.239 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.240 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.240 DEBUG:boto:Params: {} 2024-04-16T17:47:03.240 DEBUG:boto:Token: None 2024-04-16T17:47:03.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2acda4679ace686-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.243 DEBUG:boto:b'cjqttm-8&1000false&2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.243 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.243 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.243 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.244 DEBUG:boto:Path: /cjqttm-8/%26 2024-04-16T17:47:03.244 DEBUG:boto:Data: 2024-04-16T17:47:03.244 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.244 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.244 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.244 DEBUG:boto:Params: {} 2024-04-16T17:47:03.244 DEBUG:boto:Token: None 2024-04-16T17:47:03.244 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26 2024-04-16T17:47:03.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1f8teWc0Ix3GxplGuQycssGIIHk= 2024-04-16T17:47:03.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1f8teWc0Ix3GxplGuQycssGIIHk=', 'Content-Length': '0'} 2024-04-16T17:47:03.246 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007338970c43a8cd8b-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.247 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.247 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.247 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.247 DEBUG:boto:Path: /cjqttm-8/%26 2024-04-16T17:47:03.247 DEBUG:boto:Data: 2024-04-16T17:47:03.247 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.247 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.247 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.247 DEBUG:boto:Params: {} 2024-04-16T17:47:03.247 DEBUG:boto:Token: None 2024-04-16T17:47:03.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26 2024-04-16T17:47:03.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1f8teWc0Ix3GxplGuQycssGIIHk= 2024-04-16T17:47:03.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1f8teWc0Ix3GxplGuQycssGIIHk=', 'Content-Length': '0'} 2024-04-16T17:47:03.250 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c16b8747ef52080d-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.250 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2024-04-16T17:47:03.250 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.250 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.250 DEBUG:boto:Method: GET 2024-04-16T17:47:03.250 DEBUG:boto:Path: /cjqttm-8/%26 2024-04-16T17:47:03.250 DEBUG:boto:Data: 2024-04-16T17:47:03.250 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.251 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.251 DEBUG:boto:Params: {} 2024-04-16T17:47:03.251 DEBUG:boto:Token: None 2024-04-16T17:47:03.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26 2024-04-16T17:47:03.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ImsZW3UHbIlljIBqLCzUnZuV1vc= 2024-04-16T17:47:03.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ImsZW3UHbIlljIBqLCzUnZuV1vc=', 'Content-Length': '0'} 2024-04-16T17:47:03.253 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a199c1c3e49bbff5-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.294 DEBUG:boto:path=/cjqttm-8/%26 2024-04-16T17:47:03.294 DEBUG:boto:auth_path=/cjqttm-8/%26 2024-04-16T17:47:03.295 DEBUG:boto:Method: GET 2024-04-16T17:47:03.295 DEBUG:boto:Path: /cjqttm-8/%26 2024-04-16T17:47:03.295 DEBUG:boto:Data: 2024-04-16T17:47:03.295 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.295 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.295 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.295 DEBUG:boto:Params: {} 2024-04-16T17:47:03.295 DEBUG:boto:Token: None 2024-04-16T17:47:03.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/%26 2024-04-16T17:47:03.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ImsZW3UHbIlljIBqLCzUnZuV1vc= 2024-04-16T17:47:03.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ImsZW3UHbIlljIBqLCzUnZuV1vc=', 'Content-Length': '0'} 2024-04-16T17:47:03.298 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000266a1ad066651c78-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.298 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.298 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.298 DEBUG:boto:path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.299 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.299 DEBUG:boto:Method: GET 2024-04-16T17:47:03.299 DEBUG:boto:Path: /cjqttm-8/?prefix=%26 2024-04-16T17:47:03.299 DEBUG:boto:Data: 2024-04-16T17:47:03.299 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.299 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.299 DEBUG:boto:Params: {} 2024-04-16T17:47:03.299 DEBUG:boto:Token: None 2024-04-16T17:47:03.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.302 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ecf5b894bc7f1d9e-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.342 DEBUG:boto:b'cjqttm-8&1000false&2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.343 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.343 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.343 DEBUG:boto:path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.343 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%26 2024-04-16T17:47:03.343 DEBUG:boto:Method: GET 2024-04-16T17:47:03.343 DEBUG:boto:Path: /cjqttm-8/?prefix=%26 2024-04-16T17:47:03.343 DEBUG:boto:Data: 2024-04-16T17:47:03.343 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.344 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.344 DEBUG:boto:Params: {} 2024-04-16T17:47:03.344 DEBUG:boto:Token: None 2024-04-16T17:47:03.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.347 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000720af9a814eedfc8-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.347 DEBUG:boto:b'cjqttm-8&1000false&2024-04-16T17:46:46.174Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-16T17:47:03.347 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.347 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.347 DEBUG:boto:path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.348 DEBUG:boto:auth_path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.348 DEBUG:boto:Method: GET 2024-04-16T17:47:03.348 DEBUG:boto:Path: /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.348 DEBUG:boto:Data: 2024-04-16T17:47:03.348 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.348 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.348 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.348 DEBUG:boto:Params: {} 2024-04-16T17:47:03.348 DEBUG:boto:Token: None 2024-04-16T17:47:03.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI= 2024-04-16T17:47:03.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI=', 'Content-Length': '0'} 2024-04-16T17:47:03.351 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a1c8f324989af89-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.351 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.351 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.351 DEBUG:boto:path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.351 DEBUG:boto:auth_path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.351 DEBUG:boto:Method: GET 2024-04-16T17:47:03.351 DEBUG:boto:Path: /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.351 DEBUG:boto:Data: 2024-04-16T17:47:03.352 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.352 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.352 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.352 DEBUG:boto:Params: {} 2024-04-16T17:47:03.352 DEBUG:boto:Token: None 2024-04-16T17:47:03.352 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI= 2024-04-16T17:47:03.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI=', 'Content-Length': '0'} 2024-04-16T17:47:03.354 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005f31998265e58f76-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.354 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.355 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.355 DEBUG:boto:path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.355 DEBUG:boto:auth_path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.355 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.355 DEBUG:boto:Path: /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.355 DEBUG:boto:Data: 2024-04-16T17:47:03.355 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.355 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.355 DEBUG:boto:Params: {} 2024-04-16T17:47:03.355 DEBUG:boto:Token: None 2024-04-16T17:47:03.356 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wXnt4XSKUz+bnuQnzvWnvkd3400= 2024-04-16T17:47:03.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wXnt4XSKUz+bnuQnzvWnvkd3400=', 'Content-Length': '0'} 2024-04-16T17:47:03.358 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000500d14ded5777e2b-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.358 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.358 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.358 DEBUG:boto:path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.358 DEBUG:boto:auth_path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.358 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.358 DEBUG:boto:Path: /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.358 DEBUG:boto:Data: 2024-04-16T17:47:03.358 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.359 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.359 DEBUG:boto:Params: {} 2024-04-16T17:47:03.359 DEBUG:boto:Token: None 2024-04-16T17:47:03.359 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wXnt4XSKUz+bnuQnzvWnvkd3400= 2024-04-16T17:47:03.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wXnt4XSKUz+bnuQnzvWnvkd3400=', 'Content-Length': '0'} 2024-04-16T17:47:03.361 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e457a7015bcf85a4-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-16T17:47:03.362 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.362 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.362 DEBUG:boto:path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.362 DEBUG:boto:auth_path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.362 DEBUG:boto:Method: GET 2024-04-16T17:47:03.362 DEBUG:boto:Path: /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.362 DEBUG:boto:Data: 2024-04-16T17:47:03.362 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.362 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.363 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.363 DEBUG:boto:Params: {} 2024-04-16T17:47:03.363 DEBUG:boto:Token: None 2024-04-16T17:47:03.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI= 2024-04-16T17:47:03.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI=', 'Content-Length': '0'} 2024-04-16T17:47:03.365 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008db5188021e4f1e5-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.365 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.365 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.366 DEBUG:boto:path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.366 DEBUG:boto:auth_path=/cjqttm-8/.?versionId=null 2024-04-16T17:47:03.366 DEBUG:boto:Method: GET 2024-04-16T17:47:03.366 DEBUG:boto:Path: /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.366 DEBUG:boto:Data: 2024-04-16T17:47:03.366 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.366 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.366 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.366 DEBUG:boto:Params: {} 2024-04-16T17:47:03.366 DEBUG:boto:Token: None 2024-04-16T17:47:03.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.?versionId=null 2024-04-16T17:47:03.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI= 2024-04-16T17:47:03.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DZY+UQrOZnRq6fX5LT2X/cTgAKI=', 'Content-Length': '0'} 2024-04-16T17:47:03.369 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009434aba74b12b87b-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.369 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.369 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.369 DEBUG:boto:path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.370 DEBUG:boto:auth_path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.370 DEBUG:boto:Method: GET 2024-04-16T17:47:03.370 DEBUG:boto:Path: /cjqttm-8/?prefix=. 2024-04-16T17:47:03.370 DEBUG:boto:Data: 2024-04-16T17:47:03.370 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.370 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.370 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.370 DEBUG:boto:Params: {} 2024-04-16T17:47:03.370 DEBUG:boto:Token: None 2024-04-16T17:47:03.370 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.373 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e67704b205d22ffc-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.373 DEBUG:boto:b'cjqttm-8.1000false.2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.373 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.374 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.374 DEBUG:boto:path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.374 DEBUG:boto:auth_path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.374 DEBUG:boto:Method: GET 2024-04-16T17:47:03.374 DEBUG:boto:Path: /cjqttm-8/?prefix=. 2024-04-16T17:47:03.374 DEBUG:boto:Data: 2024-04-16T17:47:03.374 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.374 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.374 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.374 DEBUG:boto:Params: {} 2024-04-16T17:47:03.374 DEBUG:boto:Token: None 2024-04-16T17:47:03.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f989f9ebbcde99d-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.377 DEBUG:boto:b'cjqttm-8.1000false.2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.378 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.378 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.378 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.378 DEBUG:boto:Path: /cjqttm-8/. 2024-04-16T17:47:03.378 DEBUG:boto:Data: 2024-04-16T17:47:03.378 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.378 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.378 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.378 DEBUG:boto:Params: {} 2024-04-16T17:47:03.379 DEBUG:boto:Token: None 2024-04-16T17:47:03.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/. 2024-04-16T17:47:03.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZNm9kOXsiPaMsiMs6kCGyGFNyYc= 2024-04-16T17:47:03.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZNm9kOXsiPaMsiMs6kCGyGFNyYc=', 'Content-Length': '0'} 2024-04-16T17:47:03.381 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000067cb14feec74416b-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.381 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.381 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.381 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.381 DEBUG:boto:Path: /cjqttm-8/. 2024-04-16T17:47:03.382 DEBUG:boto:Data: 2024-04-16T17:47:03.382 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.382 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.382 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.382 DEBUG:boto:Params: {} 2024-04-16T17:47:03.382 DEBUG:boto:Token: None 2024-04-16T17:47:03.382 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/. 2024-04-16T17:47:03.382 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZNm9kOXsiPaMsiMs6kCGyGFNyYc= 2024-04-16T17:47:03.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZNm9kOXsiPaMsiMs6kCGyGFNyYc=', 'Content-Length': '0'} 2024-04-16T17:47:03.384 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005946ec811987c275-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=. 2024-04-16T17:47:03.385 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.385 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.385 DEBUG:boto:Method: GET 2024-04-16T17:47:03.385 DEBUG:boto:Path: /cjqttm-8/. 2024-04-16T17:47:03.385 DEBUG:boto:Data: 2024-04-16T17:47:03.385 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.385 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.385 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.385 DEBUG:boto:Params: {} 2024-04-16T17:47:03.386 DEBUG:boto:Token: None 2024-04-16T17:47:03.386 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/. 2024-04-16T17:47:03.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rD+AgSGV0K3nJ89y1hKVJRXdhIM= 2024-04-16T17:47:03.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rD+AgSGV0K3nJ89y1hKVJRXdhIM=', 'Content-Length': '0'} 2024-04-16T17:47:03.388 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aed57ed2c99f6284-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.388 DEBUG:boto:path=/cjqttm-8/. 2024-04-16T17:47:03.388 DEBUG:boto:auth_path=/cjqttm-8/. 2024-04-16T17:47:03.388 DEBUG:boto:Method: GET 2024-04-16T17:47:03.388 DEBUG:boto:Path: /cjqttm-8/. 2024-04-16T17:47:03.388 DEBUG:boto:Data: 2024-04-16T17:47:03.388 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.388 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.389 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.389 DEBUG:boto:Params: {} 2024-04-16T17:47:03.389 DEBUG:boto:Token: None 2024-04-16T17:47:03.389 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/. 2024-04-16T17:47:03.389 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rD+AgSGV0K3nJ89y1hKVJRXdhIM= 2024-04-16T17:47:03.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rD+AgSGV0K3nJ89y1hKVJRXdhIM=', 'Content-Length': '0'} 2024-04-16T17:47:03.391 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000afb738040ca2fe95-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.392 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.392 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.392 DEBUG:boto:path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.392 DEBUG:boto:auth_path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.392 DEBUG:boto:Method: GET 2024-04-16T17:47:03.392 DEBUG:boto:Path: /cjqttm-8/?prefix=. 2024-04-16T17:47:03.392 DEBUG:boto:Data: 2024-04-16T17:47:03.392 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.392 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.392 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.393 DEBUG:boto:Params: {} 2024-04-16T17:47:03.393 DEBUG:boto:Token: None 2024-04-16T17:47:03.393 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.393 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc8a968eab1e250b-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.396 DEBUG:boto:b'cjqttm-8.1000false.2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.396 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.396 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.396 DEBUG:boto:path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.396 DEBUG:boto:auth_path=/cjqttm-8/?prefix=. 2024-04-16T17:47:03.396 DEBUG:boto:Method: GET 2024-04-16T17:47:03.397 DEBUG:boto:Path: /cjqttm-8/?prefix=. 2024-04-16T17:47:03.397 DEBUG:boto:Data: 2024-04-16T17:47:03.397 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.397 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.397 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.397 DEBUG:boto:Params: {} 2024-04-16T17:47:03.397 DEBUG:boto:Token: None 2024-04-16T17:47:03.397 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f6ce2bead825ea1-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.400 DEBUG:boto:b'cjqttm-8.1000false.2024-04-16T17:46:46.223Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.401 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-16T17:47:03.401 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.401 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.401 DEBUG:boto:path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.401 DEBUG:boto:auth_path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.401 DEBUG:boto:Method: GET 2024-04-16T17:47:03.401 DEBUG:boto:Path: /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.401 DEBUG:boto:Data: 2024-04-16T17:47:03.401 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.401 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.401 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.402 DEBUG:boto:Params: {} 2024-04-16T17:47:03.402 DEBUG:boto:Token: None 2024-04-16T17:47:03.402 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.402 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys= 2024-04-16T17:47:03.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys=', 'Content-Length': '0'} 2024-04-16T17:47:03.404 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f9d4048fb5c4ef4-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.446 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.447 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.447 DEBUG:boto:path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.447 DEBUG:boto:auth_path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.447 DEBUG:boto:Method: GET 2024-04-16T17:47:03.447 DEBUG:boto:Path: /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.447 DEBUG:boto:Data: 2024-04-16T17:47:03.447 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.447 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.447 DEBUG:boto:Params: {} 2024-04-16T17:47:03.447 DEBUG:boto:Token: None 2024-04-16T17:47:03.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys= 2024-04-16T17:47:03.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys=', 'Content-Length': '0'} 2024-04-16T17:47:03.450 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000060b28d3b51e3af7b-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.450 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.450 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.450 DEBUG:boto:path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.451 DEBUG:boto:auth_path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.451 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.451 DEBUG:boto:Path: /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.451 DEBUG:boto:Data: 2024-04-16T17:47:03.451 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.451 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.451 DEBUG:boto:Params: {} 2024-04-16T17:47:03.451 DEBUG:boto:Token: None 2024-04-16T17:47:03.451 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2UJ82pGk7vWvQdKmDudnygDLY6U= 2024-04-16T17:47:03.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2UJ82pGk7vWvQdKmDudnygDLY6U=', 'Content-Length': '0'} 2024-04-16T17:47:03.453 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000090fa1d63e5590b28-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.454 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.454 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.454 DEBUG:boto:path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.454 DEBUG:boto:auth_path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.454 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.454 DEBUG:boto:Path: /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.454 DEBUG:boto:Data: 2024-04-16T17:47:03.454 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.454 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.454 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.455 DEBUG:boto:Params: {} 2024-04-16T17:47:03.455 DEBUG:boto:Token: None 2024-04-16T17:47:03.455 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2UJ82pGk7vWvQdKmDudnygDLY6U= 2024-04-16T17:47:03.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2UJ82pGk7vWvQdKmDudnygDLY6U=', 'Content-Length': '0'} 2024-04-16T17:47:03.457 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000075819b964a16bdc7-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.457 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-16T17:47:03.457 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.457 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.457 DEBUG:boto:path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.457 DEBUG:boto:auth_path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.457 DEBUG:boto:Method: GET 2024-04-16T17:47:03.458 DEBUG:boto:Path: /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.458 DEBUG:boto:Data: 2024-04-16T17:47:03.458 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.458 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.458 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.458 DEBUG:boto:Params: {} 2024-04-16T17:47:03.458 DEBUG:boto:Token: None 2024-04-16T17:47:03.458 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.458 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys= 2024-04-16T17:47:03.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys=', 'Content-Length': '0'} 2024-04-16T17:47:03.460 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009d06078479996668-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.461 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.461 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.461 DEBUG:boto:path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.461 DEBUG:boto:auth_path=/cjqttm-8/..?versionId=null 2024-04-16T17:47:03.461 DEBUG:boto:Method: GET 2024-04-16T17:47:03.461 DEBUG:boto:Path: /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.461 DEBUG:boto:Data: 2024-04-16T17:47:03.461 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.461 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.461 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.461 DEBUG:boto:Params: {} 2024-04-16T17:47:03.462 DEBUG:boto:Token: None 2024-04-16T17:47:03.462 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/..?versionId=null 2024-04-16T17:47:03.462 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys= 2024-04-16T17:47:03.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbCCmtNJYbMEeMwqPKuWuTGXxys=', 'Content-Length': '0'} 2024-04-16T17:47:03.464 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000063733bb5b6ded137-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.464 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.464 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.464 DEBUG:boto:path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.464 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.464 DEBUG:boto:Method: GET 2024-04-16T17:47:03.464 DEBUG:boto:Path: /cjqttm-8/?prefix=.. 2024-04-16T17:47:03.465 DEBUG:boto:Data: 2024-04-16T17:47:03.465 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.465 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.465 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.465 DEBUG:boto:Params: {} 2024-04-16T17:47:03.465 DEBUG:boto:Token: None 2024-04-16T17:47:03.465 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.465 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003899ad1800000e4a-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.468 DEBUG:boto:b'cjqttm-8..1000false..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.468 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.468 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.469 DEBUG:boto:path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.469 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.469 DEBUG:boto:Method: GET 2024-04-16T17:47:03.469 DEBUG:boto:Path: /cjqttm-8/?prefix=.. 2024-04-16T17:47:03.469 DEBUG:boto:Data: 2024-04-16T17:47:03.469 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.469 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.469 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.469 DEBUG:boto:Params: {} 2024-04-16T17:47:03.469 DEBUG:boto:Token: None 2024-04-16T17:47:03.470 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.470 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.472 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038b3fcb4fe5868c7-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.472 DEBUG:boto:b'cjqttm-8..1000false..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.473 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.473 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.473 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.473 DEBUG:boto:Path: /cjqttm-8/.. 2024-04-16T17:47:03.473 DEBUG:boto:Data: 2024-04-16T17:47:03.473 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.473 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.473 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.473 DEBUG:boto:Params: {} 2024-04-16T17:47:03.474 DEBUG:boto:Token: None 2024-04-16T17:47:03.474 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.. 2024-04-16T17:47:03.474 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvR7vGuGGQBETFdf8dtR0z88nAQ= 2024-04-16T17:47:03.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvR7vGuGGQBETFdf8dtR0z88nAQ=', 'Content-Length': '0'} 2024-04-16T17:47:03.476 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e38e79962f6aa2e8-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.476 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.476 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.476 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.476 DEBUG:boto:Path: /cjqttm-8/.. 2024-04-16T17:47:03.476 DEBUG:boto:Data: 2024-04-16T17:47:03.476 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.476 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.477 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.477 DEBUG:boto:Params: {} 2024-04-16T17:47:03.477 DEBUG:boto:Token: None 2024-04-16T17:47:03.477 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.. 2024-04-16T17:47:03.477 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvR7vGuGGQBETFdf8dtR0z88nAQ= 2024-04-16T17:47:03.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvR7vGuGGQBETFdf8dtR0z88nAQ=', 'Content-Length': '0'} 2024-04-16T17:47:03.479 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a57055c64e5fd41e-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.. 2024-04-16T17:47:03.479 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.479 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.479 DEBUG:boto:Method: GET 2024-04-16T17:47:03.479 DEBUG:boto:Path: /cjqttm-8/.. 2024-04-16T17:47:03.479 DEBUG:boto:Data: 2024-04-16T17:47:03.480 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.480 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.480 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.480 DEBUG:boto:Params: {} 2024-04-16T17:47:03.480 DEBUG:boto:Token: None 2024-04-16T17:47:03.480 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.. 2024-04-16T17:47:03.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mtCI0YmnbFTNx6SjpNKMy0TXcXE= 2024-04-16T17:47:03.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mtCI0YmnbFTNx6SjpNKMy0TXcXE=', 'Content-Length': '0'} 2024-04-16T17:47:03.482 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ce0519dfa9ba3cea-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.482 DEBUG:boto:path=/cjqttm-8/.. 2024-04-16T17:47:03.482 DEBUG:boto:auth_path=/cjqttm-8/.. 2024-04-16T17:47:03.482 DEBUG:boto:Method: GET 2024-04-16T17:47:03.483 DEBUG:boto:Path: /cjqttm-8/.. 2024-04-16T17:47:03.483 DEBUG:boto:Data: 2024-04-16T17:47:03.483 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.483 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.483 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.483 DEBUG:boto:Params: {} 2024-04-16T17:47:03.483 DEBUG:boto:Token: None 2024-04-16T17:47:03.483 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.. 2024-04-16T17:47:03.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mtCI0YmnbFTNx6SjpNKMy0TXcXE= 2024-04-16T17:47:03.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mtCI0YmnbFTNx6SjpNKMy0TXcXE=', 'Content-Length': '0'} 2024-04-16T17:47:03.485 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000beaf052aae3fd38-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.485 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.486 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.486 DEBUG:boto:path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.486 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.486 DEBUG:boto:Method: GET 2024-04-16T17:47:03.486 DEBUG:boto:Path: /cjqttm-8/?prefix=.. 2024-04-16T17:47:03.486 DEBUG:boto:Data: 2024-04-16T17:47:03.486 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.486 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.486 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.486 DEBUG:boto:Params: {} 2024-04-16T17:47:03.486 DEBUG:boto:Token: None 2024-04-16T17:47:03.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d0c920e54600323-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.489 DEBUG:boto:b'cjqttm-8..1000false..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.489 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.489 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.489 DEBUG:boto:path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.490 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.. 2024-04-16T17:47:03.490 DEBUG:boto:Method: GET 2024-04-16T17:47:03.490 DEBUG:boto:Path: /cjqttm-8/?prefix=.. 2024-04-16T17:47:03.490 DEBUG:boto:Data: 2024-04-16T17:47:03.490 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.490 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.490 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.490 DEBUG:boto:Params: {} 2024-04-16T17:47:03.490 DEBUG:boto:Token: None 2024-04-16T17:47:03.490 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.493 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003acdceb6d0462583-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.493 DEBUG:boto:b'cjqttm-8..1000false..2024-04-16T17:46:46.238Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.494 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-16T17:47:03.494 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.494 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.494 DEBUG:boto:path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.494 DEBUG:boto:auth_path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.494 DEBUG:boto:Method: GET 2024-04-16T17:47:03.494 DEBUG:boto:Path: /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.494 DEBUG:boto:Data: 2024-04-16T17:47:03.494 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.495 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.495 DEBUG:boto:Params: {} 2024-04-16T17:47:03.495 DEBUG:boto:Token: None 2024-04-16T17:47:03.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y= 2024-04-16T17:47:03.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y=', 'Content-Length': '0'} 2024-04-16T17:47:03.497 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009e449af35b21d2c5-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.497 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.498 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.498 DEBUG:boto:path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.498 DEBUG:boto:auth_path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.498 DEBUG:boto:Method: GET 2024-04-16T17:47:03.498 DEBUG:boto:Path: /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.498 DEBUG:boto:Data: 2024-04-16T17:47:03.498 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.498 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.498 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.498 DEBUG:boto:Params: {} 2024-04-16T17:47:03.498 DEBUG:boto:Token: None 2024-04-16T17:47:03.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y= 2024-04-16T17:47:03.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y=', 'Content-Length': '0'} 2024-04-16T17:47:03.501 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e032ac22bcbf219-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.501 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.501 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.501 DEBUG:boto:path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.501 DEBUG:boto:auth_path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.501 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.501 DEBUG:boto:Path: /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.502 DEBUG:boto:Data: 2024-04-16T17:47:03.502 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.502 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.502 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.502 DEBUG:boto:Params: {} 2024-04-16T17:47:03.502 DEBUG:boto:Token: None 2024-04-16T17:47:03.502 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.502 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XfqFtet6VMCBBCbUoMdW60NKKcI= 2024-04-16T17:47:03.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XfqFtet6VMCBBCbUoMdW60NKKcI=', 'Content-Length': '0'} 2024-04-16T17:47:03.504 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b9bba32434bba1c1-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.504 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.505 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.505 DEBUG:boto:path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.505 DEBUG:boto:auth_path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.505 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.505 DEBUG:boto:Path: /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.505 DEBUG:boto:Data: 2024-04-16T17:47:03.505 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.505 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.505 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.505 DEBUG:boto:Params: {} 2024-04-16T17:47:03.505 DEBUG:boto:Token: None 2024-04-16T17:47:03.506 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.506 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XfqFtet6VMCBBCbUoMdW60NKKcI= 2024-04-16T17:47:03.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XfqFtet6VMCBBCbUoMdW60NKKcI=', 'Content-Length': '0'} 2024-04-16T17:47:03.507 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e8c90cc72bab476f-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.508 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-16T17:47:03.508 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.508 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.508 DEBUG:boto:path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.508 DEBUG:boto:auth_path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.508 DEBUG:boto:Method: GET 2024-04-16T17:47:03.508 DEBUG:boto:Path: /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.508 DEBUG:boto:Data: 2024-04-16T17:47:03.508 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.509 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.509 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.509 DEBUG:boto:Params: {} 2024-04-16T17:47:03.509 DEBUG:boto:Token: None 2024-04-16T17:47:03.509 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y= 2024-04-16T17:47:03.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y=', 'Content-Length': '0'} 2024-04-16T17:47:03.511 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b40e416e579d3b52-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.511 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.511 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.511 DEBUG:boto:path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.512 DEBUG:boto:auth_path=/cjqttm-8/...?versionId=null 2024-04-16T17:47:03.512 DEBUG:boto:Method: GET 2024-04-16T17:47:03.512 DEBUG:boto:Path: /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.512 DEBUG:boto:Data: 2024-04-16T17:47:03.512 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.512 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.512 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.512 DEBUG:boto:Params: {} 2024-04-16T17:47:03.512 DEBUG:boto:Token: None 2024-04-16T17:47:03.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/...?versionId=null 2024-04-16T17:47:03.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y= 2024-04-16T17:47:03.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2waAK8M/++TgVI9GYMaWuWFNH8Y=', 'Content-Length': '0'} 2024-04-16T17:47:03.514 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003fa06bb17b7bba5e-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.514 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.515 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.515 DEBUG:boto:path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.515 DEBUG:boto:auth_path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.515 DEBUG:boto:Method: GET 2024-04-16T17:47:03.515 DEBUG:boto:Path: /cjqttm-8/?prefix=... 2024-04-16T17:47:03.515 DEBUG:boto:Data: 2024-04-16T17:47:03.515 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.515 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.515 DEBUG:boto:Params: {} 2024-04-16T17:47:03.515 DEBUG:boto:Token: None 2024-04-16T17:47:03.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009873705ca3e079cd-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.558 DEBUG:boto:b'cjqttm-8...1000false...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.559 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.559 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.559 DEBUG:boto:path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.559 DEBUG:boto:auth_path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.559 DEBUG:boto:Method: GET 2024-04-16T17:47:03.559 DEBUG:boto:Path: /cjqttm-8/?prefix=... 2024-04-16T17:47:03.559 DEBUG:boto:Data: 2024-04-16T17:47:03.559 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.560 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.560 DEBUG:boto:Params: {} 2024-04-16T17:47:03.560 DEBUG:boto:Token: None 2024-04-16T17:47:03.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0627386fd968e33-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.563 DEBUG:boto:b'cjqttm-8...1000false...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.563 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.563 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.563 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.563 DEBUG:boto:Path: /cjqttm-8/... 2024-04-16T17:47:03.563 DEBUG:boto:Data: 2024-04-16T17:47:03.564 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.564 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.564 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.564 DEBUG:boto:Params: {} 2024-04-16T17:47:03.564 DEBUG:boto:Token: None 2024-04-16T17:47:03.564 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/... 2024-04-16T17:47:03.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YU1ZDFFG5OYbZQ/6PiZcsp/eX9o= 2024-04-16T17:47:03.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YU1ZDFFG5OYbZQ/6PiZcsp/eX9o=', 'Content-Length': '0'} 2024-04-16T17:47:03.566 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000efab4df0706a60fe-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.566 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.566 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.566 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.566 DEBUG:boto:Path: /cjqttm-8/... 2024-04-16T17:47:03.567 DEBUG:boto:Data: 2024-04-16T17:47:03.567 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.567 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.567 DEBUG:boto:Params: {} 2024-04-16T17:47:03.567 DEBUG:boto:Token: None 2024-04-16T17:47:03.567 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/... 2024-04-16T17:47:03.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YU1ZDFFG5OYbZQ/6PiZcsp/eX9o= 2024-04-16T17:47:03.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YU1ZDFFG5OYbZQ/6PiZcsp/eX9o=', 'Content-Length': '0'} 2024-04-16T17:47:03.569 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f1907f6044f6fd50-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.569 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=... 2024-04-16T17:47:03.569 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.569 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.570 DEBUG:boto:Method: GET 2024-04-16T17:47:03.570 DEBUG:boto:Path: /cjqttm-8/... 2024-04-16T17:47:03.570 DEBUG:boto:Data: 2024-04-16T17:47:03.570 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.570 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.570 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.570 DEBUG:boto:Params: {} 2024-04-16T17:47:03.570 DEBUG:boto:Token: None 2024-04-16T17:47:03.570 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/... 2024-04-16T17:47:03.570 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V+0uv++YtOfTZGT/X3CjTobNdBo= 2024-04-16T17:47:03.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V+0uv++YtOfTZGT/X3CjTobNdBo=', 'Content-Length': '0'} 2024-04-16T17:47:03.572 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003067217543ef8169-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.573 DEBUG:boto:path=/cjqttm-8/... 2024-04-16T17:47:03.573 DEBUG:boto:auth_path=/cjqttm-8/... 2024-04-16T17:47:03.573 DEBUG:boto:Method: GET 2024-04-16T17:47:03.573 DEBUG:boto:Path: /cjqttm-8/... 2024-04-16T17:47:03.573 DEBUG:boto:Data: 2024-04-16T17:47:03.573 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.573 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.573 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.573 DEBUG:boto:Params: {} 2024-04-16T17:47:03.573 DEBUG:boto:Token: None 2024-04-16T17:47:03.574 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/... 2024-04-16T17:47:03.574 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V+0uv++YtOfTZGT/X3CjTobNdBo= 2024-04-16T17:47:03.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V+0uv++YtOfTZGT/X3CjTobNdBo=', 'Content-Length': '0'} 2024-04-16T17:47:03.575 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000f9621ac54a15300-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.576 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.576 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.576 DEBUG:boto:path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.576 DEBUG:boto:auth_path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.576 DEBUG:boto:Method: GET 2024-04-16T17:47:03.576 DEBUG:boto:Path: /cjqttm-8/?prefix=... 2024-04-16T17:47:03.576 DEBUG:boto:Data: 2024-04-16T17:47:03.576 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.576 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.576 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.576 DEBUG:boto:Params: {} 2024-04-16T17:47:03.577 DEBUG:boto:Token: None 2024-04-16T17:47:03.577 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.577 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.579 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aca447fef8570afc-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.579 DEBUG:boto:b'cjqttm-8...1000false...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.580 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.580 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.580 DEBUG:boto:path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.580 DEBUG:boto:auth_path=/cjqttm-8/?prefix=... 2024-04-16T17:47:03.580 DEBUG:boto:Method: GET 2024-04-16T17:47:03.580 DEBUG:boto:Path: /cjqttm-8/?prefix=... 2024-04-16T17:47:03.580 DEBUG:boto:Data: 2024-04-16T17:47:03.580 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.581 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.581 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.581 DEBUG:boto:Params: {} 2024-04-16T17:47:03.581 DEBUG:boto:Token: None 2024-04-16T17:47:03.581 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.581 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000748d7b1796e45b16-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.632 DEBUG:boto:b'cjqttm-8...1000false...2024-04-16T17:46:46.248Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-16T17:47:03.632 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.632 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.632 DEBUG:boto:path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.633 DEBUG:boto:auth_path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.633 DEBUG:boto:Method: GET 2024-04-16T17:47:03.633 DEBUG:boto:Path: /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.633 DEBUG:boto:Data: 2024-04-16T17:47:03.633 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.633 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.633 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.633 DEBUG:boto:Params: {} 2024-04-16T17:47:03.633 DEBUG:boto:Token: None 2024-04-16T17:47:03.633 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.634 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw= 2024-04-16T17:47:03.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw=', 'Content-Length': '0'} 2024-04-16T17:47:03.645 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b4d4878b06ce15da-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.646 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.646 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.646 DEBUG:boto:path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.646 DEBUG:boto:auth_path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.646 DEBUG:boto:Method: GET 2024-04-16T17:47:03.646 DEBUG:boto:Path: /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.646 DEBUG:boto:Data: 2024-04-16T17:47:03.646 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.646 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.646 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.646 DEBUG:boto:Params: {} 2024-04-16T17:47:03.647 DEBUG:boto:Token: None 2024-04-16T17:47:03.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw= 2024-04-16T17:47:03.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw=', 'Content-Length': '0'} 2024-04-16T17:47:03.656 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000ffd5cc545b633a4-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.699 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.700 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.700 DEBUG:boto:path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.700 DEBUG:boto:auth_path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.700 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.700 DEBUG:boto:Path: /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.700 DEBUG:boto:Data: 2024-04-16T17:47:03.700 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.700 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.700 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.700 DEBUG:boto:Params: {} 2024-04-16T17:47:03.700 DEBUG:boto:Token: None 2024-04-16T17:47:03.701 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.701 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZKt9cp+UVnA9Ow8Wpu3a0R+XO8A= 2024-04-16T17:47:03.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZKt9cp+UVnA9Ow8Wpu3a0R+XO8A=', 'Content-Length': '0'} 2024-04-16T17:47:03.705 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000592704603c860770-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.705 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.705 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.705 DEBUG:boto:path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.706 DEBUG:boto:auth_path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.706 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.706 DEBUG:boto:Path: /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.706 DEBUG:boto:Data: 2024-04-16T17:47:03.706 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.706 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.706 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.706 DEBUG:boto:Params: {} 2024-04-16T17:47:03.706 DEBUG:boto:Token: None 2024-04-16T17:47:03.706 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZKt9cp+UVnA9Ow8Wpu3a0R+XO8A= 2024-04-16T17:47:03.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZKt9cp+UVnA9Ow8Wpu3a0R+XO8A=', 'Content-Length': '0'} 2024-04-16T17:47:03.709 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006101060b10650bec-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.709 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-16T17:47:03.709 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.710 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.710 DEBUG:boto:path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.710 DEBUG:boto:auth_path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.710 DEBUG:boto:Method: GET 2024-04-16T17:47:03.710 DEBUG:boto:Path: /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.710 DEBUG:boto:Data: 2024-04-16T17:47:03.710 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.710 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.710 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.710 DEBUG:boto:Params: {} 2024-04-16T17:47:03.710 DEBUG:boto:Token: None 2024-04-16T17:47:03.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw= 2024-04-16T17:47:03.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw=', 'Content-Length': '0'} 2024-04-16T17:47:03.713 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000439febe5e1f1eccc-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.717 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.717 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.717 DEBUG:boto:path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.717 DEBUG:boto:auth_path=/cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.717 DEBUG:boto:Method: GET 2024-04-16T17:47:03.717 DEBUG:boto:Path: /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.717 DEBUG:boto:Data: 2024-04-16T17:47:03.717 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.717 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.718 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.718 DEBUG:boto:Params: {} 2024-04-16T17:47:03.718 DEBUG:boto:Token: None 2024-04-16T17:47:03.718 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o?versionId=null 2024-04-16T17:47:03.718 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw= 2024-04-16T17:47:03.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V3rRQ9kK059k6XlCwFHgRYBB2xw=', 'Content-Length': '0'} 2024-04-16T17:47:03.722 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a0227c5f6f9f41e7-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.722 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.722 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.722 DEBUG:boto:path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.723 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.723 DEBUG:boto:Method: GET 2024-04-16T17:47:03.723 DEBUG:boto:Path: /cjqttm-8/?prefix=.o 2024-04-16T17:47:03.723 DEBUG:boto:Data: 2024-04-16T17:47:03.723 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.723 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.723 DEBUG:boto:Params: {} 2024-04-16T17:47:03.723 DEBUG:boto:Token: None 2024-04-16T17:47:03.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e8eb2817a999794-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.775 DEBUG:boto:b'cjqttm-8.o1000false.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.776 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.776 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.776 DEBUG:boto:path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.776 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.776 DEBUG:boto:Method: GET 2024-04-16T17:47:03.776 DEBUG:boto:Path: /cjqttm-8/?prefix=.o 2024-04-16T17:47:03.776 DEBUG:boto:Data: 2024-04-16T17:47:03.776 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.777 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.777 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.777 DEBUG:boto:Params: {} 2024-04-16T17:47:03.777 DEBUG:boto:Token: None 2024-04-16T17:47:03.777 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.781 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000abd8ca859c4f988c-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.782 DEBUG:boto:b'cjqttm-8.o1000false.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.783 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.783 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.783 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.783 DEBUG:boto:Path: /cjqttm-8/.o 2024-04-16T17:47:03.783 DEBUG:boto:Data: 2024-04-16T17:47:03.783 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.783 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.784 DEBUG:boto:Params: {} 2024-04-16T17:47:03.784 DEBUG:boto:Token: None 2024-04-16T17:47:03.784 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o 2024-04-16T17:47:03.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MBZBKdXHBWr/NADr2/qFFs06gnE= 2024-04-16T17:47:03.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MBZBKdXHBWr/NADr2/qFFs06gnE=', 'Content-Length': '0'} 2024-04-16T17:47:03.786 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b201b947d6522a97-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.787 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.787 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.787 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.787 DEBUG:boto:Path: /cjqttm-8/.o 2024-04-16T17:47:03.787 DEBUG:boto:Data: 2024-04-16T17:47:03.787 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.787 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.788 DEBUG:boto:Params: {} 2024-04-16T17:47:03.788 DEBUG:boto:Token: None 2024-04-16T17:47:03.788 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o 2024-04-16T17:47:03.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MBZBKdXHBWr/NADr2/qFFs06gnE= 2024-04-16T17:47:03.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MBZBKdXHBWr/NADr2/qFFs06gnE=', 'Content-Length': '0'} 2024-04-16T17:47:03.790 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000040155606f13179b4-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.790 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o 2024-04-16T17:47:03.791 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.791 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.791 DEBUG:boto:Method: GET 2024-04-16T17:47:03.791 DEBUG:boto:Path: /cjqttm-8/.o 2024-04-16T17:47:03.791 DEBUG:boto:Data: 2024-04-16T17:47:03.791 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.791 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.791 DEBUG:boto:Params: {} 2024-04-16T17:47:03.791 DEBUG:boto:Token: None 2024-04-16T17:47:03.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o 2024-04-16T17:47:03.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qeWVbm0wudxeOVBQmnnBaUSINWo= 2024-04-16T17:47:03.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qeWVbm0wudxeOVBQmnnBaUSINWo=', 'Content-Length': '0'} 2024-04-16T17:47:03.795 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d4679693e802ad24-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.797 DEBUG:boto:path=/cjqttm-8/.o 2024-04-16T17:47:03.797 DEBUG:boto:auth_path=/cjqttm-8/.o 2024-04-16T17:47:03.797 DEBUG:boto:Method: GET 2024-04-16T17:47:03.797 DEBUG:boto:Path: /cjqttm-8/.o 2024-04-16T17:47:03.797 DEBUG:boto:Data: 2024-04-16T17:47:03.797 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.797 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.797 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.798 DEBUG:boto:Params: {} 2024-04-16T17:47:03.798 DEBUG:boto:Token: None 2024-04-16T17:47:03.798 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o 2024-04-16T17:47:03.798 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qeWVbm0wudxeOVBQmnnBaUSINWo= 2024-04-16T17:47:03.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qeWVbm0wudxeOVBQmnnBaUSINWo=', 'Content-Length': '0'} 2024-04-16T17:47:03.801 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007f8a6db4b4292063-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.842 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.843 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.843 DEBUG:boto:path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.846 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.846 DEBUG:boto:Method: GET 2024-04-16T17:47:03.846 DEBUG:boto:Path: /cjqttm-8/?prefix=.o 2024-04-16T17:47:03.846 DEBUG:boto:Data: 2024-04-16T17:47:03.847 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.847 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.847 DEBUG:boto:Params: {} 2024-04-16T17:47:03.848 DEBUG:boto:Token: None 2024-04-16T17:47:03.848 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.849 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4e375174eadf817-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.853 DEBUG:boto:b'cjqttm-8.o1000false.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.853 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.853 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.853 DEBUG:boto:path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.854 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o 2024-04-16T17:47:03.854 DEBUG:boto:Method: GET 2024-04-16T17:47:03.854 DEBUG:boto:Path: /cjqttm-8/?prefix=.o 2024-04-16T17:47:03.854 DEBUG:boto:Data: 2024-04-16T17:47:03.854 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.854 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.854 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.854 DEBUG:boto:Params: {} 2024-04-16T17:47:03.854 DEBUG:boto:Token: None 2024-04-16T17:47:03.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.859 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd5fe5fe706d1a37-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.861 DEBUG:boto:b'cjqttm-8.o1000false.o2024-04-16T17:46:46.295Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-16T17:47:03.861 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.861 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.862 DEBUG:boto:path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.862 DEBUG:boto:auth_path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.862 DEBUG:boto:Method: GET 2024-04-16T17:47:03.862 DEBUG:boto:Path: /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.862 DEBUG:boto:Data: 2024-04-16T17:47:03.862 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.862 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.862 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.862 DEBUG:boto:Params: {} 2024-04-16T17:47:03.862 DEBUG:boto:Token: None 2024-04-16T17:47:03.863 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE= 2024-04-16T17:47:03.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE=', 'Content-Length': '0'} 2024-04-16T17:47:03.865 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f5cb5aff1c5c98f7-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.906 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.907 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.907 DEBUG:boto:path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.907 DEBUG:boto:auth_path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.907 DEBUG:boto:Method: GET 2024-04-16T17:47:03.907 DEBUG:boto:Path: /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.907 DEBUG:boto:Data: 2024-04-16T17:47:03.907 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.907 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.908 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.908 DEBUG:boto:Params: {} 2024-04-16T17:47:03.908 DEBUG:boto:Token: None 2024-04-16T17:47:03.908 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE= 2024-04-16T17:47:03.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE=', 'Content-Length': '0'} 2024-04-16T17:47:03.911 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a22b005ae19f1d30-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.912 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.912 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.912 DEBUG:boto:path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.912 DEBUG:boto:auth_path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.912 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.912 DEBUG:boto:Path: /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.912 DEBUG:boto:Data: 2024-04-16T17:47:03.912 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.912 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.913 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.913 DEBUG:boto:Params: {} 2024-04-16T17:47:03.913 DEBUG:boto:Token: None 2024-04-16T17:47:03.913 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.913 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eqlWn26c3QVfz3WJLXSGCxy3L2I= 2024-04-16T17:47:03.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eqlWn26c3QVfz3WJLXSGCxy3L2I=', 'Content-Length': '0'} 2024-04-16T17:47:03.915 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4d05c0b0357968c-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.916 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.916 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.916 DEBUG:boto:path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.916 DEBUG:boto:auth_path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.916 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.916 DEBUG:boto:Path: /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.916 DEBUG:boto:Data: 2024-04-16T17:47:03.916 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.917 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.917 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.917 DEBUG:boto:Params: {} 2024-04-16T17:47:03.917 DEBUG:boto:Token: None 2024-04-16T17:47:03.917 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.917 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eqlWn26c3QVfz3WJLXSGCxy3L2I= 2024-04-16T17:47:03.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eqlWn26c3QVfz3WJLXSGCxy3L2I=', 'Content-Length': '0'} 2024-04-16T17:47:03.919 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005a370344ba94a414-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-16T17:47:03.920 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.920 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.920 DEBUG:boto:path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.920 DEBUG:boto:auth_path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.920 DEBUG:boto:Method: GET 2024-04-16T17:47:03.920 DEBUG:boto:Path: /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.920 DEBUG:boto:Data: 2024-04-16T17:47:03.920 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.920 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.920 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.921 DEBUG:boto:Params: {} 2024-04-16T17:47:03.921 DEBUG:boto:Token: None 2024-04-16T17:47:03.921 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.921 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE= 2024-04-16T17:47:03.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE=', 'Content-Length': '0'} 2024-04-16T17:47:03.923 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b4cf283bc57b1bff-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.924 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.924 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.924 DEBUG:boto:path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.924 DEBUG:boto:auth_path=/cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.924 DEBUG:boto:Method: GET 2024-04-16T17:47:03.924 DEBUG:boto:Path: /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.924 DEBUG:boto:Data: 2024-04-16T17:47:03.924 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.925 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.925 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.925 DEBUG:boto:Params: {} 2024-04-16T17:47:03.925 DEBUG:boto:Token: None 2024-04-16T17:47:03.925 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o.?versionId=null 2024-04-16T17:47:03.925 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE= 2024-04-16T17:47:03.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmRWIJvg+6zGDRv/U6eE9hP1THE=', 'Content-Length': '0'} 2024-04-16T17:47:03.927 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000acb334299f82571-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.971 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.971 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.971 DEBUG:boto:path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:03.971 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:03.971 DEBUG:boto:Method: GET 2024-04-16T17:47:03.971 DEBUG:boto:Path: /cjqttm-8/?prefix=.o. 2024-04-16T17:47:03.971 DEBUG:boto:Data: 2024-04-16T17:47:03.971 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.972 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.972 DEBUG:boto:Params: {} 2024-04-16T17:47:03.972 DEBUG:boto:Token: None 2024-04-16T17:47:03.972 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.974 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab7e08d810f7d388-00661eb997-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.975 DEBUG:boto:b'cjqttm-8.o.1000false.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.975 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:03.975 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:03.975 DEBUG:boto:path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:03.975 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:03.975 DEBUG:boto:Method: GET 2024-04-16T17:47:03.975 DEBUG:boto:Path: /cjqttm-8/?prefix=.o. 2024-04-16T17:47:03.976 DEBUG:boto:Data: 2024-04-16T17:47:03.976 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.976 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.976 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.976 DEBUG:boto:Params: {} 2024-04-16T17:47:03.976 DEBUG:boto:Token: None 2024-04-16T17:47:03.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/ 2024-04-16T17:47:03.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0= 2024-04-16T17:47:03.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J7Umr1TEHo0aAxM4bm+PexXvvA0=', 'Content-Length': '0'} 2024-04-16T17:47:03.979 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1a60523eea1fde1-00661eb997-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.979 DEBUG:boto:b'cjqttm-8.o.1000false.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:03.979 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.979 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.979 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.980 DEBUG:boto:Path: /cjqttm-8/.o. 2024-04-16T17:47:03.980 DEBUG:boto:Data: 2024-04-16T17:47:03.980 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.980 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.980 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.980 DEBUG:boto:Params: {} 2024-04-16T17:47:03.980 DEBUG:boto:Token: None 2024-04-16T17:47:03.980 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o. 2024-04-16T17:47:03.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LGyvpzbLx8gazva0WDmqea1tN0= 2024-04-16T17:47:03.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LGyvpzbLx8gazva0WDmqea1tN0=', 'Content-Length': '0'} 2024-04-16T17:47:03.982 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000d043441e9f53014-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.982 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.983 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.983 DEBUG:boto:Method: HEAD 2024-04-16T17:47:03.983 DEBUG:boto:Path: /cjqttm-8/.o. 2024-04-16T17:47:03.983 DEBUG:boto:Data: 2024-04-16T17:47:03.983 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:03.983 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.983 DEBUG:boto:Params: {} 2024-04-16T17:47:03.983 DEBUG:boto:Token: None 2024-04-16T17:47:03.983 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o. 2024-04-16T17:47:03.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LGyvpzbLx8gazva0WDmqea1tN0= 2024-04-16T17:47:03.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LGyvpzbLx8gazva0WDmqea1tN0=', 'Content-Length': '0'} 2024-04-16T17:47:03.985 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006f9c5c7fc689f7ba-00661eb997-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:03.986 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=.o. 2024-04-16T17:47:03.986 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:03.986 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:03.986 DEBUG:boto:Method: GET 2024-04-16T17:47:03.986 DEBUG:boto:Path: /cjqttm-8/.o. 2024-04-16T17:47:03.986 DEBUG:boto:Data: 2024-04-16T17:47:03.986 DEBUG:boto:Headers: {} 2024-04-16T17:47:03.986 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:03.986 DEBUG:boto:Port: 8000 2024-04-16T17:47:03.987 DEBUG:boto:Params: {} 2024-04-16T17:47:03.987 DEBUG:boto:Token: None 2024-04-16T17:47:03.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:03 GMT /cjqttm-8/.o. 2024-04-16T17:47:03.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bODT5G6YN6Drn1SB8nQEq8MFFsQ= 2024-04-16T17:47:03.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bODT5G6YN6Drn1SB8nQEq8MFFsQ=', 'Content-Length': '0'} 2024-04-16T17:47:03.989 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e5b4ae04db4a588d-00661eb997-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.030 DEBUG:boto:path=/cjqttm-8/.o. 2024-04-16T17:47:04.030 DEBUG:boto:auth_path=/cjqttm-8/.o. 2024-04-16T17:47:04.031 DEBUG:boto:Method: GET 2024-04-16T17:47:04.031 DEBUG:boto:Path: /cjqttm-8/.o. 2024-04-16T17:47:04.031 DEBUG:boto:Data: 2024-04-16T17:47:04.031 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.031 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.031 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.031 DEBUG:boto:Params: {} 2024-04-16T17:47:04.031 DEBUG:boto:Token: None 2024-04-16T17:47:04.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/.o. 2024-04-16T17:47:04.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YaZ50fDfKliP0jUElAg6lS5Redg= 2024-04-16T17:47:04.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YaZ50fDfKliP0jUElAg6lS5Redg=', 'Content-Length': '0'} 2024-04-16T17:47:04.033 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e43b8b2d71723fe5-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.034 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.034 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.034 DEBUG:boto:path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:04.034 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:04.034 DEBUG:boto:Method: GET 2024-04-16T17:47:04.034 DEBUG:boto:Path: /cjqttm-8/?prefix=.o. 2024-04-16T17:47:04.034 DEBUG:boto:Data: 2024-04-16T17:47:04.034 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.034 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.034 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.035 DEBUG:boto:Params: {} 2024-04-16T17:47:04.035 DEBUG:boto:Token: None 2024-04-16T17:47:04.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025d16dfa99d1a3ff-00661eb998-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.037 DEBUG:boto:b'cjqttm-8.o.1000false.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.037 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.038 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.038 DEBUG:boto:path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:04.038 DEBUG:boto:auth_path=/cjqttm-8/?prefix=.o. 2024-04-16T17:47:04.038 DEBUG:boto:Method: GET 2024-04-16T17:47:04.038 DEBUG:boto:Path: /cjqttm-8/?prefix=.o. 2024-04-16T17:47:04.038 DEBUG:boto:Data: 2024-04-16T17:47:04.038 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.038 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.038 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.038 DEBUG:boto:Params: {} 2024-04-16T17:47:04.038 DEBUG:boto:Token: None 2024-04-16T17:47:04.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cccdb6ebf81506c8-00661eb998-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.041 DEBUG:boto:b'cjqttm-8.o.1000false.o.2024-04-16T17:46:46.305Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.042 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-16T17:47:04.042 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.042 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.042 DEBUG:boto:path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.042 DEBUG:boto:auth_path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.042 DEBUG:boto:Method: GET 2024-04-16T17:47:04.042 DEBUG:boto:Path: /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.042 DEBUG:boto:Data: 2024-04-16T17:47:04.043 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.043 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.043 DEBUG:boto:Params: {} 2024-04-16T17:47:04.043 DEBUG:boto:Token: None 2024-04-16T17:47:04.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M= 2024-04-16T17:47:04.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M=', 'Content-Length': '0'} 2024-04-16T17:47:04.045 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000905deb79caa9272-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.045 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.045 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.045 DEBUG:boto:path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.045 DEBUG:boto:auth_path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.046 DEBUG:boto:Method: GET 2024-04-16T17:47:04.046 DEBUG:boto:Path: /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.046 DEBUG:boto:Data: 2024-04-16T17:47:04.046 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.046 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.046 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.046 DEBUG:boto:Params: {} 2024-04-16T17:47:04.046 DEBUG:boto:Token: None 2024-04-16T17:47:04.046 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M= 2024-04-16T17:47:04.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M=', 'Content-Length': '0'} 2024-04-16T17:47:04.048 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a1b2084657b4e947-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.049 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.049 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.049 DEBUG:boto:path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.049 DEBUG:boto:auth_path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.049 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.049 DEBUG:boto:Path: /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.049 DEBUG:boto:Data: 2024-04-16T17:47:04.049 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.049 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.049 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.050 DEBUG:boto:Params: {} 2024-04-16T17:47:04.050 DEBUG:boto:Token: None 2024-04-16T17:47:04.050 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.050 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Gf3hI7KX9x72BoqVFw0l7vte+NQ= 2024-04-16T17:47:04.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gf3hI7KX9x72BoqVFw0l7vte+NQ=', 'Content-Length': '0'} 2024-04-16T17:47:04.052 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000049531ded3a583f50-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.052 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.052 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.052 DEBUG:boto:path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.052 DEBUG:boto:auth_path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.053 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.053 DEBUG:boto:Path: /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.053 DEBUG:boto:Data: 2024-04-16T17:47:04.053 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.053 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.053 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.053 DEBUG:boto:Params: {} 2024-04-16T17:47:04.053 DEBUG:boto:Token: None 2024-04-16T17:47:04.053 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.053 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Gf3hI7KX9x72BoqVFw0l7vte+NQ= 2024-04-16T17:47:04.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gf3hI7KX9x72BoqVFw0l7vte+NQ=', 'Content-Length': '0'} 2024-04-16T17:47:04.055 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002f2d6859df86ebb4-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-16T17:47:04.056 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.056 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.056 DEBUG:boto:path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.056 DEBUG:boto:auth_path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.056 DEBUG:boto:Method: GET 2024-04-16T17:47:04.056 DEBUG:boto:Path: /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.056 DEBUG:boto:Data: 2024-04-16T17:47:04.056 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.056 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.056 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.057 DEBUG:boto:Params: {} 2024-04-16T17:47:04.057 DEBUG:boto:Token: None 2024-04-16T17:47:04.057 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.057 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M= 2024-04-16T17:47:04.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M=', 'Content-Length': '0'} 2024-04-16T17:47:04.059 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000339f9d9819c90e2f-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.059 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.059 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.059 DEBUG:boto:path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.059 DEBUG:boto:auth_path=/cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.060 DEBUG:boto:Method: GET 2024-04-16T17:47:04.060 DEBUG:boto:Path: /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.060 DEBUG:boto:Data: 2024-04-16T17:47:04.060 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.060 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.060 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.060 DEBUG:boto:Params: {} 2024-04-16T17:47:04.060 DEBUG:boto:Token: None 2024-04-16T17:47:04.060 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A?versionId=null 2024-04-16T17:47:04.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M= 2024-04-16T17:47:04.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WLbklaEWgQfkbetOkUrd1CjNL1M=', 'Content-Length': '0'} 2024-04-16T17:47:04.062 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009268fbe70b42677e-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.106 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.107 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.107 DEBUG:boto:path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.107 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.107 DEBUG:boto:Method: GET 2024-04-16T17:47:04.107 DEBUG:boto:Path: /cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.107 DEBUG:boto:Data: 2024-04-16T17:47:04.107 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.107 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.107 DEBUG:boto:Params: {} 2024-04-16T17:47:04.108 DEBUG:boto:Token: None 2024-04-16T17:47:04.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.110 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a21349af384a8d05-00661eb998-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.110 DEBUG:boto:b'cjqttm-8:1000false:2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.111 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.111 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.111 DEBUG:boto:path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.111 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.111 DEBUG:boto:Method: GET 2024-04-16T17:47:04.111 DEBUG:boto:Path: /cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.112 DEBUG:boto:Data: 2024-04-16T17:47:04.112 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.112 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.112 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.112 DEBUG:boto:Params: {} 2024-04-16T17:47:04.112 DEBUG:boto:Token: None 2024-04-16T17:47:04.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067b9b5e503c475d5-00661eb998-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.115 DEBUG:boto:b'cjqttm-8:1000false:2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.115 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.115 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.115 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.115 DEBUG:boto:Path: /cjqttm-8/%3A 2024-04-16T17:47:04.115 DEBUG:boto:Data: 2024-04-16T17:47:04.115 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.115 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.116 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.116 DEBUG:boto:Params: {} 2024-04-16T17:47:04.116 DEBUG:boto:Token: None 2024-04-16T17:47:04.116 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A 2024-04-16T17:47:04.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tIUJGXhAOBXWzd5SXiaBQtchAyg= 2024-04-16T17:47:04.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tIUJGXhAOBXWzd5SXiaBQtchAyg=', 'Content-Length': '0'} 2024-04-16T17:47:04.118 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000006bcd17411c33017-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.118 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.118 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.118 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.118 DEBUG:boto:Path: /cjqttm-8/%3A 2024-04-16T17:47:04.118 DEBUG:boto:Data: 2024-04-16T17:47:04.119 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.119 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.119 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.119 DEBUG:boto:Params: {} 2024-04-16T17:47:04.119 DEBUG:boto:Token: None 2024-04-16T17:47:04.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A 2024-04-16T17:47:04.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tIUJGXhAOBXWzd5SXiaBQtchAyg= 2024-04-16T17:47:04.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tIUJGXhAOBXWzd5SXiaBQtchAyg=', 'Content-Length': '0'} 2024-04-16T17:47:04.121 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003292cd83bd9aab54-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2024-04-16T17:47:04.121 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.121 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.121 DEBUG:boto:Method: GET 2024-04-16T17:47:04.121 DEBUG:boto:Path: /cjqttm-8/%3A 2024-04-16T17:47:04.122 DEBUG:boto:Data: 2024-04-16T17:47:04.122 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.122 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.122 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.122 DEBUG:boto:Params: {} 2024-04-16T17:47:04.122 DEBUG:boto:Token: None 2024-04-16T17:47:04.122 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A 2024-04-16T17:47:04.122 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q95ZLm3a1PQx2ldQNgTpY7goUxM= 2024-04-16T17:47:04.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q95ZLm3a1PQx2ldQNgTpY7goUxM=', 'Content-Length': '0'} 2024-04-16T17:47:04.124 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000074be2e1c10936815-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.124 DEBUG:boto:path=/cjqttm-8/%3A 2024-04-16T17:47:04.124 DEBUG:boto:auth_path=/cjqttm-8/%3A 2024-04-16T17:47:04.125 DEBUG:boto:Method: GET 2024-04-16T17:47:04.125 DEBUG:boto:Path: /cjqttm-8/%3A 2024-04-16T17:47:04.125 DEBUG:boto:Data: 2024-04-16T17:47:04.125 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.125 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.125 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.125 DEBUG:boto:Params: {} 2024-04-16T17:47:04.125 DEBUG:boto:Token: None 2024-04-16T17:47:04.125 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/%3A 2024-04-16T17:47:04.126 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q95ZLm3a1PQx2ldQNgTpY7goUxM= 2024-04-16T17:47:04.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q95ZLm3a1PQx2ldQNgTpY7goUxM=', 'Content-Length': '0'} 2024-04-16T17:47:04.127 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000076cf2df15c679e6b-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.128 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.128 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.128 DEBUG:boto:path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.128 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.128 DEBUG:boto:Method: GET 2024-04-16T17:47:04.128 DEBUG:boto:Path: /cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.128 DEBUG:boto:Data: 2024-04-16T17:47:04.128 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.128 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.129 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.129 DEBUG:boto:Params: {} 2024-04-16T17:47:04.129 DEBUG:boto:Token: None 2024-04-16T17:47:04.129 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.129 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.131 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094245af96d125c1e-00661eb998-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.132 DEBUG:boto:b'cjqttm-8:1000false:2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.132 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.132 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.132 DEBUG:boto:path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.132 DEBUG:boto:auth_path=/cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.132 DEBUG:boto:Method: GET 2024-04-16T17:47:04.132 DEBUG:boto:Path: /cjqttm-8/?prefix=%3A 2024-04-16T17:47:04.133 DEBUG:boto:Data: 2024-04-16T17:47:04.133 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.133 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.133 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.133 DEBUG:boto:Params: {} 2024-04-16T17:47:04.133 DEBUG:boto:Token: None 2024-04-16T17:47:04.133 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.133 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.135 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088facf53709a00af-00661eb998-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.178 DEBUG:boto:b'cjqttm-8:1000false:2024-04-16T17:46:46.161Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-16T17:47:04.179 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.179 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.179 DEBUG:boto:path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.179 DEBUG:boto:auth_path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.179 DEBUG:boto:Method: GET 2024-04-16T17:47:04.179 DEBUG:boto:Path: /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.180 DEBUG:boto:Data: 2024-04-16T17:47:04.180 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.180 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.180 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.180 DEBUG:boto:Params: {} 2024-04-16T17:47:04.180 DEBUG:boto:Token: None 2024-04-16T17:47:04.180 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY= 2024-04-16T17:47:04.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY=', 'Content-Length': '0'} 2024-04-16T17:47:04.183 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000a1bcab524c38356-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.183 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.183 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.183 DEBUG:boto:path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.183 DEBUG:boto:auth_path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.184 DEBUG:boto:Method: GET 2024-04-16T17:47:04.184 DEBUG:boto:Path: /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.184 DEBUG:boto:Data: 2024-04-16T17:47:04.184 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.184 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.184 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.184 DEBUG:boto:Params: {} 2024-04-16T17:47:04.184 DEBUG:boto:Token: None 2024-04-16T17:47:04.184 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY= 2024-04-16T17:47:04.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY=', 'Content-Length': '0'} 2024-04-16T17:47:04.187 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fdaf5dca11b39263-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.187 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.187 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.187 DEBUG:boto:path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.187 DEBUG:boto:auth_path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.187 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.187 DEBUG:boto:Path: /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.188 DEBUG:boto:Data: 2024-04-16T17:47:04.188 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.188 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.188 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.188 DEBUG:boto:Params: {} 2024-04-16T17:47:04.188 DEBUG:boto:Token: None 2024-04-16T17:47:04.188 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4USEjwDL2y80+X0qSW1E0bzKA34= 2024-04-16T17:47:04.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4USEjwDL2y80+X0qSW1E0bzKA34=', 'Content-Length': '0'} 2024-04-16T17:47:04.191 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bf8d06598906b5b0-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.191 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.191 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.191 DEBUG:boto:path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.191 DEBUG:boto:auth_path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.191 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.191 DEBUG:boto:Path: /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.191 DEBUG:boto:Data: 2024-04-16T17:47:04.191 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.192 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.192 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.192 DEBUG:boto:Params: {} 2024-04-16T17:47:04.192 DEBUG:boto:Token: None 2024-04-16T17:47:04.192 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4USEjwDL2y80+X0qSW1E0bzKA34= 2024-04-16T17:47:04.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4USEjwDL2y80+X0qSW1E0bzKA34=', 'Content-Length': '0'} 2024-04-16T17:47:04.194 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005decb74e483b8f21-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-16T17:47:04.195 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.195 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.195 DEBUG:boto:path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.195 DEBUG:boto:auth_path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.195 DEBUG:boto:Method: GET 2024-04-16T17:47:04.195 DEBUG:boto:Path: /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.195 DEBUG:boto:Data: 2024-04-16T17:47:04.195 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.195 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.195 DEBUG:boto:Params: {} 2024-04-16T17:47:04.196 DEBUG:boto:Token: None 2024-04-16T17:47:04.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY= 2024-04-16T17:47:04.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY=', 'Content-Length': '0'} 2024-04-16T17:47:04.198 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000b7d0a5c4e726006-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.238 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.239 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.239 DEBUG:boto:path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.239 DEBUG:boto:auth_path=/cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.239 DEBUG:boto:Method: GET 2024-04-16T17:47:04.239 DEBUG:boto:Path: /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.239 DEBUG:boto:Data: 2024-04-16T17:47:04.239 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.239 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.239 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.239 DEBUG:boto:Params: {} 2024-04-16T17:47:04.240 DEBUG:boto:Token: None 2024-04-16T17:47:04.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj?versionId=null 2024-04-16T17:47:04.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY= 2024-04-16T17:47:04.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SRk9Vvk4ifaKfIhTqmWV/WjNgkY=', 'Content-Length': '0'} 2024-04-16T17:47:04.242 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b89806b1277e889-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.242 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.242 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.242 DEBUG:boto:path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.242 DEBUG:boto:auth_path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.243 DEBUG:boto:Method: GET 2024-04-16T17:47:04.243 DEBUG:boto:Path: /cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.243 DEBUG:boto:Data: 2024-04-16T17:47:04.243 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.243 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.243 DEBUG:boto:Params: {} 2024-04-16T17:47:04.243 DEBUG:boto:Token: None 2024-04-16T17:47:04.243 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc989a813b300ea3-00661eb998-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.246 DEBUG:boto:b'cjqttm-8_myobj1000false_myobj2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.246 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.246 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.246 DEBUG:boto:path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.246 DEBUG:boto:auth_path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.246 DEBUG:boto:Method: GET 2024-04-16T17:47:04.247 DEBUG:boto:Path: /cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.247 DEBUG:boto:Data: 2024-04-16T17:47:04.247 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.247 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.247 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.247 DEBUG:boto:Params: {} 2024-04-16T17:47:04.247 DEBUG:boto:Token: None 2024-04-16T17:47:04.247 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.250 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f22d66cbbcbde584-00661eb998-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.250 DEBUG:boto:b'cjqttm-8_myobj1000false_myobj2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.250 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.250 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.254 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.254 DEBUG:boto:Path: /cjqttm-8/_myobj 2024-04-16T17:47:04.254 DEBUG:boto:Data: 2024-04-16T17:47:04.254 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.254 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.254 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.254 DEBUG:boto:Params: {} 2024-04-16T17:47:04.255 DEBUG:boto:Token: None 2024-04-16T17:47:04.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj 2024-04-16T17:47:04.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v+fRKRs7QutirFEAa3U/QXSvavI= 2024-04-16T17:47:04.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v+fRKRs7QutirFEAa3U/QXSvavI=', 'Content-Length': '0'} 2024-04-16T17:47:04.257 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a3a94c0570d93d81-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.257 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.257 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.258 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.258 DEBUG:boto:Path: /cjqttm-8/_myobj 2024-04-16T17:47:04.258 DEBUG:boto:Data: 2024-04-16T17:47:04.258 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.258 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.258 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.258 DEBUG:boto:Params: {} 2024-04-16T17:47:04.258 DEBUG:boto:Token: None 2024-04-16T17:47:04.258 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj 2024-04-16T17:47:04.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v+fRKRs7QutirFEAa3U/QXSvavI= 2024-04-16T17:47:04.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v+fRKRs7QutirFEAa3U/QXSvavI=', 'Content-Length': '0'} 2024-04-16T17:47:04.260 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003c1c72ebef08bd2c-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2024-04-16T17:47:04.261 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.261 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.261 DEBUG:boto:Method: GET 2024-04-16T17:47:04.261 DEBUG:boto:Path: /cjqttm-8/_myobj 2024-04-16T17:47:04.261 DEBUG:boto:Data: 2024-04-16T17:47:04.261 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.261 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.262 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.262 DEBUG:boto:Params: {} 2024-04-16T17:47:04.262 DEBUG:boto:Token: None 2024-04-16T17:47:04.262 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj 2024-04-16T17:47:04.262 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PgwHFx+aSWpueY3dKG5VducSWC8= 2024-04-16T17:47:04.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PgwHFx+aSWpueY3dKG5VducSWC8=', 'Content-Length': '0'} 2024-04-16T17:47:04.264 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:59 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000058e25f99085c4efe-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.265 DEBUG:boto:path=/cjqttm-8/_myobj 2024-04-16T17:47:04.265 DEBUG:boto:auth_path=/cjqttm-8/_myobj 2024-04-16T17:47:04.265 DEBUG:boto:Method: GET 2024-04-16T17:47:04.265 DEBUG:boto:Path: /cjqttm-8/_myobj 2024-04-16T17:47:04.265 DEBUG:boto:Data: 2024-04-16T17:47:04.265 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.265 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.265 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.265 DEBUG:boto:Params: {} 2024-04-16T17:47:04.265 DEBUG:boto:Token: None 2024-04-16T17:47:04.266 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/_myobj 2024-04-16T17:47:04.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PgwHFx+aSWpueY3dKG5VducSWC8= 2024-04-16T17:47:04.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PgwHFx+aSWpueY3dKG5VducSWC8=', 'Content-Length': '0'} 2024-04-16T17:47:04.268 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000502c11e439e630bc-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.268 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.268 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.268 DEBUG:boto:path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.269 DEBUG:boto:auth_path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.269 DEBUG:boto:Method: GET 2024-04-16T17:47:04.269 DEBUG:boto:Path: /cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.269 DEBUG:boto:Data: 2024-04-16T17:47:04.269 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.269 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.269 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.269 DEBUG:boto:Params: {} 2024-04-16T17:47:04.269 DEBUG:boto:Token: None 2024-04-16T17:47:04.269 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.269 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.272 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a3dd1f0584d6fa5-00661eb998-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.272 DEBUG:boto:b'cjqttm-8_myobj1000false_myobj2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.272 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.272 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.273 DEBUG:boto:path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.273 DEBUG:boto:auth_path=/cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.273 DEBUG:boto:Method: GET 2024-04-16T17:47:04.273 DEBUG:boto:Path: /cjqttm-8/?prefix=_myobj 2024-04-16T17:47:04.273 DEBUG:boto:Data: 2024-04-16T17:47:04.273 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.273 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.273 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.273 DEBUG:boto:Params: {} 2024-04-16T17:47:04.273 DEBUG:boto:Token: None 2024-04-16T17:47:04.274 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.274 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.276 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f44ae26eefa170f-00661eb998-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.276 DEBUG:boto:b'cjqttm-8_myobj1000false_myobj2024-04-16T17:46:46.111Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.276 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:04.277 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.277 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.277 DEBUG:boto:path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.277 DEBUG:boto:auth_path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.277 DEBUG:boto:Method: GET 2024-04-16T17:47:04.277 DEBUG:boto:Path: /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.277 DEBUG:boto:Data: 2024-04-16T17:47:04.277 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.277 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.277 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.277 DEBUG:boto:Params: {} 2024-04-16T17:47:04.278 DEBUG:boto:Token: None 2024-04-16T17:47:04.278 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.278 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA= 2024-04-16T17:47:04.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA=', 'Content-Length': '0'} 2024-04-16T17:47:04.280 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e2f5811ebc0da940-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.280 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.280 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.280 DEBUG:boto:path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.280 DEBUG:boto:auth_path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.280 DEBUG:boto:Method: GET 2024-04-16T17:47:04.281 DEBUG:boto:Path: /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.281 DEBUG:boto:Data: 2024-04-16T17:47:04.281 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.281 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.281 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.281 DEBUG:boto:Params: {} 2024-04-16T17:47:04.281 DEBUG:boto:Token: None 2024-04-16T17:47:04.281 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.281 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA= 2024-04-16T17:47:04.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA=', 'Content-Length': '0'} 2024-04-16T17:47:04.283 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009e716e04581888dd-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.283 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.283 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.284 DEBUG:boto:path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.284 DEBUG:boto:auth_path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.284 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.284 DEBUG:boto:Path: /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.284 DEBUG:boto:Data: 2024-04-16T17:47:04.284 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.284 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.284 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.284 DEBUG:boto:Params: {} 2024-04-16T17:47:04.284 DEBUG:boto:Token: None 2024-04-16T17:47:04.284 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hccYp4xyikv9/KLsRtTs2TqBe/c= 2024-04-16T17:47:04.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hccYp4xyikv9/KLsRtTs2TqBe/c=', 'Content-Length': '0'} 2024-04-16T17:47:04.286 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000019157c56bed6d187-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.287 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.287 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.287 DEBUG:boto:path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.287 DEBUG:boto:auth_path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.287 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.287 DEBUG:boto:Path: /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.287 DEBUG:boto:Data: 2024-04-16T17:47:04.287 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.288 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.288 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.288 DEBUG:boto:Params: {} 2024-04-16T17:47:04.288 DEBUG:boto:Token: None 2024-04-16T17:47:04.288 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hccYp4xyikv9/KLsRtTs2TqBe/c= 2024-04-16T17:47:04.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hccYp4xyikv9/KLsRtTs2TqBe/c=', 'Content-Length': '0'} 2024-04-16T17:47:04.290 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f5bfc880ad0dc680-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:04.290 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.290 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.290 DEBUG:boto:path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.290 DEBUG:boto:auth_path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.291 DEBUG:boto:Method: GET 2024-04-16T17:47:04.291 DEBUG:boto:Path: /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.291 DEBUG:boto:Data: 2024-04-16T17:47:04.291 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.291 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.291 DEBUG:boto:Params: {} 2024-04-16T17:47:04.291 DEBUG:boto:Token: None 2024-04-16T17:47:04.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA= 2024-04-16T17:47:04.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA=', 'Content-Length': '0'} 2024-04-16T17:47:04.293 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005f10b0c9854be080-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.334 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.334 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.334 DEBUG:boto:path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.335 DEBUG:boto:auth_path=/cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.335 DEBUG:boto:Method: GET 2024-04-16T17:47:04.335 DEBUG:boto:Path: /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.335 DEBUG:boto:Data: 2024-04-16T17:47:04.335 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.335 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.335 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.335 DEBUG:boto:Params: {} 2024-04-16T17:47:04.335 DEBUG:boto:Token: None 2024-04-16T17:47:04.335 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj?versionId=null 2024-04-16T17:47:04.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA= 2024-04-16T17:47:04.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9cEErBrsZ6GXp0oXwYINhOXFjA=', 'Content-Length': '0'} 2024-04-16T17:47:04.337 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e3a3bc7e96ccf3b3-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.338 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.338 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.338 DEBUG:boto:path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.338 DEBUG:boto:auth_path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.338 DEBUG:boto:Method: GET 2024-04-16T17:47:04.338 DEBUG:boto:Path: /cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.338 DEBUG:boto:Data: 2024-04-16T17:47:04.338 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.338 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.338 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.338 DEBUG:boto:Params: {} 2024-04-16T17:47:04.339 DEBUG:boto:Token: None 2024-04-16T17:47:04.339 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.339 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008053af6f6af8d241-00661eb998-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.341 DEBUG:boto:b'cjqttm-8myobj1000falsemyobj2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.342 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.342 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.342 DEBUG:boto:path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.342 DEBUG:boto:auth_path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.342 DEBUG:boto:Method: GET 2024-04-16T17:47:04.342 DEBUG:boto:Path: /cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.342 DEBUG:boto:Data: 2024-04-16T17:47:04.342 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.343 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.343 DEBUG:boto:Params: {} 2024-04-16T17:47:04.343 DEBUG:boto:Token: None 2024-04-16T17:47:04.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.345 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa8831489c9a6d38-00661eb998-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.346 DEBUG:boto:b'cjqttm-8myobj1000falsemyobj2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.346 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.346 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.346 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.346 DEBUG:boto:Path: /cjqttm-8/myobj 2024-04-16T17:47:04.346 DEBUG:boto:Data: 2024-04-16T17:47:04.347 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.347 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.347 DEBUG:boto:Params: {} 2024-04-16T17:47:04.347 DEBUG:boto:Token: None 2024-04-16T17:47:04.347 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj 2024-04-16T17:47:04.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5W5Uy+SADoBLqjm55UNjQcYmfUU= 2024-04-16T17:47:04.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5W5Uy+SADoBLqjm55UNjQcYmfUU=', 'Content-Length': '0'} 2024-04-16T17:47:04.349 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000c64a417150f8202-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.349 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.349 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.349 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.350 DEBUG:boto:Path: /cjqttm-8/myobj 2024-04-16T17:47:04.350 DEBUG:boto:Data: 2024-04-16T17:47:04.350 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.350 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.350 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.350 DEBUG:boto:Params: {} 2024-04-16T17:47:04.350 DEBUG:boto:Token: None 2024-04-16T17:47:04.350 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj 2024-04-16T17:47:04.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5W5Uy+SADoBLqjm55UNjQcYmfUU= 2024-04-16T17:47:04.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5W5Uy+SADoBLqjm55UNjQcYmfUU=', 'Content-Length': '0'} 2024-04-16T17:47:04.352 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000148b90b9db675a7d-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:04.353 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.353 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.353 DEBUG:boto:Method: GET 2024-04-16T17:47:04.353 DEBUG:boto:Path: /cjqttm-8/myobj 2024-04-16T17:47:04.353 DEBUG:boto:Data: 2024-04-16T17:47:04.353 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.354 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.354 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.354 DEBUG:boto:Params: {} 2024-04-16T17:47:04.354 DEBUG:boto:Token: None 2024-04-16T17:47:04.354 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj 2024-04-16T17:47:04.354 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PIzrorp/uMad8OpymSiIHevLnlA= 2024-04-16T17:47:04.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PIzrorp/uMad8OpymSiIHevLnlA=', 'Content-Length': '0'} 2024-04-16T17:47:04.356 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:46:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b5477cd47b8d9a0f-00661eb998-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.356 DEBUG:boto:path=/cjqttm-8/myobj 2024-04-16T17:47:04.357 DEBUG:boto:auth_path=/cjqttm-8/myobj 2024-04-16T17:47:04.357 DEBUG:boto:Method: GET 2024-04-16T17:47:04.357 DEBUG:boto:Path: /cjqttm-8/myobj 2024-04-16T17:47:04.357 DEBUG:boto:Data: 2024-04-16T17:47:04.357 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.357 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.357 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.357 DEBUG:boto:Params: {} 2024-04-16T17:47:04.357 DEBUG:boto:Token: None 2024-04-16T17:47:04.357 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/myobj 2024-04-16T17:47:04.358 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PIzrorp/uMad8OpymSiIHevLnlA= 2024-04-16T17:47:04.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PIzrorp/uMad8OpymSiIHevLnlA=', 'Content-Length': '0'} 2024-04-16T17:47:04.360 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:46:46 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f9df621409c66838-00661eb998-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.360 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.360 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.360 DEBUG:boto:path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.360 DEBUG:boto:auth_path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.360 DEBUG:boto:Method: GET 2024-04-16T17:47:04.360 DEBUG:boto:Path: /cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.360 DEBUG:boto:Data: 2024-04-16T17:47:04.361 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.361 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.361 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.361 DEBUG:boto:Params: {} 2024-04-16T17:47:04.361 DEBUG:boto:Token: None 2024-04-16T17:47:04.361 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.361 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000050c731e0481ba5d9-00661eb998-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.364 DEBUG:boto:b'cjqttm-8myobj1000falsemyobj2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.364 DEBUG:boto:path=/cjqttm-8/ 2024-04-16T17:47:04.364 DEBUG:boto:auth_path=/cjqttm-8/ 2024-04-16T17:47:04.365 DEBUG:boto:path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.365 DEBUG:boto:auth_path=/cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.365 DEBUG:boto:Method: GET 2024-04-16T17:47:04.365 DEBUG:boto:Path: /cjqttm-8/?prefix=myobj 2024-04-16T17:47:04.365 DEBUG:boto:Data: 2024-04-16T17:47:04.365 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.365 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.365 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.365 DEBUG:boto:Params: {} 2024-04-16T17:47:04.365 DEBUG:boto:Token: None 2024-04-16T17:47:04.366 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-8/ 2024-04-16T17:47:04.366 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c= 2024-04-16T17:47:04.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukufCj3VVMD9aItQNK3TbR1bi8c=', 'Content-Length': '0'} 2024-04-16T17:47:04.368 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b66294deaaafedbb-00661eb998-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.368 DEBUG:boto:b'cjqttm-8myobj1000falsemyobj2024-04-16T17:46:46.096Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:04.369 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-8 zones={test-zone1, test-zone2} 2024-04-16T17:47:04.369 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2024-04-16T17:47:04.370 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-9 2024-04-16T17:47:04.370 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:04.371 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:04.371 DEBUG:boto:Method: PUT 2024-04-16T17:47:04.371 DEBUG:boto:Path: /cjqttm-9/ 2024-04-16T17:47:04.371 DEBUG:boto:Data: 2024-04-16T17:47:04.371 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.371 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.371 DEBUG:boto:Params: {} 2024-04-16T17:47:04.371 DEBUG:boto:Token: None 2024-04-16T17:47:04.371 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-9/ 2024-04-16T17:47:04.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3ppnepCZxjyrVwmceVUFgmkis6c= 2024-04-16T17:47:04.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3ppnepCZxjyrVwmceVUFgmkis6c=', 'Content-Length': '0'} 2024-04-16T17:47:04.386 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a5cfff08dda3c939-00661eb998-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.387 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-10 2024-04-16T17:47:04.387 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:04.387 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:04.387 DEBUG:boto:Method: PUT 2024-04-16T17:47:04.387 DEBUG:boto:Path: /cjqttm-10/ 2024-04-16T17:47:04.387 DEBUG:boto:Data: 2024-04-16T17:47:04.387 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.387 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.387 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.387 DEBUG:boto:Params: {} 2024-04-16T17:47:04.388 DEBUG:boto:Token: None 2024-04-16T17:47:04.388 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-10/ 2024-04-16T17:47:04.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:poWhW/9g+gh5mDB840wnw1F7kCk= 2024-04-16T17:47:04.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:poWhW/9g+gh5mDB840wnw1F7kCk=', 'Content-Length': '0'} 2024-04-16T17:47:04.413 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000960e5769b6e2e81a-00661eb998-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.413 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:04.413 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:04.413 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.413 DEBUG:boto:Path: /cjqttm-9/ 2024-04-16T17:47:04.413 DEBUG:boto:Data: 2024-04-16T17:47:04.413 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.413 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.413 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.414 DEBUG:boto:Params: {} 2024-04-16T17:47:04.414 DEBUG:boto:Token: None 2024-04-16T17:47:04.414 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-9/ 2024-04-16T17:47:04.414 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MrQUjnPRG1YUxZPnIhnvMv69w2E= 2024-04-16T17:47:04.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MrQUjnPRG1YUxZPnIhnvMv69w2E=', 'Content-Length': '0'} 2024-04-16T17:47:04.416 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e77ec6614a2cbaa0-00661eb998-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.416 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:04.416 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:04.417 DEBUG:boto:Method: PUT 2024-04-16T17:47:04.417 DEBUG:boto:Path: /cjqttm-9/myobj 2024-04-16T17:47:04.417 DEBUG:boto:Data: 2024-04-16T17:47:04.417 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:04.417 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:04.417 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.417 DEBUG:boto:Params: {} 2024-04-16T17:47:04.417 DEBUG:boto:Token: None 2024-04-16T17:47:04.418 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-9/myobj 2024-04-16T17:47:04.418 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TPy8lJAQFYm3Ib5LMpwaBlsHJiI= 2024-04-16T17:47:04.418 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TPy8lJAQFYm3Ib5LMpwaBlsHJiI='} 2024-04-16T17:47:04.462 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e2202577507a737a-00661eb998-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.463 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:04.463 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:04.463 DEBUG:boto:Method: HEAD 2024-04-16T17:47:04.463 DEBUG:boto:Path: /cjqttm-10/ 2024-04-16T17:47:04.463 DEBUG:boto:Data: 2024-04-16T17:47:04.463 DEBUG:boto:Headers: {} 2024-04-16T17:47:04.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.464 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.464 DEBUG:boto:Params: {} 2024-04-16T17:47:04.464 DEBUG:boto:Token: None 2024-04-16T17:47:04.464 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-10/ 2024-04-16T17:47:04.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wbyp9vmpATTdmfkmqRRnOab08qk= 2024-04-16T17:47:04.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wbyp9vmpATTdmfkmqRRnOab08qk=', 'Content-Length': '0'} 2024-04-16T17:47:04.466 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002d1992bb1f7acc9c-00661eb998-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.467 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:04.467 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:04.467 DEBUG:boto:Method: PUT 2024-04-16T17:47:04.467 DEBUG:boto:Path: /cjqttm-10/myobj 2024-04-16T17:47:04.467 DEBUG:boto:Data: 2024-04-16T17:47:04.467 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:04.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:04.468 DEBUG:boto:Port: 8000 2024-04-16T17:47:04.468 DEBUG:boto:Params: {} 2024-04-16T17:47:04.468 DEBUG:boto:Token: None 2024-04-16T17:47:04.468 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:04 GMT /cjqttm-10/myobj 2024-04-16T17:47:04.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q6wIxESM51KBPF/UtfS+o7fYImQ= 2024-04-16T17:47:04.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q6wIxESM51KBPF/UtfS+o7fYImQ='} 2024-04-16T17:47:04.476 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000035352f7718aa5745-00661eb998-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:04.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:04.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:04.476 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:47:04.530 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:04.531 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:04.586 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:47:04.607 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289624.404919_44.1","last_update":"2024-04-16T17:47:04.404919Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:47:04.607 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289624.404919_44.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:04.607 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:47:04.608 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:04.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:04.608 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:47:04.668 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:04.668 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:04.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:04.717+0000 7fb2ad930800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:47:04.717 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:04.718+0000 7fb2ad930800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:47:04.737 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289624.397816_41.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.397816Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:04Z"} 2024-04-16T17:47:04.737 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289624.397816_41.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.397816Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:04Z"} 2024-04-16T17:47:04.737 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713289624.397816_41.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.397816Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:47:04.738 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289624.404919_44.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:04.738 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289624.397816_41.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:04.738 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713289624.404919_44.1 target=1_1713289624.397816_41.1 2024-04-16T17:47:09.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:09.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:09.740 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:47:09.795 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:09.795 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:09.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:09.849+0000 7f18e582e800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:47:09.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:09.850+0000 7f18e582e800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:47:09.870 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289624.404919_44.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.404919Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:09Z"} 2024-04-16T17:47:09.870 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289624.404919_44.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.404919Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:09Z"} 2024-04-16T17:47:09.870 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713289624.404919_44.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.404919Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:47:09.870 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289624.404919_44.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:09.870 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289624.404919_44.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:09.871 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:47:09.871 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:09.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:09.871 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:47:09.926 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:09.926 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:09.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:09.981+0000 7fac72032800 1 bucket sync caught up with source: 2024-04-16T17:47:09.980 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.6.6, , , , , , , , , ] 2024-04-16T17:47:09.980 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000001.6.6, , , , , , , , , ] 2024-04-16T17:47:09.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:09.981+0000 7fac72032800 0 bucket checkpoint complete 2024-04-16T17:47:09.999 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-9 zones={test-zone2, test-zone1} 2024-04-16T17:47:10.000 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.000 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.000 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.000 DEBUG:boto:Path: /cjqttm-9/ 2024-04-16T17:47:10.000 DEBUG:boto:Data: 2024-04-16T17:47:10.000 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.000 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.000 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.001 DEBUG:boto:Params: {} 2024-04-16T17:47:10.001 DEBUG:boto:Token: None 2024-04-16T17:47:10.001 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/ 2024-04-16T17:47:10.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hF2H3/QXGyTrpTUSJj7GSmMUSeA= 2024-04-16T17:47:10.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hF2H3/QXGyTrpTUSJj7GSmMUSeA=', 'Content-Length': '0'} 2024-04-16T17:47:10.003 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c77e5becd393f4fa-00661eb99e-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.004 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.004 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.004 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.004 DEBUG:boto:Path: /cjqttm-9/ 2024-04-16T17:47:10.004 DEBUG:boto:Data: 2024-04-16T17:47:10.004 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.004 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.005 DEBUG:boto:Params: {} 2024-04-16T17:47:10.005 DEBUG:boto:Token: None 2024-04-16T17:47:10.005 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/ 2024-04-16T17:47:10.005 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hF2H3/QXGyTrpTUSJj7GSmMUSeA= 2024-04-16T17:47:10.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hF2H3/QXGyTrpTUSJj7GSmMUSeA=', 'Content-Length': '0'} 2024-04-16T17:47:10.007 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f485b21d18d8209-00661eb99e-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.007 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:47:10.007 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.008 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.008 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.008 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.008 DEBUG:boto:Method: GET 2024-04-16T17:47:10.008 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.008 DEBUG:boto:Data: 2024-04-16T17:47:10.008 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.008 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.008 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.008 DEBUG:boto:Params: {} 2024-04-16T17:47:10.009 DEBUG:boto:Token: None 2024-04-16T17:47:10.009 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/?versions 2024-04-16T17:47:10.009 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0= 2024-04-16T17:47:10.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0=', 'Content-Length': '0'} 2024-04-16T17:47:10.011 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5a9f6bcdc6785b2-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.011 DEBUG:boto:b'cjqttm-9999falsemyobjnulltrue2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.012 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:47:10.012 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:47:10.012 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.012 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.012 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.012 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.012 DEBUG:boto:Method: GET 2024-04-16T17:47:10.012 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.012 DEBUG:boto:Data: 2024-04-16T17:47:10.013 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.013 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.013 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.013 DEBUG:boto:Params: {} 2024-04-16T17:47:10.013 DEBUG:boto:Token: None 2024-04-16T17:47:10.013 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/?versions 2024-04-16T17:47:10.013 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0= 2024-04-16T17:47:10.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0=', 'Content-Length': '0'} 2024-04-16T17:47:10.016 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae718d2a08120c43-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.016 DEBUG:boto:b'cjqttm-9999falsemyobjnulltrue2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.016 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:47:10.016 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.016 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.016 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.017 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.017 DEBUG:boto:Method: GET 2024-04-16T17:47:10.017 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.017 DEBUG:boto:Data: 2024-04-16T17:47:10.017 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.017 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.017 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.017 DEBUG:boto:Params: {} 2024-04-16T17:47:10.017 DEBUG:boto:Token: None 2024-04-16T17:47:10.017 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/?versions 2024-04-16T17:47:10.018 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0= 2024-04-16T17:47:10.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0=', 'Content-Length': '0'} 2024-04-16T17:47:10.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004c9baea9cf64dd8-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.062 DEBUG:boto:b'cjqttm-9999falsemyobjnulltrue2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.063 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.063 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.063 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.063 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.063 DEBUG:boto:Method: GET 2024-04-16T17:47:10.063 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:10.063 DEBUG:boto:Data: 2024-04-16T17:47:10.063 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.063 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.064 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.064 DEBUG:boto:Params: {} 2024-04-16T17:47:10.064 DEBUG:boto:Token: None 2024-04-16T17:47:10.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/?versions 2024-04-16T17:47:10.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0= 2024-04-16T17:47:10.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2C95utcK4XjIvyxPUy/nWBx2Wo0=', 'Content-Length': '0'} 2024-04-16T17:47:10.066 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc54075bf01102f5-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.067 DEBUG:boto:b'cjqttm-9999falsemyobjnulltrue2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.067 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:10.067 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.067 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.067 DEBUG:boto:path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.067 DEBUG:boto:auth_path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.067 DEBUG:boto:Method: GET 2024-04-16T17:47:10.068 DEBUG:boto:Path: /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.068 DEBUG:boto:Data: 2024-04-16T17:47:10.068 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.068 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.068 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.068 DEBUG:boto:Params: {} 2024-04-16T17:47:10.068 DEBUG:boto:Token: None 2024-04-16T17:47:10.068 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0= 2024-04-16T17:47:10.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0=', 'Content-Length': '0'} 2024-04-16T17:47:10.070 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000037878851e7f019f5-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.071 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.071 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.071 DEBUG:boto:path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.071 DEBUG:boto:auth_path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.071 DEBUG:boto:Method: GET 2024-04-16T17:47:10.071 DEBUG:boto:Path: /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.071 DEBUG:boto:Data: 2024-04-16T17:47:10.071 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.071 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.072 DEBUG:boto:Params: {} 2024-04-16T17:47:10.072 DEBUG:boto:Token: None 2024-04-16T17:47:10.072 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0= 2024-04-16T17:47:10.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0=', 'Content-Length': '0'} 2024-04-16T17:47:10.074 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000caf440e1a7d18659-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.075 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.075 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.075 DEBUG:boto:path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.075 DEBUG:boto:auth_path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.075 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.075 DEBUG:boto:Path: /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.075 DEBUG:boto:Data: 2024-04-16T17:47:10.075 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.075 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.075 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.076 DEBUG:boto:Params: {} 2024-04-16T17:47:10.076 DEBUG:boto:Token: None 2024-04-16T17:47:10.076 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qH5Gu97wBrae+zTAXt1Di0vMUuU= 2024-04-16T17:47:10.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qH5Gu97wBrae+zTAXt1Di0vMUuU=', 'Content-Length': '0'} 2024-04-16T17:47:10.078 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8bb19f424616f72-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.078 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.078 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.078 DEBUG:boto:path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.079 DEBUG:boto:auth_path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.079 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.079 DEBUG:boto:Path: /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.079 DEBUG:boto:Data: 2024-04-16T17:47:10.079 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.079 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.079 DEBUG:boto:Params: {} 2024-04-16T17:47:10.079 DEBUG:boto:Token: None 2024-04-16T17:47:10.080 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qH5Gu97wBrae+zTAXt1Di0vMUuU= 2024-04-16T17:47:10.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qH5Gu97wBrae+zTAXt1Di0vMUuU=', 'Content-Length': '0'} 2024-04-16T17:47:10.082 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000039906f558cba728-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.082 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:10.082 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.082 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.083 DEBUG:boto:path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.083 DEBUG:boto:auth_path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.083 DEBUG:boto:Method: GET 2024-04-16T17:47:10.083 DEBUG:boto:Path: /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.083 DEBUG:boto:Data: 2024-04-16T17:47:10.083 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.083 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.083 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.083 DEBUG:boto:Params: {} 2024-04-16T17:47:10.083 DEBUG:boto:Token: None 2024-04-16T17:47:10.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0= 2024-04-16T17:47:10.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0=', 'Content-Length': '0'} 2024-04-16T17:47:10.085 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c7e6a47f4edbe73e-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.086 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.086 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.086 DEBUG:boto:path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.086 DEBUG:boto:auth_path=/cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.086 DEBUG:boto:Method: GET 2024-04-16T17:47:10.086 DEBUG:boto:Path: /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.086 DEBUG:boto:Data: 2024-04-16T17:47:10.086 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.086 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.087 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.087 DEBUG:boto:Params: {} 2024-04-16T17:47:10.087 DEBUG:boto:Token: None 2024-04-16T17:47:10.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj?versionId=null 2024-04-16T17:47:10.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0= 2024-04-16T17:47:10.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/qz0l3uLOMHLXY4rZ86EcKggT+0=', 'Content-Length': '0'} 2024-04-16T17:47:10.089 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000126c3ccab665c83a-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.130 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.131 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.131 DEBUG:boto:path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.131 DEBUG:boto:auth_path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.131 DEBUG:boto:Method: GET 2024-04-16T17:47:10.131 DEBUG:boto:Path: /cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.131 DEBUG:boto:Data: 2024-04-16T17:47:10.131 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.131 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.131 DEBUG:boto:Params: {} 2024-04-16T17:47:10.131 DEBUG:boto:Token: None 2024-04-16T17:47:10.132 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/ 2024-04-16T17:47:10.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU= 2024-04-16T17:47:10.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU=', 'Content-Length': '0'} 2024-04-16T17:47:10.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c4d5a02c36df9bc-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.134 DEBUG:boto:b'cjqttm-9myobj1000falsemyobj2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.135 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.135 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.135 DEBUG:boto:path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.135 DEBUG:boto:auth_path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.135 DEBUG:boto:Method: GET 2024-04-16T17:47:10.135 DEBUG:boto:Path: /cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.135 DEBUG:boto:Data: 2024-04-16T17:47:10.135 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.135 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.136 DEBUG:boto:Params: {} 2024-04-16T17:47:10.136 DEBUG:boto:Token: None 2024-04-16T17:47:10.136 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/ 2024-04-16T17:47:10.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU= 2024-04-16T17:47:10.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU=', 'Content-Length': '0'} 2024-04-16T17:47:10.138 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b02b292b02b4209-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.138 DEBUG:boto:b'cjqttm-9myobj1000falsemyobj2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.138 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.139 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.139 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.139 DEBUG:boto:Path: /cjqttm-9/myobj 2024-04-16T17:47:10.139 DEBUG:boto:Data: 2024-04-16T17:47:10.139 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.139 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.139 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.139 DEBUG:boto:Params: {} 2024-04-16T17:47:10.139 DEBUG:boto:Token: None 2024-04-16T17:47:10.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj 2024-04-16T17:47:10.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GAeqzzdNU6S+2MKQ0k8j1Vk5Dm0= 2024-04-16T17:47:10.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GAeqzzdNU6S+2MKQ0k8j1Vk5Dm0=', 'Content-Length': '0'} 2024-04-16T17:47:10.141 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000be92b3d728721376-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.142 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.142 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.142 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.142 DEBUG:boto:Path: /cjqttm-9/myobj 2024-04-16T17:47:10.142 DEBUG:boto:Data: 2024-04-16T17:47:10.142 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.142 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.143 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.143 DEBUG:boto:Params: {} 2024-04-16T17:47:10.143 DEBUG:boto:Token: None 2024-04-16T17:47:10.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj 2024-04-16T17:47:10.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GAeqzzdNU6S+2MKQ0k8j1Vk5Dm0= 2024-04-16T17:47:10.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GAeqzzdNU6S+2MKQ0k8j1Vk5Dm0=', 'Content-Length': '0'} 2024-04-16T17:47:10.145 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a3acf5f0d1ee132-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:10.146 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.146 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.146 DEBUG:boto:Method: GET 2024-04-16T17:47:10.146 DEBUG:boto:Path: /cjqttm-9/myobj 2024-04-16T17:47:10.146 DEBUG:boto:Data: 2024-04-16T17:47:10.146 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.146 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.146 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.146 DEBUG:boto:Params: {} 2024-04-16T17:47:10.146 DEBUG:boto:Token: None 2024-04-16T17:47:10.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj 2024-04-16T17:47:10.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wth+ObpQ+73v3agvMxh3MVW3V2k= 2024-04-16T17:47:10.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wth+ObpQ+73v3agvMxh3MVW3V2k=', 'Content-Length': '0'} 2024-04-16T17:47:10.149 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:05 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d8868b8b70502769-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.190 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.190 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.190 DEBUG:boto:Method: GET 2024-04-16T17:47:10.191 DEBUG:boto:Path: /cjqttm-9/myobj 2024-04-16T17:47:10.191 DEBUG:boto:Data: 2024-04-16T17:47:10.191 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.191 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.191 DEBUG:boto:Params: {} 2024-04-16T17:47:10.191 DEBUG:boto:Token: None 2024-04-16T17:47:10.191 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj 2024-04-16T17:47:10.191 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wth+ObpQ+73v3agvMxh3MVW3V2k= 2024-04-16T17:47:10.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wth+ObpQ+73v3agvMxh3MVW3V2k=', 'Content-Length': '0'} 2024-04-16T17:47:10.194 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007cdb50e551cc9b27-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.194 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.194 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.194 DEBUG:boto:path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.194 DEBUG:boto:auth_path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.194 DEBUG:boto:Method: GET 2024-04-16T17:47:10.195 DEBUG:boto:Path: /cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.195 DEBUG:boto:Data: 2024-04-16T17:47:10.195 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.195 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.195 DEBUG:boto:Params: {} 2024-04-16T17:47:10.195 DEBUG:boto:Token: None 2024-04-16T17:47:10.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/ 2024-04-16T17:47:10.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU= 2024-04-16T17:47:10.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU=', 'Content-Length': '0'} 2024-04-16T17:47:10.197 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073c124844b861ac7-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.238 DEBUG:boto:b'cjqttm-9myobj1000falsemyobj2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.239 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.239 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.239 DEBUG:boto:path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.239 DEBUG:boto:auth_path=/cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.239 DEBUG:boto:Method: GET 2024-04-16T17:47:10.239 DEBUG:boto:Path: /cjqttm-9/?prefix=myobj 2024-04-16T17:47:10.239 DEBUG:boto:Data: 2024-04-16T17:47:10.239 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.240 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.240 DEBUG:boto:Params: {} 2024-04-16T17:47:10.240 DEBUG:boto:Token: None 2024-04-16T17:47:10.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/ 2024-04-16T17:47:10.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU= 2024-04-16T17:47:10.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gJFc8Vvdz4+mfDtuu+HZ/RFnJVU=', 'Content-Length': '0'} 2024-04-16T17:47:10.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000324c96243af8caf1-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.242 DEBUG:boto:b'cjqttm-9myobj1000falsemyobj2024-04-16T17:47:04.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.243 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-9 zones={test-zone2, test-zone1} 2024-04-16T17:47:10.243 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:10.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:10.243 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:47:10.306 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:10.306 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:10.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:10.371+0000 7f04f4a2e800 1 bucket sync caught up with source: 2024-04-16T17:47:10.369 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.7.6, , , , , , , , , ] 2024-04-16T17:47:10.369 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.7.6, , , , , , , , , ] 2024-04-16T17:47:10.369 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:10.371+0000 7f04f4a2e800 0 bucket checkpoint complete 2024-04-16T17:47:10.390 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-10 zones={test-zone1, test-zone2} 2024-04-16T17:47:10.390 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.390 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.390 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.390 DEBUG:boto:Path: /cjqttm-10/ 2024-04-16T17:47:10.391 DEBUG:boto:Data: 2024-04-16T17:47:10.391 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.391 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.391 DEBUG:boto:Params: {} 2024-04-16T17:47:10.391 DEBUG:boto:Token: None 2024-04-16T17:47:10.391 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/ 2024-04-16T17:47:10.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mhhsoEEqD9SqjdGLStvA3qLf+b4= 2024-04-16T17:47:10.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mhhsoEEqD9SqjdGLStvA3qLf+b4=', 'Content-Length': '0'} 2024-04-16T17:47:10.393 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000051f2dac37626a1aa-00661eb99e-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.394 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.394 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.394 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.394 DEBUG:boto:Path: /cjqttm-10/ 2024-04-16T17:47:10.394 DEBUG:boto:Data: 2024-04-16T17:47:10.394 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.394 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.394 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.394 DEBUG:boto:Params: {} 2024-04-16T17:47:10.394 DEBUG:boto:Token: None 2024-04-16T17:47:10.395 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/ 2024-04-16T17:47:10.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mhhsoEEqD9SqjdGLStvA3qLf+b4= 2024-04-16T17:47:10.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mhhsoEEqD9SqjdGLStvA3qLf+b4=', 'Content-Length': '0'} 2024-04-16T17:47:10.397 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a5ecbc791ae31d5c-00661eb99e-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.397 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:47:10.397 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.397 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.397 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.398 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.398 DEBUG:boto:Method: GET 2024-04-16T17:47:10.398 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.398 DEBUG:boto:Data: 2024-04-16T17:47:10.398 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.398 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.398 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.398 DEBUG:boto:Params: {} 2024-04-16T17:47:10.398 DEBUG:boto:Token: None 2024-04-16T17:47:10.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/?versions 2024-04-16T17:47:10.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk= 2024-04-16T17:47:10.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk=', 'Content-Length': '0'} 2024-04-16T17:47:10.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b4746443b91760f-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.401 DEBUG:boto:b'cjqttm-10999falsemyobjnulltrue2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.401 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:47:10.401 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:47:10.401 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.401 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.401 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.402 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.402 DEBUG:boto:Method: GET 2024-04-16T17:47:10.402 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.402 DEBUG:boto:Data: 2024-04-16T17:47:10.402 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.402 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.402 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.402 DEBUG:boto:Params: {} 2024-04-16T17:47:10.402 DEBUG:boto:Token: None 2024-04-16T17:47:10.402 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/?versions 2024-04-16T17:47:10.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk= 2024-04-16T17:47:10.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk=', 'Content-Length': '0'} 2024-04-16T17:47:10.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000683fed2e58dacc78-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.405 DEBUG:boto:b'cjqttm-10999falsemyobjnulltrue2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.406 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2024-04-16T17:47:10.406 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.406 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.406 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.406 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.406 DEBUG:boto:Method: GET 2024-04-16T17:47:10.406 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.406 DEBUG:boto:Data: 2024-04-16T17:47:10.406 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.407 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.407 DEBUG:boto:Params: {} 2024-04-16T17:47:10.407 DEBUG:boto:Token: None 2024-04-16T17:47:10.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/?versions 2024-04-16T17:47:10.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk= 2024-04-16T17:47:10.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk=', 'Content-Length': '0'} 2024-04-16T17:47:10.409 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000522f4957743454b0-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.410 DEBUG:boto:b'cjqttm-10999falsemyobjnulltrue2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.410 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.410 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.410 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.410 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.410 DEBUG:boto:Method: GET 2024-04-16T17:47:10.411 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:10.411 DEBUG:boto:Data: 2024-04-16T17:47:10.411 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.411 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.411 DEBUG:boto:Params: {} 2024-04-16T17:47:10.411 DEBUG:boto:Token: None 2024-04-16T17:47:10.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/?versions 2024-04-16T17:47:10.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk= 2024-04-16T17:47:10.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdOYRuhhSie/3hRqLhpuilOO9qk=', 'Content-Length': '0'} 2024-04-16T17:47:10.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006423be14bc9b1e62-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.414 DEBUG:boto:b'cjqttm-10999falsemyobjnulltrue2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:10.415 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.415 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.415 DEBUG:boto:path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.415 DEBUG:boto:auth_path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.415 DEBUG:boto:Method: GET 2024-04-16T17:47:10.415 DEBUG:boto:Path: /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.415 DEBUG:boto:Data: 2024-04-16T17:47:10.415 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.415 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.415 DEBUG:boto:Params: {} 2024-04-16T17:47:10.416 DEBUG:boto:Token: None 2024-04-16T17:47:10.416 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE= 2024-04-16T17:47:10.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE=', 'Content-Length': '0'} 2024-04-16T17:47:10.418 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000048b4948aec37625a-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.418 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.418 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.418 DEBUG:boto:path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.418 DEBUG:boto:auth_path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.418 DEBUG:boto:Method: GET 2024-04-16T17:47:10.419 DEBUG:boto:Path: /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.419 DEBUG:boto:Data: 2024-04-16T17:47:10.419 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.419 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.419 DEBUG:boto:Params: {} 2024-04-16T17:47:10.419 DEBUG:boto:Token: None 2024-04-16T17:47:10.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE= 2024-04-16T17:47:10.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE=', 'Content-Length': '0'} 2024-04-16T17:47:10.421 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008efcdc9e39fefde1-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.421 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.421 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.421 DEBUG:boto:path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.422 DEBUG:boto:auth_path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.422 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.422 DEBUG:boto:Path: /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.422 DEBUG:boto:Data: 2024-04-16T17:47:10.422 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.422 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.422 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.422 DEBUG:boto:Params: {} 2024-04-16T17:47:10.422 DEBUG:boto:Token: None 2024-04-16T17:47:10.423 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LP9Md1MwW9eXzbrTWm3iNp4IyXY= 2024-04-16T17:47:10.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LP9Md1MwW9eXzbrTWm3iNp4IyXY=', 'Content-Length': '0'} 2024-04-16T17:47:10.424 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cb740b27b143d118-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.424 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.425 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.425 DEBUG:boto:path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.425 DEBUG:boto:auth_path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.425 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.425 DEBUG:boto:Path: /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.425 DEBUG:boto:Data: 2024-04-16T17:47:10.425 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.425 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.425 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.425 DEBUG:boto:Params: {} 2024-04-16T17:47:10.426 DEBUG:boto:Token: None 2024-04-16T17:47:10.426 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.426 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LP9Md1MwW9eXzbrTWm3iNp4IyXY= 2024-04-16T17:47:10.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LP9Md1MwW9eXzbrTWm3iNp4IyXY=', 'Content-Length': '0'} 2024-04-16T17:47:10.427 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f2e9b8e0512e1db2-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.428 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:10.428 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.428 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.428 DEBUG:boto:path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.428 DEBUG:boto:auth_path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.428 DEBUG:boto:Method: GET 2024-04-16T17:47:10.428 DEBUG:boto:Path: /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.428 DEBUG:boto:Data: 2024-04-16T17:47:10.429 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.429 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.429 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.429 DEBUG:boto:Params: {} 2024-04-16T17:47:10.429 DEBUG:boto:Token: None 2024-04-16T17:47:10.429 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE= 2024-04-16T17:47:10.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE=', 'Content-Length': '0'} 2024-04-16T17:47:10.431 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007968ad03a8ccd3ef-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.431 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.431 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.431 DEBUG:boto:path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.431 DEBUG:boto:auth_path=/cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.431 DEBUG:boto:Method: GET 2024-04-16T17:47:10.431 DEBUG:boto:Path: /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.432 DEBUG:boto:Data: 2024-04-16T17:47:10.432 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.432 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.432 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.432 DEBUG:boto:Params: {} 2024-04-16T17:47:10.432 DEBUG:boto:Token: None 2024-04-16T17:47:10.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj?versionId=null 2024-04-16T17:47:10.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE= 2024-04-16T17:47:10.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:etSGSAX7EzP7oF5dgd4EAob2seE=', 'Content-Length': '0'} 2024-04-16T17:47:10.434 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b0cec7fdec1f8bf8-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.434 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.435 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.435 DEBUG:boto:path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.435 DEBUG:boto:auth_path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.435 DEBUG:boto:Method: GET 2024-04-16T17:47:10.435 DEBUG:boto:Path: /cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.435 DEBUG:boto:Data: 2024-04-16T17:47:10.435 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.435 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.435 DEBUG:boto:Params: {} 2024-04-16T17:47:10.435 DEBUG:boto:Token: None 2024-04-16T17:47:10.436 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/ 2024-04-16T17:47:10.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc= 2024-04-16T17:47:10.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc=', 'Content-Length': '0'} 2024-04-16T17:47:10.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa966b2768540317-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.438 DEBUG:boto:b'cjqttm-10myobj1000falsemyobj2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.438 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.438 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.438 DEBUG:boto:path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.438 DEBUG:boto:auth_path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.438 DEBUG:boto:Method: GET 2024-04-16T17:47:10.439 DEBUG:boto:Path: /cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.439 DEBUG:boto:Data: 2024-04-16T17:47:10.439 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.439 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.439 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.439 DEBUG:boto:Params: {} 2024-04-16T17:47:10.439 DEBUG:boto:Token: None 2024-04-16T17:47:10.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/ 2024-04-16T17:47:10.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc= 2024-04-16T17:47:10.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc=', 'Content-Length': '0'} 2024-04-16T17:47:10.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9e2550e0cf58be7-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.442 DEBUG:boto:b'cjqttm-10myobj1000falsemyobj2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.442 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.442 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.442 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.443 DEBUG:boto:Path: /cjqttm-10/myobj 2024-04-16T17:47:10.443 DEBUG:boto:Data: 2024-04-16T17:47:10.443 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.443 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.443 DEBUG:boto:Params: {} 2024-04-16T17:47:10.443 DEBUG:boto:Token: None 2024-04-16T17:47:10.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj 2024-04-16T17:47:10.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ikOa515fpT5qlQzlZ2HG41DMKQ8= 2024-04-16T17:47:10.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ikOa515fpT5qlQzlZ2HG41DMKQ8=', 'Content-Length': '0'} 2024-04-16T17:47:10.445 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008c873e82d417768e-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.445 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.445 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.445 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.445 DEBUG:boto:Path: /cjqttm-10/myobj 2024-04-16T17:47:10.445 DEBUG:boto:Data: 2024-04-16T17:47:10.446 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.446 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.446 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.446 DEBUG:boto:Params: {} 2024-04-16T17:47:10.446 DEBUG:boto:Token: None 2024-04-16T17:47:10.446 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj 2024-04-16T17:47:10.446 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ikOa515fpT5qlQzlZ2HG41DMKQ8= 2024-04-16T17:47:10.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ikOa515fpT5qlQzlZ2HG41DMKQ8=', 'Content-Length': '0'} 2024-04-16T17:47:10.448 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000323946f7d3e02280-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2024-04-16T17:47:10.448 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.448 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.449 DEBUG:boto:Method: GET 2024-04-16T17:47:10.449 DEBUG:boto:Path: /cjqttm-10/myobj 2024-04-16T17:47:10.449 DEBUG:boto:Data: 2024-04-16T17:47:10.449 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.449 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.449 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.449 DEBUG:boto:Params: {} 2024-04-16T17:47:10.449 DEBUG:boto:Token: None 2024-04-16T17:47:10.449 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj 2024-04-16T17:47:10.449 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uv88PMuwIp1/hmD/U91K6w34Tj4= 2024-04-16T17:47:10.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uv88PMuwIp1/hmD/U91K6w34Tj4=', 'Content-Length': '0'} 2024-04-16T17:47:10.451 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:47:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000049514e074c6f74d2-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.451 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:10.452 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:10.452 DEBUG:boto:Method: GET 2024-04-16T17:47:10.452 DEBUG:boto:Path: /cjqttm-10/myobj 2024-04-16T17:47:10.452 DEBUG:boto:Data: 2024-04-16T17:47:10.452 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.452 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.452 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.452 DEBUG:boto:Params: {} 2024-04-16T17:47:10.452 DEBUG:boto:Token: None 2024-04-16T17:47:10.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/myobj 2024-04-16T17:47:10.453 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uv88PMuwIp1/hmD/U91K6w34Tj4= 2024-04-16T17:47:10.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uv88PMuwIp1/hmD/U91K6w34Tj4=', 'Content-Length': '0'} 2024-04-16T17:47:10.454 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a3a28232f59c70c7-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.454 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.455 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.455 DEBUG:boto:path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.455 DEBUG:boto:auth_path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.455 DEBUG:boto:Method: GET 2024-04-16T17:47:10.455 DEBUG:boto:Path: /cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.455 DEBUG:boto:Data: 2024-04-16T17:47:10.455 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.455 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.455 DEBUG:boto:Params: {} 2024-04-16T17:47:10.455 DEBUG:boto:Token: None 2024-04-16T17:47:10.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/ 2024-04-16T17:47:10.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc= 2024-04-16T17:47:10.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc=', 'Content-Length': '0'} 2024-04-16T17:47:10.458 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc063c1c0a9388bd-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.498 DEBUG:boto:b'cjqttm-10myobj1000falsemyobj2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.499 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:10.499 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:10.499 DEBUG:boto:path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.499 DEBUG:boto:auth_path=/cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.499 DEBUG:boto:Method: GET 2024-04-16T17:47:10.499 DEBUG:boto:Path: /cjqttm-10/?prefix=myobj 2024-04-16T17:47:10.499 DEBUG:boto:Data: 2024-04-16T17:47:10.499 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.499 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:10.499 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.500 DEBUG:boto:Params: {} 2024-04-16T17:47:10.500 DEBUG:boto:Token: None 2024-04-16T17:47:10.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-10/ 2024-04-16T17:47:10.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc= 2024-04-16T17:47:10.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oqMQPffnySR5aowQz/5Y7KX5pzc=', 'Content-Length': '0'} 2024-04-16T17:47:10.502 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a5abcbb2ccff463-00661eb99e-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.502 DEBUG:boto:b'cjqttm-10myobj1000falsemyobj2024-04-16T17:47:04.472Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T17:47:10.502 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-10 zones={test-zone1, test-zone2} 2024-04-16T17:47:10.503 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:10.503 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:10.503 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.503 DEBUG:boto:Path: /cjqttm-9/ 2024-04-16T17:47:10.503 DEBUG:boto:Data: 2024-04-16T17:47:10.503 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.503 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.503 DEBUG:boto:Params: {} 2024-04-16T17:47:10.503 DEBUG:boto:Token: None 2024-04-16T17:47:10.504 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/ 2024-04-16T17:47:10.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hF2H3/QXGyTrpTUSJj7GSmMUSeA= 2024-04-16T17:47:10.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hF2H3/QXGyTrpTUSJj7GSmMUSeA=', 'Content-Length': '0'} 2024-04-16T17:47:10.506 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000090e90f542638ca76-00661eb99e-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.506 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.506 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.506 DEBUG:boto:Method: HEAD 2024-04-16T17:47:10.506 DEBUG:boto:Path: /cjqttm-9/myobj 2024-04-16T17:47:10.506 DEBUG:boto:Data: 2024-04-16T17:47:10.506 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.506 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.506 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.507 DEBUG:boto:Params: {} 2024-04-16T17:47:10.507 DEBUG:boto:Token: None 2024-04-16T17:47:10.507 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj 2024-04-16T17:47:10.507 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GAeqzzdNU6S+2MKQ0k8j1Vk5Dm0= 2024-04-16T17:47:10.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GAeqzzdNU6S+2MKQ0k8j1Vk5Dm0=', 'Content-Length': '0'} 2024-04-16T17:47:10.509 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000054a4038be53b07e2-00661eb99e-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.509 DEBUG:boto:path=/cjqttm-9/myobj 2024-04-16T17:47:10.509 DEBUG:boto:auth_path=/cjqttm-9/myobj 2024-04-16T17:47:10.509 DEBUG:boto:Method: DELETE 2024-04-16T17:47:10.509 DEBUG:boto:Path: /cjqttm-9/myobj 2024-04-16T17:47:10.509 DEBUG:boto:Data: 2024-04-16T17:47:10.509 DEBUG:boto:Headers: {} 2024-04-16T17:47:10.509 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:10.510 DEBUG:boto:Port: 8000 2024-04-16T17:47:10.510 DEBUG:boto:Params: {} 2024-04-16T17:47:10.510 DEBUG:boto:Token: None 2024-04-16T17:47:10.510 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:47:10 GMT /cjqttm-9/myobj 2024-04-16T17:47:10.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LVKh0mneEdzsqaRL44+zLc9nOXw= 2024-04-16T17:47:10.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LVKh0mneEdzsqaRL44+zLc9nOXw=', 'Content-Length': '0'} 2024-04-16T17:47:10.514 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000db62fd6c124ef6bd-00661eb99e-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:10.515 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:10.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-9', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:10.515 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-9 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:47:10.573 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:10.573 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:10.628 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:10.629+0000 7f0f2652c800 1 waiting for incremental sync to catch up: 2024-04-16T17:47:10.628 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.6.6, , , , , , , , , ] 2024-04-16T17:47:10.628 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000002.8.6, , , , , , , , , ] 2024-04-16T17:47:15.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:15.630+0000 7f0f2652c800 1 bucket sync caught up with source: 2024-04-16T17:47:15.630 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000002.8.6, , , , , , , , , ] 2024-04-16T17:47:15.630 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000002.8.6, , , , , , , , , ] 2024-04-16T17:47:15.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:15.630+0000 7f0f2652c800 0 bucket checkpoint complete 2024-04-16T17:47:15.653 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-9 zones={test-zone2, test-zone1} 2024-04-16T17:47:15.653 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:15.653 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:15.654 DEBUG:boto:Method: HEAD 2024-04-16T17:47:15.654 DEBUG:boto:Path: /cjqttm-9/ 2024-04-16T17:47:15.654 DEBUG:boto:Data: 2024-04-16T17:47:15.654 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.654 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:15.654 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.654 DEBUG:boto:Params: {} 2024-04-16T17:47:15.654 DEBUG:boto:Token: None 2024-04-16T17:47:15.654 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-9/ 2024-04-16T17:47:15.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nd+PeYizK1JZ3n4uU2MNf7srll4= 2024-04-16T17:47:15.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nd+PeYizK1JZ3n4uU2MNf7srll4=', 'Content-Length': '0'} 2024-04-16T17:47:15.657 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ac898e7c43d0350-00661eb9a3-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.657 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:15.657 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:15.657 DEBUG:boto:Method: HEAD 2024-04-16T17:47:15.657 DEBUG:boto:Path: /cjqttm-9/ 2024-04-16T17:47:15.658 DEBUG:boto:Data: 2024-04-16T17:47:15.658 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.658 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:15.658 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.658 DEBUG:boto:Params: {} 2024-04-16T17:47:15.658 DEBUG:boto:Token: None 2024-04-16T17:47:15.658 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-9/ 2024-04-16T17:47:15.658 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nd+PeYizK1JZ3n4uU2MNf7srll4= 2024-04-16T17:47:15.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nd+PeYizK1JZ3n4uU2MNf7srll4=', 'Content-Length': '0'} 2024-04-16T17:47:15.661 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001f9bd8d062ffbfd7-00661eb9a3-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.661 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:47:15.661 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:15.661 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:15.661 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.661 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.661 DEBUG:boto:Method: GET 2024-04-16T17:47:15.662 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.662 DEBUG:boto:Data: 2024-04-16T17:47:15.662 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.662 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:15.662 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.662 DEBUG:boto:Params: {} 2024-04-16T17:47:15.662 DEBUG:boto:Token: None 2024-04-16T17:47:15.662 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-9/?versions 2024-04-16T17:47:15.662 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48= 2024-04-16T17:47:15.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48=', 'Content-Length': '0'} 2024-04-16T17:47:15.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000514e96a5b7cf9655-00661eb9a3-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.665 DEBUG:boto:b'cjqttm-9999false' 2024-04-16T17:47:15.665 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:47:15.666 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:15.666 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:15.666 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.666 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.666 DEBUG:boto:Method: GET 2024-04-16T17:47:15.666 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.666 DEBUG:boto:Data: 2024-04-16T17:47:15.666 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.666 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:15.667 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.667 DEBUG:boto:Params: {} 2024-04-16T17:47:15.667 DEBUG:boto:Token: None 2024-04-16T17:47:15.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-9/?versions 2024-04-16T17:47:15.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48= 2024-04-16T17:47:15.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48=', 'Content-Length': '0'} 2024-04-16T17:47:15.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000246f2774e952add7-00661eb9a3-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.669 DEBUG:boto:b'cjqttm-9999false' 2024-04-16T17:47:15.670 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:15.670 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:15.670 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.670 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.670 DEBUG:boto:Method: GET 2024-04-16T17:47:15.670 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.670 DEBUG:boto:Data: 2024-04-16T17:47:15.670 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.670 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:15.670 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.670 DEBUG:boto:Params: {} 2024-04-16T17:47:15.671 DEBUG:boto:Token: None 2024-04-16T17:47:15.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-9/?versions 2024-04-16T17:47:15.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48= 2024-04-16T17:47:15.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48=', 'Content-Length': '0'} 2024-04-16T17:47:15.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000514be1f95493589b-00661eb9a3-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.673 DEBUG:boto:b'cjqttm-9999false' 2024-04-16T17:47:15.673 DEBUG:boto:path=/cjqttm-9/ 2024-04-16T17:47:15.673 DEBUG:boto:auth_path=/cjqttm-9/ 2024-04-16T17:47:15.673 DEBUG:boto:path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.674 DEBUG:boto:auth_path=/cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.674 DEBUG:boto:Method: GET 2024-04-16T17:47:15.674 DEBUG:boto:Path: /cjqttm-9/?versions&max-keys=999 2024-04-16T17:47:15.674 DEBUG:boto:Data: 2024-04-16T17:47:15.674 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.674 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:15.674 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.674 DEBUG:boto:Params: {} 2024-04-16T17:47:15.674 DEBUG:boto:Token: None 2024-04-16T17:47:15.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-9/?versions 2024-04-16T17:47:15.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48= 2024-04-16T17:47:15.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:exWWyn8g2DHYUp+MsJHrlttZc48=', 'Content-Length': '0'} 2024-04-16T17:47:15.677 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070bb81e789aebf4b-00661eb9a3-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.677 DEBUG:boto:b'cjqttm-9999false' 2024-04-16T17:47:15.677 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-9 zones={test-zone2, test-zone1} 2024-04-16T17:47:15.677 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:15.677 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:15.678 DEBUG:boto:Method: HEAD 2024-04-16T17:47:15.678 DEBUG:boto:Path: /cjqttm-10/ 2024-04-16T17:47:15.678 DEBUG:boto:Data: 2024-04-16T17:47:15.678 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.678 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:15.678 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.678 DEBUG:boto:Params: {} 2024-04-16T17:47:15.678 DEBUG:boto:Token: None 2024-04-16T17:47:15.678 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-10/ 2024-04-16T17:47:15.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hd/aa1Ftw9yoMCUmRHLAhg25AoM= 2024-04-16T17:47:15.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hd/aa1Ftw9yoMCUmRHLAhg25AoM=', 'Content-Length': '0'} 2024-04-16T17:47:15.681 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d09e860d6c824a8-00661eb9a3-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.681 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:15.681 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:15.681 DEBUG:boto:Method: HEAD 2024-04-16T17:47:15.681 DEBUG:boto:Path: /cjqttm-10/myobj 2024-04-16T17:47:15.681 DEBUG:boto:Data: 2024-04-16T17:47:15.681 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.681 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:15.682 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.682 DEBUG:boto:Params: {} 2024-04-16T17:47:15.682 DEBUG:boto:Token: None 2024-04-16T17:47:15.682 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-10/myobj 2024-04-16T17:47:15.682 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l3k75ZU9n3jEfj76873u4EiHzPU= 2024-04-16T17:47:15.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l3k75ZU9n3jEfj76873u4EiHzPU=', 'Content-Length': '0'} 2024-04-16T17:47:15.684 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:47:04 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cc2ae9ff7a28c444-00661eb9a3-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.684 DEBUG:boto:path=/cjqttm-10/myobj 2024-04-16T17:47:15.684 DEBUG:boto:auth_path=/cjqttm-10/myobj 2024-04-16T17:47:15.684 DEBUG:boto:Method: DELETE 2024-04-16T17:47:15.684 DEBUG:boto:Path: /cjqttm-10/myobj 2024-04-16T17:47:15.685 DEBUG:boto:Data: 2024-04-16T17:47:15.685 DEBUG:boto:Headers: {} 2024-04-16T17:47:15.685 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:15.685 DEBUG:boto:Port: 8000 2024-04-16T17:47:15.685 DEBUG:boto:Params: {} 2024-04-16T17:47:15.685 DEBUG:boto:Token: None 2024-04-16T17:47:15.685 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:47:15 GMT /cjqttm-10/myobj 2024-04-16T17:47:15.685 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sxFGYxHVn6iOSJcJBR/irwMamz0= 2024-04-16T17:47:15.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sxFGYxHVn6iOSJcJBR/irwMamz0=', 'Content-Length': '0'} 2024-04-16T17:47:15.689 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000086af987949ca53ab-00661eb9a3-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:15.690 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:15.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-10', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:15.690 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-10 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:47:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:15.752 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:15.814 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:15.816+0000 7fe1f5416800 1 waiting for incremental sync to catch up: 2024-04-16T17:47:15.815 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.7.6, , , , , , , , , ] 2024-04-16T17:47:15.815 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.11.6, , , , , , , , , ] 2024-04-16T17:47:20.816 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:20.817+0000 7fe1f5416800 1 waiting for incremental sync to catch up: 2024-04-16T17:47:20.816 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.7.6, , , , , , , , , ] 2024-04-16T17:47:20.816 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.11.6, , , , , , , , , ] 2024-04-16T17:47:25.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:25.819+0000 7fe1f5416800 1 bucket sync caught up with source: 2024-04-16T17:47:25.818 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.11.6, , , , , , , , , ] 2024-04-16T17:47:25.818 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.11.6, , , , , , , , , ] 2024-04-16T17:47:25.818 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:47:25.819+0000 7fe1f5416800 0 bucket checkpoint complete 2024-04-16T17:47:25.844 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-10 zones={test-zone1, test-zone2} 2024-04-16T17:47:25.844 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:25.844 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:25.845 DEBUG:boto:Method: HEAD 2024-04-16T17:47:25.845 DEBUG:boto:Path: /cjqttm-10/ 2024-04-16T17:47:25.845 DEBUG:boto:Data: 2024-04-16T17:47:25.845 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.845 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:25.845 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.845 DEBUG:boto:Params: {} 2024-04-16T17:47:25.845 DEBUG:boto:Token: None 2024-04-16T17:47:25.845 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-10/ 2024-04-16T17:47:25.846 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:glDkty58CQ84q3UJuq3yQFO7c/A= 2024-04-16T17:47:25.846 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:glDkty58CQ84q3UJuq3yQFO7c/A=', 'Content-Length': '0'} 2024-04-16T17:47:25.848 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a3bc53fab36c2b0c-00661eb9ad-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.848 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:25.848 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:25.848 DEBUG:boto:Method: HEAD 2024-04-16T17:47:25.848 DEBUG:boto:Path: /cjqttm-10/ 2024-04-16T17:47:25.848 DEBUG:boto:Data: 2024-04-16T17:47:25.849 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.849 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:25.849 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.849 DEBUG:boto:Params: {} 2024-04-16T17:47:25.849 DEBUG:boto:Token: None 2024-04-16T17:47:25.849 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-10/ 2024-04-16T17:47:25.849 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:glDkty58CQ84q3UJuq3yQFO7c/A= 2024-04-16T17:47:25.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:glDkty58CQ84q3UJuq3yQFO7c/A=', 'Content-Length': '0'} 2024-04-16T17:47:25.852 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000094dd09fba402f96f-00661eb9ad-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.852 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:47:25.852 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:25.852 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:25.852 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.852 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.852 DEBUG:boto:Method: GET 2024-04-16T17:47:25.852 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.852 DEBUG:boto:Data: 2024-04-16T17:47:25.853 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.853 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:25.853 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.853 DEBUG:boto:Params: {} 2024-04-16T17:47:25.853 DEBUG:boto:Token: None 2024-04-16T17:47:25.853 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-10/?versions 2024-04-16T17:47:25.853 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8= 2024-04-16T17:47:25.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8=', 'Content-Length': '0'} 2024-04-16T17:47:25.856 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dcd25bf1f9dedcf2-00661eb9ad-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.856 DEBUG:boto:b'cjqttm-10999false' 2024-04-16T17:47:25.856 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:47:25.856 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:25.856 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:25.856 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.857 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.857 DEBUG:boto:Method: GET 2024-04-16T17:47:25.857 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.857 DEBUG:boto:Data: 2024-04-16T17:47:25.857 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.857 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:25.857 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.857 DEBUG:boto:Params: {} 2024-04-16T17:47:25.857 DEBUG:boto:Token: None 2024-04-16T17:47:25.857 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-10/?versions 2024-04-16T17:47:25.858 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8= 2024-04-16T17:47:25.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8=', 'Content-Length': '0'} 2024-04-16T17:47:25.860 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000145c3f6c171eefc0-00661eb9ad-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.860 DEBUG:boto:b'cjqttm-10999false' 2024-04-16T17:47:25.860 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:25.861 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:25.861 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.861 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.861 DEBUG:boto:Method: GET 2024-04-16T17:47:25.861 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.861 DEBUG:boto:Data: 2024-04-16T17:47:25.861 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.861 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:25.861 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.861 DEBUG:boto:Params: {} 2024-04-16T17:47:25.861 DEBUG:boto:Token: None 2024-04-16T17:47:25.862 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-10/?versions 2024-04-16T17:47:25.862 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8= 2024-04-16T17:47:25.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8=', 'Content-Length': '0'} 2024-04-16T17:47:25.864 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c1c045896544237-00661eb9ad-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.864 DEBUG:boto:b'cjqttm-10999false' 2024-04-16T17:47:25.864 DEBUG:boto:path=/cjqttm-10/ 2024-04-16T17:47:25.864 DEBUG:boto:auth_path=/cjqttm-10/ 2024-04-16T17:47:25.864 DEBUG:boto:path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.864 DEBUG:boto:auth_path=/cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.865 DEBUG:boto:Method: GET 2024-04-16T17:47:25.865 DEBUG:boto:Path: /cjqttm-10/?versions&max-keys=999 2024-04-16T17:47:25.865 DEBUG:boto:Data: 2024-04-16T17:47:25.865 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.865 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:25.865 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.865 DEBUG:boto:Params: {} 2024-04-16T17:47:25.865 DEBUG:boto:Token: None 2024-04-16T17:47:25.865 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-10/?versions 2024-04-16T17:47:25.865 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8= 2024-04-16T17:47:25.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FtmyPH+BiWOqI+lmYoefAz5jVf8=', 'Content-Length': '0'} 2024-04-16T17:47:25.868 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057ffa1493f6e9c9b-00661eb9ad-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.910 DEBUG:boto:b'cjqttm-10999false' 2024-04-16T17:47:25.911 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-10 zones={test-zone1, test-zone2} 2024-04-16T17:47:25.911 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2024-04-16T17:47:25.912 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-11 2024-04-16T17:47:25.912 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:25.912 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:25.912 DEBUG:boto:Method: PUT 2024-04-16T17:47:25.912 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:25.912 DEBUG:boto:Data: 2024-04-16T17:47:25.912 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.912 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:25.912 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.913 DEBUG:boto:Params: {} 2024-04-16T17:47:25.913 DEBUG:boto:Token: None 2024-04-16T17:47:25.913 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-11/ 2024-04-16T17:47:25.913 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FYA0tXr0MkdyhfMe2AKxrugecto= 2024-04-16T17:47:25.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FYA0tXr0MkdyhfMe2AKxrugecto=', 'Content-Length': '0'} 2024-04-16T17:47:25.930 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002876d9e283da8fc6-00661eb9ad-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.930 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-12 2024-04-16T17:47:25.930 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:25.930 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:25.930 DEBUG:boto:Method: PUT 2024-04-16T17:47:25.930 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:25.930 DEBUG:boto:Data: 2024-04-16T17:47:25.930 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:25.931 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.931 DEBUG:boto:Params: {} 2024-04-16T17:47:25.931 DEBUG:boto:Token: None 2024-04-16T17:47:25.931 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-12/ 2024-04-16T17:47:25.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrxbRwxu9IIxJNUMrfz03PGUUdQ= 2024-04-16T17:47:25.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrxbRwxu9IIxJNUMrfz03PGUUdQ=', 'Content-Length': '0'} 2024-04-16T17:47:25.958 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000051fc48eecc40bcc7-00661eb9ad-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.959 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:25.959 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:25.959 DEBUG:boto:Method: HEAD 2024-04-16T17:47:25.959 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:25.959 DEBUG:boto:Data: 2024-04-16T17:47:25.959 DEBUG:boto:Headers: {} 2024-04-16T17:47:25.959 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:25.959 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.959 DEBUG:boto:Params: {} 2024-04-16T17:47:25.959 DEBUG:boto:Token: None 2024-04-16T17:47:25.960 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-11/ 2024-04-16T17:47:25.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NZrbhgLey558jneK9DvoA1CEz2U= 2024-04-16T17:47:25.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NZrbhgLey558jneK9DvoA1CEz2U=', 'Content-Length': '0'} 2024-04-16T17:47:25.962 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000afb051af02c6eafc-00661eb9ad-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:25.962 DEBUG:boto:path=/cjqttm-11/obj1 2024-04-16T17:47:25.962 DEBUG:boto:auth_path=/cjqttm-11/obj1 2024-04-16T17:47:25.962 DEBUG:boto:Method: PUT 2024-04-16T17:47:25.962 DEBUG:boto:Path: /cjqttm-11/obj1 2024-04-16T17:47:25.963 DEBUG:boto:Data: 2024-04-16T17:47:25.963 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:25.963 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:25.963 DEBUG:boto:Port: 8000 2024-04-16T17:47:25.963 DEBUG:boto:Params: {} 2024-04-16T17:47:25.963 DEBUG:boto:Token: None 2024-04-16T17:47:25.963 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:25 GMT /cjqttm-11/obj1 2024-04-16T17:47:25.963 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4OPod198yM/KER+h/KTmaepOM1M= 2024-04-16T17:47:25.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4OPod198yM/KER+h/KTmaepOM1M='} 2024-04-16T17:47:26.006 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004671fa29aff6db59-00661eb9ad-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.007 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.007 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.007 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.007 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.007 DEBUG:boto:Data: 2024-04-16T17:47:26.007 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.007 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.007 DEBUG:boto:Params: {} 2024-04-16T17:47:26.008 DEBUG:boto:Token: None 2024-04-16T17:47:26.008 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.010 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000303ce4891a8cdf60-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.010 DEBUG:boto:path=/cjqttm-11/obj2 2024-04-16T17:47:26.010 DEBUG:boto:auth_path=/cjqttm-11/obj2 2024-04-16T17:47:26.011 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.011 DEBUG:boto:Path: /cjqttm-11/obj2 2024-04-16T17:47:26.011 DEBUG:boto:Data: 2024-04-16T17:47:26.011 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.011 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.011 DEBUG:boto:Params: {} 2024-04-16T17:47:26.011 DEBUG:boto:Token: None 2024-04-16T17:47:26.011 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj2 2024-04-16T17:47:26.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d3rsHYqWDwJ7bSTuoKexGt8TDSI= 2024-04-16T17:47:26.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d3rsHYqWDwJ7bSTuoKexGt8TDSI='} 2024-04-16T17:47:26.018 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004795aa1fc7529ba0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.018 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.018 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.018 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.018 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.018 DEBUG:boto:Data: 2024-04-16T17:47:26.018 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.019 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.019 DEBUG:boto:Params: {} 2024-04-16T17:47:26.019 DEBUG:boto:Token: None 2024-04-16T17:47:26.019 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.019 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.021 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000414c3b51e26523a1-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.021 DEBUG:boto:path=/cjqttm-11/obj3 2024-04-16T17:47:26.021 DEBUG:boto:auth_path=/cjqttm-11/obj3 2024-04-16T17:47:26.021 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.021 DEBUG:boto:Path: /cjqttm-11/obj3 2024-04-16T17:47:26.022 DEBUG:boto:Data: 2024-04-16T17:47:26.022 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.022 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.022 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.022 DEBUG:boto:Params: {} 2024-04-16T17:47:26.022 DEBUG:boto:Token: None 2024-04-16T17:47:26.022 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj3 2024-04-16T17:47:26.022 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dKBnj/19xy9l4VCAV1+8bo7ssDg= 2024-04-16T17:47:26.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dKBnj/19xy9l4VCAV1+8bo7ssDg='} 2024-04-16T17:47:26.028 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000059f49ea8ade7bab8-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.028 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.028 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.028 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.028 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.028 DEBUG:boto:Data: 2024-04-16T17:47:26.028 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.028 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.028 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.029 DEBUG:boto:Params: {} 2024-04-16T17:47:26.029 DEBUG:boto:Token: None 2024-04-16T17:47:26.029 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.031 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000da3de7ebc3963e91-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.031 DEBUG:boto:path=/cjqttm-11/obj4 2024-04-16T17:47:26.031 DEBUG:boto:auth_path=/cjqttm-11/obj4 2024-04-16T17:47:26.031 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.031 DEBUG:boto:Path: /cjqttm-11/obj4 2024-04-16T17:47:26.032 DEBUG:boto:Data: 2024-04-16T17:47:26.032 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.032 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.032 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.032 DEBUG:boto:Params: {} 2024-04-16T17:47:26.032 DEBUG:boto:Token: None 2024-04-16T17:47:26.032 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj4 2024-04-16T17:47:26.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:niGBsT6O68NGyGjIDhgFJCXQO1A= 2024-04-16T17:47:26.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:niGBsT6O68NGyGjIDhgFJCXQO1A='} 2024-04-16T17:47:26.074 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d2f25f5580dbb814-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.075 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.075 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.075 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.075 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.075 DEBUG:boto:Data: 2024-04-16T17:47:26.075 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.075 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.075 DEBUG:boto:Params: {} 2024-04-16T17:47:26.076 DEBUG:boto:Token: None 2024-04-16T17:47:26.076 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.078 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8da54ee4895b54e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.078 DEBUG:boto:path=/cjqttm-11/obj5 2024-04-16T17:47:26.078 DEBUG:boto:auth_path=/cjqttm-11/obj5 2024-04-16T17:47:26.078 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.078 DEBUG:boto:Path: /cjqttm-11/obj5 2024-04-16T17:47:26.079 DEBUG:boto:Data: 2024-04-16T17:47:26.079 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.079 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.079 DEBUG:boto:Params: {} 2024-04-16T17:47:26.079 DEBUG:boto:Token: None 2024-04-16T17:47:26.079 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj5 2024-04-16T17:47:26.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vLquXldup+EvxTL9+WUXY3iL9sY= 2024-04-16T17:47:26.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLquXldup+EvxTL9+WUXY3iL9sY='} 2024-04-16T17:47:26.083 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000068fc6d4904e5a608-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.083 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.084 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.084 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.084 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.084 DEBUG:boto:Data: 2024-04-16T17:47:26.084 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.084 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.084 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.084 DEBUG:boto:Params: {} 2024-04-16T17:47:26.084 DEBUG:boto:Token: None 2024-04-16T17:47:26.085 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.085 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.086 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003369d9be87062499-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.087 DEBUG:boto:path=/cjqttm-11/obj6 2024-04-16T17:47:26.087 DEBUG:boto:auth_path=/cjqttm-11/obj6 2024-04-16T17:47:26.087 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.087 DEBUG:boto:Path: /cjqttm-11/obj6 2024-04-16T17:47:26.087 DEBUG:boto:Data: 2024-04-16T17:47:26.087 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.087 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.087 DEBUG:boto:Params: {} 2024-04-16T17:47:26.088 DEBUG:boto:Token: None 2024-04-16T17:47:26.089 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj6 2024-04-16T17:47:26.089 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V4wsWZoiYrGdrx+Wtd0oaEpnO7k= 2024-04-16T17:47:26.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V4wsWZoiYrGdrx+Wtd0oaEpnO7k='} 2024-04-16T17:47:26.134 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008214225667663fd3-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.135 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.135 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.135 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.135 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.135 DEBUG:boto:Data: 2024-04-16T17:47:26.135 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.135 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.135 DEBUG:boto:Params: {} 2024-04-16T17:47:26.135 DEBUG:boto:Token: None 2024-04-16T17:47:26.136 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.138 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006aa3fc1b3d6a666e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.138 DEBUG:boto:path=/cjqttm-11/obj7 2024-04-16T17:47:26.138 DEBUG:boto:auth_path=/cjqttm-11/obj7 2024-04-16T17:47:26.138 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.138 DEBUG:boto:Path: /cjqttm-11/obj7 2024-04-16T17:47:26.139 DEBUG:boto:Data: 2024-04-16T17:47:26.139 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.139 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.139 DEBUG:boto:Params: {} 2024-04-16T17:47:26.139 DEBUG:boto:Token: None 2024-04-16T17:47:26.139 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj7 2024-04-16T17:47:26.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oLuuZO9Od2W81ovnXq4xESNX4rM= 2024-04-16T17:47:26.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oLuuZO9Od2W81ovnXq4xESNX4rM='} 2024-04-16T17:47:26.144 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002a7e89eb89280f75-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.144 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.144 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.144 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.144 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.145 DEBUG:boto:Data: 2024-04-16T17:47:26.145 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.145 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.145 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.145 DEBUG:boto:Params: {} 2024-04-16T17:47:26.145 DEBUG:boto:Token: None 2024-04-16T17:47:26.145 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.145 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.147 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f239ecbfa8f0f07-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.147 DEBUG:boto:path=/cjqttm-11/obj8 2024-04-16T17:47:26.148 DEBUG:boto:auth_path=/cjqttm-11/obj8 2024-04-16T17:47:26.148 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.148 DEBUG:boto:Path: /cjqttm-11/obj8 2024-04-16T17:47:26.148 DEBUG:boto:Data: 2024-04-16T17:47:26.148 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.148 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.148 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.148 DEBUG:boto:Params: {} 2024-04-16T17:47:26.148 DEBUG:boto:Token: None 2024-04-16T17:47:26.148 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj8 2024-04-16T17:47:26.149 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zE1PDEHp34itBxJNknZfaq5h6z0= 2024-04-16T17:47:26.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zE1PDEHp34itBxJNknZfaq5h6z0='} 2024-04-16T17:47:26.190 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000249ee1e6e386e8fc-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.190 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.191 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.191 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.191 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.191 DEBUG:boto:Data: 2024-04-16T17:47:26.191 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.191 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.191 DEBUG:boto:Params: {} 2024-04-16T17:47:26.191 DEBUG:boto:Token: None 2024-04-16T17:47:26.191 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.193 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000c661dae56b52e4f-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.193 DEBUG:boto:path=/cjqttm-11/obj9 2024-04-16T17:47:26.194 DEBUG:boto:auth_path=/cjqttm-11/obj9 2024-04-16T17:47:26.194 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.194 DEBUG:boto:Path: /cjqttm-11/obj9 2024-04-16T17:47:26.194 DEBUG:boto:Data: 2024-04-16T17:47:26.194 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.194 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.194 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.194 DEBUG:boto:Params: {} 2024-04-16T17:47:26.194 DEBUG:boto:Token: None 2024-04-16T17:47:26.195 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj9 2024-04-16T17:47:26.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jCDYNUTlntoYu68IKYrv6E50LWM= 2024-04-16T17:47:26.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jCDYNUTlntoYu68IKYrv6E50LWM='} 2024-04-16T17:47:26.200 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d64b9f9b248be01a-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.200 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.200 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.201 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.201 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.201 DEBUG:boto:Data: 2024-04-16T17:47:26.201 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.201 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.201 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.201 DEBUG:boto:Params: {} 2024-04-16T17:47:26.201 DEBUG:boto:Token: None 2024-04-16T17:47:26.201 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.203 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a81ccc34d4d49e4d-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.203 DEBUG:boto:path=/cjqttm-11/obj10 2024-04-16T17:47:26.203 DEBUG:boto:auth_path=/cjqttm-11/obj10 2024-04-16T17:47:26.203 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.204 DEBUG:boto:Path: /cjqttm-11/obj10 2024-04-16T17:47:26.204 DEBUG:boto:Data: 2024-04-16T17:47:26.204 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.204 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.204 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.204 DEBUG:boto:Params: {} 2024-04-16T17:47:26.204 DEBUG:boto:Token: None 2024-04-16T17:47:26.204 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj10 2024-04-16T17:47:26.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1av36fivsduuMxnzaJ8vsboOuN4= 2024-04-16T17:47:26.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1av36fivsduuMxnzaJ8vsboOuN4='} 2024-04-16T17:47:26.246 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000551a1d8b76ac4ab6-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.247 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.247 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.247 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.247 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.247 DEBUG:boto:Data: 2024-04-16T17:47:26.247 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.247 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.247 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.247 DEBUG:boto:Params: {} 2024-04-16T17:47:26.247 DEBUG:boto:Token: None 2024-04-16T17:47:26.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.250 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000677ce7b9d4b09a83-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.250 DEBUG:boto:path=/cjqttm-11/obj11 2024-04-16T17:47:26.250 DEBUG:boto:auth_path=/cjqttm-11/obj11 2024-04-16T17:47:26.250 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.250 DEBUG:boto:Path: /cjqttm-11/obj11 2024-04-16T17:47:26.250 DEBUG:boto:Data: 2024-04-16T17:47:26.251 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.251 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.251 DEBUG:boto:Params: {} 2024-04-16T17:47:26.251 DEBUG:boto:Token: None 2024-04-16T17:47:26.251 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj11 2024-04-16T17:47:26.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2nmvozd+ZG18ehO/M3JBZe/cgog= 2024-04-16T17:47:26.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2nmvozd+ZG18ehO/M3JBZe/cgog='} 2024-04-16T17:47:26.256 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000527b1e265805c5d4-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.257 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.257 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.257 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.257 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.257 DEBUG:boto:Data: 2024-04-16T17:47:26.257 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.257 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.257 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.257 DEBUG:boto:Params: {} 2024-04-16T17:47:26.258 DEBUG:boto:Token: None 2024-04-16T17:47:26.258 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.260 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001790a02ed1c6b468-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.260 DEBUG:boto:path=/cjqttm-11/obj12 2024-04-16T17:47:26.261 DEBUG:boto:auth_path=/cjqttm-11/obj12 2024-04-16T17:47:26.261 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.261 DEBUG:boto:Path: /cjqttm-11/obj12 2024-04-16T17:47:26.261 DEBUG:boto:Data: 2024-04-16T17:47:26.261 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.261 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.261 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.261 DEBUG:boto:Params: {} 2024-04-16T17:47:26.261 DEBUG:boto:Token: None 2024-04-16T17:47:26.261 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj12 2024-04-16T17:47:26.262 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qowW0Kf/IqIZ85gDmtjaWAxtT+A= 2024-04-16T17:47:26.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qowW0Kf/IqIZ85gDmtjaWAxtT+A='} 2024-04-16T17:47:26.266 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d89393059ee80060-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.266 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.266 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.266 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.266 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.266 DEBUG:boto:Data: 2024-04-16T17:47:26.266 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.266 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.266 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.267 DEBUG:boto:Params: {} 2024-04-16T17:47:26.267 DEBUG:boto:Token: None 2024-04-16T17:47:26.267 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.269 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000752c6e161b2ed4ca-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.269 DEBUG:boto:path=/cjqttm-11/obj13 2024-04-16T17:47:26.269 DEBUG:boto:auth_path=/cjqttm-11/obj13 2024-04-16T17:47:26.269 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.269 DEBUG:boto:Path: /cjqttm-11/obj13 2024-04-16T17:47:26.269 DEBUG:boto:Data: 2024-04-16T17:47:26.270 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.270 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.270 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.270 DEBUG:boto:Params: {} 2024-04-16T17:47:26.270 DEBUG:boto:Token: None 2024-04-16T17:47:26.270 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj13 2024-04-16T17:47:26.270 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dvzcvrbsdHcsrdnhF09OVZ0CECk= 2024-04-16T17:47:26.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvzcvrbsdHcsrdnhF09OVZ0CECk='} 2024-04-16T17:47:26.274 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000aaeafd5527927613-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.274 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.274 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.275 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.275 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.275 DEBUG:boto:Data: 2024-04-16T17:47:26.275 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.275 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.275 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.275 DEBUG:boto:Params: {} 2024-04-16T17:47:26.275 DEBUG:boto:Token: None 2024-04-16T17:47:26.275 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.277 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b737a2366e199060-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.277 DEBUG:boto:path=/cjqttm-11/obj14 2024-04-16T17:47:26.278 DEBUG:boto:auth_path=/cjqttm-11/obj14 2024-04-16T17:47:26.278 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.278 DEBUG:boto:Path: /cjqttm-11/obj14 2024-04-16T17:47:26.278 DEBUG:boto:Data: 2024-04-16T17:47:26.278 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.278 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.278 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.278 DEBUG:boto:Params: {} 2024-04-16T17:47:26.278 DEBUG:boto:Token: None 2024-04-16T17:47:26.278 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj14 2024-04-16T17:47:26.279 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WIMSuQIQM627BQoT5K0haqJi1zE= 2024-04-16T17:47:26.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WIMSuQIQM627BQoT5K0haqJi1zE='} 2024-04-16T17:47:26.282 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bee7d1f04f739207-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.282 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.282 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.283 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.283 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.283 DEBUG:boto:Data: 2024-04-16T17:47:26.283 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.283 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.283 DEBUG:boto:Params: {} 2024-04-16T17:47:26.283 DEBUG:boto:Token: None 2024-04-16T17:47:26.283 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.285 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f33e4b7ab0a54c8c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.285 DEBUG:boto:path=/cjqttm-11/obj15 2024-04-16T17:47:26.285 DEBUG:boto:auth_path=/cjqttm-11/obj15 2024-04-16T17:47:26.286 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.286 DEBUG:boto:Path: /cjqttm-11/obj15 2024-04-16T17:47:26.286 DEBUG:boto:Data: 2024-04-16T17:47:26.286 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.286 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.286 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.286 DEBUG:boto:Params: {} 2024-04-16T17:47:26.286 DEBUG:boto:Token: None 2024-04-16T17:47:26.286 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj15 2024-04-16T17:47:26.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8R9H7uX2E8P/vlnBVq219Dto1Rk= 2024-04-16T17:47:26.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8R9H7uX2E8P/vlnBVq219Dto1Rk='} 2024-04-16T17:47:26.330 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004efb1bc4d3cd2d8e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.331 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.331 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.331 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.331 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.331 DEBUG:boto:Data: 2024-04-16T17:47:26.331 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.331 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.331 DEBUG:boto:Params: {} 2024-04-16T17:47:26.331 DEBUG:boto:Token: None 2024-04-16T17:47:26.332 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.334 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000074b436e2f42fc691-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.334 DEBUG:boto:path=/cjqttm-11/obj16 2024-04-16T17:47:26.334 DEBUG:boto:auth_path=/cjqttm-11/obj16 2024-04-16T17:47:26.335 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.335 DEBUG:boto:Path: /cjqttm-11/obj16 2024-04-16T17:47:26.335 DEBUG:boto:Data: 2024-04-16T17:47:26.335 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.335 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.335 DEBUG:boto:Params: {} 2024-04-16T17:47:26.335 DEBUG:boto:Token: None 2024-04-16T17:47:26.335 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj16 2024-04-16T17:47:26.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YesXTthbfx3TI6MDTl1TaGhLYRo= 2024-04-16T17:47:26.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YesXTthbfx3TI6MDTl1TaGhLYRo='} 2024-04-16T17:47:26.340 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e4a6859b4e84ac79-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.341 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.341 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.341 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.341 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.341 DEBUG:boto:Data: 2024-04-16T17:47:26.341 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.341 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.341 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.341 DEBUG:boto:Params: {} 2024-04-16T17:47:26.341 DEBUG:boto:Token: None 2024-04-16T17:47:26.342 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.342 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.344 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049c731f3c2255d28-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.344 DEBUG:boto:path=/cjqttm-11/obj17 2024-04-16T17:47:26.344 DEBUG:boto:auth_path=/cjqttm-11/obj17 2024-04-16T17:47:26.344 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.344 DEBUG:boto:Path: /cjqttm-11/obj17 2024-04-16T17:47:26.344 DEBUG:boto:Data: 2024-04-16T17:47:26.344 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.344 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.345 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.345 DEBUG:boto:Params: {} 2024-04-16T17:47:26.345 DEBUG:boto:Token: None 2024-04-16T17:47:26.345 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj17 2024-04-16T17:47:26.345 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wzvCOySsPL4BwTDnpAwcYz8sjwc= 2024-04-16T17:47:26.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wzvCOySsPL4BwTDnpAwcYz8sjwc='} 2024-04-16T17:47:26.349 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c3b9da5aae9efc8-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.349 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.349 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.349 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.349 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.349 DEBUG:boto:Data: 2024-04-16T17:47:26.349 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.349 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.349 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.349 DEBUG:boto:Params: {} 2024-04-16T17:47:26.350 DEBUG:boto:Token: None 2024-04-16T17:47:26.350 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.352 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008d6f2ac1c505bd0c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.352 DEBUG:boto:path=/cjqttm-11/obj18 2024-04-16T17:47:26.352 DEBUG:boto:auth_path=/cjqttm-11/obj18 2024-04-16T17:47:26.352 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.353 DEBUG:boto:Path: /cjqttm-11/obj18 2024-04-16T17:47:26.353 DEBUG:boto:Data: 2024-04-16T17:47:26.353 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.353 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.353 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.353 DEBUG:boto:Params: {} 2024-04-16T17:47:26.353 DEBUG:boto:Token: None 2024-04-16T17:47:26.353 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj18 2024-04-16T17:47:26.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FHRakz0t9qgEKD5OS/7dCyYxFpw= 2024-04-16T17:47:26.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FHRakz0t9qgEKD5OS/7dCyYxFpw='} 2024-04-16T17:47:26.398 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000193f017d09f9c0ad-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.399 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.399 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.399 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.399 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.399 DEBUG:boto:Data: 2024-04-16T17:47:26.399 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.399 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.399 DEBUG:boto:Params: {} 2024-04-16T17:47:26.400 DEBUG:boto:Token: None 2024-04-16T17:47:26.400 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.402 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000068d62ef8e7f4b2c1-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.402 DEBUG:boto:path=/cjqttm-11/obj19 2024-04-16T17:47:26.402 DEBUG:boto:auth_path=/cjqttm-11/obj19 2024-04-16T17:47:26.403 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.403 DEBUG:boto:Path: /cjqttm-11/obj19 2024-04-16T17:47:26.403 DEBUG:boto:Data: 2024-04-16T17:47:26.403 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.403 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.403 DEBUG:boto:Params: {} 2024-04-16T17:47:26.403 DEBUG:boto:Token: None 2024-04-16T17:47:26.403 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj19 2024-04-16T17:47:26.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DDAgIKOPRAMN35z1tiE+Fp8++jo= 2024-04-16T17:47:26.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DDAgIKOPRAMN35z1tiE+Fp8++jo='} 2024-04-16T17:47:26.407 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000070d2435db5420d7e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.407 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.408 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.408 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.408 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.408 DEBUG:boto:Data: 2024-04-16T17:47:26.408 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.408 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.408 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.408 DEBUG:boto:Params: {} 2024-04-16T17:47:26.408 DEBUG:boto:Token: None 2024-04-16T17:47:26.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.409 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.411 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f51e85757924128-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.411 DEBUG:boto:path=/cjqttm-11/obj20 2024-04-16T17:47:26.411 DEBUG:boto:auth_path=/cjqttm-11/obj20 2024-04-16T17:47:26.411 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.411 DEBUG:boto:Path: /cjqttm-11/obj20 2024-04-16T17:47:26.411 DEBUG:boto:Data: 2024-04-16T17:47:26.411 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.412 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.412 DEBUG:boto:Params: {} 2024-04-16T17:47:26.412 DEBUG:boto:Token: None 2024-04-16T17:47:26.412 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj20 2024-04-16T17:47:26.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8dJtSC70CFKCsshF3zvUwhFPTOg= 2024-04-16T17:47:26.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8dJtSC70CFKCsshF3zvUwhFPTOg='} 2024-04-16T17:47:26.454 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfe3b607bdfc2c74-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.455 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.455 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.455 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.455 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.455 DEBUG:boto:Data: 2024-04-16T17:47:26.455 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.455 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.455 DEBUG:boto:Params: {} 2024-04-16T17:47:26.455 DEBUG:boto:Token: None 2024-04-16T17:47:26.456 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.458 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006c923ca1b74de2ca-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.458 DEBUG:boto:path=/cjqttm-11/obj21 2024-04-16T17:47:26.458 DEBUG:boto:auth_path=/cjqttm-11/obj21 2024-04-16T17:47:26.458 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.459 DEBUG:boto:Path: /cjqttm-11/obj21 2024-04-16T17:47:26.459 DEBUG:boto:Data: 2024-04-16T17:47:26.459 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.459 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.459 DEBUG:boto:Params: {} 2024-04-16T17:47:26.459 DEBUG:boto:Token: None 2024-04-16T17:47:26.459 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj21 2024-04-16T17:47:26.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c276dX12dw96Hfjo3N9ARjsGkkc= 2024-04-16T17:47:26.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c276dX12dw96Hfjo3N9ARjsGkkc='} 2024-04-16T17:47:26.465 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d8cd0fc31a5ac63c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.465 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.465 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.465 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.465 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.465 DEBUG:boto:Data: 2024-04-16T17:47:26.465 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.465 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.465 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.465 DEBUG:boto:Params: {} 2024-04-16T17:47:26.466 DEBUG:boto:Token: None 2024-04-16T17:47:26.466 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.466 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.468 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d9b3ebcdffb293d-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.468 DEBUG:boto:path=/cjqttm-11/obj22 2024-04-16T17:47:26.468 DEBUG:boto:auth_path=/cjqttm-11/obj22 2024-04-16T17:47:26.468 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.468 DEBUG:boto:Path: /cjqttm-11/obj22 2024-04-16T17:47:26.468 DEBUG:boto:Data: 2024-04-16T17:47:26.468 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.469 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.469 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.469 DEBUG:boto:Params: {} 2024-04-16T17:47:26.469 DEBUG:boto:Token: None 2024-04-16T17:47:26.469 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj22 2024-04-16T17:47:26.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Gzp4jKRe8WivcVy+nb7YKcWunCM= 2024-04-16T17:47:26.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gzp4jKRe8WivcVy+nb7YKcWunCM='} 2024-04-16T17:47:26.473 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cfc190819ae96f86-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.473 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.473 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.473 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.473 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.473 DEBUG:boto:Data: 2024-04-16T17:47:26.473 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.473 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.474 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.474 DEBUG:boto:Params: {} 2024-04-16T17:47:26.474 DEBUG:boto:Token: None 2024-04-16T17:47:26.474 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.474 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.476 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '132'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7573fcb64e100b2-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.476 DEBUG:boto:path=/cjqttm-11/obj23 2024-04-16T17:47:26.476 DEBUG:boto:auth_path=/cjqttm-11/obj23 2024-04-16T17:47:26.476 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.476 DEBUG:boto:Path: /cjqttm-11/obj23 2024-04-16T17:47:26.476 DEBUG:boto:Data: 2024-04-16T17:47:26.476 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.476 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.477 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.477 DEBUG:boto:Params: {} 2024-04-16T17:47:26.477 DEBUG:boto:Token: None 2024-04-16T17:47:26.477 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj23 2024-04-16T17:47:26.477 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gIjrQaq5/23rJ+LTEQOpcFfzCk8= 2024-04-16T17:47:26.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gIjrQaq5/23rJ+LTEQOpcFfzCk8='} 2024-04-16T17:47:26.518 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ab1581bdf59e7799-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.519 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.519 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.519 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.519 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.519 DEBUG:boto:Data: 2024-04-16T17:47:26.519 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.519 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.519 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.519 DEBUG:boto:Params: {} 2024-04-16T17:47:26.520 DEBUG:boto:Token: None 2024-04-16T17:47:26.520 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.522 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9cba2ccc92e6ff7-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.522 DEBUG:boto:path=/cjqttm-11/obj24 2024-04-16T17:47:26.522 DEBUG:boto:auth_path=/cjqttm-11/obj24 2024-04-16T17:47:26.522 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.523 DEBUG:boto:Path: /cjqttm-11/obj24 2024-04-16T17:47:26.523 DEBUG:boto:Data: 2024-04-16T17:47:26.523 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.523 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.523 DEBUG:boto:Params: {} 2024-04-16T17:47:26.523 DEBUG:boto:Token: None 2024-04-16T17:47:26.523 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj24 2024-04-16T17:47:26.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x3sCHAwaxXhUiuDhp4nUucv20a0= 2024-04-16T17:47:26.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x3sCHAwaxXhUiuDhp4nUucv20a0='} 2024-04-16T17:47:26.527 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a690e597cb619c55-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.528 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.528 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.528 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.528 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.528 DEBUG:boto:Data: 2024-04-16T17:47:26.528 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.528 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.528 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.528 DEBUG:boto:Params: {} 2024-04-16T17:47:26.528 DEBUG:boto:Token: None 2024-04-16T17:47:26.529 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.529 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.530 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f841cbfcee6b3eea-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.531 DEBUG:boto:path=/cjqttm-11/obj25 2024-04-16T17:47:26.531 DEBUG:boto:auth_path=/cjqttm-11/obj25 2024-04-16T17:47:26.531 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.531 DEBUG:boto:Path: /cjqttm-11/obj25 2024-04-16T17:47:26.531 DEBUG:boto:Data: 2024-04-16T17:47:26.531 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.531 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.531 DEBUG:boto:Params: {} 2024-04-16T17:47:26.531 DEBUG:boto:Token: None 2024-04-16T17:47:26.532 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj25 2024-04-16T17:47:26.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZO8FtU5U7wLsSBhEDrA6p5HkI3k= 2024-04-16T17:47:26.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZO8FtU5U7wLsSBhEDrA6p5HkI3k='} 2024-04-16T17:47:26.574 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e4731b777057d382-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.575 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.575 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.575 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.575 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.575 DEBUG:boto:Data: 2024-04-16T17:47:26.575 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.575 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.575 DEBUG:boto:Params: {} 2024-04-16T17:47:26.575 DEBUG:boto:Token: None 2024-04-16T17:47:26.576 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.577 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eb4de812624a5058-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.578 DEBUG:boto:path=/cjqttm-11/obj26 2024-04-16T17:47:26.578 DEBUG:boto:auth_path=/cjqttm-11/obj26 2024-04-16T17:47:26.578 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.578 DEBUG:boto:Path: /cjqttm-11/obj26 2024-04-16T17:47:26.578 DEBUG:boto:Data: 2024-04-16T17:47:26.578 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.578 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.578 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.578 DEBUG:boto:Params: {} 2024-04-16T17:47:26.579 DEBUG:boto:Token: None 2024-04-16T17:47:26.579 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj26 2024-04-16T17:47:26.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JPl2s8Ea0jm0LFyrm/0NUNfWOY4= 2024-04-16T17:47:26.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JPl2s8Ea0jm0LFyrm/0NUNfWOY4='} 2024-04-16T17:47:26.582 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005dbe754b8f1532b9-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.583 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.583 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.583 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.583 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.583 DEBUG:boto:Data: 2024-04-16T17:47:26.583 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.583 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.583 DEBUG:boto:Params: {} 2024-04-16T17:47:26.583 DEBUG:boto:Token: None 2024-04-16T17:47:26.583 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.585 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000420ef169bddc0f59-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.586 DEBUG:boto:path=/cjqttm-11/obj27 2024-04-16T17:47:26.586 DEBUG:boto:auth_path=/cjqttm-11/obj27 2024-04-16T17:47:26.586 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.586 DEBUG:boto:Path: /cjqttm-11/obj27 2024-04-16T17:47:26.586 DEBUG:boto:Data: 2024-04-16T17:47:26.586 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.586 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.586 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.586 DEBUG:boto:Params: {} 2024-04-16T17:47:26.586 DEBUG:boto:Token: None 2024-04-16T17:47:26.587 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj27 2024-04-16T17:47:26.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vfWS9yZgfuVJKdF0tVfzKobygyg= 2024-04-16T17:47:26.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vfWS9yZgfuVJKdF0tVfzKobygyg='} 2024-04-16T17:47:26.591 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002d9ed16775113082-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.591 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.591 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.591 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.591 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.591 DEBUG:boto:Data: 2024-04-16T17:47:26.591 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.591 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.591 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.592 DEBUG:boto:Params: {} 2024-04-16T17:47:26.592 DEBUG:boto:Token: None 2024-04-16T17:47:26.592 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.594 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007d23daa80542f52a-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.594 DEBUG:boto:path=/cjqttm-11/obj28 2024-04-16T17:47:26.594 DEBUG:boto:auth_path=/cjqttm-11/obj28 2024-04-16T17:47:26.594 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.594 DEBUG:boto:Path: /cjqttm-11/obj28 2024-04-16T17:47:26.594 DEBUG:boto:Data: 2024-04-16T17:47:26.594 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.594 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.594 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.595 DEBUG:boto:Params: {} 2024-04-16T17:47:26.595 DEBUG:boto:Token: None 2024-04-16T17:47:26.595 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj28 2024-04-16T17:47:26.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rBUta3LMtjkRnlH8ANK6s3jvoRw= 2024-04-16T17:47:26.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rBUta3LMtjkRnlH8ANK6s3jvoRw='} 2024-04-16T17:47:26.638 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000751cdde29fe4cb57-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.639 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.639 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.639 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.639 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.639 DEBUG:boto:Data: 2024-04-16T17:47:26.639 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.639 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.639 DEBUG:boto:Params: {} 2024-04-16T17:47:26.640 DEBUG:boto:Token: None 2024-04-16T17:47:26.640 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.642 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058cac51eed7d39a2-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.642 DEBUG:boto:path=/cjqttm-11/obj29 2024-04-16T17:47:26.642 DEBUG:boto:auth_path=/cjqttm-11/obj29 2024-04-16T17:47:26.643 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.643 DEBUG:boto:Path: /cjqttm-11/obj29 2024-04-16T17:47:26.643 DEBUG:boto:Data: 2024-04-16T17:47:26.643 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.643 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.643 DEBUG:boto:Params: {} 2024-04-16T17:47:26.643 DEBUG:boto:Token: None 2024-04-16T17:47:26.643 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj29 2024-04-16T17:47:26.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ymhfDZZDd8lfwydw7LPJxsHf8Mg= 2024-04-16T17:47:26.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ymhfDZZDd8lfwydw7LPJxsHf8Mg='} 2024-04-16T17:47:26.647 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ee95dc10a6f1d521-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.647 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.648 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.648 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.648 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.648 DEBUG:boto:Data: 2024-04-16T17:47:26.648 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.648 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.648 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.648 DEBUG:boto:Params: {} 2024-04-16T17:47:26.648 DEBUG:boto:Token: None 2024-04-16T17:47:26.648 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.649 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.650 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b088c2888316d739-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.651 DEBUG:boto:path=/cjqttm-11/obj30 2024-04-16T17:47:26.651 DEBUG:boto:auth_path=/cjqttm-11/obj30 2024-04-16T17:47:26.651 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.651 DEBUG:boto:Path: /cjqttm-11/obj30 2024-04-16T17:47:26.651 DEBUG:boto:Data: 2024-04-16T17:47:26.651 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.651 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.651 DEBUG:boto:Params: {} 2024-04-16T17:47:26.652 DEBUG:boto:Token: None 2024-04-16T17:47:26.652 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj30 2024-04-16T17:47:26.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vJwbMqXs3FAoF8Re6a/uwENKMGQ= 2024-04-16T17:47:26.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vJwbMqXs3FAoF8Re6a/uwENKMGQ='} 2024-04-16T17:47:26.694 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e76566e2c6f96475-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.695 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.695 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.695 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.695 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.695 DEBUG:boto:Data: 2024-04-16T17:47:26.695 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.695 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.695 DEBUG:boto:Params: {} 2024-04-16T17:47:26.696 DEBUG:boto:Token: None 2024-04-16T17:47:26.696 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.697 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '180'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005ef62977ea61ccb0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.698 DEBUG:boto:path=/cjqttm-11/obj31 2024-04-16T17:47:26.698 DEBUG:boto:auth_path=/cjqttm-11/obj31 2024-04-16T17:47:26.698 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.698 DEBUG:boto:Path: /cjqttm-11/obj31 2024-04-16T17:47:26.698 DEBUG:boto:Data: 2024-04-16T17:47:26.698 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.698 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.698 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.698 DEBUG:boto:Params: {} 2024-04-16T17:47:26.699 DEBUG:boto:Token: None 2024-04-16T17:47:26.699 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj31 2024-04-16T17:47:26.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xwA7bf6aRt9dffAKEEK0pmvTReg= 2024-04-16T17:47:26.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xwA7bf6aRt9dffAKEEK0pmvTReg='} 2024-04-16T17:47:26.703 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008605fcd4ce1e27f0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.703 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.703 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.703 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.703 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.703 DEBUG:boto:Data: 2024-04-16T17:47:26.704 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.704 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.704 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.704 DEBUG:boto:Params: {} 2024-04-16T17:47:26.704 DEBUG:boto:Token: None 2024-04-16T17:47:26.704 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.706 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '186'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e311532400912f74-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.706 DEBUG:boto:path=/cjqttm-11/obj32 2024-04-16T17:47:26.706 DEBUG:boto:auth_path=/cjqttm-11/obj32 2024-04-16T17:47:26.706 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.706 DEBUG:boto:Path: /cjqttm-11/obj32 2024-04-16T17:47:26.706 DEBUG:boto:Data: 2024-04-16T17:47:26.707 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.707 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.707 DEBUG:boto:Params: {} 2024-04-16T17:47:26.707 DEBUG:boto:Token: None 2024-04-16T17:47:26.707 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj32 2024-04-16T17:47:26.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7/+1yBKsegt1GFyxspchKf6lOW4= 2024-04-16T17:47:26.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7/+1yBKsegt1GFyxspchKf6lOW4='} 2024-04-16T17:47:26.711 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004dfdba08e18bb832-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.711 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.711 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.712 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.712 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.712 DEBUG:boto:Data: 2024-04-16T17:47:26.712 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.712 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.712 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.712 DEBUG:boto:Params: {} 2024-04-16T17:47:26.712 DEBUG:boto:Token: None 2024-04-16T17:47:26.712 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.714 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '192'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000013ef02e591929cef-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.715 DEBUG:boto:path=/cjqttm-11/obj33 2024-04-16T17:47:26.715 DEBUG:boto:auth_path=/cjqttm-11/obj33 2024-04-16T17:47:26.715 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.715 DEBUG:boto:Path: /cjqttm-11/obj33 2024-04-16T17:47:26.715 DEBUG:boto:Data: 2024-04-16T17:47:26.715 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.715 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.715 DEBUG:boto:Params: {} 2024-04-16T17:47:26.716 DEBUG:boto:Token: None 2024-04-16T17:47:26.716 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj33 2024-04-16T17:47:26.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vLE1CQvuIJEWjlWLaTEteZehzbo= 2024-04-16T17:47:26.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLE1CQvuIJEWjlWLaTEteZehzbo='} 2024-04-16T17:47:26.758 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000034067af6dacca90f-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.759 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.759 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.759 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.759 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.759 DEBUG:boto:Data: 2024-04-16T17:47:26.759 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.759 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.760 DEBUG:boto:Params: {} 2024-04-16T17:47:26.760 DEBUG:boto:Token: None 2024-04-16T17:47:26.760 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.762 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '198'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8faf401036a69ee-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.762 DEBUG:boto:path=/cjqttm-11/obj34 2024-04-16T17:47:26.763 DEBUG:boto:auth_path=/cjqttm-11/obj34 2024-04-16T17:47:26.763 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.763 DEBUG:boto:Path: /cjqttm-11/obj34 2024-04-16T17:47:26.763 DEBUG:boto:Data: 2024-04-16T17:47:26.763 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.763 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.763 DEBUG:boto:Params: {} 2024-04-16T17:47:26.763 DEBUG:boto:Token: None 2024-04-16T17:47:26.763 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj34 2024-04-16T17:47:26.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/WVZnbS3NfwDSMIWZzf3nETE6Q= 2024-04-16T17:47:26.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/WVZnbS3NfwDSMIWZzf3nETE6Q='} 2024-04-16T17:47:26.767 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000262e6166454003f1-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.767 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.768 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.768 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.768 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.768 DEBUG:boto:Data: 2024-04-16T17:47:26.768 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.768 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.768 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.768 DEBUG:boto:Params: {} 2024-04-16T17:47:26.768 DEBUG:boto:Token: None 2024-04-16T17:47:26.768 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.770 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '204'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ff81e53753f4a24-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.770 DEBUG:boto:path=/cjqttm-11/obj35 2024-04-16T17:47:26.771 DEBUG:boto:auth_path=/cjqttm-11/obj35 2024-04-16T17:47:26.771 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.771 DEBUG:boto:Path: /cjqttm-11/obj35 2024-04-16T17:47:26.771 DEBUG:boto:Data: 2024-04-16T17:47:26.771 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.771 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.771 DEBUG:boto:Params: {} 2024-04-16T17:47:26.771 DEBUG:boto:Token: None 2024-04-16T17:47:26.771 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj35 2024-04-16T17:47:26.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ftDpX6qnJ1hCT+Mk4iGSfsKUR8o= 2024-04-16T17:47:26.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ftDpX6qnJ1hCT+Mk4iGSfsKUR8o='} 2024-04-16T17:47:26.814 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004779d93f83659ac4-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.815 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.815 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.815 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.815 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.815 DEBUG:boto:Data: 2024-04-16T17:47:26.815 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.815 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.815 DEBUG:boto:Params: {} 2024-04-16T17:47:26.815 DEBUG:boto:Token: None 2024-04-16T17:47:26.816 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.818 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '210'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f88fc273ea1362a0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.818 DEBUG:boto:path=/cjqttm-11/obj36 2024-04-16T17:47:26.818 DEBUG:boto:auth_path=/cjqttm-11/obj36 2024-04-16T17:47:26.818 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.818 DEBUG:boto:Path: /cjqttm-11/obj36 2024-04-16T17:47:26.818 DEBUG:boto:Data: 2024-04-16T17:47:26.819 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.819 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.819 DEBUG:boto:Params: {} 2024-04-16T17:47:26.819 DEBUG:boto:Token: None 2024-04-16T17:47:26.819 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj36 2024-04-16T17:47:26.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7yH1T3/zoKKRTOlXBh7DfsWdY9Q= 2024-04-16T17:47:26.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7yH1T3/zoKKRTOlXBh7DfsWdY9Q='} 2024-04-16T17:47:26.823 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fd5836bcdf865fa2-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.823 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.823 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.823 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.823 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.823 DEBUG:boto:Data: 2024-04-16T17:47:26.823 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.823 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.824 DEBUG:boto:Params: {} 2024-04-16T17:47:26.824 DEBUG:boto:Token: None 2024-04-16T17:47:26.824 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.826 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '216'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d7827da6120a420-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.826 DEBUG:boto:path=/cjqttm-11/obj37 2024-04-16T17:47:26.826 DEBUG:boto:auth_path=/cjqttm-11/obj37 2024-04-16T17:47:26.826 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.827 DEBUG:boto:Path: /cjqttm-11/obj37 2024-04-16T17:47:26.827 DEBUG:boto:Data: 2024-04-16T17:47:26.827 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.827 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.827 DEBUG:boto:Params: {} 2024-04-16T17:47:26.827 DEBUG:boto:Token: None 2024-04-16T17:47:26.827 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj37 2024-04-16T17:47:26.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xM+Ml5XTLbBEJTsMtN8YnlFLOcw= 2024-04-16T17:47:26.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xM+Ml5XTLbBEJTsMtN8YnlFLOcw='} 2024-04-16T17:47:26.831 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000988c7422f809e322-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.831 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.831 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.831 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.831 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.831 DEBUG:boto:Data: 2024-04-16T17:47:26.831 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.832 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.832 DEBUG:boto:Params: {} 2024-04-16T17:47:26.832 DEBUG:boto:Token: None 2024-04-16T17:47:26.832 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.834 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '222'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000048fa7afc4557d24b-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.834 DEBUG:boto:path=/cjqttm-11/obj38 2024-04-16T17:47:26.834 DEBUG:boto:auth_path=/cjqttm-11/obj38 2024-04-16T17:47:26.834 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.834 DEBUG:boto:Path: /cjqttm-11/obj38 2024-04-16T17:47:26.834 DEBUG:boto:Data: 2024-04-16T17:47:26.834 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.835 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.835 DEBUG:boto:Params: {} 2024-04-16T17:47:26.835 DEBUG:boto:Token: None 2024-04-16T17:47:26.835 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj38 2024-04-16T17:47:26.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ3jssVhNWHavEtb9Nwg6j1j1dU= 2024-04-16T17:47:26.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ3jssVhNWHavEtb9Nwg6j1j1dU='} 2024-04-16T17:47:26.878 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007a9e369de7b069b0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.879 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.879 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.879 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.879 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.879 DEBUG:boto:Data: 2024-04-16T17:47:26.879 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.879 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.879 DEBUG:boto:Params: {} 2024-04-16T17:47:26.879 DEBUG:boto:Token: None 2024-04-16T17:47:26.880 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.882 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '228'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000986c2ad5e9324bbf-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.882 DEBUG:boto:path=/cjqttm-11/obj39 2024-04-16T17:47:26.882 DEBUG:boto:auth_path=/cjqttm-11/obj39 2024-04-16T17:47:26.882 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.882 DEBUG:boto:Path: /cjqttm-11/obj39 2024-04-16T17:47:26.883 DEBUG:boto:Data: 2024-04-16T17:47:26.883 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.883 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.883 DEBUG:boto:Params: {} 2024-04-16T17:47:26.883 DEBUG:boto:Token: None 2024-04-16T17:47:26.883 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj39 2024-04-16T17:47:26.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Si/6fml6PyQHFJDheAmftroRjB4= 2024-04-16T17:47:26.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Si/6fml6PyQHFJDheAmftroRjB4='} 2024-04-16T17:47:26.887 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ab1a7cba0394898-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.887 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.887 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.888 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.888 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.888 DEBUG:boto:Data: 2024-04-16T17:47:26.888 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.888 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.888 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.888 DEBUG:boto:Params: {} 2024-04-16T17:47:26.888 DEBUG:boto:Token: None 2024-04-16T17:47:26.888 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.890 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '234'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000034139396922f65b7-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.890 DEBUG:boto:path=/cjqttm-11/obj40 2024-04-16T17:47:26.890 DEBUG:boto:auth_path=/cjqttm-11/obj40 2024-04-16T17:47:26.891 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.891 DEBUG:boto:Path: /cjqttm-11/obj40 2024-04-16T17:47:26.891 DEBUG:boto:Data: 2024-04-16T17:47:26.891 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.891 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.891 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.891 DEBUG:boto:Params: {} 2024-04-16T17:47:26.891 DEBUG:boto:Token: None 2024-04-16T17:47:26.891 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj40 2024-04-16T17:47:26.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VzU13Da8Rt/XNUNBH1FTXyMB6N4= 2024-04-16T17:47:26.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VzU13Da8Rt/XNUNBH1FTXyMB6N4='} 2024-04-16T17:47:26.895 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000013f6c3950b6a1e32-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.895 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.895 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.895 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.895 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.895 DEBUG:boto:Data: 2024-04-16T17:47:26.896 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.896 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.896 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.896 DEBUG:boto:Params: {} 2024-04-16T17:47:26.896 DEBUG:boto:Token: None 2024-04-16T17:47:26.896 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.898 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '240'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c3e72e236d72988c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.898 DEBUG:boto:path=/cjqttm-11/obj41 2024-04-16T17:47:26.898 DEBUG:boto:auth_path=/cjqttm-11/obj41 2024-04-16T17:47:26.898 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.898 DEBUG:boto:Path: /cjqttm-11/obj41 2024-04-16T17:47:26.899 DEBUG:boto:Data: 2024-04-16T17:47:26.899 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.899 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.899 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.899 DEBUG:boto:Params: {} 2024-04-16T17:47:26.899 DEBUG:boto:Token: None 2024-04-16T17:47:26.899 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj41 2024-04-16T17:47:26.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HL7j6iHyIuhrysEpY/2gTQ9NJvg= 2024-04-16T17:47:26.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HL7j6iHyIuhrysEpY/2gTQ9NJvg='} 2024-04-16T17:47:26.942 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000973edb00e241038-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.943 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.943 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.943 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.943 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.943 DEBUG:boto:Data: 2024-04-16T17:47:26.943 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.943 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.943 DEBUG:boto:Params: {} 2024-04-16T17:47:26.943 DEBUG:boto:Token: None 2024-04-16T17:47:26.944 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.946 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '246'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c1199ede6db6dcba-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.946 DEBUG:boto:path=/cjqttm-11/obj42 2024-04-16T17:47:26.946 DEBUG:boto:auth_path=/cjqttm-11/obj42 2024-04-16T17:47:26.946 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.946 DEBUG:boto:Path: /cjqttm-11/obj42 2024-04-16T17:47:26.947 DEBUG:boto:Data: 2024-04-16T17:47:26.947 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.947 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.947 DEBUG:boto:Params: {} 2024-04-16T17:47:26.947 DEBUG:boto:Token: None 2024-04-16T17:47:26.947 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj42 2024-04-16T17:47:26.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H0Ddww+f9hfQdoQ6Z+qZ3U76OA8= 2024-04-16T17:47:26.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H0Ddww+f9hfQdoQ6Z+qZ3U76OA8='} 2024-04-16T17:47:26.951 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed362cca4a9815d7-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.951 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.951 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.951 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.952 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.952 DEBUG:boto:Data: 2024-04-16T17:47:26.952 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.952 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.952 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.952 DEBUG:boto:Params: {} 2024-04-16T17:47:26.952 DEBUG:boto:Token: None 2024-04-16T17:47:26.952 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.954 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '252'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000079bbded0d3552086-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.954 DEBUG:boto:path=/cjqttm-11/obj43 2024-04-16T17:47:26.954 DEBUG:boto:auth_path=/cjqttm-11/obj43 2024-04-16T17:47:26.955 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.955 DEBUG:boto:Path: /cjqttm-11/obj43 2024-04-16T17:47:26.955 DEBUG:boto:Data: 2024-04-16T17:47:26.955 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.955 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.955 DEBUG:boto:Params: {} 2024-04-16T17:47:26.955 DEBUG:boto:Token: None 2024-04-16T17:47:26.955 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj43 2024-04-16T17:47:26.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:to4evVLrTvZs56dmswqijFH/srU= 2024-04-16T17:47:26.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:to4evVLrTvZs56dmswqijFH/srU='} 2024-04-16T17:47:26.959 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c61336e516a868db-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.959 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:26.959 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:26.960 DEBUG:boto:Method: HEAD 2024-04-16T17:47:26.960 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:26.960 DEBUG:boto:Data: 2024-04-16T17:47:26.960 DEBUG:boto:Headers: {} 2024-04-16T17:47:26.960 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.960 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.960 DEBUG:boto:Params: {} 2024-04-16T17:47:26.960 DEBUG:boto:Token: None 2024-04-16T17:47:26.960 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/ 2024-04-16T17:47:26.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T17:47:26.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T17:47:26.963 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '258'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd34f5634ae4af1f-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:26.963 DEBUG:boto:path=/cjqttm-11/obj44 2024-04-16T17:47:26.963 DEBUG:boto:auth_path=/cjqttm-11/obj44 2024-04-16T17:47:26.963 DEBUG:boto:Method: PUT 2024-04-16T17:47:26.963 DEBUG:boto:Path: /cjqttm-11/obj44 2024-04-16T17:47:26.963 DEBUG:boto:Data: 2024-04-16T17:47:26.963 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:26.964 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:26.964 DEBUG:boto:Port: 8000 2024-04-16T17:47:26.964 DEBUG:boto:Params: {} 2024-04-16T17:47:26.964 DEBUG:boto:Token: None 2024-04-16T17:47:26.964 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:26 GMT /cjqttm-11/obj44 2024-04-16T17:47:26.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MvD6leINCegpPbJAmVpY2icC9UQ= 2024-04-16T17:47:26.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MvD6leINCegpPbJAmVpY2icC9UQ='} 2024-04-16T17:47:27.006 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f931c4fc8057df0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.007 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:27.007 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:27.007 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.007 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:27.007 DEBUG:boto:Data: 2024-04-16T17:47:27.007 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.007 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.007 DEBUG:boto:Params: {} 2024-04-16T17:47:27.008 DEBUG:boto:Token: None 2024-04-16T17:47:27.008 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/ 2024-04-16T17:47:27.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T17:47:27.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T17:47:27.010 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '44'), ('X-RGW-Bytes-Used', '264'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d1cb7135bfc0c34b-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.010 DEBUG:boto:path=/cjqttm-11/obj45 2024-04-16T17:47:27.010 DEBUG:boto:auth_path=/cjqttm-11/obj45 2024-04-16T17:47:27.010 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.010 DEBUG:boto:Path: /cjqttm-11/obj45 2024-04-16T17:47:27.011 DEBUG:boto:Data: 2024-04-16T17:47:27.011 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.011 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.011 DEBUG:boto:Params: {} 2024-04-16T17:47:27.011 DEBUG:boto:Token: None 2024-04-16T17:47:27.011 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/obj45 2024-04-16T17:47:27.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2yVwYK88b8yiX3IXpXjBbMwioyk= 2024-04-16T17:47:27.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2yVwYK88b8yiX3IXpXjBbMwioyk='} 2024-04-16T17:47:27.015 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b766d7e6a4386716-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.015 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:27.015 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:27.016 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.016 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:27.016 DEBUG:boto:Data: 2024-04-16T17:47:27.016 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.016 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.016 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.016 DEBUG:boto:Params: {} 2024-04-16T17:47:27.016 DEBUG:boto:Token: None 2024-04-16T17:47:27.016 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/ 2024-04-16T17:47:27.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T17:47:27.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T17:47:27.018 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '270'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dff0fb670c52189d-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.018 DEBUG:boto:path=/cjqttm-11/obj46 2024-04-16T17:47:27.018 DEBUG:boto:auth_path=/cjqttm-11/obj46 2024-04-16T17:47:27.018 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.019 DEBUG:boto:Path: /cjqttm-11/obj46 2024-04-16T17:47:27.019 DEBUG:boto:Data: 2024-04-16T17:47:27.019 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.019 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.019 DEBUG:boto:Params: {} 2024-04-16T17:47:27.019 DEBUG:boto:Token: None 2024-04-16T17:47:27.019 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/obj46 2024-04-16T17:47:27.019 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rPmfI5vgcackT216SI4tCTHbR2E= 2024-04-16T17:47:27.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rPmfI5vgcackT216SI4tCTHbR2E='} 2024-04-16T17:47:27.023 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000781c3364a6754da4-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.023 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:27.023 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:27.023 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.023 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:27.024 DEBUG:boto:Data: 2024-04-16T17:47:27.024 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.024 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.024 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.024 DEBUG:boto:Params: {} 2024-04-16T17:47:27.024 DEBUG:boto:Token: None 2024-04-16T17:47:27.024 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/ 2024-04-16T17:47:27.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T17:47:27.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T17:47:27.026 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '276'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000029e5668c7fcb80a-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.026 DEBUG:boto:path=/cjqttm-11/obj47 2024-04-16T17:47:27.026 DEBUG:boto:auth_path=/cjqttm-11/obj47 2024-04-16T17:47:27.026 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.027 DEBUG:boto:Path: /cjqttm-11/obj47 2024-04-16T17:47:27.027 DEBUG:boto:Data: 2024-04-16T17:47:27.027 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.027 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.027 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.027 DEBUG:boto:Params: {} 2024-04-16T17:47:27.027 DEBUG:boto:Token: None 2024-04-16T17:47:27.027 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/obj47 2024-04-16T17:47:27.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3/44dLXvZSykB3x98gaayNvTez0= 2024-04-16T17:47:27.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3/44dLXvZSykB3x98gaayNvTez0='} 2024-04-16T17:47:27.070 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003816e6b7eeaf9604-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.071 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:27.071 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:27.071 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.071 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:27.071 DEBUG:boto:Data: 2024-04-16T17:47:27.071 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.071 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.071 DEBUG:boto:Params: {} 2024-04-16T17:47:27.072 DEBUG:boto:Token: None 2024-04-16T17:47:27.072 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/ 2024-04-16T17:47:27.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T17:47:27.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T17:47:27.074 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '282'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c3c209f761339fae-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.074 DEBUG:boto:path=/cjqttm-11/obj48 2024-04-16T17:47:27.074 DEBUG:boto:auth_path=/cjqttm-11/obj48 2024-04-16T17:47:27.074 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.074 DEBUG:boto:Path: /cjqttm-11/obj48 2024-04-16T17:47:27.075 DEBUG:boto:Data: 2024-04-16T17:47:27.075 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.075 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.075 DEBUG:boto:Params: {} 2024-04-16T17:47:27.075 DEBUG:boto:Token: None 2024-04-16T17:47:27.075 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/obj48 2024-04-16T17:47:27.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZQCa8u32Gf08G7EBhUo3r4NhavU= 2024-04-16T17:47:27.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZQCa8u32Gf08G7EBhUo3r4NhavU='} 2024-04-16T17:47:27.079 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eb9e436e18448b9d-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.079 DEBUG:boto:path=/cjqttm-11/ 2024-04-16T17:47:27.079 DEBUG:boto:auth_path=/cjqttm-11/ 2024-04-16T17:47:27.080 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.080 DEBUG:boto:Path: /cjqttm-11/ 2024-04-16T17:47:27.080 DEBUG:boto:Data: 2024-04-16T17:47:27.080 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.080 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.080 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.080 DEBUG:boto:Params: {} 2024-04-16T17:47:27.080 DEBUG:boto:Token: None 2024-04-16T17:47:27.080 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/ 2024-04-16T17:47:27.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T17:47:27.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T17:47:27.082 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '288'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000091b97ffc0c1f958-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.082 DEBUG:boto:path=/cjqttm-11/obj49 2024-04-16T17:47:27.083 DEBUG:boto:auth_path=/cjqttm-11/obj49 2024-04-16T17:47:27.083 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.083 DEBUG:boto:Path: /cjqttm-11/obj49 2024-04-16T17:47:27.083 DEBUG:boto:Data: 2024-04-16T17:47:27.083 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:47:27.083 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.083 DEBUG:boto:Params: {} 2024-04-16T17:47:27.083 DEBUG:boto:Token: None 2024-04-16T17:47:27.083 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-11/obj49 2024-04-16T17:47:27.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pavBdtCbPYJFFO0M9Rdw2nJ6CIM= 2024-04-16T17:47:27.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pavBdtCbPYJFFO0M9Rdw2nJ6CIM='} 2024-04-16T17:47:27.126 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000712a5b3ee2f15988-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.127 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.127 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.127 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.127 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.127 DEBUG:boto:Data: 2024-04-16T17:47:27.127 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.127 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.127 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.127 DEBUG:boto:Params: {} 2024-04-16T17:47:27.128 DEBUG:boto:Token: None 2024-04-16T17:47:27.128 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.130 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000051612fda4195febb-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.131 DEBUG:boto:path=/cjqttm-12/obj1 2024-04-16T17:47:27.131 DEBUG:boto:auth_path=/cjqttm-12/obj1 2024-04-16T17:47:27.131 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.131 DEBUG:boto:Path: /cjqttm-12/obj1 2024-04-16T17:47:27.131 DEBUG:boto:Data: 2024-04-16T17:47:27.131 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.131 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.132 DEBUG:boto:Params: {} 2024-04-16T17:47:27.132 DEBUG:boto:Token: None 2024-04-16T17:47:27.132 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj1 2024-04-16T17:47:27.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dtwTi8nzqaP8iu7l2sQxhDdFPEY= 2024-04-16T17:47:27.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dtwTi8nzqaP8iu7l2sQxhDdFPEY='} 2024-04-16T17:47:27.139 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c07b55cb4091039a-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.139 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.139 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.139 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.139 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.139 DEBUG:boto:Data: 2024-04-16T17:47:27.139 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.140 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.140 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.140 DEBUG:boto:Params: {} 2024-04-16T17:47:27.140 DEBUG:boto:Token: None 2024-04-16T17:47:27.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.143 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e81f0dab7cfc764e-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.143 DEBUG:boto:path=/cjqttm-12/obj2 2024-04-16T17:47:27.143 DEBUG:boto:auth_path=/cjqttm-12/obj2 2024-04-16T17:47:27.143 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.143 DEBUG:boto:Path: /cjqttm-12/obj2 2024-04-16T17:47:27.143 DEBUG:boto:Data: 2024-04-16T17:47:27.143 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.144 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.144 DEBUG:boto:Params: {} 2024-04-16T17:47:27.144 DEBUG:boto:Token: None 2024-04-16T17:47:27.144 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj2 2024-04-16T17:47:27.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4pj2X71LvLJ09PQg5ygciFvubSg= 2024-04-16T17:47:27.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4pj2X71LvLJ09PQg5ygciFvubSg='} 2024-04-16T17:47:27.186 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000019b43bc628b036e5-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.187 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.187 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.187 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.187 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.187 DEBUG:boto:Data: 2024-04-16T17:47:27.187 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.187 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.187 DEBUG:boto:Params: {} 2024-04-16T17:47:27.187 DEBUG:boto:Token: None 2024-04-16T17:47:27.188 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.190 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007595d8cc2b431178-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.190 DEBUG:boto:path=/cjqttm-12/obj3 2024-04-16T17:47:27.190 DEBUG:boto:auth_path=/cjqttm-12/obj3 2024-04-16T17:47:27.191 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.191 DEBUG:boto:Path: /cjqttm-12/obj3 2024-04-16T17:47:27.191 DEBUG:boto:Data: 2024-04-16T17:47:27.191 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.191 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.191 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.191 DEBUG:boto:Params: {} 2024-04-16T17:47:27.191 DEBUG:boto:Token: None 2024-04-16T17:47:27.191 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj3 2024-04-16T17:47:27.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H4GbpkzJ2LFaD6SMbuf/qwj7JI0= 2024-04-16T17:47:27.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H4GbpkzJ2LFaD6SMbuf/qwj7JI0='} 2024-04-16T17:47:27.198 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fca27330a7eb3470-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.198 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.198 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.198 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.198 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.198 DEBUG:boto:Data: 2024-04-16T17:47:27.198 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.198 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.199 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.199 DEBUG:boto:Params: {} 2024-04-16T17:47:27.199 DEBUG:boto:Token: None 2024-04-16T17:47:27.199 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.201 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f5d7d63f0309f984-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.202 DEBUG:boto:path=/cjqttm-12/obj4 2024-04-16T17:47:27.202 DEBUG:boto:auth_path=/cjqttm-12/obj4 2024-04-16T17:47:27.202 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.202 DEBUG:boto:Path: /cjqttm-12/obj4 2024-04-16T17:47:27.202 DEBUG:boto:Data: 2024-04-16T17:47:27.202 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.202 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.202 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.202 DEBUG:boto:Params: {} 2024-04-16T17:47:27.203 DEBUG:boto:Token: None 2024-04-16T17:47:27.203 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj4 2024-04-16T17:47:27.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XlX9x/hI/T8J9QjZvyhMDmpY/Tk= 2024-04-16T17:47:27.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XlX9x/hI/T8J9QjZvyhMDmpY/Tk='} 2024-04-16T17:47:27.210 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000052256bc8e4fa5df5-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.210 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.210 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.210 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.210 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.211 DEBUG:boto:Data: 2024-04-16T17:47:27.211 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.211 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.211 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.211 DEBUG:boto:Params: {} 2024-04-16T17:47:27.211 DEBUG:boto:Token: None 2024-04-16T17:47:27.211 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.214 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b01685cc6cfd146c-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.214 DEBUG:boto:path=/cjqttm-12/obj5 2024-04-16T17:47:27.214 DEBUG:boto:auth_path=/cjqttm-12/obj5 2024-04-16T17:47:27.214 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.214 DEBUG:boto:Path: /cjqttm-12/obj5 2024-04-16T17:47:27.214 DEBUG:boto:Data: 2024-04-16T17:47:27.214 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.214 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.215 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.215 DEBUG:boto:Params: {} 2024-04-16T17:47:27.215 DEBUG:boto:Token: None 2024-04-16T17:47:27.215 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj5 2024-04-16T17:47:27.215 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zYUD7pA0fOiBkRCqcnPMvJVOOEg= 2024-04-16T17:47:27.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zYUD7pA0fOiBkRCqcnPMvJVOOEg='} 2024-04-16T17:47:27.258 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009adc32f771bdcc6e-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.259 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.259 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.259 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.259 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.259 DEBUG:boto:Data: 2024-04-16T17:47:27.259 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.259 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.259 DEBUG:boto:Params: {} 2024-04-16T17:47:27.259 DEBUG:boto:Token: None 2024-04-16T17:47:27.260 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.262 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d234dfed51e2ab42-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.262 DEBUG:boto:path=/cjqttm-12/obj6 2024-04-16T17:47:27.263 DEBUG:boto:auth_path=/cjqttm-12/obj6 2024-04-16T17:47:27.263 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.263 DEBUG:boto:Path: /cjqttm-12/obj6 2024-04-16T17:47:27.263 DEBUG:boto:Data: 2024-04-16T17:47:27.263 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.263 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.263 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.263 DEBUG:boto:Params: {} 2024-04-16T17:47:27.263 DEBUG:boto:Token: None 2024-04-16T17:47:27.264 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj6 2024-04-16T17:47:27.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ymbsspnvdt4HH10vo/68Z/I4qt8= 2024-04-16T17:47:27.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ymbsspnvdt4HH10vo/68Z/I4qt8='} 2024-04-16T17:47:27.268 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b32973b5803417ed-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.268 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.269 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.269 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.269 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.269 DEBUG:boto:Data: 2024-04-16T17:47:27.269 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.269 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.269 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.269 DEBUG:boto:Params: {} 2024-04-16T17:47:27.269 DEBUG:boto:Token: None 2024-04-16T17:47:27.270 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.270 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.272 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9e937e435073380-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.272 DEBUG:boto:path=/cjqttm-12/obj7 2024-04-16T17:47:27.272 DEBUG:boto:auth_path=/cjqttm-12/obj7 2024-04-16T17:47:27.273 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.273 DEBUG:boto:Path: /cjqttm-12/obj7 2024-04-16T17:47:27.273 DEBUG:boto:Data: 2024-04-16T17:47:27.273 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.273 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.273 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.273 DEBUG:boto:Params: {} 2024-04-16T17:47:27.273 DEBUG:boto:Token: None 2024-04-16T17:47:27.273 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj7 2024-04-16T17:47:27.274 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SjvY1vNx0kkD+wmyV+/X3rYWxVI= 2024-04-16T17:47:27.274 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SjvY1vNx0kkD+wmyV+/X3rYWxVI='} 2024-04-16T17:47:27.278 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000039d573e872043953-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.278 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.278 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.278 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.278 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.279 DEBUG:boto:Data: 2024-04-16T17:47:27.279 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.279 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.279 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.279 DEBUG:boto:Params: {} 2024-04-16T17:47:27.279 DEBUG:boto:Token: None 2024-04-16T17:47:27.279 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.279 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.281 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5443d9c31446065-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.282 DEBUG:boto:path=/cjqttm-12/obj8 2024-04-16T17:47:27.282 DEBUG:boto:auth_path=/cjqttm-12/obj8 2024-04-16T17:47:27.282 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.282 DEBUG:boto:Path: /cjqttm-12/obj8 2024-04-16T17:47:27.282 DEBUG:boto:Data: 2024-04-16T17:47:27.282 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.282 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.283 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.283 DEBUG:boto:Params: {} 2024-04-16T17:47:27.283 DEBUG:boto:Token: None 2024-04-16T17:47:27.283 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj8 2024-04-16T17:47:27.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lK3jk9EkgJHxreAcnNilA50tCqQ= 2024-04-16T17:47:27.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lK3jk9EkgJHxreAcnNilA50tCqQ='} 2024-04-16T17:47:27.288 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003dc266d054cf2c6a-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.288 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.288 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.288 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.288 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.288 DEBUG:boto:Data: 2024-04-16T17:47:27.288 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.288 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.288 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.289 DEBUG:boto:Params: {} 2024-04-16T17:47:27.289 DEBUG:boto:Token: None 2024-04-16T17:47:27.289 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.289 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.289 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.291 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d24811c4a9f0187b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.292 DEBUG:boto:path=/cjqttm-12/obj9 2024-04-16T17:47:27.292 DEBUG:boto:auth_path=/cjqttm-12/obj9 2024-04-16T17:47:27.292 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.292 DEBUG:boto:Path: /cjqttm-12/obj9 2024-04-16T17:47:27.292 DEBUG:boto:Data: 2024-04-16T17:47:27.292 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.292 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.292 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.293 DEBUG:boto:Params: {} 2024-04-16T17:47:27.293 DEBUG:boto:Token: None 2024-04-16T17:47:27.293 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj9 2024-04-16T17:47:27.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/8oE/V3qliIyzOoj7Aj5VQXUb6U= 2024-04-16T17:47:27.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/8oE/V3qliIyzOoj7Aj5VQXUb6U='} 2024-04-16T17:47:27.338 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d90bbd99bf84196-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.339 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.339 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.339 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.339 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.339 DEBUG:boto:Data: 2024-04-16T17:47:27.339 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.339 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.339 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.339 DEBUG:boto:Params: {} 2024-04-16T17:47:27.340 DEBUG:boto:Token: None 2024-04-16T17:47:27.340 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.342 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d3752ffb9770fa96-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.342 DEBUG:boto:path=/cjqttm-12/obj10 2024-04-16T17:47:27.342 DEBUG:boto:auth_path=/cjqttm-12/obj10 2024-04-16T17:47:27.343 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.343 DEBUG:boto:Path: /cjqttm-12/obj10 2024-04-16T17:47:27.343 DEBUG:boto:Data: 2024-04-16T17:47:27.343 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.343 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.343 DEBUG:boto:Params: {} 2024-04-16T17:47:27.343 DEBUG:boto:Token: None 2024-04-16T17:47:27.343 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj10 2024-04-16T17:47:27.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pN3xzNK8fHfGgNQOjJAez8bA7Bg= 2024-04-16T17:47:27.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pN3xzNK8fHfGgNQOjJAez8bA7Bg='} 2024-04-16T17:47:27.348 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000577f157752bd10d-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.348 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.348 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.348 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.348 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.348 DEBUG:boto:Data: 2024-04-16T17:47:27.348 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.349 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.349 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.349 DEBUG:boto:Params: {} 2024-04-16T17:47:27.349 DEBUG:boto:Token: None 2024-04-16T17:47:27.349 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.349 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.351 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000334439debb568f58-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.351 DEBUG:boto:path=/cjqttm-12/obj11 2024-04-16T17:47:27.351 DEBUG:boto:auth_path=/cjqttm-12/obj11 2024-04-16T17:47:27.352 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.352 DEBUG:boto:Path: /cjqttm-12/obj11 2024-04-16T17:47:27.352 DEBUG:boto:Data: 2024-04-16T17:47:27.352 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.352 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.352 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.352 DEBUG:boto:Params: {} 2024-04-16T17:47:27.352 DEBUG:boto:Token: None 2024-04-16T17:47:27.352 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj11 2024-04-16T17:47:27.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h03jb1q2BKCJbtyTtQSQfj3Wmj0= 2024-04-16T17:47:27.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h03jb1q2BKCJbtyTtQSQfj3Wmj0='} 2024-04-16T17:47:27.394 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005f2e4f4e35f9806b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.395 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.395 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.395 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.395 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.395 DEBUG:boto:Data: 2024-04-16T17:47:27.395 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.395 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.395 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.395 DEBUG:boto:Params: {} 2024-04-16T17:47:27.396 DEBUG:boto:Token: None 2024-04-16T17:47:27.396 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.398 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a447a172246b47b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.399 DEBUG:boto:path=/cjqttm-12/obj12 2024-04-16T17:47:27.399 DEBUG:boto:auth_path=/cjqttm-12/obj12 2024-04-16T17:47:27.399 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.399 DEBUG:boto:Path: /cjqttm-12/obj12 2024-04-16T17:47:27.399 DEBUG:boto:Data: 2024-04-16T17:47:27.399 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.399 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.399 DEBUG:boto:Params: {} 2024-04-16T17:47:27.399 DEBUG:boto:Token: None 2024-04-16T17:47:27.400 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj12 2024-04-16T17:47:27.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vcn3ZW2QhkDviUrrneshx7yAsUQ= 2024-04-16T17:47:27.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vcn3ZW2QhkDviUrrneshx7yAsUQ='} 2024-04-16T17:47:27.404 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a98c7982e4cbe3f8-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.404 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.404 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.404 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.404 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.404 DEBUG:boto:Data: 2024-04-16T17:47:27.404 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.404 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.405 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.405 DEBUG:boto:Params: {} 2024-04-16T17:47:27.405 DEBUG:boto:Token: None 2024-04-16T17:47:27.405 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.405 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.407 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000921235918ab0dbd-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.407 DEBUG:boto:path=/cjqttm-12/obj13 2024-04-16T17:47:27.407 DEBUG:boto:auth_path=/cjqttm-12/obj13 2024-04-16T17:47:27.407 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.407 DEBUG:boto:Path: /cjqttm-12/obj13 2024-04-16T17:47:27.407 DEBUG:boto:Data: 2024-04-16T17:47:27.408 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.408 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.408 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.408 DEBUG:boto:Params: {} 2024-04-16T17:47:27.408 DEBUG:boto:Token: None 2024-04-16T17:47:27.408 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj13 2024-04-16T17:47:27.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iNdj9KEq3K9bpUMOiq4F0301EIw= 2024-04-16T17:47:27.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iNdj9KEq3K9bpUMOiq4F0301EIw='} 2024-04-16T17:47:27.450 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd690c1dc1944e45-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.451 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.451 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.451 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.451 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.451 DEBUG:boto:Data: 2024-04-16T17:47:27.451 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.451 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.451 DEBUG:boto:Params: {} 2024-04-16T17:47:27.452 DEBUG:boto:Token: None 2024-04-16T17:47:27.452 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.454 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8dc32ea7db87846-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.454 DEBUG:boto:path=/cjqttm-12/obj14 2024-04-16T17:47:27.454 DEBUG:boto:auth_path=/cjqttm-12/obj14 2024-04-16T17:47:27.455 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.455 DEBUG:boto:Path: /cjqttm-12/obj14 2024-04-16T17:47:27.455 DEBUG:boto:Data: 2024-04-16T17:47:27.455 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.455 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.455 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.455 DEBUG:boto:Params: {} 2024-04-16T17:47:27.455 DEBUG:boto:Token: None 2024-04-16T17:47:27.455 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj14 2024-04-16T17:47:27.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cVok4EWYLJ6UaUGrC7dXYqDMrF4= 2024-04-16T17:47:27.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cVok4EWYLJ6UaUGrC7dXYqDMrF4='} 2024-04-16T17:47:27.459 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d08f41fb983b327-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.460 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.460 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.460 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.460 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.460 DEBUG:boto:Data: 2024-04-16T17:47:27.460 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.460 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.460 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.460 DEBUG:boto:Params: {} 2024-04-16T17:47:27.460 DEBUG:boto:Token: None 2024-04-16T17:47:27.461 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.461 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.463 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000aa84b48c32c29090-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.463 DEBUG:boto:path=/cjqttm-12/obj15 2024-04-16T17:47:27.463 DEBUG:boto:auth_path=/cjqttm-12/obj15 2024-04-16T17:47:27.463 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.463 DEBUG:boto:Path: /cjqttm-12/obj15 2024-04-16T17:47:27.464 DEBUG:boto:Data: 2024-04-16T17:47:27.464 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.464 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.464 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.464 DEBUG:boto:Params: {} 2024-04-16T17:47:27.464 DEBUG:boto:Token: None 2024-04-16T17:47:27.464 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj15 2024-04-16T17:47:27.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TCZCwSX6jUoGgt+263Lir6D6TwM= 2024-04-16T17:47:27.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TCZCwSX6jUoGgt+263Lir6D6TwM='} 2024-04-16T17:47:27.506 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a547353236d0ad2c-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.507 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.507 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.507 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.507 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.507 DEBUG:boto:Data: 2024-04-16T17:47:27.507 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.507 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.507 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.507 DEBUG:boto:Params: {} 2024-04-16T17:47:27.508 DEBUG:boto:Token: None 2024-04-16T17:47:27.508 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.510 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c10dfc0b7607d2b0-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.511 DEBUG:boto:path=/cjqttm-12/obj16 2024-04-16T17:47:27.511 DEBUG:boto:auth_path=/cjqttm-12/obj16 2024-04-16T17:47:27.511 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.511 DEBUG:boto:Path: /cjqttm-12/obj16 2024-04-16T17:47:27.511 DEBUG:boto:Data: 2024-04-16T17:47:27.511 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.511 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.511 DEBUG:boto:Params: {} 2024-04-16T17:47:27.511 DEBUG:boto:Token: None 2024-04-16T17:47:27.512 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj16 2024-04-16T17:47:27.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a2xPEzq2hI8k1tN54vB7Ul3Whqo= 2024-04-16T17:47:27.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a2xPEzq2hI8k1tN54vB7Ul3Whqo='} 2024-04-16T17:47:27.517 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004b92da91fe4d3851-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.518 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.518 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.518 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.518 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.518 DEBUG:boto:Data: 2024-04-16T17:47:27.518 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.518 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.518 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.518 DEBUG:boto:Params: {} 2024-04-16T17:47:27.519 DEBUG:boto:Token: None 2024-04-16T17:47:27.519 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.519 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.521 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000630f1183d853085c-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.522 DEBUG:boto:path=/cjqttm-12/obj17 2024-04-16T17:47:27.522 DEBUG:boto:auth_path=/cjqttm-12/obj17 2024-04-16T17:47:27.522 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.522 DEBUG:boto:Path: /cjqttm-12/obj17 2024-04-16T17:47:27.522 DEBUG:boto:Data: 2024-04-16T17:47:27.522 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.522 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.522 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.522 DEBUG:boto:Params: {} 2024-04-16T17:47:27.523 DEBUG:boto:Token: None 2024-04-16T17:47:27.523 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj17 2024-04-16T17:47:27.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YomLWsfrZxSxAmqDL9pBaQ8AaV0= 2024-04-16T17:47:27.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YomLWsfrZxSxAmqDL9pBaQ8AaV0='} 2024-04-16T17:47:27.566 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f72f6d1b388e6c22-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.567 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.567 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.567 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.567 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.567 DEBUG:boto:Data: 2024-04-16T17:47:27.567 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.567 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.567 DEBUG:boto:Params: {} 2024-04-16T17:47:27.567 DEBUG:boto:Token: None 2024-04-16T17:47:27.568 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.570 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000337389457ea4f6a9-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.570 DEBUG:boto:path=/cjqttm-12/obj18 2024-04-16T17:47:27.570 DEBUG:boto:auth_path=/cjqttm-12/obj18 2024-04-16T17:47:27.571 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.571 DEBUG:boto:Path: /cjqttm-12/obj18 2024-04-16T17:47:27.571 DEBUG:boto:Data: 2024-04-16T17:47:27.571 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.571 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.571 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.571 DEBUG:boto:Params: {} 2024-04-16T17:47:27.571 DEBUG:boto:Token: None 2024-04-16T17:47:27.571 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj18 2024-04-16T17:47:27.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VYpgO4LZDOUBxuAaESL0z19LWQg= 2024-04-16T17:47:27.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VYpgO4LZDOUBxuAaESL0z19LWQg='} 2024-04-16T17:47:27.576 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000317ae3a8300913b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.576 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.576 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.576 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.576 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.576 DEBUG:boto:Data: 2024-04-16T17:47:27.577 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.577 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.577 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.577 DEBUG:boto:Params: {} 2024-04-16T17:47:27.577 DEBUG:boto:Token: None 2024-04-16T17:47:27.577 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.577 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.579 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a79b4ee3ec463304-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.580 DEBUG:boto:path=/cjqttm-12/obj19 2024-04-16T17:47:27.580 DEBUG:boto:auth_path=/cjqttm-12/obj19 2024-04-16T17:47:27.580 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.580 DEBUG:boto:Path: /cjqttm-12/obj19 2024-04-16T17:47:27.580 DEBUG:boto:Data: 2024-04-16T17:47:27.580 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.580 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.580 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.580 DEBUG:boto:Params: {} 2024-04-16T17:47:27.580 DEBUG:boto:Token: None 2024-04-16T17:47:27.581 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj19 2024-04-16T17:47:27.581 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z8xugLqlf7zoHF3QrJaN9GlZiAM= 2024-04-16T17:47:27.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z8xugLqlf7zoHF3QrJaN9GlZiAM='} 2024-04-16T17:47:27.622 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009491646ad86c2bdd-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.623 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.623 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.623 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.623 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.623 DEBUG:boto:Data: 2024-04-16T17:47:27.623 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.623 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.623 DEBUG:boto:Params: {} 2024-04-16T17:47:27.623 DEBUG:boto:Token: None 2024-04-16T17:47:27.624 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.626 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007aa89724ba1565c1-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.626 DEBUG:boto:path=/cjqttm-12/obj20 2024-04-16T17:47:27.627 DEBUG:boto:auth_path=/cjqttm-12/obj20 2024-04-16T17:47:27.627 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.627 DEBUG:boto:Path: /cjqttm-12/obj20 2024-04-16T17:47:27.627 DEBUG:boto:Data: 2024-04-16T17:47:27.627 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.627 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.627 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.627 DEBUG:boto:Params: {} 2024-04-16T17:47:27.627 DEBUG:boto:Token: None 2024-04-16T17:47:27.627 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj20 2024-04-16T17:47:27.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gtg5cmd8plBykBsCA4qigDbcmUQ= 2024-04-16T17:47:27.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gtg5cmd8plBykBsCA4qigDbcmUQ='} 2024-04-16T17:47:27.633 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f35ccc7755780cce-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.633 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.634 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.634 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.634 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.634 DEBUG:boto:Data: 2024-04-16T17:47:27.634 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.634 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.634 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.634 DEBUG:boto:Params: {} 2024-04-16T17:47:27.634 DEBUG:boto:Token: None 2024-04-16T17:47:27.635 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.637 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000023ab5c5cffccf1c4-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.637 DEBUG:boto:path=/cjqttm-12/obj21 2024-04-16T17:47:27.637 DEBUG:boto:auth_path=/cjqttm-12/obj21 2024-04-16T17:47:27.638 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.638 DEBUG:boto:Path: /cjqttm-12/obj21 2024-04-16T17:47:27.638 DEBUG:boto:Data: 2024-04-16T17:47:27.638 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.638 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.638 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.638 DEBUG:boto:Params: {} 2024-04-16T17:47:27.638 DEBUG:boto:Token: None 2024-04-16T17:47:27.638 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj21 2024-04-16T17:47:27.638 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yooXc58byo5iGm7JT8MDwj8qXJ0= 2024-04-16T17:47:27.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yooXc58byo5iGm7JT8MDwj8qXJ0='} 2024-04-16T17:47:27.643 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bf6dc037ff1909bb-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.644 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.644 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.644 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.644 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.644 DEBUG:boto:Data: 2024-04-16T17:47:27.644 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.644 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.644 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.644 DEBUG:boto:Params: {} 2024-04-16T17:47:27.644 DEBUG:boto:Token: None 2024-04-16T17:47:27.645 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.645 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.647 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e18c70bc104bbee-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.647 DEBUG:boto:path=/cjqttm-12/obj22 2024-04-16T17:47:27.648 DEBUG:boto:auth_path=/cjqttm-12/obj22 2024-04-16T17:47:27.648 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.648 DEBUG:boto:Path: /cjqttm-12/obj22 2024-04-16T17:47:27.648 DEBUG:boto:Data: 2024-04-16T17:47:27.648 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.648 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.648 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.648 DEBUG:boto:Params: {} 2024-04-16T17:47:27.649 DEBUG:boto:Token: None 2024-04-16T17:47:27.649 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj22 2024-04-16T17:47:27.649 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:blYKtmgh7rPx4uRjsR/2p70Afng= 2024-04-16T17:47:27.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:blYKtmgh7rPx4uRjsR/2p70Afng='} 2024-04-16T17:47:27.690 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004c12ccf61c5275bc-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.691 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.691 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.691 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.691 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.691 DEBUG:boto:Data: 2024-04-16T17:47:27.691 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.691 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.691 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.692 DEBUG:boto:Params: {} 2024-04-16T17:47:27.692 DEBUG:boto:Token: None 2024-04-16T17:47:27.692 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.694 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '132'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009076920a6f03f642-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.694 DEBUG:boto:path=/cjqttm-12/obj23 2024-04-16T17:47:27.695 DEBUG:boto:auth_path=/cjqttm-12/obj23 2024-04-16T17:47:27.695 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.695 DEBUG:boto:Path: /cjqttm-12/obj23 2024-04-16T17:47:27.695 DEBUG:boto:Data: 2024-04-16T17:47:27.695 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.695 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.695 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.695 DEBUG:boto:Params: {} 2024-04-16T17:47:27.695 DEBUG:boto:Token: None 2024-04-16T17:47:27.695 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj23 2024-04-16T17:47:27.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3egx1jxuTTNXTSoSrYOesz6pGdg= 2024-04-16T17:47:27.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3egx1jxuTTNXTSoSrYOesz6pGdg='} 2024-04-16T17:47:27.700 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c00ab9af0024a2d-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.700 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.700 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.700 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.700 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.700 DEBUG:boto:Data: 2024-04-16T17:47:27.700 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.700 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.700 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.701 DEBUG:boto:Params: {} 2024-04-16T17:47:27.701 DEBUG:boto:Token: None 2024-04-16T17:47:27.701 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.701 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.703 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004da523b27301ff56-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.704 DEBUG:boto:path=/cjqttm-12/obj24 2024-04-16T17:47:27.704 DEBUG:boto:auth_path=/cjqttm-12/obj24 2024-04-16T17:47:27.704 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.704 DEBUG:boto:Path: /cjqttm-12/obj24 2024-04-16T17:47:27.704 DEBUG:boto:Data: 2024-04-16T17:47:27.704 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.704 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.704 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.704 DEBUG:boto:Params: {} 2024-04-16T17:47:27.705 DEBUG:boto:Token: None 2024-04-16T17:47:27.705 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj24 2024-04-16T17:47:27.705 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DI4xojSMFqjUrN+B2I+6fskvDww= 2024-04-16T17:47:27.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DI4xojSMFqjUrN+B2I+6fskvDww='} 2024-04-16T17:47:27.751 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ceee4859c0006a8-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.751 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.751 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.751 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.751 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.751 DEBUG:boto:Data: 2024-04-16T17:47:27.751 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.752 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.752 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.752 DEBUG:boto:Params: {} 2024-04-16T17:47:27.752 DEBUG:boto:Token: None 2024-04-16T17:47:27.752 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.755 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000067d931ada935d76a-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.755 DEBUG:boto:path=/cjqttm-12/obj25 2024-04-16T17:47:27.755 DEBUG:boto:auth_path=/cjqttm-12/obj25 2024-04-16T17:47:27.755 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.755 DEBUG:boto:Path: /cjqttm-12/obj25 2024-04-16T17:47:27.755 DEBUG:boto:Data: 2024-04-16T17:47:27.755 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.755 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.756 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.756 DEBUG:boto:Params: {} 2024-04-16T17:47:27.756 DEBUG:boto:Token: None 2024-04-16T17:47:27.756 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj25 2024-04-16T17:47:27.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XpssgDk5KroJOMFzddNCQX2b7uY= 2024-04-16T17:47:27.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XpssgDk5KroJOMFzddNCQX2b7uY='} 2024-04-16T17:47:27.760 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b388cb90e5b8d042-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.761 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.761 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.761 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.761 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.761 DEBUG:boto:Data: 2024-04-16T17:47:27.761 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.761 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.761 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.761 DEBUG:boto:Params: {} 2024-04-16T17:47:27.762 DEBUG:boto:Token: None 2024-04-16T17:47:27.762 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.762 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.764 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008642a02c673b679f-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.764 DEBUG:boto:path=/cjqttm-12/obj26 2024-04-16T17:47:27.764 DEBUG:boto:auth_path=/cjqttm-12/obj26 2024-04-16T17:47:27.764 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.765 DEBUG:boto:Path: /cjqttm-12/obj26 2024-04-16T17:47:27.765 DEBUG:boto:Data: 2024-04-16T17:47:27.765 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.765 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.765 DEBUG:boto:Params: {} 2024-04-16T17:47:27.765 DEBUG:boto:Token: None 2024-04-16T17:47:27.765 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj26 2024-04-16T17:47:27.765 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2AcccMAupdLX9Pl7EWA6o/B6eLg= 2024-04-16T17:47:27.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2AcccMAupdLX9Pl7EWA6o/B6eLg='} 2024-04-16T17:47:27.810 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009f96cd4c4ca7ecda-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.811 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.811 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.811 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.811 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.811 DEBUG:boto:Data: 2024-04-16T17:47:27.811 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.811 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.811 DEBUG:boto:Params: {} 2024-04-16T17:47:27.812 DEBUG:boto:Token: None 2024-04-16T17:47:27.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.814 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000045a0fd3d8220fa4b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.814 DEBUG:boto:path=/cjqttm-12/obj27 2024-04-16T17:47:27.814 DEBUG:boto:auth_path=/cjqttm-12/obj27 2024-04-16T17:47:27.814 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.814 DEBUG:boto:Path: /cjqttm-12/obj27 2024-04-16T17:47:27.815 DEBUG:boto:Data: 2024-04-16T17:47:27.815 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.815 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.815 DEBUG:boto:Params: {} 2024-04-16T17:47:27.815 DEBUG:boto:Token: None 2024-04-16T17:47:27.815 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj27 2024-04-16T17:47:27.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:74JMhRLo/Q+nmKetVbejvpPzn6o= 2024-04-16T17:47:27.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:74JMhRLo/Q+nmKetVbejvpPzn6o='} 2024-04-16T17:47:27.820 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d47e384b834e52c6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.820 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.820 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.820 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.820 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.820 DEBUG:boto:Data: 2024-04-16T17:47:27.820 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.820 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.820 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.820 DEBUG:boto:Params: {} 2024-04-16T17:47:27.821 DEBUG:boto:Token: None 2024-04-16T17:47:27.821 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.821 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.823 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f1d7b07f47c000f-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.823 DEBUG:boto:path=/cjqttm-12/obj28 2024-04-16T17:47:27.823 DEBUG:boto:auth_path=/cjqttm-12/obj28 2024-04-16T17:47:27.823 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.824 DEBUG:boto:Path: /cjqttm-12/obj28 2024-04-16T17:47:27.824 DEBUG:boto:Data: 2024-04-16T17:47:27.824 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.824 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.824 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.824 DEBUG:boto:Params: {} 2024-04-16T17:47:27.824 DEBUG:boto:Token: None 2024-04-16T17:47:27.824 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj28 2024-04-16T17:47:27.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0qfZ5RDzqdIcztq06EjldkJ9A9E= 2024-04-16T17:47:27.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0qfZ5RDzqdIcztq06EjldkJ9A9E='} 2024-04-16T17:47:27.866 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d48e4bccc1ef3ac6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.866 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.867 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.867 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.867 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.867 DEBUG:boto:Data: 2024-04-16T17:47:27.867 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.867 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.867 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.867 DEBUG:boto:Params: {} 2024-04-16T17:47:27.867 DEBUG:boto:Token: None 2024-04-16T17:47:27.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.870 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000044cc6569fafbdbce-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.870 DEBUG:boto:path=/cjqttm-12/obj29 2024-04-16T17:47:27.870 DEBUG:boto:auth_path=/cjqttm-12/obj29 2024-04-16T17:47:27.870 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.870 DEBUG:boto:Path: /cjqttm-12/obj29 2024-04-16T17:47:27.871 DEBUG:boto:Data: 2024-04-16T17:47:27.871 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.871 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.871 DEBUG:boto:Params: {} 2024-04-16T17:47:27.871 DEBUG:boto:Token: None 2024-04-16T17:47:27.871 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj29 2024-04-16T17:47:27.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VtG94HENJReqYPSJ0AOyDd2kkOU= 2024-04-16T17:47:27.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VtG94HENJReqYPSJ0AOyDd2kkOU='} 2024-04-16T17:47:27.876 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d7816c7e05f143f6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.876 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.876 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.876 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.876 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.876 DEBUG:boto:Data: 2024-04-16T17:47:27.876 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.876 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.877 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.877 DEBUG:boto:Params: {} 2024-04-16T17:47:27.877 DEBUG:boto:Token: None 2024-04-16T17:47:27.877 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.877 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.879 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d19ed080dcaf1fe-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.879 DEBUG:boto:path=/cjqttm-12/obj30 2024-04-16T17:47:27.880 DEBUG:boto:auth_path=/cjqttm-12/obj30 2024-04-16T17:47:27.880 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.880 DEBUG:boto:Path: /cjqttm-12/obj30 2024-04-16T17:47:27.880 DEBUG:boto:Data: 2024-04-16T17:47:27.880 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.880 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.880 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.880 DEBUG:boto:Params: {} 2024-04-16T17:47:27.880 DEBUG:boto:Token: None 2024-04-16T17:47:27.880 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj30 2024-04-16T17:47:27.881 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:krUMyViK+rLpdrFe9hGtRohP9h0= 2024-04-16T17:47:27.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:krUMyViK+rLpdrFe9hGtRohP9h0='} 2024-04-16T17:47:27.922 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000232a7f0c694c84d5-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.923 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.923 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.923 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.923 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.923 DEBUG:boto:Data: 2024-04-16T17:47:27.923 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.923 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.923 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.924 DEBUG:boto:Params: {} 2024-04-16T17:47:27.926 DEBUG:boto:Token: None 2024-04-16T17:47:27.926 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.928 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '180'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ecbf814b6e88c74d-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.929 DEBUG:boto:path=/cjqttm-12/obj31 2024-04-16T17:47:27.929 DEBUG:boto:auth_path=/cjqttm-12/obj31 2024-04-16T17:47:27.929 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.929 DEBUG:boto:Path: /cjqttm-12/obj31 2024-04-16T17:47:27.929 DEBUG:boto:Data: 2024-04-16T17:47:27.929 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.929 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.929 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.929 DEBUG:boto:Params: {} 2024-04-16T17:47:27.930 DEBUG:boto:Token: None 2024-04-16T17:47:27.930 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj31 2024-04-16T17:47:27.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LLctdF6FUegKxxZlOjd88n4TaUQ= 2024-04-16T17:47:27.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LLctdF6FUegKxxZlOjd88n4TaUQ='} 2024-04-16T17:47:27.934 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000a7d16010a6b2bb2-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.934 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.934 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.934 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.934 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.934 DEBUG:boto:Data: 2024-04-16T17:47:27.934 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.934 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.934 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.935 DEBUG:boto:Params: {} 2024-04-16T17:47:27.935 DEBUG:boto:Token: None 2024-04-16T17:47:27.935 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.937 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '186'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000462d330aea30b0c2-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.937 DEBUG:boto:path=/cjqttm-12/obj32 2024-04-16T17:47:27.938 DEBUG:boto:auth_path=/cjqttm-12/obj32 2024-04-16T17:47:27.938 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.938 DEBUG:boto:Path: /cjqttm-12/obj32 2024-04-16T17:47:27.938 DEBUG:boto:Data: 2024-04-16T17:47:27.938 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.938 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.938 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.938 DEBUG:boto:Params: {} 2024-04-16T17:47:27.938 DEBUG:boto:Token: None 2024-04-16T17:47:27.939 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj32 2024-04-16T17:47:27.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QVMjgmIQET20R5mU+shdkalIvGo= 2024-04-16T17:47:27.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QVMjgmIQET20R5mU+shdkalIvGo='} 2024-04-16T17:47:27.942 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c44d49c9cb1cca96-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.943 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.943 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.943 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.943 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.943 DEBUG:boto:Data: 2024-04-16T17:47:27.943 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.943 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.943 DEBUG:boto:Params: {} 2024-04-16T17:47:27.943 DEBUG:boto:Token: None 2024-04-16T17:47:27.944 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.946 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '192'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000530cfadfa6223ee3-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.946 DEBUG:boto:path=/cjqttm-12/obj33 2024-04-16T17:47:27.946 DEBUG:boto:auth_path=/cjqttm-12/obj33 2024-04-16T17:47:27.946 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.946 DEBUG:boto:Path: /cjqttm-12/obj33 2024-04-16T17:47:27.946 DEBUG:boto:Data: 2024-04-16T17:47:27.947 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.947 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.947 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.947 DEBUG:boto:Params: {} 2024-04-16T17:47:27.947 DEBUG:boto:Token: None 2024-04-16T17:47:27.947 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj33 2024-04-16T17:47:27.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TNypBiE+QMKl46lh4FKFrnTejxI= 2024-04-16T17:47:27.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TNypBiE+QMKl46lh4FKFrnTejxI='} 2024-04-16T17:47:27.951 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af166c0795c5d173-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.951 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.951 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.951 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.951 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.951 DEBUG:boto:Data: 2024-04-16T17:47:27.952 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.952 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.952 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.952 DEBUG:boto:Params: {} 2024-04-16T17:47:27.952 DEBUG:boto:Token: None 2024-04-16T17:47:27.952 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/ 2024-04-16T17:47:27.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T17:47:27.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T17:47:27.954 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '198'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ef3b8e88212a92d6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.955 DEBUG:boto:path=/cjqttm-12/obj34 2024-04-16T17:47:27.955 DEBUG:boto:auth_path=/cjqttm-12/obj34 2024-04-16T17:47:27.955 DEBUG:boto:Method: PUT 2024-04-16T17:47:27.955 DEBUG:boto:Path: /cjqttm-12/obj34 2024-04-16T17:47:27.955 DEBUG:boto:Data: 2024-04-16T17:47:27.955 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:27.955 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.955 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.955 DEBUG:boto:Params: {} 2024-04-16T17:47:27.955 DEBUG:boto:Token: None 2024-04-16T17:47:27.956 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:27 GMT /cjqttm-12/obj34 2024-04-16T17:47:27.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Lgs2WRKcIsFiia0Vu2OQsDSftQw= 2024-04-16T17:47:27.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Lgs2WRKcIsFiia0Vu2OQsDSftQw='} 2024-04-16T17:47:27.998 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000067c76515085ea9c3-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:27.999 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:27.999 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:27.999 DEBUG:boto:Method: HEAD 2024-04-16T17:47:27.999 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:27.999 DEBUG:boto:Data: 2024-04-16T17:47:27.999 DEBUG:boto:Headers: {} 2024-04-16T17:47:27.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:27.999 DEBUG:boto:Port: 8000 2024-04-16T17:47:27.999 DEBUG:boto:Params: {} 2024-04-16T17:47:28.000 DEBUG:boto:Token: None 2024-04-16T17:47:28.000 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.002 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '204'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be91d240b4c0da74-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.002 DEBUG:boto:path=/cjqttm-12/obj35 2024-04-16T17:47:28.003 DEBUG:boto:auth_path=/cjqttm-12/obj35 2024-04-16T17:47:28.003 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.003 DEBUG:boto:Path: /cjqttm-12/obj35 2024-04-16T17:47:28.003 DEBUG:boto:Data: 2024-04-16T17:47:28.003 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.003 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.003 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.003 DEBUG:boto:Params: {} 2024-04-16T17:47:28.003 DEBUG:boto:Token: None 2024-04-16T17:47:28.003 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj35 2024-04-16T17:47:28.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hT5ezXzpS6RYuQijnhnWWNAKaD0= 2024-04-16T17:47:28.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hT5ezXzpS6RYuQijnhnWWNAKaD0='} 2024-04-16T17:47:28.008 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ecc65aeff1f596b-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.008 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.008 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.008 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.008 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.009 DEBUG:boto:Data: 2024-04-16T17:47:28.009 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.009 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.009 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.009 DEBUG:boto:Params: {} 2024-04-16T17:47:28.009 DEBUG:boto:Token: None 2024-04-16T17:47:28.009 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.009 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.011 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '210'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000888f85e4eb033ad0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.012 DEBUG:boto:path=/cjqttm-12/obj36 2024-04-16T17:47:28.012 DEBUG:boto:auth_path=/cjqttm-12/obj36 2024-04-16T17:47:28.012 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.012 DEBUG:boto:Path: /cjqttm-12/obj36 2024-04-16T17:47:28.012 DEBUG:boto:Data: 2024-04-16T17:47:28.012 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.012 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.012 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.012 DEBUG:boto:Params: {} 2024-04-16T17:47:28.012 DEBUG:boto:Token: None 2024-04-16T17:47:28.012 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj36 2024-04-16T17:47:28.013 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yFKSBKcssb0owrR1l7wXTKvyFpE= 2024-04-16T17:47:28.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yFKSBKcssb0owrR1l7wXTKvyFpE='} 2024-04-16T17:47:28.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000097f22078d29db560-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.055 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.055 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.055 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.055 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.055 DEBUG:boto:Data: 2024-04-16T17:47:28.055 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.055 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.055 DEBUG:boto:Params: {} 2024-04-16T17:47:28.055 DEBUG:boto:Token: None 2024-04-16T17:47:28.056 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.058 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '216'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a2616ab8c9c7f694-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.058 DEBUG:boto:path=/cjqttm-12/obj37 2024-04-16T17:47:28.059 DEBUG:boto:auth_path=/cjqttm-12/obj37 2024-04-16T17:47:28.059 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.059 DEBUG:boto:Path: /cjqttm-12/obj37 2024-04-16T17:47:28.059 DEBUG:boto:Data: 2024-04-16T17:47:28.059 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.059 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.059 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.059 DEBUG:boto:Params: {} 2024-04-16T17:47:28.059 DEBUG:boto:Token: None 2024-04-16T17:47:28.059 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj37 2024-04-16T17:47:28.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rX/Oy8T0MYGnaxPfPDBkF5VRWNw= 2024-04-16T17:47:28.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rX/Oy8T0MYGnaxPfPDBkF5VRWNw='} 2024-04-16T17:47:28.064 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000213efa7c5662813d-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.064 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.064 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.064 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.064 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.064 DEBUG:boto:Data: 2024-04-16T17:47:28.065 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.065 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.065 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.065 DEBUG:boto:Params: {} 2024-04-16T17:47:28.065 DEBUG:boto:Token: None 2024-04-16T17:47:28.065 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.065 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.068 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '222'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002850e3050b8ddb18-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.068 DEBUG:boto:path=/cjqttm-12/obj38 2024-04-16T17:47:28.068 DEBUG:boto:auth_path=/cjqttm-12/obj38 2024-04-16T17:47:28.069 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.069 DEBUG:boto:Path: /cjqttm-12/obj38 2024-04-16T17:47:28.069 DEBUG:boto:Data: 2024-04-16T17:47:28.069 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.069 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.069 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.069 DEBUG:boto:Params: {} 2024-04-16T17:47:28.069 DEBUG:boto:Token: None 2024-04-16T17:47:28.070 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj38 2024-04-16T17:47:28.070 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sPArBvCXE7DwHenyg+w6tHn4qmI= 2024-04-16T17:47:28.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sPArBvCXE7DwHenyg+w6tHn4qmI='} 2024-04-16T17:47:28.074 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000091944b08f745ac78-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.074 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.074 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.074 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.074 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.074 DEBUG:boto:Data: 2024-04-16T17:47:28.074 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.075 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.075 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.075 DEBUG:boto:Params: {} 2024-04-16T17:47:28.075 DEBUG:boto:Token: None 2024-04-16T17:47:28.075 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.077 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '228'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f4dd9b142e819c0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.077 DEBUG:boto:path=/cjqttm-12/obj39 2024-04-16T17:47:28.078 DEBUG:boto:auth_path=/cjqttm-12/obj39 2024-04-16T17:47:28.078 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.078 DEBUG:boto:Path: /cjqttm-12/obj39 2024-04-16T17:47:28.078 DEBUG:boto:Data: 2024-04-16T17:47:28.078 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.078 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.078 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.078 DEBUG:boto:Params: {} 2024-04-16T17:47:28.078 DEBUG:boto:Token: None 2024-04-16T17:47:28.078 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj39 2024-04-16T17:47:28.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DI7xmQuagI+6Mow3OgMz1l5ePpw= 2024-04-16T17:47:28.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DI7xmQuagI+6Mow3OgMz1l5ePpw='} 2024-04-16T17:47:28.083 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001bbbb458118bc92e-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.083 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.083 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.083 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.083 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.083 DEBUG:boto:Data: 2024-04-16T17:47:28.084 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.084 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.084 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.084 DEBUG:boto:Params: {} 2024-04-16T17:47:28.084 DEBUG:boto:Token: None 2024-04-16T17:47:28.084 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.086 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '234'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ecd0a4e838b6281b-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.087 DEBUG:boto:path=/cjqttm-12/obj40 2024-04-16T17:47:28.087 DEBUG:boto:auth_path=/cjqttm-12/obj40 2024-04-16T17:47:28.087 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.087 DEBUG:boto:Path: /cjqttm-12/obj40 2024-04-16T17:47:28.087 DEBUG:boto:Data: 2024-04-16T17:47:28.087 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.087 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.087 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.088 DEBUG:boto:Params: {} 2024-04-16T17:47:28.088 DEBUG:boto:Token: None 2024-04-16T17:47:28.088 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj40 2024-04-16T17:47:28.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xoHEf1A9lvxvVThonzepguZAGL8= 2024-04-16T17:47:28.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xoHEf1A9lvxvVThonzepguZAGL8='} 2024-04-16T17:47:28.130 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f0271afd6e214e3f-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.131 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.131 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.131 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.131 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.131 DEBUG:boto:Data: 2024-04-16T17:47:28.131 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.131 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.131 DEBUG:boto:Params: {} 2024-04-16T17:47:28.132 DEBUG:boto:Token: None 2024-04-16T17:47:28.132 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.134 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '240'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087960575f62b4cba-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.135 DEBUG:boto:path=/cjqttm-12/obj41 2024-04-16T17:47:28.135 DEBUG:boto:auth_path=/cjqttm-12/obj41 2024-04-16T17:47:28.135 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.135 DEBUG:boto:Path: /cjqttm-12/obj41 2024-04-16T17:47:28.135 DEBUG:boto:Data: 2024-04-16T17:47:28.135 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.135 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.135 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.135 DEBUG:boto:Params: {} 2024-04-16T17:47:28.136 DEBUG:boto:Token: None 2024-04-16T17:47:28.136 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj41 2024-04-16T17:47:28.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4InBuOtg4mXxG+DQ0MjJLbQu+js= 2024-04-16T17:47:28.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4InBuOtg4mXxG+DQ0MjJLbQu+js='} 2024-04-16T17:47:28.140 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000063811427d0a4cc0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.140 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.140 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.140 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.140 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.140 DEBUG:boto:Data: 2024-04-16T17:47:28.140 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.140 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.141 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.141 DEBUG:boto:Params: {} 2024-04-16T17:47:28.141 DEBUG:boto:Token: None 2024-04-16T17:47:28.141 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.141 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.143 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '246'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bd5d99eba2d511a6-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.144 DEBUG:boto:path=/cjqttm-12/obj42 2024-04-16T17:47:28.144 DEBUG:boto:auth_path=/cjqttm-12/obj42 2024-04-16T17:47:28.144 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.144 DEBUG:boto:Path: /cjqttm-12/obj42 2024-04-16T17:47:28.144 DEBUG:boto:Data: 2024-04-16T17:47:28.144 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.144 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.144 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.144 DEBUG:boto:Params: {} 2024-04-16T17:47:28.144 DEBUG:boto:Token: None 2024-04-16T17:47:28.145 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj42 2024-04-16T17:47:28.145 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:92OkW2dTpSGmYtGK1S1NwfhMK5Y= 2024-04-16T17:47:28.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:92OkW2dTpSGmYtGK1S1NwfhMK5Y='} 2024-04-16T17:47:28.186 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b4268c5bccfa6c9-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.187 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.187 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.187 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.187 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.187 DEBUG:boto:Data: 2024-04-16T17:47:28.187 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.187 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.187 DEBUG:boto:Params: {} 2024-04-16T17:47:28.187 DEBUG:boto:Token: None 2024-04-16T17:47:28.188 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.190 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '252'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006362a047328857b5-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.190 DEBUG:boto:path=/cjqttm-12/obj43 2024-04-16T17:47:28.190 DEBUG:boto:auth_path=/cjqttm-12/obj43 2024-04-16T17:47:28.191 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.191 DEBUG:boto:Path: /cjqttm-12/obj43 2024-04-16T17:47:28.191 DEBUG:boto:Data: 2024-04-16T17:47:28.191 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.191 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.191 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.191 DEBUG:boto:Params: {} 2024-04-16T17:47:28.191 DEBUG:boto:Token: None 2024-04-16T17:47:28.191 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj43 2024-04-16T17:47:28.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fO9VIl483kOVzTBRCDGsgnCPyuQ= 2024-04-16T17:47:28.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fO9VIl483kOVzTBRCDGsgnCPyuQ='} 2024-04-16T17:47:28.196 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000091d256a4c925dbd0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.196 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.196 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.196 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.196 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.196 DEBUG:boto:Data: 2024-04-16T17:47:28.196 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.196 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.196 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.197 DEBUG:boto:Params: {} 2024-04-16T17:47:28.197 DEBUG:boto:Token: None 2024-04-16T17:47:28.197 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.197 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.199 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '258'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c38136f9a27ee9a5-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.200 DEBUG:boto:path=/cjqttm-12/obj44 2024-04-16T17:47:28.200 DEBUG:boto:auth_path=/cjqttm-12/obj44 2024-04-16T17:47:28.200 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.200 DEBUG:boto:Path: /cjqttm-12/obj44 2024-04-16T17:47:28.200 DEBUG:boto:Data: 2024-04-16T17:47:28.200 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.200 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.200 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.200 DEBUG:boto:Params: {} 2024-04-16T17:47:28.201 DEBUG:boto:Token: None 2024-04-16T17:47:28.201 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj44 2024-04-16T17:47:28.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XJRBLiATpaWFkOoMLjovr0EIaTI= 2024-04-16T17:47:28.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XJRBLiATpaWFkOoMLjovr0EIaTI='} 2024-04-16T17:47:28.242 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000005e699ceb55d68e4-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.243 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.243 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.243 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.243 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.243 DEBUG:boto:Data: 2024-04-16T17:47:28.243 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.243 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.244 DEBUG:boto:Params: {} 2024-04-16T17:47:28.244 DEBUG:boto:Token: None 2024-04-16T17:47:28.244 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.246 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '44'), ('X-RGW-Bytes-Used', '264'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d6556edbac6f88a-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.247 DEBUG:boto:path=/cjqttm-12/obj45 2024-04-16T17:47:28.247 DEBUG:boto:auth_path=/cjqttm-12/obj45 2024-04-16T17:47:28.247 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.247 DEBUG:boto:Path: /cjqttm-12/obj45 2024-04-16T17:47:28.247 DEBUG:boto:Data: 2024-04-16T17:47:28.247 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.247 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.247 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.247 DEBUG:boto:Params: {} 2024-04-16T17:47:28.247 DEBUG:boto:Token: None 2024-04-16T17:47:28.248 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj45 2024-04-16T17:47:28.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LbNlWcQ1Sfl3qisaBdRxlXS2hCM= 2024-04-16T17:47:28.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LbNlWcQ1Sfl3qisaBdRxlXS2hCM='} 2024-04-16T17:47:28.252 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005e4a3796bbe7bdf6-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.252 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.252 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.252 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.252 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.252 DEBUG:boto:Data: 2024-04-16T17:47:28.253 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.253 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.253 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.253 DEBUG:boto:Params: {} 2024-04-16T17:47:28.253 DEBUG:boto:Token: None 2024-04-16T17:47:28.253 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.255 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '270'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f45c4f31df39473d-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.255 DEBUG:boto:path=/cjqttm-12/obj46 2024-04-16T17:47:28.256 DEBUG:boto:auth_path=/cjqttm-12/obj46 2024-04-16T17:47:28.256 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.256 DEBUG:boto:Path: /cjqttm-12/obj46 2024-04-16T17:47:28.256 DEBUG:boto:Data: 2024-04-16T17:47:28.256 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.256 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.256 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.256 DEBUG:boto:Params: {} 2024-04-16T17:47:28.256 DEBUG:boto:Token: None 2024-04-16T17:47:28.256 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj46 2024-04-16T17:47:28.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a4qZm0tcYjJr/FMchlzL/ZHi6Ug= 2024-04-16T17:47:28.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a4qZm0tcYjJr/FMchlzL/ZHi6Ug='} 2024-04-16T17:47:28.298 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a712bb86e186661-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.299 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.299 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.299 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.299 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.299 DEBUG:boto:Data: 2024-04-16T17:47:28.299 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.299 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.299 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.300 DEBUG:boto:Params: {} 2024-04-16T17:47:28.300 DEBUG:boto:Token: None 2024-04-16T17:47:28.300 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.302 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '276'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bdd608dfe66c00a9-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.302 DEBUG:boto:path=/cjqttm-12/obj47 2024-04-16T17:47:28.302 DEBUG:boto:auth_path=/cjqttm-12/obj47 2024-04-16T17:47:28.302 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.303 DEBUG:boto:Path: /cjqttm-12/obj47 2024-04-16T17:47:28.303 DEBUG:boto:Data: 2024-04-16T17:47:28.303 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.303 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.303 DEBUG:boto:Params: {} 2024-04-16T17:47:28.303 DEBUG:boto:Token: None 2024-04-16T17:47:28.303 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj47 2024-04-16T17:47:28.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LTqPo0Yqe2kSVBLRRh0mI/52VpA= 2024-04-16T17:47:28.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LTqPo0Yqe2kSVBLRRh0mI/52VpA='} 2024-04-16T17:47:28.308 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000928547df8e5086f0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.308 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.308 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.308 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.308 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.308 DEBUG:boto:Data: 2024-04-16T17:47:28.308 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.309 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.309 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.309 DEBUG:boto:Params: {} 2024-04-16T17:47:28.309 DEBUG:boto:Token: None 2024-04-16T17:47:28.309 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.312 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '282'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000714c1dbab33a4dc-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.312 DEBUG:boto:path=/cjqttm-12/obj48 2024-04-16T17:47:28.312 DEBUG:boto:auth_path=/cjqttm-12/obj48 2024-04-16T17:47:28.312 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.312 DEBUG:boto:Path: /cjqttm-12/obj48 2024-04-16T17:47:28.312 DEBUG:boto:Data: 2024-04-16T17:47:28.312 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.313 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.313 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.313 DEBUG:boto:Params: {} 2024-04-16T17:47:28.313 DEBUG:boto:Token: None 2024-04-16T17:47:28.313 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj48 2024-04-16T17:47:28.313 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTTWPsLi54l2Wi6xf9/czfU7toc= 2024-04-16T17:47:28.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTTWPsLi54l2Wi6xf9/czfU7toc='} 2024-04-16T17:47:28.358 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002cf798e9b2d2616a-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.359 DEBUG:boto:path=/cjqttm-12/ 2024-04-16T17:47:28.359 DEBUG:boto:auth_path=/cjqttm-12/ 2024-04-16T17:47:28.359 DEBUG:boto:Method: HEAD 2024-04-16T17:47:28.359 DEBUG:boto:Path: /cjqttm-12/ 2024-04-16T17:47:28.359 DEBUG:boto:Data: 2024-04-16T17:47:28.359 DEBUG:boto:Headers: {} 2024-04-16T17:47:28.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.359 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.359 DEBUG:boto:Params: {} 2024-04-16T17:47:28.360 DEBUG:boto:Token: None 2024-04-16T17:47:28.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/ 2024-04-16T17:47:28.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T17:47:28.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T17:47:28.362 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '288'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fc99a0f121c7ef8c-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.363 DEBUG:boto:path=/cjqttm-12/obj49 2024-04-16T17:47:28.363 DEBUG:boto:auth_path=/cjqttm-12/obj49 2024-04-16T17:47:28.363 DEBUG:boto:Method: PUT 2024-04-16T17:47:28.363 DEBUG:boto:Path: /cjqttm-12/obj49 2024-04-16T17:47:28.363 DEBUG:boto:Data: 2024-04-16T17:47:28.363 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T17:47:28.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:47:28.363 DEBUG:boto:Port: 8000 2024-04-16T17:47:28.363 DEBUG:boto:Params: {} 2024-04-16T17:47:28.364 DEBUG:boto:Token: None 2024-04-16T17:47:28.364 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 17:47:28 GMT /cjqttm-12/obj49 2024-04-16T17:47:28.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OwlVj7IITuO8RepeKuk6SnmG0VM= 2024-04-16T17:47:28.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OwlVj7IITuO8RepeKuk6SnmG0VM='} 2024-04-16T17:47:28.368 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031a3e8543944da7e-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:47:28.368 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:28.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:28.368 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:47:28.423 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:28.423 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:28.479 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:47:28.501 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289645.949278_54.1","last_update":"2024-04-16T17:47:25.949278Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:47:28.501 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289645.949278_54.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:28.501 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:47:28.502 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:28.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:47:28.502 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:47:28.550 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:28.551 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:28.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:28.600+0000 7f9da7644800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:47:28.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:28.601+0000 7f9da7644800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:47:28.621 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289645.949278_54.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:25.949278Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:28Z"} 2024-04-16T17:47:28.621 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289645.949278_54.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:25.949278Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:28Z"} 2024-04-16T17:47:28.621 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713289645.949278_54.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:25.949278Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:47:28.622 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289645.949278_54.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:28.622 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289645.949278_54.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:47:28.622 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:47:28.622 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:28.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:47:28.622 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:47:28.677 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:47:28.677 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:47:28.734 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:28.735+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:47:33.735 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:33.735+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:47:38.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:38.736+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:47:43.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:43.737+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:47:48.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:48.738+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:47:53.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:53.739+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:47:58.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:47:58.741+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:03.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:03.741+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:08.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:08.743+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:13.742 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:13.743+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:18.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:18.744+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:23.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:23.745+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:28.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:28.746+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:33.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:33.746+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:38.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:38.747+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:43.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:43.748+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:48.749 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:48.749+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:53.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:53.751+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:48:58.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:48:58.752+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:03.751 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:03.753+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:08.752 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:08.753+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:13.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:13.754+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:18.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:18.755+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:23.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:23.756+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:28.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:28.757+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:33.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:33.758+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:38.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:38.760+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:43.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:43.761+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:48.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:48.762+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:53.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:53.763+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:49:58.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:49:58.762+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:03.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:03.763+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:08.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:08.764+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:13.764 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:13.765+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:18.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:18.767+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:23.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:23.767+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:28.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:28.769+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:33.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:33.770+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:38.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:38.771+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:43.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:43.771+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:48.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:48.772+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:53.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:53.773+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:50:58.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:50:58.774+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:03.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:03.775+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:08.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:08.776+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:13.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:13.778+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:18.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:18.778+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:23.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:23.779+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:28.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:28.779+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:33.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:33.780+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:38.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:38.781+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:43.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:43.782+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:48.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:48.783+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:53.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:53.784+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:51:58.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:51:58.785+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:52:03.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:03.787+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:52:08.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:08.788+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:52:13.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:13.789+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:52:18.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:18.789+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T17:52:23.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:23.790+0000 7f716a733800 -1 bucket checkpoint timed out waiting to reach incremental sync 2024-04-16T17:52:23.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:23.790+0000 7f716a733800 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T17:52:23.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:23.790+0000 7f716a733800 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T17:52:23.813 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-04-16T17:52:23.837 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_object_delete ... FAIL 2024-04-16T17:52:23.839 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-13 2024-04-16T17:52:23.839 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:23.839 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:23.839 DEBUG:boto:Method: PUT 2024-04-16T17:52:23.840 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:23.840 DEBUG:boto:Data: 2024-04-16T17:52:23.840 DEBUG:boto:Headers: {} 2024-04-16T17:52:23.840 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:23.840 DEBUG:boto:Port: 8000 2024-04-16T17:52:23.840 DEBUG:boto:Params: {} 2024-04-16T17:52:23.841 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:52:23.841 DEBUG:boto:Token: None 2024-04-16T17:52:23.841 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:23 GMT /cjqttm-13/ 2024-04-16T17:52:23.841 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rv+KQqSyyTSIyI4v7N7Xit41GMA= 2024-04-16T17:52:23.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rv+KQqSyyTSIyI4v7N7Xit41GMA=', 'Content-Length': '0'} 2024-04-16T17:52:23.862 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000fbb0f702cf91c42c-00661ebad7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:23.862 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-14 2024-04-16T17:52:23.863 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:23.863 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:23.863 DEBUG:boto:Method: PUT 2024-04-16T17:52:23.863 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:23.863 DEBUG:boto:Data: 2024-04-16T17:52:23.863 DEBUG:boto:Headers: {} 2024-04-16T17:52:23.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:23.863 DEBUG:boto:Port: 8000 2024-04-16T17:52:23.863 DEBUG:boto:Params: {} 2024-04-16T17:52:23.863 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:52:23.864 DEBUG:boto:Token: None 2024-04-16T17:52:23.864 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:23 GMT /cjqttm-14/ 2024-04-16T17:52:23.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q7N7qcRiqCA6z1X+hs2bp7euPQc= 2024-04-16T17:52:23.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q7N7qcRiqCA6z1X+hs2bp7euPQc=', 'Content-Length': '0'} 2024-04-16T17:52:23.893 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000eef87cfb3bcc58cf-00661ebad7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:23.894 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:23.894 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:23.894 DEBUG:boto:path=/cjqttm-13/?versioning 2024-04-16T17:52:23.894 DEBUG:boto:auth_path=/cjqttm-13/?versioning 2024-04-16T17:52:23.894 DEBUG:boto:Method: PUT 2024-04-16T17:52:23.894 DEBUG:boto:Path: /cjqttm-13/?versioning 2024-04-16T17:52:23.894 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:52:23.894 DEBUG:boto:Headers: {} 2024-04-16T17:52:23.894 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:23.894 DEBUG:boto:Port: 8000 2024-04-16T17:52:23.894 DEBUG:boto:Params: {} 2024-04-16T17:52:23.895 DEBUG:boto:Token: None 2024-04-16T17:52:23.895 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:23 GMT /cjqttm-13/?versioning 2024-04-16T17:52:23.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bOQtrgfCZZeSYiuFs6Y8dvsTIPk= 2024-04-16T17:52:23.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bOQtrgfCZZeSYiuFs6Y8dvsTIPk=', 'Content-Length': '228'} 2024-04-16T17:52:23.901 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000091d587946c1c8f8e-00661ebad7-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:23.901 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:23.902 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:23.902 DEBUG:boto:path=/cjqttm-14/?versioning 2024-04-16T17:52:23.902 DEBUG:boto:auth_path=/cjqttm-14/?versioning 2024-04-16T17:52:23.902 DEBUG:boto:Method: PUT 2024-04-16T17:52:23.902 DEBUG:boto:Path: /cjqttm-14/?versioning 2024-04-16T17:52:23.902 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:52:23.902 DEBUG:boto:Headers: {} 2024-04-16T17:52:23.902 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:23.902 DEBUG:boto:Port: 8000 2024-04-16T17:52:23.902 DEBUG:boto:Params: {} 2024-04-16T17:52:23.902 DEBUG:boto:Token: None 2024-04-16T17:52:23.903 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:23 GMT /cjqttm-14/?versioning 2024-04-16T17:52:23.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0txAx7IvAvcKZvhTFFZXH8vhAaA= 2024-04-16T17:52:23.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0txAx7IvAvcKZvhTFFZXH8vhAaA=', 'Content-Length': '228'} 2024-04-16T17:52:23.913 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000b65c05a64d809ddf-00661ebad7-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:23.913 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:52:23.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:52:23.914 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:52:23.967 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:23.967 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:24.020 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:52:24.042 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289943.911734_117.1","last_update":"2024-04-16T17:52:23.911734Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:52:24.043 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289943.911734_117.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:52:24.043 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:52:24.043 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:52:24.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:52:24.043 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:52:24.097 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:24.097 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:24.148 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:24.150+0000 7fe59c535800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:52:24.149 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:24.151+0000 7fe59c535800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:52:24.171 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289943.852984_106.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:23.852984Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:52:24Z"} 2024-04-16T17:52:24.171 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289943.852984_106.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:23.852984Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:52:24Z"} 2024-04-16T17:52:24.171 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713289943.852984_106.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:23.852984Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:52:24.171 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289943.911734_117.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:52:24.171 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289943.852984_106.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:52:24.172 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713289943.911734_117.1 target=1_1713289943.852984_106.1 2024-04-16T17:52:29.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:52:29.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:52:29.173 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:52:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:29.227 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:29.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:29.281+0000 7f9141f25800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:52:29.281 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:29.282+0000 7f9141f25800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:52:29.301 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289943.911734_117.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:23.911734Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:52:29Z"} 2024-04-16T17:52:29.302 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289943.911734_117.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:23.911734Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:52:29Z"} 2024-04-16T17:52:29.302 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713289943.911734_117.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:23.911734Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:52:29.302 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289943.911734_117.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:52:29.302 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289943.911734_117.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:52:29.302 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:52:29.302 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:29.302 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:29.303 DEBUG:boto:Method: HEAD 2024-04-16T17:52:29.303 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:29.303 DEBUG:boto:Data: 2024-04-16T17:52:29.303 DEBUG:boto:Headers: {} 2024-04-16T17:52:29.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:29.303 DEBUG:boto:Port: 8000 2024-04-16T17:52:29.303 DEBUG:boto:Params: {} 2024-04-16T17:52:29.303 DEBUG:boto:Token: None 2024-04-16T17:52:29.303 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:29 GMT /cjqttm-13/ 2024-04-16T17:52:29.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NwpvIxhXsTs1cjcjB7gpgGoIo34= 2024-04-16T17:52:29.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NwpvIxhXsTs1cjcjB7gpgGoIo34=', 'Content-Length': '0'} 2024-04-16T17:52:29.306 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e20ee0707529ea62-00661ebadd-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:29.307 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:29.307 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:29.307 DEBUG:boto:Method: PUT 2024-04-16T17:52:29.307 DEBUG:boto:Path: /cjqttm-13/dummy 2024-04-16T17:52:29.307 DEBUG:boto:Data: 2024-04-16T17:52:29.307 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:52:29.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:29.308 DEBUG:boto:Port: 8000 2024-04-16T17:52:29.308 DEBUG:boto:Params: {} 2024-04-16T17:52:29.308 DEBUG:boto:Token: None 2024-04-16T17:52:29.308 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:52:29 GMT /cjqttm-13/dummy 2024-04-16T17:52:29.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C6HezpJYI6uYtrKN079Fgv5DKCI= 2024-04-16T17:52:29.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C6HezpJYI6uYtrKN079Fgv5DKCI='} 2024-04-16T17:52:29.321 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-amz-request-id', 'tx000005ee810f3afc32a7a-00661ebadd-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:29.321 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:29.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:29.321 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:52:29.381 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:29.381 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:29.434 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:29.435+0000 7f89ad4c0800 1 waiting to reach incremental sync.. 2024-04-16T17:52:34.436 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:34.437+0000 7f89ad4c0800 1 bucket sync caught up with source: 2024-04-16T17:52:34.437 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000002.12.11, , , , , ] 2024-04-16T17:52:34.437 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000002.12.11, , , , , ] 2024-04-16T17:52:34.437 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:34.437+0000 7f89ad4c0800 0 bucket checkpoint complete 2024-04-16T17:52:34.462 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:34.462 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:34.462 DEBUG:boto:Method: HEAD 2024-04-16T17:52:34.462 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:34.462 DEBUG:boto:Data: 2024-04-16T17:52:34.463 DEBUG:boto:Headers: {} 2024-04-16T17:52:34.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:34.463 DEBUG:boto:Port: 8000 2024-04-16T17:52:34.463 DEBUG:boto:Params: {} 2024-04-16T17:52:34.463 DEBUG:boto:Token: None 2024-04-16T17:52:34.463 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:34 GMT /cjqttm-14/ 2024-04-16T17:52:34.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GZivZ1Cqu58Y8giIOepZS23JJJg= 2024-04-16T17:52:34.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GZivZ1Cqu58Y8giIOepZS23JJJg=', 'Content-Length': '0'} 2024-04-16T17:52:34.466 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009353d527fc517839-00661ebae2-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:34.467 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:34.467 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:34.467 DEBUG:boto:Method: PUT 2024-04-16T17:52:34.467 DEBUG:boto:Path: /cjqttm-14/dummy 2024-04-16T17:52:34.468 DEBUG:boto:Data: 2024-04-16T17:52:34.468 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:52:34.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:34.468 DEBUG:boto:Port: 8000 2024-04-16T17:52:34.468 DEBUG:boto:Params: {} 2024-04-16T17:52:34.468 DEBUG:boto:Token: None 2024-04-16T17:52:34.469 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:52:34 GMT /cjqttm-14/dummy 2024-04-16T17:52:34.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eNpAK6u/54ncoaTYSchpb4/uSEQ= 2024-04-16T17:52:34.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eNpAK6u/54ncoaTYSchpb4/uSEQ='} 2024-04-16T17:52:34.483 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-amz-request-id', 'tx00000381be87580060f50-00661ebae2-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:34.483 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:34.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:34.484 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:52:34.547 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:34.547 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:34.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:34.608+0000 7fca50624800 1 waiting to reach incremental sync.. 2024-04-16T17:52:39.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:39.610+0000 7fca50624800 1 bucket sync caught up with source: 2024-04-16T17:52:39.609 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000002.24.11, , , , , ] 2024-04-16T17:52:39.609 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000002.24.11, , , , , ] 2024-04-16T17:52:39.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:39.610+0000 7fca50624800 0 bucket checkpoint complete 2024-04-16T17:52:39.633 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:39.633 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:39.633 DEBUG:boto:Method: HEAD 2024-04-16T17:52:39.633 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:39.634 DEBUG:boto:Data: 2024-04-16T17:52:39.634 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.634 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.634 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.634 DEBUG:boto:Params: {} 2024-04-16T17:52:39.634 DEBUG:boto:Token: None 2024-04-16T17:52:39.634 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/ 2024-04-16T17:52:39.634 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IzXq5LAN8mNbIHrWBrs7x8IEemc= 2024-04-16T17:52:39.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IzXq5LAN8mNbIHrWBrs7x8IEemc=', 'Content-Length': '0'} 2024-04-16T17:52:39.637 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008be79c2375dba7cf-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.637 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.637 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.637 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.638 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.638 DEBUG:boto:Data: 2024-04-16T17:52:39.638 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.638 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.638 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.638 DEBUG:boto:Params: {} 2024-04-16T17:52:39.638 DEBUG:boto:Token: None 2024-04-16T17:52:39.638 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.638 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TDpLclKc7PLrlEZzmelb4+1DPJs= 2024-04-16T17:52:39.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TDpLclKc7PLrlEZzmelb4+1DPJs='} 2024-04-16T17:52:39.651 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-amz-request-id', 'tx0000001b318aba3652777-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.651 DEBUG:rgw_multi.tests:version1 id=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:39.651 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.651 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.651 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.651 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.651 DEBUG:boto:Data: 2024-04-16T17:52:39.651 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.652 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.652 DEBUG:boto:Params: {} 2024-04-16T17:52:39.652 DEBUG:boto:Token: None 2024-04-16T17:52:39.652 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hiE+4UJ9iaW7cOqRqKTy123HX4Y= 2024-04-16T17:52:39.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hiE+4UJ9iaW7cOqRqKTy123HX4Y='} 2024-04-16T17:52:39.694 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'b2pNtIUiubjDLzyQgKVIVTWcz1NyB5Q'), ('x-amz-request-id', 'tx00000c003f0a5854b95c9-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.695 DEBUG:rgw_multi.tests:version2 id=b2pNtIUiubjDLzyQgKVIVTWcz1NyB5Q 2024-04-16T17:52:39.695 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.695 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.695 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=b2pNtIUiubjDLzyQgKVIVTWcz1NyB5Q 2024-04-16T17:52:39.695 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=b2pNtIUiubjDLzyQgKVIVTWcz1NyB5Q 2024-04-16T17:52:39.695 DEBUG:boto:Method: DELETE 2024-04-16T17:52:39.695 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=b2pNtIUiubjDLzyQgKVIVTWcz1NyB5Q 2024-04-16T17:52:39.695 DEBUG:boto:Data: 2024-04-16T17:52:39.695 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.695 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.695 DEBUG:boto:Params: {} 2024-04-16T17:52:39.696 DEBUG:boto:Token: None 2024-04-16T17:52:39.696 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone1?versionId=b2pNtIUiubjDLzyQgKVIVTWcz1NyB5Q 2024-04-16T17:52:39.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4VsID2Rp2lrZWGLI+Sre9E0nEYs= 2024-04-16T17:52:39.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4VsID2Rp2lrZWGLI+Sre9E0nEYs=', 'Content-Length': '0'} 2024-04-16T17:52:39.706 DEBUG:boto:Response headers: [('x-amz-version-id', 'b2pNtIUiubjDLzyQgKVIVTWcz1NyB5Q'), ('x-amz-request-id', 'tx00000d065f02d67621be7-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.706 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.707 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.707 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.707 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.707 DEBUG:boto:Data: 2024-04-16T17:52:39.707 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.707 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.707 DEBUG:boto:Params: {} 2024-04-16T17:52:39.707 DEBUG:boto:Token: None 2024-04-16T17:52:39.707 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zTgVB9+/8CHcoCjnqvKjsWDZ0Bc= 2024-04-16T17:52:39.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zTgVB9+/8CHcoCjnqvKjsWDZ0Bc='} 2024-04-16T17:52:39.717 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '5UoSMaGlz2b9.E01i58XGqTNOLleGm5'), ('x-amz-request-id', 'tx00000e5fb0658eed31ec3-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.717 DEBUG:rgw_multi.tests:version3 id=5UoSMaGlz2b9.E01i58XGqTNOLleGm5 2024-04-16T17:52:39.717 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.717 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:39.717 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=5UoSMaGlz2b9.E01i58XGqTNOLleGm5 2024-04-16T17:52:39.717 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=5UoSMaGlz2b9.E01i58XGqTNOLleGm5 2024-04-16T17:52:39.718 DEBUG:boto:Method: DELETE 2024-04-16T17:52:39.718 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=5UoSMaGlz2b9.E01i58XGqTNOLleGm5 2024-04-16T17:52:39.718 DEBUG:boto:Data: 2024-04-16T17:52:39.718 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.718 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.718 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.718 DEBUG:boto:Params: {} 2024-04-16T17:52:39.718 DEBUG:boto:Token: None 2024-04-16T17:52:39.718 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone1?versionId=5UoSMaGlz2b9.E01i58XGqTNOLleGm5 2024-04-16T17:52:39.718 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bEgO6FR5ugQ+TXNWm8RtW8om47w= 2024-04-16T17:52:39.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bEgO6FR5ugQ+TXNWm8RtW8om47w=', 'Content-Length': '0'} 2024-04-16T17:52:39.728 DEBUG:boto:Response headers: [('x-amz-version-id', '5UoSMaGlz2b9.E01i58XGqTNOLleGm5'), ('x-amz-request-id', 'tx00000258c4ac9a4d3648e-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.728 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:39.729 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:39.729 DEBUG:boto:Method: HEAD 2024-04-16T17:52:39.729 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:39.729 DEBUG:boto:Data: 2024-04-16T17:52:39.729 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.729 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.729 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.729 DEBUG:boto:Params: {} 2024-04-16T17:52:39.729 DEBUG:boto:Token: None 2024-04-16T17:52:39.729 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/ 2024-04-16T17:52:39.729 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IzXq5LAN8mNbIHrWBrs7x8IEemc= 2024-04-16T17:52:39.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IzXq5LAN8mNbIHrWBrs7x8IEemc=', 'Content-Length': '0'} 2024-04-16T17:52:39.732 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e59d4219d84c68d-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.732 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.732 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.732 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.732 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.732 DEBUG:boto:Data: 2024-04-16T17:52:39.732 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.733 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.733 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.733 DEBUG:boto:Params: {} 2024-04-16T17:52:39.733 DEBUG:boto:Token: None 2024-04-16T17:52:39.733 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.733 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jQQ1v+KUbmC0N+oQa16SDb6JaRo= 2024-04-16T17:52:39.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jQQ1v+KUbmC0N+oQa16SDb6JaRo='} 2024-04-16T17:52:39.779 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-amz-request-id', 'tx00000e07236f0d324ab60-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.779 DEBUG:rgw_multi.tests:version1 id=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:39.779 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.779 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.779 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.779 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.780 DEBUG:boto:Data: 2024-04-16T17:52:39.780 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.780 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.780 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.780 DEBUG:boto:Params: {} 2024-04-16T17:52:39.780 DEBUG:boto:Token: None 2024-04-16T17:52:39.780 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UuycSekHl6OAswpGx+WBtnC9A5c= 2024-04-16T17:52:39.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UuycSekHl6OAswpGx+WBtnC9A5c='} 2024-04-16T17:52:39.792 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'W-obzWf3XktNzD29uC5.eDDoa61j9lx'), ('x-amz-request-id', 'tx000000baba862b6c96197-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.792 DEBUG:rgw_multi.tests:version2 id=W-obzWf3XktNzD29uC5.eDDoa61j9lx 2024-04-16T17:52:39.793 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.793 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.793 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=W-obzWf3XktNzD29uC5.eDDoa61j9lx 2024-04-16T17:52:39.793 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=W-obzWf3XktNzD29uC5.eDDoa61j9lx 2024-04-16T17:52:39.793 DEBUG:boto:Method: DELETE 2024-04-16T17:52:39.793 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=W-obzWf3XktNzD29uC5.eDDoa61j9lx 2024-04-16T17:52:39.793 DEBUG:boto:Data: 2024-04-16T17:52:39.793 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.793 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.793 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.794 DEBUG:boto:Params: {} 2024-04-16T17:52:39.794 DEBUG:boto:Token: None 2024-04-16T17:52:39.794 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone2?versionId=W-obzWf3XktNzD29uC5.eDDoa61j9lx 2024-04-16T17:52:39.794 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XmmoIOvTVLIzzjng/h1va1+om4s= 2024-04-16T17:52:39.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XmmoIOvTVLIzzjng/h1va1+om4s=', 'Content-Length': '0'} 2024-04-16T17:52:39.805 DEBUG:boto:Response headers: [('x-amz-version-id', 'W-obzWf3XktNzD29uC5.eDDoa61j9lx'), ('x-amz-request-id', 'tx000002949d000b4c70f4a-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.806 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.806 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.806 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.806 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.806 DEBUG:boto:Data: 2024-04-16T17:52:39.806 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.806 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.806 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.806 DEBUG:boto:Params: {} 2024-04-16T17:52:39.807 DEBUG:boto:Token: None 2024-04-16T17:52:39.807 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iKs/Ek913dkJVQ2lsTd5q67MZiA= 2024-04-16T17:52:39.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iKs/Ek913dkJVQ2lsTd5q67MZiA='} 2024-04-16T17:52:39.850 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'm8Knx-qFCtskKeHUlovJK7IpTk.ZcYU'), ('x-amz-request-id', 'tx000009030892b043b06df-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.851 DEBUG:rgw_multi.tests:version3 id=m8Knx-qFCtskKeHUlovJK7IpTk.ZcYU 2024-04-16T17:52:39.851 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.851 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:39.851 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=m8Knx-qFCtskKeHUlovJK7IpTk.ZcYU 2024-04-16T17:52:39.851 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=m8Knx-qFCtskKeHUlovJK7IpTk.ZcYU 2024-04-16T17:52:39.851 DEBUG:boto:Method: DELETE 2024-04-16T17:52:39.851 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=m8Knx-qFCtskKeHUlovJK7IpTk.ZcYU 2024-04-16T17:52:39.851 DEBUG:boto:Data: 2024-04-16T17:52:39.852 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.852 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.852 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.852 DEBUG:boto:Params: {} 2024-04-16T17:52:39.852 DEBUG:boto:Token: None 2024-04-16T17:52:39.852 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-13/obj-test-zone2?versionId=m8Knx-qFCtskKeHUlovJK7IpTk.ZcYU 2024-04-16T17:52:39.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5emsewro4Ae/3uQksOSOIkwx/yA= 2024-04-16T17:52:39.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5emsewro4Ae/3uQksOSOIkwx/yA=', 'Content-Length': '0'} 2024-04-16T17:52:39.863 DEBUG:boto:Response headers: [('x-amz-version-id', 'm8Knx-qFCtskKeHUlovJK7IpTk.ZcYU'), ('x-amz-request-id', 'tx00000ad1cab7db60d8988-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.863 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:39.863 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:39.863 DEBUG:boto:Method: HEAD 2024-04-16T17:52:39.863 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:39.863 DEBUG:boto:Data: 2024-04-16T17:52:39.863 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.864 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.864 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.864 DEBUG:boto:Params: {} 2024-04-16T17:52:39.864 DEBUG:boto:Token: None 2024-04-16T17:52:39.864 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/ 2024-04-16T17:52:39.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IukacO9H5N+ycgxEjv56D+Mi7GM= 2024-04-16T17:52:39.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IukacO9H5N+ycgxEjv56D+Mi7GM=', 'Content-Length': '0'} 2024-04-16T17:52:39.866 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002d7bb96275a1afec-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.867 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.867 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.867 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.867 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.867 DEBUG:boto:Data: 2024-04-16T17:52:39.867 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.867 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.867 DEBUG:boto:Params: {} 2024-04-16T17:52:39.867 DEBUG:boto:Token: None 2024-04-16T17:52:39.868 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7OwZjaT1V39oe/nn3f5TYCMxm6g= 2024-04-16T17:52:39.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7OwZjaT1V39oe/nn3f5TYCMxm6g='} 2024-04-16T17:52:39.880 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-amz-request-id', 'tx0000089e3095d896de681-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.880 DEBUG:rgw_multi.tests:version1 id=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:39.880 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.880 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.881 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.881 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.881 DEBUG:boto:Data: 2024-04-16T17:52:39.881 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.881 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.881 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.881 DEBUG:boto:Params: {} 2024-04-16T17:52:39.881 DEBUG:boto:Token: None 2024-04-16T17:52:39.881 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.882 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dhsjTxRG17Ytxyb6K4j1Y8inTQE= 2024-04-16T17:52:39.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dhsjTxRG17Ytxyb6K4j1Y8inTQE='} 2024-04-16T17:52:39.892 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'j9lq.a838NnZ1rqWUPGPGvcAF6Qm9vI'), ('x-amz-request-id', 'tx0000021f15b365171a5b8-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.892 DEBUG:rgw_multi.tests:version2 id=j9lq.a838NnZ1rqWUPGPGvcAF6Qm9vI 2024-04-16T17:52:39.892 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.893 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.893 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=j9lq.a838NnZ1rqWUPGPGvcAF6Qm9vI 2024-04-16T17:52:39.893 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=j9lq.a838NnZ1rqWUPGPGvcAF6Qm9vI 2024-04-16T17:52:39.893 DEBUG:boto:Method: DELETE 2024-04-16T17:52:39.893 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=j9lq.a838NnZ1rqWUPGPGvcAF6Qm9vI 2024-04-16T17:52:39.893 DEBUG:boto:Data: 2024-04-16T17:52:39.893 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.893 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.893 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.893 DEBUG:boto:Params: {} 2024-04-16T17:52:39.893 DEBUG:boto:Token: None 2024-04-16T17:52:39.894 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/obj-test-zone1?versionId=j9lq.a838NnZ1rqWUPGPGvcAF6Qm9vI 2024-04-16T17:52:39.894 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xF1ahqCF0Lpe3NyWfnFY5AEsq+I= 2024-04-16T17:52:39.894 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xF1ahqCF0Lpe3NyWfnFY5AEsq+I=', 'Content-Length': '0'} 2024-04-16T17:52:39.905 DEBUG:boto:Response headers: [('x-amz-version-id', 'j9lq.a838NnZ1rqWUPGPGvcAF6Qm9vI'), ('x-amz-request-id', 'tx000001d36e0a406d13b05-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.905 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.905 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.905 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.905 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.905 DEBUG:boto:Data: 2024-04-16T17:52:39.905 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.906 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.906 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.906 DEBUG:boto:Params: {} 2024-04-16T17:52:39.906 DEBUG:boto:Token: None 2024-04-16T17:52:39.906 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.906 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e5uVLZI+11eMlAMUi9LQsvIhxkY= 2024-04-16T17:52:39.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5uVLZI+11eMlAMUi9LQsvIhxkY='} 2024-04-16T17:52:39.950 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'b5Ax3bPbHuTg56KQjWnkxEaqhvD8Wps'), ('x-amz-request-id', 'tx000001ae4e88fe92d46dc-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.951 DEBUG:rgw_multi.tests:version3 id=b5Ax3bPbHuTg56KQjWnkxEaqhvD8Wps 2024-04-16T17:52:39.951 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.951 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:39.951 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=b5Ax3bPbHuTg56KQjWnkxEaqhvD8Wps 2024-04-16T17:52:39.951 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=b5Ax3bPbHuTg56KQjWnkxEaqhvD8Wps 2024-04-16T17:52:39.951 DEBUG:boto:Method: DELETE 2024-04-16T17:52:39.951 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=b5Ax3bPbHuTg56KQjWnkxEaqhvD8Wps 2024-04-16T17:52:39.951 DEBUG:boto:Data: 2024-04-16T17:52:39.951 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:39.951 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.952 DEBUG:boto:Params: {} 2024-04-16T17:52:39.952 DEBUG:boto:Token: None 2024-04-16T17:52:39.952 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/obj-test-zone1?versionId=b5Ax3bPbHuTg56KQjWnkxEaqhvD8Wps 2024-04-16T17:52:39.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NEZ6rdzXoVvUUzNrYbtUxDAzk34= 2024-04-16T17:52:39.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NEZ6rdzXoVvUUzNrYbtUxDAzk34=', 'Content-Length': '0'} 2024-04-16T17:52:39.963 DEBUG:boto:Response headers: [('x-amz-version-id', 'b5Ax3bPbHuTg56KQjWnkxEaqhvD8Wps'), ('x-amz-request-id', 'tx0000019ecc85928f8129d-00661ebae7-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.963 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:39.963 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:39.963 DEBUG:boto:Method: HEAD 2024-04-16T17:52:39.963 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:39.963 DEBUG:boto:Data: 2024-04-16T17:52:39.964 DEBUG:boto:Headers: {} 2024-04-16T17:52:39.964 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.964 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.964 DEBUG:boto:Params: {} 2024-04-16T17:52:39.964 DEBUG:boto:Token: None 2024-04-16T17:52:39.964 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/ 2024-04-16T17:52:39.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IukacO9H5N+ycgxEjv56D+Mi7GM= 2024-04-16T17:52:39.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IukacO9H5N+ycgxEjv56D+Mi7GM=', 'Content-Length': '0'} 2024-04-16T17:52:39.966 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e2c104e751515a7f-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.967 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.967 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.967 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.967 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.967 DEBUG:boto:Data: 2024-04-16T17:52:39.967 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.967 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.967 DEBUG:boto:Params: {} 2024-04-16T17:52:39.968 DEBUG:boto:Token: None 2024-04-16T17:52:39.968 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HiorC5QlFOJiZTyyGeRLBBOdMHw= 2024-04-16T17:52:39.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HiorC5QlFOJiZTyyGeRLBBOdMHw='} 2024-04-16T17:52:39.981 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-amz-request-id', 'tx000007602d6c310b99ea8-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:39.981 DEBUG:rgw_multi.tests:version1 id=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:39.981 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.981 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.981 DEBUG:boto:Method: PUT 2024-04-16T17:52:39.981 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.981 DEBUG:boto:Data: 2024-04-16T17:52:39.982 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:39.982 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:39.982 DEBUG:boto:Port: 8000 2024-04-16T17:52:39.982 DEBUG:boto:Params: {} 2024-04-16T17:52:39.982 DEBUG:boto:Token: None 2024-04-16T17:52:39.982 DEBUG:boto:StringToSign: PUT Lg6VKF8IoH3qF+fuERshyA== application/octet-stream Tue, 16 Apr 2024 17:52:39 GMT /cjqttm-14/obj-test-zone2 2024-04-16T17:52:39.982 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QOboTHGnU5jPynDm4ztBY1NSHwE= 2024-04-16T17:52:39.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'Lg6VKF8IoH3qF+fuERshyA==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QOboTHGnU5jPynDm4ztBY1NSHwE='} 2024-04-16T17:52:40.026 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"2e0e95285f08a07dea17e7ee111b21c8"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'lUgIslOA1FSa2I6SoXh89aFRcVgVu.8'), ('x-amz-request-id', 'tx00000bec18039a88f8f9f-00661ebae7-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:40.027 DEBUG:rgw_multi.tests:version2 id=lUgIslOA1FSa2I6SoXh89aFRcVgVu.8 2024-04-16T17:52:40.027 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.027 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.027 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=lUgIslOA1FSa2I6SoXh89aFRcVgVu.8 2024-04-16T17:52:40.027 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=lUgIslOA1FSa2I6SoXh89aFRcVgVu.8 2024-04-16T17:52:40.027 DEBUG:boto:Method: DELETE 2024-04-16T17:52:40.027 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=lUgIslOA1FSa2I6SoXh89aFRcVgVu.8 2024-04-16T17:52:40.027 DEBUG:boto:Data: 2024-04-16T17:52:40.027 DEBUG:boto:Headers: {} 2024-04-16T17:52:40.027 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:40.027 DEBUG:boto:Port: 8000 2024-04-16T17:52:40.028 DEBUG:boto:Params: {} 2024-04-16T17:52:40.028 DEBUG:boto:Token: None 2024-04-16T17:52:40.028 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:40 GMT /cjqttm-14/obj-test-zone2?versionId=lUgIslOA1FSa2I6SoXh89aFRcVgVu.8 2024-04-16T17:52:40.028 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jWDCbgHJd+pP5GIDp+JS6TP+0gg= 2024-04-16T17:52:40.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jWDCbgHJd+pP5GIDp+JS6TP+0gg=', 'Content-Length': '0'} 2024-04-16T17:52:40.039 DEBUG:boto:Response headers: [('x-amz-version-id', 'lUgIslOA1FSa2I6SoXh89aFRcVgVu.8'), ('x-amz-request-id', 'tx00000168360dd3c8bb145-00661ebae8-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:40.039 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.039 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.039 DEBUG:boto:Method: PUT 2024-04-16T17:52:40.039 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.040 DEBUG:boto:Data: 2024-04-16T17:52:40.040 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:52:40.040 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:40.040 DEBUG:boto:Port: 8000 2024-04-16T17:52:40.040 DEBUG:boto:Params: {} 2024-04-16T17:52:40.040 DEBUG:boto:Token: None 2024-04-16T17:52:40.040 DEBUG:boto:StringToSign: PUT HiNA5/HU7CwjRIhUZJ8d7Q== application/octet-stream Tue, 16 Apr 2024 17:52:40 GMT /cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6vxLIMYEhrhWwIFi/ipFkg1Pqu8= 2024-04-16T17:52:40.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'HiNA5/HU7CwjRIhUZJ8d7Q==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:52:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6vxLIMYEhrhWwIFi/ipFkg1Pqu8='} 2024-04-16T17:52:40.050 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"1e2340e7f1d4ec2c23448854649f1ded"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '1InnJ9stH0n6ErhfAWIfZzGMf66g9TD'), ('x-amz-request-id', 'tx000002cd4ec6e6a8994b9-00661ebae8-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:40.051 DEBUG:rgw_multi.tests:version3 id=1InnJ9stH0n6ErhfAWIfZzGMf66g9TD 2024-04-16T17:52:40.051 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.051 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:40.051 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=1InnJ9stH0n6ErhfAWIfZzGMf66g9TD 2024-04-16T17:52:40.051 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=1InnJ9stH0n6ErhfAWIfZzGMf66g9TD 2024-04-16T17:52:40.051 DEBUG:boto:Method: DELETE 2024-04-16T17:52:40.051 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=1InnJ9stH0n6ErhfAWIfZzGMf66g9TD 2024-04-16T17:52:40.051 DEBUG:boto:Data: 2024-04-16T17:52:40.051 DEBUG:boto:Headers: {} 2024-04-16T17:52:40.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:40.051 DEBUG:boto:Port: 8000 2024-04-16T17:52:40.051 DEBUG:boto:Params: {} 2024-04-16T17:52:40.052 DEBUG:boto:Token: None 2024-04-16T17:52:40.052 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:52:40 GMT /cjqttm-14/obj-test-zone2?versionId=1InnJ9stH0n6ErhfAWIfZzGMf66g9TD 2024-04-16T17:52:40.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KFz5eGZSGJatb4Si1IC7yia8wV4= 2024-04-16T17:52:40.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KFz5eGZSGJatb4Si1IC7yia8wV4=', 'Content-Length': '0'} 2024-04-16T17:52:40.062 DEBUG:boto:Response headers: [('x-amz-version-id', '1InnJ9stH0n6ErhfAWIfZzGMf66g9TD'), ('x-amz-request-id', 'tx00000439e5534115f88fc-00661ebae8-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:40.062 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-13 2024-04-16T17:52:40.062 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:40.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:40.063 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:52:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:40.119 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:40.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:40.176+0000 7f0e3e214800 1 waiting for incremental sync to catch up: 2024-04-16T17:52:40.175 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000002.12.11, , , , , ] 2024-04-16T17:52:40.176 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000010.22.6, , , , 00000000003.14.10, , , , , ] 2024-04-16T17:52:45.177 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:45.178+0000 7f0e3e214800 1 waiting for incremental sync to catch up: 2024-04-16T17:52:45.177 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000008.18.12, , , , 00000000002.12.11, , , , , ] 2024-04-16T17:52:45.177 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000010.22.6, , , , 00000000003.14.10, , , , , ] 2024-04-16T17:52:50.178 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:50.180+0000 7f0e3e214800 1 bucket sync caught up with source: 2024-04-16T17:52:50.179 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000010.22.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:52:50.179 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000010.22.6, , , , 00000000003.14.10, , , , , ] 2024-04-16T17:52:50.179 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:50.180+0000 7f0e3e214800 0 bucket checkpoint complete 2024-04-16T17:52:50.202 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-13 2024-04-16T17:52:50.202 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:50.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:50.202 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:52:50.264 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:50.265 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:50.328+0000 7fe1450e4800 1 bucket sync caught up with source: 2024-04-16T17:52:50.327 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:52:50.327 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:52:50.327 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:50.328+0000 7fe1450e4800 0 bucket checkpoint complete 2024-04-16T17:52:50.348 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-13 zones={test-zone2, test-zone1} 2024-04-16T17:52:50.348 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.348 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.348 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.348 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:50.348 DEBUG:boto:Data: 2024-04-16T17:52:50.349 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.349 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.349 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.349 DEBUG:boto:Params: {} 2024-04-16T17:52:50.349 DEBUG:boto:Token: None 2024-04-16T17:52:50.349 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.349 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sBAA8YhPI+jjZB2253HEl6/vDJM= 2024-04-16T17:52:50.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sBAA8YhPI+jjZB2253HEl6/vDJM=', 'Content-Length': '0'} 2024-04-16T17:52:50.352 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ed2e29db2ee7811-00661ebaf2-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.352 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.352 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.352 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.352 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:50.352 DEBUG:boto:Data: 2024-04-16T17:52:50.352 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.352 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.353 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.353 DEBUG:boto:Params: {} 2024-04-16T17:52:50.353 DEBUG:boto:Token: None 2024-04-16T17:52:50.353 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sBAA8YhPI+jjZB2253HEl6/vDJM= 2024-04-16T17:52:50.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sBAA8YhPI+jjZB2253HEl6/vDJM=', 'Content-Length': '0'} 2024-04-16T17:52:50.356 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003fe057ecc3d87653-00661ebaf2-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.356 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:52:50.356 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.356 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.356 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.356 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.356 DEBUG:boto:Method: GET 2024-04-16T17:52:50.356 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.356 DEBUG:boto:Data: 2024-04-16T17:52:50.357 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.357 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.357 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.357 DEBUG:boto:Params: {} 2024-04-16T17:52:50.357 DEBUG:boto:Token: None 2024-04-16T17:52:50.357 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/?versions 2024-04-16T17:52:50.357 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk= 2024-04-16T17:52:50.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk=', 'Content-Length': '0'} 2024-04-16T17:52:50.360 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000965e5a2f3f6ec603-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.360 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.361 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:52:50.361 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:52:50.361 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:52:50.361 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:52:50.361 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.361 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.361 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.362 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.362 DEBUG:boto:Method: GET 2024-04-16T17:52:50.362 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.362 DEBUG:boto:Data: 2024-04-16T17:52:50.362 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.362 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.362 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.362 DEBUG:boto:Params: {} 2024-04-16T17:52:50.362 DEBUG:boto:Token: None 2024-04-16T17:52:50.362 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/?versions 2024-04-16T17:52:50.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk= 2024-04-16T17:52:50.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk=', 'Content-Length': '0'} 2024-04-16T17:52:50.365 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3d00151ead123ed-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.365 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.365 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:52:50.365 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:52:50.365 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:52:50.366 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.366 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.366 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.366 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.366 DEBUG:boto:Method: GET 2024-04-16T17:52:50.366 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.366 DEBUG:boto:Data: 2024-04-16T17:52:50.366 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.366 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.366 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.366 DEBUG:boto:Params: {} 2024-04-16T17:52:50.367 DEBUG:boto:Token: None 2024-04-16T17:52:50.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/?versions 2024-04-16T17:52:50.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk= 2024-04-16T17:52:50.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk=', 'Content-Length': '0'} 2024-04-16T17:52:50.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036bd35f1a54d2966-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.369 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.370 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.370 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.370 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.370 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.370 DEBUG:boto:Method: GET 2024-04-16T17:52:50.370 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:52:50.370 DEBUG:boto:Data: 2024-04-16T17:52:50.370 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.370 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.370 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.371 DEBUG:boto:Params: {} 2024-04-16T17:52:50.371 DEBUG:boto:Token: None 2024-04-16T17:52:50.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/?versions 2024-04-16T17:52:50.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk= 2024-04-16T17:52:50.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kadzBjb+aUOI7/A9XPHRym5OVCk=', 'Content-Length': '0'} 2024-04-16T17:52:50.373 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b12b219948ac05ca-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.373 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.374 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:52:50.374 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.374 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.374 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.374 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.374 DEBUG:boto:Method: GET 2024-04-16T17:52:50.375 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.375 DEBUG:boto:Data: 2024-04-16T17:52:50.375 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.375 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.375 DEBUG:boto:Params: {} 2024-04-16T17:52:50.375 DEBUG:boto:Token: None 2024-04-16T17:52:50.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI= 2024-04-16T17:52:50.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI=', 'Content-Length': '0'} 2024-04-16T17:52:50.377 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003a207152675eb844-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.377 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.377 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.378 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.378 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.378 DEBUG:boto:Method: GET 2024-04-16T17:52:50.378 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.378 DEBUG:boto:Data: 2024-04-16T17:52:50.378 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.378 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.378 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.378 DEBUG:boto:Params: {} 2024-04-16T17:52:50.378 DEBUG:boto:Token: None 2024-04-16T17:52:50.378 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI= 2024-04-16T17:52:50.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI=', 'Content-Length': '0'} 2024-04-16T17:52:50.380 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c2900496effdaf0f-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.380 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.381 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.381 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.381 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.381 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.381 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.381 DEBUG:boto:Data: 2024-04-16T17:52:50.381 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.381 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.381 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.381 DEBUG:boto:Params: {} 2024-04-16T17:52:50.382 DEBUG:boto:Token: None 2024-04-16T17:52:50.382 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.382 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRd0Dq1Vox4dPipwNQZDtEMut00= 2024-04-16T17:52:50.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRd0Dq1Vox4dPipwNQZDtEMut00=', 'Content-Length': '0'} 2024-04-16T17:52:50.383 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b4ff7df18f4fc327-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.384 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.384 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.384 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.384 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.384 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.384 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.384 DEBUG:boto:Data: 2024-04-16T17:52:50.384 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.384 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.384 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.385 DEBUG:boto:Params: {} 2024-04-16T17:52:50.385 DEBUG:boto:Token: None 2024-04-16T17:52:50.385 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.385 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRd0Dq1Vox4dPipwNQZDtEMut00= 2024-04-16T17:52:50.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRd0Dq1Vox4dPipwNQZDtEMut00=', 'Content-Length': '0'} 2024-04-16T17:52:50.387 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e1f329da3eb860ea-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.387 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:52:50.387 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.387 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.387 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.387 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.387 DEBUG:boto:Method: GET 2024-04-16T17:52:50.388 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.388 DEBUG:boto:Data: 2024-04-16T17:52:50.388 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.388 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.388 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.388 DEBUG:boto:Params: {} 2024-04-16T17:52:50.388 DEBUG:boto:Token: None 2024-04-16T17:52:50.388 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI= 2024-04-16T17:52:50.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI=', 'Content-Length': '0'} 2024-04-16T17:52:50.390 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000cc870151b4b67856-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.390 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.391 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.391 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.391 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.391 DEBUG:boto:Method: GET 2024-04-16T17:52:50.391 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.391 DEBUG:boto:Data: 2024-04-16T17:52:50.391 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.391 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.391 DEBUG:boto:Params: {} 2024-04-16T17:52:50.392 DEBUG:boto:Token: None 2024-04-16T17:52:50.392 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI= 2024-04-16T17:52:50.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI=', 'Content-Length': '0'} 2024-04-16T17:52:50.393 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007f2594ad7bf38d50-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.394 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.394 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.394 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.394 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.394 DEBUG:boto:Method: GET 2024-04-16T17:52:50.394 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.394 DEBUG:boto:Data: 2024-04-16T17:52:50.394 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.394 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.394 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.395 DEBUG:boto:Params: {} 2024-04-16T17:52:50.395 DEBUG:boto:Token: None 2024-04-16T17:52:50.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.397 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044085dd6f2717187-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.397 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.397 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.398 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.398 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.398 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.398 DEBUG:boto:Method: GET 2024-04-16T17:52:50.398 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.398 DEBUG:boto:Data: 2024-04-16T17:52:50.398 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.398 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.398 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.398 DEBUG:boto:Params: {} 2024-04-16T17:52:50.398 DEBUG:boto:Token: None 2024-04-16T17:52:50.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.401 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000050334391ea669710-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.442 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.443 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.443 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.443 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.443 DEBUG:boto:Path: /cjqttm-13/dummy 2024-04-16T17:52:50.443 DEBUG:boto:Data: 2024-04-16T17:52:50.443 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.443 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.443 DEBUG:boto:Params: {} 2024-04-16T17:52:50.443 DEBUG:boto:Token: None 2024-04-16T17:52:50.444 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy 2024-04-16T17:52:50.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aralmMJ1rSkFASxzGrh1KMjNXKA= 2024-04-16T17:52:50.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aralmMJ1rSkFASxzGrh1KMjNXKA=', 'Content-Length': '0'} 2024-04-16T17:52:50.447 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e9cde71072c5fe3a-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.447 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.447 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.447 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.447 DEBUG:boto:Path: /cjqttm-13/dummy 2024-04-16T17:52:50.447 DEBUG:boto:Data: 2024-04-16T17:52:50.447 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.448 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.448 DEBUG:boto:Params: {} 2024-04-16T17:52:50.448 DEBUG:boto:Token: None 2024-04-16T17:52:50.448 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy 2024-04-16T17:52:50.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aralmMJ1rSkFASxzGrh1KMjNXKA= 2024-04-16T17:52:50.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aralmMJ1rSkFASxzGrh1KMjNXKA=', 'Content-Length': '0'} 2024-04-16T17:52:50.450 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009263320513476624-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.450 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:52:50.450 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.451 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.451 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.451 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.451 DEBUG:boto:Method: GET 2024-04-16T17:52:50.451 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.451 DEBUG:boto:Data: 2024-04-16T17:52:50.451 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.451 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.451 DEBUG:boto:Params: {} 2024-04-16T17:52:50.451 DEBUG:boto:Token: None 2024-04-16T17:52:50.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI= 2024-04-16T17:52:50.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI=', 'Content-Length': '0'} 2024-04-16T17:52:50.453 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003fff73bc3811aeee-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.454 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:52:50.454 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:52:50.454 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.454 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.454 DEBUG:boto:Method: GET 2024-04-16T17:52:50.454 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.454 DEBUG:boto:Data: 2024-04-16T17:52:50.454 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.455 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.455 DEBUG:boto:Params: {} 2024-04-16T17:52:50.455 DEBUG:boto:Token: None 2024-04-16T17:52:50.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:52:50.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI= 2024-04-16T17:52:50.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5QJGr+n0x9/aF2yTfPj0NHs5vnI=', 'Content-Length': '0'} 2024-04-16T17:52:50.457 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ae67a347f285cae5-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.457 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.457 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.457 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.457 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.457 DEBUG:boto:Method: GET 2024-04-16T17:52:50.457 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.458 DEBUG:boto:Data: 2024-04-16T17:52:50.458 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.458 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.458 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.458 DEBUG:boto:Params: {} 2024-04-16T17:52:50.458 DEBUG:boto:Token: None 2024-04-16T17:52:50.458 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.458 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.460 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e994a03092ff305-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.502 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.503 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.503 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.503 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.503 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.503 DEBUG:boto:Method: GET 2024-04-16T17:52:50.503 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:52:50.503 DEBUG:boto:Data: 2024-04-16T17:52:50.503 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.503 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.503 DEBUG:boto:Params: {} 2024-04-16T17:52:50.504 DEBUG:boto:Token: None 2024-04-16T17:52:50.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.506 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7ce37a1a817cb26-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.506 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:52:50.506 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.506 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.507 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.507 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.507 DEBUG:boto:Method: GET 2024-04-16T17:52:50.507 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.507 DEBUG:boto:Data: 2024-04-16T17:52:50.507 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.507 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.507 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.507 DEBUG:boto:Params: {} 2024-04-16T17:52:50.507 DEBUG:boto:Token: None 2024-04-16T17:52:50.507 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o= 2024-04-16T17:52:50.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o=', 'Content-Length': '0'} 2024-04-16T17:52:50.510 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f3ef208c60cb1a76-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.550 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.550 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.551 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.551 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.551 DEBUG:boto:Method: GET 2024-04-16T17:52:50.551 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.551 DEBUG:boto:Data: 2024-04-16T17:52:50.551 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.551 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.551 DEBUG:boto:Params: {} 2024-04-16T17:52:50.551 DEBUG:boto:Token: None 2024-04-16T17:52:50.551 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o= 2024-04-16T17:52:50.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o=', 'Content-Length': '0'} 2024-04-16T17:52:50.554 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000066ed8eadd0afb878-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.554 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.554 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.554 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.554 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.555 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.555 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.555 DEBUG:boto:Data: 2024-04-16T17:52:50.555 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.555 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.555 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.555 DEBUG:boto:Params: {} 2024-04-16T17:52:50.555 DEBUG:boto:Token: None 2024-04-16T17:52:50.555 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kvBjY7tvsyeTSsEl/9Rfa63qum4= 2024-04-16T17:52:50.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kvBjY7tvsyeTSsEl/9Rfa63qum4=', 'Content-Length': '0'} 2024-04-16T17:52:50.558 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005c491180111535e7-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.558 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.558 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.558 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.558 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.558 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.558 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.559 DEBUG:boto:Data: 2024-04-16T17:52:50.559 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.559 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.559 DEBUG:boto:Params: {} 2024-04-16T17:52:50.559 DEBUG:boto:Token: None 2024-04-16T17:52:50.559 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kvBjY7tvsyeTSsEl/9Rfa63qum4= 2024-04-16T17:52:50.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kvBjY7tvsyeTSsEl/9Rfa63qum4=', 'Content-Length': '0'} 2024-04-16T17:52:50.561 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000373352cf383ab32-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:52:50.562 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.562 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.562 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.562 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.562 DEBUG:boto:Method: GET 2024-04-16T17:52:50.562 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.562 DEBUG:boto:Data: 2024-04-16T17:52:50.562 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.562 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.562 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.562 DEBUG:boto:Params: {} 2024-04-16T17:52:50.563 DEBUG:boto:Token: None 2024-04-16T17:52:50.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o= 2024-04-16T17:52:50.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o=', 'Content-Length': '0'} 2024-04-16T17:52:50.565 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000036c2597dc7fa13e3-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.606 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.606 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.606 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.607 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.607 DEBUG:boto:Method: GET 2024-04-16T17:52:50.607 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.607 DEBUG:boto:Data: 2024-04-16T17:52:50.607 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.607 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.607 DEBUG:boto:Params: {} 2024-04-16T17:52:50.607 DEBUG:boto:Token: None 2024-04-16T17:52:50.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o= 2024-04-16T17:52:50.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o=', 'Content-Length': '0'} 2024-04-16T17:52:50.610 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bfb71d929f139755-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.610 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.611 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.611 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.611 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.611 DEBUG:boto:Method: GET 2024-04-16T17:52:50.611 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.611 DEBUG:boto:Data: 2024-04-16T17:52:50.612 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.612 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.612 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.612 DEBUG:boto:Params: {} 2024-04-16T17:52:50.612 DEBUG:boto:Token: None 2024-04-16T17:52:50.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.615 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d27270eae4e04d48-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.658 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.659 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.659 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.659 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.659 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.659 DEBUG:boto:Method: GET 2024-04-16T17:52:50.659 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.659 DEBUG:boto:Data: 2024-04-16T17:52:50.659 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.659 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.659 DEBUG:boto:Params: {} 2024-04-16T17:52:50.660 DEBUG:boto:Token: None 2024-04-16T17:52:50.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4bdd8a1e4be4b69-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.662 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.663 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.663 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.663 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.663 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.663 DEBUG:boto:Data: 2024-04-16T17:52:50.663 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.663 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.663 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.663 DEBUG:boto:Params: {} 2024-04-16T17:52:50.663 DEBUG:boto:Token: None 2024-04-16T17:52:50.664 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hxb8hSy6YWCv+au14nP18ifInh8= 2024-04-16T17:52:50.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hxb8hSy6YWCv+au14nP18ifInh8=', 'Content-Length': '0'} 2024-04-16T17:52:50.667 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008c537be148884d84-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.667 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.667 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.667 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.667 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.668 DEBUG:boto:Data: 2024-04-16T17:52:50.668 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.668 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.668 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.668 DEBUG:boto:Params: {} 2024-04-16T17:52:50.668 DEBUG:boto:Token: None 2024-04-16T17:52:50.668 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hxb8hSy6YWCv+au14nP18ifInh8= 2024-04-16T17:52:50.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hxb8hSy6YWCv+au14nP18ifInh8=', 'Content-Length': '0'} 2024-04-16T17:52:50.671 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006004be51aec462ca-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:52:50.672 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.672 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.672 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.672 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.672 DEBUG:boto:Method: GET 2024-04-16T17:52:50.672 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.672 DEBUG:boto:Data: 2024-04-16T17:52:50.672 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.672 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.672 DEBUG:boto:Params: {} 2024-04-16T17:52:50.673 DEBUG:boto:Token: None 2024-04-16T17:52:50.673 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o= 2024-04-16T17:52:50.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o=', 'Content-Length': '0'} 2024-04-16T17:52:50.675 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cae12a385db47e6c-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.718 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.719 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:50.719 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.719 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.719 DEBUG:boto:Method: GET 2024-04-16T17:52:50.719 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.719 DEBUG:boto:Data: 2024-04-16T17:52:50.719 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.719 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.720 DEBUG:boto:Params: {} 2024-04-16T17:52:50.720 DEBUG:boto:Token: None 2024-04-16T17:52:50.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:52:50.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o= 2024-04-16T17:52:50.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afZjnGAtK27YdA7j83XK82e1L8o=', 'Content-Length': '0'} 2024-04-16T17:52:50.722 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000722430a1835a7081-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.722 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.723 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.723 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.723 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.723 DEBUG:boto:Method: GET 2024-04-16T17:52:50.723 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.723 DEBUG:boto:Data: 2024-04-16T17:52:50.723 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.723 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.723 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.723 DEBUG:boto:Params: {} 2024-04-16T17:52:50.723 DEBUG:boto:Token: None 2024-04-16T17:52:50.724 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.726 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7350e619bb5dc63-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.766 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.767 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.767 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.767 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.767 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.767 DEBUG:boto:Method: GET 2024-04-16T17:52:50.767 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:52:50.767 DEBUG:boto:Data: 2024-04-16T17:52:50.767 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.767 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.768 DEBUG:boto:Params: {} 2024-04-16T17:52:50.768 DEBUG:boto:Token: None 2024-04-16T17:52:50.768 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.770 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a33e4dee11f0475-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.770 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:52:50.771 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.771 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.771 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.771 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.771 DEBUG:boto:Method: GET 2024-04-16T17:52:50.771 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.771 DEBUG:boto:Data: 2024-04-16T17:52:50.771 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.771 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.771 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.772 DEBUG:boto:Params: {} 2024-04-16T17:52:50.772 DEBUG:boto:Token: None 2024-04-16T17:52:50.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU= 2024-04-16T17:52:50.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU=', 'Content-Length': '0'} 2024-04-16T17:52:50.774 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009008d38e26d13054-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.774 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.774 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.775 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.775 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.775 DEBUG:boto:Method: GET 2024-04-16T17:52:50.775 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.775 DEBUG:boto:Data: 2024-04-16T17:52:50.775 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.775 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.775 DEBUG:boto:Params: {} 2024-04-16T17:52:50.775 DEBUG:boto:Token: None 2024-04-16T17:52:50.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU= 2024-04-16T17:52:50.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU=', 'Content-Length': '0'} 2024-04-16T17:52:50.778 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003d8d741dad4fad1b-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.818 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.818 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.818 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.819 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.819 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.819 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.819 DEBUG:boto:Data: 2024-04-16T17:52:50.819 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.819 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.819 DEBUG:boto:Params: {} 2024-04-16T17:52:50.819 DEBUG:boto:Token: None 2024-04-16T17:52:50.819 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3hHlUvEFz5AfMjF1dGGXGnE7DTg= 2024-04-16T17:52:50.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3hHlUvEFz5AfMjF1dGGXGnE7DTg=', 'Content-Length': '0'} 2024-04-16T17:52:50.822 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000364569f5354ac16-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.822 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.822 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.822 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.822 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.822 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.822 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.823 DEBUG:boto:Data: 2024-04-16T17:52:50.823 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.823 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.823 DEBUG:boto:Params: {} 2024-04-16T17:52:50.823 DEBUG:boto:Token: None 2024-04-16T17:52:50.823 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3hHlUvEFz5AfMjF1dGGXGnE7DTg= 2024-04-16T17:52:50.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3hHlUvEFz5AfMjF1dGGXGnE7DTg=', 'Content-Length': '0'} 2024-04-16T17:52:50.825 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000669a70b53052e4ce-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.826 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:52:50.826 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.826 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.826 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.826 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.826 DEBUG:boto:Method: GET 2024-04-16T17:52:50.826 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.826 DEBUG:boto:Data: 2024-04-16T17:52:50.826 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.826 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.827 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.827 DEBUG:boto:Params: {} 2024-04-16T17:52:50.827 DEBUG:boto:Token: None 2024-04-16T17:52:50.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU= 2024-04-16T17:52:50.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU=', 'Content-Length': '0'} 2024-04-16T17:52:50.829 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ee4a3821dc316663-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.830 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.830 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.830 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.830 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.830 DEBUG:boto:Method: GET 2024-04-16T17:52:50.830 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.830 DEBUG:boto:Data: 2024-04-16T17:52:50.830 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.830 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.831 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.831 DEBUG:boto:Params: {} 2024-04-16T17:52:50.831 DEBUG:boto:Token: None 2024-04-16T17:52:50.831 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU= 2024-04-16T17:52:50.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU=', 'Content-Length': '0'} 2024-04-16T17:52:50.833 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001d6190d8eb534983-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.874 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.874 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.874 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.875 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.875 DEBUG:boto:Method: GET 2024-04-16T17:52:50.875 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.875 DEBUG:boto:Data: 2024-04-16T17:52:50.875 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.875 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.875 DEBUG:boto:Params: {} 2024-04-16T17:52:50.875 DEBUG:boto:Token: None 2024-04-16T17:52:50.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.878 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000148fc90b857363c-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.878 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.878 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.878 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.878 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.879 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.879 DEBUG:boto:Method: GET 2024-04-16T17:52:50.879 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.879 DEBUG:boto:Data: 2024-04-16T17:52:50.879 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.879 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.879 DEBUG:boto:Params: {} 2024-04-16T17:52:50.879 DEBUG:boto:Token: None 2024-04-16T17:52:50.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7dac2fed708489c-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.882 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.882 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.882 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.882 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.882 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.882 DEBUG:boto:Data: 2024-04-16T17:52:50.883 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.883 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.883 DEBUG:boto:Params: {} 2024-04-16T17:52:50.883 DEBUG:boto:Token: None 2024-04-16T17:52:50.883 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cb0JnLrsdTkD+9VMk0S7Jqifq5Q= 2024-04-16T17:52:50.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cb0JnLrsdTkD+9VMk0S7Jqifq5Q=', 'Content-Length': '0'} 2024-04-16T17:52:50.886 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000361a958f3e3c3d8-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.886 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.886 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.886 DEBUG:boto:Method: HEAD 2024-04-16T17:52:50.887 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.887 DEBUG:boto:Data: 2024-04-16T17:52:50.887 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.887 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.887 DEBUG:boto:Params: {} 2024-04-16T17:52:50.887 DEBUG:boto:Token: None 2024-04-16T17:52:50.887 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cb0JnLrsdTkD+9VMk0S7Jqifq5Q= 2024-04-16T17:52:50.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cb0JnLrsdTkD+9VMk0S7Jqifq5Q=', 'Content-Length': '0'} 2024-04-16T17:52:50.890 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e5206515cf1af5df-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.890 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:52:50.890 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.890 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.890 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.891 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.891 DEBUG:boto:Method: GET 2024-04-16T17:52:50.891 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.891 DEBUG:boto:Data: 2024-04-16T17:52:50.891 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.891 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.891 DEBUG:boto:Params: {} 2024-04-16T17:52:50.891 DEBUG:boto:Token: None 2024-04-16T17:52:50.891 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU= 2024-04-16T17:52:50.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU=', 'Content-Length': '0'} 2024-04-16T17:52:50.894 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000048cf4c63a004508a-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.894 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.894 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:50.894 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.894 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.894 DEBUG:boto:Method: GET 2024-04-16T17:52:50.894 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.894 DEBUG:boto:Data: 2024-04-16T17:52:50.895 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.895 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.895 DEBUG:boto:Params: {} 2024-04-16T17:52:50.895 DEBUG:boto:Token: None 2024-04-16T17:52:50.895 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:52:50.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU= 2024-04-16T17:52:50.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/EC8UkULbaSDQyvm71pzwmZQMU=', 'Content-Length': '0'} 2024-04-16T17:52:50.897 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f80c6fd990d871f0-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.938 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.938 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.939 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.939 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.939 DEBUG:boto:Method: GET 2024-04-16T17:52:50.939 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.939 DEBUG:boto:Data: 2024-04-16T17:52:50.939 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:50.939 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.939 DEBUG:boto:Params: {} 2024-04-16T17:52:50.939 DEBUG:boto:Token: None 2024-04-16T17:52:50.940 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.942 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5ee8374c439f8b0-00661ebaf2-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.942 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.942 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:50.943 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:50.943 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.943 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.943 DEBUG:boto:Method: GET 2024-04-16T17:52:50.943 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:52:50.943 DEBUG:boto:Data: 2024-04-16T17:52:50.943 DEBUG:boto:Headers: {} 2024-04-16T17:52:50.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:50.943 DEBUG:boto:Port: 8000 2024-04-16T17:52:50.943 DEBUG:boto:Params: {} 2024-04-16T17:52:50.944 DEBUG:boto:Token: None 2024-04-16T17:52:50.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:50 GMT /cjqttm-13/ 2024-04-16T17:52:50.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I= 2024-04-16T17:52:50.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3dZAYg2dkGvLu6FjYd30rhT5m4I=', 'Content-Length': '0'} 2024-04-16T17:52:50.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b418d170c25c2396-00661ebaf2-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:50.986 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:50.987 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-13 zones={test-zone2, test-zone1} 2024-04-16T17:52:50.987 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-14 2024-04-16T17:52:50.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:50.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:50.987 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:52:51.050 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:51.051 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:51.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:51.114+0000 7f1655b33800 1 bucket sync caught up with source: 2024-04-16T17:52:51.112 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000010.32.6, , 00000000002.16.11, , 00000000002.8.11, , , , , ] 2024-04-16T17:52:51.112 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000010.32.6, , 00000000002.16.11, , 00000000002.8.11, , , , , ] 2024-04-16T17:52:51.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:51.114+0000 7f1655b33800 0 bucket checkpoint complete 2024-04-16T17:52:51.132 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-14 2024-04-16T17:52:51.132 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:51.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:51.132 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:52:51.195 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:51.195 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:51.258 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:51.260+0000 7f6f4a28c800 1 waiting for incremental sync to catch up: 2024-04-16T17:52:51.258 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.30.11, , 00000000010.55.6, , 00000000002.24.11, , , , , ] 2024-04-16T17:52:51.258 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.30.11, , 00000000010.55.6, , 00000000003.26.10, , , , , ] 2024-04-16T17:52:56.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:56.261+0000 7f6f4a28c800 1 bucket sync caught up with source: 2024-04-16T17:52:56.260 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.30.11, , 00000000010.55.6, , 00000000003.26.10, , , , , ] 2024-04-16T17:52:56.260 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.30.11, , 00000000010.55.6, , 00000000003.26.10, , , , , ] 2024-04-16T17:52:56.260 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:52:56.261+0000 7f6f4a28c800 0 bucket checkpoint complete 2024-04-16T17:52:56.286 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-14 zones={test-zone2, test-zone1} 2024-04-16T17:52:56.286 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.286 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.286 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.286 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:56.286 DEBUG:boto:Data: 2024-04-16T17:52:56.287 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.287 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.287 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.287 DEBUG:boto:Params: {} 2024-04-16T17:52:56.287 DEBUG:boto:Token: None 2024-04-16T17:52:56.287 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY= 2024-04-16T17:52:56.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY=', 'Content-Length': '0'} 2024-04-16T17:52:56.290 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000784a95f0f04dbd2-00661ebaf8-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.290 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.290 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.290 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.291 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:56.291 DEBUG:boto:Data: 2024-04-16T17:52:56.291 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.291 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.291 DEBUG:boto:Params: {} 2024-04-16T17:52:56.291 DEBUG:boto:Token: None 2024-04-16T17:52:56.291 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY= 2024-04-16T17:52:56.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY=', 'Content-Length': '0'} 2024-04-16T17:52:56.294 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000054ff767f4b7cdd23-00661ebaf8-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.294 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:52:56.294 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.294 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.294 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.294 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.294 DEBUG:boto:Method: GET 2024-04-16T17:52:56.294 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.295 DEBUG:boto:Data: 2024-04-16T17:52:56.295 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.295 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.295 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.295 DEBUG:boto:Params: {} 2024-04-16T17:52:56.295 DEBUG:boto:Token: None 2024-04-16T17:52:56.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/?versions 2024-04-16T17:52:56.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg= 2024-04-16T17:52:56.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg=', 'Content-Length': '0'} 2024-04-16T17:52:56.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009edfd7e6f8320c47-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.298 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.298 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:52:56.299 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:52:56.299 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:52:56.299 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:52:56.299 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.299 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.299 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.299 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.299 DEBUG:boto:Method: GET 2024-04-16T17:52:56.299 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.299 DEBUG:boto:Data: 2024-04-16T17:52:56.300 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.300 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.300 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.300 DEBUG:boto:Params: {} 2024-04-16T17:52:56.300 DEBUG:boto:Token: None 2024-04-16T17:52:56.300 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/?versions 2024-04-16T17:52:56.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg= 2024-04-16T17:52:56.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg=', 'Content-Length': '0'} 2024-04-16T17:52:56.302 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6ed443a0a82d3b6-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.303 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.303 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:52:56.303 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:52:56.303 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:52:56.303 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.303 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.303 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.304 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.304 DEBUG:boto:Method: GET 2024-04-16T17:52:56.304 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.304 DEBUG:boto:Data: 2024-04-16T17:52:56.304 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.304 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.304 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.304 DEBUG:boto:Params: {} 2024-04-16T17:52:56.304 DEBUG:boto:Token: None 2024-04-16T17:52:56.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/?versions 2024-04-16T17:52:56.305 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg= 2024-04-16T17:52:56.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg=', 'Content-Length': '0'} 2024-04-16T17:52:56.307 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ebdc2dd7d91e8c81-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.307 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.308 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.308 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.308 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.308 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.308 DEBUG:boto:Method: GET 2024-04-16T17:52:56.308 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:52:56.308 DEBUG:boto:Data: 2024-04-16T17:52:56.308 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.308 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.308 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.309 DEBUG:boto:Params: {} 2024-04-16T17:52:56.309 DEBUG:boto:Token: None 2024-04-16T17:52:56.309 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/?versions 2024-04-16T17:52:56.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg= 2024-04-16T17:52:56.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg=', 'Content-Length': '0'} 2024-04-16T17:52:56.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075cb694723ad8497-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.311 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.312 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:52:56.312 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.312 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.312 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.312 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.312 DEBUG:boto:Method: GET 2024-04-16T17:52:56.312 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.312 DEBUG:boto:Data: 2024-04-16T17:52:56.313 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.313 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.313 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.313 DEBUG:boto:Params: {} 2024-04-16T17:52:56.313 DEBUG:boto:Token: None 2024-04-16T17:52:56.313 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.313 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s= 2024-04-16T17:52:56.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s=', 'Content-Length': '0'} 2024-04-16T17:52:56.315 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c84fa10da671d45b-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.315 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.316 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.316 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.316 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.316 DEBUG:boto:Method: GET 2024-04-16T17:52:56.316 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.316 DEBUG:boto:Data: 2024-04-16T17:52:56.316 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.316 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.316 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.316 DEBUG:boto:Params: {} 2024-04-16T17:52:56.316 DEBUG:boto:Token: None 2024-04-16T17:52:56.317 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.317 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s= 2024-04-16T17:52:56.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s=', 'Content-Length': '0'} 2024-04-16T17:52:56.319 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003f49fa4426742984-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.319 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.319 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.319 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.320 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.320 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.320 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.320 DEBUG:boto:Data: 2024-04-16T17:52:56.320 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.320 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.320 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.320 DEBUG:boto:Params: {} 2024-04-16T17:52:56.320 DEBUG:boto:Token: None 2024-04-16T17:52:56.320 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.321 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gydCCqiaDSbGzlj1xeh4fBhmXXA= 2024-04-16T17:52:56.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gydCCqiaDSbGzlj1xeh4fBhmXXA=', 'Content-Length': '0'} 2024-04-16T17:52:56.323 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000151837c9fd8cd5ad-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.323 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.323 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.323 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.323 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.323 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.323 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.323 DEBUG:boto:Data: 2024-04-16T17:52:56.323 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.324 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.324 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.324 DEBUG:boto:Params: {} 2024-04-16T17:52:56.324 DEBUG:boto:Token: None 2024-04-16T17:52:56.324 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gydCCqiaDSbGzlj1xeh4fBhmXXA= 2024-04-16T17:52:56.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gydCCqiaDSbGzlj1xeh4fBhmXXA=', 'Content-Length': '0'} 2024-04-16T17:52:56.326 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000459a649ea01f7f4e-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.326 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:52:56.327 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.327 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.327 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.327 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.327 DEBUG:boto:Method: GET 2024-04-16T17:52:56.327 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.327 DEBUG:boto:Data: 2024-04-16T17:52:56.327 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.327 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.327 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.327 DEBUG:boto:Params: {} 2024-04-16T17:52:56.328 DEBUG:boto:Token: None 2024-04-16T17:52:56.328 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s= 2024-04-16T17:52:56.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s=', 'Content-Length': '0'} 2024-04-16T17:52:56.330 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005a4b322a9469a2ff-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.330 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.330 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.330 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.331 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.331 DEBUG:boto:Method: GET 2024-04-16T17:52:56.331 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.331 DEBUG:boto:Data: 2024-04-16T17:52:56.331 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.331 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.331 DEBUG:boto:Params: {} 2024-04-16T17:52:56.331 DEBUG:boto:Token: None 2024-04-16T17:52:56.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s= 2024-04-16T17:52:56.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s=', 'Content-Length': '0'} 2024-04-16T17:52:56.334 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000099f43ea7fcac7e05-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.334 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.334 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.334 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.334 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.334 DEBUG:boto:Method: GET 2024-04-16T17:52:56.334 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.334 DEBUG:boto:Data: 2024-04-16T17:52:56.335 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.335 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.335 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.335 DEBUG:boto:Params: {} 2024-04-16T17:52:56.335 DEBUG:boto:Token: None 2024-04-16T17:52:56.335 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5ec128fe3c0dc03-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.378 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.379 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.379 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.379 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.379 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.379 DEBUG:boto:Method: GET 2024-04-16T17:52:56.379 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.379 DEBUG:boto:Data: 2024-04-16T17:52:56.379 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.379 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.379 DEBUG:boto:Params: {} 2024-04-16T17:52:56.380 DEBUG:boto:Token: None 2024-04-16T17:52:56.380 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.382 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e67cc6e67a01177-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.382 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.382 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.383 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.383 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.383 DEBUG:boto:Path: /cjqttm-14/dummy 2024-04-16T17:52:56.383 DEBUG:boto:Data: 2024-04-16T17:52:56.383 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.383 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.383 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.383 DEBUG:boto:Params: {} 2024-04-16T17:52:56.383 DEBUG:boto:Token: None 2024-04-16T17:52:56.383 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy 2024-04-16T17:52:56.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KH5aNAd37oPZFu6EQWzt3fF2ODM= 2024-04-16T17:52:56.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KH5aNAd37oPZFu6EQWzt3fF2ODM=', 'Content-Length': '0'} 2024-04-16T17:52:56.386 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000019727c43f0af1368-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.386 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.386 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.387 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.387 DEBUG:boto:Path: /cjqttm-14/dummy 2024-04-16T17:52:56.387 DEBUG:boto:Data: 2024-04-16T17:52:56.387 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.387 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.387 DEBUG:boto:Params: {} 2024-04-16T17:52:56.387 DEBUG:boto:Token: None 2024-04-16T17:52:56.387 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy 2024-04-16T17:52:56.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KH5aNAd37oPZFu6EQWzt3fF2ODM= 2024-04-16T17:52:56.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KH5aNAd37oPZFu6EQWzt3fF2ODM=', 'Content-Length': '0'} 2024-04-16T17:52:56.390 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000bd7e318d59d88af6-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:52:56.390 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.390 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.390 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.391 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.391 DEBUG:boto:Method: GET 2024-04-16T17:52:56.391 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.391 DEBUG:boto:Data: 2024-04-16T17:52:56.391 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.391 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.391 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.391 DEBUG:boto:Params: {} 2024-04-16T17:52:56.391 DEBUG:boto:Token: None 2024-04-16T17:52:56.391 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s= 2024-04-16T17:52:56.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s=', 'Content-Length': '0'} 2024-04-16T17:52:56.393 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000061b6a6e4b634d805-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.394 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:52:56.394 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:52:56.394 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.394 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.394 DEBUG:boto:Method: GET 2024-04-16T17:52:56.394 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.394 DEBUG:boto:Data: 2024-04-16T17:52:56.394 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.394 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.394 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.395 DEBUG:boto:Params: {} 2024-04-16T17:52:56.395 DEBUG:boto:Token: None 2024-04-16T17:52:56.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:52:56.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s= 2024-04-16T17:52:56.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUfUYQ8Yd40MjuuzrpJJmZJIL6s=', 'Content-Length': '0'} 2024-04-16T17:52:56.397 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b84140b526fc5f27-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.398 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.398 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.398 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.398 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.398 DEBUG:boto:Method: GET 2024-04-16T17:52:56.398 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.398 DEBUG:boto:Data: 2024-04-16T17:52:56.398 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.398 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.398 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.398 DEBUG:boto:Params: {} 2024-04-16T17:52:56.399 DEBUG:boto:Token: None 2024-04-16T17:52:56.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.401 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cfefcd5b516a94ba-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.401 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.402 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.402 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.402 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.402 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.402 DEBUG:boto:Method: GET 2024-04-16T17:52:56.402 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:52:56.402 DEBUG:boto:Data: 2024-04-16T17:52:56.402 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.402 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.403 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.403 DEBUG:boto:Params: {} 2024-04-16T17:52:56.403 DEBUG:boto:Token: None 2024-04-16T17:52:56.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc936a5032075f83-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.405 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.406 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:52:56.406 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.406 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.406 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.406 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.406 DEBUG:boto:Method: GET 2024-04-16T17:52:56.406 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.406 DEBUG:boto:Data: 2024-04-16T17:52:56.406 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.406 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.407 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.407 DEBUG:boto:Params: {} 2024-04-16T17:52:56.407 DEBUG:boto:Token: None 2024-04-16T17:52:56.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I= 2024-04-16T17:52:56.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I=', 'Content-Length': '0'} 2024-04-16T17:52:56.411 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c1b6dab310c827ee-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.411 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.411 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.411 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.411 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.411 DEBUG:boto:Method: GET 2024-04-16T17:52:56.411 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.411 DEBUG:boto:Data: 2024-04-16T17:52:56.412 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.412 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.412 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.412 DEBUG:boto:Params: {} 2024-04-16T17:52:56.412 DEBUG:boto:Token: None 2024-04-16T17:52:56.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I= 2024-04-16T17:52:56.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I=', 'Content-Length': '0'} 2024-04-16T17:52:56.414 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004edae2ffcd6ff57b-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.414 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.414 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.415 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.415 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.415 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.415 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.415 DEBUG:boto:Data: 2024-04-16T17:52:56.415 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.415 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.415 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.415 DEBUG:boto:Params: {} 2024-04-16T17:52:56.415 DEBUG:boto:Token: None 2024-04-16T17:52:56.415 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YOVbZYzhDx9kQ1geZLonoOipkMw= 2024-04-16T17:52:56.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YOVbZYzhDx9kQ1geZLonoOipkMw=', 'Content-Length': '0'} 2024-04-16T17:52:56.418 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c09f8161cd53a0c0-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.418 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.418 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.418 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.418 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.418 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.418 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.418 DEBUG:boto:Data: 2024-04-16T17:52:56.418 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.419 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.419 DEBUG:boto:Params: {} 2024-04-16T17:52:56.419 DEBUG:boto:Token: None 2024-04-16T17:52:56.419 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YOVbZYzhDx9kQ1geZLonoOipkMw= 2024-04-16T17:52:56.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YOVbZYzhDx9kQ1geZLonoOipkMw=', 'Content-Length': '0'} 2024-04-16T17:52:56.421 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000af2c7829e45afb03-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.421 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:52:56.421 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.421 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.421 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.422 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.422 DEBUG:boto:Method: GET 2024-04-16T17:52:56.422 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.422 DEBUG:boto:Data: 2024-04-16T17:52:56.422 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.422 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.422 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.422 DEBUG:boto:Params: {} 2024-04-16T17:52:56.422 DEBUG:boto:Token: None 2024-04-16T17:52:56.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I= 2024-04-16T17:52:56.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I=', 'Content-Length': '0'} 2024-04-16T17:52:56.425 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008c126abd69f42e7f-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.466 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.466 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.467 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.467 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.467 DEBUG:boto:Method: GET 2024-04-16T17:52:56.467 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.467 DEBUG:boto:Data: 2024-04-16T17:52:56.467 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.467 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.467 DEBUG:boto:Params: {} 2024-04-16T17:52:56.467 DEBUG:boto:Token: None 2024-04-16T17:52:56.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I= 2024-04-16T17:52:56.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I=', 'Content-Length': '0'} 2024-04-16T17:52:56.470 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b18c5689a2dc238d-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.470 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.470 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.470 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.470 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.470 DEBUG:boto:Method: GET 2024-04-16T17:52:56.471 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.471 DEBUG:boto:Data: 2024-04-16T17:52:56.471 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.471 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.471 DEBUG:boto:Params: {} 2024-04-16T17:52:56.471 DEBUG:boto:Token: None 2024-04-16T17:52:56.471 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d9f628f9f839441-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.514 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.515 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.515 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.515 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.515 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.515 DEBUG:boto:Method: GET 2024-04-16T17:52:56.515 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.515 DEBUG:boto:Data: 2024-04-16T17:52:56.515 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.515 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.516 DEBUG:boto:Params: {} 2024-04-16T17:52:56.516 DEBUG:boto:Token: None 2024-04-16T17:52:56.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab000b77f3e47547-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.519 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.519 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.519 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.519 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.519 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.519 DEBUG:boto:Data: 2024-04-16T17:52:56.519 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.520 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.520 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.520 DEBUG:boto:Params: {} 2024-04-16T17:52:56.520 DEBUG:boto:Token: None 2024-04-16T17:52:56.520 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GidLbkFokLJLYWwLSX6Xu9rB02w= 2024-04-16T17:52:56.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GidLbkFokLJLYWwLSX6Xu9rB02w=', 'Content-Length': '0'} 2024-04-16T17:52:56.523 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000088f86aa836652499-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.523 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.523 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.523 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.523 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.523 DEBUG:boto:Data: 2024-04-16T17:52:56.523 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.524 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.524 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.524 DEBUG:boto:Params: {} 2024-04-16T17:52:56.524 DEBUG:boto:Token: None 2024-04-16T17:52:56.524 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GidLbkFokLJLYWwLSX6Xu9rB02w= 2024-04-16T17:52:56.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GidLbkFokLJLYWwLSX6Xu9rB02w=', 'Content-Length': '0'} 2024-04-16T17:52:56.527 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007c1001ef8d9fe53a-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:52:56.527 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.527 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.527 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.527 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.527 DEBUG:boto:Method: GET 2024-04-16T17:52:56.528 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.528 DEBUG:boto:Data: 2024-04-16T17:52:56.528 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.528 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.528 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.528 DEBUG:boto:Params: {} 2024-04-16T17:52:56.528 DEBUG:boto:Token: None 2024-04-16T17:52:56.528 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I= 2024-04-16T17:52:56.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I=', 'Content-Length': '0'} 2024-04-16T17:52:56.530 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009fe10078da4a7d83-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.574 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.574 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.575 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.575 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.575 DEBUG:boto:Method: GET 2024-04-16T17:52:56.575 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.575 DEBUG:boto:Data: 2024-04-16T17:52:56.575 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.575 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.575 DEBUG:boto:Params: {} 2024-04-16T17:52:56.575 DEBUG:boto:Token: None 2024-04-16T17:52:56.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:52:56.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I= 2024-04-16T17:52:56.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvkIJqd85Tz583nj/WvA3cTQ+9I=', 'Content-Length': '0'} 2024-04-16T17:52:56.578 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005aa39e29ed3c99b5-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.578 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.578 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.578 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.578 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.579 DEBUG:boto:Method: GET 2024-04-16T17:52:56.579 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.579 DEBUG:boto:Data: 2024-04-16T17:52:56.579 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.579 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.579 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.579 DEBUG:boto:Params: {} 2024-04-16T17:52:56.579 DEBUG:boto:Token: None 2024-04-16T17:52:56.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.582 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e82f9709f80f8730-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.622 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.623 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.623 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.623 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.623 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.623 DEBUG:boto:Method: GET 2024-04-16T17:52:56.623 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:52:56.623 DEBUG:boto:Data: 2024-04-16T17:52:56.623 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.623 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.623 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.624 DEBUG:boto:Params: {} 2024-04-16T17:52:56.624 DEBUG:boto:Token: None 2024-04-16T17:52:56.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000428d17c76ff4ff61-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.626 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:52:56.627 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.627 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.627 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.627 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.627 DEBUG:boto:Method: GET 2024-04-16T17:52:56.627 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.627 DEBUG:boto:Data: 2024-04-16T17:52:56.627 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.627 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.628 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.628 DEBUG:boto:Params: {} 2024-04-16T17:52:56.628 DEBUG:boto:Token: None 2024-04-16T17:52:56.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc= 2024-04-16T17:52:56.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc=', 'Content-Length': '0'} 2024-04-16T17:52:56.630 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000de4ce8b19d51cdf7-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.630 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.631 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.631 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.631 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.631 DEBUG:boto:Method: GET 2024-04-16T17:52:56.631 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.631 DEBUG:boto:Data: 2024-04-16T17:52:56.631 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.631 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.631 DEBUG:boto:Params: {} 2024-04-16T17:52:56.631 DEBUG:boto:Token: None 2024-04-16T17:52:56.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc= 2024-04-16T17:52:56.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc=', 'Content-Length': '0'} 2024-04-16T17:52:56.634 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a942faf633cb27ea-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.674 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.674 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.674 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.675 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.675 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.675 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.675 DEBUG:boto:Data: 2024-04-16T17:52:56.675 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.675 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.675 DEBUG:boto:Params: {} 2024-04-16T17:52:56.675 DEBUG:boto:Token: None 2024-04-16T17:52:56.676 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LAE/p6FxqBbIPZQ3itcMG7LihSk= 2024-04-16T17:52:56.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LAE/p6FxqBbIPZQ3itcMG7LihSk=', 'Content-Length': '0'} 2024-04-16T17:52:56.678 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003e9d2313825fe1a8-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.678 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.678 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.678 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.678 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.678 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.679 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.679 DEBUG:boto:Data: 2024-04-16T17:52:56.679 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.679 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.679 DEBUG:boto:Params: {} 2024-04-16T17:52:56.679 DEBUG:boto:Token: None 2024-04-16T17:52:56.679 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LAE/p6FxqBbIPZQ3itcMG7LihSk= 2024-04-16T17:52:56.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LAE/p6FxqBbIPZQ3itcMG7LihSk=', 'Content-Length': '0'} 2024-04-16T17:52:56.682 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff7046174a562171-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.682 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:52:56.682 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.682 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.682 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.682 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.682 DEBUG:boto:Method: GET 2024-04-16T17:52:56.682 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.683 DEBUG:boto:Data: 2024-04-16T17:52:56.683 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.683 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.683 DEBUG:boto:Params: {} 2024-04-16T17:52:56.683 DEBUG:boto:Token: None 2024-04-16T17:52:56.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc= 2024-04-16T17:52:56.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc=', 'Content-Length': '0'} 2024-04-16T17:52:56.686 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000db34416e9a9a286c-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.686 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.686 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.687 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.687 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.687 DEBUG:boto:Method: GET 2024-04-16T17:52:56.687 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.687 DEBUG:boto:Data: 2024-04-16T17:52:56.687 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.687 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.687 DEBUG:boto:Params: {} 2024-04-16T17:52:56.687 DEBUG:boto:Token: None 2024-04-16T17:52:56.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc= 2024-04-16T17:52:56.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc=', 'Content-Length': '0'} 2024-04-16T17:52:56.690 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f3fbc9b75f0501f1-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.730 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.730 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.731 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.731 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.731 DEBUG:boto:Method: GET 2024-04-16T17:52:56.731 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.731 DEBUG:boto:Data: 2024-04-16T17:52:56.731 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.731 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.731 DEBUG:boto:Params: {} 2024-04-16T17:52:56.731 DEBUG:boto:Token: None 2024-04-16T17:52:56.732 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.734 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbfc204e7b6ce3ea-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.734 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.735 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.735 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.735 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.735 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.735 DEBUG:boto:Method: GET 2024-04-16T17:52:56.735 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.735 DEBUG:boto:Data: 2024-04-16T17:52:56.735 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.736 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.736 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.736 DEBUG:boto:Params: {} 2024-04-16T17:52:56.736 DEBUG:boto:Token: None 2024-04-16T17:52:56.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.739 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ad17088cd20adb3-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.739 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.739 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.739 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.739 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.740 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.740 DEBUG:boto:Data: 2024-04-16T17:52:56.740 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.740 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.740 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.740 DEBUG:boto:Params: {} 2024-04-16T17:52:56.740 DEBUG:boto:Token: None 2024-04-16T17:52:56.740 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qZcLAFS/AF1SCD0oYV0G8hnb3ZM= 2024-04-16T17:52:56.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qZcLAFS/AF1SCD0oYV0G8hnb3ZM=', 'Content-Length': '0'} 2024-04-16T17:52:56.743 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000030441576caaace34-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.743 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.743 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.743 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.743 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.743 DEBUG:boto:Data: 2024-04-16T17:52:56.744 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.744 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.744 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.744 DEBUG:boto:Params: {} 2024-04-16T17:52:56.744 DEBUG:boto:Token: None 2024-04-16T17:52:56.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qZcLAFS/AF1SCD0oYV0G8hnb3ZM= 2024-04-16T17:52:56.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qZcLAFS/AF1SCD0oYV0G8hnb3ZM=', 'Content-Length': '0'} 2024-04-16T17:52:56.747 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d00e1127d6dbd376-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:52:56.747 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.748 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.748 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.748 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.748 DEBUG:boto:Method: GET 2024-04-16T17:52:56.748 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.748 DEBUG:boto:Data: 2024-04-16T17:52:56.748 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.748 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.748 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.748 DEBUG:boto:Params: {} 2024-04-16T17:52:56.749 DEBUG:boto:Token: None 2024-04-16T17:52:56.749 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.749 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc= 2024-04-16T17:52:56.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc=', 'Content-Length': '0'} 2024-04-16T17:52:56.751 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000680385f1de90ff3d-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.794 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.794 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.794 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.795 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.795 DEBUG:boto:Method: GET 2024-04-16T17:52:56.795 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.795 DEBUG:boto:Data: 2024-04-16T17:52:56.795 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.795 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.795 DEBUG:boto:Params: {} 2024-04-16T17:52:56.795 DEBUG:boto:Token: None 2024-04-16T17:52:56.795 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:52:56.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc= 2024-04-16T17:52:56.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M/E0XtWUgVVEuK4h2hSwTigZzgc=', 'Content-Length': '0'} 2024-04-16T17:52:56.798 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c9b0114f65c40ed9-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.842 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.842 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.843 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.843 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.843 DEBUG:boto:Method: GET 2024-04-16T17:52:56.843 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.843 DEBUG:boto:Data: 2024-04-16T17:52:56.843 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.843 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.843 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.843 DEBUG:boto:Params: {} 2024-04-16T17:52:56.843 DEBUG:boto:Token: None 2024-04-16T17:52:56.844 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.846 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027ea07a54b9050ee-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.846 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.847 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.847 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.847 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.847 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.847 DEBUG:boto:Method: GET 2024-04-16T17:52:56.847 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:52:56.847 DEBUG:boto:Data: 2024-04-16T17:52:56.847 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.848 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.848 DEBUG:boto:Params: {} 2024-04-16T17:52:56.848 DEBUG:boto:Token: None 2024-04-16T17:52:56.848 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc= 2024-04-16T17:52:56.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+SryMZ+pxO7HElkomkyWkpLXLGc=', 'Content-Length': '0'} 2024-04-16T17:52:56.850 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021d9d32ac0066fcd-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.850 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.851 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-14 zones={test-zone2, test-zone1} 2024-04-16T17:52:56.851 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:56.851 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:56.851 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.851 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:56.851 DEBUG:boto:Data: 2024-04-16T17:52:56.851 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.851 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.852 DEBUG:boto:Params: {} 2024-04-16T17:52:56.852 DEBUG:boto:Token: None 2024-04-16T17:52:56.852 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-13/ 2024-04-16T17:52:56.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4fBj54bNSQG7F3zfL7JVPFXWcYA= 2024-04-16T17:52:56.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4fBj54bNSQG7F3zfL7JVPFXWcYA=', 'Content-Length': '0'} 2024-04-16T17:52:56.854 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000df4cb46c4c832266-00661ebaf8-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.854 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:56.855 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:56.855 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-16T17:52:56.855 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-16T17:52:56.855 DEBUG:boto:Method: GET 2024-04-16T17:52:56.855 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-16T17:52:56.855 DEBUG:boto:Data: 2024-04-16T17:52:56.855 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.855 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.855 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.855 DEBUG:boto:Params: {} 2024-04-16T17:52:56.856 DEBUG:boto:Token: None 2024-04-16T17:52:56.856 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-13/?versions 2024-04-16T17:52:56.856 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wEyX2HG/7pGEpuelNNePYbn/sJU= 2024-04-16T17:52:56.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wEyX2HG/7pGEpuelNNePYbn/sJU=', 'Content-Length': '0'} 2024-04-16T17:52:56.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9d4e34a27db9ed7-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.858 DEBUG:boto:b'cjqttm-13obj-test-zone1999falseobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.859 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:56.859 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:52:56.859 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?acl 2024-04-16T17:52:56.859 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?acl 2024-04-16T17:52:56.859 DEBUG:boto:Method: PUT 2024-04-16T17:52:56.859 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?acl 2024-04-16T17:52:56.859 DEBUG:boto:Data: 2024-04-16T17:52:56.859 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-16T17:52:56.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.859 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.859 DEBUG:boto:Params: {} 2024-04-16T17:52:56.860 DEBUG:boto:Token: None 2024-04-16T17:52:56.860 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:56 GMT x-amz-acl:public-read /cjqttm-13/obj-test-zone1?acl 2024-04-16T17:52:56.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KzyTtg3BBNLmB2LhvQ8O8O6Dw+Q= 2024-04-16T17:52:56.860 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KzyTtg3BBNLmB2LhvQ8O8O6Dw+Q=', 'Content-Length': '0'} 2024-04-16T17:52:56.865 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c08cb63029ea8fde-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.866 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:56.866 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:56.866 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.866 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:52:56.866 DEBUG:boto:Data: 2024-04-16T17:52:56.866 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.866 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.866 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.866 DEBUG:boto:Params: {} 2024-04-16T17:52:56.866 DEBUG:boto:Token: None 2024-04-16T17:52:56.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-13/ 2024-04-16T17:52:56.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4fBj54bNSQG7F3zfL7JVPFXWcYA= 2024-04-16T17:52:56.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4fBj54bNSQG7F3zfL7JVPFXWcYA=', 'Content-Length': '0'} 2024-04-16T17:52:56.869 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d58490448e3df8e-00661ebaf8-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.869 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:52:56.869 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:52:56.869 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-16T17:52:56.869 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-16T17:52:56.869 DEBUG:boto:Method: GET 2024-04-16T17:52:56.870 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-16T17:52:56.870 DEBUG:boto:Data: 2024-04-16T17:52:56.870 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.870 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.870 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.870 DEBUG:boto:Params: {} 2024-04-16T17:52:56.870 DEBUG:boto:Token: None 2024-04-16T17:52:56.870 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-13/?versions 2024-04-16T17:52:56.870 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wEyX2HG/7pGEpuelNNePYbn/sJU= 2024-04-16T17:52:56.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wEyX2HG/7pGEpuelNNePYbn/sJU=', 'Content-Length': '0'} 2024-04-16T17:52:56.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c48b131d7afef91e-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.873 DEBUG:boto:b'cjqttm-13obj-test-zone2999falseobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.873 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:56.873 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:52:56.873 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?acl 2024-04-16T17:52:56.873 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?acl 2024-04-16T17:52:56.874 DEBUG:boto:Method: PUT 2024-04-16T17:52:56.874 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?acl 2024-04-16T17:52:56.874 DEBUG:boto:Data: 2024-04-16T17:52:56.874 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-16T17:52:56.874 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.874 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.874 DEBUG:boto:Params: {} 2024-04-16T17:52:56.874 DEBUG:boto:Token: None 2024-04-16T17:52:56.874 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:56 GMT x-amz-acl:public-read /cjqttm-13/obj-test-zone2?acl 2024-04-16T17:52:56.874 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kEz4HvKv+sBWY5i9fA7eMtZ6Gd4= 2024-04-16T17:52:56.875 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kEz4HvKv+sBWY5i9fA7eMtZ6Gd4=', 'Content-Length': '0'} 2024-04-16T17:52:56.881 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002e7b8d97292be59f-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.881 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.881 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.881 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.881 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:56.881 DEBUG:boto:Data: 2024-04-16T17:52:56.882 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.882 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.882 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.882 DEBUG:boto:Params: {} 2024-04-16T17:52:56.882 DEBUG:boto:Token: None 2024-04-16T17:52:56.882 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.882 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY= 2024-04-16T17:52:56.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY=', 'Content-Length': '0'} 2024-04-16T17:52:56.884 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ac612cd00e082221-00661ebaf8-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.885 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.885 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.885 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-16T17:52:56.885 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-16T17:52:56.885 DEBUG:boto:Method: GET 2024-04-16T17:52:56.885 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999&prefix=obj-test-zone1 2024-04-16T17:52:56.885 DEBUG:boto:Data: 2024-04-16T17:52:56.885 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.885 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.886 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.886 DEBUG:boto:Params: {} 2024-04-16T17:52:56.886 DEBUG:boto:Token: None 2024-04-16T17:52:56.886 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/?versions 2024-04-16T17:52:56.886 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg= 2024-04-16T17:52:56.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg=', 'Content-Length': '0'} 2024-04-16T17:52:56.888 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f280ff0a1bcfa1c5-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.930 DEBUG:boto:b'cjqttm-14obj-test-zone1999falseobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.931 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.931 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:52:56.931 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?acl 2024-04-16T17:52:56.931 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?acl 2024-04-16T17:52:56.931 DEBUG:boto:Method: PUT 2024-04-16T17:52:56.931 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?acl 2024-04-16T17:52:56.931 DEBUG:boto:Data: 2024-04-16T17:52:56.931 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-16T17:52:56.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:52:56.931 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.931 DEBUG:boto:Params: {} 2024-04-16T17:52:56.932 DEBUG:boto:Token: None 2024-04-16T17:52:56.932 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:56 GMT x-amz-acl:public-read /cjqttm-14/obj-test-zone1?acl 2024-04-16T17:52:56.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QP3/5vZByrO6KOS3mT986FcrF/w= 2024-04-16T17:52:56.932 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QP3/5vZByrO6KOS3mT986FcrF/w=', 'Content-Length': '0'} 2024-04-16T17:52:56.937 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000febde6714fd488be-00661ebaf8-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.938 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.938 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.938 DEBUG:boto:Method: HEAD 2024-04-16T17:52:56.938 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:52:56.938 DEBUG:boto:Data: 2024-04-16T17:52:56.938 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.938 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.938 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.938 DEBUG:boto:Params: {} 2024-04-16T17:52:56.938 DEBUG:boto:Token: None 2024-04-16T17:52:56.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/ 2024-04-16T17:52:56.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY= 2024-04-16T17:52:56.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/fpstcp1z4l4Jg+gsdnmIAr2FsY=', 'Content-Length': '0'} 2024-04-16T17:52:56.941 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007fc35dc36775f04e-00661ebaf8-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.941 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:52:56.941 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:52:56.941 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-16T17:52:56.942 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-16T17:52:56.942 DEBUG:boto:Method: GET 2024-04-16T17:52:56.942 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999&prefix=obj-test-zone2 2024-04-16T17:52:56.942 DEBUG:boto:Data: 2024-04-16T17:52:56.942 DEBUG:boto:Headers: {} 2024-04-16T17:52:56.942 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.942 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.942 DEBUG:boto:Params: {} 2024-04-16T17:52:56.942 DEBUG:boto:Token: None 2024-04-16T17:52:56.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:52:56 GMT /cjqttm-14/?versions 2024-04-16T17:52:56.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg= 2024-04-16T17:52:56.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIWvM8EuQMDWs/KKM0Tpq8HT5Pg=', 'Content-Length': '0'} 2024-04-16T17:52:56.945 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1214ec6fef40186-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.945 DEBUG:boto:b'cjqttm-14obj-test-zone2999falseobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:52:56.945 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.945 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:52:56.945 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?acl 2024-04-16T17:52:56.946 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?acl 2024-04-16T17:52:56.946 DEBUG:boto:Method: PUT 2024-04-16T17:52:56.946 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?acl 2024-04-16T17:52:56.946 DEBUG:boto:Data: 2024-04-16T17:52:56.946 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-16T17:52:56.946 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:52:56.946 DEBUG:boto:Port: 8000 2024-04-16T17:52:56.946 DEBUG:boto:Params: {} 2024-04-16T17:52:56.946 DEBUG:boto:Token: None 2024-04-16T17:52:56.946 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:52:56 GMT x-amz-acl:public-read /cjqttm-14/obj-test-zone2?acl 2024-04-16T17:52:56.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vUnaPdXOQuLoYa0pJbh3R5GkrMI= 2024-04-16T17:52:56.947 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:52:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vUnaPdXOQuLoYa0pJbh3R5GkrMI=', 'Content-Length': '0'} 2024-04-16T17:52:56.952 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000048d53631285e0e77-00661ebaf8-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:52:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:52:56.952 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-13 2024-04-16T17:52:56.952 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:56.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:52:56.953 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-13 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:52:57.014 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:52:57.014 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:52:57.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:52:57.076+0000 7f2e8032a800 1 waiting for incremental sync to catch up: 2024-04-16T17:52:57.074 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000010.22.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:52:57.074 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000011.25.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:53:02.075 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:02.076+0000 7f2e8032a800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:02.076 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000010.22.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:53:02.076 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000011.25.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:53:07.077 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:07.078+0000 7f2e8032a800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:07.077 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000010.22.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:53:07.077 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000011.25.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:53:12.078 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:12.079+0000 7f2e8032a800 1 bucket sync caught up with source: 2024-04-16T17:53:12.078 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000011.25.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:53:12.079 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000011.25.6, , 00000000002.27.11, , 00000000003.14.10, , , , , ] 2024-04-16T17:53:12.079 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:12.079+0000 7f2e8032a800 0 bucket checkpoint complete 2024-04-16T17:53:12.103 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-13 2024-04-16T17:53:12.103 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:12.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-13', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:12.104 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-13 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:53:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:12.231 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:12.232+0000 7f3463015800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:12.231 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:12.231 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:17.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:17.233+0000 7f3463015800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:17.235 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:17.235 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:22.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:22.236+0000 7f3463015800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:22.235 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:22.235 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:27.235 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:27.237+0000 7f3463015800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:27.236 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:27.236 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:32.238+0000 7f3463015800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:32.237 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:32.237 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:37.238 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:37.239+0000 7f3463015800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:37.238 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:37.239 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:42.239 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:42.241+0000 7f3463015800 1 waiting for incremental sync to catch up: 2024-04-16T17:53:42.240 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000010.72.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:42.240 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:47.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:47.242+0000 7f3463015800 1 bucket sync caught up with source: 2024-04-16T17:53:47.241 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:47.241 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.37.11, , 00000000011.75.6, , 00000000002.27.11, , , , , ] 2024-04-16T17:53:47.241 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:47.242+0000 7f3463015800 0 bucket checkpoint complete 2024-04-16T17:53:47.267 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-13 zones={test-zone2, test-zone1} 2024-04-16T17:53:47.267 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.267 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.267 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.267 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:53:47.267 DEBUG:boto:Data: 2024-04-16T17:53:47.268 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.268 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.268 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.268 DEBUG:boto:Params: {} 2024-04-16T17:53:47.268 DEBUG:boto:Token: None 2024-04-16T17:53:47.268 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.269 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WBRmp08MbrxtSYQ/Dd4oV7cefFM= 2024-04-16T17:53:47.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WBRmp08MbrxtSYQ/Dd4oV7cefFM=', 'Content-Length': '0'} 2024-04-16T17:53:47.272 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b3f649f70d0d8c2e-00661ebb2b-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.272 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.272 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.272 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.272 DEBUG:boto:Path: /cjqttm-13/ 2024-04-16T17:53:47.272 DEBUG:boto:Data: 2024-04-16T17:53:47.272 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.273 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.273 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.273 DEBUG:boto:Params: {} 2024-04-16T17:53:47.273 DEBUG:boto:Token: None 2024-04-16T17:53:47.273 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.273 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WBRmp08MbrxtSYQ/Dd4oV7cefFM= 2024-04-16T17:53:47.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WBRmp08MbrxtSYQ/Dd4oV7cefFM=', 'Content-Length': '0'} 2024-04-16T17:53:47.276 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000761e9e26cfc96dad-00661ebb2b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.276 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:53:47.276 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.276 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.276 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.276 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.276 DEBUG:boto:Method: GET 2024-04-16T17:53:47.277 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.277 DEBUG:boto:Data: 2024-04-16T17:53:47.277 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.277 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.277 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.277 DEBUG:boto:Params: {} 2024-04-16T17:53:47.277 DEBUG:boto:Token: None 2024-04-16T17:53:47.277 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/?versions 2024-04-16T17:53:47.277 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4= 2024-04-16T17:53:47.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4=', 'Content-Length': '0'} 2024-04-16T17:53:47.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab67c6e826caf411-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.280 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.281 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:53:47.281 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:53:47.281 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:53:47.281 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:53:47.281 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.281 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.282 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.282 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.282 DEBUG:boto:Method: GET 2024-04-16T17:53:47.282 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.282 DEBUG:boto:Data: 2024-04-16T17:53:47.282 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.282 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.282 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.282 DEBUG:boto:Params: {} 2024-04-16T17:53:47.282 DEBUG:boto:Token: None 2024-04-16T17:53:47.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/?versions 2024-04-16T17:53:47.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4= 2024-04-16T17:53:47.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4=', 'Content-Length': '0'} 2024-04-16T17:53:47.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbcf47a1fb95fc5f-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.285 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.286 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:53:47.286 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:53:47.286 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:53:47.286 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.286 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.286 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.286 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.286 DEBUG:boto:Method: GET 2024-04-16T17:53:47.286 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.287 DEBUG:boto:Data: 2024-04-16T17:53:47.287 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.287 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.287 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.287 DEBUG:boto:Params: {} 2024-04-16T17:53:47.287 DEBUG:boto:Token: None 2024-04-16T17:53:47.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/?versions 2024-04-16T17:53:47.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4= 2024-04-16T17:53:47.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4=', 'Content-Length': '0'} 2024-04-16T17:53:47.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8a73d34f4ac9aea-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.330 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.331 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.331 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.331 DEBUG:boto:path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.331 DEBUG:boto:auth_path=/cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.331 DEBUG:boto:Method: GET 2024-04-16T17:53:47.331 DEBUG:boto:Path: /cjqttm-13/?versions&max-keys=999 2024-04-16T17:53:47.331 DEBUG:boto:Data: 2024-04-16T17:53:47.331 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.332 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.332 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.332 DEBUG:boto:Params: {} 2024-04-16T17:53:47.332 DEBUG:boto:Token: None 2024-04-16T17:53:47.332 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/?versions 2024-04-16T17:53:47.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4= 2024-04-16T17:53:47.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMzJNAjMm2dnDxcab1MtqJ9D/k4=', 'Content-Length': '0'} 2024-04-16T17:53:47.334 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004983ffea4c1e09a4-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.335 DEBUG:boto:b'cjqttm-13999falsedummy8jjKta9P7Ah26MvQouyqIJN0o6syfd.true2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1HSJh4Behr8H1kT28M.SwZFU1q92gRjstrue2024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.true2024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.335 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:53:47.335 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.335 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.335 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.335 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.335 DEBUG:boto:Method: GET 2024-04-16T17:53:47.336 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.336 DEBUG:boto:Data: 2024-04-16T17:53:47.336 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.336 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.336 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.336 DEBUG:boto:Params: {} 2024-04-16T17:53:47.336 DEBUG:boto:Token: None 2024-04-16T17:53:47.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM= 2024-04-16T17:53:47.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM=', 'Content-Length': '0'} 2024-04-16T17:53:47.338 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000079c96bc84662869f-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.339 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.339 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.339 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.339 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.339 DEBUG:boto:Method: GET 2024-04-16T17:53:47.339 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.339 DEBUG:boto:Data: 2024-04-16T17:53:47.339 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.339 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.339 DEBUG:boto:Params: {} 2024-04-16T17:53:47.340 DEBUG:boto:Token: None 2024-04-16T17:53:47.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM= 2024-04-16T17:53:47.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM=', 'Content-Length': '0'} 2024-04-16T17:53:47.342 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009a23e21c6b165b63-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.342 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.342 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.342 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.342 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.342 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.342 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.342 DEBUG:boto:Data: 2024-04-16T17:53:47.343 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.343 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.343 DEBUG:boto:Params: {} 2024-04-16T17:53:47.343 DEBUG:boto:Token: None 2024-04-16T17:53:47.343 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZFJvihLUW8fXO67ajnE+j2gSlrE= 2024-04-16T17:53:47.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZFJvihLUW8fXO67ajnE+j2gSlrE=', 'Content-Length': '0'} 2024-04-16T17:53:47.345 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fbac989291fb27c8-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.345 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.345 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.345 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.346 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.346 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.346 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.346 DEBUG:boto:Data: 2024-04-16T17:53:47.346 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.346 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.346 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.346 DEBUG:boto:Params: {} 2024-04-16T17:53:47.346 DEBUG:boto:Token: None 2024-04-16T17:53:47.346 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZFJvihLUW8fXO67ajnE+j2gSlrE= 2024-04-16T17:53:47.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZFJvihLUW8fXO67ajnE+j2gSlrE=', 'Content-Length': '0'} 2024-04-16T17:53:47.348 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f7ecf6e96cdcac70-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:53:47.349 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.349 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.349 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.349 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.349 DEBUG:boto:Method: GET 2024-04-16T17:53:47.349 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.349 DEBUG:boto:Data: 2024-04-16T17:53:47.349 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.349 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.350 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.350 DEBUG:boto:Params: {} 2024-04-16T17:53:47.350 DEBUG:boto:Token: None 2024-04-16T17:53:47.350 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM= 2024-04-16T17:53:47.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM=', 'Content-Length': '0'} 2024-04-16T17:53:47.352 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007da42e0fd50949be-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.352 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.352 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.352 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.352 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.353 DEBUG:boto:Method: GET 2024-04-16T17:53:47.353 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.353 DEBUG:boto:Data: 2024-04-16T17:53:47.353 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.353 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.353 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.353 DEBUG:boto:Params: {} 2024-04-16T17:53:47.353 DEBUG:boto:Token: None 2024-04-16T17:53:47.353 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.354 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM= 2024-04-16T17:53:47.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM=', 'Content-Length': '0'} 2024-04-16T17:53:47.356 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009af003f99b6c7ebc-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.356 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.356 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.356 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.356 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.356 DEBUG:boto:Method: GET 2024-04-16T17:53:47.357 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.357 DEBUG:boto:Data: 2024-04-16T17:53:47.357 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.357 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.357 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.357 DEBUG:boto:Params: {} 2024-04-16T17:53:47.357 DEBUG:boto:Token: None 2024-04-16T17:53:47.357 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.357 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.360 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f523f91dc4e42a42-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.360 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.360 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.360 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.360 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.361 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.361 DEBUG:boto:Method: GET 2024-04-16T17:53:47.361 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.361 DEBUG:boto:Data: 2024-04-16T17:53:47.361 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.361 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.361 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.361 DEBUG:boto:Params: {} 2024-04-16T17:53:47.361 DEBUG:boto:Token: None 2024-04-16T17:53:47.361 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.362 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.364 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059c056e85e137b5d-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.406 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.406 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.407 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.407 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.407 DEBUG:boto:Path: /cjqttm-13/dummy 2024-04-16T17:53:47.407 DEBUG:boto:Data: 2024-04-16T17:53:47.407 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.407 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.407 DEBUG:boto:Params: {} 2024-04-16T17:53:47.407 DEBUG:boto:Token: None 2024-04-16T17:53:47.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy 2024-04-16T17:53:47.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OuTYfKur6KwZtp5dtjlC95BLowE= 2024-04-16T17:53:47.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OuTYfKur6KwZtp5dtjlC95BLowE=', 'Content-Length': '0'} 2024-04-16T17:53:47.410 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e5c8eb9f3caa36cb-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.410 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.410 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.411 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.411 DEBUG:boto:Path: /cjqttm-13/dummy 2024-04-16T17:53:47.411 DEBUG:boto:Data: 2024-04-16T17:53:47.411 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.411 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.411 DEBUG:boto:Params: {} 2024-04-16T17:53:47.411 DEBUG:boto:Token: None 2024-04-16T17:53:47.411 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy 2024-04-16T17:53:47.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OuTYfKur6KwZtp5dtjlC95BLowE= 2024-04-16T17:53:47.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OuTYfKur6KwZtp5dtjlC95BLowE=', 'Content-Length': '0'} 2024-04-16T17:53:47.414 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a07b036fd653be87-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:53:47.414 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.414 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.415 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.415 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.415 DEBUG:boto:Method: GET 2024-04-16T17:53:47.415 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.415 DEBUG:boto:Data: 2024-04-16T17:53:47.415 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.415 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.415 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.415 DEBUG:boto:Params: {} 2024-04-16T17:53:47.415 DEBUG:boto:Token: None 2024-04-16T17:53:47.416 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM= 2024-04-16T17:53:47.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM=', 'Content-Length': '0'} 2024-04-16T17:53:47.417 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:31 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c61da5c3f068925c-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.418 DEBUG:boto:path=/cjqttm-13/dummy 2024-04-16T17:53:47.418 DEBUG:boto:auth_path=/cjqttm-13/dummy 2024-04-16T17:53:47.418 DEBUG:boto:path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.418 DEBUG:boto:auth_path=/cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.418 DEBUG:boto:Method: GET 2024-04-16T17:53:47.418 DEBUG:boto:Path: /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.418 DEBUG:boto:Data: 2024-04-16T17:53:47.419 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.419 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.419 DEBUG:boto:Params: {} 2024-04-16T17:53:47.419 DEBUG:boto:Token: None 2024-04-16T17:53:47.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/dummy?versionId=8jjKta9P7Ah26MvQouyqIJN0o6syfd. 2024-04-16T17:53:47.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM= 2024-04-16T17:53:47.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4grepBCyljaNdabcHACOetUGHrM=', 'Content-Length': '0'} 2024-04-16T17:53:47.421 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:29 GMT'), ('x-amz-version-id', '8jjKta9P7Ah26MvQouyqIJN0o6syfd.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000093160dd9cd78f16e-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.421 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.421 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.422 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.422 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.422 DEBUG:boto:Method: GET 2024-04-16T17:53:47.422 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.422 DEBUG:boto:Data: 2024-04-16T17:53:47.422 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.422 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.422 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.422 DEBUG:boto:Params: {} 2024-04-16T17:53:47.422 DEBUG:boto:Token: None 2024-04-16T17:53:47.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a96fe5e13cfd5106-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.425 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.425 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.426 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.426 DEBUG:boto:path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.426 DEBUG:boto:auth_path=/cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.426 DEBUG:boto:Method: GET 2024-04-16T17:53:47.426 DEBUG:boto:Path: /cjqttm-13/?prefix=dummy 2024-04-16T17:53:47.426 DEBUG:boto:Data: 2024-04-16T17:53:47.426 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.426 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.426 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.426 DEBUG:boto:Params: {} 2024-04-16T17:53:47.426 DEBUG:boto:Token: None 2024-04-16T17:53:47.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.427 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.429 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000449fae010c341c46-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.429 DEBUG:boto:b'cjqttm-13dummy1000falsedummy2024-04-16T17:52:29.312Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.430 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:53:47.430 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.430 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.430 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.430 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.430 DEBUG:boto:Method: GET 2024-04-16T17:53:47.430 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.430 DEBUG:boto:Data: 2024-04-16T17:53:47.430 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.430 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.431 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.431 DEBUG:boto:Params: {} 2024-04-16T17:53:47.431 DEBUG:boto:Token: None 2024-04-16T17:53:47.431 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.431 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk= 2024-04-16T17:53:47.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk=', 'Content-Length': '0'} 2024-04-16T17:53:47.433 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e01b3691b4cdf291-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.474 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.474 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.474 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.475 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.475 DEBUG:boto:Method: GET 2024-04-16T17:53:47.475 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.475 DEBUG:boto:Data: 2024-04-16T17:53:47.475 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.475 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.475 DEBUG:boto:Params: {} 2024-04-16T17:53:47.475 DEBUG:boto:Token: None 2024-04-16T17:53:47.475 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk= 2024-04-16T17:53:47.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk=', 'Content-Length': '0'} 2024-04-16T17:53:47.478 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000064cff5218e8eafd5-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.478 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.479 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.479 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.479 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.479 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.479 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.479 DEBUG:boto:Data: 2024-04-16T17:53:47.479 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.479 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.479 DEBUG:boto:Params: {} 2024-04-16T17:53:47.480 DEBUG:boto:Token: None 2024-04-16T17:53:47.480 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ISLuJDXYz9Jdyv222vcTNZDATWM= 2024-04-16T17:53:47.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ISLuJDXYz9Jdyv222vcTNZDATWM=', 'Content-Length': '0'} 2024-04-16T17:53:47.482 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000077459f3a9a9cb8fe-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.482 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.482 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.482 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.482 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.483 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.483 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.483 DEBUG:boto:Data: 2024-04-16T17:53:47.483 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.483 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.483 DEBUG:boto:Params: {} 2024-04-16T17:53:47.483 DEBUG:boto:Token: None 2024-04-16T17:53:47.483 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ISLuJDXYz9Jdyv222vcTNZDATWM= 2024-04-16T17:53:47.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ISLuJDXYz9Jdyv222vcTNZDATWM=', 'Content-Length': '0'} 2024-04-16T17:53:47.486 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000084c9921708085365-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.486 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:53:47.486 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.486 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.486 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.487 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.487 DEBUG:boto:Method: GET 2024-04-16T17:53:47.487 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.487 DEBUG:boto:Data: 2024-04-16T17:53:47.487 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.487 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.487 DEBUG:boto:Params: {} 2024-04-16T17:53:47.488 DEBUG:boto:Token: None 2024-04-16T17:53:47.488 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk= 2024-04-16T17:53:47.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk=', 'Content-Length': '0'} 2024-04-16T17:53:47.490 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c206df691a52a6dc-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.530 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.530 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.531 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.531 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.531 DEBUG:boto:Method: GET 2024-04-16T17:53:47.531 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.531 DEBUG:boto:Data: 2024-04-16T17:53:47.531 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.531 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.531 DEBUG:boto:Params: {} 2024-04-16T17:53:47.531 DEBUG:boto:Token: None 2024-04-16T17:53:47.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk= 2024-04-16T17:53:47.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk=', 'Content-Length': '0'} 2024-04-16T17:53:47.534 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000308afe22a839d28f-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.534 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.534 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.534 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.534 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.535 DEBUG:boto:Method: GET 2024-04-16T17:53:47.535 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.535 DEBUG:boto:Data: 2024-04-16T17:53:47.535 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.535 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.535 DEBUG:boto:Params: {} 2024-04-16T17:53:47.535 DEBUG:boto:Token: None 2024-04-16T17:53:47.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc8b06b7c4a339d6-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.538 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.538 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.538 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.539 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.539 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.539 DEBUG:boto:Method: GET 2024-04-16T17:53:47.539 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.539 DEBUG:boto:Data: 2024-04-16T17:53:47.539 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.539 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.539 DEBUG:boto:Params: {} 2024-04-16T17:53:47.539 DEBUG:boto:Token: None 2024-04-16T17:53:47.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000456d0b9adea9c0-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.542 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.543 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.543 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.543 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.543 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.543 DEBUG:boto:Data: 2024-04-16T17:53:47.543 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.543 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.543 DEBUG:boto:Params: {} 2024-04-16T17:53:47.544 DEBUG:boto:Token: None 2024-04-16T17:53:47.544 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vfwVPv45hzsasheaksgXwQ26Di0= 2024-04-16T17:53:47.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vfwVPv45hzsasheaksgXwQ26Di0=', 'Content-Length': '0'} 2024-04-16T17:53:47.547 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008615e42bf618cdcc-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.547 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.547 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.547 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.547 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.547 DEBUG:boto:Data: 2024-04-16T17:53:47.547 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.548 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.548 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.548 DEBUG:boto:Params: {} 2024-04-16T17:53:47.548 DEBUG:boto:Token: None 2024-04-16T17:53:47.548 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vfwVPv45hzsasheaksgXwQ26Di0= 2024-04-16T17:53:47.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vfwVPv45hzsasheaksgXwQ26Di0=', 'Content-Length': '0'} 2024-04-16T17:53:47.551 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b28e30b3e008f45f-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.551 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:53:47.551 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.551 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.551 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.551 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.551 DEBUG:boto:Method: GET 2024-04-16T17:53:47.551 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.551 DEBUG:boto:Data: 2024-04-16T17:53:47.552 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.552 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.552 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.552 DEBUG:boto:Params: {} 2024-04-16T17:53:47.552 DEBUG:boto:Token: None 2024-04-16T17:53:47.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk= 2024-04-16T17:53:47.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk=', 'Content-Length': '0'} 2024-04-16T17:53:47.554 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000093f85fd15ed64a61-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.598 DEBUG:boto:path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.599 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1 2024-04-16T17:53:47.599 DEBUG:boto:path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.599 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.599 DEBUG:boto:Method: GET 2024-04-16T17:53:47.599 DEBUG:boto:Path: /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.599 DEBUG:boto:Data: 2024-04-16T17:53:47.599 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.599 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.599 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.599 DEBUG:boto:Params: {} 2024-04-16T17:53:47.599 DEBUG:boto:Token: None 2024-04-16T17:53:47.600 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone1?versionId=HSJh4Behr8H1kT28M.SwZFU1q92gRjs 2024-04-16T17:53:47.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk= 2024-04-16T17:53:47.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VfMwqHMtlnLwkMgiJDhKCKPzTDk=', 'Content-Length': '0'} 2024-04-16T17:53:47.602 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'HSJh4Behr8H1kT28M.SwZFU1q92gRjs'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c385896bd9ef149d-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.602 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.602 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.602 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.603 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.603 DEBUG:boto:Method: GET 2024-04-16T17:53:47.603 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.603 DEBUG:boto:Data: 2024-04-16T17:53:47.603 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.603 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.603 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.603 DEBUG:boto:Params: {} 2024-04-16T17:53:47.603 DEBUG:boto:Token: None 2024-04-16T17:53:47.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.606 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee5eb5a9de5a47c8-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.646 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.647 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.647 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.647 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.647 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.647 DEBUG:boto:Method: GET 2024-04-16T17:53:47.647 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone1 2024-04-16T17:53:47.647 DEBUG:boto:Data: 2024-04-16T17:53:47.647 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.647 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.647 DEBUG:boto:Params: {} 2024-04-16T17:53:47.648 DEBUG:boto:Token: None 2024-04-16T17:53:47.648 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a646ee745c890146-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.651 DEBUG:boto:b'cjqttm-13obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.642Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.651 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:53:47.651 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.651 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.651 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.651 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.651 DEBUG:boto:Method: GET 2024-04-16T17:53:47.652 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.652 DEBUG:boto:Data: 2024-04-16T17:53:47.652 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.652 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.652 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.652 DEBUG:boto:Params: {} 2024-04-16T17:53:47.652 DEBUG:boto:Token: None 2024-04-16T17:53:47.652 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk= 2024-04-16T17:53:47.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk=', 'Content-Length': '0'} 2024-04-16T17:53:47.655 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006619f7c54d4d1eea-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.655 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.655 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.655 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.655 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.656 DEBUG:boto:Method: GET 2024-04-16T17:53:47.656 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.656 DEBUG:boto:Data: 2024-04-16T17:53:47.656 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.656 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.656 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.656 DEBUG:boto:Params: {} 2024-04-16T17:53:47.656 DEBUG:boto:Token: None 2024-04-16T17:53:47.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk= 2024-04-16T17:53:47.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk=', 'Content-Length': '0'} 2024-04-16T17:53:47.659 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009459a20cbfd7e278-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.659 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.659 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.659 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.659 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.659 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.659 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.659 DEBUG:boto:Data: 2024-04-16T17:53:47.660 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.660 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.660 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.660 DEBUG:boto:Params: {} 2024-04-16T17:53:47.660 DEBUG:boto:Token: None 2024-04-16T17:53:47.660 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4VFsOtaheuNVngiTI7s9RVqSyNo= 2024-04-16T17:53:47.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4VFsOtaheuNVngiTI7s9RVqSyNo=', 'Content-Length': '0'} 2024-04-16T17:53:47.662 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000040fe212a546f5d66-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.663 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.663 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.663 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.663 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.663 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.663 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.663 DEBUG:boto:Data: 2024-04-16T17:53:47.663 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.664 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.664 DEBUG:boto:Params: {} 2024-04-16T17:53:47.664 DEBUG:boto:Token: None 2024-04-16T17:53:47.664 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4VFsOtaheuNVngiTI7s9RVqSyNo= 2024-04-16T17:53:47.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4VFsOtaheuNVngiTI7s9RVqSyNo=', 'Content-Length': '0'} 2024-04-16T17:53:47.666 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000717e2ab6de55ba8e-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:53:47.667 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.667 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.667 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.667 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.667 DEBUG:boto:Method: GET 2024-04-16T17:53:47.667 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.667 DEBUG:boto:Data: 2024-04-16T17:53:47.667 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.667 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.667 DEBUG:boto:Params: {} 2024-04-16T17:53:47.668 DEBUG:boto:Token: None 2024-04-16T17:53:47.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk= 2024-04-16T17:53:47.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk=', 'Content-Length': '0'} 2024-04-16T17:53:47.670 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d1e50f4be30db7c1-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.710 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.710 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.711 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.711 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.711 DEBUG:boto:Method: GET 2024-04-16T17:53:47.711 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.711 DEBUG:boto:Data: 2024-04-16T17:53:47.711 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.711 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.711 DEBUG:boto:Params: {} 2024-04-16T17:53:47.711 DEBUG:boto:Token: None 2024-04-16T17:53:47.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk= 2024-04-16T17:53:47.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk=', 'Content-Length': '0'} 2024-04-16T17:53:47.714 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f9514f61ad23ea33-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.754 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.754 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.755 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.755 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.755 DEBUG:boto:Method: GET 2024-04-16T17:53:47.755 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.755 DEBUG:boto:Data: 2024-04-16T17:53:47.755 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.755 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.755 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.755 DEBUG:boto:Params: {} 2024-04-16T17:53:47.755 DEBUG:boto:Token: None 2024-04-16T17:53:47.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f33d1d9195cfcc31-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.758 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.758 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.758 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.758 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.759 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.759 DEBUG:boto:Method: GET 2024-04-16T17:53:47.759 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.759 DEBUG:boto:Data: 2024-04-16T17:53:47.759 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.759 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.759 DEBUG:boto:Params: {} 2024-04-16T17:53:47.759 DEBUG:boto:Token: None 2024-04-16T17:53:47.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006088297714958ca8-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.806 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.807 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.807 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.807 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.807 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.807 DEBUG:boto:Data: 2024-04-16T17:53:47.807 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.807 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.807 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.807 DEBUG:boto:Params: {} 2024-04-16T17:53:47.807 DEBUG:boto:Token: None 2024-04-16T17:53:47.808 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zwaRQE1VQ2OMkpfhKBV4NFyme2Q= 2024-04-16T17:53:47.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zwaRQE1VQ2OMkpfhKBV4NFyme2Q=', 'Content-Length': '0'} 2024-04-16T17:53:47.810 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009805ee077a870c25-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.810 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.811 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.811 DEBUG:boto:Method: HEAD 2024-04-16T17:53:47.811 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.811 DEBUG:boto:Data: 2024-04-16T17:53:47.811 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.811 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.811 DEBUG:boto:Params: {} 2024-04-16T17:53:47.811 DEBUG:boto:Token: None 2024-04-16T17:53:47.811 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zwaRQE1VQ2OMkpfhKBV4NFyme2Q= 2024-04-16T17:53:47.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zwaRQE1VQ2OMkpfhKBV4NFyme2Q=', 'Content-Length': '0'} 2024-04-16T17:53:47.814 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008cda6b817c28b3f4-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:53:47.815 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.815 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.815 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.815 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.815 DEBUG:boto:Method: GET 2024-04-16T17:53:47.815 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.815 DEBUG:boto:Data: 2024-04-16T17:53:47.816 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.816 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.816 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.816 DEBUG:boto:Params: {} 2024-04-16T17:53:47.816 DEBUG:boto:Token: None 2024-04-16T17:53:47.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk= 2024-04-16T17:53:47.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk=', 'Content-Length': '0'} 2024-04-16T17:53:47.818 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000005d93fa25c5c9279-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.818 DEBUG:boto:path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.819 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2 2024-04-16T17:53:47.819 DEBUG:boto:path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.819 DEBUG:boto:auth_path=/cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.819 DEBUG:boto:Method: GET 2024-04-16T17:53:47.819 DEBUG:boto:Path: /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.819 DEBUG:boto:Data: 2024-04-16T17:53:47.819 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.819 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.819 DEBUG:boto:Params: {} 2024-04-16T17:53:47.820 DEBUG:boto:Token: None 2024-04-16T17:53:47.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/obj-test-zone2?versionId=tzEiM0Y03oTSLXTNtwRDEROW7SSRiC. 2024-04-16T17:53:47.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk= 2024-04-16T17:53:47.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nItkowG7e8DW2lBDUTL0+1IUCvk=', 'Content-Length': '0'} 2024-04-16T17:53:47.822 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'tzEiM0Y03oTSLXTNtwRDEROW7SSRiC.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d95353aef5ec2cfe-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.862 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.862 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.863 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.863 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.863 DEBUG:boto:Method: GET 2024-04-16T17:53:47.863 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.863 DEBUG:boto:Data: 2024-04-16T17:53:47.863 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:47.863 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.863 DEBUG:boto:Params: {} 2024-04-16T17:53:47.863 DEBUG:boto:Token: None 2024-04-16T17:53:47.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f859b41cb11cb843-00661ebb2b-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.866 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.867 DEBUG:boto:path=/cjqttm-13/ 2024-04-16T17:53:47.867 DEBUG:boto:auth_path=/cjqttm-13/ 2024-04-16T17:53:47.867 DEBUG:boto:path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.867 DEBUG:boto:auth_path=/cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.867 DEBUG:boto:Method: GET 2024-04-16T17:53:47.867 DEBUG:boto:Path: /cjqttm-13/?prefix=obj-test-zone2 2024-04-16T17:53:47.867 DEBUG:boto:Data: 2024-04-16T17:53:47.867 DEBUG:boto:Headers: {} 2024-04-16T17:53:47.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:47.868 DEBUG:boto:Port: 8000 2024-04-16T17:53:47.868 DEBUG:boto:Params: {} 2024-04-16T17:53:47.868 DEBUG:boto:Token: None 2024-04-16T17:53:47.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:47 GMT /cjqttm-13/ 2024-04-16T17:53:47.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E= 2024-04-16T17:53:47.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ns+UThOhtycsEJbCRCjJBgrRm8E=', 'Content-Length': '0'} 2024-04-16T17:53:47.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b09ed3865429babc-00661ebb2b-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:47.914 DEBUG:boto:b'cjqttm-13obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.737Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:47.915 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-13 zones={test-zone2, test-zone1} 2024-04-16T17:53:47.915 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-14 2024-04-16T17:53:47.915 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:47.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:47.916 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-14 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:53:47.977 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:47.977 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:48.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:48.038+0000 7fca7bb11800 1 bucket sync caught up with source: 2024-04-16T17:53:48.036 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000011.35.6, , 00000000002.16.11, , 00000000002.8.11, , , , , ] 2024-04-16T17:53:48.036 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000011.35.6, , 00000000002.16.11, , 00000000002.8.11, , , , , ] 2024-04-16T17:53:48.036 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:48.038+0000 7fca7bb11800 0 bucket checkpoint complete 2024-04-16T17:53:48.055 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-14 2024-04-16T17:53:48.056 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:48.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-14', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:48.056 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-14 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:53:48.119 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:48.119 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:48.181 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:48.183+0000 7f21cd738800 1 bucket sync caught up with source: 2024-04-16T17:53:48.181 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.30.11, , 00000000011.58.6, , 00000000003.26.10, , , , , ] 2024-04-16T17:53:48.181 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.30.11, , 00000000011.58.6, , 00000000003.26.10, , , , , ] 2024-04-16T17:53:48.182 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:48.183+0000 7f21cd738800 0 bucket checkpoint complete 2024-04-16T17:53:48.203 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-14 zones={test-zone2, test-zone1} 2024-04-16T17:53:48.203 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.203 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.203 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.203 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:53:48.203 DEBUG:boto:Data: 2024-04-16T17:53:48.203 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.203 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.204 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.204 DEBUG:boto:Params: {} 2024-04-16T17:53:48.204 DEBUG:boto:Token: None 2024-04-16T17:53:48.204 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:drA6LGSeHlJEEewWh76Bsb73XsE= 2024-04-16T17:53:48.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:drA6LGSeHlJEEewWh76Bsb73XsE=', 'Content-Length': '0'} 2024-04-16T17:53:48.206 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f186a05bb4fcf6d3-00661ebb2c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.207 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.207 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.207 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.207 DEBUG:boto:Path: /cjqttm-14/ 2024-04-16T17:53:48.207 DEBUG:boto:Data: 2024-04-16T17:53:48.207 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.207 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.207 DEBUG:boto:Params: {} 2024-04-16T17:53:48.208 DEBUG:boto:Token: None 2024-04-16T17:53:48.208 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:drA6LGSeHlJEEewWh76Bsb73XsE= 2024-04-16T17:53:48.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:drA6LGSeHlJEEewWh76Bsb73XsE=', 'Content-Length': '0'} 2024-04-16T17:53:48.210 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003951c661ea283c6b-00661ebb2c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.211 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:53:48.211 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.211 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.211 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.211 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.211 DEBUG:boto:Method: GET 2024-04-16T17:53:48.211 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.211 DEBUG:boto:Data: 2024-04-16T17:53:48.211 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.211 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.212 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.212 DEBUG:boto:Params: {} 2024-04-16T17:53:48.212 DEBUG:boto:Token: None 2024-04-16T17:53:48.212 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/?versions 2024-04-16T17:53:48.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I= 2024-04-16T17:53:48.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I=', 'Content-Length': '0'} 2024-04-16T17:53:48.215 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff22a9627cb635cf-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.215 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.215 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:53:48.215 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:53:48.215 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:53:48.216 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:53:48.216 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.216 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.216 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.216 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.216 DEBUG:boto:Method: GET 2024-04-16T17:53:48.216 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.216 DEBUG:boto:Data: 2024-04-16T17:53:48.216 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.216 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.217 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.217 DEBUG:boto:Params: {} 2024-04-16T17:53:48.217 DEBUG:boto:Token: None 2024-04-16T17:53:48.217 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/?versions 2024-04-16T17:53:48.217 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I= 2024-04-16T17:53:48.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I=', 'Content-Length': '0'} 2024-04-16T17:53:48.219 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004adc722672240603-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.219 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.220 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:53:48.220 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2024-04-16T17:53:48.220 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2024-04-16T17:53:48.220 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.220 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.220 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.220 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.221 DEBUG:boto:Method: GET 2024-04-16T17:53:48.221 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.221 DEBUG:boto:Data: 2024-04-16T17:53:48.221 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.221 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.221 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.221 DEBUG:boto:Params: {} 2024-04-16T17:53:48.221 DEBUG:boto:Token: None 2024-04-16T17:53:48.221 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/?versions 2024-04-16T17:53:48.221 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I= 2024-04-16T17:53:48.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I=', 'Content-Length': '0'} 2024-04-16T17:53:48.224 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd898aa76bb93ea5-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.224 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.224 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.225 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.225 DEBUG:boto:path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.225 DEBUG:boto:auth_path=/cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.225 DEBUG:boto:Method: GET 2024-04-16T17:53:48.225 DEBUG:boto:Path: /cjqttm-14/?versions&max-keys=999 2024-04-16T17:53:48.225 DEBUG:boto:Data: 2024-04-16T17:53:48.225 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.225 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.225 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.225 DEBUG:boto:Params: {} 2024-04-16T17:53:48.226 DEBUG:boto:Token: None 2024-04-16T17:53:48.226 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/?versions 2024-04-16T17:53:48.226 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I= 2024-04-16T17:53:48.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WoAt8wEMx6mF9dNlpOPdM4Quo8I=', 'Content-Length': '0'} 2024-04-16T17:53:48.228 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000dee3fb9f17ae9b4-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.228 DEBUG:boto:b'cjqttm-14999falsedummy-ILHP..pKgFZgg8FrhjB2h9955DT0S-true2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobj-test-zone1cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQXtrue2024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-test-zone2oI6mQOc0edTf42IPP-iMU2nuPhG61AZtrue2024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.229 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:53:48.229 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.229 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.229 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.229 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.229 DEBUG:boto:Method: GET 2024-04-16T17:53:48.229 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.229 DEBUG:boto:Data: 2024-04-16T17:53:48.229 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.229 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.229 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.230 DEBUG:boto:Params: {} 2024-04-16T17:53:48.230 DEBUG:boto:Token: None 2024-04-16T17:53:48.230 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.230 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0= 2024-04-16T17:53:48.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0=', 'Content-Length': '0'} 2024-04-16T17:53:48.232 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000beea3487089756b0-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.232 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.232 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.232 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.233 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.233 DEBUG:boto:Method: GET 2024-04-16T17:53:48.233 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.233 DEBUG:boto:Data: 2024-04-16T17:53:48.233 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.233 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.233 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.233 DEBUG:boto:Params: {} 2024-04-16T17:53:48.233 DEBUG:boto:Token: None 2024-04-16T17:53:48.234 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.234 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0= 2024-04-16T17:53:48.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0=', 'Content-Length': '0'} 2024-04-16T17:53:48.235 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000051136f00e16cf30c-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.236 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.236 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.236 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.236 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.236 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.236 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.236 DEBUG:boto:Data: 2024-04-16T17:53:48.236 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.237 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.237 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.237 DEBUG:boto:Params: {} 2024-04-16T17:53:48.237 DEBUG:boto:Token: None 2024-04-16T17:53:48.237 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.237 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7u4ntLgC6A7y1fcpHspiRvc6tzM= 2024-04-16T17:53:48.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7u4ntLgC6A7y1fcpHspiRvc6tzM=', 'Content-Length': '0'} 2024-04-16T17:53:48.239 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004504e0e7f2810874-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.239 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.239 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.240 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.240 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.240 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.240 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.240 DEBUG:boto:Data: 2024-04-16T17:53:48.240 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.240 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.240 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.240 DEBUG:boto:Params: {} 2024-04-16T17:53:48.240 DEBUG:boto:Token: None 2024-04-16T17:53:48.241 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.241 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7u4ntLgC6A7y1fcpHspiRvc6tzM= 2024-04-16T17:53:48.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7u4ntLgC6A7y1fcpHspiRvc6tzM=', 'Content-Length': '0'} 2024-04-16T17:53:48.243 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002ba04f9c25148723-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:53:48.243 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.243 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.243 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.243 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.243 DEBUG:boto:Method: GET 2024-04-16T17:53:48.244 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.244 DEBUG:boto:Data: 2024-04-16T17:53:48.244 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.244 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.244 DEBUG:boto:Params: {} 2024-04-16T17:53:48.244 DEBUG:boto:Token: None 2024-04-16T17:53:48.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0= 2024-04-16T17:53:48.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0=', 'Content-Length': '0'} 2024-04-16T17:53:48.246 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000001ddc12ba3f3339b0-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.246 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.247 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.247 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.247 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.247 DEBUG:boto:Method: GET 2024-04-16T17:53:48.247 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.247 DEBUG:boto:Data: 2024-04-16T17:53:48.247 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.247 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.247 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.247 DEBUG:boto:Params: {} 2024-04-16T17:53:48.248 DEBUG:boto:Token: None 2024-04-16T17:53:48.248 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0= 2024-04-16T17:53:48.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0=', 'Content-Length': '0'} 2024-04-16T17:53:48.250 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c3ed15b5f4a7c211-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.250 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.250 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.250 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.251 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.251 DEBUG:boto:Method: GET 2024-04-16T17:53:48.251 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.251 DEBUG:boto:Data: 2024-04-16T17:53:48.251 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.251 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.251 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.251 DEBUG:boto:Params: {} 2024-04-16T17:53:48.251 DEBUG:boto:Token: None 2024-04-16T17:53:48.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f02b348808628fcc-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.294 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.295 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.295 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.295 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.295 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.295 DEBUG:boto:Method: GET 2024-04-16T17:53:48.295 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.295 DEBUG:boto:Data: 2024-04-16T17:53:48.295 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.296 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.296 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.296 DEBUG:boto:Params: {} 2024-04-16T17:53:48.296 DEBUG:boto:Token: None 2024-04-16T17:53:48.296 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d471db192c0a8aa0-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.299 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.299 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.299 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.299 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.299 DEBUG:boto:Path: /cjqttm-14/dummy 2024-04-16T17:53:48.299 DEBUG:boto:Data: 2024-04-16T17:53:48.299 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.300 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.300 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.300 DEBUG:boto:Params: {} 2024-04-16T17:53:48.300 DEBUG:boto:Token: None 2024-04-16T17:53:48.300 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy 2024-04-16T17:53:48.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RZG8VnOshtb9uX66snvjW6C7X3k= 2024-04-16T17:53:48.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RZG8VnOshtb9uX66snvjW6C7X3k=', 'Content-Length': '0'} 2024-04-16T17:53:48.303 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a5c14a84d3040f02-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.303 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.303 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.303 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.303 DEBUG:boto:Path: /cjqttm-14/dummy 2024-04-16T17:53:48.304 DEBUG:boto:Data: 2024-04-16T17:53:48.304 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.304 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.304 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.304 DEBUG:boto:Params: {} 2024-04-16T17:53:48.304 DEBUG:boto:Token: None 2024-04-16T17:53:48.304 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy 2024-04-16T17:53:48.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RZG8VnOshtb9uX66snvjW6C7X3k= 2024-04-16T17:53:48.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RZG8VnOshtb9uX66snvjW6C7X3k=', 'Content-Length': '0'} 2024-04-16T17:53:48.307 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004fd21dcb17fcd626-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.307 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:53:48.307 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.307 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.308 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.308 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.308 DEBUG:boto:Method: GET 2024-04-16T17:53:48.308 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.308 DEBUG:boto:Data: 2024-04-16T17:53:48.308 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.308 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.308 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.308 DEBUG:boto:Params: {} 2024-04-16T17:53:48.308 DEBUG:boto:Token: None 2024-04-16T17:53:48.309 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0= 2024-04-16T17:53:48.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0=', 'Content-Length': '0'} 2024-04-16T17:53:48.311 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000f75bf739901bb2fb-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.311 DEBUG:boto:path=/cjqttm-14/dummy 2024-04-16T17:53:48.311 DEBUG:boto:auth_path=/cjqttm-14/dummy 2024-04-16T17:53:48.311 DEBUG:boto:path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.311 DEBUG:boto:auth_path=/cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.311 DEBUG:boto:Method: GET 2024-04-16T17:53:48.311 DEBUG:boto:Path: /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.312 DEBUG:boto:Data: 2024-04-16T17:53:48.312 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.312 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.312 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.312 DEBUG:boto:Params: {} 2024-04-16T17:53:48.312 DEBUG:boto:Token: None 2024-04-16T17:53:48.312 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/dummy?versionId=-ILHP..pKgFZgg8FrhjB2h9955DT0S- 2024-04-16T17:53:48.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0= 2024-04-16T17:53:48.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4jG2d8vm/8DML7gkgPX44atYp0=', 'Content-Length': '0'} 2024-04-16T17:53:48.314 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:34 GMT'), ('x-amz-version-id', '-ILHP..pKgFZgg8FrhjB2h9955DT0S-'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:35 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ae3777473e148f69-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.314 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.315 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.315 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.315 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.315 DEBUG:boto:Method: GET 2024-04-16T17:53:48.315 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.315 DEBUG:boto:Data: 2024-04-16T17:53:48.315 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.315 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.315 DEBUG:boto:Params: {} 2024-04-16T17:53:48.316 DEBUG:boto:Token: None 2024-04-16T17:53:48.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000566aaafe1056c6a8-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.358 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.359 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.359 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.359 DEBUG:boto:path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.359 DEBUG:boto:auth_path=/cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.359 DEBUG:boto:Method: GET 2024-04-16T17:53:48.359 DEBUG:boto:Path: /cjqttm-14/?prefix=dummy 2024-04-16T17:53:48.359 DEBUG:boto:Data: 2024-04-16T17:53:48.359 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.359 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.359 DEBUG:boto:Params: {} 2024-04-16T17:53:48.360 DEBUG:boto:Token: None 2024-04-16T17:53:48.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.361 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008906bdf80f2b29c8-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.362 DEBUG:boto:b'cjqttm-14dummy1000falsedummy2024-04-16T17:52:34.473Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:53:48.362 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.362 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.362 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.362 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.363 DEBUG:boto:Method: GET 2024-04-16T17:53:48.363 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.363 DEBUG:boto:Data: 2024-04-16T17:53:48.363 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.363 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.363 DEBUG:boto:Params: {} 2024-04-16T17:53:48.363 DEBUG:boto:Token: None 2024-04-16T17:53:48.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI= 2024-04-16T17:53:48.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI=', 'Content-Length': '0'} 2024-04-16T17:53:48.365 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cffa220d9dbe2638-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.366 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.366 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.366 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.366 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.366 DEBUG:boto:Method: GET 2024-04-16T17:53:48.366 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.366 DEBUG:boto:Data: 2024-04-16T17:53:48.366 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.366 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.367 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.367 DEBUG:boto:Params: {} 2024-04-16T17:53:48.367 DEBUG:boto:Token: None 2024-04-16T17:53:48.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI= 2024-04-16T17:53:48.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI=', 'Content-Length': '0'} 2024-04-16T17:53:48.369 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000db220473401fd526-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.370 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.370 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.370 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.370 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.370 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.370 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.370 DEBUG:boto:Data: 2024-04-16T17:53:48.370 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.370 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.370 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.371 DEBUG:boto:Params: {} 2024-04-16T17:53:48.371 DEBUG:boto:Token: None 2024-04-16T17:53:48.371 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mBMKZZ6U0nGyff5Vu0+PA7YFBnw= 2024-04-16T17:53:48.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mBMKZZ6U0nGyff5Vu0+PA7YFBnw=', 'Content-Length': '0'} 2024-04-16T17:53:48.373 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f4f23ebdc4252a4f-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.373 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.373 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.374 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.374 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.374 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.374 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.374 DEBUG:boto:Data: 2024-04-16T17:53:48.374 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.374 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.374 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.374 DEBUG:boto:Params: {} 2024-04-16T17:53:48.374 DEBUG:boto:Token: None 2024-04-16T17:53:48.375 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mBMKZZ6U0nGyff5Vu0+PA7YFBnw= 2024-04-16T17:53:48.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mBMKZZ6U0nGyff5Vu0+PA7YFBnw=', 'Content-Length': '0'} 2024-04-16T17:53:48.376 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008c4cea09ea012058-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.377 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:53:48.377 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.377 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.377 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.377 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.377 DEBUG:boto:Method: GET 2024-04-16T17:53:48.377 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.377 DEBUG:boto:Data: 2024-04-16T17:53:48.377 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.377 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.378 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.378 DEBUG:boto:Params: {} 2024-04-16T17:53:48.378 DEBUG:boto:Token: None 2024-04-16T17:53:48.378 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.378 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI= 2024-04-16T17:53:48.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI=', 'Content-Length': '0'} 2024-04-16T17:53:48.380 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002d8c7e540f42324c-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.422 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.422 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.423 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.423 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.423 DEBUG:boto:Method: GET 2024-04-16T17:53:48.423 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.423 DEBUG:boto:Data: 2024-04-16T17:53:48.423 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.423 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.423 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.423 DEBUG:boto:Params: {} 2024-04-16T17:53:48.424 DEBUG:boto:Token: None 2024-04-16T17:53:48.424 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI= 2024-04-16T17:53:48.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI=', 'Content-Length': '0'} 2024-04-16T17:53:48.426 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a59527a030670b48-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.427 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.427 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.427 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.427 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.427 DEBUG:boto:Method: GET 2024-04-16T17:53:48.427 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.427 DEBUG:boto:Data: 2024-04-16T17:53:48.427 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.427 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.427 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.428 DEBUG:boto:Params: {} 2024-04-16T17:53:48.428 DEBUG:boto:Token: None 2024-04-16T17:53:48.428 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003caa4fea3020dacf-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.430 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.431 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.431 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.431 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.431 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.431 DEBUG:boto:Method: GET 2024-04-16T17:53:48.431 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.431 DEBUG:boto:Data: 2024-04-16T17:53:48.431 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.432 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.432 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.432 DEBUG:boto:Params: {} 2024-04-16T17:53:48.432 DEBUG:boto:Token: None 2024-04-16T17:53:48.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6c4ab119866c3ee-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.478 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.479 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.479 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.479 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.479 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.479 DEBUG:boto:Data: 2024-04-16T17:53:48.479 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.479 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.479 DEBUG:boto:Params: {} 2024-04-16T17:53:48.480 DEBUG:boto:Token: None 2024-04-16T17:53:48.480 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4zYlIpHXP9Mr2j/5G3aDzTFIJpY= 2024-04-16T17:53:48.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4zYlIpHXP9Mr2j/5G3aDzTFIJpY=', 'Content-Length': '0'} 2024-04-16T17:53:48.482 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009fa9042223fb48c9-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.482 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.483 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.483 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.483 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.483 DEBUG:boto:Data: 2024-04-16T17:53:48.483 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.483 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.483 DEBUG:boto:Params: {} 2024-04-16T17:53:48.483 DEBUG:boto:Token: None 2024-04-16T17:53:48.483 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4zYlIpHXP9Mr2j/5G3aDzTFIJpY= 2024-04-16T17:53:48.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4zYlIpHXP9Mr2j/5G3aDzTFIJpY=', 'Content-Length': '0'} 2024-04-16T17:53:48.486 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000608a5b7234cb7038-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.486 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2024-04-16T17:53:48.486 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.487 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.487 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.487 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.487 DEBUG:boto:Method: GET 2024-04-16T17:53:48.487 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.487 DEBUG:boto:Data: 2024-04-16T17:53:48.487 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.487 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.487 DEBUG:boto:Params: {} 2024-04-16T17:53:48.488 DEBUG:boto:Token: None 2024-04-16T17:53:48.488 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI= 2024-04-16T17:53:48.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI=', 'Content-Length': '0'} 2024-04-16T17:53:48.490 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:42 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000911b6e127b43a93b-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.530 DEBUG:boto:path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.531 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1 2024-04-16T17:53:48.531 DEBUG:boto:path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.531 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.531 DEBUG:boto:Method: GET 2024-04-16T17:53:48.531 DEBUG:boto:Path: /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.531 DEBUG:boto:Data: 2024-04-16T17:53:48.531 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.531 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.531 DEBUG:boto:Params: {} 2024-04-16T17:53:48.532 DEBUG:boto:Token: None 2024-04-16T17:53:48.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone1?versionId=cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX 2024-04-16T17:53:48.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI= 2024-04-16T17:53:48.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ce3lwEzWJ3XFdAL/WcJWZdZtzKI=', 'Content-Length': '0'} 2024-04-16T17:53:48.534 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'cQEZAHIlBIIrBg0SkSQ1xGoIGg6KmQX'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005fa23bf929976b50-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.535 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.535 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.535 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.535 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.535 DEBUG:boto:Method: GET 2024-04-16T17:53:48.535 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.536 DEBUG:boto:Data: 2024-04-16T17:53:48.536 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.536 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.536 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.536 DEBUG:boto:Params: {} 2024-04-16T17:53:48.536 DEBUG:boto:Token: None 2024-04-16T17:53:48.536 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000146f74f0f10f7746-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.582 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.583 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.583 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.583 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.583 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.583 DEBUG:boto:Method: GET 2024-04-16T17:53:48.583 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone1 2024-04-16T17:53:48.583 DEBUG:boto:Data: 2024-04-16T17:53:48.583 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.584 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.584 DEBUG:boto:Params: {} 2024-04-16T17:53:48.584 DEBUG:boto:Token: None 2024-04-16T17:53:48.584 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.586 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee9aa6049bac11ae-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.587 DEBUG:boto:b'cjqttm-14obj-test-zone11000falseobj-test-zone12024-04-16T17:52:39.871Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.587 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:53:48.587 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.587 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.587 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.587 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.588 DEBUG:boto:Method: GET 2024-04-16T17:53:48.588 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.588 DEBUG:boto:Data: 2024-04-16T17:53:48.588 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.588 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.588 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.588 DEBUG:boto:Params: {} 2024-04-16T17:53:48.588 DEBUG:boto:Token: None 2024-04-16T17:53:48.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.589 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w= 2024-04-16T17:53:48.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w=', 'Content-Length': '0'} 2024-04-16T17:53:48.591 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003ee2984f21717948-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.591 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.591 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.591 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.591 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.591 DEBUG:boto:Method: GET 2024-04-16T17:53:48.591 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.592 DEBUG:boto:Data: 2024-04-16T17:53:48.592 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.592 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.592 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.592 DEBUG:boto:Params: {} 2024-04-16T17:53:48.592 DEBUG:boto:Token: None 2024-04-16T17:53:48.592 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w= 2024-04-16T17:53:48.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w=', 'Content-Length': '0'} 2024-04-16T17:53:48.595 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ceeae970055f2f1b-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.638 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.639 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.639 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.639 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.639 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.639 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.639 DEBUG:boto:Data: 2024-04-16T17:53:48.639 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.639 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.639 DEBUG:boto:Params: {} 2024-04-16T17:53:48.640 DEBUG:boto:Token: None 2024-04-16T17:53:48.640 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:71l/6PmYwsczJ68j4yS0MdWzysE= 2024-04-16T17:53:48.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:71l/6PmYwsczJ68j4yS0MdWzysE=', 'Content-Length': '0'} 2024-04-16T17:53:48.642 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004dfc1d698deed395-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.642 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.642 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.642 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.642 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.642 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.643 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.643 DEBUG:boto:Data: 2024-04-16T17:53:48.643 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.643 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.643 DEBUG:boto:Params: {} 2024-04-16T17:53:48.643 DEBUG:boto:Token: None 2024-04-16T17:53:48.643 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:71l/6PmYwsczJ68j4yS0MdWzysE= 2024-04-16T17:53:48.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:71l/6PmYwsczJ68j4yS0MdWzysE=', 'Content-Length': '0'} 2024-04-16T17:53:48.646 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff629a43c7753bc0-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.646 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:53:48.646 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.646 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.646 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.646 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.646 DEBUG:boto:Method: GET 2024-04-16T17:53:48.647 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.647 DEBUG:boto:Data: 2024-04-16T17:53:48.647 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.647 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.647 DEBUG:boto:Params: {} 2024-04-16T17:53:48.647 DEBUG:boto:Token: None 2024-04-16T17:53:48.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w= 2024-04-16T17:53:48.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w=', 'Content-Length': '0'} 2024-04-16T17:53:48.649 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009371bb7551cfb33f-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.650 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.650 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.650 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.650 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.650 DEBUG:boto:Method: GET 2024-04-16T17:53:48.650 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.650 DEBUG:boto:Data: 2024-04-16T17:53:48.650 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.650 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.650 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.650 DEBUG:boto:Params: {} 2024-04-16T17:53:48.651 DEBUG:boto:Token: None 2024-04-16T17:53:48.651 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w= 2024-04-16T17:53:48.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w=', 'Content-Length': '0'} 2024-04-16T17:53:48.653 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001c14ba933977c797-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.694 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.694 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.695 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.695 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.695 DEBUG:boto:Method: GET 2024-04-16T17:53:48.695 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.695 DEBUG:boto:Data: 2024-04-16T17:53:48.695 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.695 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.695 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.695 DEBUG:boto:Params: {} 2024-04-16T17:53:48.695 DEBUG:boto:Token: None 2024-04-16T17:53:48.696 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e0862cd58fd0e8a-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.699 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.699 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.699 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.699 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.699 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.699 DEBUG:boto:Method: GET 2024-04-16T17:53:48.700 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.700 DEBUG:boto:Data: 2024-04-16T17:53:48.700 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.700 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.700 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.700 DEBUG:boto:Params: {} 2024-04-16T17:53:48.700 DEBUG:boto:Token: None 2024-04-16T17:53:48.700 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.703 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040f5afe3000749d8-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.703 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.703 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.704 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.704 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.704 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.704 DEBUG:boto:Data: 2024-04-16T17:53:48.704 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.704 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.704 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.704 DEBUG:boto:Params: {} 2024-04-16T17:53:48.704 DEBUG:boto:Token: None 2024-04-16T17:53:48.705 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.705 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RyCeIXu3kFFUWSq7Wu31KbE0Jgs= 2024-04-16T17:53:48.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RyCeIXu3kFFUWSq7Wu31KbE0Jgs=', 'Content-Length': '0'} 2024-04-16T17:53:48.707 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d7b59ca2c9aa1dde-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.708 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.708 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.708 DEBUG:boto:Method: HEAD 2024-04-16T17:53:48.708 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.708 DEBUG:boto:Data: 2024-04-16T17:53:48.708 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.708 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.708 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.708 DEBUG:boto:Params: {} 2024-04-16T17:53:48.709 DEBUG:boto:Token: None 2024-04-16T17:53:48.709 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.709 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RyCeIXu3kFFUWSq7Wu31KbE0Jgs= 2024-04-16T17:53:48.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RyCeIXu3kFFUWSq7Wu31KbE0Jgs=', 'Content-Length': '0'} 2024-04-16T17:53:48.712 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007352751e87c634d9-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.712 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2024-04-16T17:53:48.712 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.712 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.712 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.712 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.712 DEBUG:boto:Method: GET 2024-04-16T17:53:48.713 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.713 DEBUG:boto:Data: 2024-04-16T17:53:48.713 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.713 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.713 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.713 DEBUG:boto:Params: {} 2024-04-16T17:53:48.713 DEBUG:boto:Token: None 2024-04-16T17:53:48.713 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.713 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w= 2024-04-16T17:53:48.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w=', 'Content-Length': '0'} 2024-04-16T17:53:48.716 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003bed23b0abd0a4ee-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.758 DEBUG:boto:path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.758 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2 2024-04-16T17:53:48.758 DEBUG:boto:path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.759 DEBUG:boto:auth_path=/cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.759 DEBUG:boto:Method: GET 2024-04-16T17:53:48.759 DEBUG:boto:Path: /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.759 DEBUG:boto:Data: 2024-04-16T17:53:48.759 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.759 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.759 DEBUG:boto:Params: {} 2024-04-16T17:53:48.759 DEBUG:boto:Token: None 2024-04-16T17:53:48.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/obj-test-zone2?versionId=oI6mQOc0edTf42IPP-iMU2nuPhG61AZ 2024-04-16T17:53:48.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w= 2024-04-16T17:53:48.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SmIKbMmkZHuVoVlpElWL0m79n6w=', 'Content-Length': '0'} 2024-04-16T17:53:48.762 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:52:39 GMT'), ('x-amz-version-id', 'oI6mQOc0edTf42IPP-iMU2nuPhG61AZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:52:44 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003e1d85d290046b01-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.802 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.802 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.803 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.803 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.803 DEBUG:boto:Method: GET 2024-04-16T17:53:48.803 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.803 DEBUG:boto:Data: 2024-04-16T17:53:48.803 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:53:48.803 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.803 DEBUG:boto:Params: {} 2024-04-16T17:53:48.803 DEBUG:boto:Token: None 2024-04-16T17:53:48.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000705aa73dddcacd69-00661ebb2c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.806 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.807 DEBUG:boto:path=/cjqttm-14/ 2024-04-16T17:53:48.807 DEBUG:boto:auth_path=/cjqttm-14/ 2024-04-16T17:53:48.807 DEBUG:boto:path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.807 DEBUG:boto:auth_path=/cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.807 DEBUG:boto:Method: GET 2024-04-16T17:53:48.807 DEBUG:boto:Path: /cjqttm-14/?prefix=obj-test-zone2 2024-04-16T17:53:48.807 DEBUG:boto:Data: 2024-04-16T17:53:48.807 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.807 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.807 DEBUG:boto:Params: {} 2024-04-16T17:53:48.808 DEBUG:boto:Token: None 2024-04-16T17:53:48.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-14/ 2024-04-16T17:53:48.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g= 2024-04-16T17:53:48.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvFbboR4PVADZcTjC8r6Mil5T+g=', 'Content-Length': '0'} 2024-04-16T17:53:48.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ff9f6f887a3e5f6-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.810 DEBUG:boto:b'cjqttm-14obj-test-zone21000falseobj-test-zone22024-04-16T17:52:39.972Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:53:48.811 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-14 zones={test-zone2, test-zone1} 2024-04-16T17:53:48.811 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2024-04-16T17:53:48.813 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:53:48.813 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:53:48.813 DEBUG:boto:Method: PUT 2024-04-16T17:53:48.813 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:53:48.813 DEBUG:boto:Data: 2024-04-16T17:53:48.813 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.813 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.814 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.814 DEBUG:boto:Params: {} 2024-04-16T17:53:48.814 DEBUG:boto:Token: None 2024-04-16T17:53:48.814 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-15/ 2024-04-16T17:53:48.814 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S+3PtYFZ86Te7VfIEyZo8FJiJSE= 2024-04-16T17:53:48.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S+3PtYFZ86Te7VfIEyZo8FJiJSE=', 'Content-Length': '0'} 2024-04-16T17:53:48.831 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a232fb0df9376f9c-00661ebb2c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.831 DEBUG:rgw_multi.tests:created bucket=cjqttm-15 2024-04-16T17:53:48.831 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:53:48.831 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:53:48.831 DEBUG:boto:path=/cjqttm-15/?versioning 2024-04-16T17:53:48.831 DEBUG:boto:auth_path=/cjqttm-15/?versioning 2024-04-16T17:53:48.831 DEBUG:boto:Method: PUT 2024-04-16T17:53:48.831 DEBUG:boto:Path: /cjqttm-15/?versioning 2024-04-16T17:53:48.831 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:53:48.832 DEBUG:boto:Headers: {} 2024-04-16T17:53:48.832 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:48.832 DEBUG:boto:Port: 8000 2024-04-16T17:53:48.832 DEBUG:boto:Params: {} 2024-04-16T17:53:48.832 DEBUG:boto:Token: None 2024-04-16T17:53:48.832 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:53:48 GMT /cjqttm-15/?versioning 2024-04-16T17:53:48.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oDy+PYt7B658HXaEROF+0HeKD8Q= 2024-04-16T17:53:48.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oDy+PYt7B658HXaEROF+0HeKD8Q=', 'Content-Length': '228'} 2024-04-16T17:53:48.838 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000093e5f48feca0c4df-00661ebb2c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:48.839 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:53:48.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:53:48.839 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:53:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:48.891 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:48.946 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:53:48.968 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290028.840033_137.1","last_update":"2024-04-16T17:53:48.840033Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:53:48.969 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290028.840033_137.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:53:48.969 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:53:48.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:53:48.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:53:48.970 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:53:49.020 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:49.021 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:49.070 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:49.071+0000 7feca9ee4800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:53:49.071 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:49.072+0000 7feca9ee4800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:53:49.091 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289943.911734_117.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:23.911734Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:53:49Z"} 2024-04-16T17:53:49.092 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289943.911734_117.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:23.911734Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:53:49Z"} 2024-04-16T17:53:49.092 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713289943.911734_117.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:23.911734Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:53:49.092 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290028.840033_137.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:53:49.092 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289943.911734_117.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:53:49.092 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290028.840033_137.1 target=1_1713289943.911734_117.1 2024-04-16T17:53:54.093 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:53:54.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:53:54.093 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:53:54.148 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:54.149 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:54.201 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:54.202+0000 7fd11d610800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:53:54.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:54.204+0000 7fd11d610800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:53:54.224 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290028.840033_137.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:53:48.840033Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:53:54Z"} 2024-04-16T17:53:54.224 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290028.840033_137.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:53:48.840033Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:53:54Z"} 2024-04-16T17:53:54.225 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290028.840033_137.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:53:48.840033Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:53:54.225 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290028.840033_137.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:53:54.225 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290028.840033_137.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:53:54.225 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:53:54.225 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:53:54.225 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:53:54.225 DEBUG:boto:Method: HEAD 2024-04-16T17:53:54.225 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:53:54.226 DEBUG:boto:Data: 2024-04-16T17:53:54.226 DEBUG:boto:Headers: {} 2024-04-16T17:53:54.226 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:54.226 DEBUG:boto:Port: 8000 2024-04-16T17:53:54.226 DEBUG:boto:Params: {} 2024-04-16T17:53:54.226 DEBUG:boto:Token: None 2024-04-16T17:53:54.226 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:53:54 GMT /cjqttm-15/ 2024-04-16T17:53:54.226 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7dkXNC107HrZsUOLrEx/csiXN68= 2024-04-16T17:53:54.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:53:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7dkXNC107HrZsUOLrEx/csiXN68=', 'Content-Length': '0'} 2024-04-16T17:53:54.229 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008c24bac44e32a3f2-00661ebb32-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:54.229 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:53:54.229 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:53:54.229 DEBUG:boto:Method: PUT 2024-04-16T17:53:54.230 DEBUG:boto:Path: /cjqttm-15/dummy 2024-04-16T17:53:54.230 DEBUG:boto:Data: 2024-04-16T17:53:54.230 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:53:54.230 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:53:54.230 DEBUG:boto:Port: 8000 2024-04-16T17:53:54.230 DEBUG:boto:Params: {} 2024-04-16T17:53:54.230 DEBUG:boto:Token: None 2024-04-16T17:53:54.230 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:53:54 GMT /cjqttm-15/dummy 2024-04-16T17:53:54.230 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FEnGpIIUIZQ/c5XpNN7DZ9yv7Xc= 2024-04-16T17:53:54.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:53:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FEnGpIIUIZQ/c5XpNN7DZ9yv7Xc='} 2024-04-16T17:53:54.245 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-amz-request-id', 'tx00000529663f9d4a32f93-00661ebb32-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:53:54.245 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-15 2024-04-16T17:53:54.245 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:54.245 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:54.245 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-15 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:53:54.301 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:54.301 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:54.355 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:54.356+0000 7f6d7c42f800 1 waiting to reach incremental sync.. 2024-04-16T17:53:59.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:59.358+0000 7f6d7c42f800 1 bucket sync caught up with source: 2024-04-16T17:53:59.357 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000002.10.11, , , , , ] 2024-04-16T17:53:59.357 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000002.10.11, , , , , ] 2024-04-16T17:53:59.357 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:53:59.358+0000 7f6d7c42f800 0 bucket checkpoint complete 2024-04-16T17:53:59.381 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-15 2024-04-16T17:53:59.381 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:59.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:53:59.382 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-15 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:53:59.445 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:53:59.446 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:53:59.508 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:53:59.509+0000 7fb16a543800 1 waiting to reach incremental sync.. 2024-04-16T17:54:04.510 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:54:04.512+0000 7fb16a543800 1 bucket sync caught up with source: 2024-04-16T17:54:04.511 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000002.23.11, , , , , ] 2024-04-16T17:54:04.511 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000002.23.11, , , , , ] 2024-04-16T17:54:04.511 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:54:04.512+0000 7fb16a543800 0 bucket checkpoint complete 2024-04-16T17:54:04.536 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-15 zones={test-zone2, test-zone1} 2024-04-16T17:54:04.536 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.536 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.536 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.536 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.536 DEBUG:boto:Data: 2024-04-16T17:54:04.536 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.536 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.537 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.537 DEBUG:boto:Params: {} 2024-04-16T17:54:04.537 DEBUG:boto:Token: None 2024-04-16T17:54:04.537 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.540 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c3a0b77cca5d18a3-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.540 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.540 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.540 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.540 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.540 DEBUG:boto:Data: 2024-04-16T17:54:04.540 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.541 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.541 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.541 DEBUG:boto:Params: {} 2024-04-16T17:54:04.541 DEBUG:boto:Token: None 2024-04-16T17:54:04.541 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.541 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.543 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e46c7d618b88df1f-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.544 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:54:04.544 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.544 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.544 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.544 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.544 DEBUG:boto:Method: GET 2024-04-16T17:54:04.544 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.544 DEBUG:boto:Data: 2024-04-16T17:54:04.544 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.545 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.545 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.545 DEBUG:boto:Params: {} 2024-04-16T17:54:04.545 DEBUG:boto:Token: None 2024-04-16T17:54:04.545 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/?versions 2024-04-16T17:54:04.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8= 2024-04-16T17:54:04.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8=', 'Content-Length': '0'} 2024-04-16T17:54:04.548 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040ac3d02d5033327-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.548 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.548 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:54:04.548 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:54:04.548 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.548 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.549 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.549 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.549 DEBUG:boto:Method: GET 2024-04-16T17:54:04.549 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.549 DEBUG:boto:Data: 2024-04-16T17:54:04.549 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.549 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.549 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.549 DEBUG:boto:Params: {} 2024-04-16T17:54:04.549 DEBUG:boto:Token: None 2024-04-16T17:54:04.549 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/?versions 2024-04-16T17:54:04.550 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8= 2024-04-16T17:54:04.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8=', 'Content-Length': '0'} 2024-04-16T17:54:04.552 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000541b6fafda16b5be-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.552 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.552 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:54:04.552 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.553 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.553 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.553 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.553 DEBUG:boto:Method: GET 2024-04-16T17:54:04.553 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.553 DEBUG:boto:Data: 2024-04-16T17:54:04.553 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.553 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.553 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.553 DEBUG:boto:Params: {} 2024-04-16T17:54:04.553 DEBUG:boto:Token: None 2024-04-16T17:54:04.554 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/?versions 2024-04-16T17:54:04.554 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8= 2024-04-16T17:54:04.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8=', 'Content-Length': '0'} 2024-04-16T17:54:04.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ee0ceb576c408e1-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.557 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.557 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.557 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.557 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.557 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.557 DEBUG:boto:Method: GET 2024-04-16T17:54:04.557 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:04.557 DEBUG:boto:Data: 2024-04-16T17:54:04.558 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.558 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.558 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.558 DEBUG:boto:Params: {} 2024-04-16T17:54:04.558 DEBUG:boto:Token: None 2024-04-16T17:54:04.558 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/?versions 2024-04-16T17:54:04.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8= 2024-04-16T17:54:04.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ouIwdw6/hullDUe53YjB0Xj1r8=', 'Content-Length': '0'} 2024-04-16T17:54:04.561 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053d6e5153359954f-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.561 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:54:04.561 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.561 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.562 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.562 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.562 DEBUG:boto:Method: GET 2024-04-16T17:54:04.562 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.562 DEBUG:boto:Data: 2024-04-16T17:54:04.562 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.562 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.562 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.562 DEBUG:boto:Params: {} 2024-04-16T17:54:04.562 DEBUG:boto:Token: None 2024-04-16T17:54:04.562 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY= 2024-04-16T17:54:04.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY=', 'Content-Length': '0'} 2024-04-16T17:54:04.565 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003b1ecc365967ab31-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.565 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.565 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.565 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.565 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.565 DEBUG:boto:Method: GET 2024-04-16T17:54:04.565 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.565 DEBUG:boto:Data: 2024-04-16T17:54:04.566 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.566 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.566 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.566 DEBUG:boto:Params: {} 2024-04-16T17:54:04.566 DEBUG:boto:Token: None 2024-04-16T17:54:04.566 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY= 2024-04-16T17:54:04.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY=', 'Content-Length': '0'} 2024-04-16T17:54:04.568 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c27a7aca6440345c-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.568 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.568 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.569 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.569 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.569 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.569 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.569 DEBUG:boto:Data: 2024-04-16T17:54:04.569 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.569 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.569 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.569 DEBUG:boto:Params: {} 2024-04-16T17:54:04.569 DEBUG:boto:Token: None 2024-04-16T17:54:04.569 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.570 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JdvioGAtZSuf/eS9hxGoOyBhjA0= 2024-04-16T17:54:04.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JdvioGAtZSuf/eS9hxGoOyBhjA0=', 'Content-Length': '0'} 2024-04-16T17:54:04.571 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c7c3a245da99d5fb-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.572 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.572 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.572 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.572 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.572 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.572 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.572 DEBUG:boto:Data: 2024-04-16T17:54:04.572 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.572 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.572 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.573 DEBUG:boto:Params: {} 2024-04-16T17:54:04.573 DEBUG:boto:Token: None 2024-04-16T17:54:04.573 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.573 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JdvioGAtZSuf/eS9hxGoOyBhjA0= 2024-04-16T17:54:04.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JdvioGAtZSuf/eS9hxGoOyBhjA0=', 'Content-Length': '0'} 2024-04-16T17:54:04.574 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003cc50bf666155a62-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.575 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:54:04.575 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.575 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.575 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.575 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.575 DEBUG:boto:Method: GET 2024-04-16T17:54:04.575 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.575 DEBUG:boto:Data: 2024-04-16T17:54:04.575 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.576 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.576 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.576 DEBUG:boto:Params: {} 2024-04-16T17:54:04.576 DEBUG:boto:Token: None 2024-04-16T17:54:04.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY= 2024-04-16T17:54:04.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY=', 'Content-Length': '0'} 2024-04-16T17:54:04.578 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003ff0bba02b9a22c7-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.578 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.578 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.578 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.579 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.579 DEBUG:boto:Method: GET 2024-04-16T17:54:04.579 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.579 DEBUG:boto:Data: 2024-04-16T17:54:04.579 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.579 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.579 DEBUG:boto:Params: {} 2024-04-16T17:54:04.579 DEBUG:boto:Token: None 2024-04-16T17:54:04.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY= 2024-04-16T17:54:04.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY=', 'Content-Length': '0'} 2024-04-16T17:54:04.581 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005b0ac27b52a2ce2e-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.581 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.581 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.582 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.582 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.582 DEBUG:boto:Method: GET 2024-04-16T17:54:04.582 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.582 DEBUG:boto:Data: 2024-04-16T17:54:04.582 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.582 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.582 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.582 DEBUG:boto:Params: {} 2024-04-16T17:54:04.582 DEBUG:boto:Token: None 2024-04-16T17:54:04.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg= 2024-04-16T17:54:04.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg=', 'Content-Length': '0'} 2024-04-16T17:54:04.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ef2abd9a0169c69-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.585 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.586 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.586 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.586 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.586 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.586 DEBUG:boto:Method: GET 2024-04-16T17:54:04.586 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.586 DEBUG:boto:Data: 2024-04-16T17:54:04.586 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.586 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.586 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.586 DEBUG:boto:Params: {} 2024-04-16T17:54:04.587 DEBUG:boto:Token: None 2024-04-16T17:54:04.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg= 2024-04-16T17:54:04.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg=', 'Content-Length': '0'} 2024-04-16T17:54:04.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d6eeab6c42bddbd-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.630 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.631 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.631 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.631 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.631 DEBUG:boto:Path: /cjqttm-15/dummy 2024-04-16T17:54:04.631 DEBUG:boto:Data: 2024-04-16T17:54:04.631 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.631 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.631 DEBUG:boto:Params: {} 2024-04-16T17:54:04.631 DEBUG:boto:Token: None 2024-04-16T17:54:04.632 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy 2024-04-16T17:54:04.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ES/Jx1V0Gs7yesi/t2teEl6fex0= 2024-04-16T17:54:04.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ES/Jx1V0Gs7yesi/t2teEl6fex0=', 'Content-Length': '0'} 2024-04-16T17:54:04.634 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005cb5f6abe9d4b769-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.634 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.634 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.635 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.635 DEBUG:boto:Path: /cjqttm-15/dummy 2024-04-16T17:54:04.635 DEBUG:boto:Data: 2024-04-16T17:54:04.635 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.635 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.635 DEBUG:boto:Params: {} 2024-04-16T17:54:04.635 DEBUG:boto:Token: None 2024-04-16T17:54:04.635 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy 2024-04-16T17:54:04.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ES/Jx1V0Gs7yesi/t2teEl6fex0= 2024-04-16T17:54:04.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ES/Jx1V0Gs7yesi/t2teEl6fex0=', 'Content-Length': '0'} 2024-04-16T17:54:04.638 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006cffbc285f36d541-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:54:04.638 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.638 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.638 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.638 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.638 DEBUG:boto:Method: GET 2024-04-16T17:54:04.639 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.639 DEBUG:boto:Data: 2024-04-16T17:54:04.639 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.639 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.639 DEBUG:boto:Params: {} 2024-04-16T17:54:04.639 DEBUG:boto:Token: None 2024-04-16T17:54:04.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY= 2024-04-16T17:54:04.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY=', 'Content-Length': '0'} 2024-04-16T17:54:04.641 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000006a08c03ba0e7b8b4-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.641 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:04.642 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:04.642 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.642 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.642 DEBUG:boto:Method: GET 2024-04-16T17:54:04.642 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.642 DEBUG:boto:Data: 2024-04-16T17:54:04.642 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.642 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.642 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.642 DEBUG:boto:Params: {} 2024-04-16T17:54:04.642 DEBUG:boto:Token: None 2024-04-16T17:54:04.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:04.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY= 2024-04-16T17:54:04.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ll1AwFMi9olB5009BLkYaJRy8mY=', 'Content-Length': '0'} 2024-04-16T17:54:04.645 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000063d228e2e5ad679a-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.645 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.645 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.645 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.645 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.645 DEBUG:boto:Method: GET 2024-04-16T17:54:04.645 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.645 DEBUG:boto:Data: 2024-04-16T17:54:04.645 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.646 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.646 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.646 DEBUG:boto:Params: {} 2024-04-16T17:54:04.646 DEBUG:boto:Token: None 2024-04-16T17:54:04.646 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.646 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg= 2024-04-16T17:54:04.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg=', 'Content-Length': '0'} 2024-04-16T17:54:04.649 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060782d3061de4b11-00661ebb3c-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.649 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.649 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.649 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.649 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.650 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.650 DEBUG:boto:Method: GET 2024-04-16T17:54:04.650 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:04.650 DEBUG:boto:Data: 2024-04-16T17:54:04.650 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.650 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.650 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.650 DEBUG:boto:Params: {} 2024-04-16T17:54:04.650 DEBUG:boto:Token: None 2024-04-16T17:54:04.650 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.650 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg= 2024-04-16T17:54:04.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUPa5QwSzoXX9os7tsdRHYSn3wg=', 'Content-Length': '0'} 2024-04-16T17:54:04.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000610d4af85b363f7a-00661ebb3c-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.653 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:04.653 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-15 zones={test-zone2, test-zone1} 2024-04-16T17:54:04.653 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.653 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.654 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.654 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.654 DEBUG:boto:Data: 2024-04-16T17:54:04.654 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.654 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.654 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.654 DEBUG:boto:Params: {} 2024-04-16T17:54:04.654 DEBUG:boto:Token: None 2024-04-16T17:54:04.654 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.654 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.656 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e2463cfe598755a7-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.657 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.657 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.657 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.657 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.657 DEBUG:boto:Data: 2024-04-16T17:54:04.657 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.657 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.657 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.658 DEBUG:boto:Params: {} 2024-04-16T17:54:04.658 DEBUG:boto:Token: None 2024-04-16T17:54:04.658 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.658 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.671 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF'), ('x-amz-request-id', 'tx000000c39407a548ba119-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.671 DEBUG:rgw_multi.tests:zone=test-zone1 version=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:04.671 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.671 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.671 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.671 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.671 DEBUG:boto:Data: 2024-04-16T17:54:04.672 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.672 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.672 DEBUG:boto:Params: {} 2024-04-16T17:54:04.672 DEBUG:boto:Token: None 2024-04-16T17:54:04.672 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.672 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.675 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0f0136aff58209c-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.675 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.675 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.675 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.675 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.675 DEBUG:boto:Data: 2024-04-16T17:54:04.675 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.675 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.676 DEBUG:boto:Params: {} 2024-04-16T17:54:04.676 DEBUG:boto:Token: None 2024-04-16T17:54:04.676 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.718 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'JucDcxVZ9qgmI0OztdICOj4W2RIrqby'), ('x-amz-request-id', 'tx00000bdeb54ed527ee526-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.719 DEBUG:rgw_multi.tests:zone=test-zone2 version=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:04.719 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.719 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.719 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.719 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.719 DEBUG:boto:Data: 2024-04-16T17:54:04.719 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.719 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.719 DEBUG:boto:Params: {} 2024-04-16T17:54:04.719 DEBUG:boto:Token: None 2024-04-16T17:54:04.720 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.722 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '8'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cc13989404c13899-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.722 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.722 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.722 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.723 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.723 DEBUG:boto:Data: 2024-04-16T17:54:04.723 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.723 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.723 DEBUG:boto:Params: {} 2024-04-16T17:54:04.723 DEBUG:boto:Token: None 2024-04-16T17:54:04.723 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.735 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk'), ('x-amz-request-id', 'tx000009161eceea28ee91b-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.735 DEBUG:rgw_multi.tests:zone=test-zone1 version=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:04.735 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.735 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.735 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.735 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.736 DEBUG:boto:Data: 2024-04-16T17:54:04.736 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.736 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.736 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.736 DEBUG:boto:Params: {} 2024-04-16T17:54:04.736 DEBUG:boto:Token: None 2024-04-16T17:54:04.736 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.739 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '8'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008bd17c8d9d4cc45c-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.739 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.739 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.739 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.739 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.739 DEBUG:boto:Data: 2024-04-16T17:54:04.739 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.740 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.740 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.740 DEBUG:boto:Params: {} 2024-04-16T17:54:04.740 DEBUG:boto:Token: None 2024-04-16T17:54:04.740 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.751 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'VwizYqBwWwCzmZWE47pL-WKkYURTerJ'), ('x-amz-request-id', 'tx0000092019491037d8638-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.752 DEBUG:rgw_multi.tests:zone=test-zone2 version=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:04.752 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.752 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.752 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.752 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.752 DEBUG:boto:Data: 2024-04-16T17:54:04.752 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.752 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.752 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.752 DEBUG:boto:Params: {} 2024-04-16T17:54:04.753 DEBUG:boto:Token: None 2024-04-16T17:54:04.753 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.753 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.755 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000036244b58390ccbea-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.755 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.755 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.755 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.756 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.756 DEBUG:boto:Data: 2024-04-16T17:54:04.756 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.756 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.756 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.756 DEBUG:boto:Params: {} 2024-04-16T17:54:04.756 DEBUG:boto:Token: None 2024-04-16T17:54:04.756 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.798 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '-aHIUiyjmFhuHE47MSVsxlWPcDikiwe'), ('x-amz-request-id', 'tx000003861726fa9bb2181-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.799 DEBUG:rgw_multi.tests:zone=test-zone1 version=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:04.799 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.799 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.799 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.799 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.799 DEBUG:boto:Data: 2024-04-16T17:54:04.799 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.799 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.799 DEBUG:boto:Params: {} 2024-04-16T17:54:04.799 DEBUG:boto:Token: None 2024-04-16T17:54:04.800 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.802 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '16'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8b54794480acb24-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.802 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.802 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.802 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.803 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.803 DEBUG:boto:Data: 2024-04-16T17:54:04.803 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.803 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.803 DEBUG:boto:Params: {} 2024-04-16T17:54:04.803 DEBUG:boto:Token: None 2024-04-16T17:54:04.803 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.815 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2'), ('x-amz-request-id', 'tx00000584c03256b967a81-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.815 DEBUG:rgw_multi.tests:zone=test-zone2 version=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:04.815 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.815 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.815 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.816 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.816 DEBUG:boto:Data: 2024-04-16T17:54:04.816 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.816 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.816 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.816 DEBUG:boto:Params: {} 2024-04-16T17:54:04.816 DEBUG:boto:Token: None 2024-04-16T17:54:04.816 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.818 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000086127fa0b8aa5af5-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.819 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.819 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.819 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.819 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.819 DEBUG:boto:Data: 2024-04-16T17:54:04.819 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.819 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.819 DEBUG:boto:Params: {} 2024-04-16T17:54:04.819 DEBUG:boto:Token: None 2024-04-16T17:54:04.820 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.830 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '2fb-K9ByyRpc7Tzwku5korrvhuw4A.S'), ('x-amz-request-id', 'tx0000085fa5ac156d153c1-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.831 DEBUG:rgw_multi.tests:zone=test-zone1 version=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:04.831 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.831 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.831 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.831 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.831 DEBUG:boto:Data: 2024-04-16T17:54:04.831 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.831 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.831 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.831 DEBUG:boto:Params: {} 2024-04-16T17:54:04.831 DEBUG:boto:Token: None 2024-04-16T17:54:04.832 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.834 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d6e309e1cbb2ee3c-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.834 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.835 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.835 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.835 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.835 DEBUG:boto:Data: 2024-04-16T17:54:04.835 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.835 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.835 DEBUG:boto:Params: {} 2024-04-16T17:54:04.835 DEBUG:boto:Token: None 2024-04-16T17:54:04.835 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.879 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '3obakRtfs0Ijpsz5FE-v1gRrXHzevrL'), ('x-amz-request-id', 'tx00000f1d390f22a578623-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.879 DEBUG:rgw_multi.tests:zone=test-zone2 version=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:04.879 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.879 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.879 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.879 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.879 DEBUG:boto:Data: 2024-04-16T17:54:04.879 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.879 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.880 DEBUG:boto:Params: {} 2024-04-16T17:54:04.880 DEBUG:boto:Token: None 2024-04-16T17:54:04.880 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.882 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '32'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006b0cbc89762a924b-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.882 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.882 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.882 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.882 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.883 DEBUG:boto:Data: 2024-04-16T17:54:04.883 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.883 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.883 DEBUG:boto:Params: {} 2024-04-16T17:54:04.883 DEBUG:boto:Token: None 2024-04-16T17:54:04.883 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.894 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV'), ('x-amz-request-id', 'tx0000075ac1a3a152d03b5-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.894 DEBUG:rgw_multi.tests:zone=test-zone1 version=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:04.895 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.895 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.895 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.895 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.895 DEBUG:boto:Data: 2024-04-16T17:54:04.895 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.895 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.895 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.895 DEBUG:boto:Params: {} 2024-04-16T17:54:04.895 DEBUG:boto:Token: None 2024-04-16T17:54:04.896 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.898 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '32'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000515ceec0130a9d8d-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.898 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.899 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.899 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.899 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.899 DEBUG:boto:Data: 2024-04-16T17:54:04.899 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.899 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.899 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.899 DEBUG:boto:Params: {} 2024-04-16T17:54:04.899 DEBUG:boto:Token: None 2024-04-16T17:54:04.899 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.910 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa'), ('x-amz-request-id', 'tx00000b10e1f1f6804e068-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.910 DEBUG:rgw_multi.tests:zone=test-zone2 version=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:04.910 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.910 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.910 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.910 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.911 DEBUG:boto:Data: 2024-04-16T17:54:04.911 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.911 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.911 DEBUG:boto:Params: {} 2024-04-16T17:54:04.911 DEBUG:boto:Token: None 2024-04-16T17:54:04.911 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.911 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.914 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '40'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007c062a5601740651-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.914 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.914 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.914 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.914 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.915 DEBUG:boto:Data: 2024-04-16T17:54:04.915 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.915 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.915 DEBUG:boto:Params: {} 2024-04-16T17:54:04.915 DEBUG:boto:Token: None 2024-04-16T17:54:04.915 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.915 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.958 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'rRAocyayeRmdB8IvmApsF26PLzo26tc'), ('x-amz-request-id', 'tx00000906644ca92c5e1b1-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.959 DEBUG:rgw_multi.tests:zone=test-zone1 version=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:04.959 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.959 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.959 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.959 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.959 DEBUG:boto:Data: 2024-04-16T17:54:04.959 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.959 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.959 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.959 DEBUG:boto:Params: {} 2024-04-16T17:54:04.959 DEBUG:boto:Token: None 2024-04-16T17:54:04.960 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.962 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '40'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003b7c652559b82da7-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.962 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.962 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.963 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.963 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.963 DEBUG:boto:Data: 2024-04-16T17:54:04.963 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.963 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.963 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.963 DEBUG:boto:Params: {} 2024-04-16T17:54:04.963 DEBUG:boto:Token: None 2024-04-16T17:54:04.963 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.975 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL'), ('x-amz-request-id', 'tx0000001c804935e28cef7-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.975 DEBUG:rgw_multi.tests:zone=test-zone2 version=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:04.975 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.975 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.975 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.976 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.976 DEBUG:boto:Data: 2024-04-16T17:54:04.976 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.976 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.976 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.976 DEBUG:boto:Params: {} 2024-04-16T17:54:04.976 DEBUG:boto:Token: None 2024-04-16T17:54:04.976 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.978 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007d806fbe00504fe5-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.979 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.979 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.979 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.979 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.979 DEBUG:boto:Data: 2024-04-16T17:54:04.979 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:04.979 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.979 DEBUG:boto:Params: {} 2024-04-16T17:54:04.979 DEBUG:boto:Token: None 2024-04-16T17:54:04.979 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:04.991 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '1c4TdlwWMboSOcM44DN89E--l0dwI-X'), ('x-amz-request-id', 'tx0000010f35d2b6f06841c-00661ebb3c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.991 DEBUG:rgw_multi.tests:zone=test-zone1 version=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:04.991 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:04.991 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:04.992 DEBUG:boto:Method: HEAD 2024-04-16T17:54:04.992 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:04.992 DEBUG:boto:Data: 2024-04-16T17:54:04.992 DEBUG:boto:Headers: {} 2024-04-16T17:54:04.992 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.992 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.992 DEBUG:boto:Params: {} 2024-04-16T17:54:04.992 DEBUG:boto:Token: None 2024-04-16T17:54:04.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/ 2024-04-16T17:54:04.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc= 2024-04-16T17:54:04.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gHwCae9QGHoBkugtExHM4W3Kozc=', 'Content-Length': '0'} 2024-04-16T17:54:04.995 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000012b34470a3d7aed9-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:04.995 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:04.995 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:04.995 DEBUG:boto:Method: PUT 2024-04-16T17:54:04.995 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:04.995 DEBUG:boto:Data: 2024-04-16T17:54:04.995 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:04.996 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:04.996 DEBUG:boto:Port: 8000 2024-04-16T17:54:04.996 DEBUG:boto:Params: {} 2024-04-16T17:54:04.996 DEBUG:boto:Token: None 2024-04-16T17:54:04.996 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:04 GMT /cjqttm-15/obj 2024-04-16T17:54:04.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho= 2024-04-16T17:54:04.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVZRJlWVJATkJADnPj3wtoYH/ho='} 2024-04-16T17:54:05.039 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 's0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5'), ('x-amz-request-id', 'tx000000c70d28ed45c58bf-00661ebb3c-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.039 DEBUG:rgw_multi.tests:zone=test-zone2 version=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:05.039 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:05.039 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:05.039 DEBUG:boto:Method: HEAD 2024-04-16T17:54:05.039 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:05.039 DEBUG:boto:Data: 2024-04-16T17:54:05.039 DEBUG:boto:Headers: {} 2024-04-16T17:54:05.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:05.040 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.040 DEBUG:boto:Params: {} 2024-04-16T17:54:05.040 DEBUG:boto:Token: None 2024-04-16T17:54:05.040 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/ 2024-04-16T17:54:05.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk= 2024-04-16T17:54:05.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk=', 'Content-Length': '0'} 2024-04-16T17:54:05.042 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '56'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e1099984f658e6c3-00661ebb3d-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.042 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:05.043 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:05.043 DEBUG:boto:Method: PUT 2024-04-16T17:54:05.043 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:05.043 DEBUG:boto:Data: 2024-04-16T17:54:05.043 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:05.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:05.043 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.043 DEBUG:boto:Params: {} 2024-04-16T17:54:05.043 DEBUG:boto:Token: None 2024-04-16T17:54:05.043 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/obj 2024-04-16T17:54:05.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M= 2024-04-16T17:54:05.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M='} 2024-04-16T17:54:05.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y'), ('x-amz-request-id', 'tx0000066f16471482e8d7f-00661ebb3d-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.054 DEBUG:rgw_multi.tests:zone=test-zone1 version=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:05.054 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:05.054 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:05.054 DEBUG:boto:Method: HEAD 2024-04-16T17:54:05.055 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:05.055 DEBUG:boto:Data: 2024-04-16T17:54:05.055 DEBUG:boto:Headers: {} 2024-04-16T17:54:05.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:05.055 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.055 DEBUG:boto:Params: {} 2024-04-16T17:54:05.055 DEBUG:boto:Token: None 2024-04-16T17:54:05.055 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/ 2024-04-16T17:54:05.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk= 2024-04-16T17:54:05.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk=', 'Content-Length': '0'} 2024-04-16T17:54:05.058 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '56'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d3226304a09f55db-00661ebb3d-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.058 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:05.058 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:05.058 DEBUG:boto:Method: PUT 2024-04-16T17:54:05.058 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:05.058 DEBUG:boto:Data: 2024-04-16T17:54:05.058 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:05.059 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:05.059 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.059 DEBUG:boto:Params: {} 2024-04-16T17:54:05.059 DEBUG:boto:Token: None 2024-04-16T17:54:05.059 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/obj 2024-04-16T17:54:05.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M= 2024-04-16T17:54:05.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M='} 2024-04-16T17:54:05.070 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv'), ('x-amz-request-id', 'tx00000ed367164edc73ba6-00661ebb3d-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.070 DEBUG:rgw_multi.tests:zone=test-zone2 version=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:05.070 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:05.070 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:05.070 DEBUG:boto:Method: HEAD 2024-04-16T17:54:05.070 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:05.070 DEBUG:boto:Data: 2024-04-16T17:54:05.070 DEBUG:boto:Headers: {} 2024-04-16T17:54:05.070 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:05.070 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.071 DEBUG:boto:Params: {} 2024-04-16T17:54:05.071 DEBUG:boto:Token: None 2024-04-16T17:54:05.071 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/ 2024-04-16T17:54:05.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk= 2024-04-16T17:54:05.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk=', 'Content-Length': '0'} 2024-04-16T17:54:05.073 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '64'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5c86b47fad898a5-00661ebb3d-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.073 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:05.073 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:05.073 DEBUG:boto:Method: PUT 2024-04-16T17:54:05.074 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:05.074 DEBUG:boto:Data: 2024-04-16T17:54:05.074 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:05.074 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:05.074 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.074 DEBUG:boto:Params: {} 2024-04-16T17:54:05.074 DEBUG:boto:Token: None 2024-04-16T17:54:05.074 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/obj 2024-04-16T17:54:05.074 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M= 2024-04-16T17:54:05.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M='} 2024-04-16T17:54:05.119 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'vTREMZn1EzfswARdOGGpjluDjm3yEXg'), ('x-amz-request-id', 'tx00000fc1dfcd3390f2461-00661ebb3d-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.119 DEBUG:rgw_multi.tests:zone=test-zone1 version=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:05.119 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:05.119 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:05.119 DEBUG:boto:Method: HEAD 2024-04-16T17:54:05.119 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:05.119 DEBUG:boto:Data: 2024-04-16T17:54:05.119 DEBUG:boto:Headers: {} 2024-04-16T17:54:05.119 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:05.119 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.119 DEBUG:boto:Params: {} 2024-04-16T17:54:05.120 DEBUG:boto:Token: None 2024-04-16T17:54:05.120 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/ 2024-04-16T17:54:05.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk= 2024-04-16T17:54:05.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk=', 'Content-Length': '0'} 2024-04-16T17:54:05.122 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '64'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000066ea0ab98325b7ed-00661ebb3d-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.122 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:05.123 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:05.123 DEBUG:boto:Method: PUT 2024-04-16T17:54:05.123 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:05.123 DEBUG:boto:Data: 2024-04-16T17:54:05.123 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:05.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:05.123 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.123 DEBUG:boto:Params: {} 2024-04-16T17:54:05.123 DEBUG:boto:Token: None 2024-04-16T17:54:05.123 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/obj 2024-04-16T17:54:05.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M= 2024-04-16T17:54:05.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M='} 2024-04-16T17:54:05.133 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4'), ('x-amz-request-id', 'tx00000fddf5997ad6c847b-00661ebb3d-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.134 DEBUG:rgw_multi.tests:zone=test-zone2 version=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:05.134 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:05.134 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:05.134 DEBUG:boto:Method: HEAD 2024-04-16T17:54:05.134 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:05.134 DEBUG:boto:Data: 2024-04-16T17:54:05.134 DEBUG:boto:Headers: {} 2024-04-16T17:54:05.134 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:05.135 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.135 DEBUG:boto:Params: {} 2024-04-16T17:54:05.135 DEBUG:boto:Token: None 2024-04-16T17:54:05.135 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/ 2024-04-16T17:54:05.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk= 2024-04-16T17:54:05.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk=', 'Content-Length': '0'} 2024-04-16T17:54:05.137 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000753493ae48c6bc68-00661ebb3d-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.138 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:05.138 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:05.138 DEBUG:boto:Method: PUT 2024-04-16T17:54:05.138 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:05.138 DEBUG:boto:Data: 2024-04-16T17:54:05.138 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:05.138 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:05.138 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.138 DEBUG:boto:Params: {} 2024-04-16T17:54:05.139 DEBUG:boto:Token: None 2024-04-16T17:54:05.139 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/obj 2024-04-16T17:54:05.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M= 2024-04-16T17:54:05.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M='} 2024-04-16T17:54:05.149 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'vgrrRY9V0zXodnnv6v9TdUYa7uNg0o.'), ('x-amz-request-id', 'tx000007579951f2c75fa59-00661ebb3d-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.149 DEBUG:rgw_multi.tests:zone=test-zone1 version=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:05.149 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:05.149 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:05.149 DEBUG:boto:Method: HEAD 2024-04-16T17:54:05.149 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:05.150 DEBUG:boto:Data: 2024-04-16T17:54:05.150 DEBUG:boto:Headers: {} 2024-04-16T17:54:05.150 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:05.150 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.150 DEBUG:boto:Params: {} 2024-04-16T17:54:05.150 DEBUG:boto:Token: None 2024-04-16T17:54:05.150 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/ 2024-04-16T17:54:05.150 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk= 2024-04-16T17:54:05.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e86LI+kGwmBtiGSJF4iLc3o7zSk=', 'Content-Length': '0'} 2024-04-16T17:54:05.153 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007a61371a9f4e8494-00661ebb3d-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.153 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:05.153 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:05.153 DEBUG:boto:Method: PUT 2024-04-16T17:54:05.153 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:05.153 DEBUG:boto:Data: 2024-04-16T17:54:05.153 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue'} 2024-04-16T17:54:05.153 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:05.154 DEBUG:boto:Port: 8000 2024-04-16T17:54:05.154 DEBUG:boto:Params: {} 2024-04-16T17:54:05.154 DEBUG:boto:Token: None 2024-04-16T17:54:05.154 DEBUG:boto:StringToSign: PUT lmY06/L8E1cH1nU2kr9LHg== application/octet-stream Tue, 16 Apr 2024 17:54:05 GMT /cjqttm-15/obj 2024-04-16T17:54:05.154 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M= 2024-04-16T17:54:05.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'lmY06/L8E1cH1nU2kr9LHg==', 'Content-Length': '8', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x30am3Urx0rTJSzv94Fe2rf022M='} 2024-04-16T17:54:05.165 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-amz-request-id', 'tx0000050ba04c20635ff7a-00661ebb3d-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:05.165 DEBUG:rgw_multi.tests:zone=test-zone2 version=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:05.165 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-15 2024-04-16T17:54:05.165 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:54:05.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:54:05.165 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-15 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:54:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:05.225 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:05.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:05.281+0000 7f41c3214800 1 waiting for incremental sync to catch up: 2024-04-16T17:54:05.280 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000002.10.11, , , , , ] 2024-04-16T17:54:05.280 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000003.12.10, , , 00000000025.82.6, , ] 2024-04-16T17:54:10.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:10.282+0000 7f41c3214800 1 waiting for incremental sync to catch up: 2024-04-16T17:54:10.282 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000002.10.11, , , 00000000031.98.12, , ] 2024-04-16T17:54:10.282 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000003.12.10, , , 00000000025.82.6, , ] 2024-04-16T17:54:15.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:15.284+0000 7f41c3214800 1 bucket sync caught up with source: 2024-04-16T17:54:15.283 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000003.12.10, , , 00000000031.98.12, , ] 2024-04-16T17:54:15.283 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000003.12.10, , , 00000000025.82.6, , ] 2024-04-16T17:54:15.283 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:15.284+0000 7f41c3214800 0 bucket checkpoint complete 2024-04-16T17:54:15.309 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-15 2024-04-16T17:54:15.309 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:54:15.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-15', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:54:15.309 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-15 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:54:15.372 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:15.372 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:15.433 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:54:15.434+0000 7f9227a0f800 1 waiting for incremental sync to catch up: 2024-04-16T17:54:15.434 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000002.23.11, , , 00000000020.71.12, , ] 2024-04-16T17:54:15.434 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000002.23.11, , , 00000000031.102.9, , ] 2024-04-16T17:54:20.435 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:54:20.436+0000 7f9227a0f800 1 waiting for incremental sync to catch up: 2024-04-16T17:54:20.435 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000002.23.11, , , 00000000020.71.12, , ] 2024-04-16T17:54:20.435 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000002.23.11, , , 00000000031.102.9, , ] 2024-04-16T17:54:25.436 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:54:25.438+0000 7f9227a0f800 1 bucket sync caught up with source: 2024-04-16T17:54:25.437 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000002.23.11, , , 00000000031.102.9, , ] 2024-04-16T17:54:25.437 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000002.23.11, , , 00000000031.102.9, , ] 2024-04-16T17:54:25.437 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:54:25.438+0000 7f9227a0f800 0 bucket checkpoint complete 2024-04-16T17:54:25.462 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-15 zones={test-zone2, test-zone1} 2024-04-16T17:54:25.462 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.462 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.463 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.463 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:25.463 DEBUG:boto:Data: 2024-04-16T17:54:25.463 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.463 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.463 DEBUG:boto:Params: {} 2024-04-16T17:54:25.463 DEBUG:boto:Token: None 2024-04-16T17:54:25.464 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UZmf3JMIeZCF34+HgjOj3B1RUS4= 2024-04-16T17:54:25.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UZmf3JMIeZCF34+HgjOj3B1RUS4=', 'Content-Length': '0'} 2024-04-16T17:54:25.466 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '160'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000913ea7ed0c0d3208-00661ebb51-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.466 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.466 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.467 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.467 DEBUG:boto:Path: /cjqttm-15/ 2024-04-16T17:54:25.467 DEBUG:boto:Data: 2024-04-16T17:54:25.467 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.467 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.467 DEBUG:boto:Params: {} 2024-04-16T17:54:25.467 DEBUG:boto:Token: None 2024-04-16T17:54:25.467 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UZmf3JMIeZCF34+HgjOj3B1RUS4= 2024-04-16T17:54:25.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UZmf3JMIeZCF34+HgjOj3B1RUS4=', 'Content-Length': '0'} 2024-04-16T17:54:25.470 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '160'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a35284faefe9549f-00661ebb51-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.470 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:54:25.470 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.470 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.470 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.471 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.471 DEBUG:boto:Method: GET 2024-04-16T17:54:25.471 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.471 DEBUG:boto:Data: 2024-04-16T17:54:25.471 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.471 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.471 DEBUG:boto:Params: {} 2024-04-16T17:54:25.471 DEBUG:boto:Token: None 2024-04-16T17:54:25.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/?versions 2024-04-16T17:54:25.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo= 2024-04-16T17:54:25.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo=', 'Content-Length': '0'} 2024-04-16T17:54:25.475 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c7b4936d21aadc3-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.475 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjPPQnPScCOHLg2S4TBpNKfL6FrX58j-Mtrue2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvgrrRY9V0zXodnnv6v9TdUYa7uNg0o.false2024-04-16T17:54:05.143Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4false2024-04-16T17:54:05.127Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvTREMZn1EzfswARdOGGpjluDjm3yEXgfalse2024-04-16T17:54:05.078Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.yfalse2024-04-16T17:54:05.048Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjfiMDRmyGlpGOPS6DI7RX1WXUQKZETtvfalse2024-04-16T17:54:05.063Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj1c4TdlwWMboSOcM44DN89E--l0dwI-Xfalse2024-04-16T17:54:04.983Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobjs0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5false2024-04-16T17:54:05.000Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjEoxqu5ek2McGVKPWqPlJlluO-U3qmwLfalse2024-04-16T17:54:04.967Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjrRAocyayeRmdB8IvmApsF26PLzo26tcfalse2024-04-16T17:54:04.919Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj8krpup4f0Cg6HoGt4aAFxqi.y-zJLDafalse2024-04-16T17:54:04.903Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobju-0W910MI-SYnp8QNZlQTG3Xr4-dmFVfalse2024-04-16T17:54:04.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2fb-K9ByyRpc7Tzwku5korrvhuw4A.Sfalse2024-04-16T17:54:04.824Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj3obakRtfs0Ijpsz5FE-v1gRrXHzevrLfalse2024-04-16T17:54:04.839Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-aHIUiyjmFhuHE47MSVsxlWPcDikiwefalse2024-04-16T17:54:04.760Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2false2024-04-16T17:54:04.807Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjE57QjKZ1k9Cp9vGCtIWKujXW8fM3RAkfalse2024-04-16T17:54:04.727Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjVwizYqBwWwCzmZWE47pL-WKkYURTerJfalse2024-04-16T17:54:04.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjJucDcxVZ9qgmI0OztdICOj4W2RIrqbyfalse2024-04-16T17:54:04.680Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjMOLDDnaoqaVLyO3BIwM-SeFZtpM.2NFfalse2024-04-16T17:54:04.662Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.476 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:54:25.476 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.478 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:54:25.479 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.479 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.479 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.479 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.479 DEBUG:boto:Method: GET 2024-04-16T17:54:25.479 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.479 DEBUG:boto:Data: 2024-04-16T17:54:25.479 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.479 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.479 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.480 DEBUG:boto:Params: {} 2024-04-16T17:54:25.480 DEBUG:boto:Token: None 2024-04-16T17:54:25.480 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/?versions 2024-04-16T17:54:25.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo= 2024-04-16T17:54:25.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo=', 'Content-Length': '0'} 2024-04-16T17:54:25.483 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095a968a6f3881a54-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.483 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjPPQnPScCOHLg2S4TBpNKfL6FrX58j-Mtrue2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvgrrRY9V0zXodnnv6v9TdUYa7uNg0o.false2024-04-16T17:54:05.143Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4false2024-04-16T17:54:05.127Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvTREMZn1EzfswARdOGGpjluDjm3yEXgfalse2024-04-16T17:54:05.078Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.yfalse2024-04-16T17:54:05.048Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjfiMDRmyGlpGOPS6DI7RX1WXUQKZETtvfalse2024-04-16T17:54:05.063Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj1c4TdlwWMboSOcM44DN89E--l0dwI-Xfalse2024-04-16T17:54:04.983Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobjs0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5false2024-04-16T17:54:05.000Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjEoxqu5ek2McGVKPWqPlJlluO-U3qmwLfalse2024-04-16T17:54:04.967Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjrRAocyayeRmdB8IvmApsF26PLzo26tcfalse2024-04-16T17:54:04.919Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj8krpup4f0Cg6HoGt4aAFxqi.y-zJLDafalse2024-04-16T17:54:04.903Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobju-0W910MI-SYnp8QNZlQTG3Xr4-dmFVfalse2024-04-16T17:54:04.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2fb-K9ByyRpc7Tzwku5korrvhuw4A.Sfalse2024-04-16T17:54:04.824Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj3obakRtfs0Ijpsz5FE-v1gRrXHzevrLfalse2024-04-16T17:54:04.839Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-aHIUiyjmFhuHE47MSVsxlWPcDikiwefalse2024-04-16T17:54:04.760Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2false2024-04-16T17:54:04.807Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjE57QjKZ1k9Cp9vGCtIWKujXW8fM3RAkfalse2024-04-16T17:54:04.727Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjVwizYqBwWwCzmZWE47pL-WKkYURTerJfalse2024-04-16T17:54:04.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjJucDcxVZ9qgmI0OztdICOj4W2RIrqbyfalse2024-04-16T17:54:04.680Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjMOLDDnaoqaVLyO3BIwM-SeFZtpM.2NFfalse2024-04-16T17:54:04.662Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.484 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T17:54:25.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.484 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.485 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.486 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.486 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:54:25.486 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.486 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.486 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.486 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.486 DEBUG:boto:Method: GET 2024-04-16T17:54:25.486 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.486 DEBUG:boto:Data: 2024-04-16T17:54:25.487 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.487 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.487 DEBUG:boto:Params: {} 2024-04-16T17:54:25.487 DEBUG:boto:Token: None 2024-04-16T17:54:25.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/?versions 2024-04-16T17:54:25.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo= 2024-04-16T17:54:25.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo=', 'Content-Length': '0'} 2024-04-16T17:54:25.490 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f84515da1e2aafcf-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.491 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjPPQnPScCOHLg2S4TBpNKfL6FrX58j-Mtrue2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvgrrRY9V0zXodnnv6v9TdUYa7uNg0o.false2024-04-16T17:54:05.143Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4false2024-04-16T17:54:05.127Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvTREMZn1EzfswARdOGGpjluDjm3yEXgfalse2024-04-16T17:54:05.078Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.yfalse2024-04-16T17:54:05.048Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjfiMDRmyGlpGOPS6DI7RX1WXUQKZETtvfalse2024-04-16T17:54:05.063Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj1c4TdlwWMboSOcM44DN89E--l0dwI-Xfalse2024-04-16T17:54:04.983Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobjs0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5false2024-04-16T17:54:05.000Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjEoxqu5ek2McGVKPWqPlJlluO-U3qmwLfalse2024-04-16T17:54:04.967Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjrRAocyayeRmdB8IvmApsF26PLzo26tcfalse2024-04-16T17:54:04.919Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj8krpup4f0Cg6HoGt4aAFxqi.y-zJLDafalse2024-04-16T17:54:04.903Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobju-0W910MI-SYnp8QNZlQTG3Xr4-dmFVfalse2024-04-16T17:54:04.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2fb-K9ByyRpc7Tzwku5korrvhuw4A.Sfalse2024-04-16T17:54:04.824Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj3obakRtfs0Ijpsz5FE-v1gRrXHzevrLfalse2024-04-16T17:54:04.839Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-aHIUiyjmFhuHE47MSVsxlWPcDikiwefalse2024-04-16T17:54:04.760Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2false2024-04-16T17:54:04.807Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjE57QjKZ1k9Cp9vGCtIWKujXW8fM3RAkfalse2024-04-16T17:54:04.727Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjVwizYqBwWwCzmZWE47pL-WKkYURTerJfalse2024-04-16T17:54:04.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjJucDcxVZ9qgmI0OztdICOj4W2RIrqbyfalse2024-04-16T17:54:04.680Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjMOLDDnaoqaVLyO3BIwM-SeFZtpM.2NFfalse2024-04-16T17:54:04.662Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.492 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.492 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.492 DEBUG:boto:path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.492 DEBUG:boto:auth_path=/cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.492 DEBUG:boto:Method: GET 2024-04-16T17:54:25.492 DEBUG:boto:Path: /cjqttm-15/?versions&max-keys=999 2024-04-16T17:54:25.492 DEBUG:boto:Data: 2024-04-16T17:54:25.493 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.493 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.493 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.493 DEBUG:boto:Params: {} 2024-04-16T17:54:25.493 DEBUG:boto:Token: None 2024-04-16T17:54:25.493 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/?versions 2024-04-16T17:54:25.493 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo= 2024-04-16T17:54:25.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6flZglcD2LbDEV0garOqOKRtWPo=', 'Content-Length': '0'} 2024-04-16T17:54:25.496 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9dd3a3c0ec2e8e4-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.496 DEBUG:boto:b'cjqttm-15999falsedummymAXvZPTpVzN2UAX6WigBG43KjIha5hZtrue2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjPPQnPScCOHLg2S4TBpNKfL6FrX58j-Mtrue2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvgrrRY9V0zXodnnv6v9TdUYa7uNg0o.false2024-04-16T17:54:05.143Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4false2024-04-16T17:54:05.127Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjvTREMZn1EzfswARdOGGpjluDjm3yEXgfalse2024-04-16T17:54:05.078Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.yfalse2024-04-16T17:54:05.048Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjfiMDRmyGlpGOPS6DI7RX1WXUQKZETtvfalse2024-04-16T17:54:05.063Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj1c4TdlwWMboSOcM44DN89E--l0dwI-Xfalse2024-04-16T17:54:04.983Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobjs0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5false2024-04-16T17:54:05.000Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjEoxqu5ek2McGVKPWqPlJlluO-U3qmwLfalse2024-04-16T17:54:04.967Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjrRAocyayeRmdB8IvmApsF26PLzo26tcfalse2024-04-16T17:54:04.919Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj8krpup4f0Cg6HoGt4aAFxqi.y-zJLDafalse2024-04-16T17:54:04.903Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobju-0W910MI-SYnp8QNZlQTG3Xr4-dmFVfalse2024-04-16T17:54:04.887Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj2fb-K9ByyRpc7Tzwku5korrvhuw4A.Sfalse2024-04-16T17:54:04.824Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj3obakRtfs0Ijpsz5FE-v1gRrXHzevrLfalse2024-04-16T17:54:04.839Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj-aHIUiyjmFhuHE47MSVsxlWPcDikiwefalse2024-04-16T17:54:04.760Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normalobj6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2false2024-04-16T17:54:04.807Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjE57QjKZ1k9Cp9vGCtIWKujXW8fM3RAkfalse2024-04-16T17:54:04.727Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjVwizYqBwWwCzmZWE47pL-WKkYURTerJfalse2024-04-16T17:54:04.744Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjJucDcxVZ9qgmI0OztdICOj4W2RIrqbyfalse2024-04-16T17:54:04.680Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111NormalobjMOLDDnaoqaVLyO3BIwM-SeFZtpM.2NFfalse2024-04-16T17:54:04.662Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:54:25.497 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.498 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.498 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.498 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.498 DEBUG:boto:Method: GET 2024-04-16T17:54:25.498 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.498 DEBUG:boto:Data: 2024-04-16T17:54:25.498 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.498 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.498 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.498 DEBUG:boto:Params: {} 2024-04-16T17:54:25.499 DEBUG:boto:Token: None 2024-04-16T17:54:25.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g= 2024-04-16T17:54:25.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g=', 'Content-Length': '0'} 2024-04-16T17:54:25.501 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b71a1f784baa8b56-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.501 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.501 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.501 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.502 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.502 DEBUG:boto:Method: GET 2024-04-16T17:54:25.502 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.502 DEBUG:boto:Data: 2024-04-16T17:54:25.502 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.502 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.502 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.502 DEBUG:boto:Params: {} 2024-04-16T17:54:25.502 DEBUG:boto:Token: None 2024-04-16T17:54:25.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.503 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g= 2024-04-16T17:54:25.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g=', 'Content-Length': '0'} 2024-04-16T17:54:25.504 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000008228422fb983c147-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.505 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.505 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.505 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.505 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.505 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.505 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.505 DEBUG:boto:Data: 2024-04-16T17:54:25.505 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.505 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.505 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.506 DEBUG:boto:Params: {} 2024-04-16T17:54:25.506 DEBUG:boto:Token: None 2024-04-16T17:54:25.506 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.506 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xjrmK6VcgOOrAIUv/XRVyHMmHLY= 2024-04-16T17:54:25.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xjrmK6VcgOOrAIUv/XRVyHMmHLY=', 'Content-Length': '0'} 2024-04-16T17:54:25.508 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000088b51ae5311f4cf6-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.508 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.508 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.508 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.508 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.509 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.509 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.509 DEBUG:boto:Data: 2024-04-16T17:54:25.509 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.509 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.509 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.509 DEBUG:boto:Params: {} 2024-04-16T17:54:25.509 DEBUG:boto:Token: None 2024-04-16T17:54:25.509 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xjrmK6VcgOOrAIUv/XRVyHMmHLY= 2024-04-16T17:54:25.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xjrmK6VcgOOrAIUv/XRVyHMmHLY=', 'Content-Length': '0'} 2024-04-16T17:54:25.511 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000078842bb5f8948878-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:54:25.511 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.512 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.512 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.512 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.512 DEBUG:boto:Method: GET 2024-04-16T17:54:25.512 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.512 DEBUG:boto:Data: 2024-04-16T17:54:25.512 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.512 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.512 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.512 DEBUG:boto:Params: {} 2024-04-16T17:54:25.513 DEBUG:boto:Token: None 2024-04-16T17:54:25.513 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.513 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g= 2024-04-16T17:54:25.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g=', 'Content-Length': '0'} 2024-04-16T17:54:25.515 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000021ce862ef45d3ae9-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.515 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.515 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.515 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.515 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.515 DEBUG:boto:Method: GET 2024-04-16T17:54:25.515 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.516 DEBUG:boto:Data: 2024-04-16T17:54:25.516 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.516 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.516 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.516 DEBUG:boto:Params: {} 2024-04-16T17:54:25.516 DEBUG:boto:Token: None 2024-04-16T17:54:25.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g= 2024-04-16T17:54:25.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g=', 'Content-Length': '0'} 2024-04-16T17:54:25.518 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007d4818429b43151e-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.518 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.518 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.518 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.519 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.519 DEBUG:boto:Method: GET 2024-04-16T17:54:25.519 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.519 DEBUG:boto:Data: 2024-04-16T17:54:25.519 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.519 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.519 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.519 DEBUG:boto:Params: {} 2024-04-16T17:54:25.519 DEBUG:boto:Token: None 2024-04-16T17:54:25.519 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005923c81913be0441-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.562 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.563 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.563 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.563 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.563 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.563 DEBUG:boto:Method: GET 2024-04-16T17:54:25.563 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.563 DEBUG:boto:Data: 2024-04-16T17:54:25.563 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.563 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.563 DEBUG:boto:Params: {} 2024-04-16T17:54:25.564 DEBUG:boto:Token: None 2024-04-16T17:54:25.564 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.566 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000642c0ce8ff58a558-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.566 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.567 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.567 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.567 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.567 DEBUG:boto:Path: /cjqttm-15/dummy 2024-04-16T17:54:25.567 DEBUG:boto:Data: 2024-04-16T17:54:25.567 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.567 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.567 DEBUG:boto:Params: {} 2024-04-16T17:54:25.568 DEBUG:boto:Token: None 2024-04-16T17:54:25.568 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy 2024-04-16T17:54:25.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MiQ09nYRPIH1jl4HYPazyc6z2vw= 2024-04-16T17:54:25.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MiQ09nYRPIH1jl4HYPazyc6z2vw=', 'Content-Length': '0'} 2024-04-16T17:54:25.570 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e3a24a8759105ba6-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.570 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.571 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.571 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.571 DEBUG:boto:Path: /cjqttm-15/dummy 2024-04-16T17:54:25.571 DEBUG:boto:Data: 2024-04-16T17:54:25.571 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.571 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.571 DEBUG:boto:Params: {} 2024-04-16T17:54:25.571 DEBUG:boto:Token: None 2024-04-16T17:54:25.572 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy 2024-04-16T17:54:25.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MiQ09nYRPIH1jl4HYPazyc6z2vw= 2024-04-16T17:54:25.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MiQ09nYRPIH1jl4HYPazyc6z2vw=', 'Content-Length': '0'} 2024-04-16T17:54:25.574 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000198d89d85073fdf1-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.574 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T17:54:25.574 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.575 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.575 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.575 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.575 DEBUG:boto:Method: GET 2024-04-16T17:54:25.575 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.575 DEBUG:boto:Data: 2024-04-16T17:54:25.575 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.575 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.575 DEBUG:boto:Params: {} 2024-04-16T17:54:25.576 DEBUG:boto:Token: None 2024-04-16T17:54:25.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g= 2024-04-16T17:54:25.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g=', 'Content-Length': '0'} 2024-04-16T17:54:25.578 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:53:57 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000033dabb796b2a161b-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.578 DEBUG:boto:path=/cjqttm-15/dummy 2024-04-16T17:54:25.578 DEBUG:boto:auth_path=/cjqttm-15/dummy 2024-04-16T17:54:25.578 DEBUG:boto:path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.578 DEBUG:boto:auth_path=/cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.578 DEBUG:boto:Method: GET 2024-04-16T17:54:25.578 DEBUG:boto:Path: /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.578 DEBUG:boto:Data: 2024-04-16T17:54:25.579 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.579 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.579 DEBUG:boto:Params: {} 2024-04-16T17:54:25.579 DEBUG:boto:Token: None 2024-04-16T17:54:25.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/dummy?versionId=mAXvZPTpVzN2UAX6WigBG43KjIha5hZ 2024-04-16T17:54:25.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g= 2024-04-16T17:54:25.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D+32sKFx29AL+m3NxZPjvC9/u/g=', 'Content-Length': '0'} 2024-04-16T17:54:25.581 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:53:54 GMT'), ('x-amz-version-id', 'mAXvZPTpVzN2UAX6WigBG43KjIha5hZ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000d15737542488de3-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.581 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.581 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.581 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.581 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.582 DEBUG:boto:Method: GET 2024-04-16T17:54:25.582 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.582 DEBUG:boto:Data: 2024-04-16T17:54:25.582 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.582 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.582 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.582 DEBUG:boto:Params: {} 2024-04-16T17:54:25.582 DEBUG:boto:Token: None 2024-04-16T17:54:25.582 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.582 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000986ea1e2acd45c84-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.585 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.585 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.585 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.586 DEBUG:boto:path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.586 DEBUG:boto:auth_path=/cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.586 DEBUG:boto:Method: GET 2024-04-16T17:54:25.586 DEBUG:boto:Path: /cjqttm-15/?prefix=dummy 2024-04-16T17:54:25.586 DEBUG:boto:Data: 2024-04-16T17:54:25.586 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.586 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.586 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.586 DEBUG:boto:Params: {} 2024-04-16T17:54:25.586 DEBUG:boto:Token: None 2024-04-16T17:54:25.586 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c66456f5b1841f73-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.589 DEBUG:boto:b'cjqttm-15dummy1000falsedummy2024-04-16T17:53:54.234Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:25.589 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.589 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.589 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.589 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.589 DEBUG:boto:Method: GET 2024-04-16T17:54:25.589 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.590 DEBUG:boto:Data: 2024-04-16T17:54:25.590 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.590 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.590 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.590 DEBUG:boto:Params: {} 2024-04-16T17:54:25.590 DEBUG:boto:Token: None 2024-04-16T17:54:25.590 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.590 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8= 2024-04-16T17:54:25.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8=', 'Content-Length': '0'} 2024-04-16T17:54:25.592 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008b46fae294e8c760-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.593 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.593 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.593 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.593 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.593 DEBUG:boto:Method: GET 2024-04-16T17:54:25.593 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.593 DEBUG:boto:Data: 2024-04-16T17:54:25.593 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.593 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.593 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.593 DEBUG:boto:Params: {} 2024-04-16T17:54:25.594 DEBUG:boto:Token: None 2024-04-16T17:54:25.594 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.594 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8= 2024-04-16T17:54:25.594 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8=', 'Content-Length': '0'} 2024-04-16T17:54:25.596 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004e337dc3f43efd77-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.597 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.597 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.597 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.597 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.597 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.597 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.597 DEBUG:boto:Data: 2024-04-16T17:54:25.597 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.597 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.597 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.597 DEBUG:boto:Params: {} 2024-04-16T17:54:25.598 DEBUG:boto:Token: None 2024-04-16T17:54:25.598 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.598 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5TEZDntgoqfLXm7CyOSRkIwTv9w= 2024-04-16T17:54:25.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5TEZDntgoqfLXm7CyOSRkIwTv9w=', 'Content-Length': '0'} 2024-04-16T17:54:25.600 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003a42149b27a64681-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.600 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.600 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.600 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.600 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.600 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.600 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.601 DEBUG:boto:Data: 2024-04-16T17:54:25.601 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.601 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.601 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.601 DEBUG:boto:Params: {} 2024-04-16T17:54:25.601 DEBUG:boto:Token: None 2024-04-16T17:54:25.601 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.601 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5TEZDntgoqfLXm7CyOSRkIwTv9w= 2024-04-16T17:54:25.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5TEZDntgoqfLXm7CyOSRkIwTv9w=', 'Content-Length': '0'} 2024-04-16T17:54:25.605 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009f25ad8748b2ee74-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:25.605 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.605 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.606 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.606 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.606 DEBUG:boto:Method: GET 2024-04-16T17:54:25.606 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.606 DEBUG:boto:Data: 2024-04-16T17:54:25.606 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.606 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.606 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.606 DEBUG:boto:Params: {} 2024-04-16T17:54:25.606 DEBUG:boto:Token: None 2024-04-16T17:54:25.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8= 2024-04-16T17:54:25.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8=', 'Content-Length': '0'} 2024-04-16T17:54:25.609 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009df4b4ff615d7deb-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.609 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.610 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.610 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.610 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.610 DEBUG:boto:Method: GET 2024-04-16T17:54:25.610 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.610 DEBUG:boto:Data: 2024-04-16T17:54:25.610 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.610 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.610 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.610 DEBUG:boto:Params: {} 2024-04-16T17:54:25.610 DEBUG:boto:Token: None 2024-04-16T17:54:25.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8= 2024-04-16T17:54:25.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8=', 'Content-Length': '0'} 2024-04-16T17:54:25.613 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bf20b32e7b27682d-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.654 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.654 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.655 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.655 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.655 DEBUG:boto:Method: GET 2024-04-16T17:54:25.655 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:25.655 DEBUG:boto:Data: 2024-04-16T17:54:25.655 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.655 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.655 DEBUG:boto:Params: {} 2024-04-16T17:54:25.655 DEBUG:boto:Token: None 2024-04-16T17:54:25.655 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ad32922cf172a48-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.658 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.659 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.659 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.659 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.659 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.659 DEBUG:boto:Method: GET 2024-04-16T17:54:25.659 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:25.659 DEBUG:boto:Data: 2024-04-16T17:54:25.659 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.659 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.659 DEBUG:boto:Params: {} 2024-04-16T17:54:25.660 DEBUG:boto:Token: None 2024-04-16T17:54:25.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002dea8981ca29f7f9-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.702 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.703 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.703 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.703 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.703 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:25.703 DEBUG:boto:Data: 2024-04-16T17:54:25.703 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.703 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.703 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.703 DEBUG:boto:Params: {} 2024-04-16T17:54:25.703 DEBUG:boto:Token: None 2024-04-16T17:54:25.704 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj 2024-04-16T17:54:25.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI= 2024-04-16T17:54:25.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI=', 'Content-Length': '0'} 2024-04-16T17:54:25.707 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000648b15d03c623fa-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.707 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.707 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.708 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.708 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:25.708 DEBUG:boto:Data: 2024-04-16T17:54:25.708 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.708 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.708 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.708 DEBUG:boto:Params: {} 2024-04-16T17:54:25.709 DEBUG:boto:Token: None 2024-04-16T17:54:25.709 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj 2024-04-16T17:54:25.709 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI= 2024-04-16T17:54:25.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI=', 'Content-Length': '0'} 2024-04-16T17:54:25.712 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ecb1d560eb9c15f6-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.713 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:25.713 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.713 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.713 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.713 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.713 DEBUG:boto:Method: GET 2024-04-16T17:54:25.713 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.713 DEBUG:boto:Data: 2024-04-16T17:54:25.714 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.714 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.714 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.714 DEBUG:boto:Params: {} 2024-04-16T17:54:25.714 DEBUG:boto:Token: None 2024-04-16T17:54:25.714 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.714 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8= 2024-04-16T17:54:25.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8=', 'Content-Length': '0'} 2024-04-16T17:54:25.716 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c0b558348091b2d5-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.758 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.758 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.759 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.759 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.759 DEBUG:boto:Method: GET 2024-04-16T17:54:25.759 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.759 DEBUG:boto:Data: 2024-04-16T17:54:25.759 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.759 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.759 DEBUG:boto:Params: {} 2024-04-16T17:54:25.759 DEBUG:boto:Token: None 2024-04-16T17:54:25.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8= 2024-04-16T17:54:25.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8=', 'Content-Length': '0'} 2024-04-16T17:54:25.762 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff83676e99ed8b50-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.802 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.802 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.803 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.803 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.803 DEBUG:boto:Method: GET 2024-04-16T17:54:25.803 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:25.803 DEBUG:boto:Data: 2024-04-16T17:54:25.803 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.803 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.803 DEBUG:boto:Params: {} 2024-04-16T17:54:25.803 DEBUG:boto:Token: None 2024-04-16T17:54:25.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073d19fb63f544d4c-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.807 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.807 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.807 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.807 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.807 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.807 DEBUG:boto:Method: GET 2024-04-16T17:54:25.807 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:25.808 DEBUG:boto:Data: 2024-04-16T17:54:25.808 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.808 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.808 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.808 DEBUG:boto:Params: {} 2024-04-16T17:54:25.808 DEBUG:boto:Token: None 2024-04-16T17:54:25.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ac921318a203985-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.854 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.855 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:25.855 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.855 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.855 DEBUG:boto:path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.855 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.855 DEBUG:boto:Method: GET 2024-04-16T17:54:25.855 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.855 DEBUG:boto:Data: 2024-04-16T17:54:25.855 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.856 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.856 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.856 DEBUG:boto:Params: {} 2024-04-16T17:54:25.856 DEBUG:boto:Token: None 2024-04-16T17:54:25.856 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.856 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig= 2024-04-16T17:54:25.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig=', 'Content-Length': '0'} 2024-04-16T17:54:25.858 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vgrrRY9V0zXodnnv6v9TdUYa7uNg0o.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000121d3766afcbcb5b-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.898 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.898 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.899 DEBUG:boto:path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.899 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.899 DEBUG:boto:Method: GET 2024-04-16T17:54:25.899 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.899 DEBUG:boto:Data: 2024-04-16T17:54:25.899 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.899 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.899 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.899 DEBUG:boto:Params: {} 2024-04-16T17:54:25.899 DEBUG:boto:Token: None 2024-04-16T17:54:25.900 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig= 2024-04-16T17:54:25.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig=', 'Content-Length': '0'} 2024-04-16T17:54:25.902 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vgrrRY9V0zXodnnv6v9TdUYa7uNg0o.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003ef234a622f52f7e-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.902 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.902 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.902 DEBUG:boto:path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.902 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.902 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.903 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.903 DEBUG:boto:Data: 2024-04-16T17:54:25.903 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.903 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.903 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.903 DEBUG:boto:Params: {} 2024-04-16T17:54:25.903 DEBUG:boto:Token: None 2024-04-16T17:54:25.903 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8mxsS/FKH6nWdpxU3gxKsO+U5o= 2024-04-16T17:54:25.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8mxsS/FKH6nWdpxU3gxKsO+U5o=', 'Content-Length': '0'} 2024-04-16T17:54:25.905 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vgrrRY9V0zXodnnv6v9TdUYa7uNg0o.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000175ff558dc49d05a-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.906 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.906 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.906 DEBUG:boto:path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.906 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.906 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.906 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.906 DEBUG:boto:Data: 2024-04-16T17:54:25.906 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.906 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.906 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.907 DEBUG:boto:Params: {} 2024-04-16T17:54:25.907 DEBUG:boto:Token: None 2024-04-16T17:54:25.907 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.907 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8mxsS/FKH6nWdpxU3gxKsO+U5o= 2024-04-16T17:54:25.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8mxsS/FKH6nWdpxU3gxKsO+U5o=', 'Content-Length': '0'} 2024-04-16T17:54:25.909 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vgrrRY9V0zXodnnv6v9TdUYa7uNg0o.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007237f8d628852d42-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:25.909 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.909 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.909 DEBUG:boto:path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.910 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.910 DEBUG:boto:Method: GET 2024-04-16T17:54:25.910 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.910 DEBUG:boto:Data: 2024-04-16T17:54:25.910 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.910 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.910 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.910 DEBUG:boto:Params: {} 2024-04-16T17:54:25.910 DEBUG:boto:Token: None 2024-04-16T17:54:25.911 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.911 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig= 2024-04-16T17:54:25.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig=', 'Content-Length': '0'} 2024-04-16T17:54:25.912 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vgrrRY9V0zXodnnv6v9TdUYa7uNg0o.'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000dfc8fc9d09611410-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.954 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.954 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.955 DEBUG:boto:path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.955 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.955 DEBUG:boto:Method: GET 2024-04-16T17:54:25.955 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.955 DEBUG:boto:Data: 2024-04-16T17:54:25.955 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.955 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.955 DEBUG:boto:Params: {} 2024-04-16T17:54:25.955 DEBUG:boto:Token: None 2024-04-16T17:54:25.956 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=vgrrRY9V0zXodnnv6v9TdUYa7uNg0o. 2024-04-16T17:54:25.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig= 2024-04-16T17:54:25.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+U5GPNUBy+7UsJf0n7kwzZIo8Ig=', 'Content-Length': '0'} 2024-04-16T17:54:25.958 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vgrrRY9V0zXodnnv6v9TdUYa7uNg0o.'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bd7528e637ce95a7-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.958 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.958 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.958 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.958 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.959 DEBUG:boto:Method: GET 2024-04-16T17:54:25.959 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:25.959 DEBUG:boto:Data: 2024-04-16T17:54:25.959 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.959 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.959 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.959 DEBUG:boto:Params: {} 2024-04-16T17:54:25.959 DEBUG:boto:Token: None 2024-04-16T17:54:25.959 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.959 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.962 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000093fe56d5edfa54a-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.962 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.962 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:25.963 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:25.963 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.963 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:25.963 DEBUG:boto:Method: GET 2024-04-16T17:54:25.963 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:25.963 DEBUG:boto:Data: 2024-04-16T17:54:25.963 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.963 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.963 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.963 DEBUG:boto:Params: {} 2024-04-16T17:54:25.964 DEBUG:boto:Token: None 2024-04-16T17:54:25.964 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/ 2024-04-16T17:54:25.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA= 2024-04-16T17:54:25.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:STxdjOrV28oIGqayqw3K9WECwgA=', 'Content-Length': '0'} 2024-04-16T17:54:25.966 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbe6ad64fb6c2fd5-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.966 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:25.967 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.967 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.967 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.967 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:25.967 DEBUG:boto:Data: 2024-04-16T17:54:25.967 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.967 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.967 DEBUG:boto:Params: {} 2024-04-16T17:54:25.968 DEBUG:boto:Token: None 2024-04-16T17:54:25.968 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj 2024-04-16T17:54:25.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI= 2024-04-16T17:54:25.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI=', 'Content-Length': '0'} 2024-04-16T17:54:25.971 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c09cb68ddeba8375-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.972 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.972 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.972 DEBUG:boto:Method: HEAD 2024-04-16T17:54:25.972 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:25.972 DEBUG:boto:Data: 2024-04-16T17:54:25.972 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.972 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:25.972 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.972 DEBUG:boto:Params: {} 2024-04-16T17:54:25.973 DEBUG:boto:Token: None 2024-04-16T17:54:25.973 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj 2024-04-16T17:54:25.973 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI= 2024-04-16T17:54:25.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EwSrfZqnhf79raufiXweb5j+KI=', 'Content-Length': '0'} 2024-04-16T17:54:25.976 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c30946ad9fdc8f32-00661ebb51-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:25.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:25.977 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:25.977 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:25.977 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.977 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.977 DEBUG:boto:Method: GET 2024-04-16T17:54:25.977 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.977 DEBUG:boto:Data: 2024-04-16T17:54:25.978 DEBUG:boto:Headers: {} 2024-04-16T17:54:25.978 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:25.978 DEBUG:boto:Port: 8000 2024-04-16T17:54:25.978 DEBUG:boto:Params: {} 2024-04-16T17:54:25.978 DEBUG:boto:Token: None 2024-04-16T17:54:25.978 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:25 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:25.978 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8= 2024-04-16T17:54:25.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rm+r/ees4MpDbQF/iSm6rc1f2l8=', 'Content-Length': '0'} 2024-04-16T17:54:25.980 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e3aa2fd265ae045c-00661ebb51-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.022 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.022 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.023 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.023 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.023 DEBUG:boto:Method: GET 2024-04-16T17:54:26.023 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.023 DEBUG:boto:Data: 2024-04-16T17:54:26.023 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.023 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.023 DEBUG:boto:Params: {} 2024-04-16T17:54:26.023 DEBUG:boto:Token: None 2024-04-16T17:54:26.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw= 2024-04-16T17:54:26.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw=', 'Content-Length': '0'} 2024-04-16T17:54:26.025 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000abeeab6754b63ff7-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.066 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.066 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.067 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.067 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.067 DEBUG:boto:Method: GET 2024-04-16T17:54:26.067 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.067 DEBUG:boto:Data: 2024-04-16T17:54:26.067 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.067 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.067 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.067 DEBUG:boto:Params: {} 2024-04-16T17:54:26.067 DEBUG:boto:Token: None 2024-04-16T17:54:26.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.070 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000834fefe75ce0e001-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.070 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.071 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.071 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.071 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.071 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.071 DEBUG:boto:Method: GET 2024-04-16T17:54:26.071 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.071 DEBUG:boto:Data: 2024-04-16T17:54:26.071 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.072 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.072 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.072 DEBUG:boto:Params: {} 2024-04-16T17:54:26.072 DEBUG:boto:Token: None 2024-04-16T17:54:26.072 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a386e9ff4ed3d63-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.118 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.119 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.119 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.119 DEBUG:boto:path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.119 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.119 DEBUG:boto:Method: GET 2024-04-16T17:54:26.119 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.119 DEBUG:boto:Data: 2024-04-16T17:54:26.119 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.119 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.119 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.119 DEBUG:boto:Params: {} 2024-04-16T17:54:26.120 DEBUG:boto:Token: None 2024-04-16T17:54:26.120 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI= 2024-04-16T17:54:26.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI=', 'Content-Length': '0'} 2024-04-16T17:54:26.122 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000711d7f72cac06c83-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.122 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.122 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.122 DEBUG:boto:path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.123 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.123 DEBUG:boto:Method: GET 2024-04-16T17:54:26.123 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.123 DEBUG:boto:Data: 2024-04-16T17:54:26.123 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.123 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.123 DEBUG:boto:Params: {} 2024-04-16T17:54:26.123 DEBUG:boto:Token: None 2024-04-16T17:54:26.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI= 2024-04-16T17:54:26.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI=', 'Content-Length': '0'} 2024-04-16T17:54:26.126 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000b7b4515e5fc87c9-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.166 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.166 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.167 DEBUG:boto:path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.167 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.167 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.167 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.167 DEBUG:boto:Data: 2024-04-16T17:54:26.167 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.167 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.167 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.168 DEBUG:boto:Params: {} 2024-04-16T17:54:26.168 DEBUG:boto:Token: None 2024-04-16T17:54:26.168 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FDiRbOn2YWmUxssI6gyZX9vt/Lw= 2024-04-16T17:54:26.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FDiRbOn2YWmUxssI6gyZX9vt/Lw=', 'Content-Length': '0'} 2024-04-16T17:54:26.170 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000efc6d41e8e08b466-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.170 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.170 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.170 DEBUG:boto:path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.171 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.171 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.171 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.171 DEBUG:boto:Data: 2024-04-16T17:54:26.171 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.171 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.171 DEBUG:boto:Params: {} 2024-04-16T17:54:26.171 DEBUG:boto:Token: None 2024-04-16T17:54:26.172 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FDiRbOn2YWmUxssI6gyZX9vt/Lw= 2024-04-16T17:54:26.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FDiRbOn2YWmUxssI6gyZX9vt/Lw=', 'Content-Length': '0'} 2024-04-16T17:54:26.174 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004d1764e4c1656d38-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.174 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.174 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.174 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.175 DEBUG:boto:path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.175 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.175 DEBUG:boto:Method: GET 2024-04-16T17:54:26.175 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.175 DEBUG:boto:Data: 2024-04-16T17:54:26.175 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.175 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.175 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.175 DEBUG:boto:Params: {} 2024-04-16T17:54:26.175 DEBUG:boto:Token: None 2024-04-16T17:54:26.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI= 2024-04-16T17:54:26.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI=', 'Content-Length': '0'} 2024-04-16T17:54:26.178 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000aab5ab1dcf164b51-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.178 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.178 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.178 DEBUG:boto:path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.179 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.179 DEBUG:boto:Method: GET 2024-04-16T17:54:26.179 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.179 DEBUG:boto:Data: 2024-04-16T17:54:26.179 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.179 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.179 DEBUG:boto:Params: {} 2024-04-16T17:54:26.179 DEBUG:boto:Token: None 2024-04-16T17:54:26.179 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4 2024-04-16T17:54:26.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI= 2024-04-16T17:54:26.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:35QDOagJl9vSTfm8rVhpegy0TqI=', 'Content-Length': '0'} 2024-04-16T17:54:26.182 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '2VIYLrIlVBa6nWz5tE4xBl3MQaoODp4'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b0c166df8f8edd99-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.222 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.223 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.223 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.223 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.223 DEBUG:boto:Method: GET 2024-04-16T17:54:26.223 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.223 DEBUG:boto:Data: 2024-04-16T17:54:26.223 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.223 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.223 DEBUG:boto:Params: {} 2024-04-16T17:54:26.223 DEBUG:boto:Token: None 2024-04-16T17:54:26.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.226 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002853944b6d0c2cfc-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.226 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.227 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.227 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.227 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.227 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.227 DEBUG:boto:Method: GET 2024-04-16T17:54:26.227 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.227 DEBUG:boto:Data: 2024-04-16T17:54:26.227 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.228 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.228 DEBUG:boto:Params: {} 2024-04-16T17:54:26.228 DEBUG:boto:Token: None 2024-04-16T17:54:26.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7d1565f41b89fd8-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.274 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.275 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.275 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.275 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.275 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:26.275 DEBUG:boto:Data: 2024-04-16T17:54:26.275 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.275 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.275 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.276 DEBUG:boto:Params: {} 2024-04-16T17:54:26.276 DEBUG:boto:Token: None 2024-04-16T17:54:26.276 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj 2024-04-16T17:54:26.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U= 2024-04-16T17:54:26.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U=', 'Content-Length': '0'} 2024-04-16T17:54:26.280 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000adc65c5c3c9c8607-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.280 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.280 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.280 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.280 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:26.280 DEBUG:boto:Data: 2024-04-16T17:54:26.281 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.281 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.281 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.281 DEBUG:boto:Params: {} 2024-04-16T17:54:26.281 DEBUG:boto:Token: None 2024-04-16T17:54:26.281 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj 2024-04-16T17:54:26.281 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U= 2024-04-16T17:54:26.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U=', 'Content-Length': '0'} 2024-04-16T17:54:26.285 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000420a4a1e5ae8110-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.285 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.285 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.285 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.286 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.286 DEBUG:boto:Method: GET 2024-04-16T17:54:26.286 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.286 DEBUG:boto:Data: 2024-04-16T17:54:26.286 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.286 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.286 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.286 DEBUG:boto:Params: {} 2024-04-16T17:54:26.286 DEBUG:boto:Token: None 2024-04-16T17:54:26.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw= 2024-04-16T17:54:26.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw=', 'Content-Length': '0'} 2024-04-16T17:54:26.289 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005971aeaa873f1f20-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.289 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.289 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.289 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.289 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.289 DEBUG:boto:Method: GET 2024-04-16T17:54:26.289 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.290 DEBUG:boto:Data: 2024-04-16T17:54:26.290 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.290 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.290 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.290 DEBUG:boto:Params: {} 2024-04-16T17:54:26.290 DEBUG:boto:Token: None 2024-04-16T17:54:26.290 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.290 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw= 2024-04-16T17:54:26.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw=', 'Content-Length': '0'} 2024-04-16T17:54:26.293 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004133f3106e66bc19-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.334 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.334 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.335 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.335 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.335 DEBUG:boto:Method: GET 2024-04-16T17:54:26.335 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.335 DEBUG:boto:Data: 2024-04-16T17:54:26.335 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.335 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.335 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.335 DEBUG:boto:Params: {} 2024-04-16T17:54:26.335 DEBUG:boto:Token: None 2024-04-16T17:54:26.335 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b770006756a0542-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.338 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.339 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.339 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.339 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.339 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.339 DEBUG:boto:Method: GET 2024-04-16T17:54:26.339 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.339 DEBUG:boto:Data: 2024-04-16T17:54:26.339 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.339 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.339 DEBUG:boto:Params: {} 2024-04-16T17:54:26.340 DEBUG:boto:Token: None 2024-04-16T17:54:26.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.342 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007fd3061aef216029-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.386 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.387 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.387 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.387 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.387 DEBUG:boto:path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.387 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.387 DEBUG:boto:Method: GET 2024-04-16T17:54:26.387 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.387 DEBUG:boto:Data: 2024-04-16T17:54:26.387 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.388 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.388 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.388 DEBUG:boto:Params: {} 2024-04-16T17:54:26.388 DEBUG:boto:Token: None 2024-04-16T17:54:26.388 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE= 2024-04-16T17:54:26.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE=', 'Content-Length': '0'} 2024-04-16T17:54:26.390 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vTREMZn1EzfswARdOGGpjluDjm3yEXg'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e1b90e8771f101b0-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.434 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.435 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.435 DEBUG:boto:path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.435 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.435 DEBUG:boto:Method: GET 2024-04-16T17:54:26.435 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.435 DEBUG:boto:Data: 2024-04-16T17:54:26.435 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.435 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.436 DEBUG:boto:Params: {} 2024-04-16T17:54:26.436 DEBUG:boto:Token: None 2024-04-16T17:54:26.436 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE= 2024-04-16T17:54:26.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE=', 'Content-Length': '0'} 2024-04-16T17:54:26.438 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vTREMZn1EzfswARdOGGpjluDjm3yEXg'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009e5d6bf29540fb3a-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.438 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.439 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.439 DEBUG:boto:path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.439 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.439 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.439 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.439 DEBUG:boto:Data: 2024-04-16T17:54:26.439 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.439 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.439 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.439 DEBUG:boto:Params: {} 2024-04-16T17:54:26.440 DEBUG:boto:Token: None 2024-04-16T17:54:26.440 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:objUrdhw3+o1bnfUOzoRM8oijlc= 2024-04-16T17:54:26.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:objUrdhw3+o1bnfUOzoRM8oijlc=', 'Content-Length': '0'} 2024-04-16T17:54:26.442 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vTREMZn1EzfswARdOGGpjluDjm3yEXg'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c6e4393447418187-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.442 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.442 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.442 DEBUG:boto:path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.442 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.443 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.443 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.443 DEBUG:boto:Data: 2024-04-16T17:54:26.443 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.443 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.443 DEBUG:boto:Params: {} 2024-04-16T17:54:26.443 DEBUG:boto:Token: None 2024-04-16T17:54:26.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:objUrdhw3+o1bnfUOzoRM8oijlc= 2024-04-16T17:54:26.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:objUrdhw3+o1bnfUOzoRM8oijlc=', 'Content-Length': '0'} 2024-04-16T17:54:26.445 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vTREMZn1EzfswARdOGGpjluDjm3yEXg'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e11aa825b5c3845f-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.446 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.446 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.446 DEBUG:boto:path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.446 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.446 DEBUG:boto:Method: GET 2024-04-16T17:54:26.446 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.447 DEBUG:boto:Data: 2024-04-16T17:54:26.447 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.447 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.447 DEBUG:boto:Params: {} 2024-04-16T17:54:26.447 DEBUG:boto:Token: None 2024-04-16T17:54:26.447 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.447 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE= 2024-04-16T17:54:26.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE=', 'Content-Length': '0'} 2024-04-16T17:54:26.449 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vTREMZn1EzfswARdOGGpjluDjm3yEXg'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d003d5539748ca7e-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.490 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.490 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.491 DEBUG:boto:path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.491 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.491 DEBUG:boto:Method: GET 2024-04-16T17:54:26.491 DEBUG:boto:Path: /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.491 DEBUG:boto:Data: 2024-04-16T17:54:26.491 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.491 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.491 DEBUG:boto:Params: {} 2024-04-16T17:54:26.491 DEBUG:boto:Token: None 2024-04-16T17:54:26.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=vTREMZn1EzfswARdOGGpjluDjm3yEXg 2024-04-16T17:54:26.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE= 2024-04-16T17:54:26.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y68xz2X4kNzALwW51H9RbgWs4wE=', 'Content-Length': '0'} 2024-04-16T17:54:26.493 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'vTREMZn1EzfswARdOGGpjluDjm3yEXg'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d4b0fa840b5d60cf-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.494 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.494 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.494 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.494 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.494 DEBUG:boto:Method: GET 2024-04-16T17:54:26.494 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.494 DEBUG:boto:Data: 2024-04-16T17:54:26.494 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.494 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.494 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.495 DEBUG:boto:Params: {} 2024-04-16T17:54:26.495 DEBUG:boto:Token: None 2024-04-16T17:54:26.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000713c5a9b1dd13e32-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.538 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.539 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.539 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.539 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.539 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.539 DEBUG:boto:Method: GET 2024-04-16T17:54:26.539 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.539 DEBUG:boto:Data: 2024-04-16T17:54:26.539 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.540 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.540 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.540 DEBUG:boto:Params: {} 2024-04-16T17:54:26.540 DEBUG:boto:Token: None 2024-04-16T17:54:26.540 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000848f416a9fe4bbcc-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.543 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.543 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.543 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.543 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.543 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:26.543 DEBUG:boto:Data: 2024-04-16T17:54:26.544 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.544 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.544 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.544 DEBUG:boto:Params: {} 2024-04-16T17:54:26.544 DEBUG:boto:Token: None 2024-04-16T17:54:26.544 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj 2024-04-16T17:54:26.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U= 2024-04-16T17:54:26.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U=', 'Content-Length': '0'} 2024-04-16T17:54:26.548 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000017b2c6a1d552aac9-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.548 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.548 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.548 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.548 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:26.548 DEBUG:boto:Data: 2024-04-16T17:54:26.549 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.549 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.549 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.549 DEBUG:boto:Params: {} 2024-04-16T17:54:26.549 DEBUG:boto:Token: None 2024-04-16T17:54:26.549 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj 2024-04-16T17:54:26.549 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U= 2024-04-16T17:54:26.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U=', 'Content-Length': '0'} 2024-04-16T17:54:26.552 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b0adf12194ae9a99-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.553 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.553 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.553 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.553 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.553 DEBUG:boto:Method: GET 2024-04-16T17:54:26.553 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.553 DEBUG:boto:Data: 2024-04-16T17:54:26.553 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.553 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.554 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.554 DEBUG:boto:Params: {} 2024-04-16T17:54:26.554 DEBUG:boto:Token: None 2024-04-16T17:54:26.554 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.554 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw= 2024-04-16T17:54:26.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw=', 'Content-Length': '0'} 2024-04-16T17:54:26.556 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000077ee325f8ea3315d-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.557 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.557 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.557 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.557 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.557 DEBUG:boto:Method: GET 2024-04-16T17:54:26.557 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.557 DEBUG:boto:Data: 2024-04-16T17:54:26.557 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.557 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.557 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.558 DEBUG:boto:Params: {} 2024-04-16T17:54:26.558 DEBUG:boto:Token: None 2024-04-16T17:54:26.558 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw= 2024-04-16T17:54:26.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw=', 'Content-Length': '0'} 2024-04-16T17:54:26.560 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000655b881a231c55b9-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.602 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.602 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.603 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.603 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.603 DEBUG:boto:Method: GET 2024-04-16T17:54:26.603 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.603 DEBUG:boto:Data: 2024-04-16T17:54:26.603 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.603 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.603 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.603 DEBUG:boto:Params: {} 2024-04-16T17:54:26.604 DEBUG:boto:Token: None 2024-04-16T17:54:26.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2849b0f55b139d1-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.607 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.607 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.607 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.608 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.608 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.608 DEBUG:boto:Method: GET 2024-04-16T17:54:26.608 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.608 DEBUG:boto:Data: 2024-04-16T17:54:26.608 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.608 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.608 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.608 DEBUG:boto:Params: {} 2024-04-16T17:54:26.608 DEBUG:boto:Token: None 2024-04-16T17:54:26.609 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.609 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.611 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000192ed2f23d7dfd9-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.654 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.655 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.655 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.655 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.655 DEBUG:boto:path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.655 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.655 DEBUG:boto:Method: GET 2024-04-16T17:54:26.655 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.655 DEBUG:boto:Data: 2024-04-16T17:54:26.655 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.656 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.656 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.656 DEBUG:boto:Params: {} 2024-04-16T17:54:26.656 DEBUG:boto:Token: None 2024-04-16T17:54:26.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4= 2024-04-16T17:54:26.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4=', 'Content-Length': '0'} 2024-04-16T17:54:26.658 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003e482a7b6e9a3d61-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.702 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.702 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.703 DEBUG:boto:path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.703 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.703 DEBUG:boto:Method: GET 2024-04-16T17:54:26.703 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.703 DEBUG:boto:Data: 2024-04-16T17:54:26.703 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.703 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.703 DEBUG:boto:Params: {} 2024-04-16T17:54:26.703 DEBUG:boto:Token: None 2024-04-16T17:54:26.704 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4= 2024-04-16T17:54:26.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4=', 'Content-Length': '0'} 2024-04-16T17:54:26.706 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000020880c45859bc141-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.706 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.706 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.706 DEBUG:boto:path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.706 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.706 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.706 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.706 DEBUG:boto:Data: 2024-04-16T17:54:26.707 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.707 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.707 DEBUG:boto:Params: {} 2024-04-16T17:54:26.707 DEBUG:boto:Token: None 2024-04-16T17:54:26.707 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uT1v3OAa9/qeD9lu0ZuP66oL0Qs= 2024-04-16T17:54:26.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uT1v3OAa9/qeD9lu0ZuP66oL0Qs=', 'Content-Length': '0'} 2024-04-16T17:54:26.709 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f82eb2a0a2ebd63f-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.709 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.710 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.710 DEBUG:boto:path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.710 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.710 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.710 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.710 DEBUG:boto:Data: 2024-04-16T17:54:26.710 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.710 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.710 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.710 DEBUG:boto:Params: {} 2024-04-16T17:54:26.710 DEBUG:boto:Token: None 2024-04-16T17:54:26.711 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uT1v3OAa9/qeD9lu0ZuP66oL0Qs= 2024-04-16T17:54:26.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uT1v3OAa9/qeD9lu0ZuP66oL0Qs=', 'Content-Length': '0'} 2024-04-16T17:54:26.713 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003ce69d2f1d197fff-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.713 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.713 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.713 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.713 DEBUG:boto:path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.713 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.713 DEBUG:boto:Method: GET 2024-04-16T17:54:26.714 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.714 DEBUG:boto:Data: 2024-04-16T17:54:26.714 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.714 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.714 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.714 DEBUG:boto:Params: {} 2024-04-16T17:54:26.714 DEBUG:boto:Token: None 2024-04-16T17:54:26.714 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.714 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4= 2024-04-16T17:54:26.714 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4=', 'Content-Length': '0'} 2024-04-16T17:54:26.716 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000fed1acc6f40b699-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.758 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.758 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.758 DEBUG:boto:path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.759 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.759 DEBUG:boto:Method: GET 2024-04-16T17:54:26.759 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.759 DEBUG:boto:Data: 2024-04-16T17:54:26.759 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.759 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.759 DEBUG:boto:Params: {} 2024-04-16T17:54:26.759 DEBUG:boto:Token: None 2024-04-16T17:54:26.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y 2024-04-16T17:54:26.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4= 2024-04-16T17:54:26.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oB5JbpCjeunJ38kNpLIMzgIUw/4=', 'Content-Length': '0'} 2024-04-16T17:54:26.762 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', '-5.fYqpaeWQ2TU3hY9jA3EgqXR.O3.y'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008ccc3c2f35d7ce8c-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.762 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.762 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.762 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.762 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.762 DEBUG:boto:Method: GET 2024-04-16T17:54:26.763 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.763 DEBUG:boto:Data: 2024-04-16T17:54:26.763 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.763 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.763 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.763 DEBUG:boto:Params: {} 2024-04-16T17:54:26.763 DEBUG:boto:Token: None 2024-04-16T17:54:26.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.766 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007cf200d3f46346a-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.766 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.767 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.767 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.767 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.767 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.767 DEBUG:boto:Method: GET 2024-04-16T17:54:26.767 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.767 DEBUG:boto:Data: 2024-04-16T17:54:26.767 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.767 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.767 DEBUG:boto:Params: {} 2024-04-16T17:54:26.768 DEBUG:boto:Token: None 2024-04-16T17:54:26.768 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.771 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002550164b448f7c3f-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.771 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.771 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.771 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.771 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.772 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:26.772 DEBUG:boto:Data: 2024-04-16T17:54:26.772 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.772 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.772 DEBUG:boto:Params: {} 2024-04-16T17:54:26.772 DEBUG:boto:Token: None 2024-04-16T17:54:26.772 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj 2024-04-16T17:54:26.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U= 2024-04-16T17:54:26.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U=', 'Content-Length': '0'} 2024-04-16T17:54:26.776 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000532498fa42ddc3ca-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.776 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.776 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.776 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.776 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:26.776 DEBUG:boto:Data: 2024-04-16T17:54:26.776 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.776 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.776 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.776 DEBUG:boto:Params: {} 2024-04-16T17:54:26.777 DEBUG:boto:Token: None 2024-04-16T17:54:26.777 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj 2024-04-16T17:54:26.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U= 2024-04-16T17:54:26.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clv3XjQrJYKl6hCVEfH5WdJL71U=', 'Content-Length': '0'} 2024-04-16T17:54:26.780 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d2c123c8c1279bc5-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.780 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.781 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.781 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.781 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.781 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.781 DEBUG:boto:Method: GET 2024-04-16T17:54:26.781 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.781 DEBUG:boto:Data: 2024-04-16T17:54:26.781 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.781 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.781 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.781 DEBUG:boto:Params: {} 2024-04-16T17:54:26.782 DEBUG:boto:Token: None 2024-04-16T17:54:26.782 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.782 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw= 2024-04-16T17:54:26.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw=', 'Content-Length': '0'} 2024-04-16T17:54:26.784 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000b9e46e2da06f42f-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.826 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.827 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.827 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.827 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.827 DEBUG:boto:Method: GET 2024-04-16T17:54:26.827 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.827 DEBUG:boto:Data: 2024-04-16T17:54:26.827 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.827 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.827 DEBUG:boto:Params: {} 2024-04-16T17:54:26.827 DEBUG:boto:Token: None 2024-04-16T17:54:26.828 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:26.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw= 2024-04-16T17:54:26.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i0s/AX0mNmJZmutono9ooyMs5aw=', 'Content-Length': '0'} 2024-04-16T17:54:26.830 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c723b6d1d6e369cf-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.870 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.870 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.871 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.871 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.871 DEBUG:boto:Method: GET 2024-04-16T17:54:26.871 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.871 DEBUG:boto:Data: 2024-04-16T17:54:26.871 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.871 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.871 DEBUG:boto:Params: {} 2024-04-16T17:54:26.871 DEBUG:boto:Token: None 2024-04-16T17:54:26.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ae95f56733f923a-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.874 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.875 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:26.875 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:26.875 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.875 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:26.875 DEBUG:boto:Method: GET 2024-04-16T17:54:26.875 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:26.875 DEBUG:boto:Data: 2024-04-16T17:54:26.875 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.876 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.876 DEBUG:boto:Params: {} 2024-04-16T17:54:26.876 DEBUG:boto:Token: None 2024-04-16T17:54:26.876 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/ 2024-04-16T17:54:26.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU= 2024-04-16T17:54:26.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pNHklfgBJyKq8AG0h9Ekbs1bSqU=', 'Content-Length': '0'} 2024-04-16T17:54:26.878 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c23acee23ce0cb0b-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.922 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:26.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.923 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.923 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.923 DEBUG:boto:path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.923 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.923 DEBUG:boto:Method: GET 2024-04-16T17:54:26.923 DEBUG:boto:Path: /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.923 DEBUG:boto:Data: 2024-04-16T17:54:26.923 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.924 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.924 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.924 DEBUG:boto:Params: {} 2024-04-16T17:54:26.924 DEBUG:boto:Token: None 2024-04-16T17:54:26.924 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs= 2024-04-16T17:54:26.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs=', 'Content-Length': '0'} 2024-04-16T17:54:26.926 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000631784c82dc067b2-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.927 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.927 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.927 DEBUG:boto:path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.927 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.927 DEBUG:boto:Method: GET 2024-04-16T17:54:26.927 DEBUG:boto:Path: /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.927 DEBUG:boto:Data: 2024-04-16T17:54:26.927 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.927 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.928 DEBUG:boto:Params: {} 2024-04-16T17:54:26.928 DEBUG:boto:Token: None 2024-04-16T17:54:26.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs= 2024-04-16T17:54:26.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs=', 'Content-Length': '0'} 2024-04-16T17:54:26.930 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000097401e378801893a-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.974 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.974 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.975 DEBUG:boto:path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.975 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.975 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.975 DEBUG:boto:Path: /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.975 DEBUG:boto:Data: 2024-04-16T17:54:26.975 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.975 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.975 DEBUG:boto:Params: {} 2024-04-16T17:54:26.975 DEBUG:boto:Token: None 2024-04-16T17:54:26.976 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0AMxlRMYp6JshCwTMujAZgZXfhc= 2024-04-16T17:54:26.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0AMxlRMYp6JshCwTMujAZgZXfhc=', 'Content-Length': '0'} 2024-04-16T17:54:26.978 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009e42f57a82fb12c9-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.978 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.979 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.979 DEBUG:boto:path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.979 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.979 DEBUG:boto:Method: HEAD 2024-04-16T17:54:26.979 DEBUG:boto:Path: /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.979 DEBUG:boto:Data: 2024-04-16T17:54:26.979 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.979 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.979 DEBUG:boto:Params: {} 2024-04-16T17:54:26.979 DEBUG:boto:Token: None 2024-04-16T17:54:26.980 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0AMxlRMYp6JshCwTMujAZgZXfhc= 2024-04-16T17:54:26.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0AMxlRMYp6JshCwTMujAZgZXfhc=', 'Content-Length': '0'} 2024-04-16T17:54:26.982 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004bedfddf3bb5d3f0-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:26.982 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.982 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.983 DEBUG:boto:path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.983 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.983 DEBUG:boto:Method: GET 2024-04-16T17:54:26.983 DEBUG:boto:Path: /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.983 DEBUG:boto:Data: 2024-04-16T17:54:26.983 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:26.983 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.983 DEBUG:boto:Params: {} 2024-04-16T17:54:26.983 DEBUG:boto:Token: None 2024-04-16T17:54:26.984 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs= 2024-04-16T17:54:26.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs=', 'Content-Length': '0'} 2024-04-16T17:54:26.986 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f49967cb3478f05b-00661ebb52-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:26.986 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:26.986 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:26.987 DEBUG:boto:path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.987 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.987 DEBUG:boto:Method: GET 2024-04-16T17:54:26.987 DEBUG:boto:Path: /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.987 DEBUG:boto:Data: 2024-04-16T17:54:26.987 DEBUG:boto:Headers: {} 2024-04-16T17:54:26.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:26.987 DEBUG:boto:Port: 8000 2024-04-16T17:54:26.987 DEBUG:boto:Params: {} 2024-04-16T17:54:26.987 DEBUG:boto:Token: None 2024-04-16T17:54:26.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:26 GMT /cjqttm-15/obj?versionId=fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv 2024-04-16T17:54:26.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs= 2024-04-16T17:54:26.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5a0P4kT13MamRGPw0kjEA90GNs=', 'Content-Length': '0'} 2024-04-16T17:54:26.990 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'fiMDRmyGlpGOPS6DI7RX1WXUQKZETtv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000531f2962f930fb79-00661ebb52-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.030 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.033 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.033 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.033 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.033 DEBUG:boto:Method: GET 2024-04-16T17:54:27.033 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.034 DEBUG:boto:Data: 2024-04-16T17:54:27.034 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.034 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.034 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.034 DEBUG:boto:Params: {} 2024-04-16T17:54:27.034 DEBUG:boto:Token: None 2024-04-16T17:54:27.034 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.034 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf1bc5bb7438ebea-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.037 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.037 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.038 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.038 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.038 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.038 DEBUG:boto:Method: GET 2024-04-16T17:54:27.038 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.038 DEBUG:boto:Data: 2024-04-16T17:54:27.038 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.038 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.038 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.038 DEBUG:boto:Params: {} 2024-04-16T17:54:27.039 DEBUG:boto:Token: None 2024-04-16T17:54:27.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000425999e907aa0301-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.082 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.083 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.083 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.083 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.083 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.083 DEBUG:boto:Data: 2024-04-16T17:54:27.083 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.083 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.083 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.083 DEBUG:boto:Params: {} 2024-04-16T17:54:27.083 DEBUG:boto:Token: None 2024-04-16T17:54:27.084 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.087 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a0252817ce444ebf-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.087 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.087 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.088 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.088 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.088 DEBUG:boto:Data: 2024-04-16T17:54:27.088 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.088 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.088 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.088 DEBUG:boto:Params: {} 2024-04-16T17:54:27.088 DEBUG:boto:Token: None 2024-04-16T17:54:27.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.089 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.092 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000078e2bb3b775b55f0-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.092 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.093 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.093 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.093 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.093 DEBUG:boto:Method: GET 2024-04-16T17:54:27.093 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.093 DEBUG:boto:Data: 2024-04-16T17:54:27.093 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.093 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.093 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.093 DEBUG:boto:Params: {} 2024-04-16T17:54:27.094 DEBUG:boto:Token: None 2024-04-16T17:54:27.094 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.094 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.096 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000f9095297c1fac1c-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.096 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.096 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.097 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.097 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.097 DEBUG:boto:Method: GET 2024-04-16T17:54:27.097 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.097 DEBUG:boto:Data: 2024-04-16T17:54:27.097 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.097 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.097 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.097 DEBUG:boto:Params: {} 2024-04-16T17:54:27.097 DEBUG:boto:Token: None 2024-04-16T17:54:27.098 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.098 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.100 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007a157870c6d86922-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.142 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.142 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.143 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.143 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.143 DEBUG:boto:Method: GET 2024-04-16T17:54:27.143 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.143 DEBUG:boto:Data: 2024-04-16T17:54:27.143 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.143 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.143 DEBUG:boto:Params: {} 2024-04-16T17:54:27.143 DEBUG:boto:Token: None 2024-04-16T17:54:27.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f05b877450dd0b2-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.147 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.147 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.147 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.147 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.147 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.147 DEBUG:boto:Method: GET 2024-04-16T17:54:27.147 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.148 DEBUG:boto:Data: 2024-04-16T17:54:27.148 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.148 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.148 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.148 DEBUG:boto:Params: {} 2024-04-16T17:54:27.148 DEBUG:boto:Token: None 2024-04-16T17:54:27.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.151 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d1dbe4182f6dfb9-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.194 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.195 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.195 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.195 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.195 DEBUG:boto:path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.195 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.195 DEBUG:boto:Method: GET 2024-04-16T17:54:27.195 DEBUG:boto:Path: /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.195 DEBUG:boto:Data: 2024-04-16T17:54:27.195 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.195 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.196 DEBUG:boto:Params: {} 2024-04-16T17:54:27.196 DEBUG:boto:Token: None 2024-04-16T17:54:27.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M= 2024-04-16T17:54:27.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M=', 'Content-Length': '0'} 2024-04-16T17:54:27.198 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '1c4TdlwWMboSOcM44DN89E--l0dwI-X'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000026b3630cfb8af3c0-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.238 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.238 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.239 DEBUG:boto:path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.239 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.239 DEBUG:boto:Method: GET 2024-04-16T17:54:27.239 DEBUG:boto:Path: /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.239 DEBUG:boto:Data: 2024-04-16T17:54:27.239 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.239 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.239 DEBUG:boto:Params: {} 2024-04-16T17:54:27.239 DEBUG:boto:Token: None 2024-04-16T17:54:27.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M= 2024-04-16T17:54:27.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M=', 'Content-Length': '0'} 2024-04-16T17:54:27.242 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '1c4TdlwWMboSOcM44DN89E--l0dwI-X'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000778b611e60fe712e-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.242 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.242 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.242 DEBUG:boto:path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.242 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.242 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.242 DEBUG:boto:Path: /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.243 DEBUG:boto:Data: 2024-04-16T17:54:27.243 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.243 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.243 DEBUG:boto:Params: {} 2024-04-16T17:54:27.243 DEBUG:boto:Token: None 2024-04-16T17:54:27.243 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h1CMx85vRmgvj50xbOiDvtWSrtI= 2024-04-16T17:54:27.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h1CMx85vRmgvj50xbOiDvtWSrtI=', 'Content-Length': '0'} 2024-04-16T17:54:27.246 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '1c4TdlwWMboSOcM44DN89E--l0dwI-X'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001ada70220a862d05-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.246 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.246 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.246 DEBUG:boto:path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.246 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.246 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.247 DEBUG:boto:Path: /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.247 DEBUG:boto:Data: 2024-04-16T17:54:27.247 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.247 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.247 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.247 DEBUG:boto:Params: {} 2024-04-16T17:54:27.247 DEBUG:boto:Token: None 2024-04-16T17:54:27.247 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h1CMx85vRmgvj50xbOiDvtWSrtI= 2024-04-16T17:54:27.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h1CMx85vRmgvj50xbOiDvtWSrtI=', 'Content-Length': '0'} 2024-04-16T17:54:27.249 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '1c4TdlwWMboSOcM44DN89E--l0dwI-X'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001b7a3861fc2ed029-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.250 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.250 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.250 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.250 DEBUG:boto:path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.250 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.250 DEBUG:boto:Method: GET 2024-04-16T17:54:27.250 DEBUG:boto:Path: /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.250 DEBUG:boto:Data: 2024-04-16T17:54:27.250 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.250 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.250 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.251 DEBUG:boto:Params: {} 2024-04-16T17:54:27.251 DEBUG:boto:Token: None 2024-04-16T17:54:27.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M= 2024-04-16T17:54:27.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M=', 'Content-Length': '0'} 2024-04-16T17:54:27.253 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '1c4TdlwWMboSOcM44DN89E--l0dwI-X'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ff52221d5536cd0e-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.294 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.294 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.295 DEBUG:boto:path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.295 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.295 DEBUG:boto:Method: GET 2024-04-16T17:54:27.295 DEBUG:boto:Path: /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.295 DEBUG:boto:Data: 2024-04-16T17:54:27.295 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.295 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.295 DEBUG:boto:Params: {} 2024-04-16T17:54:27.295 DEBUG:boto:Token: None 2024-04-16T17:54:27.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=1c4TdlwWMboSOcM44DN89E--l0dwI-X 2024-04-16T17:54:27.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M= 2024-04-16T17:54:27.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KP5XjdyIUV187QXhKRgMUWUPo1M=', 'Content-Length': '0'} 2024-04-16T17:54:27.297 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '1c4TdlwWMboSOcM44DN89E--l0dwI-X'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b0a0f862eda537fb-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.298 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.298 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.298 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.298 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.298 DEBUG:boto:Method: GET 2024-04-16T17:54:27.298 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.298 DEBUG:boto:Data: 2024-04-16T17:54:27.299 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.299 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.299 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.299 DEBUG:boto:Params: {} 2024-04-16T17:54:27.299 DEBUG:boto:Token: None 2024-04-16T17:54:27.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.302 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052a3f391490937ec-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.342 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.343 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.343 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.343 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.343 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.343 DEBUG:boto:Method: GET 2024-04-16T17:54:27.343 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.343 DEBUG:boto:Data: 2024-04-16T17:54:27.343 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.344 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.344 DEBUG:boto:Params: {} 2024-04-16T17:54:27.344 DEBUG:boto:Token: None 2024-04-16T17:54:27.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.346 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003327b3d29a7f6a1d-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.347 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.347 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.347 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.347 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.347 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.347 DEBUG:boto:Data: 2024-04-16T17:54:27.347 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.348 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.348 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.348 DEBUG:boto:Params: {} 2024-04-16T17:54:27.348 DEBUG:boto:Token: None 2024-04-16T17:54:27.348 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.352 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000077f3c07767f48c53-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.352 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.352 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.352 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.352 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.353 DEBUG:boto:Data: 2024-04-16T17:54:27.353 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.353 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.353 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.353 DEBUG:boto:Params: {} 2024-04-16T17:54:27.353 DEBUG:boto:Token: None 2024-04-16T17:54:27.353 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.357 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e4a3312819576a38-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.357 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.357 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.357 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.357 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.357 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.357 DEBUG:boto:Method: GET 2024-04-16T17:54:27.358 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.358 DEBUG:boto:Data: 2024-04-16T17:54:27.358 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.358 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.358 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.358 DEBUG:boto:Params: {} 2024-04-16T17:54:27.358 DEBUG:boto:Token: None 2024-04-16T17:54:27.358 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.358 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.361 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000bccd247a0cfa09c3-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.361 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.361 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.361 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.361 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.362 DEBUG:boto:Method: GET 2024-04-16T17:54:27.362 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.362 DEBUG:boto:Data: 2024-04-16T17:54:27.362 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.362 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.362 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.362 DEBUG:boto:Params: {} 2024-04-16T17:54:27.362 DEBUG:boto:Token: None 2024-04-16T17:54:27.362 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.365 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d6e8e0f6ca72d954-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.406 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.406 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.407 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.407 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.407 DEBUG:boto:Method: GET 2024-04-16T17:54:27.407 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.407 DEBUG:boto:Data: 2024-04-16T17:54:27.407 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.407 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.407 DEBUG:boto:Params: {} 2024-04-16T17:54:27.407 DEBUG:boto:Token: None 2024-04-16T17:54:27.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012bc7158d879a398-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.410 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.411 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.411 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.411 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.411 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.411 DEBUG:boto:Method: GET 2024-04-16T17:54:27.411 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.411 DEBUG:boto:Data: 2024-04-16T17:54:27.411 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.412 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.412 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.412 DEBUG:boto:Params: {} 2024-04-16T17:54:27.412 DEBUG:boto:Token: None 2024-04-16T17:54:27.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d973fe1d36b7a1b-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.462 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.463 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.463 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.463 DEBUG:boto:path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.463 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.463 DEBUG:boto:Method: GET 2024-04-16T17:54:27.463 DEBUG:boto:Path: /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.463 DEBUG:boto:Data: 2024-04-16T17:54:27.464 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.464 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.464 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.464 DEBUG:boto:Params: {} 2024-04-16T17:54:27.464 DEBUG:boto:Token: None 2024-04-16T17:54:27.464 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs= 2024-04-16T17:54:27.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs=', 'Content-Length': '0'} 2024-04-16T17:54:27.466 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 's0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000797f242eae464774-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.466 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.466 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.467 DEBUG:boto:path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.467 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.467 DEBUG:boto:Method: GET 2024-04-16T17:54:27.467 DEBUG:boto:Path: /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.467 DEBUG:boto:Data: 2024-04-16T17:54:27.467 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.467 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.467 DEBUG:boto:Params: {} 2024-04-16T17:54:27.467 DEBUG:boto:Token: None 2024-04-16T17:54:27.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs= 2024-04-16T17:54:27.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs=', 'Content-Length': '0'} 2024-04-16T17:54:27.470 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 's0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003d6647929631abc5-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.510 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.510 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.510 DEBUG:boto:path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.511 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.511 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.511 DEBUG:boto:Path: /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.511 DEBUG:boto:Data: 2024-04-16T17:54:27.511 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.511 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.511 DEBUG:boto:Params: {} 2024-04-16T17:54:27.511 DEBUG:boto:Token: None 2024-04-16T17:54:27.511 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BityicNv0J/cngaZSFwVb5AU9dY= 2024-04-16T17:54:27.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BityicNv0J/cngaZSFwVb5AU9dY=', 'Content-Length': '0'} 2024-04-16T17:54:27.513 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 's0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000074089a50f175cdad-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.513 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.514 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.514 DEBUG:boto:path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.514 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.514 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.514 DEBUG:boto:Path: /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.514 DEBUG:boto:Data: 2024-04-16T17:54:27.514 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.514 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.514 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.515 DEBUG:boto:Params: {} 2024-04-16T17:54:27.515 DEBUG:boto:Token: None 2024-04-16T17:54:27.515 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BityicNv0J/cngaZSFwVb5AU9dY= 2024-04-16T17:54:27.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BityicNv0J/cngaZSFwVb5AU9dY=', 'Content-Length': '0'} 2024-04-16T17:54:27.517 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 's0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ce35e6a7309f8547-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.517 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.517 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.517 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.518 DEBUG:boto:path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.518 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.518 DEBUG:boto:Method: GET 2024-04-16T17:54:27.518 DEBUG:boto:Path: /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.518 DEBUG:boto:Data: 2024-04-16T17:54:27.518 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.518 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.518 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.518 DEBUG:boto:Params: {} 2024-04-16T17:54:27.518 DEBUG:boto:Token: None 2024-04-16T17:54:27.519 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.519 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs= 2024-04-16T17:54:27.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs=', 'Content-Length': '0'} 2024-04-16T17:54:27.520 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 's0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000073952ca1bef78ba1-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.521 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.521 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.521 DEBUG:boto:path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.521 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.521 DEBUG:boto:Method: GET 2024-04-16T17:54:27.521 DEBUG:boto:Path: /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.521 DEBUG:boto:Data: 2024-04-16T17:54:27.521 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.522 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.522 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.522 DEBUG:boto:Params: {} 2024-04-16T17:54:27.522 DEBUG:boto:Token: None 2024-04-16T17:54:27.522 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=s0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5 2024-04-16T17:54:27.522 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs= 2024-04-16T17:54:27.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDvVLGO1fvQglJ0xJf+DU2j4RXs=', 'Content-Length': '0'} 2024-04-16T17:54:27.524 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 's0WpRqQBbr-wl5VYpcQ4t0ui-31tgw5'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000067763035e2d743fa-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.566 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.567 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.567 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.567 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.567 DEBUG:boto:Method: GET 2024-04-16T17:54:27.567 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.567 DEBUG:boto:Data: 2024-04-16T17:54:27.567 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.567 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.567 DEBUG:boto:Params: {} 2024-04-16T17:54:27.567 DEBUG:boto:Token: None 2024-04-16T17:54:27.568 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ac234185ccd5ebe-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.570 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.571 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.571 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.571 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.571 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.571 DEBUG:boto:Method: GET 2024-04-16T17:54:27.571 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.571 DEBUG:boto:Data: 2024-04-16T17:54:27.571 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.571 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.571 DEBUG:boto:Params: {} 2024-04-16T17:54:27.572 DEBUG:boto:Token: None 2024-04-16T17:54:27.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c90b32c7d83c22df-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.618 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.619 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.619 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.619 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.619 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.619 DEBUG:boto:Data: 2024-04-16T17:54:27.619 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.619 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.619 DEBUG:boto:Params: {} 2024-04-16T17:54:27.619 DEBUG:boto:Token: None 2024-04-16T17:54:27.620 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.624 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a429aee0488be253-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.624 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.624 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.624 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.624 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.624 DEBUG:boto:Data: 2024-04-16T17:54:27.624 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.624 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.624 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.625 DEBUG:boto:Params: {} 2024-04-16T17:54:27.625 DEBUG:boto:Token: None 2024-04-16T17:54:27.625 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.625 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.629 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d15bfef718137fa2-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.629 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.629 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.629 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.629 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.629 DEBUG:boto:Method: GET 2024-04-16T17:54:27.629 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.630 DEBUG:boto:Data: 2024-04-16T17:54:27.630 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.630 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.630 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.630 DEBUG:boto:Params: {} 2024-04-16T17:54:27.630 DEBUG:boto:Token: None 2024-04-16T17:54:27.630 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.630 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.632 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e04b1424c1063840-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.674 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.675 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.675 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.675 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.675 DEBUG:boto:Method: GET 2024-04-16T17:54:27.675 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.675 DEBUG:boto:Data: 2024-04-16T17:54:27.675 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.675 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.675 DEBUG:boto:Params: {} 2024-04-16T17:54:27.675 DEBUG:boto:Token: None 2024-04-16T17:54:27.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.678 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002134cd089e2f4350-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.718 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.718 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.719 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.719 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.719 DEBUG:boto:Method: GET 2024-04-16T17:54:27.719 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.719 DEBUG:boto:Data: 2024-04-16T17:54:27.719 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.719 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.719 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.719 DEBUG:boto:Params: {} 2024-04-16T17:54:27.719 DEBUG:boto:Token: None 2024-04-16T17:54:27.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.722 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b61aed186b1eda90-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.723 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.723 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.723 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.723 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.723 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.723 DEBUG:boto:Method: GET 2024-04-16T17:54:27.723 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.723 DEBUG:boto:Data: 2024-04-16T17:54:27.724 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.724 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.724 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.724 DEBUG:boto:Params: {} 2024-04-16T17:54:27.724 DEBUG:boto:Token: None 2024-04-16T17:54:27.724 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.727 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000450e7765dd48c144-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.770 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.771 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.771 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.771 DEBUG:boto:path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.771 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.771 DEBUG:boto:Method: GET 2024-04-16T17:54:27.771 DEBUG:boto:Path: /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.771 DEBUG:boto:Data: 2024-04-16T17:54:27.772 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.772 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.772 DEBUG:boto:Params: {} 2024-04-16T17:54:27.772 DEBUG:boto:Token: None 2024-04-16T17:54:27.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs= 2024-04-16T17:54:27.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs=', 'Content-Length': '0'} 2024-04-16T17:54:27.774 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000d4540ce462e74ce-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.775 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.775 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.775 DEBUG:boto:path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.775 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.775 DEBUG:boto:Method: GET 2024-04-16T17:54:27.775 DEBUG:boto:Path: /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.775 DEBUG:boto:Data: 2024-04-16T17:54:27.775 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.776 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.776 DEBUG:boto:Params: {} 2024-04-16T17:54:27.776 DEBUG:boto:Token: None 2024-04-16T17:54:27.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs= 2024-04-16T17:54:27.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs=', 'Content-Length': '0'} 2024-04-16T17:54:27.779 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000024dd5ddf6f072a37-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.826 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.826 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.827 DEBUG:boto:path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.827 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.827 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.827 DEBUG:boto:Path: /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.827 DEBUG:boto:Data: 2024-04-16T17:54:27.827 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.827 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.827 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.827 DEBUG:boto:Params: {} 2024-04-16T17:54:27.828 DEBUG:boto:Token: None 2024-04-16T17:54:27.828 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S4fCP5eag3wtpWQ6d10Wu2+7n1w= 2024-04-16T17:54:27.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S4fCP5eag3wtpWQ6d10Wu2+7n1w=', 'Content-Length': '0'} 2024-04-16T17:54:27.830 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000064286b17227d68a0-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.831 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.831 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.831 DEBUG:boto:path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.831 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.831 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.831 DEBUG:boto:Path: /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.831 DEBUG:boto:Data: 2024-04-16T17:54:27.831 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.831 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.832 DEBUG:boto:Params: {} 2024-04-16T17:54:27.832 DEBUG:boto:Token: None 2024-04-16T17:54:27.832 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S4fCP5eag3wtpWQ6d10Wu2+7n1w= 2024-04-16T17:54:27.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S4fCP5eag3wtpWQ6d10Wu2+7n1w=', 'Content-Length': '0'} 2024-04-16T17:54:27.834 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000593fc6bf6f24d3ff-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.835 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.835 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.835 DEBUG:boto:path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.835 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.835 DEBUG:boto:Method: GET 2024-04-16T17:54:27.835 DEBUG:boto:Path: /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.835 DEBUG:boto:Data: 2024-04-16T17:54:27.835 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.836 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.836 DEBUG:boto:Params: {} 2024-04-16T17:54:27.836 DEBUG:boto:Token: None 2024-04-16T17:54:27.836 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs= 2024-04-16T17:54:27.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs=', 'Content-Length': '0'} 2024-04-16T17:54:27.838 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000051e6ac85b6f789b1-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.838 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.839 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.839 DEBUG:boto:path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.839 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.839 DEBUG:boto:Method: GET 2024-04-16T17:54:27.839 DEBUG:boto:Path: /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.839 DEBUG:boto:Data: 2024-04-16T17:54:27.839 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.839 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.839 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.839 DEBUG:boto:Params: {} 2024-04-16T17:54:27.840 DEBUG:boto:Token: None 2024-04-16T17:54:27.840 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL 2024-04-16T17:54:27.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs= 2024-04-16T17:54:27.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+8cRuflnLv5JdSafAQtaMeJ7IZs=', 'Content-Length': '0'} 2024-04-16T17:54:27.842 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'Eoxqu5ek2McGVKPWqPlJlluO-U3qmwL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006c2bacd31e11a530-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.886 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.886 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.887 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.887 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.887 DEBUG:boto:Method: GET 2024-04-16T17:54:27.887 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.887 DEBUG:boto:Data: 2024-04-16T17:54:27.887 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.887 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.887 DEBUG:boto:Params: {} 2024-04-16T17:54:27.888 DEBUG:boto:Token: None 2024-04-16T17:54:27.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e3102202e435aa4-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.891 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.891 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.891 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.891 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.891 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.891 DEBUG:boto:Method: GET 2024-04-16T17:54:27.892 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.892 DEBUG:boto:Data: 2024-04-16T17:54:27.892 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.892 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.892 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.892 DEBUG:boto:Params: {} 2024-04-16T17:54:27.892 DEBUG:boto:Token: None 2024-04-16T17:54:27.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/ 2024-04-16T17:54:27.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM= 2024-04-16T17:54:27.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R/wk8m0J8yGJl56MgrJedit+BNM=', 'Content-Length': '0'} 2024-04-16T17:54:27.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000491434ec76eda36b-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.938 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:27.939 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.939 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.939 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.939 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.939 DEBUG:boto:Data: 2024-04-16T17:54:27.939 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.939 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.939 DEBUG:boto:Params: {} 2024-04-16T17:54:27.940 DEBUG:boto:Token: None 2024-04-16T17:54:27.940 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.944 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000098904410ec8ac7f2-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.944 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.944 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.944 DEBUG:boto:Method: HEAD 2024-04-16T17:54:27.944 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:27.944 DEBUG:boto:Data: 2024-04-16T17:54:27.945 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.945 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.945 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.945 DEBUG:boto:Params: {} 2024-04-16T17:54:27.945 DEBUG:boto:Token: None 2024-04-16T17:54:27.945 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj 2024-04-16T17:54:27.945 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738= 2024-04-16T17:54:27.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9Xh7hU53vYXV3KUSBapIIzLt738=', 'Content-Length': '0'} 2024-04-16T17:54:27.949 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001da55e0130e850fe-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.949 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:27.949 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.949 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.949 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.950 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.950 DEBUG:boto:Method: GET 2024-04-16T17:54:27.950 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.950 DEBUG:boto:Data: 2024-04-16T17:54:27.950 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.950 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.950 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.950 DEBUG:boto:Params: {} 2024-04-16T17:54:27.950 DEBUG:boto:Token: None 2024-04-16T17:54:27.950 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.953 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000043a509080155004b-00661ebb53-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.953 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:27.953 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:27.953 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.954 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.954 DEBUG:boto:Method: GET 2024-04-16T17:54:27.954 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.954 DEBUG:boto:Data: 2024-04-16T17:54:27.954 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.954 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:27.954 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.954 DEBUG:boto:Params: {} 2024-04-16T17:54:27.954 DEBUG:boto:Token: None 2024-04-16T17:54:27.954 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:27 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:27.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw= 2024-04-16T17:54:27.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s776AT2T2CHZj+Z+Bej3h3DALYw=', 'Content-Length': '0'} 2024-04-16T17:54:27.957 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000eb1996c60d90aa85-00661ebb53-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:27.998 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:27.998 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:27.999 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.999 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:27.999 DEBUG:boto:Method: GET 2024-04-16T17:54:27.999 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:27.999 DEBUG:boto:Data: 2024-04-16T17:54:27.999 DEBUG:boto:Headers: {} 2024-04-16T17:54:27.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:27.999 DEBUG:boto:Port: 8000 2024-04-16T17:54:27.999 DEBUG:boto:Params: {} 2024-04-16T17:54:27.999 DEBUG:boto:Token: None 2024-04-16T17:54:28.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.003 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7189ba5c4c65d1b-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.003 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.003 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.003 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.003 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.003 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.004 DEBUG:boto:Method: GET 2024-04-16T17:54:28.004 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.004 DEBUG:boto:Data: 2024-04-16T17:54:28.004 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.004 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.004 DEBUG:boto:Params: {} 2024-04-16T17:54:28.004 DEBUG:boto:Token: None 2024-04-16T17:54:28.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.005 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ef9fa2aff480b81-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.050 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.051 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.051 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.051 DEBUG:boto:path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.051 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.051 DEBUG:boto:Method: GET 2024-04-16T17:54:28.051 DEBUG:boto:Path: /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.051 DEBUG:boto:Data: 2024-04-16T17:54:28.051 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.052 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.052 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.052 DEBUG:boto:Params: {} 2024-04-16T17:54:28.052 DEBUG:boto:Token: None 2024-04-16T17:54:28.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U= 2024-04-16T17:54:28.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U=', 'Content-Length': '0'} 2024-04-16T17:54:28.055 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'rRAocyayeRmdB8IvmApsF26PLzo26tc'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000003c93eef93610543-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.098 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.098 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.098 DEBUG:boto:path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.099 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.099 DEBUG:boto:Method: GET 2024-04-16T17:54:28.099 DEBUG:boto:Path: /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.099 DEBUG:boto:Data: 2024-04-16T17:54:28.099 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.099 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.099 DEBUG:boto:Params: {} 2024-04-16T17:54:28.099 DEBUG:boto:Token: None 2024-04-16T17:54:28.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U= 2024-04-16T17:54:28.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U=', 'Content-Length': '0'} 2024-04-16T17:54:28.101 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'rRAocyayeRmdB8IvmApsF26PLzo26tc'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000717e1b755682cd1f-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.102 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.102 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.102 DEBUG:boto:path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.102 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.102 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.102 DEBUG:boto:Path: /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.102 DEBUG:boto:Data: 2024-04-16T17:54:28.102 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.102 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.102 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.103 DEBUG:boto:Params: {} 2024-04-16T17:54:28.103 DEBUG:boto:Token: None 2024-04-16T17:54:28.103 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZTQBnRro8fWm9ghoRReF1pRjyqU= 2024-04-16T17:54:28.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZTQBnRro8fWm9ghoRReF1pRjyqU=', 'Content-Length': '0'} 2024-04-16T17:54:28.105 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'rRAocyayeRmdB8IvmApsF26PLzo26tc'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003907b6c1eec0d7df-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.106 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.106 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.106 DEBUG:boto:path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.106 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.106 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.106 DEBUG:boto:Path: /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.106 DEBUG:boto:Data: 2024-04-16T17:54:28.106 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.106 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.106 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.107 DEBUG:boto:Params: {} 2024-04-16T17:54:28.107 DEBUG:boto:Token: None 2024-04-16T17:54:28.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZTQBnRro8fWm9ghoRReF1pRjyqU= 2024-04-16T17:54:28.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZTQBnRro8fWm9ghoRReF1pRjyqU=', 'Content-Length': '0'} 2024-04-16T17:54:28.109 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'rRAocyayeRmdB8IvmApsF26PLzo26tc'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c15ca3d24c9f2787-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.109 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.109 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.110 DEBUG:boto:path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.110 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.110 DEBUG:boto:Method: GET 2024-04-16T17:54:28.110 DEBUG:boto:Path: /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.110 DEBUG:boto:Data: 2024-04-16T17:54:28.110 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.110 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.110 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.110 DEBUG:boto:Params: {} 2024-04-16T17:54:28.110 DEBUG:boto:Token: None 2024-04-16T17:54:28.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U= 2024-04-16T17:54:28.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U=', 'Content-Length': '0'} 2024-04-16T17:54:28.113 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'rRAocyayeRmdB8IvmApsF26PLzo26tc'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000018d43424c4065cd0-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.154 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.155 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.155 DEBUG:boto:path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.155 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.155 DEBUG:boto:Method: GET 2024-04-16T17:54:28.155 DEBUG:boto:Path: /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.155 DEBUG:boto:Data: 2024-04-16T17:54:28.155 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.155 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.155 DEBUG:boto:Params: {} 2024-04-16T17:54:28.155 DEBUG:boto:Token: None 2024-04-16T17:54:28.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=rRAocyayeRmdB8IvmApsF26PLzo26tc 2024-04-16T17:54:28.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U= 2024-04-16T17:54:28.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F+76DWcD1+ggBcMI4m1sw/+SF2U=', 'Content-Length': '0'} 2024-04-16T17:54:28.158 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'rRAocyayeRmdB8IvmApsF26PLzo26tc'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b7b23589caebe181-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.158 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.158 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.158 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.158 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.158 DEBUG:boto:Method: GET 2024-04-16T17:54:28.158 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.159 DEBUG:boto:Data: 2024-04-16T17:54:28.159 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.159 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.159 DEBUG:boto:Params: {} 2024-04-16T17:54:28.159 DEBUG:boto:Token: None 2024-04-16T17:54:28.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b543a7b804646a4e-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.162 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.163 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.163 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.163 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.163 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.163 DEBUG:boto:Method: GET 2024-04-16T17:54:28.163 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.163 DEBUG:boto:Data: 2024-04-16T17:54:28.163 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.163 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.163 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.163 DEBUG:boto:Params: {} 2024-04-16T17:54:28.164 DEBUG:boto:Token: None 2024-04-16T17:54:28.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b95fc75a18b57959-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.166 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.167 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.167 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.167 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.167 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.167 DEBUG:boto:Data: 2024-04-16T17:54:28.167 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.167 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.167 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.167 DEBUG:boto:Params: {} 2024-04-16T17:54:28.167 DEBUG:boto:Token: None 2024-04-16T17:54:28.168 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.171 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003411244f5289e62f-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.172 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.172 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.172 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.172 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.172 DEBUG:boto:Data: 2024-04-16T17:54:28.172 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.172 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.172 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.172 DEBUG:boto:Params: {} 2024-04-16T17:54:28.172 DEBUG:boto:Token: None 2024-04-16T17:54:28.172 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.173 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.176 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007aa937278c24edfa-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.177 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.177 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.177 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.177 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.177 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.177 DEBUG:boto:Method: GET 2024-04-16T17:54:28.177 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.177 DEBUG:boto:Data: 2024-04-16T17:54:28.177 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.177 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.178 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.178 DEBUG:boto:Params: {} 2024-04-16T17:54:28.178 DEBUG:boto:Token: None 2024-04-16T17:54:28.178 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.178 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.180 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000042815209665d9c69-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.222 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.222 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.222 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.223 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.223 DEBUG:boto:Method: GET 2024-04-16T17:54:28.223 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.223 DEBUG:boto:Data: 2024-04-16T17:54:28.223 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.223 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.223 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.223 DEBUG:boto:Params: {} 2024-04-16T17:54:28.223 DEBUG:boto:Token: None 2024-04-16T17:54:28.224 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.226 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c40901aa4677d2b5-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.266 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.266 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.267 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.267 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.267 DEBUG:boto:Method: GET 2024-04-16T17:54:28.267 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.267 DEBUG:boto:Data: 2024-04-16T17:54:28.267 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.267 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.267 DEBUG:boto:Params: {} 2024-04-16T17:54:28.268 DEBUG:boto:Token: None 2024-04-16T17:54:28.268 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b70b4b51b0d7ac3-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.271 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.271 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.271 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.271 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.271 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.272 DEBUG:boto:Method: GET 2024-04-16T17:54:28.272 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.272 DEBUG:boto:Data: 2024-04-16T17:54:28.272 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.272 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.272 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.272 DEBUG:boto:Params: {} 2024-04-16T17:54:28.272 DEBUG:boto:Token: None 2024-04-16T17:54:28.272 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.275 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078e043ba337dc7a4-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.318 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.319 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.319 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.319 DEBUG:boto:path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.319 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.319 DEBUG:boto:Method: GET 2024-04-16T17:54:28.319 DEBUG:boto:Path: /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.319 DEBUG:boto:Data: 2024-04-16T17:54:28.319 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.319 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.319 DEBUG:boto:Params: {} 2024-04-16T17:54:28.320 DEBUG:boto:Token: None 2024-04-16T17:54:28.320 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4= 2024-04-16T17:54:28.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4=', 'Content-Length': '0'} 2024-04-16T17:54:28.322 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008aac6da8d1f745fd-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.322 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.322 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.322 DEBUG:boto:path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.322 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.322 DEBUG:boto:Method: GET 2024-04-16T17:54:28.323 DEBUG:boto:Path: /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.323 DEBUG:boto:Data: 2024-04-16T17:54:28.323 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.323 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.323 DEBUG:boto:Params: {} 2024-04-16T17:54:28.323 DEBUG:boto:Token: None 2024-04-16T17:54:28.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4= 2024-04-16T17:54:28.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4=', 'Content-Length': '0'} 2024-04-16T17:54:28.325 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005f82b752ff99df8e-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.366 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.366 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.366 DEBUG:boto:path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.367 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.367 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.367 DEBUG:boto:Path: /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.367 DEBUG:boto:Data: 2024-04-16T17:54:28.367 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.367 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.367 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.367 DEBUG:boto:Params: {} 2024-04-16T17:54:28.367 DEBUG:boto:Token: None 2024-04-16T17:54:28.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIYPC89ccPRdpWZ/KfVYcZ4zlqU= 2024-04-16T17:54:28.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIYPC89ccPRdpWZ/KfVYcZ4zlqU=', 'Content-Length': '0'} 2024-04-16T17:54:28.369 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007145452a306c3891-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.369 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.370 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.370 DEBUG:boto:path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.370 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.370 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.370 DEBUG:boto:Path: /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.370 DEBUG:boto:Data: 2024-04-16T17:54:28.370 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.370 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.370 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.370 DEBUG:boto:Params: {} 2024-04-16T17:54:28.370 DEBUG:boto:Token: None 2024-04-16T17:54:28.371 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIYPC89ccPRdpWZ/KfVYcZ4zlqU= 2024-04-16T17:54:28.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIYPC89ccPRdpWZ/KfVYcZ4zlqU=', 'Content-Length': '0'} 2024-04-16T17:54:28.372 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b9dff6a355f5c19c-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.373 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.373 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.373 DEBUG:boto:path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.373 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.373 DEBUG:boto:Method: GET 2024-04-16T17:54:28.373 DEBUG:boto:Path: /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.374 DEBUG:boto:Data: 2024-04-16T17:54:28.374 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.374 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.374 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.374 DEBUG:boto:Params: {} 2024-04-16T17:54:28.374 DEBUG:boto:Token: None 2024-04-16T17:54:28.374 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.374 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4= 2024-04-16T17:54:28.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4=', 'Content-Length': '0'} 2024-04-16T17:54:28.376 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e19cda80fb2ae5d8-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.376 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.377 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.377 DEBUG:boto:path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.377 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.377 DEBUG:boto:Method: GET 2024-04-16T17:54:28.377 DEBUG:boto:Path: /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.377 DEBUG:boto:Data: 2024-04-16T17:54:28.377 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.377 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.377 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.377 DEBUG:boto:Params: {} 2024-04-16T17:54:28.378 DEBUG:boto:Token: None 2024-04-16T17:54:28.378 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa 2024-04-16T17:54:28.378 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4= 2024-04-16T17:54:28.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BCd23bnpipGoIrrIsmjUx0i5PU4=', 'Content-Length': '0'} 2024-04-16T17:54:28.380 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '8krpup4f0Cg6HoGt4aAFxqi.y-zJLDa'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ee517309116ca230-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.422 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.422 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.423 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.423 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.423 DEBUG:boto:Method: GET 2024-04-16T17:54:28.423 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.423 DEBUG:boto:Data: 2024-04-16T17:54:28.423 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.423 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.423 DEBUG:boto:Params: {} 2024-04-16T17:54:28.423 DEBUG:boto:Token: None 2024-04-16T17:54:28.424 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6a842cfc6d6369d-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.426 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.427 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.427 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.427 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.428 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.428 DEBUG:boto:Method: GET 2024-04-16T17:54:28.428 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.428 DEBUG:boto:Data: 2024-04-16T17:54:28.428 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.428 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.428 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.428 DEBUG:boto:Params: {} 2024-04-16T17:54:28.428 DEBUG:boto:Token: None 2024-04-16T17:54:28.428 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.431 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062eb2f24711cba1c-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.474 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.475 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.475 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.475 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.475 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.475 DEBUG:boto:Data: 2024-04-16T17:54:28.475 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.475 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.475 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.475 DEBUG:boto:Params: {} 2024-04-16T17:54:28.476 DEBUG:boto:Token: None 2024-04-16T17:54:28.476 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.480 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f1e1a551e2d689f2-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.480 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.481 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.481 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.481 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.481 DEBUG:boto:Data: 2024-04-16T17:54:28.481 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.481 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.481 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.481 DEBUG:boto:Params: {} 2024-04-16T17:54:28.481 DEBUG:boto:Token: None 2024-04-16T17:54:28.482 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.482 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.485 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000082a7e35e2de324bb-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.486 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.486 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.486 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.486 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.486 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.486 DEBUG:boto:Method: GET 2024-04-16T17:54:28.486 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.486 DEBUG:boto:Data: 2024-04-16T17:54:28.486 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.487 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.487 DEBUG:boto:Params: {} 2024-04-16T17:54:28.487 DEBUG:boto:Token: None 2024-04-16T17:54:28.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.489 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000e03979ae39e73d4-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.490 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.490 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.490 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.490 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.490 DEBUG:boto:Method: GET 2024-04-16T17:54:28.490 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.490 DEBUG:boto:Data: 2024-04-16T17:54:28.490 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.490 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.491 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.491 DEBUG:boto:Params: {} 2024-04-16T17:54:28.491 DEBUG:boto:Token: None 2024-04-16T17:54:28.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.493 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000072aa9c787364a231-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.534 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.534 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.535 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.535 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.535 DEBUG:boto:Method: GET 2024-04-16T17:54:28.535 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.535 DEBUG:boto:Data: 2024-04-16T17:54:28.535 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.535 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.535 DEBUG:boto:Params: {} 2024-04-16T17:54:28.535 DEBUG:boto:Token: None 2024-04-16T17:54:28.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9f8e4029ea23dd1-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.539 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.539 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.539 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.539 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.539 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.539 DEBUG:boto:Method: GET 2024-04-16T17:54:28.540 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.540 DEBUG:boto:Data: 2024-04-16T17:54:28.540 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.540 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.540 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.540 DEBUG:boto:Params: {} 2024-04-16T17:54:28.540 DEBUG:boto:Token: None 2024-04-16T17:54:28.540 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8264ea6b555afe3-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.543 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.543 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.543 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.544 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.544 DEBUG:boto:path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.544 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.544 DEBUG:boto:Method: GET 2024-04-16T17:54:28.544 DEBUG:boto:Path: /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.544 DEBUG:boto:Data: 2024-04-16T17:54:28.544 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.544 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.544 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.544 DEBUG:boto:Params: {} 2024-04-16T17:54:28.545 DEBUG:boto:Token: None 2024-04-16T17:54:28.545 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M= 2024-04-16T17:54:28.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M=', 'Content-Length': '0'} 2024-04-16T17:54:28.547 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000060baf7b4a2cea323-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.590 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.591 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.591 DEBUG:boto:path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.591 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.591 DEBUG:boto:Method: GET 2024-04-16T17:54:28.591 DEBUG:boto:Path: /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.591 DEBUG:boto:Data: 2024-04-16T17:54:28.591 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.591 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.591 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.591 DEBUG:boto:Params: {} 2024-04-16T17:54:28.592 DEBUG:boto:Token: None 2024-04-16T17:54:28.592 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M= 2024-04-16T17:54:28.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M=', 'Content-Length': '0'} 2024-04-16T17:54:28.594 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000051423266dceea0b8-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.594 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.594 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.595 DEBUG:boto:path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.595 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.595 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.595 DEBUG:boto:Path: /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.595 DEBUG:boto:Data: 2024-04-16T17:54:28.595 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.595 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.595 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.595 DEBUG:boto:Params: {} 2024-04-16T17:54:28.595 DEBUG:boto:Token: None 2024-04-16T17:54:28.596 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gNNGNZ5GxVTDFETbbzYz73CJXrg= 2024-04-16T17:54:28.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gNNGNZ5GxVTDFETbbzYz73CJXrg=', 'Content-Length': '0'} 2024-04-16T17:54:28.598 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a48cd0e59f9c88d0-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.598 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.598 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.598 DEBUG:boto:path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.599 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.599 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.599 DEBUG:boto:Path: /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.599 DEBUG:boto:Data: 2024-04-16T17:54:28.599 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.599 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.600 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.600 DEBUG:boto:Params: {} 2024-04-16T17:54:28.600 DEBUG:boto:Token: None 2024-04-16T17:54:28.600 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.601 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gNNGNZ5GxVTDFETbbzYz73CJXrg= 2024-04-16T17:54:28.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gNNGNZ5GxVTDFETbbzYz73CJXrg=', 'Content-Length': '0'} 2024-04-16T17:54:28.602 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009adfe5d157550d76-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.603 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.603 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.603 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.603 DEBUG:boto:path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.603 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.603 DEBUG:boto:Method: GET 2024-04-16T17:54:28.604 DEBUG:boto:Path: /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.604 DEBUG:boto:Data: 2024-04-16T17:54:28.604 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.604 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.604 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.604 DEBUG:boto:Params: {} 2024-04-16T17:54:28.604 DEBUG:boto:Token: None 2024-04-16T17:54:28.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M= 2024-04-16T17:54:28.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M=', 'Content-Length': '0'} 2024-04-16T17:54:28.606 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f5c09ef69b09e4f7-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.650 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.651 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.651 DEBUG:boto:path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.651 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.651 DEBUG:boto:Method: GET 2024-04-16T17:54:28.651 DEBUG:boto:Path: /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.651 DEBUG:boto:Data: 2024-04-16T17:54:28.651 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.651 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.651 DEBUG:boto:Params: {} 2024-04-16T17:54:28.651 DEBUG:boto:Token: None 2024-04-16T17:54:28.652 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV 2024-04-16T17:54:28.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M= 2024-04-16T17:54:28.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zYQ5bi36B/2RafU3ztzGe/HN7M=', 'Content-Length': '0'} 2024-04-16T17:54:28.654 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'u-0W910MI-SYnp8QNZlQTG3Xr4-dmFV'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e404f0f470be8033-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.654 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.654 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.654 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.655 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.655 DEBUG:boto:Method: GET 2024-04-16T17:54:28.655 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.655 DEBUG:boto:Data: 2024-04-16T17:54:28.655 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.655 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.655 DEBUG:boto:Params: {} 2024-04-16T17:54:28.655 DEBUG:boto:Token: None 2024-04-16T17:54:28.655 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c07f4fa64a924dec-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.659 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.659 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.659 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.659 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.659 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.659 DEBUG:boto:Method: GET 2024-04-16T17:54:28.659 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.659 DEBUG:boto:Data: 2024-04-16T17:54:28.660 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.660 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.660 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.660 DEBUG:boto:Params: {} 2024-04-16T17:54:28.660 DEBUG:boto:Token: None 2024-04-16T17:54:28.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.663 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093b90dfb65a82044-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.663 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.663 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.663 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.663 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.664 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.664 DEBUG:boto:Data: 2024-04-16T17:54:28.664 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.664 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.664 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.664 DEBUG:boto:Params: {} 2024-04-16T17:54:28.664 DEBUG:boto:Token: None 2024-04-16T17:54:28.664 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.668 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000b4f85fdf68e02ac-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.668 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.668 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.668 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.668 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.668 DEBUG:boto:Data: 2024-04-16T17:54:28.669 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.669 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.669 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.669 DEBUG:boto:Params: {} 2024-04-16T17:54:28.669 DEBUG:boto:Token: None 2024-04-16T17:54:28.669 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.669 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.673 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004cd6b75215e1491d-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.673 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.673 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.674 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.674 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.674 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.674 DEBUG:boto:Method: GET 2024-04-16T17:54:28.674 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.674 DEBUG:boto:Data: 2024-04-16T17:54:28.674 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.674 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.675 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.675 DEBUG:boto:Params: {} 2024-04-16T17:54:28.675 DEBUG:boto:Token: None 2024-04-16T17:54:28.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.677 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008597d413cf6b9cb5-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.718 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.718 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.719 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.719 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.719 DEBUG:boto:Method: GET 2024-04-16T17:54:28.719 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.719 DEBUG:boto:Data: 2024-04-16T17:54:28.719 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.719 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.719 DEBUG:boto:Params: {} 2024-04-16T17:54:28.719 DEBUG:boto:Token: None 2024-04-16T17:54:28.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.722 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000f21c43da72e8372-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.762 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.763 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.763 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.763 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.763 DEBUG:boto:Method: GET 2024-04-16T17:54:28.763 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.763 DEBUG:boto:Data: 2024-04-16T17:54:28.763 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.763 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.763 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.763 DEBUG:boto:Params: {} 2024-04-16T17:54:28.763 DEBUG:boto:Token: None 2024-04-16T17:54:28.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.766 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006514f881733bc9dc-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.767 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.767 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.767 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.767 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.767 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.767 DEBUG:boto:Method: GET 2024-04-16T17:54:28.767 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.767 DEBUG:boto:Data: 2024-04-16T17:54:28.768 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.768 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.768 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.768 DEBUG:boto:Params: {} 2024-04-16T17:54:28.768 DEBUG:boto:Token: None 2024-04-16T17:54:28.768 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.771 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5080e33739c42dc-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.814 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.815 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.815 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.815 DEBUG:boto:path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.815 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.815 DEBUG:boto:Method: GET 2024-04-16T17:54:28.815 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.815 DEBUG:boto:Data: 2024-04-16T17:54:28.815 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.816 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.816 DEBUG:boto:Params: {} 2024-04-16T17:54:28.816 DEBUG:boto:Token: None 2024-04-16T17:54:28.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc= 2024-04-16T17:54:28.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc=', 'Content-Length': '0'} 2024-04-16T17:54:28.818 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '2fb-K9ByyRpc7Tzwku5korrvhuw4A.S'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003cea3cd578d797fe-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.862 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.862 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.863 DEBUG:boto:path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.863 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.863 DEBUG:boto:Method: GET 2024-04-16T17:54:28.863 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.863 DEBUG:boto:Data: 2024-04-16T17:54:28.863 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.863 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.863 DEBUG:boto:Params: {} 2024-04-16T17:54:28.863 DEBUG:boto:Token: None 2024-04-16T17:54:28.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc= 2024-04-16T17:54:28.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc=', 'Content-Length': '0'} 2024-04-16T17:54:28.865 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '2fb-K9ByyRpc7Tzwku5korrvhuw4A.S'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001283b098bd6fabde-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.866 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.866 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.866 DEBUG:boto:path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.866 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.866 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.866 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.866 DEBUG:boto:Data: 2024-04-16T17:54:28.866 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.866 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.867 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.867 DEBUG:boto:Params: {} 2024-04-16T17:54:28.867 DEBUG:boto:Token: None 2024-04-16T17:54:28.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m036348dKTGEUVKEhkSHNJoljL0= 2024-04-16T17:54:28.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m036348dKTGEUVKEhkSHNJoljL0=', 'Content-Length': '0'} 2024-04-16T17:54:28.869 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '2fb-K9ByyRpc7Tzwku5korrvhuw4A.S'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004fa1d8fa56d24030-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.869 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.869 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.869 DEBUG:boto:path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.869 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.869 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.870 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.870 DEBUG:boto:Data: 2024-04-16T17:54:28.870 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.870 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.870 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.870 DEBUG:boto:Params: {} 2024-04-16T17:54:28.870 DEBUG:boto:Token: None 2024-04-16T17:54:28.870 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.870 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m036348dKTGEUVKEhkSHNJoljL0= 2024-04-16T17:54:28.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m036348dKTGEUVKEhkSHNJoljL0=', 'Content-Length': '0'} 2024-04-16T17:54:28.872 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '2fb-K9ByyRpc7Tzwku5korrvhuw4A.S'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000834c648e8b8c4ee9-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.872 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.873 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.873 DEBUG:boto:path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.873 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.873 DEBUG:boto:Method: GET 2024-04-16T17:54:28.873 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.873 DEBUG:boto:Data: 2024-04-16T17:54:28.873 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.873 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.873 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.873 DEBUG:boto:Params: {} 2024-04-16T17:54:28.873 DEBUG:boto:Token: None 2024-04-16T17:54:28.873 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.874 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc= 2024-04-16T17:54:28.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc=', 'Content-Length': '0'} 2024-04-16T17:54:28.875 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '2fb-K9ByyRpc7Tzwku5korrvhuw4A.S'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000786019d3f900b6ff-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.918 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.918 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.919 DEBUG:boto:path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.919 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.919 DEBUG:boto:Method: GET 2024-04-16T17:54:28.919 DEBUG:boto:Path: /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.919 DEBUG:boto:Data: 2024-04-16T17:54:28.919 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.919 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.919 DEBUG:boto:Params: {} 2024-04-16T17:54:28.920 DEBUG:boto:Token: None 2024-04-16T17:54:28.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=2fb-K9ByyRpc7Tzwku5korrvhuw4A.S 2024-04-16T17:54:28.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc= 2024-04-16T17:54:28.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N2a3xggB02pie1Uw3w+Cb6dfOTc=', 'Content-Length': '0'} 2024-04-16T17:54:28.921 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '2fb-K9ByyRpc7Tzwku5korrvhuw4A.S'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000657bed93406695d4-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.922 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.922 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.922 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.922 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.922 DEBUG:boto:Method: GET 2024-04-16T17:54:28.922 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.922 DEBUG:boto:Data: 2024-04-16T17:54:28.923 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.923 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.923 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.923 DEBUG:boto:Params: {} 2024-04-16T17:54:28.923 DEBUG:boto:Token: None 2024-04-16T17:54:28.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.926 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8c319ad9e8cf58a-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.926 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.926 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:28.927 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:28.927 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.927 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:28.927 DEBUG:boto:Method: GET 2024-04-16T17:54:28.927 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:28.927 DEBUG:boto:Data: 2024-04-16T17:54:28.927 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.927 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.927 DEBUG:boto:Params: {} 2024-04-16T17:54:28.928 DEBUG:boto:Token: None 2024-04-16T17:54:28.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/ 2024-04-16T17:54:28.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU= 2024-04-16T17:54:28.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0a13Y22CKD3/nIp9YrLLK7iXVU=', 'Content-Length': '0'} 2024-04-16T17:54:28.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040244b8d9d2887ca-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.930 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:28.931 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.931 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.931 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.931 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.931 DEBUG:boto:Data: 2024-04-16T17:54:28.931 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.931 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.931 DEBUG:boto:Params: {} 2024-04-16T17:54:28.932 DEBUG:boto:Token: None 2024-04-16T17:54:28.932 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.935 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ba6bdcaf151e23fe-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.935 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.935 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.935 DEBUG:boto:Method: HEAD 2024-04-16T17:54:28.936 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:28.936 DEBUG:boto:Data: 2024-04-16T17:54:28.936 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.936 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.936 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.936 DEBUG:boto:Params: {} 2024-04-16T17:54:28.936 DEBUG:boto:Token: None 2024-04-16T17:54:28.936 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj 2024-04-16T17:54:28.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso= 2024-04-16T17:54:28.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yvA0UfV0am+ROG27PmbbjNFMyso=', 'Content-Length': '0'} 2024-04-16T17:54:28.940 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001695eddd400f7358-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.940 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:28.940 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.940 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.941 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.941 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.941 DEBUG:boto:Method: GET 2024-04-16T17:54:28.941 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.941 DEBUG:boto:Data: 2024-04-16T17:54:28.941 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.941 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:28.941 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.941 DEBUG:boto:Params: {} 2024-04-16T17:54:28.941 DEBUG:boto:Token: None 2024-04-16T17:54:28.941 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.942 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.944 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000003b8998109e9a7c1-00661ebb54-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:28.986 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:28.986 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:28.987 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.987 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.987 DEBUG:boto:Method: GET 2024-04-16T17:54:28.987 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.987 DEBUG:boto:Data: 2024-04-16T17:54:28.987 DEBUG:boto:Headers: {} 2024-04-16T17:54:28.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:28.987 DEBUG:boto:Port: 8000 2024-04-16T17:54:28.987 DEBUG:boto:Params: {} 2024-04-16T17:54:28.987 DEBUG:boto:Token: None 2024-04-16T17:54:28.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:28 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:28.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U= 2024-04-16T17:54:28.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3sX+ybihguDC5QZlMgAemE928U=', 'Content-Length': '0'} 2024-04-16T17:54:28.989 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009312688e6ed58717-00661ebb54-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.030 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.031 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.031 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.031 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.031 DEBUG:boto:Method: GET 2024-04-16T17:54:29.031 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.031 DEBUG:boto:Data: 2024-04-16T17:54:29.031 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.031 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.031 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.031 DEBUG:boto:Params: {} 2024-04-16T17:54:29.031 DEBUG:boto:Token: None 2024-04-16T17:54:29.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002765492137b3b23e-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.034 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.035 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.035 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.035 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.035 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.035 DEBUG:boto:Method: GET 2024-04-16T17:54:29.035 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.035 DEBUG:boto:Data: 2024-04-16T17:54:29.035 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.036 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.036 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.036 DEBUG:boto:Params: {} 2024-04-16T17:54:29.036 DEBUG:boto:Token: None 2024-04-16T17:54:29.036 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.038 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ed6f606aa0a7d5f-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.082 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.083 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.083 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.083 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.083 DEBUG:boto:path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.084 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.084 DEBUG:boto:Method: GET 2024-04-16T17:54:29.084 DEBUG:boto:Path: /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.084 DEBUG:boto:Data: 2024-04-16T17:54:29.084 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.084 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.084 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.084 DEBUG:boto:Params: {} 2024-04-16T17:54:29.085 DEBUG:boto:Token: None 2024-04-16T17:54:29.085 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.085 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04= 2024-04-16T17:54:29.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04=', 'Content-Length': '0'} 2024-04-16T17:54:29.087 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '3obakRtfs0Ijpsz5FE-v1gRrXHzevrL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005f40c1132b863270-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.087 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.087 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.087 DEBUG:boto:path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.088 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.088 DEBUG:boto:Method: GET 2024-04-16T17:54:29.088 DEBUG:boto:Path: /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.088 DEBUG:boto:Data: 2024-04-16T17:54:29.088 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.088 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.088 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.088 DEBUG:boto:Params: {} 2024-04-16T17:54:29.088 DEBUG:boto:Token: None 2024-04-16T17:54:29.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04= 2024-04-16T17:54:29.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04=', 'Content-Length': '0'} 2024-04-16T17:54:29.091 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '3obakRtfs0Ijpsz5FE-v1gRrXHzevrL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000959642bb21976008-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.134 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.134 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.134 DEBUG:boto:path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.135 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.135 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.135 DEBUG:boto:Path: /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.135 DEBUG:boto:Data: 2024-04-16T17:54:29.135 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.135 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.135 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.135 DEBUG:boto:Params: {} 2024-04-16T17:54:29.135 DEBUG:boto:Token: None 2024-04-16T17:54:29.135 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x/+ZDbM5nSUue5d9V52sOH7xnQ8= 2024-04-16T17:54:29.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x/+ZDbM5nSUue5d9V52sOH7xnQ8=', 'Content-Length': '0'} 2024-04-16T17:54:29.137 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '3obakRtfs0Ijpsz5FE-v1gRrXHzevrL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000223e0aa6a562ee0c-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.138 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.138 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.138 DEBUG:boto:path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.138 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.138 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.138 DEBUG:boto:Path: /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.138 DEBUG:boto:Data: 2024-04-16T17:54:29.138 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.139 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.139 DEBUG:boto:Params: {} 2024-04-16T17:54:29.139 DEBUG:boto:Token: None 2024-04-16T17:54:29.139 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x/+ZDbM5nSUue5d9V52sOH7xnQ8= 2024-04-16T17:54:29.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x/+ZDbM5nSUue5d9V52sOH7xnQ8=', 'Content-Length': '0'} 2024-04-16T17:54:29.141 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '3obakRtfs0Ijpsz5FE-v1gRrXHzevrL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003ec2fe8eeca18602-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.142 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.142 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.142 DEBUG:boto:path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.142 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.142 DEBUG:boto:Method: GET 2024-04-16T17:54:29.142 DEBUG:boto:Path: /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.142 DEBUG:boto:Data: 2024-04-16T17:54:29.142 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.142 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.142 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.142 DEBUG:boto:Params: {} 2024-04-16T17:54:29.143 DEBUG:boto:Token: None 2024-04-16T17:54:29.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04= 2024-04-16T17:54:29.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04=', 'Content-Length': '0'} 2024-04-16T17:54:29.145 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '3obakRtfs0Ijpsz5FE-v1gRrXHzevrL'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000017cdcd51318e6820-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.145 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.145 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.146 DEBUG:boto:path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.146 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.146 DEBUG:boto:Method: GET 2024-04-16T17:54:29.146 DEBUG:boto:Path: /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.146 DEBUG:boto:Data: 2024-04-16T17:54:29.146 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.146 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.146 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.146 DEBUG:boto:Params: {} 2024-04-16T17:54:29.146 DEBUG:boto:Token: None 2024-04-16T17:54:29.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=3obakRtfs0Ijpsz5FE-v1gRrXHzevrL 2024-04-16T17:54:29.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04= 2024-04-16T17:54:29.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xkl/pg6QUlo9zJjbQogw/VyDd04=', 'Content-Length': '0'} 2024-04-16T17:54:29.149 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '3obakRtfs0Ijpsz5FE-v1gRrXHzevrL'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002383180e5934c5c4-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.190 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.190 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.191 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.191 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.191 DEBUG:boto:Method: GET 2024-04-16T17:54:29.191 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.191 DEBUG:boto:Data: 2024-04-16T17:54:29.191 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.191 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.191 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.191 DEBUG:boto:Params: {} 2024-04-16T17:54:29.191 DEBUG:boto:Token: None 2024-04-16T17:54:29.191 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009b23b1001be8e38-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.194 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.195 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.195 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.195 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.195 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.195 DEBUG:boto:Method: GET 2024-04-16T17:54:29.195 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.195 DEBUG:boto:Data: 2024-04-16T17:54:29.195 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.195 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.196 DEBUG:boto:Params: {} 2024-04-16T17:54:29.196 DEBUG:boto:Token: None 2024-04-16T17:54:29.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dd875cdc4db8c58-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.242 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.243 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.243 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.243 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.243 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:29.243 DEBUG:boto:Data: 2024-04-16T17:54:29.243 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.243 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.243 DEBUG:boto:Params: {} 2024-04-16T17:54:29.244 DEBUG:boto:Token: None 2024-04-16T17:54:29.244 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj 2024-04-16T17:54:29.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU= 2024-04-16T17:54:29.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU=', 'Content-Length': '0'} 2024-04-16T17:54:29.247 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000007cabac2fe2be1dff-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.247 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.247 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.247 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.248 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:29.248 DEBUG:boto:Data: 2024-04-16T17:54:29.248 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.248 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.248 DEBUG:boto:Params: {} 2024-04-16T17:54:29.248 DEBUG:boto:Token: None 2024-04-16T17:54:29.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj 2024-04-16T17:54:29.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU= 2024-04-16T17:54:29.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU=', 'Content-Length': '0'} 2024-04-16T17:54:29.251 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c5317ffbd4d00bf4-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.252 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.252 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.252 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.252 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.252 DEBUG:boto:Method: GET 2024-04-16T17:54:29.252 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.252 DEBUG:boto:Data: 2024-04-16T17:54:29.252 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.252 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.252 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.253 DEBUG:boto:Params: {} 2024-04-16T17:54:29.253 DEBUG:boto:Token: None 2024-04-16T17:54:29.253 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo= 2024-04-16T17:54:29.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo=', 'Content-Length': '0'} 2024-04-16T17:54:29.255 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002bb218b54420736f-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.256 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.256 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.256 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.256 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.256 DEBUG:boto:Method: GET 2024-04-16T17:54:29.256 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.256 DEBUG:boto:Data: 2024-04-16T17:54:29.256 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.256 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.256 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.256 DEBUG:boto:Params: {} 2024-04-16T17:54:29.257 DEBUG:boto:Token: None 2024-04-16T17:54:29.257 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.257 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo= 2024-04-16T17:54:29.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo=', 'Content-Length': '0'} 2024-04-16T17:54:29.259 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c7c66cd849115bd7-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.302 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.303 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.303 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.303 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.303 DEBUG:boto:Method: GET 2024-04-16T17:54:29.303 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.303 DEBUG:boto:Data: 2024-04-16T17:54:29.303 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.303 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.304 DEBUG:boto:Params: {} 2024-04-16T17:54:29.304 DEBUG:boto:Token: None 2024-04-16T17:54:29.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.307 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d23200395894e537-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.307 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.307 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.307 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.308 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.308 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.308 DEBUG:boto:Method: GET 2024-04-16T17:54:29.308 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.308 DEBUG:boto:Data: 2024-04-16T17:54:29.308 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.308 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.308 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.308 DEBUG:boto:Params: {} 2024-04-16T17:54:29.308 DEBUG:boto:Token: None 2024-04-16T17:54:29.309 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000283294a580b119d-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.354 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.355 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.355 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.355 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.355 DEBUG:boto:path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.355 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.355 DEBUG:boto:Method: GET 2024-04-16T17:54:29.355 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.355 DEBUG:boto:Data: 2024-04-16T17:54:29.355 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.356 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.356 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.356 DEBUG:boto:Params: {} 2024-04-16T17:54:29.356 DEBUG:boto:Token: None 2024-04-16T17:54:29.356 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY= 2024-04-16T17:54:29.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY=', 'Content-Length': '0'} 2024-04-16T17:54:29.359 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '-aHIUiyjmFhuHE47MSVsxlWPcDikiwe'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000029114e57ba181936-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.402 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.402 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.402 DEBUG:boto:path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.403 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.403 DEBUG:boto:Method: GET 2024-04-16T17:54:29.403 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.403 DEBUG:boto:Data: 2024-04-16T17:54:29.403 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.403 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.403 DEBUG:boto:Params: {} 2024-04-16T17:54:29.403 DEBUG:boto:Token: None 2024-04-16T17:54:29.404 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY= 2024-04-16T17:54:29.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY=', 'Content-Length': '0'} 2024-04-16T17:54:29.406 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '-aHIUiyjmFhuHE47MSVsxlWPcDikiwe'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f4a12f79b1e6f454-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.406 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.406 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.406 DEBUG:boto:path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.407 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.407 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.407 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.407 DEBUG:boto:Data: 2024-04-16T17:54:29.407 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.407 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.407 DEBUG:boto:Params: {} 2024-04-16T17:54:29.407 DEBUG:boto:Token: None 2024-04-16T17:54:29.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YbMdsKKWrHCCXITDyu8VFdVfsoQ= 2024-04-16T17:54:29.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YbMdsKKWrHCCXITDyu8VFdVfsoQ=', 'Content-Length': '0'} 2024-04-16T17:54:29.409 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '-aHIUiyjmFhuHE47MSVsxlWPcDikiwe'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000073f44be1877412dd-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.410 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.410 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.410 DEBUG:boto:path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.410 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.410 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.410 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.410 DEBUG:boto:Data: 2024-04-16T17:54:29.411 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.411 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.411 DEBUG:boto:Params: {} 2024-04-16T17:54:29.411 DEBUG:boto:Token: None 2024-04-16T17:54:29.411 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YbMdsKKWrHCCXITDyu8VFdVfsoQ= 2024-04-16T17:54:29.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YbMdsKKWrHCCXITDyu8VFdVfsoQ=', 'Content-Length': '0'} 2024-04-16T17:54:29.413 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '-aHIUiyjmFhuHE47MSVsxlWPcDikiwe'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000051ca181f8ec47218-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.414 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.414 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.414 DEBUG:boto:path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.414 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.414 DEBUG:boto:Method: GET 2024-04-16T17:54:29.414 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.414 DEBUG:boto:Data: 2024-04-16T17:54:29.414 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.414 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.414 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.415 DEBUG:boto:Params: {} 2024-04-16T17:54:29.415 DEBUG:boto:Token: None 2024-04-16T17:54:29.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY= 2024-04-16T17:54:29.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY=', 'Content-Length': '0'} 2024-04-16T17:54:29.417 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '-aHIUiyjmFhuHE47MSVsxlWPcDikiwe'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b723a8d8afb8a2c5-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.458 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.458 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.459 DEBUG:boto:path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.459 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.459 DEBUG:boto:Method: GET 2024-04-16T17:54:29.459 DEBUG:boto:Path: /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.459 DEBUG:boto:Data: 2024-04-16T17:54:29.459 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.459 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.459 DEBUG:boto:Params: {} 2024-04-16T17:54:29.459 DEBUG:boto:Token: None 2024-04-16T17:54:29.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=-aHIUiyjmFhuHE47MSVsxlWPcDikiwe 2024-04-16T17:54:29.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY= 2024-04-16T17:54:29.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:twQ+2xoEFPQU20ZzEtovDPu6dLY=', 'Content-Length': '0'} 2024-04-16T17:54:29.462 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '-aHIUiyjmFhuHE47MSVsxlWPcDikiwe'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e3e1c61ee7a89c32-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.462 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.462 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.462 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.462 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.462 DEBUG:boto:Method: GET 2024-04-16T17:54:29.463 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.463 DEBUG:boto:Data: 2024-04-16T17:54:29.463 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.463 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.463 DEBUG:boto:Params: {} 2024-04-16T17:54:29.463 DEBUG:boto:Token: None 2024-04-16T17:54:29.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.466 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d545d27a610d27c-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.506 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.507 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.507 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.507 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.507 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.507 DEBUG:boto:Method: GET 2024-04-16T17:54:29.507 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.507 DEBUG:boto:Data: 2024-04-16T17:54:29.507 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.508 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.508 DEBUG:boto:Params: {} 2024-04-16T17:54:29.508 DEBUG:boto:Token: None 2024-04-16T17:54:29.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.511 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cee2b75cd160fc95-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.511 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.511 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.511 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.511 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.512 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:29.512 DEBUG:boto:Data: 2024-04-16T17:54:29.512 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.512 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.512 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.512 DEBUG:boto:Params: {} 2024-04-16T17:54:29.512 DEBUG:boto:Token: None 2024-04-16T17:54:29.512 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj 2024-04-16T17:54:29.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU= 2024-04-16T17:54:29.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU=', 'Content-Length': '0'} 2024-04-16T17:54:29.516 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005f22eee7605aed99-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.516 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.517 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.517 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.517 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:29.517 DEBUG:boto:Data: 2024-04-16T17:54:29.517 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.517 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.517 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.517 DEBUG:boto:Params: {} 2024-04-16T17:54:29.517 DEBUG:boto:Token: None 2024-04-16T17:54:29.517 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj 2024-04-16T17:54:29.517 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU= 2024-04-16T17:54:29.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU=', 'Content-Length': '0'} 2024-04-16T17:54:29.521 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e6e358d89432370c-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.521 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.521 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.522 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.522 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.522 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.522 DEBUG:boto:Method: GET 2024-04-16T17:54:29.522 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.522 DEBUG:boto:Data: 2024-04-16T17:54:29.522 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.522 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.522 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.522 DEBUG:boto:Params: {} 2024-04-16T17:54:29.522 DEBUG:boto:Token: None 2024-04-16T17:54:29.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo= 2024-04-16T17:54:29.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo=', 'Content-Length': '0'} 2024-04-16T17:54:29.525 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000793383c9e5563af4-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.525 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.525 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.525 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.525 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.525 DEBUG:boto:Method: GET 2024-04-16T17:54:29.525 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.526 DEBUG:boto:Data: 2024-04-16T17:54:29.526 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.526 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.526 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.526 DEBUG:boto:Params: {} 2024-04-16T17:54:29.526 DEBUG:boto:Token: None 2024-04-16T17:54:29.526 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.526 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo= 2024-04-16T17:54:29.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo=', 'Content-Length': '0'} 2024-04-16T17:54:29.528 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e546e5cd8e1a5337-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.570 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.570 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.571 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.571 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.571 DEBUG:boto:Method: GET 2024-04-16T17:54:29.571 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.571 DEBUG:boto:Data: 2024-04-16T17:54:29.571 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.571 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.571 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.571 DEBUG:boto:Params: {} 2024-04-16T17:54:29.571 DEBUG:boto:Token: None 2024-04-16T17:54:29.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008449a2d76b9f6a61-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.574 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.575 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.575 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.575 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.575 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.575 DEBUG:boto:Method: GET 2024-04-16T17:54:29.575 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.575 DEBUG:boto:Data: 2024-04-16T17:54:29.576 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.576 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.576 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.576 DEBUG:boto:Params: {} 2024-04-16T17:54:29.576 DEBUG:boto:Token: None 2024-04-16T17:54:29.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.578 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000058571a4e1ba4e5c-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.622 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.623 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.623 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.623 DEBUG:boto:path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.623 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.623 DEBUG:boto:Method: GET 2024-04-16T17:54:29.623 DEBUG:boto:Path: /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.623 DEBUG:boto:Data: 2024-04-16T17:54:29.623 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.623 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.624 DEBUG:boto:Params: {} 2024-04-16T17:54:29.624 DEBUG:boto:Token: None 2024-04-16T17:54:29.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg= 2024-04-16T17:54:29.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg=', 'Content-Length': '0'} 2024-04-16T17:54:29.626 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ba235209e133a102-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.627 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.627 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.627 DEBUG:boto:path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.627 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.627 DEBUG:boto:Method: GET 2024-04-16T17:54:29.627 DEBUG:boto:Path: /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.627 DEBUG:boto:Data: 2024-04-16T17:54:29.627 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.628 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.628 DEBUG:boto:Params: {} 2024-04-16T17:54:29.628 DEBUG:boto:Token: None 2024-04-16T17:54:29.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg= 2024-04-16T17:54:29.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg=', 'Content-Length': '0'} 2024-04-16T17:54:29.631 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000014be0b3ebeb0d423-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.674 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.674 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.675 DEBUG:boto:path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.675 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.675 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.675 DEBUG:boto:Path: /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.675 DEBUG:boto:Data: 2024-04-16T17:54:29.675 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.675 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.675 DEBUG:boto:Params: {} 2024-04-16T17:54:29.675 DEBUG:boto:Token: None 2024-04-16T17:54:29.676 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vLDNe9t8jzhx+ebkeGVibOEGKyI= 2024-04-16T17:54:29.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLDNe9t8jzhx+ebkeGVibOEGKyI=', 'Content-Length': '0'} 2024-04-16T17:54:29.678 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000006ce4ee5c2027b288-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.678 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.678 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.678 DEBUG:boto:path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.678 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.678 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.679 DEBUG:boto:Path: /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.679 DEBUG:boto:Data: 2024-04-16T17:54:29.679 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.679 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.679 DEBUG:boto:Params: {} 2024-04-16T17:54:29.679 DEBUG:boto:Token: None 2024-04-16T17:54:29.679 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vLDNe9t8jzhx+ebkeGVibOEGKyI= 2024-04-16T17:54:29.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLDNe9t8jzhx+ebkeGVibOEGKyI=', 'Content-Length': '0'} 2024-04-16T17:54:29.681 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000009a0e758b6e56c663-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.682 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.682 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.682 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.682 DEBUG:boto:path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.682 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.682 DEBUG:boto:Method: GET 2024-04-16T17:54:29.682 DEBUG:boto:Path: /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.682 DEBUG:boto:Data: 2024-04-16T17:54:29.683 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.683 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.683 DEBUG:boto:Params: {} 2024-04-16T17:54:29.683 DEBUG:boto:Token: None 2024-04-16T17:54:29.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg= 2024-04-16T17:54:29.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg=', 'Content-Length': '0'} 2024-04-16T17:54:29.685 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fe8132b6ae502517-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.686 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.686 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.686 DEBUG:boto:path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.686 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.686 DEBUG:boto:Method: GET 2024-04-16T17:54:29.686 DEBUG:boto:Path: /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.686 DEBUG:boto:Data: 2024-04-16T17:54:29.686 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.686 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.687 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.687 DEBUG:boto:Params: {} 2024-04-16T17:54:29.687 DEBUG:boto:Token: None 2024-04-16T17:54:29.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2 2024-04-16T17:54:29.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg= 2024-04-16T17:54:29.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZqhOkqxPwl78HRibi13zYbCJakg=', 'Content-Length': '0'} 2024-04-16T17:54:29.689 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', '6wnUivQlftaQHgWaHaxGKzp8w-x0Hb2'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b4e89d69d3cd8565-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.730 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.730 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.731 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.731 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.731 DEBUG:boto:Method: GET 2024-04-16T17:54:29.731 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.731 DEBUG:boto:Data: 2024-04-16T17:54:29.731 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.731 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.731 DEBUG:boto:Params: {} 2024-04-16T17:54:29.731 DEBUG:boto:Token: None 2024-04-16T17:54:29.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.734 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a5839e5a3217919-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.734 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.735 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.735 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.735 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.735 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.735 DEBUG:boto:Method: GET 2024-04-16T17:54:29.735 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.735 DEBUG:boto:Data: 2024-04-16T17:54:29.735 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.735 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.736 DEBUG:boto:Params: {} 2024-04-16T17:54:29.736 DEBUG:boto:Token: None 2024-04-16T17:54:29.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.738 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023a32d86cd77a43a-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.782 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.783 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.783 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.783 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.783 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:29.783 DEBUG:boto:Data: 2024-04-16T17:54:29.783 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.783 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.783 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.783 DEBUG:boto:Params: {} 2024-04-16T17:54:29.783 DEBUG:boto:Token: None 2024-04-16T17:54:29.784 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj 2024-04-16T17:54:29.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU= 2024-04-16T17:54:29.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU=', 'Content-Length': '0'} 2024-04-16T17:54:29.787 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005217101c07ea56e4-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.787 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.787 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.787 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.788 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:29.788 DEBUG:boto:Data: 2024-04-16T17:54:29.788 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.788 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.788 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.788 DEBUG:boto:Params: {} 2024-04-16T17:54:29.788 DEBUG:boto:Token: None 2024-04-16T17:54:29.788 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj 2024-04-16T17:54:29.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU= 2024-04-16T17:54:29.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BGYZCc2b+Elvw7byWtVzBU0VFrU=', 'Content-Length': '0'} 2024-04-16T17:54:29.792 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008af03ed7999ccad9-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.792 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.792 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.792 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.792 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.792 DEBUG:boto:Method: GET 2024-04-16T17:54:29.793 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.793 DEBUG:boto:Data: 2024-04-16T17:54:29.793 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.793 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.793 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.793 DEBUG:boto:Params: {} 2024-04-16T17:54:29.793 DEBUG:boto:Token: None 2024-04-16T17:54:29.793 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.793 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo= 2024-04-16T17:54:29.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo=', 'Content-Length': '0'} 2024-04-16T17:54:29.795 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cd79efeacb07fe2f-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.838 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.838 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.839 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.839 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.839 DEBUG:boto:Method: GET 2024-04-16T17:54:29.839 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.839 DEBUG:boto:Data: 2024-04-16T17:54:29.839 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.839 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.839 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.839 DEBUG:boto:Params: {} 2024-04-16T17:54:29.839 DEBUG:boto:Token: None 2024-04-16T17:54:29.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:29.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo= 2024-04-16T17:54:29.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3UktwAZZgLaMHyw8t+0k9KNtjTo=', 'Content-Length': '0'} 2024-04-16T17:54:29.842 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000fba1bed7016d0364-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.882 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.882 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.882 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.883 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.883 DEBUG:boto:Method: GET 2024-04-16T17:54:29.883 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.883 DEBUG:boto:Data: 2024-04-16T17:54:29.883 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.883 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.883 DEBUG:boto:Params: {} 2024-04-16T17:54:29.883 DEBUG:boto:Token: None 2024-04-16T17:54:29.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d11a9d3a9029c962-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.886 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.886 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:29.887 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:29.887 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.887 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:29.887 DEBUG:boto:Method: GET 2024-04-16T17:54:29.887 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:29.887 DEBUG:boto:Data: 2024-04-16T17:54:29.887 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.887 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.887 DEBUG:boto:Params: {} 2024-04-16T17:54:29.888 DEBUG:boto:Token: None 2024-04-16T17:54:29.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/ 2024-04-16T17:54:29.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo= 2024-04-16T17:54:29.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UxKHyylx7nHxX+qDPmVkO/a1mo=', 'Content-Length': '0'} 2024-04-16T17:54:29.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001bf420dd816336d9-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.934 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:29.935 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.935 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.935 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.935 DEBUG:boto:path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.935 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.935 DEBUG:boto:Method: GET 2024-04-16T17:54:29.935 DEBUG:boto:Path: /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.935 DEBUG:boto:Data: 2024-04-16T17:54:29.935 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.935 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.935 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.936 DEBUG:boto:Params: {} 2024-04-16T17:54:29.936 DEBUG:boto:Token: None 2024-04-16T17:54:29.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1cOJikX+NehHCrbusLnUBSo2YRU= 2024-04-16T17:54:29.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1cOJikX+NehHCrbusLnUBSo2YRU=', 'Content-Length': '0'} 2024-04-16T17:54:29.938 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d2592e397072315f-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.978 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.978 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.979 DEBUG:boto:path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.979 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.979 DEBUG:boto:Method: GET 2024-04-16T17:54:29.979 DEBUG:boto:Path: /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.979 DEBUG:boto:Data: 2024-04-16T17:54:29.979 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.979 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.979 DEBUG:boto:Params: {} 2024-04-16T17:54:29.979 DEBUG:boto:Token: None 2024-04-16T17:54:29.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1cOJikX+NehHCrbusLnUBSo2YRU= 2024-04-16T17:54:29.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1cOJikX+NehHCrbusLnUBSo2YRU=', 'Content-Length': '0'} 2024-04-16T17:54:29.981 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008152947ba3dc6e64-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.982 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.982 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.982 DEBUG:boto:path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.982 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.982 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.982 DEBUG:boto:Path: /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.982 DEBUG:boto:Data: 2024-04-16T17:54:29.982 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.983 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.983 DEBUG:boto:Params: {} 2024-04-16T17:54:29.983 DEBUG:boto:Token: None 2024-04-16T17:54:29.983 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kuG4wgI/+kxwIIxBbu2xXVlUrwU= 2024-04-16T17:54:29.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kuG4wgI/+kxwIIxBbu2xXVlUrwU=', 'Content-Length': '0'} 2024-04-16T17:54:29.985 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000037fcfbbfa3f4c23a-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.985 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.985 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.985 DEBUG:boto:path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.986 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.986 DEBUG:boto:Method: HEAD 2024-04-16T17:54:29.986 DEBUG:boto:Path: /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.986 DEBUG:boto:Data: 2024-04-16T17:54:29.986 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.986 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:29.986 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.986 DEBUG:boto:Params: {} 2024-04-16T17:54:29.986 DEBUG:boto:Token: None 2024-04-16T17:54:29.986 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kuG4wgI/+kxwIIxBbu2xXVlUrwU= 2024-04-16T17:54:29.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kuG4wgI/+kxwIIxBbu2xXVlUrwU=', 'Content-Length': '0'} 2024-04-16T17:54:29.989 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e652c85bf078bcfb-00661ebb55-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:29.989 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:29.989 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:29.990 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:29.990 DEBUG:boto:path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.990 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.990 DEBUG:boto:Method: GET 2024-04-16T17:54:29.990 DEBUG:boto:Path: /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.990 DEBUG:boto:Data: 2024-04-16T17:54:29.990 DEBUG:boto:Headers: {} 2024-04-16T17:54:29.990 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:29.990 DEBUG:boto:Port: 8000 2024-04-16T17:54:29.990 DEBUG:boto:Params: {} 2024-04-16T17:54:29.991 DEBUG:boto:Token: None 2024-04-16T17:54:29.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:29 GMT /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:29.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1cOJikX+NehHCrbusLnUBSo2YRU= 2024-04-16T17:54:29.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1cOJikX+NehHCrbusLnUBSo2YRU=', 'Content-Length': '0'} 2024-04-16T17:54:29.993 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e2912255c28967bf-00661ebb55-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.034 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.034 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.035 DEBUG:boto:path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:30.035 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:30.035 DEBUG:boto:Method: GET 2024-04-16T17:54:30.035 DEBUG:boto:Path: /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:30.035 DEBUG:boto:Data: 2024-04-16T17:54:30.035 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.035 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.035 DEBUG:boto:Params: {} 2024-04-16T17:54:30.035 DEBUG:boto:Token: None 2024-04-16T17:54:30.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk 2024-04-16T17:54:30.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RE/cOThZxfoSFppsRxFd1WDER4U= 2024-04-16T17:54:30.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RE/cOThZxfoSFppsRxFd1WDER4U=', 'Content-Length': '0'} 2024-04-16T17:54:30.038 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'E57QjKZ1k9Cp9vGCtIWKujXW8fM3RAk'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b4892f0de2be8a6b-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.038 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.038 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.038 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.038 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.039 DEBUG:boto:Method: GET 2024-04-16T17:54:30.039 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.039 DEBUG:boto:Data: 2024-04-16T17:54:30.039 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.039 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.039 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.039 DEBUG:boto:Params: {} 2024-04-16T17:54:30.039 DEBUG:boto:Token: None 2024-04-16T17:54:30.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004debfaf347a239c3-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.042 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.042 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.043 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.043 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.043 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.043 DEBUG:boto:Method: GET 2024-04-16T17:54:30.043 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.043 DEBUG:boto:Data: 2024-04-16T17:54:30.043 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.043 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.043 DEBUG:boto:Params: {} 2024-04-16T17:54:30.044 DEBUG:boto:Token: None 2024-04-16T17:54:30.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c247d14fe8e1873f-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.046 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.047 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.047 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.047 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.047 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.047 DEBUG:boto:Data: 2024-04-16T17:54:30.047 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.047 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.048 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.048 DEBUG:boto:Params: {} 2024-04-16T17:54:30.048 DEBUG:boto:Token: None 2024-04-16T17:54:30.048 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.052 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000157d3bc0cbc7607b-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.052 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.052 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.052 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.053 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.053 DEBUG:boto:Data: 2024-04-16T17:54:30.053 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.053 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.053 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.053 DEBUG:boto:Params: {} 2024-04-16T17:54:30.053 DEBUG:boto:Token: None 2024-04-16T17:54:30.053 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.053 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.057 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b1b21b0a8154f3fe-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.057 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.057 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.057 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.057 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.057 DEBUG:boto:Method: GET 2024-04-16T17:54:30.058 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.058 DEBUG:boto:Data: 2024-04-16T17:54:30.058 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.058 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.058 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.058 DEBUG:boto:Params: {} 2024-04-16T17:54:30.058 DEBUG:boto:Token: None 2024-04-16T17:54:30.058 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.058 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.060 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000026d938a962c986fe-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.102 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.102 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.103 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.103 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.103 DEBUG:boto:Method: GET 2024-04-16T17:54:30.103 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.103 DEBUG:boto:Data: 2024-04-16T17:54:30.103 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.103 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.103 DEBUG:boto:Params: {} 2024-04-16T17:54:30.103 DEBUG:boto:Token: None 2024-04-16T17:54:30.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.105 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.107 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000002dbef2f36f85871b-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.150 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.150 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.151 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.151 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.151 DEBUG:boto:Method: GET 2024-04-16T17:54:30.151 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.151 DEBUG:boto:Data: 2024-04-16T17:54:30.151 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.151 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.151 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.151 DEBUG:boto:Params: {} 2024-04-16T17:54:30.151 DEBUG:boto:Token: None 2024-04-16T17:54:30.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.154 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acd0c08cc6e24c90-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.154 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.155 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.155 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.155 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.155 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.155 DEBUG:boto:Method: GET 2024-04-16T17:54:30.155 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.155 DEBUG:boto:Data: 2024-04-16T17:54:30.155 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.155 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.155 DEBUG:boto:Params: {} 2024-04-16T17:54:30.156 DEBUG:boto:Token: None 2024-04-16T17:54:30.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.158 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ab17f0f6b54fc31-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.202 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.202 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.203 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.203 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.203 DEBUG:boto:path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.203 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.203 DEBUG:boto:Method: GET 2024-04-16T17:54:30.203 DEBUG:boto:Path: /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.203 DEBUG:boto:Data: 2024-04-16T17:54:30.203 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.203 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.203 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.203 DEBUG:boto:Params: {} 2024-04-16T17:54:30.204 DEBUG:boto:Token: None 2024-04-16T17:54:30.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8= 2024-04-16T17:54:30.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8=', 'Content-Length': '0'} 2024-04-16T17:54:30.206 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'VwizYqBwWwCzmZWE47pL-WKkYURTerJ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000cc9bc017d855314d-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.206 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.206 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.206 DEBUG:boto:path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.207 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.207 DEBUG:boto:Method: GET 2024-04-16T17:54:30.207 DEBUG:boto:Path: /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.207 DEBUG:boto:Data: 2024-04-16T17:54:30.207 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.207 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.207 DEBUG:boto:Params: {} 2024-04-16T17:54:30.207 DEBUG:boto:Token: None 2024-04-16T17:54:30.207 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8= 2024-04-16T17:54:30.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8=', 'Content-Length': '0'} 2024-04-16T17:54:30.210 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'VwizYqBwWwCzmZWE47pL-WKkYURTerJ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000014bb8b5df687ba16-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.250 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.250 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.250 DEBUG:boto:path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.251 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.251 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.251 DEBUG:boto:Path: /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.251 DEBUG:boto:Data: 2024-04-16T17:54:30.251 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.251 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.251 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.251 DEBUG:boto:Params: {} 2024-04-16T17:54:30.251 DEBUG:boto:Token: None 2024-04-16T17:54:30.251 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6vsIh6GFgHBhAXM3aIdhjTU+QdA= 2024-04-16T17:54:30.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6vsIh6GFgHBhAXM3aIdhjTU+QdA=', 'Content-Length': '0'} 2024-04-16T17:54:30.253 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'VwizYqBwWwCzmZWE47pL-WKkYURTerJ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000d762be8b4a0fe43e-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.253 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.254 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.254 DEBUG:boto:path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.254 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.254 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.254 DEBUG:boto:Path: /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.254 DEBUG:boto:Data: 2024-04-16T17:54:30.254 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.254 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.254 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.254 DEBUG:boto:Params: {} 2024-04-16T17:54:30.255 DEBUG:boto:Token: None 2024-04-16T17:54:30.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6vsIh6GFgHBhAXM3aIdhjTU+QdA= 2024-04-16T17:54:30.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6vsIh6GFgHBhAXM3aIdhjTU+QdA=', 'Content-Length': '0'} 2024-04-16T17:54:30.256 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'VwizYqBwWwCzmZWE47pL-WKkYURTerJ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ffd8623faed6ff11-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.257 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.257 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.257 DEBUG:boto:path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.257 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.257 DEBUG:boto:Method: GET 2024-04-16T17:54:30.257 DEBUG:boto:Path: /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.257 DEBUG:boto:Data: 2024-04-16T17:54:30.257 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.257 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.257 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.258 DEBUG:boto:Params: {} 2024-04-16T17:54:30.258 DEBUG:boto:Token: None 2024-04-16T17:54:30.258 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8= 2024-04-16T17:54:30.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8=', 'Content-Length': '0'} 2024-04-16T17:54:30.260 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'VwizYqBwWwCzmZWE47pL-WKkYURTerJ'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f237c72e8f102987-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.260 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.260 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.260 DEBUG:boto:path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.260 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.260 DEBUG:boto:Method: GET 2024-04-16T17:54:30.261 DEBUG:boto:Path: /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.261 DEBUG:boto:Data: 2024-04-16T17:54:30.261 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.261 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.261 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.261 DEBUG:boto:Params: {} 2024-04-16T17:54:30.261 DEBUG:boto:Token: None 2024-04-16T17:54:30.261 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=VwizYqBwWwCzmZWE47pL-WKkYURTerJ 2024-04-16T17:54:30.261 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8= 2024-04-16T17:54:30.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lnSwQKITuJa5tdbY73Rd+e7IaI8=', 'Content-Length': '0'} 2024-04-16T17:54:30.263 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'VwizYqBwWwCzmZWE47pL-WKkYURTerJ'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000082358fe90c222574-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.306 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.306 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.307 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.307 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.307 DEBUG:boto:Method: GET 2024-04-16T17:54:30.307 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.307 DEBUG:boto:Data: 2024-04-16T17:54:30.307 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.307 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.307 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.307 DEBUG:boto:Params: {} 2024-04-16T17:54:30.307 DEBUG:boto:Token: None 2024-04-16T17:54:30.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.310 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6688c87fa25a3ba-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.310 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.310 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.311 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.311 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.311 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.311 DEBUG:boto:Method: GET 2024-04-16T17:54:30.311 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.311 DEBUG:boto:Data: 2024-04-16T17:54:30.311 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.311 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.311 DEBUG:boto:Params: {} 2024-04-16T17:54:30.312 DEBUG:boto:Token: None 2024-04-16T17:54:30.312 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.314 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f567b811832ff76a-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.358 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.359 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.359 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.359 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.359 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.359 DEBUG:boto:Data: 2024-04-16T17:54:30.359 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.359 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.359 DEBUG:boto:Params: {} 2024-04-16T17:54:30.359 DEBUG:boto:Token: None 2024-04-16T17:54:30.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.364 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a447fc92d310af8b-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.364 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.364 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.364 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.364 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.364 DEBUG:boto:Data: 2024-04-16T17:54:30.364 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.364 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.365 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.365 DEBUG:boto:Params: {} 2024-04-16T17:54:30.365 DEBUG:boto:Token: None 2024-04-16T17:54:30.365 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.365 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.368 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f2eead185b955de7-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.369 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.369 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.369 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.369 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.369 DEBUG:boto:Method: GET 2024-04-16T17:54:30.369 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.369 DEBUG:boto:Data: 2024-04-16T17:54:30.369 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.369 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.369 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.369 DEBUG:boto:Params: {} 2024-04-16T17:54:30.370 DEBUG:boto:Token: None 2024-04-16T17:54:30.370 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.370 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.372 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a9814fcdab39f4f5-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.373 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.373 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.373 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.373 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.373 DEBUG:boto:Method: GET 2024-04-16T17:54:30.373 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.373 DEBUG:boto:Data: 2024-04-16T17:54:30.373 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.373 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.373 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.373 DEBUG:boto:Params: {} 2024-04-16T17:54:30.374 DEBUG:boto:Token: None 2024-04-16T17:54:30.374 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.374 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.376 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ecb2891447c4a0b4-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.418 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.418 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.419 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.419 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.419 DEBUG:boto:Method: GET 2024-04-16T17:54:30.419 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.419 DEBUG:boto:Data: 2024-04-16T17:54:30.419 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.419 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.419 DEBUG:boto:Params: {} 2024-04-16T17:54:30.419 DEBUG:boto:Token: None 2024-04-16T17:54:30.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc0dea2fbadfb415-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.422 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.422 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.423 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.423 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.423 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.423 DEBUG:boto:Method: GET 2024-04-16T17:54:30.423 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.423 DEBUG:boto:Data: 2024-04-16T17:54:30.423 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.423 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.423 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.423 DEBUG:boto:Params: {} 2024-04-16T17:54:30.423 DEBUG:boto:Token: None 2024-04-16T17:54:30.424 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030b2e8df20e222b5-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.466 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.467 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.467 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.467 DEBUG:boto:path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.467 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.467 DEBUG:boto:Method: GET 2024-04-16T17:54:30.467 DEBUG:boto:Path: /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.467 DEBUG:boto:Data: 2024-04-16T17:54:30.468 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.468 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.468 DEBUG:boto:Params: {} 2024-04-16T17:54:30.468 DEBUG:boto:Token: None 2024-04-16T17:54:30.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0= 2024-04-16T17:54:30.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0=', 'Content-Length': '0'} 2024-04-16T17:54:30.470 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'JucDcxVZ9qgmI0OztdICOj4W2RIrqby'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000a6f0f70b90150440-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.471 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.471 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.471 DEBUG:boto:path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.471 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.471 DEBUG:boto:Method: GET 2024-04-16T17:54:30.471 DEBUG:boto:Path: /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.471 DEBUG:boto:Data: 2024-04-16T17:54:30.471 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.471 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.471 DEBUG:boto:Params: {} 2024-04-16T17:54:30.472 DEBUG:boto:Token: None 2024-04-16T17:54:30.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0= 2024-04-16T17:54:30.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0=', 'Content-Length': '0'} 2024-04-16T17:54:30.474 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'JucDcxVZ9qgmI0OztdICOj4W2RIrqby'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000e5c893848f7b2fa2-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.514 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.514 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.514 DEBUG:boto:path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.515 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.515 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.515 DEBUG:boto:Path: /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.515 DEBUG:boto:Data: 2024-04-16T17:54:30.517 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.517 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.517 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.517 DEBUG:boto:Params: {} 2024-04-16T17:54:30.517 DEBUG:boto:Token: None 2024-04-16T17:54:30.517 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.517 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g1I6aLwFSOVTeupQGljwoFbzaIs= 2024-04-16T17:54:30.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g1I6aLwFSOVTeupQGljwoFbzaIs=', 'Content-Length': '0'} 2024-04-16T17:54:30.519 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'JucDcxVZ9qgmI0OztdICOj4W2RIrqby'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000096e8ad7430072783-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.520 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.520 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.520 DEBUG:boto:path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.520 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.520 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.520 DEBUG:boto:Path: /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.520 DEBUG:boto:Data: 2024-04-16T17:54:30.520 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.520 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.520 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.521 DEBUG:boto:Params: {} 2024-04-16T17:54:30.521 DEBUG:boto:Token: None 2024-04-16T17:54:30.521 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.521 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g1I6aLwFSOVTeupQGljwoFbzaIs= 2024-04-16T17:54:30.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g1I6aLwFSOVTeupQGljwoFbzaIs=', 'Content-Length': '0'} 2024-04-16T17:54:30.523 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'JucDcxVZ9qgmI0OztdICOj4W2RIrqby'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000001f7ba8e0e12a55fb-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.523 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.524 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.524 DEBUG:boto:path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.524 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.524 DEBUG:boto:Method: GET 2024-04-16T17:54:30.524 DEBUG:boto:Path: /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.524 DEBUG:boto:Data: 2024-04-16T17:54:30.524 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.524 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.524 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.524 DEBUG:boto:Params: {} 2024-04-16T17:54:30.525 DEBUG:boto:Token: None 2024-04-16T17:54:30.525 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.525 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0= 2024-04-16T17:54:30.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0=', 'Content-Length': '0'} 2024-04-16T17:54:30.527 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'JucDcxVZ9qgmI0OztdICOj4W2RIrqby'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000149e3b8dee3737d8-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.527 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.527 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.527 DEBUG:boto:path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.527 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.527 DEBUG:boto:Method: GET 2024-04-16T17:54:30.527 DEBUG:boto:Path: /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.528 DEBUG:boto:Data: 2024-04-16T17:54:30.528 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.528 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.528 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.528 DEBUG:boto:Params: {} 2024-04-16T17:54:30.528 DEBUG:boto:Token: None 2024-04-16T17:54:30.528 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=JucDcxVZ9qgmI0OztdICOj4W2RIrqby 2024-04-16T17:54:30.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0= 2024-04-16T17:54:30.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RLVJmU7aUSiaKC9rv3D+x7wK1T0=', 'Content-Length': '0'} 2024-04-16T17:54:30.530 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'JucDcxVZ9qgmI0OztdICOj4W2RIrqby'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000c8e9f7c04d6c3c12-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.570 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.571 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.571 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.571 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.571 DEBUG:boto:Method: GET 2024-04-16T17:54:30.571 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.571 DEBUG:boto:Data: 2024-04-16T17:54:30.571 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.571 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.571 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.571 DEBUG:boto:Params: {} 2024-04-16T17:54:30.572 DEBUG:boto:Token: None 2024-04-16T17:54:30.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3540e43599b6f25-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.575 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.575 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.575 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.575 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.575 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.575 DEBUG:boto:Method: GET 2024-04-16T17:54:30.575 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.576 DEBUG:boto:Data: 2024-04-16T17:54:30.576 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.576 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.576 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.576 DEBUG:boto:Params: {} 2024-04-16T17:54:30.576 DEBUG:boto:Token: None 2024-04-16T17:54:30.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.578 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000458a6e63f08262d5-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.579 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.579 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.579 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.579 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.579 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.579 DEBUG:boto:Data: 2024-04-16T17:54:30.579 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.579 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.580 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.580 DEBUG:boto:Params: {} 2024-04-16T17:54:30.580 DEBUG:boto:Token: None 2024-04-16T17:54:30.580 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.584 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b6809e83124da341-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.584 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.584 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.584 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.584 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.584 DEBUG:boto:Data: 2024-04-16T17:54:30.584 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.584 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.584 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.584 DEBUG:boto:Params: {} 2024-04-16T17:54:30.585 DEBUG:boto:Token: None 2024-04-16T17:54:30.585 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.585 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.588 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005d476a5e82148117-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.589 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.589 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.589 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.589 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.589 DEBUG:boto:Method: GET 2024-04-16T17:54:30.589 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.589 DEBUG:boto:Data: 2024-04-16T17:54:30.589 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.590 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.590 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.590 DEBUG:boto:Params: {} 2024-04-16T17:54:30.590 DEBUG:boto:Token: None 2024-04-16T17:54:30.590 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.590 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.592 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000005f137366efae78e4-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.634 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.634 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.634 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.635 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.635 DEBUG:boto:Method: GET 2024-04-16T17:54:30.635 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.635 DEBUG:boto:Data: 2024-04-16T17:54:30.635 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.635 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.635 DEBUG:boto:Params: {} 2024-04-16T17:54:30.635 DEBUG:boto:Token: None 2024-04-16T17:54:30.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.638 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000004c0652bcb62bb490-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.678 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.679 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.679 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.679 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.679 DEBUG:boto:Method: GET 2024-04-16T17:54:30.679 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.679 DEBUG:boto:Data: 2024-04-16T17:54:30.679 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.679 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.679 DEBUG:boto:Params: {} 2024-04-16T17:54:30.679 DEBUG:boto:Token: None 2024-04-16T17:54:30.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e438b4377ca03ac6-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.682 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.683 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.683 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.683 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.683 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.683 DEBUG:boto:Method: GET 2024-04-16T17:54:30.683 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.683 DEBUG:boto:Data: 2024-04-16T17:54:30.683 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.683 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.683 DEBUG:boto:Params: {} 2024-04-16T17:54:30.684 DEBUG:boto:Token: None 2024-04-16T17:54:30.684 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.686 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc85803e4f3ae2b9-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.686 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.687 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.687 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.687 DEBUG:boto:path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.687 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.687 DEBUG:boto:Method: GET 2024-04-16T17:54:30.687 DEBUG:boto:Path: /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.687 DEBUG:boto:Data: 2024-04-16T17:54:30.687 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.687 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.688 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.688 DEBUG:boto:Params: {} 2024-04-16T17:54:30.688 DEBUG:boto:Token: None 2024-04-16T17:54:30.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk= 2024-04-16T17:54:30.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk=', 'Content-Length': '0'} 2024-04-16T17:54:30.690 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000003a5417be647617b1-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.738 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.738 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.739 DEBUG:boto:path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.739 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.739 DEBUG:boto:Method: GET 2024-04-16T17:54:30.739 DEBUG:boto:Path: /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.739 DEBUG:boto:Data: 2024-04-16T17:54:30.739 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.739 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.739 DEBUG:boto:Params: {} 2024-04-16T17:54:30.739 DEBUG:boto:Token: None 2024-04-16T17:54:30.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk= 2024-04-16T17:54:30.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk=', 'Content-Length': '0'} 2024-04-16T17:54:30.742 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000f16b9f05db7fd381-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.742 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.742 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.742 DEBUG:boto:path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.743 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.743 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.743 DEBUG:boto:Path: /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.743 DEBUG:boto:Data: 2024-04-16T17:54:30.743 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.743 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.743 DEBUG:boto:Params: {} 2024-04-16T17:54:30.743 DEBUG:boto:Token: None 2024-04-16T17:54:30.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIt6Bb0jzBwp26SPv8WsBcCGVpQ= 2024-04-16T17:54:30.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIt6Bb0jzBwp26SPv8WsBcCGVpQ=', 'Content-Length': '0'} 2024-04-16T17:54:30.746 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000008dee94239cc759e3-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.746 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.746 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.746 DEBUG:boto:path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.747 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.747 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.747 DEBUG:boto:Path: /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.747 DEBUG:boto:Data: 2024-04-16T17:54:30.747 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.747 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.747 DEBUG:boto:Params: {} 2024-04-16T17:54:30.747 DEBUG:boto:Token: None 2024-04-16T17:54:30.747 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VIt6Bb0jzBwp26SPv8WsBcCGVpQ= 2024-04-16T17:54:30.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VIt6Bb0jzBwp26SPv8WsBcCGVpQ=', 'Content-Length': '0'} 2024-04-16T17:54:30.749 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000b53a2914a5d82481-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.750 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.750 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.750 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.750 DEBUG:boto:path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.750 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.750 DEBUG:boto:Method: GET 2024-04-16T17:54:30.750 DEBUG:boto:Path: /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.751 DEBUG:boto:Data: 2024-04-16T17:54:30.751 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.751 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.751 DEBUG:boto:Params: {} 2024-04-16T17:54:30.751 DEBUG:boto:Token: None 2024-04-16T17:54:30.751 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk= 2024-04-16T17:54:30.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk=', 'Content-Length': '0'} 2024-04-16T17:54:30.753 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:07 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000058c001026805f3da-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.794 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.794 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.795 DEBUG:boto:path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.795 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.795 DEBUG:boto:Method: GET 2024-04-16T17:54:30.795 DEBUG:boto:Path: /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.795 DEBUG:boto:Data: 2024-04-16T17:54:30.795 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.795 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.795 DEBUG:boto:Params: {} 2024-04-16T17:54:30.795 DEBUG:boto:Token: None 2024-04-16T17:54:30.796 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF 2024-04-16T17:54:30.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk= 2024-04-16T17:54:30.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J428TabS9dHbCOI8U1esoBU0IHk=', 'Content-Length': '0'} 2024-04-16T17:54:30.798 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:04 GMT'), ('x-amz-version-id', 'MOLDDnaoqaVLyO3BIwM-SeFZtpM.2NF'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx00000ebe730cffed2503c-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.798 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.798 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.798 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.798 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.799 DEBUG:boto:Method: GET 2024-04-16T17:54:30.799 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.799 DEBUG:boto:Data: 2024-04-16T17:54:30.799 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.799 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.799 DEBUG:boto:Params: {} 2024-04-16T17:54:30.799 DEBUG:boto:Token: None 2024-04-16T17:54:30.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020f1b9d837f9e586-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.842 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.843 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.843 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.843 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.843 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.843 DEBUG:boto:Method: GET 2024-04-16T17:54:30.843 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.843 DEBUG:boto:Data: 2024-04-16T17:54:30.843 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.844 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.844 DEBUG:boto:Params: {} 2024-04-16T17:54:30.844 DEBUG:boto:Token: None 2024-04-16T17:54:30.844 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.846 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3fa89f93b09546c-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.847 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.847 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.847 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.847 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.847 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.847 DEBUG:boto:Data: 2024-04-16T17:54:30.847 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.847 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.848 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.848 DEBUG:boto:Params: {} 2024-04-16T17:54:30.848 DEBUG:boto:Token: None 2024-04-16T17:54:30.848 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.852 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx000000695f2c22291ba7b-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.852 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.852 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.852 DEBUG:boto:Method: HEAD 2024-04-16T17:54:30.852 DEBUG:boto:Path: /cjqttm-15/obj 2024-04-16T17:54:30.852 DEBUG:boto:Data: 2024-04-16T17:54:30.853 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.853 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.853 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.853 DEBUG:boto:Params: {} 2024-04-16T17:54:30.853 DEBUG:boto:Token: None 2024-04-16T17:54:30.853 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj 2024-04-16T17:54:30.853 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY= 2024-04-16T17:54:30.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LCLwgbuyICirSrW4qEeVujyrCQY=', 'Content-Length': '0'} 2024-04-16T17:54:30.857 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000021639c4b1fc63439-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.857 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:54:30.857 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.857 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.857 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.857 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.857 DEBUG:boto:Method: GET 2024-04-16T17:54:30.857 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.857 DEBUG:boto:Data: 2024-04-16T17:54:30.857 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.858 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.858 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.858 DEBUG:boto:Params: {} 2024-04-16T17:54:30.858 DEBUG:boto:Token: None 2024-04-16T17:54:30.858 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.858 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.860 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000029dd43b5539bdf8e-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.860 DEBUG:boto:path=/cjqttm-15/obj 2024-04-16T17:54:30.861 DEBUG:boto:auth_path=/cjqttm-15/obj 2024-04-16T17:54:30.861 DEBUG:boto:path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.861 DEBUG:boto:auth_path=/cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.861 DEBUG:boto:Method: GET 2024-04-16T17:54:30.861 DEBUG:boto:Path: /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.861 DEBUG:boto:Data: 2024-04-16T17:54:30.861 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.861 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.861 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.861 DEBUG:boto:Params: {} 2024-04-16T17:54:30.861 DEBUG:boto:Token: None 2024-04-16T17:54:30.862 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/obj?versionId=PPQnPScCOHLg2S4TBpNKfL6FrX58j-M 2024-04-16T17:54:30.862 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4= 2024-04-16T17:54:30.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ho8mr6/fixIWenSTPU+JxueTUL4=', 'Content-Length': '0'} 2024-04-16T17:54:30.864 DEBUG:boto:Response headers: [('Content-Length', '8'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:05 GMT'), ('x-amz-version-id', 'PPQnPScCOHLg2S4TBpNKfL6FrX58j-M'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:54:06 GMT'), ('ETag', '"966634ebf2fc135707d6753692bf4b1e"'), ('x-amz-request-id', 'tx0000059bad7d10c73b80c-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.906 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.906 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.906 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.907 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.907 DEBUG:boto:Method: GET 2024-04-16T17:54:30.907 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.907 DEBUG:boto:Data: 2024-04-16T17:54:30.907 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.907 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:54:30.907 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.907 DEBUG:boto:Params: {} 2024-04-16T17:54:30.907 DEBUG:boto:Token: None 2024-04-16T17:54:30.907 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.907 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.910 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aaff556d968876bd-00661ebb56-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.910 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.911 DEBUG:boto:path=/cjqttm-15/ 2024-04-16T17:54:30.911 DEBUG:boto:auth_path=/cjqttm-15/ 2024-04-16T17:54:30.911 DEBUG:boto:path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.911 DEBUG:boto:auth_path=/cjqttm-15/?prefix=obj 2024-04-16T17:54:30.911 DEBUG:boto:Method: GET 2024-04-16T17:54:30.911 DEBUG:boto:Path: /cjqttm-15/?prefix=obj 2024-04-16T17:54:30.911 DEBUG:boto:Data: 2024-04-16T17:54:30.911 DEBUG:boto:Headers: {} 2024-04-16T17:54:30.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:30.911 DEBUG:boto:Port: 8000 2024-04-16T17:54:30.911 DEBUG:boto:Params: {} 2024-04-16T17:54:30.912 DEBUG:boto:Token: None 2024-04-16T17:54:30.912 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:54:30 GMT /cjqttm-15/ 2024-04-16T17:54:30.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM= 2024-04-16T17:54:30.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/T5+TPmgd6Tkx9BsVqTIjKLTDIM=', 'Content-Length': '0'} 2024-04-16T17:54:30.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000adffecd2c22cec03-00661ebb56-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:30.915 DEBUG:boto:b'cjqttm-15obj1000falseobj2024-04-16T17:54:05.158Z"966634ebf2fc135707d6753692bf4b1e"8STANDARDRGW11111111111111111Normal' 2024-04-16T17:54:30.915 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-15 zones={test-zone2, test-zone1} 2024-04-16T17:54:30.915 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T17:54:30.915 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:30.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:30.916 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:54:30.972 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:30.972 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:31.056 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000002343","last_update":"2024-04-16T17:52:44.923035Z"},{"marker":"00000000000000000000:00000000000000003745","last_update":"2024-04-16T17:54:12.929337Z"},{"marker":"00000000000000000000:00000000000000004597","last_update":"2024-04-16T17:54:12.930999Z"},{"marker":"00000000000000000000:00000000000000002626","last_update":"2024-04-16T17:47:36.919302Z"}] 2024-04-16T17:54:31.056 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000003745', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002626'} 2024-04-16T17:54:31.056 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T17:54:31.056 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.056 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:54:31.113 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:31.114 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:31.190 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003745","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.929337Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004597","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.930999Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002626","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:36.919302Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T17:54:31Z"} 2024-04-16T17:54:31.190 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003745","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.929337Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004597","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.930999Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002626","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:36.919302Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T17:54:31Z"} 2024-04-16T17:54:31.191 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003745', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:12.929337Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004597', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:12.930999Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002626', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:36.919302Z'}}] 2024-04-16T17:54:31.191 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000003745', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002626'} 2024-04-16T17:54:31.191 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000003745', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002626'} 2024-04-16T17:54:31.191 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T17:54:31.191 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T17:54:31.191 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.192 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:54:31.239 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:31.239 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:31.312 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000002625","last_update":"2024-04-16T17:53:13.048342Z"},{"marker":"00000000000000000000:00000000000000003745","last_update":"2024-04-16T17:54:19.051090Z"},{"marker":"00000000000000000000:00000000000000004315","last_update":"2024-04-16T17:54:19.053096Z"},{"marker":"00000000000000000000:00000000000000002626","last_update":"2024-04-16T17:47:43.039690Z"}] 2024-04-16T17:54:31.313 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000003745', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002626'} 2024-04-16T17:54:31.313 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T17:54:31.313 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.313 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.313 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:54:31.365 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:31.365 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:31.439 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T17:53:13.048342Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003745","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.051090Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004315","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.053096Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002626","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:43.039690Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T17:54:31Z"} 2024-04-16T17:54:31.440 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T17:53:13.048342Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003745","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.051090Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004315","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.053096Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002626","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:43.039690Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T17:54:31Z"} 2024-04-16T17:54:31.440 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002625', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T17:53:13.048342Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003745', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:19.051090Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004315', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:19.053096Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002626', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:43.039690Z'}}] 2024-04-16T17:54:31.440 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000003745', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002626'} 2024-04-16T17:54:31.440 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000003745', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002626'} 2024-04-16T17:54:31.440 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T17:54:31.441 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2024-04-16T17:54:31.442 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:54:31.442 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:54:31.442 DEBUG:boto:Method: PUT 2024-04-16T17:54:31.442 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:54:31.442 DEBUG:boto:Data: 2024-04-16T17:54:31.442 DEBUG:boto:Headers: {} 2024-04-16T17:54:31.442 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:31.442 DEBUG:boto:Port: 8000 2024-04-16T17:54:31.442 DEBUG:boto:Params: {} 2024-04-16T17:54:31.443 DEBUG:boto:Token: None 2024-04-16T17:54:31.443 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:54:31 GMT /cjqttm-16/ 2024-04-16T17:54:31.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vEN05NcI4MrbzMQ7nXYgZlDFJo0= 2024-04-16T17:54:31.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vEN05NcI4MrbzMQ7nXYgZlDFJo0=', 'Content-Length': '0'} 2024-04-16T17:54:31.456 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e1e38fd93e675990-00661ebb57-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:31.457 DEBUG:rgw_multi.tests:created bucket=cjqttm-16 2024-04-16T17:54:31.457 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.457 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:54:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:31.555 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:54:31.576 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290071.457340_145.1","last_update":"2024-04-16T17:54:31.457340Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:54:31.577 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290071.457340_145.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:54:31.577 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:54:31.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:31.577 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:54:31.626 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:31.626 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:31.675 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:31.677+0000 7fe65be14800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:54:31.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:31.678+0000 7fe65be14800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:54:31.696 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290071.450344_142.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:31.450344Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:54:31Z"} 2024-04-16T17:54:31.696 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290071.450344_142.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:31.450344Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:54:31Z"} 2024-04-16T17:54:31.696 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290071.450344_142.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:31.450344Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:54:31.696 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290071.457340_145.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:54:31.697 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290071.450344_142.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:54:31.697 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290071.457340_145.1 target=1_1713290071.450344_142.1 2024-04-16T17:54:36.697 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:36.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:54:36.698 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:54:36.753 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:36.753 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:36.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:36.808+0000 7f5f0052a800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:54:36.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:36.810+0000 7f5f0052a800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:54:36.830 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290071.457340_145.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:31.457340Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:54:36Z"} 2024-04-16T17:54:36.830 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290071.457340_145.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:31.457340Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:54:36Z"} 2024-04-16T17:54:36.831 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290071.457340_145.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:31.457340Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:54:36.831 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290071.457340_145.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:54:36.831 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290071.457340_145.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:54:36.831 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:54:36.831 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:54:36.831 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:54:36.831 DEBUG:boto:Method: HEAD 2024-04-16T17:54:36.831 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:54:36.831 DEBUG:boto:Data: 2024-04-16T17:54:36.832 DEBUG:boto:Headers: {} 2024-04-16T17:54:36.832 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:36.832 DEBUG:boto:Port: 8000 2024-04-16T17:54:36.832 DEBUG:boto:Params: {} 2024-04-16T17:54:36.832 DEBUG:boto:Token: None 2024-04-16T17:54:36.832 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:54:36 GMT /cjqttm-16/ 2024-04-16T17:54:36.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nSL7KM6/4FN0076MUgjOoaVP9hk= 2024-04-16T17:54:36.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:54:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nSL7KM6/4FN0076MUgjOoaVP9hk=', 'Content-Length': '0'} 2024-04-16T17:54:36.835 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008c8a95f00acb8313-00661ebb5c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:36.835 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:54:36.835 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:54:36.835 DEBUG:boto:Method: PUT 2024-04-16T17:54:36.835 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:54:36.836 DEBUG:boto:Data: 2024-04-16T17:54:36.836 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:54:36.836 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:54:36.836 DEBUG:boto:Port: 8000 2024-04-16T17:54:36.836 DEBUG:boto:Params: {} 2024-04-16T17:54:36.836 DEBUG:boto:Token: None 2024-04-16T17:54:36.836 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:54:36 GMT /cjqttm-16/obj 2024-04-16T17:54:36.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MAEWEC37iwunW26+MeJhZWP/Ris= 2024-04-16T17:54:36.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:54:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MAEWEC37iwunW26+MeJhZWP/Ris='} 2024-04-16T17:54:36.845 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009936dcb7dcd05de3-00661ebb5c-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:54:36.846 DEBUG:rgw_multi.tests:created initial version id=None 2024-04-16T17:54:36.846 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-16 2024-04-16T17:54:36.846 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:54:36.846 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:54:36.847 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:54:36.904 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:54:36.904 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:54:36.958 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:36.960+0000 7fa92731f800 1 waiting to reach incremental sync.. 2024-04-16T17:54:41.960 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:41.961+0000 7fa92731f800 1 waiting to reach incremental sync.. 2024-04-16T17:54:46.961 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:46.962+0000 7fa92731f800 1 waiting to reach incremental sync.. 2024-04-16T17:54:51.962 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:51.963+0000 7fa92731f800 1 waiting to reach incremental sync.. 2024-04-16T17:54:56.963 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:54:56.964+0000 7fa92731f800 1 waiting to reach incremental sync.. 2024-04-16T17:55:01.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:01.965+0000 7fa92731f800 1 waiting to reach incremental sync.. 2024-04-16T17:55:06.965 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:06.967+0000 7fa92731f800 1 waiting to reach incremental sync.. 2024-04-16T17:55:11.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:11.969+0000 7fa92731f800 1 bucket sync caught up with source: 2024-04-16T17:55:11.967 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000001.29.6, , ] 2024-04-16T17:55:11.967 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000001.29.6, , ] 2024-04-16T17:55:11.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:11.969+0000 7fa92731f800 0 bucket checkpoint complete 2024-04-16T17:55:11.992 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-16 2024-04-16T17:55:11.993 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:11.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:11.993 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:55:12.056 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:12.056 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:12.120+0000 7fc7bfd3f800 1 bucket sync caught up with source: 2024-04-16T17:55:12.118 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000001.42.6, , ] 2024-04-16T17:55:12.118 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000001.42.6, , ] 2024-04-16T17:55:12.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:12.120+0000 7fc7bfd3f800 0 bucket checkpoint complete 2024-04-16T17:55:12.139 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-16 zones={test-zone2, test-zone1} 2024-04-16T17:55:12.139 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.139 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.139 DEBUG:boto:Method: HEAD 2024-04-16T17:55:12.139 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:12.140 DEBUG:boto:Data: 2024-04-16T17:55:12.140 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.140 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.140 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.140 DEBUG:boto:Params: {} 2024-04-16T17:55:12.140 DEBUG:boto:Token: None 2024-04-16T17:55:12.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/ 2024-04-16T17:55:12.141 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:piqA6a/jTWlnQu2fCUenxd1hmNk= 2024-04-16T17:55:12.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:piqA6a/jTWlnQu2fCUenxd1hmNk=', 'Content-Length': '0'} 2024-04-16T17:55:12.143 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f13e99cec4da261-00661ebb80-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.143 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.143 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.143 DEBUG:boto:Method: HEAD 2024-04-16T17:55:12.144 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:12.144 DEBUG:boto:Data: 2024-04-16T17:55:12.144 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.144 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.144 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.144 DEBUG:boto:Params: {} 2024-04-16T17:55:12.144 DEBUG:boto:Token: None 2024-04-16T17:55:12.144 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/ 2024-04-16T17:55:12.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:piqA6a/jTWlnQu2fCUenxd1hmNk= 2024-04-16T17:55:12.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:piqA6a/jTWlnQu2fCUenxd1hmNk=', 'Content-Length': '0'} 2024-04-16T17:55:12.147 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006731abb83f3c7d47-00661ebb80-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.147 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:55:12.147 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.147 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.147 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.148 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.148 DEBUG:boto:Method: GET 2024-04-16T17:55:12.148 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.148 DEBUG:boto:Data: 2024-04-16T17:55:12.148 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.148 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.148 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.148 DEBUG:boto:Params: {} 2024-04-16T17:55:12.148 DEBUG:boto:Token: None 2024-04-16T17:55:12.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/?versions 2024-04-16T17:55:12.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE= 2024-04-16T17:55:12.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE=', 'Content-Length': '0'} 2024-04-16T17:55:12.151 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007adb0f021c02647c-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.194 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.195 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:12.195 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:55:12.195 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.195 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.195 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.195 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.195 DEBUG:boto:Method: GET 2024-04-16T17:55:12.196 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.196 DEBUG:boto:Data: 2024-04-16T17:55:12.196 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.196 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.196 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.196 DEBUG:boto:Params: {} 2024-04-16T17:55:12.196 DEBUG:boto:Token: None 2024-04-16T17:55:12.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/?versions 2024-04-16T17:55:12.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE= 2024-04-16T17:55:12.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE=', 'Content-Length': '0'} 2024-04-16T17:55:12.199 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fa6f62e763e4d3d-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.199 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.199 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:12.199 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.199 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.200 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.200 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.200 DEBUG:boto:Method: GET 2024-04-16T17:55:12.200 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.200 DEBUG:boto:Data: 2024-04-16T17:55:12.200 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.200 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.200 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.200 DEBUG:boto:Params: {} 2024-04-16T17:55:12.200 DEBUG:boto:Token: None 2024-04-16T17:55:12.201 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/?versions 2024-04-16T17:55:12.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE= 2024-04-16T17:55:12.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE=', 'Content-Length': '0'} 2024-04-16T17:55:12.203 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d77c2545d0f905c1-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.203 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.204 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.204 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.204 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.204 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.204 DEBUG:boto:Method: GET 2024-04-16T17:55:12.204 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:12.204 DEBUG:boto:Data: 2024-04-16T17:55:12.204 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.204 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.205 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.205 DEBUG:boto:Params: {} 2024-04-16T17:55:12.205 DEBUG:boto:Token: None 2024-04-16T17:55:12.205 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/?versions 2024-04-16T17:55:12.205 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE= 2024-04-16T17:55:12.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6cimQcLOWVOEDO4BXYklOGrdhE=', 'Content-Length': '0'} 2024-04-16T17:55:12.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008465482c9937f5b5-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.250 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:12.251 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.251 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.251 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.251 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.251 DEBUG:boto:Method: GET 2024-04-16T17:55:12.251 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.252 DEBUG:boto:Data: 2024-04-16T17:55:12.252 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.252 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.252 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.252 DEBUG:boto:Params: {} 2024-04-16T17:55:12.252 DEBUG:boto:Token: None 2024-04-16T17:55:12.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU= 2024-04-16T17:55:12.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU=', 'Content-Length': '0'} 2024-04-16T17:55:12.254 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c509ca4b775c76ec-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.255 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.255 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.255 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.255 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.255 DEBUG:boto:Method: GET 2024-04-16T17:55:12.255 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.255 DEBUG:boto:Data: 2024-04-16T17:55:12.255 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.255 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.255 DEBUG:boto:Params: {} 2024-04-16T17:55:12.256 DEBUG:boto:Token: None 2024-04-16T17:55:12.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU= 2024-04-16T17:55:12.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU=', 'Content-Length': '0'} 2024-04-16T17:55:12.258 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004366a16e00473f87-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.258 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.258 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.258 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.258 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.258 DEBUG:boto:Method: HEAD 2024-04-16T17:55:12.258 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.258 DEBUG:boto:Data: 2024-04-16T17:55:12.258 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.258 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.259 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.259 DEBUG:boto:Params: {} 2024-04-16T17:55:12.259 DEBUG:boto:Token: None 2024-04-16T17:55:12.259 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HYIC7b+7K4iDDdQj/24LBQn8if4= 2024-04-16T17:55:12.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HYIC7b+7K4iDDdQj/24LBQn8if4=', 'Content-Length': '0'} 2024-04-16T17:55:12.261 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fea2636133cf7602-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.261 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.261 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.261 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.262 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.262 DEBUG:boto:Method: HEAD 2024-04-16T17:55:12.262 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.262 DEBUG:boto:Data: 2024-04-16T17:55:12.262 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.262 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.262 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.262 DEBUG:boto:Params: {} 2024-04-16T17:55:12.262 DEBUG:boto:Token: None 2024-04-16T17:55:12.262 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HYIC7b+7K4iDDdQj/24LBQn8if4= 2024-04-16T17:55:12.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HYIC7b+7K4iDDdQj/24LBQn8if4=', 'Content-Length': '0'} 2024-04-16T17:55:12.264 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e8efd5928fa174ea-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.265 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:12.265 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.265 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.265 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.265 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.265 DEBUG:boto:Method: GET 2024-04-16T17:55:12.265 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.265 DEBUG:boto:Data: 2024-04-16T17:55:12.265 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.266 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.266 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.266 DEBUG:boto:Params: {} 2024-04-16T17:55:12.266 DEBUG:boto:Token: None 2024-04-16T17:55:12.266 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU= 2024-04-16T17:55:12.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU=', 'Content-Length': '0'} 2024-04-16T17:55:12.268 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000002517746cb95bd634-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.269 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.269 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.269 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.269 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.269 DEBUG:boto:Method: GET 2024-04-16T17:55:12.269 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.269 DEBUG:boto:Data: 2024-04-16T17:55:12.269 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.269 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.269 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.269 DEBUG:boto:Params: {} 2024-04-16T17:55:12.269 DEBUG:boto:Token: None 2024-04-16T17:55:12.270 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:12.270 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU= 2024-04-16T17:55:12.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4X85pjSqrZRiGX2gLFtAJXVpgFU=', 'Content-Length': '0'} 2024-04-16T17:55:12.271 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d59c026d945a27bf-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.272 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.272 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.272 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.272 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.272 DEBUG:boto:Method: GET 2024-04-16T17:55:12.272 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:12.272 DEBUG:boto:Data: 2024-04-16T17:55:12.272 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.272 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.272 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.272 DEBUG:boto:Params: {} 2024-04-16T17:55:12.272 DEBUG:boto:Token: None 2024-04-16T17:55:12.273 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/ 2024-04-16T17:55:12.273 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk= 2024-04-16T17:55:12.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk=', 'Content-Length': '0'} 2024-04-16T17:55:12.275 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dab8ed79db19b96-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.275 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.275 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.275 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.276 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.276 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.276 DEBUG:boto:Method: GET 2024-04-16T17:55:12.276 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:12.276 DEBUG:boto:Data: 2024-04-16T17:55:12.276 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.276 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.276 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.276 DEBUG:boto:Params: {} 2024-04-16T17:55:12.276 DEBUG:boto:Token: None 2024-04-16T17:55:12.276 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/ 2024-04-16T17:55:12.277 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk= 2024-04-16T17:55:12.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk=', 'Content-Length': '0'} 2024-04-16T17:55:12.279 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6ccf071164b128a-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.279 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.279 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.279 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.280 DEBUG:boto:Method: HEAD 2024-04-16T17:55:12.280 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:12.280 DEBUG:boto:Data: 2024-04-16T17:55:12.280 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.280 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.280 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.280 DEBUG:boto:Params: {} 2024-04-16T17:55:12.280 DEBUG:boto:Token: None 2024-04-16T17:55:12.280 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj 2024-04-16T17:55:12.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yYY0sPH4ofWriaQh6ilzXOc5qsY= 2024-04-16T17:55:12.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yYY0sPH4ofWriaQh6ilzXOc5qsY=', 'Content-Length': '0'} 2024-04-16T17:55:12.282 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e2e3ca48a65f4d52-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.283 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.283 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.283 DEBUG:boto:Method: HEAD 2024-04-16T17:55:12.283 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:12.283 DEBUG:boto:Data: 2024-04-16T17:55:12.283 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.283 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.283 DEBUG:boto:Params: {} 2024-04-16T17:55:12.283 DEBUG:boto:Token: None 2024-04-16T17:55:12.284 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj 2024-04-16T17:55:12.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yYY0sPH4ofWriaQh6ilzXOc5qsY= 2024-04-16T17:55:12.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yYY0sPH4ofWriaQh6ilzXOc5qsY=', 'Content-Length': '0'} 2024-04-16T17:55:12.285 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a967f448aa107169-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.285 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:12.286 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.286 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.286 DEBUG:boto:Method: GET 2024-04-16T17:55:12.286 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:12.286 DEBUG:boto:Data: 2024-04-16T17:55:12.286 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.286 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.286 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.286 DEBUG:boto:Params: {} 2024-04-16T17:55:12.287 DEBUG:boto:Token: None 2024-04-16T17:55:12.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj 2024-04-16T17:55:12.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SeanCpJO9eEgSzFTTAUXoO1/Ztw= 2024-04-16T17:55:12.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SeanCpJO9eEgSzFTTAUXoO1/Ztw=', 'Content-Length': '0'} 2024-04-16T17:55:12.289 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000eb9c1d60fe2ce4d9-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.289 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.289 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.289 DEBUG:boto:Method: GET 2024-04-16T17:55:12.289 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:12.289 DEBUG:boto:Data: 2024-04-16T17:55:12.289 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.290 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.290 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.290 DEBUG:boto:Params: {} 2024-04-16T17:55:12.290 DEBUG:boto:Token: None 2024-04-16T17:55:12.290 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj 2024-04-16T17:55:12.290 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SeanCpJO9eEgSzFTTAUXoO1/Ztw= 2024-04-16T17:55:12.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SeanCpJO9eEgSzFTTAUXoO1/Ztw=', 'Content-Length': '0'} 2024-04-16T17:55:12.292 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000573a0a6f6a1f72cc-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.292 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.292 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.292 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.292 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.292 DEBUG:boto:Method: GET 2024-04-16T17:55:12.293 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:12.293 DEBUG:boto:Data: 2024-04-16T17:55:12.293 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.293 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:12.293 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.293 DEBUG:boto:Params: {} 2024-04-16T17:55:12.293 DEBUG:boto:Token: None 2024-04-16T17:55:12.293 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/ 2024-04-16T17:55:12.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk= 2024-04-16T17:55:12.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk=', 'Content-Length': '0'} 2024-04-16T17:55:12.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005efdf454697145f5-00661ebb80-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.338 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.339 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.339 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.339 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.339 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:12.339 DEBUG:boto:Method: GET 2024-04-16T17:55:12.339 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:12.339 DEBUG:boto:Data: 2024-04-16T17:55:12.339 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.339 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.339 DEBUG:boto:Params: {} 2024-04-16T17:55:12.340 DEBUG:boto:Token: None 2024-04-16T17:55:12.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/ 2024-04-16T17:55:12.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk= 2024-04-16T17:55:12.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkbjqIWiSigEALbnoCjgp05R+gk=', 'Content-Length': '0'} 2024-04-16T17:55:12.342 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000080417c7715a12e7f-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.342 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:12.342 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-16 zones={test-zone2, test-zone1} 2024-04-16T17:55:12.343 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.343 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.343 DEBUG:boto:path=/cjqttm-16/?versioning 2024-04-16T17:55:12.343 DEBUG:boto:auth_path=/cjqttm-16/?versioning 2024-04-16T17:55:12.343 DEBUG:boto:Method: PUT 2024-04-16T17:55:12.343 DEBUG:boto:Path: /cjqttm-16/?versioning 2024-04-16T17:55:12.343 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:55:12.343 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.343 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.343 DEBUG:boto:Params: {} 2024-04-16T17:55:12.344 DEBUG:boto:Token: None 2024-04-16T17:55:12.344 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/?versioning 2024-04-16T17:55:12.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5TazBxaPHpKjzObTeEuBXhXY0Ow= 2024-04-16T17:55:12.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5TazBxaPHpKjzObTeEuBXhXY0Ow=', 'Content-Length': '228'} 2024-04-16T17:55:12.350 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000069647fa86461d48e-00661ebb80-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.350 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:12.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:12.351 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:55:12.400 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:12.400 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:12.452 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:55:12.474 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290112.351803_153.1","last_update":"2024-04-16T17:55:12.351803Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:55:12.474 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290112.351803_153.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:12.475 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:55:12.475 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:12.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:12.475 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:55:12.530 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:12.530 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:12.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:12.585+0000 7fce5a011800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:12.584 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:12.586+0000 7fce5a011800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:12.604 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290112.351803_153.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:12.351803Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:12Z"} 2024-04-16T17:55:12.605 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290112.351803_153.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:12.351803Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:12Z"} 2024-04-16T17:55:12.605 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290112.351803_153.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:55:12.351803Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:55:12.605 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290112.351803_153.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:12.605 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290112.351803_153.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:12.605 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:55:12.605 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:12.605 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:12.606 DEBUG:boto:Method: HEAD 2024-04-16T17:55:12.606 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:12.606 DEBUG:boto:Data: 2024-04-16T17:55:12.606 DEBUG:boto:Headers: {} 2024-04-16T17:55:12.606 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.606 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.606 DEBUG:boto:Params: {} 2024-04-16T17:55:12.606 DEBUG:boto:Token: None 2024-04-16T17:55:12.606 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/ 2024-04-16T17:55:12.606 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:piqA6a/jTWlnQu2fCUenxd1hmNk= 2024-04-16T17:55:12.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:piqA6a/jTWlnQu2fCUenxd1hmNk=', 'Content-Length': '0'} 2024-04-16T17:55:12.609 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f95e6e7b67d870d-00661ebb80-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.609 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:12.609 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:12.610 DEBUG:boto:Method: PUT 2024-04-16T17:55:12.610 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:12.610 DEBUG:boto:Data: 2024-04-16T17:55:12.610 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:55:12.610 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:12.610 DEBUG:boto:Port: 8000 2024-04-16T17:55:12.610 DEBUG:boto:Params: {} 2024-04-16T17:55:12.610 DEBUG:boto:Token: None 2024-04-16T17:55:12.610 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:55:12 GMT /cjqttm-16/obj 2024-04-16T17:55:12.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dSq909gQuFQxZrLA97tb8i1IuTk= 2024-04-16T17:55:12.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:55:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dSq909gQuFQxZrLA97tb8i1IuTk='} 2024-04-16T17:55:12.621 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-amz-request-id', 'tx000009055196ac49d7985-00661ebb80-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:12.621 DEBUG:rgw_multi.tests:created new version id=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:12.622 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-16 2024-04-16T17:55:12.622 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:12.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:12.622 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:55:12.677 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:12.678 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:12.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:12.738+0000 7f4af1067800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:12.736 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000001.29.6, , ] 2024-04-16T17:55:12.736 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000003.32.13, , ] 2024-04-16T17:55:17.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:17.740+0000 7f4af1067800 1 bucket sync caught up with source: 2024-04-16T17:55:17.739 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000003.32.13, , ] 2024-04-16T17:55:17.739 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000003.32.13, , ] 2024-04-16T17:55:17.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:17.740+0000 7f4af1067800 0 bucket checkpoint complete 2024-04-16T17:55:17.763 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-16 2024-04-16T17:55:17.763 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:17.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:17.763 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:55:17.826 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:17.826 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:17.888 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:17.888+0000 7fe15292d800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:17.888 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000001.42.6, , ] 2024-04-16T17:55:17.888 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000003.47.13, , ] 2024-04-16T17:55:22.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:22.891+0000 7fe15292d800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:22.889 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000001.42.6, , ] 2024-04-16T17:55:22.890 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000003.47.13, , ] 2024-04-16T17:55:27.891 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:27.892+0000 7fe15292d800 1 bucket sync caught up with source: 2024-04-16T17:55:27.891 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000003.47.13, , ] 2024-04-16T17:55:27.892 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000003.47.13, , ] 2024-04-16T17:55:27.892 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:27.892+0000 7fe15292d800 0 bucket checkpoint complete 2024-04-16T17:55:27.917 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-16 zones={test-zone2, test-zone1} 2024-04-16T17:55:27.917 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.917 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.917 DEBUG:boto:Method: HEAD 2024-04-16T17:55:27.917 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:27.917 DEBUG:boto:Data: 2024-04-16T17:55:27.917 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.918 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.918 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.918 DEBUG:boto:Params: {} 2024-04-16T17:55:27.918 DEBUG:boto:Token: None 2024-04-16T17:55:27.918 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/ 2024-04-16T17:55:27.918 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P7x5CCUMzgvSr80UeeLZzPhM1f0= 2024-04-16T17:55:27.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P7x5CCUMzgvSr80UeeLZzPhM1f0=', 'Content-Length': '0'} 2024-04-16T17:55:27.921 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cfed63119453fd53-00661ebb8f-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.921 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.921 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.921 DEBUG:boto:Method: HEAD 2024-04-16T17:55:27.921 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:27.921 DEBUG:boto:Data: 2024-04-16T17:55:27.921 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.921 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.921 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.921 DEBUG:boto:Params: {} 2024-04-16T17:55:27.922 DEBUG:boto:Token: None 2024-04-16T17:55:27.922 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/ 2024-04-16T17:55:27.922 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P7x5CCUMzgvSr80UeeLZzPhM1f0= 2024-04-16T17:55:27.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P7x5CCUMzgvSr80UeeLZzPhM1f0=', 'Content-Length': '0'} 2024-04-16T17:55:27.924 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009a8089df6fb7a320-00661ebb8f-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.924 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:55:27.925 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.925 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.925 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.925 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.925 DEBUG:boto:Method: GET 2024-04-16T17:55:27.925 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.925 DEBUG:boto:Data: 2024-04-16T17:55:27.925 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.925 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.925 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.925 DEBUG:boto:Params: {} 2024-04-16T17:55:27.925 DEBUG:boto:Token: None 2024-04-16T17:55:27.926 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/?versions 2024-04-16T17:55:27.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI= 2024-04-16T17:55:27.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI=', 'Content-Length': '0'} 2024-04-16T17:55:27.928 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000544fc419306918f3-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.928 DEBUG:boto:b'cjqttm-16999falseobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvtrue2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobjnullfalse2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:27.929 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:27.929 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:27.929 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:55:27.929 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.929 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.929 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.930 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.930 DEBUG:boto:Method: GET 2024-04-16T17:55:27.930 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.930 DEBUG:boto:Data: 2024-04-16T17:55:27.930 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.930 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.930 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.930 DEBUG:boto:Params: {} 2024-04-16T17:55:27.930 DEBUG:boto:Token: None 2024-04-16T17:55:27.930 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/?versions 2024-04-16T17:55:27.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI= 2024-04-16T17:55:27.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI=', 'Content-Length': '0'} 2024-04-16T17:55:27.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd43861c43282910-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.933 DEBUG:boto:b'cjqttm-16999falseobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvtrue2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobjnullfalse2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:27.934 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:27.934 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:27.934 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.934 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.934 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.934 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.934 DEBUG:boto:Method: GET 2024-04-16T17:55:27.934 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.935 DEBUG:boto:Data: 2024-04-16T17:55:27.935 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.935 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.935 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.935 DEBUG:boto:Params: {} 2024-04-16T17:55:27.935 DEBUG:boto:Token: None 2024-04-16T17:55:27.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/?versions 2024-04-16T17:55:27.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI= 2024-04-16T17:55:27.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI=', 'Content-Length': '0'} 2024-04-16T17:55:27.938 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007241a7069f7458d1-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.938 DEBUG:boto:b'cjqttm-16999falseobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvtrue2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobjnullfalse2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:27.938 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.938 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.938 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.938 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.939 DEBUG:boto:Method: GET 2024-04-16T17:55:27.939 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:27.939 DEBUG:boto:Data: 2024-04-16T17:55:27.939 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.939 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.939 DEBUG:boto:Params: {} 2024-04-16T17:55:27.939 DEBUG:boto:Token: None 2024-04-16T17:55:27.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/?versions 2024-04-16T17:55:27.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI= 2024-04-16T17:55:27.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ahVgWu3ZJWO0lT1lKEHzo5cbVI=', 'Content-Length': '0'} 2024-04-16T17:55:27.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ca7d71dcb99feb8-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.942 DEBUG:boto:b'cjqttm-16999falseobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvtrue2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normalobjnullfalse2024-04-16T17:54:36.840Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:27.942 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:27.942 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.942 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.942 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.943 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.943 DEBUG:boto:Method: GET 2024-04-16T17:55:27.943 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.943 DEBUG:boto:Data: 2024-04-16T17:55:27.943 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.943 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.943 DEBUG:boto:Params: {} 2024-04-16T17:55:27.943 DEBUG:boto:Token: None 2024-04-16T17:55:27.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI= 2024-04-16T17:55:27.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI=', 'Content-Length': '0'} 2024-04-16T17:55:27.946 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003f078542915e9251-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.946 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.946 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.946 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.946 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.946 DEBUG:boto:Method: GET 2024-04-16T17:55:27.947 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.947 DEBUG:boto:Data: 2024-04-16T17:55:27.947 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.947 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.947 DEBUG:boto:Params: {} 2024-04-16T17:55:27.947 DEBUG:boto:Token: None 2024-04-16T17:55:27.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI= 2024-04-16T17:55:27.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI=', 'Content-Length': '0'} 2024-04-16T17:55:27.950 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d9a7d1bccad9c761-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.950 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.950 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.950 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.950 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.950 DEBUG:boto:Method: HEAD 2024-04-16T17:55:27.950 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.950 DEBUG:boto:Data: 2024-04-16T17:55:27.951 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.951 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.951 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.951 DEBUG:boto:Params: {} 2024-04-16T17:55:27.951 DEBUG:boto:Token: None 2024-04-16T17:55:27.951 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FLY6oWJsjDXQVh4SWLKDz51VM34= 2024-04-16T17:55:27.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FLY6oWJsjDXQVh4SWLKDz51VM34=', 'Content-Length': '0'} 2024-04-16T17:55:27.953 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b46a83d428425d87-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.953 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.954 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.954 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.954 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.954 DEBUG:boto:Method: HEAD 2024-04-16T17:55:27.954 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.954 DEBUG:boto:Data: 2024-04-16T17:55:27.954 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.954 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.954 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.954 DEBUG:boto:Params: {} 2024-04-16T17:55:27.954 DEBUG:boto:Token: None 2024-04-16T17:55:27.955 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FLY6oWJsjDXQVh4SWLKDz51VM34= 2024-04-16T17:55:27.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FLY6oWJsjDXQVh4SWLKDz51VM34=', 'Content-Length': '0'} 2024-04-16T17:55:27.957 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000099420416152ed91a-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:27.957 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.957 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.957 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.957 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.957 DEBUG:boto:Method: GET 2024-04-16T17:55:27.958 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.958 DEBUG:boto:Data: 2024-04-16T17:55:27.958 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.958 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.958 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.958 DEBUG:boto:Params: {} 2024-04-16T17:55:27.958 DEBUG:boto:Token: None 2024-04-16T17:55:27.958 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.958 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI= 2024-04-16T17:55:27.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI=', 'Content-Length': '0'} 2024-04-16T17:55:27.960 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ff055467f1bf75c8-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.960 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.961 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.961 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.961 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.961 DEBUG:boto:Method: GET 2024-04-16T17:55:27.961 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.961 DEBUG:boto:Data: 2024-04-16T17:55:27.961 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.961 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.961 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.961 DEBUG:boto:Params: {} 2024-04-16T17:55:27.962 DEBUG:boto:Token: None 2024-04-16T17:55:27.962 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.962 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI= 2024-04-16T17:55:27.962 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI=', 'Content-Length': '0'} 2024-04-16T17:55:27.964 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000046f880baadb5f4cd-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.964 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.964 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.964 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.964 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.964 DEBUG:boto:Method: GET 2024-04-16T17:55:27.964 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:27.965 DEBUG:boto:Data: 2024-04-16T17:55:27.965 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.965 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.965 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.965 DEBUG:boto:Params: {} 2024-04-16T17:55:27.965 DEBUG:boto:Token: None 2024-04-16T17:55:27.965 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/ 2024-04-16T17:55:27.965 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI= 2024-04-16T17:55:27.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI=', 'Content-Length': '0'} 2024-04-16T17:55:27.967 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000465e6b82284fe85a-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.967 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:27.968 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.968 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.968 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.968 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.968 DEBUG:boto:Method: GET 2024-04-16T17:55:27.968 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:27.968 DEBUG:boto:Data: 2024-04-16T17:55:27.968 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.968 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.969 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.969 DEBUG:boto:Params: {} 2024-04-16T17:55:27.969 DEBUG:boto:Token: None 2024-04-16T17:55:27.969 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/ 2024-04-16T17:55:27.969 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI= 2024-04-16T17:55:27.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI=', 'Content-Length': '0'} 2024-04-16T17:55:27.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000681ee165e6460c87-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.971 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:27.971 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.972 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.972 DEBUG:boto:Method: HEAD 2024-04-16T17:55:27.972 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:27.972 DEBUG:boto:Data: 2024-04-16T17:55:27.972 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.972 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.972 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.972 DEBUG:boto:Params: {} 2024-04-16T17:55:27.972 DEBUG:boto:Token: None 2024-04-16T17:55:27.973 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj 2024-04-16T17:55:27.973 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B68+T8sJ/ISWLqWpFoy1IhE/7mo= 2024-04-16T17:55:27.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B68+T8sJ/ISWLqWpFoy1IhE/7mo=', 'Content-Length': '0'} 2024-04-16T17:55:27.975 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000082ea5790428e5173-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.975 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.975 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.975 DEBUG:boto:Method: HEAD 2024-04-16T17:55:27.975 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:27.975 DEBUG:boto:Data: 2024-04-16T17:55:27.975 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.975 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.975 DEBUG:boto:Params: {} 2024-04-16T17:55:27.976 DEBUG:boto:Token: None 2024-04-16T17:55:27.976 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj 2024-04-16T17:55:27.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B68+T8sJ/ISWLqWpFoy1IhE/7mo= 2024-04-16T17:55:27.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B68+T8sJ/ISWLqWpFoy1IhE/7mo=', 'Content-Length': '0'} 2024-04-16T17:55:27.978 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fc2adadad2652919-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.978 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:27.979 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.979 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.979 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.979 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.979 DEBUG:boto:Method: GET 2024-04-16T17:55:27.979 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.979 DEBUG:boto:Data: 2024-04-16T17:55:27.979 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.979 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.979 DEBUG:boto:Params: {} 2024-04-16T17:55:27.979 DEBUG:boto:Token: None 2024-04-16T17:55:27.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI= 2024-04-16T17:55:27.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI=', 'Content-Length': '0'} 2024-04-16T17:55:27.982 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000265d97137b5d50c9-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.982 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:27.982 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:27.982 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.982 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.982 DEBUG:boto:Method: GET 2024-04-16T17:55:27.982 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.982 DEBUG:boto:Data: 2024-04-16T17:55:27.982 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.982 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.983 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.983 DEBUG:boto:Params: {} 2024-04-16T17:55:27.983 DEBUG:boto:Token: None 2024-04-16T17:55:27.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:27.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI= 2024-04-16T17:55:27.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qywtOi/v+Dojw5cN9ZJHA95f3rI=', 'Content-Length': '0'} 2024-04-16T17:55:27.985 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009316735e8189173b-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.985 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.985 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.985 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.985 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.986 DEBUG:boto:Method: GET 2024-04-16T17:55:27.986 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:27.986 DEBUG:boto:Data: 2024-04-16T17:55:27.986 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.986 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:27.986 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.986 DEBUG:boto:Params: {} 2024-04-16T17:55:27.986 DEBUG:boto:Token: None 2024-04-16T17:55:27.986 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/ 2024-04-16T17:55:27.986 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI= 2024-04-16T17:55:27.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI=', 'Content-Length': '0'} 2024-04-16T17:55:27.989 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a69b120e83135bc6-00661ebb8f-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:27.989 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:27.989 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:27.989 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:27.989 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.989 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:27.990 DEBUG:boto:Method: GET 2024-04-16T17:55:27.990 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:27.990 DEBUG:boto:Data: 2024-04-16T17:55:27.990 DEBUG:boto:Headers: {} 2024-04-16T17:55:27.990 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:27.990 DEBUG:boto:Port: 8000 2024-04-16T17:55:27.990 DEBUG:boto:Params: {} 2024-04-16T17:55:27.990 DEBUG:boto:Token: None 2024-04-16T17:55:27.990 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:27 GMT /cjqttm-16/ 2024-04-16T17:55:27.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI= 2024-04-16T17:55:27.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m6GzIhEVoraNAzY3lmO790T31NI=', 'Content-Length': '0'} 2024-04-16T17:55:27.993 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009dd6216c33029c4e-00661ebb8f-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.034 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:28.034 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:28.035 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.035 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.035 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.035 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.035 DEBUG:boto:Method: GET 2024-04-16T17:55:28.035 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.035 DEBUG:boto:Data: 2024-04-16T17:55:28.035 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.035 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:28.035 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.035 DEBUG:boto:Params: {} 2024-04-16T17:55:28.036 DEBUG:boto:Token: None 2024-04-16T17:55:28.036 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI= 2024-04-16T17:55:28.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI=', 'Content-Length': '0'} 2024-04-16T17:55:28.038 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000022bb8ecb844a103f-00661ebb90-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.038 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.038 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.038 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.038 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.038 DEBUG:boto:Method: GET 2024-04-16T17:55:28.038 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.039 DEBUG:boto:Data: 2024-04-16T17:55:28.039 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.039 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.039 DEBUG:boto:Params: {} 2024-04-16T17:55:28.039 DEBUG:boto:Token: None 2024-04-16T17:55:28.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI= 2024-04-16T17:55:28.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI=', 'Content-Length': '0'} 2024-04-16T17:55:28.041 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fb235882ae86729b-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.041 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.041 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.041 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.042 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.042 DEBUG:boto:Method: HEAD 2024-04-16T17:55:28.042 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.042 DEBUG:boto:Data: 2024-04-16T17:55:28.042 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.042 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:28.042 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.042 DEBUG:boto:Params: {} 2024-04-16T17:55:28.042 DEBUG:boto:Token: None 2024-04-16T17:55:28.042 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.042 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g9kPKobw7GugJrAXIeiZloCwp9A= 2024-04-16T17:55:28.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g9kPKobw7GugJrAXIeiZloCwp9A=', 'Content-Length': '0'} 2024-04-16T17:55:28.044 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000ed3da63b1fe5c1e-00661ebb90-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.045 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.045 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.045 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.045 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.045 DEBUG:boto:Method: HEAD 2024-04-16T17:55:28.045 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.045 DEBUG:boto:Data: 2024-04-16T17:55:28.045 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.045 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.045 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.045 DEBUG:boto:Params: {} 2024-04-16T17:55:28.045 DEBUG:boto:Token: None 2024-04-16T17:55:28.046 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.046 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g9kPKobw7GugJrAXIeiZloCwp9A= 2024-04-16T17:55:28.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g9kPKobw7GugJrAXIeiZloCwp9A=', 'Content-Length': '0'} 2024-04-16T17:55:28.047 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d6d5bb58f8aa1f94-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:28.048 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.048 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.048 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.048 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.048 DEBUG:boto:Method: GET 2024-04-16T17:55:28.048 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.048 DEBUG:boto:Data: 2024-04-16T17:55:28.048 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.048 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:28.048 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.049 DEBUG:boto:Params: {} 2024-04-16T17:55:28.049 DEBUG:boto:Token: None 2024-04-16T17:55:28.049 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.049 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI= 2024-04-16T17:55:28.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI=', 'Content-Length': '0'} 2024-04-16T17:55:28.051 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:07 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000d95e4612131f69f-00661ebb90-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.051 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.051 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.051 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.051 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.051 DEBUG:boto:Method: GET 2024-04-16T17:55:28.052 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.052 DEBUG:boto:Data: 2024-04-16T17:55:28.052 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.052 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.052 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.052 DEBUG:boto:Params: {} 2024-04-16T17:55:28.052 DEBUG:boto:Token: None 2024-04-16T17:55:28.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:28.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI= 2024-04-16T17:55:28.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g+NvRQDQM//zAeakQ4BDPvSsLKI=', 'Content-Length': '0'} 2024-04-16T17:55:28.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:54:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000fe2fcd0a6fc17b66-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.054 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:28.054 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:28.055 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.055 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.055 DEBUG:boto:Method: GET 2024-04-16T17:55:28.055 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:28.055 DEBUG:boto:Data: 2024-04-16T17:55:28.055 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:28.055 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.055 DEBUG:boto:Params: {} 2024-04-16T17:55:28.055 DEBUG:boto:Token: None 2024-04-16T17:55:28.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/ 2024-04-16T17:55:28.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0= 2024-04-16T17:55:28.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0=', 'Content-Length': '0'} 2024-04-16T17:55:28.058 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c54e4074939d9a0c-00661ebb90-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.098 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:28.099 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:28.099 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:28.099 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.099 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.099 DEBUG:boto:Method: GET 2024-04-16T17:55:28.099 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:28.099 DEBUG:boto:Data: 2024-04-16T17:55:28.099 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.099 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.099 DEBUG:boto:Params: {} 2024-04-16T17:55:28.100 DEBUG:boto:Token: None 2024-04-16T17:55:28.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/ 2024-04-16T17:55:28.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0= 2024-04-16T17:55:28.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0=', 'Content-Length': '0'} 2024-04-16T17:55:28.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000311bee477d06059-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.103 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:28.103 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.103 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.103 DEBUG:boto:Method: HEAD 2024-04-16T17:55:28.103 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:28.103 DEBUG:boto:Data: 2024-04-16T17:55:28.103 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:28.104 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.104 DEBUG:boto:Params: {} 2024-04-16T17:55:28.104 DEBUG:boto:Token: None 2024-04-16T17:55:28.104 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj 2024-04-16T17:55:28.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KmiMtLfv6Qr7142sk5AGjW+uwt4= 2024-04-16T17:55:28.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KmiMtLfv6Qr7142sk5AGjW+uwt4=', 'Content-Length': '0'} 2024-04-16T17:55:28.106 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000004dc6379ce9c2c0c1-00661ebb90-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.107 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.107 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.107 DEBUG:boto:Method: HEAD 2024-04-16T17:55:28.107 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:28.107 DEBUG:boto:Data: 2024-04-16T17:55:28.107 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.107 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.107 DEBUG:boto:Params: {} 2024-04-16T17:55:28.107 DEBUG:boto:Token: None 2024-04-16T17:55:28.108 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj 2024-04-16T17:55:28.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KmiMtLfv6Qr7142sk5AGjW+uwt4= 2024-04-16T17:55:28.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KmiMtLfv6Qr7142sk5AGjW+uwt4=', 'Content-Length': '0'} 2024-04-16T17:55:28.110 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e8af4ca176e68bfe-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.110 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:28.110 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.110 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.110 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.111 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.111 DEBUG:boto:Method: GET 2024-04-16T17:55:28.111 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.111 DEBUG:boto:Data: 2024-04-16T17:55:28.111 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.111 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:28.111 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.111 DEBUG:boto:Params: {} 2024-04-16T17:55:28.111 DEBUG:boto:Token: None 2024-04-16T17:55:28.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMA2TEkFdlmG/Iw4oB1Lb7PeGUc= 2024-04-16T17:55:28.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMA2TEkFdlmG/Iw4oB1Lb7PeGUc=', 'Content-Length': '0'} 2024-04-16T17:55:28.113 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000008ebbf3d3701c96e-00661ebb90-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.114 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.114 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.114 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.114 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.114 DEBUG:boto:Method: GET 2024-04-16T17:55:28.114 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.114 DEBUG:boto:Data: 2024-04-16T17:55:28.114 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.114 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.115 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.115 DEBUG:boto:Params: {} 2024-04-16T17:55:28.115 DEBUG:boto:Token: None 2024-04-16T17:55:28.115 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:28.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMA2TEkFdlmG/Iw4oB1Lb7PeGUc= 2024-04-16T17:55:28.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMA2TEkFdlmG/Iw4oB1Lb7PeGUc=', 'Content-Length': '0'} 2024-04-16T17:55:28.117 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000026d7e047b22c164e-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.117 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:28.117 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:28.117 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.117 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.118 DEBUG:boto:Method: GET 2024-04-16T17:55:28.118 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:28.118 DEBUG:boto:Data: 2024-04-16T17:55:28.118 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.118 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:28.118 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.118 DEBUG:boto:Params: {} 2024-04-16T17:55:28.118 DEBUG:boto:Token: None 2024-04-16T17:55:28.118 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/ 2024-04-16T17:55:28.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0= 2024-04-16T17:55:28.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0=', 'Content-Length': '0'} 2024-04-16T17:55:28.121 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d16f4b54fdbbace2-00661ebb90-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.121 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:28.121 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:28.121 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:28.122 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.122 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:28.122 DEBUG:boto:Method: GET 2024-04-16T17:55:28.122 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:28.122 DEBUG:boto:Data: 2024-04-16T17:55:28.122 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.122 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.122 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.122 DEBUG:boto:Params: {} 2024-04-16T17:55:28.122 DEBUG:boto:Token: None 2024-04-16T17:55:28.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/ 2024-04-16T17:55:28.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0= 2024-04-16T17:55:28.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NsJa26u1Hm9xDv18cxMptv+NEM0=', 'Content-Length': '0'} 2024-04-16T17:55:28.125 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000839f7a002789968d-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.125 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:28.125 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-16 zones={test-zone2, test-zone1} 2024-04-16T17:55:28.126 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:28.126 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:28.126 DEBUG:boto:path=/cjqttm-16/?versioning 2024-04-16T17:55:28.126 DEBUG:boto:auth_path=/cjqttm-16/?versioning 2024-04-16T17:55:28.126 DEBUG:boto:Method: PUT 2024-04-16T17:55:28.126 DEBUG:boto:Path: /cjqttm-16/?versioning 2024-04-16T17:55:28.126 DEBUG:boto:Data: Suspended Disabled 2024-04-16T17:55:28.126 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.126 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.126 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.127 DEBUG:boto:Params: {} 2024-04-16T17:55:28.127 DEBUG:boto:Token: None 2024-04-16T17:55:28.127 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/?versioning 2024-04-16T17:55:28.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u7yJKYqY6G0nG3otGLZQu+cTv3k= 2024-04-16T17:55:28.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u7yJKYqY6G0nG3otGLZQu+cTv3k=', 'Content-Length': '230'} 2024-04-16T17:55:28.134 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000000eced72f9fe7d311-00661ebb90-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.134 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:28.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:28.134 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:55:28.187 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:28.187 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:28.241 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:55:28.264 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290128.135301_156.1","last_update":"2024-04-16T17:55:28.135301Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:55:28.264 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290128.135301_156.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:28.264 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:55:28.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:28.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:28.265 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:55:28.318 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:28.319 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:28.371 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:28.373+0000 7f1f5d933800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:28.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:28.374+0000 7f1f5d933800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:28.393 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290128.135301_156.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:28.135301Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:28Z"} 2024-04-16T17:55:28.394 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290128.135301_156.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:28.135301Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:28Z"} 2024-04-16T17:55:28.394 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290128.135301_156.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:55:28.135301Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:55:28.394 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290128.135301_156.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:28.394 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290128.135301_156.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:28.394 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:55:28.394 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:28.394 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:28.395 DEBUG:boto:Method: HEAD 2024-04-16T17:55:28.395 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:28.395 DEBUG:boto:Data: 2024-04-16T17:55:28.395 DEBUG:boto:Headers: {} 2024-04-16T17:55:28.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.395 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.395 DEBUG:boto:Params: {} 2024-04-16T17:55:28.395 DEBUG:boto:Token: None 2024-04-16T17:55:28.395 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/ 2024-04-16T17:55:28.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QvTkie1s6dWhug3+8evKbsj0BOo= 2024-04-16T17:55:28.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QvTkie1s6dWhug3+8evKbsj0BOo=', 'Content-Length': '0'} 2024-04-16T17:55:28.398 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003c0518b0f51c7706-00661ebb90-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.398 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:28.398 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:28.399 DEBUG:boto:Method: PUT 2024-04-16T17:55:28.399 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:28.399 DEBUG:boto:Data: 2024-04-16T17:55:28.399 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:55:28.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:28.399 DEBUG:boto:Port: 8000 2024-04-16T17:55:28.399 DEBUG:boto:Params: {} 2024-04-16T17:55:28.399 DEBUG:boto:Token: None 2024-04-16T17:55:28.399 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:55:28 GMT /cjqttm-16/obj 2024-04-16T17:55:28.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0mRbuOOdaQnqzPkqzZX0Mj8kkdE= 2024-04-16T17:55:28.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:55:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0mRbuOOdaQnqzPkqzZX0Mj8kkdE='} 2024-04-16T17:55:28.411 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b5c78779a604658-00661ebb90-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:28.411 DEBUG:rgw_multi.tests:created null version id=None 2024-04-16T17:55:28.412 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-16 2024-04-16T17:55:28.412 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:28.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:28.412 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-16 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:55:28.467 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:28.467 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:28.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:28.524+0000 7ffbdfc11800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:28.523 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000003.32.13, , ] 2024-04-16T17:55:28.523 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000005.36.18, , ] 2024-04-16T17:55:33.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:33.525+0000 7ffbdfc11800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:33.524 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000003.32.13, , ] 2024-04-16T17:55:33.524 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000005.36.18, , ] 2024-04-16T17:55:38.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:38.528+0000 7ffbdfc11800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:38.527 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000003.32.13, , ] 2024-04-16T17:55:38.527 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000005.36.18, , ] 2024-04-16T17:55:43.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:43.529+0000 7ffbdfc11800 1 bucket sync caught up with source: 2024-04-16T17:55:43.529 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000005.36.18, , ] 2024-04-16T17:55:43.529 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000005.36.18, , ] 2024-04-16T17:55:43.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:43.529+0000 7ffbdfc11800 0 bucket checkpoint complete 2024-04-16T17:55:43.553 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-16 2024-04-16T17:55:43.554 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:43.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-16', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:43.554 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-16 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:55:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:43.619 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:43.682 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:43.683+0000 7f85a4121800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:43.682 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000003.47.13, , ] 2024-04-16T17:55:43.682 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000005.53.18, , ] 2024-04-16T17:55:48.683 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:48.685+0000 7f85a4121800 1 waiting for incremental sync to catch up: 2024-04-16T17:55:48.684 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000003.47.13, , ] 2024-04-16T17:55:48.684 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000005.53.18, , ] 2024-04-16T17:55:53.685 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:53.686+0000 7f85a4121800 1 bucket sync caught up with source: 2024-04-16T17:55:53.685 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000005.53.18, , ] 2024-04-16T17:55:53.685 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000005.53.18, , ] 2024-04-16T17:55:53.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:55:53.686+0000 7f85a4121800 0 bucket checkpoint complete 2024-04-16T17:55:53.711 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-16 zones={test-zone2, test-zone1} 2024-04-16T17:55:53.711 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.711 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.711 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.711 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:53.712 DEBUG:boto:Data: 2024-04-16T17:55:53.712 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.712 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.712 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.712 DEBUG:boto:Params: {} 2024-04-16T17:55:53.712 DEBUG:boto:Token: None 2024-04-16T17:55:53.713 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/ 2024-04-16T17:55:53.713 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8AAbQmukrinU9hBYi7IXvzJ5qf4= 2024-04-16T17:55:53.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8AAbQmukrinU9hBYi7IXvzJ5qf4=', 'Content-Length': '0'} 2024-04-16T17:55:53.716 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ce2accc47f2b2243-00661ebba9-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.716 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.716 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.716 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.717 DEBUG:boto:Path: /cjqttm-16/ 2024-04-16T17:55:53.717 DEBUG:boto:Data: 2024-04-16T17:55:53.717 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.717 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.717 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.717 DEBUG:boto:Params: {} 2024-04-16T17:55:53.717 DEBUG:boto:Token: None 2024-04-16T17:55:53.717 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/ 2024-04-16T17:55:53.718 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8AAbQmukrinU9hBYi7IXvzJ5qf4= 2024-04-16T17:55:53.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8AAbQmukrinU9hBYi7IXvzJ5qf4=', 'Content-Length': '0'} 2024-04-16T17:55:53.720 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a8e670363e0acc0b-00661ebba9-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.721 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:55:53.721 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.721 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.721 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.721 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.722 DEBUG:boto:Method: GET 2024-04-16T17:55:53.722 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.722 DEBUG:boto:Data: 2024-04-16T17:55:53.722 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.722 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.722 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.722 DEBUG:boto:Params: {} 2024-04-16T17:55:53.722 DEBUG:boto:Token: None 2024-04-16T17:55:53.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/?versions 2024-04-16T17:55:53.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY= 2024-04-16T17:55:53.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY=', 'Content-Length': '0'} 2024-04-16T17:55:53.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002af5d12635159658-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.766 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvfalse2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.767 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:53.767 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:53.768 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:55:53.768 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.768 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.768 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.768 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.768 DEBUG:boto:Method: GET 2024-04-16T17:55:53.768 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.769 DEBUG:boto:Data: 2024-04-16T17:55:53.769 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.769 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.769 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.769 DEBUG:boto:Params: {} 2024-04-16T17:55:53.769 DEBUG:boto:Token: None 2024-04-16T17:55:53.769 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/?versions 2024-04-16T17:55:53.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY= 2024-04-16T17:55:53.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY=', 'Content-Length': '0'} 2024-04-16T17:55:53.772 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074ee26502a73c34e-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.772 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvfalse2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.773 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:53.773 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:55:53.773 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.773 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.773 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.774 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.774 DEBUG:boto:Method: GET 2024-04-16T17:55:53.774 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.774 DEBUG:boto:Data: 2024-04-16T17:55:53.774 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.774 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.774 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.774 DEBUG:boto:Params: {} 2024-04-16T17:55:53.774 DEBUG:boto:Token: None 2024-04-16T17:55:53.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/?versions 2024-04-16T17:55:53.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY= 2024-04-16T17:55:53.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY=', 'Content-Length': '0'} 2024-04-16T17:55:53.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000078a7661c09a59c18-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.778 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvfalse2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.778 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.778 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.778 DEBUG:boto:path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.779 DEBUG:boto:auth_path=/cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.779 DEBUG:boto:Method: GET 2024-04-16T17:55:53.779 DEBUG:boto:Path: /cjqttm-16/?versions&max-keys=999 2024-04-16T17:55:53.779 DEBUG:boto:Data: 2024-04-16T17:55:53.779 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.779 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.779 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.779 DEBUG:boto:Params: {} 2024-04-16T17:55:53.780 DEBUG:boto:Token: None 2024-04-16T17:55:53.780 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/?versions 2024-04-16T17:55:53.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY= 2024-04-16T17:55:53.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VYkSZjBGoxwHvpRXXu601MyUUNY=', 'Content-Length': '0'} 2024-04-16T17:55:53.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fa379fb4caf647d-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.826 DEBUG:boto:b'cjqttm-16999falseobjnulltrue2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111NormalobjIzZ9SIc8oi40hbLZ93mwk3uYLvvsdcvfalse2024-04-16T17:55:12.614Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.827 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:53.827 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.827 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.827 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.827 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.827 DEBUG:boto:Method: GET 2024-04-16T17:55:53.828 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.828 DEBUG:boto:Data: 2024-04-16T17:55:53.828 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.828 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.828 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.828 DEBUG:boto:Params: {} 2024-04-16T17:55:53.828 DEBUG:boto:Token: None 2024-04-16T17:55:53.828 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.829 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk= 2024-04-16T17:55:53.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk=', 'Content-Length': '0'} 2024-04-16T17:55:53.831 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:42 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000082e8eed2098cd086-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.831 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.831 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.831 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.832 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.832 DEBUG:boto:Method: GET 2024-04-16T17:55:53.832 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.832 DEBUG:boto:Data: 2024-04-16T17:55:53.832 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.832 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.832 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.832 DEBUG:boto:Params: {} 2024-04-16T17:55:53.832 DEBUG:boto:Token: None 2024-04-16T17:55:53.833 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk= 2024-04-16T17:55:53.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk=', 'Content-Length': '0'} 2024-04-16T17:55:53.835 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000046b09bedced8ea41-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.835 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.835 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.836 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.836 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.836 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.836 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.836 DEBUG:boto:Data: 2024-04-16T17:55:53.836 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.836 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.836 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.837 DEBUG:boto:Params: {} 2024-04-16T17:55:53.837 DEBUG:boto:Token: None 2024-04-16T17:55:53.837 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.837 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8WBBNbhvzViuCEc+ddd9ctI4wKw= 2024-04-16T17:55:53.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8WBBNbhvzViuCEc+ddd9ctI4wKw=', 'Content-Length': '0'} 2024-04-16T17:55:53.839 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:42 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000486d396e53f734ae-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.839 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.840 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.840 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.840 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.840 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.840 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.840 DEBUG:boto:Data: 2024-04-16T17:55:53.840 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.840 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.841 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.841 DEBUG:boto:Params: {} 2024-04-16T17:55:53.841 DEBUG:boto:Token: None 2024-04-16T17:55:53.841 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.841 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8WBBNbhvzViuCEc+ddd9ctI4wKw= 2024-04-16T17:55:53.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8WBBNbhvzViuCEc+ddd9ctI4wKw=', 'Content-Length': '0'} 2024-04-16T17:55:53.843 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000003dca9ee08be2e68-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:53.844 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.844 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.844 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.844 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.844 DEBUG:boto:Method: GET 2024-04-16T17:55:53.844 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.844 DEBUG:boto:Data: 2024-04-16T17:55:53.845 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.845 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.845 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.845 DEBUG:boto:Params: {} 2024-04-16T17:55:53.845 DEBUG:boto:Token: None 2024-04-16T17:55:53.845 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.845 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk= 2024-04-16T17:55:53.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk=', 'Content-Length': '0'} 2024-04-16T17:55:53.847 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:42 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000e46ebf9db414b879-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.848 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.848 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.848 DEBUG:boto:path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.848 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.848 DEBUG:boto:Method: GET 2024-04-16T17:55:53.848 DEBUG:boto:Path: /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.848 DEBUG:boto:Data: 2024-04-16T17:55:53.848 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.848 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.849 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.849 DEBUG:boto:Params: {} 2024-04-16T17:55:53.849 DEBUG:boto:Token: None 2024-04-16T17:55:53.849 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=null 2024-04-16T17:55:53.849 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk= 2024-04-16T17:55:53.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O8yQWoGh8JDiiLr9T/4Mcs0pdRk=', 'Content-Length': '0'} 2024-04-16T17:55:53.851 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000007134707b8eb9728f-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.852 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.852 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.852 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.852 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.852 DEBUG:boto:Method: GET 2024-04-16T17:55:53.853 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:53.853 DEBUG:boto:Data: 2024-04-16T17:55:53.853 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.853 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.853 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.853 DEBUG:boto:Params: {} 2024-04-16T17:55:53.853 DEBUG:boto:Token: None 2024-04-16T17:55:53.853 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/ 2024-04-16T17:55:53.854 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU= 2024-04-16T17:55:53.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU=', 'Content-Length': '0'} 2024-04-16T17:55:53.856 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a4b965447c91bbc-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.898 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.899 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.899 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.899 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.899 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.899 DEBUG:boto:Method: GET 2024-04-16T17:55:53.899 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:53.900 DEBUG:boto:Data: 2024-04-16T17:55:53.900 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.900 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.900 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.900 DEBUG:boto:Params: {} 2024-04-16T17:55:53.900 DEBUG:boto:Token: None 2024-04-16T17:55:53.900 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/ 2024-04-16T17:55:53.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU= 2024-04-16T17:55:53.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU=', 'Content-Length': '0'} 2024-04-16T17:55:53.903 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f17132deb7dcf7d-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.903 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.903 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.903 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.904 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.904 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:53.904 DEBUG:boto:Data: 2024-04-16T17:55:53.904 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.904 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.904 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.904 DEBUG:boto:Params: {} 2024-04-16T17:55:53.904 DEBUG:boto:Token: None 2024-04-16T17:55:53.904 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj 2024-04-16T17:55:53.905 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O3D4yqMnL1VUEGxfZl0htR/pLvs= 2024-04-16T17:55:53.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O3D4yqMnL1VUEGxfZl0htR/pLvs=', 'Content-Length': '0'} 2024-04-16T17:55:53.907 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:42 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000066ba76b51ca6a0ef-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.907 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.907 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.907 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.907 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:53.908 DEBUG:boto:Data: 2024-04-16T17:55:53.908 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.908 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.908 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.908 DEBUG:boto:Params: {} 2024-04-16T17:55:53.908 DEBUG:boto:Token: None 2024-04-16T17:55:53.908 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj 2024-04-16T17:55:53.909 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O3D4yqMnL1VUEGxfZl0htR/pLvs= 2024-04-16T17:55:53.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O3D4yqMnL1VUEGxfZl0htR/pLvs=', 'Content-Length': '0'} 2024-04-16T17:55:53.911 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000abfe7c1cf114f1b-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.911 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:53.911 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.911 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.912 DEBUG:boto:Method: GET 2024-04-16T17:55:53.912 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:53.912 DEBUG:boto:Data: 2024-04-16T17:55:53.912 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.912 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.912 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.912 DEBUG:boto:Params: {} 2024-04-16T17:55:53.912 DEBUG:boto:Token: None 2024-04-16T17:55:53.913 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj 2024-04-16T17:55:53.913 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tcFwAnf/cQadKwqBskPfyixTONM= 2024-04-16T17:55:53.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tcFwAnf/cQadKwqBskPfyixTONM=', 'Content-Length': '0'} 2024-04-16T17:55:53.915 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:42 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003862d79fe0e9f162-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.915 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.915 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.915 DEBUG:boto:Method: GET 2024-04-16T17:55:53.915 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:53.915 DEBUG:boto:Data: 2024-04-16T17:55:53.916 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.916 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.916 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.916 DEBUG:boto:Params: {} 2024-04-16T17:55:53.916 DEBUG:boto:Token: None 2024-04-16T17:55:53.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj 2024-04-16T17:55:53.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tcFwAnf/cQadKwqBskPfyixTONM= 2024-04-16T17:55:53.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tcFwAnf/cQadKwqBskPfyixTONM=', 'Content-Length': '0'} 2024-04-16T17:55:53.918 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005f3883e671d67c65-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.919 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.919 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.919 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.919 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.919 DEBUG:boto:Method: GET 2024-04-16T17:55:53.919 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:53.919 DEBUG:boto:Data: 2024-04-16T17:55:53.920 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.920 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.920 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.920 DEBUG:boto:Params: {} 2024-04-16T17:55:53.920 DEBUG:boto:Token: None 2024-04-16T17:55:53.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/ 2024-04-16T17:55:53.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU= 2024-04-16T17:55:53.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU=', 'Content-Length': '0'} 2024-04-16T17:55:53.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6e474b305c4c1a7-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.966 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.967 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.967 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.967 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.967 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.967 DEBUG:boto:Method: GET 2024-04-16T17:55:53.967 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:53.968 DEBUG:boto:Data: 2024-04-16T17:55:53.968 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.968 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.968 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.968 DEBUG:boto:Params: {} 2024-04-16T17:55:53.968 DEBUG:boto:Token: None 2024-04-16T17:55:53.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/ 2024-04-16T17:55:53.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU= 2024-04-16T17:55:53.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU=', 'Content-Length': '0'} 2024-04-16T17:55:53.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac2728294ce1549f-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.971 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:53.972 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:53.972 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.972 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.972 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.972 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.972 DEBUG:boto:Method: GET 2024-04-16T17:55:53.972 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.972 DEBUG:boto:Data: 2024-04-16T17:55:53.973 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.973 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.973 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.973 DEBUG:boto:Params: {} 2024-04-16T17:55:53.973 DEBUG:boto:Token: None 2024-04-16T17:55:53.973 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.973 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk= 2024-04-16T17:55:53.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk=', 'Content-Length': '0'} 2024-04-16T17:55:53.975 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000a856cfea957fd325-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.976 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.976 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.976 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.976 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.976 DEBUG:boto:Method: GET 2024-04-16T17:55:53.976 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.977 DEBUG:boto:Data: 2024-04-16T17:55:53.977 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.977 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.977 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.977 DEBUG:boto:Params: {} 2024-04-16T17:55:53.977 DEBUG:boto:Token: None 2024-04-16T17:55:53.977 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.977 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk= 2024-04-16T17:55:53.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk=', 'Content-Length': '0'} 2024-04-16T17:55:53.979 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000057dedb20708e599f-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.980 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.980 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.980 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.980 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.980 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.980 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.980 DEBUG:boto:Data: 2024-04-16T17:55:53.980 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.981 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.981 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.981 DEBUG:boto:Params: {} 2024-04-16T17:55:53.981 DEBUG:boto:Token: None 2024-04-16T17:55:53.981 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.981 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EfzTcVfA+sgSAU7yXUqc3LyB024= 2024-04-16T17:55:53.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EfzTcVfA+sgSAU7yXUqc3LyB024=', 'Content-Length': '0'} 2024-04-16T17:55:53.983 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000029ed5e6715ecad13-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.984 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.984 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.984 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.984 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.984 DEBUG:boto:Method: HEAD 2024-04-16T17:55:53.984 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.984 DEBUG:boto:Data: 2024-04-16T17:55:53.985 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.985 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.985 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.985 DEBUG:boto:Params: {} 2024-04-16T17:55:53.985 DEBUG:boto:Token: None 2024-04-16T17:55:53.985 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EfzTcVfA+sgSAU7yXUqc3LyB024= 2024-04-16T17:55:53.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EfzTcVfA+sgSAU7yXUqc3LyB024=', 'Content-Length': '0'} 2024-04-16T17:55:53.987 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000ec5d6e2da266e63c-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:53.988 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.988 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.988 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.988 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.988 DEBUG:boto:Method: GET 2024-04-16T17:55:53.989 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.989 DEBUG:boto:Data: 2024-04-16T17:55:53.989 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.989 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.989 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.989 DEBUG:boto:Params: {} 2024-04-16T17:55:53.989 DEBUG:boto:Token: None 2024-04-16T17:55:53.989 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.990 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk= 2024-04-16T17:55:53.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk=', 'Content-Length': '0'} 2024-04-16T17:55:53.991 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:17 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d2b2c04d6016a783-00661ebba9-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.992 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:53.992 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:53.992 DEBUG:boto:path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.992 DEBUG:boto:auth_path=/cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.992 DEBUG:boto:Method: GET 2024-04-16T17:55:53.992 DEBUG:boto:Path: /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.992 DEBUG:boto:Data: 2024-04-16T17:55:53.993 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.993 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:53.993 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.993 DEBUG:boto:Params: {} 2024-04-16T17:55:53.993 DEBUG:boto:Token: None 2024-04-16T17:55:53.993 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/obj?versionId=IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv 2024-04-16T17:55:53.993 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk= 2024-04-16T17:55:53.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:87RdaaS8CfDaJhGFsGKWLQl+mVk=', 'Content-Length': '0'} 2024-04-16T17:55:53.995 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:12 GMT'), ('x-amz-version-id', 'IzZ9SIc8oi40hbLZ93mwk3uYLvvsdcv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c0406c3e0a06599c-00661ebba9-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:53.996 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:53.996 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:53.996 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.996 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:53.996 DEBUG:boto:Method: GET 2024-04-16T17:55:53.996 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:53.996 DEBUG:boto:Data: 2024-04-16T17:55:53.996 DEBUG:boto:Headers: {} 2024-04-16T17:55:53.997 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:53.997 DEBUG:boto:Port: 8000 2024-04-16T17:55:53.997 DEBUG:boto:Params: {} 2024-04-16T17:55:53.997 DEBUG:boto:Token: None 2024-04-16T17:55:53.997 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:53 GMT /cjqttm-16/ 2024-04-16T17:55:53.997 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU= 2024-04-16T17:55:53.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8ULH3U4Wgd/cXaPtbu24+l+ZXU=', 'Content-Length': '0'} 2024-04-16T17:55:54.000 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3b574612d0502be-00661ebbaa-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.042 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:54.043 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:54.043 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:54.043 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:54.043 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:54.043 DEBUG:boto:Method: GET 2024-04-16T17:55:54.043 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:54.043 DEBUG:boto:Data: 2024-04-16T17:55:54.044 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.044 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:54.044 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.044 DEBUG:boto:Params: {} 2024-04-16T17:55:54.044 DEBUG:boto:Token: None 2024-04-16T17:55:54.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-16/ 2024-04-16T17:55:54.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w1fsDVqyNXemMRPbKhZCzMVzBxI= 2024-04-16T17:55:54.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w1fsDVqyNXemMRPbKhZCzMVzBxI=', 'Content-Length': '0'} 2024-04-16T17:55:54.047 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fb0db9e49835220-00661ebbaa-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.047 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:54.047 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:54.047 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:54.048 DEBUG:boto:Method: HEAD 2024-04-16T17:55:54.048 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:54.048 DEBUG:boto:Data: 2024-04-16T17:55:54.048 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.048 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:54.048 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.048 DEBUG:boto:Params: {} 2024-04-16T17:55:54.048 DEBUG:boto:Token: None 2024-04-16T17:55:54.049 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-16/obj 2024-04-16T17:55:54.049 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EhtJu42dN7yAhPCAK3ZqAbc5Re8= 2024-04-16T17:55:54.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EhtJu42dN7yAhPCAK3ZqAbc5Re8=', 'Content-Length': '0'} 2024-04-16T17:55:54.051 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:42 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000618ff890dfd4081-00661ebbaa-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.051 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:54.051 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:54.051 DEBUG:boto:Method: HEAD 2024-04-16T17:55:54.052 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:54.052 DEBUG:boto:Data: 2024-04-16T17:55:54.052 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.052 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:54.052 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.052 DEBUG:boto:Params: {} 2024-04-16T17:55:54.052 DEBUG:boto:Token: None 2024-04-16T17:55:54.052 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-16/obj 2024-04-16T17:55:54.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EhtJu42dN7yAhPCAK3ZqAbc5Re8= 2024-04-16T17:55:54.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EhtJu42dN7yAhPCAK3ZqAbc5Re8=', 'Content-Length': '0'} 2024-04-16T17:55:54.055 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000005a93668f1c18777c-00661ebbaa-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:55:54.055 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:54.055 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:54.055 DEBUG:boto:Method: GET 2024-04-16T17:55:54.056 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:54.056 DEBUG:boto:Data: 2024-04-16T17:55:54.056 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.056 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:54.056 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.056 DEBUG:boto:Params: {} 2024-04-16T17:55:54.056 DEBUG:boto:Token: None 2024-04-16T17:55:54.056 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-16/obj 2024-04-16T17:55:54.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bJm+dndxlRkLBj345e+N5Ba1YZA= 2024-04-16T17:55:54.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bJm+dndxlRkLBj345e+N5Ba1YZA=', 'Content-Length': '0'} 2024-04-16T17:55:54.059 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:55:42 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c4cc4bfaedf2c1e8-00661ebbaa-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.059 DEBUG:boto:path=/cjqttm-16/obj 2024-04-16T17:55:54.059 DEBUG:boto:auth_path=/cjqttm-16/obj 2024-04-16T17:55:54.059 DEBUG:boto:Method: GET 2024-04-16T17:55:54.059 DEBUG:boto:Path: /cjqttm-16/obj 2024-04-16T17:55:54.059 DEBUG:boto:Data: 2024-04-16T17:55:54.059 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.060 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:54.060 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.060 DEBUG:boto:Params: {} 2024-04-16T17:55:54.060 DEBUG:boto:Token: None 2024-04-16T17:55:54.060 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-16/obj 2024-04-16T17:55:54.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bJm+dndxlRkLBj345e+N5Ba1YZA= 2024-04-16T17:55:54.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bJm+dndxlRkLBj345e+N5Ba1YZA=', 'Content-Length': '0'} 2024-04-16T17:55:54.062 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:28 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000405f1e14c7e4780c-00661ebbaa-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.062 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:54.063 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:54.063 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:54.063 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:54.063 DEBUG:boto:Method: GET 2024-04-16T17:55:54.063 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:54.063 DEBUG:boto:Data: 2024-04-16T17:55:54.063 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:54.063 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.064 DEBUG:boto:Params: {} 2024-04-16T17:55:54.064 DEBUG:boto:Token: None 2024-04-16T17:55:54.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-16/ 2024-04-16T17:55:54.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w1fsDVqyNXemMRPbKhZCzMVzBxI= 2024-04-16T17:55:54.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w1fsDVqyNXemMRPbKhZCzMVzBxI=', 'Content-Length': '0'} 2024-04-16T17:55:54.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7daf3e9301ece5e-00661ebbaa-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.110 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:54.111 DEBUG:boto:path=/cjqttm-16/ 2024-04-16T17:55:54.111 DEBUG:boto:auth_path=/cjqttm-16/ 2024-04-16T17:55:54.111 DEBUG:boto:path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:54.111 DEBUG:boto:auth_path=/cjqttm-16/?prefix=obj 2024-04-16T17:55:54.111 DEBUG:boto:Method: GET 2024-04-16T17:55:54.111 DEBUG:boto:Path: /cjqttm-16/?prefix=obj 2024-04-16T17:55:54.111 DEBUG:boto:Data: 2024-04-16T17:55:54.111 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.112 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:54.112 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.112 DEBUG:boto:Params: {} 2024-04-16T17:55:54.112 DEBUG:boto:Token: None 2024-04-16T17:55:54.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-16/ 2024-04-16T17:55:54.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w1fsDVqyNXemMRPbKhZCzMVzBxI= 2024-04-16T17:55:54.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w1fsDVqyNXemMRPbKhZCzMVzBxI=', 'Content-Length': '0'} 2024-04-16T17:55:54.115 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000084f4b77da8a496b2-00661ebbaa-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.115 DEBUG:boto:b'cjqttm-16obj1000falseobj2024-04-16T17:55:28.403Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:55:54.116 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-16 zones={test-zone2, test-zone1} 2024-04-16T17:55:54.116 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2024-04-16T17:55:54.118 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-17 2024-04-16T17:55:54.119 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:55:54.119 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:55:54.119 DEBUG:boto:Method: PUT 2024-04-16T17:55:54.119 DEBUG:boto:Path: /cjqttm-17/ 2024-04-16T17:55:54.119 DEBUG:boto:Data: 2024-04-16T17:55:54.119 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:54.119 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.120 DEBUG:boto:Params: {} 2024-04-16T17:55:54.120 DEBUG:boto:Token: None 2024-04-16T17:55:54.120 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-17/ 2024-04-16T17:55:54.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:93lIXmns8ytizC0m0uTGVb+JPcE= 2024-04-16T17:55:54.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:93lIXmns8ytizC0m0uTGVb+JPcE=', 'Content-Length': '0'} 2024-04-16T17:55:54.139 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000cc24d07259523a7c-00661ebbaa-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.139 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-18 2024-04-16T17:55:54.139 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:55:54.139 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:55:54.139 DEBUG:boto:Method: PUT 2024-04-16T17:55:54.139 DEBUG:boto:Path: /cjqttm-18/ 2024-04-16T17:55:54.139 DEBUG:boto:Data: 2024-04-16T17:55:54.140 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.140 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:54.140 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.140 DEBUG:boto:Params: {} 2024-04-16T17:55:54.140 DEBUG:boto:Token: None 2024-04-16T17:55:54.140 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-18/ 2024-04-16T17:55:54.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DSetIK2FqEBz6fCLvDw9NB7zP9c= 2024-04-16T17:55:54.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DSetIK2FqEBz6fCLvDw9NB7zP9c=', 'Content-Length': '0'} 2024-04-16T17:55:54.171 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004c013d8a1adabc72-00661ebbaa-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.172 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:55:54.172 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:55:54.172 DEBUG:boto:path=/cjqttm-17/?versioning 2024-04-16T17:55:54.172 DEBUG:boto:auth_path=/cjqttm-17/?versioning 2024-04-16T17:55:54.172 DEBUG:boto:Method: PUT 2024-04-16T17:55:54.172 DEBUG:boto:Path: /cjqttm-17/?versioning 2024-04-16T17:55:54.172 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:55:54.172 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.172 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:54.172 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.173 DEBUG:boto:Params: {} 2024-04-16T17:55:54.173 DEBUG:boto:Token: None 2024-04-16T17:55:54.173 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-17/?versioning 2024-04-16T17:55:54.173 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iTsiRU+OXGXSv5sD7ugmMzorEug= 2024-04-16T17:55:54.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iTsiRU+OXGXSv5sD7ugmMzorEug=', 'Content-Length': '228'} 2024-04-16T17:55:54.179 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003e4c1b3b73f014e5-00661ebbaa-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.179 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:55:54.179 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:55:54.179 DEBUG:boto:path=/cjqttm-18/?versioning 2024-04-16T17:55:54.180 DEBUG:boto:auth_path=/cjqttm-18/?versioning 2024-04-16T17:55:54.180 DEBUG:boto:Method: PUT 2024-04-16T17:55:54.180 DEBUG:boto:Path: /cjqttm-18/?versioning 2024-04-16T17:55:54.180 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:55:54.180 DEBUG:boto:Headers: {} 2024-04-16T17:55:54.180 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:54.180 DEBUG:boto:Port: 8000 2024-04-16T17:55:54.180 DEBUG:boto:Params: {} 2024-04-16T17:55:54.180 DEBUG:boto:Token: None 2024-04-16T17:55:54.180 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:55:54 GMT /cjqttm-18/?versioning 2024-04-16T17:55:54.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yd8E187IPeoargUAS6FIsPAa2Yo= 2024-04-16T17:55:54.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yd8E187IPeoargUAS6FIsPAa2Yo=', 'Content-Length': '228'} 2024-04-16T17:55:54.190 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000077976e8c0f595b61-00661ebbaa-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:54.191 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:54.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:54.191 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:55:54.242 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:54.242 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:54.295 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:55:54.317 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290154.189316_173.1","last_update":"2024-04-16T17:55:54.189316Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:55:54.317 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290154.189316_173.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:54.317 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:55:54.317 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:54.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:54.318 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:55:54.372 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:54.373 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:54.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:54.427+0000 7f0abe813800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:54.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:54.429+0000 7f0abe813800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:54.447 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290128.135301_156.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:28.135301Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:54Z"} 2024-04-16T17:55:54.447 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290128.135301_156.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:28.135301Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:54Z"} 2024-04-16T17:55:54.448 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290128.135301_156.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:55:28.135301Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:55:54.448 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290154.189316_173.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:54.448 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290128.135301_156.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:54.448 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290154.189316_173.1 target=1_1713290128.135301_156.1 2024-04-16T17:55:59.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:59.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:55:59.449 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:55:59.504 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:59.504 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:59.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:59.561+0000 7f1282933800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:59.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:59.563+0000 7f1282933800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:55:59.582 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290154.189316_173.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:54.189316Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:59Z"} 2024-04-16T17:55:59.582 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290154.189316_173.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:55:54.189316Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:55:59Z"} 2024-04-16T17:55:59.582 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290154.189316_173.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:55:54.189316Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:55:59.582 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290154.189316_173.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:59.582 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290154.189316_173.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:55:59.582 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:55:59.583 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:55:59.583 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:55:59.583 DEBUG:boto:Method: HEAD 2024-04-16T17:55:59.583 DEBUG:boto:Path: /cjqttm-17/ 2024-04-16T17:55:59.583 DEBUG:boto:Data: 2024-04-16T17:55:59.583 DEBUG:boto:Headers: {} 2024-04-16T17:55:59.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:59.583 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.583 DEBUG:boto:Params: {} 2024-04-16T17:55:59.583 DEBUG:boto:Token: None 2024-04-16T17:55:59.584 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-17/ 2024-04-16T17:55:59.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:azXFAATakP8vC8EM/GKZ/d7gl3g= 2024-04-16T17:55:59.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:azXFAATakP8vC8EM/GKZ/d7gl3g=', 'Content-Length': '0'} 2024-04-16T17:55:59.586 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d2d63dd893985b1-00661ebbaf-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.586 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:55:59.587 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:55:59.587 DEBUG:boto:Method: PUT 2024-04-16T17:55:59.587 DEBUG:boto:Path: /cjqttm-17/obj 2024-04-16T17:55:59.587 DEBUG:boto:Data: 2024-04-16T17:55:59.587 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:55:59.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:59.587 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.587 DEBUG:boto:Params: {} 2024-04-16T17:55:59.587 DEBUG:boto:Token: None 2024-04-16T17:55:59.587 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-17/obj 2024-04-16T17:55:59.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Mu4OAOK+FBsFgl3TRFVmq6Dhh4A= 2024-04-16T17:55:59.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Mu4OAOK+FBsFgl3TRFVmq6Dhh4A='} 2024-04-16T17:55:59.602 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', 'mlJfS212NFg8J0LOePxU1yWz8rpR.mu'), ('x-amz-request-id', 'tx0000001b3d2ac82c96ec2-00661ebbaf-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.602 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:55:59.602 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:55:59.602 DEBUG:boto:Method: HEAD 2024-04-16T17:55:59.602 DEBUG:boto:Path: /cjqttm-17/ 2024-04-16T17:55:59.602 DEBUG:boto:Data: 2024-04-16T17:55:59.603 DEBUG:boto:Headers: {} 2024-04-16T17:55:59.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:59.603 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.603 DEBUG:boto:Params: {} 2024-04-16T17:55:59.603 DEBUG:boto:Token: None 2024-04-16T17:55:59.603 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-17/ 2024-04-16T17:55:59.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:azXFAATakP8vC8EM/GKZ/d7gl3g= 2024-04-16T17:55:59.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:azXFAATakP8vC8EM/GKZ/d7gl3g=', 'Content-Length': '0'} 2024-04-16T17:55:59.605 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003c39d8460265174e-00661ebbaf-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.606 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:55:59.606 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:55:59.606 DEBUG:boto:Method: DELETE 2024-04-16T17:55:59.606 DEBUG:boto:Path: /cjqttm-17/obj 2024-04-16T17:55:59.606 DEBUG:boto:Data: 2024-04-16T17:55:59.606 DEBUG:boto:Headers: {} 2024-04-16T17:55:59.606 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:55:59.606 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.606 DEBUG:boto:Params: {} 2024-04-16T17:55:59.606 DEBUG:boto:Token: None 2024-04-16T17:55:59.606 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-17/obj 2024-04-16T17:55:59.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZvMyFsUDZAEkVGbYRWf2hJB6OVE= 2024-04-16T17:55:59.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZvMyFsUDZAEkVGbYRWf2hJB6OVE=', 'Content-Length': '0'} 2024-04-16T17:55:59.614 DEBUG:boto:Response headers: [('x-amz-version-id', '7nQtZUzAWislx6WMypM90X1ulyTmi5r'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx0000093970ae7f44041fe-00661ebbaf-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.615 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:55:59.615 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:55:59.615 DEBUG:boto:Method: HEAD 2024-04-16T17:55:59.615 DEBUG:boto:Path: /cjqttm-18/ 2024-04-16T17:55:59.615 DEBUG:boto:Data: 2024-04-16T17:55:59.615 DEBUG:boto:Headers: {} 2024-04-16T17:55:59.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:59.615 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.615 DEBUG:boto:Params: {} 2024-04-16T17:55:59.616 DEBUG:boto:Token: None 2024-04-16T17:55:59.616 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-18/ 2024-04-16T17:55:59.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ffjPIJ3BMVTWhtZyOEzPfKfbdkk= 2024-04-16T17:55:59.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ffjPIJ3BMVTWhtZyOEzPfKfbdkk=', 'Content-Length': '0'} 2024-04-16T17:55:59.618 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006335630fff2180a1-00661ebbaf-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.618 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:55:59.619 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:55:59.619 DEBUG:boto:Method: PUT 2024-04-16T17:55:59.619 DEBUG:boto:Path: /cjqttm-18/obj 2024-04-16T17:55:59.619 DEBUG:boto:Data: 2024-04-16T17:55:59.619 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:55:59.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:59.619 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.619 DEBUG:boto:Params: {} 2024-04-16T17:55:59.619 DEBUG:boto:Token: None 2024-04-16T17:55:59.619 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-18/obj 2024-04-16T17:55:59.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4zTsoALM7wZWQOxWs2PNXXsL9tE= 2024-04-16T17:55:59.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4zTsoALM7wZWQOxWs2PNXXsL9tE='} 2024-04-16T17:55:59.666 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-version-id', '5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv'), ('x-amz-request-id', 'tx000003b3077db6958b7f5-00661ebbaf-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.667 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:55:59.667 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:55:59.667 DEBUG:boto:Method: HEAD 2024-04-16T17:55:59.667 DEBUG:boto:Path: /cjqttm-18/ 2024-04-16T17:55:59.667 DEBUG:boto:Data: 2024-04-16T17:55:59.667 DEBUG:boto:Headers: {} 2024-04-16T17:55:59.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:59.667 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.667 DEBUG:boto:Params: {} 2024-04-16T17:55:59.667 DEBUG:boto:Token: None 2024-04-16T17:55:59.667 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-18/ 2024-04-16T17:55:59.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ffjPIJ3BMVTWhtZyOEzPfKfbdkk= 2024-04-16T17:55:59.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ffjPIJ3BMVTWhtZyOEzPfKfbdkk=', 'Content-Length': '0'} 2024-04-16T17:55:59.669 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b3f14349792ed582-00661ebbaf-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.670 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:55:59.670 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:55:59.670 DEBUG:boto:Method: DELETE 2024-04-16T17:55:59.670 DEBUG:boto:Path: /cjqttm-18/obj 2024-04-16T17:55:59.670 DEBUG:boto:Data: 2024-04-16T17:55:59.670 DEBUG:boto:Headers: {} 2024-04-16T17:55:59.670 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:55:59.670 DEBUG:boto:Port: 8000 2024-04-16T17:55:59.670 DEBUG:boto:Params: {} 2024-04-16T17:55:59.671 DEBUG:boto:Token: None 2024-04-16T17:55:59.671 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:55:59 GMT /cjqttm-18/obj 2024-04-16T17:55:59.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P5g8sYfLW9qiNYZi216KGe2IR5E= 2024-04-16T17:55:59.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:55:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P5g8sYfLW9qiNYZi216KGe2IR5E=', 'Content-Length': '0'} 2024-04-16T17:55:59.678 DEBUG:boto:Response headers: [('x-amz-version-id', '.D2GMDDT4dAi06eOh4OQ279LjZsTIEI'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx00000e52f0f39d4689056-00661ebbaf-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:55:59.678 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-17 2024-04-16T17:55:59.679 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:59.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-17', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:55:59.679 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-17 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:55:59.734 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:55:59.734 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:55:59.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:55:59.793+0000 7f476be11800 1 waiting to reach incremental sync.. 2024-04-16T17:56:04.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:56:04.795+0000 7f476be11800 1 bucket sync caught up with source: 2024-04-16T17:56:04.793 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000003.27.12, , ] 2024-04-16T17:56:04.793 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000003.27.12, , ] 2024-04-16T17:56:04.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:56:04.795+0000 7f476be11800 0 bucket checkpoint complete 2024-04-16T17:56:04.818 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-17 2024-04-16T17:56:04.819 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:56:04.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-17', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:56:04.819 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-17 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:56:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:56:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:56:04.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:04.946+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:09.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:09.947+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:14.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:14.948+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:19.948+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:24.948 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:24.950+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:29.950 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:29.951+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:34.951 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:34.952+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:39.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:39.953+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:44.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:44.954+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:49.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:49.955+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:54.955 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:54.956+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:56:59.956 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:56:59.957+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:57:04.957 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:04.958+0000 7f014c816800 1 waiting to reach incremental sync.. 2024-04-16T17:57:09.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:09.960+0000 7f014c816800 1 bucket sync caught up with source: 2024-04-16T17:57:09.961 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000002.66.6, , ] 2024-04-16T17:57:09.961 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000002.66.6, , ] 2024-04-16T17:57:09.961 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:09.960+0000 7f014c816800 0 bucket checkpoint complete 2024-04-16T17:57:09.987 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-17 zones={test-zone2, test-zone1} 2024-04-16T17:57:09.987 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:09.987 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:09.988 DEBUG:boto:Method: HEAD 2024-04-16T17:57:09.988 DEBUG:boto:Path: /cjqttm-17/ 2024-04-16T17:57:09.988 DEBUG:boto:Data: 2024-04-16T17:57:09.988 DEBUG:boto:Headers: {} 2024-04-16T17:57:09.988 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:09.988 DEBUG:boto:Port: 8000 2024-04-16T17:57:09.988 DEBUG:boto:Params: {} 2024-04-16T17:57:09.989 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:57:09.989 DEBUG:boto:Token: None 2024-04-16T17:57:09.989 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:09 GMT /cjqttm-17/ 2024-04-16T17:57:09.989 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij5JyGDjTIW+Lt4Ocq0zacSekTU= 2024-04-16T17:57:09.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij5JyGDjTIW+Lt4Ocq0zacSekTU=', 'Content-Length': '0'} 2024-04-16T17:57:09.995 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ededda6e7d8b75a1-00661ebbf5-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:09.995 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:09.995 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:09.996 DEBUG:boto:Method: HEAD 2024-04-16T17:57:09.996 DEBUG:boto:Path: /cjqttm-17/ 2024-04-16T17:57:09.996 DEBUG:boto:Data: 2024-04-16T17:57:09.996 DEBUG:boto:Headers: {} 2024-04-16T17:57:09.996 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:09.996 DEBUG:boto:Port: 8000 2024-04-16T17:57:09.996 DEBUG:boto:Params: {} 2024-04-16T17:57:09.996 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:57:09.996 DEBUG:boto:Token: None 2024-04-16T17:57:09.997 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:09 GMT /cjqttm-17/ 2024-04-16T17:57:09.997 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij5JyGDjTIW+Lt4Ocq0zacSekTU= 2024-04-16T17:57:09.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij5JyGDjTIW+Lt4Ocq0zacSekTU=', 'Content-Length': '0'} 2024-04-16T17:57:10.001 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002611b792120f708c-00661ebbf6-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.001 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:57:10.002 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:10.002 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:10.002 DEBUG:boto:path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.002 DEBUG:boto:auth_path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.002 DEBUG:boto:Method: GET 2024-04-16T17:57:10.002 DEBUG:boto:Path: /cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.002 DEBUG:boto:Data: 2024-04-16T17:57:10.002 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.002 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.002 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.002 DEBUG:boto:Params: {} 2024-04-16T17:57:10.003 DEBUG:boto:Token: None 2024-04-16T17:57:10.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/?versions 2024-04-16T17:57:10.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo= 2024-04-16T17:57:10.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo=', 'Content-Length': '0'} 2024-04-16T17:57:10.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000484705873c5cfec1-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.006 DEBUG:boto:b'cjqttm-17999falseobj7nQtZUzAWislx6WMypM90X1ulyTmi5rtrue2024-04-16T17:55:59.611ZRGW11111111111111111NormalobjmlJfS212NFg8J0LOePxU1yWz8rpR.mufalse2024-04-16T17:55:59.592Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.007 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.007 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.007 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:57:10.007 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:10.007 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:10.007 DEBUG:boto:path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.007 DEBUG:boto:auth_path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.007 DEBUG:boto:Method: GET 2024-04-16T17:57:10.007 DEBUG:boto:Path: /cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.008 DEBUG:boto:Data: 2024-04-16T17:57:10.008 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.008 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.008 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.008 DEBUG:boto:Params: {} 2024-04-16T17:57:10.008 DEBUG:boto:Token: None 2024-04-16T17:57:10.008 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/?versions 2024-04-16T17:57:10.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo= 2024-04-16T17:57:10.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo=', 'Content-Length': '0'} 2024-04-16T17:57:10.011 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f5951e0c4b93670-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.011 DEBUG:boto:b'cjqttm-17999falseobj7nQtZUzAWislx6WMypM90X1ulyTmi5rtrue2024-04-16T17:55:59.611ZRGW11111111111111111NormalobjmlJfS212NFg8J0LOePxU1yWz8rpR.mufalse2024-04-16T17:55:59.592Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.012 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.012 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.012 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:10.012 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:10.012 DEBUG:boto:path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.012 DEBUG:boto:auth_path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.012 DEBUG:boto:Method: GET 2024-04-16T17:57:10.013 DEBUG:boto:Path: /cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.013 DEBUG:boto:Data: 2024-04-16T17:57:10.013 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.013 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.013 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.013 DEBUG:boto:Params: {} 2024-04-16T17:57:10.013 DEBUG:boto:Token: None 2024-04-16T17:57:10.013 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/?versions 2024-04-16T17:57:10.013 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo= 2024-04-16T17:57:10.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo=', 'Content-Length': '0'} 2024-04-16T17:57:10.016 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d5dc43158805a2b-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.016 DEBUG:boto:b'cjqttm-17999falseobj7nQtZUzAWislx6WMypM90X1ulyTmi5rtrue2024-04-16T17:55:59.611ZRGW11111111111111111NormalobjmlJfS212NFg8J0LOePxU1yWz8rpR.mufalse2024-04-16T17:55:59.592Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.016 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:10.016 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:10.016 DEBUG:boto:path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.017 DEBUG:boto:auth_path=/cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.017 DEBUG:boto:Method: GET 2024-04-16T17:57:10.017 DEBUG:boto:Path: /cjqttm-17/?versions&max-keys=999 2024-04-16T17:57:10.017 DEBUG:boto:Data: 2024-04-16T17:57:10.017 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.017 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.017 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.017 DEBUG:boto:Params: {} 2024-04-16T17:57:10.017 DEBUG:boto:Token: None 2024-04-16T17:57:10.017 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/?versions 2024-04-16T17:57:10.018 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo= 2024-04-16T17:57:10.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j9KS7S1RXQZkkMcF6+lOr0igCyo=', 'Content-Length': '0'} 2024-04-16T17:57:10.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f96813fd5a5451bd-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.020 DEBUG:boto:b'cjqttm-17999falseobj7nQtZUzAWislx6WMypM90X1ulyTmi5rtrue2024-04-16T17:55:59.611ZRGW11111111111111111NormalobjmlJfS212NFg8J0LOePxU1yWz8rpR.mufalse2024-04-16T17:55:59.592Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.021 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:10.021 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.021 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.021 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.021 DEBUG:boto:Path: /cjqttm-17/obj 2024-04-16T17:57:10.021 DEBUG:boto:Data: 2024-04-16T17:57:10.021 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.022 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.022 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.022 DEBUG:boto:Params: {} 2024-04-16T17:57:10.022 DEBUG:boto:Token: None 2024-04-16T17:57:10.022 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj 2024-04-16T17:57:10.022 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o= 2024-04-16T17:57:10.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o=', 'Content-Length': '0'} 2024-04-16T17:57:10.025 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000004867de9814ef70cd-00661ebbf6-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.025 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.025 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.025 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.025 DEBUG:boto:Path: /cjqttm-17/obj 2024-04-16T17:57:10.026 DEBUG:boto:Data: 2024-04-16T17:57:10.026 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.026 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.026 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.026 DEBUG:boto:Params: {} 2024-04-16T17:57:10.026 DEBUG:boto:Token: None 2024-04-16T17:57:10.026 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj 2024-04-16T17:57:10.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o= 2024-04-16T17:57:10.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o=', 'Content-Length': '0'} 2024-04-16T17:57:10.029 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000a44434fd62d77dd0-00661ebbf6-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:10.029 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.029 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.029 DEBUG:boto:path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.029 DEBUG:boto:auth_path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.030 DEBUG:boto:Method: GET 2024-04-16T17:57:10.030 DEBUG:boto:Path: /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.030 DEBUG:boto:Data: 2024-04-16T17:57:10.030 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.030 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.030 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.030 DEBUG:boto:Params: {} 2024-04-16T17:57:10.030 DEBUG:boto:Token: None 2024-04-16T17:57:10.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk= 2024-04-16T17:57:10.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk=', 'Content-Length': '0'} 2024-04-16T17:57:10.033 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', 'mlJfS212NFg8J0LOePxU1yWz8rpR.mu'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:56:02 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000c989ca81c4782d25-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.033 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.033 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.033 DEBUG:boto:path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.033 DEBUG:boto:auth_path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.034 DEBUG:boto:Method: GET 2024-04-16T17:57:10.034 DEBUG:boto:Path: /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.034 DEBUG:boto:Data: 2024-04-16T17:57:10.034 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.034 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.034 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.034 DEBUG:boto:Params: {} 2024-04-16T17:57:10.034 DEBUG:boto:Token: None 2024-04-16T17:57:10.034 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.034 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk= 2024-04-16T17:57:10.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk=', 'Content-Length': '0'} 2024-04-16T17:57:10.036 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', 'mlJfS212NFg8J0LOePxU1yWz8rpR.mu'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000273401adf1e531ce-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.036 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.036 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.037 DEBUG:boto:path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.037 DEBUG:boto:auth_path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.037 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.037 DEBUG:boto:Path: /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.037 DEBUG:boto:Data: 2024-04-16T17:57:10.037 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.037 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.037 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.037 DEBUG:boto:Params: {} 2024-04-16T17:57:10.037 DEBUG:boto:Token: None 2024-04-16T17:57:10.038 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.038 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1lEjPLPiVHJ4KnEcR+ypVN94nb8= 2024-04-16T17:57:10.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1lEjPLPiVHJ4KnEcR+ypVN94nb8=', 'Content-Length': '0'} 2024-04-16T17:57:10.040 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', 'mlJfS212NFg8J0LOePxU1yWz8rpR.mu'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:56:02 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000009945221b2e725735-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.040 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.040 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.040 DEBUG:boto:path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.040 DEBUG:boto:auth_path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.041 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.041 DEBUG:boto:Path: /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.041 DEBUG:boto:Data: 2024-04-16T17:57:10.041 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.041 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.041 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.041 DEBUG:boto:Params: {} 2024-04-16T17:57:10.041 DEBUG:boto:Token: None 2024-04-16T17:57:10.041 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.042 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1lEjPLPiVHJ4KnEcR+ypVN94nb8= 2024-04-16T17:57:10.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1lEjPLPiVHJ4KnEcR+ypVN94nb8=', 'Content-Length': '0'} 2024-04-16T17:57:10.043 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', 'mlJfS212NFg8J0LOePxU1yWz8rpR.mu'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b543e6bf24b73754-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:10.044 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.044 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.044 DEBUG:boto:path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.044 DEBUG:boto:auth_path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.044 DEBUG:boto:Method: GET 2024-04-16T17:57:10.044 DEBUG:boto:Path: /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.044 DEBUG:boto:Data: 2024-04-16T17:57:10.044 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.044 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.044 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.045 DEBUG:boto:Params: {} 2024-04-16T17:57:10.045 DEBUG:boto:Token: None 2024-04-16T17:57:10.045 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.045 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk= 2024-04-16T17:57:10.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk=', 'Content-Length': '0'} 2024-04-16T17:57:10.047 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', 'mlJfS212NFg8J0LOePxU1yWz8rpR.mu'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:56:02 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b97b63774193b27d-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.047 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.047 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.047 DEBUG:boto:path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.047 DEBUG:boto:auth_path=/cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.047 DEBUG:boto:Method: GET 2024-04-16T17:57:10.048 DEBUG:boto:Path: /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.048 DEBUG:boto:Data: 2024-04-16T17:57:10.048 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.048 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.048 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.048 DEBUG:boto:Params: {} 2024-04-16T17:57:10.048 DEBUG:boto:Token: None 2024-04-16T17:57:10.048 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj?versionId=mlJfS212NFg8J0LOePxU1yWz8rpR.mu 2024-04-16T17:57:10.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk= 2024-04-16T17:57:10.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D9N/Ck77VYrC7gNC0PViGx3gtYk=', 'Content-Length': '0'} 2024-04-16T17:57:10.050 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', 'mlJfS212NFg8J0LOePxU1yWz8rpR.mu'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000003075865025b47820-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.050 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:10.051 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:10.051 DEBUG:boto:path=/cjqttm-17/?prefix=obj 2024-04-16T17:57:10.051 DEBUG:boto:auth_path=/cjqttm-17/?prefix=obj 2024-04-16T17:57:10.051 DEBUG:boto:Method: GET 2024-04-16T17:57:10.051 DEBUG:boto:Path: /cjqttm-17/?prefix=obj 2024-04-16T17:57:10.051 DEBUG:boto:Data: 2024-04-16T17:57:10.051 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.051 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.051 DEBUG:boto:Params: {} 2024-04-16T17:57:10.052 DEBUG:boto:Token: None 2024-04-16T17:57:10.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/ 2024-04-16T17:57:10.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2GYX9ZP2M+v8087MFX8gvYI0zRU= 2024-04-16T17:57:10.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2GYX9ZP2M+v8087MFX8gvYI0zRU=', 'Content-Length': '0'} 2024-04-16T17:57:10.055 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8ecc1bd3b971637-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.102 DEBUG:boto:b'cjqttm-17obj1000false' 2024-04-16T17:57:10.103 DEBUG:boto:path=/cjqttm-17/ 2024-04-16T17:57:10.103 DEBUG:boto:auth_path=/cjqttm-17/ 2024-04-16T17:57:10.103 DEBUG:boto:path=/cjqttm-17/?prefix=obj 2024-04-16T17:57:10.103 DEBUG:boto:auth_path=/cjqttm-17/?prefix=obj 2024-04-16T17:57:10.103 DEBUG:boto:Method: GET 2024-04-16T17:57:10.103 DEBUG:boto:Path: /cjqttm-17/?prefix=obj 2024-04-16T17:57:10.103 DEBUG:boto:Data: 2024-04-16T17:57:10.103 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.104 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.104 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.104 DEBUG:boto:Params: {} 2024-04-16T17:57:10.104 DEBUG:boto:Token: None 2024-04-16T17:57:10.104 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/ 2024-04-16T17:57:10.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2GYX9ZP2M+v8087MFX8gvYI0zRU= 2024-04-16T17:57:10.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2GYX9ZP2M+v8087MFX8gvYI0zRU=', 'Content-Length': '0'} 2024-04-16T17:57:10.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070fcfe481f4214f3-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.107 DEBUG:boto:b'cjqttm-17obj1000false' 2024-04-16T17:57:10.107 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.107 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.107 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.107 DEBUG:boto:Path: /cjqttm-17/obj 2024-04-16T17:57:10.107 DEBUG:boto:Data: 2024-04-16T17:57:10.107 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.107 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.108 DEBUG:boto:Params: {} 2024-04-16T17:57:10.108 DEBUG:boto:Token: None 2024-04-16T17:57:10.108 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj 2024-04-16T17:57:10.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o= 2024-04-16T17:57:10.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o=', 'Content-Length': '0'} 2024-04-16T17:57:10.110 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000360bef6d3af8f8e3-00661ebbf6-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.110 DEBUG:boto:path=/cjqttm-17/obj 2024-04-16T17:57:10.110 DEBUG:boto:auth_path=/cjqttm-17/obj 2024-04-16T17:57:10.110 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.111 DEBUG:boto:Path: /cjqttm-17/obj 2024-04-16T17:57:10.111 DEBUG:boto:Data: 2024-04-16T17:57:10.111 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.111 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.111 DEBUG:boto:Params: {} 2024-04-16T17:57:10.111 DEBUG:boto:Token: None 2024-04-16T17:57:10.111 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-17/obj 2024-04-16T17:57:10.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o= 2024-04-16T17:57:10.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jd7A8gjyw5EwmzZT1d5HaELlb7o=', 'Content-Length': '0'} 2024-04-16T17:57:10.114 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000009db033fdbf8c6eb6-00661ebbf6-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.114 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-17 zones={test-zone2, test-zone1} 2024-04-16T17:57:10.114 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-18 2024-04-16T17:57:10.114 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:10.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-18', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:10.115 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-18 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:57:10.177 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:10.178 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:10.237 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:10.238+0000 7f96a7926800 1 bucket sync caught up with source: 2024-04-16T17:57:10.237 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.20.6, , ] 2024-04-16T17:57:10.238 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000002.20.6, , ] 2024-04-16T17:57:10.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:10.238+0000 7f96a7926800 0 bucket checkpoint complete 2024-04-16T17:57:10.257 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-18 2024-04-16T17:57:10.258 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:10.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-18', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:10.258 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-18 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:57:10.321 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:10.321 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:10.382 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:10.384+0000 7f4d8f723800 1 bucket sync caught up with source: 2024-04-16T17:57:10.383 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000003.45.12, , ] 2024-04-16T17:57:10.383 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000003.45.12, , ] 2024-04-16T17:57:10.383 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:10.384+0000 7f4d8f723800 0 bucket checkpoint complete 2024-04-16T17:57:10.404 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-18 zones={test-zone2, test-zone1} 2024-04-16T17:57:10.405 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.405 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.405 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.405 DEBUG:boto:Path: /cjqttm-18/ 2024-04-16T17:57:10.405 DEBUG:boto:Data: 2024-04-16T17:57:10.405 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.405 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.405 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.405 DEBUG:boto:Params: {} 2024-04-16T17:57:10.406 DEBUG:boto:Token: None 2024-04-16T17:57:10.406 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/ 2024-04-16T17:57:10.406 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3D/GZV0L3nctOfZ3Vd418Fwrjoc= 2024-04-16T17:57:10.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3D/GZV0L3nctOfZ3Vd418Fwrjoc=', 'Content-Length': '0'} 2024-04-16T17:57:10.408 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000aaec1862b8bc307b-00661ebbf6-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.408 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.408 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.408 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.408 DEBUG:boto:Path: /cjqttm-18/ 2024-04-16T17:57:10.408 DEBUG:boto:Data: 2024-04-16T17:57:10.409 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.409 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.409 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.409 DEBUG:boto:Params: {} 2024-04-16T17:57:10.409 DEBUG:boto:Token: None 2024-04-16T17:57:10.409 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/ 2024-04-16T17:57:10.409 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3D/GZV0L3nctOfZ3Vd418Fwrjoc= 2024-04-16T17:57:10.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3D/GZV0L3nctOfZ3Vd418Fwrjoc=', 'Content-Length': '0'} 2024-04-16T17:57:10.411 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000066230f0976d5e641-00661ebbf6-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.411 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:57:10.411 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.411 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.411 DEBUG:boto:path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.412 DEBUG:boto:auth_path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.412 DEBUG:boto:Method: GET 2024-04-16T17:57:10.412 DEBUG:boto:Path: /cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.412 DEBUG:boto:Data: 2024-04-16T17:57:10.412 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.412 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.412 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.412 DEBUG:boto:Params: {} 2024-04-16T17:57:10.412 DEBUG:boto:Token: None 2024-04-16T17:57:10.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/?versions 2024-04-16T17:57:10.413 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY= 2024-04-16T17:57:10.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY=', 'Content-Length': '0'} 2024-04-16T17:57:10.415 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088a5277e82f57dc5-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.415 DEBUG:boto:b'cjqttm-18999falseobj.D2GMDDT4dAi06eOh4OQ279LjZsTIEItrue2024-04-16T17:55:59.675ZRGW11111111111111111Normalobj5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgvfalse2024-04-16T17:55:59.623Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.415 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.415 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.416 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:57:10.416 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.416 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.416 DEBUG:boto:path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.416 DEBUG:boto:auth_path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.416 DEBUG:boto:Method: GET 2024-04-16T17:57:10.416 DEBUG:boto:Path: /cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.416 DEBUG:boto:Data: 2024-04-16T17:57:10.416 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.416 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.416 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.416 DEBUG:boto:Params: {} 2024-04-16T17:57:10.417 DEBUG:boto:Token: None 2024-04-16T17:57:10.417 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/?versions 2024-04-16T17:57:10.417 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY= 2024-04-16T17:57:10.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY=', 'Content-Length': '0'} 2024-04-16T17:57:10.419 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098588e72da806e0d-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.462 DEBUG:boto:b'cjqttm-18999falseobj.D2GMDDT4dAi06eOh4OQ279LjZsTIEItrue2024-04-16T17:55:59.675ZRGW11111111111111111Normalobj5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgvfalse2024-04-16T17:55:59.623Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.463 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.463 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:10.463 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.463 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.463 DEBUG:boto:path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.464 DEBUG:boto:auth_path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.464 DEBUG:boto:Method: GET 2024-04-16T17:57:10.464 DEBUG:boto:Path: /cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.464 DEBUG:boto:Data: 2024-04-16T17:57:10.464 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.464 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.464 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.464 DEBUG:boto:Params: {} 2024-04-16T17:57:10.465 DEBUG:boto:Token: None 2024-04-16T17:57:10.465 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/?versions 2024-04-16T17:57:10.465 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY= 2024-04-16T17:57:10.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY=', 'Content-Length': '0'} 2024-04-16T17:57:10.468 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b930042a1a057d48-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.468 DEBUG:boto:b'cjqttm-18999falseobj.D2GMDDT4dAi06eOh4OQ279LjZsTIEItrue2024-04-16T17:55:59.675ZRGW11111111111111111Normalobj5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgvfalse2024-04-16T17:55:59.623Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.468 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.468 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.469 DEBUG:boto:path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.469 DEBUG:boto:auth_path=/cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.469 DEBUG:boto:Method: GET 2024-04-16T17:57:10.469 DEBUG:boto:Path: /cjqttm-18/?versions&max-keys=999 2024-04-16T17:57:10.469 DEBUG:boto:Data: 2024-04-16T17:57:10.469 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.470 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.470 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.470 DEBUG:boto:Params: {} 2024-04-16T17:57:10.470 DEBUG:boto:Token: None 2024-04-16T17:57:10.470 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/?versions 2024-04-16T17:57:10.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY= 2024-04-16T17:57:10.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E8kJtWknvduW01R005+IxVO5EbY=', 'Content-Length': '0'} 2024-04-16T17:57:10.472 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be6feb34d1b8ecd9-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.473 DEBUG:boto:b'cjqttm-18999falseobj.D2GMDDT4dAi06eOh4OQ279LjZsTIEItrue2024-04-16T17:55:59.675ZRGW11111111111111111Normalobj5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgvfalse2024-04-16T17:55:59.623Z"d41d8cd98f00b204e9800998ecf8427e"0STANDARDRGW11111111111111111Normal' 2024-04-16T17:57:10.473 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:10.474 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.474 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.474 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.474 DEBUG:boto:Path: /cjqttm-18/obj 2024-04-16T17:57:10.474 DEBUG:boto:Data: 2024-04-16T17:57:10.474 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.475 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.475 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.475 DEBUG:boto:Params: {} 2024-04-16T17:57:10.475 DEBUG:boto:Token: None 2024-04-16T17:57:10.475 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj 2024-04-16T17:57:10.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE= 2024-04-16T17:57:10.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE=', 'Content-Length': '0'} 2024-04-16T17:57:10.478 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000004c69e61bc75deb6c-00661ebbf6-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.478 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.478 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.478 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.479 DEBUG:boto:Path: /cjqttm-18/obj 2024-04-16T17:57:10.479 DEBUG:boto:Data: 2024-04-16T17:57:10.479 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.479 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.479 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.479 DEBUG:boto:Params: {} 2024-04-16T17:57:10.480 DEBUG:boto:Token: None 2024-04-16T17:57:10.480 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj 2024-04-16T17:57:10.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE= 2024-04-16T17:57:10.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE=', 'Content-Length': '0'} 2024-04-16T17:57:10.482 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000441a07290131594d-00661ebbf6-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.482 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:10.483 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.483 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.483 DEBUG:boto:path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.483 DEBUG:boto:auth_path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.483 DEBUG:boto:Method: GET 2024-04-16T17:57:10.483 DEBUG:boto:Path: /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.484 DEBUG:boto:Data: 2024-04-16T17:57:10.484 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.484 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.484 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.484 DEBUG:boto:Params: {} 2024-04-16T17:57:10.484 DEBUG:boto:Token: None 2024-04-16T17:57:10.485 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.485 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0= 2024-04-16T17:57:10.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0=', 'Content-Length': '0'} 2024-04-16T17:57:10.487 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', '5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000b494d6cfdcf54e8b-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.487 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.487 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.488 DEBUG:boto:path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.488 DEBUG:boto:auth_path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.488 DEBUG:boto:Method: GET 2024-04-16T17:57:10.488 DEBUG:boto:Path: /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.488 DEBUG:boto:Data: 2024-04-16T17:57:10.489 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.489 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.489 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.489 DEBUG:boto:Params: {} 2024-04-16T17:57:10.489 DEBUG:boto:Token: None 2024-04-16T17:57:10.490 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.490 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0= 2024-04-16T17:57:10.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0=', 'Content-Length': '0'} 2024-04-16T17:57:10.492 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', '5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:56:01 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000008630b432b64c4348-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.492 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.493 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.493 DEBUG:boto:path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.493 DEBUG:boto:auth_path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.493 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.493 DEBUG:boto:Path: /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.493 DEBUG:boto:Data: 2024-04-16T17:57:10.494 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.494 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.494 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.494 DEBUG:boto:Params: {} 2024-04-16T17:57:10.494 DEBUG:boto:Token: None 2024-04-16T17:57:10.495 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zRSqJGyg+intdRUlaa3yOFYG7Sg= 2024-04-16T17:57:10.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zRSqJGyg+intdRUlaa3yOFYG7Sg=', 'Content-Length': '0'} 2024-04-16T17:57:10.497 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', '5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000393f41f8eb0c3afe-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.497 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.497 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.498 DEBUG:boto:path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.498 DEBUG:boto:auth_path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.498 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.498 DEBUG:boto:Path: /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.498 DEBUG:boto:Data: 2024-04-16T17:57:10.499 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.499 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.499 DEBUG:boto:Params: {} 2024-04-16T17:57:10.499 DEBUG:boto:Token: None 2024-04-16T17:57:10.499 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zRSqJGyg+intdRUlaa3yOFYG7Sg= 2024-04-16T17:57:10.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zRSqJGyg+intdRUlaa3yOFYG7Sg=', 'Content-Length': '0'} 2024-04-16T17:57:10.502 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', '5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:56:01 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx0000053adc7031d136c4b-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.502 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:10.502 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.502 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.503 DEBUG:boto:path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.503 DEBUG:boto:auth_path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.503 DEBUG:boto:Method: GET 2024-04-16T17:57:10.503 DEBUG:boto:Path: /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.503 DEBUG:boto:Data: 2024-04-16T17:57:10.503 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.504 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.504 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.504 DEBUG:boto:Params: {} 2024-04-16T17:57:10.504 DEBUG:boto:Token: None 2024-04-16T17:57:10.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.505 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0= 2024-04-16T17:57:10.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0=', 'Content-Length': '0'} 2024-04-16T17:57:10.506 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', '5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx00000d3b169f6fa857007-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.507 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.507 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.507 DEBUG:boto:path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.507 DEBUG:boto:auth_path=/cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.507 DEBUG:boto:Method: GET 2024-04-16T17:57:10.508 DEBUG:boto:Path: /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.508 DEBUG:boto:Data: 2024-04-16T17:57:10.508 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.508 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.508 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.508 DEBUG:boto:Params: {} 2024-04-16T17:57:10.508 DEBUG:boto:Token: None 2024-04-16T17:57:10.509 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj?versionId=5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv 2024-04-16T17:57:10.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0= 2024-04-16T17:57:10.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o066Fa/1vhaySAofuAn8vmce8c0=', 'Content-Length': '0'} 2024-04-16T17:57:10.511 DEBUG:boto:Response headers: [('Content-Length', '0'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 17:55:59 GMT'), ('x-amz-version-id', '5fdBXBX7OyRI.5YjJQlb6lZtRjU9tgv'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 17:56:01 GMT'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('x-amz-request-id', 'tx000000fdfac7c8bebe36b-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.511 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.511 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.511 DEBUG:boto:path=/cjqttm-18/?prefix=obj 2024-04-16T17:57:10.511 DEBUG:boto:auth_path=/cjqttm-18/?prefix=obj 2024-04-16T17:57:10.511 DEBUG:boto:Method: GET 2024-04-16T17:57:10.511 DEBUG:boto:Path: /cjqttm-18/?prefix=obj 2024-04-16T17:57:10.512 DEBUG:boto:Data: 2024-04-16T17:57:10.512 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.512 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.512 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.512 DEBUG:boto:Params: {} 2024-04-16T17:57:10.512 DEBUG:boto:Token: None 2024-04-16T17:57:10.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/ 2024-04-16T17:57:10.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OoI+lMTuJeh2iy2B9JZGBkaF91Q= 2024-04-16T17:57:10.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OoI+lMTuJeh2iy2B9JZGBkaF91Q=', 'Content-Length': '0'} 2024-04-16T17:57:10.515 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000667c7a4f52937933-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.558 DEBUG:boto:b'cjqttm-18obj1000false' 2024-04-16T17:57:10.559 DEBUG:boto:path=/cjqttm-18/ 2024-04-16T17:57:10.559 DEBUG:boto:auth_path=/cjqttm-18/ 2024-04-16T17:57:10.559 DEBUG:boto:path=/cjqttm-18/?prefix=obj 2024-04-16T17:57:10.559 DEBUG:boto:auth_path=/cjqttm-18/?prefix=obj 2024-04-16T17:57:10.559 DEBUG:boto:Method: GET 2024-04-16T17:57:10.559 DEBUG:boto:Path: /cjqttm-18/?prefix=obj 2024-04-16T17:57:10.559 DEBUG:boto:Data: 2024-04-16T17:57:10.559 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.559 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.560 DEBUG:boto:Params: {} 2024-04-16T17:57:10.560 DEBUG:boto:Token: None 2024-04-16T17:57:10.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/ 2024-04-16T17:57:10.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OoI+lMTuJeh2iy2B9JZGBkaF91Q= 2024-04-16T17:57:10.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OoI+lMTuJeh2iy2B9JZGBkaF91Q=', 'Content-Length': '0'} 2024-04-16T17:57:10.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d3faf73ab318398-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.563 DEBUG:boto:b'cjqttm-18obj1000false' 2024-04-16T17:57:10.563 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.563 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.563 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.563 DEBUG:boto:Path: /cjqttm-18/obj 2024-04-16T17:57:10.563 DEBUG:boto:Data: 2024-04-16T17:57:10.563 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.563 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.564 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.564 DEBUG:boto:Params: {} 2024-04-16T17:57:10.564 DEBUG:boto:Token: None 2024-04-16T17:57:10.564 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj 2024-04-16T17:57:10.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE= 2024-04-16T17:57:10.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE=', 'Content-Length': '0'} 2024-04-16T17:57:10.567 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000898d57b896c11d77-00661ebbf6-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.567 DEBUG:boto:path=/cjqttm-18/obj 2024-04-16T17:57:10.567 DEBUG:boto:auth_path=/cjqttm-18/obj 2024-04-16T17:57:10.567 DEBUG:boto:Method: HEAD 2024-04-16T17:57:10.567 DEBUG:boto:Path: /cjqttm-18/obj 2024-04-16T17:57:10.567 DEBUG:boto:Data: 2024-04-16T17:57:10.567 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.567 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.567 DEBUG:boto:Params: {} 2024-04-16T17:57:10.568 DEBUG:boto:Token: None 2024-04-16T17:57:10.568 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-18/obj 2024-04-16T17:57:10.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE= 2024-04-16T17:57:10.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FE3p6qr5Io+WeDz8Cc8I4OiT7nE=', 'Content-Length': '0'} 2024-04-16T17:57:10.570 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx000001228d6c025b2a7c6-00661ebbf6-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.570 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-18 zones={test-zone2, test-zone1} 2024-04-16T17:57:10.571 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2024-04-16T17:57:10.572 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-19 2024-04-16T17:57:10.572 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:10.572 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:10.572 DEBUG:boto:Method: PUT 2024-04-16T17:57:10.572 DEBUG:boto:Path: /cjqttm-19/ 2024-04-16T17:57:10.573 DEBUG:boto:Data: 2024-04-16T17:57:10.573 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.573 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.573 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.573 DEBUG:boto:Params: {} 2024-04-16T17:57:10.573 DEBUG:boto:Token: None 2024-04-16T17:57:10.573 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-19/ 2024-04-16T17:57:10.573 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y7Jgf/DUxo8+nblxDDNuK9EHUhY= 2024-04-16T17:57:10.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y7Jgf/DUxo8+nblxDDNuK9EHUhY=', 'Content-Length': '0'} 2024-04-16T17:57:10.589 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000041cebaa54f45acca-00661ebbf6-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.589 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-20 2024-04-16T17:57:10.589 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:10.589 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:10.589 DEBUG:boto:Method: PUT 2024-04-16T17:57:10.589 DEBUG:boto:Path: /cjqttm-20/ 2024-04-16T17:57:10.590 DEBUG:boto:Data: 2024-04-16T17:57:10.590 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.590 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.590 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.590 DEBUG:boto:Params: {} 2024-04-16T17:57:10.590 DEBUG:boto:Token: None 2024-04-16T17:57:10.590 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-20/ 2024-04-16T17:57:10.590 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ujlyd7mKFJ8UDyZzs3sdt4PdXto= 2024-04-16T17:57:10.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ujlyd7mKFJ8UDyZzs3sdt4PdXto=', 'Content-Length': '0'} 2024-04-16T17:57:10.616 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000a595ab8a740e2c92-00661ebbf6-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.616 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:10.616 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:10.616 DEBUG:boto:path=/cjqttm-19/?versioning 2024-04-16T17:57:10.617 DEBUG:boto:auth_path=/cjqttm-19/?versioning 2024-04-16T17:57:10.617 DEBUG:boto:Method: PUT 2024-04-16T17:57:10.617 DEBUG:boto:Path: /cjqttm-19/?versioning 2024-04-16T17:57:10.617 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:57:10.617 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.617 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.617 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.617 DEBUG:boto:Params: {} 2024-04-16T17:57:10.617 DEBUG:boto:Token: None 2024-04-16T17:57:10.617 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-19/?versioning 2024-04-16T17:57:10.617 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4mMJMpMXV7TpX2kdRn2rh95egrQ= 2024-04-16T17:57:10.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4mMJMpMXV7TpX2kdRn2rh95egrQ=', 'Content-Length': '228'} 2024-04-16T17:57:10.624 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005b836ee135bcd626-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.624 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:10.624 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:10.624 DEBUG:boto:path=/cjqttm-19/?versioning 2024-04-16T17:57:10.625 DEBUG:boto:auth_path=/cjqttm-19/?versioning 2024-04-16T17:57:10.625 DEBUG:boto:Method: PUT 2024-04-16T17:57:10.625 DEBUG:boto:Path: /cjqttm-19/?versioning 2024-04-16T17:57:10.625 DEBUG:boto:Data: Suspended Disabled 2024-04-16T17:57:10.625 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.625 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:10.625 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.625 DEBUG:boto:Params: {} 2024-04-16T17:57:10.625 DEBUG:boto:Token: None 2024-04-16T17:57:10.625 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-19/?versioning 2024-04-16T17:57:10.625 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4mMJMpMXV7TpX2kdRn2rh95egrQ= 2024-04-16T17:57:10.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4mMJMpMXV7TpX2kdRn2rh95egrQ=', 'Content-Length': '230'} 2024-04-16T17:57:10.631 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c3633e57c39a24b2-00661ebbf6-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.631 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:10.631 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:10.631 DEBUG:boto:path=/cjqttm-20/?versioning 2024-04-16T17:57:10.632 DEBUG:boto:auth_path=/cjqttm-20/?versioning 2024-04-16T17:57:10.632 DEBUG:boto:Method: PUT 2024-04-16T17:57:10.632 DEBUG:boto:Path: /cjqttm-20/?versioning 2024-04-16T17:57:10.632 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:57:10.632 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.632 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.632 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.632 DEBUG:boto:Params: {} 2024-04-16T17:57:10.632 DEBUG:boto:Token: None 2024-04-16T17:57:10.632 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-20/?versioning 2024-04-16T17:57:10.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mK5fz/9l8DtRQHX0a2IHvR2Uq+4= 2024-04-16T17:57:10.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mK5fz/9l8DtRQHX0a2IHvR2Uq+4=', 'Content-Length': '228'} 2024-04-16T17:57:10.642 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d68ad3630e50302b-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.642 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:10.642 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:10.642 DEBUG:boto:path=/cjqttm-20/?versioning 2024-04-16T17:57:10.642 DEBUG:boto:auth_path=/cjqttm-20/?versioning 2024-04-16T17:57:10.642 DEBUG:boto:Method: PUT 2024-04-16T17:57:10.642 DEBUG:boto:Path: /cjqttm-20/?versioning 2024-04-16T17:57:10.642 DEBUG:boto:Data: Suspended Disabled 2024-04-16T17:57:10.643 DEBUG:boto:Headers: {} 2024-04-16T17:57:10.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:10.643 DEBUG:boto:Port: 8000 2024-04-16T17:57:10.643 DEBUG:boto:Params: {} 2024-04-16T17:57:10.643 DEBUG:boto:Token: None 2024-04-16T17:57:10.643 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:10 GMT /cjqttm-20/?versioning 2024-04-16T17:57:10.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mK5fz/9l8DtRQHX0a2IHvR2Uq+4= 2024-04-16T17:57:10.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mK5fz/9l8DtRQHX0a2IHvR2Uq+4=', 'Content-Length': '230'} 2024-04-16T17:57:10.653 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004397941a9a9bab16-00661ebbf6-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:10.653 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:10.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:10.654 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:10.701 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:10.701 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:10.751 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:57:10.771 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290230.651981_210.1","last_update":"2024-04-16T17:57:10.651981Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:57:10.772 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290230.651981_210.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:10.772 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:57:10.772 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:10.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:10.772 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:10.821 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:10.821 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:10.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:10.870+0000 7f68dbb11800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:10.870 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:10.871+0000 7f68dbb11800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:10.890 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290230.608187_202.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:10.608187Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:10Z"} 2024-04-16T17:57:10.890 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290230.608187_202.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:10.608187Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:10Z"} 2024-04-16T17:57:10.890 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290230.608187_202.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:10.608187Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:10.890 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290230.651981_210.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:10.891 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290230.608187_202.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:10.891 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290230.651981_210.1 target=1_1713290230.608187_202.1 2024-04-16T17:57:15.892 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:15.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:15.893 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:15.947 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:15.948 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:15.999 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:16.000+0000 7fbd7b412800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:16.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:16.002+0000 7fbd7b412800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:16.022 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290230.651981_210.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:10.651981Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:16Z"} 2024-04-16T17:57:16.022 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290230.651981_210.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:10.651981Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:16Z"} 2024-04-16T17:57:16.022 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290230.651981_210.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:10.651981Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:16.023 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290230.651981_210.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:16.023 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290230.651981_210.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:16.023 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:57:16.023 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:16.023 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:16.023 DEBUG:boto:Method: HEAD 2024-04-16T17:57:16.024 DEBUG:boto:Path: /cjqttm-19/ 2024-04-16T17:57:16.024 DEBUG:boto:Data: 2024-04-16T17:57:16.024 DEBUG:boto:Headers: {} 2024-04-16T17:57:16.024 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:16.024 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.024 DEBUG:boto:Params: {} 2024-04-16T17:57:16.024 DEBUG:boto:Token: None 2024-04-16T17:57:16.024 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-19/ 2024-04-16T17:57:16.025 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zqJ3wSGfjs6tLDOu1EhcVnrvUJM= 2024-04-16T17:57:16.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zqJ3wSGfjs6tLDOu1EhcVnrvUJM=', 'Content-Length': '0'} 2024-04-16T17:57:16.028 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000204308e720ef6c29-00661ebbfc-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.028 DEBUG:boto:path=/cjqttm-19/obj 2024-04-16T17:57:16.028 DEBUG:boto:auth_path=/cjqttm-19/obj 2024-04-16T17:57:16.028 DEBUG:boto:Method: PUT 2024-04-16T17:57:16.028 DEBUG:boto:Path: /cjqttm-19/obj 2024-04-16T17:57:16.028 DEBUG:boto:Data: 2024-04-16T17:57:16.029 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:57:16.029 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:16.029 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.029 DEBUG:boto:Params: {} 2024-04-16T17:57:16.029 DEBUG:boto:Token: None 2024-04-16T17:57:16.029 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-19/obj 2024-04-16T17:57:16.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U1TmGFu+zXEvxFISNDVpfbNIYus= 2024-04-16T17:57:16.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1TmGFu+zXEvxFISNDVpfbNIYus='} 2024-04-16T17:57:16.037 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f0c44b048b24c5e6-00661ebbfc-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.037 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:16.037 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:16.037 DEBUG:boto:Method: HEAD 2024-04-16T17:57:16.037 DEBUG:boto:Path: /cjqttm-19/ 2024-04-16T17:57:16.037 DEBUG:boto:Data: 2024-04-16T17:57:16.037 DEBUG:boto:Headers: {} 2024-04-16T17:57:16.038 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:16.038 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.038 DEBUG:boto:Params: {} 2024-04-16T17:57:16.038 DEBUG:boto:Token: None 2024-04-16T17:57:16.038 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-19/ 2024-04-16T17:57:16.038 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zqJ3wSGfjs6tLDOu1EhcVnrvUJM= 2024-04-16T17:57:16.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zqJ3wSGfjs6tLDOu1EhcVnrvUJM=', 'Content-Length': '0'} 2024-04-16T17:57:16.040 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000522117f7acd5eee1-00661ebbfc-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.041 DEBUG:boto:path=/cjqttm-19/obj 2024-04-16T17:57:16.041 DEBUG:boto:auth_path=/cjqttm-19/obj 2024-04-16T17:57:16.041 DEBUG:boto:Method: DELETE 2024-04-16T17:57:16.041 DEBUG:boto:Path: /cjqttm-19/obj 2024-04-16T17:57:16.041 DEBUG:boto:Data: 2024-04-16T17:57:16.041 DEBUG:boto:Headers: {} 2024-04-16T17:57:16.041 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:16.041 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.041 DEBUG:boto:Params: {} 2024-04-16T17:57:16.042 DEBUG:boto:Token: None 2024-04-16T17:57:16.042 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-19/obj 2024-04-16T17:57:16.042 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A92mnpSS667MkvnMuVUwMjZDbXE= 2024-04-16T17:57:16.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A92mnpSS667MkvnMuVUwMjZDbXE=', 'Content-Length': '0'} 2024-04-16T17:57:16.053 DEBUG:boto:Response headers: [('x-amz-version-id', 'null'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx00000e7c761bb06a8b0ef-00661ebbfc-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.054 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:16.054 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:16.054 DEBUG:boto:Method: HEAD 2024-04-16T17:57:16.054 DEBUG:boto:Path: /cjqttm-20/ 2024-04-16T17:57:16.054 DEBUG:boto:Data: 2024-04-16T17:57:16.054 DEBUG:boto:Headers: {} 2024-04-16T17:57:16.054 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:16.054 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.054 DEBUG:boto:Params: {} 2024-04-16T17:57:16.055 DEBUG:boto:Token: None 2024-04-16T17:57:16.055 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-20/ 2024-04-16T17:57:16.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W14BMY427aPNzrB1oahSQCdXZAA= 2024-04-16T17:57:16.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W14BMY427aPNzrB1oahSQCdXZAA=', 'Content-Length': '0'} 2024-04-16T17:57:16.058 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ccb7d6353fe8539-00661ebbfc-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.058 DEBUG:boto:path=/cjqttm-20/obj 2024-04-16T17:57:16.058 DEBUG:boto:auth_path=/cjqttm-20/obj 2024-04-16T17:57:16.058 DEBUG:boto:Method: PUT 2024-04-16T17:57:16.058 DEBUG:boto:Path: /cjqttm-20/obj 2024-04-16T17:57:16.058 DEBUG:boto:Data: 2024-04-16T17:57:16.058 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue'} 2024-04-16T17:57:16.058 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:16.059 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.059 DEBUG:boto:Params: {} 2024-04-16T17:57:16.059 DEBUG:boto:Token: None 2024-04-16T17:57:16.059 DEBUG:boto:StringToSign: PUT 1B2M2Y8AsgTpgAmY7PhCfg== application/octet-stream Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-20/obj 2024-04-16T17:57:16.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5leuwQeDu/nsBX54kaAEn8gnKSw= 2024-04-16T17:57:16.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Content-Length': '0', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5leuwQeDu/nsBX54kaAEn8gnKSw='} 2024-04-16T17:57:16.066 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"d41d8cd98f00b204e9800998ecf8427e"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b7f7c77ff8b8f4e4-00661ebbfc-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.066 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:16.066 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:16.066 DEBUG:boto:Method: HEAD 2024-04-16T17:57:16.066 DEBUG:boto:Path: /cjqttm-20/ 2024-04-16T17:57:16.066 DEBUG:boto:Data: 2024-04-16T17:57:16.066 DEBUG:boto:Headers: {} 2024-04-16T17:57:16.067 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:16.067 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.067 DEBUG:boto:Params: {} 2024-04-16T17:57:16.067 DEBUG:boto:Token: None 2024-04-16T17:57:16.067 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-20/ 2024-04-16T17:57:16.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W14BMY427aPNzrB1oahSQCdXZAA= 2024-04-16T17:57:16.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W14BMY427aPNzrB1oahSQCdXZAA=', 'Content-Length': '0'} 2024-04-16T17:57:16.070 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000058952c35f0bfcb1-00661ebbfc-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.070 DEBUG:boto:path=/cjqttm-20/obj 2024-04-16T17:57:16.070 DEBUG:boto:auth_path=/cjqttm-20/obj 2024-04-16T17:57:16.070 DEBUG:boto:Method: DELETE 2024-04-16T17:57:16.070 DEBUG:boto:Path: /cjqttm-20/obj 2024-04-16T17:57:16.071 DEBUG:boto:Data: 2024-04-16T17:57:16.071 DEBUG:boto:Headers: {} 2024-04-16T17:57:16.071 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:16.071 DEBUG:boto:Port: 8000 2024-04-16T17:57:16.071 DEBUG:boto:Params: {} 2024-04-16T17:57:16.071 DEBUG:boto:Token: None 2024-04-16T17:57:16.071 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:57:16 GMT /cjqttm-20/obj 2024-04-16T17:57:16.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RT+1mcIvKrMKS4mRJ0I3DgxeFJQ= 2024-04-16T17:57:16.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RT+1mcIvKrMKS4mRJ0I3DgxeFJQ=', 'Content-Length': '0'} 2024-04-16T17:57:16.081 DEBUG:boto:Response headers: [('x-amz-version-id', 'null'), ('x-amz-delete-marker', 'true'), ('x-amz-request-id', 'tx00000c907efab2bf3271f-00661ebbfc-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:16.081 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-19 2024-04-16T17:57:16.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:16.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-19', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:16.081 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-19 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:57:16.138 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:16.138 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:16.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:16.193+0000 7fd01652f800 1 waiting to reach incremental sync.. 2024-04-16T17:57:21.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:21.195+0000 7fd01652f800 1 bucket sync caught up with source: 2024-04-16T17:57:21.195 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000003.17.7, , ] 2024-04-16T17:57:21.195 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000003.17.7, , ] 2024-04-16T17:57:21.195 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:21.195+0000 7fd01652f800 0 bucket checkpoint complete 2024-04-16T17:57:21.219 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-19 2024-04-16T17:57:21.219 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:21.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-19', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:21.219 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-19 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:57:21.282 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:21.283 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:21.343 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:21.344+0000 7fe74ace4800 1 waiting to reach incremental sync.. 2024-04-16T17:57:26.345 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:26.346+0000 7fe74ace4800 1 bucket sync caught up with source: 2024-04-16T17:57:26.346 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000001.11.14, , ] 2024-04-16T17:57:26.346 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000001.11.14, , ] 2024-04-16T17:57:26.346 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:26.346+0000 7fe74ace4800 0 bucket checkpoint complete 2024-04-16T17:57:26.371 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-19 zones={test-zone2, test-zone1} 2024-04-16T17:57:26.372 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:26.372 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:26.372 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.372 DEBUG:boto:Path: /cjqttm-19/ 2024-04-16T17:57:26.372 DEBUG:boto:Data: 2024-04-16T17:57:26.372 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.372 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.372 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.372 DEBUG:boto:Params: {} 2024-04-16T17:57:26.372 DEBUG:boto:Token: None 2024-04-16T17:57:26.373 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/ 2024-04-16T17:57:26.373 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8aInLx6fEboo5zd2eUz/QGtDZNA= 2024-04-16T17:57:26.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8aInLx6fEboo5zd2eUz/QGtDZNA=', 'Content-Length': '0'} 2024-04-16T17:57:26.375 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d27949ee67e7d2d2-00661ebc06-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.376 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:26.376 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:26.376 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.376 DEBUG:boto:Path: /cjqttm-19/ 2024-04-16T17:57:26.376 DEBUG:boto:Data: 2024-04-16T17:57:26.376 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.376 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.376 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.376 DEBUG:boto:Params: {} 2024-04-16T17:57:26.376 DEBUG:boto:Token: None 2024-04-16T17:57:26.376 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/ 2024-04-16T17:57:26.377 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8aInLx6fEboo5zd2eUz/QGtDZNA= 2024-04-16T17:57:26.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8aInLx6fEboo5zd2eUz/QGtDZNA=', 'Content-Length': '0'} 2024-04-16T17:57:26.379 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008995dda0f5bdcc35-00661ebc06-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.379 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:57:26.379 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:26.379 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:26.379 DEBUG:boto:path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.380 DEBUG:boto:auth_path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.380 DEBUG:boto:Method: GET 2024-04-16T17:57:26.380 DEBUG:boto:Path: /cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.380 DEBUG:boto:Data: 2024-04-16T17:57:26.380 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.380 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.380 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.380 DEBUG:boto:Params: {} 2024-04-16T17:57:26.380 DEBUG:boto:Token: None 2024-04-16T17:57:26.380 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/?versions 2024-04-16T17:57:26.381 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc= 2024-04-16T17:57:26.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc=', 'Content-Length': '0'} 2024-04-16T17:57:26.383 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f79c3f1087737c63-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.383 DEBUG:boto:b'cjqttm-19999falseobjnulltrue2024-04-16T17:57:16.046ZRGW11111111111111111Normal' 2024-04-16T17:57:26.384 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:26.384 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:57:26.384 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:26.384 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:26.384 DEBUG:boto:path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.384 DEBUG:boto:auth_path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.385 DEBUG:boto:Method: GET 2024-04-16T17:57:26.385 DEBUG:boto:Path: /cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.385 DEBUG:boto:Data: 2024-04-16T17:57:26.385 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.385 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.385 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.385 DEBUG:boto:Params: {} 2024-04-16T17:57:26.385 DEBUG:boto:Token: None 2024-04-16T17:57:26.385 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/?versions 2024-04-16T17:57:26.385 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc= 2024-04-16T17:57:26.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc=', 'Content-Length': '0'} 2024-04-16T17:57:26.388 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba0cfc5aece64f55-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.430 DEBUG:boto:b'cjqttm-19999falseobjnulltrue2024-04-16T17:57:16.046ZRGW11111111111111111Normal' 2024-04-16T17:57:26.431 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:26.431 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:26.431 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:26.431 DEBUG:boto:path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.431 DEBUG:boto:auth_path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.431 DEBUG:boto:Method: GET 2024-04-16T17:57:26.431 DEBUG:boto:Path: /cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.431 DEBUG:boto:Data: 2024-04-16T17:57:26.431 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.432 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.432 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.432 DEBUG:boto:Params: {} 2024-04-16T17:57:26.432 DEBUG:boto:Token: None 2024-04-16T17:57:26.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/?versions 2024-04-16T17:57:26.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc= 2024-04-16T17:57:26.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc=', 'Content-Length': '0'} 2024-04-16T17:57:26.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a46848dee38c0b6-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.435 DEBUG:boto:b'cjqttm-19999falseobjnulltrue2024-04-16T17:57:16.046ZRGW11111111111111111Normal' 2024-04-16T17:57:26.435 DEBUG:boto:path=/cjqttm-19/ 2024-04-16T17:57:26.435 DEBUG:boto:auth_path=/cjqttm-19/ 2024-04-16T17:57:26.435 DEBUG:boto:path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.435 DEBUG:boto:auth_path=/cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.435 DEBUG:boto:Method: GET 2024-04-16T17:57:26.435 DEBUG:boto:Path: /cjqttm-19/?versions&max-keys=999 2024-04-16T17:57:26.436 DEBUG:boto:Data: 2024-04-16T17:57:26.436 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.436 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.436 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.436 DEBUG:boto:Params: {} 2024-04-16T17:57:26.436 DEBUG:boto:Token: None 2024-04-16T17:57:26.436 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/?versions 2024-04-16T17:57:26.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc= 2024-04-16T17:57:26.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaLrv4VyAH3PHGwHJ8KdhUQeQLc=', 'Content-Length': '0'} 2024-04-16T17:57:26.439 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae2d8b67a7830244-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.439 DEBUG:boto:b'cjqttm-19999falseobjnulltrue2024-04-16T17:57:16.046ZRGW11111111111111111Normal' 2024-04-16T17:57:26.439 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:26.439 DEBUG:boto:path=/cjqttm-19/obj 2024-04-16T17:57:26.439 DEBUG:boto:auth_path=/cjqttm-19/obj 2024-04-16T17:57:26.439 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.440 DEBUG:boto:Path: /cjqttm-19/obj 2024-04-16T17:57:26.440 DEBUG:boto:Data: 2024-04-16T17:57:26.440 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.440 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.440 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.440 DEBUG:boto:Params: {} 2024-04-16T17:57:26.440 DEBUG:boto:Token: None 2024-04-16T17:57:26.440 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/obj 2024-04-16T17:57:26.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0MnLFCWO0KaliMAeLishf84H1cw= 2024-04-16T17:57:26.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0MnLFCWO0KaliMAeLishf84H1cw=', 'Content-Length': '0'} 2024-04-16T17:57:26.442 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000a50ae06a45fdd31e-00661ebc06-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.442 DEBUG:boto:path=/cjqttm-19/obj 2024-04-16T17:57:26.442 DEBUG:boto:auth_path=/cjqttm-19/obj 2024-04-16T17:57:26.442 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.443 DEBUG:boto:Path: /cjqttm-19/obj 2024-04-16T17:57:26.443 DEBUG:boto:Data: 2024-04-16T17:57:26.443 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.443 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.443 DEBUG:boto:Params: {} 2024-04-16T17:57:26.443 DEBUG:boto:Token: None 2024-04-16T17:57:26.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-19/obj 2024-04-16T17:57:26.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0MnLFCWO0KaliMAeLishf84H1cw= 2024-04-16T17:57:26.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0MnLFCWO0KaliMAeLishf84H1cw=', 'Content-Length': '0'} 2024-04-16T17:57:26.445 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000e0c96b128c07238e-00661ebc06-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.445 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-19 zones={test-zone2, test-zone1} 2024-04-16T17:57:26.445 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-20 2024-04-16T17:57:26.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:26.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-20', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:26.445 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-20 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T17:57:26.508 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:26.508 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:26.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:26.571+0000 7f9a5b73b800 1 bucket sync caught up with source: 2024-04-16T17:57:26.569 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000001.32.14, , ] 2024-04-16T17:57:26.569 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000001.32.14, , ] 2024-04-16T17:57:26.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:26.571+0000 7f9a5b73b800 0 bucket checkpoint complete 2024-04-16T17:57:26.589 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-20 2024-04-16T17:57:26.589 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:26.589 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-20', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T17:57:26.589 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-20 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T17:57:26.652 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:26.652 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:26.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:26.713+0000 7f45bcf2d800 1 bucket sync caught up with source: 2024-04-16T17:57:26.713 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000003.103.7, , ] 2024-04-16T17:57:26.713 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000003.103.7, , ] 2024-04-16T17:57:26.713 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T17:57:26.713+0000 7f45bcf2d800 0 bucket checkpoint complete 2024-04-16T17:57:26.734 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-20 zones={test-zone2, test-zone1} 2024-04-16T17:57:26.734 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:26.734 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:26.734 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.735 DEBUG:boto:Path: /cjqttm-20/ 2024-04-16T17:57:26.735 DEBUG:boto:Data: 2024-04-16T17:57:26.735 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.735 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.735 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.735 DEBUG:boto:Params: {} 2024-04-16T17:57:26.735 DEBUG:boto:Token: None 2024-04-16T17:57:26.735 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/ 2024-04-16T17:57:26.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qZCf9rJqZWnFqKGqO7lQLoH786w= 2024-04-16T17:57:26.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qZCf9rJqZWnFqKGqO7lQLoH786w=', 'Content-Length': '0'} 2024-04-16T17:57:26.738 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005515263f6ab0eab9-00661ebc06-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.738 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:26.738 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:26.738 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.738 DEBUG:boto:Path: /cjqttm-20/ 2024-04-16T17:57:26.738 DEBUG:boto:Data: 2024-04-16T17:57:26.738 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.739 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.739 DEBUG:boto:Params: {} 2024-04-16T17:57:26.739 DEBUG:boto:Token: None 2024-04-16T17:57:26.739 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/ 2024-04-16T17:57:26.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qZCf9rJqZWnFqKGqO7lQLoH786w= 2024-04-16T17:57:26.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qZCf9rJqZWnFqKGqO7lQLoH786w=', 'Content-Length': '0'} 2024-04-16T17:57:26.741 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f57191f81089e795-00661ebc06-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.741 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T17:57:26.741 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:26.742 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:26.742 DEBUG:boto:path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.742 DEBUG:boto:auth_path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.742 DEBUG:boto:Method: GET 2024-04-16T17:57:26.742 DEBUG:boto:Path: /cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.742 DEBUG:boto:Data: 2024-04-16T17:57:26.742 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.742 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.742 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.742 DEBUG:boto:Params: {} 2024-04-16T17:57:26.743 DEBUG:boto:Token: None 2024-04-16T17:57:26.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/?versions 2024-04-16T17:57:26.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk= 2024-04-16T17:57:26.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk=', 'Content-Length': '0'} 2024-04-16T17:57:26.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3b24631eb774a16-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.745 DEBUG:boto:b'cjqttm-20999falseobjnulltrue2024-04-16T17:57:16.076ZRGW11111111111111111Normal' 2024-04-16T17:57:26.745 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:26.745 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T17:57:26.745 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:26.745 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:26.746 DEBUG:boto:path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.746 DEBUG:boto:auth_path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.746 DEBUG:boto:Method: GET 2024-04-16T17:57:26.746 DEBUG:boto:Path: /cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.746 DEBUG:boto:Data: 2024-04-16T17:57:26.746 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.746 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.746 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.746 DEBUG:boto:Params: {} 2024-04-16T17:57:26.746 DEBUG:boto:Token: None 2024-04-16T17:57:26.746 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/?versions 2024-04-16T17:57:26.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk= 2024-04-16T17:57:26.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk=', 'Content-Length': '0'} 2024-04-16T17:57:26.749 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5c94ff7102050a5-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.749 DEBUG:boto:b'cjqttm-20999falseobjnulltrue2024-04-16T17:57:16.076ZRGW11111111111111111Normal' 2024-04-16T17:57:26.749 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2024-04-16T17:57:26.749 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:26.749 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:26.750 DEBUG:boto:path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.750 DEBUG:boto:auth_path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.750 DEBUG:boto:Method: GET 2024-04-16T17:57:26.750 DEBUG:boto:Path: /cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.750 DEBUG:boto:Data: 2024-04-16T17:57:26.750 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.750 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.750 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.750 DEBUG:boto:Params: {} 2024-04-16T17:57:26.750 DEBUG:boto:Token: None 2024-04-16T17:57:26.751 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/?versions 2024-04-16T17:57:26.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk= 2024-04-16T17:57:26.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk=', 'Content-Length': '0'} 2024-04-16T17:57:26.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f5425893d88a871-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.753 DEBUG:boto:b'cjqttm-20999falseobjnulltrue2024-04-16T17:57:16.076ZRGW11111111111111111Normal' 2024-04-16T17:57:26.753 DEBUG:boto:path=/cjqttm-20/ 2024-04-16T17:57:26.754 DEBUG:boto:auth_path=/cjqttm-20/ 2024-04-16T17:57:26.754 DEBUG:boto:path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.754 DEBUG:boto:auth_path=/cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.754 DEBUG:boto:Method: GET 2024-04-16T17:57:26.754 DEBUG:boto:Path: /cjqttm-20/?versions&max-keys=999 2024-04-16T17:57:26.754 DEBUG:boto:Data: 2024-04-16T17:57:26.754 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.754 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.754 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.754 DEBUG:boto:Params: {} 2024-04-16T17:57:26.754 DEBUG:boto:Token: None 2024-04-16T17:57:26.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/?versions 2024-04-16T17:57:26.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk= 2024-04-16T17:57:26.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ltVA9nUC2aY8j70NljVVRNq6dtk=', 'Content-Length': '0'} 2024-04-16T17:57:26.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a81958a30fb1c1bb-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.757 DEBUG:boto:b'cjqttm-20999falseobjnulltrue2024-04-16T17:57:16.076ZRGW11111111111111111Normal' 2024-04-16T17:57:26.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2024-04-16T17:57:26.757 DEBUG:boto:path=/cjqttm-20/obj 2024-04-16T17:57:26.757 DEBUG:boto:auth_path=/cjqttm-20/obj 2024-04-16T17:57:26.757 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.757 DEBUG:boto:Path: /cjqttm-20/obj 2024-04-16T17:57:26.758 DEBUG:boto:Data: 2024-04-16T17:57:26.758 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.758 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.758 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.758 DEBUG:boto:Params: {} 2024-04-16T17:57:26.758 DEBUG:boto:Token: None 2024-04-16T17:57:26.758 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/obj 2024-04-16T17:57:26.758 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMkCAPGYtWsjMvT+dVMh2nIRjU8= 2024-04-16T17:57:26.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMkCAPGYtWsjMvT+dVMh2nIRjU8=', 'Content-Length': '0'} 2024-04-16T17:57:26.760 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx0000040c858893f38fba5-00661ebc06-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.760 DEBUG:boto:path=/cjqttm-20/obj 2024-04-16T17:57:26.760 DEBUG:boto:auth_path=/cjqttm-20/obj 2024-04-16T17:57:26.760 DEBUG:boto:Method: HEAD 2024-04-16T17:57:26.760 DEBUG:boto:Path: /cjqttm-20/obj 2024-04-16T17:57:26.760 DEBUG:boto:Data: 2024-04-16T17:57:26.760 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.760 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.760 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.761 DEBUG:boto:Params: {} 2024-04-16T17:57:26.761 DEBUG:boto:Token: None 2024-04-16T17:57:26.761 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-20/obj 2024-04-16T17:57:26.761 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMkCAPGYtWsjMvT+dVMh2nIRjU8= 2024-04-16T17:57:26.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMkCAPGYtWsjMvT+dVMh2nIRjU8=', 'Content-Length': '0'} 2024-04-16T17:57:26.762 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000c5ab68a2da1ac1b7-00661ebc06-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.763 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-20 zones={test-zone2, test-zone1} 2024-04-16T17:57:26.763 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... ok 2024-04-16T17:57:26.763 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-21 2024-04-16T17:57:26.763 DEBUG:boto:path=/cjqttm-21/ 2024-04-16T17:57:26.764 DEBUG:boto:auth_path=/cjqttm-21/ 2024-04-16T17:57:26.764 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.764 DEBUG:boto:Path: /cjqttm-21/ 2024-04-16T17:57:26.764 DEBUG:boto:Data: 2024-04-16T17:57:26.764 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.764 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.764 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.764 DEBUG:boto:Params: {} 2024-04-16T17:57:26.764 DEBUG:boto:Token: None 2024-04-16T17:57:26.764 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-21/ 2024-04-16T17:57:26.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K35nYw6TUtystQwyvALkeOzmpxs= 2024-04-16T17:57:26.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K35nYw6TUtystQwyvALkeOzmpxs=', 'Content-Length': '0'} 2024-04-16T17:57:26.778 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005661a91d71c65a3a-00661ebc06-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.778 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-22 2024-04-16T17:57:26.779 DEBUG:boto:path=/cjqttm-22/ 2024-04-16T17:57:26.779 DEBUG:boto:auth_path=/cjqttm-22/ 2024-04-16T17:57:26.779 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.779 DEBUG:boto:Path: /cjqttm-22/ 2024-04-16T17:57:26.779 DEBUG:boto:Data: 2024-04-16T17:57:26.779 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.779 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.779 DEBUG:boto:Params: {} 2024-04-16T17:57:26.779 DEBUG:boto:Token: None 2024-04-16T17:57:26.780 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-22/ 2024-04-16T17:57:26.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4oLC5ZKeeZE7GS9AFogqsujnE2I= 2024-04-16T17:57:26.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4oLC5ZKeeZE7GS9AFogqsujnE2I=', 'Content-Length': '0'} 2024-04-16T17:57:26.809 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000063d21ae4de80622e-00661ebc06-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.809 DEBUG:boto:path=/cjqttm-21/ 2024-04-16T17:57:26.809 DEBUG:boto:auth_path=/cjqttm-21/ 2024-04-16T17:57:26.809 DEBUG:boto:path=/cjqttm-21/?versioning 2024-04-16T17:57:26.809 DEBUG:boto:auth_path=/cjqttm-21/?versioning 2024-04-16T17:57:26.809 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.809 DEBUG:boto:Path: /cjqttm-21/?versioning 2024-04-16T17:57:26.810 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:57:26.810 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.810 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.810 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.810 DEBUG:boto:Params: {} 2024-04-16T17:57:26.810 DEBUG:boto:Token: None 2024-04-16T17:57:26.810 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-21/?versioning 2024-04-16T17:57:26.810 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqlK1+CW0COefx8trWLzZoO+Bes= 2024-04-16T17:57:26.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqlK1+CW0COefx8trWLzZoO+Bes=', 'Content-Length': '228'} 2024-04-16T17:57:26.816 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001504fc75a0a171ac-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.816 DEBUG:boto:path=/cjqttm-21/ 2024-04-16T17:57:26.816 DEBUG:boto:auth_path=/cjqttm-21/ 2024-04-16T17:57:26.816 DEBUG:boto:path=/cjqttm-21/?versioning 2024-04-16T17:57:26.816 DEBUG:boto:auth_path=/cjqttm-21/?versioning 2024-04-16T17:57:26.816 DEBUG:boto:Method: GET 2024-04-16T17:57:26.816 DEBUG:boto:Path: /cjqttm-21/?versioning 2024-04-16T17:57:26.816 DEBUG:boto:Data: 2024-04-16T17:57:26.817 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.817 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.817 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.817 DEBUG:boto:Params: {} 2024-04-16T17:57:26.817 DEBUG:boto:Token: None 2024-04-16T17:57:26.817 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-21/?versioning 2024-04-16T17:57:26.817 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PkvQEGq/4zja3ydKySrjF3Rh3II= 2024-04-16T17:57:26.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PkvQEGq/4zja3ydKySrjF3Rh3II=', 'Content-Length': '0'} 2024-04-16T17:57:26.818 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e92ed4b65e66a193-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '192'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.858 DEBUG:boto:EnabledDisabled 2024-04-16T17:57:26.859 DEBUG:boto:path=/cjqttm-22/ 2024-04-16T17:57:26.859 DEBUG:boto:auth_path=/cjqttm-22/ 2024-04-16T17:57:26.859 DEBUG:boto:path=/cjqttm-22/?versioning 2024-04-16T17:57:26.859 DEBUG:boto:auth_path=/cjqttm-22/?versioning 2024-04-16T17:57:26.859 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.860 DEBUG:boto:Path: /cjqttm-22/?versioning 2024-04-16T17:57:26.860 DEBUG:boto:Data: Enabled Disabled 2024-04-16T17:57:26.860 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.860 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.860 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.860 DEBUG:boto:Params: {} 2024-04-16T17:57:26.860 DEBUG:boto:Token: None 2024-04-16T17:57:26.860 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-22/?versioning 2024-04-16T17:57:26.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k+tr1hVHZlJbKp2GeV1CmgtHoGI= 2024-04-16T17:57:26.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k+tr1hVHZlJbKp2GeV1CmgtHoGI=', 'Content-Length': '228'} 2024-04-16T17:57:26.869 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000525cb2b8be41af8e-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.869 DEBUG:boto:path=/cjqttm-22/ 2024-04-16T17:57:26.869 DEBUG:boto:auth_path=/cjqttm-22/ 2024-04-16T17:57:26.869 DEBUG:boto:path=/cjqttm-22/?versioning 2024-04-16T17:57:26.869 DEBUG:boto:auth_path=/cjqttm-22/?versioning 2024-04-16T17:57:26.869 DEBUG:boto:Method: GET 2024-04-16T17:57:26.869 DEBUG:boto:Path: /cjqttm-22/?versioning 2024-04-16T17:57:26.869 DEBUG:boto:Data: 2024-04-16T17:57:26.870 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.870 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.870 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.870 DEBUG:boto:Params: {} 2024-04-16T17:57:26.870 DEBUG:boto:Token: None 2024-04-16T17:57:26.870 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-22/?versioning 2024-04-16T17:57:26.870 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IQ3bUMz7/aGAnCWAzs5tXcyFze4= 2024-04-16T17:57:26.870 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IQ3bUMz7/aGAnCWAzs5tXcyFze4=', 'Content-Length': '0'} 2024-04-16T17:57:26.871 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000627c06966f3a569e-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '192'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.871 DEBUG:boto:EnabledDisabled 2024-04-16T17:57:26.872 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2024-04-16T17:57:26.872 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-23 2024-04-16T17:57:26.872 DEBUG:boto:path=/cjqttm-23/ 2024-04-16T17:57:26.872 DEBUG:boto:auth_path=/cjqttm-23/ 2024-04-16T17:57:26.872 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.872 DEBUG:boto:Path: /cjqttm-23/ 2024-04-16T17:57:26.872 DEBUG:boto:Data: 2024-04-16T17:57:26.873 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.873 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.873 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.873 DEBUG:boto:Params: {} 2024-04-16T17:57:26.873 DEBUG:boto:Token: None 2024-04-16T17:57:26.873 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-23/ 2024-04-16T17:57:26.873 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9UlBuL5i2LJrUEb9zYTVPeB52no= 2024-04-16T17:57:26.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9UlBuL5i2LJrUEb9zYTVPeB52no=', 'Content-Length': '0'} 2024-04-16T17:57:26.886 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000010d2f1574e79dcb3-00661ebc06-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.886 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-24 2024-04-16T17:57:26.886 DEBUG:boto:path=/cjqttm-24/ 2024-04-16T17:57:26.886 DEBUG:boto:auth_path=/cjqttm-24/ 2024-04-16T17:57:26.887 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.887 DEBUG:boto:Path: /cjqttm-24/ 2024-04-16T17:57:26.887 DEBUG:boto:Data: 2024-04-16T17:57:26.887 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.887 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.887 DEBUG:boto:Params: {} 2024-04-16T17:57:26.887 DEBUG:boto:Token: None 2024-04-16T17:57:26.887 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-24/ 2024-04-16T17:57:26.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dsyv1LiS0n92fuVbt62qRvwi7Fo= 2024-04-16T17:57:26.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dsyv1LiS0n92fuVbt62qRvwi7Fo=', 'Content-Length': '0'} 2024-04-16T17:57:26.954 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ae2f260dfa1ce9e7-00661ebc06-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.954 DEBUG:boto:path=/cjqttm-23/ 2024-04-16T17:57:26.954 DEBUG:boto:auth_path=/cjqttm-23/ 2024-04-16T17:57:26.954 DEBUG:boto:path=/cjqttm-23/?acl 2024-04-16T17:57:26.954 DEBUG:boto:auth_path=/cjqttm-23/?acl 2024-04-16T17:57:26.954 DEBUG:boto:Method: GET 2024-04-16T17:57:26.955 DEBUG:boto:Path: /cjqttm-23/?acl 2024-04-16T17:57:26.955 DEBUG:boto:Data: 2024-04-16T17:57:26.955 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.955 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.955 DEBUG:boto:Params: {} 2024-04-16T17:57:26.955 DEBUG:boto:Token: None 2024-04-16T17:57:26.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-23/?acl 2024-04-16T17:57:26.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1fE7UNEzPVJvZMbA6ILLQodRM2A= 2024-04-16T17:57:26.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1fE7UNEzPVJvZMbA6ILLQodRM2A=', 'Content-Length': '0'} 2024-04-16T17:57:26.957 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d63b8f1ee777a832-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '391'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.957 DEBUG:boto:path=/cjqttm-23/ 2024-04-16T17:57:26.957 DEBUG:boto:auth_path=/cjqttm-23/ 2024-04-16T17:57:26.957 DEBUG:boto:path=/cjqttm-23/?acl 2024-04-16T17:57:26.957 DEBUG:boto:auth_path=/cjqttm-23/?acl 2024-04-16T17:57:26.957 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.957 DEBUG:boto:Path: /cjqttm-23/?acl 2024-04-16T17:57:26.957 DEBUG:boto:Data: 2024-04-16T17:57:26.958 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-16T17:57:26.958 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.958 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.958 DEBUG:boto:Params: {} 2024-04-16T17:57:26.958 DEBUG:boto:Token: None 2024-04-16T17:57:26.958 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT x-amz-acl:public-read /cjqttm-23/?acl 2024-04-16T17:57:26.958 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZhpLUVAtdF4WLAJJJrXSIl2cU4s= 2024-04-16T17:57:26.958 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZhpLUVAtdF4WLAJJJrXSIl2cU4s=', 'Content-Length': '0'} 2024-04-16T17:57:26.964 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006bc829d51545cd5e-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.964 DEBUG:boto:path=/cjqttm-23/ 2024-04-16T17:57:26.964 DEBUG:boto:auth_path=/cjqttm-23/ 2024-04-16T17:57:26.964 DEBUG:boto:path=/cjqttm-23/?acl 2024-04-16T17:57:26.964 DEBUG:boto:auth_path=/cjqttm-23/?acl 2024-04-16T17:57:26.964 DEBUG:boto:Method: GET 2024-04-16T17:57:26.964 DEBUG:boto:Path: /cjqttm-23/?acl 2024-04-16T17:57:26.964 DEBUG:boto:Data: 2024-04-16T17:57:26.964 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.964 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:26.964 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.965 DEBUG:boto:Params: {} 2024-04-16T17:57:26.965 DEBUG:boto:Token: None 2024-04-16T17:57:26.965 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-23/?acl 2024-04-16T17:57:26.965 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1fE7UNEzPVJvZMbA6ILLQodRM2A= 2024-04-16T17:57:26.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1fE7UNEzPVJvZMbA6ILLQodRM2A=', 'Content-Length': '0'} 2024-04-16T17:57:26.966 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000d41494ca561a0c10-00661ebc06-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '583'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.966 DEBUG:boto:path=/cjqttm-24/ 2024-04-16T17:57:26.967 DEBUG:boto:auth_path=/cjqttm-24/ 2024-04-16T17:57:26.967 DEBUG:boto:path=/cjqttm-24/?acl 2024-04-16T17:57:26.967 DEBUG:boto:auth_path=/cjqttm-24/?acl 2024-04-16T17:57:26.967 DEBUG:boto:Method: GET 2024-04-16T17:57:26.967 DEBUG:boto:Path: /cjqttm-24/?acl 2024-04-16T17:57:26.967 DEBUG:boto:Data: 2024-04-16T17:57:26.967 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.967 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.967 DEBUG:boto:Params: {} 2024-04-16T17:57:26.967 DEBUG:boto:Token: None 2024-04-16T17:57:26.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-24/?acl 2024-04-16T17:57:26.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SV43PzsSl8i2FOCJ6xqrP5UUi2M= 2024-04-16T17:57:26.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SV43PzsSl8i2FOCJ6xqrP5UUi2M=', 'Content-Length': '0'} 2024-04-16T17:57:26.969 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000487b9562312ba545-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '391'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.969 DEBUG:boto:path=/cjqttm-24/ 2024-04-16T17:57:26.969 DEBUG:boto:auth_path=/cjqttm-24/ 2024-04-16T17:57:26.970 DEBUG:boto:path=/cjqttm-24/?acl 2024-04-16T17:57:26.970 DEBUG:boto:auth_path=/cjqttm-24/?acl 2024-04-16T17:57:26.970 DEBUG:boto:Method: PUT 2024-04-16T17:57:26.970 DEBUG:boto:Path: /cjqttm-24/?acl 2024-04-16T17:57:26.970 DEBUG:boto:Data: 2024-04-16T17:57:26.970 DEBUG:boto:Headers: {'x-amz-acl': 'public-read'} 2024-04-16T17:57:26.970 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.970 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.970 DEBUG:boto:Params: {} 2024-04-16T17:57:26.970 DEBUG:boto:Token: None 2024-04-16T17:57:26.970 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:26 GMT x-amz-acl:public-read /cjqttm-24/?acl 2024-04-16T17:57:26.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t2dpQ7WpqmmrACXXdbXR12AIHTg= 2024-04-16T17:57:26.971 DEBUG:boto:Final headers: {'x-amz-acl': 'public-read', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t2dpQ7WpqmmrACXXdbXR12AIHTg=', 'Content-Length': '0'} 2024-04-16T17:57:26.980 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e0e64d005bfcfad2-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:26.980 DEBUG:boto:path=/cjqttm-24/ 2024-04-16T17:57:26.980 DEBUG:boto:auth_path=/cjqttm-24/ 2024-04-16T17:57:26.980 DEBUG:boto:path=/cjqttm-24/?acl 2024-04-16T17:57:26.980 DEBUG:boto:auth_path=/cjqttm-24/?acl 2024-04-16T17:57:26.980 DEBUG:boto:Method: GET 2024-04-16T17:57:26.980 DEBUG:boto:Path: /cjqttm-24/?acl 2024-04-16T17:57:26.981 DEBUG:boto:Data: 2024-04-16T17:57:26.981 DEBUG:boto:Headers: {} 2024-04-16T17:57:26.981 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:26.981 DEBUG:boto:Port: 8000 2024-04-16T17:57:26.981 DEBUG:boto:Params: {} 2024-04-16T17:57:26.981 DEBUG:boto:Token: None 2024-04-16T17:57:26.981 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:26 GMT /cjqttm-24/?acl 2024-04-16T17:57:26.981 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SV43PzsSl8i2FOCJ6xqrP5UUi2M= 2024-04-16T17:57:26.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SV43PzsSl8i2FOCJ6xqrP5UUi2M=', 'Content-Length': '0'} 2024-04-16T17:57:26.982 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000096cbfef47a713665-00661ebc06-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '583'), ('Date', 'Tue, 16 Apr 2024 17:57:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:27.026 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2024-04-16T17:57:27.027 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-25 2024-04-16T17:57:27.027 DEBUG:boto:path=/cjqttm-25/ 2024-04-16T17:57:27.027 DEBUG:boto:auth_path=/cjqttm-25/ 2024-04-16T17:57:27.027 DEBUG:boto:Method: PUT 2024-04-16T17:57:27.027 DEBUG:boto:Path: /cjqttm-25/ 2024-04-16T17:57:27.027 DEBUG:boto:Data: 2024-04-16T17:57:27.027 DEBUG:boto:Headers: {} 2024-04-16T17:57:27.027 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:27.028 DEBUG:boto:Port: 8000 2024-04-16T17:57:27.028 DEBUG:boto:Params: {} 2024-04-16T17:57:27.028 DEBUG:boto:Token: None 2024-04-16T17:57:27.028 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:27 GMT /cjqttm-25/ 2024-04-16T17:57:27.028 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ltse+9gACZ6j5mzOw4r+fCl/N98= 2024-04-16T17:57:27.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ltse+9gACZ6j5mzOw4r+fCl/N98=', 'Content-Length': '0'} 2024-04-16T17:57:27.042 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000030347026448cd35f-00661ebc07-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:27.042 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-26 2024-04-16T17:57:27.042 DEBUG:boto:path=/cjqttm-26/ 2024-04-16T17:57:27.043 DEBUG:boto:auth_path=/cjqttm-26/ 2024-04-16T17:57:27.043 DEBUG:boto:Method: PUT 2024-04-16T17:57:27.043 DEBUG:boto:Path: /cjqttm-26/ 2024-04-16T17:57:27.043 DEBUG:boto:Data: 2024-04-16T17:57:27.043 DEBUG:boto:Headers: {} 2024-04-16T17:57:27.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:27.043 DEBUG:boto:Port: 8000 2024-04-16T17:57:27.043 DEBUG:boto:Params: {} 2024-04-16T17:57:27.043 DEBUG:boto:Token: None 2024-04-16T17:57:27.043 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:27 GMT /cjqttm-26/ 2024-04-16T17:57:27.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fATQZRQ3rsguCFhM9vvxQaG+jgs= 2024-04-16T17:57:27.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fATQZRQ3rsguCFhM9vvxQaG+jgs=', 'Content-Length': '0'} 2024-04-16T17:57:27.069 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000c55232d399c84686-00661ebc07-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:27.069 DEBUG:boto:path=/cjqttm-25/ 2024-04-16T17:57:27.069 DEBUG:boto:auth_path=/cjqttm-25/ 2024-04-16T17:57:27.069 DEBUG:boto:path=/cjqttm-25/?cors 2024-04-16T17:57:27.069 DEBUG:boto:auth_path=/cjqttm-25/?cors 2024-04-16T17:57:27.069 DEBUG:boto:Method: PUT 2024-04-16T17:57:27.070 DEBUG:boto:Path: /cjqttm-25/?cors 2024-04-16T17:57:27.070 DEBUG:boto:Data: DELETEhttps://www.example.com*3000 2024-04-16T17:57:27.070 DEBUG:boto:Headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml'} 2024-04-16T17:57:27.070 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:27.070 DEBUG:boto:Port: 8000 2024-04-16T17:57:27.070 DEBUG:boto:Params: {} 2024-04-16T17:57:27.070 DEBUG:boto:Token: None 2024-04-16T17:57:27.070 DEBUG:boto:StringToSign: PUT c5gEzAIzM7zcw8WVE+AbrQ== text/xml Tue, 16 Apr 2024 17:57:27 GMT /cjqttm-25/?cors 2024-04-16T17:57:27.070 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9t0rwvR4PiqHKgxrc1Dx5yC2vZU= 2024-04-16T17:57:27.070 DEBUG:boto:Final headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9t0rwvR4PiqHKgxrc1Dx5yC2vZU=', 'Content-Length': '218'} 2024-04-16T17:57:27.076 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000007c4e4a0afe86cfed-00661ebc07-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:27.076 DEBUG:boto:path=/cjqttm-25/ 2024-04-16T17:57:27.076 DEBUG:boto:auth_path=/cjqttm-25/ 2024-04-16T17:57:27.076 DEBUG:boto:path=/cjqttm-25/?cors 2024-04-16T17:57:27.077 DEBUG:boto:auth_path=/cjqttm-25/?cors 2024-04-16T17:57:27.077 DEBUG:boto:Method: GET 2024-04-16T17:57:27.077 DEBUG:boto:Path: /cjqttm-25/?cors 2024-04-16T17:57:27.077 DEBUG:boto:Data: 2024-04-16T17:57:27.077 DEBUG:boto:Headers: {} 2024-04-16T17:57:27.077 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:27.077 DEBUG:boto:Port: 8000 2024-04-16T17:57:27.077 DEBUG:boto:Params: {} 2024-04-16T17:57:27.077 DEBUG:boto:Token: None 2024-04-16T17:57:27.077 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:27 GMT /cjqttm-25/?cors 2024-04-16T17:57:27.077 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k4XN+D785ahp1ZH5DtET9dXaEEY= 2024-04-16T17:57:27.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k4XN+D785ahp1ZH5DtET9dXaEEY=', 'Content-Length': '0'} 2024-04-16T17:57:27.078 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e73ad90ff419adf1-00661ebc07-4365-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '266'), ('Date', 'Tue, 16 Apr 2024 17:57:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:27.122 DEBUG:boto:b'DELETEhttps://www.example.com*3000' 2024-04-16T17:57:27.123 DEBUG:boto:path=/cjqttm-26/ 2024-04-16T17:57:27.123 DEBUG:boto:auth_path=/cjqttm-26/ 2024-04-16T17:57:27.123 DEBUG:boto:path=/cjqttm-26/?cors 2024-04-16T17:57:27.123 DEBUG:boto:auth_path=/cjqttm-26/?cors 2024-04-16T17:57:27.123 DEBUG:boto:Method: PUT 2024-04-16T17:57:27.123 DEBUG:boto:Path: /cjqttm-26/?cors 2024-04-16T17:57:27.123 DEBUG:boto:Data: DELETEhttps://www.example.com*3000 2024-04-16T17:57:27.123 DEBUG:boto:Headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml'} 2024-04-16T17:57:27.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:27.123 DEBUG:boto:Port: 8000 2024-04-16T17:57:27.123 DEBUG:boto:Params: {} 2024-04-16T17:57:27.124 DEBUG:boto:Token: None 2024-04-16T17:57:27.124 DEBUG:boto:StringToSign: PUT c5gEzAIzM7zcw8WVE+AbrQ== text/xml Tue, 16 Apr 2024 17:57:27 GMT /cjqttm-26/?cors 2024-04-16T17:57:27.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x30k/sP3Hclw7YMiprdyPMpG4cs= 2024-04-16T17:57:27.124 DEBUG:boto:Final headers: {'Content-MD5': 'c5gEzAIzM7zcw8WVE+AbrQ==', 'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x30k/sP3Hclw7YMiprdyPMpG4cs=', 'Content-Length': '218'} 2024-04-16T17:57:28.135 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000024f1638933b689ca-00661ebc07-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:28.136 DEBUG:boto:path=/cjqttm-26/ 2024-04-16T17:57:28.136 DEBUG:boto:auth_path=/cjqttm-26/ 2024-04-16T17:57:28.136 DEBUG:boto:path=/cjqttm-26/?cors 2024-04-16T17:57:28.136 DEBUG:boto:auth_path=/cjqttm-26/?cors 2024-04-16T17:57:28.136 DEBUG:boto:Method: GET 2024-04-16T17:57:28.136 DEBUG:boto:Path: /cjqttm-26/?cors 2024-04-16T17:57:28.136 DEBUG:boto:Data: 2024-04-16T17:57:28.136 DEBUG:boto:Headers: {} 2024-04-16T17:57:28.136 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:28.137 DEBUG:boto:Port: 8000 2024-04-16T17:57:28.137 DEBUG:boto:Params: {} 2024-04-16T17:57:28.137 DEBUG:boto:Token: None 2024-04-16T17:57:28.137 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 17:57:28 GMT /cjqttm-26/?cors 2024-04-16T17:57:28.137 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UwJVAQnnoZQF/uRYNTajQQ17VIM= 2024-04-16T17:57:28.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UwJVAQnnoZQF/uRYNTajQQ17VIM=', 'Content-Length': '0'} 2024-04-16T17:57:28.138 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f365cb30f26a9af6-00661ebc08-4336-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '266'), ('Date', 'Tue, 16 Apr 2024 17:57:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:28.138 DEBUG:boto:b'DELETEhttps://www.example.com*3000' 2024-04-16T17:57:28.139 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2024-04-16T17:57:28.140 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-27 2024-04-16T17:57:28.140 DEBUG:boto:path=/cjqttm-27/ 2024-04-16T17:57:28.140 DEBUG:boto:auth_path=/cjqttm-27/ 2024-04-16T17:57:28.140 DEBUG:boto:Method: PUT 2024-04-16T17:57:28.140 DEBUG:boto:Path: /cjqttm-27/ 2024-04-16T17:57:28.140 DEBUG:boto:Data: 2024-04-16T17:57:28.140 DEBUG:boto:Headers: {} 2024-04-16T17:57:28.140 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:57:28.140 DEBUG:boto:Port: 8000 2024-04-16T17:57:28.141 DEBUG:boto:Params: {} 2024-04-16T17:57:28.141 DEBUG:boto:Token: None 2024-04-16T17:57:28.141 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:28 GMT /cjqttm-27/ 2024-04-16T17:57:28.141 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OugQI+WeXUrQ2fH5byX7gSJ2yfA= 2024-04-16T17:57:28.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OugQI+WeXUrQ2fH5byX7gSJ2yfA=', 'Content-Length': '0'} 2024-04-16T17:57:28.158 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000318d9031c3b5fa94-00661ebc08-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:28.158 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-28 2024-04-16T17:57:28.159 DEBUG:boto:path=/cjqttm-28/ 2024-04-16T17:57:28.159 DEBUG:boto:auth_path=/cjqttm-28/ 2024-04-16T17:57:28.159 DEBUG:boto:Method: PUT 2024-04-16T17:57:28.159 DEBUG:boto:Path: /cjqttm-28/ 2024-04-16T17:57:28.159 DEBUG:boto:Data: 2024-04-16T17:57:28.159 DEBUG:boto:Headers: {} 2024-04-16T17:57:28.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:57:28.159 DEBUG:boto:Port: 8000 2024-04-16T17:57:28.159 DEBUG:boto:Params: {} 2024-04-16T17:57:28.160 DEBUG:boto:Token: None 2024-04-16T17:57:28.160 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:57:28 GMT /cjqttm-28/ 2024-04-16T17:57:28.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x7mAjRcujuI1tX+zUvIH8z4n5w8= 2024-04-16T17:57:28.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:57:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x7mAjRcujuI1tX+zUvIH8z4n5w8=', 'Content-Length': '0'} 2024-04-16T17:57:28.229 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000004e8faa92b9d19d06-00661ebc08-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:57:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:57:28.229 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:28.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:28.229 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:28.284 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:28.284 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:28.340 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:57:28.362 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290248.178469_259.1","last_update":"2024-04-16T17:57:28.178469Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:57:28.362 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:28.362 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:57:28.362 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:28.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:28.363 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:28.411 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:28.411 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:28.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:28.461+0000 7f7cf271f800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:28.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:28.463+0000 7f7cf271f800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:28.488 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.814413_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.814413Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:28Z"} 2024-04-16T17:57:28.488 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.814413_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.814413Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:28Z"} 2024-04-16T17:57:28.488 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.814413_224.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.814413Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:28.489 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:28.489 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.814413_224.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:28.489 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.814413_224.1 2024-04-16T17:57:33.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:33.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:33.490 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:33.555 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:33.556 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:33.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:33.612+0000 7fee09424800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:33.611 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:33.613+0000 7fee09424800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:33.631 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.775053_217.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.775053Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:33Z"} 2024-04-16T17:57:33.631 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.775053_217.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.775053Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:33Z"} 2024-04-16T17:57:33.631 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.775053_217.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.775053Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:33.631 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:33.631 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.775053_217.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:33.632 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.775053_217.1 2024-04-16T17:57:38.633 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:38.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:38.633 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:38.687 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:38.687 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:38.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:38.740+0000 7fbc18211800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:38.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:38.742+0000 7fbc18211800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:38.761 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.817740_225.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.817740Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:38Z"} 2024-04-16T17:57:38.762 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.817740_225.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.817740Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:38Z"} 2024-04-16T17:57:38.762 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.817740_225.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.817740Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:38.762 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:38.762 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.817740_225.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:38.762 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.817740_225.1 2024-04-16T17:57:43.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:43.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:43.764 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:43.816 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:43.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:43.869+0000 7f4668f39800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:43.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:43.870+0000 7f4668f39800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:43.889 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.793002_221.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.793002Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:43Z"} 2024-04-16T17:57:43.889 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.793002_221.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.793002Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:43Z"} 2024-04-16T17:57:43.889 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.793002_221.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.793002Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:43.890 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:43.890 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.793002_221.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:43.890 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.793002_221.1 2024-04-16T17:57:48.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:48.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:48.891 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:48.946 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:48.946 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:49.001 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:49.002+0000 7f076572c800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:49.002 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:49.003+0000 7f076572c800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:49.023 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.817740_225.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.817740Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:49Z"} 2024-04-16T17:57:49.023 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.817740_225.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.817740Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:49Z"} 2024-04-16T17:57:49.023 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.817740_225.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.817740Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:49.024 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:49.024 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.817740_225.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:49.024 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.817740_225.1 2024-04-16T17:57:54.025 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:54.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:54.026 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:54.082 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:54.134 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:54.135 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:54.136+0000 7fd887ac0800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:54.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:54.137+0000 7fd887ac0800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:54.157 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:54Z"} 2024-04-16T17:57:54.158 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:54Z"} 2024-04-16T17:57:54.158 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.865317_226.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.865317Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:54.158 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:54.158 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.865317_226.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:54.158 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.865317_226.1 2024-04-16T17:57:59.160 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:59.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:57:59.160 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:57:59.215 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:57:59.215 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:57:59.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:59.273+0000 7f8150d2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:59.274 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:57:59.275+0000 7f8150d2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:57:59.300 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:59Z"} 2024-04-16T17:57:59.300 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:57:59Z"} 2024-04-16T17:57:59.300 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.865317_226.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.865317Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:57:59.300 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:59.300 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.865317_226.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:57:59.301 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.865317_226.1 2024-04-16T17:58:04.302 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:04.302 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:04.303 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:04.357 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:04.357 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:04.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:04.411+0000 7efe0aa22800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:04.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:04.413+0000 7efe0aa22800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:04.432 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.793002_221.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.793002Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:04Z"} 2024-04-16T17:58:04.432 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.793002_221.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.793002Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:04Z"} 2024-04-16T17:58:04.432 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.793002_221.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.793002Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:04.432 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:04.433 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.793002_221.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:04.433 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.793002_221.1 2024-04-16T17:58:09.434 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:09.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:09.435 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:09.488 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:09.488 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:09.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:09.540+0000 7fa94e52a800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:09.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:09.541+0000 7fa94e52a800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:09.562 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:09Z"} 2024-04-16T17:58:09.562 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:09Z"} 2024-04-16T17:58:09.562 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.865317_226.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.865317Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:09.562 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:09.562 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.865317_226.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:09.563 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.865317_226.1 2024-04-16T17:58:14.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:14.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:14.564 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:14.617 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:14.617 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:14.671 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:14.673+0000 7f6b04b2a800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:14.672 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:14.674+0000 7f6b04b2a800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:14.692 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:14Z"} 2024-04-16T17:58:14.693 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:14Z"} 2024-04-16T17:58:14.693 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.865317_226.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.865317Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:14.693 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:14.693 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.865317_226.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:14.693 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.865317_226.1 2024-04-16T17:58:19.694 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:19.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:19.723 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:19.778 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:19.778 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:19.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:19.832+0000 7f6815044800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:19.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:19.833+0000 7f6815044800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:19.853 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.796522_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.796522Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:19Z"} 2024-04-16T17:58:19.853 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.796522_223.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.796522Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:19Z"} 2024-04-16T17:58:19.853 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.796522_223.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.796522Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:19.853 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:19.853 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.796522_223.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:19.854 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.796522_223.1 2024-04-16T17:58:24.855 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:24.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:24.856 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:24.911 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:24.911 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:24.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:24.968+0000 7fb91ec2e800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:24.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:24.969+0000 7fb91ec2e800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:24.989 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:24Z"} 2024-04-16T17:58:24.989 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:24Z"} 2024-04-16T17:58:24.989 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.865317_226.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.865317Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:24.989 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:24.989 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.865317_226.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:24.990 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.865317_226.1 2024-04-16T17:58:29.991 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:29.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:29.992 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:30.047 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:30.048 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:30.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:30.101+0000 7ff579a0f800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:30.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:30.102+0000 7ff579a0f800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:30.123 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:30Z"} 2024-04-16T17:58:30.123 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290246.865317_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:26.865317Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:30Z"} 2024-04-16T17:58:30.123 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290246.865317_226.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:26.865317Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:30.123 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:30.123 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290246.865317_226.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:30.123 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290248.178469_259.1 target=1_1713290246.865317_226.1 2024-04-16T17:58:35.125 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.125 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:35.180 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:35.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:35.234+0000 7f7993d30800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:35.235 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:35.236+0000 7f7993d30800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:35.256 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290248.178469_259.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:28.178469Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:35Z"} 2024-04-16T17:58:35.256 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290248.178469_259.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:28.178469Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:35Z"} 2024-04-16T17:58:35.256 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290248.178469_259.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:28.178469Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:35.256 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:35.257 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290248.178469_259.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:35.257 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:58:35.257 DEBUG:boto:path=/cjqttm-27/ 2024-04-16T17:58:35.257 DEBUG:boto:auth_path=/cjqttm-27/ 2024-04-16T17:58:35.257 DEBUG:boto:Method: HEAD 2024-04-16T17:58:35.257 DEBUG:boto:Path: /cjqttm-27/ 2024-04-16T17:58:35.257 DEBUG:boto:Data: 2024-04-16T17:58:35.258 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.258 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.258 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.258 DEBUG:boto:Params: {} 2024-04-16T17:58:35.258 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:58:35.259 DEBUG:boto:Token: None 2024-04-16T17:58:35.259 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-27/ 2024-04-16T17:58:35.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JPyovMetwVhOdcQ/Y/ash1+d+Ew= 2024-04-16T17:58:35.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JPyovMetwVhOdcQ/Y/ash1+d+Ew=', 'Content-Length': '0'} 2024-04-16T17:58:35.264 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b67d56c8e3a6b97a-00661ebc4b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.265 DEBUG:boto:path=/cjqttm-27/foo 2024-04-16T17:58:35.265 DEBUG:boto:auth_path=/cjqttm-27/foo 2024-04-16T17:58:35.265 DEBUG:boto:Method: PUT 2024-04-16T17:58:35.265 DEBUG:boto:Path: /cjqttm-27/foo 2024-04-16T17:58:35.265 DEBUG:boto:Data: 2024-04-16T17:58:35.265 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T17:58:35.266 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.266 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.266 DEBUG:boto:Params: {} 2024-04-16T17:58:35.266 DEBUG:boto:Token: None 2024-04-16T17:58:35.266 DEBUG:boto:StringToSign: PUT N7UdGUp1E+RbVvZSTy1R8g== application/octet-stream Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-27/foo 2024-04-16T17:58:35.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VsWTGabW5MGyibVO79Lob7i05M4= 2024-04-16T17:58:35.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VsWTGabW5MGyibVO79Lob7i05M4='} 2024-04-16T17:58:35.274 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"37b51d194a7513e45b56f6524f2d51f2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009efee602656432da-00661ebc4b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.274 DEBUG:boto:path=/cjqttm-27/ 2024-04-16T17:58:35.274 DEBUG:boto:auth_path=/cjqttm-27/ 2024-04-16T17:58:35.274 DEBUG:boto:Method: DELETE 2024-04-16T17:58:35.274 DEBUG:boto:Path: /cjqttm-27/ 2024-04-16T17:58:35.274 DEBUG:boto:Data: 2024-04-16T17:58:35.274 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.274 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.275 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.275 DEBUG:boto:Params: {} 2024-04-16T17:58:35.275 DEBUG:boto:Token: None 2024-04-16T17:58:35.275 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-27/ 2024-04-16T17:58:35.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0WxbI1Eym0/Jp2LXfZqqoohqKaE= 2024-04-16T17:58:35.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0WxbI1Eym0/Jp2LXfZqqoohqKaE=', 'Content-Length': '0'} 2024-04-16T17:58:35.283 DEBUG:boto:Response headers: [('Content-Length', '253'), ('x-amz-request-id', 'tx00000b60eed1ec3aa2fe5-00661ebc4b-4365-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.284 DEBUG:boto:path=/cjqttm-28/ 2024-04-16T17:58:35.284 DEBUG:boto:auth_path=/cjqttm-28/ 2024-04-16T17:58:35.284 DEBUG:boto:Method: HEAD 2024-04-16T17:58:35.284 DEBUG:boto:Path: /cjqttm-28/ 2024-04-16T17:58:35.284 DEBUG:boto:Data: 2024-04-16T17:58:35.284 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.284 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:58:35.285 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.285 DEBUG:boto:Params: {} 2024-04-16T17:58:35.285 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T17:58:35.285 DEBUG:boto:Token: None 2024-04-16T17:58:35.285 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-28/ 2024-04-16T17:58:35.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:POHEU1FEvGZKDdn45MO6mgxehrQ= 2024-04-16T17:58:35.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:POHEU1FEvGZKDdn45MO6mgxehrQ=', 'Content-Length': '0'} 2024-04-16T17:58:35.289 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009445e20f9ee3aa9c-00661ebc4b-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.289 DEBUG:boto:path=/cjqttm-28/foo 2024-04-16T17:58:35.289 DEBUG:boto:auth_path=/cjqttm-28/foo 2024-04-16T17:58:35.289 DEBUG:boto:Method: PUT 2024-04-16T17:58:35.289 DEBUG:boto:Path: /cjqttm-28/foo 2024-04-16T17:58:35.290 DEBUG:boto:Data: 2024-04-16T17:58:35.290 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T17:58:35.290 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:58:35.290 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.290 DEBUG:boto:Params: {} 2024-04-16T17:58:35.290 DEBUG:boto:Token: None 2024-04-16T17:58:35.290 DEBUG:boto:StringToSign: PUT N7UdGUp1E+RbVvZSTy1R8g== application/octet-stream Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-28/foo 2024-04-16T17:58:35.290 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jCS/VZHNUrOMQvHAvhwE3pBdbGU= 2024-04-16T17:58:35.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'N7UdGUp1E+RbVvZSTy1R8g==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jCS/VZHNUrOMQvHAvhwE3pBdbGU='} 2024-04-16T17:58:35.296 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"37b51d194a7513e45b56f6524f2d51f2"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000add9717605eced9f-00661ebc4b-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.297 DEBUG:boto:path=/cjqttm-28/ 2024-04-16T17:58:35.297 DEBUG:boto:auth_path=/cjqttm-28/ 2024-04-16T17:58:35.297 DEBUG:boto:Method: DELETE 2024-04-16T17:58:35.297 DEBUG:boto:Path: /cjqttm-28/ 2024-04-16T17:58:35.297 DEBUG:boto:Data: 2024-04-16T17:58:35.297 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.297 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:58:35.297 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.297 DEBUG:boto:Params: {} 2024-04-16T17:58:35.298 DEBUG:boto:Token: None 2024-04-16T17:58:35.298 DEBUG:boto:StringToSign: DELETE Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-28/ 2024-04-16T17:58:35.298 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sh2S6smRpurZTFBhv51J8gVg5tM= 2024-04-16T17:58:35.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sh2S6smRpurZTFBhv51J8gVg5tM=', 'Content-Length': '0'} 2024-04-16T17:58:35.305 DEBUG:boto:Response headers: [('Content-Length', '253'), ('x-amz-request-id', 'tx000008d6575384a51e6c3-00661ebc4b-4336-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.306 DEBUG:boto:path=/cjqttm-27/ 2024-04-16T17:58:35.306 DEBUG:boto:auth_path=/cjqttm-27/ 2024-04-16T17:58:35.306 DEBUG:boto:Method: HEAD 2024-04-16T17:58:35.306 DEBUG:boto:Path: /cjqttm-27/ 2024-04-16T17:58:35.306 DEBUG:boto:Data: 2024-04-16T17:58:35.306 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.306 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.307 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.307 DEBUG:boto:Params: {} 2024-04-16T17:58:35.307 DEBUG:boto:Token: None 2024-04-16T17:58:35.307 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-27/ 2024-04-16T17:58:35.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JPyovMetwVhOdcQ/Y/ash1+d+Ew= 2024-04-16T17:58:35.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JPyovMetwVhOdcQ/Y/ash1+d+Ew=', 'Content-Length': '0'} 2024-04-16T17:58:35.309 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004c688b47157eec7e-00661ebc4b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.309 DEBUG:boto:path=/cjqttm-28/ 2024-04-16T17:58:35.310 DEBUG:boto:auth_path=/cjqttm-28/ 2024-04-16T17:58:35.310 DEBUG:boto:Method: HEAD 2024-04-16T17:58:35.310 DEBUG:boto:Path: /cjqttm-28/ 2024-04-16T17:58:35.310 DEBUG:boto:Data: 2024-04-16T17:58:35.310 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.310 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.310 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.310 DEBUG:boto:Params: {} 2024-04-16T17:58:35.310 DEBUG:boto:Token: None 2024-04-16T17:58:35.311 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-28/ 2024-04-16T17:58:35.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:POHEU1FEvGZKDdn45MO6mgxehrQ= 2024-04-16T17:58:35.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:POHEU1FEvGZKDdn45MO6mgxehrQ=', 'Content-Length': '0'} 2024-04-16T17:58:35.313 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006fe13ce21944fa54-00661ebc4b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.313 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2024-04-16T17:58:35.315 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... SKIP: test_multi_period_incremental_sync skipped. Requires 3 or more zones in master zonegroup. 2024-04-16T17:58:35.315 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-29 2024-04-16T17:58:35.315 DEBUG:boto:path=/cjqttm-29/ 2024-04-16T17:58:35.316 DEBUG:boto:auth_path=/cjqttm-29/ 2024-04-16T17:58:35.316 DEBUG:boto:Method: PUT 2024-04-16T17:58:35.316 DEBUG:boto:Path: /cjqttm-29/ 2024-04-16T17:58:35.316 DEBUG:boto:Data: 2024-04-16T17:58:35.316 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.316 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.316 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.316 DEBUG:boto:Params: {} 2024-04-16T17:58:35.316 DEBUG:boto:Token: None 2024-04-16T17:58:35.316 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-29/ 2024-04-16T17:58:35.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eSn3H+Nv9bjOB3QY5MJPsBSoV0c= 2024-04-16T17:58:35.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eSn3H+Nv9bjOB3QY5MJPsBSoV0c=', 'Content-Length': '0'} 2024-04-16T17:58:35.333 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000cae4459df59f5a46-00661ebc4b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.333 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-30 2024-04-16T17:58:35.333 DEBUG:boto:path=/cjqttm-30/ 2024-04-16T17:58:35.333 DEBUG:boto:auth_path=/cjqttm-30/ 2024-04-16T17:58:35.333 DEBUG:boto:Method: PUT 2024-04-16T17:58:35.333 DEBUG:boto:Path: /cjqttm-30/ 2024-04-16T17:58:35.333 DEBUG:boto:Data: 2024-04-16T17:58:35.333 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.333 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:58:35.334 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.334 DEBUG:boto:Params: {} 2024-04-16T17:58:35.334 DEBUG:boto:Token: None 2024-04-16T17:58:35.334 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-30/ 2024-04-16T17:58:35.334 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A7EVABLbxxNmifqaH65edcs+FnM= 2024-04-16T17:58:35.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A7EVABLbxxNmifqaH65edcs+FnM=', 'Content-Length': '0'} 2024-04-16T17:58:35.363 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003b872579dd3f039f-00661ebc4b-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.363 DEBUG:boto:path=/cjqttm-29/ 2024-04-16T17:58:35.363 DEBUG:boto:auth_path=/cjqttm-29/ 2024-04-16T17:58:35.364 DEBUG:boto:Method: HEAD 2024-04-16T17:58:35.364 DEBUG:boto:Path: /cjqttm-29/ 2024-04-16T17:58:35.364 DEBUG:boto:Data: 2024-04-16T17:58:35.364 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.364 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.364 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.364 DEBUG:boto:Params: {} 2024-04-16T17:58:35.364 DEBUG:boto:Token: None 2024-04-16T17:58:35.365 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-29/ 2024-04-16T17:58:35.365 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YxTPYmQJvQMt9DWmpQZNQ+CE1Oc= 2024-04-16T17:58:35.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YxTPYmQJvQMt9DWmpQZNQ+CE1Oc=', 'Content-Length': '0'} 2024-04-16T17:58:35.368 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c815282ba9af3ccb-00661ebc4b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.368 DEBUG:boto:path=/cjqttm-29/key 2024-04-16T17:58:35.368 DEBUG:boto:auth_path=/cjqttm-29/key 2024-04-16T17:58:35.368 DEBUG:boto:Method: PUT 2024-04-16T17:58:35.368 DEBUG:boto:Path: /cjqttm-29/key 2024-04-16T17:58:35.368 DEBUG:boto:Data: 2024-04-16T17:58:35.368 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2024-04-16T17:58:35.368 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T17:58:35.369 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.369 DEBUG:boto:Params: {} 2024-04-16T17:58:35.369 DEBUG:boto:Token: None 2024-04-16T17:58:35.369 DEBUG:boto:StringToSign: PUT hBotaJrYa9FhFEdFPCLG/A== application/octet-stream Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-29/key 2024-04-16T17:58:35.369 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QjswFjku0PHH/Pcszx950JYb5Dk= 2024-04-16T17:58:35.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QjswFjku0PHH/Pcszx950JYb5Dk='} 2024-04-16T17:58:35.414 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d5c645a4c0f6fc76-00661ebc4b-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.415 DEBUG:boto:path=/cjqttm-30/ 2024-04-16T17:58:35.415 DEBUG:boto:auth_path=/cjqttm-30/ 2024-04-16T17:58:35.415 DEBUG:boto:Method: HEAD 2024-04-16T17:58:35.415 DEBUG:boto:Path: /cjqttm-30/ 2024-04-16T17:58:35.415 DEBUG:boto:Data: 2024-04-16T17:58:35.415 DEBUG:boto:Headers: {} 2024-04-16T17:58:35.416 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:58:35.416 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.416 DEBUG:boto:Params: {} 2024-04-16T17:58:35.416 DEBUG:boto:Token: None 2024-04-16T17:58:35.416 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-30/ 2024-04-16T17:58:35.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJHtNu5t+ZNAi5IvejdIKGKukCY= 2024-04-16T17:58:35.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJHtNu5t+ZNAi5IvejdIKGKukCY=', 'Content-Length': '0'} 2024-04-16T17:58:35.419 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000068354fe4674cb8af-00661ebc4b-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.419 DEBUG:boto:path=/cjqttm-30/key 2024-04-16T17:58:35.419 DEBUG:boto:auth_path=/cjqttm-30/key 2024-04-16T17:58:35.419 DEBUG:boto:Method: PUT 2024-04-16T17:58:35.419 DEBUG:boto:Path: /cjqttm-30/key 2024-04-16T17:58:35.419 DEBUG:boto:Data: 2024-04-16T17:58:35.420 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue'} 2024-04-16T17:58:35.420 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T17:58:35.420 DEBUG:boto:Port: 8000 2024-04-16T17:58:35.420 DEBUG:boto:Params: {} 2024-04-16T17:58:35.420 DEBUG:boto:Token: None 2024-04-16T17:58:35.420 DEBUG:boto:StringToSign: PUT hBotaJrYa9FhFEdFPCLG/A== application/octet-stream Tue, 16 Apr 2024 17:58:35 GMT /cjqttm-30/key 2024-04-16T17:58:35.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vK+ebYz/mBOrGzAYLlfx0n1fE3Q= 2024-04-16T17:58:35.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'hBotaJrYa9FhFEdFPCLG/A==', 'Content-Length': '4', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:58:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vK+ebYz/mBOrGzAYLlfx0n1fE3Q='} 2024-04-16T17:58:35.466 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"841a2d689ad86bd1611447453c22c6fc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007738f9ca9e4c9691-00661ebc4b-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:58:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T17:58:35.467 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.467 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:35.518 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:35.572 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T17:58:35.594 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290315.352723_278.1","last_update":"2024-04-16T17:58:35.352723Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T17:58:35.594 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:35.595 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T17:58:35.595 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.595 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:35.644 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:35.644 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:35.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:35.695+0000 7f9092d31800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:35.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T17:58:35.697+0000 7f9092d31800 20 RGW-SYNC:meta: read sync status 2024-04-16T17:58:35.717 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:35Z"} 2024-04-16T17:58:35.717 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:58:35Z"} 2024-04-16T17:58:35.718 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T17:58:35.718 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:35.718 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T17:58:35.719 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T17:58:35.719 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T17:58:35.719 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.720 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:35.767 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:35.767 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:35.843 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000002343","last_update":"2024-04-16T17:52:44.923035Z"},{"marker":"00000000000000000000:00000000000000006001","last_update":"2024-04-16T17:58:35.377317Z"},{"marker":"00000000000000000000:00000000000000004597","last_update":"2024-04-16T17:54:12.930999Z"},{"marker":"00000000000000000000:00000000000000002768","last_update":"2024-04-16T17:58:35.275738Z"}] 2024-04-16T17:58:35.844 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006001', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002768'} 2024-04-16T17:58:35.844 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T17:58:35.844 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:35.844 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:35.895 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:35.895 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:35.968 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005860","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:30.944135Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004597","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.930999Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002768","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.275738Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T17:58:35Z"} 2024-04-16T17:58:35.968 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005860","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:57:30.944135Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004597","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.930999Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002768","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.275738Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T17:58:35Z"} 2024-04-16T17:58:35.969 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005860', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:57:30.944135Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004597', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:12.930999Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002768', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.275738Z'}}] 2024-04-16T17:58:35.969 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006001', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002768'} 2024-04-16T17:58:35.969 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000005860', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002768'} 2024-04-16T17:58:35.969 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=1 master=00000000000000000000:00000000000000006001 target=00000000000000000000:00000000000000005860 2024-04-16T17:58:40.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:40.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:40.971 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:41.028 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:41.028 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:41.107 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004597","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.930999Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002768","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.275738Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T17:58:41Z"} 2024-04-16T17:58:41.107 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004597","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:12.930999Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002768","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.275738Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T17:58:41Z"} 2024-04-16T17:58:41.107 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006142', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:37.732544Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004597', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:12.930999Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002768', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.275738Z'}}] 2024-04-16T17:58:41.107 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006001', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002768'} 2024-04-16T17:58:41.108 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006142', 2: '00000000000000000000:00000000000000004597', 3: '00000000000000000000:00000000000000002768'} 2024-04-16T17:58:41.108 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T17:58:41.108 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T17:58:41.108 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:41.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:41.108 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:41.155 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:41.156 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:41.230 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000002625","last_update":"2024-04-16T17:53:13.048342Z"},{"marker":"00000000000000000000:00000000000000005578","last_update":"2024-04-16T17:58:39.863756Z"},{"marker":"00000000000000000000:00000000000000004315","last_update":"2024-04-16T17:54:19.053096Z"},{"marker":"00000000000000000000:00000000000000002910","last_update":"2024-04-16T17:58:35.436547Z"}] 2024-04-16T17:58:41.230 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000005578', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T17:58:41.231 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T17:58:41.231 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:41.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:41.231 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:41.367 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T17:53:13.048342Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005437","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.429083Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004315","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.053096Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.436547Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T17:58:41Z"} 2024-04-16T17:58:41.367 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T17:53:13.048342Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005437","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.429083Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004315","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.053096Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.436547Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T17:58:41Z"} 2024-04-16T17:58:41.367 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002625', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T17:53:13.048342Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005437', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.429083Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004315', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:19.053096Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002910', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.436547Z'}}] 2024-04-16T17:58:41.368 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000005578', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T17:58:41.368 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000005437', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T17:58:41.368 WARNING:rgw_multi.tests:data of zone test-zone1 behind zone test-zone2: shard=1 master=00000000000000000000:00000000000000005578 target=00000000000000000000:00000000000000005437 2024-04-16T17:58:46.369 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.370 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:46.428 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:46.428 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:46.510 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T17:53:13.048342Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005578","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:39.863756Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004315","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.053096Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.436547Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T17:58:46Z"} 2024-04-16T17:58:46.510 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002625","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T17:53:13.048342Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005578","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:39.863756Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004315","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:54:19.053096Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.436547Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T17:58:46Z"} 2024-04-16T17:58:46.510 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002625', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T17:53:13.048342Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005578', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:39.863756Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004315', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:54:19.053096Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002910', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.436547Z'}}] 2024-04-16T17:58:46.510 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000005578', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T17:58:46.511 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002625', 1: '00000000000000000000:00000000000000005578', 2: '00000000000000000000:00000000000000004315', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T17:58:46.511 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T17:58:46.511 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.511 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:46.632 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000002343","last_update":"2024-04-16T17:52:44.923035Z"},{"marker":"00000000000000000000:00000000000000006142","last_update":"2024-04-16T17:58:37.732544Z"},{"marker":"00000000000000000000:00000000000000004597","last_update":"2024-04-16T17:54:12.930999Z"},{"marker":"00000000000000000000:00000000000000002910","last_update":"2024-04-16T17:58:40.373080Z"}] 2024-04-16T17:58:46.633 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:46.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:46.633 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T17:58:46.715 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:46.715 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:46.799 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.799 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 0 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:46.886 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:46.887 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:46.962 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T17:58:46.962 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:46.963 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 1 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:47.010 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.010 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.085 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T17:58:47.085 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.085 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 2 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:47.132 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.132 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.205 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T17:58:47.205 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.206 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 3 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:47.252 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.253 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.325 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T17:58:47.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.325 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:47.376 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.376 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.459 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000002625","last_update":"2024-04-16T17:53:13.048342Z"},{"marker":"00000000000000000000:00000000000000005578","last_update":"2024-04-16T17:58:39.863756Z"},{"marker":"00000000000000000000:00000000000000004315","last_update":"2024-04-16T17:54:19.053096Z"},{"marker":"00000000000000000000:00000000000000002910","last_update":"2024-04-16T17:58:35.436547Z"}] 2024-04-16T17:58:47.459 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:47.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:47.459 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T17:58:47.502 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.502 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.584 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.584 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 0 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:47.671 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.671 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.740 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2024-04-16T17:58:47.741 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.741 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 1 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:47.789 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.789 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.858 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2024-04-16T17:58:47.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.859 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 2 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:47.908 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:47.909 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:47.978 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2024-04-16T17:58:47.979 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T17:58:47.979 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 3 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T17:58:48.027 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:48.027 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:48.097 INFO:teuthology.orchestra.run.smithi139.stdout:[] 2024-04-16T17:58:48.098 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... ok 2024-04-16T17:58:48.098 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:48.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:48.099 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T17:58:48.145 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:48.145 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:48.188 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","account_pool":"test-zone2.rgw.meta:accounts","group_pool":"test-zone2.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T17:58:48.188 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:48.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T17:58:48.189 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T17:58:48.235 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T17:58:48.236 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T17:58:48.304 INFO:teuthology.orchestra.run.smithi139.stderr:Sending period to new master zone 9ba59572-f51c-4bce-9578-e6350e822996 2024-04-16T17:58:48.351 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":3,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":false,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T17:58:48.351 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2024-04-16T18:00:18.353 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-31 2024-04-16T18:00:18.354 DEBUG:boto:path=/cjqttm-31/ 2024-04-16T18:00:18.354 DEBUG:boto:auth_path=/cjqttm-31/ 2024-04-16T18:00:18.354 DEBUG:boto:Method: PUT 2024-04-16T18:00:18.354 DEBUG:boto:Path: /cjqttm-31/ 2024-04-16T18:00:18.354 DEBUG:boto:Data: 2024-04-16T18:00:18.355 DEBUG:boto:Headers: {} 2024-04-16T18:00:18.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:00:18.355 DEBUG:boto:Port: 8000 2024-04-16T18:00:18.355 DEBUG:boto:Params: {} 2024-04-16T18:00:18.355 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:00:18.356 DEBUG:boto:Token: None 2024-04-16T18:00:18.356 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:00:18 GMT /cjqttm-31/ 2024-04-16T18:00:18.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Bl1w5tRLAEtFkhOumwmq0NgXhv4= 2024-04-16T18:00:18.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:00:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Bl1w5tRLAEtFkhOumwmq0NgXhv4=', 'Content-Length': '0'} 2024-04-16T18:00:18.380 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000007564d1e7068fa26e-00661ebcb2-4711-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:00:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:00:18.381 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:00:18.381 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:00:18.381 DEBUG:boto:Method: PUT 2024-04-16T18:00:18.381 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:00:18.381 DEBUG:boto:Data: 2024-04-16T18:00:18.382 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-16T18:00:18.382 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:00:18.382 DEBUG:boto:Port: 8000 2024-04-16T18:00:18.382 DEBUG:boto:Params: {} 2024-04-16T18:00:18.382 DEBUG:boto:Token: None 2024-04-16T18:00:18.382 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Tue, 16 Apr 2024 18:00:18 GMT /cjqttm-31/testredirect 2024-04-16T18:00:18.382 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OoG74Vhv4C/CKb5YhUyaH6CKdlg= 2024-04-16T18:00:18.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:00:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OoG74Vhv4C/CKb5YhUyaH6CKdlg='} 2024-04-16T18:00:18.392 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000061a4eb7c9e2e73e3-00661ebcb2-4711-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:00:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:00:18.392 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:18.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:18.393 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:18.446 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:18.446 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:18.501 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:00:18.523 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290418.380291_312.1","last_update":"2024-04-16T18:00:18.380291Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:00:18.524 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:18.524 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:00:18.524 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:18.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:18.524 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:18.589 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:18.589 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:18.642 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:18.643+0000 7f2a58034800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:18.643 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:18.645+0000 7f2a58034800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:18.664 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:18Z"} 2024-04-16T18:00:18.665 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:18Z"} 2024-04-16T18:00:18.665 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:18.665 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:18.665 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:18.665 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290418.380291_312.1 target=1_1713290315.352723_278.1 2024-04-16T18:00:23.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:23.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:23.668 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:23.722 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:23.723 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:23.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:23.778+0000 7ff92d32d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:23.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:23.780+0000 7ff92d32d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:23.800 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:23Z"} 2024-04-16T18:00:23.800 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:23Z"} 2024-04-16T18:00:23.800 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:23.800 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:23.801 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:23.801 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290418.380291_312.1 target=1_1713290315.352723_278.1 2024-04-16T18:00:28.802 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:28.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:28.802 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:28.859 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:28.859 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:28.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:28.915+0000 7fdc5e147800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:28.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:28.917+0000 7fdc5e147800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:28.936 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:28Z"} 2024-04-16T18:00:28.936 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:28Z"} 2024-04-16T18:00:28.937 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:28.937 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:28.937 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:28.937 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290418.380291_312.1 target=1_1713290315.352723_278.1 2024-04-16T18:00:33.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:33.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:33.939 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:33.995 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:33.995 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:34.049 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:34.051+0000 7faebd616800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:34.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:34.053+0000 7faebd616800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:34.071 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:34Z"} 2024-04-16T18:00:34.072 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:34Z"} 2024-04-16T18:00:34.072 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:34.072 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:34.072 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:34.072 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290418.380291_312.1 target=1_1713290315.352723_278.1 2024-04-16T18:00:39.074 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:39.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:39.074 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:39.129 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:39.129 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:39.182 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:39.184+0000 7f9cee80f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:39.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:39.186+0000 7f9cee80f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:39.205 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:39Z"} 2024-04-16T18:00:39.206 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:39Z"} 2024-04-16T18:00:39.206 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:39.206 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:39.206 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:39.206 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290418.380291_312.1 target=1_1713290315.352723_278.1 2024-04-16T18:00:44.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:44.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:44.208 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:44.262 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:44.263 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:44.316 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:44.317+0000 7f7202a3c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:44.317 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:44.318+0000 7f7202a3c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:44.339 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:44Z"} 2024-04-16T18:00:44.339 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:44Z"} 2024-04-16T18:00:44.339 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:44.339 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:44.339 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:44.339 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290418.380291_312.1 target=1_1713290315.352723_278.1 2024-04-16T18:00:49.340 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:49.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:49.341 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:49.399 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:49.399 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:49.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:49.454+0000 7f1e250e4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:49.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:49.456+0000 7f1e250e4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:49.475 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:49Z"} 2024-04-16T18:00:49.476 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290315.352723_278.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:35.352723Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:49Z"} 2024-04-16T18:00:49.476 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290315.352723_278.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:35.352723Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:49.476 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:49.476 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290315.352723_278.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:49.476 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290418.380291_312.1 target=1_1713290315.352723_278.1 2024-04-16T18:00:49.572 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T18:00:49.574+0000 7f0207b59640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2024-04-16T18:00:54.477 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:54.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:00:54.477 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:00:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:54.532 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:54.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:54.590+0000 7f87f0844800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:54.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:00:54.591+0000 7f87f0844800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:00:54.611 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:54Z"} 2024-04-16T18:00:54.612 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:00:54Z"} 2024-04-16T18:00:54.612 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:00:54.612 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:54.612 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:00:54.612 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:00:54.612 DEBUG:boto:path=/cjqttm-31/ 2024-04-16T18:00:54.613 DEBUG:boto:auth_path=/cjqttm-31/ 2024-04-16T18:00:54.613 DEBUG:boto:Method: HEAD 2024-04-16T18:00:54.613 DEBUG:boto:Path: /cjqttm-31/ 2024-04-16T18:00:54.613 DEBUG:boto:Data: 2024-04-16T18:00:54.613 DEBUG:boto:Headers: {} 2024-04-16T18:00:54.613 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:00:54.614 DEBUG:boto:Port: 8000 2024-04-16T18:00:54.614 DEBUG:boto:Params: {} 2024-04-16T18:00:54.615 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:00:54.615 DEBUG:boto:Token: None 2024-04-16T18:00:54.615 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:00:54 GMT /cjqttm-31/ 2024-04-16T18:00:54.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UqlkXpdVWSQeSbBCwjP+wWkD37Q= 2024-04-16T18:00:54.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:00:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UqlkXpdVWSQeSbBCwjP+wWkD37Q=', 'Content-Length': '0'} 2024-04-16T18:00:54.621 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000067a8ac0bc6cd5064-00661ebcd6-4852-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:00:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:00:54.621 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:00:54.621 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:00:54.621 DEBUG:boto:Method: HEAD 2024-04-16T18:00:54.621 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:00:54.622 DEBUG:boto:Data: 2024-04-16T18:00:54.622 DEBUG:boto:Headers: {} 2024-04-16T18:00:54.622 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:00:54.622 DEBUG:boto:Port: 8000 2024-04-16T18:00:54.622 DEBUG:boto:Params: {} 2024-04-16T18:00:54.622 DEBUG:boto:Token: None 2024-04-16T18:00:54.622 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:00:54 GMT /cjqttm-31/testredirect 2024-04-16T18:00:54.622 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:puA51CbSSRDCvwaEUb8h9Krrt4M= 2024-04-16T18:00:54.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:00:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:puA51CbSSRDCvwaEUb8h9Krrt4M=', 'Content-Length': '0'} 2024-04-16T18:00:54.624 DEBUG:boto:Response headers: [('Content-Length', '248'), ('x-amz-request-id', 'tx00000e498a8a4b270a9aa-00661ebcd6-4852-test-zone2'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:00:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:00:54.624 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=9ba59572-f51c-4bce-9578-e6350e822996', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:00:54.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=9ba59572-f51c-4bce-9578-e6350e822996', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:00:54.624 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=9ba59572-f51c-4bce-9578-e6350e822996 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:00:54.671 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:54.671 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:54.715 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","account_pool":"test-zone2.rgw.meta:accounts","group_pool":"test-zone2.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T18:00:54.716 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:00:54.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:00:54.716 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:00:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:00:54.763 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:00:54.832 INFO:teuthology.orchestra.run.smithi139.stderr:Sending period to new master zone 9ba59572-f51c-4bce-9578-e6350e822996 2024-04-16T18:00:54.883 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":4,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":false,"sync_from":[],"redirect_zone":"9ba59572-f51c-4bce-9578-e6350e822996","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T18:00:54.883 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "9ba59572-f51c-4bce-9578-e6350e822996" 2024-04-16T18:02:24.884 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.885 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.885 DEBUG:boto:Method: HEAD 2024-04-16T18:02:24.885 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.885 DEBUG:boto:Data: 2024-04-16T18:02:24.885 DEBUG:boto:Headers: {} 2024-04-16T18:02:24.886 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:02:24.886 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.886 DEBUG:boto:Params: {} 2024-04-16T18:02:24.886 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:02:24.887 DEBUG:boto:Token: None 2024-04-16T18:02:24.887 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DaMSTMYbh2eDu8gEbFyuoiAjc9Q= 2024-04-16T18:02:24.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DaMSTMYbh2eDu8gEbFyuoiAjc9Q=', 'Content-Length': '0'} 2024-04-16T18:02:24.896 DEBUG:boto:Response headers: [('Location', 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-31/testredirect?'), ('x-amz-request-id', 'tx00000bce1b0b716adca7a-00661ebd30-4925-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.897 DEBUG:boto:Redirecting: http://smithi016.front.sepia.ceph.com/cjqttm-31/testredirect 2024-04-16T18:02:24.897 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': '8000'} 2024-04-16T18:02:24.897 DEBUG:boto:Token: None 2024-04-16T18:02:24.897 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.897 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DaMSTMYbh2eDu8gEbFyuoiAjc9Q= 2024-04-16T18:02:24.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DaMSTMYbh2eDu8gEbFyuoiAjc9Q=', 'Content-Length': '0'} 2024-04-16T18:02:24.905 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:00:18 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx000002c5bb64740c9b651-00661ebd30-4721-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.905 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.906 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.906 DEBUG:boto:Method: GET 2024-04-16T18:02:24.906 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.906 DEBUG:boto:Data: 2024-04-16T18:02:24.906 DEBUG:boto:Headers: {} 2024-04-16T18:02:24.906 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:02:24.906 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.906 DEBUG:boto:Params: {} 2024-04-16T18:02:24.906 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:02:24.906 DEBUG:boto:Token: None 2024-04-16T18:02:24.907 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.907 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.910 DEBUG:boto:Response headers: [('Location', 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-31/testredirect?'), ('x-amz-request-id', 'tx000001d3d67bddfd69690-00661ebd30-4925-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.910 DEBUG:boto:Redirecting: http://smithi016.front.sepia.ceph.com/cjqttm-31/testredirect 2024-04-16T18:02:24.910 DEBUG:boto:Token: None 2024-04-16T18:02:24.910 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.910 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.912 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:00:18 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000f2e9ddf8e4346047-00661ebd30-4721-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.912 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.913 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.913 DEBUG:boto:Method: PUT 2024-04-16T18:02:24.913 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.913 DEBUG:boto:Data: 2024-04-16T18:02:24.913 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VpBzljOcorCZvRIkX5Nt3A==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-16T18:02:24.913 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:02:24.913 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.913 DEBUG:boto:Params: {} 2024-04-16T18:02:24.913 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:02:24.914 DEBUG:boto:Token: None 2024-04-16T18:02:24.914 DEBUG:boto:StringToSign: PUT VpBzljOcorCZvRIkX5Nt3A== application/octet-stream Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.914 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GA6YAkJDBEPIArbV4/YIHtJ2O4E= 2024-04-16T18:02:24.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'VpBzljOcorCZvRIkX5Nt3A==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GA6YAkJDBEPIArbV4/YIHtJ2O4E='} 2024-04-16T18:02:24.928 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"56907396339ca2b099bd12245f936ddc"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000329d69572e68af5c-00661ebd30-4721-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.928 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.928 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.929 DEBUG:boto:Method: GET 2024-04-16T18:02:24.929 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.929 DEBUG:boto:Data: 2024-04-16T18:02:24.929 DEBUG:boto:Headers: {} 2024-04-16T18:02:24.929 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:02:24.929 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.929 DEBUG:boto:Params: {} 2024-04-16T18:02:24.929 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:02:24.929 DEBUG:boto:Token: None 2024-04-16T18:02:24.929 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.933 DEBUG:boto:Response headers: [('Location', 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-31/testredirect?'), ('x-amz-request-id', 'tx00000a7f928bd8de178c3-00661ebd30-4925-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.933 DEBUG:boto:Redirecting: http://smithi016.front.sepia.ceph.com/cjqttm-31/testredirect 2024-04-16T18:02:24.933 DEBUG:boto:Token: None 2024-04-16T18:02:24.933 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.933 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.935 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"56907396339ca2b099bd12245f936ddc"'), ('x-amz-request-id', 'tx0000083139c8feccb01f8-00661ebd30-4721-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.936 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.936 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.936 DEBUG:boto:Method: PUT 2024-04-16T18:02:24.936 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.936 DEBUG:boto:Data: 2024-04-16T18:02:24.936 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uk9S5NXZfBvPq4jGr+LM5g==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-16T18:02:24.936 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:02:24.936 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.936 DEBUG:boto:Params: {} 2024-04-16T18:02:24.936 DEBUG:boto:Token: None 2024-04-16T18:02:24.937 DEBUG:boto:StringToSign: PUT uk9S5NXZfBvPq4jGr+LM5g== application/octet-stream Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.937 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bfAvwzcO10pFzDhpAyF3Wh9QWOc= 2024-04-16T18:02:24.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'uk9S5NXZfBvPq4jGr+LM5g==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bfAvwzcO10pFzDhpAyF3Wh9QWOc='} 2024-04-16T18:02:24.942 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"ba4f52e4d5d97c1bcfab88c6afe2cce6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ee672b8bb51ebf7f-00661ebd30-4721-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.942 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.942 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.943 DEBUG:boto:Method: GET 2024-04-16T18:02:24.943 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.943 DEBUG:boto:Data: 2024-04-16T18:02:24.943 DEBUG:boto:Headers: {} 2024-04-16T18:02:24.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:02:24.943 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.943 DEBUG:boto:Params: {} 2024-04-16T18:02:24.943 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:02:24.943 DEBUG:boto:Token: None 2024-04-16T18:02:24.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.946 DEBUG:boto:Response headers: [('Location', 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-31/testredirect?'), ('x-amz-request-id', 'tx0000084e9e0689972ab95-00661ebd30-4925-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.947 DEBUG:boto:Redirecting: http://smithi016.front.sepia.ceph.com/cjqttm-31/testredirect 2024-04-16T18:02:24.947 DEBUG:boto:Token: None 2024-04-16T18:02:24.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.949 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"ba4f52e4d5d97c1bcfab88c6afe2cce6"'), ('x-amz-request-id', 'tx00000cc842008ba98fe39-00661ebd30-4721-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.949 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.949 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.949 DEBUG:boto:Method: PUT 2024-04-16T18:02:24.950 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.950 DEBUG:boto:Data: 2024-04-16T18:02:24.950 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6aKmvaJMgaK7Z2rfDZvVeg==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-16T18:02:24.950 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:02:24.950 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.950 DEBUG:boto:Params: {} 2024-04-16T18:02:24.950 DEBUG:boto:Token: None 2024-04-16T18:02:24.950 DEBUG:boto:StringToSign: PUT 6aKmvaJMgaK7Z2rfDZvVeg== application/octet-stream Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMydFEXoHQYA8pfxIXZNKlC0pRA= 2024-04-16T18:02:24.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '6aKmvaJMgaK7Z2rfDZvVeg==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMydFEXoHQYA8pfxIXZNKlC0pRA='} 2024-04-16T18:02:24.956 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"e9a2a6bda24c81a2bb676adf0d9bd57a"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000013e59d8f4000500a-00661ebd30-4721-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.956 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.956 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.957 DEBUG:boto:Method: GET 2024-04-16T18:02:24.957 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.957 DEBUG:boto:Data: 2024-04-16T18:02:24.957 DEBUG:boto:Headers: {} 2024-04-16T18:02:24.957 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:02:24.957 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.957 DEBUG:boto:Params: {} 2024-04-16T18:02:24.957 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:02:24.957 DEBUG:boto:Token: None 2024-04-16T18:02:24.957 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.960 DEBUG:boto:Response headers: [('Location', 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-31/testredirect?'), ('x-amz-request-id', 'tx000003bd9dc1a489befd9-00661ebd30-4925-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.961 DEBUG:boto:Redirecting: http://smithi016.front.sepia.ceph.com/cjqttm-31/testredirect 2024-04-16T18:02:24.961 DEBUG:boto:Token: None 2024-04-16T18:02:24.961 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw= 2024-04-16T18:02:24.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoQ0QDsxRVNL2LOJ7NP+61UqGOw=', 'Content-Length': '0'} 2024-04-16T18:02:24.963 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"e9a2a6bda24c81a2bb676adf0d9bd57a"'), ('x-amz-request-id', 'tx00000652000059b44820f-00661ebd30-4721-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:24.963 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:24.963 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:24.964 DEBUG:boto:Method: PUT 2024-04-16T18:02:24.964 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:24.964 DEBUG:boto:Data: 2024-04-16T18:02:24.964 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GbNgNQ5MAukCtgY+rsT5Xw==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-16T18:02:24.964 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:02:24.964 DEBUG:boto:Port: 8000 2024-04-16T18:02:24.964 DEBUG:boto:Params: {} 2024-04-16T18:02:24.964 DEBUG:boto:Token: None 2024-04-16T18:02:24.964 DEBUG:boto:StringToSign: PUT GbNgNQ5MAukCtgY+rsT5Xw== application/octet-stream Tue, 16 Apr 2024 18:02:24 GMT /cjqttm-31/testredirect 2024-04-16T18:02:24.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4NPNND+/6X+20gNeOZmieWhWFO4= 2024-04-16T18:02:24.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'GbNgNQ5MAukCtgY+rsT5Xw==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:02:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4NPNND+/6X+20gNeOZmieWhWFO4='} 2024-04-16T18:02:25.006 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"19b360350e4c02e902b6063eaec4f95f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004ad672f4ded1ed2e-00661ebd30-4721-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:25.007 DEBUG:boto:path=/cjqttm-31/testredirect 2024-04-16T18:02:25.007 DEBUG:boto:auth_path=/cjqttm-31/testredirect 2024-04-16T18:02:25.007 DEBUG:boto:Method: GET 2024-04-16T18:02:25.007 DEBUG:boto:Path: /cjqttm-31/testredirect 2024-04-16T18:02:25.007 DEBUG:boto:Data: 2024-04-16T18:02:25.007 DEBUG:boto:Headers: {} 2024-04-16T18:02:25.007 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:02:25.007 DEBUG:boto:Port: 8000 2024-04-16T18:02:25.007 DEBUG:boto:Params: {} 2024-04-16T18:02:25.007 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:02:25.008 DEBUG:boto:Token: None 2024-04-16T18:02:25.008 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:25 GMT /cjqttm-31/testredirect 2024-04-16T18:02:25.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7A+S+N1hMYuygP+0vphUtt8kkVk= 2024-04-16T18:02:25.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7A+S+N1hMYuygP+0vphUtt8kkVk=', 'Content-Length': '0'} 2024-04-16T18:02:25.011 DEBUG:boto:Response headers: [('Location', 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-31/testredirect?'), ('x-amz-request-id', 'tx000008577560825874ac1-00661ebd31-4925-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:02:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:25.011 DEBUG:boto:Redirecting: http://smithi016.front.sepia.ceph.com/cjqttm-31/testredirect 2024-04-16T18:02:25.011 DEBUG:boto:Token: None 2024-04-16T18:02:25.011 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:02:25 GMT /cjqttm-31/testredirect 2024-04-16T18:02:25.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7A+S+N1hMYuygP+0vphUtt8kkVk= 2024-04-16T18:02:25.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:02:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7A+S+N1hMYuygP+0vphUtt8kkVk=', 'Content-Length': '0'} 2024-04-16T18:02:25.013 DEBUG:boto:Response headers: [('Content-Length', '512'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:02:24 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"19b360350e4c02e902b6063eaec4f95f"'), ('x-amz-request-id', 'tx00000c1241b374e60597f-00661ebd31-4721-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:02:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:02:25.014 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:02:25.014 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:02:25.014 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:02:25.071 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:02:25.071 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:02:25.119 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","account_pool":"test-zone2.rgw.meta:accounts","group_pool":"test-zone2.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T18:02:25.120 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:02:25.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:02:25.120 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:02:25.167 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:02:25.168 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:02:25.232 INFO:teuthology.orchestra.run.smithi139.stderr:Sending period to new master zone 9ba59572-f51c-4bce-9578-e6350e822996 2024-04-16T18:02:25.280 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":5,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"9ba59572-f51c-4bce-9578-e6350e822996","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T18:02:25.280 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2024-04-16T18:03:55.282 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:03:55.282 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:03:55.283 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:03:55.338 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:03:55.338 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:03:55.387 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","notif_pool":"test-zone2.rgw.log:notif","topics_pool":"test-zone2.rgw.meta:topics","account_pool":"test-zone2.rgw.meta:accounts","group_pool":"test-zone2.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T18:03:55.387 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:03:55.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:03:55.388 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:03:55.435 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:03:55.436 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:03:55.502 INFO:teuthology.orchestra.run.smithi139.stderr:Sending period to new master zone 9ba59572-f51c-4bce-9578-e6350e822996 2024-04-16T18:03:55.547 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":6,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T18:03:55.547 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2024-04-16T18:04:56.775 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T18:04:56.776+0000 7f0207b59640 -1 WARNING: The OSD cluster is overloaded and struggling to complete ops. You need more capacity to serve this level of demand. 2024-04-16T18:05:25.549 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... ok 2024-04-16T18:05:25.551 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:25.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:25.551 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:25.606 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:25.607 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:25.665 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:05:25.688 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290418.380291_312.1","last_update":"2024-04-16T18:00:18.380291Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:05:25.688 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:25.688 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:05:25.688 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:25.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:25.689 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:25.743 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:25.743 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:25.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:25.799+0000 7fc07102e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:25.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:25.800+0000 7fc07102e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:25.820 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:25Z"} 2024-04-16T18:05:25.820 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:25Z"} 2024-04-16T18:05:25.820 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:05:25.820 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:25.820 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:25.820 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:05:25.820 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:25.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UE802SBVX3HXAUMK', '--secret', 'jXpFaSqV9ms87CpECKjGhckmyG9kDw37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:25.821 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key UE802SBVX3HXAUMK --secret jXpFaSqV9ms87CpECKjGhckmyG9kDw37 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:25.871 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:25.871 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:25.901 INFO:teuthology.orchestra.run.smithi139.stderr:NOTICE: set zone's realm_id=c3c61b36-e722-463c-9f73-5156628a053b 2024-04-16T18:05:25.927 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"209564e6-2af4-459d-ae93-1edf1a86d0c3","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","notif_pool":"remove.rgw.log:notif","topics_pool":"remove.rgw.meta:topics","account_pool":"remove.rgw.meta:accounts","group_pool":"remove.rgw.meta:groups","system_key":{"access_key":"UE802SBVX3HXAUMK","secret_key":"jXpFaSqV9ms87CpECKjGhckmyG9kDw37"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T18:05:25.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:25.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:25.928 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:25.975 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:25.975 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:26.010 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:26.011+0000 7f33bbc67800 0 period (224d2f86-f40f-4dbd-9d55-5b22f2e34bfe does not have zone 209564e6-2af4-459d-ae93-1edf1a86d0c3 configured 2024-04-16T18:05:32.147 INFO:teuthology.orchestra.run.smithi139.stderr:Sending period to new master zone 9ba59572-f51c-4bce-9578-e6350e822996 2024-04-16T18:05:32.198 INFO:teuthology.orchestra.run.smithi139.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":7,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"209564e6-2af4-459d-ae93-1edf1a86d0c3","name":"remove","endpoints":[],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"209564e6-2af4-459d-ae93-1edf1a86d0c3","val":2713849561},{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T18:05:32.198 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.199 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:32.298 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-16T18:05:32.298 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.298 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:32.349 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:32.349 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:32.389 INFO:teuthology.orchestra.run.smithi016.stderr:zone name remove not found in zonegroup test-zonegroup 2024-04-16T18:05:32.404 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-16T18:05:32.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.405 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:32.451 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:32.451 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:32.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:32.497+0000 7f708294b800 0 Removed zone from zonegroup test-zonegroup 2024-04-16T18:05:32.511 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.511 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:32.561 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:32.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:05:32.604+0000 7f5f2869d800 0 WARNING: can't generate connection for zone 209564e6-2af4-459d-ae93-1edf1a86d0c3 id remove: no endpoints defined 2024-04-16T18:05:32.660 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":8,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T18:05:32.661 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zonegroup_remove ... ok 2024-04-16T18:05:32.661 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.662 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:32.705 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:32.749 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"50da73ad-c1e9-4799-a686-2396368a848e","name":"remove_zg","api_name":"remove_zg","is_master":false,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":[]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-16T18:05:32.749 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.749 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:32.797 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:32.797 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:32.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:05:32.849+0000 7fc891416800 0 NOTICE: promoted remove as new master_zone of zonegroup remove_zg 2024-04-16T18:05:32.869 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"e40b3a82-d94c-4194-b7be-b89153175dfb","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","notif_pool":"remove.rgw.log:notif","topics_pool":"remove.rgw.meta:topics","account_pool":"remove.rgw.meta:accounts","group_pool":"remove.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b"} 2024-04-16T18:05:32.869 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:32.870 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:32.923 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:33.025 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":9,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"50da73ad-c1e9-4799-a686-2396368a848e","name":"remove_zg","api_name":"remove_zg","is_master":false,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"e40b3a82-d94c-4194-b7be-b89153175dfb","zones":[{"id":"e40b3a82-d94c-4194-b7be-b89153175dfb","name":"remove","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017},{"key":"e40b3a82-d94c-4194-b7be-b89153175dfb","val":2943875527}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T18:05:33.026 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.026 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:33.118 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:05:33.120+0000 7f3cee943800 0 NOTICE: removed master_zone of zonegroup remove_zg 2024-04-16T18:05:33.119 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:05:33.120+0000 7f3cee943800 0 Removed zone from zonegroup remove_zg 2024-04-16T18:05:33.134 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.134 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:33.184 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:33.184 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:33.234 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:05:33.236+0000 7f3f0de9d800 0 ERROR: zonegroup remove_zg has a non existent master zone 2024-04-16T18:05:33.249 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-16T18:05:33.250 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.250 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:33.299 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:33.300 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:33.347 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:05:33.348 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:05:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:33.396 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:33.492 INFO:teuthology.orchestra.run.smithi016.stdout:{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","epoch":10,"predecessor_uuid":"16a6013d-6130-415e-b546-915bfb3780b6","sync_status":[],"period_map":{"id":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":true,"endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","zones":[{"id":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","name":"test-zone2","endpoints":["http://smithi139.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]},{"id":"9ba59572-f51c-4bce-9578-e6350e822996","name":"test-zone1","endpoints":["http://smithi016.front.sepia.ceph.com:8000"],"log_meta":false,"log_data":true,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["compress-encrypted","notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]}],"short_zone_ids":[{"key":"316ebd79-1e8f-459c-be24-e6b3e0dc08e5","val":2110687966},{"key":"9ba59572-f51c-4bce-9578-e6350e822996","val":1915603017}]},"master_zonegroup":"test-zonegroup","master_zone":"9ba59572-f51c-4bce-9578-e6350e822996","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"bucket_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false},"anonymous_ratelimit":{"max_read_ops":0,"max_write_ops":0,"max_read_bytes":0,"max_write_bytes":0,"enabled":false}},"realm_id":"c3c61b36-e722-463c-9f73-5156628a053b","realm_epoch":2} 2024-04-16T18:05:33.493 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zg_master_zone_delete ... ok 2024-04-16T18:05:33.493 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-32 2024-04-16T18:05:33.493 DEBUG:boto:path=/cjqttm-32/ 2024-04-16T18:05:33.494 DEBUG:boto:auth_path=/cjqttm-32/ 2024-04-16T18:05:33.494 DEBUG:boto:Method: PUT 2024-04-16T18:05:33.494 DEBUG:boto:Path: /cjqttm-32/ 2024-04-16T18:05:33.494 DEBUG:boto:Data: 2024-04-16T18:05:33.494 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.494 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:05:33.494 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.494 DEBUG:boto:Params: {} 2024-04-16T18:05:33.495 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:05:33.495 DEBUG:boto:Token: None 2024-04-16T18:05:33.495 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-32/ 2024-04-16T18:05:33.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o1GXzT7ypB6MdBi5z7jjw+Sz0bk= 2024-04-16T18:05:33.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o1GXzT7ypB6MdBi5z7jjw+Sz0bk=', 'Content-Length': '0'} 2024-04-16T18:05:33.702 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000850847d7312a1d25-00661ebded-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:05:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:33.702 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-33 2024-04-16T18:05:33.702 DEBUG:boto:path=/cjqttm-33/ 2024-04-16T18:05:33.702 DEBUG:boto:auth_path=/cjqttm-33/ 2024-04-16T18:05:33.703 DEBUG:boto:Method: PUT 2024-04-16T18:05:33.703 DEBUG:boto:Path: /cjqttm-33/ 2024-04-16T18:05:33.703 DEBUG:boto:Data: 2024-04-16T18:05:33.703 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.703 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:05:33.703 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.703 DEBUG:boto:Params: {} 2024-04-16T18:05:33.703 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:05:33.704 DEBUG:boto:Token: None 2024-04-16T18:05:33.704 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-33/ 2024-04-16T18:05:33.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zt61LzqQUcZyyQPVfVqPIIn4ndg= 2024-04-16T18:05:33.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zt61LzqQUcZyyQPVfVqPIIn4ndg=', 'Content-Length': '0'} 2024-04-16T18:05:33.799 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ade2237ffb8b828c-00661ebded-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:05:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:33.799 DEBUG:boto:path=/cjqttm-32/ 2024-04-16T18:05:33.799 DEBUG:boto:auth_path=/cjqttm-32/ 2024-04-16T18:05:33.799 DEBUG:boto:path=/cjqttm-32/?website 2024-04-16T18:05:33.799 DEBUG:boto:auth_path=/cjqttm-32/?website 2024-04-16T18:05:33.799 DEBUG:boto:Method: PUT 2024-04-16T18:05:33.799 DEBUG:boto:Path: /cjqttm-32/?website 2024-04-16T18:05:33.800 DEBUG:boto:Data: index.htmlerror.html 2024-04-16T18:05:33.800 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.800 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:05:33.800 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.800 DEBUG:boto:Params: {} 2024-04-16T18:05:33.800 DEBUG:boto:Token: None 2024-04-16T18:05:33.800 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-32/?website 2024-04-16T18:05:33.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y/NikhyFz43qupO45Op+EuiPoLw= 2024-04-16T18:05:33.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y/NikhyFz43qupO45Op+EuiPoLw=', 'Content-Length': '241'} 2024-04-16T18:05:33.801 DEBUG:boto:Response headers: [('Content-Length', '221'), ('x-amz-request-id', 'tx000001e55ef053e2748db-00661ebded-4816-test-zone1'), ('Accept-Ranges', 'bytes'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:05:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:33.802 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_website ... SKIP: test_set_bucket_website skipped. Requires rgw_enable_static_website = 1. 2024-04-16T18:05:33.803 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-34 2024-04-16T18:05:33.803 DEBUG:boto:path=/cjqttm-34/ 2024-04-16T18:05:33.803 DEBUG:boto:auth_path=/cjqttm-34/ 2024-04-16T18:05:33.803 DEBUG:boto:Method: PUT 2024-04-16T18:05:33.803 DEBUG:boto:Path: /cjqttm-34/ 2024-04-16T18:05:33.804 DEBUG:boto:Data: 2024-04-16T18:05:33.804 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.804 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:05:33.804 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.804 DEBUG:boto:Params: {} 2024-04-16T18:05:33.804 DEBUG:boto:Token: None 2024-04-16T18:05:33.804 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-34/ 2024-04-16T18:05:33.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ImEpgUeIwMIBBRSLUSThm2P9Ak= 2024-04-16T18:05:33.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ImEpgUeIwMIBBRSLUSThm2P9Ak=', 'Content-Length': '0'} 2024-04-16T18:05:33.817 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000057650301f3be44d1-00661ebded-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:05:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:33.817 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-35 2024-04-16T18:05:33.817 DEBUG:boto:path=/cjqttm-35/ 2024-04-16T18:05:33.817 DEBUG:boto:auth_path=/cjqttm-35/ 2024-04-16T18:05:33.817 DEBUG:boto:Method: PUT 2024-04-16T18:05:33.817 DEBUG:boto:Path: /cjqttm-35/ 2024-04-16T18:05:33.817 DEBUG:boto:Data: 2024-04-16T18:05:33.817 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.818 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:05:33.818 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.818 DEBUG:boto:Params: {} 2024-04-16T18:05:33.818 DEBUG:boto:Token: None 2024-04-16T18:05:33.818 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-35/ 2024-04-16T18:05:33.818 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/aUQMhxZZs1CBwiCtvmXlSRL26E= 2024-04-16T18:05:33.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/aUQMhxZZs1CBwiCtvmXlSRL26E=', 'Content-Length': '0'} 2024-04-16T18:05:33.879 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000e0ce6d0a1d7b5b9e-00661ebded-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:05:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:33.879 DEBUG:boto:path=/cjqttm-34/ 2024-04-16T18:05:33.879 DEBUG:boto:auth_path=/cjqttm-34/ 2024-04-16T18:05:33.880 DEBUG:boto:path=/cjqttm-34/?policy 2024-04-16T18:05:33.880 DEBUG:boto:auth_path=/cjqttm-34/?policy 2024-04-16T18:05:33.880 DEBUG:boto:Method: PUT 2024-04-16T18:05:33.880 DEBUG:boto:Path: /cjqttm-34/?policy 2024-04-16T18:05:33.880 DEBUG:boto:Data: { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Principal": "*" }] } 2024-04-16T18:05:33.880 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.880 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:05:33.880 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.880 DEBUG:boto:Params: {} 2024-04-16T18:05:33.880 DEBUG:boto:Token: None 2024-04-16T18:05:33.880 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-34/?policy 2024-04-16T18:05:33.881 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/LvMovvsElDqr59Tm+kw9za8Wmk= 2024-04-16T18:05:33.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/LvMovvsElDqr59Tm+kw9za8Wmk=', 'Content-Length': '97'} 2024-04-16T18:05:33.886 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ffd9995dce6547be-00661ebded-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:05:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:33.886 DEBUG:boto:path=/cjqttm-34/ 2024-04-16T18:05:33.886 DEBUG:boto:auth_path=/cjqttm-34/ 2024-04-16T18:05:33.886 DEBUG:boto:path=/cjqttm-34/?policy 2024-04-16T18:05:33.886 DEBUG:boto:auth_path=/cjqttm-34/?policy 2024-04-16T18:05:33.887 DEBUG:boto:Method: GET 2024-04-16T18:05:33.887 DEBUG:boto:Path: /cjqttm-34/?policy 2024-04-16T18:05:33.887 DEBUG:boto:Data: 2024-04-16T18:05:33.887 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:05:33.887 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.887 DEBUG:boto:Params: {} 2024-04-16T18:05:33.887 DEBUG:boto:Token: None 2024-04-16T18:05:33.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-34/?policy 2024-04-16T18:05:33.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9GnVccL6u+LvhvDS/IlywXhkmSk= 2024-04-16T18:05:33.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9GnVccL6u+LvhvDS/IlywXhkmSk=', 'Content-Length': '0'} 2024-04-16T18:05:33.889 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000014f858b6252f1dc4-00661ebded-4816-test-zone1'), ('Content-Type', 'application/json'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '97'), ('Date', 'Tue, 16 Apr 2024 18:05:33 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:33.889 DEBUG:boto:path=/cjqttm-35/ 2024-04-16T18:05:33.889 DEBUG:boto:auth_path=/cjqttm-35/ 2024-04-16T18:05:33.889 DEBUG:boto:path=/cjqttm-35/?policy 2024-04-16T18:05:33.889 DEBUG:boto:auth_path=/cjqttm-35/?policy 2024-04-16T18:05:33.889 DEBUG:boto:Method: PUT 2024-04-16T18:05:33.889 DEBUG:boto:Path: /cjqttm-35/?policy 2024-04-16T18:05:33.889 DEBUG:boto:Data: { "Version": "2012-10-17", "Statement": [{ "Effect": "Allow", "Principal": "*" }] } 2024-04-16T18:05:33.889 DEBUG:boto:Headers: {} 2024-04-16T18:05:33.890 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:05:33.890 DEBUG:boto:Port: 8000 2024-04-16T18:05:33.890 DEBUG:boto:Params: {} 2024-04-16T18:05:33.890 DEBUG:boto:Token: None 2024-04-16T18:05:33.890 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:33 GMT /cjqttm-35/?policy 2024-04-16T18:05:33.890 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p4UDsbnANbEDY2r7FIyIcZ7e7UU= 2024-04-16T18:05:33.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:33 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p4UDsbnANbEDY2r7FIyIcZ7e7UU=', 'Content-Length': '97'} 2024-04-16T18:05:34.902 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000000f157e965bfdec20-00661ebded-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:05:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:34.902 DEBUG:boto:path=/cjqttm-35/ 2024-04-16T18:05:34.902 DEBUG:boto:auth_path=/cjqttm-35/ 2024-04-16T18:05:34.902 DEBUG:boto:path=/cjqttm-35/?policy 2024-04-16T18:05:34.903 DEBUG:boto:auth_path=/cjqttm-35/?policy 2024-04-16T18:05:34.903 DEBUG:boto:Method: GET 2024-04-16T18:05:34.903 DEBUG:boto:Path: /cjqttm-35/?policy 2024-04-16T18:05:34.903 DEBUG:boto:Data: 2024-04-16T18:05:34.903 DEBUG:boto:Headers: {} 2024-04-16T18:05:34.903 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:05:34.903 DEBUG:boto:Port: 8000 2024-04-16T18:05:34.903 DEBUG:boto:Params: {} 2024-04-16T18:05:34.903 DEBUG:boto:Token: None 2024-04-16T18:05:34.904 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:05:34 GMT /cjqttm-35/?policy 2024-04-16T18:05:34.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:457+asueHd1pux6iNITiknQQB6k= 2024-04-16T18:05:34.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:457+asueHd1pux6iNITiknQQB6k=', 'Content-Length': '0'} 2024-04-16T18:05:34.905 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f145cf55774a78d5-00661ebdee-4999-test-zone2'), ('Content-Type', 'application/json'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '97'), ('Date', 'Tue, 16 Apr 2024 18:05:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:34.946 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_policy ... ok 2024-04-16T18:05:34.947 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-36 2024-04-16T18:05:34.947 DEBUG:boto:path=/cjqttm-36/ 2024-04-16T18:05:34.947 DEBUG:boto:auth_path=/cjqttm-36/ 2024-04-16T18:05:34.947 DEBUG:boto:Method: PUT 2024-04-16T18:05:34.947 DEBUG:boto:Path: /cjqttm-36/ 2024-04-16T18:05:34.948 DEBUG:boto:Data: 2024-04-16T18:05:34.948 DEBUG:boto:Headers: {} 2024-04-16T18:05:34.948 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:05:34.948 DEBUG:boto:Port: 8000 2024-04-16T18:05:34.948 DEBUG:boto:Params: {} 2024-04-16T18:05:34.948 DEBUG:boto:Token: None 2024-04-16T18:05:34.948 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:34 GMT /cjqttm-36/ 2024-04-16T18:05:34.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NtlTa5F+rKqvLDtGHP+qqaWJOpg= 2024-04-16T18:05:34.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NtlTa5F+rKqvLDtGHP+qqaWJOpg=', 'Content-Length': '0'} 2024-04-16T18:05:34.964 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000bde31f109c8f7de1-00661ebdee-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:05:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:34.965 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-37 2024-04-16T18:05:34.965 DEBUG:boto:path=/cjqttm-37/ 2024-04-16T18:05:34.965 DEBUG:boto:auth_path=/cjqttm-37/ 2024-04-16T18:05:34.965 DEBUG:boto:Method: PUT 2024-04-16T18:05:34.965 DEBUG:boto:Path: /cjqttm-37/ 2024-04-16T18:05:34.965 DEBUG:boto:Data: 2024-04-16T18:05:34.965 DEBUG:boto:Headers: {} 2024-04-16T18:05:34.965 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:05:34.965 DEBUG:boto:Port: 8000 2024-04-16T18:05:34.965 DEBUG:boto:Params: {} 2024-04-16T18:05:34.966 DEBUG:boto:Token: None 2024-04-16T18:05:34.966 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:05:34 GMT /cjqttm-37/ 2024-04-16T18:05:34.966 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x+LwIE3B3CwtXCUCEON5kVeyB10= 2024-04-16T18:05:34.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:05:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x+LwIE3B3CwtXCUCEON5kVeyB10=', 'Content-Length': '0'} 2024-04-16T18:05:34.993 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000050e566ac45db4cf0-00661ebdee-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:05:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:05:34.994 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:34.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:34.994 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:35.047 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:35.047 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:35.102 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:05:35.124 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290734.983865_482.1","last_update":"2024-04-16T18:05:34.983865Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:05:35.124 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:35.125 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:05:35.125 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:35.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:35.125 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:35.179 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:35.233 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:35.234+0000 7f0834d24800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:35.234 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:35.235+0000 7f0834d24800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:35.255 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:35Z"} 2024-04-16T18:05:35.255 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:35Z"} 2024-04-16T18:05:35.255 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:05:35.256 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:35.256 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:35.256 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:05:40.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:40.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:40.257 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:40.312 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:40.312 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:40.367 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:40.368+0000 7fc204216800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:40.368 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:40.370+0000 7fc204216800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:40.390 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:40Z"} 2024-04-16T18:05:40.390 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:40Z"} 2024-04-16T18:05:40.390 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:05:40.390 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:40.391 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:40.391 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:05:45.391 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:45.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:45.392 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:45.448 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:45.448 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:45.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:45.503+0000 7f29b371f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:45.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:45.504+0000 7f29b371f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:45.525 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:45Z"} 2024-04-16T18:05:45.526 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:45Z"} 2024-04-16T18:05:45.526 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:05:45.526 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:45.526 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:45.526 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:05:50.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:50.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:50.528 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:50.583 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:50.583 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:50.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:50.640+0000 7f90e7c2e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:50.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:50.641+0000 7f90e7c2e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:50.663 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:50Z"} 2024-04-16T18:05:50.663 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:50Z"} 2024-04-16T18:05:50.663 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:05:50.663 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:50.663 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:50.663 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:05:55.665 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:55.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:05:55.666 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:05:55.724 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:05:55.724 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:05:55.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:55.779+0000 7fcf13044800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:55.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:05:55.781+0000 7fcf13044800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:05:55.801 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:55Z"} 2024-04-16T18:05:55.802 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:05:55Z"} 2024-04-16T18:05:55.802 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:05:55.802 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:55.802 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:05:55.802 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:00.803 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:00.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:00.804 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:00.859 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:00.859 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:00.922+0000 7ff2f9244800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:00.923+0000 7ff2f9244800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:00.943 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:00Z"} 2024-04-16T18:06:00.943 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:00Z"} 2024-04-16T18:06:00.944 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:00.944 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:00.944 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:00.944 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:05.945 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:05.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:05.946 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:06.003 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:06.003 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:06.057 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:06.059+0000 7f3a2ee33800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:06.058 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:06.060+0000 7f3a2ee33800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:06.080 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:06Z"} 2024-04-16T18:06:06.080 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:06Z"} 2024-04-16T18:06:06.080 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:06.080 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:06.080 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:06.080 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:11.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:11.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:11.082 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:11.138 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:11.138 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:11.192 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:11.193+0000 7f5ab163d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:11.194 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:11.195+0000 7f5ab163d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:11.215 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:11Z"} 2024-04-16T18:06:11.216 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:11Z"} 2024-04-16T18:06:11.216 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:11.216 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:11.216 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:11.216 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:16.218 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:16.218 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:16.218 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:16.275 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:16.276 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:16.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:16.331+0000 7f9f9509d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:16.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:16.332+0000 7f9f9509d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:16.352 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:16Z"} 2024-04-16T18:06:16.352 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:16Z"} 2024-04-16T18:06:16.353 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:16.353 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:16.353 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:16.353 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:21.354 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:21.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:21.355 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:21.409 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:21.409 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:21.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:21.468+0000 7f6805d33800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:21.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:21.469+0000 7f6805d33800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:21.490 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:21Z"} 2024-04-16T18:06:21.490 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:21Z"} 2024-04-16T18:06:21.490 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:21.490 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:21.490 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:21.490 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:26.491 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:26.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:26.492 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:26.547 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:26.547 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:26.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:26.603+0000 7f15a92e4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:26.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:26.604+0000 7f15a92e4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:26.626 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:26Z"} 2024-04-16T18:06:26.626 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:26Z"} 2024-04-16T18:06:26.626 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:26.627 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:26.627 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:26.627 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:31.628 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:31.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:31.629 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:31.685 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:31.685 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:31.739 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:31.740+0000 7f6481d28800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:31.740 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:31.741+0000 7f6481d28800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:31.761 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:31Z"} 2024-04-16T18:06:31.761 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:31Z"} 2024-04-16T18:06:31.762 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:31.762 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:31.762 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:31.762 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:36.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:36.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:36.763 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:36.818 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:36.818 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:36.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:36.873+0000 7feaf6d2a800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:36.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:36.875+0000 7feaf6d2a800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:36.894 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:36Z"} 2024-04-16T18:06:36.895 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:36Z"} 2024-04-16T18:06:36.895 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:36.895 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:36.895 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:36.895 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:41.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:41.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:41.897 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:41.952 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:41.952 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:42.006 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:42.008+0000 7f4f0ad3b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:42.007 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:42.009+0000 7f4f0ad3b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:42.028 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:42Z"} 2024-04-16T18:06:42.029 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:42Z"} 2024-04-16T18:06:42.029 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:42.029 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:42.029 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:42.029 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:47.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:47.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:47.030 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:47.086 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:47.086 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:47.142 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:47.145+0000 7f964a92c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:47.144 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:47.146+0000 7f964a92c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:47.165 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:47Z"} 2024-04-16T18:06:47.165 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:47Z"} 2024-04-16T18:06:47.166 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:47.166 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:47.166 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:47.166 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:52.167 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:52.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:52.168 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:52.225 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:52.226 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:52.280 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:52.283+0000 7fd500812800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:52.282 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:52.284+0000 7fd500812800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:52.304 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:52Z"} 2024-04-16T18:06:52.304 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:52Z"} 2024-04-16T18:06:52.304 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:52.304 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:52.304 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:52.304 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:06:57.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:57.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:06:57.306 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:06:57.364 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:06:57.364 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:06:57.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:57.418+0000 7fd953ae4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:57.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:06:57.420+0000 7fd953ae4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:06:57.440 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:57Z"} 2024-04-16T18:06:57.440 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:06:57Z"} 2024-04-16T18:06:57.440 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:06:57.441 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:57.441 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:06:57.441 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:07:02.442 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:02.442 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:02.442 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:02.497 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:02.498 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:02.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:02.554+0000 7feb7832b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:02.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:02.555+0000 7feb7832b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:02.575 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:02Z"} 2024-04-16T18:07:02.576 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290418.380291_312.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:00:18.380291Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:02Z"} 2024-04-16T18:07:02.576 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290418.380291_312.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:00:18.380291Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:07:02.576 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:02.576 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290418.380291_312.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:02.576 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290418.380291_312.1 2024-04-16T18:07:07.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:07.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:07.578 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:07.634 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:07.634 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:07.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:07.690+0000 7f55b0b1f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:07.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:07.691+0000 7f55b0b1f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:07.712 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290733.697587_441.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:05:33.697587Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:07Z"} 2024-04-16T18:07:07.712 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290733.697587_441.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:05:33.697587Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:07Z"} 2024-04-16T18:07:07.713 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290733.697587_441.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:05:33.697587Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:07:07.713 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:07.713 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290733.697587_441.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:07.713 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290734.983865_482.1 target=1_1713290733.697587_441.1 2024-04-16T18:07:12.714 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:12.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:12.715 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:12.770 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:12.770 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:12.824 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:12.825+0000 7faa4ce3d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:12.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:12.826+0000 7faa4ce3d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:12.847 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290734.983865_482.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:05:34.983865Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:12Z"} 2024-04-16T18:07:12.847 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290734.983865_482.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:05:34.983865Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:12Z"} 2024-04-16T18:07:12.848 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290734.983865_482.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:05:34.983865Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:07:12.848 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:12.848 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290734.983865_482.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:12.848 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:07:12.848 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'cjqttm-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:12.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'cjqttm-36', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:12.848 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket cjqttm-36 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:07:12.904 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:12.904 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:13.011 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'cjqttm-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:13.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'cjqttm-37', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:13.012 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket cjqttm-37 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:07:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:13.060 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:13.159 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.160 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:13.204 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:13.204 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:13.276 INFO:teuthology.orchestra.run.smithi016.stdout:["sync.error-log.29","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:2","obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:7","sync.error-log.23","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:8","obj_delete_at_hint.0000000026","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:2","sync.error-log.8","obj_delete_at_hint.0000000028","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:1","sync.error-log.30","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:10","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17","obj_delete_at_hint.0000000040","sync.error-log.6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:4","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:8","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:6","obj_delete_at_hint.0000000035","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:6","obj_delete_at_hint.0000000037","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:3","obj_delete_at_hint.0000000024","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:7","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:0","data_log.3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:0","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:6","data_loggenerations_metadata","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:9","meta.log.224d2f86-f40f-4dbd-9d55-5b22f2e34bfe.0","obj_delete_at_hint.0000000076","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:9","obj_delete_at_hint.0000000113","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:5","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","sync.error-log.21","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:1","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:0","sync.error-log.0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:4","obj_delete_at_hint.0000000096","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:5","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:3","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:10","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:3","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:8","bilog.trim","obj_delete_at_hint.0000000016","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:0","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:4","obj_delete_at_hint.0000000092","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:10","sync.error-log.27","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:7","sync.error-log.4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:3","obj_delete_at_hint.0000000014","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:8","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","sync.error-log.16","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:9","obj_delete_at_hint.0000000074","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:1","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:2","obj_delete_at_hint.0000000121","data_log.1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:6","sync.error-log.17","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:10","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:5","obj_delete_at_hint.0000000077","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:3","obj_delete_at_hint.0000000032","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:3","sync.error-log.24","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:4","obj_delete_at_hint.0000000065","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:6","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:9","sync.error-log.7","sync.error-log.3","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:6","data_log.1.zu40Qg3qqnc.0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:8","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:5","sync.error-log.12","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:3","obj_delete_at_hint.0000000116","sync.error-log.25","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:10","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","sync.error-log.13","meta.log.224d2f86-f40f-4dbd-9d55-5b22f2e34bfe.3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:5","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:6","datalog.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:1","sync.error-log.14","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34","obj_delete_at_hint.0000000066","data_log.0.zOZcxdTXFWL.0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:7","obj_delete_at_hint.0000000068","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:5","obj_delete_at_hint.0000000085","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:3","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:10","sync.error-log.10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:0","obj_delete_at_hint.0000000118","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:3","obj_delete_at_hint.0000000036","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:10","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:1","obj_delete_at_hint.0000000103","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:10","obj_delete_at_hint.0000000119","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:4","obj_delete_at_hint.0000000098","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:7","obj_delete_at_hint.0000000027","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:8","obj_delete_at_hint.0000000019","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.0","obj_delete_at_hint.0000000039","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:4","obj_delete_at_hint.0000000100","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:5","meta.log.224d2f86-f40f-4dbd-9d55-5b22f2e34bfe.2","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.2.retry","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.1","obj_delete_at_hint.0000000093","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:7","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:3","obj_delete_at_hint.0000000122","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:10","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:7","sync.error-log.2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:3","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12","data_log.0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:4","obj_delete_at_hint.0000000012","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:2","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.0.retry","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:5","sync.error-log.11","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:0","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:9","obj_delete_at_hint.0000000020","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:6","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","sync.error-log.19","sync.error-log.28","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:3","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:2","sync.error-log.1","obj_delete_at_hint.0000000033","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:4","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","sync.error-log.31","sync.error-log.18","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:0","obj_delete_at_hint.0000000108","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:0","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:3","obj_delete_at_hint.0000000109","sync.error-log.15","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:2","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:7","obj_delete_at_hint.0000000013","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:1","data_log.2.UpmNyDp2SVn.0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:8","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:8","obj_delete_at_hint.0000000051","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:0","obj_delete_at_hint.0000000106","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:1","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.3.retry","obj_delete_at_hint.0000000017","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:5","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:10","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:2","obj_delete_at_hint.0000000046","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:1","sync.error-log.26","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:8","sync.error-log.22","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:10","data_log.2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:1","obj_delete_at_hint.0000000067","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:2","sync.error-log.9","obj_delete_at_hint.0000000086","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:1","sync.error-log.5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:6","sync.error-log.20","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:4","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:5","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:2","obj_delete_at_hint.0000000050","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.2","obj_delete_at_hint.0000000102","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:1","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:6","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2:7","obj_delete_at_hint.0000000124","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:9","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:9","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.1.retry","obj_delete_at_hint.0000000061","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:6","obj_delete_at_hint.0000000097","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:8","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15","datalog.sync-status.shard.316ebd79-1e8f-459c-be24-e6b3e0dc08e5.3","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:6","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:8","obj_delete_at_hint.0000000042","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:10","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:2","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:4","data_log.3.tyl4PiVNf/B.0","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1:4","bucket.full-sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22","obj_delete_at_hint.0000000075","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:7","bucket.sync-status.316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:7","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-16T18:07:13.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.297 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:13.341 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:13.341 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:13.416 INFO:teuthology.orchestra.run.smithi139.stdout:["sync.error-log.29","obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:3","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.2","sync.error-log.23","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:5","obj_delete_at_hint.0000000026","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:9","sync.error-log.8","obj_delete_at_hint.0000000028","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:1","sync.error-log.30","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:4","obj_delete_at_hint.0000000040","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:2","sync.error-log.6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:7","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:2","obj_delete_at_hint.0000000035","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:1","obj_delete_at_hint.0000000037","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:10","obj_delete_at_hint.0000000024","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:1","obj_delete_at_hint.0000000000","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:0","obj_delete_at_hint.0000000031","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:2","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:10","data_log.3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:1","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33","data_loggenerations_metadata","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:10","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.0.retry","meta.log.224d2f86-f40f-4dbd-9d55-5b22f2e34bfe.0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:6","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.3.retry","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31","obj_delete_at_hint.0000000052","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:2","sync.error-log.21","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:6","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","sync.error-log.0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:0","obj_delete_at_hint.0000000096","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:10","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:3","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.1","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:3","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:0","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:8","sync.error-log.27","sync.error-log.4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:3","obj_delete_at_hint.0000000014","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:10","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:0","sync.error-log.16","obj_delete_at_hint.0000000064","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:8","obj_delete_at_hint.0000000071","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:5","obj_delete_at_hint.0000000074","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.1.retry","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:7","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:1","obj_delete_at_hint.0000000121","data_log.1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:0","data_log.0.+2cUKCEkcFC.0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:9","sync.error-log.17","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:8","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","datalog.sync-status.9ba59572-f51c-4bce-9578-e6350e822996","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","data_log.3.gGjG6FQTj9p.0","obj_delete_at_hint.0000000077","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:3","obj_delete_at_hint.0000000032","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:2","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16","sync.error-log.24","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:9","obj_delete_at_hint.0000000053","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:10","obj_delete_at_hint.0000000091","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:0","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:1","sync.error-log.7","sync.error-log.3","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:7","mdlog.sync-status.shard.2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:6","obj_delete_at_hint.0000000045","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:1","obj_delete_at_hint.0000000002","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:9","sync.error-log.12","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:0","obj_delete_at_hint.0000000116","sync.error-log.25","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:5","obj_delete_at_hint.0000000034","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:8","obj_delete_at_hint.0000000101","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:2","sync.error-log.13","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:9","mdlog.sync-status.shard.1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:0","meta.log.224d2f86-f40f-4dbd-9d55-5b22f2e34bfe.3","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:8","sync.error-log.14","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:6","obj_delete_at_hint.0000000066","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:9","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18","obj_delete_at_hint.0000000068","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:9","obj_delete_at_hint.0000000085","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:1","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:5","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32","sync.error-log.10","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:4","mdlog.sync-status.shard.3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:9","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:0","mdlog.sync-status.shard.0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:8","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:0","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:10","obj_delete_at_hint.0000000039","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:10","obj_delete_at_hint.0000000100","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:6","meta.log.224d2f86-f40f-4dbd-9d55-5b22f2e34bfe.2","obj_delete_at_hint.0000000093","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:6","data_log.1.9kJw8kJK3rb.0","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:3","obj_delete_at_hint.0000000122","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:2","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","sync.error-log.2","data_log.0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:10","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:7","obj_delete_at_hint.0000000012","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:7","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:9","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:10","sync.error-log.11","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-15:9ba59572-f51c-4bce-9578-e6350e822996.4365.19:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:2","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:8","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.0","obj_delete_at_hint.0000000020","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:6","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","sync.error-log.19","sync.error-log.28","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:1","obj_delete_at_hint.0000000072","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:9","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","sync.error-log.1","obj_delete_at_hint.0000000033","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:5","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:5","obj_delete_at_hint.0000000025","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:7","datalog.sync-status.shard.9ba59572-f51c-4bce-9578-e6350e822996.2.retry","obj_delete_at_hint.0000000123","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:3","sync.error-log.31","sync.error-log.18","obj_delete_at_hint.0000000108","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:8","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","sync.error-log.15","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:3","obj_delete_at_hint.0000000013","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:8","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:9","obj_delete_at_hint.0000000051","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:5","obj_delete_at_hint.0000000106","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:2","obj_delete_at_hint.0000000017","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:1","obj_delete_at_hint.0000000023","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12","obj_delete_at_hint.0000000107","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:0","obj_delete_at_hint.0000000046","sync.error-log.26","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-13:9ba59572-f51c-4bce-9578-e6350e822996.4365.17:6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:6","sync.error-log.22","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:4","data_log.2","obj_delete_at_hint.0000000067","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:6","sync.error-log.9","obj_delete_at_hint.0000000086","sync.error-log.5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:7","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:7","sync.error-log.20","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-10:9ba59572-f51c-4bce-9578-e6350e822996.4365.14:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-18:9ba59572-f51c-4bce-9578-e6350e822996.4365.22:5","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:2","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-27:9ba59572-f51c-4bce-9578-e6350e822996.4365.31:6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:8","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:2","data_log.2.qzXw6zh5Xd5.0","obj_delete_at_hint.0000000124","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-20:9ba59572-f51c-4bce-9578-e6350e822996.4365.24:3","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-29:9ba59572-f51c-4bce-9578-e6350e822996.4365.33:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:9","obj_delete_at_hint.0000000061","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:3","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-12:9ba59572-f51c-4bce-9578-e6350e822996.4365.16:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-28:9ba59572-f51c-4bce-9578-e6350e822996.4365.32:8","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-14:9ba59572-f51c-4bce-9578-e6350e822996.4365.18:2","obj_delete_at_hint.0000000097","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-11:9ba59572-f51c-4bce-9578-e6350e822996.4365.15:6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-16:9ba59572-f51c-4bce-9578-e6350e822996.4365.20:6","obj_delete_at_hint.0000000042","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:1","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:10","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:7","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-17:9ba59572-f51c-4bce-9578-e6350e822996.4365.21:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-9:9ba59572-f51c-4bce-9578-e6350e822996.4365.13:6","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-31:9ba59572-f51c-4bce-9578-e6350e822996.4711.1:5","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23:4","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-8:9ba59572-f51c-4bce-9578-e6350e822996.4365.12:0","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-30:9ba59572-f51c-4bce-9578-e6350e822996.4365.34:6","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-19:9ba59572-f51c-4bce-9578-e6350e822996.4365.23","bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-7:9ba59572-f51c-4bce-9578-e6350e822996.4365.11:6"] 2024-04-16T18:07:13.436 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T18:07:13.437 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.437 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:13.484 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:13.484 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:13.566 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000002904","last_update":"2024-04-16T18:07:13.132127Z"},{"marker":"00000000000000000000:00000000000000006983","last_update":"2024-04-16T18:07:13.133573Z"},{"marker":"00000000000000000000:00000000000000005858","last_update":"2024-04-16T18:07:13.134679Z"},{"marker":"00000000000000000000:00000000000000003753","last_update":"2024-04-16T18:07:13.136053Z"}] 2024-04-16T18:07:13.566 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:13.566 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:07:13.566 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:13.567 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:13.617 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:13.618 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:13.691 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:13Z"} 2024-04-16T18:07:13.691 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:13Z"} 2024-04-16T18:07:13.691 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006142', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:37.732544Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005018', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:02:25.416474Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002910', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:40.373080Z'}}] 2024-04-16T18:07:13.691 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:13.692 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006142', 2: '00000000000000000000:00000000000000005018', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T18:07:13.692 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002904 target=00000000000000000000:00000000000000002343, shard=1 master=00000000000000000000:00000000000000006983 target=00000000000000000000:00000000000000006142, shard=2 master=00000000000000000000:00000000000000005858 target=00000000000000000000:00000000000000005018, shard=3 master=00000000000000000000:00000000000000003753 target=00000000000000000000:00000000000000002910 2024-04-16T18:07:18.692 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:18.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:18.693 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:18.750 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:18.750 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:18.831 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:18Z"} 2024-04-16T18:07:18.831 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:18Z"} 2024-04-16T18:07:18.831 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006142', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:37.732544Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005018', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:02:25.416474Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002910', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:40.373080Z'}}] 2024-04-16T18:07:18.831 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:18.831 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006142', 2: '00000000000000000000:00000000000000005018', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T18:07:18.832 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002904 target=00000000000000000000:00000000000000002343, shard=1 master=00000000000000000000:00000000000000006983 target=00000000000000000000:00000000000000006142, shard=2 master=00000000000000000000:00000000000000005858 target=00000000000000000000:00000000000000005018, shard=3 master=00000000000000000000:00000000000000003753 target=00000000000000000000:00000000000000002910 2024-04-16T18:07:23.832 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:23.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:23.833 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:23.892 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:23.892 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:23.972 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:23Z"} 2024-04-16T18:07:23.972 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:23Z"} 2024-04-16T18:07:23.973 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006142', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:37.732544Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005018', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:02:25.416474Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002910', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:40.373080Z'}}] 2024-04-16T18:07:23.973 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:23.973 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006142', 2: '00000000000000000000:00000000000000005018', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T18:07:23.973 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002904 target=00000000000000000000:00000000000000002343, shard=1 master=00000000000000000000:00000000000000006983 target=00000000000000000000:00000000000000006142, shard=2 master=00000000000000000000:00000000000000005858 target=00000000000000000000:00000000000000005018, shard=3 master=00000000000000000000:00000000000000003753 target=00000000000000000000:00000000000000002910 2024-04-16T18:07:28.973 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:28.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:28.974 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:29.030 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:29.030 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:29.114 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:29Z"} 2024-04-16T18:07:29.114 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:29Z"} 2024-04-16T18:07:29.114 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006142', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:37.732544Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005018', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:02:25.416474Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002910', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:40.373080Z'}}] 2024-04-16T18:07:29.114 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:29.114 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006142', 2: '00000000000000000000:00000000000000005018', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T18:07:29.115 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002904 target=00000000000000000000:00000000000000002343, shard=1 master=00000000000000000000:00000000000000006983 target=00000000000000000000:00000000000000006142, shard=2 master=00000000000000000000:00000000000000005858 target=00000000000000000000:00000000000000005018, shard=3 master=00000000000000000000:00000000000000003753 target=00000000000000000000:00000000000000002910 2024-04-16T18:07:34.115 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:34.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:34.116 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:34.172 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:34.173 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:34.251 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:34Z"} 2024-04-16T18:07:34.251 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002343","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:52:44.923035Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006142","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:37.732544Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005018","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:02:25.416474Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002910","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:58:40.373080Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:34Z"} 2024-04-16T18:07:34.251 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002343', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:52:44.923035Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006142', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:37.732544Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005018', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:02:25.416474Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002910', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:58:40.373080Z'}}] 2024-04-16T18:07:34.251 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:34.251 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002343', 1: '00000000000000000000:00000000000000006142', 2: '00000000000000000000:00000000000000005018', 3: '00000000000000000000:00000000000000002910'} 2024-04-16T18:07:34.251 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000002904 target=00000000000000000000:00000000000000002343, shard=1 master=00000000000000000000:00000000000000006983 target=00000000000000000000:00000000000000006142, shard=2 master=00000000000000000000:00000000000000005858 target=00000000000000000000:00000000000000005018, shard=3 master=00000000000000000000:00000000000000003753 target=00000000000000000000:00000000000000002910 2024-04-16T18:07:39.252 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.253 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:39.310 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:39.310 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:39.388 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002904","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.132127Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006983","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.133573Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005858","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.134679Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003753","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.136053Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:39Z"} 2024-04-16T18:07:39.388 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000002904","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.132127Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006983","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.133573Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005858","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.134679Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003753","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.136053Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:07:39Z"} 2024-04-16T18:07:39.388 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000002904', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.132127Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006983', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.133573Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005858', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.134679Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003753', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.136053Z'}}] 2024-04-16T18:07:39.388 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:39.388 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000002904', 1: '00000000000000000000:00000000000000006983', 2: '00000000000000000000:00000000000000005858', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:39.389 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:07:39.389 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T18:07:39.389 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.389 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:39.436 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:39.436 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:39.513 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000003186","last_update":"2024-04-16T18:07:13.288123Z"},{"marker":"00000000000000000000:00000000000000006419","last_update":"2024-04-16T18:07:13.289423Z"},{"marker":"00000000000000000000:00000000000000005296","last_update":"2024-04-16T18:07:13.290728Z"},{"marker":"00000000000000000000:00000000000000003753","last_update":"2024-04-16T18:07:13.291900Z"}] 2024-04-16T18:07:39.514 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000003186', 1: '00000000000000000000:00000000000000006419', 2: '00000000000000000000:00000000000000005296', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:39.514 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:07:39.514 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.514 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:39.571 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:39.571 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:39.651 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003186","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:07:13.288123Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006419","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.289423Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005296","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.290728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003753","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.291900Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:07:39Z"} 2024-04-16T18:07:39.651 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003186","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:07:13.288123Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006419","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.289423Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005296","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.290728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003753","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.291900Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:07:39Z"} 2024-04-16T18:07:39.651 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003186', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.288123Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006419', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.289423Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005296', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.290728Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003753', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.291900Z'}}] 2024-04-16T18:07:39.652 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003186', 1: '00000000000000000000:00000000000000006419', 2: '00000000000000000000:00000000000000005296', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:39.652 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000003186', 1: '00000000000000000000:00000000000000006419', 2: '00000000000000000000:00000000000000005296', 3: '00000000000000000000:00000000000000003753'} 2024-04-16T18:07:39.652 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:07:39.652 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable ... ok 2024-04-16T18:07:39.654 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-38 2024-04-16T18:07:39.654 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:39.654 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:39.654 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.655 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:39.655 DEBUG:boto:Data: 2024-04-16T18:07:39.655 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.655 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.655 DEBUG:boto:Params: {} 2024-04-16T18:07:39.655 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:07:39.656 DEBUG:boto:Token: None 2024-04-16T18:07:39.656 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/ 2024-04-16T18:07:39.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:icptv0zswMk25ECTNq74OzQQSHM= 2024-04-16T18:07:39.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:icptv0zswMk25ECTNq74OzQQSHM=', 'Content-Length': '0'} 2024-04-16T18:07:39.675 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000001de44bf376dbef32-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.676 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-39 2024-04-16T18:07:39.676 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:39.676 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:39.676 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.676 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:39.676 DEBUG:boto:Data: 2024-04-16T18:07:39.676 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.676 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.676 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.676 DEBUG:boto:Params: {} 2024-04-16T18:07:39.677 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:07:39.677 DEBUG:boto:Token: None 2024-04-16T18:07:39.677 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/ 2024-04-16T18:07:39.677 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FWsrBshZWaLewGXhy84yCkaja6Q= 2024-04-16T18:07:39.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FWsrBshZWaLewGXhy84yCkaja6Q=', 'Content-Length': '0'} 2024-04-16T18:07:39.706 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000005115023d30393665-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.706 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:39.706 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:39.706 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.706 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:39.706 DEBUG:boto:Data: 2024-04-16T18:07:39.706 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.706 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.707 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.707 DEBUG:boto:Params: {} 2024-04-16T18:07:39.707 DEBUG:boto:Token: None 2024-04-16T18:07:39.707 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/ 2024-04-16T18:07:39.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ= 2024-04-16T18:07:39.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ=', 'Content-Length': '0'} 2024-04-16T18:07:39.709 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000008b3126aa6301cdb-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.709 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:39.709 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:39.709 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.710 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:07:39.710 DEBUG:boto:Data: 2024-04-16T18:07:39.710 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.710 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.710 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.710 DEBUG:boto:Params: {} 2024-04-16T18:07:39.710 DEBUG:boto:Token: None 2024-04-16T18:07:39.710 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/obj1 2024-04-16T18:07:39.710 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Z26wOXQVgaNKMCwwWD2pbboANA= 2024-04-16T18:07:39.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Z26wOXQVgaNKMCwwWD2pbboANA='} 2024-04-16T18:07:39.717 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002f0f166f52d83e4c-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.718 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:39.718 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:39.718 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.718 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:39.718 DEBUG:boto:Data: 2024-04-16T18:07:39.718 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.718 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.718 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.718 DEBUG:boto:Params: {} 2024-04-16T18:07:39.718 DEBUG:boto:Token: None 2024-04-16T18:07:39.719 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/ 2024-04-16T18:07:39.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ= 2024-04-16T18:07:39.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ=', 'Content-Length': '0'} 2024-04-16T18:07:39.721 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049ca869d776ed450-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.721 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:39.721 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:39.721 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.721 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:07:39.721 DEBUG:boto:Data: 2024-04-16T18:07:39.721 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.721 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.721 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.722 DEBUG:boto:Params: {} 2024-04-16T18:07:39.722 DEBUG:boto:Token: None 2024-04-16T18:07:39.722 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/obj2 2024-04-16T18:07:39.722 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vVtM0YJHdoCrs1vJcObk0UAzSrI= 2024-04-16T18:07:39.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vVtM0YJHdoCrs1vJcObk0UAzSrI='} 2024-04-16T18:07:39.727 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f6d79378aacb5b4f-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.727 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:39.727 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:39.727 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.728 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:39.728 DEBUG:boto:Data: 2024-04-16T18:07:39.728 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.728 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.728 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.728 DEBUG:boto:Params: {} 2024-04-16T18:07:39.728 DEBUG:boto:Token: None 2024-04-16T18:07:39.728 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/ 2024-04-16T18:07:39.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ= 2024-04-16T18:07:39.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ=', 'Content-Length': '0'} 2024-04-16T18:07:39.730 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004c6baa992f6cf035-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.730 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:39.731 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:39.731 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.731 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:07:39.731 DEBUG:boto:Data: 2024-04-16T18:07:39.731 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.731 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.731 DEBUG:boto:Params: {} 2024-04-16T18:07:39.731 DEBUG:boto:Token: None 2024-04-16T18:07:39.731 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/obj3 2024-04-16T18:07:39.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hyks2epg+EIZqeGt4PnLJubi4ik= 2024-04-16T18:07:39.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hyks2epg+EIZqeGt4PnLJubi4ik='} 2024-04-16T18:07:39.774 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000069d3fbbf111b3701-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.775 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:39.775 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:39.775 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.775 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:39.775 DEBUG:boto:Data: 2024-04-16T18:07:39.775 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.775 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.775 DEBUG:boto:Params: {} 2024-04-16T18:07:39.775 DEBUG:boto:Token: None 2024-04-16T18:07:39.775 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/ 2024-04-16T18:07:39.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ= 2024-04-16T18:07:39.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l8JFVYXbI9h/JrFQmHWfIzscHyQ=', 'Content-Length': '0'} 2024-04-16T18:07:39.777 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007811f959e7cce56b-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.777 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:39.778 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:39.778 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.778 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:07:39.778 DEBUG:boto:Data: 2024-04-16T18:07:39.778 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.778 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:39.778 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.778 DEBUG:boto:Params: {} 2024-04-16T18:07:39.778 DEBUG:boto:Token: None 2024-04-16T18:07:39.778 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-38/obj4 2024-04-16T18:07:39.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AKxl9LYx9OtkBWm/Y5w9fcfQGoE= 2024-04-16T18:07:39.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AKxl9LYx9OtkBWm/Y5w9fcfQGoE='} 2024-04-16T18:07:39.783 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008803a48e2e44921a-00661ebe6b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.783 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:39.783 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:39.784 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.784 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:39.784 DEBUG:boto:Data: 2024-04-16T18:07:39.784 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.784 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.784 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.784 DEBUG:boto:Params: {} 2024-04-16T18:07:39.784 DEBUG:boto:Token: None 2024-04-16T18:07:39.784 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/ 2024-04-16T18:07:39.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA= 2024-04-16T18:07:39.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA=', 'Content-Length': '0'} 2024-04-16T18:07:39.786 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000094715f536c8fac71-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.787 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:39.787 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:39.787 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.787 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:07:39.787 DEBUG:boto:Data: 2024-04-16T18:07:39.787 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.787 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.787 DEBUG:boto:Params: {} 2024-04-16T18:07:39.788 DEBUG:boto:Token: None 2024-04-16T18:07:39.788 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/obj1 2024-04-16T18:07:39.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ed7qN3JgdLIcFr5/aKv+jKyn6IU= 2024-04-16T18:07:39.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ed7qN3JgdLIcFr5/aKv+jKyn6IU='} 2024-04-16T18:07:39.795 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000bcdb333ac297524-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.795 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:39.795 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:39.795 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.795 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:39.795 DEBUG:boto:Data: 2024-04-16T18:07:39.795 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.795 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.795 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.796 DEBUG:boto:Params: {} 2024-04-16T18:07:39.796 DEBUG:boto:Token: None 2024-04-16T18:07:39.796 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/ 2024-04-16T18:07:39.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA= 2024-04-16T18:07:39.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA=', 'Content-Length': '0'} 2024-04-16T18:07:39.798 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ee47ac050dc20efe-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.798 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:39.798 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:39.798 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.799 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:07:39.799 DEBUG:boto:Data: 2024-04-16T18:07:39.799 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.799 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.799 DEBUG:boto:Params: {} 2024-04-16T18:07:39.799 DEBUG:boto:Token: None 2024-04-16T18:07:39.799 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/obj2 2024-04-16T18:07:39.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:au99r3dV9GLvK6OiXZpmYvqSNwo= 2024-04-16T18:07:39.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:au99r3dV9GLvK6OiXZpmYvqSNwo='} 2024-04-16T18:07:39.804 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001cd2ab69229ce836-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.805 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:39.805 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:39.805 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.805 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:39.805 DEBUG:boto:Data: 2024-04-16T18:07:39.805 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.805 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.805 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.805 DEBUG:boto:Params: {} 2024-04-16T18:07:39.805 DEBUG:boto:Token: None 2024-04-16T18:07:39.805 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/ 2024-04-16T18:07:39.806 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA= 2024-04-16T18:07:39.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA=', 'Content-Length': '0'} 2024-04-16T18:07:39.807 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eb6a9a8c19ea1414-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.808 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:39.808 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:39.808 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.808 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:07:39.808 DEBUG:boto:Data: 2024-04-16T18:07:39.808 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.808 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.808 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.808 DEBUG:boto:Params: {} 2024-04-16T18:07:39.808 DEBUG:boto:Token: None 2024-04-16T18:07:39.808 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/obj3 2024-04-16T18:07:39.809 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MCuaXEqshcdw4hmj4Z6AOO5kl8g= 2024-04-16T18:07:39.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MCuaXEqshcdw4hmj4Z6AOO5kl8g='} 2024-04-16T18:07:39.850 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cf28e3ab4e55f70e-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.851 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:39.851 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:39.851 DEBUG:boto:Method: HEAD 2024-04-16T18:07:39.851 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:39.851 DEBUG:boto:Data: 2024-04-16T18:07:39.851 DEBUG:boto:Headers: {} 2024-04-16T18:07:39.851 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.851 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.851 DEBUG:boto:Params: {} 2024-04-16T18:07:39.851 DEBUG:boto:Token: None 2024-04-16T18:07:39.852 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/ 2024-04-16T18:07:39.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA= 2024-04-16T18:07:39.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XVNjGcLbf2UCCQzAeyMzwsH1bCA=', 'Content-Length': '0'} 2024-04-16T18:07:39.854 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000057fd1f53f6346b21-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.854 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:39.854 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:39.854 DEBUG:boto:Method: PUT 2024-04-16T18:07:39.854 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:07:39.854 DEBUG:boto:Data: 2024-04-16T18:07:39.854 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:39.855 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:39.855 DEBUG:boto:Port: 8000 2024-04-16T18:07:39.855 DEBUG:boto:Params: {} 2024-04-16T18:07:39.855 DEBUG:boto:Token: None 2024-04-16T18:07:39.855 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:39 GMT /cjqttm-39/obj4 2024-04-16T18:07:39.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IhaLhdVyoEsMQ9egNWRPqy6F8rM= 2024-04-16T18:07:39.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IhaLhdVyoEsMQ9egNWRPqy6F8rM='} 2024-04-16T18:07:39.860 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b4ef8d26e27c890e-00661ebe6b-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:39.860 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.861 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:39.907 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:39.907 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:39.961 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:07:39.983 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290859.696474_511.1","last_update":"2024-04-16T18:07:39.696474Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:07:39.983 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290859.696474_511.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:39.983 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:07:39.983 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:39.983 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:40.031 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:40.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:40.085+0000 7fb9d4211800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:40.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:40.086+0000 7fb9d4211800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:40.104 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290859.669088_504.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:39.669088Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:40Z"} 2024-04-16T18:07:40.104 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290859.669088_504.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:39.669088Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:40Z"} 2024-04-16T18:07:40.105 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290859.669088_504.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:39.669088Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:07:40.105 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290859.696474_511.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:40.105 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290859.669088_504.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:40.105 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290859.696474_511.1 target=1_1713290859.669088_504.1 2024-04-16T18:07:45.105 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:45.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:07:45.106 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:07:45.161 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:45.161 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:45.216 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:45.217+0000 7f8de46c0800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:45.217 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:45.218+0000 7f8de46c0800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:07:45.239 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290859.696474_511.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:39.696474Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:45Z"} 2024-04-16T18:07:45.239 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290859.696474_511.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:39.696474Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:07:45Z"} 2024-04-16T18:07:45.240 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290859.696474_511.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:39.696474Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:07:45.240 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290859.696474_511.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:45.240 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290859.696474_511.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:07:45.240 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:07:45.240 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-38 2024-04-16T18:07:45.240 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:45.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:45.241 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-38 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:07:45.296 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:45.296 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:45.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:45.354+0000 7f1945824800 1 bucket sync caught up with source: 2024-04-16T18:07:45.352 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.27.6, , 00000000001.34.6, , 00000000001.29.6, , , 00000000001.21.6, , , ] 2024-04-16T18:07:45.353 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.27.6, , 00000000001.34.6, , 00000000001.29.6, , , 00000000001.21.6, , , ] 2024-04-16T18:07:45.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:45.354+0000 7f1945824800 0 bucket checkpoint complete 2024-04-16T18:07:45.372 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-38 2024-04-16T18:07:45.373 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:45.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:45.373 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-38 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:07:45.435 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:45.435 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:45.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:07:45.498+0000 7f1a27133800 1 bucket sync caught up with source: 2024-04-16T18:07:45.497 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.260.6, , 00000000001.190.6, , 00000000001.392.6, , , 00000000001.204.6, , , ] 2024-04-16T18:07:45.497 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000001.260.6, , 00000000001.190.6, , 00000000001.392.6, , , 00000000001.204.6, , , ] 2024-04-16T18:07:45.497 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:07:45.498+0000 7f1a27133800 0 bucket checkpoint complete 2024-04-16T18:07:45.519 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-38 zones={test-zone2, test-zone1} 2024-04-16T18:07:45.519 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.519 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.519 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.519 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:45.519 DEBUG:boto:Data: 2024-04-16T18:07:45.520 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.520 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.520 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.520 DEBUG:boto:Params: {} 2024-04-16T18:07:45.520 DEBUG:boto:Token: None 2024-04-16T18:07:45.520 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nyB58sLYMoqFuYbYatGXHKO5590= 2024-04-16T18:07:45.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nyB58sLYMoqFuYbYatGXHKO5590=', 'Content-Length': '0'} 2024-04-16T18:07:45.523 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009e324bbc774dc7cc-00661ebe71-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.523 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.523 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.523 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.523 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:45.524 DEBUG:boto:Data: 2024-04-16T18:07:45.524 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.524 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.524 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.524 DEBUG:boto:Params: {} 2024-04-16T18:07:45.524 DEBUG:boto:Token: None 2024-04-16T18:07:45.524 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nyB58sLYMoqFuYbYatGXHKO5590= 2024-04-16T18:07:45.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nyB58sLYMoqFuYbYatGXHKO5590=', 'Content-Length': '0'} 2024-04-16T18:07:45.527 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005908bf7a36846ad5-00661ebe71-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.527 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:07:45.527 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.527 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.527 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.527 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.528 DEBUG:boto:Method: GET 2024-04-16T18:07:45.528 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.528 DEBUG:boto:Data: 2024-04-16T18:07:45.528 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.528 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.528 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.528 DEBUG:boto:Params: {} 2024-04-16T18:07:45.528 DEBUG:boto:Token: None 2024-04-16T18:07:45.528 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/?versions 2024-04-16T18:07:45.529 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU= 2024-04-16T18:07:45.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU=', 'Content-Length': '0'} 2024-04-16T18:07:45.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7ea2223f92a1ad6-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.531 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.532 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:07:45.532 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:07:45.533 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:07:45.533 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:07:45.533 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:07:45.533 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.533 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.533 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.533 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.533 DEBUG:boto:Method: GET 2024-04-16T18:07:45.534 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.534 DEBUG:boto:Data: 2024-04-16T18:07:45.534 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.534 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.534 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.534 DEBUG:boto:Params: {} 2024-04-16T18:07:45.534 DEBUG:boto:Token: None 2024-04-16T18:07:45.534 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/?versions 2024-04-16T18:07:45.534 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU= 2024-04-16T18:07:45.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU=', 'Content-Length': '0'} 2024-04-16T18:07:45.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029586e4e34027a40-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.537 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.537 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:07:45.538 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:07:45.538 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:07:45.538 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:07:45.538 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.538 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.538 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.538 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.538 DEBUG:boto:Method: GET 2024-04-16T18:07:45.538 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.539 DEBUG:boto:Data: 2024-04-16T18:07:45.539 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.539 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.539 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.539 DEBUG:boto:Params: {} 2024-04-16T18:07:45.539 DEBUG:boto:Token: None 2024-04-16T18:07:45.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/?versions 2024-04-16T18:07:45.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU= 2024-04-16T18:07:45.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU=', 'Content-Length': '0'} 2024-04-16T18:07:45.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066f686fd6a586fa2-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.542 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.542 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.543 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.543 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.543 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.543 DEBUG:boto:Method: GET 2024-04-16T18:07:45.543 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:07:45.543 DEBUG:boto:Data: 2024-04-16T18:07:45.543 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.544 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.544 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.544 DEBUG:boto:Params: {} 2024-04-16T18:07:45.544 DEBUG:boto:Token: None 2024-04-16T18:07:45.544 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/?versions 2024-04-16T18:07:45.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU= 2024-04-16T18:07:45.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GKSPmYc7WifCKIRgUfwTvHFU7JU=', 'Content-Length': '0'} 2024-04-16T18:07:45.546 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbbd1fe90c02421c-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.546 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.547 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:07:45.547 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.547 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.547 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.547 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.548 DEBUG:boto:Method: GET 2024-04-16T18:07:45.548 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.548 DEBUG:boto:Data: 2024-04-16T18:07:45.548 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.548 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.548 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.548 DEBUG:boto:Params: {} 2024-04-16T18:07:45.548 DEBUG:boto:Token: None 2024-04-16T18:07:45.549 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.549 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU= 2024-04-16T18:07:45.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU=', 'Content-Length': '0'} 2024-04-16T18:07:45.551 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006e180a65a046ab02-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.594 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.594 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.595 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.595 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.595 DEBUG:boto:Method: GET 2024-04-16T18:07:45.595 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.595 DEBUG:boto:Data: 2024-04-16T18:07:45.595 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.595 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.595 DEBUG:boto:Params: {} 2024-04-16T18:07:45.596 DEBUG:boto:Token: None 2024-04-16T18:07:45.596 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU= 2024-04-16T18:07:45.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU=', 'Content-Length': '0'} 2024-04-16T18:07:45.598 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f08b3661c515a733-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.598 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.598 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.598 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.598 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.599 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.599 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.599 DEBUG:boto:Data: 2024-04-16T18:07:45.599 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.599 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.599 DEBUG:boto:Params: {} 2024-04-16T18:07:45.599 DEBUG:boto:Token: None 2024-04-16T18:07:45.599 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sdCY2QRRkYMKWFbHcP21LJwDuLI= 2024-04-16T18:07:45.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sdCY2QRRkYMKWFbHcP21LJwDuLI=', 'Content-Length': '0'} 2024-04-16T18:07:45.601 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000b60c214cd48e4be-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.602 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.602 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.602 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.602 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.602 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.602 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.602 DEBUG:boto:Data: 2024-04-16T18:07:45.602 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.603 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.603 DEBUG:boto:Params: {} 2024-04-16T18:07:45.603 DEBUG:boto:Token: None 2024-04-16T18:07:45.603 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sdCY2QRRkYMKWFbHcP21LJwDuLI= 2024-04-16T18:07:45.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sdCY2QRRkYMKWFbHcP21LJwDuLI=', 'Content-Length': '0'} 2024-04-16T18:07:45.605 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e0b02d429a19d554-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:07:45.605 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.605 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.605 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.606 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.606 DEBUG:boto:Method: GET 2024-04-16T18:07:45.606 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.606 DEBUG:boto:Data: 2024-04-16T18:07:45.606 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.606 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.606 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.606 DEBUG:boto:Params: {} 2024-04-16T18:07:45.606 DEBUG:boto:Token: None 2024-04-16T18:07:45.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU= 2024-04-16T18:07:45.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU=', 'Content-Length': '0'} 2024-04-16T18:07:45.608 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000824dd2fd7d7906fa-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.609 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.609 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.609 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.609 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.609 DEBUG:boto:Method: GET 2024-04-16T18:07:45.609 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.609 DEBUG:boto:Data: 2024-04-16T18:07:45.610 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.610 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.610 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.610 DEBUG:boto:Params: {} 2024-04-16T18:07:45.610 DEBUG:boto:Token: None 2024-04-16T18:07:45.610 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:07:45.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU= 2024-04-16T18:07:45.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:39WEdGsuDxMhRT6A1CZNPK5fsHU=', 'Content-Length': '0'} 2024-04-16T18:07:45.612 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e4a4d4baf084ebb8-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.612 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.613 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.613 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.613 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.613 DEBUG:boto:Method: GET 2024-04-16T18:07:45.613 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.613 DEBUG:boto:Data: 2024-04-16T18:07:45.613 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.613 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.614 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.614 DEBUG:boto:Params: {} 2024-04-16T18:07:45.614 DEBUG:boto:Token: None 2024-04-16T18:07:45.614 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.614 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.616 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002fe2e6587376937f-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.616 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.617 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.617 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.617 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.617 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.617 DEBUG:boto:Method: GET 2024-04-16T18:07:45.617 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.617 DEBUG:boto:Data: 2024-04-16T18:07:45.618 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.618 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.618 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.618 DEBUG:boto:Params: {} 2024-04-16T18:07:45.618 DEBUG:boto:Token: None 2024-04-16T18:07:45.618 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.618 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.620 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a80f4c4fe87bb8b3-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.621 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.621 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.621 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.621 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.621 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:07:45.621 DEBUG:boto:Data: 2024-04-16T18:07:45.622 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.622 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.622 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.622 DEBUG:boto:Params: {} 2024-04-16T18:07:45.622 DEBUG:boto:Token: None 2024-04-16T18:07:45.622 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1 2024-04-16T18:07:45.622 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dGpZeY7+sIha277XZBwVpbwxUxg= 2024-04-16T18:07:45.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dGpZeY7+sIha277XZBwVpbwxUxg=', 'Content-Length': '0'} 2024-04-16T18:07:45.624 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e9d319fb9d54f72d-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.624 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.624 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.625 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.625 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:07:45.625 DEBUG:boto:Data: 2024-04-16T18:07:45.625 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.625 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.625 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.625 DEBUG:boto:Params: {} 2024-04-16T18:07:45.625 DEBUG:boto:Token: None 2024-04-16T18:07:45.626 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1 2024-04-16T18:07:45.626 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dGpZeY7+sIha277XZBwVpbwxUxg= 2024-04-16T18:07:45.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dGpZeY7+sIha277XZBwVpbwxUxg=', 'Content-Length': '0'} 2024-04-16T18:07:45.627 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009258f9235537906b-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.628 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:07:45.628 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.628 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.628 DEBUG:boto:Method: GET 2024-04-16T18:07:45.628 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:07:45.628 DEBUG:boto:Data: 2024-04-16T18:07:45.628 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.628 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.629 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.629 DEBUG:boto:Params: {} 2024-04-16T18:07:45.629 DEBUG:boto:Token: None 2024-04-16T18:07:45.629 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1 2024-04-16T18:07:45.629 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lR9LPwTfV+c9h266jFK1/ZFhJ40= 2024-04-16T18:07:45.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lR9LPwTfV+c9h266jFK1/ZFhJ40=', 'Content-Length': '0'} 2024-04-16T18:07:45.631 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d09e5696d417b320-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.678 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:07:45.679 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:07:45.679 DEBUG:boto:Method: GET 2024-04-16T18:07:45.679 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:07:45.679 DEBUG:boto:Data: 2024-04-16T18:07:45.679 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.679 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.679 DEBUG:boto:Params: {} 2024-04-16T18:07:45.680 DEBUG:boto:Token: None 2024-04-16T18:07:45.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj1 2024-04-16T18:07:45.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lR9LPwTfV+c9h266jFK1/ZFhJ40= 2024-04-16T18:07:45.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lR9LPwTfV+c9h266jFK1/ZFhJ40=', 'Content-Length': '0'} 2024-04-16T18:07:45.682 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8febfee55de57fb-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.682 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.682 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.682 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.683 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.683 DEBUG:boto:Method: GET 2024-04-16T18:07:45.683 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.683 DEBUG:boto:Data: 2024-04-16T18:07:45.683 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.683 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.683 DEBUG:boto:Params: {} 2024-04-16T18:07:45.683 DEBUG:boto:Token: None 2024-04-16T18:07:45.685 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.685 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.688 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f9ac168b3b5b9f4-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.688 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.689 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.689 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.689 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.689 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.689 DEBUG:boto:Method: GET 2024-04-16T18:07:45.689 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:07:45.690 DEBUG:boto:Data: 2024-04-16T18:07:45.690 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.690 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.690 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.690 DEBUG:boto:Params: {} 2024-04-16T18:07:45.690 DEBUG:boto:Token: None 2024-04-16T18:07:45.690 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000417ee6575e8e63ec-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.693 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.693 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:07:45.693 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.693 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.693 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.694 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.694 DEBUG:boto:Method: GET 2024-04-16T18:07:45.694 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.694 DEBUG:boto:Data: 2024-04-16T18:07:45.694 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.694 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.694 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.694 DEBUG:boto:Params: {} 2024-04-16T18:07:45.695 DEBUG:boto:Token: None 2024-04-16T18:07:45.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE= 2024-04-16T18:07:45.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE=', 'Content-Length': '0'} 2024-04-16T18:07:45.697 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007ad3f59ff7f7a67b-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.739 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.739 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.739 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.739 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.739 DEBUG:boto:Method: GET 2024-04-16T18:07:45.739 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.739 DEBUG:boto:Data: 2024-04-16T18:07:45.739 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.740 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.740 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.740 DEBUG:boto:Params: {} 2024-04-16T18:07:45.740 DEBUG:boto:Token: None 2024-04-16T18:07:45.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE= 2024-04-16T18:07:45.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE=', 'Content-Length': '0'} 2024-04-16T18:07:45.742 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a46933175b903f7a-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.742 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.742 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.743 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.743 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.743 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.743 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.743 DEBUG:boto:Data: 2024-04-16T18:07:45.743 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.743 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.743 DEBUG:boto:Params: {} 2024-04-16T18:07:45.744 DEBUG:boto:Token: None 2024-04-16T18:07:45.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TlRLCjX0f/95xRlgX3fhU3hs/yI= 2024-04-16T18:07:45.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TlRLCjX0f/95xRlgX3fhU3hs/yI=', 'Content-Length': '0'} 2024-04-16T18:07:45.746 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000513bbb0d0bfd12ad-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.746 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.746 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.746 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.746 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.747 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.747 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.747 DEBUG:boto:Data: 2024-04-16T18:07:45.747 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.747 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.747 DEBUG:boto:Params: {} 2024-04-16T18:07:45.747 DEBUG:boto:Token: None 2024-04-16T18:07:45.747 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TlRLCjX0f/95xRlgX3fhU3hs/yI= 2024-04-16T18:07:45.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TlRLCjX0f/95xRlgX3fhU3hs/yI=', 'Content-Length': '0'} 2024-04-16T18:07:45.749 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000827cd8731adbbba1-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.749 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:07:45.750 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.750 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.750 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.750 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.750 DEBUG:boto:Method: GET 2024-04-16T18:07:45.750 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.750 DEBUG:boto:Data: 2024-04-16T18:07:45.750 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.750 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.751 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.751 DEBUG:boto:Params: {} 2024-04-16T18:07:45.751 DEBUG:boto:Token: None 2024-04-16T18:07:45.751 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE= 2024-04-16T18:07:45.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE=', 'Content-Length': '0'} 2024-04-16T18:07:45.753 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004b33fbccd6e203fe-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.794 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.795 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.795 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.795 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.795 DEBUG:boto:Method: GET 2024-04-16T18:07:45.795 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.795 DEBUG:boto:Data: 2024-04-16T18:07:45.795 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.795 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.795 DEBUG:boto:Params: {} 2024-04-16T18:07:45.796 DEBUG:boto:Token: None 2024-04-16T18:07:45.796 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:07:45.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE= 2024-04-16T18:07:45.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h9yInBwR3gDR28jP374Y4bmCGmE=', 'Content-Length': '0'} 2024-04-16T18:07:45.798 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000746ceae663b199cb-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.798 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.798 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.798 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.798 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.799 DEBUG:boto:Method: GET 2024-04-16T18:07:45.799 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.799 DEBUG:boto:Data: 2024-04-16T18:07:45.799 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.799 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.799 DEBUG:boto:Params: {} 2024-04-16T18:07:45.799 DEBUG:boto:Token: None 2024-04-16T18:07:45.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b40fa1e40c5f3dca-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.802 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.803 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.803 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.803 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.803 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.803 DEBUG:boto:Method: GET 2024-04-16T18:07:45.803 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.803 DEBUG:boto:Data: 2024-04-16T18:07:45.804 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.804 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.804 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.804 DEBUG:boto:Params: {} 2024-04-16T18:07:45.804 DEBUG:boto:Token: None 2024-04-16T18:07:45.804 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f5a513f47b06342-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.807 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.807 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.807 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.807 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.807 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:07:45.807 DEBUG:boto:Data: 2024-04-16T18:07:45.808 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.808 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.808 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.808 DEBUG:boto:Params: {} 2024-04-16T18:07:45.808 DEBUG:boto:Token: None 2024-04-16T18:07:45.808 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2 2024-04-16T18:07:45.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qXMPnwFOasyuRbvKtD2tOmou0yU= 2024-04-16T18:07:45.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qXMPnwFOasyuRbvKtD2tOmou0yU=', 'Content-Length': '0'} 2024-04-16T18:07:45.810 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002ca203c2cec29072-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.810 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.810 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.811 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.811 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:07:45.811 DEBUG:boto:Data: 2024-04-16T18:07:45.811 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.811 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.811 DEBUG:boto:Params: {} 2024-04-16T18:07:45.811 DEBUG:boto:Token: None 2024-04-16T18:07:45.811 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2 2024-04-16T18:07:45.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qXMPnwFOasyuRbvKtD2tOmou0yU= 2024-04-16T18:07:45.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qXMPnwFOasyuRbvKtD2tOmou0yU=', 'Content-Length': '0'} 2024-04-16T18:07:45.813 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006ca7b23838ade3e1-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:07:45.813 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.814 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.814 DEBUG:boto:Method: GET 2024-04-16T18:07:45.814 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:07:45.814 DEBUG:boto:Data: 2024-04-16T18:07:45.814 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.814 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.814 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.814 DEBUG:boto:Params: {} 2024-04-16T18:07:45.814 DEBUG:boto:Token: None 2024-04-16T18:07:45.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2 2024-04-16T18:07:45.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6dH6ZFrw4AGzN7y19J3cfnpQQhM= 2024-04-16T18:07:45.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6dH6ZFrw4AGzN7y19J3cfnpQQhM=', 'Content-Length': '0'} 2024-04-16T18:07:45.817 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000037edb214ccd6f5bc-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.858 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:07:45.859 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:07:45.859 DEBUG:boto:Method: GET 2024-04-16T18:07:45.859 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:07:45.859 DEBUG:boto:Data: 2024-04-16T18:07:45.859 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.859 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.859 DEBUG:boto:Params: {} 2024-04-16T18:07:45.859 DEBUG:boto:Token: None 2024-04-16T18:07:45.859 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj2 2024-04-16T18:07:45.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6dH6ZFrw4AGzN7y19J3cfnpQQhM= 2024-04-16T18:07:45.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6dH6ZFrw4AGzN7y19J3cfnpQQhM=', 'Content-Length': '0'} 2024-04-16T18:07:45.861 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000370f31fcb0faac8-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.862 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.862 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.862 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.862 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.862 DEBUG:boto:Method: GET 2024-04-16T18:07:45.862 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.863 DEBUG:boto:Data: 2024-04-16T18:07:45.863 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.863 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.863 DEBUG:boto:Params: {} 2024-04-16T18:07:45.863 DEBUG:boto:Token: None 2024-04-16T18:07:45.863 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1e51025c37d32b6-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.866 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.866 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.866 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.867 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.867 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.867 DEBUG:boto:Method: GET 2024-04-16T18:07:45.867 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:07:45.867 DEBUG:boto:Data: 2024-04-16T18:07:45.867 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.867 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.867 DEBUG:boto:Params: {} 2024-04-16T18:07:45.867 DEBUG:boto:Token: None 2024-04-16T18:07:45.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037ad153329e237cb-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.870 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:45.871 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:07:45.871 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:45.871 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:45.871 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.871 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.871 DEBUG:boto:Method: GET 2024-04-16T18:07:45.871 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.871 DEBUG:boto:Data: 2024-04-16T18:07:45.872 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.872 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.872 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.872 DEBUG:boto:Params: {} 2024-04-16T18:07:45.872 DEBUG:boto:Token: None 2024-04-16T18:07:45.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k= 2024-04-16T18:07:45.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k=', 'Content-Length': '0'} 2024-04-16T18:07:45.874 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a7a959e11ff4d734-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.914 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:45.914 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:45.915 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.915 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.915 DEBUG:boto:Method: GET 2024-04-16T18:07:45.915 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.915 DEBUG:boto:Data: 2024-04-16T18:07:45.915 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.915 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.915 DEBUG:boto:Params: {} 2024-04-16T18:07:45.916 DEBUG:boto:Token: None 2024-04-16T18:07:45.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k= 2024-04-16T18:07:45.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k=', 'Content-Length': '0'} 2024-04-16T18:07:45.918 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000095940f328095a111-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.918 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:45.918 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:45.918 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.918 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.919 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.919 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.919 DEBUG:boto:Data: 2024-04-16T18:07:45.919 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.919 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.919 DEBUG:boto:Params: {} 2024-04-16T18:07:45.919 DEBUG:boto:Token: None 2024-04-16T18:07:45.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8uOYID63Dl5vX1Ywe5k0j2fg1y4= 2024-04-16T18:07:45.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8uOYID63Dl5vX1Ywe5k0j2fg1y4=', 'Content-Length': '0'} 2024-04-16T18:07:45.922 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004cce5bcf4ca2cc36-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.922 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:45.922 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:45.922 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.922 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.922 DEBUG:boto:Method: HEAD 2024-04-16T18:07:45.923 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.923 DEBUG:boto:Data: 2024-04-16T18:07:45.923 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.923 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.923 DEBUG:boto:Params: {} 2024-04-16T18:07:45.923 DEBUG:boto:Token: None 2024-04-16T18:07:45.923 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8uOYID63Dl5vX1Ywe5k0j2fg1y4= 2024-04-16T18:07:45.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8uOYID63Dl5vX1Ywe5k0j2fg1y4=', 'Content-Length': '0'} 2024-04-16T18:07:45.925 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d260be7c51742dc5-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.925 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:07:45.926 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:45.926 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:45.926 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.926 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.926 DEBUG:boto:Method: GET 2024-04-16T18:07:45.926 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.926 DEBUG:boto:Data: 2024-04-16T18:07:45.926 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.926 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.927 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.927 DEBUG:boto:Params: {} 2024-04-16T18:07:45.927 DEBUG:boto:Token: None 2024-04-16T18:07:45.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k= 2024-04-16T18:07:45.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k=', 'Content-Length': '0'} 2024-04-16T18:07:45.929 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000f93721a7402dcc9-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.971 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:45.971 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:45.971 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.971 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.971 DEBUG:boto:Method: GET 2024-04-16T18:07:45.971 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.971 DEBUG:boto:Data: 2024-04-16T18:07:45.971 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:45.972 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.972 DEBUG:boto:Params: {} 2024-04-16T18:07:45.972 DEBUG:boto:Token: None 2024-04-16T18:07:45.972 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:07:45.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k= 2024-04-16T18:07:45.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jNd1YwyWoXTqu4jrfiJrztipV9k=', 'Content-Length': '0'} 2024-04-16T18:07:45.974 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bd507780666c1c05-00661ebe71-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:45.974 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:45.974 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:45.975 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:45.975 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:45.975 DEBUG:boto:Method: GET 2024-04-16T18:07:45.975 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:07:45.975 DEBUG:boto:Data: 2024-04-16T18:07:45.975 DEBUG:boto:Headers: {} 2024-04-16T18:07:45.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:45.975 DEBUG:boto:Port: 8000 2024-04-16T18:07:45.975 DEBUG:boto:Params: {} 2024-04-16T18:07:45.975 DEBUG:boto:Token: None 2024-04-16T18:07:45.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:45 GMT /cjqttm-38/ 2024-04-16T18:07:45.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw= 2024-04-16T18:07:45.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qiiLM6vW3wgM3CTw/OQOPKzR6jw=', 'Content-Length': '0'} 2024-04-16T18:07:45.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ade54c209a529e1-00661ebe71-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.018 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.019 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:46.019 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:46.019 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.019 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.019 DEBUG:boto:Method: GET 2024-04-16T18:07:46.019 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.019 DEBUG:boto:Data: 2024-04-16T18:07:46.019 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.020 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.020 DEBUG:boto:Params: {} 2024-04-16T18:07:46.020 DEBUG:boto:Token: None 2024-04-16T18:07:46.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/ 2024-04-16T18:07:46.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q= 2024-04-16T18:07:46.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q=', 'Content-Length': '0'} 2024-04-16T18:07:46.022 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f25f375dc8dee5eb-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.023 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.023 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:46.023 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:46.023 DEBUG:boto:Method: HEAD 2024-04-16T18:07:46.023 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:07:46.023 DEBUG:boto:Data: 2024-04-16T18:07:46.024 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.024 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.024 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.024 DEBUG:boto:Params: {} 2024-04-16T18:07:46.024 DEBUG:boto:Token: None 2024-04-16T18:07:46.024 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj3 2024-04-16T18:07:46.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7GRibBWorf9FZ0wahdzdb6yzzm4= 2024-04-16T18:07:46.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7GRibBWorf9FZ0wahdzdb6yzzm4=', 'Content-Length': '0'} 2024-04-16T18:07:46.026 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d4c406a9d01d00b-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.026 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:46.026 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:46.027 DEBUG:boto:Method: HEAD 2024-04-16T18:07:46.027 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:07:46.027 DEBUG:boto:Data: 2024-04-16T18:07:46.027 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.027 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.027 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.027 DEBUG:boto:Params: {} 2024-04-16T18:07:46.027 DEBUG:boto:Token: None 2024-04-16T18:07:46.027 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj3 2024-04-16T18:07:46.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7GRibBWorf9FZ0wahdzdb6yzzm4= 2024-04-16T18:07:46.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7GRibBWorf9FZ0wahdzdb6yzzm4=', 'Content-Length': '0'} 2024-04-16T18:07:46.030 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a12b561dc39aaf88-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.030 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:07:46.030 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:46.030 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:46.030 DEBUG:boto:Method: GET 2024-04-16T18:07:46.031 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:07:46.031 DEBUG:boto:Data: 2024-04-16T18:07:46.031 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.031 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.031 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.031 DEBUG:boto:Params: {} 2024-04-16T18:07:46.031 DEBUG:boto:Token: None 2024-04-16T18:07:46.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj3 2024-04-16T18:07:46.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dzz2SAEzX3BL0LsQmxImbLTJIaM= 2024-04-16T18:07:46.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dzz2SAEzX3BL0LsQmxImbLTJIaM=', 'Content-Length': '0'} 2024-04-16T18:07:46.033 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007baee237be51d34c-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.074 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:07:46.075 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:07:46.075 DEBUG:boto:Method: GET 2024-04-16T18:07:46.075 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:07:46.075 DEBUG:boto:Data: 2024-04-16T18:07:46.075 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.075 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.075 DEBUG:boto:Params: {} 2024-04-16T18:07:46.075 DEBUG:boto:Token: None 2024-04-16T18:07:46.076 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj3 2024-04-16T18:07:46.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dzz2SAEzX3BL0LsQmxImbLTJIaM= 2024-04-16T18:07:46.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dzz2SAEzX3BL0LsQmxImbLTJIaM=', 'Content-Length': '0'} 2024-04-16T18:07:46.078 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000012e585a269bb1d81-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.079 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:46.079 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:46.079 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.079 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.079 DEBUG:boto:Method: GET 2024-04-16T18:07:46.079 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.079 DEBUG:boto:Data: 2024-04-16T18:07:46.079 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.079 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.079 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.079 DEBUG:boto:Params: {} 2024-04-16T18:07:46.080 DEBUG:boto:Token: None 2024-04-16T18:07:46.080 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/ 2024-04-16T18:07:46.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q= 2024-04-16T18:07:46.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q=', 'Content-Length': '0'} 2024-04-16T18:07:46.082 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052f09fbf9b4e8786-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.083 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.083 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:46.083 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:46.083 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.083 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.083 DEBUG:boto:Method: GET 2024-04-16T18:07:46.083 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:07:46.084 DEBUG:boto:Data: 2024-04-16T18:07:46.084 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.084 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.084 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.084 DEBUG:boto:Params: {} 2024-04-16T18:07:46.084 DEBUG:boto:Token: None 2024-04-16T18:07:46.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/ 2024-04-16T18:07:46.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q= 2024-04-16T18:07:46.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q=', 'Content-Length': '0'} 2024-04-16T18:07:46.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000cf07525c9745c42-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.087 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.087 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:07:46.087 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.087 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.087 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.088 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.088 DEBUG:boto:Method: GET 2024-04-16T18:07:46.088 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.088 DEBUG:boto:Data: 2024-04-16T18:07:46.088 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.088 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.088 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.088 DEBUG:boto:Params: {} 2024-04-16T18:07:46.088 DEBUG:boto:Token: None 2024-04-16T18:07:46.089 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.089 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU= 2024-04-16T18:07:46.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU=', 'Content-Length': '0'} 2024-04-16T18:07:46.091 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c206672ddca97328-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.134 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.135 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.135 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.135 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.135 DEBUG:boto:Method: GET 2024-04-16T18:07:46.135 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.135 DEBUG:boto:Data: 2024-04-16T18:07:46.135 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.135 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.135 DEBUG:boto:Params: {} 2024-04-16T18:07:46.136 DEBUG:boto:Token: None 2024-04-16T18:07:46.136 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU= 2024-04-16T18:07:46.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU=', 'Content-Length': '0'} 2024-04-16T18:07:46.138 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000927cdf933e837cf0-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.138 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.138 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.138 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.138 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.139 DEBUG:boto:Method: HEAD 2024-04-16T18:07:46.139 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.139 DEBUG:boto:Data: 2024-04-16T18:07:46.139 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.139 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.139 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.139 DEBUG:boto:Params: {} 2024-04-16T18:07:46.139 DEBUG:boto:Token: None 2024-04-16T18:07:46.139 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dONuuyMZfyslVw31aRfp+lbJJhk= 2024-04-16T18:07:46.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dONuuyMZfyslVw31aRfp+lbJJhk=', 'Content-Length': '0'} 2024-04-16T18:07:46.141 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cafb22ed2f7ac033-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.142 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.142 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.142 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.142 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.142 DEBUG:boto:Method: HEAD 2024-04-16T18:07:46.142 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.142 DEBUG:boto:Data: 2024-04-16T18:07:46.142 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.142 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.143 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.143 DEBUG:boto:Params: {} 2024-04-16T18:07:46.143 DEBUG:boto:Token: None 2024-04-16T18:07:46.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dONuuyMZfyslVw31aRfp+lbJJhk= 2024-04-16T18:07:46.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dONuuyMZfyslVw31aRfp+lbJJhk=', 'Content-Length': '0'} 2024-04-16T18:07:46.145 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000030cdd0d0ed5a04c5-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:07:46.146 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.146 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.146 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.146 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.146 DEBUG:boto:Method: GET 2024-04-16T18:07:46.146 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.146 DEBUG:boto:Data: 2024-04-16T18:07:46.146 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.146 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.146 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.147 DEBUG:boto:Params: {} 2024-04-16T18:07:46.147 DEBUG:boto:Token: None 2024-04-16T18:07:46.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU= 2024-04-16T18:07:46.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU=', 'Content-Length': '0'} 2024-04-16T18:07:46.149 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008ab5818a79c3ab5b-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.190 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.191 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.191 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.191 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.191 DEBUG:boto:Method: GET 2024-04-16T18:07:46.191 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.191 DEBUG:boto:Data: 2024-04-16T18:07:46.191 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.191 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.191 DEBUG:boto:Params: {} 2024-04-16T18:07:46.192 DEBUG:boto:Token: None 2024-04-16T18:07:46.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:07:46.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU= 2024-04-16T18:07:46.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cpceBB039S7GIdugVWe2K0UQqpU=', 'Content-Length': '0'} 2024-04-16T18:07:46.194 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000050cf92c5141c956e-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.194 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:46.194 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:46.194 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.195 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.195 DEBUG:boto:Method: GET 2024-04-16T18:07:46.195 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.195 DEBUG:boto:Data: 2024-04-16T18:07:46.195 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.195 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.195 DEBUG:boto:Params: {} 2024-04-16T18:07:46.195 DEBUG:boto:Token: None 2024-04-16T18:07:46.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/ 2024-04-16T18:07:46.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q= 2024-04-16T18:07:46.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q=', 'Content-Length': '0'} 2024-04-16T18:07:46.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054eb81510f41321d-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.199 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.199 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:46.199 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:46.199 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.199 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.199 DEBUG:boto:Method: GET 2024-04-16T18:07:46.199 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.200 DEBUG:boto:Data: 2024-04-16T18:07:46.200 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.200 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.200 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.200 DEBUG:boto:Params: {} 2024-04-16T18:07:46.200 DEBUG:boto:Token: None 2024-04-16T18:07:46.200 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/ 2024-04-16T18:07:46.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q= 2024-04-16T18:07:46.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q=', 'Content-Length': '0'} 2024-04-16T18:07:46.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2d93bd29c6b6b1c-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.203 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.203 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.203 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.203 DEBUG:boto:Method: HEAD 2024-04-16T18:07:46.203 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:07:46.204 DEBUG:boto:Data: 2024-04-16T18:07:46.204 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.204 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.204 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.204 DEBUG:boto:Params: {} 2024-04-16T18:07:46.204 DEBUG:boto:Token: None 2024-04-16T18:07:46.204 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4 2024-04-16T18:07:46.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wj4wjCYJqHgd1fXnic08sotMqrw= 2024-04-16T18:07:46.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wj4wjCYJqHgd1fXnic08sotMqrw=', 'Content-Length': '0'} 2024-04-16T18:07:46.206 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006f4dbe27f4c929f9-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.206 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.206 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.207 DEBUG:boto:Method: HEAD 2024-04-16T18:07:46.207 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:07:46.207 DEBUG:boto:Data: 2024-04-16T18:07:46.207 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.207 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.207 DEBUG:boto:Params: {} 2024-04-16T18:07:46.207 DEBUG:boto:Token: None 2024-04-16T18:07:46.207 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4 2024-04-16T18:07:46.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wj4wjCYJqHgd1fXnic08sotMqrw= 2024-04-16T18:07:46.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wj4wjCYJqHgd1fXnic08sotMqrw=', 'Content-Length': '0'} 2024-04-16T18:07:46.210 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e2844804ab1ad948-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:07:46.210 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.210 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.210 DEBUG:boto:Method: GET 2024-04-16T18:07:46.210 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:07:46.210 DEBUG:boto:Data: 2024-04-16T18:07:46.211 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.211 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.211 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.211 DEBUG:boto:Params: {} 2024-04-16T18:07:46.211 DEBUG:boto:Token: None 2024-04-16T18:07:46.211 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4 2024-04-16T18:07:46.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KTIDUeoZG1+/dA79//xAXLI3b2w= 2024-04-16T18:07:46.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KTIDUeoZG1+/dA79//xAXLI3b2w=', 'Content-Length': '0'} 2024-04-16T18:07:46.213 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a52698dd7d643f1e-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.254 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:07:46.255 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:07:46.255 DEBUG:boto:Method: GET 2024-04-16T18:07:46.255 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:07:46.255 DEBUG:boto:Data: 2024-04-16T18:07:46.255 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.255 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.255 DEBUG:boto:Params: {} 2024-04-16T18:07:46.255 DEBUG:boto:Token: None 2024-04-16T18:07:46.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/obj4 2024-04-16T18:07:46.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KTIDUeoZG1+/dA79//xAXLI3b2w= 2024-04-16T18:07:46.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KTIDUeoZG1+/dA79//xAXLI3b2w=', 'Content-Length': '0'} 2024-04-16T18:07:46.258 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cd92683a57ab73c3-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.258 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:46.258 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:46.259 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.259 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.259 DEBUG:boto:Method: GET 2024-04-16T18:07:46.259 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.259 DEBUG:boto:Data: 2024-04-16T18:07:46.259 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:46.259 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.259 DEBUG:boto:Params: {} 2024-04-16T18:07:46.259 DEBUG:boto:Token: None 2024-04-16T18:07:46.260 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/ 2024-04-16T18:07:46.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q= 2024-04-16T18:07:46.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q=', 'Content-Length': '0'} 2024-04-16T18:07:46.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000799bd3bb6465ebae-00661ebe72-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.262 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.263 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:46.263 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:46.263 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.263 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.263 DEBUG:boto:Method: GET 2024-04-16T18:07:46.263 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:07:46.263 DEBUG:boto:Data: 2024-04-16T18:07:46.263 DEBUG:boto:Headers: {} 2024-04-16T18:07:46.264 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:46.264 DEBUG:boto:Port: 8000 2024-04-16T18:07:46.264 DEBUG:boto:Params: {} 2024-04-16T18:07:46.264 DEBUG:boto:Token: None 2024-04-16T18:07:46.264 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:46 GMT /cjqttm-38/ 2024-04-16T18:07:46.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q= 2024-04-16T18:07:46.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyQ7mjyLZdbgee4yDzE4SFc+e+Q=', 'Content-Length': '0'} 2024-04-16T18:07:46.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000124a9772f50ff4a7-00661ebe72-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:46.267 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:46.267 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-38 zones={test-zone2, test-zone1} 2024-04-16T18:07:46.267 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-39 2024-04-16T18:07:46.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:46.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:46.268 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-39 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:07:46.323 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:46.324 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:46.380 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:46.382+0000 7fc2fd32c800 1 waiting to reach incremental sync.. 2024-04-16T18:07:51.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:51.384+0000 7fc2fd32c800 1 bucket sync caught up with source: 2024-04-16T18:07:51.383 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.36.6, , 00000000001.36.6, , 00000000001.31.6, , , 00000000001.113.6, , , ] 2024-04-16T18:07:51.383 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.36.6, , 00000000001.36.6, , 00000000001.31.6, , , 00000000001.113.6, , , ] 2024-04-16T18:07:51.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:51.384+0000 7fc2fd32c800 0 bucket checkpoint complete 2024-04-16T18:07:51.409 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-39 2024-04-16T18:07:51.409 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:51.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:51.409 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-39 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:07:51.472 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:51.472 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:51.535 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:07:51.537+0000 7fd591324800 1 bucket sync caught up with source: 2024-04-16T18:07:51.535 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.622.6, , 00000000001.188.6, , 00000000001.1201.6, , , 00000000001.465.6, , , ] 2024-04-16T18:07:51.535 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000001.622.6, , 00000000001.188.6, , 00000000001.1201.6, , , 00000000001.465.6, , , ] 2024-04-16T18:07:51.536 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:07:51.537+0000 7fd591324800 0 bucket checkpoint complete 2024-04-16T18:07:51.556 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-39 zones={test-zone2, test-zone1} 2024-04-16T18:07:51.557 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.557 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.557 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.557 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:51.557 DEBUG:boto:Data: 2024-04-16T18:07:51.557 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.557 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.557 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.558 DEBUG:boto:Params: {} 2024-04-16T18:07:51.558 DEBUG:boto:Token: None 2024-04-16T18:07:51.558 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DOLqYVrBbMLTHrjvmJtAldLhdV8= 2024-04-16T18:07:51.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DOLqYVrBbMLTHrjvmJtAldLhdV8=', 'Content-Length': '0'} 2024-04-16T18:07:51.561 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001d290894ed4119a1-00661ebe77-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.561 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.561 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.561 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.561 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:51.562 DEBUG:boto:Data: 2024-04-16T18:07:51.562 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.562 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.562 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.562 DEBUG:boto:Params: {} 2024-04-16T18:07:51.562 DEBUG:boto:Token: None 2024-04-16T18:07:51.562 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.562 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DOLqYVrBbMLTHrjvmJtAldLhdV8= 2024-04-16T18:07:51.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DOLqYVrBbMLTHrjvmJtAldLhdV8=', 'Content-Length': '0'} 2024-04-16T18:07:51.564 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009892ee4cca6cb14d-00661ebe77-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.565 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:07:51.565 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.565 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.565 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.565 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.565 DEBUG:boto:Method: GET 2024-04-16T18:07:51.565 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.565 DEBUG:boto:Data: 2024-04-16T18:07:51.566 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.566 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.566 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.566 DEBUG:boto:Params: {} 2024-04-16T18:07:51.566 DEBUG:boto:Token: None 2024-04-16T18:07:51.566 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/?versions 2024-04-16T18:07:51.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc= 2024-04-16T18:07:51.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc=', 'Content-Length': '0'} 2024-04-16T18:07:51.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a5e04551b661272-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.569 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.570 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:07:51.570 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:07:51.570 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:07:51.570 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:07:51.570 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:07:51.570 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.570 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.571 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.571 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.571 DEBUG:boto:Method: GET 2024-04-16T18:07:51.571 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.571 DEBUG:boto:Data: 2024-04-16T18:07:51.571 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.571 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.571 DEBUG:boto:Params: {} 2024-04-16T18:07:51.571 DEBUG:boto:Token: None 2024-04-16T18:07:51.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/?versions 2024-04-16T18:07:51.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc= 2024-04-16T18:07:51.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc=', 'Content-Length': '0'} 2024-04-16T18:07:51.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f16c01d78e2d9890-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.574 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.574 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:07:51.575 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:07:51.575 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:07:51.575 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:07:51.575 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.575 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.575 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.575 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.575 DEBUG:boto:Method: GET 2024-04-16T18:07:51.575 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.575 DEBUG:boto:Data: 2024-04-16T18:07:51.575 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.576 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.576 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.576 DEBUG:boto:Params: {} 2024-04-16T18:07:51.576 DEBUG:boto:Token: None 2024-04-16T18:07:51.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/?versions 2024-04-16T18:07:51.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc= 2024-04-16T18:07:51.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc=', 'Content-Length': '0'} 2024-04-16T18:07:51.579 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000788706e96f933fde-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.579 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.579 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.579 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.579 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.580 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.580 DEBUG:boto:Method: GET 2024-04-16T18:07:51.580 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:07:51.580 DEBUG:boto:Data: 2024-04-16T18:07:51.580 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.580 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.580 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.580 DEBUG:boto:Params: {} 2024-04-16T18:07:51.580 DEBUG:boto:Token: None 2024-04-16T18:07:51.581 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/?versions 2024-04-16T18:07:51.581 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc= 2024-04-16T18:07:51.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MdJsVV2v+ERqn2o4O6EEgFwlBdc=', 'Content-Length': '0'} 2024-04-16T18:07:51.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b36c738c5c9da2b-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.583 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.584 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:07:51.584 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.584 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.584 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.584 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.584 DEBUG:boto:Method: GET 2024-04-16T18:07:51.584 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.584 DEBUG:boto:Data: 2024-04-16T18:07:51.584 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.585 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.585 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.585 DEBUG:boto:Params: {} 2024-04-16T18:07:51.585 DEBUG:boto:Token: None 2024-04-16T18:07:51.585 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.585 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY= 2024-04-16T18:07:51.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY=', 'Content-Length': '0'} 2024-04-16T18:07:51.587 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000010df392b9ac81c07-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.588 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.588 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.588 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.588 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.588 DEBUG:boto:Method: GET 2024-04-16T18:07:51.588 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.588 DEBUG:boto:Data: 2024-04-16T18:07:51.588 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.588 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.589 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.589 DEBUG:boto:Params: {} 2024-04-16T18:07:51.589 DEBUG:boto:Token: None 2024-04-16T18:07:51.589 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.589 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY= 2024-04-16T18:07:51.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY=', 'Content-Length': '0'} 2024-04-16T18:07:51.591 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009d63bdbd88ef3e42-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.591 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.591 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.591 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.591 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.591 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.592 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.592 DEBUG:boto:Data: 2024-04-16T18:07:51.592 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.592 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.592 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.592 DEBUG:boto:Params: {} 2024-04-16T18:07:51.592 DEBUG:boto:Token: None 2024-04-16T18:07:51.592 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NhSGuCoHu/M5QzXBj9cU01WzGVs= 2024-04-16T18:07:51.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NhSGuCoHu/M5QzXBj9cU01WzGVs=', 'Content-Length': '0'} 2024-04-16T18:07:51.594 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000936ac5733fe990a4-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.594 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.595 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.595 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.595 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.595 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.595 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.595 DEBUG:boto:Data: 2024-04-16T18:07:51.595 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.595 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.595 DEBUG:boto:Params: {} 2024-04-16T18:07:51.595 DEBUG:boto:Token: None 2024-04-16T18:07:51.596 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NhSGuCoHu/M5QzXBj9cU01WzGVs= 2024-04-16T18:07:51.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NhSGuCoHu/M5QzXBj9cU01WzGVs=', 'Content-Length': '0'} 2024-04-16T18:07:51.597 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000067a739ad08dbe592-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.597 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:07:51.598 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.598 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.598 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.598 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.598 DEBUG:boto:Method: GET 2024-04-16T18:07:51.598 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.598 DEBUG:boto:Data: 2024-04-16T18:07:51.598 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.601 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.601 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.601 DEBUG:boto:Params: {} 2024-04-16T18:07:51.601 DEBUG:boto:Token: None 2024-04-16T18:07:51.601 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.601 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY= 2024-04-16T18:07:51.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY=', 'Content-Length': '0'} 2024-04-16T18:07:51.603 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000750e90fa4a67d839-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.646 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.646 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.646 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.647 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.647 DEBUG:boto:Method: GET 2024-04-16T18:07:51.647 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.647 DEBUG:boto:Data: 2024-04-16T18:07:51.647 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.647 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.647 DEBUG:boto:Params: {} 2024-04-16T18:07:51.647 DEBUG:boto:Token: None 2024-04-16T18:07:51.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:07:51.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY= 2024-04-16T18:07:51.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k/y1aaGwEq/7k9YrAQXoDtrxXoY=', 'Content-Length': '0'} 2024-04-16T18:07:51.649 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8a7bc6e35ecd4a2-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.650 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.650 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.650 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.650 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.650 DEBUG:boto:Method: GET 2024-04-16T18:07:51.650 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.650 DEBUG:boto:Data: 2024-04-16T18:07:51.650 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.650 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.650 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.651 DEBUG:boto:Params: {} 2024-04-16T18:07:51.651 DEBUG:boto:Token: None 2024-04-16T18:07:51.651 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024289dd03c7fb682-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.653 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.654 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.654 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.654 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.654 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.654 DEBUG:boto:Method: GET 2024-04-16T18:07:51.654 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.654 DEBUG:boto:Data: 2024-04-16T18:07:51.654 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.655 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.655 DEBUG:boto:Params: {} 2024-04-16T18:07:51.655 DEBUG:boto:Token: None 2024-04-16T18:07:51.655 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c002340221436404-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.657 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.657 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.658 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.658 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.658 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:07:51.658 DEBUG:boto:Data: 2024-04-16T18:07:51.658 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.658 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.658 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.658 DEBUG:boto:Params: {} 2024-04-16T18:07:51.658 DEBUG:boto:Token: None 2024-04-16T18:07:51.658 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1 2024-04-16T18:07:51.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pt07z9vKGxOdQ9WrcMRO0lh0pPU= 2024-04-16T18:07:51.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pt07z9vKGxOdQ9WrcMRO0lh0pPU=', 'Content-Length': '0'} 2024-04-16T18:07:51.661 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000087c2fb8a8516ec55-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.661 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.661 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.661 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.661 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:07:51.661 DEBUG:boto:Data: 2024-04-16T18:07:51.661 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.662 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.662 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.662 DEBUG:boto:Params: {} 2024-04-16T18:07:51.662 DEBUG:boto:Token: None 2024-04-16T18:07:51.662 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1 2024-04-16T18:07:51.662 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pt07z9vKGxOdQ9WrcMRO0lh0pPU= 2024-04-16T18:07:51.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pt07z9vKGxOdQ9WrcMRO0lh0pPU=', 'Content-Length': '0'} 2024-04-16T18:07:51.664 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000059e446da4c3fad76-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:07:51.664 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.664 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.664 DEBUG:boto:Method: GET 2024-04-16T18:07:51.664 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:07:51.664 DEBUG:boto:Data: 2024-04-16T18:07:51.664 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.665 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.665 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.665 DEBUG:boto:Params: {} 2024-04-16T18:07:51.665 DEBUG:boto:Token: None 2024-04-16T18:07:51.665 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1 2024-04-16T18:07:51.665 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:650hl+JrSPe+VJUkuZX5LGyNwck= 2024-04-16T18:07:51.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:650hl+JrSPe+VJUkuZX5LGyNwck=', 'Content-Length': '0'} 2024-04-16T18:07:51.667 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000788bdd366aa29925-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.667 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:07:51.667 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:07:51.667 DEBUG:boto:Method: GET 2024-04-16T18:07:51.667 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:07:51.668 DEBUG:boto:Data: 2024-04-16T18:07:51.668 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.668 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.668 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.668 DEBUG:boto:Params: {} 2024-04-16T18:07:51.668 DEBUG:boto:Token: None 2024-04-16T18:07:51.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj1 2024-04-16T18:07:51.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:650hl+JrSPe+VJUkuZX5LGyNwck= 2024-04-16T18:07:51.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:650hl+JrSPe+VJUkuZX5LGyNwck=', 'Content-Length': '0'} 2024-04-16T18:07:51.670 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006fe75f92becb52df-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.710 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.710 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.711 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.711 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.711 DEBUG:boto:Method: GET 2024-04-16T18:07:51.711 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.711 DEBUG:boto:Data: 2024-04-16T18:07:51.711 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.711 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.711 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.711 DEBUG:boto:Params: {} 2024-04-16T18:07:51.711 DEBUG:boto:Token: None 2024-04-16T18:07:51.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e243dcbc219a189-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.714 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.715 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.715 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.715 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.715 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.715 DEBUG:boto:Method: GET 2024-04-16T18:07:51.715 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:07:51.715 DEBUG:boto:Data: 2024-04-16T18:07:51.715 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.716 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.716 DEBUG:boto:Params: {} 2024-04-16T18:07:51.716 DEBUG:boto:Token: None 2024-04-16T18:07:51.716 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acec147ccabc600c-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.758 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.759 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:07:51.759 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.759 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.759 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.759 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.759 DEBUG:boto:Method: GET 2024-04-16T18:07:51.759 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.759 DEBUG:boto:Data: 2024-04-16T18:07:51.759 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.760 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.760 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.760 DEBUG:boto:Params: {} 2024-04-16T18:07:51.760 DEBUG:boto:Token: None 2024-04-16T18:07:51.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE= 2024-04-16T18:07:51.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE=', 'Content-Length': '0'} 2024-04-16T18:07:51.762 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004b6ece6401a628e0-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.762 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.762 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.763 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.763 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.763 DEBUG:boto:Method: GET 2024-04-16T18:07:51.763 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.763 DEBUG:boto:Data: 2024-04-16T18:07:51.763 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.763 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.763 DEBUG:boto:Params: {} 2024-04-16T18:07:51.763 DEBUG:boto:Token: None 2024-04-16T18:07:51.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE= 2024-04-16T18:07:51.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE=', 'Content-Length': '0'} 2024-04-16T18:07:51.765 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e3591fa65302504-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.806 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.807 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.807 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.807 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.807 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.807 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.807 DEBUG:boto:Data: 2024-04-16T18:07:51.807 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.807 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.807 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.807 DEBUG:boto:Params: {} 2024-04-16T18:07:51.807 DEBUG:boto:Token: None 2024-04-16T18:07:51.808 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uzdwSwGsigfJA3JVcxy9yGQl1jE= 2024-04-16T18:07:51.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uzdwSwGsigfJA3JVcxy9yGQl1jE=', 'Content-Length': '0'} 2024-04-16T18:07:51.810 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004ebccbc65edad23d-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.810 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.810 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.810 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.810 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.811 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.811 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.811 DEBUG:boto:Data: 2024-04-16T18:07:51.811 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.811 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.811 DEBUG:boto:Params: {} 2024-04-16T18:07:51.811 DEBUG:boto:Token: None 2024-04-16T18:07:51.811 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uzdwSwGsigfJA3JVcxy9yGQl1jE= 2024-04-16T18:07:51.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uzdwSwGsigfJA3JVcxy9yGQl1jE=', 'Content-Length': '0'} 2024-04-16T18:07:51.813 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003bfefd4ad3535984-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:07:51.814 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.814 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.814 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.814 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.814 DEBUG:boto:Method: GET 2024-04-16T18:07:51.814 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.814 DEBUG:boto:Data: 2024-04-16T18:07:51.814 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.815 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.815 DEBUG:boto:Params: {} 2024-04-16T18:07:51.815 DEBUG:boto:Token: None 2024-04-16T18:07:51.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE= 2024-04-16T18:07:51.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE=', 'Content-Length': '0'} 2024-04-16T18:07:51.817 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004006b27def47190b-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.817 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.817 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.817 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.817 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.818 DEBUG:boto:Method: GET 2024-04-16T18:07:51.818 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.818 DEBUG:boto:Data: 2024-04-16T18:07:51.818 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.818 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.818 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.818 DEBUG:boto:Params: {} 2024-04-16T18:07:51.818 DEBUG:boto:Token: None 2024-04-16T18:07:51.818 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:07:51.818 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE= 2024-04-16T18:07:51.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jIrxpnS/ZAEFeEIT0qxaoGzTWCE=', 'Content-Length': '0'} 2024-04-16T18:07:51.820 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c65b21e478b31580-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.820 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.821 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.821 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.821 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.821 DEBUG:boto:Method: GET 2024-04-16T18:07:51.821 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.821 DEBUG:boto:Data: 2024-04-16T18:07:51.821 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.821 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.821 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.821 DEBUG:boto:Params: {} 2024-04-16T18:07:51.821 DEBUG:boto:Token: None 2024-04-16T18:07:51.822 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.822 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.824 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d251c3eca2f7b4a-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.824 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.825 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.825 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.825 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.825 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.825 DEBUG:boto:Method: GET 2024-04-16T18:07:51.825 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.825 DEBUG:boto:Data: 2024-04-16T18:07:51.825 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.825 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.825 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.826 DEBUG:boto:Params: {} 2024-04-16T18:07:51.826 DEBUG:boto:Token: None 2024-04-16T18:07:51.826 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.826 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.828 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081046c1d8e9ca8e8-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.829 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.829 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.829 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.829 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.829 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:07:51.829 DEBUG:boto:Data: 2024-04-16T18:07:51.829 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.829 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.829 DEBUG:boto:Params: {} 2024-04-16T18:07:51.830 DEBUG:boto:Token: None 2024-04-16T18:07:51.830 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2 2024-04-16T18:07:51.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FjuEDGQQoPKCdre8CCwVipb+2ig= 2024-04-16T18:07:51.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FjuEDGQQoPKCdre8CCwVipb+2ig=', 'Content-Length': '0'} 2024-04-16T18:07:51.832 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c97de402aa148f63-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.832 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.832 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.832 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.832 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:07:51.832 DEBUG:boto:Data: 2024-04-16T18:07:51.832 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.832 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.832 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.833 DEBUG:boto:Params: {} 2024-04-16T18:07:51.833 DEBUG:boto:Token: None 2024-04-16T18:07:51.833 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2 2024-04-16T18:07:51.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FjuEDGQQoPKCdre8CCwVipb+2ig= 2024-04-16T18:07:51.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FjuEDGQQoPKCdre8CCwVipb+2ig=', 'Content-Length': '0'} 2024-04-16T18:07:51.834 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000061226f4932e831fa-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.835 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:07:51.835 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.835 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.835 DEBUG:boto:Method: GET 2024-04-16T18:07:51.835 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:07:51.835 DEBUG:boto:Data: 2024-04-16T18:07:51.835 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.835 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.835 DEBUG:boto:Params: {} 2024-04-16T18:07:51.836 DEBUG:boto:Token: None 2024-04-16T18:07:51.836 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2 2024-04-16T18:07:51.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j1SI/4QYsFW3dSNWcbNkLTlKjUs= 2024-04-16T18:07:51.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j1SI/4QYsFW3dSNWcbNkLTlKjUs=', 'Content-Length': '0'} 2024-04-16T18:07:51.838 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000032cd9735e3cf0f04-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.838 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:07:51.838 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:07:51.838 DEBUG:boto:Method: GET 2024-04-16T18:07:51.838 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:07:51.838 DEBUG:boto:Data: 2024-04-16T18:07:51.838 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.838 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.839 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.839 DEBUG:boto:Params: {} 2024-04-16T18:07:51.839 DEBUG:boto:Token: None 2024-04-16T18:07:51.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj2 2024-04-16T18:07:51.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j1SI/4QYsFW3dSNWcbNkLTlKjUs= 2024-04-16T18:07:51.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j1SI/4QYsFW3dSNWcbNkLTlKjUs=', 'Content-Length': '0'} 2024-04-16T18:07:51.841 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a76560b9c3cf9b03-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.882 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.882 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.883 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.883 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.883 DEBUG:boto:Method: GET 2024-04-16T18:07:51.883 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.883 DEBUG:boto:Data: 2024-04-16T18:07:51.883 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.883 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.883 DEBUG:boto:Params: {} 2024-04-16T18:07:51.883 DEBUG:boto:Token: None 2024-04-16T18:07:51.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005353e4860431fccd-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.886 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.886 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.887 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.887 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.887 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.887 DEBUG:boto:Method: GET 2024-04-16T18:07:51.887 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:07:51.887 DEBUG:boto:Data: 2024-04-16T18:07:51.887 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.887 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.887 DEBUG:boto:Params: {} 2024-04-16T18:07:51.887 DEBUG:boto:Token: None 2024-04-16T18:07:51.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef0772d1e7ec6e05-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.890 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.890 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:07:51.890 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.891 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.891 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.891 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.891 DEBUG:boto:Method: GET 2024-04-16T18:07:51.891 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.891 DEBUG:boto:Data: 2024-04-16T18:07:51.891 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.891 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.891 DEBUG:boto:Params: {} 2024-04-16T18:07:51.891 DEBUG:boto:Token: None 2024-04-16T18:07:51.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak= 2024-04-16T18:07:51.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak=', 'Content-Length': '0'} 2024-04-16T18:07:51.894 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ac6e450d45385ad0-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.894 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.894 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.894 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.894 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.894 DEBUG:boto:Method: GET 2024-04-16T18:07:51.894 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.894 DEBUG:boto:Data: 2024-04-16T18:07:51.895 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.895 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.895 DEBUG:boto:Params: {} 2024-04-16T18:07:51.895 DEBUG:boto:Token: None 2024-04-16T18:07:51.895 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak= 2024-04-16T18:07:51.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak=', 'Content-Length': '0'} 2024-04-16T18:07:51.897 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d9c63be3e3f66bc6-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.898 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.898 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.898 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.898 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.898 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.898 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.898 DEBUG:boto:Data: 2024-04-16T18:07:51.898 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.898 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.898 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.898 DEBUG:boto:Params: {} 2024-04-16T18:07:51.899 DEBUG:boto:Token: None 2024-04-16T18:07:51.899 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iNZSX2aN2FnaTsU7zTctUp+5pDk= 2024-04-16T18:07:51.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iNZSX2aN2FnaTsU7zTctUp+5pDk=', 'Content-Length': '0'} 2024-04-16T18:07:51.900 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bcf2d88062ff25a5-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.901 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.901 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.901 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.901 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.901 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.901 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.901 DEBUG:boto:Data: 2024-04-16T18:07:51.901 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.901 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.901 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.901 DEBUG:boto:Params: {} 2024-04-16T18:07:51.902 DEBUG:boto:Token: None 2024-04-16T18:07:51.902 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.902 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iNZSX2aN2FnaTsU7zTctUp+5pDk= 2024-04-16T18:07:51.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iNZSX2aN2FnaTsU7zTctUp+5pDk=', 'Content-Length': '0'} 2024-04-16T18:07:51.904 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ba3770d532c6aa6a-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.904 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:07:51.904 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.904 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.904 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.904 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.904 DEBUG:boto:Method: GET 2024-04-16T18:07:51.904 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.904 DEBUG:boto:Data: 2024-04-16T18:07:51.905 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.905 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.905 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.905 DEBUG:boto:Params: {} 2024-04-16T18:07:51.905 DEBUG:boto:Token: None 2024-04-16T18:07:51.905 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.905 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak= 2024-04-16T18:07:51.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak=', 'Content-Length': '0'} 2024-04-16T18:07:51.907 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e495aaa1a997b3c9-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.907 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.908 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.908 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.908 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.908 DEBUG:boto:Method: GET 2024-04-16T18:07:51.908 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.908 DEBUG:boto:Data: 2024-04-16T18:07:51.908 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.908 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.908 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.908 DEBUG:boto:Params: {} 2024-04-16T18:07:51.908 DEBUG:boto:Token: None 2024-04-16T18:07:51.909 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:07:51.909 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak= 2024-04-16T18:07:51.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:smDt0E/k9YNDlHFMRvVTQBJzgak=', 'Content-Length': '0'} 2024-04-16T18:07:51.910 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009b7ac55a447cc6af-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.911 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.911 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.911 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.911 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.911 DEBUG:boto:Method: GET 2024-04-16T18:07:51.911 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.911 DEBUG:boto:Data: 2024-04-16T18:07:51.911 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.911 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.911 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.912 DEBUG:boto:Params: {} 2024-04-16T18:07:51.912 DEBUG:boto:Token: None 2024-04-16T18:07:51.912 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000273f53f2c0440726-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.915 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.915 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.915 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.915 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.915 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.915 DEBUG:boto:Method: GET 2024-04-16T18:07:51.915 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.915 DEBUG:boto:Data: 2024-04-16T18:07:51.915 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.916 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.916 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.916 DEBUG:boto:Params: {} 2024-04-16T18:07:51.916 DEBUG:boto:Token: None 2024-04-16T18:07:51.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.918 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069f58e34c8c1ad9a-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.918 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.918 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.918 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.919 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.919 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:07:51.919 DEBUG:boto:Data: 2024-04-16T18:07:51.919 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.919 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.919 DEBUG:boto:Params: {} 2024-04-16T18:07:51.919 DEBUG:boto:Token: None 2024-04-16T18:07:51.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3 2024-04-16T18:07:51.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kF9Sd2zrlSwLTRhNoXYu9HIRw7w= 2024-04-16T18:07:51.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kF9Sd2zrlSwLTRhNoXYu9HIRw7w=', 'Content-Length': '0'} 2024-04-16T18:07:51.921 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e9a64d9423c8ea94-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.921 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.922 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.922 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.922 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:07:51.922 DEBUG:boto:Data: 2024-04-16T18:07:51.922 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.922 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.922 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.922 DEBUG:boto:Params: {} 2024-04-16T18:07:51.922 DEBUG:boto:Token: None 2024-04-16T18:07:51.922 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3 2024-04-16T18:07:51.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kF9Sd2zrlSwLTRhNoXYu9HIRw7w= 2024-04-16T18:07:51.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kF9Sd2zrlSwLTRhNoXYu9HIRw7w=', 'Content-Length': '0'} 2024-04-16T18:07:51.924 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007bb52594f499e334-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:07:51.924 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.925 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.925 DEBUG:boto:Method: GET 2024-04-16T18:07:51.925 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:07:51.925 DEBUG:boto:Data: 2024-04-16T18:07:51.925 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.925 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.925 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.925 DEBUG:boto:Params: {} 2024-04-16T18:07:51.925 DEBUG:boto:Token: None 2024-04-16T18:07:51.925 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3 2024-04-16T18:07:51.925 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KJkEPcXSJwODal0lkdTqBbQ0P2c= 2024-04-16T18:07:51.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KJkEPcXSJwODal0lkdTqBbQ0P2c=', 'Content-Length': '0'} 2024-04-16T18:07:51.927 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000188a12a5bf74b0ce-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.970 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:07:51.970 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:07:51.971 DEBUG:boto:Method: GET 2024-04-16T18:07:51.971 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:07:51.971 DEBUG:boto:Data: 2024-04-16T18:07:51.971 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.971 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.971 DEBUG:boto:Params: {} 2024-04-16T18:07:51.971 DEBUG:boto:Token: None 2024-04-16T18:07:51.971 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj3 2024-04-16T18:07:51.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KJkEPcXSJwODal0lkdTqBbQ0P2c= 2024-04-16T18:07:51.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KJkEPcXSJwODal0lkdTqBbQ0P2c=', 'Content-Length': '0'} 2024-04-16T18:07:51.974 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003529e21cccd0ed36-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.974 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.974 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.974 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.974 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.974 DEBUG:boto:Method: GET 2024-04-16T18:07:51.974 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.974 DEBUG:boto:Data: 2024-04-16T18:07:51.974 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.975 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.975 DEBUG:boto:Params: {} 2024-04-16T18:07:51.975 DEBUG:boto:Token: None 2024-04-16T18:07:51.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003298c67d4dbc4ff9-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.978 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.978 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:51.978 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:51.978 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.978 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.979 DEBUG:boto:Method: GET 2024-04-16T18:07:51.979 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:07:51.979 DEBUG:boto:Data: 2024-04-16T18:07:51.979 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.979 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.979 DEBUG:boto:Params: {} 2024-04-16T18:07:51.979 DEBUG:boto:Token: None 2024-04-16T18:07:51.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/ 2024-04-16T18:07:51.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M= 2024-04-16T18:07:51.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEm+RvUteCrEy+TUEmAXSsHSK8M=', 'Content-Length': '0'} 2024-04-16T18:07:51.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023b242da89bdca92-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.982 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:51.982 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:07:51.982 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:51.982 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:51.983 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.983 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.983 DEBUG:boto:Method: GET 2024-04-16T18:07:51.983 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.983 DEBUG:boto:Data: 2024-04-16T18:07:51.983 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.983 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.983 DEBUG:boto:Params: {} 2024-04-16T18:07:51.983 DEBUG:boto:Token: None 2024-04-16T18:07:51.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PEaevENXDMqmpEdBYERRm+jHurw= 2024-04-16T18:07:51.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PEaevENXDMqmpEdBYERRm+jHurw=', 'Content-Length': '0'} 2024-04-16T18:07:51.986 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000031d48148a5962edd-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.986 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:51.986 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:51.986 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.986 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.986 DEBUG:boto:Method: GET 2024-04-16T18:07:51.986 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.986 DEBUG:boto:Data: 2024-04-16T18:07:51.987 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.987 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.987 DEBUG:boto:Params: {} 2024-04-16T18:07:51.987 DEBUG:boto:Token: None 2024-04-16T18:07:51.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PEaevENXDMqmpEdBYERRm+jHurw= 2024-04-16T18:07:51.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PEaevENXDMqmpEdBYERRm+jHurw=', 'Content-Length': '0'} 2024-04-16T18:07:51.989 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008cf9f9972afcc6cb-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.989 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:51.989 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:51.990 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.990 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.990 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.990 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.990 DEBUG:boto:Data: 2024-04-16T18:07:51.990 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.990 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.990 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.990 DEBUG:boto:Params: {} 2024-04-16T18:07:51.990 DEBUG:boto:Token: None 2024-04-16T18:07:51.990 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MrmucO3Ajuay6gdwHYyOI3uLjO4= 2024-04-16T18:07:51.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MrmucO3Ajuay6gdwHYyOI3uLjO4=', 'Content-Length': '0'} 2024-04-16T18:07:51.993 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f2cb199b9cd3c4a0-00661ebe77-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.993 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:51.993 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:51.993 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.993 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.993 DEBUG:boto:Method: HEAD 2024-04-16T18:07:51.993 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.993 DEBUG:boto:Data: 2024-04-16T18:07:51.993 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.993 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:51.994 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.994 DEBUG:boto:Params: {} 2024-04-16T18:07:51.994 DEBUG:boto:Token: None 2024-04-16T18:07:51.994 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.994 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MrmucO3Ajuay6gdwHYyOI3uLjO4= 2024-04-16T18:07:51.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MrmucO3Ajuay6gdwHYyOI3uLjO4=', 'Content-Length': '0'} 2024-04-16T18:07:51.996 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ff9c6a8dedc14f5f-00661ebe77-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.996 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:07:51.996 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:51.996 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:51.996 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.996 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.996 DEBUG:boto:Method: GET 2024-04-16T18:07:51.996 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.996 DEBUG:boto:Data: 2024-04-16T18:07:51.997 DEBUG:boto:Headers: {} 2024-04-16T18:07:51.997 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:51.997 DEBUG:boto:Port: 8000 2024-04-16T18:07:51.997 DEBUG:boto:Params: {} 2024-04-16T18:07:51.997 DEBUG:boto:Token: None 2024-04-16T18:07:51.997 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:51 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:51.997 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PEaevENXDMqmpEdBYERRm+jHurw= 2024-04-16T18:07:51.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PEaevENXDMqmpEdBYERRm+jHurw=', 'Content-Length': '0'} 2024-04-16T18:07:51.999 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004cca01ce115244e8-00661ebe78-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:51.999 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:51.999 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:52.000 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:52.000 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:07:52.000 DEBUG:boto:Method: GET 2024-04-16T18:07:52.000 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:52.000 DEBUG:boto:Data: 2024-04-16T18:07:52.000 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.000 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.000 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.000 DEBUG:boto:Params: {} 2024-04-16T18:07:52.000 DEBUG:boto:Token: None 2024-04-16T18:07:52.001 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:07:52.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A5i6orsDrRM+6/0icZygfp1q3Zw= 2024-04-16T18:07:52.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A5i6orsDrRM+6/0icZygfp1q3Zw=', 'Content-Length': '0'} 2024-04-16T18:07:52.002 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008447630fc455e434-00661ebe78-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.003 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.003 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.003 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.003 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.003 DEBUG:boto:Method: GET 2024-04-16T18:07:52.003 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.003 DEBUG:boto:Data: 2024-04-16T18:07:52.003 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.004 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.004 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.004 DEBUG:boto:Params: {} 2024-04-16T18:07:52.004 DEBUG:boto:Token: None 2024-04-16T18:07:52.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc= 2024-04-16T18:07:52.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc=', 'Content-Length': '0'} 2024-04-16T18:07:52.006 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e7ff2c74a3ab24a-00661ebe78-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.006 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:52.007 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.007 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.007 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.007 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.007 DEBUG:boto:Method: GET 2024-04-16T18:07:52.007 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.007 DEBUG:boto:Data: 2024-04-16T18:07:52.007 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.008 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.008 DEBUG:boto:Params: {} 2024-04-16T18:07:52.008 DEBUG:boto:Token: None 2024-04-16T18:07:52.008 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc= 2024-04-16T18:07:52.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc=', 'Content-Length': '0'} 2024-04-16T18:07:52.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3f6d0c952334320-00661ebe78-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.054 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:52.055 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:52.055 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:52.055 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.055 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:07:52.055 DEBUG:boto:Data: 2024-04-16T18:07:52.055 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.055 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.055 DEBUG:boto:Params: {} 2024-04-16T18:07:52.056 DEBUG:boto:Token: None 2024-04-16T18:07:52.056 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj4 2024-04-16T18:07:52.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fflJEB9dKtOutQ4cvGIXSKkxcME= 2024-04-16T18:07:52.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fflJEB9dKtOutQ4cvGIXSKkxcME=', 'Content-Length': '0'} 2024-04-16T18:07:52.058 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001feccb0be65a37dd-00661ebe78-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.058 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:52.058 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:52.058 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.058 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:07:52.058 DEBUG:boto:Data: 2024-04-16T18:07:52.058 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.058 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.059 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.059 DEBUG:boto:Params: {} 2024-04-16T18:07:52.059 DEBUG:boto:Token: None 2024-04-16T18:07:52.059 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj4 2024-04-16T18:07:52.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fflJEB9dKtOutQ4cvGIXSKkxcME= 2024-04-16T18:07:52.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fflJEB9dKtOutQ4cvGIXSKkxcME=', 'Content-Length': '0'} 2024-04-16T18:07:52.061 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d8501c7e85c0666f-00661ebe78-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.061 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:07:52.061 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:52.061 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:52.061 DEBUG:boto:Method: GET 2024-04-16T18:07:52.061 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:07:52.061 DEBUG:boto:Data: 2024-04-16T18:07:52.062 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.062 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.062 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.062 DEBUG:boto:Params: {} 2024-04-16T18:07:52.062 DEBUG:boto:Token: None 2024-04-16T18:07:52.062 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj4 2024-04-16T18:07:52.062 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+gYSsYG7VvONVjGdQmAlKNsx+MU= 2024-04-16T18:07:52.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+gYSsYG7VvONVjGdQmAlKNsx+MU=', 'Content-Length': '0'} 2024-04-16T18:07:52.064 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005b7e2d5903af0b2b-00661ebe78-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.064 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:07:52.064 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:07:52.064 DEBUG:boto:Method: GET 2024-04-16T18:07:52.065 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:07:52.065 DEBUG:boto:Data: 2024-04-16T18:07:52.065 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.065 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.065 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.065 DEBUG:boto:Params: {} 2024-04-16T18:07:52.065 DEBUG:boto:Token: None 2024-04-16T18:07:52.065 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj4 2024-04-16T18:07:52.065 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+gYSsYG7VvONVjGdQmAlKNsx+MU= 2024-04-16T18:07:52.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+gYSsYG7VvONVjGdQmAlKNsx+MU=', 'Content-Length': '0'} 2024-04-16T18:07:52.067 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009912779132886d1d-00661ebe78-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.067 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.067 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.067 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.067 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.068 DEBUG:boto:Method: GET 2024-04-16T18:07:52.068 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.068 DEBUG:boto:Data: 2024-04-16T18:07:52.068 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.068 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.068 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.068 DEBUG:boto:Params: {} 2024-04-16T18:07:52.068 DEBUG:boto:Token: None 2024-04-16T18:07:52.068 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc= 2024-04-16T18:07:52.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc=', 'Content-Length': '0'} 2024-04-16T18:07:52.071 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a3c5936771a1068-00661ebe78-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.071 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:52.071 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.071 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.071 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.071 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.071 DEBUG:boto:Method: GET 2024-04-16T18:07:52.072 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:07:52.072 DEBUG:boto:Data: 2024-04-16T18:07:52.072 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.072 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.072 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.072 DEBUG:boto:Params: {} 2024-04-16T18:07:52.072 DEBUG:boto:Token: None 2024-04-16T18:07:52.072 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc= 2024-04-16T18:07:52.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mBDj5+JDl8TjNfyCc4/jrV6hIFc=', 'Content-Length': '0'} 2024-04-16T18:07:52.074 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099a764cd92fab50d-00661ebe78-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.075 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:07:52.075 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-39 zones={test-zone2, test-zone1} 2024-04-16T18:07:52.075 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'cjqttm-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'cjqttm-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.075 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket cjqttm-38 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:07:52.128 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:52.128 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:52.228 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'cjqttm-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'cjqttm-38', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.229 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket cjqttm-38 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:07:52.277 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:52.277 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:52.375 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'cjqttm-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'cjqttm-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.375 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket cjqttm-39 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:07:52.424 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:52.424 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:52.525 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'cjqttm-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'cjqttm-39', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:07:52.526 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket cjqttm-39 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:07:52.575 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:52.575 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:52.669 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:52.669 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:52.669 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.670 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:52.670 DEBUG:boto:Data: 2024-04-16T18:07:52.670 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.670 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.670 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.670 DEBUG:boto:Params: {} 2024-04-16T18:07:52.670 DEBUG:boto:Token: None 2024-04-16T18:07:52.670 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/ 2024-04-16T18:07:52.670 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4= 2024-04-16T18:07:52.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4=', 'Content-Length': '0'} 2024-04-16T18:07:52.673 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006587b2e1c9c4ca11-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.673 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:07:52.673 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:07:52.673 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.673 DEBUG:boto:Path: /cjqttm-38/obj5 2024-04-16T18:07:52.673 DEBUG:boto:Data: 2024-04-16T18:07:52.673 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.673 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.674 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.674 DEBUG:boto:Params: {} 2024-04-16T18:07:52.674 DEBUG:boto:Token: None 2024-04-16T18:07:52.674 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/obj5 2024-04-16T18:07:52.674 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ldb+f1MOsHxwgRUCjW9XVDG6DTk= 2024-04-16T18:07:52.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ldb+f1MOsHxwgRUCjW9XVDG6DTk='} 2024-04-16T18:07:52.678 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000de8bee4c6f677c60-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.678 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:52.679 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:52.679 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.679 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:52.679 DEBUG:boto:Data: 2024-04-16T18:07:52.679 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.680 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.680 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.680 DEBUG:boto:Params: {} 2024-04-16T18:07:52.680 DEBUG:boto:Token: None 2024-04-16T18:07:52.680 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/ 2024-04-16T18:07:52.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4= 2024-04-16T18:07:52.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4=', 'Content-Length': '0'} 2024-04-16T18:07:52.682 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb0584b362840a01-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.682 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:07:52.682 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:07:52.682 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.683 DEBUG:boto:Path: /cjqttm-38/obj6 2024-04-16T18:07:52.683 DEBUG:boto:Data: 2024-04-16T18:07:52.683 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.683 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.683 DEBUG:boto:Params: {} 2024-04-16T18:07:52.683 DEBUG:boto:Token: None 2024-04-16T18:07:52.683 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/obj6 2024-04-16T18:07:52.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4SVsFMxAdfIf9Xo8RN/3Ydy1awY= 2024-04-16T18:07:52.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4SVsFMxAdfIf9Xo8RN/3Ydy1awY='} 2024-04-16T18:07:52.687 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e8b71c29f85b62fb-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.687 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:52.687 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:52.688 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.688 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:52.688 DEBUG:boto:Data: 2024-04-16T18:07:52.688 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.688 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.688 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.688 DEBUG:boto:Params: {} 2024-04-16T18:07:52.688 DEBUG:boto:Token: None 2024-04-16T18:07:52.688 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/ 2024-04-16T18:07:52.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4= 2024-04-16T18:07:52.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4=', 'Content-Length': '0'} 2024-04-16T18:07:52.690 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001be2720e6fd2c1f1-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.690 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:07:52.691 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:07:52.691 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.691 DEBUG:boto:Path: /cjqttm-38/obj7 2024-04-16T18:07:52.691 DEBUG:boto:Data: 2024-04-16T18:07:52.691 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.691 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.691 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.691 DEBUG:boto:Params: {} 2024-04-16T18:07:52.691 DEBUG:boto:Token: None 2024-04-16T18:07:52.691 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/obj7 2024-04-16T18:07:52.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wSqYJRisTUHVVsLmgNrJyc9ndto= 2024-04-16T18:07:52.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wSqYJRisTUHVVsLmgNrJyc9ndto='} 2024-04-16T18:07:52.734 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000099bba65b7661522e-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.735 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:07:52.735 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:07:52.735 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.735 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:07:52.735 DEBUG:boto:Data: 2024-04-16T18:07:52.735 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.735 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.735 DEBUG:boto:Params: {} 2024-04-16T18:07:52.735 DEBUG:boto:Token: None 2024-04-16T18:07:52.735 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/ 2024-04-16T18:07:52.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4= 2024-04-16T18:07:52.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vttnuwca3l2RzMr6J/4byPJ80Q4=', 'Content-Length': '0'} 2024-04-16T18:07:52.738 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004e5793f37607b5d7-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.738 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:07:52.738 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:07:52.738 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.738 DEBUG:boto:Path: /cjqttm-38/obj8 2024-04-16T18:07:52.738 DEBUG:boto:Data: 2024-04-16T18:07:52.738 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:07:52.739 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.739 DEBUG:boto:Params: {} 2024-04-16T18:07:52.739 DEBUG:boto:Token: None 2024-04-16T18:07:52.739 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-38/obj8 2024-04-16T18:07:52.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VYhbLYsViYY4TKARwBy6lPIiM04= 2024-04-16T18:07:52.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VYhbLYsViYY4TKARwBy6lPIiM04='} 2024-04-16T18:07:52.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000763bcd494757b544-00661ebe78-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.743 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.743 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.743 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.743 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:52.743 DEBUG:boto:Data: 2024-04-16T18:07:52.743 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.743 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.743 DEBUG:boto:Params: {} 2024-04-16T18:07:52.743 DEBUG:boto:Token: None 2024-04-16T18:07:52.743 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k= 2024-04-16T18:07:52.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k=', 'Content-Length': '0'} 2024-04-16T18:07:52.746 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000055f06f60e08033c9-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.746 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:07:52.746 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:07:52.747 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.747 DEBUG:boto:Path: /cjqttm-39/obj5 2024-04-16T18:07:52.747 DEBUG:boto:Data: 2024-04-16T18:07:52.747 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.747 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.747 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.747 DEBUG:boto:Params: {} 2024-04-16T18:07:52.747 DEBUG:boto:Token: None 2024-04-16T18:07:52.747 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj5 2024-04-16T18:07:52.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mTi20s/WK+67/IB3Wu9TFMJyYQE= 2024-04-16T18:07:52.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mTi20s/WK+67/IB3Wu9TFMJyYQE='} 2024-04-16T18:07:52.753 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000374be0dbd0004f9c-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.753 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.753 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.754 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.754 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:52.754 DEBUG:boto:Data: 2024-04-16T18:07:52.754 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.754 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.754 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.754 DEBUG:boto:Params: {} 2024-04-16T18:07:52.754 DEBUG:boto:Token: None 2024-04-16T18:07:52.754 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k= 2024-04-16T18:07:52.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k=', 'Content-Length': '0'} 2024-04-16T18:07:52.757 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f9680a60556739f-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.757 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:07:52.757 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:07:52.757 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.757 DEBUG:boto:Path: /cjqttm-39/obj6 2024-04-16T18:07:52.758 DEBUG:boto:Data: 2024-04-16T18:07:52.758 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.758 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.758 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.758 DEBUG:boto:Params: {} 2024-04-16T18:07:52.758 DEBUG:boto:Token: None 2024-04-16T18:07:52.758 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj6 2024-04-16T18:07:52.758 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9J+Xhxkz2WcWQJ8u2lHto4D+GLg= 2024-04-16T18:07:52.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9J+Xhxkz2WcWQJ8u2lHto4D+GLg='} 2024-04-16T18:07:52.802 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009acba5ef74c9f00d-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.803 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.803 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.803 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.803 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:52.803 DEBUG:boto:Data: 2024-04-16T18:07:52.803 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.803 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.803 DEBUG:boto:Params: {} 2024-04-16T18:07:52.803 DEBUG:boto:Token: None 2024-04-16T18:07:52.804 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k= 2024-04-16T18:07:52.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k=', 'Content-Length': '0'} 2024-04-16T18:07:52.806 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003d04807d710e1ea9-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.806 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:07:52.806 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:07:52.806 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.806 DEBUG:boto:Path: /cjqttm-39/obj7 2024-04-16T18:07:52.806 DEBUG:boto:Data: 2024-04-16T18:07:52.807 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.807 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.807 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.807 DEBUG:boto:Params: {} 2024-04-16T18:07:52.807 DEBUG:boto:Token: None 2024-04-16T18:07:52.807 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj7 2024-04-16T18:07:52.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vm0qKztvlK4lfdr5eOhAb+/rFRA= 2024-04-16T18:07:52.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vm0qKztvlK4lfdr5eOhAb+/rFRA='} 2024-04-16T18:07:52.812 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000026861fef451d32e5-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.812 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:07:52.812 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:07:52.812 DEBUG:boto:Method: HEAD 2024-04-16T18:07:52.812 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:07:52.813 DEBUG:boto:Data: 2024-04-16T18:07:52.813 DEBUG:boto:Headers: {} 2024-04-16T18:07:52.813 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.813 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.813 DEBUG:boto:Params: {} 2024-04-16T18:07:52.813 DEBUG:boto:Token: None 2024-04-16T18:07:52.813 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/ 2024-04-16T18:07:52.813 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k= 2024-04-16T18:07:52.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pd9lU3sq3hS+O/P3L3W6uaWxb9k=', 'Content-Length': '0'} 2024-04-16T18:07:52.815 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008c757283338e7e7b-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.815 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:07:52.815 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:07:52.816 DEBUG:boto:Method: PUT 2024-04-16T18:07:52.816 DEBUG:boto:Path: /cjqttm-39/obj8 2024-04-16T18:07:52.816 DEBUG:boto:Data: 2024-04-16T18:07:52.816 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:07:52.816 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:07:52.816 DEBUG:boto:Port: 8000 2024-04-16T18:07:52.816 DEBUG:boto:Params: {} 2024-04-16T18:07:52.816 DEBUG:boto:Token: None 2024-04-16T18:07:52.816 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:07:52 GMT /cjqttm-39/obj8 2024-04-16T18:07:52.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jpmLdt/ZHlGiMVY/6gbwF+1Gpww= 2024-04-16T18:07:52.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:07:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jpmLdt/ZHlGiMVY/6gbwF+1Gpww='} 2024-04-16T18:07:52.858 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000006f6993733afb7b0-00661ebe78-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:07:52.859 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-38 2024-04-16T18:07:52.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:52.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:52.859 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-38 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:07:52.920 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:52.920 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:52.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:52.980+0000 7fa588416800 1 waiting for incremental sync to catch up: 2024-04-16T18:07:52.979 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.27.6, , 00000000001.34.6, , 00000000001.29.6, , , 00000000001.21.6, , , ] 2024-04-16T18:07:52.979 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.33.6, 00000000002.26.1, 00000000004.42.6, 00000000002.22.1, 00000000004.33.6, 00000000002.33.1, 00000000002.23.1, 00000000004.25.6, 00000000002.26.1, 00000000002.27.1, 00000000002.34.1] 2024-04-16T18:07:57.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:57.981+0000 7fa588416800 1 bucket sync caught up with source: 2024-04-16T18:07:57.981 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.33.6, 00000000002.26.1, 00000000004.42.6, 00000000002.22.1, 00000000004.33.6, 00000000002.33.1, 00000000002.23.1, 00000000004.25.6, 00000000002.26.1, 00000000002.27.1, 00000000002.34.1] 2024-04-16T18:07:57.981 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.33.6, 00000000002.26.1, 00000000004.42.6, 00000000002.22.1, 00000000004.33.6, 00000000002.33.1, 00000000002.23.1, 00000000004.25.6, 00000000002.26.1, 00000000002.27.1, 00000000002.34.1] 2024-04-16T18:07:57.981 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:07:57.981+0000 7fa588416800 0 bucket checkpoint complete 2024-04-16T18:07:58.007 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-38 2024-04-16T18:07:58.007 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:58.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-38', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:07:58.008 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-38 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:07:58.071 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:07:58.071 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:07:58.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:07:58.134+0000 7fec9572d800 1 waiting for incremental sync to catch up: 2024-04-16T18:07:58.134 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.260.6, , 00000000001.190.6, , 00000000001.392.6, , , 00000000001.204.6, , , ] 2024-04-16T18:07:58.134 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000002.279.6, , 00000000002.211.6, , 00000000002.402.6, , , 00000000002.214.6, , , ] 2024-04-16T18:08:03.135 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:03.136+0000 7fec9572d800 1 waiting for incremental sync to catch up: 2024-04-16T18:08:03.136 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.260.6, , 00000000001.190.6, , 00000000001.392.6, , , 00000000001.204.6, , , ] 2024-04-16T18:08:03.136 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000002.279.6, , 00000000002.211.6, , 00000000002.402.6, , , 00000000002.214.6, , , ] 2024-04-16T18:08:08.136 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:08.138+0000 7fec9572d800 1 waiting for incremental sync to catch up: 2024-04-16T18:08:08.136 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000002.279.6, , 00000000001.190.6, , 00000000002.402.6, , , 00000000002.214.6, , , ] 2024-04-16T18:08:08.137 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000002.279.6, , 00000000002.211.6, , 00000000002.402.6, , , 00000000002.214.6, , , ] 2024-04-16T18:08:13.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:13.139+0000 7fec9572d800 1 bucket sync caught up with source: 2024-04-16T18:08:13.138 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000002.279.6, , 00000000002.211.6, , 00000000002.402.6, , , 00000000002.214.6, , , ] 2024-04-16T18:08:13.138 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000002.279.6, , 00000000002.211.6, , 00000000002.402.6, , , 00000000002.214.6, , , ] 2024-04-16T18:08:13.138 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:13.139+0000 7fec9572d800 0 bucket checkpoint complete 2024-04-16T18:08:13.164 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-38 zones={test-zone2, test-zone1} 2024-04-16T18:08:13.164 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.165 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.165 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.165 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:08:13.165 DEBUG:boto:Data: 2024-04-16T18:08:13.165 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.165 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.165 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.165 DEBUG:boto:Params: {} 2024-04-16T18:08:13.165 DEBUG:boto:Token: None 2024-04-16T18:08:13.166 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j2Kq4ojC8bYgn6J0wyU2Z1yytHA= 2024-04-16T18:08:13.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j2Kq4ojC8bYgn6J0wyU2Z1yytHA=', 'Content-Length': '0'} 2024-04-16T18:08:13.169 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d800135c79f15c49-00661ebe8d-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.169 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.169 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.169 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.170 DEBUG:boto:Path: /cjqttm-38/ 2024-04-16T18:08:13.170 DEBUG:boto:Data: 2024-04-16T18:08:13.170 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.170 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.170 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.170 DEBUG:boto:Params: {} 2024-04-16T18:08:13.170 DEBUG:boto:Token: None 2024-04-16T18:08:13.170 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j2Kq4ojC8bYgn6J0wyU2Z1yytHA= 2024-04-16T18:08:13.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j2Kq4ojC8bYgn6J0wyU2Z1yytHA=', 'Content-Length': '0'} 2024-04-16T18:08:13.173 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae60eacf802ece89-00661ebe8d-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.173 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:08:13.173 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.173 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.173 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.173 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.174 DEBUG:boto:Method: GET 2024-04-16T18:08:13.174 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.174 DEBUG:boto:Data: 2024-04-16T18:08:13.174 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.174 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.174 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.174 DEBUG:boto:Params: {} 2024-04-16T18:08:13.174 DEBUG:boto:Token: None 2024-04-16T18:08:13.174 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/?versions 2024-04-16T18:08:13.174 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k= 2024-04-16T18:08:13.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k=', 'Content-Length': '0'} 2024-04-16T18:08:13.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000578b02cd709f584b-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.177 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.178 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:13.178 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:13.178 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:13.178 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:13.179 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:13.179 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:13.179 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:13.179 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:13.179 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:08:13.179 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.179 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.179 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.179 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.179 DEBUG:boto:Method: GET 2024-04-16T18:08:13.179 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.179 DEBUG:boto:Data: 2024-04-16T18:08:13.180 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.180 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.180 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.180 DEBUG:boto:Params: {} 2024-04-16T18:08:13.180 DEBUG:boto:Token: None 2024-04-16T18:08:13.180 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/?versions 2024-04-16T18:08:13.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k= 2024-04-16T18:08:13.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k=', 'Content-Length': '0'} 2024-04-16T18:08:13.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008fd68f665f694636-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.182 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:13.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:13.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:13.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:13.183 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:13.184 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:13.184 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:13.184 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:13.184 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.184 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.184 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.184 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.184 DEBUG:boto:Method: GET 2024-04-16T18:08:13.184 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.184 DEBUG:boto:Data: 2024-04-16T18:08:13.184 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.184 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.185 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.185 DEBUG:boto:Params: {} 2024-04-16T18:08:13.185 DEBUG:boto:Token: None 2024-04-16T18:08:13.185 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/?versions 2024-04-16T18:08:13.185 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k= 2024-04-16T18:08:13.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k=', 'Content-Length': '0'} 2024-04-16T18:08:13.188 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d892f1544bfb6e90-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.188 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.188 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.189 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.189 DEBUG:boto:path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.189 DEBUG:boto:auth_path=/cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.189 DEBUG:boto:Method: GET 2024-04-16T18:08:13.189 DEBUG:boto:Path: /cjqttm-38/?versions&max-keys=999 2024-04-16T18:08:13.189 DEBUG:boto:Data: 2024-04-16T18:08:13.189 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.189 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.189 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.189 DEBUG:boto:Params: {} 2024-04-16T18:08:13.189 DEBUG:boto:Token: None 2024-04-16T18:08:13.190 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/?versions 2024-04-16T18:08:13.190 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k= 2024-04-16T18:08:13.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fq7Pl8rEaYZNtE1ihKN3xldgH1k=', 'Content-Length': '0'} 2024-04-16T18:08:13.192 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6780a616c065129-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.192 DEBUG:boto:b'cjqttm-38999falseobj1nulltrue2024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:13.193 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.193 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.193 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.193 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.193 DEBUG:boto:Method: GET 2024-04-16T18:08:13.193 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.193 DEBUG:boto:Data: 2024-04-16T18:08:13.193 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.193 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.193 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.194 DEBUG:boto:Params: {} 2024-04-16T18:08:13.194 DEBUG:boto:Token: None 2024-04-16T18:08:13.194 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.194 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY= 2024-04-16T18:08:13.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY=', 'Content-Length': '0'} 2024-04-16T18:08:13.196 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000063bcde63fa672374-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.196 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.196 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.196 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.196 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.197 DEBUG:boto:Method: GET 2024-04-16T18:08:13.197 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.197 DEBUG:boto:Data: 2024-04-16T18:08:13.197 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.197 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.197 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.197 DEBUG:boto:Params: {} 2024-04-16T18:08:13.197 DEBUG:boto:Token: None 2024-04-16T18:08:13.197 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.198 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY= 2024-04-16T18:08:13.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY=', 'Content-Length': '0'} 2024-04-16T18:08:13.200 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000029ee98c4b725649b-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.200 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.200 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.200 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.200 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.200 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.200 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.201 DEBUG:boto:Data: 2024-04-16T18:08:13.201 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.201 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.201 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.201 DEBUG:boto:Params: {} 2024-04-16T18:08:13.201 DEBUG:boto:Token: None 2024-04-16T18:08:13.201 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:caFM5NDdpIwk8MS8P5uTiTdnFIY= 2024-04-16T18:08:13.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:caFM5NDdpIwk8MS8P5uTiTdnFIY=', 'Content-Length': '0'} 2024-04-16T18:08:13.203 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000014a9cb4e5c1e4709-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.203 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.204 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.204 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.204 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.204 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.204 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.204 DEBUG:boto:Data: 2024-04-16T18:08:13.204 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.204 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.204 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.204 DEBUG:boto:Params: {} 2024-04-16T18:08:13.204 DEBUG:boto:Token: None 2024-04-16T18:08:13.205 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.205 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:caFM5NDdpIwk8MS8P5uTiTdnFIY= 2024-04-16T18:08:13.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:caFM5NDdpIwk8MS8P5uTiTdnFIY=', 'Content-Length': '0'} 2024-04-16T18:08:13.206 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001fc128d205b9e692-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:13.207 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.207 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.207 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.207 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.207 DEBUG:boto:Method: GET 2024-04-16T18:08:13.207 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.207 DEBUG:boto:Data: 2024-04-16T18:08:13.207 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.207 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.207 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.207 DEBUG:boto:Params: {} 2024-04-16T18:08:13.208 DEBUG:boto:Token: None 2024-04-16T18:08:13.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY= 2024-04-16T18:08:13.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY=', 'Content-Length': '0'} 2024-04-16T18:08:13.210 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e05c65c022ca61c5-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.210 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.210 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.210 DEBUG:boto:path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.210 DEBUG:boto:auth_path=/cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.210 DEBUG:boto:Method: GET 2024-04-16T18:08:13.211 DEBUG:boto:Path: /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.211 DEBUG:boto:Data: 2024-04-16T18:08:13.211 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.211 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.211 DEBUG:boto:Params: {} 2024-04-16T18:08:13.211 DEBUG:boto:Token: None 2024-04-16T18:08:13.211 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1?versionId=null 2024-04-16T18:08:13.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY= 2024-04-16T18:08:13.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+vUow4mQ7rx5QEkCPOq7Or0tvwY=', 'Content-Length': '0'} 2024-04-16T18:08:13.213 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eda7e9c79f2e7013-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.254 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.254 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.255 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.255 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.255 DEBUG:boto:Method: GET 2024-04-16T18:08:13.255 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.255 DEBUG:boto:Data: 2024-04-16T18:08:13.255 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.255 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.255 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.255 DEBUG:boto:Params: {} 2024-04-16T18:08:13.255 DEBUG:boto:Token: None 2024-04-16T18:08:13.255 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.259 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000571054aa860d18af-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.259 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.259 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.259 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.259 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.259 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.260 DEBUG:boto:Method: GET 2024-04-16T18:08:13.260 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.260 DEBUG:boto:Data: 2024-04-16T18:08:13.260 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.260 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.260 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.260 DEBUG:boto:Params: {} 2024-04-16T18:08:13.260 DEBUG:boto:Token: None 2024-04-16T18:08:13.260 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.263 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f56f66c4f3ce51d5-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.263 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.263 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.263 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.263 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.263 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:08:13.264 DEBUG:boto:Data: 2024-04-16T18:08:13.264 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.264 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.264 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.264 DEBUG:boto:Params: {} 2024-04-16T18:08:13.264 DEBUG:boto:Token: None 2024-04-16T18:08:13.264 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1 2024-04-16T18:08:13.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u7G4uTbaenL33v8izvVo6bTa/xc= 2024-04-16T18:08:13.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u7G4uTbaenL33v8izvVo6bTa/xc=', 'Content-Length': '0'} 2024-04-16T18:08:13.266 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fd0c3bbd681f12f9-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.266 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.267 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.267 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.267 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:08:13.267 DEBUG:boto:Data: 2024-04-16T18:08:13.267 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.267 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.267 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.267 DEBUG:boto:Params: {} 2024-04-16T18:08:13.267 DEBUG:boto:Token: None 2024-04-16T18:08:13.267 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1 2024-04-16T18:08:13.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u7G4uTbaenL33v8izvVo6bTa/xc= 2024-04-16T18:08:13.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u7G4uTbaenL33v8izvVo6bTa/xc=', 'Content-Length': '0'} 2024-04-16T18:08:13.269 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c45d9faaabc7c0b1-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:13.270 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.270 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.270 DEBUG:boto:Method: GET 2024-04-16T18:08:13.270 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:08:13.270 DEBUG:boto:Data: 2024-04-16T18:08:13.270 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.270 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.271 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.271 DEBUG:boto:Params: {} 2024-04-16T18:08:13.271 DEBUG:boto:Token: None 2024-04-16T18:08:13.271 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1 2024-04-16T18:08:13.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H9/QXtisKIq6OYaBPP1LMyIwrWE= 2024-04-16T18:08:13.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H9/QXtisKIq6OYaBPP1LMyIwrWE=', 'Content-Length': '0'} 2024-04-16T18:08:13.273 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000076c8c417126235bb-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.314 DEBUG:boto:path=/cjqttm-38/obj1 2024-04-16T18:08:13.314 DEBUG:boto:auth_path=/cjqttm-38/obj1 2024-04-16T18:08:13.315 DEBUG:boto:Method: GET 2024-04-16T18:08:13.315 DEBUG:boto:Path: /cjqttm-38/obj1 2024-04-16T18:08:13.315 DEBUG:boto:Data: 2024-04-16T18:08:13.315 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.315 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.315 DEBUG:boto:Params: {} 2024-04-16T18:08:13.315 DEBUG:boto:Token: None 2024-04-16T18:08:13.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj1 2024-04-16T18:08:13.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H9/QXtisKIq6OYaBPP1LMyIwrWE= 2024-04-16T18:08:13.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H9/QXtisKIq6OYaBPP1LMyIwrWE=', 'Content-Length': '0'} 2024-04-16T18:08:13.318 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e82ca5c575bfbbe0-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.318 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.318 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.318 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.318 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.318 DEBUG:boto:Method: GET 2024-04-16T18:08:13.318 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.318 DEBUG:boto:Data: 2024-04-16T18:08:13.319 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.319 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.319 DEBUG:boto:Params: {} 2024-04-16T18:08:13.319 DEBUG:boto:Token: None 2024-04-16T18:08:13.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.321 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1d7fbdd8e547dd9-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.322 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.322 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.322 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.322 DEBUG:boto:path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.322 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.322 DEBUG:boto:Method: GET 2024-04-16T18:08:13.322 DEBUG:boto:Path: /cjqttm-38/?prefix=obj1 2024-04-16T18:08:13.323 DEBUG:boto:Data: 2024-04-16T18:08:13.323 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.323 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.323 DEBUG:boto:Params: {} 2024-04-16T18:08:13.323 DEBUG:boto:Token: None 2024-04-16T18:08:13.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.326 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000164b65a206cd9f58-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.326 DEBUG:boto:b'cjqttm-38obj11000falseobj12024-04-16T18:07:39.716Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.326 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:13.326 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.326 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.326 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.327 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.327 DEBUG:boto:Method: GET 2024-04-16T18:08:13.327 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.327 DEBUG:boto:Data: 2024-04-16T18:08:13.327 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.327 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.327 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.327 DEBUG:boto:Params: {} 2024-04-16T18:08:13.327 DEBUG:boto:Token: None 2024-04-16T18:08:13.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs= 2024-04-16T18:08:13.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs=', 'Content-Length': '0'} 2024-04-16T18:08:13.329 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000775344919a2a0932-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.370 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.371 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.371 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.371 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.371 DEBUG:boto:Method: GET 2024-04-16T18:08:13.371 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.371 DEBUG:boto:Data: 2024-04-16T18:08:13.371 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.371 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.371 DEBUG:boto:Params: {} 2024-04-16T18:08:13.371 DEBUG:boto:Token: None 2024-04-16T18:08:13.372 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs= 2024-04-16T18:08:13.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs=', 'Content-Length': '0'} 2024-04-16T18:08:13.374 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000090a89fbc1a7dc044-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.374 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.374 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.374 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.374 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.375 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.375 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.375 DEBUG:boto:Data: 2024-04-16T18:08:13.375 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.375 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.375 DEBUG:boto:Params: {} 2024-04-16T18:08:13.375 DEBUG:boto:Token: None 2024-04-16T18:08:13.375 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ASB1RFq5vWa95HebvIj5wKNZSno= 2024-04-16T18:08:13.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ASB1RFq5vWa95HebvIj5wKNZSno=', 'Content-Length': '0'} 2024-04-16T18:08:13.378 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000671808ff198ec8b3-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.378 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.378 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.378 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.378 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.378 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.378 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.378 DEBUG:boto:Data: 2024-04-16T18:08:13.379 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.379 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.379 DEBUG:boto:Params: {} 2024-04-16T18:08:13.379 DEBUG:boto:Token: None 2024-04-16T18:08:13.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ASB1RFq5vWa95HebvIj5wKNZSno= 2024-04-16T18:08:13.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ASB1RFq5vWa95HebvIj5wKNZSno=', 'Content-Length': '0'} 2024-04-16T18:08:13.381 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b5154771bbb8c3e3-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.381 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:13.381 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.381 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.382 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.382 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.382 DEBUG:boto:Method: GET 2024-04-16T18:08:13.382 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.382 DEBUG:boto:Data: 2024-04-16T18:08:13.382 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.382 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.382 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.382 DEBUG:boto:Params: {} 2024-04-16T18:08:13.382 DEBUG:boto:Token: None 2024-04-16T18:08:13.382 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs= 2024-04-16T18:08:13.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs=', 'Content-Length': '0'} 2024-04-16T18:08:13.384 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000be5e67f0567ced7a-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.426 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.427 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.427 DEBUG:boto:path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.427 DEBUG:boto:auth_path=/cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.427 DEBUG:boto:Method: GET 2024-04-16T18:08:13.427 DEBUG:boto:Path: /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.427 DEBUG:boto:Data: 2024-04-16T18:08:13.427 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.427 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.427 DEBUG:boto:Params: {} 2024-04-16T18:08:13.427 DEBUG:boto:Token: None 2024-04-16T18:08:13.428 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2?versionId=null 2024-04-16T18:08:13.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs= 2024-04-16T18:08:13.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FTJemmBBEFlMmoLaRzc/gw6JHJs=', 'Content-Length': '0'} 2024-04-16T18:08:13.430 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001929c210a4612760-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.430 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.430 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.430 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.430 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.431 DEBUG:boto:Method: GET 2024-04-16T18:08:13.431 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.431 DEBUG:boto:Data: 2024-04-16T18:08:13.431 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.431 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.431 DEBUG:boto:Params: {} 2024-04-16T18:08:13.431 DEBUG:boto:Token: None 2024-04-16T18:08:13.431 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.431 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d80a0dbf97fc590-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.474 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.475 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.475 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.475 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.475 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.475 DEBUG:boto:Method: GET 2024-04-16T18:08:13.475 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.475 DEBUG:boto:Data: 2024-04-16T18:08:13.475 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.476 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.476 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.476 DEBUG:boto:Params: {} 2024-04-16T18:08:13.476 DEBUG:boto:Token: None 2024-04-16T18:08:13.476 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.478 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a9fd1e2da9c2e5a-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.479 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.479 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.479 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.479 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.479 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:08:13.479 DEBUG:boto:Data: 2024-04-16T18:08:13.479 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.480 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.480 DEBUG:boto:Params: {} 2024-04-16T18:08:13.480 DEBUG:boto:Token: None 2024-04-16T18:08:13.480 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2 2024-04-16T18:08:13.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P/j1mj7sehFZC7jMtSAZKn4LjC8= 2024-04-16T18:08:13.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P/j1mj7sehFZC7jMtSAZKn4LjC8=', 'Content-Length': '0'} 2024-04-16T18:08:13.482 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f7e9a64439c6d48-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.482 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.482 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.482 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.482 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:08:13.482 DEBUG:boto:Data: 2024-04-16T18:08:13.482 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.483 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.483 DEBUG:boto:Params: {} 2024-04-16T18:08:13.483 DEBUG:boto:Token: None 2024-04-16T18:08:13.483 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2 2024-04-16T18:08:13.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P/j1mj7sehFZC7jMtSAZKn4LjC8= 2024-04-16T18:08:13.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P/j1mj7sehFZC7jMtSAZKn4LjC8=', 'Content-Length': '0'} 2024-04-16T18:08:13.485 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000573861ab1049a66-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.485 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:13.485 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.485 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.486 DEBUG:boto:Method: GET 2024-04-16T18:08:13.486 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:08:13.486 DEBUG:boto:Data: 2024-04-16T18:08:13.486 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.486 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.486 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.486 DEBUG:boto:Params: {} 2024-04-16T18:08:13.486 DEBUG:boto:Token: None 2024-04-16T18:08:13.486 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2 2024-04-16T18:08:13.486 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uhinkjEHA4O2ZkV+2m9bngNFflE= 2024-04-16T18:08:13.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uhinkjEHA4O2ZkV+2m9bngNFflE=', 'Content-Length': '0'} 2024-04-16T18:08:13.488 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001aa3217bad4a7ed1-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.530 DEBUG:boto:path=/cjqttm-38/obj2 2024-04-16T18:08:13.530 DEBUG:boto:auth_path=/cjqttm-38/obj2 2024-04-16T18:08:13.531 DEBUG:boto:Method: GET 2024-04-16T18:08:13.531 DEBUG:boto:Path: /cjqttm-38/obj2 2024-04-16T18:08:13.531 DEBUG:boto:Data: 2024-04-16T18:08:13.531 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.531 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.531 DEBUG:boto:Params: {} 2024-04-16T18:08:13.531 DEBUG:boto:Token: None 2024-04-16T18:08:13.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj2 2024-04-16T18:08:13.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uhinkjEHA4O2ZkV+2m9bngNFflE= 2024-04-16T18:08:13.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uhinkjEHA4O2ZkV+2m9bngNFflE=', 'Content-Length': '0'} 2024-04-16T18:08:13.533 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000894457ef26c3106d-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.534 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.534 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.534 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.534 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.534 DEBUG:boto:Method: GET 2024-04-16T18:08:13.534 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.534 DEBUG:boto:Data: 2024-04-16T18:08:13.534 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.534 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.534 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.535 DEBUG:boto:Params: {} 2024-04-16T18:08:13.535 DEBUG:boto:Token: None 2024-04-16T18:08:13.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000daaec517a563b1bd-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.538 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.538 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.538 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.538 DEBUG:boto:path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.538 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.538 DEBUG:boto:Method: GET 2024-04-16T18:08:13.539 DEBUG:boto:Path: /cjqttm-38/?prefix=obj2 2024-04-16T18:08:13.539 DEBUG:boto:Data: 2024-04-16T18:08:13.539 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.539 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.539 DEBUG:boto:Params: {} 2024-04-16T18:08:13.539 DEBUG:boto:Token: None 2024-04-16T18:08:13.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4c0f2cfdc0914a9-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.542 DEBUG:boto:b'cjqttm-38obj21000falseobj22024-04-16T18:07:39.726Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:13.542 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.542 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.542 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.543 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.543 DEBUG:boto:Method: GET 2024-04-16T18:08:13.543 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.543 DEBUG:boto:Data: 2024-04-16T18:08:13.543 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.543 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.543 DEBUG:boto:Params: {} 2024-04-16T18:08:13.543 DEBUG:boto:Token: None 2024-04-16T18:08:13.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug= 2024-04-16T18:08:13.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug=', 'Content-Length': '0'} 2024-04-16T18:08:13.545 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dd425826e84ce3b7-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.586 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.587 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.587 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.587 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.587 DEBUG:boto:Method: GET 2024-04-16T18:08:13.587 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.587 DEBUG:boto:Data: 2024-04-16T18:08:13.587 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.587 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.587 DEBUG:boto:Params: {} 2024-04-16T18:08:13.587 DEBUG:boto:Token: None 2024-04-16T18:08:13.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug= 2024-04-16T18:08:13.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug=', 'Content-Length': '0'} 2024-04-16T18:08:13.590 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c83dc2b77c818d6d-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.590 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.591 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.591 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.591 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.591 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.591 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.591 DEBUG:boto:Data: 2024-04-16T18:08:13.591 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.591 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.591 DEBUG:boto:Params: {} 2024-04-16T18:08:13.592 DEBUG:boto:Token: None 2024-04-16T18:08:13.592 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PYyoiLnMk06a4vqEpUzbr1w2VkY= 2024-04-16T18:08:13.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PYyoiLnMk06a4vqEpUzbr1w2VkY=', 'Content-Length': '0'} 2024-04-16T18:08:13.594 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006c3388af25d8c6d0-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.594 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.594 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.595 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.595 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.595 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.595 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.595 DEBUG:boto:Data: 2024-04-16T18:08:13.595 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.595 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.595 DEBUG:boto:Params: {} 2024-04-16T18:08:13.595 DEBUG:boto:Token: None 2024-04-16T18:08:13.595 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PYyoiLnMk06a4vqEpUzbr1w2VkY= 2024-04-16T18:08:13.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PYyoiLnMk06a4vqEpUzbr1w2VkY=', 'Content-Length': '0'} 2024-04-16T18:08:13.598 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000026c9cad7f921d585-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.598 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:13.598 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.598 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.598 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.599 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.599 DEBUG:boto:Method: GET 2024-04-16T18:08:13.599 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.599 DEBUG:boto:Data: 2024-04-16T18:08:13.599 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.599 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.599 DEBUG:boto:Params: {} 2024-04-16T18:08:13.599 DEBUG:boto:Token: None 2024-04-16T18:08:13.599 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug= 2024-04-16T18:08:13.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug=', 'Content-Length': '0'} 2024-04-16T18:08:13.602 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ba9ed00a36604f26-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.642 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.642 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.643 DEBUG:boto:path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.643 DEBUG:boto:auth_path=/cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.643 DEBUG:boto:Method: GET 2024-04-16T18:08:13.643 DEBUG:boto:Path: /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.643 DEBUG:boto:Data: 2024-04-16T18:08:13.643 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.643 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.643 DEBUG:boto:Params: {} 2024-04-16T18:08:13.643 DEBUG:boto:Token: None 2024-04-16T18:08:13.644 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3?versionId=null 2024-04-16T18:08:13.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug= 2024-04-16T18:08:13.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iPpcRzi+dUOHJvdG92eNjSS7Zug=', 'Content-Length': '0'} 2024-04-16T18:08:13.646 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005df2b4685a7b06ab-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.646 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.646 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.646 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.646 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.646 DEBUG:boto:Method: GET 2024-04-16T18:08:13.646 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.647 DEBUG:boto:Data: 2024-04-16T18:08:13.647 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.647 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.647 DEBUG:boto:Params: {} 2024-04-16T18:08:13.647 DEBUG:boto:Token: None 2024-04-16T18:08:13.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f82eaf05a1127a71-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.650 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.650 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.650 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.650 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.651 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.651 DEBUG:boto:Method: GET 2024-04-16T18:08:13.651 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.651 DEBUG:boto:Data: 2024-04-16T18:08:13.651 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.651 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.651 DEBUG:boto:Params: {} 2024-04-16T18:08:13.651 DEBUG:boto:Token: None 2024-04-16T18:08:13.651 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025d31457726d51e3-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.654 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.654 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.654 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.654 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.655 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:08:13.655 DEBUG:boto:Data: 2024-04-16T18:08:13.655 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.655 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.655 DEBUG:boto:Params: {} 2024-04-16T18:08:13.655 DEBUG:boto:Token: None 2024-04-16T18:08:13.655 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3 2024-04-16T18:08:13.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VNo/m0lgQZfUTiQ6tJNUVxMPXB8= 2024-04-16T18:08:13.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VNo/m0lgQZfUTiQ6tJNUVxMPXB8=', 'Content-Length': '0'} 2024-04-16T18:08:13.658 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008486de6752cd5240-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.658 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.658 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.658 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.658 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:08:13.658 DEBUG:boto:Data: 2024-04-16T18:08:13.658 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.658 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.659 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.659 DEBUG:boto:Params: {} 2024-04-16T18:08:13.659 DEBUG:boto:Token: None 2024-04-16T18:08:13.659 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3 2024-04-16T18:08:13.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VNo/m0lgQZfUTiQ6tJNUVxMPXB8= 2024-04-16T18:08:13.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VNo/m0lgQZfUTiQ6tJNUVxMPXB8=', 'Content-Length': '0'} 2024-04-16T18:08:13.661 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000260408c60da88586-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:13.662 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.662 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.662 DEBUG:boto:Method: GET 2024-04-16T18:08:13.662 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:08:13.662 DEBUG:boto:Data: 2024-04-16T18:08:13.662 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.662 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.662 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.662 DEBUG:boto:Params: {} 2024-04-16T18:08:13.662 DEBUG:boto:Token: None 2024-04-16T18:08:13.662 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3 2024-04-16T18:08:13.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tMF9ybrjtzDIorO/AXLb4r7t0K0= 2024-04-16T18:08:13.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tMF9ybrjtzDIorO/AXLb4r7t0K0=', 'Content-Length': '0'} 2024-04-16T18:08:13.665 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008eeacb6175f40cd2-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.706 DEBUG:boto:path=/cjqttm-38/obj3 2024-04-16T18:08:13.706 DEBUG:boto:auth_path=/cjqttm-38/obj3 2024-04-16T18:08:13.706 DEBUG:boto:Method: GET 2024-04-16T18:08:13.707 DEBUG:boto:Path: /cjqttm-38/obj3 2024-04-16T18:08:13.707 DEBUG:boto:Data: 2024-04-16T18:08:13.707 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.707 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.707 DEBUG:boto:Params: {} 2024-04-16T18:08:13.707 DEBUG:boto:Token: None 2024-04-16T18:08:13.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj3 2024-04-16T18:08:13.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tMF9ybrjtzDIorO/AXLb4r7t0K0= 2024-04-16T18:08:13.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tMF9ybrjtzDIorO/AXLb4r7t0K0=', 'Content-Length': '0'} 2024-04-16T18:08:13.709 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a3308b1d0350cfb-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.710 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.710 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.710 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.710 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.710 DEBUG:boto:Method: GET 2024-04-16T18:08:13.710 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.710 DEBUG:boto:Data: 2024-04-16T18:08:13.710 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.710 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.711 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.711 DEBUG:boto:Params: {} 2024-04-16T18:08:13.711 DEBUG:boto:Token: None 2024-04-16T18:08:13.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c8db8af467a96c3-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.714 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.714 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.714 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.714 DEBUG:boto:path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.714 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.714 DEBUG:boto:Method: GET 2024-04-16T18:08:13.714 DEBUG:boto:Path: /cjqttm-38/?prefix=obj3 2024-04-16T18:08:13.715 DEBUG:boto:Data: 2024-04-16T18:08:13.715 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.715 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.715 DEBUG:boto:Params: {} 2024-04-16T18:08:13.715 DEBUG:boto:Token: None 2024-04-16T18:08:13.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000640c405ab07a9886-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.718 DEBUG:boto:b'cjqttm-38obj31000falseobj32024-04-16T18:07:39.735Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.718 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:13.718 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.718 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.718 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.718 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.718 DEBUG:boto:Method: GET 2024-04-16T18:08:13.719 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.719 DEBUG:boto:Data: 2024-04-16T18:08:13.719 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.719 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.719 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.719 DEBUG:boto:Params: {} 2024-04-16T18:08:13.719 DEBUG:boto:Token: None 2024-04-16T18:08:13.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik= 2024-04-16T18:08:13.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik=', 'Content-Length': '0'} 2024-04-16T18:08:13.722 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001a570da729270596-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.762 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.762 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.763 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.763 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.763 DEBUG:boto:Method: GET 2024-04-16T18:08:13.763 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.763 DEBUG:boto:Data: 2024-04-16T18:08:13.763 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.763 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.763 DEBUG:boto:Params: {} 2024-04-16T18:08:13.763 DEBUG:boto:Token: None 2024-04-16T18:08:13.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik= 2024-04-16T18:08:13.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik=', 'Content-Length': '0'} 2024-04-16T18:08:13.766 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d9c1a18907ac6a9-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.766 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.766 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.766 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.766 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.767 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.767 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.767 DEBUG:boto:Data: 2024-04-16T18:08:13.767 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.767 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.767 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.767 DEBUG:boto:Params: {} 2024-04-16T18:08:13.767 DEBUG:boto:Token: None 2024-04-16T18:08:13.767 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.767 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4yw3dZeeOj7Ri5NAvFh3vkOM8DA= 2024-04-16T18:08:13.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4yw3dZeeOj7Ri5NAvFh3vkOM8DA=', 'Content-Length': '0'} 2024-04-16T18:08:13.769 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e23bce3bffd60b89-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.770 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.770 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.770 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.770 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.770 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.770 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.770 DEBUG:boto:Data: 2024-04-16T18:08:13.770 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.770 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.771 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.771 DEBUG:boto:Params: {} 2024-04-16T18:08:13.771 DEBUG:boto:Token: None 2024-04-16T18:08:13.771 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4yw3dZeeOj7Ri5NAvFh3vkOM8DA= 2024-04-16T18:08:13.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4yw3dZeeOj7Ri5NAvFh3vkOM8DA=', 'Content-Length': '0'} 2024-04-16T18:08:13.773 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000350c8158bbcea870-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:13.773 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.774 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.774 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.774 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.774 DEBUG:boto:Method: GET 2024-04-16T18:08:13.774 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.774 DEBUG:boto:Data: 2024-04-16T18:08:13.774 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.774 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.774 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.774 DEBUG:boto:Params: {} 2024-04-16T18:08:13.775 DEBUG:boto:Token: None 2024-04-16T18:08:13.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik= 2024-04-16T18:08:13.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik=', 'Content-Length': '0'} 2024-04-16T18:08:13.777 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f0c19356265d61f2-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.818 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.818 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.818 DEBUG:boto:path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.819 DEBUG:boto:auth_path=/cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.819 DEBUG:boto:Method: GET 2024-04-16T18:08:13.819 DEBUG:boto:Path: /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.819 DEBUG:boto:Data: 2024-04-16T18:08:13.819 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.819 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.819 DEBUG:boto:Params: {} 2024-04-16T18:08:13.819 DEBUG:boto:Token: None 2024-04-16T18:08:13.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4?versionId=null 2024-04-16T18:08:13.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik= 2024-04-16T18:08:13.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y3GCqd+0UDLFdoyY5bvH871DXik=', 'Content-Length': '0'} 2024-04-16T18:08:13.822 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f9450bc6e3000e58-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.822 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.822 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.822 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.822 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.822 DEBUG:boto:Method: GET 2024-04-16T18:08:13.823 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.823 DEBUG:boto:Data: 2024-04-16T18:08:13.823 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.823 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.823 DEBUG:boto:Params: {} 2024-04-16T18:08:13.823 DEBUG:boto:Token: None 2024-04-16T18:08:13.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000affa04d2cec01fb0-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.826 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.826 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.827 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.827 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.827 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.827 DEBUG:boto:Method: GET 2024-04-16T18:08:13.827 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.827 DEBUG:boto:Data: 2024-04-16T18:08:13.827 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.827 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.827 DEBUG:boto:Params: {} 2024-04-16T18:08:13.827 DEBUG:boto:Token: None 2024-04-16T18:08:13.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.830 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001496f4c732e52ef-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.830 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.830 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.830 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.831 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.831 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:08:13.831 DEBUG:boto:Data: 2024-04-16T18:08:13.831 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.831 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.831 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.831 DEBUG:boto:Params: {} 2024-04-16T18:08:13.831 DEBUG:boto:Token: None 2024-04-16T18:08:13.831 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4 2024-04-16T18:08:13.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YJXWzhNoqa1xlQmfVyJi1FlaItM= 2024-04-16T18:08:13.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YJXWzhNoqa1xlQmfVyJi1FlaItM=', 'Content-Length': '0'} 2024-04-16T18:08:13.833 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a7422a1634ac251c-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.833 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.834 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.834 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.834 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:08:13.834 DEBUG:boto:Data: 2024-04-16T18:08:13.834 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.834 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.834 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.834 DEBUG:boto:Params: {} 2024-04-16T18:08:13.834 DEBUG:boto:Token: None 2024-04-16T18:08:13.835 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4 2024-04-16T18:08:13.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YJXWzhNoqa1xlQmfVyJi1FlaItM= 2024-04-16T18:08:13.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YJXWzhNoqa1xlQmfVyJi1FlaItM=', 'Content-Length': '0'} 2024-04-16T18:08:13.837 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d98e73cbc8724c9d-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.837 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:13.837 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.837 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.837 DEBUG:boto:Method: GET 2024-04-16T18:08:13.838 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:08:13.838 DEBUG:boto:Data: 2024-04-16T18:08:13.838 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.838 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.838 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.838 DEBUG:boto:Params: {} 2024-04-16T18:08:13.838 DEBUG:boto:Token: None 2024-04-16T18:08:13.838 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4 2024-04-16T18:08:13.838 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xyPGAfyeg0dJvHkTxxzn1xJj8EQ= 2024-04-16T18:08:13.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xyPGAfyeg0dJvHkTxxzn1xJj8EQ=', 'Content-Length': '0'} 2024-04-16T18:08:13.841 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e2c4a9e62fe1482-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.882 DEBUG:boto:path=/cjqttm-38/obj4 2024-04-16T18:08:13.882 DEBUG:boto:auth_path=/cjqttm-38/obj4 2024-04-16T18:08:13.883 DEBUG:boto:Method: GET 2024-04-16T18:08:13.883 DEBUG:boto:Path: /cjqttm-38/obj4 2024-04-16T18:08:13.883 DEBUG:boto:Data: 2024-04-16T18:08:13.883 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.883 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.883 DEBUG:boto:Params: {} 2024-04-16T18:08:13.883 DEBUG:boto:Token: None 2024-04-16T18:08:13.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj4 2024-04-16T18:08:13.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xyPGAfyeg0dJvHkTxxzn1xJj8EQ= 2024-04-16T18:08:13.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xyPGAfyeg0dJvHkTxxzn1xJj8EQ=', 'Content-Length': '0'} 2024-04-16T18:08:13.886 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000584cbc624a963d24-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.886 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.886 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.887 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.887 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.887 DEBUG:boto:Method: GET 2024-04-16T18:08:13.887 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.887 DEBUG:boto:Data: 2024-04-16T18:08:13.887 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.887 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.887 DEBUG:boto:Params: {} 2024-04-16T18:08:13.887 DEBUG:boto:Token: None 2024-04-16T18:08:13.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdd272850f734195-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.890 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.890 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.890 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.891 DEBUG:boto:path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.891 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.891 DEBUG:boto:Method: GET 2024-04-16T18:08:13.891 DEBUG:boto:Path: /cjqttm-38/?prefix=obj4 2024-04-16T18:08:13.891 DEBUG:boto:Data: 2024-04-16T18:08:13.891 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.891 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.891 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.891 DEBUG:boto:Params: {} 2024-04-16T18:08:13.891 DEBUG:boto:Token: None 2024-04-16T18:08:13.891 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:13.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:13.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:13.894 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b97b6e41471c2ee1-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.894 DEBUG:boto:b'cjqttm-38obj41000falseobj42024-04-16T18:07:39.783Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:13.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:13.895 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:13.895 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:13.895 DEBUG:boto:path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.895 DEBUG:boto:auth_path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.895 DEBUG:boto:Method: GET 2024-04-16T18:08:13.895 DEBUG:boto:Path: /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.895 DEBUG:boto:Data: 2024-04-16T18:08:13.895 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.895 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.895 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.895 DEBUG:boto:Params: {} 2024-04-16T18:08:13.895 DEBUG:boto:Token: None 2024-04-16T18:08:13.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg= 2024-04-16T18:08:13.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg=', 'Content-Length': '0'} 2024-04-16T18:08:13.898 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b80acf0fbb17d498-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.938 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:13.938 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:13.939 DEBUG:boto:path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.939 DEBUG:boto:auth_path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.939 DEBUG:boto:Method: GET 2024-04-16T18:08:13.939 DEBUG:boto:Path: /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.939 DEBUG:boto:Data: 2024-04-16T18:08:13.939 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.939 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.939 DEBUG:boto:Params: {} 2024-04-16T18:08:13.939 DEBUG:boto:Token: None 2024-04-16T18:08:13.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg= 2024-04-16T18:08:13.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg=', 'Content-Length': '0'} 2024-04-16T18:08:13.942 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a8042b363353d923-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.942 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:13.942 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:13.942 DEBUG:boto:path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.942 DEBUG:boto:auth_path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.943 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.943 DEBUG:boto:Path: /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.943 DEBUG:boto:Data: 2024-04-16T18:08:13.943 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.943 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.943 DEBUG:boto:Params: {} 2024-04-16T18:08:13.943 DEBUG:boto:Token: None 2024-04-16T18:08:13.943 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6kPI3pn+/z01gpXUR7XeYVrtH20= 2024-04-16T18:08:13.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6kPI3pn+/z01gpXUR7XeYVrtH20=', 'Content-Length': '0'} 2024-04-16T18:08:13.945 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005542bbef4b773fc8-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.946 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:13.946 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:13.946 DEBUG:boto:path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.946 DEBUG:boto:auth_path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.946 DEBUG:boto:Method: HEAD 2024-04-16T18:08:13.946 DEBUG:boto:Path: /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.946 DEBUG:boto:Data: 2024-04-16T18:08:13.946 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.946 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.946 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.947 DEBUG:boto:Params: {} 2024-04-16T18:08:13.947 DEBUG:boto:Token: None 2024-04-16T18:08:13.947 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6kPI3pn+/z01gpXUR7XeYVrtH20= 2024-04-16T18:08:13.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6kPI3pn+/z01gpXUR7XeYVrtH20=', 'Content-Length': '0'} 2024-04-16T18:08:13.949 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003eda08f1bd9b2fb8-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.949 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:13.949 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:13.950 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:13.950 DEBUG:boto:path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.950 DEBUG:boto:auth_path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.950 DEBUG:boto:Method: GET 2024-04-16T18:08:13.950 DEBUG:boto:Path: /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.950 DEBUG:boto:Data: 2024-04-16T18:08:13.950 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.950 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.950 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.950 DEBUG:boto:Params: {} 2024-04-16T18:08:13.951 DEBUG:boto:Token: None 2024-04-16T18:08:13.951 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg= 2024-04-16T18:08:13.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg=', 'Content-Length': '0'} 2024-04-16T18:08:13.953 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008d5cd6105e62aed0-00661ebe8d-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.994 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:13.994 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:13.995 DEBUG:boto:path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.995 DEBUG:boto:auth_path=/cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.995 DEBUG:boto:Method: GET 2024-04-16T18:08:13.995 DEBUG:boto:Path: /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.995 DEBUG:boto:Data: 2024-04-16T18:08:13.995 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:13.995 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.995 DEBUG:boto:Params: {} 2024-04-16T18:08:13.995 DEBUG:boto:Token: None 2024-04-16T18:08:13.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/obj5?versionId=null 2024-04-16T18:08:13.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg= 2024-04-16T18:08:13.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KM7p/XWgfjuvqeg4tNCmc3Pg/wg=', 'Content-Length': '0'} 2024-04-16T18:08:13.998 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a523dfbf97e0626f-00661ebe8d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:13.998 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:13.998 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:13.998 DEBUG:boto:path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:13.999 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:13.999 DEBUG:boto:Method: GET 2024-04-16T18:08:13.999 DEBUG:boto:Path: /cjqttm-38/?prefix=obj5 2024-04-16T18:08:13.999 DEBUG:boto:Data: 2024-04-16T18:08:13.999 DEBUG:boto:Headers: {} 2024-04-16T18:08:13.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:13.999 DEBUG:boto:Port: 8000 2024-04-16T18:08:13.999 DEBUG:boto:Params: {} 2024-04-16T18:08:13.999 DEBUG:boto:Token: None 2024-04-16T18:08:13.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:13 GMT /cjqttm-38/ 2024-04-16T18:08:14.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY= 2024-04-16T18:08:14.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O9gG460B078oESWwba2FDgmNFBY=', 'Content-Length': '0'} 2024-04-16T18:08:14.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cac3129eeeee1f6e-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.002 DEBUG:boto:b'cjqttm-38obj51000falseobj52024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.003 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.003 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.003 DEBUG:boto:path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.003 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.003 DEBUG:boto:Method: GET 2024-04-16T18:08:14.003 DEBUG:boto:Path: /cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.003 DEBUG:boto:Data: 2024-04-16T18:08:14.003 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.004 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.004 DEBUG:boto:Params: {} 2024-04-16T18:08:14.004 DEBUG:boto:Token: None 2024-04-16T18:08:14.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bd799187fa9f78da-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.007 DEBUG:boto:b'cjqttm-38obj51000falseobj52024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.007 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:14.007 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:14.007 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.007 DEBUG:boto:Path: /cjqttm-38/obj5 2024-04-16T18:08:14.007 DEBUG:boto:Data: 2024-04-16T18:08:14.007 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.008 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.008 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.008 DEBUG:boto:Params: {} 2024-04-16T18:08:14.008 DEBUG:boto:Token: None 2024-04-16T18:08:14.008 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj5 2024-04-16T18:08:14.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoONYceW7TUaWGF3qheTIsCBDQU= 2024-04-16T18:08:14.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoONYceW7TUaWGF3qheTIsCBDQU=', 'Content-Length': '0'} 2024-04-16T18:08:14.010 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000710dadefadf791ef-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.010 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:14.010 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:14.010 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.010 DEBUG:boto:Path: /cjqttm-38/obj5 2024-04-16T18:08:14.011 DEBUG:boto:Data: 2024-04-16T18:08:14.011 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.011 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.011 DEBUG:boto:Params: {} 2024-04-16T18:08:14.011 DEBUG:boto:Token: None 2024-04-16T18:08:14.011 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj5 2024-04-16T18:08:14.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hoONYceW7TUaWGF3qheTIsCBDQU= 2024-04-16T18:08:14.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hoONYceW7TUaWGF3qheTIsCBDQU=', 'Content-Length': '0'} 2024-04-16T18:08:14.013 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001a179ce1201b1a19-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:14.014 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:14.014 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:14.014 DEBUG:boto:Method: GET 2024-04-16T18:08:14.014 DEBUG:boto:Path: /cjqttm-38/obj5 2024-04-16T18:08:14.014 DEBUG:boto:Data: 2024-04-16T18:08:14.014 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.014 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.014 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.015 DEBUG:boto:Params: {} 2024-04-16T18:08:14.015 DEBUG:boto:Token: None 2024-04-16T18:08:14.015 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj5 2024-04-16T18:08:14.015 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YOMUBh281H9A3BZKZ2JKzpnZORM= 2024-04-16T18:08:14.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YOMUBh281H9A3BZKZ2JKzpnZORM=', 'Content-Length': '0'} 2024-04-16T18:08:14.017 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a8fedbefc439dc43-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.058 DEBUG:boto:path=/cjqttm-38/obj5 2024-04-16T18:08:14.059 DEBUG:boto:auth_path=/cjqttm-38/obj5 2024-04-16T18:08:14.059 DEBUG:boto:Method: GET 2024-04-16T18:08:14.059 DEBUG:boto:Path: /cjqttm-38/obj5 2024-04-16T18:08:14.059 DEBUG:boto:Data: 2024-04-16T18:08:14.059 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.059 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.059 DEBUG:boto:Params: {} 2024-04-16T18:08:14.059 DEBUG:boto:Token: None 2024-04-16T18:08:14.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj5 2024-04-16T18:08:14.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YOMUBh281H9A3BZKZ2JKzpnZORM= 2024-04-16T18:08:14.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YOMUBh281H9A3BZKZ2JKzpnZORM=', 'Content-Length': '0'} 2024-04-16T18:08:14.062 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004543cee03877ba64-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.062 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.062 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.062 DEBUG:boto:path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.062 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.062 DEBUG:boto:Method: GET 2024-04-16T18:08:14.062 DEBUG:boto:Path: /cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.062 DEBUG:boto:Data: 2024-04-16T18:08:14.062 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.063 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.063 DEBUG:boto:Params: {} 2024-04-16T18:08:14.063 DEBUG:boto:Token: None 2024-04-16T18:08:14.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009367200c61380bda-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.106 DEBUG:boto:b'cjqttm-38obj51000falseobj52024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.107 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.107 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.107 DEBUG:boto:path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.107 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.107 DEBUG:boto:Method: GET 2024-04-16T18:08:14.107 DEBUG:boto:Path: /cjqttm-38/?prefix=obj5 2024-04-16T18:08:14.107 DEBUG:boto:Data: 2024-04-16T18:08:14.107 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.107 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.107 DEBUG:boto:Params: {} 2024-04-16T18:08:14.108 DEBUG:boto:Token: None 2024-04-16T18:08:14.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.110 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ddef2de98ba577c7-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.110 DEBUG:boto:b'cjqttm-38obj51000falseobj52024-04-16T18:07:52.678Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:14.111 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.111 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.111 DEBUG:boto:path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.111 DEBUG:boto:auth_path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.111 DEBUG:boto:Method: GET 2024-04-16T18:08:14.111 DEBUG:boto:Path: /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.111 DEBUG:boto:Data: 2024-04-16T18:08:14.111 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.112 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.112 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.112 DEBUG:boto:Params: {} 2024-04-16T18:08:14.112 DEBUG:boto:Token: None 2024-04-16T18:08:14.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0= 2024-04-16T18:08:14.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0=', 'Content-Length': '0'} 2024-04-16T18:08:14.115 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cd06850919f97264-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.158 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.158 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.159 DEBUG:boto:path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.159 DEBUG:boto:auth_path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.159 DEBUG:boto:Method: GET 2024-04-16T18:08:14.159 DEBUG:boto:Path: /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.159 DEBUG:boto:Data: 2024-04-16T18:08:14.159 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.159 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.159 DEBUG:boto:Params: {} 2024-04-16T18:08:14.159 DEBUG:boto:Token: None 2024-04-16T18:08:14.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0= 2024-04-16T18:08:14.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0=', 'Content-Length': '0'} 2024-04-16T18:08:14.162 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002a3511b55b67ad8e-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.162 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.162 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.162 DEBUG:boto:path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.162 DEBUG:boto:auth_path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.163 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.163 DEBUG:boto:Path: /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.163 DEBUG:boto:Data: 2024-04-16T18:08:14.163 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.163 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.163 DEBUG:boto:Params: {} 2024-04-16T18:08:14.163 DEBUG:boto:Token: None 2024-04-16T18:08:14.163 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eNUHiXfJ70Plg8R1uPk2i/W7bSc= 2024-04-16T18:08:14.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eNUHiXfJ70Plg8R1uPk2i/W7bSc=', 'Content-Length': '0'} 2024-04-16T18:08:14.166 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000099414a1035c84303-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.166 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.166 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.166 DEBUG:boto:path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.166 DEBUG:boto:auth_path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.166 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.166 DEBUG:boto:Path: /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.167 DEBUG:boto:Data: 2024-04-16T18:08:14.167 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.167 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.167 DEBUG:boto:Params: {} 2024-04-16T18:08:14.167 DEBUG:boto:Token: None 2024-04-16T18:08:14.167 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eNUHiXfJ70Plg8R1uPk2i/W7bSc= 2024-04-16T18:08:14.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eNUHiXfJ70Plg8R1uPk2i/W7bSc=', 'Content-Length': '0'} 2024-04-16T18:08:14.169 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e41d952713f70a0-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.170 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:14.170 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.170 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.170 DEBUG:boto:path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.170 DEBUG:boto:auth_path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.170 DEBUG:boto:Method: GET 2024-04-16T18:08:14.170 DEBUG:boto:Path: /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.170 DEBUG:boto:Data: 2024-04-16T18:08:14.170 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.170 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.171 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.171 DEBUG:boto:Params: {} 2024-04-16T18:08:14.171 DEBUG:boto:Token: None 2024-04-16T18:08:14.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0= 2024-04-16T18:08:14.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0=', 'Content-Length': '0'} 2024-04-16T18:08:14.173 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000101fda7ef60477e6-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.214 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.214 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.214 DEBUG:boto:path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.215 DEBUG:boto:auth_path=/cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.215 DEBUG:boto:Method: GET 2024-04-16T18:08:14.215 DEBUG:boto:Path: /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.215 DEBUG:boto:Data: 2024-04-16T18:08:14.215 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.215 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.215 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.215 DEBUG:boto:Params: {} 2024-04-16T18:08:14.215 DEBUG:boto:Token: None 2024-04-16T18:08:14.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6?versionId=null 2024-04-16T18:08:14.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0= 2024-04-16T18:08:14.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXK5gDz8XmM0JbVhvCw4eiaHmR0=', 'Content-Length': '0'} 2024-04-16T18:08:14.217 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a0b5630fc6224303-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.218 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.218 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.218 DEBUG:boto:path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.218 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.218 DEBUG:boto:Method: GET 2024-04-16T18:08:14.218 DEBUG:boto:Path: /cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.218 DEBUG:boto:Data: 2024-04-16T18:08:14.218 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.218 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.218 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.218 DEBUG:boto:Params: {} 2024-04-16T18:08:14.219 DEBUG:boto:Token: None 2024-04-16T18:08:14.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cce78c81b7d84499-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.262 DEBUG:boto:b'cjqttm-38obj61000falseobj62024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.263 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.263 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.263 DEBUG:boto:path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.263 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.263 DEBUG:boto:Method: GET 2024-04-16T18:08:14.263 DEBUG:boto:Path: /cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.263 DEBUG:boto:Data: 2024-04-16T18:08:14.263 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.263 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.264 DEBUG:boto:Params: {} 2024-04-16T18:08:14.264 DEBUG:boto:Token: None 2024-04-16T18:08:14.264 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d368af75ae0f41cd-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.266 DEBUG:boto:b'cjqttm-38obj61000falseobj62024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.267 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.267 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.267 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.267 DEBUG:boto:Path: /cjqttm-38/obj6 2024-04-16T18:08:14.267 DEBUG:boto:Data: 2024-04-16T18:08:14.267 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.267 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.268 DEBUG:boto:Params: {} 2024-04-16T18:08:14.268 DEBUG:boto:Token: None 2024-04-16T18:08:14.268 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6 2024-04-16T18:08:14.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T3RspSrY2/PZvtgmvS+JbgCtNEs= 2024-04-16T18:08:14.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T3RspSrY2/PZvtgmvS+JbgCtNEs=', 'Content-Length': '0'} 2024-04-16T18:08:14.270 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000453eb43a9a5b5608-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.270 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.271 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.271 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.271 DEBUG:boto:Path: /cjqttm-38/obj6 2024-04-16T18:08:14.271 DEBUG:boto:Data: 2024-04-16T18:08:14.271 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.271 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.271 DEBUG:boto:Params: {} 2024-04-16T18:08:14.271 DEBUG:boto:Token: None 2024-04-16T18:08:14.271 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6 2024-04-16T18:08:14.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T3RspSrY2/PZvtgmvS+JbgCtNEs= 2024-04-16T18:08:14.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T3RspSrY2/PZvtgmvS+JbgCtNEs=', 'Content-Length': '0'} 2024-04-16T18:08:14.274 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000123f3fa023d7989d-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:14.274 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.274 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.274 DEBUG:boto:Method: GET 2024-04-16T18:08:14.274 DEBUG:boto:Path: /cjqttm-38/obj6 2024-04-16T18:08:14.275 DEBUG:boto:Data: 2024-04-16T18:08:14.275 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.275 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.275 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.275 DEBUG:boto:Params: {} 2024-04-16T18:08:14.275 DEBUG:boto:Token: None 2024-04-16T18:08:14.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6 2024-04-16T18:08:14.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yzomNk77i3lIU/Vj/+Su/h7Owh0= 2024-04-16T18:08:14.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yzomNk77i3lIU/Vj/+Su/h7Owh0=', 'Content-Length': '0'} 2024-04-16T18:08:14.277 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ec6a8fe95e75daa2-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.318 DEBUG:boto:path=/cjqttm-38/obj6 2024-04-16T18:08:14.318 DEBUG:boto:auth_path=/cjqttm-38/obj6 2024-04-16T18:08:14.318 DEBUG:boto:Method: GET 2024-04-16T18:08:14.319 DEBUG:boto:Path: /cjqttm-38/obj6 2024-04-16T18:08:14.319 DEBUG:boto:Data: 2024-04-16T18:08:14.319 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.319 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.319 DEBUG:boto:Params: {} 2024-04-16T18:08:14.319 DEBUG:boto:Token: None 2024-04-16T18:08:14.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj6 2024-04-16T18:08:14.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yzomNk77i3lIU/Vj/+Su/h7Owh0= 2024-04-16T18:08:14.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yzomNk77i3lIU/Vj/+Su/h7Owh0=', 'Content-Length': '0'} 2024-04-16T18:08:14.321 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bc238d7013aa4231-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.322 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.322 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.322 DEBUG:boto:path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.322 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.322 DEBUG:boto:Method: GET 2024-04-16T18:08:14.322 DEBUG:boto:Path: /cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.322 DEBUG:boto:Data: 2024-04-16T18:08:14.322 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.322 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.322 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.323 DEBUG:boto:Params: {} 2024-04-16T18:08:14.323 DEBUG:boto:Token: None 2024-04-16T18:08:14.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a86c2ace892ec523-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.326 DEBUG:boto:b'cjqttm-38obj61000falseobj62024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.326 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.326 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.326 DEBUG:boto:path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.326 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.326 DEBUG:boto:Method: GET 2024-04-16T18:08:14.326 DEBUG:boto:Path: /cjqttm-38/?prefix=obj6 2024-04-16T18:08:14.326 DEBUG:boto:Data: 2024-04-16T18:08:14.327 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.327 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.327 DEBUG:boto:Params: {} 2024-04-16T18:08:14.327 DEBUG:boto:Token: None 2024-04-16T18:08:14.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013c0b1a8509cea1e-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.329 DEBUG:boto:b'cjqttm-38obj61000falseobj62024-04-16T18:07:52.688Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:14.330 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.330 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.330 DEBUG:boto:path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.330 DEBUG:boto:auth_path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.330 DEBUG:boto:Method: GET 2024-04-16T18:08:14.330 DEBUG:boto:Path: /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.331 DEBUG:boto:Data: 2024-04-16T18:08:14.331 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.331 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.331 DEBUG:boto:Params: {} 2024-04-16T18:08:14.331 DEBUG:boto:Token: None 2024-04-16T18:08:14.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY= 2024-04-16T18:08:14.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY=', 'Content-Length': '0'} 2024-04-16T18:08:14.333 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000708bcdc012b7475-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.374 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.374 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.374 DEBUG:boto:path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.375 DEBUG:boto:auth_path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.375 DEBUG:boto:Method: GET 2024-04-16T18:08:14.375 DEBUG:boto:Path: /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.375 DEBUG:boto:Data: 2024-04-16T18:08:14.375 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.375 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.375 DEBUG:boto:Params: {} 2024-04-16T18:08:14.375 DEBUG:boto:Token: None 2024-04-16T18:08:14.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY= 2024-04-16T18:08:14.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY=', 'Content-Length': '0'} 2024-04-16T18:08:14.377 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ae32f081ebcecb73-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.378 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.378 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.378 DEBUG:boto:path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.378 DEBUG:boto:auth_path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.378 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.378 DEBUG:boto:Path: /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.378 DEBUG:boto:Data: 2024-04-16T18:08:14.378 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.378 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.378 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.379 DEBUG:boto:Params: {} 2024-04-16T18:08:14.379 DEBUG:boto:Token: None 2024-04-16T18:08:14.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dt5IvaoGo7McQpSMbrp9HOMki3k= 2024-04-16T18:08:14.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dt5IvaoGo7McQpSMbrp9HOMki3k=', 'Content-Length': '0'} 2024-04-16T18:08:14.381 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008c494a300e285d50-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.381 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.381 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.381 DEBUG:boto:path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.381 DEBUG:boto:auth_path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.381 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.381 DEBUG:boto:Path: /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.381 DEBUG:boto:Data: 2024-04-16T18:08:14.382 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.382 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.382 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.382 DEBUG:boto:Params: {} 2024-04-16T18:08:14.382 DEBUG:boto:Token: None 2024-04-16T18:08:14.382 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.382 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dt5IvaoGo7McQpSMbrp9HOMki3k= 2024-04-16T18:08:14.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dt5IvaoGo7McQpSMbrp9HOMki3k=', 'Content-Length': '0'} 2024-04-16T18:08:14.384 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ed30d1b40b6f7f76-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:14.384 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.384 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.384 DEBUG:boto:path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.384 DEBUG:boto:auth_path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.385 DEBUG:boto:Method: GET 2024-04-16T18:08:14.385 DEBUG:boto:Path: /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.385 DEBUG:boto:Data: 2024-04-16T18:08:14.385 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.385 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.385 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.385 DEBUG:boto:Params: {} 2024-04-16T18:08:14.385 DEBUG:boto:Token: None 2024-04-16T18:08:14.385 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.385 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY= 2024-04-16T18:08:14.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY=', 'Content-Length': '0'} 2024-04-16T18:08:14.387 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c82a8d3e2296ebba-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.430 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.430 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.431 DEBUG:boto:path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.431 DEBUG:boto:auth_path=/cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.431 DEBUG:boto:Method: GET 2024-04-16T18:08:14.431 DEBUG:boto:Path: /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.431 DEBUG:boto:Data: 2024-04-16T18:08:14.431 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.431 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.431 DEBUG:boto:Params: {} 2024-04-16T18:08:14.431 DEBUG:boto:Token: None 2024-04-16T18:08:14.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7?versionId=null 2024-04-16T18:08:14.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY= 2024-04-16T18:08:14.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQr/L4WtGHnT3hHRBZe1NJxkWTY=', 'Content-Length': '0'} 2024-04-16T18:08:14.433 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009ab03802639be26f-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.434 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.434 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.434 DEBUG:boto:path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.434 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.434 DEBUG:boto:Method: GET 2024-04-16T18:08:14.434 DEBUG:boto:Path: /cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.434 DEBUG:boto:Data: 2024-04-16T18:08:14.434 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.435 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.435 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.435 DEBUG:boto:Params: {} 2024-04-16T18:08:14.435 DEBUG:boto:Token: None 2024-04-16T18:08:14.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000151843f903cc6843-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.438 DEBUG:boto:b'cjqttm-38obj71000falseobj72024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.438 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.438 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.438 DEBUG:boto:path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.438 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.438 DEBUG:boto:Method: GET 2024-04-16T18:08:14.438 DEBUG:boto:Path: /cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.439 DEBUG:boto:Data: 2024-04-16T18:08:14.439 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.439 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.439 DEBUG:boto:Params: {} 2024-04-16T18:08:14.439 DEBUG:boto:Token: None 2024-04-16T18:08:14.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004953a34f7ec0354a-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.442 DEBUG:boto:b'cjqttm-38obj71000falseobj72024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.442 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.442 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.442 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.442 DEBUG:boto:Path: /cjqttm-38/obj7 2024-04-16T18:08:14.443 DEBUG:boto:Data: 2024-04-16T18:08:14.443 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.443 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.443 DEBUG:boto:Params: {} 2024-04-16T18:08:14.443 DEBUG:boto:Token: None 2024-04-16T18:08:14.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7 2024-04-16T18:08:14.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/LHtqtMEK20lH5m/KV2y+y/R7Uw= 2024-04-16T18:08:14.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/LHtqtMEK20lH5m/KV2y+y/R7Uw=', 'Content-Length': '0'} 2024-04-16T18:08:14.445 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000141f4390d09d1134-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.445 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.445 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.446 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.446 DEBUG:boto:Path: /cjqttm-38/obj7 2024-04-16T18:08:14.446 DEBUG:boto:Data: 2024-04-16T18:08:14.446 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.446 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.446 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.446 DEBUG:boto:Params: {} 2024-04-16T18:08:14.446 DEBUG:boto:Token: None 2024-04-16T18:08:14.446 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7 2024-04-16T18:08:14.446 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/LHtqtMEK20lH5m/KV2y+y/R7Uw= 2024-04-16T18:08:14.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/LHtqtMEK20lH5m/KV2y+y/R7Uw=', 'Content-Length': '0'} 2024-04-16T18:08:14.448 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f0ad09d61e1122dd-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:14.448 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.448 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.449 DEBUG:boto:Method: GET 2024-04-16T18:08:14.449 DEBUG:boto:Path: /cjqttm-38/obj7 2024-04-16T18:08:14.449 DEBUG:boto:Data: 2024-04-16T18:08:14.449 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.449 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.449 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.449 DEBUG:boto:Params: {} 2024-04-16T18:08:14.449 DEBUG:boto:Token: None 2024-04-16T18:08:14.449 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7 2024-04-16T18:08:14.449 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LxcZ3dy+aidPQ4deS0w8hG12Pw= 2024-04-16T18:08:14.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LxcZ3dy+aidPQ4deS0w8hG12Pw=', 'Content-Length': '0'} 2024-04-16T18:08:14.451 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006ac360a1d6ee8a95-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.494 DEBUG:boto:path=/cjqttm-38/obj7 2024-04-16T18:08:14.494 DEBUG:boto:auth_path=/cjqttm-38/obj7 2024-04-16T18:08:14.495 DEBUG:boto:Method: GET 2024-04-16T18:08:14.495 DEBUG:boto:Path: /cjqttm-38/obj7 2024-04-16T18:08:14.495 DEBUG:boto:Data: 2024-04-16T18:08:14.495 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.495 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.495 DEBUG:boto:Params: {} 2024-04-16T18:08:14.495 DEBUG:boto:Token: None 2024-04-16T18:08:14.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj7 2024-04-16T18:08:14.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1LxcZ3dy+aidPQ4deS0w8hG12Pw= 2024-04-16T18:08:14.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1LxcZ3dy+aidPQ4deS0w8hG12Pw=', 'Content-Length': '0'} 2024-04-16T18:08:14.497 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004039d12826bf3609-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.498 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.498 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.498 DEBUG:boto:path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.498 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.498 DEBUG:boto:Method: GET 2024-04-16T18:08:14.498 DEBUG:boto:Path: /cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.498 DEBUG:boto:Data: 2024-04-16T18:08:14.498 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.498 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.499 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.499 DEBUG:boto:Params: {} 2024-04-16T18:08:14.499 DEBUG:boto:Token: None 2024-04-16T18:08:14.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000644d51d98f3da47f-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.502 DEBUG:boto:b'cjqttm-38obj71000falseobj72024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.502 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.502 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.502 DEBUG:boto:path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.502 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.502 DEBUG:boto:Method: GET 2024-04-16T18:08:14.503 DEBUG:boto:Path: /cjqttm-38/?prefix=obj7 2024-04-16T18:08:14.503 DEBUG:boto:Data: 2024-04-16T18:08:14.503 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.503 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.503 DEBUG:boto:Params: {} 2024-04-16T18:08:14.503 DEBUG:boto:Token: None 2024-04-16T18:08:14.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.503 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000227d202dffa37df8-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.506 DEBUG:boto:b'cjqttm-38obj71000falseobj72024-04-16T18:07:52.695Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:14.506 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.506 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.506 DEBUG:boto:path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.506 DEBUG:boto:auth_path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.507 DEBUG:boto:Method: GET 2024-04-16T18:08:14.507 DEBUG:boto:Path: /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.507 DEBUG:boto:Data: 2024-04-16T18:08:14.507 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.507 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.507 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.507 DEBUG:boto:Params: {} 2024-04-16T18:08:14.507 DEBUG:boto:Token: None 2024-04-16T18:08:14.507 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.507 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk= 2024-04-16T18:08:14.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk=', 'Content-Length': '0'} 2024-04-16T18:08:14.510 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000843b65569e08e1ae-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.550 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.550 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.551 DEBUG:boto:path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.551 DEBUG:boto:auth_path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.551 DEBUG:boto:Method: GET 2024-04-16T18:08:14.551 DEBUG:boto:Path: /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.551 DEBUG:boto:Data: 2024-04-16T18:08:14.551 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.551 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.551 DEBUG:boto:Params: {} 2024-04-16T18:08:14.551 DEBUG:boto:Token: None 2024-04-16T18:08:14.551 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk= 2024-04-16T18:08:14.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk=', 'Content-Length': '0'} 2024-04-16T18:08:14.554 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d2d36e7422a6b245-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.554 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.554 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.554 DEBUG:boto:path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.554 DEBUG:boto:auth_path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.555 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.555 DEBUG:boto:Path: /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.555 DEBUG:boto:Data: 2024-04-16T18:08:14.555 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.555 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.555 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.555 DEBUG:boto:Params: {} 2024-04-16T18:08:14.555 DEBUG:boto:Token: None 2024-04-16T18:08:14.555 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3GGo4i6lRX1Tk6V0FyZHQMlO6ak= 2024-04-16T18:08:14.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3GGo4i6lRX1Tk6V0FyZHQMlO6ak=', 'Content-Length': '0'} 2024-04-16T18:08:14.557 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000066b2c43daa19e3dc-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.558 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.558 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.558 DEBUG:boto:path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.558 DEBUG:boto:auth_path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.558 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.558 DEBUG:boto:Path: /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.558 DEBUG:boto:Data: 2024-04-16T18:08:14.558 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.558 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.559 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.559 DEBUG:boto:Params: {} 2024-04-16T18:08:14.559 DEBUG:boto:Token: None 2024-04-16T18:08:14.559 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3GGo4i6lRX1Tk6V0FyZHQMlO6ak= 2024-04-16T18:08:14.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3GGo4i6lRX1Tk6V0FyZHQMlO6ak=', 'Content-Length': '0'} 2024-04-16T18:08:14.561 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000072ef4e902e6223c2-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:14.561 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.562 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.562 DEBUG:boto:path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.562 DEBUG:boto:auth_path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.562 DEBUG:boto:Method: GET 2024-04-16T18:08:14.562 DEBUG:boto:Path: /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.562 DEBUG:boto:Data: 2024-04-16T18:08:14.562 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.562 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.562 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.562 DEBUG:boto:Params: {} 2024-04-16T18:08:14.562 DEBUG:boto:Token: None 2024-04-16T18:08:14.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk= 2024-04-16T18:08:14.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk=', 'Content-Length': '0'} 2024-04-16T18:08:14.565 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007e5728c51f10a36d-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.606 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.606 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.606 DEBUG:boto:path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.607 DEBUG:boto:auth_path=/cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.607 DEBUG:boto:Method: GET 2024-04-16T18:08:14.607 DEBUG:boto:Path: /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.607 DEBUG:boto:Data: 2024-04-16T18:08:14.607 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.607 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.607 DEBUG:boto:Params: {} 2024-04-16T18:08:14.607 DEBUG:boto:Token: None 2024-04-16T18:08:14.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8?versionId=null 2024-04-16T18:08:14.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk= 2024-04-16T18:08:14.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxoaLf2I5WtGL/0RC6OAqb+ZXTk=', 'Content-Length': '0'} 2024-04-16T18:08:14.610 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000064b67fd8002e2bfc-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.610 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.610 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.610 DEBUG:boto:path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.610 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.610 DEBUG:boto:Method: GET 2024-04-16T18:08:14.610 DEBUG:boto:Path: /cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.611 DEBUG:boto:Data: 2024-04-16T18:08:14.611 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.611 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.611 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.611 DEBUG:boto:Params: {} 2024-04-16T18:08:14.611 DEBUG:boto:Token: None 2024-04-16T18:08:14.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c83364a62b83d1e-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.614 DEBUG:boto:b'cjqttm-38obj81000falseobj82024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.614 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.614 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.614 DEBUG:boto:path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.614 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.614 DEBUG:boto:Method: GET 2024-04-16T18:08:14.614 DEBUG:boto:Path: /cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.614 DEBUG:boto:Data: 2024-04-16T18:08:14.615 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.615 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.615 DEBUG:boto:Params: {} 2024-04-16T18:08:14.615 DEBUG:boto:Token: None 2024-04-16T18:08:14.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024228d4e204c6ae8-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.618 DEBUG:boto:b'cjqttm-38obj81000falseobj82024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.618 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.618 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.618 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.618 DEBUG:boto:Path: /cjqttm-38/obj8 2024-04-16T18:08:14.619 DEBUG:boto:Data: 2024-04-16T18:08:14.619 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.619 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.619 DEBUG:boto:Params: {} 2024-04-16T18:08:14.619 DEBUG:boto:Token: None 2024-04-16T18:08:14.619 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8 2024-04-16T18:08:14.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FMfgDu0OfHMnQsySF7vUqsFvo6k= 2024-04-16T18:08:14.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FMfgDu0OfHMnQsySF7vUqsFvo6k=', 'Content-Length': '0'} 2024-04-16T18:08:14.621 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003613ae1c33c9a481-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.622 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.622 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.622 DEBUG:boto:Method: HEAD 2024-04-16T18:08:14.622 DEBUG:boto:Path: /cjqttm-38/obj8 2024-04-16T18:08:14.622 DEBUG:boto:Data: 2024-04-16T18:08:14.622 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.622 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.622 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.622 DEBUG:boto:Params: {} 2024-04-16T18:08:14.622 DEBUG:boto:Token: None 2024-04-16T18:08:14.622 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8 2024-04-16T18:08:14.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FMfgDu0OfHMnQsySF7vUqsFvo6k= 2024-04-16T18:08:14.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FMfgDu0OfHMnQsySF7vUqsFvo6k=', 'Content-Length': '0'} 2024-04-16T18:08:14.625 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000035e27b3f7889d96c-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.625 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:14.625 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.625 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.625 DEBUG:boto:Method: GET 2024-04-16T18:08:14.626 DEBUG:boto:Path: /cjqttm-38/obj8 2024-04-16T18:08:14.626 DEBUG:boto:Data: 2024-04-16T18:08:14.626 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.626 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.626 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.626 DEBUG:boto:Params: {} 2024-04-16T18:08:14.626 DEBUG:boto:Token: None 2024-04-16T18:08:14.626 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8 2024-04-16T18:08:14.626 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2nUPXFLP7NH2w0leR3ofpQkpW7I= 2024-04-16T18:08:14.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2nUPXFLP7NH2w0leR3ofpQkpW7I=', 'Content-Length': '0'} 2024-04-16T18:08:14.629 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-38:9ba59572-f51c-4bce-9578-e6350e822996.4816.7'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:54 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000377bd9a6ea2e1b7b-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.670 DEBUG:boto:path=/cjqttm-38/obj8 2024-04-16T18:08:14.670 DEBUG:boto:auth_path=/cjqttm-38/obj8 2024-04-16T18:08:14.671 DEBUG:boto:Method: GET 2024-04-16T18:08:14.671 DEBUG:boto:Path: /cjqttm-38/obj8 2024-04-16T18:08:14.671 DEBUG:boto:Data: 2024-04-16T18:08:14.671 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.671 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.671 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.671 DEBUG:boto:Params: {} 2024-04-16T18:08:14.671 DEBUG:boto:Token: None 2024-04-16T18:08:14.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/obj8 2024-04-16T18:08:14.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2nUPXFLP7NH2w0leR3ofpQkpW7I= 2024-04-16T18:08:14.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2nUPXFLP7NH2w0leR3ofpQkpW7I=', 'Content-Length': '0'} 2024-04-16T18:08:14.673 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000935edb5ca3ae20f1-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.674 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.674 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.674 DEBUG:boto:path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.674 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.674 DEBUG:boto:Method: GET 2024-04-16T18:08:14.674 DEBUG:boto:Path: /cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.674 DEBUG:boto:Data: 2024-04-16T18:08:14.674 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:14.675 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.675 DEBUG:boto:Params: {} 2024-04-16T18:08:14.675 DEBUG:boto:Token: None 2024-04-16T18:08:14.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.678 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3b54eb339b26681-00661ebe8e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.678 DEBUG:boto:b'cjqttm-38obj81000falseobj82024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.678 DEBUG:boto:path=/cjqttm-38/ 2024-04-16T18:08:14.678 DEBUG:boto:auth_path=/cjqttm-38/ 2024-04-16T18:08:14.678 DEBUG:boto:path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.679 DEBUG:boto:auth_path=/cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.679 DEBUG:boto:Method: GET 2024-04-16T18:08:14.679 DEBUG:boto:Path: /cjqttm-38/?prefix=obj8 2024-04-16T18:08:14.679 DEBUG:boto:Data: 2024-04-16T18:08:14.679 DEBUG:boto:Headers: {} 2024-04-16T18:08:14.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:14.679 DEBUG:boto:Port: 8000 2024-04-16T18:08:14.679 DEBUG:boto:Params: {} 2024-04-16T18:08:14.679 DEBUG:boto:Token: None 2024-04-16T18:08:14.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:14 GMT /cjqttm-38/ 2024-04-16T18:08:14.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls= 2024-04-16T18:08:14.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:owazudEH5XMf/XqBRANXQezVCls=', 'Content-Length': '0'} 2024-04-16T18:08:14.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e82ca6c37641ff4c-00661ebe8e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:14.682 DEBUG:boto:b'cjqttm-38obj81000falseobj82024-04-16T18:07:52.743Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:14.682 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-38 zones={test-zone2, test-zone1} 2024-04-16T18:08:14.682 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-39 2024-04-16T18:08:14.682 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:14.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:14.683 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-39 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:14.745 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:14.746 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:14.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:14.810+0000 7f688c024800 1 waiting for incremental sync to catch up: 2024-04-16T18:08:14.808 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.40.6, 00000000002.50.1, 00000000003.40.1, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000003.116.1, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:14.808 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.40.6, 00000000002.50.1, 00000000004.44.6, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000004.119.6, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:19.810 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:19.812+0000 7f688c024800 1 waiting for incremental sync to catch up: 2024-04-16T18:08:19.810 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.40.6, 00000000002.50.1, 00000000003.40.1, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000003.116.1, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:19.810 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.40.6, 00000000002.50.1, 00000000004.44.6, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000004.119.6, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:24.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:24.813+0000 7f688c024800 1 waiting for incremental sync to catch up: 2024-04-16T18:08:24.812 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.40.6, 00000000002.50.1, 00000000003.40.1, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000003.116.1, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:24.812 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.40.6, 00000000002.50.1, 00000000004.44.6, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000004.119.6, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:29.813 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:29.814+0000 7f688c024800 1 waiting for incremental sync to catch up: 2024-04-16T18:08:29.813 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.40.6, 00000000002.50.1, 00000000003.40.1, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000003.116.1, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:29.813 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.40.6, 00000000002.50.1, 00000000004.44.6, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000004.119.6, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:34.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:34.816+0000 7f688c024800 1 bucket sync caught up with source: 2024-04-16T18:08:34.815 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.40.6, 00000000002.50.1, 00000000004.44.6, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000004.119.6, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:34.815 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.40.6, 00000000002.50.1, 00000000004.44.6, 00000000002.20.1, 00000000004.37.6, 00000000002.23.1, 00000000002.40.1, 00000000004.119.6, 00000000002.117.1, 00000000002.51.1, 00000000002.31.1] 2024-04-16T18:08:34.815 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:34.816+0000 7f688c024800 0 bucket checkpoint complete 2024-04-16T18:08:34.840 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-39 2024-04-16T18:08:34.841 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:34.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-39', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:34.841 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-39 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:34.904 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:34.904 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:34.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:34.969+0000 7ff1c249d800 1 bucket sync caught up with source: 2024-04-16T18:08:34.968 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000002.627.6, , 00000000002.194.6, , 00000000002.1205.6, , , 00000000002.473.6, , , ] 2024-04-16T18:08:34.968 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000002.627.6, , 00000000002.194.6, , 00000000002.1205.6, , , 00000000002.473.6, , , ] 2024-04-16T18:08:34.968 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:34.969+0000 7ff1c249d800 0 bucket checkpoint complete 2024-04-16T18:08:34.990 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-39 zones={test-zone2, test-zone1} 2024-04-16T18:08:34.990 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:34.991 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:34.991 DEBUG:boto:Method: HEAD 2024-04-16T18:08:34.991 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:08:34.991 DEBUG:boto:Data: 2024-04-16T18:08:34.991 DEBUG:boto:Headers: {} 2024-04-16T18:08:34.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:34.991 DEBUG:boto:Port: 8000 2024-04-16T18:08:34.991 DEBUG:boto:Params: {} 2024-04-16T18:08:34.991 DEBUG:boto:Token: None 2024-04-16T18:08:34.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:34 GMT /cjqttm-39/ 2024-04-16T18:08:34.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3gM8LDlDdM3WFl8jmsE5CiAjO3Q= 2024-04-16T18:08:34.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3gM8LDlDdM3WFl8jmsE5CiAjO3Q=', 'Content-Length': '0'} 2024-04-16T18:08:34.994 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000023bce01c7b4805b1-00661ebea2-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:34.995 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:34.995 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:34.995 DEBUG:boto:Method: HEAD 2024-04-16T18:08:34.995 DEBUG:boto:Path: /cjqttm-39/ 2024-04-16T18:08:34.995 DEBUG:boto:Data: 2024-04-16T18:08:34.995 DEBUG:boto:Headers: {} 2024-04-16T18:08:34.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:34.995 DEBUG:boto:Port: 8000 2024-04-16T18:08:34.995 DEBUG:boto:Params: {} 2024-04-16T18:08:34.995 DEBUG:boto:Token: None 2024-04-16T18:08:34.995 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:34 GMT /cjqttm-39/ 2024-04-16T18:08:34.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3gM8LDlDdM3WFl8jmsE5CiAjO3Q= 2024-04-16T18:08:34.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3gM8LDlDdM3WFl8jmsE5CiAjO3Q=', 'Content-Length': '0'} 2024-04-16T18:08:34.998 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009f5a6098cf90a639-00661ebea2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:34.998 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:08:34.998 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:34.999 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:34.999 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:34.999 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:34.999 DEBUG:boto:Method: GET 2024-04-16T18:08:34.999 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:34.999 DEBUG:boto:Data: 2024-04-16T18:08:34.999 DEBUG:boto:Headers: {} 2024-04-16T18:08:34.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:34.999 DEBUG:boto:Port: 8000 2024-04-16T18:08:34.999 DEBUG:boto:Params: {} 2024-04-16T18:08:35.000 DEBUG:boto:Token: None 2024-04-16T18:08:35.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/?versions 2024-04-16T18:08:35.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE= 2024-04-16T18:08:35.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE=', 'Content-Length': '0'} 2024-04-16T18:08:35.003 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d418d6de05381a3-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.003 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:35.004 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:08:35.004 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.005 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.005 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.005 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.005 DEBUG:boto:Method: GET 2024-04-16T18:08:35.005 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.005 DEBUG:boto:Data: 2024-04-16T18:08:35.005 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.005 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.005 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.005 DEBUG:boto:Params: {} 2024-04-16T18:08:35.005 DEBUG:boto:Token: None 2024-04-16T18:08:35.006 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/?versions 2024-04-16T18:08:35.006 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE= 2024-04-16T18:08:35.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE=', 'Content-Length': '0'} 2024-04-16T18:08:35.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0d33d5ef57ac126-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.009 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:35.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:35.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:35.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:35.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:35.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:35.010 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:35.011 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:35.011 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.011 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.011 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.011 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.011 DEBUG:boto:Method: GET 2024-04-16T18:08:35.011 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.011 DEBUG:boto:Data: 2024-04-16T18:08:35.011 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.011 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.011 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.012 DEBUG:boto:Params: {} 2024-04-16T18:08:35.012 DEBUG:boto:Token: None 2024-04-16T18:08:35.012 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/?versions 2024-04-16T18:08:35.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE= 2024-04-16T18:08:35.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE=', 'Content-Length': '0'} 2024-04-16T18:08:35.015 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004881c17adb84ede0-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.015 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.015 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.016 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.016 DEBUG:boto:path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.016 DEBUG:boto:auth_path=/cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.016 DEBUG:boto:Method: GET 2024-04-16T18:08:35.016 DEBUG:boto:Path: /cjqttm-39/?versions&max-keys=999 2024-04-16T18:08:35.016 DEBUG:boto:Data: 2024-04-16T18:08:35.016 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.016 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.016 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.016 DEBUG:boto:Params: {} 2024-04-16T18:08:35.016 DEBUG:boto:Token: None 2024-04-16T18:08:35.017 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/?versions 2024-04-16T18:08:35.017 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE= 2024-04-16T18:08:35.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YooLhV0YM0CMJv++zeHbNg7qkbE=', 'Content-Length': '0'} 2024-04-16T18:08:35.019 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000785621715c0482fc-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.019 DEBUG:boto:b'cjqttm-39999falseobj1nulltrue2024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:35.020 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.020 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.020 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.020 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.020 DEBUG:boto:Method: GET 2024-04-16T18:08:35.021 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.021 DEBUG:boto:Data: 2024-04-16T18:08:35.021 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.021 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.021 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.021 DEBUG:boto:Params: {} 2024-04-16T18:08:35.021 DEBUG:boto:Token: None 2024-04-16T18:08:35.021 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.021 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE= 2024-04-16T18:08:35.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE=', 'Content-Length': '0'} 2024-04-16T18:08:35.023 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002b923a07ebf78e4d-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.066 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.067 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.067 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.067 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.067 DEBUG:boto:Method: GET 2024-04-16T18:08:35.067 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.067 DEBUG:boto:Data: 2024-04-16T18:08:35.067 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.067 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.067 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.067 DEBUG:boto:Params: {} 2024-04-16T18:08:35.067 DEBUG:boto:Token: None 2024-04-16T18:08:35.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE= 2024-04-16T18:08:35.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE=', 'Content-Length': '0'} 2024-04-16T18:08:35.069 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000ba658397d3b3ab8-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.070 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.070 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.070 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.070 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.070 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.070 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.070 DEBUG:boto:Data: 2024-04-16T18:08:35.070 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.071 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.071 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.071 DEBUG:boto:Params: {} 2024-04-16T18:08:35.071 DEBUG:boto:Token: None 2024-04-16T18:08:35.071 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SahZ+7E50x0xCAzirLni0KjVkV4= 2024-04-16T18:08:35.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SahZ+7E50x0xCAzirLni0KjVkV4=', 'Content-Length': '0'} 2024-04-16T18:08:35.073 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000055e8e151009ef321-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.073 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.073 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.073 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.073 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.073 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.074 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.074 DEBUG:boto:Data: 2024-04-16T18:08:35.074 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.074 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.074 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.074 DEBUG:boto:Params: {} 2024-04-16T18:08:35.074 DEBUG:boto:Token: None 2024-04-16T18:08:35.074 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.074 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SahZ+7E50x0xCAzirLni0KjVkV4= 2024-04-16T18:08:35.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SahZ+7E50x0xCAzirLni0KjVkV4=', 'Content-Length': '0'} 2024-04-16T18:08:35.076 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cbf92b95f757bd12-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:35.076 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.076 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.077 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.077 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.077 DEBUG:boto:Method: GET 2024-04-16T18:08:35.077 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.077 DEBUG:boto:Data: 2024-04-16T18:08:35.077 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.077 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.077 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.077 DEBUG:boto:Params: {} 2024-04-16T18:08:35.077 DEBUG:boto:Token: None 2024-04-16T18:08:35.078 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.078 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE= 2024-04-16T18:08:35.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE=', 'Content-Length': '0'} 2024-04-16T18:08:35.079 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000069cfc034656a2174-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.080 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.080 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.080 DEBUG:boto:path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.080 DEBUG:boto:auth_path=/cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.080 DEBUG:boto:Method: GET 2024-04-16T18:08:35.080 DEBUG:boto:Path: /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.080 DEBUG:boto:Data: 2024-04-16T18:08:35.080 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.081 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.081 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.081 DEBUG:boto:Params: {} 2024-04-16T18:08:35.081 DEBUG:boto:Token: None 2024-04-16T18:08:35.081 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1?versionId=null 2024-04-16T18:08:35.081 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE= 2024-04-16T18:08:35.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Oni9Dcx8Je8VVZJR0QP7FRnCSRE=', 'Content-Length': '0'} 2024-04-16T18:08:35.083 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009805fb76016a7996-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.083 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.083 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.083 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.083 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.084 DEBUG:boto:Method: GET 2024-04-16T18:08:35.084 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.084 DEBUG:boto:Data: 2024-04-16T18:08:35.084 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.084 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.084 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.084 DEBUG:boto:Params: {} 2024-04-16T18:08:35.084 DEBUG:boto:Token: None 2024-04-16T18:08:35.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013b4645e8181b4ad-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.087 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.087 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.087 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.087 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.087 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.088 DEBUG:boto:Method: GET 2024-04-16T18:08:35.088 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.088 DEBUG:boto:Data: 2024-04-16T18:08:35.088 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.088 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.088 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.088 DEBUG:boto:Params: {} 2024-04-16T18:08:35.088 DEBUG:boto:Token: None 2024-04-16T18:08:35.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.091 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8fe172ddf52fe6c-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.134 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.135 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.135 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.135 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.135 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:08:35.135 DEBUG:boto:Data: 2024-04-16T18:08:35.135 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.135 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.135 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.135 DEBUG:boto:Params: {} 2024-04-16T18:08:35.136 DEBUG:boto:Token: None 2024-04-16T18:08:35.136 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1 2024-04-16T18:08:35.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:03N78SK8KLlq4adloKutjeFQT44= 2024-04-16T18:08:35.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:03N78SK8KLlq4adloKutjeFQT44=', 'Content-Length': '0'} 2024-04-16T18:08:35.138 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a897d2236c6da2e2-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.138 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.138 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.138 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.138 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:08:35.139 DEBUG:boto:Data: 2024-04-16T18:08:35.139 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.139 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.139 DEBUG:boto:Params: {} 2024-04-16T18:08:35.139 DEBUG:boto:Token: None 2024-04-16T18:08:35.139 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1 2024-04-16T18:08:35.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:03N78SK8KLlq4adloKutjeFQT44= 2024-04-16T18:08:35.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:03N78SK8KLlq4adloKutjeFQT44=', 'Content-Length': '0'} 2024-04-16T18:08:35.141 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b7b4cbb41e82c7a7-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:35.142 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.142 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.142 DEBUG:boto:Method: GET 2024-04-16T18:08:35.142 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:08:35.142 DEBUG:boto:Data: 2024-04-16T18:08:35.142 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.142 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.142 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.142 DEBUG:boto:Params: {} 2024-04-16T18:08:35.142 DEBUG:boto:Token: None 2024-04-16T18:08:35.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1 2024-04-16T18:08:35.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EMM/ZN6njxubBETBrrf4j1ebOm8= 2024-04-16T18:08:35.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EMM/ZN6njxubBETBrrf4j1ebOm8=', 'Content-Length': '0'} 2024-04-16T18:08:35.145 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ced1932986e62b20-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.145 DEBUG:boto:path=/cjqttm-39/obj1 2024-04-16T18:08:35.145 DEBUG:boto:auth_path=/cjqttm-39/obj1 2024-04-16T18:08:35.145 DEBUG:boto:Method: GET 2024-04-16T18:08:35.145 DEBUG:boto:Path: /cjqttm-39/obj1 2024-04-16T18:08:35.145 DEBUG:boto:Data: 2024-04-16T18:08:35.145 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.145 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.146 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.146 DEBUG:boto:Params: {} 2024-04-16T18:08:35.146 DEBUG:boto:Token: None 2024-04-16T18:08:35.146 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj1 2024-04-16T18:08:35.146 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EMM/ZN6njxubBETBrrf4j1ebOm8= 2024-04-16T18:08:35.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EMM/ZN6njxubBETBrrf4j1ebOm8=', 'Content-Length': '0'} 2024-04-16T18:08:35.148 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ee57c8db512c2890-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.190 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.190 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.191 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.191 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.191 DEBUG:boto:Method: GET 2024-04-16T18:08:35.191 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.191 DEBUG:boto:Data: 2024-04-16T18:08:35.191 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.191 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.191 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.191 DEBUG:boto:Params: {} 2024-04-16T18:08:35.191 DEBUG:boto:Token: None 2024-04-16T18:08:35.191 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bff362f6080190d6-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.195 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.195 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.195 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.195 DEBUG:boto:path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.195 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.195 DEBUG:boto:Method: GET 2024-04-16T18:08:35.196 DEBUG:boto:Path: /cjqttm-39/?prefix=obj1 2024-04-16T18:08:35.196 DEBUG:boto:Data: 2024-04-16T18:08:35.196 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.196 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.196 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.196 DEBUG:boto:Params: {} 2024-04-16T18:08:35.196 DEBUG:boto:Token: None 2024-04-16T18:08:35.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c45bc9a83abc9c76-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.199 DEBUG:boto:b'cjqttm-39obj11000falseobj12024-04-16T18:07:39.793Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:35.199 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.199 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.199 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.199 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.199 DEBUG:boto:Method: GET 2024-04-16T18:08:35.200 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.200 DEBUG:boto:Data: 2024-04-16T18:08:35.200 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.200 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.200 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.200 DEBUG:boto:Params: {} 2024-04-16T18:08:35.200 DEBUG:boto:Token: None 2024-04-16T18:08:35.200 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms= 2024-04-16T18:08:35.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms=', 'Content-Length': '0'} 2024-04-16T18:08:35.202 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a564c7c0615bb456-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.202 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.203 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.203 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.203 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.203 DEBUG:boto:Method: GET 2024-04-16T18:08:35.203 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.203 DEBUG:boto:Data: 2024-04-16T18:08:35.203 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.203 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.203 DEBUG:boto:Params: {} 2024-04-16T18:08:35.203 DEBUG:boto:Token: None 2024-04-16T18:08:35.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms= 2024-04-16T18:08:35.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms=', 'Content-Length': '0'} 2024-04-16T18:08:35.206 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a199529eab9bb043-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.246 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.247 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.247 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.247 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.247 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.247 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.247 DEBUG:boto:Data: 2024-04-16T18:08:35.247 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.247 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.247 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.247 DEBUG:boto:Params: {} 2024-04-16T18:08:35.248 DEBUG:boto:Token: None 2024-04-16T18:08:35.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xep26IXCrQW7e7Ifp2LuDFEr5QM= 2024-04-16T18:08:35.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xep26IXCrQW7e7Ifp2LuDFEr5QM=', 'Content-Length': '0'} 2024-04-16T18:08:35.250 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001bdd749760ad9886-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.250 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.250 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.250 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.250 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.250 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.250 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.250 DEBUG:boto:Data: 2024-04-16T18:08:35.251 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.251 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.251 DEBUG:boto:Params: {} 2024-04-16T18:08:35.251 DEBUG:boto:Token: None 2024-04-16T18:08:35.251 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xep26IXCrQW7e7Ifp2LuDFEr5QM= 2024-04-16T18:08:35.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xep26IXCrQW7e7Ifp2LuDFEr5QM=', 'Content-Length': '0'} 2024-04-16T18:08:35.253 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008446b6abebece34b-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.253 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:35.253 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.253 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.254 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.254 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.254 DEBUG:boto:Method: GET 2024-04-16T18:08:35.254 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.254 DEBUG:boto:Data: 2024-04-16T18:08:35.254 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.254 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.254 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.254 DEBUG:boto:Params: {} 2024-04-16T18:08:35.254 DEBUG:boto:Token: None 2024-04-16T18:08:35.254 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms= 2024-04-16T18:08:35.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms=', 'Content-Length': '0'} 2024-04-16T18:08:35.256 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003988e9d2b13b4e4e-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.257 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.257 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.257 DEBUG:boto:path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.257 DEBUG:boto:auth_path=/cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.257 DEBUG:boto:Method: GET 2024-04-16T18:08:35.257 DEBUG:boto:Path: /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.257 DEBUG:boto:Data: 2024-04-16T18:08:35.257 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.257 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.257 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.258 DEBUG:boto:Params: {} 2024-04-16T18:08:35.258 DEBUG:boto:Token: None 2024-04-16T18:08:35.258 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2?versionId=null 2024-04-16T18:08:35.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms= 2024-04-16T18:08:35.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sMIhMm2GfWomdxfzufhQo7TuKms=', 'Content-Length': '0'} 2024-04-16T18:08:35.260 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000411775eed2226bcd-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.302 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.302 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.303 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.303 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.303 DEBUG:boto:Method: GET 2024-04-16T18:08:35.303 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.303 DEBUG:boto:Data: 2024-04-16T18:08:35.303 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.303 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.303 DEBUG:boto:Params: {} 2024-04-16T18:08:35.303 DEBUG:boto:Token: None 2024-04-16T18:08:35.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.307 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b696f533071ec238-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.307 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.307 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.308 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.308 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.308 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.308 DEBUG:boto:Method: GET 2024-04-16T18:08:35.308 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.308 DEBUG:boto:Data: 2024-04-16T18:08:35.308 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.308 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.308 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.308 DEBUG:boto:Params: {} 2024-04-16T18:08:35.309 DEBUG:boto:Token: None 2024-04-16T18:08:35.309 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb59c0489559bd77-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.311 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.311 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.312 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.312 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.312 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:08:35.312 DEBUG:boto:Data: 2024-04-16T18:08:35.312 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.312 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.312 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.312 DEBUG:boto:Params: {} 2024-04-16T18:08:35.312 DEBUG:boto:Token: None 2024-04-16T18:08:35.312 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2 2024-04-16T18:08:35.313 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3r3q9yrDOeyGW4sE5ukxH3nM7Xo= 2024-04-16T18:08:35.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3r3q9yrDOeyGW4sE5ukxH3nM7Xo=', 'Content-Length': '0'} 2024-04-16T18:08:35.315 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000005363891c09f158d-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.315 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.315 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.315 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.315 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:08:35.315 DEBUG:boto:Data: 2024-04-16T18:08:35.315 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.316 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.316 DEBUG:boto:Params: {} 2024-04-16T18:08:35.316 DEBUG:boto:Token: None 2024-04-16T18:08:35.316 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2 2024-04-16T18:08:35.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3r3q9yrDOeyGW4sE5ukxH3nM7Xo= 2024-04-16T18:08:35.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3r3q9yrDOeyGW4sE5ukxH3nM7Xo=', 'Content-Length': '0'} 2024-04-16T18:08:35.317 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002eb848b14e788b07-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.318 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:35.318 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.318 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.318 DEBUG:boto:Method: GET 2024-04-16T18:08:35.318 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:08:35.318 DEBUG:boto:Data: 2024-04-16T18:08:35.318 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.318 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.319 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.319 DEBUG:boto:Params: {} 2024-04-16T18:08:35.319 DEBUG:boto:Token: None 2024-04-16T18:08:35.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2 2024-04-16T18:08:35.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JMshzNDXG89hAp1kWpm1xTcYarM= 2024-04-16T18:08:35.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JMshzNDXG89hAp1kWpm1xTcYarM=', 'Content-Length': '0'} 2024-04-16T18:08:35.321 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aac36a005bbda1fe-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.362 DEBUG:boto:path=/cjqttm-39/obj2 2024-04-16T18:08:35.363 DEBUG:boto:auth_path=/cjqttm-39/obj2 2024-04-16T18:08:35.363 DEBUG:boto:Method: GET 2024-04-16T18:08:35.363 DEBUG:boto:Path: /cjqttm-39/obj2 2024-04-16T18:08:35.363 DEBUG:boto:Data: 2024-04-16T18:08:35.363 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.363 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.363 DEBUG:boto:Params: {} 2024-04-16T18:08:35.363 DEBUG:boto:Token: None 2024-04-16T18:08:35.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj2 2024-04-16T18:08:35.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JMshzNDXG89hAp1kWpm1xTcYarM= 2024-04-16T18:08:35.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JMshzNDXG89hAp1kWpm1xTcYarM=', 'Content-Length': '0'} 2024-04-16T18:08:35.365 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000130e1b523a0f728b-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.406 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.407 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.407 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.407 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.407 DEBUG:boto:Method: GET 2024-04-16T18:08:35.407 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.407 DEBUG:boto:Data: 2024-04-16T18:08:35.407 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.407 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.407 DEBUG:boto:Params: {} 2024-04-16T18:08:35.407 DEBUG:boto:Token: None 2024-04-16T18:08:35.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db08198b756d35fb-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.410 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.411 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.411 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.411 DEBUG:boto:path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.411 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.411 DEBUG:boto:Method: GET 2024-04-16T18:08:35.411 DEBUG:boto:Path: /cjqttm-39/?prefix=obj2 2024-04-16T18:08:35.411 DEBUG:boto:Data: 2024-04-16T18:08:35.411 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.412 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.412 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.412 DEBUG:boto:Params: {} 2024-04-16T18:08:35.412 DEBUG:boto:Token: None 2024-04-16T18:08:35.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033f14174f83c8365-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.415 DEBUG:boto:b'cjqttm-39obj21000falseobj22024-04-16T18:07:39.803Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.415 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:35.415 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.415 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.415 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.415 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.415 DEBUG:boto:Method: GET 2024-04-16T18:08:35.415 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.415 DEBUG:boto:Data: 2024-04-16T18:08:35.416 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.416 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.416 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.416 DEBUG:boto:Params: {} 2024-04-16T18:08:35.416 DEBUG:boto:Token: None 2024-04-16T18:08:35.416 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw= 2024-04-16T18:08:35.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw=', 'Content-Length': '0'} 2024-04-16T18:08:35.418 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000268838a5585d7983-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.419 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.419 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.419 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.419 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.419 DEBUG:boto:Method: GET 2024-04-16T18:08:35.419 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.419 DEBUG:boto:Data: 2024-04-16T18:08:35.419 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.419 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.420 DEBUG:boto:Params: {} 2024-04-16T18:08:35.420 DEBUG:boto:Token: None 2024-04-16T18:08:35.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw= 2024-04-16T18:08:35.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw=', 'Content-Length': '0'} 2024-04-16T18:08:35.422 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006cbf8341ef886ede-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.462 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.463 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.463 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.463 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.463 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.463 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.463 DEBUG:boto:Data: 2024-04-16T18:08:35.463 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.463 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.463 DEBUG:boto:Params: {} 2024-04-16T18:08:35.463 DEBUG:boto:Token: None 2024-04-16T18:08:35.464 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EwkW6zZ/PGz9VJSJfxTeyDcHQvU= 2024-04-16T18:08:35.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EwkW6zZ/PGz9VJSJfxTeyDcHQvU=', 'Content-Length': '0'} 2024-04-16T18:08:35.465 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000016d2becd708ea8f6-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.466 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.466 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.466 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.466 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.466 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.466 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.466 DEBUG:boto:Data: 2024-04-16T18:08:35.466 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.466 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.467 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.467 DEBUG:boto:Params: {} 2024-04-16T18:08:35.467 DEBUG:boto:Token: None 2024-04-16T18:08:35.467 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EwkW6zZ/PGz9VJSJfxTeyDcHQvU= 2024-04-16T18:08:35.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EwkW6zZ/PGz9VJSJfxTeyDcHQvU=', 'Content-Length': '0'} 2024-04-16T18:08:35.469 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006b530128ff98072e-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.469 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:35.469 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.469 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.469 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.470 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.470 DEBUG:boto:Method: GET 2024-04-16T18:08:35.470 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.470 DEBUG:boto:Data: 2024-04-16T18:08:35.470 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.470 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.470 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.470 DEBUG:boto:Params: {} 2024-04-16T18:08:35.470 DEBUG:boto:Token: None 2024-04-16T18:08:35.470 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw= 2024-04-16T18:08:35.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw=', 'Content-Length': '0'} 2024-04-16T18:08:35.472 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c6ac36418d8e8fb5-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.473 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.473 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.473 DEBUG:boto:path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.473 DEBUG:boto:auth_path=/cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.473 DEBUG:boto:Method: GET 2024-04-16T18:08:35.473 DEBUG:boto:Path: /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.473 DEBUG:boto:Data: 2024-04-16T18:08:35.473 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.473 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.474 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.474 DEBUG:boto:Params: {} 2024-04-16T18:08:35.474 DEBUG:boto:Token: None 2024-04-16T18:08:35.474 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3?versionId=null 2024-04-16T18:08:35.474 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw= 2024-04-16T18:08:35.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yS3/yCFLkbFpkCT38Gaq/cp4bIw=', 'Content-Length': '0'} 2024-04-16T18:08:35.476 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000010015354ce06e7a3-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.518 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.519 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.519 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.519 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.519 DEBUG:boto:Method: GET 2024-04-16T18:08:35.519 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.519 DEBUG:boto:Data: 2024-04-16T18:08:35.519 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.519 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.519 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.519 DEBUG:boto:Params: {} 2024-04-16T18:08:35.519 DEBUG:boto:Token: None 2024-04-16T18:08:35.520 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.523 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8981ed853c4d0ae-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.523 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.523 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.523 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.523 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.523 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.524 DEBUG:boto:Method: GET 2024-04-16T18:08:35.524 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.524 DEBUG:boto:Data: 2024-04-16T18:08:35.524 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.524 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.524 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.524 DEBUG:boto:Params: {} 2024-04-16T18:08:35.524 DEBUG:boto:Token: None 2024-04-16T18:08:35.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.527 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f91783a1092b412d-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.527 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.527 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.527 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.527 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.528 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:08:35.528 DEBUG:boto:Data: 2024-04-16T18:08:35.528 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.528 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.528 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.528 DEBUG:boto:Params: {} 2024-04-16T18:08:35.528 DEBUG:boto:Token: None 2024-04-16T18:08:35.528 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3 2024-04-16T18:08:35.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VQxSDJ+yJVCUadGWKfeZoxruHGo= 2024-04-16T18:08:35.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VQxSDJ+yJVCUadGWKfeZoxruHGo=', 'Content-Length': '0'} 2024-04-16T18:08:35.530 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001ffd859efaa95f6c-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.531 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.531 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.531 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.531 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:08:35.531 DEBUG:boto:Data: 2024-04-16T18:08:35.531 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.531 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.531 DEBUG:boto:Params: {} 2024-04-16T18:08:35.531 DEBUG:boto:Token: None 2024-04-16T18:08:35.532 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3 2024-04-16T18:08:35.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VQxSDJ+yJVCUadGWKfeZoxruHGo= 2024-04-16T18:08:35.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VQxSDJ+yJVCUadGWKfeZoxruHGo=', 'Content-Length': '0'} 2024-04-16T18:08:35.533 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007a41adf57302af1c-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:35.534 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.534 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.534 DEBUG:boto:Method: GET 2024-04-16T18:08:35.534 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:08:35.534 DEBUG:boto:Data: 2024-04-16T18:08:35.534 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.534 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.535 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.535 DEBUG:boto:Params: {} 2024-04-16T18:08:35.535 DEBUG:boto:Token: None 2024-04-16T18:08:35.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3 2024-04-16T18:08:35.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xey4PW9H63J4TBYwE6VBlATZ4NE= 2024-04-16T18:08:35.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xey4PW9H63J4TBYwE6VBlATZ4NE=', 'Content-Length': '0'} 2024-04-16T18:08:35.537 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007ca704037f56bb9d-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.578 DEBUG:boto:path=/cjqttm-39/obj3 2024-04-16T18:08:35.578 DEBUG:boto:auth_path=/cjqttm-39/obj3 2024-04-16T18:08:35.579 DEBUG:boto:Method: GET 2024-04-16T18:08:35.579 DEBUG:boto:Path: /cjqttm-39/obj3 2024-04-16T18:08:35.579 DEBUG:boto:Data: 2024-04-16T18:08:35.579 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.579 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.579 DEBUG:boto:Params: {} 2024-04-16T18:08:35.579 DEBUG:boto:Token: None 2024-04-16T18:08:35.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj3 2024-04-16T18:08:35.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xey4PW9H63J4TBYwE6VBlATZ4NE= 2024-04-16T18:08:35.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xey4PW9H63J4TBYwE6VBlATZ4NE=', 'Content-Length': '0'} 2024-04-16T18:08:35.581 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000034b13c2d6d0766ff-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.622 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.622 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.623 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.623 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.623 DEBUG:boto:Method: GET 2024-04-16T18:08:35.623 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.623 DEBUG:boto:Data: 2024-04-16T18:08:35.623 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.623 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.623 DEBUG:boto:Params: {} 2024-04-16T18:08:35.623 DEBUG:boto:Token: None 2024-04-16T18:08:35.623 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f9e9c2b4dc3c928-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.626 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.627 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.627 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.627 DEBUG:boto:path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.627 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.627 DEBUG:boto:Method: GET 2024-04-16T18:08:35.627 DEBUG:boto:Path: /cjqttm-39/?prefix=obj3 2024-04-16T18:08:35.627 DEBUG:boto:Data: 2024-04-16T18:08:35.627 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.628 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.628 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.628 DEBUG:boto:Params: {} 2024-04-16T18:08:35.628 DEBUG:boto:Token: None 2024-04-16T18:08:35.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.630 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ab004b5694bf2a4-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.674 DEBUG:boto:b'cjqttm-39obj31000falseobj32024-04-16T18:07:39.813Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.675 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:35.675 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.675 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.675 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.675 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.675 DEBUG:boto:Method: GET 2024-04-16T18:08:35.675 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.675 DEBUG:boto:Data: 2024-04-16T18:08:35.675 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.676 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.676 DEBUG:boto:Params: {} 2024-04-16T18:08:35.676 DEBUG:boto:Token: None 2024-04-16T18:08:35.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90= 2024-04-16T18:08:35.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90=', 'Content-Length': '0'} 2024-04-16T18:08:35.678 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f1068d1106184347-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.678 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.678 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.678 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.678 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.678 DEBUG:boto:Method: GET 2024-04-16T18:08:35.679 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.679 DEBUG:boto:Data: 2024-04-16T18:08:35.679 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.679 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.679 DEBUG:boto:Params: {} 2024-04-16T18:08:35.679 DEBUG:boto:Token: None 2024-04-16T18:08:35.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90= 2024-04-16T18:08:35.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90=', 'Content-Length': '0'} 2024-04-16T18:08:35.681 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dec51605bf40e4ba-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.723 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.723 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.723 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.723 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.723 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.723 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.724 DEBUG:boto:Data: 2024-04-16T18:08:35.724 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.724 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.724 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.724 DEBUG:boto:Params: {} 2024-04-16T18:08:35.724 DEBUG:boto:Token: None 2024-04-16T18:08:35.724 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1RnjhWG5nr9lPqpbQTme8US2Q30= 2024-04-16T18:08:35.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1RnjhWG5nr9lPqpbQTme8US2Q30=', 'Content-Length': '0'} 2024-04-16T18:08:35.726 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e39d008da2ae4d02-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.726 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.727 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.727 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.727 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.727 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.727 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.727 DEBUG:boto:Data: 2024-04-16T18:08:35.727 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.727 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.727 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.727 DEBUG:boto:Params: {} 2024-04-16T18:08:35.727 DEBUG:boto:Token: None 2024-04-16T18:08:35.728 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1RnjhWG5nr9lPqpbQTme8US2Q30= 2024-04-16T18:08:35.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1RnjhWG5nr9lPqpbQTme8US2Q30=', 'Content-Length': '0'} 2024-04-16T18:08:35.730 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a45c3f2eb701c4b8-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:35.730 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.730 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.730 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.730 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.730 DEBUG:boto:Method: GET 2024-04-16T18:08:35.731 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.731 DEBUG:boto:Data: 2024-04-16T18:08:35.731 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.731 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.731 DEBUG:boto:Params: {} 2024-04-16T18:08:35.731 DEBUG:boto:Token: None 2024-04-16T18:08:35.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.731 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90= 2024-04-16T18:08:35.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90=', 'Content-Length': '0'} 2024-04-16T18:08:35.733 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f115cfab59969380-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.734 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.734 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.734 DEBUG:boto:path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.734 DEBUG:boto:auth_path=/cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.734 DEBUG:boto:Method: GET 2024-04-16T18:08:35.734 DEBUG:boto:Path: /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.734 DEBUG:boto:Data: 2024-04-16T18:08:35.734 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.735 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.735 DEBUG:boto:Params: {} 2024-04-16T18:08:35.735 DEBUG:boto:Token: None 2024-04-16T18:08:35.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4?versionId=null 2024-04-16T18:08:35.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90= 2024-04-16T18:08:35.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rWdGLvcOZRoDxVyjvFoQgrFft90=', 'Content-Length': '0'} 2024-04-16T18:08:35.737 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fe7cd622f1ada64a-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.778 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.779 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.779 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.779 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.779 DEBUG:boto:Method: GET 2024-04-16T18:08:35.779 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.779 DEBUG:boto:Data: 2024-04-16T18:08:35.779 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.779 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.779 DEBUG:boto:Params: {} 2024-04-16T18:08:35.779 DEBUG:boto:Token: None 2024-04-16T18:08:35.780 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e2ca36bf087d168-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.783 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.783 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.783 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.783 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.783 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.783 DEBUG:boto:Method: GET 2024-04-16T18:08:35.784 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.784 DEBUG:boto:Data: 2024-04-16T18:08:35.784 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.784 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.784 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.784 DEBUG:boto:Params: {} 2024-04-16T18:08:35.784 DEBUG:boto:Token: None 2024-04-16T18:08:35.784 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.787 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000600a6aaa17997de5-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.830 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.831 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.831 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.831 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.831 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:08:35.831 DEBUG:boto:Data: 2024-04-16T18:08:35.831 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.831 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.831 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.832 DEBUG:boto:Params: {} 2024-04-16T18:08:35.832 DEBUG:boto:Token: None 2024-04-16T18:08:35.832 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4 2024-04-16T18:08:35.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Mht4yFgdcouRRny5vP7J+j0xDhE= 2024-04-16T18:08:35.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Mht4yFgdcouRRny5vP7J+j0xDhE=', 'Content-Length': '0'} 2024-04-16T18:08:35.834 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d6b0a4e6f3754c7a-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.834 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.834 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.834 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.834 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:08:35.834 DEBUG:boto:Data: 2024-04-16T18:08:35.835 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.835 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.835 DEBUG:boto:Params: {} 2024-04-16T18:08:35.835 DEBUG:boto:Token: None 2024-04-16T18:08:35.835 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4 2024-04-16T18:08:35.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Mht4yFgdcouRRny5vP7J+j0xDhE= 2024-04-16T18:08:35.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Mht4yFgdcouRRny5vP7J+j0xDhE=', 'Content-Length': '0'} 2024-04-16T18:08:35.837 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009431cfd553c2b7c4-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.837 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:35.838 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.838 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.838 DEBUG:boto:Method: GET 2024-04-16T18:08:35.838 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:08:35.838 DEBUG:boto:Data: 2024-04-16T18:08:35.838 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.838 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.838 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.838 DEBUG:boto:Params: {} 2024-04-16T18:08:35.839 DEBUG:boto:Token: None 2024-04-16T18:08:35.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4 2024-04-16T18:08:35.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ExoFRWleOIkzuGos2SBN8T8MTZU= 2024-04-16T18:08:35.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ExoFRWleOIkzuGos2SBN8T8MTZU=', 'Content-Length': '0'} 2024-04-16T18:08:35.841 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004ad50a65a5e84531-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.841 DEBUG:boto:path=/cjqttm-39/obj4 2024-04-16T18:08:35.841 DEBUG:boto:auth_path=/cjqttm-39/obj4 2024-04-16T18:08:35.841 DEBUG:boto:Method: GET 2024-04-16T18:08:35.841 DEBUG:boto:Path: /cjqttm-39/obj4 2024-04-16T18:08:35.841 DEBUG:boto:Data: 2024-04-16T18:08:35.842 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.842 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.842 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.842 DEBUG:boto:Params: {} 2024-04-16T18:08:35.842 DEBUG:boto:Token: None 2024-04-16T18:08:35.842 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj4 2024-04-16T18:08:35.842 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ExoFRWleOIkzuGos2SBN8T8MTZU= 2024-04-16T18:08:35.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ExoFRWleOIkzuGos2SBN8T8MTZU=', 'Content-Length': '0'} 2024-04-16T18:08:35.844 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:39 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:07:44 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000f20f1aebb32791b-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.890 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.891 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.891 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.891 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.891 DEBUG:boto:Method: GET 2024-04-16T18:08:35.891 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.891 DEBUG:boto:Data: 2024-04-16T18:08:35.891 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.892 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.892 DEBUG:boto:Params: {} 2024-04-16T18:08:35.892 DEBUG:boto:Token: None 2024-04-16T18:08:35.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ad97ebbeeba29b7-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.895 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.895 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:35.895 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:35.895 DEBUG:boto:path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.895 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.896 DEBUG:boto:Method: GET 2024-04-16T18:08:35.896 DEBUG:boto:Path: /cjqttm-39/?prefix=obj4 2024-04-16T18:08:35.896 DEBUG:boto:Data: 2024-04-16T18:08:35.896 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.896 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.896 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.896 DEBUG:boto:Params: {} 2024-04-16T18:08:35.896 DEBUG:boto:Token: None 2024-04-16T18:08:35.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/ 2024-04-16T18:08:35.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak= 2024-04-16T18:08:35.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICx8kIxKfM3h6xv4CSkaIwm2Oak=', 'Content-Length': '0'} 2024-04-16T18:08:35.899 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2d3a2623d48c0b7-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.899 DEBUG:boto:b'cjqttm-39obj41000falseobj42024-04-16T18:07:39.859Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:35.899 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:35.899 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:35.900 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:35.900 DEBUG:boto:path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.900 DEBUG:boto:auth_path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.900 DEBUG:boto:Method: GET 2024-04-16T18:08:35.900 DEBUG:boto:Path: /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.900 DEBUG:boto:Data: 2024-04-16T18:08:35.900 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.900 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.900 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.900 DEBUG:boto:Params: {} 2024-04-16T18:08:35.900 DEBUG:boto:Token: None 2024-04-16T18:08:35.901 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.901 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI= 2024-04-16T18:08:35.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI=', 'Content-Length': '0'} 2024-04-16T18:08:35.903 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009277eca834c6c257-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.903 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:35.904 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:35.904 DEBUG:boto:path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.904 DEBUG:boto:auth_path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.904 DEBUG:boto:Method: GET 2024-04-16T18:08:35.904 DEBUG:boto:Path: /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.904 DEBUG:boto:Data: 2024-04-16T18:08:35.904 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.904 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.904 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.904 DEBUG:boto:Params: {} 2024-04-16T18:08:35.905 DEBUG:boto:Token: None 2024-04-16T18:08:35.905 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.905 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI= 2024-04-16T18:08:35.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI=', 'Content-Length': '0'} 2024-04-16T18:08:35.909 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005d530525f5a3554e-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.950 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:35.950 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:35.951 DEBUG:boto:path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.951 DEBUG:boto:auth_path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.951 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.951 DEBUG:boto:Path: /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.951 DEBUG:boto:Data: 2024-04-16T18:08:35.951 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.951 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.951 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.951 DEBUG:boto:Params: {} 2024-04-16T18:08:35.951 DEBUG:boto:Token: None 2024-04-16T18:08:35.952 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J4hLsMiU4+WZUBrrMQYFX7bED6Q= 2024-04-16T18:08:35.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J4hLsMiU4+WZUBrrMQYFX7bED6Q=', 'Content-Length': '0'} 2024-04-16T18:08:35.954 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000459910a971c6db7b-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.954 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:35.954 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:35.954 DEBUG:boto:path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.955 DEBUG:boto:auth_path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.955 DEBUG:boto:Method: HEAD 2024-04-16T18:08:35.955 DEBUG:boto:Path: /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.955 DEBUG:boto:Data: 2024-04-16T18:08:35.955 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.955 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.955 DEBUG:boto:Params: {} 2024-04-16T18:08:35.955 DEBUG:boto:Token: None 2024-04-16T18:08:35.955 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J4hLsMiU4+WZUBrrMQYFX7bED6Q= 2024-04-16T18:08:35.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J4hLsMiU4+WZUBrrMQYFX7bED6Q=', 'Content-Length': '0'} 2024-04-16T18:08:35.958 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000020c6df83bddd8b6d-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.958 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:35.958 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:35.958 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:35.959 DEBUG:boto:path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.959 DEBUG:boto:auth_path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.959 DEBUG:boto:Method: GET 2024-04-16T18:08:35.959 DEBUG:boto:Path: /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.959 DEBUG:boto:Data: 2024-04-16T18:08:35.959 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.959 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:35.959 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.959 DEBUG:boto:Params: {} 2024-04-16T18:08:35.959 DEBUG:boto:Token: None 2024-04-16T18:08:35.960 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI= 2024-04-16T18:08:35.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI=', 'Content-Length': '0'} 2024-04-16T18:08:35.962 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000855c2a54b64fce42-00661ebea3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:35.962 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:35.962 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:35.963 DEBUG:boto:path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.963 DEBUG:boto:auth_path=/cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.963 DEBUG:boto:Method: GET 2024-04-16T18:08:35.963 DEBUG:boto:Path: /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.963 DEBUG:boto:Data: 2024-04-16T18:08:35.963 DEBUG:boto:Headers: {} 2024-04-16T18:08:35.963 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:35.963 DEBUG:boto:Port: 8000 2024-04-16T18:08:35.963 DEBUG:boto:Params: {} 2024-04-16T18:08:35.963 DEBUG:boto:Token: None 2024-04-16T18:08:35.963 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:35 GMT /cjqttm-39/obj5?versionId=null 2024-04-16T18:08:35.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI= 2024-04-16T18:08:35.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZT+eVm6OrtP0ewqOAgL/7eaGKuI=', 'Content-Length': '0'} 2024-04-16T18:08:35.966 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f96eb20ebf20f753-00661ebea3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.006 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.006 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.007 DEBUG:boto:path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.007 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.007 DEBUG:boto:Method: GET 2024-04-16T18:08:36.007 DEBUG:boto:Path: /cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.007 DEBUG:boto:Data: 2024-04-16T18:08:36.007 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.007 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.007 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.007 DEBUG:boto:Params: {} 2024-04-16T18:08:36.007 DEBUG:boto:Token: None 2024-04-16T18:08:36.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000223ba4d06a94ba88-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.010 DEBUG:boto:b'cjqttm-39obj51000falseobj52024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.011 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.011 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.011 DEBUG:boto:path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.011 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.011 DEBUG:boto:Method: GET 2024-04-16T18:08:36.011 DEBUG:boto:Path: /cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.011 DEBUG:boto:Data: 2024-04-16T18:08:36.011 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.012 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.012 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.012 DEBUG:boto:Params: {} 2024-04-16T18:08:36.012 DEBUG:boto:Token: None 2024-04-16T18:08:36.012 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.014 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006735f0706fa2c421-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.015 DEBUG:boto:b'cjqttm-39obj51000falseobj52024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.015 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:36.015 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:36.015 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.015 DEBUG:boto:Path: /cjqttm-39/obj5 2024-04-16T18:08:36.015 DEBUG:boto:Data: 2024-04-16T18:08:36.016 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.016 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.016 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.016 DEBUG:boto:Params: {} 2024-04-16T18:08:36.016 DEBUG:boto:Token: None 2024-04-16T18:08:36.016 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj5 2024-04-16T18:08:36.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A6gJiJjyIfLdTdg66EFIKAleYRA= 2024-04-16T18:08:36.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A6gJiJjyIfLdTdg66EFIKAleYRA=', 'Content-Length': '0'} 2024-04-16T18:08:36.018 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f0e1a70419b51c5f-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.018 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:36.019 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:36.019 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.019 DEBUG:boto:Path: /cjqttm-39/obj5 2024-04-16T18:08:36.019 DEBUG:boto:Data: 2024-04-16T18:08:36.019 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.019 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.019 DEBUG:boto:Params: {} 2024-04-16T18:08:36.019 DEBUG:boto:Token: None 2024-04-16T18:08:36.019 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj5 2024-04-16T18:08:36.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A6gJiJjyIfLdTdg66EFIKAleYRA= 2024-04-16T18:08:36.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A6gJiJjyIfLdTdg66EFIKAleYRA=', 'Content-Length': '0'} 2024-04-16T18:08:36.022 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b52ad5434985f708-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.022 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:36.022 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:36.022 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:36.022 DEBUG:boto:Method: GET 2024-04-16T18:08:36.022 DEBUG:boto:Path: /cjqttm-39/obj5 2024-04-16T18:08:36.022 DEBUG:boto:Data: 2024-04-16T18:08:36.022 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.023 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.023 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.023 DEBUG:boto:Params: {} 2024-04-16T18:08:36.023 DEBUG:boto:Token: None 2024-04-16T18:08:36.023 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj5 2024-04-16T18:08:36.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rhvo0oU8npHZolo8pePb9gjxO14= 2024-04-16T18:08:36.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rhvo0oU8npHZolo8pePb9gjxO14=', 'Content-Length': '0'} 2024-04-16T18:08:36.025 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c584668758c0131c-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.066 DEBUG:boto:path=/cjqttm-39/obj5 2024-04-16T18:08:36.067 DEBUG:boto:auth_path=/cjqttm-39/obj5 2024-04-16T18:08:36.067 DEBUG:boto:Method: GET 2024-04-16T18:08:36.067 DEBUG:boto:Path: /cjqttm-39/obj5 2024-04-16T18:08:36.067 DEBUG:boto:Data: 2024-04-16T18:08:36.067 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.067 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.067 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.067 DEBUG:boto:Params: {} 2024-04-16T18:08:36.067 DEBUG:boto:Token: None 2024-04-16T18:08:36.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj5 2024-04-16T18:08:36.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rhvo0oU8npHZolo8pePb9gjxO14= 2024-04-16T18:08:36.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rhvo0oU8npHZolo8pePb9gjxO14=', 'Content-Length': '0'} 2024-04-16T18:08:36.070 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000051662d17509d6962-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.110 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.110 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.111 DEBUG:boto:path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.113 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.113 DEBUG:boto:Method: GET 2024-04-16T18:08:36.113 DEBUG:boto:Path: /cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.114 DEBUG:boto:Data: 2024-04-16T18:08:36.114 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.114 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.114 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.114 DEBUG:boto:Params: {} 2024-04-16T18:08:36.114 DEBUG:boto:Token: None 2024-04-16T18:08:36.114 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.114 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.117 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024bd28706a5fa95a-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.117 DEBUG:boto:b'cjqttm-39obj51000falseobj52024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.117 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.118 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.118 DEBUG:boto:path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.118 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.118 DEBUG:boto:Method: GET 2024-04-16T18:08:36.118 DEBUG:boto:Path: /cjqttm-39/?prefix=obj5 2024-04-16T18:08:36.118 DEBUG:boto:Data: 2024-04-16T18:08:36.118 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.118 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.118 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.118 DEBUG:boto:Params: {} 2024-04-16T18:08:36.119 DEBUG:boto:Token: None 2024-04-16T18:08:36.119 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.121 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008042469efd50e83-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.122 DEBUG:boto:b'cjqttm-39obj51000falseobj52024-04-16T18:07:52.752Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:36.122 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.122 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.122 DEBUG:boto:path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.123 DEBUG:boto:auth_path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.123 DEBUG:boto:Method: GET 2024-04-16T18:08:36.123 DEBUG:boto:Path: /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.123 DEBUG:boto:Data: 2024-04-16T18:08:36.123 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.123 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.123 DEBUG:boto:Params: {} 2024-04-16T18:08:36.123 DEBUG:boto:Token: None 2024-04-16T18:08:36.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA= 2024-04-16T18:08:36.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA=', 'Content-Length': '0'} 2024-04-16T18:08:36.126 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006a063a99d5cb31dd-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.126 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.126 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.126 DEBUG:boto:path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.126 DEBUG:boto:auth_path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.126 DEBUG:boto:Method: GET 2024-04-16T18:08:36.127 DEBUG:boto:Path: /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.127 DEBUG:boto:Data: 2024-04-16T18:08:36.127 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.127 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.127 DEBUG:boto:Params: {} 2024-04-16T18:08:36.127 DEBUG:boto:Token: None 2024-04-16T18:08:36.127 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA= 2024-04-16T18:08:36.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA=', 'Content-Length': '0'} 2024-04-16T18:08:36.129 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:11 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f73de082a1c97cf6-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.170 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.171 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.171 DEBUG:boto:path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.171 DEBUG:boto:auth_path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.171 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.171 DEBUG:boto:Path: /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.171 DEBUG:boto:Data: 2024-04-16T18:08:36.171 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.171 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.171 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.171 DEBUG:boto:Params: {} 2024-04-16T18:08:36.171 DEBUG:boto:Token: None 2024-04-16T18:08:36.172 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/RuW6hjGdNJO/T7CoDlUnGuQfhg= 2024-04-16T18:08:36.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/RuW6hjGdNJO/T7CoDlUnGuQfhg=', 'Content-Length': '0'} 2024-04-16T18:08:36.174 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000010572a4553d41b00-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.174 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.174 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.174 DEBUG:boto:path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.174 DEBUG:boto:auth_path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.175 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.175 DEBUG:boto:Path: /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.175 DEBUG:boto:Data: 2024-04-16T18:08:36.175 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.175 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.175 DEBUG:boto:Params: {} 2024-04-16T18:08:36.175 DEBUG:boto:Token: None 2024-04-16T18:08:36.175 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/RuW6hjGdNJO/T7CoDlUnGuQfhg= 2024-04-16T18:08:36.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/RuW6hjGdNJO/T7CoDlUnGuQfhg=', 'Content-Length': '0'} 2024-04-16T18:08:36.178 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:11 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000076bd959cd65e586c-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.178 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:36.178 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.178 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.178 DEBUG:boto:path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.178 DEBUG:boto:auth_path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.178 DEBUG:boto:Method: GET 2024-04-16T18:08:36.178 DEBUG:boto:Path: /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.179 DEBUG:boto:Data: 2024-04-16T18:08:36.179 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.179 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.179 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.179 DEBUG:boto:Params: {} 2024-04-16T18:08:36.179 DEBUG:boto:Token: None 2024-04-16T18:08:36.179 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA= 2024-04-16T18:08:36.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA=', 'Content-Length': '0'} 2024-04-16T18:08:36.181 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000544c18274e5c8efb-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.181 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.181 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.182 DEBUG:boto:path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.182 DEBUG:boto:auth_path=/cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.182 DEBUG:boto:Method: GET 2024-04-16T18:08:36.182 DEBUG:boto:Path: /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.182 DEBUG:boto:Data: 2024-04-16T18:08:36.182 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.182 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.182 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.182 DEBUG:boto:Params: {} 2024-04-16T18:08:36.183 DEBUG:boto:Token: None 2024-04-16T18:08:36.183 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6?versionId=null 2024-04-16T18:08:36.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA= 2024-04-16T18:08:36.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwO2i5dYT6JT5sN25Pj/8tOOiHA=', 'Content-Length': '0'} 2024-04-16T18:08:36.185 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:11 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008afe97b8f53de097-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.226 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.227 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.227 DEBUG:boto:path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.227 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.227 DEBUG:boto:Method: GET 2024-04-16T18:08:36.227 DEBUG:boto:Path: /cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.227 DEBUG:boto:Data: 2024-04-16T18:08:36.227 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.227 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.227 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.227 DEBUG:boto:Params: {} 2024-04-16T18:08:36.227 DEBUG:boto:Token: None 2024-04-16T18:08:36.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.230 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006788714abf6b9179-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.231 DEBUG:boto:b'cjqttm-39obj61000falseobj62024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.231 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.231 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.231 DEBUG:boto:path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.231 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.231 DEBUG:boto:Method: GET 2024-04-16T18:08:36.231 DEBUG:boto:Path: /cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.232 DEBUG:boto:Data: 2024-04-16T18:08:36.232 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.232 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.232 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.232 DEBUG:boto:Params: {} 2024-04-16T18:08:36.232 DEBUG:boto:Token: None 2024-04-16T18:08:36.232 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.235 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a59c0ef8bac83464-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.278 DEBUG:boto:b'cjqttm-39obj61000falseobj62024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.279 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.279 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.279 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.279 DEBUG:boto:Path: /cjqttm-39/obj6 2024-04-16T18:08:36.279 DEBUG:boto:Data: 2024-04-16T18:08:36.279 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.279 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.279 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.279 DEBUG:boto:Params: {} 2024-04-16T18:08:36.280 DEBUG:boto:Token: None 2024-04-16T18:08:36.280 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6 2024-04-16T18:08:36.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/3mkXTQO62KK1aPxLKYl5GDBucE= 2024-04-16T18:08:36.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/3mkXTQO62KK1aPxLKYl5GDBucE=', 'Content-Length': '0'} 2024-04-16T18:08:36.282 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005ec74c7e61c23fe1-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.282 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.282 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.282 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.282 DEBUG:boto:Path: /cjqttm-39/obj6 2024-04-16T18:08:36.283 DEBUG:boto:Data: 2024-04-16T18:08:36.283 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.283 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.283 DEBUG:boto:Params: {} 2024-04-16T18:08:36.283 DEBUG:boto:Token: None 2024-04-16T18:08:36.283 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6 2024-04-16T18:08:36.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/3mkXTQO62KK1aPxLKYl5GDBucE= 2024-04-16T18:08:36.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/3mkXTQO62KK1aPxLKYl5GDBucE=', 'Content-Length': '0'} 2024-04-16T18:08:36.286 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:11 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005c110acfd576f528-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.286 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:36.286 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.286 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.286 DEBUG:boto:Method: GET 2024-04-16T18:08:36.286 DEBUG:boto:Path: /cjqttm-39/obj6 2024-04-16T18:08:36.286 DEBUG:boto:Data: 2024-04-16T18:08:36.287 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.287 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.287 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.287 DEBUG:boto:Params: {} 2024-04-16T18:08:36.287 DEBUG:boto:Token: None 2024-04-16T18:08:36.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6 2024-04-16T18:08:36.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ISLzDdbW/1TE9qWYMGHWhgpNjRE= 2024-04-16T18:08:36.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ISLzDdbW/1TE9qWYMGHWhgpNjRE=', 'Content-Length': '0'} 2024-04-16T18:08:36.289 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003428ebdd84873f53-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.290 DEBUG:boto:path=/cjqttm-39/obj6 2024-04-16T18:08:36.290 DEBUG:boto:auth_path=/cjqttm-39/obj6 2024-04-16T18:08:36.290 DEBUG:boto:Method: GET 2024-04-16T18:08:36.290 DEBUG:boto:Path: /cjqttm-39/obj6 2024-04-16T18:08:36.290 DEBUG:boto:Data: 2024-04-16T18:08:36.290 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.290 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.290 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.290 DEBUG:boto:Params: {} 2024-04-16T18:08:36.291 DEBUG:boto:Token: None 2024-04-16T18:08:36.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj6 2024-04-16T18:08:36.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ISLzDdbW/1TE9qWYMGHWhgpNjRE= 2024-04-16T18:08:36.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ISLzDdbW/1TE9qWYMGHWhgpNjRE=', 'Content-Length': '0'} 2024-04-16T18:08:36.293 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:11 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d848671191af2de5-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.334 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.335 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.335 DEBUG:boto:path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.335 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.335 DEBUG:boto:Method: GET 2024-04-16T18:08:36.335 DEBUG:boto:Path: /cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.335 DEBUG:boto:Data: 2024-04-16T18:08:36.335 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.335 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.335 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.335 DEBUG:boto:Params: {} 2024-04-16T18:08:36.336 DEBUG:boto:Token: None 2024-04-16T18:08:36.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a4a6dccf7b3cb88f-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.339 DEBUG:boto:b'cjqttm-39obj61000falseobj62024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.339 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.339 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.339 DEBUG:boto:path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.339 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.339 DEBUG:boto:Method: GET 2024-04-16T18:08:36.339 DEBUG:boto:Path: /cjqttm-39/?prefix=obj6 2024-04-16T18:08:36.340 DEBUG:boto:Data: 2024-04-16T18:08:36.340 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.340 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.340 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.340 DEBUG:boto:Params: {} 2024-04-16T18:08:36.340 DEBUG:boto:Token: None 2024-04-16T18:08:36.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.343 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003c60bc36f4474e2-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.343 DEBUG:boto:b'cjqttm-39obj61000falseobj62024-04-16T18:07:52.762Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.343 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:36.343 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.344 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.344 DEBUG:boto:path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.344 DEBUG:boto:auth_path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.344 DEBUG:boto:Method: GET 2024-04-16T18:08:36.344 DEBUG:boto:Path: /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.344 DEBUG:boto:Data: 2024-04-16T18:08:36.344 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.344 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.344 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.344 DEBUG:boto:Params: {} 2024-04-16T18:08:36.344 DEBUG:boto:Token: None 2024-04-16T18:08:36.345 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.345 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ= 2024-04-16T18:08:36.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ=', 'Content-Length': '0'} 2024-04-16T18:08:36.347 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006ac7e0ef25e307db-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.347 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.347 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.347 DEBUG:boto:path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.347 DEBUG:boto:auth_path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.348 DEBUG:boto:Method: GET 2024-04-16T18:08:36.348 DEBUG:boto:Path: /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.348 DEBUG:boto:Data: 2024-04-16T18:08:36.348 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.348 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.348 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.348 DEBUG:boto:Params: {} 2024-04-16T18:08:36.348 DEBUG:boto:Token: None 2024-04-16T18:08:36.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ= 2024-04-16T18:08:36.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ=', 'Content-Length': '0'} 2024-04-16T18:08:36.350 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f259b208740b9aae-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.394 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.395 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.395 DEBUG:boto:path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.395 DEBUG:boto:auth_path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.395 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.395 DEBUG:boto:Path: /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.395 DEBUG:boto:Data: 2024-04-16T18:08:36.395 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.395 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.395 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.396 DEBUG:boto:Params: {} 2024-04-16T18:08:36.396 DEBUG:boto:Token: None 2024-04-16T18:08:36.396 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x8cDWVmDlHiFC/wmtrTYjXJ/NMc= 2024-04-16T18:08:36.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x8cDWVmDlHiFC/wmtrTYjXJ/NMc=', 'Content-Length': '0'} 2024-04-16T18:08:36.398 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009d8388ab56f7b12f-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.398 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.398 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.398 DEBUG:boto:path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.399 DEBUG:boto:auth_path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.399 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.399 DEBUG:boto:Path: /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.399 DEBUG:boto:Data: 2024-04-16T18:08:36.399 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.399 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.399 DEBUG:boto:Params: {} 2024-04-16T18:08:36.399 DEBUG:boto:Token: None 2024-04-16T18:08:36.399 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x8cDWVmDlHiFC/wmtrTYjXJ/NMc= 2024-04-16T18:08:36.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x8cDWVmDlHiFC/wmtrTYjXJ/NMc=', 'Content-Length': '0'} 2024-04-16T18:08:36.401 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aa028d1a72f414bc-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.402 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:36.402 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.402 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.402 DEBUG:boto:path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.402 DEBUG:boto:auth_path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.402 DEBUG:boto:Method: GET 2024-04-16T18:08:36.402 DEBUG:boto:Path: /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.403 DEBUG:boto:Data: 2024-04-16T18:08:36.403 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.403 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.403 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.403 DEBUG:boto:Params: {} 2024-04-16T18:08:36.403 DEBUG:boto:Token: None 2024-04-16T18:08:36.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ= 2024-04-16T18:08:36.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ=', 'Content-Length': '0'} 2024-04-16T18:08:36.405 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000184aefa15e4943c0-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.406 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.406 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.406 DEBUG:boto:path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.406 DEBUG:boto:auth_path=/cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.406 DEBUG:boto:Method: GET 2024-04-16T18:08:36.406 DEBUG:boto:Path: /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.406 DEBUG:boto:Data: 2024-04-16T18:08:36.406 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.407 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.407 DEBUG:boto:Params: {} 2024-04-16T18:08:36.407 DEBUG:boto:Token: None 2024-04-16T18:08:36.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7?versionId=null 2024-04-16T18:08:36.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ= 2024-04-16T18:08:36.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IOeMKas7M/RhLssypGshSsR5BpQ=', 'Content-Length': '0'} 2024-04-16T18:08:36.409 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000413a4a44aedbcecd-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.450 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.450 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.451 DEBUG:boto:path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.451 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.451 DEBUG:boto:Method: GET 2024-04-16T18:08:36.451 DEBUG:boto:Path: /cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.451 DEBUG:boto:Data: 2024-04-16T18:08:36.451 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.451 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.451 DEBUG:boto:Params: {} 2024-04-16T18:08:36.451 DEBUG:boto:Token: None 2024-04-16T18:08:36.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afbd659eb7c23cc4-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.454 DEBUG:boto:b'cjqttm-39obj71000falseobj72024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.455 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.455 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.455 DEBUG:boto:path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.455 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.455 DEBUG:boto:Method: GET 2024-04-16T18:08:36.455 DEBUG:boto:Path: /cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.455 DEBUG:boto:Data: 2024-04-16T18:08:36.456 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.456 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.456 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.456 DEBUG:boto:Params: {} 2024-04-16T18:08:36.456 DEBUG:boto:Token: None 2024-04-16T18:08:36.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.459 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f04628365adf4bd9-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.459 DEBUG:boto:b'cjqttm-39obj71000falseobj72024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.459 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.460 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.460 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.460 DEBUG:boto:Path: /cjqttm-39/obj7 2024-04-16T18:08:36.460 DEBUG:boto:Data: 2024-04-16T18:08:36.460 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.460 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.460 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.460 DEBUG:boto:Params: {} 2024-04-16T18:08:36.460 DEBUG:boto:Token: None 2024-04-16T18:08:36.461 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7 2024-04-16T18:08:36.461 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xFEBg4I+E40snFrUC8cI6wa6c0M= 2024-04-16T18:08:36.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xFEBg4I+E40snFrUC8cI6wa6c0M=', 'Content-Length': '0'} 2024-04-16T18:08:36.462 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000481cbe9d0ddac0f2-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.463 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.463 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.463 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.463 DEBUG:boto:Path: /cjqttm-39/obj7 2024-04-16T18:08:36.463 DEBUG:boto:Data: 2024-04-16T18:08:36.463 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.463 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.464 DEBUG:boto:Params: {} 2024-04-16T18:08:36.464 DEBUG:boto:Token: None 2024-04-16T18:08:36.464 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7 2024-04-16T18:08:36.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xFEBg4I+E40snFrUC8cI6wa6c0M= 2024-04-16T18:08:36.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xFEBg4I+E40snFrUC8cI6wa6c0M=', 'Content-Length': '0'} 2024-04-16T18:08:36.466 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c0d59fcd0e896e8b-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.466 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:36.466 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.466 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.466 DEBUG:boto:Method: GET 2024-04-16T18:08:36.466 DEBUG:boto:Path: /cjqttm-39/obj7 2024-04-16T18:08:36.467 DEBUG:boto:Data: 2024-04-16T18:08:36.467 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.467 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.467 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.467 DEBUG:boto:Params: {} 2024-04-16T18:08:36.467 DEBUG:boto:Token: None 2024-04-16T18:08:36.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7 2024-04-16T18:08:36.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zuP7go0K4e+i4NT6IBn65AA3Mdk= 2024-04-16T18:08:36.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zuP7go0K4e+i4NT6IBn65AA3Mdk=', 'Content-Length': '0'} 2024-04-16T18:08:36.469 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005f86811170eeac23-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.510 DEBUG:boto:path=/cjqttm-39/obj7 2024-04-16T18:08:36.510 DEBUG:boto:auth_path=/cjqttm-39/obj7 2024-04-16T18:08:36.511 DEBUG:boto:Method: GET 2024-04-16T18:08:36.511 DEBUG:boto:Path: /cjqttm-39/obj7 2024-04-16T18:08:36.511 DEBUG:boto:Data: 2024-04-16T18:08:36.511 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.511 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.511 DEBUG:boto:Params: {} 2024-04-16T18:08:36.511 DEBUG:boto:Token: None 2024-04-16T18:08:36.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj7 2024-04-16T18:08:36.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zuP7go0K4e+i4NT6IBn65AA3Mdk= 2024-04-16T18:08:36.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zuP7go0K4e+i4NT6IBn65AA3Mdk=', 'Content-Length': '0'} 2024-04-16T18:08:36.513 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:04 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008c1c280f68a5de3d-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.554 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.555 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.555 DEBUG:boto:path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.555 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.555 DEBUG:boto:Method: GET 2024-04-16T18:08:36.555 DEBUG:boto:Path: /cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.555 DEBUG:boto:Data: 2024-04-16T18:08:36.555 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.555 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.555 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.555 DEBUG:boto:Params: {} 2024-04-16T18:08:36.556 DEBUG:boto:Token: None 2024-04-16T18:08:36.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.559 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007deaafbbfdc5c9be-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.559 DEBUG:boto:b'cjqttm-39obj71000falseobj72024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.559 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.559 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.560 DEBUG:boto:path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.560 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.560 DEBUG:boto:Method: GET 2024-04-16T18:08:36.560 DEBUG:boto:Path: /cjqttm-39/?prefix=obj7 2024-04-16T18:08:36.560 DEBUG:boto:Data: 2024-04-16T18:08:36.560 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.560 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.560 DEBUG:boto:Params: {} 2024-04-16T18:08:36.561 DEBUG:boto:Token: None 2024-04-16T18:08:36.561 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.561 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.563 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe26b9a7c8367964-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.564 DEBUG:boto:b'cjqttm-39obj71000falseobj72024-04-16T18:07:52.811Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.564 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:36.564 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.564 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.564 DEBUG:boto:path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.565 DEBUG:boto:auth_path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.565 DEBUG:boto:Method: GET 2024-04-16T18:08:36.565 DEBUG:boto:Path: /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.565 DEBUG:boto:Data: 2024-04-16T18:08:36.565 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.565 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.565 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.565 DEBUG:boto:Params: {} 2024-04-16T18:08:36.565 DEBUG:boto:Token: None 2024-04-16T18:08:36.566 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0= 2024-04-16T18:08:36.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0=', 'Content-Length': '0'} 2024-04-16T18:08:36.569 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000121780cac1b36fe3-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.569 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.569 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.569 DEBUG:boto:path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.569 DEBUG:boto:auth_path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.570 DEBUG:boto:Method: GET 2024-04-16T18:08:36.570 DEBUG:boto:Path: /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.570 DEBUG:boto:Data: 2024-04-16T18:08:36.570 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.570 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.570 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.570 DEBUG:boto:Params: {} 2024-04-16T18:08:36.570 DEBUG:boto:Token: None 2024-04-16T18:08:36.570 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.571 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0= 2024-04-16T18:08:36.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0=', 'Content-Length': '0'} 2024-04-16T18:08:36.573 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000737a8f3398b67e14-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.614 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.614 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.615 DEBUG:boto:path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.615 DEBUG:boto:auth_path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.615 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.615 DEBUG:boto:Path: /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.615 DEBUG:boto:Data: 2024-04-16T18:08:36.615 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.615 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.616 DEBUG:boto:Params: {} 2024-04-16T18:08:36.616 DEBUG:boto:Token: None 2024-04-16T18:08:36.616 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8iqjA5Y1unvxbfmtk1MSnAi7m2s= 2024-04-16T18:08:36.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8iqjA5Y1unvxbfmtk1MSnAi7m2s=', 'Content-Length': '0'} 2024-04-16T18:08:36.618 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000109239909db9e7ea-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.618 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.619 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.619 DEBUG:boto:path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.619 DEBUG:boto:auth_path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.619 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.619 DEBUG:boto:Path: /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.619 DEBUG:boto:Data: 2024-04-16T18:08:36.619 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.619 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.619 DEBUG:boto:Params: {} 2024-04-16T18:08:36.620 DEBUG:boto:Token: None 2024-04-16T18:08:36.620 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8iqjA5Y1unvxbfmtk1MSnAi7m2s= 2024-04-16T18:08:36.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8iqjA5Y1unvxbfmtk1MSnAi7m2s=', 'Content-Length': '0'} 2024-04-16T18:08:36.622 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000057ed092536343620-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:36.623 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.623 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.623 DEBUG:boto:path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.623 DEBUG:boto:auth_path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.623 DEBUG:boto:Method: GET 2024-04-16T18:08:36.623 DEBUG:boto:Path: /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.623 DEBUG:boto:Data: 2024-04-16T18:08:36.623 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.624 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.624 DEBUG:boto:Params: {} 2024-04-16T18:08:36.624 DEBUG:boto:Token: None 2024-04-16T18:08:36.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0= 2024-04-16T18:08:36.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0=', 'Content-Length': '0'} 2024-04-16T18:08:36.626 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c064ab35a0b933cc-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.627 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.627 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.627 DEBUG:boto:path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.627 DEBUG:boto:auth_path=/cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.627 DEBUG:boto:Method: GET 2024-04-16T18:08:36.627 DEBUG:boto:Path: /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.627 DEBUG:boto:Data: 2024-04-16T18:08:36.628 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.628 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.628 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.628 DEBUG:boto:Params: {} 2024-04-16T18:08:36.628 DEBUG:boto:Token: None 2024-04-16T18:08:36.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8?versionId=null 2024-04-16T18:08:36.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0= 2024-04-16T18:08:36.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W56jEMo2Rj5KTcU0j0f5KaXuCR0=', 'Content-Length': '0'} 2024-04-16T18:08:36.631 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d6413fc1d2802056-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.674 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.675 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.675 DEBUG:boto:path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.675 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.675 DEBUG:boto:Method: GET 2024-04-16T18:08:36.675 DEBUG:boto:Path: /cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.675 DEBUG:boto:Data: 2024-04-16T18:08:36.675 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.676 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.676 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.676 DEBUG:boto:Params: {} 2024-04-16T18:08:36.676 DEBUG:boto:Token: None 2024-04-16T18:08:36.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.679 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c807b9e7c673ccb-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.679 DEBUG:boto:b'cjqttm-39obj81000falseobj82024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.680 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.680 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.680 DEBUG:boto:path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.680 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.680 DEBUG:boto:Method: GET 2024-04-16T18:08:36.680 DEBUG:boto:Path: /cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.680 DEBUG:boto:Data: 2024-04-16T18:08:36.680 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.681 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.681 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.681 DEBUG:boto:Params: {} 2024-04-16T18:08:36.681 DEBUG:boto:Token: None 2024-04-16T18:08:36.681 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.681 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.684 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041157f51505e89c4-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.684 DEBUG:boto:b'cjqttm-39obj81000falseobj82024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.684 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.684 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.685 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.685 DEBUG:boto:Path: /cjqttm-39/obj8 2024-04-16T18:08:36.685 DEBUG:boto:Data: 2024-04-16T18:08:36.685 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.685 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.685 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.685 DEBUG:boto:Params: {} 2024-04-16T18:08:36.685 DEBUG:boto:Token: None 2024-04-16T18:08:36.686 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8 2024-04-16T18:08:36.686 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U7KsoZnO/oF8IID4n804CAdEYuw= 2024-04-16T18:08:36.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U7KsoZnO/oF8IID4n804CAdEYuw=', 'Content-Length': '0'} 2024-04-16T18:08:36.688 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000c3c628aefe1eb61-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.688 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.688 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.688 DEBUG:boto:Method: HEAD 2024-04-16T18:08:36.689 DEBUG:boto:Path: /cjqttm-39/obj8 2024-04-16T18:08:36.689 DEBUG:boto:Data: 2024-04-16T18:08:36.689 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.689 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.689 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.689 DEBUG:boto:Params: {} 2024-04-16T18:08:36.689 DEBUG:boto:Token: None 2024-04-16T18:08:36.689 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8 2024-04-16T18:08:36.689 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U7KsoZnO/oF8IID4n804CAdEYuw= 2024-04-16T18:08:36.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U7KsoZnO/oF8IID4n804CAdEYuw=', 'Content-Length': '0'} 2024-04-16T18:08:36.692 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000080e245468add699f-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.692 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:36.692 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.692 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.692 DEBUG:boto:Method: GET 2024-04-16T18:08:36.692 DEBUG:boto:Path: /cjqttm-39/obj8 2024-04-16T18:08:36.693 DEBUG:boto:Data: 2024-04-16T18:08:36.693 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.693 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.693 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.693 DEBUG:boto:Params: {} 2024-04-16T18:08:36.693 DEBUG:boto:Token: None 2024-04-16T18:08:36.693 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8 2024-04-16T18:08:36.693 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t64o2iGLweOzGRzSOVoxoBVMGqU= 2024-04-16T18:08:36.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t64o2iGLweOzGRzSOVoxoBVMGqU=', 'Content-Length': '0'} 2024-04-16T18:08:36.696 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fc68b5c98b4e7dc9-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.696 DEBUG:boto:path=/cjqttm-39/obj8 2024-04-16T18:08:36.696 DEBUG:boto:auth_path=/cjqttm-39/obj8 2024-04-16T18:08:36.696 DEBUG:boto:Method: GET 2024-04-16T18:08:36.696 DEBUG:boto:Path: /cjqttm-39/obj8 2024-04-16T18:08:36.696 DEBUG:boto:Data: 2024-04-16T18:08:36.697 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.697 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.697 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.697 DEBUG:boto:Params: {} 2024-04-16T18:08:36.697 DEBUG:boto:Token: None 2024-04-16T18:08:36.697 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/obj8 2024-04-16T18:08:36.697 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t64o2iGLweOzGRzSOVoxoBVMGqU= 2024-04-16T18:08:36.697 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t64o2iGLweOzGRzSOVoxoBVMGqU=', 'Content-Length': '0'} 2024-04-16T18:08:36.700 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:07:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-39:9ba59572-f51c-4bce-9578-e6350e822996.4816.8'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:09 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005508cca815467e61-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.742 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.743 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.743 DEBUG:boto:path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.743 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.743 DEBUG:boto:Method: GET 2024-04-16T18:08:36.743 DEBUG:boto:Path: /cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.743 DEBUG:boto:Data: 2024-04-16T18:08:36.743 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:36.743 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.744 DEBUG:boto:Params: {} 2024-04-16T18:08:36.744 DEBUG:boto:Token: None 2024-04-16T18:08:36.744 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.747 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea4e8a91eba086ad-00661ebea4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.748 DEBUG:boto:b'cjqttm-39obj81000falseobj82024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.748 DEBUG:boto:path=/cjqttm-39/ 2024-04-16T18:08:36.748 DEBUG:boto:auth_path=/cjqttm-39/ 2024-04-16T18:08:36.748 DEBUG:boto:path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.748 DEBUG:boto:auth_path=/cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.748 DEBUG:boto:Method: GET 2024-04-16T18:08:36.749 DEBUG:boto:Path: /cjqttm-39/?prefix=obj8 2024-04-16T18:08:36.749 DEBUG:boto:Data: 2024-04-16T18:08:36.749 DEBUG:boto:Headers: {} 2024-04-16T18:08:36.749 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:36.749 DEBUG:boto:Port: 8000 2024-04-16T18:08:36.749 DEBUG:boto:Params: {} 2024-04-16T18:08:36.749 DEBUG:boto:Token: None 2024-04-16T18:08:36.749 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:36 GMT /cjqttm-39/ 2024-04-16T18:08:36.750 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4= 2024-04-16T18:08:36.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OWTzvz25o9tVUkcope648KBS2M4=', 'Content-Length': '0'} 2024-04-16T18:08:36.752 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007608621968a1292f-00661ebea4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:36.752 DEBUG:boto:b'cjqttm-39obj81000falseobj82024-04-16T18:07:52.821Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:36.753 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-39 zones={test-zone2, test-zone1} 2024-04-16T18:08:36.753 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T18:08:36.753 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:36.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:36.754 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:36.808 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:36.808 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:36.897 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000004584","last_update":"2024-04-16T18:08:29.656334Z"},{"marker":"00000000000000000000:00000000000000009783","last_update":"2024-04-16T18:08:07.652509Z"},{"marker":"00000000000000000000:00000000000000007538","last_update":"2024-04-16T18:07:52.645865Z"},{"marker":"00000000000000000000:00000000000000005998","last_update":"2024-04-16T18:08:29.658303Z"}] 2024-04-16T18:08:36.898 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000004584', 1: '00000000000000000000:00000000000000009783', 2: '00000000000000000000:00000000000000007538', 3: '00000000000000000000:00000000000000005998'} 2024-04-16T18:08:36.898 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:08:36.898 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:36.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:36.898 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:36.956 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:36.956 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:37.033 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004584","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:29.656334Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009783","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:07.652509Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007538","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:52.645865Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005998","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:29.658303Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:08:37Z"} 2024-04-16T18:08:37.033 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004584","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:29.656334Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009783","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:07.652509Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007538","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:52.645865Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005998","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:29.658303Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:08:37Z"} 2024-04-16T18:08:37.034 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004584', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:29.656334Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000009783', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:07.652509Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007538', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:52.645865Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005998', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:29.658303Z'}}] 2024-04-16T18:08:37.034 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000004584', 1: '00000000000000000000:00000000000000009783', 2: '00000000000000000000:00000000000000007538', 3: '00000000000000000000:00000000000000005998'} 2024-04-16T18:08:37.034 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000004584', 1: '00000000000000000000:00000000000000009783', 2: '00000000000000000000:00000000000000007538', 3: '00000000000000000000:00000000000000005998'} 2024-04-16T18:08:37.034 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:08:37.034 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T18:08:37.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.035 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:37.082 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:37.082 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:37.158 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000003746","last_update":"2024-04-16T18:08:07.687002Z"},{"marker":"00000000000000000000:00000000000000007539","last_update":"2024-04-16T18:08:07.689134Z"},{"marker":"00000000000000000000:00000000000000005296","last_update":"2024-04-16T18:07:13.290728Z"},{"marker":"00000000000000000000:00000000000000004314","last_update":"2024-04-16T18:08:07.690827Z"}] 2024-04-16T18:08:37.159 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000003746', 1: '00000000000000000000:00000000000000007539', 2: '00000000000000000000:00000000000000005296', 3: '00000000000000000000:00000000000000004314'} 2024-04-16T18:08:37.159 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:08:37.159 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.159 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:37.212 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:37.212 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:37.291 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003746","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:08:07.687002Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007539","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:07.689134Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005296","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.290728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004314","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:07.690827Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:08:37Z"} 2024-04-16T18:08:37.291 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000003746","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:08:07.687002Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007539","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:07.689134Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005296","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:07:13.290728Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004314","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:07.690827Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:08:37Z"} 2024-04-16T18:08:37.291 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000003746', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T18:08:07.687002Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007539', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:07.689134Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005296', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:07:13.290728Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004314', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:07.690827Z'}}] 2024-04-16T18:08:37.291 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000003746', 1: '00000000000000000000:00000000000000007539', 2: '00000000000000000000:00000000000000005296', 3: '00000000000000000000:00000000000000004314'} 2024-04-16T18:08:37.291 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000003746', 1: '00000000000000000000:00000000000000007539', 2: '00000000000000000000:00000000000000005296', 3: '00000000000000000000:00000000000000004314'} 2024-04-16T18:08:37.291 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:08:37.292 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... ok 2024-04-16T18:08:37.294 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-40 2024-04-16T18:08:37.294 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:37.294 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:37.294 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.294 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:37.294 DEBUG:boto:Data: 2024-04-16T18:08:37.295 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.295 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.295 DEBUG:boto:Params: {} 2024-04-16T18:08:37.295 DEBUG:boto:Token: None 2024-04-16T18:08:37.295 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/ 2024-04-16T18:08:37.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6S/1VOGziaEHCri0aIEruihGVmA= 2024-04-16T18:08:37.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6S/1VOGziaEHCri0aIEruihGVmA=', 'Content-Length': '0'} 2024-04-16T18:08:37.310 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000964d9ce3a9ba6b9f-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.310 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-41 2024-04-16T18:08:37.311 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:37.311 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:37.311 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.311 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:37.311 DEBUG:boto:Data: 2024-04-16T18:08:37.311 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.311 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.311 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.311 DEBUG:boto:Params: {} 2024-04-16T18:08:37.312 DEBUG:boto:Token: None 2024-04-16T18:08:37.312 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/ 2024-04-16T18:08:37.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e5is5ua553J5DeM90GuKhDf1IeA= 2024-04-16T18:08:37.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5is5ua553J5DeM90GuKhDf1IeA=', 'Content-Length': '0'} 2024-04-16T18:08:37.337 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000009628fb27e0607721-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.337 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:37.337 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:37.338 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.338 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:37.338 DEBUG:boto:Data: 2024-04-16T18:08:37.338 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.338 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.338 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.338 DEBUG:boto:Params: {} 2024-04-16T18:08:37.338 DEBUG:boto:Token: None 2024-04-16T18:08:37.338 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/ 2024-04-16T18:08:37.338 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ= 2024-04-16T18:08:37.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ=', 'Content-Length': '0'} 2024-04-16T18:08:37.341 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007fa7a3c92f473fee-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.341 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:37.341 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:37.341 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.341 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:37.341 DEBUG:boto:Data: 2024-04-16T18:08:37.341 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.342 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.342 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.342 DEBUG:boto:Params: {} 2024-04-16T18:08:37.342 DEBUG:boto:Token: None 2024-04-16T18:08:37.342 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/obj1 2024-04-16T18:08:37.342 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fBg6WXB6kdLqQJAYEQE5tDHNraA= 2024-04-16T18:08:37.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fBg6WXB6kdLqQJAYEQE5tDHNraA='} 2024-04-16T18:08:37.348 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000740d5727df7668d8-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.348 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:37.348 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:37.348 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.348 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:37.348 DEBUG:boto:Data: 2024-04-16T18:08:37.348 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.349 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.349 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.349 DEBUG:boto:Params: {} 2024-04-16T18:08:37.349 DEBUG:boto:Token: None 2024-04-16T18:08:37.349 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/ 2024-04-16T18:08:37.349 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ= 2024-04-16T18:08:37.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ=', 'Content-Length': '0'} 2024-04-16T18:08:37.351 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000226172cecdeb81c0-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.351 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:37.351 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:37.351 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.352 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:37.352 DEBUG:boto:Data: 2024-04-16T18:08:37.352 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.352 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.352 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.352 DEBUG:boto:Params: {} 2024-04-16T18:08:37.352 DEBUG:boto:Token: None 2024-04-16T18:08:37.352 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/obj2 2024-04-16T18:08:37.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TOzyCZq6e7JLcVynbiikeZtLcJc= 2024-04-16T18:08:37.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TOzyCZq6e7JLcVynbiikeZtLcJc='} 2024-04-16T18:08:37.394 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000528092a7a43acb9-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.395 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:37.395 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:37.395 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.395 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:37.395 DEBUG:boto:Data: 2024-04-16T18:08:37.395 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.395 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.395 DEBUG:boto:Params: {} 2024-04-16T18:08:37.395 DEBUG:boto:Token: None 2024-04-16T18:08:37.396 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/ 2024-04-16T18:08:37.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ= 2024-04-16T18:08:37.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ=', 'Content-Length': '0'} 2024-04-16T18:08:37.398 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003ce91dfce5bbe3e8-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.398 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:37.398 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:37.399 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.399 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:37.399 DEBUG:boto:Data: 2024-04-16T18:08:37.399 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.399 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.399 DEBUG:boto:Params: {} 2024-04-16T18:08:37.399 DEBUG:boto:Token: None 2024-04-16T18:08:37.399 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/obj3 2024-04-16T18:08:37.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:95SSGx1j8pnDAp0buJALukcqMQs= 2024-04-16T18:08:37.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:95SSGx1j8pnDAp0buJALukcqMQs='} 2024-04-16T18:08:37.405 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af506fb0566a5b89-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.405 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:37.405 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:37.405 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.405 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:37.405 DEBUG:boto:Data: 2024-04-16T18:08:37.405 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.405 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.405 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.405 DEBUG:boto:Params: {} 2024-04-16T18:08:37.406 DEBUG:boto:Token: None 2024-04-16T18:08:37.406 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/ 2024-04-16T18:08:37.406 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ= 2024-04-16T18:08:37.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PKnpFZHlhd2jlOsKTOQb8v09WqQ=', 'Content-Length': '0'} 2024-04-16T18:08:37.408 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000018f26d7cc41af85f-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.408 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:37.408 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:37.408 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.408 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:37.408 DEBUG:boto:Data: 2024-04-16T18:08:37.408 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.408 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:37.408 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.409 DEBUG:boto:Params: {} 2024-04-16T18:08:37.409 DEBUG:boto:Token: None 2024-04-16T18:08:37.409 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-40/obj4 2024-04-16T18:08:37.409 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+lH58QWIVnX83ceP32/PDOwDYo= 2024-04-16T18:08:37.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+lH58QWIVnX83ceP32/PDOwDYo='} 2024-04-16T18:08:37.414 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b7e110275255abb8-00661ebea5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.414 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:37.414 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:37.414 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.414 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:37.414 DEBUG:boto:Data: 2024-04-16T18:08:37.415 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.415 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.415 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.415 DEBUG:boto:Params: {} 2024-04-16T18:08:37.415 DEBUG:boto:Token: None 2024-04-16T18:08:37.415 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/ 2024-04-16T18:08:37.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw= 2024-04-16T18:08:37.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw=', 'Content-Length': '0'} 2024-04-16T18:08:37.417 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003bcbbe210b30992b-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.417 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:37.417 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:37.417 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.418 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:37.418 DEBUG:boto:Data: 2024-04-16T18:08:37.418 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.418 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.418 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.418 DEBUG:boto:Params: {} 2024-04-16T18:08:37.418 DEBUG:boto:Token: None 2024-04-16T18:08:37.418 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/obj1 2024-04-16T18:08:37.418 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qcBOqNuiCC8vCiMfDKurqCsQeAs= 2024-04-16T18:08:37.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qcBOqNuiCC8vCiMfDKurqCsQeAs='} 2024-04-16T18:08:37.425 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c1fb7064bd354203-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.425 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:37.425 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:37.425 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.425 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:37.425 DEBUG:boto:Data: 2024-04-16T18:08:37.425 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.425 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.426 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.426 DEBUG:boto:Params: {} 2024-04-16T18:08:37.426 DEBUG:boto:Token: None 2024-04-16T18:08:37.426 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/ 2024-04-16T18:08:37.426 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw= 2024-04-16T18:08:37.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw=', 'Content-Length': '0'} 2024-04-16T18:08:37.428 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006db69b53284617c5-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.428 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:37.428 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:37.428 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.428 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:37.429 DEBUG:boto:Data: 2024-04-16T18:08:37.429 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.429 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.429 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.429 DEBUG:boto:Params: {} 2024-04-16T18:08:37.429 DEBUG:boto:Token: None 2024-04-16T18:08:37.429 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/obj2 2024-04-16T18:08:37.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xIaFsTp9KpECJVEyYFAs2K6Ktx8= 2024-04-16T18:08:37.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xIaFsTp9KpECJVEyYFAs2K6Ktx8='} 2024-04-16T18:08:37.474 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003f9d44bf5da4a267-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.475 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:37.475 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:37.475 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.475 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:37.475 DEBUG:boto:Data: 2024-04-16T18:08:37.475 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.475 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.475 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.475 DEBUG:boto:Params: {} 2024-04-16T18:08:37.475 DEBUG:boto:Token: None 2024-04-16T18:08:37.476 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/ 2024-04-16T18:08:37.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw= 2024-04-16T18:08:37.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw=', 'Content-Length': '0'} 2024-04-16T18:08:37.477 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f3ce0a26e8cdaa2-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.478 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:37.478 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:37.478 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.478 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:37.478 DEBUG:boto:Data: 2024-04-16T18:08:37.478 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.478 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.478 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.478 DEBUG:boto:Params: {} 2024-04-16T18:08:37.478 DEBUG:boto:Token: None 2024-04-16T18:08:37.479 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/obj3 2024-04-16T18:08:37.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6XKlorFAWfwSbZjt0sF1wWzYdos= 2024-04-16T18:08:37.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6XKlorFAWfwSbZjt0sF1wWzYdos='} 2024-04-16T18:08:37.485 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007cab65203e4ca504-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.486 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:37.486 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:37.486 DEBUG:boto:Method: HEAD 2024-04-16T18:08:37.486 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:37.486 DEBUG:boto:Data: 2024-04-16T18:08:37.486 DEBUG:boto:Headers: {} 2024-04-16T18:08:37.486 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.486 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.486 DEBUG:boto:Params: {} 2024-04-16T18:08:37.486 DEBUG:boto:Token: None 2024-04-16T18:08:37.487 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/ 2024-04-16T18:08:37.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw= 2024-04-16T18:08:37.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mZCGZUvzZE/1KDRm4HmNi4XZqFw=', 'Content-Length': '0'} 2024-04-16T18:08:37.489 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007b9be1247f468915-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.489 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:37.489 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:37.489 DEBUG:boto:Method: PUT 2024-04-16T18:08:37.489 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:37.489 DEBUG:boto:Data: 2024-04-16T18:08:37.489 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:37.489 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:37.489 DEBUG:boto:Port: 8000 2024-04-16T18:08:37.490 DEBUG:boto:Params: {} 2024-04-16T18:08:37.490 DEBUG:boto:Token: None 2024-04-16T18:08:37.490 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:37 GMT /cjqttm-41/obj4 2024-04-16T18:08:37.490 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N1PWV/fXgyqd34WqevAevdMri7Y= 2024-04-16T18:08:37.490 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N1PWV/fXgyqd34WqevAevdMri7Y='} 2024-04-16T18:08:37.496 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008903dfb4969a5fc2-00661ebea5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:37.496 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.496 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:37.543 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:37.544 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:37.593 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:08:37.615 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290917.329828_546.1","last_update":"2024-04-16T18:08:37.329828Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:08:37.616 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290917.329828_546.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:37.616 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:08:37.616 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:37.616 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:37.664 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:37.664 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:37.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:37.714+0000 7f327b31f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:08:37.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:37.716+0000 7f327b31f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:08:37.735 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290917.303444_539.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:37.303444Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:08:37Z"} 2024-04-16T18:08:37.735 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290917.303444_539.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:37.303444Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:08:37Z"} 2024-04-16T18:08:37.735 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290917.303444_539.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:37.303444Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:08:37.735 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290917.329828_546.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:37.735 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290917.303444_539.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:37.735 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290917.329828_546.1 target=1_1713290917.303444_539.1 2024-04-16T18:08:42.736 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:42.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:42.737 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:42.793 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:42.793 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:42.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:42.850+0000 7f22f4f26800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:08:42.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:42.852+0000 7f22f4f26800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:08:42.873 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290917.329828_546.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:37.329828Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:08:42Z"} 2024-04-16T18:08:42.873 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290917.329828_546.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:37.329828Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:08:42Z"} 2024-04-16T18:08:42.873 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290917.329828_546.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:37.329828Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:08:42.873 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290917.329828_546.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:42.874 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290917.329828_546.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:42.874 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:08:42.874 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-40 2024-04-16T18:08:42.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:42.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:42.874 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-40 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:42.929 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:42.930 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:42.987 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:42.989+0000 7f7dfce24800 1 bucket sync caught up with source: 2024-04-16T18:08:42.988 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.32.6, , 00000000001.20.6, , 00000000001.30.6, , , 00000000001.24.6, , , ] 2024-04-16T18:08:42.988 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.32.6, , 00000000001.20.6, , 00000000001.30.6, , , 00000000001.24.6, , , ] 2024-04-16T18:08:42.988 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:42.989+0000 7f7dfce24800 0 bucket checkpoint complete 2024-04-16T18:08:43.008 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-40 2024-04-16T18:08:43.008 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:43.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:43.009 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-40 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:43.073 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:43.074 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:43.133 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:43.135+0000 7fc8a531f800 1 bucket sync caught up with source: 2024-04-16T18:08:43.133 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.225.6, , 00000000001.214.6, , 00000000001.226.6, , , 00000000001.302.6, , , ] 2024-04-16T18:08:43.134 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000001.225.6, , 00000000001.214.6, , 00000000001.226.6, , , 00000000001.302.6, , , ] 2024-04-16T18:08:43.134 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:43.135+0000 7fc8a531f800 0 bucket checkpoint complete 2024-04-16T18:08:43.156 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-40 zones={test-zone2, test-zone1} 2024-04-16T18:08:43.156 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.156 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.156 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.156 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:43.156 DEBUG:boto:Data: 2024-04-16T18:08:43.156 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.156 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.157 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.157 DEBUG:boto:Params: {} 2024-04-16T18:08:43.157 DEBUG:boto:Token: None 2024-04-16T18:08:43.157 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.157 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ojidYYUD0bCV2ogzWkSG9n5WGGE= 2024-04-16T18:08:43.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ojidYYUD0bCV2ogzWkSG9n5WGGE=', 'Content-Length': '0'} 2024-04-16T18:08:43.160 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e89b9332d94f24d-00661ebeab-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.160 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.160 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.160 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.160 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:43.160 DEBUG:boto:Data: 2024-04-16T18:08:43.160 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.160 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.160 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.161 DEBUG:boto:Params: {} 2024-04-16T18:08:43.161 DEBUG:boto:Token: None 2024-04-16T18:08:43.161 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.161 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ojidYYUD0bCV2ogzWkSG9n5WGGE= 2024-04-16T18:08:43.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ojidYYUD0bCV2ogzWkSG9n5WGGE=', 'Content-Length': '0'} 2024-04-16T18:08:43.164 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cb2beef3b5fd0dc6-00661ebeab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.164 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:08:43.164 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.164 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.164 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.164 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.164 DEBUG:boto:Method: GET 2024-04-16T18:08:43.164 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.164 DEBUG:boto:Data: 2024-04-16T18:08:43.165 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.165 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.165 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.165 DEBUG:boto:Params: {} 2024-04-16T18:08:43.165 DEBUG:boto:Token: None 2024-04-16T18:08:43.165 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/?versions 2024-04-16T18:08:43.165 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI= 2024-04-16T18:08:43.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI=', 'Content-Length': '0'} 2024-04-16T18:08:43.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000807817ec96f73f2e-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.168 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:43.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:43.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:43.169 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:43.169 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:08:43.169 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.169 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.169 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.169 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.169 DEBUG:boto:Method: GET 2024-04-16T18:08:43.170 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.170 DEBUG:boto:Data: 2024-04-16T18:08:43.170 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.170 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.170 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.170 DEBUG:boto:Params: {} 2024-04-16T18:08:43.170 DEBUG:boto:Token: None 2024-04-16T18:08:43.170 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/?versions 2024-04-16T18:08:43.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI= 2024-04-16T18:08:43.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI=', 'Content-Length': '0'} 2024-04-16T18:08:43.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5b3d7038d05b914-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.173 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.173 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:43.173 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:43.174 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:43.174 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:43.174 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.174 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.174 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.174 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.174 DEBUG:boto:Method: GET 2024-04-16T18:08:43.174 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.174 DEBUG:boto:Data: 2024-04-16T18:08:43.175 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.175 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.175 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.175 DEBUG:boto:Params: {} 2024-04-16T18:08:43.175 DEBUG:boto:Token: None 2024-04-16T18:08:43.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/?versions 2024-04-16T18:08:43.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI= 2024-04-16T18:08:43.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI=', 'Content-Length': '0'} 2024-04-16T18:08:43.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000153ae2ab45039f80-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.178 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.178 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.178 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.178 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.178 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.178 DEBUG:boto:Method: GET 2024-04-16T18:08:43.178 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:43.179 DEBUG:boto:Data: 2024-04-16T18:08:43.179 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.179 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.179 DEBUG:boto:Params: {} 2024-04-16T18:08:43.179 DEBUG:boto:Token: None 2024-04-16T18:08:43.179 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/?versions 2024-04-16T18:08:43.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI= 2024-04-16T18:08:43.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s09Zyj1MUZNxktRoFha1Ez3KQeI=', 'Content-Length': '0'} 2024-04-16T18:08:43.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c958316ad4cb274c-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.182 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.182 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:43.183 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.183 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.183 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.183 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.183 DEBUG:boto:Method: GET 2024-04-16T18:08:43.183 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.183 DEBUG:boto:Data: 2024-04-16T18:08:43.183 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.183 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.183 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.183 DEBUG:boto:Params: {} 2024-04-16T18:08:43.184 DEBUG:boto:Token: None 2024-04-16T18:08:43.184 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U= 2024-04-16T18:08:43.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U=', 'Content-Length': '0'} 2024-04-16T18:08:43.186 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004faf07f999ae52f3-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.226 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.226 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.227 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.227 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.227 DEBUG:boto:Method: GET 2024-04-16T18:08:43.227 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.227 DEBUG:boto:Data: 2024-04-16T18:08:43.227 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.227 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.227 DEBUG:boto:Params: {} 2024-04-16T18:08:43.227 DEBUG:boto:Token: None 2024-04-16T18:08:43.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U= 2024-04-16T18:08:43.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U=', 'Content-Length': '0'} 2024-04-16T18:08:43.229 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003655430c55f58224-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.230 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.230 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.230 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.230 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.230 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.230 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.230 DEBUG:boto:Data: 2024-04-16T18:08:43.230 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.231 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.231 DEBUG:boto:Params: {} 2024-04-16T18:08:43.231 DEBUG:boto:Token: None 2024-04-16T18:08:43.231 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tkVJl3WthnFNEeZVO99BjV7BxOg= 2024-04-16T18:08:43.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tkVJl3WthnFNEeZVO99BjV7BxOg=', 'Content-Length': '0'} 2024-04-16T18:08:43.233 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005a73a1e6d1476526-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.233 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.233 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.233 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.233 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.234 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.234 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.234 DEBUG:boto:Data: 2024-04-16T18:08:43.234 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.234 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.234 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.234 DEBUG:boto:Params: {} 2024-04-16T18:08:43.234 DEBUG:boto:Token: None 2024-04-16T18:08:43.234 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.234 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tkVJl3WthnFNEeZVO99BjV7BxOg= 2024-04-16T18:08:43.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tkVJl3WthnFNEeZVO99BjV7BxOg=', 'Content-Length': '0'} 2024-04-16T18:08:43.236 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007dfc3d14fe2d308a-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.236 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:43.236 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.237 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.237 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.237 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.237 DEBUG:boto:Method: GET 2024-04-16T18:08:43.237 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.237 DEBUG:boto:Data: 2024-04-16T18:08:43.237 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.237 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.237 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.237 DEBUG:boto:Params: {} 2024-04-16T18:08:43.237 DEBUG:boto:Token: None 2024-04-16T18:08:43.238 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.238 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U= 2024-04-16T18:08:43.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U=', 'Content-Length': '0'} 2024-04-16T18:08:43.240 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009fedc14c64a67533-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.240 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.240 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.240 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.240 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.240 DEBUG:boto:Method: GET 2024-04-16T18:08:43.241 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.241 DEBUG:boto:Data: 2024-04-16T18:08:43.241 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.241 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.241 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.241 DEBUG:boto:Params: {} 2024-04-16T18:08:43.241 DEBUG:boto:Token: None 2024-04-16T18:08:43.241 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:43.241 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U= 2024-04-16T18:08:43.242 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dG85It9OBvDLHvTXd/BvLAHTg8U=', 'Content-Length': '0'} 2024-04-16T18:08:43.243 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e7c71180dd839085-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.244 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.244 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.244 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.244 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.244 DEBUG:boto:Method: GET 2024-04-16T18:08:43.244 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.244 DEBUG:boto:Data: 2024-04-16T18:08:43.244 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.244 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.245 DEBUG:boto:Params: {} 2024-04-16T18:08:43.245 DEBUG:boto:Token: None 2024-04-16T18:08:43.245 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.245 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.247 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087523dc633648394-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.247 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.248 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.248 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.248 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.248 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.248 DEBUG:boto:Method: GET 2024-04-16T18:08:43.248 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.248 DEBUG:boto:Data: 2024-04-16T18:08:43.248 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.249 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.249 DEBUG:boto:Params: {} 2024-04-16T18:08:43.249 DEBUG:boto:Token: None 2024-04-16T18:08:43.249 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.251 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc5cb09f612f7b01-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.251 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.252 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.252 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.252 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.252 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:43.252 DEBUG:boto:Data: 2024-04-16T18:08:43.252 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.252 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.253 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.253 DEBUG:boto:Params: {} 2024-04-16T18:08:43.253 DEBUG:boto:Token: None 2024-04-16T18:08:43.253 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1 2024-04-16T18:08:43.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/TEKgnrOgzxqx9C4fuxabhTNUJ8= 2024-04-16T18:08:43.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/TEKgnrOgzxqx9C4fuxabhTNUJ8=', 'Content-Length': '0'} 2024-04-16T18:08:43.255 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000609186bae2040cb4-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.255 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.255 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.255 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.255 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:43.256 DEBUG:boto:Data: 2024-04-16T18:08:43.256 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.256 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.256 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.256 DEBUG:boto:Params: {} 2024-04-16T18:08:43.256 DEBUG:boto:Token: None 2024-04-16T18:08:43.256 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1 2024-04-16T18:08:43.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/TEKgnrOgzxqx9C4fuxabhTNUJ8= 2024-04-16T18:08:43.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/TEKgnrOgzxqx9C4fuxabhTNUJ8=', 'Content-Length': '0'} 2024-04-16T18:08:43.258 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ac618fb7c0c12f8c-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.258 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:43.258 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.258 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.259 DEBUG:boto:Method: GET 2024-04-16T18:08:43.259 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:43.259 DEBUG:boto:Data: 2024-04-16T18:08:43.259 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.259 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.259 DEBUG:boto:Params: {} 2024-04-16T18:08:43.259 DEBUG:boto:Token: None 2024-04-16T18:08:43.259 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1 2024-04-16T18:08:43.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qTna5axDg/zQE/nBCVJmXW1iNps= 2024-04-16T18:08:43.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qTna5axDg/zQE/nBCVJmXW1iNps=', 'Content-Length': '0'} 2024-04-16T18:08:43.261 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000926a01159134b270-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.302 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:43.303 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:43.303 DEBUG:boto:Method: GET 2024-04-16T18:08:43.303 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:43.303 DEBUG:boto:Data: 2024-04-16T18:08:43.303 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.303 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.303 DEBUG:boto:Params: {} 2024-04-16T18:08:43.303 DEBUG:boto:Token: None 2024-04-16T18:08:43.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj1 2024-04-16T18:08:43.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qTna5axDg/zQE/nBCVJmXW1iNps= 2024-04-16T18:08:43.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qTna5axDg/zQE/nBCVJmXW1iNps=', 'Content-Length': '0'} 2024-04-16T18:08:43.305 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a094785864828356-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.305 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.306 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.306 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.306 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.306 DEBUG:boto:Method: GET 2024-04-16T18:08:43.306 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.306 DEBUG:boto:Data: 2024-04-16T18:08:43.306 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.306 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.306 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.306 DEBUG:boto:Params: {} 2024-04-16T18:08:43.307 DEBUG:boto:Token: None 2024-04-16T18:08:43.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.309 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000030bdd6c8bbc964bf-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.309 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.309 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.310 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.310 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.310 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.310 DEBUG:boto:Method: GET 2024-04-16T18:08:43.310 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:43.310 DEBUG:boto:Data: 2024-04-16T18:08:43.310 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.310 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.310 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.310 DEBUG:boto:Params: {} 2024-04-16T18:08:43.311 DEBUG:boto:Token: None 2024-04-16T18:08:43.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017fd7e08a6c563dc-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.313 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:43.314 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.314 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.314 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.314 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.314 DEBUG:boto:Method: GET 2024-04-16T18:08:43.314 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.314 DEBUG:boto:Data: 2024-04-16T18:08:43.315 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.315 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.315 DEBUG:boto:Params: {} 2024-04-16T18:08:43.315 DEBUG:boto:Token: None 2024-04-16T18:08:43.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE= 2024-04-16T18:08:43.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE=', 'Content-Length': '0'} 2024-04-16T18:08:43.317 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000051efd4e56946972-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.358 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.358 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.358 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.359 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.359 DEBUG:boto:Method: GET 2024-04-16T18:08:43.359 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.359 DEBUG:boto:Data: 2024-04-16T18:08:43.359 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.359 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.359 DEBUG:boto:Params: {} 2024-04-16T18:08:43.359 DEBUG:boto:Token: None 2024-04-16T18:08:43.359 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE= 2024-04-16T18:08:43.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE=', 'Content-Length': '0'} 2024-04-16T18:08:43.362 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008bc4a68e88156b99-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.362 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.362 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.362 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.362 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.362 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.362 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.362 DEBUG:boto:Data: 2024-04-16T18:08:43.363 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.363 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.363 DEBUG:boto:Params: {} 2024-04-16T18:08:43.363 DEBUG:boto:Token: None 2024-04-16T18:08:43.363 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u9cKQ45Bgizwz/+a2nf0Vxq6nR4= 2024-04-16T18:08:43.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u9cKQ45Bgizwz/+a2nf0Vxq6nR4=', 'Content-Length': '0'} 2024-04-16T18:08:43.365 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f93b98490a2b31e2-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.365 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.365 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.365 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.365 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.365 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.366 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.366 DEBUG:boto:Data: 2024-04-16T18:08:43.366 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.366 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.366 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.366 DEBUG:boto:Params: {} 2024-04-16T18:08:43.366 DEBUG:boto:Token: None 2024-04-16T18:08:43.366 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u9cKQ45Bgizwz/+a2nf0Vxq6nR4= 2024-04-16T18:08:43.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u9cKQ45Bgizwz/+a2nf0Vxq6nR4=', 'Content-Length': '0'} 2024-04-16T18:08:43.369 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d9437bced5e0262e-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:43.369 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.369 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.369 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.369 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.369 DEBUG:boto:Method: GET 2024-04-16T18:08:43.369 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.370 DEBUG:boto:Data: 2024-04-16T18:08:43.370 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.370 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.370 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.370 DEBUG:boto:Params: {} 2024-04-16T18:08:43.370 DEBUG:boto:Token: None 2024-04-16T18:08:43.370 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.370 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE= 2024-04-16T18:08:43.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE=', 'Content-Length': '0'} 2024-04-16T18:08:43.372 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008b4f01f7b2da927a-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.414 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.414 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.415 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.415 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.415 DEBUG:boto:Method: GET 2024-04-16T18:08:43.415 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.415 DEBUG:boto:Data: 2024-04-16T18:08:43.415 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.415 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.415 DEBUG:boto:Params: {} 2024-04-16T18:08:43.415 DEBUG:boto:Token: None 2024-04-16T18:08:43.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:43.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE= 2024-04-16T18:08:43.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/v5SDIRCoVXcoounGwRWsLWfHtE=', 'Content-Length': '0'} 2024-04-16T18:08:43.418 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000017548dfd831a1d5b-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.418 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.418 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.418 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.418 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.418 DEBUG:boto:Method: GET 2024-04-16T18:08:43.419 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.419 DEBUG:boto:Data: 2024-04-16T18:08:43.419 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.419 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.419 DEBUG:boto:Params: {} 2024-04-16T18:08:43.419 DEBUG:boto:Token: None 2024-04-16T18:08:43.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ef058a14ed49428-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.462 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.463 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.463 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.463 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.463 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.463 DEBUG:boto:Method: GET 2024-04-16T18:08:43.463 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.463 DEBUG:boto:Data: 2024-04-16T18:08:43.463 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.463 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.463 DEBUG:boto:Params: {} 2024-04-16T18:08:43.464 DEBUG:boto:Token: None 2024-04-16T18:08:43.464 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.466 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a1de32cf7e56719-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.467 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.467 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.467 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.467 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.467 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:43.467 DEBUG:boto:Data: 2024-04-16T18:08:43.467 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.467 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.468 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.468 DEBUG:boto:Params: {} 2024-04-16T18:08:43.468 DEBUG:boto:Token: None 2024-04-16T18:08:43.468 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2 2024-04-16T18:08:43.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VrztJqGyWWj/vbbYFCoL9y2QjL0= 2024-04-16T18:08:43.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VrztJqGyWWj/vbbYFCoL9y2QjL0=', 'Content-Length': '0'} 2024-04-16T18:08:43.470 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005afff2e0c746bbfa-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.470 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.470 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.471 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.471 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:43.471 DEBUG:boto:Data: 2024-04-16T18:08:43.471 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.471 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.471 DEBUG:boto:Params: {} 2024-04-16T18:08:43.471 DEBUG:boto:Token: None 2024-04-16T18:08:43.471 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2 2024-04-16T18:08:43.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VrztJqGyWWj/vbbYFCoL9y2QjL0= 2024-04-16T18:08:43.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VrztJqGyWWj/vbbYFCoL9y2QjL0=', 'Content-Length': '0'} 2024-04-16T18:08:43.473 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000aed833a4aceedb95-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.473 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:43.474 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.474 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.474 DEBUG:boto:Method: GET 2024-04-16T18:08:43.474 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:43.474 DEBUG:boto:Data: 2024-04-16T18:08:43.474 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.474 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.474 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.474 DEBUG:boto:Params: {} 2024-04-16T18:08:43.475 DEBUG:boto:Token: None 2024-04-16T18:08:43.475 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2 2024-04-16T18:08:43.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uEn/ERLp6h2Ql57oWYeLcxlK+4k= 2024-04-16T18:08:43.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uEn/ERLp6h2Ql57oWYeLcxlK+4k=', 'Content-Length': '0'} 2024-04-16T18:08:43.477 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eed0057cfaf4543a-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.518 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:43.519 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:43.519 DEBUG:boto:Method: GET 2024-04-16T18:08:43.519 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:43.519 DEBUG:boto:Data: 2024-04-16T18:08:43.519 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.519 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.519 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.519 DEBUG:boto:Params: {} 2024-04-16T18:08:43.519 DEBUG:boto:Token: None 2024-04-16T18:08:43.519 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj2 2024-04-16T18:08:43.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uEn/ERLp6h2Ql57oWYeLcxlK+4k= 2024-04-16T18:08:43.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uEn/ERLp6h2Ql57oWYeLcxlK+4k=', 'Content-Length': '0'} 2024-04-16T18:08:43.522 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000079623f89dcebc0a4-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.522 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.522 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.522 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.522 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.522 DEBUG:boto:Method: GET 2024-04-16T18:08:43.523 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.523 DEBUG:boto:Data: 2024-04-16T18:08:43.523 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.523 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.523 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.523 DEBUG:boto:Params: {} 2024-04-16T18:08:43.523 DEBUG:boto:Token: None 2024-04-16T18:08:43.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.525 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000048deb79708583f1-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.526 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.526 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.526 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.526 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.526 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.527 DEBUG:boto:Method: GET 2024-04-16T18:08:43.527 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:43.527 DEBUG:boto:Data: 2024-04-16T18:08:43.527 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.527 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.527 DEBUG:boto:Params: {} 2024-04-16T18:08:43.527 DEBUG:boto:Token: None 2024-04-16T18:08:43.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f1f619f8e08806b-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.530 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.531 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:43.531 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.531 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.531 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.531 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.531 DEBUG:boto:Method: GET 2024-04-16T18:08:43.531 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.531 DEBUG:boto:Data: 2024-04-16T18:08:43.531 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.531 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.532 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.532 DEBUG:boto:Params: {} 2024-04-16T18:08:43.532 DEBUG:boto:Token: None 2024-04-16T18:08:43.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ= 2024-04-16T18:08:43.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ=', 'Content-Length': '0'} 2024-04-16T18:08:43.534 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dbba6fc3eb190c87-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.574 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.574 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.575 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.575 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.575 DEBUG:boto:Method: GET 2024-04-16T18:08:43.575 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.575 DEBUG:boto:Data: 2024-04-16T18:08:43.575 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.575 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.575 DEBUG:boto:Params: {} 2024-04-16T18:08:43.576 DEBUG:boto:Token: None 2024-04-16T18:08:43.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ= 2024-04-16T18:08:43.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ=', 'Content-Length': '0'} 2024-04-16T18:08:43.578 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000080e2e4cadcac11c7-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.578 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.578 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.579 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.579 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.579 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.579 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.579 DEBUG:boto:Data: 2024-04-16T18:08:43.579 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.579 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.579 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.579 DEBUG:boto:Params: {} 2024-04-16T18:08:43.579 DEBUG:boto:Token: None 2024-04-16T18:08:43.580 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AoesEIKBxllSFPgjTMfrsSl1FxI= 2024-04-16T18:08:43.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AoesEIKBxllSFPgjTMfrsSl1FxI=', 'Content-Length': '0'} 2024-04-16T18:08:43.581 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f7e902bfe5c6dbed-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.582 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.582 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.582 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.582 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.582 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.582 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.582 DEBUG:boto:Data: 2024-04-16T18:08:43.582 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.582 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.583 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.583 DEBUG:boto:Params: {} 2024-04-16T18:08:43.583 DEBUG:boto:Token: None 2024-04-16T18:08:43.583 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AoesEIKBxllSFPgjTMfrsSl1FxI= 2024-04-16T18:08:43.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AoesEIKBxllSFPgjTMfrsSl1FxI=', 'Content-Length': '0'} 2024-04-16T18:08:43.585 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bac5cfbe367f5556-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.585 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:43.585 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.586 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.586 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.586 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.586 DEBUG:boto:Method: GET 2024-04-16T18:08:43.586 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.586 DEBUG:boto:Data: 2024-04-16T18:08:43.586 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.586 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.586 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.587 DEBUG:boto:Params: {} 2024-04-16T18:08:43.587 DEBUG:boto:Token: None 2024-04-16T18:08:43.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ= 2024-04-16T18:08:43.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ=', 'Content-Length': '0'} 2024-04-16T18:08:43.589 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a1899ed91e13a89c-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.630 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.631 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.631 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.631 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.631 DEBUG:boto:Method: GET 2024-04-16T18:08:43.631 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.631 DEBUG:boto:Data: 2024-04-16T18:08:43.631 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.631 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.631 DEBUG:boto:Params: {} 2024-04-16T18:08:43.632 DEBUG:boto:Token: None 2024-04-16T18:08:43.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:43.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ= 2024-04-16T18:08:43.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqAKuWZzqVHxRLAoTJjqPljkFzQ=', 'Content-Length': '0'} 2024-04-16T18:08:43.634 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d101c40dd1d93cec-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.634 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.634 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.634 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.635 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.635 DEBUG:boto:Method: GET 2024-04-16T18:08:43.635 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.635 DEBUG:boto:Data: 2024-04-16T18:08:43.635 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.635 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.635 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.635 DEBUG:boto:Params: {} 2024-04-16T18:08:43.635 DEBUG:boto:Token: None 2024-04-16T18:08:43.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.638 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f11b2bee995b951-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.638 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.639 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.639 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.639 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.639 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.639 DEBUG:boto:Method: GET 2024-04-16T18:08:43.639 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.639 DEBUG:boto:Data: 2024-04-16T18:08:43.639 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.640 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.640 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.640 DEBUG:boto:Params: {} 2024-04-16T18:08:43.640 DEBUG:boto:Token: None 2024-04-16T18:08:43.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.643 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047a214bf25790c48-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.643 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.643 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.643 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.643 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.643 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:43.644 DEBUG:boto:Data: 2024-04-16T18:08:43.644 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.644 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.644 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.644 DEBUG:boto:Params: {} 2024-04-16T18:08:43.644 DEBUG:boto:Token: None 2024-04-16T18:08:43.644 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3 2024-04-16T18:08:43.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wGtX66u9Y1t6W2me2OHmKQ+YQDA= 2024-04-16T18:08:43.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wGtX66u9Y1t6W2me2OHmKQ+YQDA=', 'Content-Length': '0'} 2024-04-16T18:08:43.646 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c26b87fbb9ae591c-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.646 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.646 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.646 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.647 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:43.647 DEBUG:boto:Data: 2024-04-16T18:08:43.647 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.647 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.647 DEBUG:boto:Params: {} 2024-04-16T18:08:43.647 DEBUG:boto:Token: None 2024-04-16T18:08:43.647 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3 2024-04-16T18:08:43.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wGtX66u9Y1t6W2me2OHmKQ+YQDA= 2024-04-16T18:08:43.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wGtX66u9Y1t6W2me2OHmKQ+YQDA=', 'Content-Length': '0'} 2024-04-16T18:08:43.649 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000096636261d414fc21-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:43.650 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.650 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.650 DEBUG:boto:Method: GET 2024-04-16T18:08:43.650 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:43.650 DEBUG:boto:Data: 2024-04-16T18:08:43.650 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.650 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.650 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.651 DEBUG:boto:Params: {} 2024-04-16T18:08:43.651 DEBUG:boto:Token: None 2024-04-16T18:08:43.651 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3 2024-04-16T18:08:43.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SALGbOgc/BOKQEDXBlDsZeexmtw= 2024-04-16T18:08:43.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SALGbOgc/BOKQEDXBlDsZeexmtw=', 'Content-Length': '0'} 2024-04-16T18:08:43.653 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003c39d3547fdc14ff-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.694 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:43.694 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:43.695 DEBUG:boto:Method: GET 2024-04-16T18:08:43.695 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:43.695 DEBUG:boto:Data: 2024-04-16T18:08:43.695 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.695 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.695 DEBUG:boto:Params: {} 2024-04-16T18:08:43.695 DEBUG:boto:Token: None 2024-04-16T18:08:43.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj3 2024-04-16T18:08:43.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SALGbOgc/BOKQEDXBlDsZeexmtw= 2024-04-16T18:08:43.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SALGbOgc/BOKQEDXBlDsZeexmtw=', 'Content-Length': '0'} 2024-04-16T18:08:43.698 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b40218ac1b3deb8c-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.698 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.699 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.699 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.699 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.699 DEBUG:boto:Method: GET 2024-04-16T18:08:43.699 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.699 DEBUG:boto:Data: 2024-04-16T18:08:43.699 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.699 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.699 DEBUG:boto:Params: {} 2024-04-16T18:08:43.699 DEBUG:boto:Token: None 2024-04-16T18:08:43.700 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.702 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bc430be2ba959c3-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.742 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.743 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.743 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.743 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.743 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.743 DEBUG:boto:Method: GET 2024-04-16T18:08:43.743 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:43.743 DEBUG:boto:Data: 2024-04-16T18:08:43.743 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.744 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.744 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.744 DEBUG:boto:Params: {} 2024-04-16T18:08:43.744 DEBUG:boto:Token: None 2024-04-16T18:08:43.744 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.747 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d9194718b0dac1f-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.747 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:43.747 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.747 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.747 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.747 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.748 DEBUG:boto:Method: GET 2024-04-16T18:08:43.748 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.748 DEBUG:boto:Data: 2024-04-16T18:08:43.748 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.748 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.748 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.748 DEBUG:boto:Params: {} 2024-04-16T18:08:43.748 DEBUG:boto:Token: None 2024-04-16T18:08:43.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo= 2024-04-16T18:08:43.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo=', 'Content-Length': '0'} 2024-04-16T18:08:43.750 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f74fc0db4cc1e1c3-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.790 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.790 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.791 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.791 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.791 DEBUG:boto:Method: GET 2024-04-16T18:08:43.791 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.791 DEBUG:boto:Data: 2024-04-16T18:08:43.791 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.791 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.791 DEBUG:boto:Params: {} 2024-04-16T18:08:43.791 DEBUG:boto:Token: None 2024-04-16T18:08:43.791 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo= 2024-04-16T18:08:43.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo=', 'Content-Length': '0'} 2024-04-16T18:08:43.794 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000086c783020db83a5e-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.794 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.794 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.794 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.794 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.794 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.794 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.795 DEBUG:boto:Data: 2024-04-16T18:08:43.795 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.795 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.795 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.795 DEBUG:boto:Params: {} 2024-04-16T18:08:43.795 DEBUG:boto:Token: None 2024-04-16T18:08:43.795 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OG18HrKRGgGglKkhhcLokbtJWrE= 2024-04-16T18:08:43.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OG18HrKRGgGglKkhhcLokbtJWrE=', 'Content-Length': '0'} 2024-04-16T18:08:43.797 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c1af3a9d27a89f8a-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.797 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.797 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.797 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.797 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.798 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.798 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.798 DEBUG:boto:Data: 2024-04-16T18:08:43.798 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.798 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.798 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.798 DEBUG:boto:Params: {} 2024-04-16T18:08:43.798 DEBUG:boto:Token: None 2024-04-16T18:08:43.798 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.798 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OG18HrKRGgGglKkhhcLokbtJWrE= 2024-04-16T18:08:43.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OG18HrKRGgGglKkhhcLokbtJWrE=', 'Content-Length': '0'} 2024-04-16T18:08:43.800 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f5f44e5c1cbb8903-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:43.801 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.801 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.801 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.801 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.801 DEBUG:boto:Method: GET 2024-04-16T18:08:43.801 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.801 DEBUG:boto:Data: 2024-04-16T18:08:43.801 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.801 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.801 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.801 DEBUG:boto:Params: {} 2024-04-16T18:08:43.802 DEBUG:boto:Token: None 2024-04-16T18:08:43.802 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.802 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo= 2024-04-16T18:08:43.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo=', 'Content-Length': '0'} 2024-04-16T18:08:43.804 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000011d4cfed0debfdb-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.846 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.846 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.846 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.847 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.847 DEBUG:boto:Method: GET 2024-04-16T18:08:43.847 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.847 DEBUG:boto:Data: 2024-04-16T18:08:43.847 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.847 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.847 DEBUG:boto:Params: {} 2024-04-16T18:08:43.847 DEBUG:boto:Token: None 2024-04-16T18:08:43.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:43.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo= 2024-04-16T18:08:43.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AFV8GrexbZoGy0SgAqReYhmXaFo=', 'Content-Length': '0'} 2024-04-16T18:08:43.849 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000027285940f756bb40-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.850 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.850 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.850 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.850 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.850 DEBUG:boto:Method: GET 2024-04-16T18:08:43.850 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.850 DEBUG:boto:Data: 2024-04-16T18:08:43.850 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.850 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.851 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.851 DEBUG:boto:Params: {} 2024-04-16T18:08:43.851 DEBUG:boto:Token: None 2024-04-16T18:08:43.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001de267e77e9ddfb8-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.894 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.895 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.895 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.895 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.895 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.895 DEBUG:boto:Method: GET 2024-04-16T18:08:43.895 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.895 DEBUG:boto:Data: 2024-04-16T18:08:43.895 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.895 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.896 DEBUG:boto:Params: {} 2024-04-16T18:08:43.896 DEBUG:boto:Token: None 2024-04-16T18:08:43.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.898 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023e10f8109fe2663-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.899 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.899 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.899 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.899 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.899 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:43.899 DEBUG:boto:Data: 2024-04-16T18:08:43.899 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.900 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.900 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.900 DEBUG:boto:Params: {} 2024-04-16T18:08:43.900 DEBUG:boto:Token: None 2024-04-16T18:08:43.900 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4 2024-04-16T18:08:43.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I29YT+qshbjUXfftK0iuF48/99k= 2024-04-16T18:08:43.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I29YT+qshbjUXfftK0iuF48/99k=', 'Content-Length': '0'} 2024-04-16T18:08:43.902 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000305675f3375a261e-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.902 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.902 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.902 DEBUG:boto:Method: HEAD 2024-04-16T18:08:43.902 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:43.902 DEBUG:boto:Data: 2024-04-16T18:08:43.903 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.903 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.903 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.903 DEBUG:boto:Params: {} 2024-04-16T18:08:43.903 DEBUG:boto:Token: None 2024-04-16T18:08:43.903 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4 2024-04-16T18:08:43.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I29YT+qshbjUXfftK0iuF48/99k= 2024-04-16T18:08:43.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I29YT+qshbjUXfftK0iuF48/99k=', 'Content-Length': '0'} 2024-04-16T18:08:43.905 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000775b4096b26fb352-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.905 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:43.906 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.906 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.906 DEBUG:boto:Method: GET 2024-04-16T18:08:43.906 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:43.906 DEBUG:boto:Data: 2024-04-16T18:08:43.906 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.906 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.906 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.906 DEBUG:boto:Params: {} 2024-04-16T18:08:43.907 DEBUG:boto:Token: None 2024-04-16T18:08:43.907 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4 2024-04-16T18:08:43.907 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/I4jaap55EGMGEd5oCwotqPbBWk= 2024-04-16T18:08:43.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/I4jaap55EGMGEd5oCwotqPbBWk=', 'Content-Length': '0'} 2024-04-16T18:08:43.909 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001d097067b940157f-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.950 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:43.950 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:43.951 DEBUG:boto:Method: GET 2024-04-16T18:08:43.951 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:43.951 DEBUG:boto:Data: 2024-04-16T18:08:43.951 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.951 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.951 DEBUG:boto:Params: {} 2024-04-16T18:08:43.951 DEBUG:boto:Token: None 2024-04-16T18:08:43.951 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/obj4 2024-04-16T18:08:43.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/I4jaap55EGMGEd5oCwotqPbBWk= 2024-04-16T18:08:43.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/I4jaap55EGMGEd5oCwotqPbBWk=', 'Content-Length': '0'} 2024-04-16T18:08:43.953 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ebe8380005cbf41d-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.954 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.954 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.954 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.954 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.954 DEBUG:boto:Method: GET 2024-04-16T18:08:43.954 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.954 DEBUG:boto:Data: 2024-04-16T18:08:43.954 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.954 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:43.955 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.955 DEBUG:boto:Params: {} 2024-04-16T18:08:43.955 DEBUG:boto:Token: None 2024-04-16T18:08:43.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.957 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cce8ff9276253a85-00661ebeab-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.958 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.958 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:43.958 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:43.958 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.958 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.958 DEBUG:boto:Method: GET 2024-04-16T18:08:43.958 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:43.959 DEBUG:boto:Data: 2024-04-16T18:08:43.959 DEBUG:boto:Headers: {} 2024-04-16T18:08:43.959 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:43.959 DEBUG:boto:Port: 8000 2024-04-16T18:08:43.959 DEBUG:boto:Params: {} 2024-04-16T18:08:43.959 DEBUG:boto:Token: None 2024-04-16T18:08:43.959 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:43 GMT /cjqttm-40/ 2024-04-16T18:08:43.959 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg= 2024-04-16T18:08:43.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M9ZZznCtt9+M9TH3mE+F/8X7PFg=', 'Content-Length': '0'} 2024-04-16T18:08:43.962 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9adb4074f595070-00661ebeab-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:43.962 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:43.963 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-40 zones={test-zone2, test-zone1} 2024-04-16T18:08:43.963 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-41 2024-04-16T18:08:43.963 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:43.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:43.963 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-41 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:44.019 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:44.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:44.077+0000 7f1aefa12800 1 bucket sync caught up with source: 2024-04-16T18:08:44.076 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.40.6, , 00000000001.24.6, , 00000000001.27.6, , , 00000000001.16.6, , , ] 2024-04-16T18:08:44.076 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.40.6, , 00000000001.24.6, , 00000000001.27.6, , , 00000000001.16.6, , , ] 2024-04-16T18:08:44.076 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:44.077+0000 7f1aefa12800 0 bucket checkpoint complete 2024-04-16T18:08:44.096 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-41 2024-04-16T18:08:44.097 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:44.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:44.097 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-41 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:44.159 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:44.160 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:44.222 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:44.224+0000 7fe2ade10800 1 bucket sync caught up with source: 2024-04-16T18:08:44.222 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.1227.6, , 00000000001.597.6, , 00000000001.378.6, , , 00000000001.358.6, , , ] 2024-04-16T18:08:44.222 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000001.1227.6, , 00000000001.597.6, , 00000000001.378.6, , , 00000000001.358.6, , , ] 2024-04-16T18:08:44.223 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:44.224+0000 7fe2ade10800 0 bucket checkpoint complete 2024-04-16T18:08:44.244 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-41 zones={test-zone2, test-zone1} 2024-04-16T18:08:44.244 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.244 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.244 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.244 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:44.244 DEBUG:boto:Data: 2024-04-16T18:08:44.244 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.244 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.245 DEBUG:boto:Params: {} 2024-04-16T18:08:44.245 DEBUG:boto:Token: None 2024-04-16T18:08:44.245 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.245 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LmjFYQnYrcH3lMTtJS5D/zZfyLY= 2024-04-16T18:08:44.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LmjFYQnYrcH3lMTtJS5D/zZfyLY=', 'Content-Length': '0'} 2024-04-16T18:08:44.247 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006010c815db3e817e-00661ebeac-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.247 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.247 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.247 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.247 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:44.247 DEBUG:boto:Data: 2024-04-16T18:08:44.247 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.248 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.248 DEBUG:boto:Params: {} 2024-04-16T18:08:44.248 DEBUG:boto:Token: None 2024-04-16T18:08:44.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LmjFYQnYrcH3lMTtJS5D/zZfyLY= 2024-04-16T18:08:44.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LmjFYQnYrcH3lMTtJS5D/zZfyLY=', 'Content-Length': '0'} 2024-04-16T18:08:44.250 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000000d6a71b158f6150-00661ebeac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.250 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:08:44.251 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.251 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.251 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.251 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.251 DEBUG:boto:Method: GET 2024-04-16T18:08:44.251 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.251 DEBUG:boto:Data: 2024-04-16T18:08:44.251 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.251 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.251 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.252 DEBUG:boto:Params: {} 2024-04-16T18:08:44.252 DEBUG:boto:Token: None 2024-04-16T18:08:44.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/?versions 2024-04-16T18:08:44.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg= 2024-04-16T18:08:44.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg=', 'Content-Length': '0'} 2024-04-16T18:08:44.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000600cca274f260f09-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.254 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.255 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:44.255 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:44.255 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:44.255 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:44.255 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:08:44.255 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.255 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.255 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.256 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.256 DEBUG:boto:Method: GET 2024-04-16T18:08:44.256 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.256 DEBUG:boto:Data: 2024-04-16T18:08:44.256 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.256 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.256 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.256 DEBUG:boto:Params: {} 2024-04-16T18:08:44.256 DEBUG:boto:Token: None 2024-04-16T18:08:44.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/?versions 2024-04-16T18:08:44.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg= 2024-04-16T18:08:44.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg=', 'Content-Length': '0'} 2024-04-16T18:08:44.259 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e6992de70ae0950-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.259 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.259 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:44.259 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:44.260 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:44.260 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:44.260 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.260 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.260 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.260 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.260 DEBUG:boto:Method: GET 2024-04-16T18:08:44.260 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.260 DEBUG:boto:Data: 2024-04-16T18:08:44.260 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.260 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.261 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.261 DEBUG:boto:Params: {} 2024-04-16T18:08:44.261 DEBUG:boto:Token: None 2024-04-16T18:08:44.261 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/?versions 2024-04-16T18:08:44.261 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg= 2024-04-16T18:08:44.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg=', 'Content-Length': '0'} 2024-04-16T18:08:44.263 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039141e99cb7a645c-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.264 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.264 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.264 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.264 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.264 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.264 DEBUG:boto:Method: GET 2024-04-16T18:08:44.264 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:44.265 DEBUG:boto:Data: 2024-04-16T18:08:44.265 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.265 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.265 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.265 DEBUG:boto:Params: {} 2024-04-16T18:08:44.265 DEBUG:boto:Token: None 2024-04-16T18:08:44.265 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/?versions 2024-04-16T18:08:44.265 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg= 2024-04-16T18:08:44.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zeDFEJCRshfuPZAXHKFQVoWNlrg=', 'Content-Length': '0'} 2024-04-16T18:08:44.267 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003247357778f251e9-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.267 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.268 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:44.268 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.268 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.268 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.268 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.268 DEBUG:boto:Method: GET 2024-04-16T18:08:44.268 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.269 DEBUG:boto:Data: 2024-04-16T18:08:44.269 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.269 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.269 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.269 DEBUG:boto:Params: {} 2024-04-16T18:08:44.269 DEBUG:boto:Token: None 2024-04-16T18:08:44.269 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.269 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM= 2024-04-16T18:08:44.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM=', 'Content-Length': '0'} 2024-04-16T18:08:44.271 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c7ff5688791a3a97-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.314 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.314 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.315 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.315 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.315 DEBUG:boto:Method: GET 2024-04-16T18:08:44.315 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.315 DEBUG:boto:Data: 2024-04-16T18:08:44.315 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.315 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.315 DEBUG:boto:Params: {} 2024-04-16T18:08:44.315 DEBUG:boto:Token: None 2024-04-16T18:08:44.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM= 2024-04-16T18:08:44.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM=', 'Content-Length': '0'} 2024-04-16T18:08:44.318 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000002d709765c0062ab-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.318 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.318 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.318 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.318 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.319 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.319 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.319 DEBUG:boto:Data: 2024-04-16T18:08:44.319 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.319 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.319 DEBUG:boto:Params: {} 2024-04-16T18:08:44.319 DEBUG:boto:Token: None 2024-04-16T18:08:44.319 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AwS+gZp/499I9ZFPMeD/diQv+Lk= 2024-04-16T18:08:44.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AwS+gZp/499I9ZFPMeD/diQv+Lk=', 'Content-Length': '0'} 2024-04-16T18:08:44.321 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007ce6b4fca94f907e-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.321 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.321 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.322 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.322 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.322 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.322 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.322 DEBUG:boto:Data: 2024-04-16T18:08:44.322 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.322 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.322 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.322 DEBUG:boto:Params: {} 2024-04-16T18:08:44.322 DEBUG:boto:Token: None 2024-04-16T18:08:44.323 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AwS+gZp/499I9ZFPMeD/diQv+Lk= 2024-04-16T18:08:44.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AwS+gZp/499I9ZFPMeD/diQv+Lk=', 'Content-Length': '0'} 2024-04-16T18:08:44.324 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009480e73e639a376f-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.325 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:44.325 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.325 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.325 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.325 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.325 DEBUG:boto:Method: GET 2024-04-16T18:08:44.325 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.325 DEBUG:boto:Data: 2024-04-16T18:08:44.325 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.325 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.325 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.326 DEBUG:boto:Params: {} 2024-04-16T18:08:44.326 DEBUG:boto:Token: None 2024-04-16T18:08:44.326 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.326 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM= 2024-04-16T18:08:44.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM=', 'Content-Length': '0'} 2024-04-16T18:08:44.328 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000972f7b9cfffd7900-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.328 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.328 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.328 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.328 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.328 DEBUG:boto:Method: GET 2024-04-16T18:08:44.329 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.329 DEBUG:boto:Data: 2024-04-16T18:08:44.329 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.329 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.329 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.329 DEBUG:boto:Params: {} 2024-04-16T18:08:44.329 DEBUG:boto:Token: None 2024-04-16T18:08:44.329 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:44.329 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM= 2024-04-16T18:08:44.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZUWpIxah7aJr2k182QNszjwVvM=', 'Content-Length': '0'} 2024-04-16T18:08:44.331 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dd3320cd1a941749-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.332 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.332 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.332 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.332 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.332 DEBUG:boto:Method: GET 2024-04-16T18:08:44.332 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.332 DEBUG:boto:Data: 2024-04-16T18:08:44.332 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.332 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.332 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.332 DEBUG:boto:Params: {} 2024-04-16T18:08:44.333 DEBUG:boto:Token: None 2024-04-16T18:08:44.333 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.333 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.335 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063b2d96756f43b47-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.335 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.335 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.336 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.336 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.336 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.336 DEBUG:boto:Method: GET 2024-04-16T18:08:44.336 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.336 DEBUG:boto:Data: 2024-04-16T18:08:44.336 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.336 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.336 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.336 DEBUG:boto:Params: {} 2024-04-16T18:08:44.336 DEBUG:boto:Token: None 2024-04-16T18:08:44.337 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.337 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b837a7e63b044647-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.339 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.339 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.339 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.339 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.339 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:44.339 DEBUG:boto:Data: 2024-04-16T18:08:44.339 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.340 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.340 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.340 DEBUG:boto:Params: {} 2024-04-16T18:08:44.340 DEBUG:boto:Token: None 2024-04-16T18:08:44.340 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1 2024-04-16T18:08:44.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gj8GruiHQ1/423ISMe3ri33t7Qc= 2024-04-16T18:08:44.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gj8GruiHQ1/423ISMe3ri33t7Qc=', 'Content-Length': '0'} 2024-04-16T18:08:44.342 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d7377f109c139983-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.342 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.342 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.342 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.342 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:44.342 DEBUG:boto:Data: 2024-04-16T18:08:44.342 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.342 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.342 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.343 DEBUG:boto:Params: {} 2024-04-16T18:08:44.343 DEBUG:boto:Token: None 2024-04-16T18:08:44.343 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1 2024-04-16T18:08:44.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gj8GruiHQ1/423ISMe3ri33t7Qc= 2024-04-16T18:08:44.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gj8GruiHQ1/423ISMe3ri33t7Qc=', 'Content-Length': '0'} 2024-04-16T18:08:44.344 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a6a42a62ad276017-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.345 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:44.345 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.345 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.345 DEBUG:boto:Method: GET 2024-04-16T18:08:44.345 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:44.345 DEBUG:boto:Data: 2024-04-16T18:08:44.345 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.345 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.346 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.346 DEBUG:boto:Params: {} 2024-04-16T18:08:44.346 DEBUG:boto:Token: None 2024-04-16T18:08:44.346 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1 2024-04-16T18:08:44.346 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/YEvjeGj3t9BJBvRTvR+BwdkDhE= 2024-04-16T18:08:44.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/YEvjeGj3t9BJBvRTvR+BwdkDhE=', 'Content-Length': '0'} 2024-04-16T18:08:44.348 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fead82d0e81c9ac8-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.348 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:44.348 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:44.348 DEBUG:boto:Method: GET 2024-04-16T18:08:44.348 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:44.348 DEBUG:boto:Data: 2024-04-16T18:08:44.348 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.349 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.349 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.349 DEBUG:boto:Params: {} 2024-04-16T18:08:44.349 DEBUG:boto:Token: None 2024-04-16T18:08:44.349 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj1 2024-04-16T18:08:44.349 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/YEvjeGj3t9BJBvRTvR+BwdkDhE= 2024-04-16T18:08:44.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/YEvjeGj3t9BJBvRTvR+BwdkDhE=', 'Content-Length': '0'} 2024-04-16T18:08:44.351 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000834be5d84a904aa7-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.394 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.395 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.395 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.395 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.395 DEBUG:boto:Method: GET 2024-04-16T18:08:44.395 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.395 DEBUG:boto:Data: 2024-04-16T18:08:44.395 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.395 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.395 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.395 DEBUG:boto:Params: {} 2024-04-16T18:08:44.396 DEBUG:boto:Token: None 2024-04-16T18:08:44.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3da2e1282a884b3-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.398 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.398 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.399 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.399 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.399 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.399 DEBUG:boto:Method: GET 2024-04-16T18:08:44.399 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:44.399 DEBUG:boto:Data: 2024-04-16T18:08:44.399 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.399 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.399 DEBUG:boto:Params: {} 2024-04-16T18:08:44.399 DEBUG:boto:Token: None 2024-04-16T18:08:44.400 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000506237a3fede5a74-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.442 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.443 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:44.443 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.443 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.443 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.443 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.443 DEBUG:boto:Method: GET 2024-04-16T18:08:44.443 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.443 DEBUG:boto:Data: 2024-04-16T18:08:44.443 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.444 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.444 DEBUG:boto:Params: {} 2024-04-16T18:08:44.444 DEBUG:boto:Token: None 2024-04-16T18:08:44.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s= 2024-04-16T18:08:44.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s=', 'Content-Length': '0'} 2024-04-16T18:08:44.446 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006e361ccc0c627042-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.447 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.447 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.447 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.447 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.447 DEBUG:boto:Method: GET 2024-04-16T18:08:44.447 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.447 DEBUG:boto:Data: 2024-04-16T18:08:44.447 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.447 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.447 DEBUG:boto:Params: {} 2024-04-16T18:08:44.447 DEBUG:boto:Token: None 2024-04-16T18:08:44.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s= 2024-04-16T18:08:44.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s=', 'Content-Length': '0'} 2024-04-16T18:08:44.450 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ccea44149c918e1a-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.490 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.491 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.491 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.491 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.491 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.491 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.491 DEBUG:boto:Data: 2024-04-16T18:08:44.491 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.491 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.491 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.491 DEBUG:boto:Params: {} 2024-04-16T18:08:44.491 DEBUG:boto:Token: None 2024-04-16T18:08:44.492 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aVE7UxcuplfsRz0rLE0bRVWeeXI= 2024-04-16T18:08:44.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aVE7UxcuplfsRz0rLE0bRVWeeXI=', 'Content-Length': '0'} 2024-04-16T18:08:44.494 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000605687ab2071637d-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.494 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.494 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.494 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.494 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.494 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.495 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.495 DEBUG:boto:Data: 2024-04-16T18:08:44.495 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.495 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.495 DEBUG:boto:Params: {} 2024-04-16T18:08:44.495 DEBUG:boto:Token: None 2024-04-16T18:08:44.495 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aVE7UxcuplfsRz0rLE0bRVWeeXI= 2024-04-16T18:08:44.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aVE7UxcuplfsRz0rLE0bRVWeeXI=', 'Content-Length': '0'} 2024-04-16T18:08:44.497 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003ba525933ff8179d-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.498 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:44.498 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.498 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.498 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.498 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.498 DEBUG:boto:Method: GET 2024-04-16T18:08:44.498 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.498 DEBUG:boto:Data: 2024-04-16T18:08:44.498 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.499 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.499 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.499 DEBUG:boto:Params: {} 2024-04-16T18:08:44.499 DEBUG:boto:Token: None 2024-04-16T18:08:44.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s= 2024-04-16T18:08:44.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s=', 'Content-Length': '0'} 2024-04-16T18:08:44.501 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d9b6ed0a8a305457-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.501 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.502 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.502 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.502 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.502 DEBUG:boto:Method: GET 2024-04-16T18:08:44.502 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.502 DEBUG:boto:Data: 2024-04-16T18:08:44.502 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.502 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.502 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.502 DEBUG:boto:Params: {} 2024-04-16T18:08:44.502 DEBUG:boto:Token: None 2024-04-16T18:08:44.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:44.503 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s= 2024-04-16T18:08:44.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OSnjWKNrEFzKuzohggcMsZ2889s=', 'Content-Length': '0'} 2024-04-16T18:08:44.505 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e715e19f7ecb95c6-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.546 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.546 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.547 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.547 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.547 DEBUG:boto:Method: GET 2024-04-16T18:08:44.547 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.547 DEBUG:boto:Data: 2024-04-16T18:08:44.547 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.547 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.547 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.547 DEBUG:boto:Params: {} 2024-04-16T18:08:44.547 DEBUG:boto:Token: None 2024-04-16T18:08:44.547 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.549 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000193c62f5b218d8a5-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.550 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.550 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.550 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.550 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.550 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.550 DEBUG:boto:Method: GET 2024-04-16T18:08:44.550 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.550 DEBUG:boto:Data: 2024-04-16T18:08:44.551 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.551 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.551 DEBUG:boto:Params: {} 2024-04-16T18:08:44.551 DEBUG:boto:Token: None 2024-04-16T18:08:44.551 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.551 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1d41c7c91e748cb-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.594 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.595 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.595 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.595 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.595 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:44.595 DEBUG:boto:Data: 2024-04-16T18:08:44.595 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.595 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.595 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.595 DEBUG:boto:Params: {} 2024-04-16T18:08:44.595 DEBUG:boto:Token: None 2024-04-16T18:08:44.596 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2 2024-04-16T18:08:44.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cl2oh+ihJ8EUzis0B8SeK1bV3CM= 2024-04-16T18:08:44.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cl2oh+ihJ8EUzis0B8SeK1bV3CM=', 'Content-Length': '0'} 2024-04-16T18:08:44.598 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000fa62ce0ef005104d-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.598 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.598 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.598 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.598 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:44.598 DEBUG:boto:Data: 2024-04-16T18:08:44.599 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.599 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.599 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.599 DEBUG:boto:Params: {} 2024-04-16T18:08:44.599 DEBUG:boto:Token: None 2024-04-16T18:08:44.599 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2 2024-04-16T18:08:44.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cl2oh+ihJ8EUzis0B8SeK1bV3CM= 2024-04-16T18:08:44.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cl2oh+ihJ8EUzis0B8SeK1bV3CM=', 'Content-Length': '0'} 2024-04-16T18:08:44.601 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000773c2d86c2b30092-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.602 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:44.602 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.602 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.602 DEBUG:boto:Method: GET 2024-04-16T18:08:44.602 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:44.602 DEBUG:boto:Data: 2024-04-16T18:08:44.602 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.602 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.602 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.602 DEBUG:boto:Params: {} 2024-04-16T18:08:44.602 DEBUG:boto:Token: None 2024-04-16T18:08:44.603 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2 2024-04-16T18:08:44.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WVyFLQWvNesG25TideqPePAMppc= 2024-04-16T18:08:44.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WVyFLQWvNesG25TideqPePAMppc=', 'Content-Length': '0'} 2024-04-16T18:08:44.605 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008f3371b5b8111d64-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.605 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:44.605 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:44.605 DEBUG:boto:Method: GET 2024-04-16T18:08:44.605 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:44.605 DEBUG:boto:Data: 2024-04-16T18:08:44.605 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.605 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.605 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.606 DEBUG:boto:Params: {} 2024-04-16T18:08:44.606 DEBUG:boto:Token: None 2024-04-16T18:08:44.606 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj2 2024-04-16T18:08:44.606 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WVyFLQWvNesG25TideqPePAMppc= 2024-04-16T18:08:44.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WVyFLQWvNesG25TideqPePAMppc=', 'Content-Length': '0'} 2024-04-16T18:08:44.608 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000010f347a463fc3616-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.650 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.650 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.651 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.651 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.651 DEBUG:boto:Method: GET 2024-04-16T18:08:44.651 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.651 DEBUG:boto:Data: 2024-04-16T18:08:44.651 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.651 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.651 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.651 DEBUG:boto:Params: {} 2024-04-16T18:08:44.651 DEBUG:boto:Token: None 2024-04-16T18:08:44.652 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002bc6b4a055df0818-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.654 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.654 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.655 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.655 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.655 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.655 DEBUG:boto:Method: GET 2024-04-16T18:08:44.655 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:44.655 DEBUG:boto:Data: 2024-04-16T18:08:44.655 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.655 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.655 DEBUG:boto:Params: {} 2024-04-16T18:08:44.655 DEBUG:boto:Token: None 2024-04-16T18:08:44.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a265b4887ccabcb9-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.658 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.658 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:44.658 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.659 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.659 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.659 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.659 DEBUG:boto:Method: GET 2024-04-16T18:08:44.659 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.659 DEBUG:boto:Data: 2024-04-16T18:08:44.659 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.659 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.659 DEBUG:boto:Params: {} 2024-04-16T18:08:44.659 DEBUG:boto:Token: None 2024-04-16T18:08:44.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18= 2024-04-16T18:08:44.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18=', 'Content-Length': '0'} 2024-04-16T18:08:44.662 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000057841e72e7c7069b-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.662 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.663 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.663 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.663 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.663 DEBUG:boto:Method: GET 2024-04-16T18:08:44.663 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.663 DEBUG:boto:Data: 2024-04-16T18:08:44.663 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.663 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.663 DEBUG:boto:Params: {} 2024-04-16T18:08:44.663 DEBUG:boto:Token: None 2024-04-16T18:08:44.664 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18= 2024-04-16T18:08:44.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18=', 'Content-Length': '0'} 2024-04-16T18:08:44.666 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a79b6b6e7ae9528d-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.706 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.706 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.706 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.707 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.707 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.707 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.707 DEBUG:boto:Data: 2024-04-16T18:08:44.707 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.707 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.707 DEBUG:boto:Params: {} 2024-04-16T18:08:44.707 DEBUG:boto:Token: None 2024-04-16T18:08:44.707 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.708 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7sVHbkNXEupFeRUiJnYe4Yvr6BY= 2024-04-16T18:08:44.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7sVHbkNXEupFeRUiJnYe4Yvr6BY=', 'Content-Length': '0'} 2024-04-16T18:08:44.709 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004ddb6b3dc94f1061-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.710 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.710 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.710 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.710 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.710 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.710 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.710 DEBUG:boto:Data: 2024-04-16T18:08:44.710 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.710 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.710 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.710 DEBUG:boto:Params: {} 2024-04-16T18:08:44.711 DEBUG:boto:Token: None 2024-04-16T18:08:44.711 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7sVHbkNXEupFeRUiJnYe4Yvr6BY= 2024-04-16T18:08:44.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7sVHbkNXEupFeRUiJnYe4Yvr6BY=', 'Content-Length': '0'} 2024-04-16T18:08:44.713 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000042ef7523622a105e-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.713 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:44.713 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.713 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.713 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.714 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.714 DEBUG:boto:Method: GET 2024-04-16T18:08:44.714 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.714 DEBUG:boto:Data: 2024-04-16T18:08:44.714 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.714 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.714 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.714 DEBUG:boto:Params: {} 2024-04-16T18:08:44.714 DEBUG:boto:Token: None 2024-04-16T18:08:44.714 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18= 2024-04-16T18:08:44.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18=', 'Content-Length': '0'} 2024-04-16T18:08:44.716 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a9a22a698496fa2f-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.717 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.717 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.717 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.717 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.717 DEBUG:boto:Method: GET 2024-04-16T18:08:44.717 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.717 DEBUG:boto:Data: 2024-04-16T18:08:44.717 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.718 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.718 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.718 DEBUG:boto:Params: {} 2024-04-16T18:08:44.718 DEBUG:boto:Token: None 2024-04-16T18:08:44.718 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:44.718 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18= 2024-04-16T18:08:44.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WQYWd25iKNzN1nqyE+p1Gfnpi18=', 'Content-Length': '0'} 2024-04-16T18:08:44.720 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000170612d443648831-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.762 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.762 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.763 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.763 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.763 DEBUG:boto:Method: GET 2024-04-16T18:08:44.763 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.763 DEBUG:boto:Data: 2024-04-16T18:08:44.763 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.763 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.763 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.763 DEBUG:boto:Params: {} 2024-04-16T18:08:44.763 DEBUG:boto:Token: None 2024-04-16T18:08:44.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.766 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d990b31c6f7ecb64-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.766 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.767 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.767 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.767 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.767 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.767 DEBUG:boto:Method: GET 2024-04-16T18:08:44.767 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.767 DEBUG:boto:Data: 2024-04-16T18:08:44.767 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.767 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.768 DEBUG:boto:Params: {} 2024-04-16T18:08:44.768 DEBUG:boto:Token: None 2024-04-16T18:08:44.768 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.770 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c7f7a0dd84fc71c-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.770 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.771 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.771 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.771 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.771 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:44.771 DEBUG:boto:Data: 2024-04-16T18:08:44.771 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.771 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.771 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.771 DEBUG:boto:Params: {} 2024-04-16T18:08:44.772 DEBUG:boto:Token: None 2024-04-16T18:08:44.772 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3 2024-04-16T18:08:44.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C6r+wSQGMDrAJH2BmhZq1FRJYYo= 2024-04-16T18:08:44.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C6r+wSQGMDrAJH2BmhZq1FRJYYo=', 'Content-Length': '0'} 2024-04-16T18:08:44.774 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f729555518a0f93a-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.775 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.775 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.775 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.775 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:44.775 DEBUG:boto:Data: 2024-04-16T18:08:44.775 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.775 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.775 DEBUG:boto:Params: {} 2024-04-16T18:08:44.775 DEBUG:boto:Token: None 2024-04-16T18:08:44.776 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3 2024-04-16T18:08:44.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C6r+wSQGMDrAJH2BmhZq1FRJYYo= 2024-04-16T18:08:44.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C6r+wSQGMDrAJH2BmhZq1FRJYYo=', 'Content-Length': '0'} 2024-04-16T18:08:44.777 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000842501c2229b1b2a-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.778 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:44.778 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.778 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.778 DEBUG:boto:Method: GET 2024-04-16T18:08:44.778 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:44.778 DEBUG:boto:Data: 2024-04-16T18:08:44.778 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.778 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.779 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.779 DEBUG:boto:Params: {} 2024-04-16T18:08:44.779 DEBUG:boto:Token: None 2024-04-16T18:08:44.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3 2024-04-16T18:08:44.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DjDCa9NdUJXD/PhmaqxhjGIuyWw= 2024-04-16T18:08:44.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DjDCa9NdUJXD/PhmaqxhjGIuyWw=', 'Content-Length': '0'} 2024-04-16T18:08:44.781 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bddb2db389c121f7-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.822 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:44.822 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:44.823 DEBUG:boto:Method: GET 2024-04-16T18:08:44.823 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:44.823 DEBUG:boto:Data: 2024-04-16T18:08:44.823 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.823 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.823 DEBUG:boto:Params: {} 2024-04-16T18:08:44.823 DEBUG:boto:Token: None 2024-04-16T18:08:44.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj3 2024-04-16T18:08:44.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DjDCa9NdUJXD/PhmaqxhjGIuyWw= 2024-04-16T18:08:44.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DjDCa9NdUJXD/PhmaqxhjGIuyWw=', 'Content-Length': '0'} 2024-04-16T18:08:44.826 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000065f811cc6ad27b73-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.866 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.866 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.867 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.867 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.867 DEBUG:boto:Method: GET 2024-04-16T18:08:44.867 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.867 DEBUG:boto:Data: 2024-04-16T18:08:44.867 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.867 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.867 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.867 DEBUG:boto:Params: {} 2024-04-16T18:08:44.867 DEBUG:boto:Token: None 2024-04-16T18:08:44.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f8d46cd2a126463-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.870 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.870 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:44.870 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:44.871 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.871 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.871 DEBUG:boto:Method: GET 2024-04-16T18:08:44.871 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:44.871 DEBUG:boto:Data: 2024-04-16T18:08:44.871 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.871 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.871 DEBUG:boto:Params: {} 2024-04-16T18:08:44.871 DEBUG:boto:Token: None 2024-04-16T18:08:44.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/ 2024-04-16T18:08:44.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8= 2024-04-16T18:08:44.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PxRYQPRalYBlMLRez7MQwJ5ysG8=', 'Content-Length': '0'} 2024-04-16T18:08:44.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008069ed87532d0d48-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.914 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:44.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:44.915 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:44.915 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:44.915 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.915 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.915 DEBUG:boto:Method: GET 2024-04-16T18:08:44.916 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.916 DEBUG:boto:Data: 2024-04-16T18:08:44.916 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.916 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.916 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.916 DEBUG:boto:Params: {} 2024-04-16T18:08:44.916 DEBUG:boto:Token: None 2024-04-16T18:08:44.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc= 2024-04-16T18:08:44.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc=', 'Content-Length': '0'} 2024-04-16T18:08:44.919 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e286529cb71db13a-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.919 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:44.919 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:44.919 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.919 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.919 DEBUG:boto:Method: GET 2024-04-16T18:08:44.919 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.919 DEBUG:boto:Data: 2024-04-16T18:08:44.920 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.920 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.920 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.920 DEBUG:boto:Params: {} 2024-04-16T18:08:44.920 DEBUG:boto:Token: None 2024-04-16T18:08:44.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc= 2024-04-16T18:08:44.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc=', 'Content-Length': '0'} 2024-04-16T18:08:44.922 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d05de6d0484c3fc-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.962 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:44.962 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:44.963 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.963 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.963 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.963 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.963 DEBUG:boto:Data: 2024-04-16T18:08:44.963 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.963 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.963 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.963 DEBUG:boto:Params: {} 2024-04-16T18:08:44.963 DEBUG:boto:Token: None 2024-04-16T18:08:44.963 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ddQP8iEpUbHWWEdRpWk0LQV+ws= 2024-04-16T18:08:44.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ddQP8iEpUbHWWEdRpWk0LQV+ws=', 'Content-Length': '0'} 2024-04-16T18:08:44.965 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000beae5d8a5847ba50-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.966 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:44.966 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:44.966 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.966 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.966 DEBUG:boto:Method: HEAD 2024-04-16T18:08:44.966 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.966 DEBUG:boto:Data: 2024-04-16T18:08:44.966 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.966 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.966 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.966 DEBUG:boto:Params: {} 2024-04-16T18:08:44.967 DEBUG:boto:Token: None 2024-04-16T18:08:44.967 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.967 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ddQP8iEpUbHWWEdRpWk0LQV+ws= 2024-04-16T18:08:44.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ddQP8iEpUbHWWEdRpWk0LQV+ws=', 'Content-Length': '0'} 2024-04-16T18:08:44.969 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e62d06e3938e267f-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.969 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:44.969 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:44.969 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:44.969 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.969 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.970 DEBUG:boto:Method: GET 2024-04-16T18:08:44.970 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.970 DEBUG:boto:Data: 2024-04-16T18:08:44.970 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.970 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:44.970 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.970 DEBUG:boto:Params: {} 2024-04-16T18:08:44.970 DEBUG:boto:Token: None 2024-04-16T18:08:44.970 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc= 2024-04-16T18:08:44.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc=', 'Content-Length': '0'} 2024-04-16T18:08:44.972 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008c5e09eeb24645f6-00661ebeac-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:44.973 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:44.973 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:44.973 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.973 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.973 DEBUG:boto:Method: GET 2024-04-16T18:08:44.973 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.973 DEBUG:boto:Data: 2024-04-16T18:08:44.973 DEBUG:boto:Headers: {} 2024-04-16T18:08:44.973 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:44.973 DEBUG:boto:Port: 8000 2024-04-16T18:08:44.974 DEBUG:boto:Params: {} 2024-04-16T18:08:44.974 DEBUG:boto:Token: None 2024-04-16T18:08:44.974 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:44 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:44.974 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc= 2024-04-16T18:08:44.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pwo1SjwpU2iFbvRJhVS1XMsLkoc=', 'Content-Length': '0'} 2024-04-16T18:08:44.976 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007b78b774f6c7adb6-00661ebeac-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.018 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.018 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.019 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.019 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.019 DEBUG:boto:Method: GET 2024-04-16T18:08:45.019 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.019 DEBUG:boto:Data: 2024-04-16T18:08:45.019 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.019 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.019 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.019 DEBUG:boto:Params: {} 2024-04-16T18:08:45.019 DEBUG:boto:Token: None 2024-04-16T18:08:45.019 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA= 2024-04-16T18:08:45.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA=', 'Content-Length': '0'} 2024-04-16T18:08:45.022 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012221d1e32c318eb-00661ebead-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.022 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:45.022 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.022 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.022 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.022 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.022 DEBUG:boto:Method: GET 2024-04-16T18:08:45.023 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.023 DEBUG:boto:Data: 2024-04-16T18:08:45.023 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.023 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.023 DEBUG:boto:Params: {} 2024-04-16T18:08:45.023 DEBUG:boto:Token: None 2024-04-16T18:08:45.023 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA= 2024-04-16T18:08:45.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA=', 'Content-Length': '0'} 2024-04-16T18:08:45.026 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fcc0c0cbb279c07-00661ebead-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.066 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:45.066 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:45.067 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:45.067 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.067 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:45.067 DEBUG:boto:Data: 2024-04-16T18:08:45.067 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.067 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.067 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.067 DEBUG:boto:Params: {} 2024-04-16T18:08:45.067 DEBUG:boto:Token: None 2024-04-16T18:08:45.067 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj4 2024-04-16T18:08:45.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3ZhAsrt3s340IuQxSWCMtp84oVI= 2024-04-16T18:08:45.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3ZhAsrt3s340IuQxSWCMtp84oVI=', 'Content-Length': '0'} 2024-04-16T18:08:45.069 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000f51b9a1bf9d9e8b-00661ebead-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.070 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:45.070 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:45.070 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.070 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:45.070 DEBUG:boto:Data: 2024-04-16T18:08:45.070 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.070 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.070 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.070 DEBUG:boto:Params: {} 2024-04-16T18:08:45.070 DEBUG:boto:Token: None 2024-04-16T18:08:45.071 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj4 2024-04-16T18:08:45.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3ZhAsrt3s340IuQxSWCMtp84oVI= 2024-04-16T18:08:45.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3ZhAsrt3s340IuQxSWCMtp84oVI=', 'Content-Length': '0'} 2024-04-16T18:08:45.073 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e5383ba608cd3c1-00661ebead-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:45.073 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:45.073 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:45.074 DEBUG:boto:Method: GET 2024-04-16T18:08:45.074 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:45.074 DEBUG:boto:Data: 2024-04-16T18:08:45.074 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.074 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.074 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.074 DEBUG:boto:Params: {} 2024-04-16T18:08:45.074 DEBUG:boto:Token: None 2024-04-16T18:08:45.074 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj4 2024-04-16T18:08:45.074 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kz89VACzI/d4Vr3uf8iDo/4/0Dk= 2024-04-16T18:08:45.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kz89VACzI/d4Vr3uf8iDo/4/0Dk=', 'Content-Length': '0'} 2024-04-16T18:08:45.076 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b2af56ae600d1e6a-00661ebead-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.077 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:45.077 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:45.077 DEBUG:boto:Method: GET 2024-04-16T18:08:45.077 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:45.077 DEBUG:boto:Data: 2024-04-16T18:08:45.077 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.077 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.077 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.077 DEBUG:boto:Params: {} 2024-04-16T18:08:45.077 DEBUG:boto:Token: None 2024-04-16T18:08:45.078 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj4 2024-04-16T18:08:45.078 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kz89VACzI/d4Vr3uf8iDo/4/0Dk= 2024-04-16T18:08:45.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kz89VACzI/d4Vr3uf8iDo/4/0Dk=', 'Content-Length': '0'} 2024-04-16T18:08:45.080 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f45b0c6eb9b231de-00661ebead-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.122 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.122 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.123 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.123 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.123 DEBUG:boto:Method: GET 2024-04-16T18:08:45.123 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.123 DEBUG:boto:Data: 2024-04-16T18:08:45.123 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.123 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.123 DEBUG:boto:Params: {} 2024-04-16T18:08:45.123 DEBUG:boto:Token: None 2024-04-16T18:08:45.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA= 2024-04-16T18:08:45.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA=', 'Content-Length': '0'} 2024-04-16T18:08:45.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b176ea2e2637fe84-00661ebead-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.126 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:45.127 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.127 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.127 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.127 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.127 DEBUG:boto:Method: GET 2024-04-16T18:08:45.127 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:45.127 DEBUG:boto:Data: 2024-04-16T18:08:45.127 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.127 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.127 DEBUG:boto:Params: {} 2024-04-16T18:08:45.127 DEBUG:boto:Token: None 2024-04-16T18:08:45.128 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA= 2024-04-16T18:08:45.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BBs4dlm2+xJtJOJduzP6N/JtyUA=', 'Content-Length': '0'} 2024-04-16T18:08:45.130 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041ab026afdacbde2-00661ebead-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.130 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:45.130 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-41 zones={test-zone2, test-zone1} 2024-04-16T18:08:45.131 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'cjqttm-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:45.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'cjqttm-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:45.131 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket cjqttm-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:08:45.184 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:45.295 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'cjqttm-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:45.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'cjqttm-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:45.295 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket cjqttm-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:08:45.343 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:45.344 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:45.453 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:45.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:45.453 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:45.499 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:45.500 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:45.550 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:08:45.571 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290925.433798_555.1","last_update":"2024-04-16T18:08:45.433798Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:08:45.572 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290925.433798_555.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:45.572 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:08:45.572 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:45.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:45.572 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:45.630 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:45.630 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:45.686 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:45.688+0000 7f19d5f41800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:08:45.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:45.689+0000 7f19d5f41800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:08:45.709 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290925.433798_555.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:45.433798Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:08:45Z"} 2024-04-16T18:08:45.710 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290925.433798_555.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:45.433798Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:08:45Z"} 2024-04-16T18:08:45.710 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290925.433798_555.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:45.433798Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:08:45.710 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290925.433798_555.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:45.710 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290925.433798_555.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:08:45.710 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:08:45.710 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:45.711 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:45.711 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.711 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:45.711 DEBUG:boto:Data: 2024-04-16T18:08:45.711 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.711 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.711 DEBUG:boto:Params: {} 2024-04-16T18:08:45.712 DEBUG:boto:Token: None 2024-04-16T18:08:45.712 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/ 2024-04-16T18:08:45.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg= 2024-04-16T18:08:45.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg=', 'Content-Length': '0'} 2024-04-16T18:08:45.714 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d4e261ed61a37da-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.715 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:45.715 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:45.715 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.715 DEBUG:boto:Path: /cjqttm-40/obj5 2024-04-16T18:08:45.715 DEBUG:boto:Data: 2024-04-16T18:08:45.715 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.716 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.716 DEBUG:boto:Params: {} 2024-04-16T18:08:45.716 DEBUG:boto:Token: None 2024-04-16T18:08:45.716 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/obj5 2024-04-16T18:08:45.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c5ZaGAGQkA6cH6m810iMawAGKpQ= 2024-04-16T18:08:45.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c5ZaGAGQkA6cH6m810iMawAGKpQ='} 2024-04-16T18:08:45.758 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000018b67dc9871ed3be-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.759 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:45.759 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:45.759 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.759 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:45.759 DEBUG:boto:Data: 2024-04-16T18:08:45.759 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.759 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.759 DEBUG:boto:Params: {} 2024-04-16T18:08:45.760 DEBUG:boto:Token: None 2024-04-16T18:08:45.760 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/ 2024-04-16T18:08:45.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg= 2024-04-16T18:08:45.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg=', 'Content-Length': '0'} 2024-04-16T18:08:45.762 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000913bc506911ba7e4-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.762 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:45.762 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:45.763 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.763 DEBUG:boto:Path: /cjqttm-40/obj6 2024-04-16T18:08:45.763 DEBUG:boto:Data: 2024-04-16T18:08:45.763 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.763 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.763 DEBUG:boto:Params: {} 2024-04-16T18:08:45.763 DEBUG:boto:Token: None 2024-04-16T18:08:45.763 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/obj6 2024-04-16T18:08:45.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sQ5wRJJQxvv/8XizGzu3Q+xbDDg= 2024-04-16T18:08:45.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sQ5wRJJQxvv/8XizGzu3Q+xbDDg='} 2024-04-16T18:08:45.767 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007c3d882366754c71-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.768 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:45.768 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:45.768 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.768 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:45.768 DEBUG:boto:Data: 2024-04-16T18:08:45.768 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.768 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.768 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.768 DEBUG:boto:Params: {} 2024-04-16T18:08:45.768 DEBUG:boto:Token: None 2024-04-16T18:08:45.769 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/ 2024-04-16T18:08:45.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg= 2024-04-16T18:08:45.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg=', 'Content-Length': '0'} 2024-04-16T18:08:45.771 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000013b3039a4c9a008-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.771 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:45.771 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:45.771 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.772 DEBUG:boto:Path: /cjqttm-40/obj7 2024-04-16T18:08:45.772 DEBUG:boto:Data: 2024-04-16T18:08:45.772 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.772 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.772 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.772 DEBUG:boto:Params: {} 2024-04-16T18:08:45.772 DEBUG:boto:Token: None 2024-04-16T18:08:45.772 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/obj7 2024-04-16T18:08:45.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/EKZiRWdQsHK/P2BPcb2RoByso= 2024-04-16T18:08:45.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/EKZiRWdQsHK/P2BPcb2RoByso='} 2024-04-16T18:08:45.815 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003055f81376cc6503-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.815 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:45.815 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:45.815 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.815 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:45.815 DEBUG:boto:Data: 2024-04-16T18:08:45.815 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.815 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.815 DEBUG:boto:Params: {} 2024-04-16T18:08:45.816 DEBUG:boto:Token: None 2024-04-16T18:08:45.816 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/ 2024-04-16T18:08:45.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg= 2024-04-16T18:08:45.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p0s1kS0UZEcaEqX/jAXxYyf/aMg=', 'Content-Length': '0'} 2024-04-16T18:08:45.818 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a7dc946ee5ba6e75-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.818 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:45.818 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:45.818 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.818 DEBUG:boto:Path: /cjqttm-40/obj8 2024-04-16T18:08:45.819 DEBUG:boto:Data: 2024-04-16T18:08:45.819 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:45.819 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.819 DEBUG:boto:Params: {} 2024-04-16T18:08:45.819 DEBUG:boto:Token: None 2024-04-16T18:08:45.819 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-40/obj8 2024-04-16T18:08:45.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z2YBRWVfyD1rM+NTLe31vP53VJA= 2024-04-16T18:08:45.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z2YBRWVfyD1rM+NTLe31vP53VJA='} 2024-04-16T18:08:45.823 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001bb94b1854fd9cab-00661ebead-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.824 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.824 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.824 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.824 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:45.824 DEBUG:boto:Data: 2024-04-16T18:08:45.824 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.824 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.824 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.824 DEBUG:boto:Params: {} 2024-04-16T18:08:45.825 DEBUG:boto:Token: None 2024-04-16T18:08:45.825 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.825 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw= 2024-04-16T18:08:45.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw=', 'Content-Length': '0'} 2024-04-16T18:08:45.827 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca1b05253f74cb7d-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.827 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:45.827 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:45.827 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.827 DEBUG:boto:Path: /cjqttm-41/obj5 2024-04-16T18:08:45.828 DEBUG:boto:Data: 2024-04-16T18:08:45.828 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.828 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.828 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.828 DEBUG:boto:Params: {} 2024-04-16T18:08:45.828 DEBUG:boto:Token: None 2024-04-16T18:08:45.828 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj5 2024-04-16T18:08:45.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lzqLDc9EZOSXsQZ8QiYvf3A4y7w= 2024-04-16T18:08:45.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lzqLDc9EZOSXsQZ8QiYvf3A4y7w='} 2024-04-16T18:08:45.832 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000025fbbb3acb96078-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.832 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.833 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.833 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.833 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:45.833 DEBUG:boto:Data: 2024-04-16T18:08:45.833 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.833 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.833 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.833 DEBUG:boto:Params: {} 2024-04-16T18:08:45.833 DEBUG:boto:Token: None 2024-04-16T18:08:45.833 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw= 2024-04-16T18:08:45.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw=', 'Content-Length': '0'} 2024-04-16T18:08:45.835 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003c526234181201d9-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.835 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:45.835 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:45.835 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.836 DEBUG:boto:Path: /cjqttm-41/obj6 2024-04-16T18:08:45.836 DEBUG:boto:Data: 2024-04-16T18:08:45.836 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.836 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.836 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.836 DEBUG:boto:Params: {} 2024-04-16T18:08:45.836 DEBUG:boto:Token: None 2024-04-16T18:08:45.836 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj6 2024-04-16T18:08:45.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oBUVm8k00zi3OljIU8U6BAFcp/k= 2024-04-16T18:08:45.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oBUVm8k00zi3OljIU8U6BAFcp/k='} 2024-04-16T18:08:45.878 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d87ca798ddcf2bc6-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.879 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.879 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.879 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.879 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:45.879 DEBUG:boto:Data: 2024-04-16T18:08:45.879 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.879 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.879 DEBUG:boto:Params: {} 2024-04-16T18:08:45.879 DEBUG:boto:Token: None 2024-04-16T18:08:45.880 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw= 2024-04-16T18:08:45.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw=', 'Content-Length': '0'} 2024-04-16T18:08:45.882 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000464927c8c0826825-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.882 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:45.882 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:45.882 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.882 DEBUG:boto:Path: /cjqttm-41/obj7 2024-04-16T18:08:45.882 DEBUG:boto:Data: 2024-04-16T18:08:45.882 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.883 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.883 DEBUG:boto:Params: {} 2024-04-16T18:08:45.883 DEBUG:boto:Token: None 2024-04-16T18:08:45.883 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj7 2024-04-16T18:08:45.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5yoZ6PQsR6Hqwj4a5/goAMMkTuQ= 2024-04-16T18:08:45.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5yoZ6PQsR6Hqwj4a5/goAMMkTuQ='} 2024-04-16T18:08:45.888 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f9fe4234df6414e2-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.888 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:45.888 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:45.888 DEBUG:boto:Method: HEAD 2024-04-16T18:08:45.888 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:45.888 DEBUG:boto:Data: 2024-04-16T18:08:45.888 DEBUG:boto:Headers: {} 2024-04-16T18:08:45.888 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.888 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.888 DEBUG:boto:Params: {} 2024-04-16T18:08:45.889 DEBUG:boto:Token: None 2024-04-16T18:08:45.889 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/ 2024-04-16T18:08:45.889 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw= 2024-04-16T18:08:45.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Vjo9R+bi8OWBh2X4YCdsom+k6kw=', 'Content-Length': '0'} 2024-04-16T18:08:45.891 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a139efedc08895b7-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.891 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:45.891 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:45.891 DEBUG:boto:Method: PUT 2024-04-16T18:08:45.891 DEBUG:boto:Path: /cjqttm-41/obj8 2024-04-16T18:08:45.891 DEBUG:boto:Data: 2024-04-16T18:08:45.891 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T18:08:45.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:45.892 DEBUG:boto:Port: 8000 2024-04-16T18:08:45.892 DEBUG:boto:Params: {} 2024-04-16T18:08:45.892 DEBUG:boto:Token: None 2024-04-16T18:08:45.892 DEBUG:boto:StringToSign: PUT qPXxZ/RPSWTmyZje6CcRDA== application/octet-stream Tue, 16 Apr 2024 18:08:45 GMT /cjqttm-41/obj8 2024-04-16T18:08:45.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D4c9bjJ7kHUMrDhHlkxgzAlni2I= 2024-04-16T18:08:45.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:08:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D4c9bjJ7kHUMrDhHlkxgzAlni2I='} 2024-04-16T18:08:45.934 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005af167d2d1ea5fdf-00661ebead-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:45.935 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'cjqttm-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:45.935 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'cjqttm-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:45.935 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket cjqttm-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:08:45.985 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:45.985 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:46.087 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'cjqttm-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:46.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'cjqttm-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:08:46.087 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket cjqttm-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:08:46.137 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:46.137 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:46.240 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-40 2024-04-16T18:08:46.240 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:46.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:46.241 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-40 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:46.296 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:46.296 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:46.352 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:46.354+0000 7f6cc6cc0800 1 bucket sync caught up with source: 2024-04-16T18:08:46.352 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.40.1, 00000000002.19.1, 00000000004.24.1, 00000000002.36.1, 00000000004.41.1, 00000000002.27.1, 00000000002.15.1, 00000000004.29.1, 00000000002.53.1, 00000000002.30.1, 00000000002.122.1] 2024-04-16T18:08:46.352 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.40.1, 00000000002.19.1, 00000000004.24.1, 00000000002.36.1, 00000000004.41.1, 00000000002.27.1, 00000000002.15.1, 00000000004.29.1, 00000000002.53.1, 00000000002.30.1, 00000000002.122.1] 2024-04-16T18:08:46.353 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:46.354+0000 7f6cc6cc0800 0 bucket checkpoint complete 2024-04-16T18:08:46.372 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-40 2024-04-16T18:08:46.373 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:46.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-40', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:46.373 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-40 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:46.428 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:46.428 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:46.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:46.488+0000 7fa0fe29d800 1 waiting to reach incremental sync.. 2024-04-16T18:08:51.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:51.490+0000 7fa0fe29d800 1 bucket sync caught up with source: 2024-04-16T18:08:51.488 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000004.240.1, 00000000002.503.1, 00000000004.220.1, 00000000002.288.1, 00000000004.241.1, 00000000002.608.1, 00000000002.435.1, 00000000004.311.1, 00000000002.300.1, 00000000002.312.1, 00000000002.494.1] 2024-04-16T18:08:51.489 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000004.240.1, 00000000002.503.1, 00000000004.220.1, 00000000002.288.1, 00000000004.241.1, 00000000002.608.1, 00000000002.435.1, 00000000004.311.1, 00000000002.300.1, 00000000002.312.1, 00000000002.494.1] 2024-04-16T18:08:51.489 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:51.490+0000 7fa0fe29d800 0 bucket checkpoint complete 2024-04-16T18:08:51.516 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-40 zones={test-zone2, test-zone1} 2024-04-16T18:08:51.516 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.516 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.516 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.516 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:51.516 DEBUG:boto:Data: 2024-04-16T18:08:51.516 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.516 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.517 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.517 DEBUG:boto:Params: {} 2024-04-16T18:08:51.517 DEBUG:boto:Token: None 2024-04-16T18:08:51.517 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.517 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qsPbS6MiOpVE173FQbKLAq+tAAk= 2024-04-16T18:08:51.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qsPbS6MiOpVE173FQbKLAq+tAAk=', 'Content-Length': '0'} 2024-04-16T18:08:51.520 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049f903584eb251e8-00661ebeb3-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.520 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.520 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.520 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.521 DEBUG:boto:Path: /cjqttm-40/ 2024-04-16T18:08:51.521 DEBUG:boto:Data: 2024-04-16T18:08:51.521 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.521 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.521 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.521 DEBUG:boto:Params: {} 2024-04-16T18:08:51.521 DEBUG:boto:Token: None 2024-04-16T18:08:51.521 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.521 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qsPbS6MiOpVE173FQbKLAq+tAAk= 2024-04-16T18:08:51.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qsPbS6MiOpVE173FQbKLAq+tAAk=', 'Content-Length': '0'} 2024-04-16T18:08:51.524 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f0240d075d1a6320-00661ebeb3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.524 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:08:51.524 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.524 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.524 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.525 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.525 DEBUG:boto:Method: GET 2024-04-16T18:08:51.525 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.525 DEBUG:boto:Data: 2024-04-16T18:08:51.525 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.525 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.525 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.525 DEBUG:boto:Params: {} 2024-04-16T18:08:51.525 DEBUG:boto:Token: None 2024-04-16T18:08:51.525 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/?versions 2024-04-16T18:08:51.526 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY= 2024-04-16T18:08:51.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY=', 'Content-Length': '0'} 2024-04-16T18:08:51.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046c48da3894ceaf2-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.529 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.529 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:51.529 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:51.529 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:51.530 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:51.530 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:51.530 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:51.530 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:51.530 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:51.530 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:08:51.530 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.530 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.531 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.531 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.531 DEBUG:boto:Method: GET 2024-04-16T18:08:51.531 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.531 DEBUG:boto:Data: 2024-04-16T18:08:51.531 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.531 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.531 DEBUG:boto:Params: {} 2024-04-16T18:08:51.531 DEBUG:boto:Token: None 2024-04-16T18:08:51.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/?versions 2024-04-16T18:08:51.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY= 2024-04-16T18:08:51.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY=', 'Content-Length': '0'} 2024-04-16T18:08:51.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049c927cd4384ba89-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.535 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.535 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:51.535 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:51.536 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:51.536 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:51.536 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:51.536 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:51.536 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:51.536 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:51.536 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.536 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.536 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.537 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.537 DEBUG:boto:Method: GET 2024-04-16T18:08:51.537 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.537 DEBUG:boto:Data: 2024-04-16T18:08:51.537 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.537 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.537 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.537 DEBUG:boto:Params: {} 2024-04-16T18:08:51.537 DEBUG:boto:Token: None 2024-04-16T18:08:51.537 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/?versions 2024-04-16T18:08:51.538 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY= 2024-04-16T18:08:51.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY=', 'Content-Length': '0'} 2024-04-16T18:08:51.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4ef60d60bc2eac3-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.540 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.541 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.541 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.541 DEBUG:boto:path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.541 DEBUG:boto:auth_path=/cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.542 DEBUG:boto:Method: GET 2024-04-16T18:08:51.542 DEBUG:boto:Path: /cjqttm-40/?versions&max-keys=999 2024-04-16T18:08:51.542 DEBUG:boto:Data: 2024-04-16T18:08:51.542 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.542 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.542 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.542 DEBUG:boto:Params: {} 2024-04-16T18:08:51.542 DEBUG:boto:Token: None 2024-04-16T18:08:51.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/?versions 2024-04-16T18:08:51.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY= 2024-04-16T18:08:51.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u6585hBhxW8RvXJdsZ8Ip9lB2dY=', 'Content-Length': '0'} 2024-04-16T18:08:51.546 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000024a8d8e4ffcd90b-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.546 DEBUG:boto:b'cjqttm-40999falseobj1nulltrue2024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.546 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:51.547 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.547 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.547 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.547 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.547 DEBUG:boto:Method: GET 2024-04-16T18:08:51.547 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.547 DEBUG:boto:Data: 2024-04-16T18:08:51.547 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.548 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.548 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.548 DEBUG:boto:Params: {} 2024-04-16T18:08:51.548 DEBUG:boto:Token: None 2024-04-16T18:08:51.548 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI= 2024-04-16T18:08:51.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI=', 'Content-Length': '0'} 2024-04-16T18:08:51.551 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ce298c0bdab0036d-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.551 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.551 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.551 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.551 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.551 DEBUG:boto:Method: GET 2024-04-16T18:08:51.551 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.552 DEBUG:boto:Data: 2024-04-16T18:08:51.552 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.552 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.552 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.552 DEBUG:boto:Params: {} 2024-04-16T18:08:51.552 DEBUG:boto:Token: None 2024-04-16T18:08:51.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI= 2024-04-16T18:08:51.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI=', 'Content-Length': '0'} 2024-04-16T18:08:51.554 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000eaecc953937bafbe-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.598 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.598 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.599 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.599 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.599 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.599 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.599 DEBUG:boto:Data: 2024-04-16T18:08:51.599 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.599 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.599 DEBUG:boto:Params: {} 2024-04-16T18:08:51.599 DEBUG:boto:Token: None 2024-04-16T18:08:51.600 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5mqhSo5lIHgZk5ZpNAJ35iS2/ws= 2024-04-16T18:08:51.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5mqhSo5lIHgZk5ZpNAJ35iS2/ws=', 'Content-Length': '0'} 2024-04-16T18:08:51.602 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000046956bc55d5844f0-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.602 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.603 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.603 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.603 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.603 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.603 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.603 DEBUG:boto:Data: 2024-04-16T18:08:51.603 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.603 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.603 DEBUG:boto:Params: {} 2024-04-16T18:08:51.604 DEBUG:boto:Token: None 2024-04-16T18:08:51.604 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5mqhSo5lIHgZk5ZpNAJ35iS2/ws= 2024-04-16T18:08:51.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5mqhSo5lIHgZk5ZpNAJ35iS2/ws=', 'Content-Length': '0'} 2024-04-16T18:08:51.606 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000061da6d520f163c51-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.606 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:51.606 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.606 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.606 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.607 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.607 DEBUG:boto:Method: GET 2024-04-16T18:08:51.607 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.607 DEBUG:boto:Data: 2024-04-16T18:08:51.607 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.607 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.607 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.607 DEBUG:boto:Params: {} 2024-04-16T18:08:51.607 DEBUG:boto:Token: None 2024-04-16T18:08:51.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI= 2024-04-16T18:08:51.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI=', 'Content-Length': '0'} 2024-04-16T18:08:51.610 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000071cef7e14eadc8aa-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.610 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.610 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.611 DEBUG:boto:path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.611 DEBUG:boto:auth_path=/cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.611 DEBUG:boto:Method: GET 2024-04-16T18:08:51.611 DEBUG:boto:Path: /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.611 DEBUG:boto:Data: 2024-04-16T18:08:51.611 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.611 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.611 DEBUG:boto:Params: {} 2024-04-16T18:08:51.611 DEBUG:boto:Token: None 2024-04-16T18:08:51.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1?versionId=null 2024-04-16T18:08:51.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI= 2024-04-16T18:08:51.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4PUNzrmk/GO97YEEHtBrb/dIPaI=', 'Content-Length': '0'} 2024-04-16T18:08:51.614 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000462894530ba4317-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.614 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.614 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.614 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.615 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.615 DEBUG:boto:Method: GET 2024-04-16T18:08:51.615 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.615 DEBUG:boto:Data: 2024-04-16T18:08:51.615 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.615 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.615 DEBUG:boto:Params: {} 2024-04-16T18:08:51.615 DEBUG:boto:Token: None 2024-04-16T18:08:51.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.619 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000edd83f8ce90b4bdc-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.619 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.619 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.619 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.619 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.620 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.620 DEBUG:boto:Method: GET 2024-04-16T18:08:51.620 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.620 DEBUG:boto:Data: 2024-04-16T18:08:51.620 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.620 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.620 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.620 DEBUG:boto:Params: {} 2024-04-16T18:08:51.620 DEBUG:boto:Token: None 2024-04-16T18:08:51.621 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.621 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.623 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0e78bbfbf74ba36-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.623 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.624 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.624 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.624 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.624 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:51.624 DEBUG:boto:Data: 2024-04-16T18:08:51.624 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.624 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.624 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.624 DEBUG:boto:Params: {} 2024-04-16T18:08:51.625 DEBUG:boto:Token: None 2024-04-16T18:08:51.625 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1 2024-04-16T18:08:51.625 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5MKBDSFEEvU0+9foZ0t8qf96/gA= 2024-04-16T18:08:51.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5MKBDSFEEvU0+9foZ0t8qf96/gA=', 'Content-Length': '0'} 2024-04-16T18:08:51.627 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dea86a328b0a409f-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.627 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.628 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.628 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.628 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:51.628 DEBUG:boto:Data: 2024-04-16T18:08:51.628 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.628 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.628 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.628 DEBUG:boto:Params: {} 2024-04-16T18:08:51.628 DEBUG:boto:Token: None 2024-04-16T18:08:51.628 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1 2024-04-16T18:08:51.629 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5MKBDSFEEvU0+9foZ0t8qf96/gA= 2024-04-16T18:08:51.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5MKBDSFEEvU0+9foZ0t8qf96/gA=', 'Content-Length': '0'} 2024-04-16T18:08:51.631 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000971f6ebec4c426c4-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.631 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:51.631 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.631 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.631 DEBUG:boto:Method: GET 2024-04-16T18:08:51.631 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:51.632 DEBUG:boto:Data: 2024-04-16T18:08:51.632 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.632 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.632 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.632 DEBUG:boto:Params: {} 2024-04-16T18:08:51.632 DEBUG:boto:Token: None 2024-04-16T18:08:51.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1 2024-04-16T18:08:51.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xMgcARJdiJlzdnCKLjV9zO79P0w= 2024-04-16T18:08:51.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xMgcARJdiJlzdnCKLjV9zO79P0w=', 'Content-Length': '0'} 2024-04-16T18:08:51.634 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000505f0299d9cce78d-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.678 DEBUG:boto:path=/cjqttm-40/obj1 2024-04-16T18:08:51.679 DEBUG:boto:auth_path=/cjqttm-40/obj1 2024-04-16T18:08:51.679 DEBUG:boto:Method: GET 2024-04-16T18:08:51.679 DEBUG:boto:Path: /cjqttm-40/obj1 2024-04-16T18:08:51.679 DEBUG:boto:Data: 2024-04-16T18:08:51.679 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.679 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.679 DEBUG:boto:Params: {} 2024-04-16T18:08:51.679 DEBUG:boto:Token: None 2024-04-16T18:08:51.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj1 2024-04-16T18:08:51.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xMgcARJdiJlzdnCKLjV9zO79P0w= 2024-04-16T18:08:51.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xMgcARJdiJlzdnCKLjV9zO79P0w=', 'Content-Length': '0'} 2024-04-16T18:08:51.682 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009241a8bbe0555be8-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.682 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.682 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.682 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.683 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.683 DEBUG:boto:Method: GET 2024-04-16T18:08:51.683 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.683 DEBUG:boto:Data: 2024-04-16T18:08:51.683 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.683 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.683 DEBUG:boto:Params: {} 2024-04-16T18:08:51.683 DEBUG:boto:Token: None 2024-04-16T18:08:51.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.686 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f125d2e90fdffbd7-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.686 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.687 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.687 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.687 DEBUG:boto:path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.687 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.687 DEBUG:boto:Method: GET 2024-04-16T18:08:51.687 DEBUG:boto:Path: /cjqttm-40/?prefix=obj1 2024-04-16T18:08:51.687 DEBUG:boto:Data: 2024-04-16T18:08:51.687 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.688 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.688 DEBUG:boto:Params: {} 2024-04-16T18:08:51.688 DEBUG:boto:Token: None 2024-04-16T18:08:51.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.690 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8a7ad01ae02d32d-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.691 DEBUG:boto:b'cjqttm-40obj11000falseobj12024-04-16T18:08:37.346Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.691 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:51.691 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.691 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.691 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.692 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.692 DEBUG:boto:Method: GET 2024-04-16T18:08:51.692 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.692 DEBUG:boto:Data: 2024-04-16T18:08:51.692 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.692 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.692 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.692 DEBUG:boto:Params: {} 2024-04-16T18:08:51.692 DEBUG:boto:Token: None 2024-04-16T18:08:51.693 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.693 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0= 2024-04-16T18:08:51.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0=', 'Content-Length': '0'} 2024-04-16T18:08:51.695 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003b9745132213b28f-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.738 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.739 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.739 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.739 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.739 DEBUG:boto:Method: GET 2024-04-16T18:08:51.739 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.739 DEBUG:boto:Data: 2024-04-16T18:08:51.739 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.739 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.740 DEBUG:boto:Params: {} 2024-04-16T18:08:51.740 DEBUG:boto:Token: None 2024-04-16T18:08:51.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0= 2024-04-16T18:08:51.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0=', 'Content-Length': '0'} 2024-04-16T18:08:51.742 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e3b6c1d8580a946-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.743 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.743 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.743 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.743 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.743 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.743 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.744 DEBUG:boto:Data: 2024-04-16T18:08:51.744 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.744 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.744 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.744 DEBUG:boto:Params: {} 2024-04-16T18:08:51.744 DEBUG:boto:Token: None 2024-04-16T18:08:51.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FfEJUbJNuVJmvLfjWE0qyL1dubg= 2024-04-16T18:08:51.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FfEJUbJNuVJmvLfjWE0qyL1dubg=', 'Content-Length': '0'} 2024-04-16T18:08:51.746 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000028356e5cf6ec2a6c-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.747 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.747 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.747 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.747 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.747 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.747 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.747 DEBUG:boto:Data: 2024-04-16T18:08:51.747 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.748 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.748 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.748 DEBUG:boto:Params: {} 2024-04-16T18:08:51.748 DEBUG:boto:Token: None 2024-04-16T18:08:51.748 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FfEJUbJNuVJmvLfjWE0qyL1dubg= 2024-04-16T18:08:51.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FfEJUbJNuVJmvLfjWE0qyL1dubg=', 'Content-Length': '0'} 2024-04-16T18:08:51.751 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004acc41d524bc59e3-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:51.751 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.751 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.752 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.752 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.752 DEBUG:boto:Method: GET 2024-04-16T18:08:51.752 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.752 DEBUG:boto:Data: 2024-04-16T18:08:51.752 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.752 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.752 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.752 DEBUG:boto:Params: {} 2024-04-16T18:08:51.752 DEBUG:boto:Token: None 2024-04-16T18:08:51.753 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.753 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0= 2024-04-16T18:08:51.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0=', 'Content-Length': '0'} 2024-04-16T18:08:51.755 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b99b130d819635f9-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.798 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.799 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.799 DEBUG:boto:path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.799 DEBUG:boto:auth_path=/cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.799 DEBUG:boto:Method: GET 2024-04-16T18:08:51.799 DEBUG:boto:Path: /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.799 DEBUG:boto:Data: 2024-04-16T18:08:51.799 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.799 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.799 DEBUG:boto:Params: {} 2024-04-16T18:08:51.800 DEBUG:boto:Token: None 2024-04-16T18:08:51.800 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2?versionId=null 2024-04-16T18:08:51.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0= 2024-04-16T18:08:51.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6BSwkDozPcJBV6aCpY3wXuKGb0=', 'Content-Length': '0'} 2024-04-16T18:08:51.802 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b40c19cabcb51b8d-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.803 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.803 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.803 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.803 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.803 DEBUG:boto:Method: GET 2024-04-16T18:08:51.803 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.803 DEBUG:boto:Data: 2024-04-16T18:08:51.803 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.804 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.804 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.804 DEBUG:boto:Params: {} 2024-04-16T18:08:51.804 DEBUG:boto:Token: None 2024-04-16T18:08:51.804 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b58041a118ab22e6-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.806 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.807 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.807 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.807 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.807 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.807 DEBUG:boto:Method: GET 2024-04-16T18:08:51.807 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.807 DEBUG:boto:Data: 2024-04-16T18:08:51.808 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.808 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.808 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.808 DEBUG:boto:Params: {} 2024-04-16T18:08:51.809 DEBUG:boto:Token: None 2024-04-16T18:08:51.809 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.809 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.812 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e79693f9ff4373f3-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.854 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.855 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.855 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.855 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.856 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:51.856 DEBUG:boto:Data: 2024-04-16T18:08:51.856 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.856 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.856 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.857 DEBUG:boto:Params: {} 2024-04-16T18:08:51.857 DEBUG:boto:Token: None 2024-04-16T18:08:51.857 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2 2024-04-16T18:08:51.857 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yc58VN/cx/Bu3P56KIo9F/OyAT8= 2024-04-16T18:08:51.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yc58VN/cx/Bu3P56KIo9F/OyAT8=', 'Content-Length': '0'} 2024-04-16T18:08:51.860 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ef81f983be443251-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.860 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.860 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.861 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.861 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:51.861 DEBUG:boto:Data: 2024-04-16T18:08:51.861 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.862 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.862 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.862 DEBUG:boto:Params: {} 2024-04-16T18:08:51.862 DEBUG:boto:Token: None 2024-04-16T18:08:51.862 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2 2024-04-16T18:08:51.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yc58VN/cx/Bu3P56KIo9F/OyAT8= 2024-04-16T18:08:51.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yc58VN/cx/Bu3P56KIo9F/OyAT8=', 'Content-Length': '0'} 2024-04-16T18:08:51.865 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000081be35e9569420f9-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:51.866 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.866 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.866 DEBUG:boto:Method: GET 2024-04-16T18:08:51.866 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:51.866 DEBUG:boto:Data: 2024-04-16T18:08:51.867 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.867 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.867 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.867 DEBUG:boto:Params: {} 2024-04-16T18:08:51.867 DEBUG:boto:Token: None 2024-04-16T18:08:51.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2 2024-04-16T18:08:51.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A+WgMakl4xl4ThcfearuiI2bDAE= 2024-04-16T18:08:51.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A+WgMakl4xl4ThcfearuiI2bDAE=', 'Content-Length': '0'} 2024-04-16T18:08:51.871 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000949729d54e1cbc2c-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.914 DEBUG:boto:path=/cjqttm-40/obj2 2024-04-16T18:08:51.915 DEBUG:boto:auth_path=/cjqttm-40/obj2 2024-04-16T18:08:51.915 DEBUG:boto:Method: GET 2024-04-16T18:08:51.915 DEBUG:boto:Path: /cjqttm-40/obj2 2024-04-16T18:08:51.915 DEBUG:boto:Data: 2024-04-16T18:08:51.915 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.916 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.916 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.916 DEBUG:boto:Params: {} 2024-04-16T18:08:51.916 DEBUG:boto:Token: None 2024-04-16T18:08:51.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj2 2024-04-16T18:08:51.917 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A+WgMakl4xl4ThcfearuiI2bDAE= 2024-04-16T18:08:51.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A+WgMakl4xl4ThcfearuiI2bDAE=', 'Content-Length': '0'} 2024-04-16T18:08:51.919 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008876863c98f61a81-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.919 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.920 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.920 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.920 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.920 DEBUG:boto:Method: GET 2024-04-16T18:08:51.920 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.920 DEBUG:boto:Data: 2024-04-16T18:08:51.920 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.920 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.920 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.920 DEBUG:boto:Params: {} 2024-04-16T18:08:51.921 DEBUG:boto:Token: None 2024-04-16T18:08:51.921 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.921 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071b52a59130b859a-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.923 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.924 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:51.924 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:51.924 DEBUG:boto:path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.924 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.924 DEBUG:boto:Method: GET 2024-04-16T18:08:51.924 DEBUG:boto:Path: /cjqttm-40/?prefix=obj2 2024-04-16T18:08:51.924 DEBUG:boto:Data: 2024-04-16T18:08:51.924 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.925 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.925 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.925 DEBUG:boto:Params: {} 2024-04-16T18:08:51.925 DEBUG:boto:Token: None 2024-04-16T18:08:51.925 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/ 2024-04-16T18:08:51.925 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw= 2024-04-16T18:08:51.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QKpZQoOinIeSKQ3oSQ+C2g+71lw=', 'Content-Length': '0'} 2024-04-16T18:08:51.927 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e12753f635625d2-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.928 DEBUG:boto:b'cjqttm-40obj21000falseobj22024-04-16T18:08:37.356Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:51.928 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:51.928 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:51.928 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:51.929 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.929 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.929 DEBUG:boto:Method: GET 2024-04-16T18:08:51.929 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.929 DEBUG:boto:Data: 2024-04-16T18:08:51.929 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.929 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.929 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.929 DEBUG:boto:Params: {} 2024-04-16T18:08:51.929 DEBUG:boto:Token: None 2024-04-16T18:08:51.930 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:44Z5d77wDtfdAgB6b/lyJH1tFQU= 2024-04-16T18:08:51.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:44Z5d77wDtfdAgB6b/lyJH1tFQU=', 'Content-Length': '0'} 2024-04-16T18:08:51.932 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000057fcaa07ba0fb2f-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.974 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:51.975 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:51.975 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.975 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.975 DEBUG:boto:Method: GET 2024-04-16T18:08:51.975 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.975 DEBUG:boto:Data: 2024-04-16T18:08:51.975 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.975 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.975 DEBUG:boto:Params: {} 2024-04-16T18:08:51.976 DEBUG:boto:Token: None 2024-04-16T18:08:51.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:44Z5d77wDtfdAgB6b/lyJH1tFQU= 2024-04-16T18:08:51.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:44Z5d77wDtfdAgB6b/lyJH1tFQU=', 'Content-Length': '0'} 2024-04-16T18:08:51.978 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001c77844fe3418df9-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.979 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:51.979 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:51.979 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.979 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.980 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.980 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.980 DEBUG:boto:Data: 2024-04-16T18:08:51.980 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.980 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.980 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.980 DEBUG:boto:Params: {} 2024-04-16T18:08:51.981 DEBUG:boto:Token: None 2024-04-16T18:08:51.981 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.981 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WKIccW5cvFb9KOk2ijn0FvZhG+w= 2024-04-16T18:08:51.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKIccW5cvFb9KOk2ijn0FvZhG+w=', 'Content-Length': '0'} 2024-04-16T18:08:51.983 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000af52b3c9ffeb176a-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.983 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:51.983 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:51.984 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.984 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.984 DEBUG:boto:Method: HEAD 2024-04-16T18:08:51.984 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.984 DEBUG:boto:Data: 2024-04-16T18:08:51.984 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.984 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:51.984 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.984 DEBUG:boto:Params: {} 2024-04-16T18:08:51.984 DEBUG:boto:Token: None 2024-04-16T18:08:51.985 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WKIccW5cvFb9KOk2ijn0FvZhG+w= 2024-04-16T18:08:51.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKIccW5cvFb9KOk2ijn0FvZhG+w=', 'Content-Length': '0'} 2024-04-16T18:08:51.987 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003a3baedd5fbca38e-00661ebeb3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:51.987 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:51.987 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:51.987 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:51.987 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.987 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.987 DEBUG:boto:Method: GET 2024-04-16T18:08:51.988 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.988 DEBUG:boto:Data: 2024-04-16T18:08:51.988 DEBUG:boto:Headers: {} 2024-04-16T18:08:51.988 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:51.988 DEBUG:boto:Port: 8000 2024-04-16T18:08:51.988 DEBUG:boto:Params: {} 2024-04-16T18:08:51.988 DEBUG:boto:Token: None 2024-04-16T18:08:51.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:51 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:51.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:44Z5d77wDtfdAgB6b/lyJH1tFQU= 2024-04-16T18:08:51.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:44Z5d77wDtfdAgB6b/lyJH1tFQU=', 'Content-Length': '0'} 2024-04-16T18:08:51.991 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cd7f8b572b2f2f6c-00661ebeb3-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.034 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:52.034 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:52.034 DEBUG:boto:path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:52.035 DEBUG:boto:auth_path=/cjqttm-40/obj3?versionId=null 2024-04-16T18:08:52.035 DEBUG:boto:Method: GET 2024-04-16T18:08:52.035 DEBUG:boto:Path: /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:52.035 DEBUG:boto:Data: 2024-04-16T18:08:52.035 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.035 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.035 DEBUG:boto:Params: {} 2024-04-16T18:08:52.035 DEBUG:boto:Token: None 2024-04-16T18:08:52.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj3?versionId=null 2024-04-16T18:08:52.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MJpp3Z/HEovqAqrk0noGyq9wiP4= 2024-04-16T18:08:52.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MJpp3Z/HEovqAqrk0noGyq9wiP4=', 'Content-Length': '0'} 2024-04-16T18:08:52.038 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008a6c9d9a980df7b0-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.038 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.038 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.038 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.038 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.039 DEBUG:boto:Method: GET 2024-04-16T18:08:52.039 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.039 DEBUG:boto:Data: 2024-04-16T18:08:52.039 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.039 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.039 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.039 DEBUG:boto:Params: {} 2024-04-16T18:08:52.039 DEBUG:boto:Token: None 2024-04-16T18:08:52.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d082a0a91e234cc-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.082 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.083 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.083 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.083 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.083 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.083 DEBUG:boto:Method: GET 2024-04-16T18:08:52.083 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.083 DEBUG:boto:Data: 2024-04-16T18:08:52.083 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.083 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.084 DEBUG:boto:Params: {} 2024-04-16T18:08:52.084 DEBUG:boto:Token: None 2024-04-16T18:08:52.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046f1d1cb4042d50b-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.086 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.087 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:52.087 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:52.087 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.087 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:52.087 DEBUG:boto:Data: 2024-04-16T18:08:52.087 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.087 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.087 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.087 DEBUG:boto:Params: {} 2024-04-16T18:08:52.087 DEBUG:boto:Token: None 2024-04-16T18:08:52.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj3 2024-04-16T18:08:52.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIUuB+x7ZTUtEPn8cUBn/2L6sjI= 2024-04-16T18:08:52.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIUuB+x7ZTUtEPn8cUBn/2L6sjI=', 'Content-Length': '0'} 2024-04-16T18:08:52.090 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000068e8cf63f56dd2c2-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.090 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:52.090 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:52.090 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.091 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:52.091 DEBUG:boto:Data: 2024-04-16T18:08:52.091 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.091 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.091 DEBUG:boto:Params: {} 2024-04-16T18:08:52.091 DEBUG:boto:Token: None 2024-04-16T18:08:52.091 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj3 2024-04-16T18:08:52.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIUuB+x7ZTUtEPn8cUBn/2L6sjI= 2024-04-16T18:08:52.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIUuB+x7ZTUtEPn8cUBn/2L6sjI=', 'Content-Length': '0'} 2024-04-16T18:08:52.093 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000011af41fe4b6ea2db-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.094 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:52.094 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:52.094 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:52.094 DEBUG:boto:Method: GET 2024-04-16T18:08:52.094 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:52.094 DEBUG:boto:Data: 2024-04-16T18:08:52.094 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.094 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.094 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.095 DEBUG:boto:Params: {} 2024-04-16T18:08:52.095 DEBUG:boto:Token: None 2024-04-16T18:08:52.095 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj3 2024-04-16T18:08:52.095 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ddWuTdZUmOwH+XDruc2agFBwig0= 2024-04-16T18:08:52.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ddWuTdZUmOwH+XDruc2agFBwig0=', 'Content-Length': '0'} 2024-04-16T18:08:52.097 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000060401a94a0235765-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.138 DEBUG:boto:path=/cjqttm-40/obj3 2024-04-16T18:08:52.138 DEBUG:boto:auth_path=/cjqttm-40/obj3 2024-04-16T18:08:52.139 DEBUG:boto:Method: GET 2024-04-16T18:08:52.139 DEBUG:boto:Path: /cjqttm-40/obj3 2024-04-16T18:08:52.139 DEBUG:boto:Data: 2024-04-16T18:08:52.139 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.139 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.139 DEBUG:boto:Params: {} 2024-04-16T18:08:52.139 DEBUG:boto:Token: None 2024-04-16T18:08:52.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj3 2024-04-16T18:08:52.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ddWuTdZUmOwH+XDruc2agFBwig0= 2024-04-16T18:08:52.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ddWuTdZUmOwH+XDruc2agFBwig0=', 'Content-Length': '0'} 2024-04-16T18:08:52.142 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001e3de79deb6b2e57-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.142 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.142 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.142 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.142 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.142 DEBUG:boto:Method: GET 2024-04-16T18:08:52.142 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.142 DEBUG:boto:Data: 2024-04-16T18:08:52.142 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.143 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.143 DEBUG:boto:Params: {} 2024-04-16T18:08:52.143 DEBUG:boto:Token: None 2024-04-16T18:08:52.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000601ae9100d0c3972-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.146 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.146 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.146 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.146 DEBUG:boto:path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.147 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.147 DEBUG:boto:Method: GET 2024-04-16T18:08:52.147 DEBUG:boto:Path: /cjqttm-40/?prefix=obj3 2024-04-16T18:08:52.147 DEBUG:boto:Data: 2024-04-16T18:08:52.147 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.147 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.147 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.147 DEBUG:boto:Params: {} 2024-04-16T18:08:52.147 DEBUG:boto:Token: None 2024-04-16T18:08:52.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c6cb6fa7910cb5e-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.150 DEBUG:boto:b'cjqttm-40obj31000falseobj32024-04-16T18:08:37.404Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:52.150 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.150 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.150 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.150 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.150 DEBUG:boto:Method: GET 2024-04-16T18:08:52.151 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.151 DEBUG:boto:Data: 2024-04-16T18:08:52.151 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.151 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.151 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.151 DEBUG:boto:Params: {} 2024-04-16T18:08:52.151 DEBUG:boto:Token: None 2024-04-16T18:08:52.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w= 2024-04-16T18:08:52.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w=', 'Content-Length': '0'} 2024-04-16T18:08:52.153 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000132031d600cf3f20-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.194 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.194 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.194 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.195 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.195 DEBUG:boto:Method: GET 2024-04-16T18:08:52.195 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.195 DEBUG:boto:Data: 2024-04-16T18:08:52.195 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.195 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.195 DEBUG:boto:Params: {} 2024-04-16T18:08:52.195 DEBUG:boto:Token: None 2024-04-16T18:08:52.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w= 2024-04-16T18:08:52.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w=', 'Content-Length': '0'} 2024-04-16T18:08:52.198 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003a89b7406495b97c-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.198 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.198 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.198 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.198 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.198 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.199 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.199 DEBUG:boto:Data: 2024-04-16T18:08:52.199 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.199 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.199 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.199 DEBUG:boto:Params: {} 2024-04-16T18:08:52.199 DEBUG:boto:Token: None 2024-04-16T18:08:52.199 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UMqOvnHjHyF7XBQy/uJJ8XF8GEE= 2024-04-16T18:08:52.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UMqOvnHjHyF7XBQy/uJJ8XF8GEE=', 'Content-Length': '0'} 2024-04-16T18:08:52.201 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000069230f2354e4457-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.201 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.202 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.202 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.202 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.202 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.202 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.202 DEBUG:boto:Data: 2024-04-16T18:08:52.202 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.202 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.202 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.202 DEBUG:boto:Params: {} 2024-04-16T18:08:52.202 DEBUG:boto:Token: None 2024-04-16T18:08:52.203 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UMqOvnHjHyF7XBQy/uJJ8XF8GEE= 2024-04-16T18:08:52.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UMqOvnHjHyF7XBQy/uJJ8XF8GEE=', 'Content-Length': '0'} 2024-04-16T18:08:52.208 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000053cd33e23adf4387-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:52.208 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.208 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.208 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.208 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.208 DEBUG:boto:Method: GET 2024-04-16T18:08:52.209 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.209 DEBUG:boto:Data: 2024-04-16T18:08:52.209 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.209 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.209 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.209 DEBUG:boto:Params: {} 2024-04-16T18:08:52.209 DEBUG:boto:Token: None 2024-04-16T18:08:52.209 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.209 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w= 2024-04-16T18:08:52.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w=', 'Content-Length': '0'} 2024-04-16T18:08:52.211 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006690fc935729ecf0-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.254 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.254 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.255 DEBUG:boto:path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.255 DEBUG:boto:auth_path=/cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.255 DEBUG:boto:Method: GET 2024-04-16T18:08:52.255 DEBUG:boto:Path: /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.255 DEBUG:boto:Data: 2024-04-16T18:08:52.255 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.255 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.255 DEBUG:boto:Params: {} 2024-04-16T18:08:52.255 DEBUG:boto:Token: None 2024-04-16T18:08:52.255 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4?versionId=null 2024-04-16T18:08:52.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w= 2024-04-16T18:08:52.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9gH8t2Q/g6XbCPJ7VRv70fVaA4w=', 'Content-Length': '0'} 2024-04-16T18:08:52.258 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000009852921e48a6401a-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.258 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.258 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.258 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.258 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.258 DEBUG:boto:Method: GET 2024-04-16T18:08:52.258 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.258 DEBUG:boto:Data: 2024-04-16T18:08:52.259 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.259 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.259 DEBUG:boto:Params: {} 2024-04-16T18:08:52.259 DEBUG:boto:Token: None 2024-04-16T18:08:52.259 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b553b161bdf93383-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.262 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.262 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.262 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.262 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.262 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.262 DEBUG:boto:Method: GET 2024-04-16T18:08:52.263 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.263 DEBUG:boto:Data: 2024-04-16T18:08:52.263 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.263 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.263 DEBUG:boto:Params: {} 2024-04-16T18:08:52.263 DEBUG:boto:Token: None 2024-04-16T18:08:52.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fbf3565859b10e3-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.266 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.267 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.267 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.267 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.267 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:52.267 DEBUG:boto:Data: 2024-04-16T18:08:52.267 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.267 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.267 DEBUG:boto:Params: {} 2024-04-16T18:08:52.267 DEBUG:boto:Token: None 2024-04-16T18:08:52.268 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4 2024-04-16T18:08:52.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ACLqg0nujk489BWlQll/TLYNimU= 2024-04-16T18:08:52.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ACLqg0nujk489BWlQll/TLYNimU=', 'Content-Length': '0'} 2024-04-16T18:08:52.269 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008a876170d20115a7-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.270 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.270 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.270 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.270 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:52.270 DEBUG:boto:Data: 2024-04-16T18:08:52.270 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.270 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.270 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.271 DEBUG:boto:Params: {} 2024-04-16T18:08:52.271 DEBUG:boto:Token: None 2024-04-16T18:08:52.271 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4 2024-04-16T18:08:52.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ACLqg0nujk489BWlQll/TLYNimU= 2024-04-16T18:08:52.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ACLqg0nujk489BWlQll/TLYNimU=', 'Content-Length': '0'} 2024-04-16T18:08:52.273 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e8efcbd40aacabe-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.273 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:52.274 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.274 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.274 DEBUG:boto:Method: GET 2024-04-16T18:08:52.274 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:52.274 DEBUG:boto:Data: 2024-04-16T18:08:52.274 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.274 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.274 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.274 DEBUG:boto:Params: {} 2024-04-16T18:08:52.274 DEBUG:boto:Token: None 2024-04-16T18:08:52.274 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4 2024-04-16T18:08:52.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+iLSKiBVvacdjyTESj1V1RSL25o= 2024-04-16T18:08:52.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+iLSKiBVvacdjyTESj1V1RSL25o=', 'Content-Length': '0'} 2024-04-16T18:08:52.276 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a480f215893d6f9-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.318 DEBUG:boto:path=/cjqttm-40/obj4 2024-04-16T18:08:52.318 DEBUG:boto:auth_path=/cjqttm-40/obj4 2024-04-16T18:08:52.318 DEBUG:boto:Method: GET 2024-04-16T18:08:52.319 DEBUG:boto:Path: /cjqttm-40/obj4 2024-04-16T18:08:52.319 DEBUG:boto:Data: 2024-04-16T18:08:52.319 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.319 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.319 DEBUG:boto:Params: {} 2024-04-16T18:08:52.319 DEBUG:boto:Token: None 2024-04-16T18:08:52.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj4 2024-04-16T18:08:52.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+iLSKiBVvacdjyTESj1V1RSL25o= 2024-04-16T18:08:52.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+iLSKiBVvacdjyTESj1V1RSL25o=', 'Content-Length': '0'} 2024-04-16T18:08:52.321 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000028539f4272abbd62-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.321 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.322 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.322 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.322 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.322 DEBUG:boto:Method: GET 2024-04-16T18:08:52.322 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.322 DEBUG:boto:Data: 2024-04-16T18:08:52.322 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.322 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.322 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.322 DEBUG:boto:Params: {} 2024-04-16T18:08:52.323 DEBUG:boto:Token: None 2024-04-16T18:08:52.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba6fe56fa6c36ecd-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.326 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.326 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.326 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.326 DEBUG:boto:path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.326 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.326 DEBUG:boto:Method: GET 2024-04-16T18:08:52.326 DEBUG:boto:Path: /cjqttm-40/?prefix=obj4 2024-04-16T18:08:52.327 DEBUG:boto:Data: 2024-04-16T18:08:52.327 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.327 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.327 DEBUG:boto:Params: {} 2024-04-16T18:08:52.327 DEBUG:boto:Token: None 2024-04-16T18:08:52.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.330 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000789a0a742fe26720-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.330 DEBUG:boto:b'cjqttm-40obj41000falseobj42024-04-16T18:08:37.413Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:52.331 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.331 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.331 DEBUG:boto:path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.331 DEBUG:boto:auth_path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.331 DEBUG:boto:Method: GET 2024-04-16T18:08:52.331 DEBUG:boto:Path: /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.331 DEBUG:boto:Data: 2024-04-16T18:08:52.331 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.331 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.331 DEBUG:boto:Params: {} 2024-04-16T18:08:52.332 DEBUG:boto:Token: None 2024-04-16T18:08:52.332 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow= 2024-04-16T18:08:52.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow=', 'Content-Length': '0'} 2024-04-16T18:08:52.334 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005ef6b320b0fb128b-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.374 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.374 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.375 DEBUG:boto:path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.375 DEBUG:boto:auth_path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.375 DEBUG:boto:Method: GET 2024-04-16T18:08:52.375 DEBUG:boto:Path: /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.375 DEBUG:boto:Data: 2024-04-16T18:08:52.375 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.375 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.375 DEBUG:boto:Params: {} 2024-04-16T18:08:52.375 DEBUG:boto:Token: None 2024-04-16T18:08:52.376 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.376 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow= 2024-04-16T18:08:52.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow=', 'Content-Length': '0'} 2024-04-16T18:08:52.378 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000029eb4b2b057b69b9-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.378 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.378 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.378 DEBUG:boto:path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.378 DEBUG:boto:auth_path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.378 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.379 DEBUG:boto:Path: /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.379 DEBUG:boto:Data: 2024-04-16T18:08:52.379 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.379 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.379 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.379 DEBUG:boto:Params: {} 2024-04-16T18:08:52.379 DEBUG:boto:Token: None 2024-04-16T18:08:52.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzm+xk8B9/579QpE8wkf6MfFyTQ= 2024-04-16T18:08:52.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzm+xk8B9/579QpE8wkf6MfFyTQ=', 'Content-Length': '0'} 2024-04-16T18:08:52.381 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b26607c14779069d-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.382 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.382 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.382 DEBUG:boto:path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.382 DEBUG:boto:auth_path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.382 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.382 DEBUG:boto:Path: /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.382 DEBUG:boto:Data: 2024-04-16T18:08:52.382 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.382 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.382 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.383 DEBUG:boto:Params: {} 2024-04-16T18:08:52.383 DEBUG:boto:Token: None 2024-04-16T18:08:52.383 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzm+xk8B9/579QpE8wkf6MfFyTQ= 2024-04-16T18:08:52.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzm+xk8B9/579QpE8wkf6MfFyTQ=', 'Content-Length': '0'} 2024-04-16T18:08:52.385 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002f537769e43c767b-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:52.385 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.385 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.385 DEBUG:boto:path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.386 DEBUG:boto:auth_path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.386 DEBUG:boto:Method: GET 2024-04-16T18:08:52.386 DEBUG:boto:Path: /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.386 DEBUG:boto:Data: 2024-04-16T18:08:52.386 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.386 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.386 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.386 DEBUG:boto:Params: {} 2024-04-16T18:08:52.386 DEBUG:boto:Token: None 2024-04-16T18:08:52.386 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow= 2024-04-16T18:08:52.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow=', 'Content-Length': '0'} 2024-04-16T18:08:52.389 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a5b8dbff0005cbe3-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.433 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.433 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.433 DEBUG:boto:path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.434 DEBUG:boto:auth_path=/cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.434 DEBUG:boto:Method: GET 2024-04-16T18:08:52.434 DEBUG:boto:Path: /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.434 DEBUG:boto:Data: 2024-04-16T18:08:52.434 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.434 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.434 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.434 DEBUG:boto:Params: {} 2024-04-16T18:08:52.434 DEBUG:boto:Token: None 2024-04-16T18:08:52.434 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5?versionId=null 2024-04-16T18:08:52.434 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow= 2024-04-16T18:08:52.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4iTQm64QZ3zH1m62Jn50tsWNpow=', 'Content-Length': '0'} 2024-04-16T18:08:52.436 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005e1f37fcaeae0d46-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.437 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.437 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.437 DEBUG:boto:path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.437 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.437 DEBUG:boto:Method: GET 2024-04-16T18:08:52.437 DEBUG:boto:Path: /cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.437 DEBUG:boto:Data: 2024-04-16T18:08:52.437 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.438 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.438 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.438 DEBUG:boto:Params: {} 2024-04-16T18:08:52.438 DEBUG:boto:Token: None 2024-04-16T18:08:52.438 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.438 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e42ba59b4a5febfb-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.441 DEBUG:boto:b'cjqttm-40obj51000falseobj52024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.441 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.441 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.441 DEBUG:boto:path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.441 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.442 DEBUG:boto:Method: GET 2024-04-16T18:08:52.442 DEBUG:boto:Path: /cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.442 DEBUG:boto:Data: 2024-04-16T18:08:52.442 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.442 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.442 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.442 DEBUG:boto:Params: {} 2024-04-16T18:08:52.442 DEBUG:boto:Token: None 2024-04-16T18:08:52.442 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.442 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ef30d14d1f3e877-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.445 DEBUG:boto:b'cjqttm-40obj51000falseobj52024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.446 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.446 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.446 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.446 DEBUG:boto:Path: /cjqttm-40/obj5 2024-04-16T18:08:52.446 DEBUG:boto:Data: 2024-04-16T18:08:52.446 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.446 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.446 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.446 DEBUG:boto:Params: {} 2024-04-16T18:08:52.446 DEBUG:boto:Token: None 2024-04-16T18:08:52.447 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5 2024-04-16T18:08:52.447 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yeXxMLvRThiiYB0qMZ82bTQ4ApI= 2024-04-16T18:08:52.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yeXxMLvRThiiYB0qMZ82bTQ4ApI=', 'Content-Length': '0'} 2024-04-16T18:08:52.449 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000007b01542d3c77641-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.449 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.449 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.449 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.449 DEBUG:boto:Path: /cjqttm-40/obj5 2024-04-16T18:08:52.450 DEBUG:boto:Data: 2024-04-16T18:08:52.450 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.450 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.450 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.450 DEBUG:boto:Params: {} 2024-04-16T18:08:52.450 DEBUG:boto:Token: None 2024-04-16T18:08:52.450 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5 2024-04-16T18:08:52.450 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yeXxMLvRThiiYB0qMZ82bTQ4ApI= 2024-04-16T18:08:52.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yeXxMLvRThiiYB0qMZ82bTQ4ApI=', 'Content-Length': '0'} 2024-04-16T18:08:52.452 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000029307072318b847f-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.453 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:52.453 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.453 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.453 DEBUG:boto:Method: GET 2024-04-16T18:08:52.453 DEBUG:boto:Path: /cjqttm-40/obj5 2024-04-16T18:08:52.453 DEBUG:boto:Data: 2024-04-16T18:08:52.453 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.453 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.453 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.454 DEBUG:boto:Params: {} 2024-04-16T18:08:52.454 DEBUG:boto:Token: None 2024-04-16T18:08:52.454 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5 2024-04-16T18:08:52.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sShcAiDgxzZPgy/YlOBUW/2KQpg= 2024-04-16T18:08:52.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sShcAiDgxzZPgy/YlOBUW/2KQpg=', 'Content-Length': '0'} 2024-04-16T18:08:52.457 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005bbd61a0edb5003c-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.498 DEBUG:boto:path=/cjqttm-40/obj5 2024-04-16T18:08:52.498 DEBUG:boto:auth_path=/cjqttm-40/obj5 2024-04-16T18:08:52.499 DEBUG:boto:Method: GET 2024-04-16T18:08:52.499 DEBUG:boto:Path: /cjqttm-40/obj5 2024-04-16T18:08:52.499 DEBUG:boto:Data: 2024-04-16T18:08:52.499 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.499 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.499 DEBUG:boto:Params: {} 2024-04-16T18:08:52.499 DEBUG:boto:Token: None 2024-04-16T18:08:52.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj5 2024-04-16T18:08:52.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sShcAiDgxzZPgy/YlOBUW/2KQpg= 2024-04-16T18:08:52.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sShcAiDgxzZPgy/YlOBUW/2KQpg=', 'Content-Length': '0'} 2024-04-16T18:08:52.502 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000037db6c25edc57193-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.502 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.502 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.502 DEBUG:boto:path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.503 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.503 DEBUG:boto:Method: GET 2024-04-16T18:08:52.503 DEBUG:boto:Path: /cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.503 DEBUG:boto:Data: 2024-04-16T18:08:52.503 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.503 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.503 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.503 DEBUG:boto:Params: {} 2024-04-16T18:08:52.503 DEBUG:boto:Token: None 2024-04-16T18:08:52.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.506 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d9c691718fecde9-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.506 DEBUG:boto:b'cjqttm-40obj51000falseobj52024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.507 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.507 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.507 DEBUG:boto:path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.507 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.507 DEBUG:boto:Method: GET 2024-04-16T18:08:52.507 DEBUG:boto:Path: /cjqttm-40/?prefix=obj5 2024-04-16T18:08:52.507 DEBUG:boto:Data: 2024-04-16T18:08:52.507 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.507 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.507 DEBUG:boto:Params: {} 2024-04-16T18:08:52.508 DEBUG:boto:Token: None 2024-04-16T18:08:52.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.510 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df85307844512218-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.510 DEBUG:boto:b'cjqttm-40obj51000falseobj52024-04-16T18:08:45.720Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:52.511 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.511 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.511 DEBUG:boto:path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.511 DEBUG:boto:auth_path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.511 DEBUG:boto:Method: GET 2024-04-16T18:08:52.511 DEBUG:boto:Path: /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.511 DEBUG:boto:Data: 2024-04-16T18:08:52.511 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.511 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.512 DEBUG:boto:Params: {} 2024-04-16T18:08:52.512 DEBUG:boto:Token: None 2024-04-16T18:08:52.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y= 2024-04-16T18:08:52.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y=', 'Content-Length': '0'} 2024-04-16T18:08:52.514 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000148fd6720c50a9b1-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.554 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.554 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.554 DEBUG:boto:path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.555 DEBUG:boto:auth_path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.555 DEBUG:boto:Method: GET 2024-04-16T18:08:52.555 DEBUG:boto:Path: /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.555 DEBUG:boto:Data: 2024-04-16T18:08:52.555 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.555 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.555 DEBUG:boto:Params: {} 2024-04-16T18:08:52.555 DEBUG:boto:Token: None 2024-04-16T18:08:52.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y= 2024-04-16T18:08:52.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y=', 'Content-Length': '0'} 2024-04-16T18:08:52.557 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004a501e697aba19d1-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.558 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.558 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.558 DEBUG:boto:path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.558 DEBUG:boto:auth_path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.558 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.558 DEBUG:boto:Path: /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.559 DEBUG:boto:Data: 2024-04-16T18:08:52.559 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.559 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.559 DEBUG:boto:Params: {} 2024-04-16T18:08:52.559 DEBUG:boto:Token: None 2024-04-16T18:08:52.560 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qrAmjGDQQePGKELAlgKfnSdyYA= 2024-04-16T18:08:52.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qrAmjGDQQePGKELAlgKfnSdyYA=', 'Content-Length': '0'} 2024-04-16T18:08:52.561 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000051d8d4a51d7f413e-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.562 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.562 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.562 DEBUG:boto:path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.562 DEBUG:boto:auth_path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.562 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.562 DEBUG:boto:Path: /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.562 DEBUG:boto:Data: 2024-04-16T18:08:52.562 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.562 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.562 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.563 DEBUG:boto:Params: {} 2024-04-16T18:08:52.563 DEBUG:boto:Token: None 2024-04-16T18:08:52.563 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qrAmjGDQQePGKELAlgKfnSdyYA= 2024-04-16T18:08:52.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qrAmjGDQQePGKELAlgKfnSdyYA=', 'Content-Length': '0'} 2024-04-16T18:08:52.565 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e440581a67b281c6-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.565 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:52.565 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.565 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.565 DEBUG:boto:path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.565 DEBUG:boto:auth_path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.565 DEBUG:boto:Method: GET 2024-04-16T18:08:52.565 DEBUG:boto:Path: /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.566 DEBUG:boto:Data: 2024-04-16T18:08:52.566 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.566 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.566 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.566 DEBUG:boto:Params: {} 2024-04-16T18:08:52.566 DEBUG:boto:Token: None 2024-04-16T18:08:52.566 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y= 2024-04-16T18:08:52.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y=', 'Content-Length': '0'} 2024-04-16T18:08:52.569 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f4d604a54a41d59d-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.610 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.610 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.610 DEBUG:boto:path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.611 DEBUG:boto:auth_path=/cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.611 DEBUG:boto:Method: GET 2024-04-16T18:08:52.611 DEBUG:boto:Path: /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.611 DEBUG:boto:Data: 2024-04-16T18:08:52.611 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.611 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.611 DEBUG:boto:Params: {} 2024-04-16T18:08:52.611 DEBUG:boto:Token: None 2024-04-16T18:08:52.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6?versionId=null 2024-04-16T18:08:52.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y= 2024-04-16T18:08:52.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XIGKIHmcF9z2QjHYO3/HmSsQI/Y=', 'Content-Length': '0'} 2024-04-16T18:08:52.613 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000072fab3248625343b-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.614 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.614 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.614 DEBUG:boto:path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.614 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.614 DEBUG:boto:Method: GET 2024-04-16T18:08:52.614 DEBUG:boto:Path: /cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.614 DEBUG:boto:Data: 2024-04-16T18:08:52.614 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.614 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.615 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.615 DEBUG:boto:Params: {} 2024-04-16T18:08:52.615 DEBUG:boto:Token: None 2024-04-16T18:08:52.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1188c882104e9be-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.618 DEBUG:boto:b'cjqttm-40obj61000falseobj62024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.618 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.618 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.618 DEBUG:boto:path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.618 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.618 DEBUG:boto:Method: GET 2024-04-16T18:08:52.619 DEBUG:boto:Path: /cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.619 DEBUG:boto:Data: 2024-04-16T18:08:52.619 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.619 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.619 DEBUG:boto:Params: {} 2024-04-16T18:08:52.619 DEBUG:boto:Token: None 2024-04-16T18:08:52.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028cf6d88f10371c2-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.622 DEBUG:boto:b'cjqttm-40obj61000falseobj62024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.622 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.622 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.622 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.622 DEBUG:boto:Path: /cjqttm-40/obj6 2024-04-16T18:08:52.622 DEBUG:boto:Data: 2024-04-16T18:08:52.622 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.623 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.623 DEBUG:boto:Params: {} 2024-04-16T18:08:52.623 DEBUG:boto:Token: None 2024-04-16T18:08:52.623 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6 2024-04-16T18:08:52.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9/FCS5FWdH0E4zJjIFPhaDF0B2Y= 2024-04-16T18:08:52.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9/FCS5FWdH0E4zJjIFPhaDF0B2Y=', 'Content-Length': '0'} 2024-04-16T18:08:52.625 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000f1ef65136fef792-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.625 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.625 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.625 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.626 DEBUG:boto:Path: /cjqttm-40/obj6 2024-04-16T18:08:52.626 DEBUG:boto:Data: 2024-04-16T18:08:52.626 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.626 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.626 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.626 DEBUG:boto:Params: {} 2024-04-16T18:08:52.626 DEBUG:boto:Token: None 2024-04-16T18:08:52.626 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6 2024-04-16T18:08:52.626 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9/FCS5FWdH0E4zJjIFPhaDF0B2Y= 2024-04-16T18:08:52.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9/FCS5FWdH0E4zJjIFPhaDF0B2Y=', 'Content-Length': '0'} 2024-04-16T18:08:52.628 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001376fdff045f3e53-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.628 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:52.628 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.629 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.629 DEBUG:boto:Method: GET 2024-04-16T18:08:52.629 DEBUG:boto:Path: /cjqttm-40/obj6 2024-04-16T18:08:52.629 DEBUG:boto:Data: 2024-04-16T18:08:52.629 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.629 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.629 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.629 DEBUG:boto:Params: {} 2024-04-16T18:08:52.629 DEBUG:boto:Token: None 2024-04-16T18:08:52.629 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6 2024-04-16T18:08:52.630 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LikuCw8bVX8nTtHSEU2jmm8Zim4= 2024-04-16T18:08:52.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LikuCw8bVX8nTtHSEU2jmm8Zim4=', 'Content-Length': '0'} 2024-04-16T18:08:52.632 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ea90f400fac6ce07-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.674 DEBUG:boto:path=/cjqttm-40/obj6 2024-04-16T18:08:52.675 DEBUG:boto:auth_path=/cjqttm-40/obj6 2024-04-16T18:08:52.675 DEBUG:boto:Method: GET 2024-04-16T18:08:52.675 DEBUG:boto:Path: /cjqttm-40/obj6 2024-04-16T18:08:52.675 DEBUG:boto:Data: 2024-04-16T18:08:52.675 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.675 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.675 DEBUG:boto:Params: {} 2024-04-16T18:08:52.675 DEBUG:boto:Token: None 2024-04-16T18:08:52.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj6 2024-04-16T18:08:52.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LikuCw8bVX8nTtHSEU2jmm8Zim4= 2024-04-16T18:08:52.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LikuCw8bVX8nTtHSEU2jmm8Zim4=', 'Content-Length': '0'} 2024-04-16T18:08:52.677 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004b4f2863468da975-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.678 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.678 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.678 DEBUG:boto:path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.678 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.678 DEBUG:boto:Method: GET 2024-04-16T18:08:52.678 DEBUG:boto:Path: /cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.678 DEBUG:boto:Data: 2024-04-16T18:08:52.678 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.678 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.678 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.679 DEBUG:boto:Params: {} 2024-04-16T18:08:52.679 DEBUG:boto:Token: None 2024-04-16T18:08:52.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.681 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df0cd7968c0c0bee-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.682 DEBUG:boto:b'cjqttm-40obj61000falseobj62024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.682 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.682 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.682 DEBUG:boto:path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.682 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.682 DEBUG:boto:Method: GET 2024-04-16T18:08:52.683 DEBUG:boto:Path: /cjqttm-40/?prefix=obj6 2024-04-16T18:08:52.683 DEBUG:boto:Data: 2024-04-16T18:08:52.683 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.683 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.683 DEBUG:boto:Params: {} 2024-04-16T18:08:52.683 DEBUG:boto:Token: None 2024-04-16T18:08:52.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.685 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c8c7d1ba4a3ea37-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.686 DEBUG:boto:b'cjqttm-40obj61000falseobj62024-04-16T18:08:45.768Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.686 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:52.686 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.687 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.687 DEBUG:boto:path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.687 DEBUG:boto:auth_path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.687 DEBUG:boto:Method: GET 2024-04-16T18:08:52.687 DEBUG:boto:Path: /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.687 DEBUG:boto:Data: 2024-04-16T18:08:52.688 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.688 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.688 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.688 DEBUG:boto:Params: {} 2024-04-16T18:08:52.688 DEBUG:boto:Token: None 2024-04-16T18:08:52.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw= 2024-04-16T18:08:52.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw=', 'Content-Length': '0'} 2024-04-16T18:08:52.690 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000007589f18410781cf6-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.730 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.730 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.731 DEBUG:boto:path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.731 DEBUG:boto:auth_path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.731 DEBUG:boto:Method: GET 2024-04-16T18:08:52.731 DEBUG:boto:Path: /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.731 DEBUG:boto:Data: 2024-04-16T18:08:52.731 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.731 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.731 DEBUG:boto:Params: {} 2024-04-16T18:08:52.731 DEBUG:boto:Token: None 2024-04-16T18:08:52.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw= 2024-04-16T18:08:52.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw=', 'Content-Length': '0'} 2024-04-16T18:08:52.733 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000035366f8fbcd3a981-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.734 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.734 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.734 DEBUG:boto:path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.734 DEBUG:boto:auth_path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.734 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.734 DEBUG:boto:Path: /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.734 DEBUG:boto:Data: 2024-04-16T18:08:52.734 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.734 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.734 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.735 DEBUG:boto:Params: {} 2024-04-16T18:08:52.735 DEBUG:boto:Token: None 2024-04-16T18:08:52.735 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:puzhGne7xHY7w55a3AeGA+WAO/E= 2024-04-16T18:08:52.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:puzhGne7xHY7w55a3AeGA+WAO/E=', 'Content-Length': '0'} 2024-04-16T18:08:52.737 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e76b6c2f5d6d1218-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.737 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.737 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.737 DEBUG:boto:path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.737 DEBUG:boto:auth_path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.737 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.737 DEBUG:boto:Path: /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.738 DEBUG:boto:Data: 2024-04-16T18:08:52.738 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.738 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.738 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.738 DEBUG:boto:Params: {} 2024-04-16T18:08:52.738 DEBUG:boto:Token: None 2024-04-16T18:08:52.738 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.738 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:puzhGne7xHY7w55a3AeGA+WAO/E= 2024-04-16T18:08:52.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:puzhGne7xHY7w55a3AeGA+WAO/E=', 'Content-Length': '0'} 2024-04-16T18:08:52.740 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004921912550fb354d-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.740 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:52.741 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.741 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.741 DEBUG:boto:path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.741 DEBUG:boto:auth_path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.741 DEBUG:boto:Method: GET 2024-04-16T18:08:52.741 DEBUG:boto:Path: /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.741 DEBUG:boto:Data: 2024-04-16T18:08:52.741 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.741 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.741 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.741 DEBUG:boto:Params: {} 2024-04-16T18:08:52.741 DEBUG:boto:Token: None 2024-04-16T18:08:52.742 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.742 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw= 2024-04-16T18:08:52.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw=', 'Content-Length': '0'} 2024-04-16T18:08:52.744 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006e7d4d6d8ed923ba-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.786 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.787 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.787 DEBUG:boto:path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.787 DEBUG:boto:auth_path=/cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.787 DEBUG:boto:Method: GET 2024-04-16T18:08:52.787 DEBUG:boto:Path: /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.787 DEBUG:boto:Data: 2024-04-16T18:08:52.787 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.787 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.787 DEBUG:boto:Params: {} 2024-04-16T18:08:52.788 DEBUG:boto:Token: None 2024-04-16T18:08:52.788 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7?versionId=null 2024-04-16T18:08:52.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw= 2024-04-16T18:08:52.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PzEt4IidnzO0b0jecnIIILqtpPw=', 'Content-Length': '0'} 2024-04-16T18:08:52.790 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000002894bb37d6d00a3-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.790 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.790 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.790 DEBUG:boto:path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.790 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.791 DEBUG:boto:Method: GET 2024-04-16T18:08:52.791 DEBUG:boto:Path: /cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.791 DEBUG:boto:Data: 2024-04-16T18:08:52.791 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.791 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.791 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.791 DEBUG:boto:Params: {} 2024-04-16T18:08:52.791 DEBUG:boto:Token: None 2024-04-16T18:08:52.791 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.794 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f805d45aad6debb-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.794 DEBUG:boto:b'cjqttm-40obj71000falseobj72024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.794 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.794 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.795 DEBUG:boto:path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.795 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.795 DEBUG:boto:Method: GET 2024-04-16T18:08:52.795 DEBUG:boto:Path: /cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.795 DEBUG:boto:Data: 2024-04-16T18:08:52.795 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.795 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.795 DEBUG:boto:Params: {} 2024-04-16T18:08:52.795 DEBUG:boto:Token: None 2024-04-16T18:08:52.795 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.798 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d28cb09adb0dc643-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.798 DEBUG:boto:b'cjqttm-40obj71000falseobj72024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.798 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.798 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.799 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.799 DEBUG:boto:Path: /cjqttm-40/obj7 2024-04-16T18:08:52.799 DEBUG:boto:Data: 2024-04-16T18:08:52.799 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.799 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.799 DEBUG:boto:Params: {} 2024-04-16T18:08:52.799 DEBUG:boto:Token: None 2024-04-16T18:08:52.799 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7 2024-04-16T18:08:52.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DeeEkWoO4S7JAUukZ4ZX+JfC504= 2024-04-16T18:08:52.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DeeEkWoO4S7JAUukZ4ZX+JfC504=', 'Content-Length': '0'} 2024-04-16T18:08:52.801 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000067f486ea2dba7083-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.802 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.802 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.802 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.802 DEBUG:boto:Path: /cjqttm-40/obj7 2024-04-16T18:08:52.802 DEBUG:boto:Data: 2024-04-16T18:08:52.802 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.802 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.802 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.802 DEBUG:boto:Params: {} 2024-04-16T18:08:52.802 DEBUG:boto:Token: None 2024-04-16T18:08:52.803 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7 2024-04-16T18:08:52.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DeeEkWoO4S7JAUukZ4ZX+JfC504= 2024-04-16T18:08:52.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DeeEkWoO4S7JAUukZ4ZX+JfC504=', 'Content-Length': '0'} 2024-04-16T18:08:52.805 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000054f32f097f5ed2fa-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.805 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:52.805 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.805 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.805 DEBUG:boto:Method: GET 2024-04-16T18:08:52.805 DEBUG:boto:Path: /cjqttm-40/obj7 2024-04-16T18:08:52.805 DEBUG:boto:Data: 2024-04-16T18:08:52.806 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.806 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.806 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.806 DEBUG:boto:Params: {} 2024-04-16T18:08:52.806 DEBUG:boto:Token: None 2024-04-16T18:08:52.806 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7 2024-04-16T18:08:52.806 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QE5MiYUEy6bdpaOFLF6KIEGOBz8= 2024-04-16T18:08:52.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QE5MiYUEy6bdpaOFLF6KIEGOBz8=', 'Content-Length': '0'} 2024-04-16T18:08:52.808 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000045b3efec39ca6c4f-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.850 DEBUG:boto:path=/cjqttm-40/obj7 2024-04-16T18:08:52.850 DEBUG:boto:auth_path=/cjqttm-40/obj7 2024-04-16T18:08:52.851 DEBUG:boto:Method: GET 2024-04-16T18:08:52.851 DEBUG:boto:Path: /cjqttm-40/obj7 2024-04-16T18:08:52.851 DEBUG:boto:Data: 2024-04-16T18:08:52.851 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.851 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.851 DEBUG:boto:Params: {} 2024-04-16T18:08:52.851 DEBUG:boto:Token: None 2024-04-16T18:08:52.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj7 2024-04-16T18:08:52.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QE5MiYUEy6bdpaOFLF6KIEGOBz8= 2024-04-16T18:08:52.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QE5MiYUEy6bdpaOFLF6KIEGOBz8=', 'Content-Length': '0'} 2024-04-16T18:08:52.854 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000016777ecda46f2f3-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.854 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.854 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.854 DEBUG:boto:path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.854 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.854 DEBUG:boto:Method: GET 2024-04-16T18:08:52.855 DEBUG:boto:Path: /cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.855 DEBUG:boto:Data: 2024-04-16T18:08:52.855 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.855 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.855 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.855 DEBUG:boto:Params: {} 2024-04-16T18:08:52.855 DEBUG:boto:Token: None 2024-04-16T18:08:52.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a0542b196a874ec-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.858 DEBUG:boto:b'cjqttm-40obj71000falseobj72024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.858 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.858 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.859 DEBUG:boto:path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.859 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.859 DEBUG:boto:Method: GET 2024-04-16T18:08:52.859 DEBUG:boto:Path: /cjqttm-40/?prefix=obj7 2024-04-16T18:08:52.859 DEBUG:boto:Data: 2024-04-16T18:08:52.859 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.859 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.859 DEBUG:boto:Params: {} 2024-04-16T18:08:52.859 DEBUG:boto:Token: None 2024-04-16T18:08:52.860 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.863 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000448da7cd4dd1b52b-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.863 DEBUG:boto:b'cjqttm-40obj71000falseobj72024-04-16T18:08:45.777Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.863 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:52.863 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.863 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.863 DEBUG:boto:path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.864 DEBUG:boto:auth_path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.864 DEBUG:boto:Method: GET 2024-04-16T18:08:52.864 DEBUG:boto:Path: /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.864 DEBUG:boto:Data: 2024-04-16T18:08:52.864 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.864 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.864 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.864 DEBUG:boto:Params: {} 2024-04-16T18:08:52.864 DEBUG:boto:Token: None 2024-04-16T18:08:52.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw= 2024-04-16T18:08:52.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw=', 'Content-Length': '0'} 2024-04-16T18:08:52.866 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000289ddb7404ee787d-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.910 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.911 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.911 DEBUG:boto:path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.911 DEBUG:boto:auth_path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.911 DEBUG:boto:Method: GET 2024-04-16T18:08:52.911 DEBUG:boto:Path: /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.911 DEBUG:boto:Data: 2024-04-16T18:08:52.912 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.912 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.912 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.912 DEBUG:boto:Params: {} 2024-04-16T18:08:52.912 DEBUG:boto:Token: None 2024-04-16T18:08:52.913 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.913 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw= 2024-04-16T18:08:52.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw=', 'Content-Length': '0'} 2024-04-16T18:08:52.915 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000869b337dd4387063-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.915 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.916 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.916 DEBUG:boto:path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.916 DEBUG:boto:auth_path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.916 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.916 DEBUG:boto:Path: /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.916 DEBUG:boto:Data: 2024-04-16T18:08:52.917 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.917 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.917 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.917 DEBUG:boto:Params: {} 2024-04-16T18:08:52.917 DEBUG:boto:Token: None 2024-04-16T18:08:52.917 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.918 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cnHNZMufb1hHKYb+Ug4Ji8m2H8I= 2024-04-16T18:08:52.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cnHNZMufb1hHKYb+Ug4Ji8m2H8I=', 'Content-Length': '0'} 2024-04-16T18:08:52.920 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a5207ede5c52fcbc-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.920 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.920 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.921 DEBUG:boto:path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.921 DEBUG:boto:auth_path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.921 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.921 DEBUG:boto:Path: /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.921 DEBUG:boto:Data: 2024-04-16T18:08:52.922 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.922 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.922 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.922 DEBUG:boto:Params: {} 2024-04-16T18:08:52.923 DEBUG:boto:Token: None 2024-04-16T18:08:52.923 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cnHNZMufb1hHKYb+Ug4Ji8m2H8I= 2024-04-16T18:08:52.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cnHNZMufb1hHKYb+Ug4Ji8m2H8I=', 'Content-Length': '0'} 2024-04-16T18:08:52.925 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006736e4286ca05f52-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.925 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:52.925 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.925 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.926 DEBUG:boto:path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.926 DEBUG:boto:auth_path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.926 DEBUG:boto:Method: GET 2024-04-16T18:08:52.926 DEBUG:boto:Path: /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.926 DEBUG:boto:Data: 2024-04-16T18:08:52.926 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.926 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.926 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.926 DEBUG:boto:Params: {} 2024-04-16T18:08:52.926 DEBUG:boto:Token: None 2024-04-16T18:08:52.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw= 2024-04-16T18:08:52.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw=', 'Content-Length': '0'} 2024-04-16T18:08:52.929 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000039096fe750fe8d38-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.970 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.970 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.970 DEBUG:boto:path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.971 DEBUG:boto:auth_path=/cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.971 DEBUG:boto:Method: GET 2024-04-16T18:08:52.971 DEBUG:boto:Path: /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.971 DEBUG:boto:Data: 2024-04-16T18:08:52.971 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.971 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.971 DEBUG:boto:Params: {} 2024-04-16T18:08:52.971 DEBUG:boto:Token: None 2024-04-16T18:08:52.971 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8?versionId=null 2024-04-16T18:08:52.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw= 2024-04-16T18:08:52.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:scMWeeRf452DYibaMztm8IK9sFw=', 'Content-Length': '0'} 2024-04-16T18:08:52.973 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000df30d5ec81995149-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.974 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.974 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.974 DEBUG:boto:path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:52.974 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:52.974 DEBUG:boto:Method: GET 2024-04-16T18:08:52.974 DEBUG:boto:Path: /cjqttm-40/?prefix=obj8 2024-04-16T18:08:52.974 DEBUG:boto:Data: 2024-04-16T18:08:52.975 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.975 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.975 DEBUG:boto:Params: {} 2024-04-16T18:08:52.975 DEBUG:boto:Token: None 2024-04-16T18:08:52.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.977 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9edbfe647eee5f9-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.978 DEBUG:boto:b'cjqttm-40obj81000falseobj82024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.978 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:52.978 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:52.978 DEBUG:boto:path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:52.978 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:52.978 DEBUG:boto:Method: GET 2024-04-16T18:08:52.978 DEBUG:boto:Path: /cjqttm-40/?prefix=obj8 2024-04-16T18:08:52.979 DEBUG:boto:Data: 2024-04-16T18:08:52.979 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.979 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.979 DEBUG:boto:Params: {} 2024-04-16T18:08:52.979 DEBUG:boto:Token: None 2024-04-16T18:08:52.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/ 2024-04-16T18:08:52.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s= 2024-04-16T18:08:52.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aOpMaRw8Btg+G48XXme+fzcla0s=', 'Content-Length': '0'} 2024-04-16T18:08:52.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cfd27a05c74bbd65-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.982 DEBUG:boto:b'cjqttm-40obj81000falseobj82024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:52.982 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.982 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.982 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.982 DEBUG:boto:Path: /cjqttm-40/obj8 2024-04-16T18:08:52.983 DEBUG:boto:Data: 2024-04-16T18:08:52.983 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.983 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.983 DEBUG:boto:Params: {} 2024-04-16T18:08:52.983 DEBUG:boto:Token: None 2024-04-16T18:08:52.983 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8 2024-04-16T18:08:52.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WhP8htRtwOr3KFq6K7JRCG0nArc= 2024-04-16T18:08:52.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WhP8htRtwOr3KFq6K7JRCG0nArc=', 'Content-Length': '0'} 2024-04-16T18:08:52.985 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ce7ad7100b92bee8-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.985 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.985 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.986 DEBUG:boto:Method: HEAD 2024-04-16T18:08:52.986 DEBUG:boto:Path: /cjqttm-40/obj8 2024-04-16T18:08:52.986 DEBUG:boto:Data: 2024-04-16T18:08:52.986 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.986 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:52.986 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.986 DEBUG:boto:Params: {} 2024-04-16T18:08:52.986 DEBUG:boto:Token: None 2024-04-16T18:08:52.986 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8 2024-04-16T18:08:52.986 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WhP8htRtwOr3KFq6K7JRCG0nArc= 2024-04-16T18:08:52.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WhP8htRtwOr3KFq6K7JRCG0nArc=', 'Content-Length': '0'} 2024-04-16T18:08:52.988 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f4a7e3af220e2aac-00661ebeb4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:52.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:52.988 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:52.989 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:52.989 DEBUG:boto:Method: GET 2024-04-16T18:08:52.989 DEBUG:boto:Path: /cjqttm-40/obj8 2024-04-16T18:08:52.989 DEBUG:boto:Data: 2024-04-16T18:08:52.989 DEBUG:boto:Headers: {} 2024-04-16T18:08:52.989 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:52.989 DEBUG:boto:Port: 8000 2024-04-16T18:08:52.989 DEBUG:boto:Params: {} 2024-04-16T18:08:52.989 DEBUG:boto:Token: None 2024-04-16T18:08:52.989 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:52 GMT /cjqttm-40/obj8 2024-04-16T18:08:52.990 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MFRaN7H8GldEhikU9ukIto294n8= 2024-04-16T18:08:52.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MFRaN7H8GldEhikU9ukIto294n8=', 'Content-Length': '0'} 2024-04-16T18:08:52.992 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-40:9ba59572-f51c-4bce-9578-e6350e822996.4816.9'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:46 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000016d65bf64b06952-00661ebeb4-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.034 DEBUG:boto:path=/cjqttm-40/obj8 2024-04-16T18:08:53.034 DEBUG:boto:auth_path=/cjqttm-40/obj8 2024-04-16T18:08:53.035 DEBUG:boto:Method: GET 2024-04-16T18:08:53.035 DEBUG:boto:Path: /cjqttm-40/obj8 2024-04-16T18:08:53.035 DEBUG:boto:Data: 2024-04-16T18:08:53.035 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.035 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.035 DEBUG:boto:Params: {} 2024-04-16T18:08:53.035 DEBUG:boto:Token: None 2024-04-16T18:08:53.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-40/obj8 2024-04-16T18:08:53.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QsSBtaMpnaGICz7guSTdMnYjV1o= 2024-04-16T18:08:53.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QsSBtaMpnaGICz7guSTdMnYjV1o=', 'Content-Length': '0'} 2024-04-16T18:08:53.037 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e31729fbff31d1ea-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.038 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:53.038 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:53.038 DEBUG:boto:path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:53.038 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:53.038 DEBUG:boto:Method: GET 2024-04-16T18:08:53.038 DEBUG:boto:Path: /cjqttm-40/?prefix=obj8 2024-04-16T18:08:53.038 DEBUG:boto:Data: 2024-04-16T18:08:53.038 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.038 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.039 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.039 DEBUG:boto:Params: {} 2024-04-16T18:08:53.039 DEBUG:boto:Token: None 2024-04-16T18:08:53.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-40/ 2024-04-16T18:08:53.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wanG0XF5c2vgmO4y76b3doRepqA= 2024-04-16T18:08:53.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wanG0XF5c2vgmO4y76b3doRepqA=', 'Content-Length': '0'} 2024-04-16T18:08:53.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd5bbae96d2cf78a-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.042 DEBUG:boto:b'cjqttm-40obj81000falseobj82024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.042 DEBUG:boto:path=/cjqttm-40/ 2024-04-16T18:08:53.042 DEBUG:boto:auth_path=/cjqttm-40/ 2024-04-16T18:08:53.042 DEBUG:boto:path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:53.045 DEBUG:boto:auth_path=/cjqttm-40/?prefix=obj8 2024-04-16T18:08:53.045 DEBUG:boto:Method: GET 2024-04-16T18:08:53.045 DEBUG:boto:Path: /cjqttm-40/?prefix=obj8 2024-04-16T18:08:53.045 DEBUG:boto:Data: 2024-04-16T18:08:53.045 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.046 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.046 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.046 DEBUG:boto:Params: {} 2024-04-16T18:08:53.046 DEBUG:boto:Token: None 2024-04-16T18:08:53.046 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-40/ 2024-04-16T18:08:53.046 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wanG0XF5c2vgmO4y76b3doRepqA= 2024-04-16T18:08:53.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wanG0XF5c2vgmO4y76b3doRepqA=', 'Content-Length': '0'} 2024-04-16T18:08:53.049 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000072b85abd7fbaf13-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.049 DEBUG:boto:b'cjqttm-40obj81000falseobj82024-04-16T18:08:45.823Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.050 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-40 zones={test-zone2, test-zone1} 2024-04-16T18:08:53.050 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-41 2024-04-16T18:08:53.050 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:53.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:53.050 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-41 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:53.113 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:53.113 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:53.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:53.176+0000 7f5d32b2f800 1 bucket sync caught up with source: 2024-04-16T18:08:53.175 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000004.44.6, 00000000002.42.1, 00000000004.30.6, 00000000002.36.1, 00000000004.33.6, 00000000002.26.1, 00000000002.31.1, 00000000004.20.6, 00000000002.37.1, 00000000002.16.1, 00000000002.29.1] 2024-04-16T18:08:53.175 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000004.44.6, 00000000002.42.1, 00000000004.30.6, 00000000002.36.1, 00000000004.33.6, 00000000002.26.1, 00000000002.31.1, 00000000004.20.6, 00000000002.37.1, 00000000002.16.1, 00000000002.29.1] 2024-04-16T18:08:53.175 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:08:53.176+0000 7f5d32b2f800 0 bucket checkpoint complete 2024-04-16T18:08:53.195 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-41 2024-04-16T18:08:53.195 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:53.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-41', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:08:53.195 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-41 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:08:53.257 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:53.258 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:53.319 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:53.321+0000 7f467113b800 1 bucket sync caught up with source: 2024-04-16T18:08:53.320 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000004.1234.1, 00000000002.242.1, 00000000004.609.1, 00000000002.455.1, 00000000004.389.1, 00000000002.529.1, 00000000002.390.1, 00000000004.365.1, 00000000002.842.1, 00000000002.437.1, 00000000002.485.1] 2024-04-16T18:08:53.320 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000004.1234.1, 00000000002.242.1, 00000000004.609.1, 00000000002.455.1, 00000000004.389.1, 00000000002.529.1, 00000000002.390.1, 00000000004.365.1, 00000000002.842.1, 00000000002.437.1, 00000000002.485.1] 2024-04-16T18:08:53.320 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:08:53.321+0000 7f467113b800 0 bucket checkpoint complete 2024-04-16T18:08:53.342 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-41 zones={test-zone2, test-zone1} 2024-04-16T18:08:53.342 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.342 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.342 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.342 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:53.342 DEBUG:boto:Data: 2024-04-16T18:08:53.342 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.342 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.342 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.343 DEBUG:boto:Params: {} 2024-04-16T18:08:53.343 DEBUG:boto:Token: None 2024-04-16T18:08:53.343 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fDZOg0/GiP7PDOJ0ZVVcpuuaAFs= 2024-04-16T18:08:53.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fDZOg0/GiP7PDOJ0ZVVcpuuaAFs=', 'Content-Length': '0'} 2024-04-16T18:08:53.345 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e60fd6791b57a818-00661ebeb5-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.345 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.345 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.345 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.346 DEBUG:boto:Path: /cjqttm-41/ 2024-04-16T18:08:53.346 DEBUG:boto:Data: 2024-04-16T18:08:53.346 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.346 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.346 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.346 DEBUG:boto:Params: {} 2024-04-16T18:08:53.346 DEBUG:boto:Token: None 2024-04-16T18:08:53.346 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.346 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fDZOg0/GiP7PDOJ0ZVVcpuuaAFs= 2024-04-16T18:08:53.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fDZOg0/GiP7PDOJ0ZVVcpuuaAFs=', 'Content-Length': '0'} 2024-04-16T18:08:53.349 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000038f074728118fe4c-00661ebeb5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.349 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:08:53.349 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.349 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.349 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.349 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.349 DEBUG:boto:Method: GET 2024-04-16T18:08:53.349 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.350 DEBUG:boto:Data: 2024-04-16T18:08:53.350 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.350 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.350 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.350 DEBUG:boto:Params: {} 2024-04-16T18:08:53.350 DEBUG:boto:Token: None 2024-04-16T18:08:53.350 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/?versions 2024-04-16T18:08:53.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic= 2024-04-16T18:08:53.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic=', 'Content-Length': '0'} 2024-04-16T18:08:53.352 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7ea1c4ff62cef8e-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.353 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.353 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:53.353 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:53.353 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:53.354 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:53.354 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:53.354 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:53.354 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:53.354 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:53.354 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:08:53.354 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.354 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.354 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.354 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.355 DEBUG:boto:Method: GET 2024-04-16T18:08:53.355 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.355 DEBUG:boto:Data: 2024-04-16T18:08:53.355 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.355 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.355 DEBUG:boto:Params: {} 2024-04-16T18:08:53.355 DEBUG:boto:Token: None 2024-04-16T18:08:53.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/?versions 2024-04-16T18:08:53.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic= 2024-04-16T18:08:53.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic=', 'Content-Length': '0'} 2024-04-16T18:08:53.358 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000311542741127472c-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.358 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2024-04-16T18:08:53.359 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2024-04-16T18:08:53.359 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.359 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.360 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.360 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.360 DEBUG:boto:Method: GET 2024-04-16T18:08:53.360 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.360 DEBUG:boto:Data: 2024-04-16T18:08:53.360 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.360 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.360 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.360 DEBUG:boto:Params: {} 2024-04-16T18:08:53.360 DEBUG:boto:Token: None 2024-04-16T18:08:53.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/?versions 2024-04-16T18:08:53.361 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic= 2024-04-16T18:08:53.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic=', 'Content-Length': '0'} 2024-04-16T18:08:53.363 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042b5aa903ecc48a5-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.363 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.364 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.364 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.364 DEBUG:boto:path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.364 DEBUG:boto:auth_path=/cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.364 DEBUG:boto:Method: GET 2024-04-16T18:08:53.365 DEBUG:boto:Path: /cjqttm-41/?versions&max-keys=999 2024-04-16T18:08:53.365 DEBUG:boto:Data: 2024-04-16T18:08:53.365 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.365 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.365 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.365 DEBUG:boto:Params: {} 2024-04-16T18:08:53.365 DEBUG:boto:Token: None 2024-04-16T18:08:53.365 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/?versions 2024-04-16T18:08:53.365 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic= 2024-04-16T18:08:53.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I2hl84ce1OMKs/s6Vjah+hpmpic=', 'Content-Length': '0'} 2024-04-16T18:08:53.367 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000188b7100f322881d-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.368 DEBUG:boto:b'cjqttm-41999falseobj1nulltrue2024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj2nulltrue2024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj3nulltrue2024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj4nulltrue2024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj5nulltrue2024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj6nulltrue2024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj7nulltrue2024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normalobj8nulltrue2024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:53.368 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.368 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.369 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.369 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.369 DEBUG:boto:Method: GET 2024-04-16T18:08:53.369 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.369 DEBUG:boto:Data: 2024-04-16T18:08:53.369 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.369 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.369 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.369 DEBUG:boto:Params: {} 2024-04-16T18:08:53.369 DEBUG:boto:Token: None 2024-04-16T18:08:53.370 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.370 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno= 2024-04-16T18:08:53.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno=', 'Content-Length': '0'} 2024-04-16T18:08:53.371 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000573b7994a66a477-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.414 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.414 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.414 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.415 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.415 DEBUG:boto:Method: GET 2024-04-16T18:08:53.415 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.415 DEBUG:boto:Data: 2024-04-16T18:08:53.415 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.415 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.415 DEBUG:boto:Params: {} 2024-04-16T18:08:53.415 DEBUG:boto:Token: None 2024-04-16T18:08:53.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno= 2024-04-16T18:08:53.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno=', 'Content-Length': '0'} 2024-04-16T18:08:53.417 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004b0a1130d7b65ebb-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.418 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.418 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.418 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.418 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.418 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.418 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.418 DEBUG:boto:Data: 2024-04-16T18:08:53.418 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.418 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.418 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.419 DEBUG:boto:Params: {} 2024-04-16T18:08:53.419 DEBUG:boto:Token: None 2024-04-16T18:08:53.419 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fJzSXIYCgn7LlOEUVAlwRP4Y+0w= 2024-04-16T18:08:53.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fJzSXIYCgn7LlOEUVAlwRP4Y+0w=', 'Content-Length': '0'} 2024-04-16T18:08:53.421 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000be1769816dc4941b-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.421 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.421 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.421 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.421 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.421 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.422 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.422 DEBUG:boto:Data: 2024-04-16T18:08:53.422 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.422 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.422 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.422 DEBUG:boto:Params: {} 2024-04-16T18:08:53.422 DEBUG:boto:Token: None 2024-04-16T18:08:53.422 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.422 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fJzSXIYCgn7LlOEUVAlwRP4Y+0w= 2024-04-16T18:08:53.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fJzSXIYCgn7LlOEUVAlwRP4Y+0w=', 'Content-Length': '0'} 2024-04-16T18:08:53.424 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dbcb5f279a7e6b81-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:53.424 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.424 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.424 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.425 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.425 DEBUG:boto:Method: GET 2024-04-16T18:08:53.425 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.425 DEBUG:boto:Data: 2024-04-16T18:08:53.425 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.425 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.425 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.425 DEBUG:boto:Params: {} 2024-04-16T18:08:53.425 DEBUG:boto:Token: None 2024-04-16T18:08:53.425 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.426 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno= 2024-04-16T18:08:53.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno=', 'Content-Length': '0'} 2024-04-16T18:08:53.427 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000dd7e6ec7393f8fda-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.427 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.428 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.428 DEBUG:boto:path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.428 DEBUG:boto:auth_path=/cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.428 DEBUG:boto:Method: GET 2024-04-16T18:08:53.428 DEBUG:boto:Path: /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.428 DEBUG:boto:Data: 2024-04-16T18:08:53.428 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.428 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.428 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.428 DEBUG:boto:Params: {} 2024-04-16T18:08:53.428 DEBUG:boto:Token: None 2024-04-16T18:08:53.429 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1?versionId=null 2024-04-16T18:08:53.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno= 2024-04-16T18:08:53.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zcm+HnnOKMhiMgFekfQnx9GCKno=', 'Content-Length': '0'} 2024-04-16T18:08:53.430 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002476bdf04d856012-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.431 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.431 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.431 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.431 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.431 DEBUG:boto:Method: GET 2024-04-16T18:08:53.431 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.431 DEBUG:boto:Data: 2024-04-16T18:08:53.431 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.432 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.432 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.432 DEBUG:boto:Params: {} 2024-04-16T18:08:53.432 DEBUG:boto:Token: None 2024-04-16T18:08:53.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000486a063bafd79092-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.434 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.435 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.435 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.435 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.435 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.435 DEBUG:boto:Method: GET 2024-04-16T18:08:53.435 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.435 DEBUG:boto:Data: 2024-04-16T18:08:53.435 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.435 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.435 DEBUG:boto:Params: {} 2024-04-16T18:08:53.436 DEBUG:boto:Token: None 2024-04-16T18:08:53.436 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e499f86edea92bd-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.438 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.438 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.438 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.439 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.439 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:53.439 DEBUG:boto:Data: 2024-04-16T18:08:53.439 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.439 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.439 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.439 DEBUG:boto:Params: {} 2024-04-16T18:08:53.439 DEBUG:boto:Token: None 2024-04-16T18:08:53.439 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1 2024-04-16T18:08:53.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9NnOyvCkknwU5WtO9rWeipLRPYs= 2024-04-16T18:08:53.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9NnOyvCkknwU5WtO9rWeipLRPYs=', 'Content-Length': '0'} 2024-04-16T18:08:53.441 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f22fd8ccfdc95cd0-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.441 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.441 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.441 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.441 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:53.441 DEBUG:boto:Data: 2024-04-16T18:08:53.441 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.442 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.442 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.442 DEBUG:boto:Params: {} 2024-04-16T18:08:53.442 DEBUG:boto:Token: None 2024-04-16T18:08:53.442 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1 2024-04-16T18:08:53.442 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9NnOyvCkknwU5WtO9rWeipLRPYs= 2024-04-16T18:08:53.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9NnOyvCkknwU5WtO9rWeipLRPYs=', 'Content-Length': '0'} 2024-04-16T18:08:53.443 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000881ae26319a070c4-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.444 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2024-04-16T18:08:53.444 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.444 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.444 DEBUG:boto:Method: GET 2024-04-16T18:08:53.444 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:53.444 DEBUG:boto:Data: 2024-04-16T18:08:53.444 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.445 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.445 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.445 DEBUG:boto:Params: {} 2024-04-16T18:08:53.445 DEBUG:boto:Token: None 2024-04-16T18:08:53.445 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1 2024-04-16T18:08:53.445 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OAwGFJUf6huJJ/wzMYgJbd84ow8= 2024-04-16T18:08:53.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OAwGFJUf6huJJ/wzMYgJbd84ow8=', 'Content-Length': '0'} 2024-04-16T18:08:53.447 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006073cb43a27df730-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.447 DEBUG:boto:path=/cjqttm-41/obj1 2024-04-16T18:08:53.447 DEBUG:boto:auth_path=/cjqttm-41/obj1 2024-04-16T18:08:53.447 DEBUG:boto:Method: GET 2024-04-16T18:08:53.447 DEBUG:boto:Path: /cjqttm-41/obj1 2024-04-16T18:08:53.447 DEBUG:boto:Data: 2024-04-16T18:08:53.448 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.448 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.448 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.448 DEBUG:boto:Params: {} 2024-04-16T18:08:53.448 DEBUG:boto:Token: None 2024-04-16T18:08:53.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj1 2024-04-16T18:08:53.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OAwGFJUf6huJJ/wzMYgJbd84ow8= 2024-04-16T18:08:53.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OAwGFJUf6huJJ/wzMYgJbd84ow8=', 'Content-Length': '0'} 2024-04-16T18:08:53.450 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c2a027e6b6b9d440-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.490 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.490 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.491 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.491 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.491 DEBUG:boto:Method: GET 2024-04-16T18:08:53.491 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.491 DEBUG:boto:Data: 2024-04-16T18:08:53.491 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.491 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.491 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.491 DEBUG:boto:Params: {} 2024-04-16T18:08:53.491 DEBUG:boto:Token: None 2024-04-16T18:08:53.492 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000061be7d993b5745ba-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.494 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.494 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.495 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.495 DEBUG:boto:path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.495 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.495 DEBUG:boto:Method: GET 2024-04-16T18:08:53.495 DEBUG:boto:Path: /cjqttm-41/?prefix=obj1 2024-04-16T18:08:53.495 DEBUG:boto:Data: 2024-04-16T18:08:53.495 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.495 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.495 DEBUG:boto:Params: {} 2024-04-16T18:08:53.496 DEBUG:boto:Token: None 2024-04-16T18:08:53.496 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4b0fa324b33f739-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.498 DEBUG:boto:b'cjqttm-41obj11000falseobj12024-04-16T18:08:37.422Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.498 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:53.499 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.499 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.499 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.499 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.499 DEBUG:boto:Method: GET 2024-04-16T18:08:53.499 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.499 DEBUG:boto:Data: 2024-04-16T18:08:53.499 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.499 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.499 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.499 DEBUG:boto:Params: {} 2024-04-16T18:08:53.500 DEBUG:boto:Token: None 2024-04-16T18:08:53.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8= 2024-04-16T18:08:53.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8=', 'Content-Length': '0'} 2024-04-16T18:08:53.502 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e465cc7f1d15d61f-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.502 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.502 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.503 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.503 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.503 DEBUG:boto:Method: GET 2024-04-16T18:08:53.503 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.503 DEBUG:boto:Data: 2024-04-16T18:08:53.503 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.503 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.503 DEBUG:boto:Params: {} 2024-04-16T18:08:53.503 DEBUG:boto:Token: None 2024-04-16T18:08:53.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8= 2024-04-16T18:08:53.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8=', 'Content-Length': '0'} 2024-04-16T18:08:53.506 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000072ab7a286515c712-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.546 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.546 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.547 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.547 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.547 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.547 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.547 DEBUG:boto:Data: 2024-04-16T18:08:53.547 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.547 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.547 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.547 DEBUG:boto:Params: {} 2024-04-16T18:08:53.547 DEBUG:boto:Token: None 2024-04-16T18:08:53.547 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X0gREBayyyRyRl8e4n3OYO5KqGs= 2024-04-16T18:08:53.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X0gREBayyyRyRl8e4n3OYO5KqGs=', 'Content-Length': '0'} 2024-04-16T18:08:53.550 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d21fd9208953ccea-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.550 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.550 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.550 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.551 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.551 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.551 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.551 DEBUG:boto:Data: 2024-04-16T18:08:53.551 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.551 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.551 DEBUG:boto:Params: {} 2024-04-16T18:08:53.551 DEBUG:boto:Token: None 2024-04-16T18:08:53.551 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.551 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X0gREBayyyRyRl8e4n3OYO5KqGs= 2024-04-16T18:08:53.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X0gREBayyyRyRl8e4n3OYO5KqGs=', 'Content-Length': '0'} 2024-04-16T18:08:53.553 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000cf64e44413fc2ce0-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.554 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:53.554 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.554 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.554 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.554 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.554 DEBUG:boto:Method: GET 2024-04-16T18:08:53.554 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.555 DEBUG:boto:Data: 2024-04-16T18:08:53.555 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.555 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.555 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.555 DEBUG:boto:Params: {} 2024-04-16T18:08:53.555 DEBUG:boto:Token: None 2024-04-16T18:08:53.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8= 2024-04-16T18:08:53.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8=', 'Content-Length': '0'} 2024-04-16T18:08:53.557 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000044a259f96af9b9f8-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.558 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.558 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.558 DEBUG:boto:path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.558 DEBUG:boto:auth_path=/cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.558 DEBUG:boto:Method: GET 2024-04-16T18:08:53.558 DEBUG:boto:Path: /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.558 DEBUG:boto:Data: 2024-04-16T18:08:53.558 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.558 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.558 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.559 DEBUG:boto:Params: {} 2024-04-16T18:08:53.559 DEBUG:boto:Token: None 2024-04-16T18:08:53.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2?versionId=null 2024-04-16T18:08:53.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8= 2024-04-16T18:08:53.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ck5ssvLS7Eibpz3qlCk/45CLgd8=', 'Content-Length': '0'} 2024-04-16T18:08:53.561 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f8a371a9826c68ab-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.602 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.603 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.603 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.603 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.603 DEBUG:boto:Method: GET 2024-04-16T18:08:53.603 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.603 DEBUG:boto:Data: 2024-04-16T18:08:53.603 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.603 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.603 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.603 DEBUG:boto:Params: {} 2024-04-16T18:08:53.604 DEBUG:boto:Token: None 2024-04-16T18:08:53.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.606 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af6e55062b6966de-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.606 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.606 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.606 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.606 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.607 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.607 DEBUG:boto:Method: GET 2024-04-16T18:08:53.607 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.607 DEBUG:boto:Data: 2024-04-16T18:08:53.607 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.607 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.607 DEBUG:boto:Params: {} 2024-04-16T18:08:53.607 DEBUG:boto:Token: None 2024-04-16T18:08:53.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.609 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c9344379e7ccc56-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.610 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.610 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.610 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.610 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.610 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:53.610 DEBUG:boto:Data: 2024-04-16T18:08:53.611 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.611 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.611 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.611 DEBUG:boto:Params: {} 2024-04-16T18:08:53.611 DEBUG:boto:Token: None 2024-04-16T18:08:53.611 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2 2024-04-16T18:08:53.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5gUVN8DmIW7dNjyQegis54ao8J8= 2024-04-16T18:08:53.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5gUVN8DmIW7dNjyQegis54ao8J8=', 'Content-Length': '0'} 2024-04-16T18:08:53.613 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000039ce6f6cd8b1bb19-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.613 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.613 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.613 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.613 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:53.613 DEBUG:boto:Data: 2024-04-16T18:08:53.614 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.614 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.614 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.614 DEBUG:boto:Params: {} 2024-04-16T18:08:53.614 DEBUG:boto:Token: None 2024-04-16T18:08:53.614 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2 2024-04-16T18:08:53.614 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5gUVN8DmIW7dNjyQegis54ao8J8= 2024-04-16T18:08:53.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5gUVN8DmIW7dNjyQegis54ao8J8=', 'Content-Length': '0'} 2024-04-16T18:08:53.616 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f83c6267a7d37ad3-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2024-04-16T18:08:53.617 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.617 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.617 DEBUG:boto:Method: GET 2024-04-16T18:08:53.617 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:53.617 DEBUG:boto:Data: 2024-04-16T18:08:53.617 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.617 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.617 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.617 DEBUG:boto:Params: {} 2024-04-16T18:08:53.617 DEBUG:boto:Token: None 2024-04-16T18:08:53.617 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2 2024-04-16T18:08:53.618 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3r4I0BOic7lQV9Q0VhY6kL4ljUI= 2024-04-16T18:08:53.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3r4I0BOic7lQV9Q0VhY6kL4ljUI=', 'Content-Length': '0'} 2024-04-16T18:08:53.620 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000353fa7f4f759a5bc-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.620 DEBUG:boto:path=/cjqttm-41/obj2 2024-04-16T18:08:53.620 DEBUG:boto:auth_path=/cjqttm-41/obj2 2024-04-16T18:08:53.620 DEBUG:boto:Method: GET 2024-04-16T18:08:53.620 DEBUG:boto:Path: /cjqttm-41/obj2 2024-04-16T18:08:53.620 DEBUG:boto:Data: 2024-04-16T18:08:53.620 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.621 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.621 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.621 DEBUG:boto:Params: {} 2024-04-16T18:08:53.621 DEBUG:boto:Token: None 2024-04-16T18:08:53.621 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj2 2024-04-16T18:08:53.621 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3r4I0BOic7lQV9Q0VhY6kL4ljUI= 2024-04-16T18:08:53.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3r4I0BOic7lQV9Q0VhY6kL4ljUI=', 'Content-Length': '0'} 2024-04-16T18:08:53.623 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000425d2e96ddc7c5ab-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.666 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.666 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.667 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.667 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.667 DEBUG:boto:Method: GET 2024-04-16T18:08:53.667 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.667 DEBUG:boto:Data: 2024-04-16T18:08:53.667 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.667 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.667 DEBUG:boto:Params: {} 2024-04-16T18:08:53.667 DEBUG:boto:Token: None 2024-04-16T18:08:53.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f53a37fdada31f8-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.670 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.670 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.670 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.670 DEBUG:boto:path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.670 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.671 DEBUG:boto:Method: GET 2024-04-16T18:08:53.671 DEBUG:boto:Path: /cjqttm-41/?prefix=obj2 2024-04-16T18:08:53.671 DEBUG:boto:Data: 2024-04-16T18:08:53.671 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.671 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.671 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.671 DEBUG:boto:Params: {} 2024-04-16T18:08:53.671 DEBUG:boto:Token: None 2024-04-16T18:08:53.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023b284ca2b8e684d-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.673 DEBUG:boto:b'cjqttm-41obj21000falseobj22024-04-16T18:08:37.433Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:53.674 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.674 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.674 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.674 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.674 DEBUG:boto:Method: GET 2024-04-16T18:08:53.674 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.674 DEBUG:boto:Data: 2024-04-16T18:08:53.674 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.674 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.674 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.675 DEBUG:boto:Params: {} 2024-04-16T18:08:53.675 DEBUG:boto:Token: None 2024-04-16T18:08:53.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo= 2024-04-16T18:08:53.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo=', 'Content-Length': '0'} 2024-04-16T18:08:53.677 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008d4630b9c13b5e92-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.677 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.678 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.678 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.678 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.678 DEBUG:boto:Method: GET 2024-04-16T18:08:53.678 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.678 DEBUG:boto:Data: 2024-04-16T18:08:53.678 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.678 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.678 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.678 DEBUG:boto:Params: {} 2024-04-16T18:08:53.678 DEBUG:boto:Token: None 2024-04-16T18:08:53.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo= 2024-04-16T18:08:53.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo=', 'Content-Length': '0'} 2024-04-16T18:08:53.681 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005d4d9b2b2ed78360-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.722 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.723 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.723 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.723 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.723 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.723 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.723 DEBUG:boto:Data: 2024-04-16T18:08:53.723 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.723 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.723 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.723 DEBUG:boto:Params: {} 2024-04-16T18:08:53.724 DEBUG:boto:Token: None 2024-04-16T18:08:53.724 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mdzKHegkI9Kg9B4UBDa7h31LERI= 2024-04-16T18:08:53.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mdzKHegkI9Kg9B4UBDa7h31LERI=', 'Content-Length': '0'} 2024-04-16T18:08:53.726 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000075ab518cae427ab3-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.726 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.726 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.727 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.727 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.727 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.727 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.727 DEBUG:boto:Data: 2024-04-16T18:08:53.727 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.727 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.727 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.727 DEBUG:boto:Params: {} 2024-04-16T18:08:53.727 DEBUG:boto:Token: None 2024-04-16T18:08:53.728 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mdzKHegkI9Kg9B4UBDa7h31LERI= 2024-04-16T18:08:53.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mdzKHegkI9Kg9B4UBDa7h31LERI=', 'Content-Length': '0'} 2024-04-16T18:08:53.730 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005302b2b9603df1dd-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:53.730 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.730 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.730 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.731 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.731 DEBUG:boto:Method: GET 2024-04-16T18:08:53.731 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.731 DEBUG:boto:Data: 2024-04-16T18:08:53.731 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.731 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.731 DEBUG:boto:Params: {} 2024-04-16T18:08:53.731 DEBUG:boto:Token: None 2024-04-16T18:08:53.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo= 2024-04-16T18:08:53.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo=', 'Content-Length': '0'} 2024-04-16T18:08:53.734 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000021cb4c6d4ce08477-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.734 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.734 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.734 DEBUG:boto:path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.734 DEBUG:boto:auth_path=/cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.735 DEBUG:boto:Method: GET 2024-04-16T18:08:53.735 DEBUG:boto:Path: /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.735 DEBUG:boto:Data: 2024-04-16T18:08:53.735 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.735 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.735 DEBUG:boto:Params: {} 2024-04-16T18:08:53.735 DEBUG:boto:Token: None 2024-04-16T18:08:53.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3?versionId=null 2024-04-16T18:08:53.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo= 2024-04-16T18:08:53.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lzd0ewW2suuBbz6yxNktAFrg+qo=', 'Content-Length': '0'} 2024-04-16T18:08:53.738 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c22eabb0835c4a30-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.778 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.779 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.779 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.779 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.779 DEBUG:boto:Method: GET 2024-04-16T18:08:53.779 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.779 DEBUG:boto:Data: 2024-04-16T18:08:53.779 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.779 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.779 DEBUG:boto:Params: {} 2024-04-16T18:08:53.780 DEBUG:boto:Token: None 2024-04-16T18:08:53.780 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040bfbfd3d697f6a5-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.782 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.783 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.783 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.783 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.783 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.783 DEBUG:boto:Method: GET 2024-04-16T18:08:53.783 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.783 DEBUG:boto:Data: 2024-04-16T18:08:53.783 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.783 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.784 DEBUG:boto:Params: {} 2024-04-16T18:08:53.784 DEBUG:boto:Token: None 2024-04-16T18:08:53.784 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.786 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d43e6b244ae2103f-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.786 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.787 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.787 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.787 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.787 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:53.787 DEBUG:boto:Data: 2024-04-16T18:08:53.787 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.787 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.787 DEBUG:boto:Params: {} 2024-04-16T18:08:53.788 DEBUG:boto:Token: None 2024-04-16T18:08:53.788 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3 2024-04-16T18:08:53.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZ3KJc7NR6J0H9p3IOhhWz1b3Yk= 2024-04-16T18:08:53.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZ3KJc7NR6J0H9p3IOhhWz1b3Yk=', 'Content-Length': '0'} 2024-04-16T18:08:53.790 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002f828bed09576d89-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.790 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.790 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.790 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.791 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:53.791 DEBUG:boto:Data: 2024-04-16T18:08:53.791 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.791 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.791 DEBUG:boto:Params: {} 2024-04-16T18:08:53.791 DEBUG:boto:Token: None 2024-04-16T18:08:53.791 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3 2024-04-16T18:08:53.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZ3KJc7NR6J0H9p3IOhhWz1b3Yk= 2024-04-16T18:08:53.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZ3KJc7NR6J0H9p3IOhhWz1b3Yk=', 'Content-Length': '0'} 2024-04-16T18:08:53.794 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bb313cc8ce593a4d-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.794 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2024-04-16T18:08:53.794 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.794 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.794 DEBUG:boto:Method: GET 2024-04-16T18:08:53.794 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:53.795 DEBUG:boto:Data: 2024-04-16T18:08:53.795 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.795 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.795 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.795 DEBUG:boto:Params: {} 2024-04-16T18:08:53.795 DEBUG:boto:Token: None 2024-04-16T18:08:53.795 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3 2024-04-16T18:08:53.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A+hDTq9clk93P4hoMRbxbGTGQhQ= 2024-04-16T18:08:53.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A+hDTq9clk93P4hoMRbxbGTGQhQ=', 'Content-Length': '0'} 2024-04-16T18:08:53.797 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003fa59feca6b74617-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.797 DEBUG:boto:path=/cjqttm-41/obj3 2024-04-16T18:08:53.798 DEBUG:boto:auth_path=/cjqttm-41/obj3 2024-04-16T18:08:53.798 DEBUG:boto:Method: GET 2024-04-16T18:08:53.798 DEBUG:boto:Path: /cjqttm-41/obj3 2024-04-16T18:08:53.798 DEBUG:boto:Data: 2024-04-16T18:08:53.798 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.798 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.798 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.798 DEBUG:boto:Params: {} 2024-04-16T18:08:53.798 DEBUG:boto:Token: None 2024-04-16T18:08:53.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj3 2024-04-16T18:08:53.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A+hDTq9clk93P4hoMRbxbGTGQhQ= 2024-04-16T18:08:53.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A+hDTq9clk93P4hoMRbxbGTGQhQ=', 'Content-Length': '0'} 2024-04-16T18:08:53.801 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000bec32bbd03cea93-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.842 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.842 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.843 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.843 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.843 DEBUG:boto:Method: GET 2024-04-16T18:08:53.843 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.843 DEBUG:boto:Data: 2024-04-16T18:08:53.843 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.843 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.843 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.843 DEBUG:boto:Params: {} 2024-04-16T18:08:53.843 DEBUG:boto:Token: None 2024-04-16T18:08:53.844 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.846 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000442eae4718ae020e-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.846 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.847 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.847 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.847 DEBUG:boto:path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.847 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.847 DEBUG:boto:Method: GET 2024-04-16T18:08:53.847 DEBUG:boto:Path: /cjqttm-41/?prefix=obj3 2024-04-16T18:08:53.847 DEBUG:boto:Data: 2024-04-16T18:08:53.847 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.847 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.848 DEBUG:boto:Params: {} 2024-04-16T18:08:53.848 DEBUG:boto:Token: None 2024-04-16T18:08:53.848 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:53.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:53.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:53.850 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048a751401ef28d9e-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.890 DEBUG:boto:b'cjqttm-41obj31000falseobj32024-04-16T18:08:37.483Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:53.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:53.891 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:53.891 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:53.891 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.891 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.891 DEBUG:boto:Method: GET 2024-04-16T18:08:53.891 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.891 DEBUG:boto:Data: 2024-04-16T18:08:53.891 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.892 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.892 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.892 DEBUG:boto:Params: {} 2024-04-16T18:08:53.892 DEBUG:boto:Token: None 2024-04-16T18:08:53.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg= 2024-04-16T18:08:53.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg=', 'Content-Length': '0'} 2024-04-16T18:08:53.894 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000a59c8213f5d08cd8-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.894 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:53.895 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:53.895 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.895 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.895 DEBUG:boto:Method: GET 2024-04-16T18:08:53.895 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.895 DEBUG:boto:Data: 2024-04-16T18:08:53.895 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.895 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.895 DEBUG:boto:Params: {} 2024-04-16T18:08:53.895 DEBUG:boto:Token: None 2024-04-16T18:08:53.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg= 2024-04-16T18:08:53.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg=', 'Content-Length': '0'} 2024-04-16T18:08:53.898 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002fb5ccf4526f1069-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.942 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:53.943 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:53.943 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.943 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.943 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.943 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.943 DEBUG:boto:Data: 2024-04-16T18:08:53.943 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.943 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.943 DEBUG:boto:Params: {} 2024-04-16T18:08:53.944 DEBUG:boto:Token: None 2024-04-16T18:08:53.944 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IcMEz0WstJw/eOT0YunEh49Hzyo= 2024-04-16T18:08:53.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IcMEz0WstJw/eOT0YunEh49Hzyo=', 'Content-Length': '0'} 2024-04-16T18:08:53.946 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003e0ac6b772ce1a7a-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.946 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:53.946 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:53.946 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.946 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.946 DEBUG:boto:Method: HEAD 2024-04-16T18:08:53.946 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.947 DEBUG:boto:Data: 2024-04-16T18:08:53.947 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.947 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.947 DEBUG:boto:Params: {} 2024-04-16T18:08:53.947 DEBUG:boto:Token: None 2024-04-16T18:08:53.947 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IcMEz0WstJw/eOT0YunEh49Hzyo= 2024-04-16T18:08:53.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IcMEz0WstJw/eOT0YunEh49Hzyo=', 'Content-Length': '0'} 2024-04-16T18:08:53.950 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000726424b6cfbdff7a-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.950 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:53.950 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:53.950 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:53.950 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.950 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.950 DEBUG:boto:Method: GET 2024-04-16T18:08:53.951 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.951 DEBUG:boto:Data: 2024-04-16T18:08:53.951 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.951 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.951 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.951 DEBUG:boto:Params: {} 2024-04-16T18:08:53.951 DEBUG:boto:Token: None 2024-04-16T18:08:53.951 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg= 2024-04-16T18:08:53.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg=', 'Content-Length': '0'} 2024-04-16T18:08:53.953 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000e6cf8816eaa6a61-00661ebeb5-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.953 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:53.953 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:53.954 DEBUG:boto:path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.954 DEBUG:boto:auth_path=/cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.954 DEBUG:boto:Method: GET 2024-04-16T18:08:53.954 DEBUG:boto:Path: /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.954 DEBUG:boto:Data: 2024-04-16T18:08:53.954 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.954 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:53.954 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.954 DEBUG:boto:Params: {} 2024-04-16T18:08:53.954 DEBUG:boto:Token: None 2024-04-16T18:08:53.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/obj4?versionId=null 2024-04-16T18:08:53.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg= 2024-04-16T18:08:53.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JmV+kvERkmXGL+WrYpC1Nxjm6lg=', 'Content-Length': '0'} 2024-04-16T18:08:53.956 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002d48d1695a3636be-00661ebeb5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:53.998 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:53.998 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:53.999 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:53.999 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:53.999 DEBUG:boto:Method: GET 2024-04-16T18:08:53.999 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:53.999 DEBUG:boto:Data: 2024-04-16T18:08:53.999 DEBUG:boto:Headers: {} 2024-04-16T18:08:53.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:53.999 DEBUG:boto:Port: 8000 2024-04-16T18:08:53.999 DEBUG:boto:Params: {} 2024-04-16T18:08:53.999 DEBUG:boto:Token: None 2024-04-16T18:08:53.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:53 GMT /cjqttm-41/ 2024-04-16T18:08:54.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U= 2024-04-16T18:08:54.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5LMd43NPOaWoX8UkkqiaCK7Br7U=', 'Content-Length': '0'} 2024-04-16T18:08:54.001 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dbdfe462a09a1fa4-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.002 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.002 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.002 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.002 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.003 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.003 DEBUG:boto:Method: GET 2024-04-16T18:08:54.003 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.003 DEBUG:boto:Data: 2024-04-16T18:08:54.003 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.003 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.003 DEBUG:boto:Params: {} 2024-04-16T18:08:54.003 DEBUG:boto:Token: None 2024-04-16T18:08:54.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.006 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a4d6bb77880c8a4-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.046 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.047 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:54.047 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:54.047 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.047 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:54.047 DEBUG:boto:Data: 2024-04-16T18:08:54.047 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.047 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.047 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.047 DEBUG:boto:Params: {} 2024-04-16T18:08:54.047 DEBUG:boto:Token: None 2024-04-16T18:08:54.048 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj4 2024-04-16T18:08:54.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QEzvFHXwg+oP5HdLxMW7zZDErlU= 2024-04-16T18:08:54.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QEzvFHXwg+oP5HdLxMW7zZDErlU=', 'Content-Length': '0'} 2024-04-16T18:08:54.050 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006449147362987159-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.050 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:54.050 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:54.050 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.050 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:54.050 DEBUG:boto:Data: 2024-04-16T18:08:54.051 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.051 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.051 DEBUG:boto:Params: {} 2024-04-16T18:08:54.051 DEBUG:boto:Token: None 2024-04-16T18:08:54.051 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj4 2024-04-16T18:08:54.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QEzvFHXwg+oP5HdLxMW7zZDErlU= 2024-04-16T18:08:54.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QEzvFHXwg+oP5HdLxMW7zZDErlU=', 'Content-Length': '0'} 2024-04-16T18:08:54.053 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001fbfbfa8cc814411-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.053 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2024-04-16T18:08:54.053 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:54.053 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:54.054 DEBUG:boto:Method: GET 2024-04-16T18:08:54.054 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:54.054 DEBUG:boto:Data: 2024-04-16T18:08:54.054 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.054 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.054 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.054 DEBUG:boto:Params: {} 2024-04-16T18:08:54.054 DEBUG:boto:Token: None 2024-04-16T18:08:54.054 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj4 2024-04-16T18:08:54.054 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L/JCGiamBCZwtDxjRYD6fiMwNSY= 2024-04-16T18:08:54.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L/JCGiamBCZwtDxjRYD6fiMwNSY=', 'Content-Length': '0'} 2024-04-16T18:08:54.056 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000006fccaa6d0c60c56d-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.057 DEBUG:boto:path=/cjqttm-41/obj4 2024-04-16T18:08:54.057 DEBUG:boto:auth_path=/cjqttm-41/obj4 2024-04-16T18:08:54.057 DEBUG:boto:Method: GET 2024-04-16T18:08:54.057 DEBUG:boto:Path: /cjqttm-41/obj4 2024-04-16T18:08:54.057 DEBUG:boto:Data: 2024-04-16T18:08:54.057 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.057 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.057 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.058 DEBUG:boto:Params: {} 2024-04-16T18:08:54.058 DEBUG:boto:Token: None 2024-04-16T18:08:54.058 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj4 2024-04-16T18:08:54.058 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L/JCGiamBCZwtDxjRYD6fiMwNSY= 2024-04-16T18:08:54.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L/JCGiamBCZwtDxjRYD6fiMwNSY=', 'Content-Length': '0'} 2024-04-16T18:08:54.060 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:39 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000377fc2286b49956e-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.102 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.102 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.103 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.103 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.103 DEBUG:boto:Method: GET 2024-04-16T18:08:54.103 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.103 DEBUG:boto:Data: 2024-04-16T18:08:54.103 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.103 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.103 DEBUG:boto:Params: {} 2024-04-16T18:08:54.103 DEBUG:boto:Token: None 2024-04-16T18:08:54.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b68cfcb66a1538b1-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.106 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.106 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.106 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.107 DEBUG:boto:path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.107 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.107 DEBUG:boto:Method: GET 2024-04-16T18:08:54.107 DEBUG:boto:Path: /cjqttm-41/?prefix=obj4 2024-04-16T18:08:54.107 DEBUG:boto:Data: 2024-04-16T18:08:54.107 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.107 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.107 DEBUG:boto:Params: {} 2024-04-16T18:08:54.107 DEBUG:boto:Token: None 2024-04-16T18:08:54.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.110 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c240e2ef5ae53dd3-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.110 DEBUG:boto:b'cjqttm-41obj41000falseobj42024-04-16T18:08:37.494Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.110 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:54.111 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.111 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.111 DEBUG:boto:path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.111 DEBUG:boto:auth_path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.111 DEBUG:boto:Method: GET 2024-04-16T18:08:54.111 DEBUG:boto:Path: /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.111 DEBUG:boto:Data: 2024-04-16T18:08:54.111 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.111 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.111 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.111 DEBUG:boto:Params: {} 2024-04-16T18:08:54.111 DEBUG:boto:Token: None 2024-04-16T18:08:54.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes= 2024-04-16T18:08:54.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes=', 'Content-Length': '0'} 2024-04-16T18:08:54.114 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ad2dae6f6f7a398e-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.114 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.115 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.115 DEBUG:boto:path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.115 DEBUG:boto:auth_path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.115 DEBUG:boto:Method: GET 2024-04-16T18:08:54.115 DEBUG:boto:Path: /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.115 DEBUG:boto:Data: 2024-04-16T18:08:54.115 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.115 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.115 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.115 DEBUG:boto:Params: {} 2024-04-16T18:08:54.115 DEBUG:boto:Token: None 2024-04-16T18:08:54.116 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes= 2024-04-16T18:08:54.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes=', 'Content-Length': '0'} 2024-04-16T18:08:54.118 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000860f265d81054494-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.158 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.159 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.159 DEBUG:boto:path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.159 DEBUG:boto:auth_path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.159 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.159 DEBUG:boto:Path: /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.159 DEBUG:boto:Data: 2024-04-16T18:08:54.159 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.159 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.159 DEBUG:boto:Params: {} 2024-04-16T18:08:54.160 DEBUG:boto:Token: None 2024-04-16T18:08:54.160 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t/O37UyryNk1U8/Is6CXIXKOok0= 2024-04-16T18:08:54.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t/O37UyryNk1U8/Is6CXIXKOok0=', 'Content-Length': '0'} 2024-04-16T18:08:54.162 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000e717c46af665471b-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.162 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.162 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.162 DEBUG:boto:path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.162 DEBUG:boto:auth_path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.162 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.163 DEBUG:boto:Path: /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.163 DEBUG:boto:Data: 2024-04-16T18:08:54.163 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.163 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.163 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.163 DEBUG:boto:Params: {} 2024-04-16T18:08:54.163 DEBUG:boto:Token: None 2024-04-16T18:08:54.163 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t/O37UyryNk1U8/Is6CXIXKOok0= 2024-04-16T18:08:54.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t/O37UyryNk1U8/Is6CXIXKOok0=', 'Content-Length': '0'} 2024-04-16T18:08:54.165 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000193ad37d653ab64e-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.166 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:54.166 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.166 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.166 DEBUG:boto:path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.166 DEBUG:boto:auth_path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.166 DEBUG:boto:Method: GET 2024-04-16T18:08:54.166 DEBUG:boto:Path: /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.166 DEBUG:boto:Data: 2024-04-16T18:08:54.166 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.167 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.167 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.167 DEBUG:boto:Params: {} 2024-04-16T18:08:54.167 DEBUG:boto:Token: None 2024-04-16T18:08:54.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes= 2024-04-16T18:08:54.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes=', 'Content-Length': '0'} 2024-04-16T18:08:54.169 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000956431ff748e9722-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.169 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.169 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.170 DEBUG:boto:path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.170 DEBUG:boto:auth_path=/cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.170 DEBUG:boto:Method: GET 2024-04-16T18:08:54.170 DEBUG:boto:Path: /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.170 DEBUG:boto:Data: 2024-04-16T18:08:54.170 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.170 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.170 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.170 DEBUG:boto:Params: {} 2024-04-16T18:08:54.170 DEBUG:boto:Token: None 2024-04-16T18:08:54.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5?versionId=null 2024-04-16T18:08:54.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes= 2024-04-16T18:08:54.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FD0Lgh7Ltu7j6fEw4Ep0rwHdoes=', 'Content-Length': '0'} 2024-04-16T18:08:54.172 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000008e4dea65817a0f59-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.214 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.215 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.215 DEBUG:boto:path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.215 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.215 DEBUG:boto:Method: GET 2024-04-16T18:08:54.215 DEBUG:boto:Path: /cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.215 DEBUG:boto:Data: 2024-04-16T18:08:54.215 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.215 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.215 DEBUG:boto:Params: {} 2024-04-16T18:08:54.215 DEBUG:boto:Token: None 2024-04-16T18:08:54.216 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.218 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f1020c8fb721fad-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.218 DEBUG:boto:b'cjqttm-41obj51000falseobj52024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.218 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.218 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.219 DEBUG:boto:path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.219 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.219 DEBUG:boto:Method: GET 2024-04-16T18:08:54.219 DEBUG:boto:Path: /cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.219 DEBUG:boto:Data: 2024-04-16T18:08:54.219 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.219 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.219 DEBUG:boto:Params: {} 2024-04-16T18:08:54.219 DEBUG:boto:Token: None 2024-04-16T18:08:54.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.222 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000444bad3ff7892126-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.222 DEBUG:boto:b'cjqttm-41obj51000falseobj52024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.223 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.223 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.223 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.223 DEBUG:boto:Path: /cjqttm-41/obj5 2024-04-16T18:08:54.223 DEBUG:boto:Data: 2024-04-16T18:08:54.223 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.223 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.223 DEBUG:boto:Params: {} 2024-04-16T18:08:54.223 DEBUG:boto:Token: None 2024-04-16T18:08:54.224 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5 2024-04-16T18:08:54.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:peUXRqY/9aX5nXo2cLk/IpFlu0E= 2024-04-16T18:08:54.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:peUXRqY/9aX5nXo2cLk/IpFlu0E=', 'Content-Length': '0'} 2024-04-16T18:08:54.226 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000046390034f7967cf2-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.226 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.226 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.227 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.227 DEBUG:boto:Path: /cjqttm-41/obj5 2024-04-16T18:08:54.227 DEBUG:boto:Data: 2024-04-16T18:08:54.227 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.227 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.227 DEBUG:boto:Params: {} 2024-04-16T18:08:54.227 DEBUG:boto:Token: None 2024-04-16T18:08:54.227 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5 2024-04-16T18:08:54.227 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:peUXRqY/9aX5nXo2cLk/IpFlu0E= 2024-04-16T18:08:54.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:peUXRqY/9aX5nXo2cLk/IpFlu0E=', 'Content-Length': '0'} 2024-04-16T18:08:54.229 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000828230495859a182-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.230 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2024-04-16T18:08:54.230 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.230 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.230 DEBUG:boto:Method: GET 2024-04-16T18:08:54.230 DEBUG:boto:Path: /cjqttm-41/obj5 2024-04-16T18:08:54.230 DEBUG:boto:Data: 2024-04-16T18:08:54.230 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.230 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.230 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.231 DEBUG:boto:Params: {} 2024-04-16T18:08:54.231 DEBUG:boto:Token: None 2024-04-16T18:08:54.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5 2024-04-16T18:08:54.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UhwzAGzK6+agLc56E9mDGn34DSE= 2024-04-16T18:08:54.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UhwzAGzK6+agLc56E9mDGn34DSE=', 'Content-Length': '0'} 2024-04-16T18:08:54.233 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f533742735539791-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.233 DEBUG:boto:path=/cjqttm-41/obj5 2024-04-16T18:08:54.233 DEBUG:boto:auth_path=/cjqttm-41/obj5 2024-04-16T18:08:54.233 DEBUG:boto:Method: GET 2024-04-16T18:08:54.233 DEBUG:boto:Path: /cjqttm-41/obj5 2024-04-16T18:08:54.233 DEBUG:boto:Data: 2024-04-16T18:08:54.233 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.233 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.234 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.234 DEBUG:boto:Params: {} 2024-04-16T18:08:54.234 DEBUG:boto:Token: None 2024-04-16T18:08:54.234 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj5 2024-04-16T18:08:54.234 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UhwzAGzK6+agLc56E9mDGn34DSE= 2024-04-16T18:08:54.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UhwzAGzK6+agLc56E9mDGn34DSE=', 'Content-Length': '0'} 2024-04-16T18:08:54.236 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002958c0275dfc6fa0-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.278 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.279 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.279 DEBUG:boto:path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.279 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.279 DEBUG:boto:Method: GET 2024-04-16T18:08:54.279 DEBUG:boto:Path: /cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.279 DEBUG:boto:Data: 2024-04-16T18:08:54.279 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.279 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.279 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.279 DEBUG:boto:Params: {} 2024-04-16T18:08:54.279 DEBUG:boto:Token: None 2024-04-16T18:08:54.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.282 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c20a5ee9e5944384-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.282 DEBUG:boto:b'cjqttm-41obj51000falseobj52024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.282 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.282 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.283 DEBUG:boto:path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.283 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.283 DEBUG:boto:Method: GET 2024-04-16T18:08:54.283 DEBUG:boto:Path: /cjqttm-41/?prefix=obj5 2024-04-16T18:08:54.283 DEBUG:boto:Data: 2024-04-16T18:08:54.283 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.283 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.283 DEBUG:boto:Params: {} 2024-04-16T18:08:54.283 DEBUG:boto:Token: None 2024-04-16T18:08:54.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c5b353e9e9d626b-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.326 DEBUG:boto:b'cjqttm-41obj51000falseobj52024-04-16T18:08:45.832Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:54.327 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.327 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.327 DEBUG:boto:path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.327 DEBUG:boto:auth_path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.327 DEBUG:boto:Method: GET 2024-04-16T18:08:54.327 DEBUG:boto:Path: /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.327 DEBUG:boto:Data: 2024-04-16T18:08:54.327 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.327 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.327 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.328 DEBUG:boto:Params: {} 2024-04-16T18:08:54.328 DEBUG:boto:Token: None 2024-04-16T18:08:54.328 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8= 2024-04-16T18:08:54.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8=', 'Content-Length': '0'} 2024-04-16T18:08:54.330 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ae8538f89eac6188-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.330 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.331 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.331 DEBUG:boto:path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.331 DEBUG:boto:auth_path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.331 DEBUG:boto:Method: GET 2024-04-16T18:08:54.331 DEBUG:boto:Path: /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.331 DEBUG:boto:Data: 2024-04-16T18:08:54.331 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.331 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.331 DEBUG:boto:Params: {} 2024-04-16T18:08:54.331 DEBUG:boto:Token: None 2024-04-16T18:08:54.332 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8= 2024-04-16T18:08:54.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8=', 'Content-Length': '0'} 2024-04-16T18:08:54.334 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004c21bacbc4577602-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.374 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.374 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.374 DEBUG:boto:path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.375 DEBUG:boto:auth_path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.375 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.375 DEBUG:boto:Path: /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.375 DEBUG:boto:Data: 2024-04-16T18:08:54.375 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.375 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.375 DEBUG:boto:Params: {} 2024-04-16T18:08:54.375 DEBUG:boto:Token: None 2024-04-16T18:08:54.375 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6smisOjEr/ZSLRWef/8Kk7yKigY= 2024-04-16T18:08:54.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6smisOjEr/ZSLRWef/8Kk7yKigY=', 'Content-Length': '0'} 2024-04-16T18:08:54.378 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000095988fa64f9e1e9e-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.378 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.378 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.378 DEBUG:boto:path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.378 DEBUG:boto:auth_path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.378 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.379 DEBUG:boto:Path: /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.379 DEBUG:boto:Data: 2024-04-16T18:08:54.379 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.379 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.379 DEBUG:boto:Params: {} 2024-04-16T18:08:54.379 DEBUG:boto:Token: None 2024-04-16T18:08:54.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6smisOjEr/ZSLRWef/8Kk7yKigY= 2024-04-16T18:08:54.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6smisOjEr/ZSLRWef/8Kk7yKigY=', 'Content-Length': '0'} 2024-04-16T18:08:54.382 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002decadb7634fcff2-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.382 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:54.382 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.382 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.382 DEBUG:boto:path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.382 DEBUG:boto:auth_path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.382 DEBUG:boto:Method: GET 2024-04-16T18:08:54.382 DEBUG:boto:Path: /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.382 DEBUG:boto:Data: 2024-04-16T18:08:54.383 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.383 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.383 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.383 DEBUG:boto:Params: {} 2024-04-16T18:08:54.383 DEBUG:boto:Token: None 2024-04-16T18:08:54.383 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8= 2024-04-16T18:08:54.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8=', 'Content-Length': '0'} 2024-04-16T18:08:54.386 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000000ce3032be43ebd96-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.386 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.386 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.386 DEBUG:boto:path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.386 DEBUG:boto:auth_path=/cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.386 DEBUG:boto:Method: GET 2024-04-16T18:08:54.386 DEBUG:boto:Path: /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.387 DEBUG:boto:Data: 2024-04-16T18:08:54.387 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.387 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.387 DEBUG:boto:Params: {} 2024-04-16T18:08:54.387 DEBUG:boto:Token: None 2024-04-16T18:08:54.387 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6?versionId=null 2024-04-16T18:08:54.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8= 2024-04-16T18:08:54.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aadb7XYP53+f5gytq5To0C2CkV8=', 'Content-Length': '0'} 2024-04-16T18:08:54.389 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000bb16db95c6fc0874-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.430 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.430 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.431 DEBUG:boto:path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.431 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.431 DEBUG:boto:Method: GET 2024-04-16T18:08:54.431 DEBUG:boto:Path: /cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.431 DEBUG:boto:Data: 2024-04-16T18:08:54.431 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.431 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.431 DEBUG:boto:Params: {} 2024-04-16T18:08:54.431 DEBUG:boto:Token: None 2024-04-16T18:08:54.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c268e6bc60683e3e-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.434 DEBUG:boto:b'cjqttm-41obj61000falseobj62024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.434 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.435 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.435 DEBUG:boto:path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.435 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.435 DEBUG:boto:Method: GET 2024-04-16T18:08:54.435 DEBUG:boto:Path: /cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.435 DEBUG:boto:Data: 2024-04-16T18:08:54.435 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.435 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.435 DEBUG:boto:Params: {} 2024-04-16T18:08:54.435 DEBUG:boto:Token: None 2024-04-16T18:08:54.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009433ac89483e29b-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.478 DEBUG:boto:b'cjqttm-41obj61000falseobj62024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.479 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.479 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.479 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.479 DEBUG:boto:Path: /cjqttm-41/obj6 2024-04-16T18:08:54.479 DEBUG:boto:Data: 2024-04-16T18:08:54.479 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.479 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.480 DEBUG:boto:Params: {} 2024-04-16T18:08:54.480 DEBUG:boto:Token: None 2024-04-16T18:08:54.480 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6 2024-04-16T18:08:54.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Te8/fe06zZZE6W1S9mXB9n6/uBQ= 2024-04-16T18:08:54.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Te8/fe06zZZE6W1S9mXB9n6/uBQ=', 'Content-Length': '0'} 2024-04-16T18:08:54.482 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001c0ab9af981f1b4a-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.482 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.482 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.483 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.483 DEBUG:boto:Path: /cjqttm-41/obj6 2024-04-16T18:08:54.483 DEBUG:boto:Data: 2024-04-16T18:08:54.483 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.483 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.483 DEBUG:boto:Params: {} 2024-04-16T18:08:54.483 DEBUG:boto:Token: None 2024-04-16T18:08:54.483 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6 2024-04-16T18:08:54.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Te8/fe06zZZE6W1S9mXB9n6/uBQ= 2024-04-16T18:08:54.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Te8/fe06zZZE6W1S9mXB9n6/uBQ=', 'Content-Length': '0'} 2024-04-16T18:08:54.486 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000af517b355f9cbefc-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.486 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2024-04-16T18:08:54.486 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.486 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.486 DEBUG:boto:Method: GET 2024-04-16T18:08:54.486 DEBUG:boto:Path: /cjqttm-41/obj6 2024-04-16T18:08:54.486 DEBUG:boto:Data: 2024-04-16T18:08:54.486 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.487 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.487 DEBUG:boto:Params: {} 2024-04-16T18:08:54.487 DEBUG:boto:Token: None 2024-04-16T18:08:54.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6 2024-04-16T18:08:54.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ie4+PiA8QvJmfJYpmooMugmwJHg= 2024-04-16T18:08:54.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ie4+PiA8QvJmfJYpmooMugmwJHg=', 'Content-Length': '0'} 2024-04-16T18:08:54.489 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000d19c01f86c1e22d3-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.490 DEBUG:boto:path=/cjqttm-41/obj6 2024-04-16T18:08:54.490 DEBUG:boto:auth_path=/cjqttm-41/obj6 2024-04-16T18:08:54.490 DEBUG:boto:Method: GET 2024-04-16T18:08:54.490 DEBUG:boto:Path: /cjqttm-41/obj6 2024-04-16T18:08:54.490 DEBUG:boto:Data: 2024-04-16T18:08:54.490 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.490 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.490 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.491 DEBUG:boto:Params: {} 2024-04-16T18:08:54.491 DEBUG:boto:Token: None 2024-04-16T18:08:54.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj6 2024-04-16T18:08:54.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ie4+PiA8QvJmfJYpmooMugmwJHg= 2024-04-16T18:08:54.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ie4+PiA8QvJmfJYpmooMugmwJHg=', 'Content-Length': '0'} 2024-04-16T18:08:54.493 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000db551886f2299d7d-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.534 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.534 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.535 DEBUG:boto:path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.535 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.535 DEBUG:boto:Method: GET 2024-04-16T18:08:54.535 DEBUG:boto:Path: /cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.535 DEBUG:boto:Data: 2024-04-16T18:08:54.535 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.535 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.535 DEBUG:boto:Params: {} 2024-04-16T18:08:54.535 DEBUG:boto:Token: None 2024-04-16T18:08:54.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef1188eb14259c49-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.538 DEBUG:boto:b'cjqttm-41obj61000falseobj62024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.538 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.538 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.538 DEBUG:boto:path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.539 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.539 DEBUG:boto:Method: GET 2024-04-16T18:08:54.539 DEBUG:boto:Path: /cjqttm-41/?prefix=obj6 2024-04-16T18:08:54.539 DEBUG:boto:Data: 2024-04-16T18:08:54.539 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.539 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.539 DEBUG:boto:Params: {} 2024-04-16T18:08:54.539 DEBUG:boto:Token: None 2024-04-16T18:08:54.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fc0c646532fc619-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.542 DEBUG:boto:b'cjqttm-41obj61000falseobj62024-04-16T18:08:45.840Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:54.542 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.542 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.543 DEBUG:boto:path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.543 DEBUG:boto:auth_path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.543 DEBUG:boto:Method: GET 2024-04-16T18:08:54.543 DEBUG:boto:Path: /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.543 DEBUG:boto:Data: 2024-04-16T18:08:54.543 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.543 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.543 DEBUG:boto:Params: {} 2024-04-16T18:08:54.543 DEBUG:boto:Token: None 2024-04-16T18:08:54.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE= 2024-04-16T18:08:54.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE=', 'Content-Length': '0'} 2024-04-16T18:08:54.546 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000004494e45403e34fd-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.546 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.546 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.546 DEBUG:boto:path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.546 DEBUG:boto:auth_path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.546 DEBUG:boto:Method: GET 2024-04-16T18:08:54.546 DEBUG:boto:Path: /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.546 DEBUG:boto:Data: 2024-04-16T18:08:54.547 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.547 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.547 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.547 DEBUG:boto:Params: {} 2024-04-16T18:08:54.547 DEBUG:boto:Token: None 2024-04-16T18:08:54.547 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.547 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE= 2024-04-16T18:08:54.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE=', 'Content-Length': '0'} 2024-04-16T18:08:54.549 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000494dde9d896e43d0-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.590 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.590 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.591 DEBUG:boto:path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.591 DEBUG:boto:auth_path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.591 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.591 DEBUG:boto:Path: /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.591 DEBUG:boto:Data: 2024-04-16T18:08:54.591 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.591 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.591 DEBUG:boto:Params: {} 2024-04-16T18:08:54.591 DEBUG:boto:Token: None 2024-04-16T18:08:54.591 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SpeFDz0sTZPwrsHZ+lY2foEAM0U= 2024-04-16T18:08:54.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SpeFDz0sTZPwrsHZ+lY2foEAM0U=', 'Content-Length': '0'} 2024-04-16T18:08:54.594 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000db97035b40623cae-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.594 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.594 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.594 DEBUG:boto:path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.594 DEBUG:boto:auth_path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.594 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.594 DEBUG:boto:Path: /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.594 DEBUG:boto:Data: 2024-04-16T18:08:54.594 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.595 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.595 DEBUG:boto:Params: {} 2024-04-16T18:08:54.595 DEBUG:boto:Token: None 2024-04-16T18:08:54.595 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SpeFDz0sTZPwrsHZ+lY2foEAM0U= 2024-04-16T18:08:54.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SpeFDz0sTZPwrsHZ+lY2foEAM0U=', 'Content-Length': '0'} 2024-04-16T18:08:54.597 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c39ea99f3cacbe1a-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.597 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:54.597 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.597 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.598 DEBUG:boto:path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.598 DEBUG:boto:auth_path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.598 DEBUG:boto:Method: GET 2024-04-16T18:08:54.598 DEBUG:boto:Path: /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.598 DEBUG:boto:Data: 2024-04-16T18:08:54.598 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.598 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.598 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.598 DEBUG:boto:Params: {} 2024-04-16T18:08:54.598 DEBUG:boto:Token: None 2024-04-16T18:08:54.598 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE= 2024-04-16T18:08:54.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE=', 'Content-Length': '0'} 2024-04-16T18:08:54.600 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000094a9d91de33580b4-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.601 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.601 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.601 DEBUG:boto:path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.601 DEBUG:boto:auth_path=/cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.601 DEBUG:boto:Method: GET 2024-04-16T18:08:54.601 DEBUG:boto:Path: /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.601 DEBUG:boto:Data: 2024-04-16T18:08:54.601 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.602 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.602 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.602 DEBUG:boto:Params: {} 2024-04-16T18:08:54.602 DEBUG:boto:Token: None 2024-04-16T18:08:54.602 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7?versionId=null 2024-04-16T18:08:54.602 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE= 2024-04-16T18:08:54.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dXDMrr0K44NQ6Hts71iAILO1YbE=', 'Content-Length': '0'} 2024-04-16T18:08:54.604 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000c4ec52895a8f5114-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.646 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.646 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.647 DEBUG:boto:path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.647 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.647 DEBUG:boto:Method: GET 2024-04-16T18:08:54.647 DEBUG:boto:Path: /cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.647 DEBUG:boto:Data: 2024-04-16T18:08:54.647 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.647 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.647 DEBUG:boto:Params: {} 2024-04-16T18:08:54.647 DEBUG:boto:Token: None 2024-04-16T18:08:54.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000657e64f504347fd-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.650 DEBUG:boto:b'cjqttm-41obj71000falseobj72024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.650 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.651 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.651 DEBUG:boto:path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.651 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.651 DEBUG:boto:Method: GET 2024-04-16T18:08:54.651 DEBUG:boto:Path: /cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.651 DEBUG:boto:Data: 2024-04-16T18:08:54.651 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.651 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.651 DEBUG:boto:Params: {} 2024-04-16T18:08:54.651 DEBUG:boto:Token: None 2024-04-16T18:08:54.652 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000571bf4c67c57b4d3-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.654 DEBUG:boto:b'cjqttm-41obj71000falseobj72024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.654 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.655 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.655 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.655 DEBUG:boto:Path: /cjqttm-41/obj7 2024-04-16T18:08:54.655 DEBUG:boto:Data: 2024-04-16T18:08:54.655 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.655 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.655 DEBUG:boto:Params: {} 2024-04-16T18:08:54.655 DEBUG:boto:Token: None 2024-04-16T18:08:54.655 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7 2024-04-16T18:08:54.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i7N4AwQP6nkXjrxitUHwp9FRbu4= 2024-04-16T18:08:54.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i7N4AwQP6nkXjrxitUHwp9FRbu4=', 'Content-Length': '0'} 2024-04-16T18:08:54.657 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000004fcfa56bd3ad6dae-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.658 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.658 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.658 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.658 DEBUG:boto:Path: /cjqttm-41/obj7 2024-04-16T18:08:54.658 DEBUG:boto:Data: 2024-04-16T18:08:54.658 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.658 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.658 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.658 DEBUG:boto:Params: {} 2024-04-16T18:08:54.658 DEBUG:boto:Token: None 2024-04-16T18:08:54.659 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7 2024-04-16T18:08:54.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i7N4AwQP6nkXjrxitUHwp9FRbu4= 2024-04-16T18:08:54.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i7N4AwQP6nkXjrxitUHwp9FRbu4=', 'Content-Length': '0'} 2024-04-16T18:08:54.660 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f10fb6e2b9248e5f-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.661 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2024-04-16T18:08:54.661 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.661 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.661 DEBUG:boto:Method: GET 2024-04-16T18:08:54.661 DEBUG:boto:Path: /cjqttm-41/obj7 2024-04-16T18:08:54.661 DEBUG:boto:Data: 2024-04-16T18:08:54.661 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.661 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.661 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.662 DEBUG:boto:Params: {} 2024-04-16T18:08:54.662 DEBUG:boto:Token: None 2024-04-16T18:08:54.662 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7 2024-04-16T18:08:54.662 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqH4VPOSc6liePvT/308mtaR7Us= 2024-04-16T18:08:54.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqH4VPOSc6liePvT/308mtaR7Us=', 'Content-Length': '0'} 2024-04-16T18:08:54.664 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000095b5227bf703d0f2-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.664 DEBUG:boto:path=/cjqttm-41/obj7 2024-04-16T18:08:54.664 DEBUG:boto:auth_path=/cjqttm-41/obj7 2024-04-16T18:08:54.664 DEBUG:boto:Method: GET 2024-04-16T18:08:54.664 DEBUG:boto:Path: /cjqttm-41/obj7 2024-04-16T18:08:54.664 DEBUG:boto:Data: 2024-04-16T18:08:54.664 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.664 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.665 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.665 DEBUG:boto:Params: {} 2024-04-16T18:08:54.665 DEBUG:boto:Token: None 2024-04-16T18:08:54.665 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj7 2024-04-16T18:08:54.665 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqH4VPOSc6liePvT/308mtaR7Us= 2024-04-16T18:08:54.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqH4VPOSc6liePvT/308mtaR7Us=', 'Content-Length': '0'} 2024-04-16T18:08:54.667 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ad9fe33a01811c0c-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.710 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.711 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.711 DEBUG:boto:path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.711 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.711 DEBUG:boto:Method: GET 2024-04-16T18:08:54.711 DEBUG:boto:Path: /cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.711 DEBUG:boto:Data: 2024-04-16T18:08:54.711 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.711 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.711 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.711 DEBUG:boto:Params: {} 2024-04-16T18:08:54.711 DEBUG:boto:Token: None 2024-04-16T18:08:54.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b3ae20800b0d27c-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.714 DEBUG:boto:b'cjqttm-41obj71000falseobj72024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.715 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.715 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.715 DEBUG:boto:path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.715 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.715 DEBUG:boto:Method: GET 2024-04-16T18:08:54.715 DEBUG:boto:Path: /cjqttm-41/?prefix=obj7 2024-04-16T18:08:54.715 DEBUG:boto:Data: 2024-04-16T18:08:54.715 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.715 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.715 DEBUG:boto:Params: {} 2024-04-16T18:08:54.716 DEBUG:boto:Token: None 2024-04-16T18:08:54.716 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ec640a63865fff9-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.718 DEBUG:boto:b'cjqttm-41obj71000falseobj72024-04-16T18:08:45.887Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.718 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:54.719 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.719 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.719 DEBUG:boto:path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.719 DEBUG:boto:auth_path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.719 DEBUG:boto:Method: GET 2024-04-16T18:08:54.719 DEBUG:boto:Path: /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.719 DEBUG:boto:Data: 2024-04-16T18:08:54.719 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.719 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.719 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.719 DEBUG:boto:Params: {} 2024-04-16T18:08:54.720 DEBUG:boto:Token: None 2024-04-16T18:08:54.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ= 2024-04-16T18:08:54.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ=', 'Content-Length': '0'} 2024-04-16T18:08:54.722 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000ab75a64ec41efb40-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.762 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.762 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.763 DEBUG:boto:path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.763 DEBUG:boto:auth_path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.763 DEBUG:boto:Method: GET 2024-04-16T18:08:54.763 DEBUG:boto:Path: /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.763 DEBUG:boto:Data: 2024-04-16T18:08:54.763 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.763 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.763 DEBUG:boto:Params: {} 2024-04-16T18:08:54.763 DEBUG:boto:Token: None 2024-04-16T18:08:54.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ= 2024-04-16T18:08:54.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ=', 'Content-Length': '0'} 2024-04-16T18:08:54.766 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000053758939c533b4f8-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.806 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.806 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.807 DEBUG:boto:path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.807 DEBUG:boto:auth_path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.807 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.807 DEBUG:boto:Path: /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.807 DEBUG:boto:Data: 2024-04-16T18:08:54.807 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.807 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.807 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.807 DEBUG:boto:Params: {} 2024-04-16T18:08:54.807 DEBUG:boto:Token: None 2024-04-16T18:08:54.807 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qiy2dLGkxMPlR/kzAO/MhHRC49E= 2024-04-16T18:08:54.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qiy2dLGkxMPlR/kzAO/MhHRC49E=', 'Content-Length': '0'} 2024-04-16T18:08:54.809 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000005a3bca85adec7fe3-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.810 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.810 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.810 DEBUG:boto:path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.810 DEBUG:boto:auth_path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.810 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.810 DEBUG:boto:Path: /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.810 DEBUG:boto:Data: 2024-04-16T18:08:54.810 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.810 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.810 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.811 DEBUG:boto:Params: {} 2024-04-16T18:08:54.811 DEBUG:boto:Token: None 2024-04-16T18:08:54.811 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qiy2dLGkxMPlR/kzAO/MhHRC49E= 2024-04-16T18:08:54.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qiy2dLGkxMPlR/kzAO/MhHRC49E=', 'Content-Length': '0'} 2024-04-16T18:08:54.813 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000f4d19a0e066f7f4d-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:54.813 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.813 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.813 DEBUG:boto:path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.813 DEBUG:boto:auth_path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.814 DEBUG:boto:Method: GET 2024-04-16T18:08:54.814 DEBUG:boto:Path: /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.814 DEBUG:boto:Data: 2024-04-16T18:08:54.814 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.814 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.814 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.814 DEBUG:boto:Params: {} 2024-04-16T18:08:54.814 DEBUG:boto:Token: None 2024-04-16T18:08:54.814 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.814 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ= 2024-04-16T18:08:54.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ=', 'Content-Length': '0'} 2024-04-16T18:08:54.816 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx00000b4d3dd042f59f779-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.817 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.817 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.817 DEBUG:boto:path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.817 DEBUG:boto:auth_path=/cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.817 DEBUG:boto:Method: GET 2024-04-16T18:08:54.817 DEBUG:boto:Path: /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.817 DEBUG:boto:Data: 2024-04-16T18:08:54.817 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.817 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.817 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.817 DEBUG:boto:Params: {} 2024-04-16T18:08:54.818 DEBUG:boto:Token: None 2024-04-16T18:08:54.818 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8?versionId=null 2024-04-16T18:08:54.818 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ= 2024-04-16T18:08:54.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j4/7jwa2nr7lGlkEobKQTGac5YQ=', 'Content-Length': '0'} 2024-04-16T18:08:54.820 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000074285b143a4790d1-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.862 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.863 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.863 DEBUG:boto:path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.863 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.863 DEBUG:boto:Method: GET 2024-04-16T18:08:54.863 DEBUG:boto:Path: /cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.863 DEBUG:boto:Data: 2024-04-16T18:08:54.863 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.863 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.863 DEBUG:boto:Params: {} 2024-04-16T18:08:54.863 DEBUG:boto:Token: None 2024-04-16T18:08:54.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000683454a4e67299d3-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.866 DEBUG:boto:b'cjqttm-41obj81000falseobj82024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.867 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.867 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.867 DEBUG:boto:path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.867 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.867 DEBUG:boto:Method: GET 2024-04-16T18:08:54.867 DEBUG:boto:Path: /cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.867 DEBUG:boto:Data: 2024-04-16T18:08:54.867 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.868 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.868 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.868 DEBUG:boto:Params: {} 2024-04-16T18:08:54.868 DEBUG:boto:Token: None 2024-04-16T18:08:54.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000252fedcbc68a88c3-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.871 DEBUG:boto:b'cjqttm-41obj81000falseobj82024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.871 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.871 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.871 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.871 DEBUG:boto:Path: /cjqttm-41/obj8 2024-04-16T18:08:54.871 DEBUG:boto:Data: 2024-04-16T18:08:54.871 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.871 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.872 DEBUG:boto:Params: {} 2024-04-16T18:08:54.872 DEBUG:boto:Token: None 2024-04-16T18:08:54.872 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8 2024-04-16T18:08:54.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pseDVEqAlTcVBh6Rj9A7J4/lMF4= 2024-04-16T18:08:54.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pseDVEqAlTcVBh6Rj9A7J4/lMF4=', 'Content-Length': '0'} 2024-04-16T18:08:54.873 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000002f332cf354cc4c99-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.874 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.874 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.874 DEBUG:boto:Method: HEAD 2024-04-16T18:08:54.874 DEBUG:boto:Path: /cjqttm-41/obj8 2024-04-16T18:08:54.874 DEBUG:boto:Data: 2024-04-16T18:08:54.874 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.874 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.874 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.875 DEBUG:boto:Params: {} 2024-04-16T18:08:54.875 DEBUG:boto:Token: None 2024-04-16T18:08:54.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8 2024-04-16T18:08:54.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pseDVEqAlTcVBh6Rj9A7J4/lMF4= 2024-04-16T18:08:54.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pseDVEqAlTcVBh6Rj9A7J4/lMF4=', 'Content-Length': '0'} 2024-04-16T18:08:54.877 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx0000050316d99796093b9-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.877 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2024-04-16T18:08:54.877 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.877 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.877 DEBUG:boto:Method: GET 2024-04-16T18:08:54.877 DEBUG:boto:Path: /cjqttm-41/obj8 2024-04-16T18:08:54.877 DEBUG:boto:Data: 2024-04-16T18:08:54.878 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.878 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.878 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.878 DEBUG:boto:Params: {} 2024-04-16T18:08:54.878 DEBUG:boto:Token: None 2024-04-16T18:08:54.878 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8 2024-04-16T18:08:54.878 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6VhaWHwZtek8L6uai5vXs2JClZw= 2024-04-16T18:08:54.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6VhaWHwZtek8L6uai5vXs2JClZw=', 'Content-Length': '0'} 2024-04-16T18:08:54.882 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000001e0f5b500c2af741-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.882 DEBUG:boto:path=/cjqttm-41/obj8 2024-04-16T18:08:54.882 DEBUG:boto:auth_path=/cjqttm-41/obj8 2024-04-16T18:08:54.882 DEBUG:boto:Method: GET 2024-04-16T18:08:54.882 DEBUG:boto:Path: /cjqttm-41/obj8 2024-04-16T18:08:54.882 DEBUG:boto:Data: 2024-04-16T18:08:54.882 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.882 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.883 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.883 DEBUG:boto:Params: {} 2024-04-16T18:08:54.883 DEBUG:boto:Token: None 2024-04-16T18:08:54.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/obj8 2024-04-16T18:08:54.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6VhaWHwZtek8L6uai5vXs2JClZw= 2024-04-16T18:08:54.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6VhaWHwZtek8L6uai5vXs2JClZw=', 'Content-Length': '0'} 2024-04-16T18:08:54.885 DEBUG:boto:Response headers: [('Content-Length', '6'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:08:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '316ebd79-1e8f-459c-be24-e6b3e0dc08e5:cjqttm-41:9ba59572-f51c-4bce-9578-e6350e822996.4816.10'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:08:49 GMT'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('x-amz-request-id', 'tx000003d0825364f666727-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.926 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.926 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.926 DEBUG:boto:path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.927 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.927 DEBUG:boto:Method: GET 2024-04-16T18:08:54.927 DEBUG:boto:Path: /cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.927 DEBUG:boto:Data: 2024-04-16T18:08:54.927 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:08:54.927 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.927 DEBUG:boto:Params: {} 2024-04-16T18:08:54.927 DEBUG:boto:Token: None 2024-04-16T18:08:54.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000050e1f59f8202f82a-00661ebeb6-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.930 DEBUG:boto:b'cjqttm-41obj81000falseobj82024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.931 DEBUG:boto:path=/cjqttm-41/ 2024-04-16T18:08:54.931 DEBUG:boto:auth_path=/cjqttm-41/ 2024-04-16T18:08:54.931 DEBUG:boto:path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.931 DEBUG:boto:auth_path=/cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.931 DEBUG:boto:Method: GET 2024-04-16T18:08:54.931 DEBUG:boto:Path: /cjqttm-41/?prefix=obj8 2024-04-16T18:08:54.931 DEBUG:boto:Data: 2024-04-16T18:08:54.931 DEBUG:boto:Headers: {} 2024-04-16T18:08:54.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:08:54.931 DEBUG:boto:Port: 8000 2024-04-16T18:08:54.931 DEBUG:boto:Params: {} 2024-04-16T18:08:54.932 DEBUG:boto:Token: None 2024-04-16T18:08:54.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:08:54 GMT /cjqttm-41/ 2024-04-16T18:08:54.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY= 2024-04-16T18:08:54.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:08:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:49ntrxPnhQUpvl/mb78rp3N0tPY=', 'Content-Length': '0'} 2024-04-16T18:08:54.934 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c2fb6f6f06da3bc-00661ebeb6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:08:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:08:54.974 DEBUG:boto:b'cjqttm-41obj81000falseobj82024-04-16T18:08:45.896Z"a8f5f167f44f4964e6c998dee827110c"6STANDARDRGW11111111111111111Normal' 2024-04-16T18:08:54.975 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-41 zones={test-zone2, test-zone1} 2024-04-16T18:08:54.975 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T18:08:54.975 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:54.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:54.975 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:55.029 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:55.029 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:55.116 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000006269","last_update":"2024-04-16T18:08:51.660333Z"},{"marker":"00000000000000000000:00000000000000012592","last_update":"2024-04-16T18:08:51.662183Z"},{"marker":"00000000000000000000:00000000000000009223","last_update":"2024-04-16T18:08:46.214674Z"},{"marker":"00000000000000000000:00000000000000008249","last_update":"2024-04-16T18:08:51.664010Z"}] 2024-04-16T18:08:55.116 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000006269', 1: '00000000000000000000:00000000000000012592', 2: '00000000000000000000:00000000000000009223', 3: '00000000000000000000:00000000000000008249'} 2024-04-16T18:08:55.116 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:08:55.116 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:55.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:08:55.117 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:08:55.174 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:08:55.174 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:08:55.253 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005988","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:46.212208Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012592","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.662183Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009223","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:46.214674Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000008249","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.664010Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:08:55Z"} 2024-04-16T18:08:55.253 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000005988","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:46.212208Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012592","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.662183Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009223","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:46.214674Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000008249","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.664010Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:08:55Z"} 2024-04-16T18:08:55.253 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000005988', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:46.212208Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000012592', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.662183Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000009223', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:46.214674Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000008249', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.664010Z'}}] 2024-04-16T18:08:55.254 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000006269', 1: '00000000000000000000:00000000000000012592', 2: '00000000000000000000:00000000000000009223', 3: '00000000000000000000:00000000000000008249'} 2024-04-16T18:08:55.254 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000005988', 1: '00000000000000000000:00000000000000012592', 2: '00000000000000000000:00000000000000009223', 3: '00000000000000000000:00000000000000008249'} 2024-04-16T18:08:55.254 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000006269 target=00000000000000000000:00000000000000005988 2024-04-16T18:09:00.255 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:00.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:00.256 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:00.313 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:00.313 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:00.391 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006269","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.660333Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012592","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.662183Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009223","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:46.214674Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000008249","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.664010Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:09:00Z"} 2024-04-16T18:09:00.391 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4839818410384348896},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006269","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.660333Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012592","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.662183Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009223","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:46.214674Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000008249","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.664010Z"}}]},"full_sync":{"total":0,"complete":0},"current_time":"2024-04-16T18:09:00Z"} 2024-04-16T18:09:00.392 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006269', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.660333Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000012592', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.662183Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000009223', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:46.214674Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000008249', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.664010Z'}}] 2024-04-16T18:09:00.392 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000006269', 1: '00000000000000000000:00000000000000012592', 2: '00000000000000000000:00000000000000009223', 3: '00000000000000000000:00000000000000008249'} 2024-04-16T18:09:00.392 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000006269', 1: '00000000000000000000:00000000000000012592', 2: '00000000000000000000:00000000000000009223', 3: '00000000000000000000:00000000000000008249'} 2024-04-16T18:09:00.392 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:09:00.392 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T18:09:00.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:00.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:00.393 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:00.440 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:00.440 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:00.517 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000004869","last_update":"2024-04-16T18:08:51.693467Z"},{"marker":"00000000000000000000:00000000000000009224","last_update":"2024-04-16T18:08:51.695707Z"},{"marker":"00000000000000000000:00000000000000006981","last_update":"2024-04-16T18:08:51.697646Z"},{"marker":"00000000000000000000:00000000000000006002","last_update":"2024-04-16T18:08:51.699165Z"}] 2024-04-16T18:09:00.517 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000004869', 1: '00000000000000000000:00000000000000009224', 2: '00000000000000000000:00000000000000006981', 3: '00000000000000000000:00000000000000006002'} 2024-04-16T18:09:00.517 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:09:00.517 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:00.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:00.518 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:00.575 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:00.575 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:00.654 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004869","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:08:51.693467Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009224","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.695707Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006981","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.697646Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006002","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.699165Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:09:00Z"} 2024-04-16T18:09:00.654 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000004869","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:08:51.693467Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000009224","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.695707Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006981","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.697646Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000006002","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:08:51.699165Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:09:00Z"} 2024-04-16T18:09:00.654 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000004869', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.693467Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000009224', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.695707Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006981', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.697646Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000006002', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:08:51.699165Z'}}] 2024-04-16T18:09:00.655 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000004869', 1: '00000000000000000000:00000000000000009224', 2: '00000000000000000000:00000000000000006981', 3: '00000000000000000000:00000000000000006002'} 2024-04-16T18:09:00.655 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000004869', 1: '00000000000000000000:00000000000000009224', 2: '00000000000000000000:00000000000000006981', 3: '00000000000000000000:00000000000000006002'} 2024-04-16T18:09:00.655 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:09:00.655 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable_enable ... ok 2024-04-16T18:09:00.656 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-42 2024-04-16T18:09:00.656 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:00.657 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:00.657 DEBUG:boto:Method: PUT 2024-04-16T18:09:00.657 DEBUG:boto:Path: /cjqttm-42/ 2024-04-16T18:09:00.657 DEBUG:boto:Data: 2024-04-16T18:09:00.657 DEBUG:boto:Headers: {} 2024-04-16T18:09:00.657 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:00.657 DEBUG:boto:Port: 8000 2024-04-16T18:09:00.657 DEBUG:boto:Params: {} 2024-04-16T18:09:00.657 DEBUG:boto:Token: None 2024-04-16T18:09:00.657 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:09:00 GMT /cjqttm-42/ 2024-04-16T18:09:00.658 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YDOayQ/Gh3OGCTy/J7tpjjmEy3U= 2024-04-16T18:09:00.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YDOayQ/Gh3OGCTy/J7tpjjmEy3U=', 'Content-Length': '0'} 2024-04-16T18:09:00.675 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008490245794459b4f-00661ebebc-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:00.675 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=cjqttm-43 2024-04-16T18:09:00.675 DEBUG:boto:path=/cjqttm-43/ 2024-04-16T18:09:00.675 DEBUG:boto:auth_path=/cjqttm-43/ 2024-04-16T18:09:00.675 DEBUG:boto:Method: PUT 2024-04-16T18:09:00.676 DEBUG:boto:Path: /cjqttm-43/ 2024-04-16T18:09:00.676 DEBUG:boto:Data: 2024-04-16T18:09:00.676 DEBUG:boto:Headers: {} 2024-04-16T18:09:00.676 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:00.676 DEBUG:boto:Port: 8000 2024-04-16T18:09:00.676 DEBUG:boto:Params: {} 2024-04-16T18:09:00.676 DEBUG:boto:Token: None 2024-04-16T18:09:00.676 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:09:00 GMT /cjqttm-43/ 2024-04-16T18:09:00.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9KFIdFs5e6+YZ3tF9kaZxuzysts= 2024-04-16T18:09:00.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9KFIdFs5e6+YZ3tF9kaZxuzysts=', 'Content-Length': '0'} 2024-04-16T18:09:00.703 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000003d3e096972c0771c-00661ebebc-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:00.703 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:00.703 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:00.703 DEBUG:boto:path=/cjqttm-42/MULTIPART?uploads 2024-04-16T18:09:00.703 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?uploads 2024-04-16T18:09:00.703 DEBUG:boto:Method: POST 2024-04-16T18:09:00.704 DEBUG:boto:Path: /cjqttm-42/MULTIPART?uploads 2024-04-16T18:09:00.704 DEBUG:boto:Data: 2024-04-16T18:09:00.704 DEBUG:boto:Headers: {} 2024-04-16T18:09:00.704 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:00.704 DEBUG:boto:Port: 8000 2024-04-16T18:09:00.704 DEBUG:boto:Params: {} 2024-04-16T18:09:00.704 DEBUG:boto:Token: None 2024-04-16T18:09:00.704 DEBUG:boto:StringToSign: POST Tue, 16 Apr 2024 18:09:00 GMT /cjqttm-42/MULTIPART?uploads 2024-04-16T18:09:00.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BUu57AqFAloWqhXjy6b26aujriE= 2024-04-16T18:09:00.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BUu57AqFAloWqhXjy6b26aujriE=', 'Content-Length': '0'} 2024-04-16T18:09:02.175 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000450994dcdbf32aa5-00661ebebc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '249'), ('Date', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:02.175 DEBUG:boto:b'cjqttm-42MULTIPART2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l' 2024-04-16T18:09:02.217 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.217 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.218 DEBUG:boto:path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=1 2024-04-16T18:09:02.218 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=1 2024-04-16T18:09:02.218 DEBUG:boto:Method: PUT 2024-04-16T18:09:02.218 DEBUG:boto:Path: /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=1 2024-04-16T18:09:02.218 DEBUG:boto:Data: 2024-04-16T18:09:02.218 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ebKBBg0ze5srhMzzkK3PdA==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-16T18:09:02.218 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:02.218 DEBUG:boto:Port: 8000 2024-04-16T18:09:02.218 DEBUG:boto:Params: {} 2024-04-16T18:09:02.218 DEBUG:boto:Token: None 2024-04-16T18:09:02.219 DEBUG:boto:StringToSign: PUT ebKBBg0ze5srhMzzkK3PdA== application/octet-stream Tue, 16 Apr 2024 18:09:02 GMT /cjqttm-42/MULTIPART?partNumber=1&uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mSKSSljKlvVMYk0IB29m2xWdIII= 2024-04-16T18:09:02.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'ebKBBg0ze5srhMzzkK3PdA==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mSKSSljKlvVMYk0IB29m2xWdIII='} 2024-04-16T18:09:02.279 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"79b281060d337b9b2b84ccf390adcf74"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000073064a6f77ea50f5-00661ebebe-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:02.310 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.310 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.310 DEBUG:boto:path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=2 2024-04-16T18:09:02.310 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=2 2024-04-16T18:09:02.310 DEBUG:boto:Method: PUT 2024-04-16T18:09:02.311 DEBUG:boto:Path: /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=2 2024-04-16T18:09:02.311 DEBUG:boto:Data: 2024-04-16T18:09:02.311 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dIQ6OrGTo4m87YmUAtmdXw==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-16T18:09:02.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:02.311 DEBUG:boto:Port: 8000 2024-04-16T18:09:02.311 DEBUG:boto:Params: {} 2024-04-16T18:09:02.311 DEBUG:boto:Token: None 2024-04-16T18:09:02.311 DEBUG:boto:StringToSign: PUT dIQ6OrGTo4m87YmUAtmdXw== application/octet-stream Tue, 16 Apr 2024 18:09:02 GMT /cjqttm-42/MULTIPART?partNumber=2&uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EPodurBe3nI3u9G/7TbVmF5P9Rs= 2024-04-16T18:09:02.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'dIQ6OrGTo4m87YmUAtmdXw==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EPodurBe3nI3u9G/7TbVmF5P9Rs='} 2024-04-16T18:09:02.366 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"74843a3ab193a389bced899402d99d5f"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000647001a7593a9e89-00661ebebe-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:02.384 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.384 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.384 DEBUG:boto:path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=3 2024-04-16T18:09:02.384 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=3 2024-04-16T18:09:02.384 DEBUG:boto:Method: PUT 2024-04-16T18:09:02.384 DEBUG:boto:Path: /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=3 2024-04-16T18:09:02.384 DEBUG:boto:Data: 2024-04-16T18:09:02.384 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e4RW4edMN49Fhh9TYZ51tg==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-16T18:09:02.385 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:02.385 DEBUG:boto:Port: 8000 2024-04-16T18:09:02.385 DEBUG:boto:Params: {} 2024-04-16T18:09:02.385 DEBUG:boto:Token: None 2024-04-16T18:09:02.385 DEBUG:boto:StringToSign: PUT e4RW4edMN49Fhh9TYZ51tg== application/octet-stream Tue, 16 Apr 2024 18:09:02 GMT /cjqttm-42/MULTIPART?partNumber=3&uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.385 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:axy84/5+ENlVcuWfII4pLmrVclo= 2024-04-16T18:09:02.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'e4RW4edMN49Fhh9TYZ51tg==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:axy84/5+ENlVcuWfII4pLmrVclo='} 2024-04-16T18:09:02.441 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"7b8456e1e74c378f45861f53619e75b6"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008e2b1f24a9690b6b-00661ebebe-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:02.459 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.459 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.459 DEBUG:boto:path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=4 2024-04-16T18:09:02.459 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=4 2024-04-16T18:09:02.459 DEBUG:boto:Method: PUT 2024-04-16T18:09:02.459 DEBUG:boto:Path: /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l&partNumber=4 2024-04-16T18:09:02.459 DEBUG:boto:Data: 2024-04-16T18:09:02.459 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'l+jDi4yPcIlVvEiQwDQZTQ==', 'Content-Length': '5242880', 'Expect': '100-Continue'} 2024-04-16T18:09:02.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:02.460 DEBUG:boto:Port: 8000 2024-04-16T18:09:02.460 DEBUG:boto:Params: {} 2024-04-16T18:09:02.460 DEBUG:boto:Token: None 2024-04-16T18:09:02.460 DEBUG:boto:StringToSign: PUT l+jDi4yPcIlVvEiQwDQZTQ== application/octet-stream Tue, 16 Apr 2024 18:09:02 GMT /cjqttm-42/MULTIPART?partNumber=4&uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q2tiHSQM7N6bFXQf+YC2J59eLFw= 2024-04-16T18:09:02.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'l+jDi4yPcIlVvEiQwDQZTQ==', 'Content-Length': '5242880', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q2tiHSQM7N6bFXQf+YC2J59eLFw='} 2024-04-16T18:09:02.514 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"97e8c38b8c8f708955bc4890c034194d"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cdb305fe91d45a8c-00661ebebe-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:02.515 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.515 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.515 DEBUG:boto:path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.515 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.515 DEBUG:boto:Method: GET 2024-04-16T18:09:02.515 DEBUG:boto:Path: /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.515 DEBUG:boto:Data: 2024-04-16T18:09:02.515 DEBUG:boto:Headers: {} 2024-04-16T18:09:02.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:02.516 DEBUG:boto:Port: 8000 2024-04-16T18:09:02.516 DEBUG:boto:Params: {} 2024-04-16T18:09:02.516 DEBUG:boto:Token: None 2024-04-16T18:09:02.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:02 GMT /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wn9ZjCsXqvMa99Hi2tX5MdVp+R0= 2024-04-16T18:09:02.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wn9ZjCsXqvMa99Hi2tX5MdVp+R0=', 'Content-Length': '0'} 2024-04-16T18:09:02.519 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de82d0fb42c48fed-00661ebebe-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:02.563 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.563 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:02.563 DEBUG:boto:path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.563 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.563 DEBUG:boto:Method: POST 2024-04-16T18:09:02.563 DEBUG:boto:Path: /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.563 DEBUG:boto:Data: 1 "79b281060d337b9b2b84ccf390adcf74" 2 "74843a3ab193a389bced899402d99d5f" 3 "7b8456e1e74c378f45861f53619e75b6" 4 "97e8c38b8c8f708955bc4890c034194d" 2024-04-16T18:09:02.563 DEBUG:boto:Headers: {'Content-Type': 'text/xml'} 2024-04-16T18:09:02.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:02.563 DEBUG:boto:Port: 8000 2024-04-16T18:09:02.564 DEBUG:boto:Params: {} 2024-04-16T18:09:02.564 DEBUG:boto:Token: None 2024-04-16T18:09:02.564 DEBUG:boto:StringToSign: POST text/xml Tue, 16 Apr 2024 18:09:02 GMT /cjqttm-42/MULTIPART?uploadId=2~mn4g5tlQvdwDABYYlHilJ_WiVZbJh5l 2024-04-16T18:09:02.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bSnD26pdbP2qQeAK1v6JUc2MRIc= 2024-04-16T18:09:02.564 DEBUG:boto:Final headers: {'Content-Type': 'text/xml', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bSnD26pdbP2qQeAK1v6JUc2MRIc=', 'Content-Length': '460'} 2024-04-16T18:09:02.577 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000ded277cb1c27385f-00661ebebe-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '325'), ('Date', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:02.577 DEBUG:boto:http://smithi016.front.sepia.ceph.com:8000/cjqttm-42/MULTIPARTcjqttm-42MULTIPARTd07d411772772538cd4b657da660bfb5-4 2024-04-16T18:09:02.577 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:02.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:02.578 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:02.624 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:02.624 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:02.677 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:09:02.699 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290940.694506_593.1","last_update":"2024-04-16T18:09:00.694506Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:09:02.699 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290940.694506_593.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:02.699 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:09:02.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:02.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:02.700 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:02.754 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:02.754 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:02.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:02.810+0000 7fb330f2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:02.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:02.812+0000 7fb330f2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:02.831 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290940.694506_593.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:00.694506Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:02Z"} 2024-04-16T18:09:02.831 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290940.694506_593.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:00.694506Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:02Z"} 2024-04-16T18:09:02.831 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290940.694506_593.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:09:00.694506Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:09:02.831 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290940.694506_593.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:02.832 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290940.694506_593.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:02.832 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:09:02.832 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-42 2024-04-16T18:09:02.832 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-42', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:02.832 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-42', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:02.832 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-42 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:09:02.887 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:02.888 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:02.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:02.945+0000 7f353f333800 1 waiting to reach incremental sync.. 2024-04-16T18:09:07.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:07.947+0000 7f353f333800 1 bucket sync caught up with source: 2024-04-16T18:09:07.945 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000006.55.6, , , , , ] 2024-04-16T18:09:07.945 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000006.55.6, , , , , ] 2024-04-16T18:09:07.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:07.947+0000 7f353f333800 0 bucket checkpoint complete 2024-04-16T18:09:07.971 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-42 2024-04-16T18:09:07.972 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-42', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:07.972 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-42', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:07.972 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-42 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:09:08.034 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:08.034 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:08.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:08.100+0000 7f2c66733800 1 waiting to reach incremental sync.. 2024-04-16T18:09:13.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:13.102+0000 7f2c66733800 1 bucket sync caught up with source: 2024-04-16T18:09:13.101 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000001.248.6, , , , , ] 2024-04-16T18:09:13.101 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000001.248.6, , , , , ] 2024-04-16T18:09:13.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:13.102+0000 7f2c66733800 0 bucket checkpoint complete 2024-04-16T18:09:13.127 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-42 zones={test-zone2, test-zone1} 2024-04-16T18:09:13.128 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.128 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.128 DEBUG:boto:Method: HEAD 2024-04-16T18:09:13.128 DEBUG:boto:Path: /cjqttm-42/ 2024-04-16T18:09:13.128 DEBUG:boto:Data: 2024-04-16T18:09:13.128 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.128 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.128 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.129 DEBUG:boto:Params: {} 2024-04-16T18:09:13.129 DEBUG:boto:Token: None 2024-04-16T18:09:13.129 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/ 2024-04-16T18:09:13.129 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eKqsoTPlMoGtk71PkANjWu6BPsU= 2024-04-16T18:09:13.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eKqsoTPlMoGtk71PkANjWu6BPsU=', 'Content-Length': '0'} 2024-04-16T18:09:13.132 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '20971520'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fe297a473193c602-00661ebec9-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.132 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.133 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.133 DEBUG:boto:Method: HEAD 2024-04-16T18:09:13.133 DEBUG:boto:Path: /cjqttm-42/ 2024-04-16T18:09:13.133 DEBUG:boto:Data: 2024-04-16T18:09:13.133 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.133 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.133 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.133 DEBUG:boto:Params: {} 2024-04-16T18:09:13.134 DEBUG:boto:Token: None 2024-04-16T18:09:13.134 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/ 2024-04-16T18:09:13.134 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eKqsoTPlMoGtk71PkANjWu6BPsU= 2024-04-16T18:09:13.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eKqsoTPlMoGtk71PkANjWu6BPsU=', 'Content-Length': '0'} 2024-04-16T18:09:13.136 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '20971520'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000b166914ac402a72-00661ebec9-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.137 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:09:13.137 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.137 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.137 DEBUG:boto:path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.137 DEBUG:boto:auth_path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.137 DEBUG:boto:Method: GET 2024-04-16T18:09:13.137 DEBUG:boto:Path: /cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.138 DEBUG:boto:Data: 2024-04-16T18:09:13.138 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.138 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.138 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.138 DEBUG:boto:Params: {} 2024-04-16T18:09:13.138 DEBUG:boto:Token: None 2024-04-16T18:09:13.138 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/?versions 2024-04-16T18:09:13.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ= 2024-04-16T18:09:13.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ=', 'Content-Length': '0'} 2024-04-16T18:09:13.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000700a8ef8ca387a25-00661ebec9-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.141 DEBUG:boto:b'cjqttm-42999falseMULTIPARTnulltrue2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.143 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2024-04-16T18:09:13.143 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:09:13.143 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.143 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.143 DEBUG:boto:path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.143 DEBUG:boto:auth_path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.143 DEBUG:boto:Method: GET 2024-04-16T18:09:13.143 DEBUG:boto:Path: /cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.144 DEBUG:boto:Data: 2024-04-16T18:09:13.144 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.144 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.144 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.144 DEBUG:boto:Params: {} 2024-04-16T18:09:13.144 DEBUG:boto:Token: None 2024-04-16T18:09:13.144 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/?versions 2024-04-16T18:09:13.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ= 2024-04-16T18:09:13.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ=', 'Content-Length': '0'} 2024-04-16T18:09:13.147 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0fea29bd6d44c5e-00661ebec9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.147 DEBUG:boto:b'cjqttm-42999falseMULTIPARTnulltrue2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.147 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2024-04-16T18:09:13.148 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.148 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.148 DEBUG:boto:path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.148 DEBUG:boto:auth_path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.148 DEBUG:boto:Method: GET 2024-04-16T18:09:13.148 DEBUG:boto:Path: /cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.148 DEBUG:boto:Data: 2024-04-16T18:09:13.148 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.149 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.149 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.149 DEBUG:boto:Params: {} 2024-04-16T18:09:13.149 DEBUG:boto:Token: None 2024-04-16T18:09:13.149 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/?versions 2024-04-16T18:09:13.149 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ= 2024-04-16T18:09:13.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ=', 'Content-Length': '0'} 2024-04-16T18:09:13.152 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f14adf9690126ea4-00661ebec9-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.152 DEBUG:boto:b'cjqttm-42999falseMULTIPARTnulltrue2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.152 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.153 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.153 DEBUG:boto:path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.153 DEBUG:boto:auth_path=/cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.153 DEBUG:boto:Method: GET 2024-04-16T18:09:13.153 DEBUG:boto:Path: /cjqttm-42/?versions&max-keys=999 2024-04-16T18:09:13.153 DEBUG:boto:Data: 2024-04-16T18:09:13.153 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.153 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.153 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.153 DEBUG:boto:Params: {} 2024-04-16T18:09:13.154 DEBUG:boto:Token: None 2024-04-16T18:09:13.154 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/?versions 2024-04-16T18:09:13.154 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ= 2024-04-16T18:09:13.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SwiCdPmh/D5iHMmibdVmzIL+3EQ=', 'Content-Length': '0'} 2024-04-16T18:09:13.156 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002b1840975e10e1cb-00661ebec9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.157 DEBUG:boto:b'cjqttm-42999falseMULTIPARTnulltrue2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.157 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2024-04-16T18:09:13.157 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.157 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.157 DEBUG:boto:path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.158 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.158 DEBUG:boto:Method: GET 2024-04-16T18:09:13.158 DEBUG:boto:Path: /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.158 DEBUG:boto:Data: 2024-04-16T18:09:13.158 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.158 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.158 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.159 DEBUG:boto:Params: {} 2024-04-16T18:09:13.159 DEBUG:boto:Token: None 2024-04-16T18:09:13.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE= 2024-04-16T18:09:13.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE=', 'Content-Length': '0'} 2024-04-16T18:09:13.164 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-42:9ba59572-f51c-4bce-9578-e6350e822996.4816.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:07 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000bd1efe208702e612-00661ebec9-4999-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.247 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.248 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.248 DEBUG:boto:path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.248 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.248 DEBUG:boto:Method: GET 2024-04-16T18:09:13.248 DEBUG:boto:Path: /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.248 DEBUG:boto:Data: 2024-04-16T18:09:13.248 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.248 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.248 DEBUG:boto:Params: {} 2024-04-16T18:09:13.249 DEBUG:boto:Token: None 2024-04-16T18:09:13.249 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE= 2024-04-16T18:09:13.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE=', 'Content-Length': '0'} 2024-04-16T18:09:13.259 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000e0482ff3456aed6e-00661ebec9-4816-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.360 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.360 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.360 DEBUG:boto:path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.360 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.361 DEBUG:boto:Method: HEAD 2024-04-16T18:09:13.361 DEBUG:boto:Path: /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.361 DEBUG:boto:Data: 2024-04-16T18:09:13.361 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.361 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.361 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.361 DEBUG:boto:Params: {} 2024-04-16T18:09:13.361 DEBUG:boto:Token: None 2024-04-16T18:09:13.361 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.362 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RAcOVxJHysfHvt3/l3+sMsg5NdM= 2024-04-16T18:09:13.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RAcOVxJHysfHvt3/l3+sMsg5NdM=', 'Content-Length': '0'} 2024-04-16T18:09:13.364 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-42:9ba59572-f51c-4bce-9578-e6350e822996.4816.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:07 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx0000034793212afa8eb9d-00661ebec9-4999-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.365 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.365 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.365 DEBUG:boto:path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.365 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.365 DEBUG:boto:Method: HEAD 2024-04-16T18:09:13.365 DEBUG:boto:Path: /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.365 DEBUG:boto:Data: 2024-04-16T18:09:13.365 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.365 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.365 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.365 DEBUG:boto:Params: {} 2024-04-16T18:09:13.365 DEBUG:boto:Token: None 2024-04-16T18:09:13.366 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.366 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RAcOVxJHysfHvt3/l3+sMsg5NdM= 2024-04-16T18:09:13.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RAcOVxJHysfHvt3/l3+sMsg5NdM=', 'Content-Length': '0'} 2024-04-16T18:09:13.368 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx0000098cec78ffbe6c7e8-00661ebec9-4816-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2024-04-16T18:09:13.368 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.368 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.368 DEBUG:boto:path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.368 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.368 DEBUG:boto:Method: GET 2024-04-16T18:09:13.368 DEBUG:boto:Path: /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.369 DEBUG:boto:Data: 2024-04-16T18:09:13.369 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.369 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.369 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.369 DEBUG:boto:Params: {} 2024-04-16T18:09:13.369 DEBUG:boto:Token: None 2024-04-16T18:09:13.369 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.369 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE= 2024-04-16T18:09:13.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE=', 'Content-Length': '0'} 2024-04-16T18:09:13.373 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-42:9ba59572-f51c-4bce-9578-e6350e822996.4816.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:07 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000009d64974878804171-00661ebec9-4999-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.463 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.463 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.463 DEBUG:boto:path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.463 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.463 DEBUG:boto:Method: GET 2024-04-16T18:09:13.463 DEBUG:boto:Path: /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.463 DEBUG:boto:Data: 2024-04-16T18:09:13.463 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.464 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.464 DEBUG:boto:Params: {} 2024-04-16T18:09:13.464 DEBUG:boto:Token: None 2024-04-16T18:09:13.464 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART?versionId=null 2024-04-16T18:09:13.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE= 2024-04-16T18:09:13.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i+IdX02wrnNjAG2brEjcnNmYBvE=', 'Content-Length': '0'} 2024-04-16T18:09:13.473 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000d6538a99b4164ad9-00661ebec9-4816-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.566 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.566 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.567 DEBUG:boto:path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.567 DEBUG:boto:auth_path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.567 DEBUG:boto:Method: GET 2024-04-16T18:09:13.567 DEBUG:boto:Path: /cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.567 DEBUG:boto:Data: 2024-04-16T18:09:13.567 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.567 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.567 DEBUG:boto:Params: {} 2024-04-16T18:09:13.567 DEBUG:boto:Token: None 2024-04-16T18:09:13.568 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/ 2024-04-16T18:09:13.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE= 2024-04-16T18:09:13.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE=', 'Content-Length': '0'} 2024-04-16T18:09:13.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058c524390a870520-00661ebec9-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.571 DEBUG:boto:b'cjqttm-42MULTIPART1000falseMULTIPART2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.571 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.571 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.571 DEBUG:boto:path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.571 DEBUG:boto:auth_path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.571 DEBUG:boto:Method: GET 2024-04-16T18:09:13.571 DEBUG:boto:Path: /cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.572 DEBUG:boto:Data: 2024-04-16T18:09:13.572 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.572 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.572 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.572 DEBUG:boto:Params: {} 2024-04-16T18:09:13.572 DEBUG:boto:Token: None 2024-04-16T18:09:13.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/ 2024-04-16T18:09:13.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE= 2024-04-16T18:09:13.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE=', 'Content-Length': '0'} 2024-04-16T18:09:13.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a516abb652881ff-00661ebec9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.575 DEBUG:boto:b'cjqttm-42MULTIPART1000falseMULTIPART2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.575 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.575 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.575 DEBUG:boto:Method: HEAD 2024-04-16T18:09:13.575 DEBUG:boto:Path: /cjqttm-42/MULTIPART 2024-04-16T18:09:13.575 DEBUG:boto:Data: 2024-04-16T18:09:13.575 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.576 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.576 DEBUG:boto:Params: {} 2024-04-16T18:09:13.576 DEBUG:boto:Token: None 2024-04-16T18:09:13.576 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART 2024-04-16T18:09:13.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LyXpyeWuw14JY5AUeW05j1sWtrg= 2024-04-16T18:09:13.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LyXpyeWuw14JY5AUeW05j1sWtrg=', 'Content-Length': '0'} 2024-04-16T18:09:13.578 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-42:9ba59572-f51c-4bce-9578-e6350e822996.4816.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:07 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000007383f7ceebf64d91-00661ebec9-4999-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.578 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.578 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.578 DEBUG:boto:Method: HEAD 2024-04-16T18:09:13.579 DEBUG:boto:Path: /cjqttm-42/MULTIPART 2024-04-16T18:09:13.579 DEBUG:boto:Data: 2024-04-16T18:09:13.579 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.579 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.579 DEBUG:boto:Params: {} 2024-04-16T18:09:13.579 DEBUG:boto:Token: None 2024-04-16T18:09:13.579 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART 2024-04-16T18:09:13.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LyXpyeWuw14JY5AUeW05j1sWtrg= 2024-04-16T18:09:13.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LyXpyeWuw14JY5AUeW05j1sWtrg=', 'Content-Length': '0'} 2024-04-16T18:09:13.581 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000000750bd656e41f8fe-00661ebec9-4816-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.582 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2024-04-16T18:09:13.582 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.582 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.582 DEBUG:boto:Method: GET 2024-04-16T18:09:13.582 DEBUG:boto:Path: /cjqttm-42/MULTIPART 2024-04-16T18:09:13.582 DEBUG:boto:Data: 2024-04-16T18:09:13.582 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.582 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.582 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.582 DEBUG:boto:Params: {} 2024-04-16T18:09:13.583 DEBUG:boto:Token: None 2024-04-16T18:09:13.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART 2024-04-16T18:09:13.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HAQdLN0JNZXniil5g+mIKUhVyKQ= 2024-04-16T18:09:13.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HAQdLN0JNZXniil5g+mIKUhVyKQ=', 'Content-Length': '0'} 2024-04-16T18:09:13.586 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-42:9ba59572-f51c-4bce-9578-e6350e822996.4816.11'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:07 GMT'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx00000729d888ebe6c6425-00661ebec9-4999-test-zone2'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.676 DEBUG:boto:path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.677 DEBUG:boto:auth_path=/cjqttm-42/MULTIPART 2024-04-16T18:09:13.677 DEBUG:boto:Method: GET 2024-04-16T18:09:13.677 DEBUG:boto:Path: /cjqttm-42/MULTIPART 2024-04-16T18:09:13.677 DEBUG:boto:Data: 2024-04-16T18:09:13.677 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.677 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.677 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.677 DEBUG:boto:Params: {} 2024-04-16T18:09:13.677 DEBUG:boto:Token: None 2024-04-16T18:09:13.677 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/MULTIPART 2024-04-16T18:09:13.678 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HAQdLN0JNZXniil5g+mIKUhVyKQ= 2024-04-16T18:09:13.678 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HAQdLN0JNZXniil5g+mIKUhVyKQ=', 'Content-Length': '0'} 2024-04-16T18:09:13.687 DEBUG:boto:Response headers: [('Content-Length', '20971520'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:02 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"d07d411772772538cd4b657da660bfb5-4"'), ('x-amz-request-id', 'tx000007964b4bc1f9a78c0-00661ebec9-4816-test-zone1'), ('Content-Type', 'binary/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.784 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.784 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.784 DEBUG:boto:path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.784 DEBUG:boto:auth_path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.784 DEBUG:boto:Method: GET 2024-04-16T18:09:13.784 DEBUG:boto:Path: /cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.785 DEBUG:boto:Data: 2024-04-16T18:09:13.785 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.785 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:13.785 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.785 DEBUG:boto:Params: {} 2024-04-16T18:09:13.785 DEBUG:boto:Token: None 2024-04-16T18:09:13.785 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/ 2024-04-16T18:09:13.785 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE= 2024-04-16T18:09:13.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE=', 'Content-Length': '0'} 2024-04-16T18:09:13.788 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a00f92f8bcb856b3-00661ebec9-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.789 DEBUG:boto:b'cjqttm-42MULTIPART1000falseMULTIPART2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.789 DEBUG:boto:path=/cjqttm-42/ 2024-04-16T18:09:13.789 DEBUG:boto:auth_path=/cjqttm-42/ 2024-04-16T18:09:13.789 DEBUG:boto:path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.789 DEBUG:boto:auth_path=/cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.790 DEBUG:boto:Method: GET 2024-04-16T18:09:13.790 DEBUG:boto:Path: /cjqttm-42/?prefix=MULTIPART 2024-04-16T18:09:13.790 DEBUG:boto:Data: 2024-04-16T18:09:13.790 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.790 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.790 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.790 DEBUG:boto:Params: {} 2024-04-16T18:09:13.790 DEBUG:boto:Token: None 2024-04-16T18:09:13.790 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-42/ 2024-04-16T18:09:13.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE= 2024-04-16T18:09:13.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ch0+o4w+54Mpxkm/pOMoPuDsCmE=', 'Content-Length': '0'} 2024-04-16T18:09:13.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e05b39c608f2bd80-00661ebec9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.793 DEBUG:boto:b'cjqttm-42MULTIPART1000falseMULTIPART2024-04-16T18:09:02.571Z"d07d411772772538cd4b657da660bfb5-4"20971520STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:13.794 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-42 zones={test-zone2, test-zone1} 2024-04-16T18:09:13.794 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync ... ok 2024-04-16T18:09:13.795 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-44 2024-04-16T18:09:13.795 DEBUG:boto:path=/cjqttm-44/ 2024-04-16T18:09:13.795 DEBUG:boto:auth_path=/cjqttm-44/ 2024-04-16T18:09:13.795 DEBUG:boto:Method: PUT 2024-04-16T18:09:13.795 DEBUG:boto:Path: /cjqttm-44/ 2024-04-16T18:09:13.795 DEBUG:boto:Data: 2024-04-16T18:09:13.795 DEBUG:boto:Headers: {} 2024-04-16T18:09:13.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.795 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.795 DEBUG:boto:Params: {} 2024-04-16T18:09:13.796 DEBUG:boto:Token: None 2024-04-16T18:09:13.796 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:09:13 GMT /cjqttm-44/ 2024-04-16T18:09:13.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VKrwXxkZ1jeKxJa/lwJL8O8rCog= 2024-04-16T18:09:13.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VKrwXxkZ1jeKxJa/lwJL8O8rCog=', 'Content-Length': '0'} 2024-04-16T18:09:13.812 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000cc17340c5e5ad2f2-00661ebec9-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.813 DEBUG:boto:path=/cjqttm-44/testobj-sse-c 2024-04-16T18:09:13.813 DEBUG:boto:auth_path=/cjqttm-44/testobj-sse-c 2024-04-16T18:09:13.813 DEBUG:boto:Method: PUT 2024-04-16T18:09:13.813 DEBUG:boto:Path: /cjqttm-44/testobj-sse-c 2024-04-16T18:09:13.813 DEBUG:boto:Data: 2024-04-16T18:09:13.813 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-16T18:09:13.813 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.813 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.813 DEBUG:boto:Params: {} 2024-04-16T18:09:13.813 DEBUG:boto:Token: None 2024-04-16T18:09:13.813 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Tue, 16 Apr 2024 18:09:13 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /cjqttm-44/testobj-sse-c 2024-04-16T18:09:13.814 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q8NILg/togE6w+gtsERUamXVQO0= 2024-04-16T18:09:13.814 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q8NILg/togE6w+gtsERUamXVQO0='} 2024-04-16T18:09:13.821 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('x-amz-request-id', 'tx000000c4eab23d05132ae-00661ebec9-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.821 DEBUG:boto:path=/cjqttm-44/testobj-sse-kms 2024-04-16T18:09:13.821 DEBUG:boto:auth_path=/cjqttm-44/testobj-sse-kms 2024-04-16T18:09:13.821 DEBUG:boto:Method: PUT 2024-04-16T18:09:13.822 DEBUG:boto:Path: /cjqttm-44/testobj-sse-kms 2024-04-16T18:09:13.822 DEBUG:boto:Data: 2024-04-16T18:09:13.822 DEBUG:boto:Headers: {'x-amz-server-side-encryption': 'aws:kms', 'x-amz-server-side-encryption-aws-kms-key-id': 'testkey-1', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue'} 2024-04-16T18:09:13.822 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:13.822 DEBUG:boto:Port: 8000 2024-04-16T18:09:13.822 DEBUG:boto:Params: {} 2024-04-16T18:09:13.822 DEBUG:boto:Token: None 2024-04-16T18:09:13.822 DEBUG:boto:StringToSign: PUT 3FCGuEcom6i4veFJuDiBdQ== application/octet-stream Tue, 16 Apr 2024 18:09:13 GMT x-amz-server-side-encryption:aws:kms x-amz-server-side-encryption-aws-kms-key-id:testkey-1 /cjqttm-44/testobj-sse-kms 2024-04-16T18:09:13.822 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+DuTc8R3J3Xtmk6bArX8tBT3aVI= 2024-04-16T18:09:13.822 DEBUG:boto:Final headers: {'x-amz-server-side-encryption': 'aws:kms', 'x-amz-server-side-encryption-aws-kms-key-id': 'testkey-1', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': '3FCGuEcom6i4veFJuDiBdQ==', 'Content-Length': '512', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+DuTc8R3J3Xtmk6bArX8tBT3aVI='} 2024-04-16T18:09:13.866 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('Accept-Ranges', 'bytes'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('x-amz-server-side-encryption-context', 'eyJhd3M6czM6YXJuIjoiYXJuOmF3czpzMzo6cmd3LW11bHRpc2l0ZS10ZXN0LXVzZXI6Y2pxdHRtLTQ0L3Rlc3RvYmotc3NlLWttcyJ9'), ('x-amz-request-id', 'tx0000035429f517cc97bfc-00661ebec9-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:13.867 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:13.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:13.867 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:13.916 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:13.916 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:13.969 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:09:13.991 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290953.812972_599.1","last_update":"2024-04-16T18:09:13.812972Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:09:13.991 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290953.812972_599.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:13.991 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:09:13.991 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:13.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:13.992 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:14.046 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:14.046 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:14.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:14.102+0000 7f00d282e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:14.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:14.103+0000 7f00d282e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:14.124 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290953.804417_596.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:13.804417Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:14Z"} 2024-04-16T18:09:14.124 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290953.804417_596.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:13.804417Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:14Z"} 2024-04-16T18:09:14.124 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290953.804417_596.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:09:13.804417Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:09:14.124 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290953.812972_599.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:14.124 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290953.804417_596.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:14.124 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290953.812972_599.1 target=1_1713290953.804417_596.1 2024-04-16T18:09:19.126 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:19.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:19.126 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:19.182 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:19.182 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:19.236 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:19.238+0000 7f949a133800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:19.238 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:19.239+0000 7f949a133800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:19.260 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290953.812972_599.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:13.812972Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:19Z"} 2024-04-16T18:09:19.260 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290953.812972_599.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:13.812972Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:19Z"} 2024-04-16T18:09:19.260 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290953.812972_599.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:09:13.812972Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:09:19.260 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290953.812972_599.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:19.260 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290953.812972_599.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:19.260 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:09:19.261 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-44', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:19.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-44', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:19.261 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-44 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:09:19.316 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:19.316 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:19.378+0000 7f5a62133800 1 bucket sync caught up with source: 2024-04-16T18:09:19.377 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.47.6, , , , 00000000001.18.6, , , , , ] 2024-04-16T18:09:19.377 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000001.47.6, , , , 00000000001.18.6, , , , , ] 2024-04-16T18:09:19.377 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:19.378+0000 7f5a62133800 0 bucket checkpoint complete 2024-04-16T18:09:19.397 DEBUG:boto:path=/cjqttm-44/ 2024-04-16T18:09:19.397 DEBUG:boto:auth_path=/cjqttm-44/ 2024-04-16T18:09:19.398 DEBUG:boto:Method: HEAD 2024-04-16T18:09:19.398 DEBUG:boto:Path: /cjqttm-44/ 2024-04-16T18:09:19.398 DEBUG:boto:Data: 2024-04-16T18:09:19.398 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.398 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:19.398 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.398 DEBUG:boto:Params: {} 2024-04-16T18:09:19.398 DEBUG:boto:Token: None 2024-04-16T18:09:19.398 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-44/ 2024-04-16T18:09:19.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3ZIy/eHKJ/GGSLlFmpRDDL3rADU= 2024-04-16T18:09:19.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3ZIy/eHKJ/GGSLlFmpRDDL3rADU=', 'Content-Length': '0'} 2024-04-16T18:09:19.401 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '1024'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c254f3dca55bab0f-00661ebecf-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.402 DEBUG:boto:path=/cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.402 DEBUG:boto:auth_path=/cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.402 DEBUG:boto:Method: HEAD 2024-04-16T18:09:19.402 DEBUG:boto:Path: /cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.402 DEBUG:boto:Data: 2024-04-16T18:09:19.402 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw=='} 2024-04-16T18:09:19.402 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:19.403 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.403 DEBUG:boto:Params: {} 2024-04-16T18:09:19.403 DEBUG:boto:Token: None 2024-04-16T18:09:19.403 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:19 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Venrpm6n3jKT/zEhR2mx/R8nXtE= 2024-04-16T18:09:19.403 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Venrpm6n3jKT/zEhR2mx/R8nXtE=', 'Content-Length': '0'} 2024-04-16T18:09:19.405 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-44:9ba59572-f51c-4bce-9578-e6350e822996.4816.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:17 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx000009a89559f7285c8a9-00661ebecf-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.405 DEBUG:boto:path=/cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.405 DEBUG:boto:auth_path=/cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.405 DEBUG:boto:Method: GET 2024-04-16T18:09:19.405 DEBUG:boto:Path: /cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.406 DEBUG:boto:Data: 2024-04-16T18:09:19.406 DEBUG:boto:Headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw=='} 2024-04-16T18:09:19.406 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:19.406 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.406 DEBUG:boto:Params: {} 2024-04-16T18:09:19.406 DEBUG:boto:Token: None 2024-04-16T18:09:19.406 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:19 GMT x-amz-server-side-encryption-customer-algorithm:AES256 x-amz-server-side-encryption-customer-key:pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= x-amz-server-side-encryption-customer-key-md5:DWygnHRtgiJ77HCm+1rvHw== /cjqttm-44/testobj-sse-c 2024-04-16T18:09:19.406 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nu1+wVf9ffYq0K6rw2FdmemsOzY= 2024-04-16T18:09:19.406 DEBUG:boto:Final headers: {'x-amz-server-side-encryption-customer-algorithm': 'AES256', 'x-amz-server-side-encryption-customer-key': 'pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs=', 'x-amz-server-side-encryption-customer-key-md5': 'DWygnHRtgiJ77HCm+1rvHw==', 'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nu1+wVf9ffYq0K6rw2FdmemsOzY=', 'Content-Length': '0'} 2024-04-16T18:09:19.408 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption-customer-algorithm', 'AES256'), ('x-amz-server-side-encryption-customer-key-MD5', 'DWygnHRtgiJ77HCm+1rvHw=='), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-44:9ba59572-f51c-4bce-9578-e6350e822996.4816.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:17 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx00000fdd466440fbe73cd-00661ebecf-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.409 DEBUG:boto:path=/cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.409 DEBUG:boto:auth_path=/cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.409 DEBUG:boto:Method: HEAD 2024-04-16T18:09:19.409 DEBUG:boto:Path: /cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.409 DEBUG:boto:Data: 2024-04-16T18:09:19.409 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.409 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:19.409 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.409 DEBUG:boto:Params: {} 2024-04-16T18:09:19.409 DEBUG:boto:Token: None 2024-04-16T18:09:19.409 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.410 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NUGnBUXifs45OowMFKXqPrR5Dn4= 2024-04-16T18:09:19.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NUGnBUXifs45OowMFKXqPrR5Dn4=', 'Content-Length': '0'} 2024-04-16T18:09:19.411 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-44:9ba59572-f51c-4bce-9578-e6350e822996.4816.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:17 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx000000639085cfbc449ea-00661ebecf-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.412 DEBUG:boto:path=/cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.412 DEBUG:boto:auth_path=/cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.412 DEBUG:boto:Method: GET 2024-04-16T18:09:19.412 DEBUG:boto:Path: /cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.412 DEBUG:boto:Data: 2024-04-16T18:09:19.412 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.412 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:19.412 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.412 DEBUG:boto:Params: {} 2024-04-16T18:09:19.413 DEBUG:boto:Token: None 2024-04-16T18:09:19.413 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-44/testobj-sse-kms 2024-04-16T18:09:19.413 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QUFdwUbWmry08GiJ3plUiMUuE/8= 2024-04-16T18:09:19.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QUFdwUbWmry08GiJ3plUiMUuE/8=', 'Content-Length': '0'} 2024-04-16T18:09:19.415 DEBUG:boto:Response headers: [('Content-Length', '512'), ('x-amz-server-side-encryption', 'aws:kms'), ('x-amz-server-side-encryption-aws-kms-key-id', 'testkey-1'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:13 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-44:9ba59572-f51c-4bce-9578-e6350e822996.4816.13'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:17 GMT'), ('ETag', '"dc5086b847289ba8b8bde149b8388175"'), ('x-amz-request-id', 'tx000000c8cd7f0b336cb8a-00661ebecf-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.415 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_encrypted_object_sync ... ok 2024-04-16T18:09:19.416 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-45 2024-04-16T18:09:19.416 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:19.416 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:19.416 DEBUG:boto:Method: PUT 2024-04-16T18:09:19.416 DEBUG:boto:Path: /cjqttm-45/ 2024-04-16T18:09:19.416 DEBUG:boto:Data: 2024-04-16T18:09:19.416 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.416 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.416 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.417 DEBUG:boto:Params: {} 2024-04-16T18:09:19.417 DEBUG:boto:Token: None 2024-04-16T18:09:19.417 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/ 2024-04-16T18:09:19.417 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j82VuEGlhRih6gaZ02GSx2mqF6o= 2024-04-16T18:09:19.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j82VuEGlhRih6gaZ02GSx2mqF6o=', 'Content-Length': '0'} 2024-04-16T18:09:19.436 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f035af4ee83de25d-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.436 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:19.436 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:19.436 DEBUG:boto:Method: HEAD 2024-04-16T18:09:19.436 DEBUG:boto:Path: /cjqttm-45/ 2024-04-16T18:09:19.436 DEBUG:boto:Data: 2024-04-16T18:09:19.436 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.437 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.437 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.437 DEBUG:boto:Params: {} 2024-04-16T18:09:19.437 DEBUG:boto:Token: None 2024-04-16T18:09:19.437 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/ 2024-04-16T18:09:19.437 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c= 2024-04-16T18:09:19.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c=', 'Content-Length': '0'} 2024-04-16T18:09:19.439 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e04c0421bc1a0e63-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.439 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:19.439 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:19.440 DEBUG:boto:Method: PUT 2024-04-16T18:09:19.440 DEBUG:boto:Path: /cjqttm-45/a 2024-04-16T18:09:19.440 DEBUG:boto:Data: 2024-04-16T18:09:19.440 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:19.440 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.440 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.440 DEBUG:boto:Params: {} 2024-04-16T18:09:19.440 DEBUG:boto:Token: None 2024-04-16T18:09:19.440 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/a 2024-04-16T18:09:19.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EagxgH0IVUw8XSfwwoOCINwT5DU= 2024-04-16T18:09:19.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EagxgH0IVUw8XSfwwoOCINwT5DU='} 2024-04-16T18:09:19.448 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009088be90410d6711-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.448 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:19.449 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:19.449 DEBUG:boto:Method: HEAD 2024-04-16T18:09:19.449 DEBUG:boto:Path: /cjqttm-45/ 2024-04-16T18:09:19.449 DEBUG:boto:Data: 2024-04-16T18:09:19.449 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.449 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.449 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.449 DEBUG:boto:Params: {} 2024-04-16T18:09:19.449 DEBUG:boto:Token: None 2024-04-16T18:09:19.449 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/ 2024-04-16T18:09:19.449 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c= 2024-04-16T18:09:19.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c=', 'Content-Length': '0'} 2024-04-16T18:09:19.452 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dc1b2dda885582eb-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.452 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:19.452 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:19.452 DEBUG:boto:Method: PUT 2024-04-16T18:09:19.452 DEBUG:boto:Path: /cjqttm-45/b 2024-04-16T18:09:19.452 DEBUG:boto:Data: 2024-04-16T18:09:19.452 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:19.452 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.453 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.453 DEBUG:boto:Params: {} 2024-04-16T18:09:19.453 DEBUG:boto:Token: None 2024-04-16T18:09:19.453 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/b 2024-04-16T18:09:19.453 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IcXAn8XlulP2VhYK411pfWNN7A4= 2024-04-16T18:09:19.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IcXAn8XlulP2VhYK411pfWNN7A4='} 2024-04-16T18:09:19.494 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e48ef10836ac80e3-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.495 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:19.495 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:19.495 DEBUG:boto:Method: HEAD 2024-04-16T18:09:19.495 DEBUG:boto:Path: /cjqttm-45/ 2024-04-16T18:09:19.495 DEBUG:boto:Data: 2024-04-16T18:09:19.495 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.495 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.495 DEBUG:boto:Params: {} 2024-04-16T18:09:19.495 DEBUG:boto:Token: None 2024-04-16T18:09:19.495 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/ 2024-04-16T18:09:19.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c= 2024-04-16T18:09:19.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c=', 'Content-Length': '0'} 2024-04-16T18:09:19.498 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009f28231c0b942a89-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.498 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:19.498 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:19.498 DEBUG:boto:Method: PUT 2024-04-16T18:09:19.498 DEBUG:boto:Path: /cjqttm-45/c 2024-04-16T18:09:19.498 DEBUG:boto:Data: 2024-04-16T18:09:19.498 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:19.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.499 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.499 DEBUG:boto:Params: {} 2024-04-16T18:09:19.499 DEBUG:boto:Token: None 2024-04-16T18:09:19.499 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/c 2024-04-16T18:09:19.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CESxuk6WtRrC+xva2G/+iynAhHY= 2024-04-16T18:09:19.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CESxuk6WtRrC+xva2G/+iynAhHY='} 2024-04-16T18:09:19.505 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008c1c5c89838f7781-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.506 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:19.506 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:19.506 DEBUG:boto:Method: HEAD 2024-04-16T18:09:19.506 DEBUG:boto:Path: /cjqttm-45/ 2024-04-16T18:09:19.506 DEBUG:boto:Data: 2024-04-16T18:09:19.506 DEBUG:boto:Headers: {} 2024-04-16T18:09:19.506 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.506 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.506 DEBUG:boto:Params: {} 2024-04-16T18:09:19.507 DEBUG:boto:Token: None 2024-04-16T18:09:19.507 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/ 2024-04-16T18:09:19.507 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c= 2024-04-16T18:09:19.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mst7xqCUMjZe9gjBXL8zarI4t3c=', 'Content-Length': '0'} 2024-04-16T18:09:19.509 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000120d9598ab7a9bbf-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.509 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:19.509 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:19.510 DEBUG:boto:Method: PUT 2024-04-16T18:09:19.510 DEBUG:boto:Path: /cjqttm-45/d 2024-04-16T18:09:19.510 DEBUG:boto:Data: 2024-04-16T18:09:19.510 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:19.510 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:19.510 DEBUG:boto:Port: 8000 2024-04-16T18:09:19.510 DEBUG:boto:Params: {} 2024-04-16T18:09:19.510 DEBUG:boto:Token: None 2024-04-16T18:09:19.510 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:19 GMT /cjqttm-45/d 2024-04-16T18:09:19.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nu4ndjs79Ja0kqQbdJx3PqOlZE0= 2024-04-16T18:09:19.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nu4ndjs79Ja0kqQbdJx3PqOlZE0='} 2024-04-16T18:09:19.517 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d60c4e28ab90fee6-00661ebecf-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:19.517 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:19.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:19.517 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:19.570 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:19.625 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:09:19.648 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290959.435550_603.1","last_update":"2024-04-16T18:09:19.435550Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:09:19.648 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290959.435550_603.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:19.648 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:09:19.649 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:19.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:19.649 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:19.698 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:19.698 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:19.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:19.747+0000 7fd22b40f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:19.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:19.749+0000 7fd22b40f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:19.768 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290959.426075_600.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:19.426075Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:19Z"} 2024-04-16T18:09:19.769 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290959.426075_600.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:19.426075Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:19Z"} 2024-04-16T18:09:19.769 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290959.426075_600.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:09:19.426075Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:09:19.769 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290959.435550_603.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:19.769 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290959.426075_600.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:19.769 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713290959.435550_603.1 target=1_1713290959.426075_600.1 2024-04-16T18:09:24.770 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:24.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:24.770 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:24.825 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:24.880 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:24.881+0000 7f7c71224800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:24.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:24.883+0000 7f7c71224800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:24.903 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290959.435550_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:19.435550Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:24Z"} 2024-04-16T18:09:24.903 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290959.435550_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:19.435550Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:24Z"} 2024-04-16T18:09:24.904 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290959.435550_603.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:09:19.435550Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:09:24.904 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290959.435550_603.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:24.904 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290959.435550_603.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:24.904 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:09:24.904 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-45 2024-04-16T18:09:24.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:24.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-45', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:24.904 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-45 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:09:24.960 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:24.960 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:25.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:25.019+0000 7fd2c492c800 1 bucket sync caught up with source: 2024-04-16T18:09:25.018 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.33.6, , , , 00000000001.40.6, , , 00000000001.31.6, , 00000000001.48.6] 2024-04-16T18:09:25.018 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000001.33.6, , , , 00000000001.40.6, , , 00000000001.31.6, , 00000000001.48.6] 2024-04-16T18:09:25.018 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:25.019+0000 7fd2c492c800 0 bucket checkpoint complete 2024-04-16T18:09:25.039 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-45 2024-04-16T18:09:25.039 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:25.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-45', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:25.039 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-45 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:09:25.102 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:25.102 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:25.162 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:25.164+0000 7fe055a16800 1 waiting to reach incremental sync.. 2024-04-16T18:09:30.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:30.166+0000 7fe055a16800 1 bucket sync caught up with source: 2024-04-16T18:09:30.164 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.617.6, , , , 00000000001.334.6, , , 00000000001.162.6, , 00000000001.1242.6] 2024-04-16T18:09:30.164 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.617.6, , , , 00000000001.334.6, , , 00000000001.162.6, , 00000000001.1242.6] 2024-04-16T18:09:30.164 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:30.166+0000 7fe055a16800 0 bucket checkpoint complete 2024-04-16T18:09:30.191 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-45 zones={test-zone2, test-zone1} 2024-04-16T18:09:30.191 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.191 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.191 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.191 DEBUG:boto:Path: /cjqttm-45/ 2024-04-16T18:09:30.191 DEBUG:boto:Data: 2024-04-16T18:09:30.191 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.191 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.192 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.192 DEBUG:boto:Params: {} 2024-04-16T18:09:30.192 DEBUG:boto:Token: None 2024-04-16T18:09:30.192 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:moWb80qgxk7xkVk6Fq3jiKfACKk= 2024-04-16T18:09:30.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:moWb80qgxk7xkVk6Fq3jiKfACKk=', 'Content-Length': '0'} 2024-04-16T18:09:30.195 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000004ee53cbe1c5a207-00661ebeda-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.195 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.195 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.196 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.196 DEBUG:boto:Path: /cjqttm-45/ 2024-04-16T18:09:30.196 DEBUG:boto:Data: 2024-04-16T18:09:30.196 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.196 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.196 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.196 DEBUG:boto:Params: {} 2024-04-16T18:09:30.196 DEBUG:boto:Token: None 2024-04-16T18:09:30.196 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:moWb80qgxk7xkVk6Fq3jiKfACKk= 2024-04-16T18:09:30.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:moWb80qgxk7xkVk6Fq3jiKfACKk=', 'Content-Length': '0'} 2024-04-16T18:09:30.199 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cc09b2a9f13e04eb-00661ebeda-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.199 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:09:30.199 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.199 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.199 DEBUG:boto:path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.199 DEBUG:boto:auth_path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.199 DEBUG:boto:Method: GET 2024-04-16T18:09:30.199 DEBUG:boto:Path: /cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.199 DEBUG:boto:Data: 2024-04-16T18:09:30.200 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.200 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.200 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.200 DEBUG:boto:Params: {} 2024-04-16T18:09:30.200 DEBUG:boto:Token: None 2024-04-16T18:09:30.200 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/?versions 2024-04-16T18:09:30.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc= 2024-04-16T18:09:30.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc=', 'Content-Length': '0'} 2024-04-16T18:09:30.203 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000192c4b77f16c9428-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.203 DEBUG:boto:b'cjqttm-45999falseanulltrue2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.203 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:09:30.203 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:09:30.204 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:09:30.204 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:09:30.204 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:09:30.204 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.204 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.204 DEBUG:boto:path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.204 DEBUG:boto:auth_path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.204 DEBUG:boto:Method: GET 2024-04-16T18:09:30.204 DEBUG:boto:Path: /cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.204 DEBUG:boto:Data: 2024-04-16T18:09:30.204 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.205 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.205 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.205 DEBUG:boto:Params: {} 2024-04-16T18:09:30.205 DEBUG:boto:Token: None 2024-04-16T18:09:30.205 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/?versions 2024-04-16T18:09:30.205 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc= 2024-04-16T18:09:30.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc=', 'Content-Length': '0'} 2024-04-16T18:09:30.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f22a97104ba0e6ce-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.207 DEBUG:boto:b'cjqttm-45999falseanulltrue2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.208 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:09:30.208 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:09:30.208 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:09:30.208 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:09:30.208 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.208 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.208 DEBUG:boto:path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.208 DEBUG:boto:auth_path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.209 DEBUG:boto:Method: GET 2024-04-16T18:09:30.209 DEBUG:boto:Path: /cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.209 DEBUG:boto:Data: 2024-04-16T18:09:30.209 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.209 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.209 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.209 DEBUG:boto:Params: {} 2024-04-16T18:09:30.209 DEBUG:boto:Token: None 2024-04-16T18:09:30.209 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/?versions 2024-04-16T18:09:30.209 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc= 2024-04-16T18:09:30.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc=', 'Content-Length': '0'} 2024-04-16T18:09:30.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009bd3ee7bfe4ecf39-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.212 DEBUG:boto:b'cjqttm-45999falseanulltrue2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.212 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.212 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.213 DEBUG:boto:path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.213 DEBUG:boto:auth_path=/cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.213 DEBUG:boto:Method: GET 2024-04-16T18:09:30.213 DEBUG:boto:Path: /cjqttm-45/?versions&max-keys=999 2024-04-16T18:09:30.213 DEBUG:boto:Data: 2024-04-16T18:09:30.213 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.213 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.213 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.213 DEBUG:boto:Params: {} 2024-04-16T18:09:30.213 DEBUG:boto:Token: None 2024-04-16T18:09:30.213 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/?versions 2024-04-16T18:09:30.213 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc= 2024-04-16T18:09:30.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+PHzWpVotbOm7BJnqCMnb60Olmc=', 'Content-Length': '0'} 2024-04-16T18:09:30.216 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f0e6251967a2c46-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.216 DEBUG:boto:b'cjqttm-45999falseanulltrue2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.216 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:09:30.216 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.217 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.217 DEBUG:boto:path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.217 DEBUG:boto:auth_path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.217 DEBUG:boto:Method: GET 2024-04-16T18:09:30.217 DEBUG:boto:Path: /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.217 DEBUG:boto:Data: 2024-04-16T18:09:30.217 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.217 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.217 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.217 DEBUG:boto:Params: {} 2024-04-16T18:09:30.217 DEBUG:boto:Token: None 2024-04-16T18:09:30.218 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.218 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU= 2024-04-16T18:09:30.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU=', 'Content-Length': '0'} 2024-04-16T18:09:30.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bad1d06f5e546a6-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.262 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.263 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.263 DEBUG:boto:path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.263 DEBUG:boto:auth_path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.263 DEBUG:boto:Method: GET 2024-04-16T18:09:30.263 DEBUG:boto:Path: /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.263 DEBUG:boto:Data: 2024-04-16T18:09:30.263 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.263 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.263 DEBUG:boto:Params: {} 2024-04-16T18:09:30.263 DEBUG:boto:Token: None 2024-04-16T18:09:30.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU= 2024-04-16T18:09:30.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU=', 'Content-Length': '0'} 2024-04-16T18:09:30.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c2220cd18a90f99-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.266 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.266 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.266 DEBUG:boto:path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.267 DEBUG:boto:auth_path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.267 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.267 DEBUG:boto:Path: /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.267 DEBUG:boto:Data: 2024-04-16T18:09:30.267 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.267 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.267 DEBUG:boto:Params: {} 2024-04-16T18:09:30.267 DEBUG:boto:Token: None 2024-04-16T18:09:30.267 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4C3/MRyMmpO1xhB3giT5SJ0iWw= 2024-04-16T18:09:30.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4C3/MRyMmpO1xhB3giT5SJ0iWw=', 'Content-Length': '0'} 2024-04-16T18:09:30.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd28bccca6669b8a-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.270 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.270 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.270 DEBUG:boto:path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.270 DEBUG:boto:auth_path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.270 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.270 DEBUG:boto:Path: /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.270 DEBUG:boto:Data: 2024-04-16T18:09:30.271 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.271 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.271 DEBUG:boto:Params: {} 2024-04-16T18:09:30.271 DEBUG:boto:Token: None 2024-04-16T18:09:30.271 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4C3/MRyMmpO1xhB3giT5SJ0iWw= 2024-04-16T18:09:30.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4C3/MRyMmpO1xhB3giT5SJ0iWw=', 'Content-Length': '0'} 2024-04-16T18:09:30.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba9691d27c27aaed-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.273 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:09:30.274 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.274 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.274 DEBUG:boto:path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.274 DEBUG:boto:auth_path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.274 DEBUG:boto:Method: GET 2024-04-16T18:09:30.274 DEBUG:boto:Path: /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.274 DEBUG:boto:Data: 2024-04-16T18:09:30.274 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.274 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.274 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.274 DEBUG:boto:Params: {} 2024-04-16T18:09:30.274 DEBUG:boto:Token: None 2024-04-16T18:09:30.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU= 2024-04-16T18:09:30.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU=', 'Content-Length': '0'} 2024-04-16T18:09:30.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000300eb43c6a7bc394-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.277 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.277 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.277 DEBUG:boto:path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.277 DEBUG:boto:auth_path=/cjqttm-45/a?versionId=null 2024-04-16T18:09:30.277 DEBUG:boto:Method: GET 2024-04-16T18:09:30.277 DEBUG:boto:Path: /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.278 DEBUG:boto:Data: 2024-04-16T18:09:30.278 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.278 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.278 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.278 DEBUG:boto:Params: {} 2024-04-16T18:09:30.278 DEBUG:boto:Token: None 2024-04-16T18:09:30.278 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a?versionId=null 2024-04-16T18:09:30.278 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU= 2024-04-16T18:09:30.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KwkhvRgOhsoQxBFkwAH+6RJRkxU=', 'Content-Length': '0'} 2024-04-16T18:09:30.280 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005dbcf0a2c7c3e8c-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.281 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.281 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.281 DEBUG:boto:path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.281 DEBUG:boto:auth_path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.281 DEBUG:boto:Method: GET 2024-04-16T18:09:30.281 DEBUG:boto:Path: /cjqttm-45/?prefix=a 2024-04-16T18:09:30.281 DEBUG:boto:Data: 2024-04-16T18:09:30.281 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.281 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.281 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.281 DEBUG:boto:Params: {} 2024-04-16T18:09:30.282 DEBUG:boto:Token: None 2024-04-16T18:09:30.282 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.282 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb4c6c543f895b3c-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.285 DEBUG:boto:b'cjqttm-45a1000falsea2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.285 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.285 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.285 DEBUG:boto:path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.285 DEBUG:boto:auth_path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.285 DEBUG:boto:Method: GET 2024-04-16T18:09:30.285 DEBUG:boto:Path: /cjqttm-45/?prefix=a 2024-04-16T18:09:30.285 DEBUG:boto:Data: 2024-04-16T18:09:30.285 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.286 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.286 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.286 DEBUG:boto:Params: {} 2024-04-16T18:09:30.286 DEBUG:boto:Token: None 2024-04-16T18:09:30.286 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.286 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.288 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009011473afc74275f-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.288 DEBUG:boto:b'cjqttm-45a1000falsea2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.289 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.289 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.289 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.289 DEBUG:boto:Path: /cjqttm-45/a 2024-04-16T18:09:30.289 DEBUG:boto:Data: 2024-04-16T18:09:30.289 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.289 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.289 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.289 DEBUG:boto:Params: {} 2024-04-16T18:09:30.290 DEBUG:boto:Token: None 2024-04-16T18:09:30.290 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a 2024-04-16T18:09:30.290 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AhS18+k99GQYtwdOVC7gJ/ayndY= 2024-04-16T18:09:30.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AhS18+k99GQYtwdOVC7gJ/ayndY=', 'Content-Length': '0'} 2024-04-16T18:09:30.292 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006277a2eaaef4c487-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.292 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.292 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.292 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.292 DEBUG:boto:Path: /cjqttm-45/a 2024-04-16T18:09:30.292 DEBUG:boto:Data: 2024-04-16T18:09:30.293 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.293 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.293 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.293 DEBUG:boto:Params: {} 2024-04-16T18:09:30.293 DEBUG:boto:Token: None 2024-04-16T18:09:30.293 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a 2024-04-16T18:09:30.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AhS18+k99GQYtwdOVC7gJ/ayndY= 2024-04-16T18:09:30.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AhS18+k99GQYtwdOVC7gJ/ayndY=', 'Content-Length': '0'} 2024-04-16T18:09:30.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b4c4db42fd293cc-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.295 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:09:30.295 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.296 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.296 DEBUG:boto:Method: GET 2024-04-16T18:09:30.296 DEBUG:boto:Path: /cjqttm-45/a 2024-04-16T18:09:30.296 DEBUG:boto:Data: 2024-04-16T18:09:30.296 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.296 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.296 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.296 DEBUG:boto:Params: {} 2024-04-16T18:09:30.296 DEBUG:boto:Token: None 2024-04-16T18:09:30.296 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a 2024-04-16T18:09:30.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wJGxYl5TZOePGKLfypg8GFoZsHE= 2024-04-16T18:09:30.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wJGxYl5TZOePGKLfypg8GFoZsHE=', 'Content-Length': '0'} 2024-04-16T18:09:30.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1b8f588e51e8607-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.342 DEBUG:boto:path=/cjqttm-45/a 2024-04-16T18:09:30.342 DEBUG:boto:auth_path=/cjqttm-45/a 2024-04-16T18:09:30.342 DEBUG:boto:Method: GET 2024-04-16T18:09:30.343 DEBUG:boto:Path: /cjqttm-45/a 2024-04-16T18:09:30.343 DEBUG:boto:Data: 2024-04-16T18:09:30.343 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.343 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.343 DEBUG:boto:Params: {} 2024-04-16T18:09:30.343 DEBUG:boto:Token: None 2024-04-16T18:09:30.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/a 2024-04-16T18:09:30.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wJGxYl5TZOePGKLfypg8GFoZsHE= 2024-04-16T18:09:30.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wJGxYl5TZOePGKLfypg8GFoZsHE=', 'Content-Length': '0'} 2024-04-16T18:09:30.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a362e70cd6d9c33-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.346 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.346 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.346 DEBUG:boto:path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.346 DEBUG:boto:auth_path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.346 DEBUG:boto:Method: GET 2024-04-16T18:09:30.346 DEBUG:boto:Path: /cjqttm-45/?prefix=a 2024-04-16T18:09:30.346 DEBUG:boto:Data: 2024-04-16T18:09:30.346 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.346 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.346 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.346 DEBUG:boto:Params: {} 2024-04-16T18:09:30.347 DEBUG:boto:Token: None 2024-04-16T18:09:30.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc37d738bb49d3da-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.350 DEBUG:boto:b'cjqttm-45a1000falsea2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.350 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.350 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.350 DEBUG:boto:path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.350 DEBUG:boto:auth_path=/cjqttm-45/?prefix=a 2024-04-16T18:09:30.350 DEBUG:boto:Method: GET 2024-04-16T18:09:30.350 DEBUG:boto:Path: /cjqttm-45/?prefix=a 2024-04-16T18:09:30.350 DEBUG:boto:Data: 2024-04-16T18:09:30.350 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.351 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.351 DEBUG:boto:Params: {} 2024-04-16T18:09:30.351 DEBUG:boto:Token: None 2024-04-16T18:09:30.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca93d852b6721fa0-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.353 DEBUG:boto:b'cjqttm-45a1000falsea2024-04-16T18:09:19.445Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:09:30.354 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.354 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.354 DEBUG:boto:path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.354 DEBUG:boto:auth_path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.354 DEBUG:boto:Method: GET 2024-04-16T18:09:30.354 DEBUG:boto:Path: /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.354 DEBUG:boto:Data: 2024-04-16T18:09:30.354 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.354 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.354 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.354 DEBUG:boto:Params: {} 2024-04-16T18:09:30.355 DEBUG:boto:Token: None 2024-04-16T18:09:30.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM= 2024-04-16T18:09:30.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM=', 'Content-Length': '0'} 2024-04-16T18:09:30.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c80edf00706d1557-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.398 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.398 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.399 DEBUG:boto:path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.399 DEBUG:boto:auth_path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.399 DEBUG:boto:Method: GET 2024-04-16T18:09:30.399 DEBUG:boto:Path: /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.399 DEBUG:boto:Data: 2024-04-16T18:09:30.399 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.399 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.399 DEBUG:boto:Params: {} 2024-04-16T18:09:30.400 DEBUG:boto:Token: None 2024-04-16T18:09:30.400 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM= 2024-04-16T18:09:30.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM=', 'Content-Length': '0'} 2024-04-16T18:09:30.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a2b5cd4610a417a-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.402 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.402 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.402 DEBUG:boto:path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.402 DEBUG:boto:auth_path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.403 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.403 DEBUG:boto:Path: /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.403 DEBUG:boto:Data: 2024-04-16T18:09:30.403 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.403 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.403 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.403 DEBUG:boto:Params: {} 2024-04-16T18:09:30.403 DEBUG:boto:Token: None 2024-04-16T18:09:30.403 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zU8XI6Mwy+5uuV30tCEJ8cLLsHo= 2024-04-16T18:09:30.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zU8XI6Mwy+5uuV30tCEJ8cLLsHo=', 'Content-Length': '0'} 2024-04-16T18:09:30.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a253379c8185dc6e-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.405 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.406 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.406 DEBUG:boto:path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.406 DEBUG:boto:auth_path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.406 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.406 DEBUG:boto:Path: /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.406 DEBUG:boto:Data: 2024-04-16T18:09:30.406 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.406 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.406 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.406 DEBUG:boto:Params: {} 2024-04-16T18:09:30.406 DEBUG:boto:Token: None 2024-04-16T18:09:30.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zU8XI6Mwy+5uuV30tCEJ8cLLsHo= 2024-04-16T18:09:30.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zU8XI6Mwy+5uuV30tCEJ8cLLsHo=', 'Content-Length': '0'} 2024-04-16T18:09:30.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e551266f5023a670-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:09:30.409 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.409 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.409 DEBUG:boto:path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.410 DEBUG:boto:auth_path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.410 DEBUG:boto:Method: GET 2024-04-16T18:09:30.410 DEBUG:boto:Path: /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.410 DEBUG:boto:Data: 2024-04-16T18:09:30.410 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.410 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.410 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.410 DEBUG:boto:Params: {} 2024-04-16T18:09:30.410 DEBUG:boto:Token: None 2024-04-16T18:09:30.410 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM= 2024-04-16T18:09:30.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM=', 'Content-Length': '0'} 2024-04-16T18:09:30.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089b6bd61d1bdfb7b-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.454 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.455 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.455 DEBUG:boto:path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.455 DEBUG:boto:auth_path=/cjqttm-45/b?versionId=null 2024-04-16T18:09:30.455 DEBUG:boto:Method: GET 2024-04-16T18:09:30.455 DEBUG:boto:Path: /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.455 DEBUG:boto:Data: 2024-04-16T18:09:30.455 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.455 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.455 DEBUG:boto:Params: {} 2024-04-16T18:09:30.456 DEBUG:boto:Token: None 2024-04-16T18:09:30.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b?versionId=null 2024-04-16T18:09:30.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM= 2024-04-16T18:09:30.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDv6Co9sP3q9u9YyOjrhGTKilmM=', 'Content-Length': '0'} 2024-04-16T18:09:30.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd61a7c2b71616d0-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.458 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.458 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.458 DEBUG:boto:path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.458 DEBUG:boto:auth_path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.459 DEBUG:boto:Method: GET 2024-04-16T18:09:30.459 DEBUG:boto:Path: /cjqttm-45/?prefix=b 2024-04-16T18:09:30.459 DEBUG:boto:Data: 2024-04-16T18:09:30.459 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.459 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.459 DEBUG:boto:Params: {} 2024-04-16T18:09:30.459 DEBUG:boto:Token: None 2024-04-16T18:09:30.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.462 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce9345d5135192f3-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.462 DEBUG:boto:b'cjqttm-45b1000falseb2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.462 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.462 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.462 DEBUG:boto:path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.463 DEBUG:boto:auth_path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.463 DEBUG:boto:Method: GET 2024-04-16T18:09:30.463 DEBUG:boto:Path: /cjqttm-45/?prefix=b 2024-04-16T18:09:30.463 DEBUG:boto:Data: 2024-04-16T18:09:30.463 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.463 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.463 DEBUG:boto:Params: {} 2024-04-16T18:09:30.463 DEBUG:boto:Token: None 2024-04-16T18:09:30.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b04bbb1fb6b1749-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.466 DEBUG:boto:b'cjqttm-45b1000falseb2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.466 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.466 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.466 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.466 DEBUG:boto:Path: /cjqttm-45/b 2024-04-16T18:09:30.466 DEBUG:boto:Data: 2024-04-16T18:09:30.466 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.466 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.467 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.467 DEBUG:boto:Params: {} 2024-04-16T18:09:30.467 DEBUG:boto:Token: None 2024-04-16T18:09:30.467 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b 2024-04-16T18:09:30.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ToBLg0atFj0hH73WJpY4Ay8xg0Y= 2024-04-16T18:09:30.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ToBLg0atFj0hH73WJpY4Ay8xg0Y=', 'Content-Length': '0'} 2024-04-16T18:09:30.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004509c1c672fbe44a-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.469 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.469 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.469 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.469 DEBUG:boto:Path: /cjqttm-45/b 2024-04-16T18:09:30.469 DEBUG:boto:Data: 2024-04-16T18:09:30.469 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.470 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.470 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.470 DEBUG:boto:Params: {} 2024-04-16T18:09:30.470 DEBUG:boto:Token: None 2024-04-16T18:09:30.470 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b 2024-04-16T18:09:30.470 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ToBLg0atFj0hH73WJpY4Ay8xg0Y= 2024-04-16T18:09:30.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ToBLg0atFj0hH73WJpY4Ay8xg0Y=', 'Content-Length': '0'} 2024-04-16T18:09:30.472 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000280182d956658a0e-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.472 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:09:30.472 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.472 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.472 DEBUG:boto:Method: GET 2024-04-16T18:09:30.473 DEBUG:boto:Path: /cjqttm-45/b 2024-04-16T18:09:30.473 DEBUG:boto:Data: 2024-04-16T18:09:30.473 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.473 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.473 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.473 DEBUG:boto:Params: {} 2024-04-16T18:09:30.473 DEBUG:boto:Token: None 2024-04-16T18:09:30.473 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b 2024-04-16T18:09:30.473 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9PLDcRrgFZMHTVvALxJAlGWaPiQ= 2024-04-16T18:09:30.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9PLDcRrgFZMHTVvALxJAlGWaPiQ=', 'Content-Length': '0'} 2024-04-16T18:09:30.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000050e6cbcd7d02ad2-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.518 DEBUG:boto:path=/cjqttm-45/b 2024-04-16T18:09:30.519 DEBUG:boto:auth_path=/cjqttm-45/b 2024-04-16T18:09:30.519 DEBUG:boto:Method: GET 2024-04-16T18:09:30.519 DEBUG:boto:Path: /cjqttm-45/b 2024-04-16T18:09:30.519 DEBUG:boto:Data: 2024-04-16T18:09:30.519 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.519 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.519 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.519 DEBUG:boto:Params: {} 2024-04-16T18:09:30.519 DEBUG:boto:Token: None 2024-04-16T18:09:30.519 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/b 2024-04-16T18:09:30.519 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9PLDcRrgFZMHTVvALxJAlGWaPiQ= 2024-04-16T18:09:30.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9PLDcRrgFZMHTVvALxJAlGWaPiQ=', 'Content-Length': '0'} 2024-04-16T18:09:30.522 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9b2b489000d05db-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.522 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.522 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.522 DEBUG:boto:path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.523 DEBUG:boto:auth_path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.523 DEBUG:boto:Method: GET 2024-04-16T18:09:30.523 DEBUG:boto:Path: /cjqttm-45/?prefix=b 2024-04-16T18:09:30.523 DEBUG:boto:Data: 2024-04-16T18:09:30.523 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.523 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.523 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.523 DEBUG:boto:Params: {} 2024-04-16T18:09:30.523 DEBUG:boto:Token: None 2024-04-16T18:09:30.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.526 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6419978a082c4a6-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.526 DEBUG:boto:b'cjqttm-45b1000falseb2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.526 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.526 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.527 DEBUG:boto:path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.527 DEBUG:boto:auth_path=/cjqttm-45/?prefix=b 2024-04-16T18:09:30.527 DEBUG:boto:Method: GET 2024-04-16T18:09:30.527 DEBUG:boto:Path: /cjqttm-45/?prefix=b 2024-04-16T18:09:30.527 DEBUG:boto:Data: 2024-04-16T18:09:30.527 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.527 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.527 DEBUG:boto:Params: {} 2024-04-16T18:09:30.527 DEBUG:boto:Token: None 2024-04-16T18:09:30.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b784719252699547-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.530 DEBUG:boto:b'cjqttm-45b1000falseb2024-04-16T18:09:19.457Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.530 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:09:30.530 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.531 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.531 DEBUG:boto:path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.531 DEBUG:boto:auth_path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.531 DEBUG:boto:Method: GET 2024-04-16T18:09:30.531 DEBUG:boto:Path: /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.531 DEBUG:boto:Data: 2024-04-16T18:09:30.531 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.531 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.531 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.531 DEBUG:boto:Params: {} 2024-04-16T18:09:30.532 DEBUG:boto:Token: None 2024-04-16T18:09:30.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms= 2024-04-16T18:09:30.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms=', 'Content-Length': '0'} 2024-04-16T18:09:30.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000639c8606e3d5bfcb-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.574 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.574 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.575 DEBUG:boto:path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.575 DEBUG:boto:auth_path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.575 DEBUG:boto:Method: GET 2024-04-16T18:09:30.575 DEBUG:boto:Path: /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.575 DEBUG:boto:Data: 2024-04-16T18:09:30.575 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.575 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.575 DEBUG:boto:Params: {} 2024-04-16T18:09:30.575 DEBUG:boto:Token: None 2024-04-16T18:09:30.575 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms= 2024-04-16T18:09:30.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms=', 'Content-Length': '0'} 2024-04-16T18:09:30.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6e31f8876cdb5ec-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.578 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.578 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.578 DEBUG:boto:path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.578 DEBUG:boto:auth_path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.578 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.578 DEBUG:boto:Path: /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.578 DEBUG:boto:Data: 2024-04-16T18:09:30.578 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.578 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.579 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.579 DEBUG:boto:Params: {} 2024-04-16T18:09:30.579 DEBUG:boto:Token: None 2024-04-16T18:09:30.579 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqlize0HOniKtRLwktF4NpvKkPU= 2024-04-16T18:09:30.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqlize0HOniKtRLwktF4NpvKkPU=', 'Content-Length': '0'} 2024-04-16T18:09:30.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd25b37177bcc91b-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.581 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.581 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.581 DEBUG:boto:path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.581 DEBUG:boto:auth_path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.581 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.582 DEBUG:boto:Path: /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.582 DEBUG:boto:Data: 2024-04-16T18:09:30.582 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.582 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.582 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.582 DEBUG:boto:Params: {} 2024-04-16T18:09:30.582 DEBUG:boto:Token: None 2024-04-16T18:09:30.582 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.582 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sqlize0HOniKtRLwktF4NpvKkPU= 2024-04-16T18:09:30.582 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sqlize0HOniKtRLwktF4NpvKkPU=', 'Content-Length': '0'} 2024-04-16T18:09:30.584 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acb31de914179eaf-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.584 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:09:30.585 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.585 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.585 DEBUG:boto:path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.585 DEBUG:boto:auth_path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.585 DEBUG:boto:Method: GET 2024-04-16T18:09:30.585 DEBUG:boto:Path: /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.585 DEBUG:boto:Data: 2024-04-16T18:09:30.585 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.585 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.585 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.585 DEBUG:boto:Params: {} 2024-04-16T18:09:30.585 DEBUG:boto:Token: None 2024-04-16T18:09:30.586 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.586 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms= 2024-04-16T18:09:30.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms=', 'Content-Length': '0'} 2024-04-16T18:09:30.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f8263a3b4adc951-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.630 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.630 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.631 DEBUG:boto:path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.631 DEBUG:boto:auth_path=/cjqttm-45/c?versionId=null 2024-04-16T18:09:30.631 DEBUG:boto:Method: GET 2024-04-16T18:09:30.631 DEBUG:boto:Path: /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.631 DEBUG:boto:Data: 2024-04-16T18:09:30.631 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.631 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.631 DEBUG:boto:Params: {} 2024-04-16T18:09:30.631 DEBUG:boto:Token: None 2024-04-16T18:09:30.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c?versionId=null 2024-04-16T18:09:30.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms= 2024-04-16T18:09:30.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/jR9KHNCyWc5V4kauDyLX1mMms=', 'Content-Length': '0'} 2024-04-16T18:09:30.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e0a82b40fee9354-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.634 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.634 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.634 DEBUG:boto:path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.634 DEBUG:boto:auth_path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.634 DEBUG:boto:Method: GET 2024-04-16T18:09:30.634 DEBUG:boto:Path: /cjqttm-45/?prefix=c 2024-04-16T18:09:30.634 DEBUG:boto:Data: 2024-04-16T18:09:30.634 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.634 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.635 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.635 DEBUG:boto:Params: {} 2024-04-16T18:09:30.635 DEBUG:boto:Token: None 2024-04-16T18:09:30.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.637 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd48ed1ec86edb6e-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.638 DEBUG:boto:b'cjqttm-45c1000falsec2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.638 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.638 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.638 DEBUG:boto:path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.638 DEBUG:boto:auth_path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.638 DEBUG:boto:Method: GET 2024-04-16T18:09:30.638 DEBUG:boto:Path: /cjqttm-45/?prefix=c 2024-04-16T18:09:30.638 DEBUG:boto:Data: 2024-04-16T18:09:30.639 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.639 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.639 DEBUG:boto:Params: {} 2024-04-16T18:09:30.639 DEBUG:boto:Token: None 2024-04-16T18:09:30.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d28d68573960b4d-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.642 DEBUG:boto:b'cjqttm-45c1000falsec2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.642 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.642 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.642 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.642 DEBUG:boto:Path: /cjqttm-45/c 2024-04-16T18:09:30.643 DEBUG:boto:Data: 2024-04-16T18:09:30.643 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.643 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.643 DEBUG:boto:Params: {} 2024-04-16T18:09:30.643 DEBUG:boto:Token: None 2024-04-16T18:09:30.643 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c 2024-04-16T18:09:30.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ITEo3l/p20LSYOciqpoWkt8/ogg= 2024-04-16T18:09:30.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ITEo3l/p20LSYOciqpoWkt8/ogg=', 'Content-Length': '0'} 2024-04-16T18:09:30.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fd9043581e4a4fe-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.645 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.645 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.645 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.646 DEBUG:boto:Path: /cjqttm-45/c 2024-04-16T18:09:30.646 DEBUG:boto:Data: 2024-04-16T18:09:30.646 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.646 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.646 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.646 DEBUG:boto:Params: {} 2024-04-16T18:09:30.646 DEBUG:boto:Token: None 2024-04-16T18:09:30.646 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c 2024-04-16T18:09:30.646 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ITEo3l/p20LSYOciqpoWkt8/ogg= 2024-04-16T18:09:30.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ITEo3l/p20LSYOciqpoWkt8/ogg=', 'Content-Length': '0'} 2024-04-16T18:09:30.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ded3f881e173d0a1-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:09:30.649 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.649 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.649 DEBUG:boto:Method: GET 2024-04-16T18:09:30.649 DEBUG:boto:Path: /cjqttm-45/c 2024-04-16T18:09:30.649 DEBUG:boto:Data: 2024-04-16T18:09:30.649 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.649 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.649 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.649 DEBUG:boto:Params: {} 2024-04-16T18:09:30.649 DEBUG:boto:Token: None 2024-04-16T18:09:30.649 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c 2024-04-16T18:09:30.650 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:de3/eU69UYcFfrBjBZi6TRECFSQ= 2024-04-16T18:09:30.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:de3/eU69UYcFfrBjBZi6TRECFSQ=', 'Content-Length': '0'} 2024-04-16T18:09:30.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9711df09d081822-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.694 DEBUG:boto:path=/cjqttm-45/c 2024-04-16T18:09:30.694 DEBUG:boto:auth_path=/cjqttm-45/c 2024-04-16T18:09:30.695 DEBUG:boto:Method: GET 2024-04-16T18:09:30.695 DEBUG:boto:Path: /cjqttm-45/c 2024-04-16T18:09:30.695 DEBUG:boto:Data: 2024-04-16T18:09:30.695 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.695 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.695 DEBUG:boto:Params: {} 2024-04-16T18:09:30.695 DEBUG:boto:Token: None 2024-04-16T18:09:30.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/c 2024-04-16T18:09:30.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:de3/eU69UYcFfrBjBZi6TRECFSQ= 2024-04-16T18:09:30.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:de3/eU69UYcFfrBjBZi6TRECFSQ=', 'Content-Length': '0'} 2024-04-16T18:09:30.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3b70fb5dff81643-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.698 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.698 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.698 DEBUG:boto:path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.698 DEBUG:boto:auth_path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.698 DEBUG:boto:Method: GET 2024-04-16T18:09:30.698 DEBUG:boto:Path: /cjqttm-45/?prefix=c 2024-04-16T18:09:30.698 DEBUG:boto:Data: 2024-04-16T18:09:30.698 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.698 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.699 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.699 DEBUG:boto:Params: {} 2024-04-16T18:09:30.699 DEBUG:boto:Token: None 2024-04-16T18:09:30.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.701 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8e42f6ab63c40c5-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.701 DEBUG:boto:b'cjqttm-45c1000falsec2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.702 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.702 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.702 DEBUG:boto:path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.702 DEBUG:boto:auth_path=/cjqttm-45/?prefix=c 2024-04-16T18:09:30.702 DEBUG:boto:Method: GET 2024-04-16T18:09:30.702 DEBUG:boto:Path: /cjqttm-45/?prefix=c 2024-04-16T18:09:30.702 DEBUG:boto:Data: 2024-04-16T18:09:30.702 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.702 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.702 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.702 DEBUG:boto:Params: {} 2024-04-16T18:09:30.703 DEBUG:boto:Token: None 2024-04-16T18:09:30.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000053a31b44a41c10a-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.705 DEBUG:boto:b'cjqttm-45c1000falsec2024-04-16T18:09:19.503Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.705 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:09:30.706 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.706 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.706 DEBUG:boto:path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.706 DEBUG:boto:auth_path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.706 DEBUG:boto:Method: GET 2024-04-16T18:09:30.706 DEBUG:boto:Path: /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.706 DEBUG:boto:Data: 2024-04-16T18:09:30.706 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.706 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.706 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.706 DEBUG:boto:Params: {} 2024-04-16T18:09:30.707 DEBUG:boto:Token: None 2024-04-16T18:09:30.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4= 2024-04-16T18:09:30.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4=', 'Content-Length': '0'} 2024-04-16T18:09:30.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac604cc19b1ff26f-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.750 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.750 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.751 DEBUG:boto:path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.751 DEBUG:boto:auth_path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.751 DEBUG:boto:Method: GET 2024-04-16T18:09:30.751 DEBUG:boto:Path: /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.751 DEBUG:boto:Data: 2024-04-16T18:09:30.751 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.751 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.751 DEBUG:boto:Params: {} 2024-04-16T18:09:30.751 DEBUG:boto:Token: None 2024-04-16T18:09:30.751 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4= 2024-04-16T18:09:30.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4=', 'Content-Length': '0'} 2024-04-16T18:09:30.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c4fa701b17d0dbd-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.754 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.754 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.754 DEBUG:boto:path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.754 DEBUG:boto:auth_path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.754 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.754 DEBUG:boto:Path: /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.755 DEBUG:boto:Data: 2024-04-16T18:09:30.755 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.755 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.755 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.755 DEBUG:boto:Params: {} 2024-04-16T18:09:30.755 DEBUG:boto:Token: None 2024-04-16T18:09:30.755 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdvC8x2IMmjeTiKPMQMmL7u4jTQ= 2024-04-16T18:09:30.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdvC8x2IMmjeTiKPMQMmL7u4jTQ=', 'Content-Length': '0'} 2024-04-16T18:09:30.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000898d0b246f7b3eaf-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.757 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.757 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.757 DEBUG:boto:path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.757 DEBUG:boto:auth_path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.758 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.758 DEBUG:boto:Path: /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.758 DEBUG:boto:Data: 2024-04-16T18:09:30.758 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.758 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.758 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.758 DEBUG:boto:Params: {} 2024-04-16T18:09:30.758 DEBUG:boto:Token: None 2024-04-16T18:09:30.758 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdvC8x2IMmjeTiKPMQMmL7u4jTQ= 2024-04-16T18:09:30.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdvC8x2IMmjeTiKPMQMmL7u4jTQ=', 'Content-Length': '0'} 2024-04-16T18:09:30.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003946489e857ad75c-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:09:30.761 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.761 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.761 DEBUG:boto:path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.761 DEBUG:boto:auth_path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.761 DEBUG:boto:Method: GET 2024-04-16T18:09:30.761 DEBUG:boto:Path: /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.761 DEBUG:boto:Data: 2024-04-16T18:09:30.761 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.761 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.761 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.761 DEBUG:boto:Params: {} 2024-04-16T18:09:30.762 DEBUG:boto:Token: None 2024-04-16T18:09:30.762 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.762 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4= 2024-04-16T18:09:30.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4=', 'Content-Length': '0'} 2024-04-16T18:09:30.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bd57b6289dad93c-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.807 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.807 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.807 DEBUG:boto:path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.807 DEBUG:boto:auth_path=/cjqttm-45/d?versionId=null 2024-04-16T18:09:30.807 DEBUG:boto:Method: GET 2024-04-16T18:09:30.807 DEBUG:boto:Path: /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.807 DEBUG:boto:Data: 2024-04-16T18:09:30.807 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.807 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.807 DEBUG:boto:Params: {} 2024-04-16T18:09:30.808 DEBUG:boto:Token: None 2024-04-16T18:09:30.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d?versionId=null 2024-04-16T18:09:30.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4= 2024-04-16T18:09:30.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/LCAaDbjL9tyRMswXQn+Hqq4Dz4=', 'Content-Length': '0'} 2024-04-16T18:09:30.810 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006133c56816fcf402-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.810 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.810 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.810 DEBUG:boto:path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.811 DEBUG:boto:auth_path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.811 DEBUG:boto:Method: GET 2024-04-16T18:09:30.811 DEBUG:boto:Path: /cjqttm-45/?prefix=d 2024-04-16T18:09:30.811 DEBUG:boto:Data: 2024-04-16T18:09:30.811 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.811 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.811 DEBUG:boto:Params: {} 2024-04-16T18:09:30.811 DEBUG:boto:Token: None 2024-04-16T18:09:30.812 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.814 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058fc47f0d1be8089-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.814 DEBUG:boto:b'cjqttm-45d1000falsed2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.815 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.815 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.815 DEBUG:boto:path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.815 DEBUG:boto:auth_path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.815 DEBUG:boto:Method: GET 2024-04-16T18:09:30.815 DEBUG:boto:Path: /cjqttm-45/?prefix=d 2024-04-16T18:09:30.815 DEBUG:boto:Data: 2024-04-16T18:09:30.815 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.816 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.816 DEBUG:boto:Params: {} 2024-04-16T18:09:30.816 DEBUG:boto:Token: None 2024-04-16T18:09:30.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.818 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000deab528a88c67212-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.819 DEBUG:boto:b'cjqttm-45d1000falsed2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.819 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.819 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.819 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.819 DEBUG:boto:Path: /cjqttm-45/d 2024-04-16T18:09:30.819 DEBUG:boto:Data: 2024-04-16T18:09:30.819 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.820 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.820 DEBUG:boto:Params: {} 2024-04-16T18:09:30.820 DEBUG:boto:Token: None 2024-04-16T18:09:30.820 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d 2024-04-16T18:09:30.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U/UHIY86f/ifPcJo6iTgtJZBJnI= 2024-04-16T18:09:30.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U/UHIY86f/ifPcJo6iTgtJZBJnI=', 'Content-Length': '0'} 2024-04-16T18:09:30.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061d3042f4224ef2b-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.822 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.822 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.823 DEBUG:boto:Method: HEAD 2024-04-16T18:09:30.823 DEBUG:boto:Path: /cjqttm-45/d 2024-04-16T18:09:30.823 DEBUG:boto:Data: 2024-04-16T18:09:30.823 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.823 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.823 DEBUG:boto:Params: {} 2024-04-16T18:09:30.823 DEBUG:boto:Token: None 2024-04-16T18:09:30.823 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d 2024-04-16T18:09:30.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U/UHIY86f/ifPcJo6iTgtJZBJnI= 2024-04-16T18:09:30.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U/UHIY86f/ifPcJo6iTgtJZBJnI=', 'Content-Length': '0'} 2024-04-16T18:09:30.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4459371d6930d1e-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.825 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:09:30.826 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.826 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.826 DEBUG:boto:Method: GET 2024-04-16T18:09:30.826 DEBUG:boto:Path: /cjqttm-45/d 2024-04-16T18:09:30.826 DEBUG:boto:Data: 2024-04-16T18:09:30.826 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.826 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.826 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.826 DEBUG:boto:Params: {} 2024-04-16T18:09:30.826 DEBUG:boto:Token: None 2024-04-16T18:09:30.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d 2024-04-16T18:09:30.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mguvP1E1xY7ptMA/P/ci23sqr7k= 2024-04-16T18:09:30.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mguvP1E1xY7ptMA/P/ci23sqr7k=', 'Content-Length': '0'} 2024-04-16T18:09:30.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:22 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a90b9b4bcdeb0d0-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.874 DEBUG:boto:path=/cjqttm-45/d 2024-04-16T18:09:30.874 DEBUG:boto:auth_path=/cjqttm-45/d 2024-04-16T18:09:30.875 DEBUG:boto:Method: GET 2024-04-16T18:09:30.875 DEBUG:boto:Path: /cjqttm-45/d 2024-04-16T18:09:30.875 DEBUG:boto:Data: 2024-04-16T18:09:30.875 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.875 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.875 DEBUG:boto:Params: {} 2024-04-16T18:09:30.875 DEBUG:boto:Token: None 2024-04-16T18:09:30.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/d 2024-04-16T18:09:30.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mguvP1E1xY7ptMA/P/ci23sqr7k= 2024-04-16T18:09:30.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mguvP1E1xY7ptMA/P/ci23sqr7k=', 'Content-Length': '0'} 2024-04-16T18:09:30.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094973d3d5810903c-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.878 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.878 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.878 DEBUG:boto:path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.878 DEBUG:boto:auth_path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.878 DEBUG:boto:Method: GET 2024-04-16T18:09:30.879 DEBUG:boto:Path: /cjqttm-45/?prefix=d 2024-04-16T18:09:30.879 DEBUG:boto:Data: 2024-04-16T18:09:30.879 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:09:30.879 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.879 DEBUG:boto:Params: {} 2024-04-16T18:09:30.879 DEBUG:boto:Token: None 2024-04-16T18:09:30.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069e0561a66ea2801-00661ebeda-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.922 DEBUG:boto:b'cjqttm-45d1000falsed2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.923 DEBUG:boto:path=/cjqttm-45/ 2024-04-16T18:09:30.923 DEBUG:boto:auth_path=/cjqttm-45/ 2024-04-16T18:09:30.923 DEBUG:boto:path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.923 DEBUG:boto:auth_path=/cjqttm-45/?prefix=d 2024-04-16T18:09:30.923 DEBUG:boto:Method: GET 2024-04-16T18:09:30.923 DEBUG:boto:Path: /cjqttm-45/?prefix=d 2024-04-16T18:09:30.923 DEBUG:boto:Data: 2024-04-16T18:09:30.923 DEBUG:boto:Headers: {} 2024-04-16T18:09:30.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:30.923 DEBUG:boto:Port: 8000 2024-04-16T18:09:30.924 DEBUG:boto:Params: {} 2024-04-16T18:09:30.924 DEBUG:boto:Token: None 2024-04-16T18:09:30.924 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:09:30 GMT /cjqttm-45/ 2024-04-16T18:09:30.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo= 2024-04-16T18:09:30.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:At+TW35NlZSRXW1QTtUKo41hxeo=', 'Content-Length': '0'} 2024-04-16T18:09:30.926 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000fde6977e643369d-00661ebeda-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:30.927 DEBUG:boto:b'cjqttm-45d1000falsed2024-04-16T18:09:19.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:09:30.927 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-45 zones={test-zone2, test-zone1} 2024-04-16T18:09:30.927 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:09:30.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:09:30.927 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:09:30.979 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:30.979 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:31.061 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-46 2024-04-16T18:09:31.061 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:09:31.061 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:09:31.061 DEBUG:boto:Method: PUT 2024-04-16T18:09:31.061 DEBUG:boto:Path: /cjqttm-46/ 2024-04-16T18:09:31.061 DEBUG:boto:Data: 2024-04-16T18:09:31.061 DEBUG:boto:Headers: {} 2024-04-16T18:09:31.062 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.062 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.062 DEBUG:boto:Params: {} 2024-04-16T18:09:31.062 DEBUG:boto:Token: None 2024-04-16T18:09:31.062 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/ 2024-04-16T18:09:31.062 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DP7+NuW+7pRVy+Lh5QnGOHS3udk= 2024-04-16T18:09:31.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DP7+NuW+7pRVy+Lh5QnGOHS3udk=', 'Content-Length': '0'} 2024-04-16T18:09:31.077 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000042e722869d7c1999-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.077 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:09:31.077 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:09:31.078 DEBUG:boto:Method: HEAD 2024-04-16T18:09:31.078 DEBUG:boto:Path: /cjqttm-46/ 2024-04-16T18:09:31.078 DEBUG:boto:Data: 2024-04-16T18:09:31.078 DEBUG:boto:Headers: {} 2024-04-16T18:09:31.078 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.078 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.078 DEBUG:boto:Params: {} 2024-04-16T18:09:31.078 DEBUG:boto:Token: None 2024-04-16T18:09:31.079 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/ 2024-04-16T18:09:31.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E= 2024-04-16T18:09:31.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E=', 'Content-Length': '0'} 2024-04-16T18:09:31.081 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000033c9027fd462f16a-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.081 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:09:31.081 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:09:31.081 DEBUG:boto:Method: PUT 2024-04-16T18:09:31.081 DEBUG:boto:Path: /cjqttm-46/a 2024-04-16T18:09:31.081 DEBUG:boto:Data: 2024-04-16T18:09:31.081 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:31.082 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.082 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.082 DEBUG:boto:Params: {} 2024-04-16T18:09:31.082 DEBUG:boto:Token: None 2024-04-16T18:09:31.082 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/a 2024-04-16T18:09:31.082 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mXT2f6czfkaIF1fB5lBFudhaU/0= 2024-04-16T18:09:31.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mXT2f6czfkaIF1fB5lBFudhaU/0='} 2024-04-16T18:09:31.088 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad8782a60109752b-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.088 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:09:31.089 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:09:31.089 DEBUG:boto:Method: HEAD 2024-04-16T18:09:31.089 DEBUG:boto:Path: /cjqttm-46/ 2024-04-16T18:09:31.089 DEBUG:boto:Data: 2024-04-16T18:09:31.089 DEBUG:boto:Headers: {} 2024-04-16T18:09:31.089 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.089 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.089 DEBUG:boto:Params: {} 2024-04-16T18:09:31.089 DEBUG:boto:Token: None 2024-04-16T18:09:31.089 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/ 2024-04-16T18:09:31.090 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E= 2024-04-16T18:09:31.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E=', 'Content-Length': '0'} 2024-04-16T18:09:31.091 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000065b45e7bb27e32c3-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.092 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:09:31.092 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:09:31.092 DEBUG:boto:Method: PUT 2024-04-16T18:09:31.092 DEBUG:boto:Path: /cjqttm-46/b 2024-04-16T18:09:31.092 DEBUG:boto:Data: 2024-04-16T18:09:31.092 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:31.092 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.092 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.092 DEBUG:boto:Params: {} 2024-04-16T18:09:31.093 DEBUG:boto:Token: None 2024-04-16T18:09:31.093 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/b 2024-04-16T18:09:31.093 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s35YKiaDfLMhX8SDeBqMDkJf4Sk= 2024-04-16T18:09:31.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s35YKiaDfLMhX8SDeBqMDkJf4Sk='} 2024-04-16T18:09:31.138 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004fbae51f2f467056-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.139 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:09:31.139 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:09:31.139 DEBUG:boto:Method: HEAD 2024-04-16T18:09:31.139 DEBUG:boto:Path: /cjqttm-46/ 2024-04-16T18:09:31.139 DEBUG:boto:Data: 2024-04-16T18:09:31.139 DEBUG:boto:Headers: {} 2024-04-16T18:09:31.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.139 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.139 DEBUG:boto:Params: {} 2024-04-16T18:09:31.140 DEBUG:boto:Token: None 2024-04-16T18:09:31.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/ 2024-04-16T18:09:31.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E= 2024-04-16T18:09:31.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E=', 'Content-Length': '0'} 2024-04-16T18:09:31.142 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000041957e7474ed3365-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.143 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:09:31.143 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:09:31.143 DEBUG:boto:Method: PUT 2024-04-16T18:09:31.143 DEBUG:boto:Path: /cjqttm-46/c 2024-04-16T18:09:31.143 DEBUG:boto:Data: 2024-04-16T18:09:31.143 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:31.143 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.143 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.143 DEBUG:boto:Params: {} 2024-04-16T18:09:31.144 DEBUG:boto:Token: None 2024-04-16T18:09:31.144 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/c 2024-04-16T18:09:31.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huKEHeAhy5PkNmjYQ0XI2GaNcmM= 2024-04-16T18:09:31.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huKEHeAhy5PkNmjYQ0XI2GaNcmM='} 2024-04-16T18:09:31.149 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c56f456002ad88c1-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.149 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:09:31.149 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:09:31.150 DEBUG:boto:Method: HEAD 2024-04-16T18:09:31.150 DEBUG:boto:Path: /cjqttm-46/ 2024-04-16T18:09:31.150 DEBUG:boto:Data: 2024-04-16T18:09:31.150 DEBUG:boto:Headers: {} 2024-04-16T18:09:31.150 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.150 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.150 DEBUG:boto:Params: {} 2024-04-16T18:09:31.150 DEBUG:boto:Token: None 2024-04-16T18:09:31.150 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/ 2024-04-16T18:09:31.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E= 2024-04-16T18:09:31.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:agECC6RCGhexl7jJzJbU88O4m7E=', 'Content-Length': '0'} 2024-04-16T18:09:31.153 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000caa8ab7ee486f013-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.153 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:09:31.153 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:09:31.153 DEBUG:boto:Method: PUT 2024-04-16T18:09:31.153 DEBUG:boto:Path: /cjqttm-46/d 2024-04-16T18:09:31.154 DEBUG:boto:Data: 2024-04-16T18:09:31.154 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:09:31.154 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:09:31.154 DEBUG:boto:Port: 8000 2024-04-16T18:09:31.154 DEBUG:boto:Params: {} 2024-04-16T18:09:31.154 DEBUG:boto:Token: None 2024-04-16T18:09:31.154 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:09:31 GMT /cjqttm-46/d 2024-04-16T18:09:31.154 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9fpC7EENm/47jOP1r2fhDF4oT6Y= 2024-04-16T18:09:31.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:09:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9fpC7EENm/47jOP1r2fhDF4oT6Y='} 2024-04-16T18:09:31.198 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000066d48f167eab91b9-00661ebedb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:09:31.199 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:31.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:31.199 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:31.246 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:31.247 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:31.296 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:09:31.318 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713290971.077773_622.1","last_update":"2024-04-16T18:09:31.077773Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:09:31.319 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290971.077773_622.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:31.319 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:09:31.319 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:31.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:09:31.319 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:09:31.374 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:31.374 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:31.427 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:31.428+0000 7feb95214800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:31.429 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:31.430+0000 7feb95214800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:09:31.450 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290971.077773_622.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:31.077773Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:31Z"} 2024-04-16T18:09:31.451 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290971.077773_622.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:31.077773Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:09:31Z"} 2024-04-16T18:09:31.451 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290971.077773_622.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:09:31.077773Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:09:31.451 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290971.077773_622.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:31.451 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290971.077773_622.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:09:31.451 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:09:31.451 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-46 2024-04-16T18:09:31.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:31.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-46', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:31.452 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-46 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:09:31.506 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:31.507 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:31.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:31.564+0000 7f5504f22800 1 waiting to reach incremental sync.. 2024-04-16T18:09:36.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:36.565+0000 7f5504f22800 1 bucket sync caught up with source: 2024-04-16T18:09:36.564 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.50.6, , , , 00000000001.36.6, , , 00000000001.57.6, , 00000000001.27.6] 2024-04-16T18:09:36.564 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000001.50.6, , , , 00000000001.36.6, , , 00000000001.57.6, , 00000000001.27.6] 2024-04-16T18:09:36.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:09:36.565+0000 7f5504f22800 0 bucket checkpoint complete 2024-04-16T18:09:36.590 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-46 2024-04-16T18:09:36.591 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:36.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-46', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:09:36.591 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-46 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:09:36.654 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:09:36.654 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:09:36.717 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:36.718+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:09:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:41.720+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:09:46.718 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:46.720+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:09:51.719 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:51.722+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:09:56.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:09:56.722+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:01.721 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:01.724+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:06.722 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:06.724+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:11.724 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:11.725+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:16.725 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:16.726+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:21.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:21.727+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:26.726 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:26.727+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:31.727 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:31.728+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:36.728 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:36.730+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:41.729 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:41.730+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:46.730 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:46.731+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:51.731 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:51.732+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:10:56.732 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:10:56.733+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:11:01.733 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:01.734+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:11:06.734 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:06.734+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:11:11.735 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:11.736+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:11:16.737 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:16.737+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:11:21.736 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:21.738+0000 7f849aee4800 1 waiting to reach incremental sync.. 2024-04-16T18:11:26.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:26.740+0000 7f849aee4800 1 bucket sync caught up with source: 2024-04-16T18:11:26.739 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.221.6, , , , 00000000001.620.6, , , 00000000001.306.6, , 00000000001.652.6] 2024-04-16T18:11:26.739 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.221.6, , , , 00000000001.620.6, , , 00000000001.306.6, , 00000000001.652.6] 2024-04-16T18:11:26.739 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:26.740+0000 7f849aee4800 0 bucket checkpoint complete 2024-04-16T18:11:26.765 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-46 zones={test-zone2, test-zone1} 2024-04-16T18:11:26.766 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.766 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.766 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.766 DEBUG:boto:Path: /cjqttm-46/ 2024-04-16T18:11:26.766 DEBUG:boto:Data: 2024-04-16T18:11:26.767 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.767 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.767 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.767 DEBUG:boto:Params: {} 2024-04-16T18:11:26.767 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:11:26.768 DEBUG:boto:Token: None 2024-04-16T18:11:26.768 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/ 2024-04-16T18:11:26.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tKhNh+XSvE2B5nFfGVHe9jiNwd4= 2024-04-16T18:11:26.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tKhNh+XSvE2B5nFfGVHe9jiNwd4=', 'Content-Length': '0'} 2024-04-16T18:11:26.775 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002b06df917464c3fd-00661ebf4e-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.775 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.775 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.775 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.775 DEBUG:boto:Path: /cjqttm-46/ 2024-04-16T18:11:26.776 DEBUG:boto:Data: 2024-04-16T18:11:26.776 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.776 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.776 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.776 DEBUG:boto:Params: {} 2024-04-16T18:11:26.776 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:11:26.776 DEBUG:boto:Token: None 2024-04-16T18:11:26.776 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/ 2024-04-16T18:11:26.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tKhNh+XSvE2B5nFfGVHe9jiNwd4= 2024-04-16T18:11:26.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tKhNh+XSvE2B5nFfGVHe9jiNwd4=', 'Content-Length': '0'} 2024-04-16T18:11:26.780 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d528af2e6f6ada13-00661ebf4e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.780 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:11:26.780 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.780 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.780 DEBUG:boto:path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.781 DEBUG:boto:auth_path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.781 DEBUG:boto:Method: GET 2024-04-16T18:11:26.781 DEBUG:boto:Path: /cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.781 DEBUG:boto:Data: 2024-04-16T18:11:26.781 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.781 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.781 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.781 DEBUG:boto:Params: {} 2024-04-16T18:11:26.781 DEBUG:boto:Token: None 2024-04-16T18:11:26.781 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/?versions 2024-04-16T18:11:26.782 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE= 2024-04-16T18:11:26.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE=', 'Content-Length': '0'} 2024-04-16T18:11:26.784 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f2623bbe550e020-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.784 DEBUG:boto:b'cjqttm-46999falseanulltrue2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.785 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:11:26.786 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:11:26.786 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:11:26.786 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:11:26.786 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:11:26.786 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.786 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.786 DEBUG:boto:path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.786 DEBUG:boto:auth_path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.786 DEBUG:boto:Method: GET 2024-04-16T18:11:26.786 DEBUG:boto:Path: /cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.787 DEBUG:boto:Data: 2024-04-16T18:11:26.787 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.787 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.787 DEBUG:boto:Params: {} 2024-04-16T18:11:26.787 DEBUG:boto:Token: None 2024-04-16T18:11:26.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/?versions 2024-04-16T18:11:26.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE= 2024-04-16T18:11:26.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE=', 'Content-Length': '0'} 2024-04-16T18:11:26.790 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3c46c66ba43747b-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.790 DEBUG:boto:b'cjqttm-46999falseanulltrue2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.790 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:11:26.790 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:11:26.790 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:11:26.790 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:11:26.791 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.791 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.791 DEBUG:boto:path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.791 DEBUG:boto:auth_path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.791 DEBUG:boto:Method: GET 2024-04-16T18:11:26.791 DEBUG:boto:Path: /cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.791 DEBUG:boto:Data: 2024-04-16T18:11:26.791 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.791 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.791 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.792 DEBUG:boto:Params: {} 2024-04-16T18:11:26.792 DEBUG:boto:Token: None 2024-04-16T18:11:26.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/?versions 2024-04-16T18:11:26.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE= 2024-04-16T18:11:26.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE=', 'Content-Length': '0'} 2024-04-16T18:11:26.794 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ea9edb751c3fea5-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.795 DEBUG:boto:b'cjqttm-46999falseanulltrue2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.795 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.795 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.795 DEBUG:boto:path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.795 DEBUG:boto:auth_path=/cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.796 DEBUG:boto:Method: GET 2024-04-16T18:11:26.796 DEBUG:boto:Path: /cjqttm-46/?versions&max-keys=999 2024-04-16T18:11:26.796 DEBUG:boto:Data: 2024-04-16T18:11:26.796 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.796 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.796 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.796 DEBUG:boto:Params: {} 2024-04-16T18:11:26.796 DEBUG:boto:Token: None 2024-04-16T18:11:26.796 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/?versions 2024-04-16T18:11:26.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE= 2024-04-16T18:11:26.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1IDw5val6Le6xgdKGUZIrBRJtLE=', 'Content-Length': '0'} 2024-04-16T18:11:26.799 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007029aae13e7e4354-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.799 DEBUG:boto:b'cjqttm-46999falseanulltrue2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.799 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:11:26.799 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.800 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.800 DEBUG:boto:path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.800 DEBUG:boto:auth_path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.800 DEBUG:boto:Method: GET 2024-04-16T18:11:26.800 DEBUG:boto:Path: /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.800 DEBUG:boto:Data: 2024-04-16T18:11:26.800 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.800 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.800 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.800 DEBUG:boto:Params: {} 2024-04-16T18:11:26.801 DEBUG:boto:Token: None 2024-04-16T18:11:26.801 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.801 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo= 2024-04-16T18:11:26.801 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo=', 'Content-Length': '0'} 2024-04-16T18:11:26.803 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d947ea7c9be5d9e-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.803 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.803 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.803 DEBUG:boto:path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.804 DEBUG:boto:auth_path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.804 DEBUG:boto:Method: GET 2024-04-16T18:11:26.804 DEBUG:boto:Path: /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.804 DEBUG:boto:Data: 2024-04-16T18:11:26.804 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.804 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.804 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.804 DEBUG:boto:Params: {} 2024-04-16T18:11:26.804 DEBUG:boto:Token: None 2024-04-16T18:11:26.804 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.805 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo= 2024-04-16T18:11:26.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo=', 'Content-Length': '0'} 2024-04-16T18:11:26.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e4bf8e1625218e1-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.807 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.807 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.807 DEBUG:boto:path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.807 DEBUG:boto:auth_path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.808 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.808 DEBUG:boto:Path: /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.808 DEBUG:boto:Data: 2024-04-16T18:11:26.808 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.808 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.808 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.808 DEBUG:boto:Params: {} 2024-04-16T18:11:26.808 DEBUG:boto:Token: None 2024-04-16T18:11:26.808 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I/gfb5DQ0twGTMGJ1HEhPQX+pmA= 2024-04-16T18:11:26.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I/gfb5DQ0twGTMGJ1HEhPQX+pmA=', 'Content-Length': '0'} 2024-04-16T18:11:26.810 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf9e4734e233860f-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.811 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.811 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.811 DEBUG:boto:path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.811 DEBUG:boto:auth_path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.811 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.811 DEBUG:boto:Path: /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.811 DEBUG:boto:Data: 2024-04-16T18:11:26.811 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.812 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.812 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.812 DEBUG:boto:Params: {} 2024-04-16T18:11:26.812 DEBUG:boto:Token: None 2024-04-16T18:11:26.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I/gfb5DQ0twGTMGJ1HEhPQX+pmA= 2024-04-16T18:11:26.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I/gfb5DQ0twGTMGJ1HEhPQX+pmA=', 'Content-Length': '0'} 2024-04-16T18:11:26.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d116d18b1dd61a2-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:11:26.814 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.814 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.815 DEBUG:boto:path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.815 DEBUG:boto:auth_path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.815 DEBUG:boto:Method: GET 2024-04-16T18:11:26.815 DEBUG:boto:Path: /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.815 DEBUG:boto:Data: 2024-04-16T18:11:26.815 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.815 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.815 DEBUG:boto:Params: {} 2024-04-16T18:11:26.815 DEBUG:boto:Token: None 2024-04-16T18:11:26.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo= 2024-04-16T18:11:26.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo=', 'Content-Length': '0'} 2024-04-16T18:11:26.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000372bce78dd5255dd-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.862 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.862 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.863 DEBUG:boto:path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.863 DEBUG:boto:auth_path=/cjqttm-46/a?versionId=null 2024-04-16T18:11:26.863 DEBUG:boto:Method: GET 2024-04-16T18:11:26.863 DEBUG:boto:Path: /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.863 DEBUG:boto:Data: 2024-04-16T18:11:26.863 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.863 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.863 DEBUG:boto:Params: {} 2024-04-16T18:11:26.863 DEBUG:boto:Token: None 2024-04-16T18:11:26.863 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a?versionId=null 2024-04-16T18:11:26.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo= 2024-04-16T18:11:26.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xvf6ZQmzrS/3EWLZqjqQ41kJcvo=', 'Content-Length': '0'} 2024-04-16T18:11:26.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000036d6d6afc9fa718-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.866 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.866 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.866 DEBUG:boto:path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.866 DEBUG:boto:auth_path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.866 DEBUG:boto:Method: GET 2024-04-16T18:11:26.867 DEBUG:boto:Path: /cjqttm-46/?prefix=a 2024-04-16T18:11:26.867 DEBUG:boto:Data: 2024-04-16T18:11:26.867 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.867 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.867 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.867 DEBUG:boto:Params: {} 2024-04-16T18:11:26.867 DEBUG:boto:Token: None 2024-04-16T18:11:26.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/ 2024-04-16T18:11:26.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs= 2024-04-16T18:11:26.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs=', 'Content-Length': '0'} 2024-04-16T18:11:26.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d34fe17e757e534e-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.870 DEBUG:boto:b'cjqttm-46a1000falsea2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.870 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.871 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.871 DEBUG:boto:path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.871 DEBUG:boto:auth_path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.871 DEBUG:boto:Method: GET 2024-04-16T18:11:26.871 DEBUG:boto:Path: /cjqttm-46/?prefix=a 2024-04-16T18:11:26.871 DEBUG:boto:Data: 2024-04-16T18:11:26.871 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.871 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.871 DEBUG:boto:Params: {} 2024-04-16T18:11:26.871 DEBUG:boto:Token: None 2024-04-16T18:11:26.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/ 2024-04-16T18:11:26.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs= 2024-04-16T18:11:26.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs=', 'Content-Length': '0'} 2024-04-16T18:11:26.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d74866ce478cd081-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.874 DEBUG:boto:b'cjqttm-46a1000falsea2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.874 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.874 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.874 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.875 DEBUG:boto:Path: /cjqttm-46/a 2024-04-16T18:11:26.875 DEBUG:boto:Data: 2024-04-16T18:11:26.875 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.875 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.875 DEBUG:boto:Params: {} 2024-04-16T18:11:26.875 DEBUG:boto:Token: None 2024-04-16T18:11:26.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a 2024-04-16T18:11:26.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n2sXZ5c4+wcGXOWghNu6xWLOMz8= 2024-04-16T18:11:26.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n2sXZ5c4+wcGXOWghNu6xWLOMz8=', 'Content-Length': '0'} 2024-04-16T18:11:26.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aebd93f48585a29a-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.877 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.877 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.878 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.878 DEBUG:boto:Path: /cjqttm-46/a 2024-04-16T18:11:26.878 DEBUG:boto:Data: 2024-04-16T18:11:26.878 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.878 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.878 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.878 DEBUG:boto:Params: {} 2024-04-16T18:11:26.878 DEBUG:boto:Token: None 2024-04-16T18:11:26.878 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a 2024-04-16T18:11:26.878 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n2sXZ5c4+wcGXOWghNu6xWLOMz8= 2024-04-16T18:11:26.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n2sXZ5c4+wcGXOWghNu6xWLOMz8=', 'Content-Length': '0'} 2024-04-16T18:11:26.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8b850c8b6a0ffc4-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:11:26.880 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.881 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.881 DEBUG:boto:Method: GET 2024-04-16T18:11:26.881 DEBUG:boto:Path: /cjqttm-46/a 2024-04-16T18:11:26.881 DEBUG:boto:Data: 2024-04-16T18:11:26.881 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.881 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.881 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.881 DEBUG:boto:Params: {} 2024-04-16T18:11:26.881 DEBUG:boto:Token: None 2024-04-16T18:11:26.881 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a 2024-04-16T18:11:26.882 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J0rYSQerAjgbilFJu7q9wEW3qYA= 2024-04-16T18:11:26.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J0rYSQerAjgbilFJu7q9wEW3qYA=', 'Content-Length': '0'} 2024-04-16T18:11:26.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000246237eb4702138b-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.926 DEBUG:boto:path=/cjqttm-46/a 2024-04-16T18:11:26.926 DEBUG:boto:auth_path=/cjqttm-46/a 2024-04-16T18:11:26.926 DEBUG:boto:Method: GET 2024-04-16T18:11:26.927 DEBUG:boto:Path: /cjqttm-46/a 2024-04-16T18:11:26.927 DEBUG:boto:Data: 2024-04-16T18:11:26.927 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.927 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.927 DEBUG:boto:Params: {} 2024-04-16T18:11:26.927 DEBUG:boto:Token: None 2024-04-16T18:11:26.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/a 2024-04-16T18:11:26.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J0rYSQerAjgbilFJu7q9wEW3qYA= 2024-04-16T18:11:26.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J0rYSQerAjgbilFJu7q9wEW3qYA=', 'Content-Length': '0'} 2024-04-16T18:11:26.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000483f20092fa52e4d-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.929 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.929 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.929 DEBUG:boto:path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.930 DEBUG:boto:auth_path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.930 DEBUG:boto:Method: GET 2024-04-16T18:11:26.930 DEBUG:boto:Path: /cjqttm-46/?prefix=a 2024-04-16T18:11:26.930 DEBUG:boto:Data: 2024-04-16T18:11:26.930 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.930 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.930 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.930 DEBUG:boto:Params: {} 2024-04-16T18:11:26.930 DEBUG:boto:Token: None 2024-04-16T18:11:26.930 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/ 2024-04-16T18:11:26.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs= 2024-04-16T18:11:26.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs=', 'Content-Length': '0'} 2024-04-16T18:11:26.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ff81028adfc167b-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.933 DEBUG:boto:b'cjqttm-46a1000falsea2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.934 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:26.934 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:26.934 DEBUG:boto:path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.934 DEBUG:boto:auth_path=/cjqttm-46/?prefix=a 2024-04-16T18:11:26.934 DEBUG:boto:Method: GET 2024-04-16T18:11:26.934 DEBUG:boto:Path: /cjqttm-46/?prefix=a 2024-04-16T18:11:26.934 DEBUG:boto:Data: 2024-04-16T18:11:26.934 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.934 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.934 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.934 DEBUG:boto:Params: {} 2024-04-16T18:11:26.935 DEBUG:boto:Token: None 2024-04-16T18:11:26.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/ 2024-04-16T18:11:26.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs= 2024-04-16T18:11:26.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DK1FvUICm1jKmUIDGbRQXorsfrs=', 'Content-Length': '0'} 2024-04-16T18:11:26.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077e3bef4328e1365-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.937 DEBUG:boto:b'cjqttm-46a1000falsea2024-04-16T18:09:31.087Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:26.938 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:11:26.938 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:26.938 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:26.938 DEBUG:boto:path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.938 DEBUG:boto:auth_path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.938 DEBUG:boto:Method: GET 2024-04-16T18:11:26.938 DEBUG:boto:Path: /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.938 DEBUG:boto:Data: 2024-04-16T18:11:26.938 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.938 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.938 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.939 DEBUG:boto:Params: {} 2024-04-16T18:11:26.939 DEBUG:boto:Token: None 2024-04-16T18:11:26.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pdb65uXB3twdEVVkCuq4uw5w8OI= 2024-04-16T18:11:26.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pdb65uXB3twdEVVkCuq4uw5w8OI=', 'Content-Length': '0'} 2024-04-16T18:11:26.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0a388abbe384818-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.982 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:26.982 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:26.982 DEBUG:boto:path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.983 DEBUG:boto:auth_path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.983 DEBUG:boto:Method: GET 2024-04-16T18:11:26.983 DEBUG:boto:Path: /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.983 DEBUG:boto:Data: 2024-04-16T18:11:26.983 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.983 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.983 DEBUG:boto:Params: {} 2024-04-16T18:11:26.983 DEBUG:boto:Token: None 2024-04-16T18:11:26.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pdb65uXB3twdEVVkCuq4uw5w8OI= 2024-04-16T18:11:26.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pdb65uXB3twdEVVkCuq4uw5w8OI=', 'Content-Length': '0'} 2024-04-16T18:11:26.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a99fa726bab1bfce-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.986 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:26.986 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:26.986 DEBUG:boto:path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.986 DEBUG:boto:auth_path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.986 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.987 DEBUG:boto:Path: /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.987 DEBUG:boto:Data: 2024-04-16T18:11:26.987 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.987 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.987 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.987 DEBUG:boto:Params: {} 2024-04-16T18:11:26.987 DEBUG:boto:Token: None 2024-04-16T18:11:26.987 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3uIHNSCXjyxUG7EAAyEDspaOJlU= 2024-04-16T18:11:26.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3uIHNSCXjyxUG7EAAyEDspaOJlU=', 'Content-Length': '0'} 2024-04-16T18:11:26.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000800e457fd1b2a43f-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.990 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:26.990 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:26.990 DEBUG:boto:path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.990 DEBUG:boto:auth_path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.990 DEBUG:boto:Method: HEAD 2024-04-16T18:11:26.990 DEBUG:boto:Path: /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.990 DEBUG:boto:Data: 2024-04-16T18:11:26.990 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.990 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:26.991 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.991 DEBUG:boto:Params: {} 2024-04-16T18:11:26.991 DEBUG:boto:Token: None 2024-04-16T18:11:26.991 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3uIHNSCXjyxUG7EAAyEDspaOJlU= 2024-04-16T18:11:26.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3uIHNSCXjyxUG7EAAyEDspaOJlU=', 'Content-Length': '0'} 2024-04-16T18:11:26.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007002360d024e01e4-00661ebf4e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:26.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:11:26.993 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:26.993 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:26.993 DEBUG:boto:path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.993 DEBUG:boto:auth_path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:26.994 DEBUG:boto:Method: GET 2024-04-16T18:11:26.994 DEBUG:boto:Path: /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.994 DEBUG:boto:Data: 2024-04-16T18:11:26.994 DEBUG:boto:Headers: {} 2024-04-16T18:11:26.994 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:26.994 DEBUG:boto:Port: 8000 2024-04-16T18:11:26.994 DEBUG:boto:Params: {} 2024-04-16T18:11:26.994 DEBUG:boto:Token: None 2024-04-16T18:11:26.994 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:26 GMT /cjqttm-46/b?versionId=null 2024-04-16T18:11:26.994 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pdb65uXB3twdEVVkCuq4uw5w8OI= 2024-04-16T18:11:26.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pdb65uXB3twdEVVkCuq4uw5w8OI=', 'Content-Length': '0'} 2024-04-16T18:11:26.996 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc2c22a9fa82d7f0-00661ebf4e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.038 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:27.038 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:27.038 DEBUG:boto:path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:27.039 DEBUG:boto:auth_path=/cjqttm-46/b?versionId=null 2024-04-16T18:11:27.039 DEBUG:boto:Method: GET 2024-04-16T18:11:27.039 DEBUG:boto:Path: /cjqttm-46/b?versionId=null 2024-04-16T18:11:27.039 DEBUG:boto:Data: 2024-04-16T18:11:27.039 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.039 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.039 DEBUG:boto:Params: {} 2024-04-16T18:11:27.039 DEBUG:boto:Token: None 2024-04-16T18:11:27.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/b?versionId=null 2024-04-16T18:11:27.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9YedMiXZsDmzD5cU/LG2PU54bp0= 2024-04-16T18:11:27.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9YedMiXZsDmzD5cU/LG2PU54bp0=', 'Content-Length': '0'} 2024-04-16T18:11:27.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000202d34acef0623a9-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.042 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.042 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.042 DEBUG:boto:path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.042 DEBUG:boto:auth_path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.042 DEBUG:boto:Method: GET 2024-04-16T18:11:27.042 DEBUG:boto:Path: /cjqttm-46/?prefix=b 2024-04-16T18:11:27.042 DEBUG:boto:Data: 2024-04-16T18:11:27.043 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.043 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.043 DEBUG:boto:Params: {} 2024-04-16T18:11:27.043 DEBUG:boto:Token: None 2024-04-16T18:11:27.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063e533e6a9d1a2d6-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.046 DEBUG:boto:b'cjqttm-46b1000falseb2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.046 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.046 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.046 DEBUG:boto:path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.046 DEBUG:boto:auth_path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.046 DEBUG:boto:Method: GET 2024-04-16T18:11:27.046 DEBUG:boto:Path: /cjqttm-46/?prefix=b 2024-04-16T18:11:27.046 DEBUG:boto:Data: 2024-04-16T18:11:27.046 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.047 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.047 DEBUG:boto:Params: {} 2024-04-16T18:11:27.047 DEBUG:boto:Token: None 2024-04-16T18:11:27.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.049 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d084f557cffe59d0-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.050 DEBUG:boto:b'cjqttm-46b1000falseb2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.050 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:27.050 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:27.050 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.050 DEBUG:boto:Path: /cjqttm-46/b 2024-04-16T18:11:27.050 DEBUG:boto:Data: 2024-04-16T18:11:27.050 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.051 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.051 DEBUG:boto:Params: {} 2024-04-16T18:11:27.051 DEBUG:boto:Token: None 2024-04-16T18:11:27.051 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/b 2024-04-16T18:11:27.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2daPs4uiGV7t/RrfltyuctYqjX0= 2024-04-16T18:11:27.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2daPs4uiGV7t/RrfltyuctYqjX0=', 'Content-Length': '0'} 2024-04-16T18:11:27.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000807af52a8f01ed1d-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.053 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:27.054 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:27.054 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.054 DEBUG:boto:Path: /cjqttm-46/b 2024-04-16T18:11:27.054 DEBUG:boto:Data: 2024-04-16T18:11:27.054 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.054 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.054 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.054 DEBUG:boto:Params: {} 2024-04-16T18:11:27.054 DEBUG:boto:Token: None 2024-04-16T18:11:27.054 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/b 2024-04-16T18:11:27.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2daPs4uiGV7t/RrfltyuctYqjX0= 2024-04-16T18:11:27.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2daPs4uiGV7t/RrfltyuctYqjX0=', 'Content-Length': '0'} 2024-04-16T18:11:27.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc41b1fda9158dc7-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:11:27.057 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:27.057 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:27.057 DEBUG:boto:Method: GET 2024-04-16T18:11:27.057 DEBUG:boto:Path: /cjqttm-46/b 2024-04-16T18:11:27.057 DEBUG:boto:Data: 2024-04-16T18:11:27.057 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.057 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.057 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.057 DEBUG:boto:Params: {} 2024-04-16T18:11:27.057 DEBUG:boto:Token: None 2024-04-16T18:11:27.057 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/b 2024-04-16T18:11:27.058 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CTCj1i75jIav+EyQQ/bBWTml2a8= 2024-04-16T18:11:27.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CTCj1i75jIav+EyQQ/bBWTml2a8=', 'Content-Length': '0'} 2024-04-16T18:11:27.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f82c0d9047b0adf7-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.102 DEBUG:boto:path=/cjqttm-46/b 2024-04-16T18:11:27.103 DEBUG:boto:auth_path=/cjqttm-46/b 2024-04-16T18:11:27.103 DEBUG:boto:Method: GET 2024-04-16T18:11:27.103 DEBUG:boto:Path: /cjqttm-46/b 2024-04-16T18:11:27.103 DEBUG:boto:Data: 2024-04-16T18:11:27.103 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.103 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.103 DEBUG:boto:Params: {} 2024-04-16T18:11:27.103 DEBUG:boto:Token: None 2024-04-16T18:11:27.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/b 2024-04-16T18:11:27.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CTCj1i75jIav+EyQQ/bBWTml2a8= 2024-04-16T18:11:27.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CTCj1i75jIav+EyQQ/bBWTml2a8=', 'Content-Length': '0'} 2024-04-16T18:11:27.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9e89d2a85ad9dca-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.105 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.106 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.106 DEBUG:boto:path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.106 DEBUG:boto:auth_path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.106 DEBUG:boto:Method: GET 2024-04-16T18:11:27.106 DEBUG:boto:Path: /cjqttm-46/?prefix=b 2024-04-16T18:11:27.106 DEBUG:boto:Data: 2024-04-16T18:11:27.106 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.106 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.106 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.106 DEBUG:boto:Params: {} 2024-04-16T18:11:27.106 DEBUG:boto:Token: None 2024-04-16T18:11:27.107 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093bd69f421fadf9d-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.109 DEBUG:boto:b'cjqttm-46b1000falseb2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.109 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.109 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.109 DEBUG:boto:path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.110 DEBUG:boto:auth_path=/cjqttm-46/?prefix=b 2024-04-16T18:11:27.110 DEBUG:boto:Method: GET 2024-04-16T18:11:27.110 DEBUG:boto:Path: /cjqttm-46/?prefix=b 2024-04-16T18:11:27.110 DEBUG:boto:Data: 2024-04-16T18:11:27.110 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.110 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.110 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.110 DEBUG:boto:Params: {} 2024-04-16T18:11:27.110 DEBUG:boto:Token: None 2024-04-16T18:11:27.110 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.110 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.113 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a53d77a037fe2aee-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.113 DEBUG:boto:b'cjqttm-46b1000falseb2024-04-16T18:09:31.097Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:11:27.114 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.114 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.114 DEBUG:boto:path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.114 DEBUG:boto:auth_path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.114 DEBUG:boto:Method: GET 2024-04-16T18:11:27.114 DEBUG:boto:Path: /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.114 DEBUG:boto:Data: 2024-04-16T18:11:27.114 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.114 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.114 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.114 DEBUG:boto:Params: {} 2024-04-16T18:11:27.115 DEBUG:boto:Token: None 2024-04-16T18:11:27.115 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU= 2024-04-16T18:11:27.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU=', 'Content-Length': '0'} 2024-04-16T18:11:27.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015d653937cb8fb2f-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.158 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.158 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.159 DEBUG:boto:path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.159 DEBUG:boto:auth_path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.159 DEBUG:boto:Method: GET 2024-04-16T18:11:27.159 DEBUG:boto:Path: /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.159 DEBUG:boto:Data: 2024-04-16T18:11:27.159 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.159 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.159 DEBUG:boto:Params: {} 2024-04-16T18:11:27.159 DEBUG:boto:Token: None 2024-04-16T18:11:27.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU= 2024-04-16T18:11:27.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU=', 'Content-Length': '0'} 2024-04-16T18:11:27.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000712cbef69ca91315-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.162 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.162 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.162 DEBUG:boto:path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.162 DEBUG:boto:auth_path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.162 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.163 DEBUG:boto:Path: /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.163 DEBUG:boto:Data: 2024-04-16T18:11:27.163 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.163 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.163 DEBUG:boto:Params: {} 2024-04-16T18:11:27.163 DEBUG:boto:Token: None 2024-04-16T18:11:27.163 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+l504j6V6wHBCM1xA75+dSJPNDM= 2024-04-16T18:11:27.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+l504j6V6wHBCM1xA75+dSJPNDM=', 'Content-Length': '0'} 2024-04-16T18:11:27.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efceb6de19583e49-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.165 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.165 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.165 DEBUG:boto:path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.166 DEBUG:boto:auth_path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.166 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.166 DEBUG:boto:Path: /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.166 DEBUG:boto:Data: 2024-04-16T18:11:27.166 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.166 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.166 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.166 DEBUG:boto:Params: {} 2024-04-16T18:11:27.166 DEBUG:boto:Token: None 2024-04-16T18:11:27.166 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+l504j6V6wHBCM1xA75+dSJPNDM= 2024-04-16T18:11:27.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+l504j6V6wHBCM1xA75+dSJPNDM=', 'Content-Length': '0'} 2024-04-16T18:11:27.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd32e9da3e663e83-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:11:27.169 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.169 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.169 DEBUG:boto:path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.169 DEBUG:boto:auth_path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.169 DEBUG:boto:Method: GET 2024-04-16T18:11:27.169 DEBUG:boto:Path: /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.169 DEBUG:boto:Data: 2024-04-16T18:11:27.169 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.169 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.169 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.169 DEBUG:boto:Params: {} 2024-04-16T18:11:27.170 DEBUG:boto:Token: None 2024-04-16T18:11:27.170 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU= 2024-04-16T18:11:27.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU=', 'Content-Length': '0'} 2024-04-16T18:11:27.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a61b9a3c23ea00ea-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.214 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.214 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.215 DEBUG:boto:path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.215 DEBUG:boto:auth_path=/cjqttm-46/c?versionId=null 2024-04-16T18:11:27.215 DEBUG:boto:Method: GET 2024-04-16T18:11:27.215 DEBUG:boto:Path: /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.215 DEBUG:boto:Data: 2024-04-16T18:11:27.215 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.215 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.215 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.215 DEBUG:boto:Params: {} 2024-04-16T18:11:27.215 DEBUG:boto:Token: None 2024-04-16T18:11:27.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c?versionId=null 2024-04-16T18:11:27.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU= 2024-04-16T18:11:27.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7GhGcWJ7ksioZcsFXI1EnEGNuwU=', 'Content-Length': '0'} 2024-04-16T18:11:27.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015ba367291b0ac88-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.218 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.218 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.218 DEBUG:boto:path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.218 DEBUG:boto:auth_path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.218 DEBUG:boto:Method: GET 2024-04-16T18:11:27.218 DEBUG:boto:Path: /cjqttm-46/?prefix=c 2024-04-16T18:11:27.218 DEBUG:boto:Data: 2024-04-16T18:11:27.218 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.219 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.219 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.219 DEBUG:boto:Params: {} 2024-04-16T18:11:27.219 DEBUG:boto:Token: None 2024-04-16T18:11:27.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f8d07fee9dc80c8-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.221 DEBUG:boto:b'cjqttm-46c1000falsec2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.222 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.222 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.222 DEBUG:boto:path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.222 DEBUG:boto:auth_path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.222 DEBUG:boto:Method: GET 2024-04-16T18:11:27.222 DEBUG:boto:Path: /cjqttm-46/?prefix=c 2024-04-16T18:11:27.222 DEBUG:boto:Data: 2024-04-16T18:11:27.222 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.222 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.223 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.223 DEBUG:boto:Params: {} 2024-04-16T18:11:27.223 DEBUG:boto:Token: None 2024-04-16T18:11:27.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.225 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083af0d10a44b8ae2-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.226 DEBUG:boto:b'cjqttm-46c1000falsec2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.226 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.226 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.226 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.226 DEBUG:boto:Path: /cjqttm-46/c 2024-04-16T18:11:27.226 DEBUG:boto:Data: 2024-04-16T18:11:27.226 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.226 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.227 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.227 DEBUG:boto:Params: {} 2024-04-16T18:11:27.227 DEBUG:boto:Token: None 2024-04-16T18:11:27.227 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c 2024-04-16T18:11:27.227 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VyvXQCEk662hhLLqy2hyGFUEZ60= 2024-04-16T18:11:27.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VyvXQCEk662hhLLqy2hyGFUEZ60=', 'Content-Length': '0'} 2024-04-16T18:11:27.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f20839a3abe31e28-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.229 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.229 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.229 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.229 DEBUG:boto:Path: /cjqttm-46/c 2024-04-16T18:11:27.229 DEBUG:boto:Data: 2024-04-16T18:11:27.230 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.230 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.230 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.230 DEBUG:boto:Params: {} 2024-04-16T18:11:27.230 DEBUG:boto:Token: None 2024-04-16T18:11:27.230 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c 2024-04-16T18:11:27.230 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VyvXQCEk662hhLLqy2hyGFUEZ60= 2024-04-16T18:11:27.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VyvXQCEk662hhLLqy2hyGFUEZ60=', 'Content-Length': '0'} 2024-04-16T18:11:27.232 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005abb10cb73ac60fc-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.232 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:11:27.232 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.233 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.233 DEBUG:boto:Method: GET 2024-04-16T18:11:27.233 DEBUG:boto:Path: /cjqttm-46/c 2024-04-16T18:11:27.233 DEBUG:boto:Data: 2024-04-16T18:11:27.233 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.233 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.233 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.233 DEBUG:boto:Params: {} 2024-04-16T18:11:27.233 DEBUG:boto:Token: None 2024-04-16T18:11:27.233 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c 2024-04-16T18:11:27.233 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I3X3JFnMHYNTU3zX33SOqMBGKzE= 2024-04-16T18:11:27.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I3X3JFnMHYNTU3zX33SOqMBGKzE=', 'Content-Length': '0'} 2024-04-16T18:11:27.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003734ce9ffb03ed4-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.278 DEBUG:boto:path=/cjqttm-46/c 2024-04-16T18:11:27.278 DEBUG:boto:auth_path=/cjqttm-46/c 2024-04-16T18:11:27.279 DEBUG:boto:Method: GET 2024-04-16T18:11:27.279 DEBUG:boto:Path: /cjqttm-46/c 2024-04-16T18:11:27.279 DEBUG:boto:Data: 2024-04-16T18:11:27.279 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.279 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.279 DEBUG:boto:Params: {} 2024-04-16T18:11:27.279 DEBUG:boto:Token: None 2024-04-16T18:11:27.279 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/c 2024-04-16T18:11:27.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I3X3JFnMHYNTU3zX33SOqMBGKzE= 2024-04-16T18:11:27.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I3X3JFnMHYNTU3zX33SOqMBGKzE=', 'Content-Length': '0'} 2024-04-16T18:11:27.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b82f0ec8522da992-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.282 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.282 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.282 DEBUG:boto:path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.282 DEBUG:boto:auth_path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.282 DEBUG:boto:Method: GET 2024-04-16T18:11:27.282 DEBUG:boto:Path: /cjqttm-46/?prefix=c 2024-04-16T18:11:27.282 DEBUG:boto:Data: 2024-04-16T18:11:27.282 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.283 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.283 DEBUG:boto:Params: {} 2024-04-16T18:11:27.283 DEBUG:boto:Token: None 2024-04-16T18:11:27.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001abe8a2d3bc996bc-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.286 DEBUG:boto:b'cjqttm-46c1000falsec2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.286 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.286 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.286 DEBUG:boto:path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.287 DEBUG:boto:auth_path=/cjqttm-46/?prefix=c 2024-04-16T18:11:27.287 DEBUG:boto:Method: GET 2024-04-16T18:11:27.287 DEBUG:boto:Path: /cjqttm-46/?prefix=c 2024-04-16T18:11:27.287 DEBUG:boto:Data: 2024-04-16T18:11:27.287 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.287 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.287 DEBUG:boto:Params: {} 2024-04-16T18:11:27.287 DEBUG:boto:Token: None 2024-04-16T18:11:27.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7a3db5b2ea0a8a1-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.290 DEBUG:boto:b'cjqttm-46c1000falsec2024-04-16T18:09:31.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:11:27.291 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.291 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.291 DEBUG:boto:path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.291 DEBUG:boto:auth_path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.291 DEBUG:boto:Method: GET 2024-04-16T18:11:27.291 DEBUG:boto:Path: /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.291 DEBUG:boto:Data: 2024-04-16T18:11:27.291 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.291 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.291 DEBUG:boto:Params: {} 2024-04-16T18:11:27.292 DEBUG:boto:Token: None 2024-04-16T18:11:27.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw= 2024-04-16T18:11:27.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw=', 'Content-Length': '0'} 2024-04-16T18:11:27.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a03f95b85c0120bf-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.334 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.335 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.335 DEBUG:boto:path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.335 DEBUG:boto:auth_path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.335 DEBUG:boto:Method: GET 2024-04-16T18:11:27.335 DEBUG:boto:Path: /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.335 DEBUG:boto:Data: 2024-04-16T18:11:27.335 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.335 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.335 DEBUG:boto:Params: {} 2024-04-16T18:11:27.336 DEBUG:boto:Token: None 2024-04-16T18:11:27.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw= 2024-04-16T18:11:27.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw=', 'Content-Length': '0'} 2024-04-16T18:11:27.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006aac85991e3d9ee3-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.339 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.339 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.339 DEBUG:boto:path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.339 DEBUG:boto:auth_path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.339 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.339 DEBUG:boto:Path: /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.339 DEBUG:boto:Data: 2024-04-16T18:11:27.339 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.340 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.340 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.340 DEBUG:boto:Params: {} 2024-04-16T18:11:27.340 DEBUG:boto:Token: None 2024-04-16T18:11:27.340 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m86nV+EsEL2IX8sAPwsod1sGYuw= 2024-04-16T18:11:27.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m86nV+EsEL2IX8sAPwsod1sGYuw=', 'Content-Length': '0'} 2024-04-16T18:11:27.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bf3bd29ee42e31d-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.342 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.343 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.343 DEBUG:boto:path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.343 DEBUG:boto:auth_path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.343 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.343 DEBUG:boto:Path: /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.343 DEBUG:boto:Data: 2024-04-16T18:11:27.343 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.343 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.343 DEBUG:boto:Params: {} 2024-04-16T18:11:27.343 DEBUG:boto:Token: None 2024-04-16T18:11:27.344 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m86nV+EsEL2IX8sAPwsod1sGYuw= 2024-04-16T18:11:27.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m86nV+EsEL2IX8sAPwsod1sGYuw=', 'Content-Length': '0'} 2024-04-16T18:11:27.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9eea0a53b32a0c8-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.346 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:11:27.346 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.346 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.346 DEBUG:boto:path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.346 DEBUG:boto:auth_path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.346 DEBUG:boto:Method: GET 2024-04-16T18:11:27.347 DEBUG:boto:Path: /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.347 DEBUG:boto:Data: 2024-04-16T18:11:27.347 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.347 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.347 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.347 DEBUG:boto:Params: {} 2024-04-16T18:11:27.347 DEBUG:boto:Token: None 2024-04-16T18:11:27.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw= 2024-04-16T18:11:27.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw=', 'Content-Length': '0'} 2024-04-16T18:11:27.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007f2ed011b804f17-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.390 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.391 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.391 DEBUG:boto:path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.391 DEBUG:boto:auth_path=/cjqttm-46/d?versionId=null 2024-04-16T18:11:27.391 DEBUG:boto:Method: GET 2024-04-16T18:11:27.391 DEBUG:boto:Path: /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.391 DEBUG:boto:Data: 2024-04-16T18:11:27.391 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.391 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.391 DEBUG:boto:Params: {} 2024-04-16T18:11:27.391 DEBUG:boto:Token: None 2024-04-16T18:11:27.392 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d?versionId=null 2024-04-16T18:11:27.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw= 2024-04-16T18:11:27.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7835rdDJ7C3Svmxy+rb7fw449Aw=', 'Content-Length': '0'} 2024-04-16T18:11:27.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f295652991f74575-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.394 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.394 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.394 DEBUG:boto:path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.395 DEBUG:boto:auth_path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.395 DEBUG:boto:Method: GET 2024-04-16T18:11:27.395 DEBUG:boto:Path: /cjqttm-46/?prefix=d 2024-04-16T18:11:27.395 DEBUG:boto:Data: 2024-04-16T18:11:27.395 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.395 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.395 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.395 DEBUG:boto:Params: {} 2024-04-16T18:11:27.395 DEBUG:boto:Token: None 2024-04-16T18:11:27.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a9821c68944c0fe-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.398 DEBUG:boto:b'cjqttm-46d1000falsed2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.399 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.399 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.399 DEBUG:boto:path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.399 DEBUG:boto:auth_path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.399 DEBUG:boto:Method: GET 2024-04-16T18:11:27.399 DEBUG:boto:Path: /cjqttm-46/?prefix=d 2024-04-16T18:11:27.399 DEBUG:boto:Data: 2024-04-16T18:11:27.399 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.400 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.400 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.400 DEBUG:boto:Params: {} 2024-04-16T18:11:27.400 DEBUG:boto:Token: None 2024-04-16T18:11:27.400 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.403 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000725333b71f855568-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.403 DEBUG:boto:b'cjqttm-46d1000falsed2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.403 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.403 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.403 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.404 DEBUG:boto:Path: /cjqttm-46/d 2024-04-16T18:11:27.404 DEBUG:boto:Data: 2024-04-16T18:11:27.404 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.404 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.404 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.404 DEBUG:boto:Params: {} 2024-04-16T18:11:27.404 DEBUG:boto:Token: None 2024-04-16T18:11:27.404 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d 2024-04-16T18:11:27.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w7Z+amRMA9i0Br46kG5ak7OtODw= 2024-04-16T18:11:27.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w7Z+amRMA9i0Br46kG5ak7OtODw=', 'Content-Length': '0'} 2024-04-16T18:11:27.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d63aedb014c02b1-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.407 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.407 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.407 DEBUG:boto:Method: HEAD 2024-04-16T18:11:27.407 DEBUG:boto:Path: /cjqttm-46/d 2024-04-16T18:11:27.407 DEBUG:boto:Data: 2024-04-16T18:11:27.407 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.408 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.408 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.408 DEBUG:boto:Params: {} 2024-04-16T18:11:27.408 DEBUG:boto:Token: None 2024-04-16T18:11:27.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d 2024-04-16T18:11:27.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w7Z+amRMA9i0Br46kG5ak7OtODw= 2024-04-16T18:11:27.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w7Z+amRMA9i0Br46kG5ak7OtODw=', 'Content-Length': '0'} 2024-04-16T18:11:27.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5b35f304f921d16-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.410 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:11:27.411 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.411 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.411 DEBUG:boto:Method: GET 2024-04-16T18:11:27.411 DEBUG:boto:Path: /cjqttm-46/d 2024-04-16T18:11:27.411 DEBUG:boto:Data: 2024-04-16T18:11:27.411 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.411 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.411 DEBUG:boto:Params: {} 2024-04-16T18:11:27.411 DEBUG:boto:Token: None 2024-04-16T18:11:27.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d 2024-04-16T18:11:27.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5pGkRJZCLNF1YLeJaGiO2h4BjTw= 2024-04-16T18:11:27.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5pGkRJZCLNF1YLeJaGiO2h4BjTw=', 'Content-Length': '0'} 2024-04-16T18:11:27.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-46:9ba59572-f51c-4bce-9578-e6350e822996.4816.15'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:09:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc32089c00e11f52-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.458 DEBUG:boto:path=/cjqttm-46/d 2024-04-16T18:11:27.458 DEBUG:boto:auth_path=/cjqttm-46/d 2024-04-16T18:11:27.459 DEBUG:boto:Method: GET 2024-04-16T18:11:27.459 DEBUG:boto:Path: /cjqttm-46/d 2024-04-16T18:11:27.459 DEBUG:boto:Data: 2024-04-16T18:11:27.459 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.459 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.459 DEBUG:boto:Params: {} 2024-04-16T18:11:27.459 DEBUG:boto:Token: None 2024-04-16T18:11:27.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/d 2024-04-16T18:11:27.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5pGkRJZCLNF1YLeJaGiO2h4BjTw= 2024-04-16T18:11:27.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5pGkRJZCLNF1YLeJaGiO2h4BjTw=', 'Content-Length': '0'} 2024-04-16T18:11:27.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:09:31 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070b6236c48c87eb8-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.462 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.462 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.462 DEBUG:boto:path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.462 DEBUG:boto:auth_path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.462 DEBUG:boto:Method: GET 2024-04-16T18:11:27.462 DEBUG:boto:Path: /cjqttm-46/?prefix=d 2024-04-16T18:11:27.462 DEBUG:boto:Data: 2024-04-16T18:11:27.462 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.462 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:27.463 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.463 DEBUG:boto:Params: {} 2024-04-16T18:11:27.463 DEBUG:boto:Token: None 2024-04-16T18:11:27.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003caa7ff3c8c39a0e-00661ebf4f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.466 DEBUG:boto:b'cjqttm-46d1000falsed2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.466 DEBUG:boto:path=/cjqttm-46/ 2024-04-16T18:11:27.466 DEBUG:boto:auth_path=/cjqttm-46/ 2024-04-16T18:11:27.466 DEBUG:boto:path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.466 DEBUG:boto:auth_path=/cjqttm-46/?prefix=d 2024-04-16T18:11:27.466 DEBUG:boto:Method: GET 2024-04-16T18:11:27.466 DEBUG:boto:Path: /cjqttm-46/?prefix=d 2024-04-16T18:11:27.467 DEBUG:boto:Data: 2024-04-16T18:11:27.467 DEBUG:boto:Headers: {} 2024-04-16T18:11:27.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:27.467 DEBUG:boto:Port: 8000 2024-04-16T18:11:27.467 DEBUG:boto:Params: {} 2024-04-16T18:11:27.467 DEBUG:boto:Token: None 2024-04-16T18:11:27.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:27 GMT /cjqttm-46/ 2024-04-16T18:11:27.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ= 2024-04-16T18:11:27.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N+Ejm1LkgG/gbziGoeqhujpq8EQ=', 'Content-Length': '0'} 2024-04-16T18:11:27.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096c2460b7e028801-00661ebf4f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:27.469 DEBUG:boto:b'cjqttm-46d1000falsed2024-04-16T18:09:31.159Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:27.470 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-46 zones={test-zone2, test-zone1} 2024-04-16T18:11:27.470 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:27.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:27.471 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 1 --rgw-sync-log-trim-min-cold-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:11:27.523 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:27.523 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:27.615 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'cjqttm-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:27.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'cjqttm-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:27.615 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket cjqttm-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:11:27.661 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:27.662 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:27.735 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T18:11:27.736 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'cjqttm-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:27.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'cjqttm-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:27.736 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket cjqttm-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:11:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:27.781 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:27.854 INFO:teuthology.orchestra.run.smithi016.stdout:[{"op_id":"1#00000000001.33.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10414783665070237457","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:09:19.445268641Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14"}]},{"op_id":"5#00000000001.40.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.15423788760421170918","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:09:19.515061782Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14"}]},{"op_id":"8#00000000001.31.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10096046210345301889","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:09:19.503694071Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14"}]},{"op_id":"10#00000000001.48.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.16469365904919789795","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:09:19.457550672Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-45:9ba59572-f51c-4bce-9578-e6350e822996.4816.14"}]}] 2024-04-16T18:11:27.854 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:27.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:27.855 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 999 --rgw-sync-log-trim-min-cold-buckets 999 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:11:27.899 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:27.899 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:28.136 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.138+0000 7f5b49eeb640 -1 req 14835139996803820654 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-32:9ba59572-f51c-4bce-9578-e6350e822996.4816.1,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-32:9ba59572-f51c-4bce-9578-e6350e822996.4816.1,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.136 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.138+0000 7f5bbc7d0640 -1 req 3009644463377513458 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-21:9ba59572-f51c-4bce-9578-e6350e822996.4365.25,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-21:9ba59572-f51c-4bce-9578-e6350e822996.4365.25,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.140 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.142+0000 7f5c1287c640 -1 req 12386567438412317178 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-43:9ba59572-f51c-4bce-9578-e6350e822996.4816.12,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-43:9ba59572-f51c-4bce-9578-e6350e822996.4816.12,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.142 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.144+0000 7f5b51efb640 -1 req 5449631239794886093 0.000999978s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-33:9ba59572-f51c-4bce-9578-e6350e822996.4816.2,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-33:9ba59572-f51c-4bce-9578-e6350e822996.4816.2,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.184 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.187+0000 7f5b506f8640 -1 req 4560900078713895178 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-35:9ba59572-f51c-4bce-9578-e6350e822996.4816.4,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-35:9ba59572-f51c-4bce-9578-e6350e822996.4816.4,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.207 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.188+0000 7f5bdc00f640 -1 req 12634830892609425877 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.207 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.189+0000 7f5bb3fbf640 -1 req 10859223974331479602 0.002999935s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-23:9ba59572-f51c-4bce-9578-e6350e822996.4365.27,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-23:9ba59572-f51c-4bce-9578-e6350e822996.4365.27,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.230 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.232+0000 7f5b7e754640 -1 req 7727932707095973187 0.002999936s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-3:9ba59572-f51c-4bce-9578-e6350e822996.4365.3,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-3:9ba59572-f51c-4bce-9578-e6350e822996.4365.3,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.366 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.368+0000 7f5bd8808640 -1 req 212832563633562286 0.001999958s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-5:9ba59572-f51c-4bce-9578-e6350e822996.4365.9,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-5:9ba59572-f51c-4bce-9578-e6350e822996.4365.9,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.417 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.419+0000 7f5bc27dc640 -1 req 5435522456025381048 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-25:9ba59572-f51c-4bce-9578-e6350e822996.4365.29,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-25:9ba59572-f51c-4bce-9578-e6350e822996.4365.29,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.419 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.422+0000 7f5b64720640 -1 req 12424563793147198135 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-22:9ba59572-f51c-4bce-9578-e6350e822996.4365.26,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-22:9ba59572-f51c-4bce-9578-e6350e822996.4365.26,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.457 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.459+0000 7f5b97786640 -1 req 5532277169811034682 0.001999958s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-34:9ba59572-f51c-4bce-9578-e6350e822996.4816.3,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-34:9ba59572-f51c-4bce-9578-e6350e822996.4816.3,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.462 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.465+0000 7f5b7d752640 -1 req 543885602742139362 0.002999936s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-24:9ba59572-f51c-4bce-9578-e6350e822996.4365.28,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-24:9ba59572-f51c-4bce-9578-e6350e822996.4365.28,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.466 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.468+0000 7f5b266a4640 -1 req 13081289366961520092 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-4:9ba59572-f51c-4bce-9578-e6350e822996.4365.4,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-4:9ba59572-f51c-4bce-9578-e6350e822996.4365.4,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.549 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.552+0000 7f5bea82c640 -1 req 17541358232712134550 0.002999935s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-2:9ba59572-f51c-4bce-9578-e6350e822996.4365.2,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.601 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:11:28.603+0000 7f5c06063640 -1 req 6253899885193914905 0.001999958s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-26:9ba59572-f51c-4bce-9578-e6350e822996.4365.30,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-26:9ba59572-f51c-4bce-9578-e6350e822996.4365.30,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:11:28.668 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'cjqttm-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:28.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'cjqttm-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:28.668 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket cjqttm-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:11:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:28.714 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:28.784 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T18:11:28.785 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_index_log_trim ... ok 2024-04-16T18:11:28.787 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:28.787 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:28.787 DEBUG:boto:Method: PUT 2024-04-16T18:11:28.787 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:28.787 DEBUG:boto:Data: 2024-04-16T18:11:28.787 DEBUG:boto:Headers: {} 2024-04-16T18:11:28.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:28.787 DEBUG:boto:Port: 8000 2024-04-16T18:11:28.787 DEBUG:boto:Params: {} 2024-04-16T18:11:28.788 DEBUG:boto:Token: None 2024-04-16T18:11:28.788 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:11:28 GMT /cjqttm-47/ 2024-04-16T18:11:28.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mNMYZWaJXB7Gd39o1Z72aB8RvEQ= 2024-04-16T18:11:28.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mNMYZWaJXB7Gd39o1Z72aB8RvEQ=', 'Content-Length': '0'} 2024-04-16T18:11:28.803 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000006c90f9ad91adac4-00661ebf50-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:28.803 DEBUG:rgw_multi.tests:created bucket=cjqttm-47 2024-04-16T18:11:28.803 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:28.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:28.803 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:11:28.849 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:28.850 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:28.899 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:11:28.920 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291088.803819_647.1","last_update":"2024-04-16T18:11:28.803819Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:11:28.920 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291088.803819_647.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:11:28.920 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:11:28.920 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:28.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:28.921 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:11:28.976 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:28.976 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:29.030 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:29.032+0000 7f4996224800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:11:29.031 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:29.033+0000 7f4996224800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:11:29.055 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290971.077773_622.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:31.077773Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:11:29Z"} 2024-04-16T18:11:29.055 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713290971.077773_622.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:09:31.077773Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:11:29Z"} 2024-04-16T18:11:29.055 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713290971.077773_622.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:09:31.077773Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:11:29.055 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291088.803819_647.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:11:29.055 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713290971.077773_622.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:11:29.056 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291088.803819_647.1 target=1_1713290971.077773_622.1 2024-04-16T18:11:34.056 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:34.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:11:34.056 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:11:34.112 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:34.112 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:34.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:34.168+0000 7f8e9d412800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:11:34.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:34.170+0000 7f8e9d412800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:11:34.190 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291088.803819_647.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:11:28.803819Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:11:34Z"} 2024-04-16T18:11:34.191 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291088.803819_647.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:11:28.803819Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:11:34Z"} 2024-04-16T18:11:34.191 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291088.803819_647.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:11:28.803819Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:11:34.191 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291088.803819_647.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:11:34.191 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291088.803819_647.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:11:34.191 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:11:34.191 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:34.192 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:34.192 DEBUG:boto:Method: HEAD 2024-04-16T18:11:34.192 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:34.192 DEBUG:boto:Data: 2024-04-16T18:11:34.192 DEBUG:boto:Headers: {} 2024-04-16T18:11:34.192 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.192 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.192 DEBUG:boto:Params: {} 2024-04-16T18:11:34.192 DEBUG:boto:Token: None 2024-04-16T18:11:34.192 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/ 2024-04-16T18:11:34.193 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag= 2024-04-16T18:11:34.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag=', 'Content-Length': '0'} 2024-04-16T18:11:34.195 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003d5b5504f8e8e4ad-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.195 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:34.195 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:34.195 DEBUG:boto:Method: PUT 2024-04-16T18:11:34.196 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:11:34.196 DEBUG:boto:Data: 2024-04-16T18:11:34.196 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:34.196 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.196 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.196 DEBUG:boto:Params: {} 2024-04-16T18:11:34.196 DEBUG:boto:Token: None 2024-04-16T18:11:34.196 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/a 2024-04-16T18:11:34.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NtXizXW3XOeh/HSnuyCR55kF2r4= 2024-04-16T18:11:34.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NtXizXW3XOeh/HSnuyCR55kF2r4='} 2024-04-16T18:11:34.204 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000383b03f67417476-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.204 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:34.204 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:34.204 DEBUG:boto:Method: HEAD 2024-04-16T18:11:34.204 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:34.204 DEBUG:boto:Data: 2024-04-16T18:11:34.205 DEBUG:boto:Headers: {} 2024-04-16T18:11:34.205 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.205 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.205 DEBUG:boto:Params: {} 2024-04-16T18:11:34.205 DEBUG:boto:Token: None 2024-04-16T18:11:34.205 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/ 2024-04-16T18:11:34.205 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag= 2024-04-16T18:11:34.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag=', 'Content-Length': '0'} 2024-04-16T18:11:34.207 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ec8664bd248d3f8-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.207 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:34.208 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:34.208 DEBUG:boto:Method: PUT 2024-04-16T18:11:34.208 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:11:34.208 DEBUG:boto:Data: 2024-04-16T18:11:34.208 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:34.208 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.208 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.208 DEBUG:boto:Params: {} 2024-04-16T18:11:34.208 DEBUG:boto:Token: None 2024-04-16T18:11:34.208 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/b 2024-04-16T18:11:34.209 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TEEAhbB64gvbBXcE+MvXGMRCb/c= 2024-04-16T18:11:34.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TEEAhbB64gvbBXcE+MvXGMRCb/c='} 2024-04-16T18:11:34.250 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000004393ac0819bc320-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.251 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:34.251 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:34.251 DEBUG:boto:Method: HEAD 2024-04-16T18:11:34.251 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:34.251 DEBUG:boto:Data: 2024-04-16T18:11:34.251 DEBUG:boto:Headers: {} 2024-04-16T18:11:34.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.251 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.251 DEBUG:boto:Params: {} 2024-04-16T18:11:34.251 DEBUG:boto:Token: None 2024-04-16T18:11:34.252 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/ 2024-04-16T18:11:34.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag= 2024-04-16T18:11:34.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag=', 'Content-Length': '0'} 2024-04-16T18:11:34.254 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008494deb881031e5e-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.254 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:34.254 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:34.254 DEBUG:boto:Method: PUT 2024-04-16T18:11:34.254 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:11:34.254 DEBUG:boto:Data: 2024-04-16T18:11:34.255 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:34.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.255 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.255 DEBUG:boto:Params: {} 2024-04-16T18:11:34.255 DEBUG:boto:Token: None 2024-04-16T18:11:34.255 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/c 2024-04-16T18:11:34.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DdWlMIWIJU+FsO/DQ6u1hr1mahY= 2024-04-16T18:11:34.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DdWlMIWIJU+FsO/DQ6u1hr1mahY='} 2024-04-16T18:11:34.261 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000efcc69c7eb3bb3eb-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.261 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:34.261 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:34.261 DEBUG:boto:Method: HEAD 2024-04-16T18:11:34.262 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:34.262 DEBUG:boto:Data: 2024-04-16T18:11:34.262 DEBUG:boto:Headers: {} 2024-04-16T18:11:34.262 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.262 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.262 DEBUG:boto:Params: {} 2024-04-16T18:11:34.262 DEBUG:boto:Token: None 2024-04-16T18:11:34.262 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/ 2024-04-16T18:11:34.262 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag= 2024-04-16T18:11:34.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0BnfH46Ja+0gDLbNolhn7ivKRag=', 'Content-Length': '0'} 2024-04-16T18:11:34.264 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009bf031b67ce12dbf-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.265 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:34.265 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:34.265 DEBUG:boto:Method: PUT 2024-04-16T18:11:34.265 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:11:34.265 DEBUG:boto:Data: 2024-04-16T18:11:34.265 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:34.265 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:34.265 DEBUG:boto:Port: 8000 2024-04-16T18:11:34.266 DEBUG:boto:Params: {} 2024-04-16T18:11:34.266 DEBUG:boto:Token: None 2024-04-16T18:11:34.266 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:34 GMT /cjqttm-47/d 2024-04-16T18:11:34.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A4Y56X8ajzUuZDNRaAaEke31Hxs= 2024-04-16T18:11:34.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:34 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A4Y56X8ajzUuZDNRaAaEke31Hxs='} 2024-04-16T18:11:34.272 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000001072ca677ec1caf-00661ebf56-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:34.272 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-47 2024-04-16T18:11:34.273 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:11:34.273 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:11:34.273 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-47 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:11:34.328 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:34.329 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:34.383 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:34.384+0000 7f08d834b800 1 waiting to reach incremental sync.. 2024-04-16T18:11:39.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:39.386+0000 7f08d834b800 1 bucket sync caught up with source: 2024-04-16T18:11:39.385 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.67.6, , , , 00000000001.31.6, , , 00000000001.39.6, , 00000000001.47.6] 2024-04-16T18:11:39.385 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000001.67.6, , , , 00000000001.31.6, , , 00000000001.39.6, , 00000000001.47.6] 2024-04-16T18:11:39.385 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:39.386+0000 7f08d834b800 0 bucket checkpoint complete 2024-04-16T18:11:39.411 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-47 2024-04-16T18:11:39.411 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:11:39.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:11:39.411 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-47 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:11:39.478 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:39.478 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:39.540 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:39.541+0000 7f1561836800 1 waiting to reach incremental sync.. 2024-04-16T18:11:44.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:44.543+0000 7f1561836800 1 bucket sync caught up with source: 2024-04-16T18:11:44.542 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.310.6, , , , 00000000001.228.6, , , 00000000001.167.6, , 00000000001.850.6] 2024-04-16T18:11:44.542 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.310.6, , , , 00000000001.228.6, , , 00000000001.167.6, , 00000000001.850.6] 2024-04-16T18:11:44.542 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:11:44.543+0000 7f1561836800 0 bucket checkpoint complete 2024-04-16T18:11:44.569 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-47 zones={test-zone2, test-zone1} 2024-04-16T18:11:44.569 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.569 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.569 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.569 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:44.570 DEBUG:boto:Data: 2024-04-16T18:11:44.570 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.570 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.570 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.570 DEBUG:boto:Params: {} 2024-04-16T18:11:44.570 DEBUG:boto:Token: None 2024-04-16T18:11:44.570 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.570 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bbmwqCaImzpjr/Z80/srY2pS2aA= 2024-04-16T18:11:44.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmwqCaImzpjr/Z80/srY2pS2aA=', 'Content-Length': '0'} 2024-04-16T18:11:44.573 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b16f73f652916bf2-00661ebf60-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.573 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.574 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.574 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.574 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:44.574 DEBUG:boto:Data: 2024-04-16T18:11:44.574 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.574 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.574 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.574 DEBUG:boto:Params: {} 2024-04-16T18:11:44.574 DEBUG:boto:Token: None 2024-04-16T18:11:44.575 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bbmwqCaImzpjr/Z80/srY2pS2aA= 2024-04-16T18:11:44.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmwqCaImzpjr/Z80/srY2pS2aA=', 'Content-Length': '0'} 2024-04-16T18:11:44.577 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001e75b58e09eec796-00661ebf60-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.577 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:11:44.577 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.577 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.577 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.578 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.578 DEBUG:boto:Method: GET 2024-04-16T18:11:44.578 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.578 DEBUG:boto:Data: 2024-04-16T18:11:44.578 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.578 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.578 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.578 DEBUG:boto:Params: {} 2024-04-16T18:11:44.578 DEBUG:boto:Token: None 2024-04-16T18:11:44.578 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/?versions 2024-04-16T18:11:44.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU= 2024-04-16T18:11:44.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU=', 'Content-Length': '0'} 2024-04-16T18:11:44.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e799b5149a25d70-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.581 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.582 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:11:44.582 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:11:44.582 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:11:44.582 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:11:44.582 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:11:44.582 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.582 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.583 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.583 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.583 DEBUG:boto:Method: GET 2024-04-16T18:11:44.583 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.583 DEBUG:boto:Data: 2024-04-16T18:11:44.583 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.583 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.583 DEBUG:boto:Params: {} 2024-04-16T18:11:44.583 DEBUG:boto:Token: None 2024-04-16T18:11:44.584 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/?versions 2024-04-16T18:11:44.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU= 2024-04-16T18:11:44.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU=', 'Content-Length': '0'} 2024-04-16T18:11:44.586 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ebf1f20882ce141c-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.586 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.586 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:11:44.587 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:11:44.587 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:11:44.587 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:11:44.587 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.587 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.587 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.587 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.587 DEBUG:boto:Method: GET 2024-04-16T18:11:44.587 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.587 DEBUG:boto:Data: 2024-04-16T18:11:44.588 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.588 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.588 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.588 DEBUG:boto:Params: {} 2024-04-16T18:11:44.588 DEBUG:boto:Token: None 2024-04-16T18:11:44.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/?versions 2024-04-16T18:11:44.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU= 2024-04-16T18:11:44.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU=', 'Content-Length': '0'} 2024-04-16T18:11:44.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011c372a4a629a4eb-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.591 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.591 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.592 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.592 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.592 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.592 DEBUG:boto:Method: GET 2024-04-16T18:11:44.592 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:11:44.592 DEBUG:boto:Data: 2024-04-16T18:11:44.592 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.592 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.592 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.592 DEBUG:boto:Params: {} 2024-04-16T18:11:44.593 DEBUG:boto:Token: None 2024-04-16T18:11:44.593 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/?versions 2024-04-16T18:11:44.593 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU= 2024-04-16T18:11:44.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0FeTewopVsLoEpJexWmgr9+WdSU=', 'Content-Length': '0'} 2024-04-16T18:11:44.595 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002438635d5325f854-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.595 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.596 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:11:44.596 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.596 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.596 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.596 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.596 DEBUG:boto:Method: GET 2024-04-16T18:11:44.596 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.596 DEBUG:boto:Data: 2024-04-16T18:11:44.596 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.596 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.597 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.597 DEBUG:boto:Params: {} 2024-04-16T18:11:44.597 DEBUG:boto:Token: None 2024-04-16T18:11:44.597 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.597 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ= 2024-04-16T18:11:44.597 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ=', 'Content-Length': '0'} 2024-04-16T18:11:44.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099a8697098a5752c-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.599 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.600 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.600 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.600 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.600 DEBUG:boto:Method: GET 2024-04-16T18:11:44.600 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.600 DEBUG:boto:Data: 2024-04-16T18:11:44.600 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.600 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.600 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.600 DEBUG:boto:Params: {} 2024-04-16T18:11:44.601 DEBUG:boto:Token: None 2024-04-16T18:11:44.601 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.601 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ= 2024-04-16T18:11:44.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ=', 'Content-Length': '0'} 2024-04-16T18:11:44.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001350d50a726249ff-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.646 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.646 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.647 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.647 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.647 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.647 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.647 DEBUG:boto:Data: 2024-04-16T18:11:44.647 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.647 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.647 DEBUG:boto:Params: {} 2024-04-16T18:11:44.647 DEBUG:boto:Token: None 2024-04-16T18:11:44.648 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kl5P2qj6uw63JRR/iaiv9cUSUwg= 2024-04-16T18:11:44.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kl5P2qj6uw63JRR/iaiv9cUSUwg=', 'Content-Length': '0'} 2024-04-16T18:11:44.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059a45c5884c55da0-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.650 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.650 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.650 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.650 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.650 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.651 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.651 DEBUG:boto:Data: 2024-04-16T18:11:44.651 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.651 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.651 DEBUG:boto:Params: {} 2024-04-16T18:11:44.651 DEBUG:boto:Token: None 2024-04-16T18:11:44.651 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kl5P2qj6uw63JRR/iaiv9cUSUwg= 2024-04-16T18:11:44.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kl5P2qj6uw63JRR/iaiv9cUSUwg=', 'Content-Length': '0'} 2024-04-16T18:11:44.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d531a54287ee37e4-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:11:44.654 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.654 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.654 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.654 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.655 DEBUG:boto:Method: GET 2024-04-16T18:11:44.655 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.655 DEBUG:boto:Data: 2024-04-16T18:11:44.655 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.655 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.655 DEBUG:boto:Params: {} 2024-04-16T18:11:44.655 DEBUG:boto:Token: None 2024-04-16T18:11:44.655 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ= 2024-04-16T18:11:44.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ=', 'Content-Length': '0'} 2024-04-16T18:11:44.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001757917c0ec2db6f-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.698 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.698 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.699 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.699 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:11:44.699 DEBUG:boto:Method: GET 2024-04-16T18:11:44.699 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.699 DEBUG:boto:Data: 2024-04-16T18:11:44.699 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.699 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.699 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.699 DEBUG:boto:Params: {} 2024-04-16T18:11:44.699 DEBUG:boto:Token: None 2024-04-16T18:11:44.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:11:44.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ= 2024-04-16T18:11:44.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ab/dWvpCz3pPHBcDVtLyIB1jXQ=', 'Content-Length': '0'} 2024-04-16T18:11:44.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097f75bc38177f86e-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.702 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.702 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.702 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.702 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.702 DEBUG:boto:Method: GET 2024-04-16T18:11:44.703 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:11:44.703 DEBUG:boto:Data: 2024-04-16T18:11:44.703 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.703 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.703 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.703 DEBUG:boto:Params: {} 2024-04-16T18:11:44.703 DEBUG:boto:Token: None 2024-04-16T18:11:44.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.706 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1d7ca3734dd4c18-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.746 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.747 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.747 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.747 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.747 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.747 DEBUG:boto:Method: GET 2024-04-16T18:11:44.747 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:11:44.747 DEBUG:boto:Data: 2024-04-16T18:11:44.747 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.747 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.748 DEBUG:boto:Params: {} 2024-04-16T18:11:44.748 DEBUG:boto:Token: None 2024-04-16T18:11:44.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005cc4f7b09bb091eb-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.750 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.751 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.751 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.751 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.751 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:11:44.751 DEBUG:boto:Data: 2024-04-16T18:11:44.751 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.751 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.751 DEBUG:boto:Params: {} 2024-04-16T18:11:44.751 DEBUG:boto:Token: None 2024-04-16T18:11:44.752 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a 2024-04-16T18:11:44.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+pj5/1aCqelOULCGnfnR9UG04LA= 2024-04-16T18:11:44.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+pj5/1aCqelOULCGnfnR9UG04LA=', 'Content-Length': '0'} 2024-04-16T18:11:44.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd184ee9396b6d36-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.754 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.754 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.754 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.754 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:11:44.754 DEBUG:boto:Data: 2024-04-16T18:11:44.754 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.755 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.755 DEBUG:boto:Params: {} 2024-04-16T18:11:44.755 DEBUG:boto:Token: None 2024-04-16T18:11:44.755 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a 2024-04-16T18:11:44.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+pj5/1aCqelOULCGnfnR9UG04LA= 2024-04-16T18:11:44.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+pj5/1aCqelOULCGnfnR9UG04LA=', 'Content-Length': '0'} 2024-04-16T18:11:44.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067a1424179865df9-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:11:44.757 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.757 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.757 DEBUG:boto:Method: GET 2024-04-16T18:11:44.757 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:11:44.758 DEBUG:boto:Data: 2024-04-16T18:11:44.758 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.758 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.758 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.758 DEBUG:boto:Params: {} 2024-04-16T18:11:44.758 DEBUG:boto:Token: None 2024-04-16T18:11:44.758 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a 2024-04-16T18:11:44.758 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:596DfgM5lvsWFMlu/T0LrCxm5y0= 2024-04-16T18:11:44.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:596DfgM5lvsWFMlu/T0LrCxm5y0=', 'Content-Length': '0'} 2024-04-16T18:11:44.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f50e4df12808a829-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.802 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:11:44.803 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:11:44.803 DEBUG:boto:Method: GET 2024-04-16T18:11:44.803 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:11:44.803 DEBUG:boto:Data: 2024-04-16T18:11:44.803 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.803 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.803 DEBUG:boto:Params: {} 2024-04-16T18:11:44.803 DEBUG:boto:Token: None 2024-04-16T18:11:44.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/a 2024-04-16T18:11:44.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:596DfgM5lvsWFMlu/T0LrCxm5y0= 2024-04-16T18:11:44.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:596DfgM5lvsWFMlu/T0LrCxm5y0=', 'Content-Length': '0'} 2024-04-16T18:11:44.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d15ee3f99419f9de-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.806 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.806 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.806 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.806 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.807 DEBUG:boto:Method: GET 2024-04-16T18:11:44.807 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:11:44.807 DEBUG:boto:Data: 2024-04-16T18:11:44.807 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.807 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.807 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.807 DEBUG:boto:Params: {} 2024-04-16T18:11:44.807 DEBUG:boto:Token: None 2024-04-16T18:11:44.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9579e9e098212af-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.810 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.810 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.810 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.810 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.811 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:11:44.811 DEBUG:boto:Method: GET 2024-04-16T18:11:44.811 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:11:44.811 DEBUG:boto:Data: 2024-04-16T18:11:44.811 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.811 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.811 DEBUG:boto:Params: {} 2024-04-16T18:11:44.811 DEBUG:boto:Token: None 2024-04-16T18:11:44.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.814 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000959ef38b9695b12-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.814 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:11:44.814 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.814 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.814 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.815 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.815 DEBUG:boto:Method: GET 2024-04-16T18:11:44.815 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.815 DEBUG:boto:Data: 2024-04-16T18:11:44.815 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.815 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.815 DEBUG:boto:Params: {} 2024-04-16T18:11:44.815 DEBUG:boto:Token: None 2024-04-16T18:11:44.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk= 2024-04-16T18:11:44.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk=', 'Content-Length': '0'} 2024-04-16T18:11:44.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5f3204d41d26ad9-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.858 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.858 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.859 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.859 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.859 DEBUG:boto:Method: GET 2024-04-16T18:11:44.859 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.859 DEBUG:boto:Data: 2024-04-16T18:11:44.859 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.859 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.859 DEBUG:boto:Params: {} 2024-04-16T18:11:44.859 DEBUG:boto:Token: None 2024-04-16T18:11:44.860 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk= 2024-04-16T18:11:44.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk=', 'Content-Length': '0'} 2024-04-16T18:11:44.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ac5ba5b0b862511-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.862 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.862 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.862 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.862 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.863 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.863 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.863 DEBUG:boto:Data: 2024-04-16T18:11:44.863 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.863 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.863 DEBUG:boto:Params: {} 2024-04-16T18:11:44.863 DEBUG:boto:Token: None 2024-04-16T18:11:44.863 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SfDfkDkhnoM3mQeDp4Wq9jENMSU= 2024-04-16T18:11:44.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SfDfkDkhnoM3mQeDp4Wq9jENMSU=', 'Content-Length': '0'} 2024-04-16T18:11:44.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010bc1ccf191e93a6-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.866 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.866 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.866 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.866 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.866 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.867 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.867 DEBUG:boto:Data: 2024-04-16T18:11:44.867 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.867 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.867 DEBUG:boto:Params: {} 2024-04-16T18:11:44.867 DEBUG:boto:Token: None 2024-04-16T18:11:44.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SfDfkDkhnoM3mQeDp4Wq9jENMSU= 2024-04-16T18:11:44.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SfDfkDkhnoM3mQeDp4Wq9jENMSU=', 'Content-Length': '0'} 2024-04-16T18:11:44.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd3bd5fe51d0ecf4-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.870 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:11:44.870 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.870 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.870 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.870 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.870 DEBUG:boto:Method: GET 2024-04-16T18:11:44.870 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.870 DEBUG:boto:Data: 2024-04-16T18:11:44.870 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.870 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.871 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.871 DEBUG:boto:Params: {} 2024-04-16T18:11:44.871 DEBUG:boto:Token: None 2024-04-16T18:11:44.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk= 2024-04-16T18:11:44.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk=', 'Content-Length': '0'} 2024-04-16T18:11:44.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001482407f94a83a0a-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.914 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.914 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.914 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.915 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:11:44.915 DEBUG:boto:Method: GET 2024-04-16T18:11:44.915 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.915 DEBUG:boto:Data: 2024-04-16T18:11:44.915 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.915 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.915 DEBUG:boto:Params: {} 2024-04-16T18:11:44.915 DEBUG:boto:Token: None 2024-04-16T18:11:44.915 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:11:44.915 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk= 2024-04-16T18:11:44.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z/V1XHOqfAva5mctX3hKXvDMAXk=', 'Content-Length': '0'} 2024-04-16T18:11:44.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068d887729be87262-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.918 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.918 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.918 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.918 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.918 DEBUG:boto:Method: GET 2024-04-16T18:11:44.918 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:11:44.918 DEBUG:boto:Data: 2024-04-16T18:11:44.918 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.919 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.919 DEBUG:boto:Params: {} 2024-04-16T18:11:44.919 DEBUG:boto:Token: None 2024-04-16T18:11:44.919 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.922 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c6e4d8669900441-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.922 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.922 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.922 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.922 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.923 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.923 DEBUG:boto:Method: GET 2024-04-16T18:11:44.923 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:11:44.923 DEBUG:boto:Data: 2024-04-16T18:11:44.923 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.923 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.923 DEBUG:boto:Params: {} 2024-04-16T18:11:44.923 DEBUG:boto:Token: None 2024-04-16T18:11:44.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.926 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fbb9f07ae9f7fb3-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.926 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.926 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.927 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.927 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.927 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:11:44.927 DEBUG:boto:Data: 2024-04-16T18:11:44.927 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.927 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.927 DEBUG:boto:Params: {} 2024-04-16T18:11:44.927 DEBUG:boto:Token: None 2024-04-16T18:11:44.927 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b 2024-04-16T18:11:44.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4geXQl5NAnCHTQwAzx9EIQ5K5N8= 2024-04-16T18:11:44.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4geXQl5NAnCHTQwAzx9EIQ5K5N8=', 'Content-Length': '0'} 2024-04-16T18:11:44.930 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004294a807d0f5b38e-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.930 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.930 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.930 DEBUG:boto:Method: HEAD 2024-04-16T18:11:44.931 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:11:44.931 DEBUG:boto:Data: 2024-04-16T18:11:44.931 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.931 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.931 DEBUG:boto:Params: {} 2024-04-16T18:11:44.931 DEBUG:boto:Token: None 2024-04-16T18:11:44.931 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b 2024-04-16T18:11:44.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4geXQl5NAnCHTQwAzx9EIQ5K5N8= 2024-04-16T18:11:44.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4geXQl5NAnCHTQwAzx9EIQ5K5N8=', 'Content-Length': '0'} 2024-04-16T18:11:44.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f9f82b8a4018b19-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.934 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:11:44.934 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.934 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.934 DEBUG:boto:Method: GET 2024-04-16T18:11:44.934 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:11:44.934 DEBUG:boto:Data: 2024-04-16T18:11:44.934 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.934 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.934 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.934 DEBUG:boto:Params: {} 2024-04-16T18:11:44.935 DEBUG:boto:Token: None 2024-04-16T18:11:44.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b 2024-04-16T18:11:44.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GMoajcQ/9mTILbv1uRwSCjQVL2I= 2024-04-16T18:11:44.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMoajcQ/9mTILbv1uRwSCjQVL2I=', 'Content-Length': '0'} 2024-04-16T18:11:44.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007967a59f21b84361-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.978 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:11:44.978 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:11:44.979 DEBUG:boto:Method: GET 2024-04-16T18:11:44.979 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:11:44.979 DEBUG:boto:Data: 2024-04-16T18:11:44.979 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.979 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.979 DEBUG:boto:Params: {} 2024-04-16T18:11:44.979 DEBUG:boto:Token: None 2024-04-16T18:11:44.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/b 2024-04-16T18:11:44.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GMoajcQ/9mTILbv1uRwSCjQVL2I= 2024-04-16T18:11:44.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMoajcQ/9mTILbv1uRwSCjQVL2I=', 'Content-Length': '0'} 2024-04-16T18:11:44.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d70e21be655da9a5-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.982 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.982 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.983 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.983 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.983 DEBUG:boto:Method: GET 2024-04-16T18:11:44.983 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:11:44.983 DEBUG:boto:Data: 2024-04-16T18:11:44.983 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.983 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.983 DEBUG:boto:Params: {} 2024-04-16T18:11:44.983 DEBUG:boto:Token: None 2024-04-16T18:11:44.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b978d5c1725299de-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.986 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.987 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:44.987 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:44.987 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.987 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:11:44.987 DEBUG:boto:Method: GET 2024-04-16T18:11:44.987 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:11:44.987 DEBUG:boto:Data: 2024-04-16T18:11:44.987 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:44.987 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.988 DEBUG:boto:Params: {} 2024-04-16T18:11:44.988 DEBUG:boto:Token: None 2024-04-16T18:11:44.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/ 2024-04-16T18:11:44.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg= 2024-04-16T18:11:44.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uMFtHQKUcCon39FHRI4ZZRRnnIg=', 'Content-Length': '0'} 2024-04-16T18:11:44.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004212b8112d9b3248-00661ebf60-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:44.990 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:44.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:11:44.991 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:44.991 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:44.991 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:44.991 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:44.991 DEBUG:boto:Method: GET 2024-04-16T18:11:44.991 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:11:44.991 DEBUG:boto:Data: 2024-04-16T18:11:44.991 DEBUG:boto:Headers: {} 2024-04-16T18:11:44.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:44.991 DEBUG:boto:Port: 8000 2024-04-16T18:11:44.992 DEBUG:boto:Params: {} 2024-04-16T18:11:44.992 DEBUG:boto:Token: None 2024-04-16T18:11:44.992 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:44 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:11:44.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jEn60hXrRaedOXMFaOHdiYATLAQ= 2024-04-16T18:11:44.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jEn60hXrRaedOXMFaOHdiYATLAQ=', 'Content-Length': '0'} 2024-04-16T18:11:44.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e184fdb0be465ffa-00661ebf60-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.034 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.034 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.034 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.035 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.035 DEBUG:boto:Method: GET 2024-04-16T18:11:45.035 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.035 DEBUG:boto:Data: 2024-04-16T18:11:45.035 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.035 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.035 DEBUG:boto:Params: {} 2024-04-16T18:11:45.035 DEBUG:boto:Token: None 2024-04-16T18:11:45.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YbMaxbBXfJR18btDVnsNBMLtpCU= 2024-04-16T18:11:45.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YbMaxbBXfJR18btDVnsNBMLtpCU=', 'Content-Length': '0'} 2024-04-16T18:11:45.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c0f82b58c611495-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.038 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.038 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.038 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.038 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.038 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.038 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.038 DEBUG:boto:Data: 2024-04-16T18:11:45.038 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.038 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.039 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.039 DEBUG:boto:Params: {} 2024-04-16T18:11:45.039 DEBUG:boto:Token: None 2024-04-16T18:11:45.039 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P9GyYHOEAXAeDN7df3BGPv8ises= 2024-04-16T18:11:45.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P9GyYHOEAXAeDN7df3BGPv8ises=', 'Content-Length': '0'} 2024-04-16T18:11:45.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbc1d1bf745f743a-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.041 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.041 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.041 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.041 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.041 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.041 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.042 DEBUG:boto:Data: 2024-04-16T18:11:45.042 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.042 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.042 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.042 DEBUG:boto:Params: {} 2024-04-16T18:11:45.042 DEBUG:boto:Token: None 2024-04-16T18:11:45.042 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.042 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P9GyYHOEAXAeDN7df3BGPv8ises= 2024-04-16T18:11:45.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P9GyYHOEAXAeDN7df3BGPv8ises=', 'Content-Length': '0'} 2024-04-16T18:11:45.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000073ee8704920c974-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:11:45.044 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.045 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.045 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.045 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.045 DEBUG:boto:Method: GET 2024-04-16T18:11:45.045 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.045 DEBUG:boto:Data: 2024-04-16T18:11:45.045 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.045 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.045 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.045 DEBUG:boto:Params: {} 2024-04-16T18:11:45.045 DEBUG:boto:Token: None 2024-04-16T18:11:45.045 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.046 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YbMaxbBXfJR18btDVnsNBMLtpCU= 2024-04-16T18:11:45.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YbMaxbBXfJR18btDVnsNBMLtpCU=', 'Content-Length': '0'} 2024-04-16T18:11:45.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001427830e0b7d275-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.090 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.091 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.091 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.091 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:11:45.091 DEBUG:boto:Method: GET 2024-04-16T18:11:45.091 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.091 DEBUG:boto:Data: 2024-04-16T18:11:45.091 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.091 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.091 DEBUG:boto:Params: {} 2024-04-16T18:11:45.091 DEBUG:boto:Token: None 2024-04-16T18:11:45.091 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:11:45.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YbMaxbBXfJR18btDVnsNBMLtpCU= 2024-04-16T18:11:45.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YbMaxbBXfJR18btDVnsNBMLtpCU=', 'Content-Length': '0'} 2024-04-16T18:11:45.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f49832aa9615a5c-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.094 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.094 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.094 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.094 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.094 DEBUG:boto:Method: GET 2024-04-16T18:11:45.095 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:11:45.095 DEBUG:boto:Data: 2024-04-16T18:11:45.095 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.095 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.095 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.095 DEBUG:boto:Params: {} 2024-04-16T18:11:45.095 DEBUG:boto:Token: None 2024-04-16T18:11:45.095 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.095 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.098 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b619256f816fa8b4-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.098 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.098 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.098 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.098 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.098 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.099 DEBUG:boto:Method: GET 2024-04-16T18:11:45.099 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:11:45.099 DEBUG:boto:Data: 2024-04-16T18:11:45.099 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.099 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.099 DEBUG:boto:Params: {} 2024-04-16T18:11:45.099 DEBUG:boto:Token: None 2024-04-16T18:11:45.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002bc6404a1a352396-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.102 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.102 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.102 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.102 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.102 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:11:45.103 DEBUG:boto:Data: 2024-04-16T18:11:45.103 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.103 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.103 DEBUG:boto:Params: {} 2024-04-16T18:11:45.103 DEBUG:boto:Token: None 2024-04-16T18:11:45.103 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c 2024-04-16T18:11:45.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gsuEJp88amNpaM4Wi5T3/YSuWZ4= 2024-04-16T18:11:45.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gsuEJp88amNpaM4Wi5T3/YSuWZ4=', 'Content-Length': '0'} 2024-04-16T18:11:45.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006fac703e854a285b-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.105 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.105 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.106 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.106 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:11:45.106 DEBUG:boto:Data: 2024-04-16T18:11:45.106 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.106 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.106 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.106 DEBUG:boto:Params: {} 2024-04-16T18:11:45.106 DEBUG:boto:Token: None 2024-04-16T18:11:45.106 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c 2024-04-16T18:11:45.106 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gsuEJp88amNpaM4Wi5T3/YSuWZ4= 2024-04-16T18:11:45.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gsuEJp88amNpaM4Wi5T3/YSuWZ4=', 'Content-Length': '0'} 2024-04-16T18:11:45.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040901e92694ed505-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:11:45.109 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.109 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.109 DEBUG:boto:Method: GET 2024-04-16T18:11:45.109 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:11:45.109 DEBUG:boto:Data: 2024-04-16T18:11:45.109 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.109 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.109 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.109 DEBUG:boto:Params: {} 2024-04-16T18:11:45.110 DEBUG:boto:Token: None 2024-04-16T18:11:45.110 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c 2024-04-16T18:11:45.110 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yE5pDDsd8pZ8XCqzy0idr37FhjU= 2024-04-16T18:11:45.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yE5pDDsd8pZ8XCqzy0idr37FhjU=', 'Content-Length': '0'} 2024-04-16T18:11:45.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d36020f74aab9759-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.154 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:11:45.154 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:11:45.155 DEBUG:boto:Method: GET 2024-04-16T18:11:45.155 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:11:45.155 DEBUG:boto:Data: 2024-04-16T18:11:45.155 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.155 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.155 DEBUG:boto:Params: {} 2024-04-16T18:11:45.155 DEBUG:boto:Token: None 2024-04-16T18:11:45.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/c 2024-04-16T18:11:45.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yE5pDDsd8pZ8XCqzy0idr37FhjU= 2024-04-16T18:11:45.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yE5pDDsd8pZ8XCqzy0idr37FhjU=', 'Content-Length': '0'} 2024-04-16T18:11:45.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d30086ee43492db-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.158 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.158 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.158 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.158 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.158 DEBUG:boto:Method: GET 2024-04-16T18:11:45.158 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:11:45.158 DEBUG:boto:Data: 2024-04-16T18:11:45.158 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.159 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.159 DEBUG:boto:Params: {} 2024-04-16T18:11:45.159 DEBUG:boto:Token: None 2024-04-16T18:11:45.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000795c0489aaedb29e-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.202 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.203 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.203 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.203 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.203 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:11:45.203 DEBUG:boto:Method: GET 2024-04-16T18:11:45.203 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:11:45.203 DEBUG:boto:Data: 2024-04-16T18:11:45.203 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.203 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.203 DEBUG:boto:Params: {} 2024-04-16T18:11:45.204 DEBUG:boto:Token: None 2024-04-16T18:11:45.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062fddc86853c4029-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.206 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:11:45.206 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.207 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.207 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.207 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.207 DEBUG:boto:Method: GET 2024-04-16T18:11:45.207 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.207 DEBUG:boto:Data: 2024-04-16T18:11:45.207 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.207 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.207 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.207 DEBUG:boto:Params: {} 2024-04-16T18:11:45.208 DEBUG:boto:Token: None 2024-04-16T18:11:45.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk= 2024-04-16T18:11:45.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk=', 'Content-Length': '0'} 2024-04-16T18:11:45.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f00ec7e6f497984-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.250 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.250 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.251 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.251 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.251 DEBUG:boto:Method: GET 2024-04-16T18:11:45.251 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.251 DEBUG:boto:Data: 2024-04-16T18:11:45.251 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.251 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.251 DEBUG:boto:Params: {} 2024-04-16T18:11:45.251 DEBUG:boto:Token: None 2024-04-16T18:11:45.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk= 2024-04-16T18:11:45.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk=', 'Content-Length': '0'} 2024-04-16T18:11:45.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042190359e7f30ec3-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.254 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.254 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.254 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.254 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.254 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.254 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.254 DEBUG:boto:Data: 2024-04-16T18:11:45.254 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.254 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.254 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.254 DEBUG:boto:Params: {} 2024-04-16T18:11:45.254 DEBUG:boto:Token: None 2024-04-16T18:11:45.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dvU1U32Iq6cevANXjXZjkFTgw0I= 2024-04-16T18:11:45.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvU1U32Iq6cevANXjXZjkFTgw0I=', 'Content-Length': '0'} 2024-04-16T18:11:45.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090299105f13c5d26-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.257 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.257 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.257 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.257 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.257 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.257 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.257 DEBUG:boto:Data: 2024-04-16T18:11:45.257 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.258 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.258 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.258 DEBUG:boto:Params: {} 2024-04-16T18:11:45.258 DEBUG:boto:Token: None 2024-04-16T18:11:45.258 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dvU1U32Iq6cevANXjXZjkFTgw0I= 2024-04-16T18:11:45.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvU1U32Iq6cevANXjXZjkFTgw0I=', 'Content-Length': '0'} 2024-04-16T18:11:45.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c177f7d850a6e04-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:11:45.260 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.260 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.260 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.261 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.261 DEBUG:boto:Method: GET 2024-04-16T18:11:45.261 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.261 DEBUG:boto:Data: 2024-04-16T18:11:45.261 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.261 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.261 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.261 DEBUG:boto:Params: {} 2024-04-16T18:11:45.261 DEBUG:boto:Token: None 2024-04-16T18:11:45.261 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.261 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk= 2024-04-16T18:11:45.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk=', 'Content-Length': '0'} 2024-04-16T18:11:45.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007abebbcf153f3ea1-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.306 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.307 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.307 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.307 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:11:45.307 DEBUG:boto:Method: GET 2024-04-16T18:11:45.307 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.307 DEBUG:boto:Data: 2024-04-16T18:11:45.307 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.307 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.307 DEBUG:boto:Params: {} 2024-04-16T18:11:45.307 DEBUG:boto:Token: None 2024-04-16T18:11:45.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:11:45.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk= 2024-04-16T18:11:45.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QvNBe0BcY/2kXZhrtLVvE50sjtk=', 'Content-Length': '0'} 2024-04-16T18:11:45.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039d9a59998a86b27-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.310 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.310 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.310 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.310 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.311 DEBUG:boto:Method: GET 2024-04-16T18:11:45.311 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:11:45.311 DEBUG:boto:Data: 2024-04-16T18:11:45.311 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.311 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.311 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.311 DEBUG:boto:Params: {} 2024-04-16T18:11:45.311 DEBUG:boto:Token: None 2024-04-16T18:11:45.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c60494889558248f-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.354 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.355 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.355 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.355 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.355 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.355 DEBUG:boto:Method: GET 2024-04-16T18:11:45.355 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:11:45.355 DEBUG:boto:Data: 2024-04-16T18:11:45.355 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.355 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.355 DEBUG:boto:Params: {} 2024-04-16T18:11:45.356 DEBUG:boto:Token: None 2024-04-16T18:11:45.356 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.358 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c00bf5e7a24de0e5-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.358 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.359 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.359 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.359 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.359 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:11:45.359 DEBUG:boto:Data: 2024-04-16T18:11:45.359 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.359 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.359 DEBUG:boto:Params: {} 2024-04-16T18:11:45.360 DEBUG:boto:Token: None 2024-04-16T18:11:45.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d 2024-04-16T18:11:45.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SrU0+4mm9yIq4qTz/4HEk0MJM5I= 2024-04-16T18:11:45.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SrU0+4mm9yIq4qTz/4HEk0MJM5I=', 'Content-Length': '0'} 2024-04-16T18:11:45.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014de833065741493-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.362 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.362 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.362 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.362 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:11:45.362 DEBUG:boto:Data: 2024-04-16T18:11:45.362 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.362 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.363 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.363 DEBUG:boto:Params: {} 2024-04-16T18:11:45.363 DEBUG:boto:Token: None 2024-04-16T18:11:45.363 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d 2024-04-16T18:11:45.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SrU0+4mm9yIq4qTz/4HEk0MJM5I= 2024-04-16T18:11:45.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SrU0+4mm9yIq4qTz/4HEk0MJM5I=', 'Content-Length': '0'} 2024-04-16T18:11:45.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067abcbe360ffcb32-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:11:45.365 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.365 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.366 DEBUG:boto:Method: GET 2024-04-16T18:11:45.366 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:11:45.366 DEBUG:boto:Data: 2024-04-16T18:11:45.366 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.366 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.366 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.366 DEBUG:boto:Params: {} 2024-04-16T18:11:45.366 DEBUG:boto:Token: None 2024-04-16T18:11:45.366 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d 2024-04-16T18:11:45.366 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pahX18Cu+22x17M3NucBZVWaIPk= 2024-04-16T18:11:45.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pahX18Cu+22x17M3NucBZVWaIPk=', 'Content-Length': '0'} 2024-04-16T18:11:45.368 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007508e50be1c919c2-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.410 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:11:45.410 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:11:45.410 DEBUG:boto:Method: GET 2024-04-16T18:11:45.411 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:11:45.411 DEBUG:boto:Data: 2024-04-16T18:11:45.411 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.411 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.411 DEBUG:boto:Params: {} 2024-04-16T18:11:45.411 DEBUG:boto:Token: None 2024-04-16T18:11:45.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/d 2024-04-16T18:11:45.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pahX18Cu+22x17M3NucBZVWaIPk= 2024-04-16T18:11:45.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pahX18Cu+22x17M3NucBZVWaIPk=', 'Content-Length': '0'} 2024-04-16T18:11:45.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019bff694acabe222-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.414 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.414 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.414 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.414 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.414 DEBUG:boto:Method: GET 2024-04-16T18:11:45.414 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:11:45.414 DEBUG:boto:Data: 2024-04-16T18:11:45.414 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.415 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:11:45.415 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.415 DEBUG:boto:Params: {} 2024-04-16T18:11:45.415 DEBUG:boto:Token: None 2024-04-16T18:11:45.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.417 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052a5082b56e3fa71-00661ebf61-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.418 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.418 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.418 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.418 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.418 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:11:45.418 DEBUG:boto:Method: GET 2024-04-16T18:11:45.419 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:11:45.419 DEBUG:boto:Data: 2024-04-16T18:11:45.419 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.419 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.419 DEBUG:boto:Params: {} 2024-04-16T18:11:45.419 DEBUG:boto:Token: None 2024-04-16T18:11:45.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag= 2024-04-16T18:11:45.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VO3XbdNW+K8JMZYzO7R1cWRPmag=', 'Content-Length': '0'} 2024-04-16T18:11:45.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099e060b24c59b47a-00661ebf61-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.422 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:11:45.422 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-47 zones={test-zone2, test-zone1} 2024-04-16T18:11:45.422 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'cjqttm-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:45.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'cjqttm-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:45.423 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket cjqttm-47 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:11:45.478 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:45.478 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:45.546 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:11:45.546 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-47 2024-04-16T18:11:45.551 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 4 2024-04-16T18:11:45.601 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'reshard', '--bucket', 'cjqttm-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:45.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'reshard', '--bucket', 'cjqttm-47', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:11:45.601 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket reshard --bucket cjqttm-47 --num-shards 3 --yes-i-really-mean-it --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:11:45.656 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:45.656 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:45.720 INFO:teuthology.orchestra.run.smithi139.stdout:tenant: 2024-04-16T18:11:45.721 INFO:teuthology.orchestra.run.smithi139.stdout:bucket name: cjqttm-47 2024-04-16T18:11:45.726 INFO:teuthology.orchestra.run.smithi139.stdout:total entries: 4 2024-04-16T18:11:45.774 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.774 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.774 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.774 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:45.775 DEBUG:boto:Data: 2024-04-16T18:11:45.775 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.775 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.775 DEBUG:boto:Params: {} 2024-04-16T18:11:45.775 DEBUG:boto:Token: None 2024-04-16T18:11:45.775 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now= 2024-04-16T18:11:45.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now=', 'Content-Length': '0'} 2024-04-16T18:11:45.777 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002760087e061b9a1b-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.778 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:11:45.778 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:11:45.778 DEBUG:boto:Method: PUT 2024-04-16T18:11:45.778 DEBUG:boto:Path: /cjqttm-47/e 2024-04-16T18:11:45.778 DEBUG:boto:Data: 2024-04-16T18:11:45.778 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:45.778 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.778 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.778 DEBUG:boto:Params: {} 2024-04-16T18:11:45.779 DEBUG:boto:Token: None 2024-04-16T18:11:45.779 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/e 2024-04-16T18:11:45.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XPBgap3KXGAT868DU7uK1r4DiGE= 2024-04-16T18:11:45.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XPBgap3KXGAT868DU7uK1r4DiGE='} 2024-04-16T18:11:45.785 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bff2d99ec192170a-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.785 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.785 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.785 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.785 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:45.785 DEBUG:boto:Data: 2024-04-16T18:11:45.786 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.786 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.786 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.786 DEBUG:boto:Params: {} 2024-04-16T18:11:45.786 DEBUG:boto:Token: None 2024-04-16T18:11:45.786 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.786 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now= 2024-04-16T18:11:45.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now=', 'Content-Length': '0'} 2024-04-16T18:11:45.788 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009053697a67188c7e-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.789 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:11:45.789 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:11:45.789 DEBUG:boto:Method: PUT 2024-04-16T18:11:45.789 DEBUG:boto:Path: /cjqttm-47/f 2024-04-16T18:11:45.789 DEBUG:boto:Data: 2024-04-16T18:11:45.789 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:45.789 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.789 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.789 DEBUG:boto:Params: {} 2024-04-16T18:11:45.789 DEBUG:boto:Token: None 2024-04-16T18:11:45.790 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/f 2024-04-16T18:11:45.790 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8UJQdgxZk/2DZnpKuKpB16FNMaM= 2024-04-16T18:11:45.790 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8UJQdgxZk/2DZnpKuKpB16FNMaM='} 2024-04-16T18:11:45.834 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fb8f96ecb1c0bbae-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.835 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.835 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.835 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.835 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:45.835 DEBUG:boto:Data: 2024-04-16T18:11:45.835 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.835 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.835 DEBUG:boto:Params: {} 2024-04-16T18:11:45.835 DEBUG:boto:Token: None 2024-04-16T18:11:45.836 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now= 2024-04-16T18:11:45.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now=', 'Content-Length': '0'} 2024-04-16T18:11:45.838 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000010f1329f52a093a2-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.838 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:11:45.838 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:11:45.838 DEBUG:boto:Method: PUT 2024-04-16T18:11:45.838 DEBUG:boto:Path: /cjqttm-47/g 2024-04-16T18:11:45.838 DEBUG:boto:Data: 2024-04-16T18:11:45.838 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:45.838 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.839 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.839 DEBUG:boto:Params: {} 2024-04-16T18:11:45.839 DEBUG:boto:Token: None 2024-04-16T18:11:45.839 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/g 2024-04-16T18:11:45.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i8BDylQrRtzBrhygWtH6lLQ+6ZU= 2024-04-16T18:11:45.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i8BDylQrRtzBrhygWtH6lLQ+6ZU='} 2024-04-16T18:11:45.846 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009bfdf7078cd4aa37-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.846 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:11:45.846 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:11:45.846 DEBUG:boto:Method: HEAD 2024-04-16T18:11:45.846 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:11:45.846 DEBUG:boto:Data: 2024-04-16T18:11:45.846 DEBUG:boto:Headers: {} 2024-04-16T18:11:45.846 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.846 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.846 DEBUG:boto:Params: {} 2024-04-16T18:11:45.847 DEBUG:boto:Token: None 2024-04-16T18:11:45.847 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/ 2024-04-16T18:11:45.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now= 2024-04-16T18:11:45.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e2zr0i+2H42GKHndr2Qfax5+Now=', 'Content-Length': '0'} 2024-04-16T18:11:45.849 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000494ee806918bb72b-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.849 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:11:45.849 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:11:45.849 DEBUG:boto:Method: PUT 2024-04-16T18:11:45.849 DEBUG:boto:Path: /cjqttm-47/h 2024-04-16T18:11:45.849 DEBUG:boto:Data: 2024-04-16T18:11:45.849 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:11:45.849 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:11:45.849 DEBUG:boto:Port: 8000 2024-04-16T18:11:45.849 DEBUG:boto:Params: {} 2024-04-16T18:11:45.850 DEBUG:boto:Token: None 2024-04-16T18:11:45.850 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:11:45 GMT /cjqttm-47/h 2024-04-16T18:11:45.850 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BVSckAi0cOOYfjbcb6/+4hqsk4= 2024-04-16T18:11:45.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:11:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BVSckAi0cOOYfjbcb6/+4hqsk4='} 2024-04-16T18:11:45.854 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000485496bab1965232-00661ebf61-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:11:45.855 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-47 2024-04-16T18:11:45.855 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:11:45.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:11:45.855 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-47 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:11:45.910 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:11:45.910 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:11:45.964 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:45.966+0000 7f86e872d800 1 waiting to reach latest gen 1, on 0.. 2024-04-16T18:11:50.966 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:50.967+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:11:50.966 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:11:50.966 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:11:55.967 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:11:55.968+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:11:55.967 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:11:55.967 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:00.968 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:00.969+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:00.969 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:00.969 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:05.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:05.971+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:05.970 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:05.970 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:10.970 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:10.972+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:10.970 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:10.970 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:15.971 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:15.973+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:15.971 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:15.971 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:20.972 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:20.973+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:20.973 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:20.973 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:25.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:25.973+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:25.973 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:25.973 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:30.973 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:30.974+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:30.973 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:30.973 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:35.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:35.975+0000 7f86e872d800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:35.977 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , ] 2024-04-16T18:12:35.977 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:40.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:40.976+0000 7f86e872d800 1 bucket sync caught up with source: 2024-04-16T18:12:40.976 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:40.976 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.58.6, 00000000002.38.6, 00000000002.50.6] 2024-04-16T18:12:40.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:40.976+0000 7f86e872d800 0 bucket checkpoint complete 2024-04-16T18:12:41.002 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-47 2024-04-16T18:12:41.002 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:12:41.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-47', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:12:41.003 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-47 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:12:41.065 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:12:41.066 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:12:41.127 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:12:41.128+0000 7f432c33b800 1 waiting for incremental sync to catch up: 2024-04-16T18:12:41.127 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , ] 2024-04-16T18:12:41.127 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000003.1250.6, 00000000002.494.6, 00000000002.340.6] 2024-04-16T18:12:46.128 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:12:46.130+0000 7f432c33b800 1 bucket sync caught up with source: 2024-04-16T18:12:46.128 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000003.1250.6, 00000000002.494.6, 00000000002.340.6] 2024-04-16T18:12:46.128 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000003.1250.6, 00000000002.494.6, 00000000002.340.6] 2024-04-16T18:12:46.129 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:12:46.130+0000 7f432c33b800 0 bucket checkpoint complete 2024-04-16T18:12:46.155 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-47 zones={test-zone2, test-zone1} 2024-04-16T18:12:46.155 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.155 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.155 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.155 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:12:46.155 DEBUG:boto:Data: 2024-04-16T18:12:46.155 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.156 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.156 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.156 DEBUG:boto:Params: {} 2024-04-16T18:12:46.156 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:12:46.156 DEBUG:boto:Token: None 2024-04-16T18:12:46.156 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RyTUGpGv5+aOkESxQiYf5cPbgWE= 2024-04-16T18:12:46.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RyTUGpGv5+aOkESxQiYf5cPbgWE=', 'Content-Length': '0'} 2024-04-16T18:12:46.160 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb39e65b3fa13cc7-00661ebf9e-4999-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.160 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.161 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.161 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.161 DEBUG:boto:Path: /cjqttm-47/ 2024-04-16T18:12:46.161 DEBUG:boto:Data: 2024-04-16T18:12:46.161 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.161 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.161 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.161 DEBUG:boto:Params: {} 2024-04-16T18:12:46.161 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:12:46.161 DEBUG:boto:Token: None 2024-04-16T18:12:46.162 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.162 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RyTUGpGv5+aOkESxQiYf5cPbgWE= 2024-04-16T18:12:46.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RyTUGpGv5+aOkESxQiYf5cPbgWE=', 'Content-Length': '0'} 2024-04-16T18:12:46.165 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009f362edfbfa89b9a-00661ebf9e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.166 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:12:46.166 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.166 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.166 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.166 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.166 DEBUG:boto:Method: GET 2024-04-16T18:12:46.166 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.166 DEBUG:boto:Data: 2024-04-16T18:12:46.166 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.166 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.167 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.167 DEBUG:boto:Params: {} 2024-04-16T18:12:46.167 DEBUG:boto:Token: None 2024-04-16T18:12:46.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/?versions 2024-04-16T18:12:46.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU= 2024-04-16T18:12:46.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU=', 'Content-Length': '0'} 2024-04-16T18:12:46.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a9f306827cadb42-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.169 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.170 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:12:46.170 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:12:46.170 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:12:46.170 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:12:46.170 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:12:46.171 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:12:46.171 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:12:46.171 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:12:46.171 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:12:46.171 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.171 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.171 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.171 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.171 DEBUG:boto:Method: GET 2024-04-16T18:12:46.171 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.171 DEBUG:boto:Data: 2024-04-16T18:12:46.171 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.172 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.172 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.172 DEBUG:boto:Params: {} 2024-04-16T18:12:46.172 DEBUG:boto:Token: None 2024-04-16T18:12:46.172 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/?versions 2024-04-16T18:12:46.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU= 2024-04-16T18:12:46.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU=', 'Content-Length': '0'} 2024-04-16T18:12:46.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000097d922d00199364-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.174 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:12:46.175 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:12:46.175 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.175 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.175 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.175 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.176 DEBUG:boto:Method: GET 2024-04-16T18:12:46.176 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.176 DEBUG:boto:Data: 2024-04-16T18:12:46.176 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.176 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.176 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.176 DEBUG:boto:Params: {} 2024-04-16T18:12:46.176 DEBUG:boto:Token: None 2024-04-16T18:12:46.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/?versions 2024-04-16T18:12:46.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU= 2024-04-16T18:12:46.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU=', 'Content-Length': '0'} 2024-04-16T18:12:46.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000823b35c0f1a15c44-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.179 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.179 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.179 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.179 DEBUG:boto:path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.179 DEBUG:boto:auth_path=/cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.180 DEBUG:boto:Method: GET 2024-04-16T18:12:46.180 DEBUG:boto:Path: /cjqttm-47/?versions&max-keys=999 2024-04-16T18:12:46.180 DEBUG:boto:Data: 2024-04-16T18:12:46.180 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.180 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.180 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.180 DEBUG:boto:Params: {} 2024-04-16T18:12:46.180 DEBUG:boto:Token: None 2024-04-16T18:12:46.180 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/?versions 2024-04-16T18:12:46.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU= 2024-04-16T18:12:46.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:msB7OHs4E0M+sPJYkcPA8yW4jLU=', 'Content-Length': '0'} 2024-04-16T18:12:46.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b530ceec5a019ce8-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.182 DEBUG:boto:b'cjqttm-47999falseanulltrue2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:12:46.183 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.183 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.183 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.183 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.183 DEBUG:boto:Method: GET 2024-04-16T18:12:46.183 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.184 DEBUG:boto:Data: 2024-04-16T18:12:46.184 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.184 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.184 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.184 DEBUG:boto:Params: {} 2024-04-16T18:12:46.184 DEBUG:boto:Token: None 2024-04-16T18:12:46.184 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA= 2024-04-16T18:12:46.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA=', 'Content-Length': '0'} 2024-04-16T18:12:46.187 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d28cd69eee95042-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.187 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.187 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.187 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.187 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.187 DEBUG:boto:Method: GET 2024-04-16T18:12:46.187 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.187 DEBUG:boto:Data: 2024-04-16T18:12:46.187 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.188 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.188 DEBUG:boto:Params: {} 2024-04-16T18:12:46.188 DEBUG:boto:Token: None 2024-04-16T18:12:46.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA= 2024-04-16T18:12:46.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA=', 'Content-Length': '0'} 2024-04-16T18:12:46.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010c59b7577ac6351-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.190 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.190 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.190 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.191 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.191 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.191 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.191 DEBUG:boto:Data: 2024-04-16T18:12:46.191 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.191 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.191 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.191 DEBUG:boto:Params: {} 2024-04-16T18:12:46.191 DEBUG:boto:Token: None 2024-04-16T18:12:46.191 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.191 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9HNZCSugPhQQNUbLieSThqJX1AQ= 2024-04-16T18:12:46.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9HNZCSugPhQQNUbLieSThqJX1AQ=', 'Content-Length': '0'} 2024-04-16T18:12:46.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dadd56200710b63c-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.194 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.194 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.194 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.194 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.194 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.194 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.194 DEBUG:boto:Data: 2024-04-16T18:12:46.194 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.194 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.195 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.195 DEBUG:boto:Params: {} 2024-04-16T18:12:46.195 DEBUG:boto:Token: None 2024-04-16T18:12:46.195 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9HNZCSugPhQQNUbLieSThqJX1AQ= 2024-04-16T18:12:46.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9HNZCSugPhQQNUbLieSThqJX1AQ=', 'Content-Length': '0'} 2024-04-16T18:12:46.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003225e83b64cc4a6f-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.197 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:12:46.197 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.197 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.198 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.198 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.198 DEBUG:boto:Method: GET 2024-04-16T18:12:46.198 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.198 DEBUG:boto:Data: 2024-04-16T18:12:46.198 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.198 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.198 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.198 DEBUG:boto:Params: {} 2024-04-16T18:12:46.198 DEBUG:boto:Token: None 2024-04-16T18:12:46.198 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA= 2024-04-16T18:12:46.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA=', 'Content-Length': '0'} 2024-04-16T18:12:46.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000492000e003b4325a-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.242 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.243 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.243 DEBUG:boto:path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.243 DEBUG:boto:auth_path=/cjqttm-47/a?versionId=null 2024-04-16T18:12:46.243 DEBUG:boto:Method: GET 2024-04-16T18:12:46.243 DEBUG:boto:Path: /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.243 DEBUG:boto:Data: 2024-04-16T18:12:46.243 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.243 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.243 DEBUG:boto:Params: {} 2024-04-16T18:12:46.244 DEBUG:boto:Token: None 2024-04-16T18:12:46.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a?versionId=null 2024-04-16T18:12:46.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA= 2024-04-16T18:12:46.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4d9Zuyx/Fc6Ov5TVooaQ+p1aABA=', 'Content-Length': '0'} 2024-04-16T18:12:46.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000232827d7b5ff7226-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.246 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.247 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.247 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.247 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.247 DEBUG:boto:Method: GET 2024-04-16T18:12:46.247 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:12:46.247 DEBUG:boto:Data: 2024-04-16T18:12:46.247 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.247 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.247 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.247 DEBUG:boto:Params: {} 2024-04-16T18:12:46.247 DEBUG:boto:Token: None 2024-04-16T18:12:46.248 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.250 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000665495d95d230cee-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.290 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.291 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.291 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.291 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.291 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.291 DEBUG:boto:Method: GET 2024-04-16T18:12:46.291 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:12:46.291 DEBUG:boto:Data: 2024-04-16T18:12:46.291 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.291 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.292 DEBUG:boto:Params: {} 2024-04-16T18:12:46.292 DEBUG:boto:Token: None 2024-04-16T18:12:46.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.294 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba26c32e25180313-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.294 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.294 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.294 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.294 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.295 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:12:46.295 DEBUG:boto:Data: 2024-04-16T18:12:46.295 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.295 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.295 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.295 DEBUG:boto:Params: {} 2024-04-16T18:12:46.295 DEBUG:boto:Token: None 2024-04-16T18:12:46.295 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a 2024-04-16T18:12:46.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I9/0yChN5paoRwrTafNspzQAfjo= 2024-04-16T18:12:46.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I9/0yChN5paoRwrTafNspzQAfjo=', 'Content-Length': '0'} 2024-04-16T18:12:46.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f7410d1fc2ac1cd-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.298 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.298 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.298 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.298 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:12:46.298 DEBUG:boto:Data: 2024-04-16T18:12:46.298 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.298 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.298 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.299 DEBUG:boto:Params: {} 2024-04-16T18:12:46.299 DEBUG:boto:Token: None 2024-04-16T18:12:46.299 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a 2024-04-16T18:12:46.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I9/0yChN5paoRwrTafNspzQAfjo= 2024-04-16T18:12:46.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I9/0yChN5paoRwrTafNspzQAfjo=', 'Content-Length': '0'} 2024-04-16T18:12:46.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e44dc61dcae2a9d-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.301 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:12:46.301 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.301 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.301 DEBUG:boto:Method: GET 2024-04-16T18:12:46.302 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:12:46.302 DEBUG:boto:Data: 2024-04-16T18:12:46.302 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.302 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.302 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.302 DEBUG:boto:Params: {} 2024-04-16T18:12:46.302 DEBUG:boto:Token: None 2024-04-16T18:12:46.302 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a 2024-04-16T18:12:46.302 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4xq1wq/L9B2oEH/gZiw4MF+KdOs= 2024-04-16T18:12:46.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4xq1wq/L9B2oEH/gZiw4MF+KdOs=', 'Content-Length': '0'} 2024-04-16T18:12:46.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2d322979bbe3a7f-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.346 DEBUG:boto:path=/cjqttm-47/a 2024-04-16T18:12:46.346 DEBUG:boto:auth_path=/cjqttm-47/a 2024-04-16T18:12:46.347 DEBUG:boto:Method: GET 2024-04-16T18:12:46.347 DEBUG:boto:Path: /cjqttm-47/a 2024-04-16T18:12:46.347 DEBUG:boto:Data: 2024-04-16T18:12:46.347 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.347 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.347 DEBUG:boto:Params: {} 2024-04-16T18:12:46.347 DEBUG:boto:Token: None 2024-04-16T18:12:46.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/a 2024-04-16T18:12:46.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4xq1wq/L9B2oEH/gZiw4MF+KdOs= 2024-04-16T18:12:46.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4xq1wq/L9B2oEH/gZiw4MF+KdOs=', 'Content-Length': '0'} 2024-04-16T18:12:46.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006556f7c64befa16c-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.350 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.350 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.350 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.350 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.350 DEBUG:boto:Method: GET 2024-04-16T18:12:46.351 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:12:46.351 DEBUG:boto:Data: 2024-04-16T18:12:46.351 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.351 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.351 DEBUG:boto:Params: {} 2024-04-16T18:12:46.351 DEBUG:boto:Token: None 2024-04-16T18:12:46.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ddcdd42ef116d696-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.353 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.354 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.354 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.354 DEBUG:boto:path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.354 DEBUG:boto:auth_path=/cjqttm-47/?prefix=a 2024-04-16T18:12:46.354 DEBUG:boto:Method: GET 2024-04-16T18:12:46.354 DEBUG:boto:Path: /cjqttm-47/?prefix=a 2024-04-16T18:12:46.355 DEBUG:boto:Data: 2024-04-16T18:12:46.355 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.355 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.355 DEBUG:boto:Params: {} 2024-04-16T18:12:46.355 DEBUG:boto:Token: None 2024-04-16T18:12:46.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.357 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071d258bd8a385c45-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.357 DEBUG:boto:b'cjqttm-47a1000falsea2024-04-16T18:11:34.201Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.358 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:12:46.358 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.358 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.358 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.358 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.358 DEBUG:boto:Method: GET 2024-04-16T18:12:46.358 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.358 DEBUG:boto:Data: 2024-04-16T18:12:46.359 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.359 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.359 DEBUG:boto:Params: {} 2024-04-16T18:12:46.359 DEBUG:boto:Token: None 2024-04-16T18:12:46.359 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U= 2024-04-16T18:12:46.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U=', 'Content-Length': '0'} 2024-04-16T18:12:46.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ea37e0284bf1be4-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.402 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.402 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.402 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.403 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.403 DEBUG:boto:Method: GET 2024-04-16T18:12:46.403 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.403 DEBUG:boto:Data: 2024-04-16T18:12:46.403 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.403 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.403 DEBUG:boto:Params: {} 2024-04-16T18:12:46.403 DEBUG:boto:Token: None 2024-04-16T18:12:46.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U= 2024-04-16T18:12:46.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U=', 'Content-Length': '0'} 2024-04-16T18:12:46.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000353ec035007f683b-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.406 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.406 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.406 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.406 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.406 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.407 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.407 DEBUG:boto:Data: 2024-04-16T18:12:46.407 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.407 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.407 DEBUG:boto:Params: {} 2024-04-16T18:12:46.407 DEBUG:boto:Token: None 2024-04-16T18:12:46.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMLyagqIYytwTm+mjmhJMgfii44= 2024-04-16T18:12:46.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMLyagqIYytwTm+mjmhJMgfii44=', 'Content-Length': '0'} 2024-04-16T18:12:46.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008609be7abb4c13f0-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.410 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.410 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.410 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.410 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.410 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.410 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.410 DEBUG:boto:Data: 2024-04-16T18:12:46.410 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.411 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.411 DEBUG:boto:Params: {} 2024-04-16T18:12:46.411 DEBUG:boto:Token: None 2024-04-16T18:12:46.411 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMLyagqIYytwTm+mjmhJMgfii44= 2024-04-16T18:12:46.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMLyagqIYytwTm+mjmhJMgfii44=', 'Content-Length': '0'} 2024-04-16T18:12:46.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab3b08dbb49b9ec6-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.413 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:12:46.413 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.413 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.414 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.414 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.414 DEBUG:boto:Method: GET 2024-04-16T18:12:46.414 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.414 DEBUG:boto:Data: 2024-04-16T18:12:46.414 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.414 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.414 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.414 DEBUG:boto:Params: {} 2024-04-16T18:12:46.414 DEBUG:boto:Token: None 2024-04-16T18:12:46.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U= 2024-04-16T18:12:46.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U=', 'Content-Length': '0'} 2024-04-16T18:12:46.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000006d973ab410e87f-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.458 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.458 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.459 DEBUG:boto:path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.459 DEBUG:boto:auth_path=/cjqttm-47/b?versionId=null 2024-04-16T18:12:46.459 DEBUG:boto:Method: GET 2024-04-16T18:12:46.459 DEBUG:boto:Path: /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.459 DEBUG:boto:Data: 2024-04-16T18:12:46.459 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.459 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.459 DEBUG:boto:Params: {} 2024-04-16T18:12:46.459 DEBUG:boto:Token: None 2024-04-16T18:12:46.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b?versionId=null 2024-04-16T18:12:46.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U= 2024-04-16T18:12:46.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HA0dK1ChoJ8Z218CMr1J3mImm4U=', 'Content-Length': '0'} 2024-04-16T18:12:46.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005eea02f6af2aa85a-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.462 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.462 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.463 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.463 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.463 DEBUG:boto:Method: GET 2024-04-16T18:12:46.463 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:12:46.463 DEBUG:boto:Data: 2024-04-16T18:12:46.463 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.463 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.463 DEBUG:boto:Params: {} 2024-04-16T18:12:46.463 DEBUG:boto:Token: None 2024-04-16T18:12:46.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011ca5cbd31f3d987-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.466 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.466 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.467 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.467 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.467 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.467 DEBUG:boto:Method: GET 2024-04-16T18:12:46.467 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:12:46.467 DEBUG:boto:Data: 2024-04-16T18:12:46.467 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.467 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.467 DEBUG:boto:Params: {} 2024-04-16T18:12:46.467 DEBUG:boto:Token: None 2024-04-16T18:12:46.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.470 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc8dc10aaac58ed7-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.470 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.470 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.471 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.471 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.471 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:12:46.471 DEBUG:boto:Data: 2024-04-16T18:12:46.471 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.471 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.471 DEBUG:boto:Params: {} 2024-04-16T18:12:46.471 DEBUG:boto:Token: None 2024-04-16T18:12:46.471 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b 2024-04-16T18:12:46.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dyLPGBFGvbbob6sW2TrSc0XIcIs= 2024-04-16T18:12:46.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dyLPGBFGvbbob6sW2TrSc0XIcIs=', 'Content-Length': '0'} 2024-04-16T18:12:46.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b517bd817eefa59-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.474 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.474 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.474 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.474 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:12:46.474 DEBUG:boto:Data: 2024-04-16T18:12:46.474 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.474 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.475 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.475 DEBUG:boto:Params: {} 2024-04-16T18:12:46.475 DEBUG:boto:Token: None 2024-04-16T18:12:46.475 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b 2024-04-16T18:12:46.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dyLPGBFGvbbob6sW2TrSc0XIcIs= 2024-04-16T18:12:46.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dyLPGBFGvbbob6sW2TrSc0XIcIs=', 'Content-Length': '0'} 2024-04-16T18:12:46.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008079098712df2558-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:12:46.477 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.477 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.478 DEBUG:boto:Method: GET 2024-04-16T18:12:46.478 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:12:46.478 DEBUG:boto:Data: 2024-04-16T18:12:46.478 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.478 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.478 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.478 DEBUG:boto:Params: {} 2024-04-16T18:12:46.478 DEBUG:boto:Token: None 2024-04-16T18:12:46.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b 2024-04-16T18:12:46.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n4Mh8/QwiJjtHd9s+KLXvig++Sc= 2024-04-16T18:12:46.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n4Mh8/QwiJjtHd9s+KLXvig++Sc=', 'Content-Length': '0'} 2024-04-16T18:12:46.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c888b50bec2cd7a7-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.522 DEBUG:boto:path=/cjqttm-47/b 2024-04-16T18:12:46.523 DEBUG:boto:auth_path=/cjqttm-47/b 2024-04-16T18:12:46.523 DEBUG:boto:Method: GET 2024-04-16T18:12:46.523 DEBUG:boto:Path: /cjqttm-47/b 2024-04-16T18:12:46.523 DEBUG:boto:Data: 2024-04-16T18:12:46.523 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.523 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.523 DEBUG:boto:Params: {} 2024-04-16T18:12:46.523 DEBUG:boto:Token: None 2024-04-16T18:12:46.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/b 2024-04-16T18:12:46.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n4Mh8/QwiJjtHd9s+KLXvig++Sc= 2024-04-16T18:12:46.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n4Mh8/QwiJjtHd9s+KLXvig++Sc=', 'Content-Length': '0'} 2024-04-16T18:12:46.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000629a05635148e4ff-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.527 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.527 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.527 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.527 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.527 DEBUG:boto:Method: GET 2024-04-16T18:12:46.527 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:12:46.527 DEBUG:boto:Data: 2024-04-16T18:12:46.527 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.527 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.527 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.527 DEBUG:boto:Params: {} 2024-04-16T18:12:46.528 DEBUG:boto:Token: None 2024-04-16T18:12:46.528 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e8f8ef42ba88c4d-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.530 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.530 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.531 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.531 DEBUG:boto:path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.531 DEBUG:boto:auth_path=/cjqttm-47/?prefix=b 2024-04-16T18:12:46.531 DEBUG:boto:Method: GET 2024-04-16T18:12:46.531 DEBUG:boto:Path: /cjqttm-47/?prefix=b 2024-04-16T18:12:46.531 DEBUG:boto:Data: 2024-04-16T18:12:46.531 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.531 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.531 DEBUG:boto:Params: {} 2024-04-16T18:12:46.531 DEBUG:boto:Token: None 2024-04-16T18:12:46.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.534 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004823600f74630392-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.534 DEBUG:boto:b'cjqttm-47b1000falseb2024-04-16T18:11:34.213Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:12:46.534 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.535 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.535 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.535 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.535 DEBUG:boto:Method: GET 2024-04-16T18:12:46.535 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.535 DEBUG:boto:Data: 2024-04-16T18:12:46.535 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.535 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.535 DEBUG:boto:Params: {} 2024-04-16T18:12:46.535 DEBUG:boto:Token: None 2024-04-16T18:12:46.536 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0= 2024-04-16T18:12:46.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0=', 'Content-Length': '0'} 2024-04-16T18:12:46.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d6be8ac9942dd5f-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.578 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.579 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.579 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.579 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.579 DEBUG:boto:Method: GET 2024-04-16T18:12:46.579 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.579 DEBUG:boto:Data: 2024-04-16T18:12:46.579 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.579 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.579 DEBUG:boto:Params: {} 2024-04-16T18:12:46.580 DEBUG:boto:Token: None 2024-04-16T18:12:46.580 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0= 2024-04-16T18:12:46.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0=', 'Content-Length': '0'} 2024-04-16T18:12:46.582 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000450708c88d8870db-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.582 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.582 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.583 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.583 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.583 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.583 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.583 DEBUG:boto:Data: 2024-04-16T18:12:46.583 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.583 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.583 DEBUG:boto:Params: {} 2024-04-16T18:12:46.583 DEBUG:boto:Token: None 2024-04-16T18:12:46.584 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HtPMhvj/0y/slUHpnJuoVYB6unA= 2024-04-16T18:12:46.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HtPMhvj/0y/slUHpnJuoVYB6unA=', 'Content-Length': '0'} 2024-04-16T18:12:46.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000789cfe8733a2ada1-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.586 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.586 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.586 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.586 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.586 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.586 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.586 DEBUG:boto:Data: 2024-04-16T18:12:46.586 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.587 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.587 DEBUG:boto:Params: {} 2024-04-16T18:12:46.587 DEBUG:boto:Token: None 2024-04-16T18:12:46.587 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HtPMhvj/0y/slUHpnJuoVYB6unA= 2024-04-16T18:12:46.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HtPMhvj/0y/slUHpnJuoVYB6unA=', 'Content-Length': '0'} 2024-04-16T18:12:46.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3cce8645429602b-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:12:46.589 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.589 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.589 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.590 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.590 DEBUG:boto:Method: GET 2024-04-16T18:12:46.590 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.590 DEBUG:boto:Data: 2024-04-16T18:12:46.590 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.590 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.590 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.590 DEBUG:boto:Params: {} 2024-04-16T18:12:46.590 DEBUG:boto:Token: None 2024-04-16T18:12:46.590 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0= 2024-04-16T18:12:46.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0=', 'Content-Length': '0'} 2024-04-16T18:12:46.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071834c02ffdb3e8b-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.634 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.635 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.635 DEBUG:boto:path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.635 DEBUG:boto:auth_path=/cjqttm-47/c?versionId=null 2024-04-16T18:12:46.635 DEBUG:boto:Method: GET 2024-04-16T18:12:46.635 DEBUG:boto:Path: /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.635 DEBUG:boto:Data: 2024-04-16T18:12:46.635 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.635 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.635 DEBUG:boto:Params: {} 2024-04-16T18:12:46.636 DEBUG:boto:Token: None 2024-04-16T18:12:46.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c?versionId=null 2024-04-16T18:12:46.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0= 2024-04-16T18:12:46.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l4y/XLswvYiTtvl0+YdRxKpsjU0=', 'Content-Length': '0'} 2024-04-16T18:12:46.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dbd56a31c122cec-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.638 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.638 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.638 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.638 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.638 DEBUG:boto:Method: GET 2024-04-16T18:12:46.639 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:12:46.639 DEBUG:boto:Data: 2024-04-16T18:12:46.639 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.639 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.639 DEBUG:boto:Params: {} 2024-04-16T18:12:46.639 DEBUG:boto:Token: None 2024-04-16T18:12:46.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.641 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9edaa90bcfdfac2-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.641 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.642 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.642 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.642 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.642 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.642 DEBUG:boto:Method: GET 2024-04-16T18:12:46.642 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:12:46.642 DEBUG:boto:Data: 2024-04-16T18:12:46.642 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.643 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.643 DEBUG:boto:Params: {} 2024-04-16T18:12:46.643 DEBUG:boto:Token: None 2024-04-16T18:12:46.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.645 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033f18f08200528e3-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.645 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.645 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.646 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.646 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.646 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:12:46.646 DEBUG:boto:Data: 2024-04-16T18:12:46.646 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.646 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.646 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.646 DEBUG:boto:Params: {} 2024-04-16T18:12:46.646 DEBUG:boto:Token: None 2024-04-16T18:12:46.646 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c 2024-04-16T18:12:46.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VDY7rmydbZw0wT5vRWatwkoO80s= 2024-04-16T18:12:46.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VDY7rmydbZw0wT5vRWatwkoO80s=', 'Content-Length': '0'} 2024-04-16T18:12:46.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000884b015dc763119-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.649 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.649 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.649 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.649 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:12:46.649 DEBUG:boto:Data: 2024-04-16T18:12:46.649 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.649 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.649 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.649 DEBUG:boto:Params: {} 2024-04-16T18:12:46.650 DEBUG:boto:Token: None 2024-04-16T18:12:46.650 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c 2024-04-16T18:12:46.650 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VDY7rmydbZw0wT5vRWatwkoO80s= 2024-04-16T18:12:46.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VDY7rmydbZw0wT5vRWatwkoO80s=', 'Content-Length': '0'} 2024-04-16T18:12:46.652 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e7b03f74298338d-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.652 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:12:46.652 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.652 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.652 DEBUG:boto:Method: GET 2024-04-16T18:12:46.652 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:12:46.652 DEBUG:boto:Data: 2024-04-16T18:12:46.653 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.653 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.653 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.653 DEBUG:boto:Params: {} 2024-04-16T18:12:46.653 DEBUG:boto:Token: None 2024-04-16T18:12:46.653 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c 2024-04-16T18:12:46.653 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fu5dolhaN1MoJN9Sa90+2IVuqTg= 2024-04-16T18:12:46.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fu5dolhaN1MoJN9Sa90+2IVuqTg=', 'Content-Length': '0'} 2024-04-16T18:12:46.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a289ac596f0010a2-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.698 DEBUG:boto:path=/cjqttm-47/c 2024-04-16T18:12:46.699 DEBUG:boto:auth_path=/cjqttm-47/c 2024-04-16T18:12:46.699 DEBUG:boto:Method: GET 2024-04-16T18:12:46.699 DEBUG:boto:Path: /cjqttm-47/c 2024-04-16T18:12:46.699 DEBUG:boto:Data: 2024-04-16T18:12:46.699 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.699 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.699 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.699 DEBUG:boto:Params: {} 2024-04-16T18:12:46.699 DEBUG:boto:Token: None 2024-04-16T18:12:46.700 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/c 2024-04-16T18:12:46.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fu5dolhaN1MoJN9Sa90+2IVuqTg= 2024-04-16T18:12:46.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fu5dolhaN1MoJN9Sa90+2IVuqTg=', 'Content-Length': '0'} 2024-04-16T18:12:46.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2177d1effd4d26b-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.702 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.702 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.702 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.702 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.703 DEBUG:boto:Method: GET 2024-04-16T18:12:46.703 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:12:46.703 DEBUG:boto:Data: 2024-04-16T18:12:46.703 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.703 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.703 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.703 DEBUG:boto:Params: {} 2024-04-16T18:12:46.703 DEBUG:boto:Token: None 2024-04-16T18:12:46.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9ad6a82c9a44c74-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.706 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.706 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.706 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.706 DEBUG:boto:path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.706 DEBUG:boto:auth_path=/cjqttm-47/?prefix=c 2024-04-16T18:12:46.706 DEBUG:boto:Method: GET 2024-04-16T18:12:46.706 DEBUG:boto:Path: /cjqttm-47/?prefix=c 2024-04-16T18:12:46.706 DEBUG:boto:Data: 2024-04-16T18:12:46.707 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.707 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.707 DEBUG:boto:Params: {} 2024-04-16T18:12:46.707 DEBUG:boto:Token: None 2024-04-16T18:12:46.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.709 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000452296812f04d1cc-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.709 DEBUG:boto:b'cjqttm-47c1000falsec2024-04-16T18:11:34.259Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.710 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:12:46.710 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.710 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.710 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.710 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.710 DEBUG:boto:Method: GET 2024-04-16T18:12:46.710 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.710 DEBUG:boto:Data: 2024-04-16T18:12:46.711 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.711 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.711 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.711 DEBUG:boto:Params: {} 2024-04-16T18:12:46.711 DEBUG:boto:Token: None 2024-04-16T18:12:46.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA= 2024-04-16T18:12:46.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA=', 'Content-Length': '0'} 2024-04-16T18:12:46.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3f81ef2dd91bef9-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.754 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.755 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.755 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.755 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.755 DEBUG:boto:Method: GET 2024-04-16T18:12:46.755 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.755 DEBUG:boto:Data: 2024-04-16T18:12:46.755 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.755 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.755 DEBUG:boto:Params: {} 2024-04-16T18:12:46.756 DEBUG:boto:Token: None 2024-04-16T18:12:46.756 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA= 2024-04-16T18:12:46.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA=', 'Content-Length': '0'} 2024-04-16T18:12:46.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022220488c627cf43-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.758 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.758 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.758 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.758 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.759 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.759 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.759 DEBUG:boto:Data: 2024-04-16T18:12:46.759 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.759 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.759 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.759 DEBUG:boto:Params: {} 2024-04-16T18:12:46.759 DEBUG:boto:Token: None 2024-04-16T18:12:46.759 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DKfQ+z/LhRP2PaHY2roJkFtRPIE= 2024-04-16T18:12:46.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DKfQ+z/LhRP2PaHY2roJkFtRPIE=', 'Content-Length': '0'} 2024-04-16T18:12:46.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d1d54d34ce51bed-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.762 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.762 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.762 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.762 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.762 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.762 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.762 DEBUG:boto:Data: 2024-04-16T18:12:46.762 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.762 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.762 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.762 DEBUG:boto:Params: {} 2024-04-16T18:12:46.763 DEBUG:boto:Token: None 2024-04-16T18:12:46.763 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DKfQ+z/LhRP2PaHY2roJkFtRPIE= 2024-04-16T18:12:46.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DKfQ+z/LhRP2PaHY2roJkFtRPIE=', 'Content-Length': '0'} 2024-04-16T18:12:46.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004166282a2e1663d1-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:12:46.765 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.765 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.765 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.765 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.765 DEBUG:boto:Method: GET 2024-04-16T18:12:46.765 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.766 DEBUG:boto:Data: 2024-04-16T18:12:46.766 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.766 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.766 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.766 DEBUG:boto:Params: {} 2024-04-16T18:12:46.766 DEBUG:boto:Token: None 2024-04-16T18:12:46.766 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA= 2024-04-16T18:12:46.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA=', 'Content-Length': '0'} 2024-04-16T18:12:46.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd97c54277d3e2fa-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.810 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.811 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.811 DEBUG:boto:path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.811 DEBUG:boto:auth_path=/cjqttm-47/d?versionId=null 2024-04-16T18:12:46.811 DEBUG:boto:Method: GET 2024-04-16T18:12:46.811 DEBUG:boto:Path: /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.811 DEBUG:boto:Data: 2024-04-16T18:12:46.811 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.811 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.811 DEBUG:boto:Params: {} 2024-04-16T18:12:46.812 DEBUG:boto:Token: None 2024-04-16T18:12:46.812 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d?versionId=null 2024-04-16T18:12:46.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA= 2024-04-16T18:12:46.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:18wFwcf4VUT5dCoMIh/EVTtF0qA=', 'Content-Length': '0'} 2024-04-16T18:12:46.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036b25d1295301a3f-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.814 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.814 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.814 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.814 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.814 DEBUG:boto:Method: GET 2024-04-16T18:12:46.815 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:12:46.815 DEBUG:boto:Data: 2024-04-16T18:12:46.815 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.815 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.815 DEBUG:boto:Params: {} 2024-04-16T18:12:46.815 DEBUG:boto:Token: None 2024-04-16T18:12:46.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000408c0d0053240acd-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.817 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.818 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.818 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.818 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.818 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.818 DEBUG:boto:Method: GET 2024-04-16T18:12:46.818 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:12:46.818 DEBUG:boto:Data: 2024-04-16T18:12:46.818 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.819 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.819 DEBUG:boto:Params: {} 2024-04-16T18:12:46.819 DEBUG:boto:Token: None 2024-04-16T18:12:46.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bbd5fcb4cc4ec8e-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.821 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.821 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.822 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.822 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.822 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:12:46.822 DEBUG:boto:Data: 2024-04-16T18:12:46.822 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.822 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.822 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.822 DEBUG:boto:Params: {} 2024-04-16T18:12:46.822 DEBUG:boto:Token: None 2024-04-16T18:12:46.822 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d 2024-04-16T18:12:46.822 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OXHmiyOnkjw+0uHD+MYxuurxF24= 2024-04-16T18:12:46.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OXHmiyOnkjw+0uHD+MYxuurxF24=', 'Content-Length': '0'} 2024-04-16T18:12:46.824 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9026323136e4baa-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.825 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.825 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.825 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.825 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:12:46.825 DEBUG:boto:Data: 2024-04-16T18:12:46.825 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.825 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.825 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.825 DEBUG:boto:Params: {} 2024-04-16T18:12:46.826 DEBUG:boto:Token: None 2024-04-16T18:12:46.826 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d 2024-04-16T18:12:46.826 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OXHmiyOnkjw+0uHD+MYxuurxF24= 2024-04-16T18:12:46.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OXHmiyOnkjw+0uHD+MYxuurxF24=', 'Content-Length': '0'} 2024-04-16T18:12:46.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c0dafaebcdbc46c-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.828 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:12:46.828 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.828 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.828 DEBUG:boto:Method: GET 2024-04-16T18:12:46.828 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:12:46.828 DEBUG:boto:Data: 2024-04-16T18:12:46.828 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.829 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.829 DEBUG:boto:Params: {} 2024-04-16T18:12:46.829 DEBUG:boto:Token: None 2024-04-16T18:12:46.829 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d 2024-04-16T18:12:46.829 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nJl+o1f00QnCTp71bVcKhHOgRfc= 2024-04-16T18:12:46.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nJl+o1f00QnCTp71bVcKhHOgRfc=', 'Content-Length': '0'} 2024-04-16T18:12:46.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:11:37 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042b2cd60c6c90a67-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.874 DEBUG:boto:path=/cjqttm-47/d 2024-04-16T18:12:46.875 DEBUG:boto:auth_path=/cjqttm-47/d 2024-04-16T18:12:46.875 DEBUG:boto:Method: GET 2024-04-16T18:12:46.875 DEBUG:boto:Path: /cjqttm-47/d 2024-04-16T18:12:46.875 DEBUG:boto:Data: 2024-04-16T18:12:46.875 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.875 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.875 DEBUG:boto:Params: {} 2024-04-16T18:12:46.875 DEBUG:boto:Token: None 2024-04-16T18:12:46.876 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/d 2024-04-16T18:12:46.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nJl+o1f00QnCTp71bVcKhHOgRfc= 2024-04-16T18:12:46.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nJl+o1f00QnCTp71bVcKhHOgRfc=', 'Content-Length': '0'} 2024-04-16T18:12:46.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:34 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000479db72e68550eff-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.878 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.878 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.878 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.878 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.878 DEBUG:boto:Method: GET 2024-04-16T18:12:46.879 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:12:46.879 DEBUG:boto:Data: 2024-04-16T18:12:46.879 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.879 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.879 DEBUG:boto:Params: {} 2024-04-16T18:12:46.879 DEBUG:boto:Token: None 2024-04-16T18:12:46.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.881 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000093612bf0539527bc-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.881 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.882 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.882 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.882 DEBUG:boto:path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.882 DEBUG:boto:auth_path=/cjqttm-47/?prefix=d 2024-04-16T18:12:46.882 DEBUG:boto:Method: GET 2024-04-16T18:12:46.882 DEBUG:boto:Path: /cjqttm-47/?prefix=d 2024-04-16T18:12:46.883 DEBUG:boto:Data: 2024-04-16T18:12:46.883 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.883 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.883 DEBUG:boto:Params: {} 2024-04-16T18:12:46.883 DEBUG:boto:Token: None 2024-04-16T18:12:46.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c25129cfb4013ad-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.886 DEBUG:boto:b'cjqttm-47d1000falsed2024-04-16T18:11:34.270Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:12:46.886 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:46.886 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:46.886 DEBUG:boto:path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.886 DEBUG:boto:auth_path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.887 DEBUG:boto:Method: GET 2024-04-16T18:12:46.887 DEBUG:boto:Path: /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.887 DEBUG:boto:Data: 2024-04-16T18:12:46.887 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.887 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.887 DEBUG:boto:Params: {} 2024-04-16T18:12:46.887 DEBUG:boto:Token: None 2024-04-16T18:12:46.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54= 2024-04-16T18:12:46.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54=', 'Content-Length': '0'} 2024-04-16T18:12:46.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be07894bc9726414-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.930 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:46.931 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:46.931 DEBUG:boto:path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.931 DEBUG:boto:auth_path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.931 DEBUG:boto:Method: GET 2024-04-16T18:12:46.931 DEBUG:boto:Path: /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.931 DEBUG:boto:Data: 2024-04-16T18:12:46.931 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.931 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.931 DEBUG:boto:Params: {} 2024-04-16T18:12:46.932 DEBUG:boto:Token: None 2024-04-16T18:12:46.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54= 2024-04-16T18:12:46.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54=', 'Content-Length': '0'} 2024-04-16T18:12:46.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bf1f43563ea6377-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.934 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:46.934 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:46.934 DEBUG:boto:path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.934 DEBUG:boto:auth_path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.934 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.935 DEBUG:boto:Path: /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.935 DEBUG:boto:Data: 2024-04-16T18:12:46.935 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.935 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.935 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.935 DEBUG:boto:Params: {} 2024-04-16T18:12:46.935 DEBUG:boto:Token: None 2024-04-16T18:12:46.935 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+kjMogyb3dGP6PHIm+fny4sEeQs= 2024-04-16T18:12:46.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+kjMogyb3dGP6PHIm+fny4sEeQs=', 'Content-Length': '0'} 2024-04-16T18:12:46.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000995fe1f0e6580b87-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.938 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:46.938 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:46.938 DEBUG:boto:path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.938 DEBUG:boto:auth_path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.938 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.938 DEBUG:boto:Path: /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.938 DEBUG:boto:Data: 2024-04-16T18:12:46.938 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.938 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.938 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.939 DEBUG:boto:Params: {} 2024-04-16T18:12:46.939 DEBUG:boto:Token: None 2024-04-16T18:12:46.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+kjMogyb3dGP6PHIm+fny4sEeQs= 2024-04-16T18:12:46.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+kjMogyb3dGP6PHIm+fny4sEeQs=', 'Content-Length': '0'} 2024-04-16T18:12:46.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bff8c21bc94fabb-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.941 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:12:46.941 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:46.941 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:46.941 DEBUG:boto:path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.941 DEBUG:boto:auth_path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.941 DEBUG:boto:Method: GET 2024-04-16T18:12:46.941 DEBUG:boto:Path: /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.941 DEBUG:boto:Data: 2024-04-16T18:12:46.942 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.942 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.942 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.942 DEBUG:boto:Params: {} 2024-04-16T18:12:46.942 DEBUG:boto:Token: None 2024-04-16T18:12:46.942 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.942 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54= 2024-04-16T18:12:46.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54=', 'Content-Length': '0'} 2024-04-16T18:12:46.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f08741ffbde29b35-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.986 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:46.987 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:46.987 DEBUG:boto:path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.987 DEBUG:boto:auth_path=/cjqttm-47/e?versionId=null 2024-04-16T18:12:46.987 DEBUG:boto:Method: GET 2024-04-16T18:12:46.987 DEBUG:boto:Path: /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.987 DEBUG:boto:Data: 2024-04-16T18:12:46.987 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.987 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.987 DEBUG:boto:Params: {} 2024-04-16T18:12:46.988 DEBUG:boto:Token: None 2024-04-16T18:12:46.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/e?versionId=null 2024-04-16T18:12:46.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54= 2024-04-16T18:12:46.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ttjWHRfUYOtl+IwZAnWceAFFS54=', 'Content-Length': '0'} 2024-04-16T18:12:46.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac594fd385ad0b9c-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.990 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.990 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.990 DEBUG:boto:path=/cjqttm-47/?prefix=e 2024-04-16T18:12:46.990 DEBUG:boto:auth_path=/cjqttm-47/?prefix=e 2024-04-16T18:12:46.991 DEBUG:boto:Method: GET 2024-04-16T18:12:46.991 DEBUG:boto:Path: /cjqttm-47/?prefix=e 2024-04-16T18:12:46.991 DEBUG:boto:Data: 2024-04-16T18:12:46.991 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.991 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.991 DEBUG:boto:Params: {} 2024-04-16T18:12:46.991 DEBUG:boto:Token: None 2024-04-16T18:12:46.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.993 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a5529d73108c20c-00661ebf9e-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.993 DEBUG:boto:b'cjqttm-47e1000falsee2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.994 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:46.994 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:46.994 DEBUG:boto:path=/cjqttm-47/?prefix=e 2024-04-16T18:12:46.994 DEBUG:boto:auth_path=/cjqttm-47/?prefix=e 2024-04-16T18:12:46.994 DEBUG:boto:Method: GET 2024-04-16T18:12:46.994 DEBUG:boto:Path: /cjqttm-47/?prefix=e 2024-04-16T18:12:46.994 DEBUG:boto:Data: 2024-04-16T18:12:46.994 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:46.995 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.995 DEBUG:boto:Params: {} 2024-04-16T18:12:46.995 DEBUG:boto:Token: None 2024-04-16T18:12:46.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/ 2024-04-16T18:12:46.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs= 2024-04-16T18:12:46.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mV1nN38cS//JtOeAuZanFWLCMVs=', 'Content-Length': '0'} 2024-04-16T18:12:46.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000902c511fda5532ad-00661ebf9e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:46.997 DEBUG:boto:b'cjqttm-47e1000falsee2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:46.998 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:46.998 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:46.998 DEBUG:boto:Method: HEAD 2024-04-16T18:12:46.998 DEBUG:boto:Path: /cjqttm-47/e 2024-04-16T18:12:46.998 DEBUG:boto:Data: 2024-04-16T18:12:46.998 DEBUG:boto:Headers: {} 2024-04-16T18:12:46.998 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:46.998 DEBUG:boto:Port: 8000 2024-04-16T18:12:46.998 DEBUG:boto:Params: {} 2024-04-16T18:12:46.998 DEBUG:boto:Token: None 2024-04-16T18:12:46.999 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:46 GMT /cjqttm-47/e 2024-04-16T18:12:46.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z550kx+Vn+IQw+2j88cYrlbuZwU= 2024-04-16T18:12:46.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z550kx+Vn+IQw+2j88cYrlbuZwU=', 'Content-Length': '0'} 2024-04-16T18:12:47.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000068dae0264ff9af2-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.001 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:47.001 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:47.001 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.001 DEBUG:boto:Path: /cjqttm-47/e 2024-04-16T18:12:47.001 DEBUG:boto:Data: 2024-04-16T18:12:47.001 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.001 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.001 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.001 DEBUG:boto:Params: {} 2024-04-16T18:12:47.002 DEBUG:boto:Token: None 2024-04-16T18:12:47.002 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/e 2024-04-16T18:12:47.002 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V8PT+EXb68vnl1It5iCe4ggLSDE= 2024-04-16T18:12:47.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V8PT+EXb68vnl1It5iCe4ggLSDE=', 'Content-Length': '0'} 2024-04-16T18:12:47.004 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000582690cc373fe1a1-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.004 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:12:47.004 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:47.004 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:47.004 DEBUG:boto:Method: GET 2024-04-16T18:12:47.004 DEBUG:boto:Path: /cjqttm-47/e 2024-04-16T18:12:47.004 DEBUG:boto:Data: 2024-04-16T18:12:47.004 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.004 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.005 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.005 DEBUG:boto:Params: {} 2024-04-16T18:12:47.005 DEBUG:boto:Token: None 2024-04-16T18:12:47.005 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/e 2024-04-16T18:12:47.005 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a1jFXqwTV0/n/EISvh8lt5ofTzI= 2024-04-16T18:12:47.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a1jFXqwTV0/n/EISvh8lt5ofTzI=', 'Content-Length': '0'} 2024-04-16T18:12:47.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003622326d25b11554-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.050 DEBUG:boto:path=/cjqttm-47/e 2024-04-16T18:12:47.051 DEBUG:boto:auth_path=/cjqttm-47/e 2024-04-16T18:12:47.051 DEBUG:boto:Method: GET 2024-04-16T18:12:47.051 DEBUG:boto:Path: /cjqttm-47/e 2024-04-16T18:12:47.051 DEBUG:boto:Data: 2024-04-16T18:12:47.051 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.051 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.051 DEBUG:boto:Params: {} 2024-04-16T18:12:47.052 DEBUG:boto:Token: None 2024-04-16T18:12:47.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/e 2024-04-16T18:12:47.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a1jFXqwTV0/n/EISvh8lt5ofTzI= 2024-04-16T18:12:47.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a1jFXqwTV0/n/EISvh8lt5ofTzI=', 'Content-Length': '0'} 2024-04-16T18:12:47.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed1836936cf10678-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.054 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.054 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.054 DEBUG:boto:path=/cjqttm-47/?prefix=e 2024-04-16T18:12:47.054 DEBUG:boto:auth_path=/cjqttm-47/?prefix=e 2024-04-16T18:12:47.055 DEBUG:boto:Method: GET 2024-04-16T18:12:47.055 DEBUG:boto:Path: /cjqttm-47/?prefix=e 2024-04-16T18:12:47.055 DEBUG:boto:Data: 2024-04-16T18:12:47.055 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.055 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.055 DEBUG:boto:Params: {} 2024-04-16T18:12:47.055 DEBUG:boto:Token: None 2024-04-16T18:12:47.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000537b5811bfba076e-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.058 DEBUG:boto:b'cjqttm-47e1000falsee2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.058 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.058 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.058 DEBUG:boto:path=/cjqttm-47/?prefix=e 2024-04-16T18:12:47.058 DEBUG:boto:auth_path=/cjqttm-47/?prefix=e 2024-04-16T18:12:47.058 DEBUG:boto:Method: GET 2024-04-16T18:12:47.058 DEBUG:boto:Path: /cjqttm-47/?prefix=e 2024-04-16T18:12:47.058 DEBUG:boto:Data: 2024-04-16T18:12:47.059 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.059 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.059 DEBUG:boto:Params: {} 2024-04-16T18:12:47.059 DEBUG:boto:Token: None 2024-04-16T18:12:47.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f01c732bf74ca53-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.062 DEBUG:boto:b'cjqttm-47e1000falsee2024-04-16T18:11:45.783Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.062 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:12:47.062 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.062 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.062 DEBUG:boto:path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.062 DEBUG:boto:auth_path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.063 DEBUG:boto:Method: GET 2024-04-16T18:12:47.063 DEBUG:boto:Path: /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.063 DEBUG:boto:Data: 2024-04-16T18:12:47.063 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.063 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.063 DEBUG:boto:Params: {} 2024-04-16T18:12:47.063 DEBUG:boto:Token: None 2024-04-16T18:12:47.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8= 2024-04-16T18:12:47.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8=', 'Content-Length': '0'} 2024-04-16T18:12:47.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af0487ac68bf3e13-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.106 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.107 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.107 DEBUG:boto:path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.107 DEBUG:boto:auth_path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.107 DEBUG:boto:Method: GET 2024-04-16T18:12:47.107 DEBUG:boto:Path: /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.107 DEBUG:boto:Data: 2024-04-16T18:12:47.107 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.107 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.107 DEBUG:boto:Params: {} 2024-04-16T18:12:47.108 DEBUG:boto:Token: None 2024-04-16T18:12:47.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8= 2024-04-16T18:12:47.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8=', 'Content-Length': '0'} 2024-04-16T18:12:47.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fac5eba3c4cedcc5-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.110 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.111 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.111 DEBUG:boto:path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.111 DEBUG:boto:auth_path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.111 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.111 DEBUG:boto:Path: /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.111 DEBUG:boto:Data: 2024-04-16T18:12:47.111 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.111 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.111 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.111 DEBUG:boto:Params: {} 2024-04-16T18:12:47.111 DEBUG:boto:Token: None 2024-04-16T18:12:47.112 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0LS0vx6qsv+Mw3IBUvTUIsUt2OQ= 2024-04-16T18:12:47.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0LS0vx6qsv+Mw3IBUvTUIsUt2OQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3e2cc996e452b1c-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.114 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.114 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.114 DEBUG:boto:path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.114 DEBUG:boto:auth_path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.115 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.115 DEBUG:boto:Path: /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.115 DEBUG:boto:Data: 2024-04-16T18:12:47.115 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.115 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.115 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.115 DEBUG:boto:Params: {} 2024-04-16T18:12:47.115 DEBUG:boto:Token: None 2024-04-16T18:12:47.115 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0LS0vx6qsv+Mw3IBUvTUIsUt2OQ= 2024-04-16T18:12:47.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0LS0vx6qsv+Mw3IBUvTUIsUt2OQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000723e7dc8806fb2e2-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:12:47.118 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.118 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.118 DEBUG:boto:path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.118 DEBUG:boto:auth_path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.118 DEBUG:boto:Method: GET 2024-04-16T18:12:47.118 DEBUG:boto:Path: /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.118 DEBUG:boto:Data: 2024-04-16T18:12:47.118 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.119 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.119 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.119 DEBUG:boto:Params: {} 2024-04-16T18:12:47.119 DEBUG:boto:Token: None 2024-04-16T18:12:47.119 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8= 2024-04-16T18:12:47.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8=', 'Content-Length': '0'} 2024-04-16T18:12:47.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000809b39779b491280-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.162 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.163 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.163 DEBUG:boto:path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.163 DEBUG:boto:auth_path=/cjqttm-47/f?versionId=null 2024-04-16T18:12:47.163 DEBUG:boto:Method: GET 2024-04-16T18:12:47.163 DEBUG:boto:Path: /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.163 DEBUG:boto:Data: 2024-04-16T18:12:47.163 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.163 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.163 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.163 DEBUG:boto:Params: {} 2024-04-16T18:12:47.164 DEBUG:boto:Token: None 2024-04-16T18:12:47.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f?versionId=null 2024-04-16T18:12:47.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8= 2024-04-16T18:12:47.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AZq/0H8cia7wd4BBBHPJHyaChf8=', 'Content-Length': '0'} 2024-04-16T18:12:47.166 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082499ee7d59ab699-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.167 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.167 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.167 DEBUG:boto:path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.167 DEBUG:boto:auth_path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.167 DEBUG:boto:Method: GET 2024-04-16T18:12:47.167 DEBUG:boto:Path: /cjqttm-47/?prefix=f 2024-04-16T18:12:47.167 DEBUG:boto:Data: 2024-04-16T18:12:47.167 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.167 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.167 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.167 DEBUG:boto:Params: {} 2024-04-16T18:12:47.168 DEBUG:boto:Token: None 2024-04-16T18:12:47.168 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.170 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004321c444af3314c1-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.170 DEBUG:boto:b'cjqttm-47f1000falsef2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.171 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.171 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.171 DEBUG:boto:path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.171 DEBUG:boto:auth_path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.171 DEBUG:boto:Method: GET 2024-04-16T18:12:47.171 DEBUG:boto:Path: /cjqttm-47/?prefix=f 2024-04-16T18:12:47.171 DEBUG:boto:Data: 2024-04-16T18:12:47.171 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.172 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.172 DEBUG:boto:Params: {} 2024-04-16T18:12:47.172 DEBUG:boto:Token: None 2024-04-16T18:12:47.172 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2c1dec3610c3a27-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.214 DEBUG:boto:b'cjqttm-47f1000falsef2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.215 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.215 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.215 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.215 DEBUG:boto:Path: /cjqttm-47/f 2024-04-16T18:12:47.215 DEBUG:boto:Data: 2024-04-16T18:12:47.215 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.216 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.216 DEBUG:boto:Params: {} 2024-04-16T18:12:47.216 DEBUG:boto:Token: None 2024-04-16T18:12:47.216 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f 2024-04-16T18:12:47.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mYYcdeVOmWUPYXpI/FaJ8Wyz4oQ= 2024-04-16T18:12:47.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mYYcdeVOmWUPYXpI/FaJ8Wyz4oQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000990614825844245-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.219 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.219 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.219 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.219 DEBUG:boto:Path: /cjqttm-47/f 2024-04-16T18:12:47.219 DEBUG:boto:Data: 2024-04-16T18:12:47.219 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.219 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.219 DEBUG:boto:Params: {} 2024-04-16T18:12:47.219 DEBUG:boto:Token: None 2024-04-16T18:12:47.220 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f 2024-04-16T18:12:47.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mYYcdeVOmWUPYXpI/FaJ8Wyz4oQ= 2024-04-16T18:12:47.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mYYcdeVOmWUPYXpI/FaJ8Wyz4oQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0534ce87872ab4b-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:12:47.222 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.222 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.222 DEBUG:boto:Method: GET 2024-04-16T18:12:47.223 DEBUG:boto:Path: /cjqttm-47/f 2024-04-16T18:12:47.223 DEBUG:boto:Data: 2024-04-16T18:12:47.223 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.223 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.223 DEBUG:boto:Params: {} 2024-04-16T18:12:47.223 DEBUG:boto:Token: None 2024-04-16T18:12:47.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f 2024-04-16T18:12:47.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ezu38w+s1PEadTbD1BA4G1zXI4A= 2024-04-16T18:12:47.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ezu38w+s1PEadTbD1BA4G1zXI4A=', 'Content-Length': '0'} 2024-04-16T18:12:47.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b094f1e142d71200-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.266 DEBUG:boto:path=/cjqttm-47/f 2024-04-16T18:12:47.267 DEBUG:boto:auth_path=/cjqttm-47/f 2024-04-16T18:12:47.267 DEBUG:boto:Method: GET 2024-04-16T18:12:47.267 DEBUG:boto:Path: /cjqttm-47/f 2024-04-16T18:12:47.267 DEBUG:boto:Data: 2024-04-16T18:12:47.267 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.267 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.267 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.267 DEBUG:boto:Params: {} 2024-04-16T18:12:47.267 DEBUG:boto:Token: None 2024-04-16T18:12:47.268 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/f 2024-04-16T18:12:47.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ezu38w+s1PEadTbD1BA4G1zXI4A= 2024-04-16T18:12:47.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ezu38w+s1PEadTbD1BA4G1zXI4A=', 'Content-Length': '0'} 2024-04-16T18:12:47.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9fa54c3bbbf468d-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.270 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.270 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.271 DEBUG:boto:path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.271 DEBUG:boto:auth_path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.271 DEBUG:boto:Method: GET 2024-04-16T18:12:47.271 DEBUG:boto:Path: /cjqttm-47/?prefix=f 2024-04-16T18:12:47.271 DEBUG:boto:Data: 2024-04-16T18:12:47.271 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.271 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.271 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.271 DEBUG:boto:Params: {} 2024-04-16T18:12:47.271 DEBUG:boto:Token: None 2024-04-16T18:12:47.271 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.274 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a80861055c1453fd-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.314 DEBUG:boto:b'cjqttm-47f1000falsef2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.315 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.315 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.315 DEBUG:boto:path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.315 DEBUG:boto:auth_path=/cjqttm-47/?prefix=f 2024-04-16T18:12:47.315 DEBUG:boto:Method: GET 2024-04-16T18:12:47.315 DEBUG:boto:Path: /cjqttm-47/?prefix=f 2024-04-16T18:12:47.315 DEBUG:boto:Data: 2024-04-16T18:12:47.315 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.315 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.315 DEBUG:boto:Params: {} 2024-04-16T18:12:47.316 DEBUG:boto:Token: None 2024-04-16T18:12:47.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d57f65dde80a71a-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.318 DEBUG:boto:b'cjqttm-47f1000falsef2024-04-16T18:11:45.794Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:12:47.319 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.319 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.319 DEBUG:boto:path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.319 DEBUG:boto:auth_path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.319 DEBUG:boto:Method: GET 2024-04-16T18:12:47.319 DEBUG:boto:Path: /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.319 DEBUG:boto:Data: 2024-04-16T18:12:47.319 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.320 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.320 DEBUG:boto:Params: {} 2024-04-16T18:12:47.320 DEBUG:boto:Token: None 2024-04-16T18:12:47.320 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8= 2024-04-16T18:12:47.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8=', 'Content-Length': '0'} 2024-04-16T18:12:47.322 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba72dfb0adaf089a-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.366 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.367 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.367 DEBUG:boto:path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.367 DEBUG:boto:auth_path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.367 DEBUG:boto:Method: GET 2024-04-16T18:12:47.367 DEBUG:boto:Path: /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.367 DEBUG:boto:Data: 2024-04-16T18:12:47.367 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.367 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.367 DEBUG:boto:Params: {} 2024-04-16T18:12:47.367 DEBUG:boto:Token: None 2024-04-16T18:12:47.368 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8= 2024-04-16T18:12:47.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8=', 'Content-Length': '0'} 2024-04-16T18:12:47.370 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008516198b4777d73b-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.370 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.370 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.370 DEBUG:boto:path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.370 DEBUG:boto:auth_path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.370 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.370 DEBUG:boto:Path: /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.371 DEBUG:boto:Data: 2024-04-16T18:12:47.371 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.371 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.371 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.371 DEBUG:boto:Params: {} 2024-04-16T18:12:47.371 DEBUG:boto:Token: None 2024-04-16T18:12:47.371 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eBhOhrSWWpQAM966IB0s/cibitw= 2024-04-16T18:12:47.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eBhOhrSWWpQAM966IB0s/cibitw=', 'Content-Length': '0'} 2024-04-16T18:12:47.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f9a55e21c922a3a-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.373 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.373 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.373 DEBUG:boto:path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.373 DEBUG:boto:auth_path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.374 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.374 DEBUG:boto:Path: /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.374 DEBUG:boto:Data: 2024-04-16T18:12:47.374 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.374 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.374 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.374 DEBUG:boto:Params: {} 2024-04-16T18:12:47.374 DEBUG:boto:Token: None 2024-04-16T18:12:47.374 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.374 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eBhOhrSWWpQAM966IB0s/cibitw= 2024-04-16T18:12:47.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eBhOhrSWWpQAM966IB0s/cibitw=', 'Content-Length': '0'} 2024-04-16T18:12:47.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000371d3fbce612df76-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:12:47.377 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.377 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.377 DEBUG:boto:path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.377 DEBUG:boto:auth_path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.377 DEBUG:boto:Method: GET 2024-04-16T18:12:47.377 DEBUG:boto:Path: /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.377 DEBUG:boto:Data: 2024-04-16T18:12:47.377 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.377 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.377 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.377 DEBUG:boto:Params: {} 2024-04-16T18:12:47.378 DEBUG:boto:Token: None 2024-04-16T18:12:47.378 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.378 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8= 2024-04-16T18:12:47.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8=', 'Content-Length': '0'} 2024-04-16T18:12:47.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015e558abb0abfdd4-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.422 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.422 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.422 DEBUG:boto:path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.423 DEBUG:boto:auth_path=/cjqttm-47/g?versionId=null 2024-04-16T18:12:47.423 DEBUG:boto:Method: GET 2024-04-16T18:12:47.423 DEBUG:boto:Path: /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.423 DEBUG:boto:Data: 2024-04-16T18:12:47.423 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.423 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.423 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.423 DEBUG:boto:Params: {} 2024-04-16T18:12:47.423 DEBUG:boto:Token: None 2024-04-16T18:12:47.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g?versionId=null 2024-04-16T18:12:47.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8= 2024-04-16T18:12:47.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eHSkhJxkZhFiw87DKLBbQ+jqEg8=', 'Content-Length': '0'} 2024-04-16T18:12:47.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecb7d7b38088f955-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.426 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.426 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.426 DEBUG:boto:path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.426 DEBUG:boto:auth_path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.426 DEBUG:boto:Method: GET 2024-04-16T18:12:47.426 DEBUG:boto:Path: /cjqttm-47/?prefix=g 2024-04-16T18:12:47.426 DEBUG:boto:Data: 2024-04-16T18:12:47.426 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.426 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.426 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.426 DEBUG:boto:Params: {} 2024-04-16T18:12:47.427 DEBUG:boto:Token: None 2024-04-16T18:12:47.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.427 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.428 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096312b7c13796b71-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.470 DEBUG:boto:b'cjqttm-47g1000falseg2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.470 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.471 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.471 DEBUG:boto:path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.471 DEBUG:boto:auth_path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.471 DEBUG:boto:Method: GET 2024-04-16T18:12:47.471 DEBUG:boto:Path: /cjqttm-47/?prefix=g 2024-04-16T18:12:47.471 DEBUG:boto:Data: 2024-04-16T18:12:47.471 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.471 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.471 DEBUG:boto:Params: {} 2024-04-16T18:12:47.471 DEBUG:boto:Token: None 2024-04-16T18:12:47.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.474 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9e35ed29541ec35-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.474 DEBUG:boto:b'cjqttm-47g1000falseg2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.474 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.474 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.474 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.475 DEBUG:boto:Path: /cjqttm-47/g 2024-04-16T18:12:47.475 DEBUG:boto:Data: 2024-04-16T18:12:47.475 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.475 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.475 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.475 DEBUG:boto:Params: {} 2024-04-16T18:12:47.475 DEBUG:boto:Token: None 2024-04-16T18:12:47.475 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g 2024-04-16T18:12:47.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jw4FzHjXqygIVKiTeMg8TnV37E8= 2024-04-16T18:12:47.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jw4FzHjXqygIVKiTeMg8TnV37E8=', 'Content-Length': '0'} 2024-04-16T18:12:47.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecce4b220417e2dd-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.477 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.477 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.477 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.478 DEBUG:boto:Path: /cjqttm-47/g 2024-04-16T18:12:47.478 DEBUG:boto:Data: 2024-04-16T18:12:47.478 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.478 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.478 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.478 DEBUG:boto:Params: {} 2024-04-16T18:12:47.478 DEBUG:boto:Token: None 2024-04-16T18:12:47.478 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g 2024-04-16T18:12:47.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jw4FzHjXqygIVKiTeMg8TnV37E8= 2024-04-16T18:12:47.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jw4FzHjXqygIVKiTeMg8TnV37E8=', 'Content-Length': '0'} 2024-04-16T18:12:47.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f99a63b627b33d2-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:12:47.481 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.481 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.481 DEBUG:boto:Method: GET 2024-04-16T18:12:47.481 DEBUG:boto:Path: /cjqttm-47/g 2024-04-16T18:12:47.481 DEBUG:boto:Data: 2024-04-16T18:12:47.481 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.481 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.481 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.481 DEBUG:boto:Params: {} 2024-04-16T18:12:47.481 DEBUG:boto:Token: None 2024-04-16T18:12:47.482 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g 2024-04-16T18:12:47.482 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rYEMBKHtEWbRD9W0vroNiRQX69o= 2024-04-16T18:12:47.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rYEMBKHtEWbRD9W0vroNiRQX69o=', 'Content-Length': '0'} 2024-04-16T18:12:47.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:38 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b81a96b052ceaa8d-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.526 DEBUG:boto:path=/cjqttm-47/g 2024-04-16T18:12:47.527 DEBUG:boto:auth_path=/cjqttm-47/g 2024-04-16T18:12:47.527 DEBUG:boto:Method: GET 2024-04-16T18:12:47.527 DEBUG:boto:Path: /cjqttm-47/g 2024-04-16T18:12:47.527 DEBUG:boto:Data: 2024-04-16T18:12:47.527 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.527 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.527 DEBUG:boto:Params: {} 2024-04-16T18:12:47.527 DEBUG:boto:Token: None 2024-04-16T18:12:47.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/g 2024-04-16T18:12:47.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rYEMBKHtEWbRD9W0vroNiRQX69o= 2024-04-16T18:12:47.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rYEMBKHtEWbRD9W0vroNiRQX69o=', 'Content-Length': '0'} 2024-04-16T18:12:47.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001d2b3b758dedb6a-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.530 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.530 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.530 DEBUG:boto:path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.530 DEBUG:boto:auth_path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.530 DEBUG:boto:Method: GET 2024-04-16T18:12:47.530 DEBUG:boto:Path: /cjqttm-47/?prefix=g 2024-04-16T18:12:47.530 DEBUG:boto:Data: 2024-04-16T18:12:47.530 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.530 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.530 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.531 DEBUG:boto:Params: {} 2024-04-16T18:12:47.531 DEBUG:boto:Token: None 2024-04-16T18:12:47.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.533 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002192c5d9cfac231a-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.533 DEBUG:boto:b'cjqttm-47g1000falseg2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.534 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.534 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.534 DEBUG:boto:path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.534 DEBUG:boto:auth_path=/cjqttm-47/?prefix=g 2024-04-16T18:12:47.534 DEBUG:boto:Method: GET 2024-04-16T18:12:47.534 DEBUG:boto:Path: /cjqttm-47/?prefix=g 2024-04-16T18:12:47.534 DEBUG:boto:Data: 2024-04-16T18:12:47.534 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.534 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.534 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.534 DEBUG:boto:Params: {} 2024-04-16T18:12:47.535 DEBUG:boto:Token: None 2024-04-16T18:12:47.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047ed7aa4d068f16c-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.537 DEBUG:boto:b'cjqttm-47g1000falseg2024-04-16T18:11:45.843Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:12:47.538 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.538 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.538 DEBUG:boto:path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.538 DEBUG:boto:auth_path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.538 DEBUG:boto:Method: GET 2024-04-16T18:12:47.538 DEBUG:boto:Path: /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.538 DEBUG:boto:Data: 2024-04-16T18:12:47.538 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.538 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.538 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.538 DEBUG:boto:Params: {} 2024-04-16T18:12:47.538 DEBUG:boto:Token: None 2024-04-16T18:12:47.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI= 2024-04-16T18:12:47.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI=', 'Content-Length': '0'} 2024-04-16T18:12:47.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dba48444ad547a0-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.582 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.582 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.582 DEBUG:boto:path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.583 DEBUG:boto:auth_path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.583 DEBUG:boto:Method: GET 2024-04-16T18:12:47.583 DEBUG:boto:Path: /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.583 DEBUG:boto:Data: 2024-04-16T18:12:47.583 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.583 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.583 DEBUG:boto:Params: {} 2024-04-16T18:12:47.583 DEBUG:boto:Token: None 2024-04-16T18:12:47.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI= 2024-04-16T18:12:47.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI=', 'Content-Length': '0'} 2024-04-16T18:12:47.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d2278c50fc66650-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.586 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.586 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.587 DEBUG:boto:path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.587 DEBUG:boto:auth_path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.587 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.587 DEBUG:boto:Path: /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.587 DEBUG:boto:Data: 2024-04-16T18:12:47.587 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.587 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.587 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.587 DEBUG:boto:Params: {} 2024-04-16T18:12:47.587 DEBUG:boto:Token: None 2024-04-16T18:12:47.588 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:we/v2BLFAUHCVXsHDl0i9TFjJYs= 2024-04-16T18:12:47.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:we/v2BLFAUHCVXsHDl0i9TFjJYs=', 'Content-Length': '0'} 2024-04-16T18:12:47.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9631c18ce0abc2b-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.590 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.591 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.591 DEBUG:boto:path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.591 DEBUG:boto:auth_path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.591 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.591 DEBUG:boto:Path: /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.591 DEBUG:boto:Data: 2024-04-16T18:12:47.591 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.591 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.591 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.591 DEBUG:boto:Params: {} 2024-04-16T18:12:47.591 DEBUG:boto:Token: None 2024-04-16T18:12:47.592 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:we/v2BLFAUHCVXsHDl0i9TFjJYs= 2024-04-16T18:12:47.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:we/v2BLFAUHCVXsHDl0i9TFjJYs=', 'Content-Length': '0'} 2024-04-16T18:12:47.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c4bd2e6fad8910a-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:12:47.594 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.594 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.595 DEBUG:boto:path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.595 DEBUG:boto:auth_path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.595 DEBUG:boto:Method: GET 2024-04-16T18:12:47.595 DEBUG:boto:Path: /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.595 DEBUG:boto:Data: 2024-04-16T18:12:47.595 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.595 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.595 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.595 DEBUG:boto:Params: {} 2024-04-16T18:12:47.595 DEBUG:boto:Token: None 2024-04-16T18:12:47.595 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI= 2024-04-16T18:12:47.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI=', 'Content-Length': '0'} 2024-04-16T18:12:47.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027435c6fd1c6724c-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.638 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.639 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.639 DEBUG:boto:path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.639 DEBUG:boto:auth_path=/cjqttm-47/h?versionId=null 2024-04-16T18:12:47.639 DEBUG:boto:Method: GET 2024-04-16T18:12:47.639 DEBUG:boto:Path: /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.639 DEBUG:boto:Data: 2024-04-16T18:12:47.639 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.639 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.640 DEBUG:boto:Params: {} 2024-04-16T18:12:47.640 DEBUG:boto:Token: None 2024-04-16T18:12:47.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h?versionId=null 2024-04-16T18:12:47.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI= 2024-04-16T18:12:47.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7EkKS7CHd4HNDI44YEhOxQ/a+LI=', 'Content-Length': '0'} 2024-04-16T18:12:47.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6109a74ffd93c59-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.642 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.643 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.643 DEBUG:boto:path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.643 DEBUG:boto:auth_path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.643 DEBUG:boto:Method: GET 2024-04-16T18:12:47.643 DEBUG:boto:Path: /cjqttm-47/?prefix=h 2024-04-16T18:12:47.643 DEBUG:boto:Data: 2024-04-16T18:12:47.643 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.643 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.643 DEBUG:boto:Params: {} 2024-04-16T18:12:47.644 DEBUG:boto:Token: None 2024-04-16T18:12:47.644 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000758f25953b9e1e8b-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.646 DEBUG:boto:b'cjqttm-47h1000falseh2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.647 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.647 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.647 DEBUG:boto:path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.647 DEBUG:boto:auth_path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.647 DEBUG:boto:Method: GET 2024-04-16T18:12:47.647 DEBUG:boto:Path: /cjqttm-47/?prefix=h 2024-04-16T18:12:47.647 DEBUG:boto:Data: 2024-04-16T18:12:47.647 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.647 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.648 DEBUG:boto:Params: {} 2024-04-16T18:12:47.648 DEBUG:boto:Token: None 2024-04-16T18:12:47.648 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067fff7ca8bcbf2f4-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.650 DEBUG:boto:b'cjqttm-47h1000falseh2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.651 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.651 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.651 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.651 DEBUG:boto:Path: /cjqttm-47/h 2024-04-16T18:12:47.651 DEBUG:boto:Data: 2024-04-16T18:12:47.651 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.651 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.651 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.652 DEBUG:boto:Params: {} 2024-04-16T18:12:47.652 DEBUG:boto:Token: None 2024-04-16T18:12:47.652 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h 2024-04-16T18:12:47.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nXoAqQWDbfXgxG157w1Se4dLGuk= 2024-04-16T18:12:47.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nXoAqQWDbfXgxG157w1Se4dLGuk=', 'Content-Length': '0'} 2024-04-16T18:12:47.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000442cafaf92d2e3c1-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.654 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.654 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.654 DEBUG:boto:Method: HEAD 2024-04-16T18:12:47.655 DEBUG:boto:Path: /cjqttm-47/h 2024-04-16T18:12:47.655 DEBUG:boto:Data: 2024-04-16T18:12:47.655 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.655 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.655 DEBUG:boto:Params: {} 2024-04-16T18:12:47.655 DEBUG:boto:Token: None 2024-04-16T18:12:47.655 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h 2024-04-16T18:12:47.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nXoAqQWDbfXgxG157w1Se4dLGuk= 2024-04-16T18:12:47.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nXoAqQWDbfXgxG157w1Se4dLGuk=', 'Content-Length': '0'} 2024-04-16T18:12:47.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c792032ee7d955c8-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.658 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:12:47.658 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.658 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.658 DEBUG:boto:Method: GET 2024-04-16T18:12:47.658 DEBUG:boto:Path: /cjqttm-47/h 2024-04-16T18:12:47.658 DEBUG:boto:Data: 2024-04-16T18:12:47.658 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.659 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.659 DEBUG:boto:Params: {} 2024-04-16T18:12:47.659 DEBUG:boto:Token: None 2024-04-16T18:12:47.659 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h 2024-04-16T18:12:47.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oIA/sLfy32xxrvnB+TNQWvdGIsk= 2024-04-16T18:12:47.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oIA/sLfy32xxrvnB+TNQWvdGIsk=', 'Content-Length': '0'} 2024-04-16T18:12:47.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-47:9ba59572-f51c-4bce-9578-e6350e822996.4816.16'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:12:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e57a70e2fd2c8823-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.702 DEBUG:boto:path=/cjqttm-47/h 2024-04-16T18:12:47.703 DEBUG:boto:auth_path=/cjqttm-47/h 2024-04-16T18:12:47.703 DEBUG:boto:Method: GET 2024-04-16T18:12:47.703 DEBUG:boto:Path: /cjqttm-47/h 2024-04-16T18:12:47.703 DEBUG:boto:Data: 2024-04-16T18:12:47.703 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.703 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.703 DEBUG:boto:Params: {} 2024-04-16T18:12:47.704 DEBUG:boto:Token: None 2024-04-16T18:12:47.704 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/h 2024-04-16T18:12:47.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oIA/sLfy32xxrvnB+TNQWvdGIsk= 2024-04-16T18:12:47.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oIA/sLfy32xxrvnB+TNQWvdGIsk=', 'Content-Length': '0'} 2024-04-16T18:12:47.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:11:45 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005519789c22160efa-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.707 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.707 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.707 DEBUG:boto:path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.707 DEBUG:boto:auth_path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.707 DEBUG:boto:Method: GET 2024-04-16T18:12:47.707 DEBUG:boto:Path: /cjqttm-47/?prefix=h 2024-04-16T18:12:47.707 DEBUG:boto:Data: 2024-04-16T18:12:47.707 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:47.707 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.707 DEBUG:boto:Params: {} 2024-04-16T18:12:47.708 DEBUG:boto:Token: None 2024-04-16T18:12:47.708 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.708 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002cff9eadd01799c0-00661ebf9f-4999-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.710 DEBUG:boto:b'cjqttm-47h1000falseh2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.711 DEBUG:boto:path=/cjqttm-47/ 2024-04-16T18:12:47.711 DEBUG:boto:auth_path=/cjqttm-47/ 2024-04-16T18:12:47.711 DEBUG:boto:path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.711 DEBUG:boto:auth_path=/cjqttm-47/?prefix=h 2024-04-16T18:12:47.711 DEBUG:boto:Method: GET 2024-04-16T18:12:47.711 DEBUG:boto:Path: /cjqttm-47/?prefix=h 2024-04-16T18:12:47.711 DEBUG:boto:Data: 2024-04-16T18:12:47.711 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.712 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.712 DEBUG:boto:Params: {} 2024-04-16T18:12:47.712 DEBUG:boto:Token: None 2024-04-16T18:12:47.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-47/ 2024-04-16T18:12:47.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ= 2024-04-16T18:12:47.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgMUsVHeAeLdviJ1snHequISXHQ=', 'Content-Length': '0'} 2024-04-16T18:12:47.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a329c5b90a438707-00661ebf9f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.754 DEBUG:boto:b'cjqttm-47h1000falseh2024-04-16T18:11:45.854Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:12:47.755 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-47 zones={test-zone2, test-zone1} 2024-04-16T18:12:47.755 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_incremental ... ok 2024-04-16T18:12:47.756 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:47.756 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:47.756 DEBUG:boto:Method: PUT 2024-04-16T18:12:47.757 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:47.757 DEBUG:boto:Data: 2024-04-16T18:12:47.757 DEBUG:boto:Headers: {} 2024-04-16T18:12:47.757 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:47.757 DEBUG:boto:Port: 8000 2024-04-16T18:12:47.757 DEBUG:boto:Params: {} 2024-04-16T18:12:47.757 DEBUG:boto:Token: None 2024-04-16T18:12:47.757 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:12:47 GMT /cjqttm-48/ 2024-04-16T18:12:47.757 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HUEsE1R8LO+aoxMY9I6vM8KI3kU= 2024-04-16T18:12:47.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HUEsE1R8LO+aoxMY9I6vM8KI3kU=', 'Content-Length': '0'} 2024-04-16T18:12:47.775 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000087c2ab8edc11d97c-00661ebf9f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:47.775 DEBUG:rgw_multi.tests:created bucket=cjqttm-48 2024-04-16T18:12:47.776 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:12:47.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:12:47.776 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:12:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:12:47.828 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:12:47.882 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:12:47.904 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291167.775341_669.1","last_update":"2024-04-16T18:12:47.775341Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:12:47.905 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291167.775341_669.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:12:47.905 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:12:47.905 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:12:47.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:12:47.906 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:12:47.960 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:12:47.961 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:12:48.015 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:48.016+0000 7ff45153b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:12:48.016 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:48.017+0000 7ff45153b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:12:48.038 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291167.766320_663.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:47.766320Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:12:48Z"} 2024-04-16T18:12:48.039 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291167.766320_663.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:47.766320Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:12:48Z"} 2024-04-16T18:12:48.039 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291167.766320_663.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:47.766320Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:12:48.039 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291167.775341_669.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:12:48.039 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291167.766320_663.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:12:48.039 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291167.775341_669.1 target=1_1713291167.766320_663.1 2024-04-16T18:12:53.040 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:12:53.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:12:53.041 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:12:53.096 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:12:53.096 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:12:53.150 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:53.152+0000 7fc2caa44800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:12:53.151 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:12:53.153+0000 7fc2caa44800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:12:53.174 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291167.775341_669.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:47.775341Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:12:53Z"} 2024-04-16T18:12:53.174 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291167.775341_669.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:47.775341Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:12:53Z"} 2024-04-16T18:12:53.175 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291167.775341_669.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:47.775341Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:12:53.175 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291167.775341_669.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:12:53.175 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291167.775341_669.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:12:53.175 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:12:53.175 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:12:53.175 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:12:53.176 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:12:53.178+0000 7f5c1a88c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 41330) UID: 0 2024-04-16T18:12:53.176 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:12:53.178+0000 7f5c1e0e5880 -1 shutting down 2024-04-16T18:12:58.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:12:59.277 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:12:59.278 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.278 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.278 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.278 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.278 DEBUG:boto:Data: 2024-04-16T18:12:59.278 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.279 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.279 DEBUG:boto:Params: {} 2024-04-16T18:12:59.279 DEBUG:boto:Token: None 2024-04-16T18:12:59.279 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.279 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.282 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ed708d8f3afcde05-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.282 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:12:59.282 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:12:59.283 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.283 DEBUG:boto:Path: /cjqttm-48/a 2024-04-16T18:12:59.283 DEBUG:boto:Data: 2024-04-16T18:12:59.283 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.283 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.283 DEBUG:boto:Params: {} 2024-04-16T18:12:59.283 DEBUG:boto:Token: None 2024-04-16T18:12:59.283 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/a 2024-04-16T18:12:59.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kSvzJk5Y8ywLdsOyJ5+Qe5rI1Aw= 2024-04-16T18:12:59.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kSvzJk5Y8ywLdsOyJ5+Qe5rI1Aw='} 2024-04-16T18:12:59.291 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003dd4149465d6b324-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.291 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.291 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.292 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.292 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.292 DEBUG:boto:Data: 2024-04-16T18:12:59.292 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.292 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.292 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.292 DEBUG:boto:Params: {} 2024-04-16T18:12:59.292 DEBUG:boto:Token: None 2024-04-16T18:12:59.292 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.295 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000641fa7f6a41b5fb2-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.295 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:12:59.295 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:12:59.295 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.295 DEBUG:boto:Path: /cjqttm-48/b 2024-04-16T18:12:59.295 DEBUG:boto:Data: 2024-04-16T18:12:59.295 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.296 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.296 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.296 DEBUG:boto:Params: {} 2024-04-16T18:12:59.296 DEBUG:boto:Token: None 2024-04-16T18:12:59.296 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/b 2024-04-16T18:12:59.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tYUYFGkdFY/T8EBKCB9kk6psRKY= 2024-04-16T18:12:59.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tYUYFGkdFY/T8EBKCB9kk6psRKY='} 2024-04-16T18:12:59.339 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f7b6ee47b6d3890a-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.339 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.339 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.339 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.339 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.339 DEBUG:boto:Data: 2024-04-16T18:12:59.340 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.340 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.340 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.340 DEBUG:boto:Params: {} 2024-04-16T18:12:59.340 DEBUG:boto:Token: None 2024-04-16T18:12:59.340 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.343 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d788f168e121f0ec-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.343 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:12:59.343 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:12:59.343 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.344 DEBUG:boto:Path: /cjqttm-48/c 2024-04-16T18:12:59.344 DEBUG:boto:Data: 2024-04-16T18:12:59.344 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.344 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.344 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.344 DEBUG:boto:Params: {} 2024-04-16T18:12:59.344 DEBUG:boto:Token: None 2024-04-16T18:12:59.344 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/c 2024-04-16T18:12:59.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bmmr5yOrqKZd+P5YRR1FjG9TCZg= 2024-04-16T18:12:59.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bmmr5yOrqKZd+P5YRR1FjG9TCZg='} 2024-04-16T18:12:59.351 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009591eb6567a560cd-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.351 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.351 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.351 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.351 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.351 DEBUG:boto:Data: 2024-04-16T18:12:59.351 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.351 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.351 DEBUG:boto:Params: {} 2024-04-16T18:12:59.352 DEBUG:boto:Token: None 2024-04-16T18:12:59.352 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.354 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e03e4ffa34f3c46a-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.354 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:12:59.354 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:12:59.355 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.355 DEBUG:boto:Path: /cjqttm-48/d 2024-04-16T18:12:59.355 DEBUG:boto:Data: 2024-04-16T18:12:59.355 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.355 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.355 DEBUG:boto:Params: {} 2024-04-16T18:12:59.355 DEBUG:boto:Token: None 2024-04-16T18:12:59.355 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/d 2024-04-16T18:12:59.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sc16DgOm6EiLl0xXcMUTKRCRCFE= 2024-04-16T18:12:59.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sc16DgOm6EiLl0xXcMUTKRCRCFE='} 2024-04-16T18:12:59.399 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eb39d8631876f908-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.399 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'cjqttm-48', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:12:59.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'cjqttm-48', '--num-shards', '3', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:12:59.400 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket cjqttm-48 --num-shards 3 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:12:59.453 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:12:59.453 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:12:59.519 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:12:59.519 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-48 2024-04-16T18:12:59.524 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 4 2024-04-16T18:12:59.571 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.571 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.572 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.572 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.572 DEBUG:boto:Data: 2024-04-16T18:12:59.572 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.572 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.572 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.572 DEBUG:boto:Params: {} 2024-04-16T18:12:59.572 DEBUG:boto:Token: None 2024-04-16T18:12:59.572 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.574 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000159d980064568977-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.575 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:12:59.575 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:12:59.575 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.575 DEBUG:boto:Path: /cjqttm-48/e 2024-04-16T18:12:59.575 DEBUG:boto:Data: 2024-04-16T18:12:59.575 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.575 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.575 DEBUG:boto:Params: {} 2024-04-16T18:12:59.576 DEBUG:boto:Token: None 2024-04-16T18:12:59.576 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/e 2024-04-16T18:12:59.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MyZgCagjepulF8BEXb+ZV2M8Lmk= 2024-04-16T18:12:59.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MyZgCagjepulF8BEXb+ZV2M8Lmk='} 2024-04-16T18:12:59.581 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000028e3fdd97cce5a9c-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.581 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.581 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.581 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.581 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.582 DEBUG:boto:Data: 2024-04-16T18:12:59.582 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.582 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.582 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.582 DEBUG:boto:Params: {} 2024-04-16T18:12:59.582 DEBUG:boto:Token: None 2024-04-16T18:12:59.582 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.582 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.584 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000446c980f5938853-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.585 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:12:59.585 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:12:59.585 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.585 DEBUG:boto:Path: /cjqttm-48/f 2024-04-16T18:12:59.585 DEBUG:boto:Data: 2024-04-16T18:12:59.585 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.585 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.585 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.586 DEBUG:boto:Params: {} 2024-04-16T18:12:59.586 DEBUG:boto:Token: None 2024-04-16T18:12:59.586 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/f 2024-04-16T18:12:59.586 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tDP/WgAt8bKnLPtQkOjA/VxAcAY= 2024-04-16T18:12:59.586 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tDP/WgAt8bKnLPtQkOjA/VxAcAY='} 2024-04-16T18:12:59.591 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004c48d22dd09ba024-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.591 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.591 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.591 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.591 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.592 DEBUG:boto:Data: 2024-04-16T18:12:59.592 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.592 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.592 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.592 DEBUG:boto:Params: {} 2024-04-16T18:12:59.592 DEBUG:boto:Token: None 2024-04-16T18:12:59.592 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.594 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dde3681c0205e02e-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.594 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:12:59.594 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:12:59.595 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.595 DEBUG:boto:Path: /cjqttm-48/g 2024-04-16T18:12:59.595 DEBUG:boto:Data: 2024-04-16T18:12:59.595 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.595 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.595 DEBUG:boto:Params: {} 2024-04-16T18:12:59.595 DEBUG:boto:Token: None 2024-04-16T18:12:59.595 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/g 2024-04-16T18:12:59.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zKZ33ZqrMq2HeoLDYAghzPVtMRE= 2024-04-16T18:12:59.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zKZ33ZqrMq2HeoLDYAghzPVtMRE='} 2024-04-16T18:12:59.639 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000da2aad856724e95c-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.639 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:12:59.639 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:12:59.639 DEBUG:boto:Method: HEAD 2024-04-16T18:12:59.639 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:12:59.639 DEBUG:boto:Data: 2024-04-16T18:12:59.639 DEBUG:boto:Headers: {} 2024-04-16T18:12:59.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.640 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.640 DEBUG:boto:Params: {} 2024-04-16T18:12:59.640 DEBUG:boto:Token: None 2024-04-16T18:12:59.640 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/ 2024-04-16T18:12:59.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw= 2024-04-16T18:12:59.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3G0eJL2QlEpqg+6I9IHa+r57dkw=', 'Content-Length': '0'} 2024-04-16T18:12:59.642 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e5019b5204f5da6-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.642 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:12:59.642 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:12:59.643 DEBUG:boto:Method: PUT 2024-04-16T18:12:59.643 DEBUG:boto:Path: /cjqttm-48/h 2024-04-16T18:12:59.643 DEBUG:boto:Data: 2024-04-16T18:12:59.643 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:12:59.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:12:59.643 DEBUG:boto:Port: 8000 2024-04-16T18:12:59.643 DEBUG:boto:Params: {} 2024-04-16T18:12:59.643 DEBUG:boto:Token: None 2024-04-16T18:12:59.643 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:12:59 GMT /cjqttm-48/h 2024-04-16T18:12:59.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IW/RHx0LdQts/cCTsp2l2UJxYFw= 2024-04-16T18:12:59.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:12:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IW/RHx0LdQts/cCTsp2l2UJxYFw='} 2024-04-16T18:12:59.647 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f770f8fe5638e53-00661ebfab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:12:59.648 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:12:59.648 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:12:59.651 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:12:59.651 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:12:59.674 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:12:59.674 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:12:59.674 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:12:59.674 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:12:59.674 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:12:59.865 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:12:59.867+0000 7f87f0ab8880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:13:00.675 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:13:00.697 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:13:00.697 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:13:00.698 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:13:00.698 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:13:00.698 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-48 2024-04-16T18:13:00.699 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:13:00.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-48', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:13:00.699 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-48 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:13:00.795 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:13:00.795 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:13:00.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:00.850+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:04.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:13:05.849 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:05.851+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:10.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:10.851+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:15.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:15.852+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:20.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:20.853+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:25.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:25.854+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:30.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:30.854+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:35.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:35.856+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:40.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:40.857+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:45.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:45.858+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:50.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:50.859+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:13:55.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:13:55.859+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:00.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:00.860+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:05.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:05.860+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:10.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:10.861+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:15.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:15.862+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:20.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:20.863+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:25.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:25.865+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:30.864 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:30.866+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:35.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:35.867+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:40.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:40.867+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:45.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:45.867+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:50.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:50.869+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:14:55.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:14:55.869+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:15:00.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:00.870+0000 7eff5111f800 1 waiting to reach incremental sync.. 2024-04-16T18:15:05.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:05.872+0000 7eff5111f800 1 bucket sync caught up with source: 2024-04-16T18:15:05.872 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000003.50.6, 00000000002.35.6, 00000000002.48.6] 2024-04-16T18:15:05.872 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000003.50.6, 00000000002.35.6, 00000000002.48.6] 2024-04-16T18:15:05.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:05.872+0000 7eff5111f800 0 bucket checkpoint complete 2024-04-16T18:15:05.898 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-48 2024-04-16T18:15:05.899 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:05.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-48', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:05.900 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-48 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:15:05.963 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:05.963 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:06.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:15:06.028+0000 7f0b43a44800 1 bucket sync caught up with source: 2024-04-16T18:15:06.027 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.449.6, , , 00000000001.320.6, 00000000001.508.6, , , 00000000002.507.6, , 00000000002.467.6] 2024-04-16T18:15:06.028 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.449.6, , , 00000000001.320.6, 00000000001.508.6, , , 00000000002.507.6, , 00000000002.467.6] 2024-04-16T18:15:06.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:15:06.028+0000 7f0b43a44800 0 bucket checkpoint complete 2024-04-16T18:15:06.048 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-48 zones={test-zone2, test-zone1} 2024-04-16T18:15:06.049 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.049 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.049 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.049 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:15:06.050 DEBUG:boto:Data: 2024-04-16T18:15:06.050 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.050 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.050 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.050 DEBUG:boto:Params: {} 2024-04-16T18:15:06.051 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:15:06.051 DEBUG:boto:Token: None 2024-04-16T18:15:06.052 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QqiqavNM555bI6R0m2iYWp1lcHI= 2024-04-16T18:15:06.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QqiqavNM555bI6R0m2iYWp1lcHI=', 'Content-Length': '0'} 2024-04-16T18:15:06.060 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000252bb94d1e76a0ae-00661ec02a-5447-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.060 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.060 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.060 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.061 DEBUG:boto:Path: /cjqttm-48/ 2024-04-16T18:15:06.061 DEBUG:boto:Data: 2024-04-16T18:15:06.061 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.061 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.061 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.061 DEBUG:boto:Params: {} 2024-04-16T18:15:06.061 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:15:06.062 DEBUG:boto:Token: None 2024-04-16T18:15:06.062 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.062 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QqiqavNM555bI6R0m2iYWp1lcHI= 2024-04-16T18:15:06.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QqiqavNM555bI6R0m2iYWp1lcHI=', 'Content-Length': '0'} 2024-04-16T18:15:06.066 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008682a646bcdc7964-00661ec02a-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.067 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:15:06.067 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.067 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.067 DEBUG:boto:path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.067 DEBUG:boto:auth_path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.067 DEBUG:boto:Method: GET 2024-04-16T18:15:06.067 DEBUG:boto:Path: /cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.068 DEBUG:boto:Data: 2024-04-16T18:15:06.068 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.068 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.068 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.068 DEBUG:boto:Params: {} 2024-04-16T18:15:06.068 DEBUG:boto:Token: None 2024-04-16T18:15:06.069 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/?versions 2024-04-16T18:15:06.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI= 2024-04-16T18:15:06.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI=', 'Content-Length': '0'} 2024-04-16T18:15:06.071 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b341d3400023958f-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.072 DEBUG:boto:b'cjqttm-48999falseanulltrue2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.073 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:15:06.073 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:15:06.074 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:15:06.074 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:15:06.074 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:15:06.074 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:15:06.074 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:15:06.074 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:15:06.074 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:15:06.075 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.075 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.075 DEBUG:boto:path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.075 DEBUG:boto:auth_path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.075 DEBUG:boto:Method: GET 2024-04-16T18:15:06.075 DEBUG:boto:Path: /cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.075 DEBUG:boto:Data: 2024-04-16T18:15:06.075 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.076 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.076 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.076 DEBUG:boto:Params: {} 2024-04-16T18:15:06.076 DEBUG:boto:Token: None 2024-04-16T18:15:06.076 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/?versions 2024-04-16T18:15:06.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI= 2024-04-16T18:15:06.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI=', 'Content-Length': '0'} 2024-04-16T18:15:06.079 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001eddfa66034cf4cb-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.079 DEBUG:boto:b'cjqttm-48999falseanulltrue2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.079 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:15:06.080 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:15:06.080 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:15:06.080 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:15:06.080 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:15:06.080 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:15:06.080 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:15:06.080 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:15:06.081 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.081 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.081 DEBUG:boto:path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.081 DEBUG:boto:auth_path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.081 DEBUG:boto:Method: GET 2024-04-16T18:15:06.081 DEBUG:boto:Path: /cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.081 DEBUG:boto:Data: 2024-04-16T18:15:06.081 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.081 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.082 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.082 DEBUG:boto:Params: {} 2024-04-16T18:15:06.082 DEBUG:boto:Token: None 2024-04-16T18:15:06.082 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/?versions 2024-04-16T18:15:06.082 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI= 2024-04-16T18:15:06.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI=', 'Content-Length': '0'} 2024-04-16T18:15:06.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ff3491f3abea407-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.085 DEBUG:boto:b'cjqttm-48999falseanulltrue2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.086 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.086 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.086 DEBUG:boto:path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.086 DEBUG:boto:auth_path=/cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.086 DEBUG:boto:Method: GET 2024-04-16T18:15:06.086 DEBUG:boto:Path: /cjqttm-48/?versions&max-keys=999 2024-04-16T18:15:06.087 DEBUG:boto:Data: 2024-04-16T18:15:06.087 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.087 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.087 DEBUG:boto:Params: {} 2024-04-16T18:15:06.087 DEBUG:boto:Token: None 2024-04-16T18:15:06.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/?versions 2024-04-16T18:15:06.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI= 2024-04-16T18:15:06.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qmN2HZzSu/ryGI8OVz1Lyk2gnI=', 'Content-Length': '0'} 2024-04-16T18:15:06.090 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007598438be895eb55-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.090 DEBUG:boto:b'cjqttm-48999falseanulltrue2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.091 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:15:06.091 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.091 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.091 DEBUG:boto:path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.091 DEBUG:boto:auth_path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.092 DEBUG:boto:Method: GET 2024-04-16T18:15:06.092 DEBUG:boto:Path: /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.092 DEBUG:boto:Data: 2024-04-16T18:15:06.092 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.092 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.092 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.092 DEBUG:boto:Params: {} 2024-04-16T18:15:06.092 DEBUG:boto:Token: None 2024-04-16T18:15:06.093 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.093 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ= 2024-04-16T18:15:06.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008eaf70d50575fa78-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.096 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.096 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.096 DEBUG:boto:path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.096 DEBUG:boto:auth_path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.096 DEBUG:boto:Method: GET 2024-04-16T18:15:06.097 DEBUG:boto:Path: /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.097 DEBUG:boto:Data: 2024-04-16T18:15:06.097 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.097 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.097 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.097 DEBUG:boto:Params: {} 2024-04-16T18:15:06.097 DEBUG:boto:Token: None 2024-04-16T18:15:06.097 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.098 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ= 2024-04-16T18:15:06.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.100 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff8ea30e5caf65f6-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.100 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.100 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.100 DEBUG:boto:path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.100 DEBUG:boto:auth_path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.101 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.101 DEBUG:boto:Path: /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.101 DEBUG:boto:Data: 2024-04-16T18:15:06.101 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.101 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.101 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.101 DEBUG:boto:Params: {} 2024-04-16T18:15:06.101 DEBUG:boto:Token: None 2024-04-16T18:15:06.102 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.102 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YtM58rb0OHkd6K2VqYgy4SGBxmE= 2024-04-16T18:15:06.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YtM58rb0OHkd6K2VqYgy4SGBxmE=', 'Content-Length': '0'} 2024-04-16T18:15:06.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd96c9a016c68b9e-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.104 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.104 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.105 DEBUG:boto:path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.105 DEBUG:boto:auth_path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.105 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.105 DEBUG:boto:Path: /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.105 DEBUG:boto:Data: 2024-04-16T18:15:06.105 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.105 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.105 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.105 DEBUG:boto:Params: {} 2024-04-16T18:15:06.106 DEBUG:boto:Token: None 2024-04-16T18:15:06.106 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.106 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YtM58rb0OHkd6K2VqYgy4SGBxmE= 2024-04-16T18:15:06.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YtM58rb0OHkd6K2VqYgy4SGBxmE=', 'Content-Length': '0'} 2024-04-16T18:15:06.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bee6aa2837c2ba36-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:15:06.108 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.108 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.108 DEBUG:boto:path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.109 DEBUG:boto:auth_path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.109 DEBUG:boto:Method: GET 2024-04-16T18:15:06.109 DEBUG:boto:Path: /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.109 DEBUG:boto:Data: 2024-04-16T18:15:06.109 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.109 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.109 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.109 DEBUG:boto:Params: {} 2024-04-16T18:15:06.109 DEBUG:boto:Token: None 2024-04-16T18:15:06.110 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.110 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ= 2024-04-16T18:15:06.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000045d6ea592a0f277-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.154 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.155 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.155 DEBUG:boto:path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.155 DEBUG:boto:auth_path=/cjqttm-48/a?versionId=null 2024-04-16T18:15:06.155 DEBUG:boto:Method: GET 2024-04-16T18:15:06.155 DEBUG:boto:Path: /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.155 DEBUG:boto:Data: 2024-04-16T18:15:06.155 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.156 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.156 DEBUG:boto:Params: {} 2024-04-16T18:15:06.156 DEBUG:boto:Token: None 2024-04-16T18:15:06.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a?versionId=null 2024-04-16T18:15:06.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ= 2024-04-16T18:15:06.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A2w0ZHe8OAiSLQpnveAHRASDwmQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c7b2853813d23f8-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.159 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.159 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.159 DEBUG:boto:path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.159 DEBUG:boto:auth_path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.159 DEBUG:boto:Method: GET 2024-04-16T18:15:06.159 DEBUG:boto:Path: /cjqttm-48/?prefix=a 2024-04-16T18:15:06.160 DEBUG:boto:Data: 2024-04-16T18:15:06.160 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.160 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.160 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.160 DEBUG:boto:Params: {} 2024-04-16T18:15:06.160 DEBUG:boto:Token: None 2024-04-16T18:15:06.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.161 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.163 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8938734b8d7acc7-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.163 DEBUG:boto:b'cjqttm-48a1000falsea2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.164 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.164 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.164 DEBUG:boto:path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.164 DEBUG:boto:auth_path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.164 DEBUG:boto:Method: GET 2024-04-16T18:15:06.164 DEBUG:boto:Path: /cjqttm-48/?prefix=a 2024-04-16T18:15:06.165 DEBUG:boto:Data: 2024-04-16T18:15:06.165 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.165 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.165 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.165 DEBUG:boto:Params: {} 2024-04-16T18:15:06.165 DEBUG:boto:Token: None 2024-04-16T18:15:06.165 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.165 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.168 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060398319beb79cd0-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.168 DEBUG:boto:b'cjqttm-48a1000falsea2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.169 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.169 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.169 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.169 DEBUG:boto:Path: /cjqttm-48/a 2024-04-16T18:15:06.169 DEBUG:boto:Data: 2024-04-16T18:15:06.169 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.169 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.169 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.169 DEBUG:boto:Params: {} 2024-04-16T18:15:06.170 DEBUG:boto:Token: None 2024-04-16T18:15:06.170 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a 2024-04-16T18:15:06.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XaZuv0P+JrsRk/23tSoIj9QGnfM= 2024-04-16T18:15:06.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XaZuv0P+JrsRk/23tSoIj9QGnfM=', 'Content-Length': '0'} 2024-04-16T18:15:06.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099aaeaaa617f7df3-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.172 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.173 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.173 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.173 DEBUG:boto:Path: /cjqttm-48/a 2024-04-16T18:15:06.173 DEBUG:boto:Data: 2024-04-16T18:15:06.173 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.173 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.173 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.173 DEBUG:boto:Params: {} 2024-04-16T18:15:06.174 DEBUG:boto:Token: None 2024-04-16T18:15:06.174 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a 2024-04-16T18:15:06.174 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XaZuv0P+JrsRk/23tSoIj9QGnfM= 2024-04-16T18:15:06.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XaZuv0P+JrsRk/23tSoIj9QGnfM=', 'Content-Length': '0'} 2024-04-16T18:15:06.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c65874ed196a6f72-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.176 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:15:06.176 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.176 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.177 DEBUG:boto:Method: GET 2024-04-16T18:15:06.177 DEBUG:boto:Path: /cjqttm-48/a 2024-04-16T18:15:06.177 DEBUG:boto:Data: 2024-04-16T18:15:06.177 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.177 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.177 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.177 DEBUG:boto:Params: {} 2024-04-16T18:15:06.177 DEBUG:boto:Token: None 2024-04-16T18:15:06.178 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a 2024-04-16T18:15:06.178 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/BmYx9XmBwrtkNQUtRZleKPOT8= 2024-04-16T18:15:06.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/BmYx9XmBwrtkNQUtRZleKPOT8=', 'Content-Length': '0'} 2024-04-16T18:15:06.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dc74a8716bf41dd-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.222 DEBUG:boto:path=/cjqttm-48/a 2024-04-16T18:15:06.223 DEBUG:boto:auth_path=/cjqttm-48/a 2024-04-16T18:15:06.223 DEBUG:boto:Method: GET 2024-04-16T18:15:06.223 DEBUG:boto:Path: /cjqttm-48/a 2024-04-16T18:15:06.223 DEBUG:boto:Data: 2024-04-16T18:15:06.223 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.223 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.223 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.224 DEBUG:boto:Params: {} 2024-04-16T18:15:06.224 DEBUG:boto:Token: None 2024-04-16T18:15:06.224 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/a 2024-04-16T18:15:06.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/BmYx9XmBwrtkNQUtRZleKPOT8= 2024-04-16T18:15:06.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/BmYx9XmBwrtkNQUtRZleKPOT8=', 'Content-Length': '0'} 2024-04-16T18:15:06.226 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097b5df3febd2afa8-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.226 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.227 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.227 DEBUG:boto:path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.227 DEBUG:boto:auth_path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.227 DEBUG:boto:Method: GET 2024-04-16T18:15:06.227 DEBUG:boto:Path: /cjqttm-48/?prefix=a 2024-04-16T18:15:06.227 DEBUG:boto:Data: 2024-04-16T18:15:06.227 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.227 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.228 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.228 DEBUG:boto:Params: {} 2024-04-16T18:15:06.228 DEBUG:boto:Token: None 2024-04-16T18:15:06.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc989b265b84ff64-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.274 DEBUG:boto:b'cjqttm-48a1000falsea2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.275 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.275 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.275 DEBUG:boto:path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.275 DEBUG:boto:auth_path=/cjqttm-48/?prefix=a 2024-04-16T18:15:06.275 DEBUG:boto:Method: GET 2024-04-16T18:15:06.275 DEBUG:boto:Path: /cjqttm-48/?prefix=a 2024-04-16T18:15:06.276 DEBUG:boto:Data: 2024-04-16T18:15:06.276 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.276 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.276 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.276 DEBUG:boto:Params: {} 2024-04-16T18:15:06.276 DEBUG:boto:Token: None 2024-04-16T18:15:06.276 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.278 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000719cebaf23f86a5d-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.279 DEBUG:boto:b'cjqttm-48a1000falsea2024-04-16T18:12:59.288Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.279 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:15:06.279 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.279 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.280 DEBUG:boto:path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.280 DEBUG:boto:auth_path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.280 DEBUG:boto:Method: GET 2024-04-16T18:15:06.280 DEBUG:boto:Path: /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.280 DEBUG:boto:Data: 2024-04-16T18:15:06.280 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.280 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.280 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.280 DEBUG:boto:Params: {} 2024-04-16T18:15:06.280 DEBUG:boto:Token: None 2024-04-16T18:15:06.281 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.281 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ= 2024-04-16T18:15:06.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dac0f6b7fa1cdd7-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.326 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.327 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.327 DEBUG:boto:path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.327 DEBUG:boto:auth_path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.327 DEBUG:boto:Method: GET 2024-04-16T18:15:06.327 DEBUG:boto:Path: /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.327 DEBUG:boto:Data: 2024-04-16T18:15:06.327 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.327 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.327 DEBUG:boto:Params: {} 2024-04-16T18:15:06.328 DEBUG:boto:Token: None 2024-04-16T18:15:06.328 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ= 2024-04-16T18:15:06.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b31683c3c9f2278b-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.330 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.331 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.331 DEBUG:boto:path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.331 DEBUG:boto:auth_path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.331 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.331 DEBUG:boto:Path: /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.331 DEBUG:boto:Data: 2024-04-16T18:15:06.331 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.331 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.331 DEBUG:boto:Params: {} 2024-04-16T18:15:06.332 DEBUG:boto:Token: None 2024-04-16T18:15:06.332 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XBSl/CvEZvxdVVq69o8/RL0tNHE= 2024-04-16T18:15:06.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XBSl/CvEZvxdVVq69o8/RL0tNHE=', 'Content-Length': '0'} 2024-04-16T18:15:06.334 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078532e3dd8b6db96-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.335 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.335 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.335 DEBUG:boto:path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.335 DEBUG:boto:auth_path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.335 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.335 DEBUG:boto:Path: /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.335 DEBUG:boto:Data: 2024-04-16T18:15:06.335 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.336 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.336 DEBUG:boto:Params: {} 2024-04-16T18:15:06.336 DEBUG:boto:Token: None 2024-04-16T18:15:06.336 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XBSl/CvEZvxdVVq69o8/RL0tNHE= 2024-04-16T18:15:06.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XBSl/CvEZvxdVVq69o8/RL0tNHE=', 'Content-Length': '0'} 2024-04-16T18:15:06.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6622dce95d5452b-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.339 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:15:06.339 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.339 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.339 DEBUG:boto:path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.339 DEBUG:boto:auth_path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.339 DEBUG:boto:Method: GET 2024-04-16T18:15:06.339 DEBUG:boto:Path: /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.339 DEBUG:boto:Data: 2024-04-16T18:15:06.340 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.340 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.340 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.340 DEBUG:boto:Params: {} 2024-04-16T18:15:06.340 DEBUG:boto:Token: None 2024-04-16T18:15:06.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ= 2024-04-16T18:15:06.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2ddb531e7d25f3c-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.386 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.387 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.387 DEBUG:boto:path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.387 DEBUG:boto:auth_path=/cjqttm-48/b?versionId=null 2024-04-16T18:15:06.387 DEBUG:boto:Method: GET 2024-04-16T18:15:06.387 DEBUG:boto:Path: /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.387 DEBUG:boto:Data: 2024-04-16T18:15:06.387 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.388 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.388 DEBUG:boto:Params: {} 2024-04-16T18:15:06.388 DEBUG:boto:Token: None 2024-04-16T18:15:06.388 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b?versionId=null 2024-04-16T18:15:06.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ= 2024-04-16T18:15:06.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NRPkj2zfWxrTWGzJVX/OyqgkzcQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.390 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c32adbb158f9676-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.391 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.391 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.391 DEBUG:boto:path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.391 DEBUG:boto:auth_path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.391 DEBUG:boto:Method: GET 2024-04-16T18:15:06.391 DEBUG:boto:Path: /cjqttm-48/?prefix=b 2024-04-16T18:15:06.391 DEBUG:boto:Data: 2024-04-16T18:15:06.392 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.392 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.392 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.392 DEBUG:boto:Params: {} 2024-04-16T18:15:06.392 DEBUG:boto:Token: None 2024-04-16T18:15:06.392 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4a45784104d42c2-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.438 DEBUG:boto:b'cjqttm-48b1000falseb2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.439 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.439 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.439 DEBUG:boto:path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.439 DEBUG:boto:auth_path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.439 DEBUG:boto:Method: GET 2024-04-16T18:15:06.439 DEBUG:boto:Path: /cjqttm-48/?prefix=b 2024-04-16T18:15:06.439 DEBUG:boto:Data: 2024-04-16T18:15:06.440 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.440 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.440 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.440 DEBUG:boto:Params: {} 2024-04-16T18:15:06.440 DEBUG:boto:Token: None 2024-04-16T18:15:06.440 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000434ce5bbcdcaa653-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.443 DEBUG:boto:b'cjqttm-48b1000falseb2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.443 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.443 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.443 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.444 DEBUG:boto:Path: /cjqttm-48/b 2024-04-16T18:15:06.444 DEBUG:boto:Data: 2024-04-16T18:15:06.444 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.444 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.444 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.444 DEBUG:boto:Params: {} 2024-04-16T18:15:06.444 DEBUG:boto:Token: None 2024-04-16T18:15:06.444 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b 2024-04-16T18:15:06.445 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2R/n9bo+bnxiUJrAKM0jT4zCwFE= 2024-04-16T18:15:06.445 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2R/n9bo+bnxiUJrAKM0jT4zCwFE=', 'Content-Length': '0'} 2024-04-16T18:15:06.447 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069de08a9389eb0af-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.447 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.447 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.447 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.448 DEBUG:boto:Path: /cjqttm-48/b 2024-04-16T18:15:06.448 DEBUG:boto:Data: 2024-04-16T18:15:06.448 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.448 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.448 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.448 DEBUG:boto:Params: {} 2024-04-16T18:15:06.448 DEBUG:boto:Token: None 2024-04-16T18:15:06.448 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b 2024-04-16T18:15:06.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2R/n9bo+bnxiUJrAKM0jT4zCwFE= 2024-04-16T18:15:06.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2R/n9bo+bnxiUJrAKM0jT4zCwFE=', 'Content-Length': '0'} 2024-04-16T18:15:06.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000514d47c08c0f9922-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.451 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:15:06.451 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.451 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.451 DEBUG:boto:Method: GET 2024-04-16T18:15:06.451 DEBUG:boto:Path: /cjqttm-48/b 2024-04-16T18:15:06.451 DEBUG:boto:Data: 2024-04-16T18:15:06.452 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.452 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.452 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.452 DEBUG:boto:Params: {} 2024-04-16T18:15:06.452 DEBUG:boto:Token: None 2024-04-16T18:15:06.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b 2024-04-16T18:15:06.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RXXjyNmt4qGSG8gtYGtVfZCkPQo= 2024-04-16T18:15:06.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RXXjyNmt4qGSG8gtYGtVfZCkPQo=', 'Content-Length': '0'} 2024-04-16T18:15:06.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024045e09256271d7-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.498 DEBUG:boto:path=/cjqttm-48/b 2024-04-16T18:15:06.499 DEBUG:boto:auth_path=/cjqttm-48/b 2024-04-16T18:15:06.499 DEBUG:boto:Method: GET 2024-04-16T18:15:06.499 DEBUG:boto:Path: /cjqttm-48/b 2024-04-16T18:15:06.499 DEBUG:boto:Data: 2024-04-16T18:15:06.499 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.499 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.499 DEBUG:boto:Params: {} 2024-04-16T18:15:06.500 DEBUG:boto:Token: None 2024-04-16T18:15:06.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/b 2024-04-16T18:15:06.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RXXjyNmt4qGSG8gtYGtVfZCkPQo= 2024-04-16T18:15:06.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RXXjyNmt4qGSG8gtYGtVfZCkPQo=', 'Content-Length': '0'} 2024-04-16T18:15:06.502 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0c87e90d2bbdd80-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.502 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.503 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.503 DEBUG:boto:path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.503 DEBUG:boto:auth_path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.503 DEBUG:boto:Method: GET 2024-04-16T18:15:06.503 DEBUG:boto:Path: /cjqttm-48/?prefix=b 2024-04-16T18:15:06.503 DEBUG:boto:Data: 2024-04-16T18:15:06.503 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.503 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.503 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.504 DEBUG:boto:Params: {} 2024-04-16T18:15:06.504 DEBUG:boto:Token: None 2024-04-16T18:15:06.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.506 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000280a0a70b64297d-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.550 DEBUG:boto:b'cjqttm-48b1000falseb2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.551 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.551 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.551 DEBUG:boto:path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.551 DEBUG:boto:auth_path=/cjqttm-48/?prefix=b 2024-04-16T18:15:06.551 DEBUG:boto:Method: GET 2024-04-16T18:15:06.551 DEBUG:boto:Path: /cjqttm-48/?prefix=b 2024-04-16T18:15:06.552 DEBUG:boto:Data: 2024-04-16T18:15:06.552 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.552 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.552 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.552 DEBUG:boto:Params: {} 2024-04-16T18:15:06.552 DEBUG:boto:Token: None 2024-04-16T18:15:06.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de9c207e3dc594e5-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.555 DEBUG:boto:b'cjqttm-48b1000falseb2024-04-16T18:12:59.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.555 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:15:06.556 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.556 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.556 DEBUG:boto:path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.556 DEBUG:boto:auth_path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.556 DEBUG:boto:Method: GET 2024-04-16T18:15:06.556 DEBUG:boto:Path: /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.556 DEBUG:boto:Data: 2024-04-16T18:15:06.556 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.557 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.557 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.557 DEBUG:boto:Params: {} 2024-04-16T18:15:06.557 DEBUG:boto:Token: None 2024-04-16T18:15:06.557 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.557 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI= 2024-04-16T18:15:06.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI=', 'Content-Length': '0'} 2024-04-16T18:15:06.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003852736178e0fbc0-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.603 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.604 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.604 DEBUG:boto:path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.604 DEBUG:boto:auth_path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.604 DEBUG:boto:Method: GET 2024-04-16T18:15:06.604 DEBUG:boto:Path: /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.604 DEBUG:boto:Data: 2024-04-16T18:15:06.604 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.604 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.604 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.605 DEBUG:boto:Params: {} 2024-04-16T18:15:06.605 DEBUG:boto:Token: None 2024-04-16T18:15:06.605 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.605 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI= 2024-04-16T18:15:06.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI=', 'Content-Length': '0'} 2024-04-16T18:15:06.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec4db58f12626cdb-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.608 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.608 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.608 DEBUG:boto:path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.608 DEBUG:boto:auth_path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.608 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.609 DEBUG:boto:Path: /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.609 DEBUG:boto:Data: 2024-04-16T18:15:06.609 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.609 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.609 DEBUG:boto:Params: {} 2024-04-16T18:15:06.609 DEBUG:boto:Token: None 2024-04-16T18:15:06.609 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V9zW9hREqTixzW71Ophoj07E+hA= 2024-04-16T18:15:06.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V9zW9hREqTixzW71Ophoj07E+hA=', 'Content-Length': '0'} 2024-04-16T18:15:06.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024000be86e1bd148-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.612 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.612 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.612 DEBUG:boto:path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.612 DEBUG:boto:auth_path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.612 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.613 DEBUG:boto:Path: /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.613 DEBUG:boto:Data: 2024-04-16T18:15:06.613 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.613 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.613 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.613 DEBUG:boto:Params: {} 2024-04-16T18:15:06.613 DEBUG:boto:Token: None 2024-04-16T18:15:06.613 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.613 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V9zW9hREqTixzW71Ophoj07E+hA= 2024-04-16T18:15:06.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V9zW9hREqTixzW71Ophoj07E+hA=', 'Content-Length': '0'} 2024-04-16T18:15:06.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e584fe4fe697ef0a-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.616 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:15:06.616 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.616 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.616 DEBUG:boto:path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.616 DEBUG:boto:auth_path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.616 DEBUG:boto:Method: GET 2024-04-16T18:15:06.616 DEBUG:boto:Path: /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.616 DEBUG:boto:Data: 2024-04-16T18:15:06.617 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.617 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.617 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.617 DEBUG:boto:Params: {} 2024-04-16T18:15:06.617 DEBUG:boto:Token: None 2024-04-16T18:15:06.617 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.617 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI= 2024-04-16T18:15:06.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI=', 'Content-Length': '0'} 2024-04-16T18:15:06.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b83bfee1f4e4d61-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.662 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.663 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.663 DEBUG:boto:path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.663 DEBUG:boto:auth_path=/cjqttm-48/c?versionId=null 2024-04-16T18:15:06.663 DEBUG:boto:Method: GET 2024-04-16T18:15:06.663 DEBUG:boto:Path: /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.663 DEBUG:boto:Data: 2024-04-16T18:15:06.663 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.663 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.664 DEBUG:boto:Params: {} 2024-04-16T18:15:06.664 DEBUG:boto:Token: None 2024-04-16T18:15:06.664 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c?versionId=null 2024-04-16T18:15:06.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI= 2024-04-16T18:15:06.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D16DhV+vZr2KQcbk/g98Py+s/GI=', 'Content-Length': '0'} 2024-04-16T18:15:06.666 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae7bfe98e322a364-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.666 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.667 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.667 DEBUG:boto:path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.667 DEBUG:boto:auth_path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.667 DEBUG:boto:Method: GET 2024-04-16T18:15:06.667 DEBUG:boto:Path: /cjqttm-48/?prefix=c 2024-04-16T18:15:06.667 DEBUG:boto:Data: 2024-04-16T18:15:06.667 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.667 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.668 DEBUG:boto:Params: {} 2024-04-16T18:15:06.668 DEBUG:boto:Token: None 2024-04-16T18:15:06.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.670 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000723aeaa02b196fa9-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.714 DEBUG:boto:b'cjqttm-48c1000falsec2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.715 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.715 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.715 DEBUG:boto:path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.715 DEBUG:boto:auth_path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.715 DEBUG:boto:Method: GET 2024-04-16T18:15:06.715 DEBUG:boto:Path: /cjqttm-48/?prefix=c 2024-04-16T18:15:06.716 DEBUG:boto:Data: 2024-04-16T18:15:06.716 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.716 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.716 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.716 DEBUG:boto:Params: {} 2024-04-16T18:15:06.716 DEBUG:boto:Token: None 2024-04-16T18:15:06.716 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9df0ac2fcfe44ec-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.719 DEBUG:boto:b'cjqttm-48c1000falsec2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.719 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.719 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.719 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.719 DEBUG:boto:Path: /cjqttm-48/c 2024-04-16T18:15:06.720 DEBUG:boto:Data: 2024-04-16T18:15:06.720 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.720 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.720 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.720 DEBUG:boto:Params: {} 2024-04-16T18:15:06.720 DEBUG:boto:Token: None 2024-04-16T18:15:06.720 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c 2024-04-16T18:15:06.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TkknVxWb4pHaV9efXhMBDGwcXyQ= 2024-04-16T18:15:06.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TkknVxWb4pHaV9efXhMBDGwcXyQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fd682f2f9059c24-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.723 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.723 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.723 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.723 DEBUG:boto:Path: /cjqttm-48/c 2024-04-16T18:15:06.723 DEBUG:boto:Data: 2024-04-16T18:15:06.723 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.724 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.724 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.724 DEBUG:boto:Params: {} 2024-04-16T18:15:06.724 DEBUG:boto:Token: None 2024-04-16T18:15:06.724 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c 2024-04-16T18:15:06.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TkknVxWb4pHaV9efXhMBDGwcXyQ= 2024-04-16T18:15:06.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TkknVxWb4pHaV9efXhMBDGwcXyQ=', 'Content-Length': '0'} 2024-04-16T18:15:06.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009372a2b2c8670387-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.726 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:15:06.726 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.726 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.727 DEBUG:boto:Method: GET 2024-04-16T18:15:06.727 DEBUG:boto:Path: /cjqttm-48/c 2024-04-16T18:15:06.727 DEBUG:boto:Data: 2024-04-16T18:15:06.727 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.727 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.727 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.727 DEBUG:boto:Params: {} 2024-04-16T18:15:06.727 DEBUG:boto:Token: None 2024-04-16T18:15:06.728 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c 2024-04-16T18:15:06.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mM6QBqGDfTyCqjkdYF+3EF/YLG4= 2024-04-16T18:15:06.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mM6QBqGDfTyCqjkdYF+3EF/YLG4=', 'Content-Length': '0'} 2024-04-16T18:15:06.730 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005af3e9ef1b38919f-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.770 DEBUG:boto:path=/cjqttm-48/c 2024-04-16T18:15:06.771 DEBUG:boto:auth_path=/cjqttm-48/c 2024-04-16T18:15:06.771 DEBUG:boto:Method: GET 2024-04-16T18:15:06.771 DEBUG:boto:Path: /cjqttm-48/c 2024-04-16T18:15:06.771 DEBUG:boto:Data: 2024-04-16T18:15:06.771 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.771 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.771 DEBUG:boto:Params: {} 2024-04-16T18:15:06.771 DEBUG:boto:Token: None 2024-04-16T18:15:06.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/c 2024-04-16T18:15:06.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mM6QBqGDfTyCqjkdYF+3EF/YLG4= 2024-04-16T18:15:06.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mM6QBqGDfTyCqjkdYF+3EF/YLG4=', 'Content-Length': '0'} 2024-04-16T18:15:06.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f6c08e83dcaa31f-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.774 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.775 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.775 DEBUG:boto:path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.775 DEBUG:boto:auth_path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.775 DEBUG:boto:Method: GET 2024-04-16T18:15:06.775 DEBUG:boto:Path: /cjqttm-48/?prefix=c 2024-04-16T18:15:06.775 DEBUG:boto:Data: 2024-04-16T18:15:06.775 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.775 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.775 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.776 DEBUG:boto:Params: {} 2024-04-16T18:15:06.776 DEBUG:boto:Token: None 2024-04-16T18:15:06.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.778 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce96a7b8cf638adf-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.822 DEBUG:boto:b'cjqttm-48c1000falsec2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.823 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.823 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.823 DEBUG:boto:path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.823 DEBUG:boto:auth_path=/cjqttm-48/?prefix=c 2024-04-16T18:15:06.823 DEBUG:boto:Method: GET 2024-04-16T18:15:06.824 DEBUG:boto:Path: /cjqttm-48/?prefix=c 2024-04-16T18:15:06.824 DEBUG:boto:Data: 2024-04-16T18:15:06.824 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.824 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.824 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.824 DEBUG:boto:Params: {} 2024-04-16T18:15:06.824 DEBUG:boto:Token: None 2024-04-16T18:15:06.824 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.825 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.827 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dab1eea3c4905838-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.827 DEBUG:boto:b'cjqttm-48c1000falsec2024-04-16T18:12:59.348Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.828 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:15:06.828 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.828 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.828 DEBUG:boto:path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.828 DEBUG:boto:auth_path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.828 DEBUG:boto:Method: GET 2024-04-16T18:15:06.829 DEBUG:boto:Path: /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.829 DEBUG:boto:Data: 2024-04-16T18:15:06.829 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.829 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.829 DEBUG:boto:Params: {} 2024-04-16T18:15:06.829 DEBUG:boto:Token: None 2024-04-16T18:15:06.829 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8= 2024-04-16T18:15:06.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8=', 'Content-Length': '0'} 2024-04-16T18:15:06.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb91765da7a11ec2-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.874 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.875 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.875 DEBUG:boto:path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.875 DEBUG:boto:auth_path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.875 DEBUG:boto:Method: GET 2024-04-16T18:15:06.875 DEBUG:boto:Path: /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.875 DEBUG:boto:Data: 2024-04-16T18:15:06.875 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.876 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.876 DEBUG:boto:Params: {} 2024-04-16T18:15:06.876 DEBUG:boto:Token: None 2024-04-16T18:15:06.876 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8= 2024-04-16T18:15:06.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8=', 'Content-Length': '0'} 2024-04-16T18:15:06.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da38f57a3a18153d-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.879 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.879 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.879 DEBUG:boto:path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.879 DEBUG:boto:auth_path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.879 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.879 DEBUG:boto:Path: /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.879 DEBUG:boto:Data: 2024-04-16T18:15:06.879 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.880 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.880 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.880 DEBUG:boto:Params: {} 2024-04-16T18:15:06.880 DEBUG:boto:Token: None 2024-04-16T18:15:06.880 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gQe7R3rnQEcG0KpX4jddsUJibFM= 2024-04-16T18:15:06.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gQe7R3rnQEcG0KpX4jddsUJibFM=', 'Content-Length': '0'} 2024-04-16T18:15:06.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9632620932f165d-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.883 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.883 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.883 DEBUG:boto:path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.883 DEBUG:boto:auth_path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.883 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.883 DEBUG:boto:Path: /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.883 DEBUG:boto:Data: 2024-04-16T18:15:06.883 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.884 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.884 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.884 DEBUG:boto:Params: {} 2024-04-16T18:15:06.884 DEBUG:boto:Token: None 2024-04-16T18:15:06.884 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gQe7R3rnQEcG0KpX4jddsUJibFM= 2024-04-16T18:15:06.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gQe7R3rnQEcG0KpX4jddsUJibFM=', 'Content-Length': '0'} 2024-04-16T18:15:06.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005ba63b788e80111-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:15:06.887 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.887 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.887 DEBUG:boto:path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.887 DEBUG:boto:auth_path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.887 DEBUG:boto:Method: GET 2024-04-16T18:15:06.887 DEBUG:boto:Path: /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.887 DEBUG:boto:Data: 2024-04-16T18:15:06.887 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.888 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.888 DEBUG:boto:Params: {} 2024-04-16T18:15:06.888 DEBUG:boto:Token: None 2024-04-16T18:15:06.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8= 2024-04-16T18:15:06.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8=', 'Content-Length': '0'} 2024-04-16T18:15:06.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000045a75940c50fee5-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.934 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.934 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.935 DEBUG:boto:path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.935 DEBUG:boto:auth_path=/cjqttm-48/d?versionId=null 2024-04-16T18:15:06.935 DEBUG:boto:Method: GET 2024-04-16T18:15:06.935 DEBUG:boto:Path: /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.935 DEBUG:boto:Data: 2024-04-16T18:15:06.935 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.935 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.935 DEBUG:boto:Params: {} 2024-04-16T18:15:06.935 DEBUG:boto:Token: None 2024-04-16T18:15:06.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d?versionId=null 2024-04-16T18:15:06.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8= 2024-04-16T18:15:06.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SPWJ/e7Zde82h7t8qNO1mZymoT8=', 'Content-Length': '0'} 2024-04-16T18:15:06.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066e662e6a3363beb-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.938 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.939 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.939 DEBUG:boto:path=/cjqttm-48/?prefix=d 2024-04-16T18:15:06.939 DEBUG:boto:auth_path=/cjqttm-48/?prefix=d 2024-04-16T18:15:06.939 DEBUG:boto:Method: GET 2024-04-16T18:15:06.939 DEBUG:boto:Path: /cjqttm-48/?prefix=d 2024-04-16T18:15:06.939 DEBUG:boto:Data: 2024-04-16T18:15:06.939 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.939 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.939 DEBUG:boto:Params: {} 2024-04-16T18:15:06.939 DEBUG:boto:Token: None 2024-04-16T18:15:06.940 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.942 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e727c1ce29c1edb-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.943 DEBUG:boto:b'cjqttm-48d1000falsed2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.943 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:06.943 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:06.943 DEBUG:boto:path=/cjqttm-48/?prefix=d 2024-04-16T18:15:06.943 DEBUG:boto:auth_path=/cjqttm-48/?prefix=d 2024-04-16T18:15:06.943 DEBUG:boto:Method: GET 2024-04-16T18:15:06.943 DEBUG:boto:Path: /cjqttm-48/?prefix=d 2024-04-16T18:15:06.943 DEBUG:boto:Data: 2024-04-16T18:15:06.943 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.944 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.944 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.944 DEBUG:boto:Params: {} 2024-04-16T18:15:06.944 DEBUG:boto:Token: None 2024-04-16T18:15:06.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/ 2024-04-16T18:15:06.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o= 2024-04-16T18:15:06.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Udt6yfeFOaL8tTbTtpryhvnV+o=', 'Content-Length': '0'} 2024-04-16T18:15:06.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0f8a7fc45da3bbd-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.947 DEBUG:boto:b'cjqttm-48d1000falsed2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:06.947 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.947 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.947 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.947 DEBUG:boto:Path: /cjqttm-48/d 2024-04-16T18:15:06.947 DEBUG:boto:Data: 2024-04-16T18:15:06.948 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.948 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.948 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.948 DEBUG:boto:Params: {} 2024-04-16T18:15:06.948 DEBUG:boto:Token: None 2024-04-16T18:15:06.948 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d 2024-04-16T18:15:06.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pjrD5BHJ32iG420PU+SyDrttljo= 2024-04-16T18:15:06.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pjrD5BHJ32iG420PU+SyDrttljo=', 'Content-Length': '0'} 2024-04-16T18:15:06.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087aa89c17bcc2d22-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.950 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.951 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.951 DEBUG:boto:Method: HEAD 2024-04-16T18:15:06.951 DEBUG:boto:Path: /cjqttm-48/d 2024-04-16T18:15:06.951 DEBUG:boto:Data: 2024-04-16T18:15:06.951 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.951 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.951 DEBUG:boto:Params: {} 2024-04-16T18:15:06.951 DEBUG:boto:Token: None 2024-04-16T18:15:06.951 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d 2024-04-16T18:15:06.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pjrD5BHJ32iG420PU+SyDrttljo= 2024-04-16T18:15:06.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pjrD5BHJ32iG420PU+SyDrttljo=', 'Content-Length': '0'} 2024-04-16T18:15:06.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc4209dc36268420-00661ec02a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.954 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:15:06.954 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.954 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.955 DEBUG:boto:Method: GET 2024-04-16T18:15:06.955 DEBUG:boto:Path: /cjqttm-48/d 2024-04-16T18:15:06.955 DEBUG:boto:Data: 2024-04-16T18:15:06.955 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.955 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:06.955 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.955 DEBUG:boto:Params: {} 2024-04-16T18:15:06.955 DEBUG:boto:Token: None 2024-04-16T18:15:06.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d 2024-04-16T18:15:06.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rUVYdl0u6t1pNxKtJ0RODprj1ak= 2024-04-16T18:15:06.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rUVYdl0u6t1pNxKtJ0RODprj1ak=', 'Content-Length': '0'} 2024-04-16T18:15:06.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab1a997392393295-00661ec02a-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:06.998 DEBUG:boto:path=/cjqttm-48/d 2024-04-16T18:15:06.998 DEBUG:boto:auth_path=/cjqttm-48/d 2024-04-16T18:15:06.999 DEBUG:boto:Method: GET 2024-04-16T18:15:06.999 DEBUG:boto:Path: /cjqttm-48/d 2024-04-16T18:15:06.999 DEBUG:boto:Data: 2024-04-16T18:15:06.999 DEBUG:boto:Headers: {} 2024-04-16T18:15:06.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:06.999 DEBUG:boto:Port: 8000 2024-04-16T18:15:06.999 DEBUG:boto:Params: {} 2024-04-16T18:15:06.999 DEBUG:boto:Token: None 2024-04-16T18:15:06.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:06 GMT /cjqttm-48/d 2024-04-16T18:15:06.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rUVYdl0u6t1pNxKtJ0RODprj1ak= 2024-04-16T18:15:07.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rUVYdl0u6t1pNxKtJ0RODprj1ak=', 'Content-Length': '0'} 2024-04-16T18:15:07.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000834c4a69fe2412dc-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.002 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.002 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.002 DEBUG:boto:path=/cjqttm-48/?prefix=d 2024-04-16T18:15:07.002 DEBUG:boto:auth_path=/cjqttm-48/?prefix=d 2024-04-16T18:15:07.002 DEBUG:boto:Method: GET 2024-04-16T18:15:07.002 DEBUG:boto:Path: /cjqttm-48/?prefix=d 2024-04-16T18:15:07.002 DEBUG:boto:Data: 2024-04-16T18:15:07.003 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.003 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.003 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.003 DEBUG:boto:Params: {} 2024-04-16T18:15:07.003 DEBUG:boto:Token: None 2024-04-16T18:15:07.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033f25c7889611ce9-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.046 DEBUG:boto:b'cjqttm-48d1000falsed2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.047 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.047 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.047 DEBUG:boto:path=/cjqttm-48/?prefix=d 2024-04-16T18:15:07.047 DEBUG:boto:auth_path=/cjqttm-48/?prefix=d 2024-04-16T18:15:07.047 DEBUG:boto:Method: GET 2024-04-16T18:15:07.047 DEBUG:boto:Path: /cjqttm-48/?prefix=d 2024-04-16T18:15:07.047 DEBUG:boto:Data: 2024-04-16T18:15:07.047 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.047 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.047 DEBUG:boto:Params: {} 2024-04-16T18:15:07.048 DEBUG:boto:Token: None 2024-04-16T18:15:07.048 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0f0cdd99ef5342d-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.050 DEBUG:boto:b'cjqttm-48d1000falsed2024-04-16T18:12:59.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:15:07.051 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.051 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.051 DEBUG:boto:path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.051 DEBUG:boto:auth_path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.051 DEBUG:boto:Method: GET 2024-04-16T18:15:07.051 DEBUG:boto:Path: /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.051 DEBUG:boto:Data: 2024-04-16T18:15:07.051 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.051 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.052 DEBUG:boto:Params: {} 2024-04-16T18:15:07.052 DEBUG:boto:Token: None 2024-04-16T18:15:07.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A= 2024-04-16T18:15:07.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A=', 'Content-Length': '0'} 2024-04-16T18:15:07.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000368daac84358b2b6-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.094 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.095 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.095 DEBUG:boto:path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.095 DEBUG:boto:auth_path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.095 DEBUG:boto:Method: GET 2024-04-16T18:15:07.095 DEBUG:boto:Path: /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.095 DEBUG:boto:Data: 2024-04-16T18:15:07.095 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.095 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.095 DEBUG:boto:Params: {} 2024-04-16T18:15:07.095 DEBUG:boto:Token: None 2024-04-16T18:15:07.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A= 2024-04-16T18:15:07.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A=', 'Content-Length': '0'} 2024-04-16T18:15:07.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e157cdff11cec1fd-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.098 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.098 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.098 DEBUG:boto:path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.098 DEBUG:boto:auth_path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.098 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.098 DEBUG:boto:Path: /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.098 DEBUG:boto:Data: 2024-04-16T18:15:07.098 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.099 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.099 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.099 DEBUG:boto:Params: {} 2024-04-16T18:15:07.099 DEBUG:boto:Token: None 2024-04-16T18:15:07.099 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JU/n+hwi6RCHlBiBtmqG4ck2D3w= 2024-04-16T18:15:07.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JU/n+hwi6RCHlBiBtmqG4ck2D3w=', 'Content-Length': '0'} 2024-04-16T18:15:07.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b704a31846e7d41-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.101 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.101 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.101 DEBUG:boto:path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.101 DEBUG:boto:auth_path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.102 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.102 DEBUG:boto:Path: /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.102 DEBUG:boto:Data: 2024-04-16T18:15:07.102 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.102 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.102 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.102 DEBUG:boto:Params: {} 2024-04-16T18:15:07.102 DEBUG:boto:Token: None 2024-04-16T18:15:07.102 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JU/n+hwi6RCHlBiBtmqG4ck2D3w= 2024-04-16T18:15:07.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JU/n+hwi6RCHlBiBtmqG4ck2D3w=', 'Content-Length': '0'} 2024-04-16T18:15:07.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b800305748cd89b8-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.105 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:15:07.105 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.105 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.105 DEBUG:boto:path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.105 DEBUG:boto:auth_path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.105 DEBUG:boto:Method: GET 2024-04-16T18:15:07.105 DEBUG:boto:Path: /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.105 DEBUG:boto:Data: 2024-04-16T18:15:07.105 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.105 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.105 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.105 DEBUG:boto:Params: {} 2024-04-16T18:15:07.106 DEBUG:boto:Token: None 2024-04-16T18:15:07.106 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.106 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A= 2024-04-16T18:15:07.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A=', 'Content-Length': '0'} 2024-04-16T18:15:07.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d2915eb5417fa971-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.150 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.150 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.151 DEBUG:boto:path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.151 DEBUG:boto:auth_path=/cjqttm-48/e?versionId=null 2024-04-16T18:15:07.151 DEBUG:boto:Method: GET 2024-04-16T18:15:07.151 DEBUG:boto:Path: /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.151 DEBUG:boto:Data: 2024-04-16T18:15:07.151 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.151 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.151 DEBUG:boto:Params: {} 2024-04-16T18:15:07.151 DEBUG:boto:Token: None 2024-04-16T18:15:07.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e?versionId=null 2024-04-16T18:15:07.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A= 2024-04-16T18:15:07.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e1PZjGUkvuo2XgH40V3sHXQMd1A=', 'Content-Length': '0'} 2024-04-16T18:15:07.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd6fbffcf18ec5a2-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.153 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.154 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.154 DEBUG:boto:path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.154 DEBUG:boto:auth_path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.154 DEBUG:boto:Method: GET 2024-04-16T18:15:07.154 DEBUG:boto:Path: /cjqttm-48/?prefix=e 2024-04-16T18:15:07.154 DEBUG:boto:Data: 2024-04-16T18:15:07.154 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.154 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.154 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.154 DEBUG:boto:Params: {} 2024-04-16T18:15:07.154 DEBUG:boto:Token: None 2024-04-16T18:15:07.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.157 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b9d3a0ad0267418-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.198 DEBUG:boto:b'cjqttm-48e1000falsee2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.199 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.199 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.199 DEBUG:boto:path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.199 DEBUG:boto:auth_path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.199 DEBUG:boto:Method: GET 2024-04-16T18:15:07.199 DEBUG:boto:Path: /cjqttm-48/?prefix=e 2024-04-16T18:15:07.199 DEBUG:boto:Data: 2024-04-16T18:15:07.199 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.199 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.199 DEBUG:boto:Params: {} 2024-04-16T18:15:07.200 DEBUG:boto:Token: None 2024-04-16T18:15:07.200 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb4c727842af8da4-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.202 DEBUG:boto:b'cjqttm-48e1000falsee2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.202 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.203 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.203 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.203 DEBUG:boto:Path: /cjqttm-48/e 2024-04-16T18:15:07.203 DEBUG:boto:Data: 2024-04-16T18:15:07.203 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.203 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.203 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.203 DEBUG:boto:Params: {} 2024-04-16T18:15:07.203 DEBUG:boto:Token: None 2024-04-16T18:15:07.203 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e 2024-04-16T18:15:07.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QdwZWcWSodkO3TGiCLxd6DuclSU= 2024-04-16T18:15:07.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QdwZWcWSodkO3TGiCLxd6DuclSU=', 'Content-Length': '0'} 2024-04-16T18:15:07.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033654d6731e4ccc9-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.206 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.206 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.206 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.206 DEBUG:boto:Path: /cjqttm-48/e 2024-04-16T18:15:07.206 DEBUG:boto:Data: 2024-04-16T18:15:07.206 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.206 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.206 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.206 DEBUG:boto:Params: {} 2024-04-16T18:15:07.207 DEBUG:boto:Token: None 2024-04-16T18:15:07.207 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e 2024-04-16T18:15:07.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QdwZWcWSodkO3TGiCLxd6DuclSU= 2024-04-16T18:15:07.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QdwZWcWSodkO3TGiCLxd6DuclSU=', 'Content-Length': '0'} 2024-04-16T18:15:07.208 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004059ea119cc5e629-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.209 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:15:07.209 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.209 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.209 DEBUG:boto:Method: GET 2024-04-16T18:15:07.209 DEBUG:boto:Path: /cjqttm-48/e 2024-04-16T18:15:07.209 DEBUG:boto:Data: 2024-04-16T18:15:07.209 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.209 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.209 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.210 DEBUG:boto:Params: {} 2024-04-16T18:15:07.210 DEBUG:boto:Token: None 2024-04-16T18:15:07.210 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e 2024-04-16T18:15:07.210 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:agvM49IrWl6g3rJkA/vNOUKEdNk= 2024-04-16T18:15:07.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:agvM49IrWl6g3rJkA/vNOUKEdNk=', 'Content-Length': '0'} 2024-04-16T18:15:07.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a6fa1aae400f1d9-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.254 DEBUG:boto:path=/cjqttm-48/e 2024-04-16T18:15:07.255 DEBUG:boto:auth_path=/cjqttm-48/e 2024-04-16T18:15:07.255 DEBUG:boto:Method: GET 2024-04-16T18:15:07.255 DEBUG:boto:Path: /cjqttm-48/e 2024-04-16T18:15:07.255 DEBUG:boto:Data: 2024-04-16T18:15:07.255 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.255 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.255 DEBUG:boto:Params: {} 2024-04-16T18:15:07.255 DEBUG:boto:Token: None 2024-04-16T18:15:07.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/e 2024-04-16T18:15:07.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:agvM49IrWl6g3rJkA/vNOUKEdNk= 2024-04-16T18:15:07.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:agvM49IrWl6g3rJkA/vNOUKEdNk=', 'Content-Length': '0'} 2024-04-16T18:15:07.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003df6266eded2abf-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.258 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.258 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.258 DEBUG:boto:path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.258 DEBUG:boto:auth_path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.258 DEBUG:boto:Method: GET 2024-04-16T18:15:07.258 DEBUG:boto:Path: /cjqttm-48/?prefix=e 2024-04-16T18:15:07.258 DEBUG:boto:Data: 2024-04-16T18:15:07.258 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.259 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.259 DEBUG:boto:Params: {} 2024-04-16T18:15:07.259 DEBUG:boto:Token: None 2024-04-16T18:15:07.259 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ad6cc102c84d20b-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.262 DEBUG:boto:b'cjqttm-48e1000falsee2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.262 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.262 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.262 DEBUG:boto:path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.262 DEBUG:boto:auth_path=/cjqttm-48/?prefix=e 2024-04-16T18:15:07.263 DEBUG:boto:Method: GET 2024-04-16T18:15:07.263 DEBUG:boto:Path: /cjqttm-48/?prefix=e 2024-04-16T18:15:07.263 DEBUG:boto:Data: 2024-04-16T18:15:07.263 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.263 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.263 DEBUG:boto:Params: {} 2024-04-16T18:15:07.263 DEBUG:boto:Token: None 2024-04-16T18:15:07.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e994465d64e1f141-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.265 DEBUG:boto:b'cjqttm-48e1000falsee2024-04-16T18:12:59.580Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.266 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:15:07.266 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.266 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.266 DEBUG:boto:path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.266 DEBUG:boto:auth_path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.266 DEBUG:boto:Method: GET 2024-04-16T18:15:07.266 DEBUG:boto:Path: /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.266 DEBUG:boto:Data: 2024-04-16T18:15:07.266 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.266 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.266 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.267 DEBUG:boto:Params: {} 2024-04-16T18:15:07.267 DEBUG:boto:Token: None 2024-04-16T18:15:07.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ= 2024-04-16T18:15:07.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ=', 'Content-Length': '0'} 2024-04-16T18:15:07.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075340f2584ce51cd-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.310 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.310 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.311 DEBUG:boto:path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.311 DEBUG:boto:auth_path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.311 DEBUG:boto:Method: GET 2024-04-16T18:15:07.311 DEBUG:boto:Path: /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.311 DEBUG:boto:Data: 2024-04-16T18:15:07.311 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.311 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.311 DEBUG:boto:Params: {} 2024-04-16T18:15:07.311 DEBUG:boto:Token: None 2024-04-16T18:15:07.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ= 2024-04-16T18:15:07.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ=', 'Content-Length': '0'} 2024-04-16T18:15:07.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043e4b64e2967e8c8-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.314 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.314 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.314 DEBUG:boto:path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.314 DEBUG:boto:auth_path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.314 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.314 DEBUG:boto:Path: /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.314 DEBUG:boto:Data: 2024-04-16T18:15:07.315 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.315 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.315 DEBUG:boto:Params: {} 2024-04-16T18:15:07.315 DEBUG:boto:Token: None 2024-04-16T18:15:07.315 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bH3YzAlfgWAsbWCaLs3ECkQBEfw= 2024-04-16T18:15:07.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bH3YzAlfgWAsbWCaLs3ECkQBEfw=', 'Content-Length': '0'} 2024-04-16T18:15:07.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037d65662522a1c8b-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.318 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.318 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.318 DEBUG:boto:path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.318 DEBUG:boto:auth_path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.318 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.318 DEBUG:boto:Path: /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.318 DEBUG:boto:Data: 2024-04-16T18:15:07.318 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.318 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.319 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.319 DEBUG:boto:Params: {} 2024-04-16T18:15:07.319 DEBUG:boto:Token: None 2024-04-16T18:15:07.319 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bH3YzAlfgWAsbWCaLs3ECkQBEfw= 2024-04-16T18:15:07.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bH3YzAlfgWAsbWCaLs3ECkQBEfw=', 'Content-Length': '0'} 2024-04-16T18:15:07.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096f964cec2af773d-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.322 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:15:07.322 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.322 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.322 DEBUG:boto:path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.322 DEBUG:boto:auth_path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.322 DEBUG:boto:Method: GET 2024-04-16T18:15:07.322 DEBUG:boto:Path: /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.322 DEBUG:boto:Data: 2024-04-16T18:15:07.322 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.322 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.322 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.323 DEBUG:boto:Params: {} 2024-04-16T18:15:07.323 DEBUG:boto:Token: None 2024-04-16T18:15:07.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ= 2024-04-16T18:15:07.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ=', 'Content-Length': '0'} 2024-04-16T18:15:07.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ba763dae67db562-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.366 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.366 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.367 DEBUG:boto:path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.367 DEBUG:boto:auth_path=/cjqttm-48/f?versionId=null 2024-04-16T18:15:07.367 DEBUG:boto:Method: GET 2024-04-16T18:15:07.367 DEBUG:boto:Path: /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.367 DEBUG:boto:Data: 2024-04-16T18:15:07.367 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.367 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.367 DEBUG:boto:Params: {} 2024-04-16T18:15:07.367 DEBUG:boto:Token: None 2024-04-16T18:15:07.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f?versionId=null 2024-04-16T18:15:07.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ= 2024-04-16T18:15:07.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxjFNvrAubZSsH8BYxak4ddZmnQ=', 'Content-Length': '0'} 2024-04-16T18:15:07.370 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d6150b96a70f3f7-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.370 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.370 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.370 DEBUG:boto:path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.371 DEBUG:boto:auth_path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.371 DEBUG:boto:Method: GET 2024-04-16T18:15:07.371 DEBUG:boto:Path: /cjqttm-48/?prefix=f 2024-04-16T18:15:07.371 DEBUG:boto:Data: 2024-04-16T18:15:07.371 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.371 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.371 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.371 DEBUG:boto:Params: {} 2024-04-16T18:15:07.371 DEBUG:boto:Token: None 2024-04-16T18:15:07.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.374 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c2b0cd42c04dea8-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.374 DEBUG:boto:b'cjqttm-48f1000falsef2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.374 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.374 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.374 DEBUG:boto:path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.374 DEBUG:boto:auth_path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.375 DEBUG:boto:Method: GET 2024-04-16T18:15:07.375 DEBUG:boto:Path: /cjqttm-48/?prefix=f 2024-04-16T18:15:07.375 DEBUG:boto:Data: 2024-04-16T18:15:07.375 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.375 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.375 DEBUG:boto:Params: {} 2024-04-16T18:15:07.375 DEBUG:boto:Token: None 2024-04-16T18:15:07.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000231ec25a6458e355-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.378 DEBUG:boto:b'cjqttm-48f1000falsef2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.378 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.378 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.378 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.378 DEBUG:boto:Path: /cjqttm-48/f 2024-04-16T18:15:07.378 DEBUG:boto:Data: 2024-04-16T18:15:07.378 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.378 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.378 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.379 DEBUG:boto:Params: {} 2024-04-16T18:15:07.379 DEBUG:boto:Token: None 2024-04-16T18:15:07.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f 2024-04-16T18:15:07.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bXYNs6PWWAf5vC7LnMWhOtZKfrg= 2024-04-16T18:15:07.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bXYNs6PWWAf5vC7LnMWhOtZKfrg=', 'Content-Length': '0'} 2024-04-16T18:15:07.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc902666e5553117-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.381 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.381 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.382 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.382 DEBUG:boto:Path: /cjqttm-48/f 2024-04-16T18:15:07.382 DEBUG:boto:Data: 2024-04-16T18:15:07.382 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.382 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.382 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.382 DEBUG:boto:Params: {} 2024-04-16T18:15:07.382 DEBUG:boto:Token: None 2024-04-16T18:15:07.382 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f 2024-04-16T18:15:07.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bXYNs6PWWAf5vC7LnMWhOtZKfrg= 2024-04-16T18:15:07.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bXYNs6PWWAf5vC7LnMWhOtZKfrg=', 'Content-Length': '0'} 2024-04-16T18:15:07.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000175a7ce80e132caa-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.385 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:15:07.385 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.385 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.385 DEBUG:boto:Method: GET 2024-04-16T18:15:07.385 DEBUG:boto:Path: /cjqttm-48/f 2024-04-16T18:15:07.385 DEBUG:boto:Data: 2024-04-16T18:15:07.385 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.385 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.385 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.385 DEBUG:boto:Params: {} 2024-04-16T18:15:07.386 DEBUG:boto:Token: None 2024-04-16T18:15:07.386 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f 2024-04-16T18:15:07.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EpxHF3A5W8oGqMqya50CoaHEOjk= 2024-04-16T18:15:07.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EpxHF3A5W8oGqMqya50CoaHEOjk=', 'Content-Length': '0'} 2024-04-16T18:15:07.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d933b30abd93d176-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.430 DEBUG:boto:path=/cjqttm-48/f 2024-04-16T18:15:07.430 DEBUG:boto:auth_path=/cjqttm-48/f 2024-04-16T18:15:07.431 DEBUG:boto:Method: GET 2024-04-16T18:15:07.431 DEBUG:boto:Path: /cjqttm-48/f 2024-04-16T18:15:07.431 DEBUG:boto:Data: 2024-04-16T18:15:07.431 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.431 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.431 DEBUG:boto:Params: {} 2024-04-16T18:15:07.431 DEBUG:boto:Token: None 2024-04-16T18:15:07.431 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/f 2024-04-16T18:15:07.431 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EpxHF3A5W8oGqMqya50CoaHEOjk= 2024-04-16T18:15:07.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EpxHF3A5W8oGqMqya50CoaHEOjk=', 'Content-Length': '0'} 2024-04-16T18:15:07.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d101add8c675b29a-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.434 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.434 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.434 DEBUG:boto:path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.434 DEBUG:boto:auth_path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.434 DEBUG:boto:Method: GET 2024-04-16T18:15:07.434 DEBUG:boto:Path: /cjqttm-48/?prefix=f 2024-04-16T18:15:07.434 DEBUG:boto:Data: 2024-04-16T18:15:07.434 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.434 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.434 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.435 DEBUG:boto:Params: {} 2024-04-16T18:15:07.435 DEBUG:boto:Token: None 2024-04-16T18:15:07.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.437 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b80c4e7b7fbaac2c-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.437 DEBUG:boto:b'cjqttm-48f1000falsef2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.438 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.438 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.438 DEBUG:boto:path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.438 DEBUG:boto:auth_path=/cjqttm-48/?prefix=f 2024-04-16T18:15:07.438 DEBUG:boto:Method: GET 2024-04-16T18:15:07.438 DEBUG:boto:Path: /cjqttm-48/?prefix=f 2024-04-16T18:15:07.438 DEBUG:boto:Data: 2024-04-16T18:15:07.438 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.439 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.439 DEBUG:boto:Params: {} 2024-04-16T18:15:07.439 DEBUG:boto:Token: None 2024-04-16T18:15:07.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acb6b801ecfcf4ed-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.441 DEBUG:boto:b'cjqttm-48f1000falsef2024-04-16T18:12:59.590Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.441 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:15:07.442 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.442 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.442 DEBUG:boto:path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.442 DEBUG:boto:auth_path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.442 DEBUG:boto:Method: GET 2024-04-16T18:15:07.442 DEBUG:boto:Path: /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.442 DEBUG:boto:Data: 2024-04-16T18:15:07.442 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.442 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.442 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.442 DEBUG:boto:Params: {} 2024-04-16T18:15:07.443 DEBUG:boto:Token: None 2024-04-16T18:15:07.443 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY= 2024-04-16T18:15:07.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY=', 'Content-Length': '0'} 2024-04-16T18:15:07.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019da736fc2380a8b-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.486 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.486 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.487 DEBUG:boto:path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.487 DEBUG:boto:auth_path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.487 DEBUG:boto:Method: GET 2024-04-16T18:15:07.487 DEBUG:boto:Path: /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.487 DEBUG:boto:Data: 2024-04-16T18:15:07.487 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.487 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.487 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.487 DEBUG:boto:Params: {} 2024-04-16T18:15:07.487 DEBUG:boto:Token: None 2024-04-16T18:15:07.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY= 2024-04-16T18:15:07.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY=', 'Content-Length': '0'} 2024-04-16T18:15:07.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b4acea36b5f2c78-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.490 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.490 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.490 DEBUG:boto:path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.490 DEBUG:boto:auth_path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.490 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.490 DEBUG:boto:Path: /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.490 DEBUG:boto:Data: 2024-04-16T18:15:07.490 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.491 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.491 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.491 DEBUG:boto:Params: {} 2024-04-16T18:15:07.491 DEBUG:boto:Token: None 2024-04-16T18:15:07.491 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEEAuQtbgZXi9/BHnz72aosTDxI= 2024-04-16T18:15:07.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEEAuQtbgZXi9/BHnz72aosTDxI=', 'Content-Length': '0'} 2024-04-16T18:15:07.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a50fd4fed0a7bf3-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.493 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.493 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.493 DEBUG:boto:path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.494 DEBUG:boto:auth_path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.494 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.494 DEBUG:boto:Path: /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.494 DEBUG:boto:Data: 2024-04-16T18:15:07.494 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.494 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.494 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.494 DEBUG:boto:Params: {} 2024-04-16T18:15:07.494 DEBUG:boto:Token: None 2024-04-16T18:15:07.494 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DEEAuQtbgZXi9/BHnz72aosTDxI= 2024-04-16T18:15:07.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DEEAuQtbgZXi9/BHnz72aosTDxI=', 'Content-Length': '0'} 2024-04-16T18:15:07.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9c8557e97ab2d68-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:15:07.496 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.497 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.497 DEBUG:boto:path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.497 DEBUG:boto:auth_path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.497 DEBUG:boto:Method: GET 2024-04-16T18:15:07.497 DEBUG:boto:Path: /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.497 DEBUG:boto:Data: 2024-04-16T18:15:07.497 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.497 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.497 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.497 DEBUG:boto:Params: {} 2024-04-16T18:15:07.497 DEBUG:boto:Token: None 2024-04-16T18:15:07.498 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.498 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY= 2024-04-16T18:15:07.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY=', 'Content-Length': '0'} 2024-04-16T18:15:07.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d815272d4936037-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.543 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.543 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.543 DEBUG:boto:path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.543 DEBUG:boto:auth_path=/cjqttm-48/g?versionId=null 2024-04-16T18:15:07.543 DEBUG:boto:Method: GET 2024-04-16T18:15:07.543 DEBUG:boto:Path: /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.543 DEBUG:boto:Data: 2024-04-16T18:15:07.543 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.543 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.543 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.543 DEBUG:boto:Params: {} 2024-04-16T18:15:07.544 DEBUG:boto:Token: None 2024-04-16T18:15:07.544 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g?versionId=null 2024-04-16T18:15:07.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY= 2024-04-16T18:15:07.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xu+itbkF7hlVH5NXHI56yaFoFGY=', 'Content-Length': '0'} 2024-04-16T18:15:07.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d33d6baffddf9a0a-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.546 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.546 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.547 DEBUG:boto:path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.547 DEBUG:boto:auth_path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.547 DEBUG:boto:Method: GET 2024-04-16T18:15:07.547 DEBUG:boto:Path: /cjqttm-48/?prefix=g 2024-04-16T18:15:07.547 DEBUG:boto:Data: 2024-04-16T18:15:07.547 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.547 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.547 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.547 DEBUG:boto:Params: {} 2024-04-16T18:15:07.547 DEBUG:boto:Token: None 2024-04-16T18:15:07.547 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.550 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051b56361f04b3abc-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.550 DEBUG:boto:b'cjqttm-48g1000falseg2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.551 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.551 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.551 DEBUG:boto:path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.551 DEBUG:boto:auth_path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.551 DEBUG:boto:Method: GET 2024-04-16T18:15:07.551 DEBUG:boto:Path: /cjqttm-48/?prefix=g 2024-04-16T18:15:07.551 DEBUG:boto:Data: 2024-04-16T18:15:07.551 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.551 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.552 DEBUG:boto:Params: {} 2024-04-16T18:15:07.552 DEBUG:boto:Token: None 2024-04-16T18:15:07.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.554 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1ea94e67803c1d0-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.555 DEBUG:boto:b'cjqttm-48g1000falseg2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.555 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.555 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.555 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.555 DEBUG:boto:Path: /cjqttm-48/g 2024-04-16T18:15:07.555 DEBUG:boto:Data: 2024-04-16T18:15:07.555 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.555 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.555 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.556 DEBUG:boto:Params: {} 2024-04-16T18:15:07.556 DEBUG:boto:Token: None 2024-04-16T18:15:07.556 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g 2024-04-16T18:15:07.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ygu7Zz55rQpkJgD5MJ/FsJFo4gU= 2024-04-16T18:15:07.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ygu7Zz55rQpkJgD5MJ/FsJFo4gU=', 'Content-Length': '0'} 2024-04-16T18:15:07.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060dd2c79adb2b338-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.558 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.558 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.558 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.558 DEBUG:boto:Path: /cjqttm-48/g 2024-04-16T18:15:07.558 DEBUG:boto:Data: 2024-04-16T18:15:07.559 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.559 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.559 DEBUG:boto:Params: {} 2024-04-16T18:15:07.559 DEBUG:boto:Token: None 2024-04-16T18:15:07.559 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g 2024-04-16T18:15:07.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ygu7Zz55rQpkJgD5MJ/FsJFo4gU= 2024-04-16T18:15:07.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ygu7Zz55rQpkJgD5MJ/FsJFo4gU=', 'Content-Length': '0'} 2024-04-16T18:15:07.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009beab882ae46ca57-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:15:07.561 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.561 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.562 DEBUG:boto:Method: GET 2024-04-16T18:15:07.562 DEBUG:boto:Path: /cjqttm-48/g 2024-04-16T18:15:07.562 DEBUG:boto:Data: 2024-04-16T18:15:07.562 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.562 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.562 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.562 DEBUG:boto:Params: {} 2024-04-16T18:15:07.562 DEBUG:boto:Token: None 2024-04-16T18:15:07.562 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g 2024-04-16T18:15:07.562 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gxjEykm7/nGEI8qLNedV7GtLQBk= 2024-04-16T18:15:07.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gxjEykm7/nGEI8qLNedV7GtLQBk=', 'Content-Length': '0'} 2024-04-16T18:15:07.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c57419d57cefbef-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.606 DEBUG:boto:path=/cjqttm-48/g 2024-04-16T18:15:07.607 DEBUG:boto:auth_path=/cjqttm-48/g 2024-04-16T18:15:07.607 DEBUG:boto:Method: GET 2024-04-16T18:15:07.607 DEBUG:boto:Path: /cjqttm-48/g 2024-04-16T18:15:07.607 DEBUG:boto:Data: 2024-04-16T18:15:07.607 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.607 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.607 DEBUG:boto:Params: {} 2024-04-16T18:15:07.607 DEBUG:boto:Token: None 2024-04-16T18:15:07.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/g 2024-04-16T18:15:07.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gxjEykm7/nGEI8qLNedV7GtLQBk= 2024-04-16T18:15:07.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gxjEykm7/nGEI8qLNedV7GtLQBk=', 'Content-Length': '0'} 2024-04-16T18:15:07.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e6aaf25227794a9-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.609 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.610 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.610 DEBUG:boto:path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.610 DEBUG:boto:auth_path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.610 DEBUG:boto:Method: GET 2024-04-16T18:15:07.610 DEBUG:boto:Path: /cjqttm-48/?prefix=g 2024-04-16T18:15:07.610 DEBUG:boto:Data: 2024-04-16T18:15:07.610 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.610 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.610 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.610 DEBUG:boto:Params: {} 2024-04-16T18:15:07.611 DEBUG:boto:Token: None 2024-04-16T18:15:07.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003314e62975d27c30-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.654 DEBUG:boto:b'cjqttm-48g1000falseg2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.655 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.655 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.655 DEBUG:boto:path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.655 DEBUG:boto:auth_path=/cjqttm-48/?prefix=g 2024-04-16T18:15:07.655 DEBUG:boto:Method: GET 2024-04-16T18:15:07.655 DEBUG:boto:Path: /cjqttm-48/?prefix=g 2024-04-16T18:15:07.655 DEBUG:boto:Data: 2024-04-16T18:15:07.655 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.655 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.656 DEBUG:boto:Params: {} 2024-04-16T18:15:07.656 DEBUG:boto:Token: None 2024-04-16T18:15:07.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.658 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038f549577b6fb783-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.658 DEBUG:boto:b'cjqttm-48g1000falseg2024-04-16T18:12:59.600Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.659 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:15:07.659 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.659 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.659 DEBUG:boto:path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.659 DEBUG:boto:auth_path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.659 DEBUG:boto:Method: GET 2024-04-16T18:15:07.659 DEBUG:boto:Path: /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.659 DEBUG:boto:Data: 2024-04-16T18:15:07.660 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.660 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.660 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.660 DEBUG:boto:Params: {} 2024-04-16T18:15:07.660 DEBUG:boto:Token: None 2024-04-16T18:15:07.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs= 2024-04-16T18:15:07.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs=', 'Content-Length': '0'} 2024-04-16T18:15:07.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009feb6cd4b2c0e426-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.702 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.702 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.703 DEBUG:boto:path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.703 DEBUG:boto:auth_path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.703 DEBUG:boto:Method: GET 2024-04-16T18:15:07.703 DEBUG:boto:Path: /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.703 DEBUG:boto:Data: 2024-04-16T18:15:07.703 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.703 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.703 DEBUG:boto:Params: {} 2024-04-16T18:15:07.703 DEBUG:boto:Token: None 2024-04-16T18:15:07.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs= 2024-04-16T18:15:07.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs=', 'Content-Length': '0'} 2024-04-16T18:15:07.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002ebfd139ab866c8-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.706 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.706 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.707 DEBUG:boto:path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.707 DEBUG:boto:auth_path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.707 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.707 DEBUG:boto:Path: /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.707 DEBUG:boto:Data: 2024-04-16T18:15:07.707 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.707 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.707 DEBUG:boto:Params: {} 2024-04-16T18:15:07.707 DEBUG:boto:Token: None 2024-04-16T18:15:07.707 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.708 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YVdredBFesCBB/RBXlFLU5juDfU= 2024-04-16T18:15:07.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YVdredBFesCBB/RBXlFLU5juDfU=', 'Content-Length': '0'} 2024-04-16T18:15:07.710 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000161d6878f0f6764f-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.710 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.710 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.710 DEBUG:boto:path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.710 DEBUG:boto:auth_path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.711 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.711 DEBUG:boto:Path: /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.711 DEBUG:boto:Data: 2024-04-16T18:15:07.711 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.711 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.711 DEBUG:boto:Params: {} 2024-04-16T18:15:07.711 DEBUG:boto:Token: None 2024-04-16T18:15:07.711 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YVdredBFesCBB/RBXlFLU5juDfU= 2024-04-16T18:15:07.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YVdredBFesCBB/RBXlFLU5juDfU=', 'Content-Length': '0'} 2024-04-16T18:15:07.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5104dd06e8b9ace-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:15:07.714 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.714 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.714 DEBUG:boto:path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.714 DEBUG:boto:auth_path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.714 DEBUG:boto:Method: GET 2024-04-16T18:15:07.714 DEBUG:boto:Path: /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.714 DEBUG:boto:Data: 2024-04-16T18:15:07.714 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.714 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.715 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.715 DEBUG:boto:Params: {} 2024-04-16T18:15:07.715 DEBUG:boto:Token: None 2024-04-16T18:15:07.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs= 2024-04-16T18:15:07.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs=', 'Content-Length': '0'} 2024-04-16T18:15:07.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bd98fd7417fed8b-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.758 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.758 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.758 DEBUG:boto:path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.759 DEBUG:boto:auth_path=/cjqttm-48/h?versionId=null 2024-04-16T18:15:07.759 DEBUG:boto:Method: GET 2024-04-16T18:15:07.759 DEBUG:boto:Path: /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.759 DEBUG:boto:Data: 2024-04-16T18:15:07.759 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.759 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.759 DEBUG:boto:Params: {} 2024-04-16T18:15:07.759 DEBUG:boto:Token: None 2024-04-16T18:15:07.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h?versionId=null 2024-04-16T18:15:07.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs= 2024-04-16T18:15:07.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OhwopLojZspooMwecq5bh27MHJs=', 'Content-Length': '0'} 2024-04-16T18:15:07.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da8333a34d5d0863-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.762 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.762 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.762 DEBUG:boto:path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.762 DEBUG:boto:auth_path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.762 DEBUG:boto:Method: GET 2024-04-16T18:15:07.762 DEBUG:boto:Path: /cjqttm-48/?prefix=h 2024-04-16T18:15:07.763 DEBUG:boto:Data: 2024-04-16T18:15:07.763 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.763 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.763 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.763 DEBUG:boto:Params: {} 2024-04-16T18:15:07.763 DEBUG:boto:Token: None 2024-04-16T18:15:07.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.766 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6a168a263362efe-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.806 DEBUG:boto:b'cjqttm-48h1000falseh2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.807 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.807 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.807 DEBUG:boto:path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.807 DEBUG:boto:auth_path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.807 DEBUG:boto:Method: GET 2024-04-16T18:15:07.807 DEBUG:boto:Path: /cjqttm-48/?prefix=h 2024-04-16T18:15:07.807 DEBUG:boto:Data: 2024-04-16T18:15:07.807 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.808 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.808 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.808 DEBUG:boto:Params: {} 2024-04-16T18:15:07.808 DEBUG:boto:Token: None 2024-04-16T18:15:07.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dda5782a3e55efa0-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.811 DEBUG:boto:b'cjqttm-48h1000falseh2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.811 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.811 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.811 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.811 DEBUG:boto:Path: /cjqttm-48/h 2024-04-16T18:15:07.812 DEBUG:boto:Data: 2024-04-16T18:15:07.812 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.812 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.812 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.812 DEBUG:boto:Params: {} 2024-04-16T18:15:07.812 DEBUG:boto:Token: None 2024-04-16T18:15:07.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h 2024-04-16T18:15:07.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/DjSFrH2ertjbDArXg95cNBAkh4= 2024-04-16T18:15:07.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/DjSFrH2ertjbDArXg95cNBAkh4=', 'Content-Length': '0'} 2024-04-16T18:15:07.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084b399f843b6bd58-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.815 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.815 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.815 DEBUG:boto:Method: HEAD 2024-04-16T18:15:07.815 DEBUG:boto:Path: /cjqttm-48/h 2024-04-16T18:15:07.815 DEBUG:boto:Data: 2024-04-16T18:15:07.815 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.816 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.816 DEBUG:boto:Params: {} 2024-04-16T18:15:07.816 DEBUG:boto:Token: None 2024-04-16T18:15:07.816 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h 2024-04-16T18:15:07.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/DjSFrH2ertjbDArXg95cNBAkh4= 2024-04-16T18:15:07.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/DjSFrH2ertjbDArXg95cNBAkh4=', 'Content-Length': '0'} 2024-04-16T18:15:07.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ad87e8a4b563331-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.818 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:15:07.818 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.819 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.819 DEBUG:boto:Method: GET 2024-04-16T18:15:07.819 DEBUG:boto:Path: /cjqttm-48/h 2024-04-16T18:15:07.819 DEBUG:boto:Data: 2024-04-16T18:15:07.819 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.819 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.819 DEBUG:boto:Params: {} 2024-04-16T18:15:07.819 DEBUG:boto:Token: None 2024-04-16T18:15:07.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h 2024-04-16T18:15:07.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXecWmeV8d1KmhylEkMyqtFHqto= 2024-04-16T18:15:07.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXecWmeV8d1KmhylEkMyqtFHqto=', 'Content-Length': '0'} 2024-04-16T18:15:07.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-48:9ba59572-f51c-4bce-9578-e6350e822996.4816.17'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b14e16bab636c477-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.866 DEBUG:boto:path=/cjqttm-48/h 2024-04-16T18:15:07.866 DEBUG:boto:auth_path=/cjqttm-48/h 2024-04-16T18:15:07.867 DEBUG:boto:Method: GET 2024-04-16T18:15:07.867 DEBUG:boto:Path: /cjqttm-48/h 2024-04-16T18:15:07.867 DEBUG:boto:Data: 2024-04-16T18:15:07.867 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.867 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.867 DEBUG:boto:Params: {} 2024-04-16T18:15:07.867 DEBUG:boto:Token: None 2024-04-16T18:15:07.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/h 2024-04-16T18:15:07.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXecWmeV8d1KmhylEkMyqtFHqto= 2024-04-16T18:15:07.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXecWmeV8d1KmhylEkMyqtFHqto=', 'Content-Length': '0'} 2024-04-16T18:15:07.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:12:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6a4eece71e41fd9-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.870 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.870 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.870 DEBUG:boto:path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.870 DEBUG:boto:auth_path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.870 DEBUG:boto:Method: GET 2024-04-16T18:15:07.871 DEBUG:boto:Path: /cjqttm-48/?prefix=h 2024-04-16T18:15:07.871 DEBUG:boto:Data: 2024-04-16T18:15:07.871 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:07.871 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.871 DEBUG:boto:Params: {} 2024-04-16T18:15:07.871 DEBUG:boto:Token: None 2024-04-16T18:15:07.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d946f5001de7d1d-00661ec02b-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.914 DEBUG:boto:b'cjqttm-48h1000falseh2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.915 DEBUG:boto:path=/cjqttm-48/ 2024-04-16T18:15:07.915 DEBUG:boto:auth_path=/cjqttm-48/ 2024-04-16T18:15:07.915 DEBUG:boto:path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.915 DEBUG:boto:auth_path=/cjqttm-48/?prefix=h 2024-04-16T18:15:07.915 DEBUG:boto:Method: GET 2024-04-16T18:15:07.915 DEBUG:boto:Path: /cjqttm-48/?prefix=h 2024-04-16T18:15:07.915 DEBUG:boto:Data: 2024-04-16T18:15:07.915 DEBUG:boto:Headers: {} 2024-04-16T18:15:07.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:07.916 DEBUG:boto:Port: 8000 2024-04-16T18:15:07.916 DEBUG:boto:Params: {} 2024-04-16T18:15:07.916 DEBUG:boto:Token: None 2024-04-16T18:15:07.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:07 GMT /cjqttm-48/ 2024-04-16T18:15:07.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas= 2024-04-16T18:15:07.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09Op9CBTDZF29BrM1V2rLGMavas=', 'Content-Length': '0'} 2024-04-16T18:15:07.918 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e6946e6a9b921ce-00661ec02b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:07.918 DEBUG:boto:b'cjqttm-48h1000falseh2024-04-16T18:12:59.647Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:07.919 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-48 zones={test-zone2, test-zone1} 2024-04-16T18:15:07.919 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_full ... ok 2024-04-16T18:15:07.921 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:07.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:07.921 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:07.975 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:08.032 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:08.055 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T18:15:08.055 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:15:08.056 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:08.056 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:08.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:08.056 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:08.111 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:08.111 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:08.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:08.167+0000 7f5c4e72f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:08.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:08.168+0000 7f5c4e72f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:08.190 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:08Z"} 2024-04-16T18:15:08.190 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:08Z"} 2024-04-16T18:15:08.191 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:15:08.191 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:15:08.191 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:15:08.191 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:08.191 DEBUG:boto:path=/ 2024-04-16T18:15:08.191 DEBUG:boto:auth_path=/ 2024-04-16T18:15:08.191 DEBUG:boto:Method: GET 2024-04-16T18:15:08.191 DEBUG:boto:Path: / 2024-04-16T18:15:08.192 DEBUG:boto:Data: 2024-04-16T18:15:08.192 DEBUG:boto:Headers: {} 2024-04-16T18:15:08.192 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:08.192 DEBUG:boto:Port: 8000 2024-04-16T18:15:08.192 DEBUG:boto:Params: {} 2024-04-16T18:15:08.192 DEBUG:boto:Token: None 2024-04-16T18:15:08.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:08 GMT / 2024-04-16T18:15:08.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:su226fozeo/ymuEvAwXkSOdOsus= 2024-04-16T18:15:08.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:su226fozeo/ymuEvAwXkSOdOsus=', 'Content-Length': '0'} 2024-04-16T18:15:08.195 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003b6eaf42d1b0bfd-00661ec02c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:08.196 DEBUG:boto:path=/ 2024-04-16T18:15:08.196 DEBUG:boto:auth_path=/ 2024-04-16T18:15:08.196 DEBUG:boto:Method: GET 2024-04-16T18:15:08.196 DEBUG:boto:Path: / 2024-04-16T18:15:08.196 DEBUG:boto:Data: 2024-04-16T18:15:08.196 DEBUG:boto:Headers: {} 2024-04-16T18:15:08.196 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:08.196 DEBUG:boto:Port: 8000 2024-04-16T18:15:08.196 DEBUG:boto:Params: {} 2024-04-16T18:15:08.197 DEBUG:boto:Token: None 2024-04-16T18:15:08.197 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:08 GMT / 2024-04-16T18:15:08.197 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:su226fozeo/ymuEvAwXkSOdOsus= 2024-04-16T18:15:08.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:su226fozeo/ymuEvAwXkSOdOsus=', 'Content-Length': '0'} 2024-04-16T18:15:08.199 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9c1ec5cce04638d-00661ec02c-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:08.200 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_creation_time ... ok 2024-04-16T18:15:08.201 INFO:rgw_multi.tests:create role zone=test-zone1 name=roles-cjqttm-1 2024-04-16T18:15:08.202 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateRole: calling handler 2024-04-16T18:15:08.202 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:08.203 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:08.203 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:08.204 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:08.204 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1', 'AssumeRolePolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:08.205 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler > 2024-04-16T18:15:08.205 DEBUG:botocore.hooks:Event choose-signer.iam.CreateRole: calling handler 2024-04-16T18:15:08.206 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:08.206 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181508Z content-type;host;x-amz-date 38f5e3eb8dcc6f24900112ad697b60511aa5771ea5c1dc4aa0018b1233e09f14 2024-04-16T18:15:08.206 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181508Z 20240416/test-zonegroup/iam/aws4_request bdf0e3b8e46a1cb56b4efc0ac5d0f700da972ed3d6f1800d8aee8c5a8ce43d9b 2024-04-16T18:15:08.207 DEBUG:botocore.auth:Signature: 3cef4aecb90f6d75a0a28dca96ab6de4efd4f2d82507a5deb537de9587a852df 2024-04-16T18:15:08.207 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler 2024-04-16T18:15:08.207 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:08.221 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005fd575cbeefcd9dd-00661ec02c-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '785', 'Date': 'Tue, 16 Apr 2024 18:15:08 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:08.221 DEBUG:botocore.parsers:Response body: b'b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}tx000005fd575cbeefcd9dd-00661ec02c-4816-test-zone1' 2024-04-16T18:15:08.250 DEBUG:botocore.hooks:Event needs-retry.iam.CreateRole: calling handler 2024-04-16T18:15:08.250 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:08.250 DEBUG:botocore.hooks:Event after-call.iam.CreateRole: calling handler 2024-04-16T18:15:08.250 INFO:rgw_multi.tests:create role zone=test-zone2 name=roles-cjqttm-2 2024-04-16T18:15:08.251 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateRole: calling handler 2024-04-16T18:15:08.251 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:08.251 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:08.252 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:08.252 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:08.252 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2', 'AssumeRolePolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:08.252 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler > 2024-04-16T18:15:08.252 DEBUG:botocore.hooks:Event choose-signer.iam.CreateRole: calling handler 2024-04-16T18:15:08.253 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:08.253 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181508Z content-type;host;x-amz-date 3cd74e79447a9d6c5ef4103c59e1fb2131cb9a4da04b9456086e835af382e680 2024-04-16T18:15:08.253 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181508Z 20240416/test-zonegroup/iam/aws4_request 28b7253f4c32afe1201c9e1e77537e74709d1781dcf8cd7974a827ed526c39e9 2024-04-16T18:15:08.253 DEBUG:botocore.auth:Signature: 424d586b099f6a6749306d804b2edd5333737d6874a69061287942590f9c7784 2024-04-16T18:15:08.253 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler 2024-04-16T18:15:08.253 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:08.273 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000070d1af0be931796f-00661ec02c-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '785', 'Date': 'Tue, 16 Apr 2024 18:15:08 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:08.273 DEBUG:botocore.parsers:Response body: b'f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}tx0000070d1af0be931796f-00661ec02c-5447-test-zone2' 2024-04-16T18:15:08.274 DEBUG:botocore.hooks:Event needs-retry.iam.CreateRole: calling handler 2024-04-16T18:15:08.274 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:08.274 DEBUG:botocore.hooks:Event after-call.iam.CreateRole: calling handler 2024-04-16T18:15:08.274 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:08.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:08.275 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:08.322 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:08.323 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:08.374 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:08.397 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713291308.265427_346.1","last_update":"2024-04-16T18:15:08.265427Z"}] 2024-04-16T18:15:08.397 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291308.265427_346.1'} 2024-04-16T18:15:08.397 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:08.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:08.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:08.398 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:08.447 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:08.448 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:08.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:08.499+0000 7f6c16524800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:08.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:08.500+0000 7f6c16524800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:08.521 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:08Z"} 2024-04-16T18:15:08.521 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:08Z"} 2024-04-16T18:15:08.521 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T18:15:08.522 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291308.265427_346.1'} 2024-04-16T18:15:08.522 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T18:15:08.522 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1713291308.265427_346.1 target=1_1713289624.386720_84.1 2024-04-16T18:15:13.522 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:13.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:13.523 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:13.579 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:13.579 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:13.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:13.637+0000 7f9d45c11800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:13.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:13.638+0000 7f9d45c11800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:13.659 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291308.265427_346.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:08.265427Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:13Z"} 2024-04-16T18:15:13.659 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291308.265427_346.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:08.265427Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:13Z"} 2024-04-16T18:15:13.660 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291308.265427_346.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:08.265427Z', 'realm_epoch': 2}}] 2024-04-16T18:15:13.660 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291308.265427_346.1'} 2024-04-16T18:15:13.660 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291308.265427_346.1'} 2024-04-16T18:15:13.660 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:13.755 DEBUG:botocore.loaders:Loading JSON file: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/data/iam/2010-05-08/paginators-1.json 2024-04-16T18:15:13.756 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRoles: calling handler 2024-04-16T18:15:13.756 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.757 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.757 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:13.757 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:13.757 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRoles) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRoles', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.758 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler > 2024-04-16T18:15:13.758 DEBUG:botocore.hooks:Event choose-signer.iam.ListRoles: calling handler 2024-04-16T18:15:13.758 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.759 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 8e689dc6b69b17003f0460011582254d8643f0dfb48ac46e093a24df58170b3f 2024-04-16T18:15:13.759 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 24dcf137357dd216566509e4c0429b7e86f6a30cfbbe356b6bbaf209000f3ecc 2024-04-16T18:15:13.759 DEBUG:botocore.auth:Signature: 54a250205cc92e1e68e3064a67353237641c9aef42826927a7b34ab2c893b3f3 2024-04-16T18:15:13.759 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler 2024-04-16T18:15:13.759 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.763 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000008a0ccb8473d9faf2-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1519', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.763 DEBUG:botocore.parsers:Response body: b'b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111falsetx000008a0ccb8473d9faf2-00661ec031-4816-test-zone1' 2024-04-16T18:15:13.764 DEBUG:botocore.hooks:Event needs-retry.iam.ListRoles: calling handler 2024-04-16T18:15:13.764 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.764 DEBUG:botocore.hooks:Event after-call.iam.ListRoles: calling handler 2024-04-16T18:15:13.765 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRoles: calling handler 2024-04-16T18:15:13.765 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.765 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:13.765 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:13.766 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:13.766 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRoles) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRoles', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.766 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler > 2024-04-16T18:15:13.766 DEBUG:botocore.hooks:Event choose-signer.iam.ListRoles: calling handler 2024-04-16T18:15:13.767 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.767 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 8e689dc6b69b17003f0460011582254d8643f0dfb48ac46e093a24df58170b3f 2024-04-16T18:15:13.767 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 1f121849a8ece83d818c80ecefc078d7643cb8125471de752eb86e013584ce16 2024-04-16T18:15:13.767 DEBUG:botocore.auth:Signature: b405507aad02a4c397bf0a8c7c520361728c463f67e6a75c9cdee0eb1f0040cd 2024-04-16T18:15:13.767 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler 2024-04-16T18:15:13.767 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.772 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000009f3b53c6e3077b65-00661ec031-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1519', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.772 DEBUG:botocore.parsers:Response body: b'b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111falsetx000009f3b53c6e3077b65-00661ec031-5447-test-zone2' 2024-04-16T18:15:13.773 DEBUG:botocore.hooks:Event needs-retry.iam.ListRoles: calling handler 2024-04-16T18:15:13.773 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.773 DEBUG:botocore.hooks:Event after-call.iam.ListRoles: calling handler 2024-04-16T18:15:13.774 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:13.774 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.774 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.774 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.774 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.775 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.775 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:13.775 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:13.775 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.776 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 8f2a258f431de2df39c452e7aa57d388d9c943f7f8a70cbd5df98df5386c6953 2024-04-16T18:15:13.776 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 15bdf9f10595b8bb76f63e2bff632e53c1fc4db1f0d3d7ae35f0413737e16aac 2024-04-16T18:15:13.776 DEBUG:botocore.auth:Signature: 59328f15dc24edfbf91a6bbf8f97534d1bd0597df8832fa02d218f7ae9c8952f 2024-04-16T18:15:13.776 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:13.776 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.778 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000032b1df16ac93b74c-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.778 DEBUG:botocore.parsers:Response body: b'tx0000032b1df16ac93b74c-00661ec031-4816-test-zone1b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:13.779 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:13.779 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.779 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:13.780 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:13.780 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.780 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:13.780 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.780 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.780 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.781 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:13.781 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:13.781 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.781 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 8f2a258f431de2df39c452e7aa57d388d9c943f7f8a70cbd5df98df5386c6953 2024-04-16T18:15:13.781 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 368fff2cdef27f719ee308c73f9366edcf04d57dbc881678fead7815b1275090 2024-04-16T18:15:13.782 DEBUG:botocore.auth:Signature: f8bacef70d1da41dbeab54c0c47ce7e77a72ed9ea5c611fffa8ccc9ac6c71f34 2024-04-16T18:15:13.782 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:13.782 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.784 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000003ea11785899b2246-00661ec031-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.784 DEBUG:botocore.parsers:Response body: b'tx000003ea11785899b2246-00661ec031-5447-test-zone2b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:13.785 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:13.785 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.785 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:13.785 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.786 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.786 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.786 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.786 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.786 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.786 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:13.787 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.787 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.787 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 3db9fbb8864693f61061506a569aad4475c506e554d7919698e984bee122e2be 2024-04-16T18:15:13.787 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 066d1827c7557bbd55171c456e39d54a96b2683b273540b806ed0f0e6baca063 2024-04-16T18:15:13.787 DEBUG:botocore.auth:Signature: 0062898da34497063e06b20661276383ac6823aa50dad3804dce2db98865d7e1 2024-04-16T18:15:13.787 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.788 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.790 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000bf3d9018c88b4394-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.790 DEBUG:botocore.parsers:Response body: b'tx00000bf3d9018c88b4394-00661ec031-4816-test-zone1' 2024-04-16T18:15:13.790 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.791 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.791 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.791 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.791 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.791 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:13.792 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.792 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.792 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.792 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:13.792 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.793 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.793 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 3db9fbb8864693f61061506a569aad4475c506e554d7919698e984bee122e2be 2024-04-16T18:15:13.793 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 829c68434281e3dfab4f73296e15815860856a98b47697608d66194b7e727c88 2024-04-16T18:15:13.793 DEBUG:botocore.auth:Signature: 72175b666a1d25f1247728d224f793ff4c0b0b31641b07eeb0d744e5408f56be 2024-04-16T18:15:13.793 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.794 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.796 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000009a7f0b98abab0f3e-00661ec031-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.796 DEBUG:botocore.parsers:Response body: b'tx000009a7f0b98abab0f3e-00661ec031-5447-test-zone2' 2024-04-16T18:15:13.796 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.796 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.796 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.797 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.797 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.797 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.798 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.798 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.798 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.798 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:13.798 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.799 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.799 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 2f314d397cbac9a588b92b4320c5a1127363dccb0d852931ea20d4eff1417de1 2024-04-16T18:15:13.799 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request f873102cd97cc19232609b73212798be4225f0f60227b31057390066d453ea52 2024-04-16T18:15:13.799 DEBUG:botocore.auth:Signature: 74da5008a5f321796a6677073c2c48fb16440d99fc412c70bd8212363cf85452 2024-04-16T18:15:13.799 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.799 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.801 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000083bca30d1bf91b6d-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.802 DEBUG:botocore.parsers:Response body: b'tx0000083bca30d1bf91b6d-00661ec031-4816-test-zone1' 2024-04-16T18:15:13.802 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.802 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.802 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.803 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.803 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.803 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:13.803 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.803 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.803 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.804 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:13.804 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.804 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.804 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 2f314d397cbac9a588b92b4320c5a1127363dccb0d852931ea20d4eff1417de1 2024-04-16T18:15:13.804 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 44a6c3b74f2b1f42035092a884532e1ea493ad62c000a24f771e27a65d50e3df 2024-04-16T18:15:13.805 DEBUG:botocore.auth:Signature: e84ce93cef34283d74a2a9c57610e8aa5ed507e89d617cbffc7b624f05de67f9 2024-04-16T18:15:13.805 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.805 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.807 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000bb89a1eaa3a6dc7c-00661ec031-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.807 DEBUG:botocore.parsers:Response body: b'tx00000bb89a1eaa3a6dc7c-00661ec031-5447-test-zone2' 2024-04-16T18:15:13.807 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.807 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.808 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.808 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:13.808 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.808 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.808 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.808 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.808 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.809 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:13.809 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:13.809 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.809 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 07892fd0c5c70e8192a39ae193652f7ff706efef8941ee3607681aa7e4b57d46 2024-04-16T18:15:13.809 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 519a0c39a8fab75162cb8135a11029e261691b39eb26adc7b760df77b9f4d240 2024-04-16T18:15:13.809 DEBUG:botocore.auth:Signature: 387b0cee9f8b2484351f64ef3d8275f396753f102acd7dd8931d585a872d6169 2024-04-16T18:15:13.809 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:13.810 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.812 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000de32ff30535709ed-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.812 DEBUG:botocore.parsers:Response body: b'tx00000de32ff30535709ed-00661ec031-4816-test-zone1f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:13.812 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:13.812 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.813 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:13.813 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:13.813 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.813 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:13.813 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.813 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:13.813 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.814 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:13.814 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:13.814 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.814 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 07892fd0c5c70e8192a39ae193652f7ff706efef8941ee3607681aa7e4b57d46 2024-04-16T18:15:13.814 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 21f602b2aeb2df5ce2cc83cbe7fd492a6b9ba429843a1b62d4ee473468199ebe 2024-04-16T18:15:13.814 DEBUG:botocore.auth:Signature: 12ec2da07b655defa9eca3eac01b5b31ff1a0292f0be4093216ad61adf3df94e 2024-04-16T18:15:13.815 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:13.815 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.816 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000c964ea255b003e68-00661ec031-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.817 DEBUG:botocore.parsers:Response body: b'tx00000c964ea255b003e68-00661ec031-5447-test-zone2f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:13.817 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:13.817 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.817 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:13.818 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.818 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.818 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.818 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.818 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.818 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.819 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:13.819 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.819 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.819 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 197b347e25417624ba8adafc5e9b6c078cfb1e82b21f5895646d7316797be137 2024-04-16T18:15:13.819 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 90063e969c4ace1a4c45fc7ba31ca1a12705638e3390c6ab948989b67c1ebb79 2024-04-16T18:15:13.819 DEBUG:botocore.auth:Signature: 670227fb00d688559335a1eb8fcb6cc723f48c16f83aefd4465dd88c209e4d08 2024-04-16T18:15:13.819 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.820 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.821 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e1565704d1802e12-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.822 DEBUG:botocore.parsers:Response body: b'tx00000e1565704d1802e12-00661ec031-4816-test-zone1' 2024-04-16T18:15:13.822 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.822 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.822 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.822 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.822 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.822 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:13.823 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.823 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.823 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.823 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:13.823 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.823 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.824 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 197b347e25417624ba8adafc5e9b6c078cfb1e82b21f5895646d7316797be137 2024-04-16T18:15:13.824 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 16c1b905afd05dacc882cf22307c1b9913b9a813907d34fd50139afa2ccc507e 2024-04-16T18:15:13.824 DEBUG:botocore.auth:Signature: ab2f1817a5b2bea8c7fef66ecd78d61e01cb7135a12f6b3148d445bcc3112092 2024-04-16T18:15:13.824 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.824 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.826 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000f76a66ff777a5446-00661ec031-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.826 DEBUG:botocore.parsers:Response body: b'tx00000f76a66ff777a5446-00661ec031-5447-test-zone2' 2024-04-16T18:15:13.826 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.827 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.827 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:13.827 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.827 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.827 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.827 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.828 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.828 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.828 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:13.828 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.828 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.828 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 644da773af884f4ddfb182a1f2b84c9ed81edd210a431358216fc28d2d9bfe04 2024-04-16T18:15:13.828 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 6f5026cc3a712ad2daab04f236211a3b9f4afa247e6bb1f25a816bcb68ace41a 2024-04-16T18:15:13.829 DEBUG:botocore.auth:Signature: bcc3393deb0b02d261f7693c8f6159d21c30d6b88d7d4496f27846abc4952d9c 2024-04-16T18:15:13.829 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.829 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.831 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b67cfb8034d63d05-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.831 DEBUG:botocore.parsers:Response body: b'tx00000b67cfb8034d63d05-00661ec031-4816-test-zone1' 2024-04-16T18:15:13.832 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.832 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.832 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.832 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.832 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.832 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:13.832 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.833 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.833 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.833 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:13.833 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.833 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.833 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date 644da773af884f4ddfb182a1f2b84c9ed81edd210a431358216fc28d2d9bfe04 2024-04-16T18:15:13.833 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request 2daf315820d0e077b3cd9fcce030612086a026fa3748a4982f36a1b4304dcfc9 2024-04-16T18:15:13.833 DEBUG:botocore.auth:Signature: 67e72624d265830eee34bd59e6f078ce2834be7b8de5305cf8d0107ec2c23282 2024-04-16T18:15:13.834 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.834 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.836 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000024af885bed852785-00661ec031-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.836 DEBUG:botocore.parsers:Response body: b'tx0000024af885bed852785-00661ec031-5447-test-zone2' 2024-04-16T18:15:13.836 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.836 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.836 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:13.837 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_role_sync ... ok 2024-04-16T18:15:13.837 INFO:rgw_multi.tests:create role zone=test-zone1 name=roles-cjqttm-3 2024-04-16T18:15:13.837 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateRole: calling handler 2024-04-16T18:15:13.837 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:13.838 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:13.838 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:13.838 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:13.838 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-3', 'AssumeRolePolicyDocument': '{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:13.838 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler > 2024-04-16T18:15:13.838 DEBUG:botocore.hooks:Event choose-signer.iam.CreateRole: calling handler 2024-04-16T18:15:13.839 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:13.839 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181513Z content-type;host;x-amz-date c7a6c69a417a7f2e3a17785fde8c8a3a075cb212e63026747d49d42a1a0656f3 2024-04-16T18:15:13.839 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181513Z 20240416/test-zonegroup/iam/aws4_request b42675a0cd7b0fd45195891e166d68b8e5b1e2c2e1c6fee15b2aca454b4d00a6 2024-04-16T18:15:13.839 DEBUG:botocore.auth:Signature: d8e612901b37686e4defdb7e8f0b3b60e8454c081517f74adb68c143d5b614c7 2024-04-16T18:15:13.839 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler 2024-04-16T18:15:13.839 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:13.894 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000003be84ab22f5fafd8-00661ec031-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '778', 'Date': 'Tue, 16 Apr 2024 18:15:13 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:13.894 DEBUG:botocore.parsers:Response body: b'1ca27639-8f7a-4f00-addf-610417dcfba8roles-cjqttm-3/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-32024-04-16T18:15:13.845Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}tx000003be84ab22f5fafd8-00661ec031-4816-test-zone1' 2024-04-16T18:15:13.895 DEBUG:botocore.hooks:Event needs-retry.iam.CreateRole: calling handler 2024-04-16T18:15:13.895 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:13.895 DEBUG:botocore.hooks:Event after-call.iam.CreateRole: calling handler 2024-04-16T18:15:13.895 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:13.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:13.896 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:13.951 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:13.951 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:14.007 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:14.030 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713291313.849349_348.1","last_update":"2024-04-16T18:15:13.849349Z"}] 2024-04-16T18:15:14.030 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291313.849349_348.1'} 2024-04-16T18:15:14.030 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:14.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.031 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:14.082 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:14.083 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:14.134 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:14.137+0000 7f281cb24800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:14.136 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:14.138+0000 7f281cb24800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:14.157 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291313.849349_348.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:13.849349Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T18:15:14.158 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291313.849349_348.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:13.849349Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T18:15:14.158 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291313.849349_348.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:13.849349Z', 'realm_epoch': 2}}] 2024-04-16T18:15:14.159 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291313.849349_348.1'} 2024-04-16T18:15:14.159 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291313.849349_348.1'} 2024-04-16T18:15:14.159 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:14.159 INFO:rgw_multi.tests:checking if zone: test-zone1 has role: roles-cjqttm-3 2024-04-16T18:15:14.159 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:14.159 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:14.159 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:14.160 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.160 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.160 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-3'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:14.160 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:14.160 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:14.161 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:14.161 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181514Z content-type;host;x-amz-date f5333e94483724e687c7b8e7c877aadc59cf0997347812bc3844ba13b03882b6 2024-04-16T18:15:14.161 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181514Z 20240416/test-zonegroup/iam/aws4_request 2fd437cb743f5fa94efa1d978cce354ac2ed88556ab9dad83711bfa5528a1aad 2024-04-16T18:15:14.161 DEBUG:botocore.auth:Signature: 6538dc39a17032262b805784aff447b4d0080fda7e1370b6ac4ede4b36f11c50 2024-04-16T18:15:14.161 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:14.161 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:14.164 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000053a8ed2fa038901-00661ec032-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '766', 'Date': 'Tue, 16 Apr 2024 18:15:14 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:14.164 DEBUG:botocore.parsers:Response body: b'tx00000053a8ed2fa038901-00661ec032-4816-test-zone11ca27639-8f7a-4f00-addf-610417dcfba8roles-cjqttm-3/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-32024-04-16T18:15:13.845Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-16T18:15:14.164 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:14.165 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:14.165 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:14.165 INFO:rgw_multi.tests:success, zone: test-zone1 has role: roles-cjqttm-3 2024-04-16T18:15:14.165 INFO:rgw_multi.tests:checking if zone: test-zone2 has role: roles-cjqttm-3 2024-04-16T18:15:14.165 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:14.165 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:14.165 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:14.166 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.166 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.166 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-3'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:14.166 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:14.166 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:14.166 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:14.167 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181514Z content-type;host;x-amz-date f5333e94483724e687c7b8e7c877aadc59cf0997347812bc3844ba13b03882b6 2024-04-16T18:15:14.167 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181514Z 20240416/test-zonegroup/iam/aws4_request 21cf8d5d7d0393fe5a14b5a52f6f821857f897e569b666bcb28b4e9ca6ec02a6 2024-04-16T18:15:14.167 DEBUG:botocore.auth:Signature: 86463431e67cb40dba3917b6bd4e6bc53997141b5332874eea6ebe8fd75080b1 2024-04-16T18:15:14.167 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:14.167 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:14.170 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000088a0494483d592fc-00661ec032-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '766', 'Date': 'Tue, 16 Apr 2024 18:15:14 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:14.170 DEBUG:botocore.parsers:Response body: b'tx0000088a0494483d592fc-00661ec032-5447-test-zone21ca27639-8f7a-4f00-addf-610417dcfba8roles-cjqttm-3/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-32024-04-16T18:15:13.845Z3600{"Version":"2012-10-17","Statement":[{"Effect":"Allow","Principal":{"AWS":["arn:aws:iam:::user/testuser"]},"Action":["sts:AssumeRole"]}]}' 2024-04-16T18:15:14.170 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:14.170 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:14.170 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:14.171 INFO:rgw_multi.tests:success, zone: test-zone2 has role: roles-cjqttm-3 2024-04-16T18:15:14.171 INFO:rgw_multi.tests:deleting role: roles-cjqttm-3 2024-04-16T18:15:14.171 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteRole: calling handler 2024-04-16T18:15:14.171 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:14.171 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:14.172 DEBUG:botocore.hooks:Event before-call.iam.DeleteRole: calling handler 2024-04-16T18:15:14.172 DEBUG:botocore.hooks:Event before-call.iam.DeleteRole: calling handler 2024-04-16T18:15:14.172 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-3'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:14.172 DEBUG:botocore.hooks:Event request-created.iam.DeleteRole: calling handler > 2024-04-16T18:15:14.172 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteRole: calling handler 2024-04-16T18:15:14.172 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:14.173 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181514Z content-type;host;x-amz-date 093dfe12dbdbb47ece35a6b943c19f856b6a3b569a918ee92d444b947589bb5c 2024-04-16T18:15:14.173 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181514Z 20240416/test-zonegroup/iam/aws4_request 318c89d83028155c15fe16c1d201d14e041e4d33b62eaa5f5abec3b6dccc62ff 2024-04-16T18:15:14.173 DEBUG:botocore.auth:Signature: f31d8f57d0988f0012deab03a295e24dee3440ef0da8c9c951c43bf2abcc00cd 2024-04-16T18:15:14.173 DEBUG:botocore.hooks:Event request-created.iam.DeleteRole: calling handler 2024-04-16T18:15:14.173 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:14.182 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000006f983990a7774ffa-00661ec032-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '151', 'Date': 'Tue, 16 Apr 2024 18:15:14 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:14.182 DEBUG:botocore.parsers:Response body: b'tx000006f983990a7774ffa-00661ec032-4816-test-zone1' 2024-04-16T18:15:14.182 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteRole: calling handler 2024-04-16T18:15:14.183 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:14.183 DEBUG:botocore.hooks:Event after-call.iam.DeleteRole: calling handler 2024-04-16T18:15:14.183 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.183 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:14.231 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:14.231 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:14.282 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:14.304 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713291314.180915_350.1","last_update":"2024-04-16T18:15:14.180915Z"}] 2024-04-16T18:15:14.304 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T18:15:14.305 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:14.305 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.305 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.305 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:14.352 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:14.353 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:14.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:14.405+0000 7f2b7b928800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:14.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:14.406+0000 7f2b7b928800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:14.426 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291314.180915_350.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:14.180915Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T18:15:14.427 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291314.180915_350.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:14.180915Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T18:15:14.427 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291314.180915_350.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:14.180915Z', 'realm_epoch': 2}}] 2024-04-16T18:15:14.427 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T18:15:14.427 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T18:15:14.427 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:14.427 INFO:rgw_multi.tests:checking if zone: test-zone1 does not have role: roles-cjqttm-3 2024-04-16T18:15:14.430 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:14.430 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:14.430 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:14.431 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.431 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.431 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-3'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:14.431 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:14.431 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:14.432 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:14.432 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181514Z content-type;host;x-amz-date f5333e94483724e687c7b8e7c877aadc59cf0997347812bc3844ba13b03882b6 2024-04-16T18:15:14.432 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181514Z 20240416/test-zonegroup/iam/aws4_request 2fd437cb743f5fa94efa1d978cce354ac2ed88556ab9dad83711bfa5528a1aad 2024-04-16T18:15:14.432 DEBUG:botocore.auth:Signature: 6538dc39a17032262b805784aff447b4d0080fda7e1370b6ac4ede4b36f11c50 2024-04-16T18:15:14.432 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:14.432 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:14.435 DEBUG:botocore.parsers:Response headers: {'Content-Length': '328', 'x-amz-request-id': 'tx000003f567fca1266544d-00661ec032-4816-test-zone1', 'Accept-Ranges': 'bytes', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:14 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:14.435 DEBUG:botocore.parsers:Response body: b'NoSuchEntityNo such RoleName in the tenanttx000003f567fca1266544d-00661ec032-4816-test-zone14816-test-zone1-test-zonegroup' 2024-04-16T18:15:14.435 DEBUG:botocore.parsers:Response headers: {'Content-Length': '328', 'x-amz-request-id': 'tx000003f567fca1266544d-00661ec032-4816-test-zone1', 'Accept-Ranges': 'bytes', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:14 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:14.436 DEBUG:botocore.parsers:Response body: b'NoSuchEntityNo such RoleName in the tenanttx000003f567fca1266544d-00661ec032-4816-test-zone14816-test-zone1-test-zonegroup' 2024-04-16T18:15:14.436 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:14.436 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:14.436 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:14.436 INFO:rgw_multi.tests:success, zone: test-zone1 does not have role: roles-cjqttm-3 2024-04-16T18:15:14.436 INFO:rgw_multi.tests:checking if zone: test-zone2 does not have role: roles-cjqttm-3 2024-04-16T18:15:14.436 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:14.437 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:14.437 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:14.437 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.437 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:14.437 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-3'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:14.437 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:14.438 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:14.438 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:14.438 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181514Z content-type;host;x-amz-date f5333e94483724e687c7b8e7c877aadc59cf0997347812bc3844ba13b03882b6 2024-04-16T18:15:14.438 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181514Z 20240416/test-zonegroup/iam/aws4_request 21cf8d5d7d0393fe5a14b5a52f6f821857f897e569b666bcb28b4e9ca6ec02a6 2024-04-16T18:15:14.438 DEBUG:botocore.auth:Signature: 86463431e67cb40dba3917b6bd4e6bc53997141b5332874eea6ebe8fd75080b1 2024-04-16T18:15:14.439 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:14.439 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:14.441 DEBUG:botocore.parsers:Response headers: {'Content-Length': '328', 'x-amz-request-id': 'tx00000667cff5a96ced107-00661ec032-5447-test-zone2', 'Accept-Ranges': 'bytes', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:14 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:14.441 DEBUG:botocore.parsers:Response body: b'NoSuchEntityNo such RoleName in the tenanttx00000667cff5a96ced107-00661ec032-5447-test-zone25447-test-zone2-test-zonegroup' 2024-04-16T18:15:14.445 DEBUG:botocore.parsers:Response headers: {'Content-Length': '328', 'x-amz-request-id': 'tx00000667cff5a96ced107-00661ec032-5447-test-zone2', 'Accept-Ranges': 'bytes', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:14 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:14.445 DEBUG:botocore.parsers:Response body: b'NoSuchEntityNo such RoleName in the tenanttx00000667cff5a96ced107-00661ec032-5447-test-zone25447-test-zone2-test-zonegroup' 2024-04-16T18:15:14.446 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:14.446 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:14.446 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:14.446 INFO:rgw_multi.tests:success, zone: test-zone2 does not have role: roles-cjqttm-3 2024-04-16T18:15:14.446 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_role_delete_sync ... ok 2024-04-16T18:15:14.447 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.447 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:14.495 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:14.495 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:14.545 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:14.567 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713291314.180915_350.1","last_update":"2024-04-16T18:15:14.180915Z"}] 2024-04-16T18:15:14.567 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T18:15:14.567 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:14.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:14.568 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:14.616 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:14.617 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:14.668 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:14.670+0000 7f35aed2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:14.670 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:14.672+0000 7f35aed2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:14.692 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291314.180915_350.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:14.180915Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T18:15:14.692 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291314.180915_350.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:14.180915Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T18:15:14.692 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291314.180915_350.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:14.180915Z', 'realm_epoch': 2}}] 2024-04-16T18:15:14.692 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T18:15:14.692 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T18:15:14.692 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:19.694 INFO:rgw_multi.tests:create topic zone=test-zone1 name=topic-cjqttm-1 2024-04-16T18:15:19.695 DEBUG:botocore.hooks:Event before-parameter-build.sns.CreateTopic: calling handler 2024-04-16T18:15:19.695 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:19.695 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:19.696 DEBUG:botocore.hooks:Event before-call.sns.CreateTopic: calling handler 2024-04-16T18:15:19.696 DEBUG:botocore.hooks:Event before-call.sns.CreateTopic: calling handler 2024-04-16T18:15:19.696 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateTopic) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateTopic', 'Version': '2010-03-31', 'Name': 'topic-cjqttm-1', 'Attributes.entry.1.key': 'push-endpoint', 'Attributes.entry.1.value': 'http://kaboom:9999', 'Attributes.entry.2.key': 'persistent', 'Attributes.entry.2.value': 'true'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:19.696 DEBUG:botocore.hooks:Event request-created.sns.CreateTopic: calling handler > 2024-04-16T18:15:19.696 DEBUG:botocore.hooks:Event choose-signer.sns.CreateTopic: calling handler 2024-04-16T18:15:19.697 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:19.697 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181519Z content-type;host;x-amz-date 143e8697d4d1b89ffe8717ebae450129ef0779812ba4588b7aa438384e39b1b2 2024-04-16T18:15:19.697 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181519Z 20240416/test-zonegroup/sns/aws4_request 54286e1399496909cbbddae0ca49766bdf2d833083a0e7ae7cfc9b71ed116ed9 2024-04-16T18:15:19.697 DEBUG:botocore.auth:Signature: ec6ba6bbec73bdd5791dd39cd492ab3457bcc32f8a4b30720e3c420bf89e55d4 2024-04-16T18:15:19.698 DEBUG:botocore.hooks:Event request-created.sns.CreateTopic: calling handler 2024-04-16T18:15:19.698 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:19.713 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000ce204c6e1c75c5b7-00661ec037-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '337', 'Date': 'Tue, 16 Apr 2024 18:15:19 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:19.713 DEBUG:botocore.parsers:Response body: b'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-19ba59572-f51c-4bce-9578-e6350e822996.4816.14852955606875489719' 2024-04-16T18:15:19.713 DEBUG:botocore.hooks:Event needs-retry.sns.CreateTopic: calling handler 2024-04-16T18:15:19.714 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:19.714 INFO:rgw_multi.tests:create topic zone=test-zone2 name=topic-cjqttm-2 2024-04-16T18:15:19.714 DEBUG:botocore.hooks:Event before-parameter-build.sns.CreateTopic: calling handler 2024-04-16T18:15:19.714 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:19.715 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:19.715 DEBUG:botocore.hooks:Event before-call.sns.CreateTopic: calling handler 2024-04-16T18:15:19.715 DEBUG:botocore.hooks:Event before-call.sns.CreateTopic: calling handler 2024-04-16T18:15:19.715 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateTopic) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateTopic', 'Version': '2010-03-31', 'Name': 'topic-cjqttm-2', 'Attributes.entry.1.key': 'push-endpoint', 'Attributes.entry.1.value': 'http://kaboom:9999', 'Attributes.entry.2.key': 'persistent', 'Attributes.entry.2.value': 'true'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:19.716 DEBUG:botocore.hooks:Event request-created.sns.CreateTopic: calling handler > 2024-04-16T18:15:19.716 DEBUG:botocore.hooks:Event choose-signer.sns.CreateTopic: calling handler 2024-04-16T18:15:19.716 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:19.716 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181519Z content-type;host;x-amz-date eab586312b6fe392ab072b498350a9e2e6af69ab7b2a7f151f87ed7361d24143 2024-04-16T18:15:19.716 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181519Z 20240416/test-zonegroup/sns/aws4_request 6ced9799f72148de04ec9c8c0240c456083e59e5de0ad6e20cb51225cc496142 2024-04-16T18:15:19.717 DEBUG:botocore.auth:Signature: 986a53a11a04c6c6ed7a3dea3c36197b9e17957c3e5259f6c5ead84e53988bc8 2024-04-16T18:15:19.717 DEBUG:botocore.hooks:Event request-created.sns.CreateTopic: calling handler 2024-04-16T18:15:19.717 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:19.740 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000136a03545c59897d-00661ec037-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '336', 'Date': 'Tue, 16 Apr 2024 18:15:19 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:19.740 DEBUG:botocore.parsers:Response body: b'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2316ebd79-1e8f-459c-be24-e6b3e0dc08e5.5447.1398934295113468285' 2024-04-16T18:15:19.741 DEBUG:botocore.hooks:Event needs-retry.sns.CreateTopic: calling handler 2024-04-16T18:15:19.741 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:19.741 DEBUG:rgw_multi.tests:topic_arns: ['arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1', 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2'] 2024-04-16T18:15:19.741 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:19.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:19.742 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:19.794 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:19.795 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:19.851 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:19.874 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713291319.732978_352.1","last_update":"2024-04-16T18:15:19.732978Z"}] 2024-04-16T18:15:19.874 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T18:15:19.874 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:19.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:19.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:19.875 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:19.932 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:19.932 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:19.985 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:19.987+0000 7fc59e12f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:19.986 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:19.989+0000 7fc59e12f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:20.010 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:19Z"} 2024-04-16T18:15:20.010 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:19Z"} 2024-04-16T18:15:20.010 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291319.732978_352.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:19.732978Z', 'realm_epoch': 2}}] 2024-04-16T18:15:20.011 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T18:15:20.011 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T18:15:20.011 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:20.011 DEBUG:botocore.hooks:Event before-parameter-build.sns.ListTopics: calling handler 2024-04-16T18:15:20.011 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:20.011 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:20.012 DEBUG:botocore.hooks:Event before-call.sns.ListTopics: calling handler 2024-04-16T18:15:20.012 DEBUG:botocore.hooks:Event before-call.sns.ListTopics: calling handler 2024-04-16T18:15:20.012 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListTopics) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListTopics', 'Version': '2010-03-31'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:20.012 DEBUG:botocore.hooks:Event request-created.sns.ListTopics: calling handler > 2024-04-16T18:15:20.012 DEBUG:botocore.hooks:Event choose-signer.sns.ListTopics: calling handler 2024-04-16T18:15:20.013 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:20.013 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181520Z content-type;host;x-amz-date 55e772bd3d832d8507965af84ab07fd17d9be3cbb788151ceb0d7fc2be442a54 2024-04-16T18:15:20.013 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181520Z 20240416/test-zonegroup/sns/aws4_request 3eb3e654525218ab8b46bf1bb96ec27bc05ff3ff0099448fb02c4d680e9704b8 2024-04-16T18:15:20.013 DEBUG:botocore.auth:Signature: 8be91d1ba0ead1604afe82574cd8cf38aef4cbdebb01664a569481c1e064430b 2024-04-16T18:15:20.013 DEBUG:botocore.hooks:Event request-created.sns.ListTopics: calling handler 2024-04-16T18:15:20.013 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:20.016 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000f814ad404aa5e6bf-00661ec038-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1415', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:20.016 DEBUG:botocore.parsers:Response body: b'RGW11111111111111111topic-cjqttm-1http://kaboom:9999Version=2010-03-31topic-cjqttm-1FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1RGW11111111111111111topic-cjqttm-2http://kaboom:9999Version=2010-03-31&rgwx-uid=RGW11111111111111111&rgwx-zonegroup=test-zonegrouptopic-cjqttm-2FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-29ba59572-f51c-4bce-9578-e6350e822996.4816.17876103312582239935' 2024-04-16T18:15:20.017 DEBUG:botocore.hooks:Event needs-retry.sns.ListTopics: calling handler 2024-04-16T18:15:20.017 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:20.017 DEBUG:rgw_multi.tests:topics for zone=test-zone1 = [{'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1'}, {'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2'}] 2024-04-16T18:15:20.017 DEBUG:botocore.hooks:Event before-parameter-build.sns.ListTopics: calling handler 2024-04-16T18:15:20.018 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:20.018 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:20.018 DEBUG:botocore.hooks:Event before-call.sns.ListTopics: calling handler 2024-04-16T18:15:20.018 DEBUG:botocore.hooks:Event before-call.sns.ListTopics: calling handler 2024-04-16T18:15:20.018 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListTopics) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListTopics', 'Version': '2010-03-31'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:20.019 DEBUG:botocore.hooks:Event request-created.sns.ListTopics: calling handler > 2024-04-16T18:15:20.019 DEBUG:botocore.hooks:Event choose-signer.sns.ListTopics: calling handler 2024-04-16T18:15:20.019 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:20.019 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181520Z content-type;host;x-amz-date 55e772bd3d832d8507965af84ab07fd17d9be3cbb788151ceb0d7fc2be442a54 2024-04-16T18:15:20.019 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181520Z 20240416/test-zonegroup/sns/aws4_request 3b028bc1933c690628a4ede59671e938c615aafbe7df102c22c60837cd3a3604 2024-04-16T18:15:20.020 DEBUG:botocore.auth:Signature: f2150ad8a63614bfea53643f1e44b819586eb8d9665429c3bc7150b427d09ac6 2024-04-16T18:15:20.020 DEBUG:botocore.hooks:Event request-created.sns.ListTopics: calling handler 2024-04-16T18:15:20.020 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:20.023 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000087c3181813bde49-00661ec038-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1413', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:20.023 DEBUG:botocore.parsers:Response body: b'RGW11111111111111111topic-cjqttm-1http://kaboom:9999Version=2010-03-31topic-cjqttm-1FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1RGW11111111111111111topic-cjqttm-2http://kaboom:9999Version=2010-03-31&rgwx-uid=RGW11111111111111111&rgwx-zonegroup=test-zonegrouptopic-cjqttm-2FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2316ebd79-1e8f-459c-be24-e6b3e0dc08e5.5447.611418081704271433' 2024-04-16T18:15:20.023 DEBUG:botocore.hooks:Event needs-retry.sns.ListTopics: calling handler 2024-04-16T18:15:20.024 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:20.024 DEBUG:rgw_multi.tests:topics for zone=test-zone2 = [{'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1'}, {'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2'}] 2024-04-16T18:15:20.024 DEBUG:boto:path=/cjqttm-49/ 2024-04-16T18:15:20.024 DEBUG:boto:auth_path=/cjqttm-49/ 2024-04-16T18:15:20.025 DEBUG:boto:Method: PUT 2024-04-16T18:15:20.025 DEBUG:boto:Path: /cjqttm-49/ 2024-04-16T18:15:20.025 DEBUG:boto:Data: 2024-04-16T18:15:20.025 DEBUG:boto:Headers: {} 2024-04-16T18:15:20.025 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:20.025 DEBUG:boto:Port: 8000 2024-04-16T18:15:20.025 DEBUG:boto:Params: {} 2024-04-16T18:15:20.026 DEBUG:boto:Token: None 2024-04-16T18:15:20.026 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:15:20 GMT /cjqttm-49/ 2024-04-16T18:15:20.026 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ToqELyd2y37zEYZX6tO/d95TAg= 2024-04-16T18:15:20.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ToqELyd2y37zEYZX6tO/d95TAg=', 'Content-Length': '0'} 2024-04-16T18:15:20.042 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx0000054d36cfab5e34f29-00661ec038-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:20.042 DEBUG:rgw_multi.tests:created bucket=cjqttm-49 2024-04-16T18:15:20.042 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:20.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:20.042 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:20.090 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:20.165 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291320.041920_721.1","last_update":"2024-04-16T18:15:20.041920Z"},{"marker":"1_1713291319.732978_352.1","last_update":"2024-04-16T18:15:19.732978Z"}] 2024-04-16T18:15:20.165 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291320.041920_721.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T18:15:20.165 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:20.165 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:20.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:20.166 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:20.215 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:20.216 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:20.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:20.269+0000 7fde21e16800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:20.269 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:20.271+0000 7fde21e16800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:20.290 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291320.041920_721.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:20.041920Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:20Z"} 2024-04-16T18:15:20.290 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291320.041920_721.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:20.041920Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:20Z"} 2024-04-16T18:15:20.290 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291320.041920_721.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:20.041920Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291319.732978_352.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:19.732978Z', 'realm_epoch': 2}}] 2024-04-16T18:15:20.290 DEBUG:rgw_multi.tests:log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291320.041920_721.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T18:15:20.291 DEBUG:rgw_multi.tests:sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291320.041920_721.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T18:15:20.291 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:20.291 INFO:rgw_multi.tests:creating bucket notification for zone=test-zone1 name=bn-cjqttm-1 2024-04-16T18:15:20.291 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.291 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.292 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.292 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.292 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.292 DEBUG:botocore.hooks:Event before-endpoint-resolution.s3: calling handler 2024-04-16T18:15:20.292 DEBUG:botocore.hooks:Event before-endpoint-resolution.s3: calling handler > 2024-04-16T18:15:20.292 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Bucket': 'cjqttm-49', 'Region': 'test-zonegroup', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True} 2024-04-16T18:15:20.293 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000/cjqttm-49 2024-04-16T18:15:20.294 DEBUG:botocore.regions:Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None" 2024-04-16T18:15:20.294 DEBUG:botocore.regions:Selected auth type "v4" as "v4" with signing context params: {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True} 2024-04-16T18:15:20.295 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.295 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.295 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.295 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.295 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutBucketNotificationConfiguration) with params: {'url_path': '?notification', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': b'bn-cjqttm-1arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1s3:ObjectCreated:*', 'auth_path': '/cjqttm-49/', 'url': 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-49?notification', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'cjqttm-49', 'params': {'Bucket': 'cjqttm-49', 'NotificationConfiguration': {'TopicConfigurations': [{'Id': 'bn-cjqttm-1', 'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1', 'Events': ['s3:ObjectCreated:*']}]}}}, 'S3Express': {'bucket_name': 'cjqttm-49'}, 'signing': {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'test-zonegroup'}]}}} 2024-04-16T18:15:20.296 DEBUG:botocore.hooks:Event request-created.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.296 DEBUG:botocore.hooks:Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.296 DEBUG:botocore.hooks:Event before-sign.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.296 DEBUG:botocore.hooks:Event before-sign.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.297 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:20.297 DEBUG:botocore.auth:CanonicalRequest: PUT /cjqttm-49 notification= host:smithi016.front.sepia.ceph.com:8000 x-amz-content-sha256:d11c39716a8496def07b586cb60f26239aad49faa703a743fe0923189299507f x-amz-date:20240416T181520Z host;x-amz-content-sha256;x-amz-date d11c39716a8496def07b586cb60f26239aad49faa703a743fe0923189299507f 2024-04-16T18:15:20.297 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181520Z 20240416/test-zonegroup/s3/aws4_request 497d5f2adb1bf890ee7a9a7b966230cc4c69d83e1a9686edd68155058b9e1ec4 2024-04-16T18:15:20.297 DEBUG:botocore.auth:Signature: 739f626990db4e7d5b8a1a2f9703c1fe75bc6a2e823aaee8e9fde2495c5df5ef 2024-04-16T18:15:20.297 DEBUG:botocore.hooks:Event request-created.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.297 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:20.308 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000df1ee8fa502afd43-00661ec038-4816-test-zone1', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '0', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:20.308 DEBUG:botocore.parsers:Response body: b'' 2024-04-16T18:15:20.308 DEBUG:botocore.hooks:Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.308 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:20.308 DEBUG:botocore.hooks:Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.309 INFO:rgw_multi.tests:creating bucket notification for zone=test-zone2 name=bn-cjqttm-2 2024-04-16T18:15:20.309 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.309 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.309 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.309 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.309 DEBUG:botocore.hooks:Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.309 DEBUG:botocore.hooks:Event before-endpoint-resolution.s3: calling handler 2024-04-16T18:15:20.310 DEBUG:botocore.hooks:Event before-endpoint-resolution.s3: calling handler > 2024-04-16T18:15:20.310 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Bucket': 'cjqttm-49', 'Region': 'test-zonegroup', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True} 2024-04-16T18:15:20.310 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000/cjqttm-49 2024-04-16T18:15:20.311 DEBUG:botocore.regions:Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None" 2024-04-16T18:15:20.311 DEBUG:botocore.regions:Selected auth type "v4" as "v4" with signing context params: {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True} 2024-04-16T18:15:20.311 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.312 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.312 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.312 DEBUG:botocore.hooks:Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.312 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutBucketNotificationConfiguration) with params: {'url_path': '?notification', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': b'bn-cjqttm-2arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2s3:ObjectCreated:*', 'auth_path': '/cjqttm-49/', 'url': 'http://smithi139.front.sepia.ceph.com:8000/cjqttm-49?notification', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'cjqttm-49', 'params': {'Bucket': 'cjqttm-49', 'NotificationConfiguration': {'TopicConfigurations': [{'Id': 'bn-cjqttm-2', 'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2', 'Events': ['s3:ObjectCreated:*']}]}}}, 'S3Express': {'bucket_name': 'cjqttm-49'}, 'signing': {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'test-zonegroup'}]}}} 2024-04-16T18:15:20.312 DEBUG:botocore.hooks:Event request-created.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.312 DEBUG:botocore.hooks:Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.313 DEBUG:botocore.hooks:Event before-sign.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.313 DEBUG:botocore.hooks:Event before-sign.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:20.313 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:20.313 DEBUG:botocore.auth:CanonicalRequest: PUT /cjqttm-49 notification= host:smithi139.front.sepia.ceph.com:8000 x-amz-content-sha256:759a7fbb80932044083686943d25476291ae96db6e81495b86d1c90721e1d90c x-amz-date:20240416T181520Z host;x-amz-content-sha256;x-amz-date 759a7fbb80932044083686943d25476291ae96db6e81495b86d1c90721e1d90c 2024-04-16T18:15:20.313 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181520Z 20240416/test-zonegroup/s3/aws4_request e74b0feb7f36acdd89560fdd3d6e9193e1a4ed9ec63f0818d92cf97721024709 2024-04-16T18:15:20.313 DEBUG:botocore.auth:Signature: eff9ae3e9aafb78cf44757a088f15e662253f683894a8ef1da03c5687bc778a1 2024-04-16T18:15:20.313 DEBUG:botocore.hooks:Event request-created.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:20.314 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.330 DEBUG:botocore.parsers:Response headers: {'Content-Length': '261', 'x-amz-request-id': 'tx000001c6cf4aef8b4a664-00661ec038-5447-test-zone2', 'Accept-Ranges': 'bytes', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.330 DEBUG:botocore.parsers:Response body: b'ConcurrentModificationcjqttm-49tx000001c6cf4aef8b4a664-00661ec038-5447-test-zone25447-test-zone2-test-zonegroup' 2024-04-16T18:15:21.334 DEBUG:botocore.hooks:Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T18:15:21.334 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.334 DEBUG:botocore.hooks:Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T18:15:21.357 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_topic_notification_sync ... ERROR 2024-04-16T18:15:21.359 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateUser: calling handler 2024-04-16T18:15:21.359 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.360 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.360 DEBUG:botocore.hooks:Event before-call.iam.CreateUser: calling handler 2024-04-16T18:15:21.360 DEBUG:botocore.hooks:Event before-call.iam.CreateUser: calling handler 2024-04-16T18:15:21.360 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateUser', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.361 DEBUG:botocore.hooks:Event request-created.iam.CreateUser: calling handler > 2024-04-16T18:15:21.361 DEBUG:botocore.hooks:Event choose-signer.iam.CreateUser: calling handler 2024-04-16T18:15:21.362 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.362 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date f7475b30454e8ffcb361ce7c694a8facda3014395dff383d48edb4ca989ef6b0 2024-04-16T18:15:21.362 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request ffb43e766a210baa9159b2b65ae9388c21006aa21a769bcbe522738fd51e8472 2024-04-16T18:15:21.362 DEBUG:botocore.auth:Signature: 519064727fbd473a7f08ebebdf84294acb4d6e8ef836f7f1d0b4d12d291afe2d 2024-04-16T18:15:21.363 DEBUG:botocore.hooks:Event request-created.iam.CreateUser: calling handler 2024-04-16T18:15:21.363 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.374 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000038272bbac6b411f3-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '499', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.375 DEBUG:botocore.parsers:Response body: b'/test-zone1255da143-d579-4866-8dd6-a847a953c645arn:aws:iam::RGW11111111111111111:user/test-zone12024-04-16T18:15:21.368818Ztx0000038272bbac6b411f3-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.376 DEBUG:botocore.hooks:Event needs-retry.iam.CreateUser: calling handler 2024-04-16T18:15:21.376 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.376 DEBUG:botocore.hooks:Event after-call.iam.CreateUser: calling handler 2024-04-16T18:15:21.376 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.377 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.377 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.377 DEBUG:botocore.hooks:Event before-call.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.377 DEBUG:botocore.hooks:Event before-call.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.378 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateAccessKey) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateAccessKey', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.378 DEBUG:botocore.hooks:Event request-created.iam.CreateAccessKey: calling handler > 2024-04-16T18:15:21.378 DEBUG:botocore.hooks:Event choose-signer.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.379 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.379 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 2d56745a01c086ed0203077dd4eef7bcaf00472bb3389da335fbf28f3732fcd0 2024-04-16T18:15:21.379 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request fe6d85bd9663c386b55f77230638684c532ac46140a7d76d953415c113b6bd03 2024-04-16T18:15:21.379 DEBUG:botocore.auth:Signature: 027fc874ae78c87b7004addb763768c61e5a68f5680f6850f864e04d85d22084 2024-04-16T18:15:21.380 DEBUG:botocore.hooks:Event request-created.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.380 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.392 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e259daa368de566d-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '547', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.392 DEBUG:botocore.parsers:Response body: b'test-zone1L54B5JRY5QAP851HQA4CActive2024-04-16T18:15:21.386460Z5Y0XyJLkDnrcrcTTN8SfAbi4C4EtfrfMcC6AsTbUtx00000e259daa368de566d-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.393 DEBUG:botocore.hooks:Event needs-retry.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.394 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.394 DEBUG:botocore.hooks:Event after-call.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.394 DEBUG:botocore.hooks:Event before-parameter-build.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.395 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.395 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.395 DEBUG:botocore.hooks:Event before-call.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.396 DEBUG:botocore.hooks:Event before-call.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.396 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'PutUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone1', 'PolicyName': 'Allow', 'PolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.396 DEBUG:botocore.hooks:Event request-created.iam.PutUserPolicy: calling handler > 2024-04-16T18:15:21.396 DEBUG:botocore.hooks:Event choose-signer.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.397 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.397 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 17879975ab2692d579dfbda99a028060b29570530de8c9f87e064005597017ac 2024-04-16T18:15:21.397 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 5f670b5255cd9693ad55e451a9fb8ffb7028722782a0401fffa470475b2d64ed 2024-04-16T18:15:21.398 DEBUG:botocore.auth:Signature: 30f1e90b8dda74ad47e7183a104395f131a217120e81c6e7d9b0218249cadb5e 2024-04-16T18:15:21.398 DEBUG:botocore.hooks:Event request-created.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.398 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.411 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000004067631d059bc60a-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '207', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.411 DEBUG:botocore.parsers:Response body: b'tx000004067631d059bc60a-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.412 DEBUG:botocore.hooks:Event needs-retry.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.412 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.412 DEBUG:botocore.hooks:Event after-call.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.413 DEBUG:botocore.hooks:Event before-parameter-build.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.413 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.413 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.413 DEBUG:botocore.hooks:Event before-call.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.414 DEBUG:botocore.hooks:Event before-call.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.414 DEBUG:botocore.endpoint:Making request for OperationModel(name=AttachUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AttachUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone1', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.414 DEBUG:botocore.hooks:Event request-created.iam.AttachUserPolicy: calling handler > 2024-04-16T18:15:21.414 DEBUG:botocore.hooks:Event choose-signer.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.415 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.415 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 6bae6a67a9faf220198a4254a71b23780816be124b7a0f3c4c5492c739caeaa2 2024-04-16T18:15:21.415 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request f9250abc3301345887354773c0fb9372f4b1313bd89f4c5e130cfa760254b144 2024-04-16T18:15:21.415 DEBUG:botocore.auth:Signature: bf90359b2c2d41760b29f5d75477f749b71b052434dcbf85160e870fa1e2ef38 2024-04-16T18:15:21.416 DEBUG:botocore.hooks:Event request-created.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.416 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.470 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000008e8367cef01d4c8f-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.471 DEBUG:botocore.parsers:Response body: b'tx000008e8367cef01d4c8f-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.471 DEBUG:botocore.hooks:Event needs-retry.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.471 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.471 DEBUG:botocore.hooks:Event after-call.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.472 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateGroup: calling handler 2024-04-16T18:15:21.472 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.472 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.473 DEBUG:botocore.hooks:Event before-call.iam.CreateGroup: calling handler 2024-04-16T18:15:21.473 DEBUG:botocore.hooks:Event before-call.iam.CreateGroup: calling handler 2024-04-16T18:15:21.473 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.473 DEBUG:botocore.hooks:Event request-created.iam.CreateGroup: calling handler > 2024-04-16T18:15:21.474 DEBUG:botocore.hooks:Event choose-signer.iam.CreateGroup: calling handler 2024-04-16T18:15:21.474 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.474 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 624e928373ac8004a209ec47e507ab54a865f60c2f07522729232344f4ba6c8a 2024-04-16T18:15:21.475 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request df205acc4f23307907b63671948d33bc614c025ab3aa6cd00fb836fd7aead500 2024-04-16T18:15:21.475 DEBUG:botocore.auth:Signature: 5c7bd1bf661d89e2bf134b6355bf82e570bb0ce9376a6bb9b6b9dd56119aed1e 2024-04-16T18:15:21.475 DEBUG:botocore.hooks:Event request-created.iam.CreateGroup: calling handler 2024-04-16T18:15:21.475 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.487 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000eb0bb5e76f7bcea6-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '458', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.487 DEBUG:botocore.parsers:Response body: b'/test-zone1708ed322-dd11-47ee-9731-07fa113c96dfarn:aws:iam::RGW11111111111111111:group/test-zone1tx00000eb0bb5e76f7bcea6-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.487 DEBUG:botocore.hooks:Event needs-retry.iam.CreateGroup: calling handler 2024-04-16T18:15:21.487 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.488 DEBUG:botocore.hooks:Event after-call.iam.CreateGroup: calling handler 2024-04-16T18:15:21.488 DEBUG:botocore.hooks:Event before-parameter-build.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.488 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.488 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.489 DEBUG:botocore.hooks:Event before-call.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.489 DEBUG:botocore.hooks:Event before-call.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.489 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'PutGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone1', 'PolicyName': 'Allow', 'PolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.489 DEBUG:botocore.hooks:Event request-created.iam.PutGroupPolicy: calling handler > 2024-04-16T18:15:21.490 DEBUG:botocore.hooks:Event choose-signer.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.490 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.491 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date ad4c82339605c3b58275f685e51aaa8f175f9d7bfa75f418f3b90f7c7b4bf620 2024-04-16T18:15:21.491 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request e69b6a1608ae07fc2de5e6c4eb7cf4b80da1b47f692cf8ce870748b599c284b8 2024-04-16T18:15:21.491 DEBUG:botocore.auth:Signature: a8e40db50e86606d3df971a92df4355e23973d8e0f8e45b0a968af13835337ed 2024-04-16T18:15:21.491 DEBUG:botocore.hooks:Event request-created.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.494 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.500 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000002b3c5713e001176d-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '247', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.500 DEBUG:botocore.parsers:Response body: b'tx000002b3c5713e001176d-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.501 DEBUG:botocore.hooks:Event needs-retry.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.501 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.501 DEBUG:botocore.hooks:Event after-call.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.502 DEBUG:botocore.hooks:Event before-parameter-build.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.503 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.503 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.503 DEBUG:botocore.hooks:Event before-call.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.503 DEBUG:botocore.hooks:Event before-call.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.504 DEBUG:botocore.endpoint:Making request for OperationModel(name=AttachGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AttachGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone1', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.504 DEBUG:botocore.hooks:Event request-created.iam.AttachGroupPolicy: calling handler > 2024-04-16T18:15:21.504 DEBUG:botocore.hooks:Event choose-signer.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.505 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.505 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 6650eb41f571a51390e5e4d8fe1d82748ac41b679798f9d70d71a7c097ba721b 2024-04-16T18:15:21.505 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 45da34929615fae61931d76d42a05d85374dc0da70c0f2dd4a7ce76fd00beaeb 2024-04-16T18:15:21.505 DEBUG:botocore.auth:Signature: cbe6303be3bbc2aa791d1e11ad7740c3002974a63108d19f5a0db17b875f4c10 2024-04-16T18:15:21.505 DEBUG:botocore.hooks:Event request-created.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.506 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.555 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000095ca50b2d3c951ee-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '253', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.555 DEBUG:botocore.parsers:Response body: b'tx0000095ca50b2d3c951ee-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.555 DEBUG:botocore.hooks:Event needs-retry.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.555 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.555 DEBUG:botocore.hooks:Event after-call.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.556 DEBUG:botocore.hooks:Event before-parameter-build.iam.AddUserToGroup: calling handler 2024-04-16T18:15:21.556 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.556 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.557 DEBUG:botocore.hooks:Event before-call.iam.AddUserToGroup: calling handler 2024-04-16T18:15:21.557 DEBUG:botocore.hooks:Event before-call.iam.AddUserToGroup: calling handler 2024-04-16T18:15:21.557 DEBUG:botocore.endpoint:Making request for OperationModel(name=AddUserToGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AddUserToGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone1', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.557 DEBUG:botocore.hooks:Event request-created.iam.AddUserToGroup: calling handler > 2024-04-16T18:15:21.557 DEBUG:botocore.hooks:Event choose-signer.iam.AddUserToGroup: calling handler 2024-04-16T18:15:21.558 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.558 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date b828f4a28c8d0ee119b54a503ae785618cc0a7bd2f1ba220c61d60c88189b9de 2024-04-16T18:15:21.558 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 876be43df31d93677d32517262857d1db6a3dbf2201ceef8beb8a17fc57011c4 2024-04-16T18:15:21.558 DEBUG:botocore.auth:Signature: 37baad5c5b4d31b773036739d10466cadc57c9daf840734353e7c52f522fd9f8 2024-04-16T18:15:21.559 DEBUG:botocore.hooks:Event request-created.iam.AddUserToGroup: calling handler 2024-04-16T18:15:21.559 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.570 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000023b9e35ff31681b1-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '247', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.570 DEBUG:botocore.parsers:Response body: b'tx0000023b9e35ff31681b1-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.570 DEBUG:botocore.hooks:Event needs-retry.iam.AddUserToGroup: calling handler 2024-04-16T18:15:21.570 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.571 DEBUG:botocore.hooks:Event after-call.iam.AddUserToGroup: calling handler 2024-04-16T18:15:21.571 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateRole: calling handler 2024-04-16T18:15:21.571 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.571 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.572 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:21.572 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:21.572 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateRole', 'Version': '2010-05-08', 'RoleName': 'test-zone1', 'AssumeRolePolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.572 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler > 2024-04-16T18:15:21.572 DEBUG:botocore.hooks:Event choose-signer.iam.CreateRole: calling handler 2024-04-16T18:15:21.573 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.573 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date b8dfbdc932156a00bb2505dfd736bc41e7bb2b32934a250726a1d2ae8ac7126c 2024-04-16T18:15:21.573 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 181c4c1cdb6708a74e0faaf2aa85640ed358b5fa1f678baf6f28e5630a0adb69 2024-04-16T18:15:21.573 DEBUG:botocore.auth:Signature: c337e97940e191e54da08724a403a9b68d71ef1b04a420c8815b192d1871ea39 2024-04-16T18:15:21.573 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler 2024-04-16T18:15:21.574 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.587 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000a5a16452f7003013-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '777', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.588 DEBUG:botocore.parsers:Response body: b'd5aaf93b-bda6-45e4-8d36-7778f10a91b7test-zone1/arn:aws:iam::RGW11111111111111111:role/test-zone12024-04-16T18:15:21.580Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}tx00000a5a16452f7003013-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.588 DEBUG:botocore.hooks:Event needs-retry.iam.CreateRole: calling handler 2024-04-16T18:15:21.588 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.589 DEBUG:botocore.hooks:Event after-call.iam.CreateRole: calling handler 2024-04-16T18:15:21.589 DEBUG:botocore.hooks:Event before-parameter-build.iam.PutRolePolicy: calling handler 2024-04-16T18:15:21.589 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.589 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.590 DEBUG:botocore.hooks:Event before-call.iam.PutRolePolicy: calling handler 2024-04-16T18:15:21.590 DEBUG:botocore.hooks:Event before-call.iam.PutRolePolicy: calling handler 2024-04-16T18:15:21.590 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'PutRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone1', 'PolicyName': 'Allow', 'PolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.591 DEBUG:botocore.hooks:Event request-created.iam.PutRolePolicy: calling handler > 2024-04-16T18:15:21.591 DEBUG:botocore.hooks:Event choose-signer.iam.PutRolePolicy: calling handler 2024-04-16T18:15:21.592 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.592 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date fbdda2fe5860cad2b2ea0a554f4430d72305dbdc0b7565c6cbd1cba689429a4d 2024-04-16T18:15:21.592 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 1066bf5bde91bbb0e9e87905a6c394096dc33fa66b29acc4cd216110d808fcd8 2024-04-16T18:15:21.592 DEBUG:botocore.auth:Signature: f87e646e1eac7860adc1dc9513856bac0dad3c102b6fd61e474114e370a8aac4 2024-04-16T18:15:21.592 DEBUG:botocore.hooks:Event request-created.iam.PutRolePolicy: calling handler 2024-04-16T18:15:21.593 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.642 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000293c8d7f67e9d2f3-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '157', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.643 DEBUG:botocore.parsers:Response body: b'tx00000293c8d7f67e9d2f3-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.643 DEBUG:botocore.hooks:Event needs-retry.iam.PutRolePolicy: calling handler 2024-04-16T18:15:21.643 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.643 DEBUG:botocore.hooks:Event after-call.iam.PutRolePolicy: calling handler 2024-04-16T18:15:21.644 DEBUG:botocore.hooks:Event before-parameter-build.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:21.644 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.644 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:21.644 DEBUG:botocore.hooks:Event before-call.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:21.644 DEBUG:botocore.hooks:Event before-call.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:21.645 DEBUG:botocore.endpoint:Making request for OperationModel(name=AttachRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AttachRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone1', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.645 DEBUG:botocore.hooks:Event request-created.iam.AttachRolePolicy: calling handler > 2024-04-16T18:15:21.645 DEBUG:botocore.hooks:Event choose-signer.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:21.646 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.646 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 98ed48432946a0db032c442aa66c08bd0e2e471826a731d2e6807950820ab209 2024-04-16T18:15:21.646 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 7662e0d3cf68ebe828a62c4b54918c7412bf5fa0dc5089eddc6823ad80e50b58 2024-04-16T18:15:21.646 DEBUG:botocore.auth:Signature: 4d2022e73e1862274744f5c5ed41d651e74f527356e464f757a6b6a4c7778132 2024-04-16T18:15:21.646 DEBUG:botocore.hooks:Event request-created.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:21.647 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.654 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000a3ed088fade89d50-00661ec039-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.654 DEBUG:botocore.parsers:Response body: b'tx00000a3ed088fade89d50-00661ec039-4816-test-zone1' 2024-04-16T18:15:21.655 DEBUG:botocore.hooks:Event needs-retry.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:21.655 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.655 DEBUG:botocore.hooks:Event after-call.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:21.655 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateUser: calling handler 2024-04-16T18:15:21.656 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.656 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:21.656 DEBUG:botocore.hooks:Event before-call.iam.CreateUser: calling handler 2024-04-16T18:15:21.656 DEBUG:botocore.hooks:Event before-call.iam.CreateUser: calling handler 2024-04-16T18:15:21.657 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateUser', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.657 DEBUG:botocore.hooks:Event request-created.iam.CreateUser: calling handler > 2024-04-16T18:15:21.657 DEBUG:botocore.hooks:Event choose-signer.iam.CreateUser: calling handler 2024-04-16T18:15:21.658 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.658 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 2510cb179a00379b5bc09d3a2af02e7e7b61a5cb434f7fa528d9845bf96444f3 2024-04-16T18:15:21.658 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 9f6cddd22c0fd241b1ae1585b874586324ee14a31f41437b3aa9d9c04c62ede6 2024-04-16T18:15:21.658 DEBUG:botocore.auth:Signature: 869de5ef5fdafb1f5a90046fb5393efca8d30ee0eb18b9dfa1fd0d44cf44577e 2024-04-16T18:15:21.658 DEBUG:botocore.hooks:Event request-created.iam.CreateUser: calling handler 2024-04-16T18:15:21.659 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.676 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000097c4e5fda09d9afe-00661ec039-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '499', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.676 DEBUG:botocore.parsers:Response body: b'/test-zone2de998ef8-5f83-4daf-9eb5-916c39046d7aarn:aws:iam::RGW11111111111111111:user/test-zone22024-04-16T18:15:21.664396Ztx0000097c4e5fda09d9afe-00661ec039-5447-test-zone2' 2024-04-16T18:15:21.676 DEBUG:botocore.hooks:Event needs-retry.iam.CreateUser: calling handler 2024-04-16T18:15:21.677 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.677 DEBUG:botocore.hooks:Event after-call.iam.CreateUser: calling handler 2024-04-16T18:15:21.677 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.677 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.677 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:21.678 DEBUG:botocore.hooks:Event before-call.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.678 DEBUG:botocore.hooks:Event before-call.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.678 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateAccessKey) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateAccessKey', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.678 DEBUG:botocore.hooks:Event request-created.iam.CreateAccessKey: calling handler > 2024-04-16T18:15:21.679 DEBUG:botocore.hooks:Event choose-signer.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.679 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.679 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date a0b5d5b3609514e9ba50d912aefb3a37850c6755f9d7985c4c4bb1c50f4d7f4b 2024-04-16T18:15:21.679 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 3021eb406eadbf295302edab540b7fb0b918b557178828b1b114c73e81477ee6 2024-04-16T18:15:21.680 DEBUG:botocore.auth:Signature: ed5de97d7004818bb1e5480f5f1d8705420281d62be09cd96e246e685c8be802 2024-04-16T18:15:21.680 DEBUG:botocore.hooks:Event request-created.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.680 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.779 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b4d17c1df7140155-00661ec039-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '547', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.779 DEBUG:botocore.parsers:Response body: b'test-zone2JK8ZAX4T5I1BOG34PU2IActive2024-04-16T18:15:21.687901ZEp29CWB5oMxmYaEAsnK1ZKWtt12Y9vIRAZEExD5ltx00000b4d17c1df7140155-00661ec039-5447-test-zone2' 2024-04-16T18:15:21.780 DEBUG:botocore.hooks:Event needs-retry.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.780 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.781 DEBUG:botocore.hooks:Event after-call.iam.CreateAccessKey: calling handler 2024-04-16T18:15:21.781 DEBUG:botocore.hooks:Event before-parameter-build.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.781 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.781 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:21.782 DEBUG:botocore.hooks:Event before-call.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.782 DEBUG:botocore.hooks:Event before-call.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.782 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'PutUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone2', 'PolicyName': 'Allow', 'PolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.782 DEBUG:botocore.hooks:Event request-created.iam.PutUserPolicy: calling handler > 2024-04-16T18:15:21.783 DEBUG:botocore.hooks:Event choose-signer.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.783 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.783 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 85bc49ee9891ccaf4f94397e9650c15250b819764da6ef0a05cb2450c32e0d43 2024-04-16T18:15:21.783 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request b4761fd1df13b6f391a2357b2e0069c4f9b7ee74998c50d3892b5cb990674f01 2024-04-16T18:15:21.784 DEBUG:botocore.auth:Signature: 8003710470a8d3a3e32a5e119760da13ffd6b9c83008204a042b8df7c9dfe2cf 2024-04-16T18:15:21.784 DEBUG:botocore.hooks:Event request-created.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.784 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.804 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000c9e7a59166b2b026-00661ec039-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '207', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.805 DEBUG:botocore.parsers:Response body: b'tx00000c9e7a59166b2b026-00661ec039-5447-test-zone2' 2024-04-16T18:15:21.805 DEBUG:botocore.hooks:Event needs-retry.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.805 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.805 DEBUG:botocore.hooks:Event after-call.iam.PutUserPolicy: calling handler 2024-04-16T18:15:21.806 DEBUG:botocore.hooks:Event before-parameter-build.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.806 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.806 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:21.807 DEBUG:botocore.hooks:Event before-call.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.807 DEBUG:botocore.hooks:Event before-call.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.807 DEBUG:botocore.endpoint:Making request for OperationModel(name=AttachUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AttachUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone2', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.807 DEBUG:botocore.hooks:Event request-created.iam.AttachUserPolicy: calling handler > 2024-04-16T18:15:21.807 DEBUG:botocore.hooks:Event choose-signer.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.808 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.808 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 9fa30c027a5dbbf088ce980f0476d5a9a21aa2fdc24be06e3279cba8bcdc470b 2024-04-16T18:15:21.808 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request b6f561c8cac2340e02051bcd7d03c8f5cd284368e2266e6a1b85c468ccea7818 2024-04-16T18:15:21.808 DEBUG:botocore.auth:Signature: cad28d7711f75378920e16f6583641dba5399b714c6e8244323f72d29a063fe6 2024-04-16T18:15:21.809 DEBUG:botocore.hooks:Event request-created.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.809 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.869 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000000a35dfa705056765-00661ec039-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.870 DEBUG:botocore.parsers:Response body: b'tx000000a35dfa705056765-00661ec039-5447-test-zone2' 2024-04-16T18:15:21.870 DEBUG:botocore.hooks:Event needs-retry.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.870 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.871 DEBUG:botocore.hooks:Event after-call.iam.AttachUserPolicy: calling handler 2024-04-16T18:15:21.871 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateGroup: calling handler 2024-04-16T18:15:21.871 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.871 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:21.872 DEBUG:botocore.hooks:Event before-call.iam.CreateGroup: calling handler 2024-04-16T18:15:21.872 DEBUG:botocore.hooks:Event before-call.iam.CreateGroup: calling handler 2024-04-16T18:15:21.872 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.872 DEBUG:botocore.hooks:Event request-created.iam.CreateGroup: calling handler > 2024-04-16T18:15:21.872 DEBUG:botocore.hooks:Event choose-signer.iam.CreateGroup: calling handler 2024-04-16T18:15:21.873 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.873 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 24a14e11b4493ec41142bbe4ace87bd6f70ba76e166d59411fd5edee5bcde329 2024-04-16T18:15:21.873 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 9faf345361e40529463220681a2723f339cbc79e1a4e796940cb15d9a59ce966 2024-04-16T18:15:21.873 DEBUG:botocore.auth:Signature: 7d09948aacb72a300284648682daca9cb87fc2363b8ff012f4f60c1d8d77ffd9 2024-04-16T18:15:21.873 DEBUG:botocore.hooks:Event request-created.iam.CreateGroup: calling handler 2024-04-16T18:15:21.874 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.974 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000ba9fc396b3479b44-00661ec039-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '458', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.975 DEBUG:botocore.parsers:Response body: b'/test-zone22458a53c-a367-43fe-b683-fe2f665bb6edarn:aws:iam::RGW11111111111111111:group/test-zone2tx00000ba9fc396b3479b44-00661ec039-5447-test-zone2' 2024-04-16T18:15:21.975 DEBUG:botocore.hooks:Event needs-retry.iam.CreateGroup: calling handler 2024-04-16T18:15:21.975 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.976 DEBUG:botocore.hooks:Event after-call.iam.CreateGroup: calling handler 2024-04-16T18:15:21.976 DEBUG:botocore.hooks:Event before-parameter-build.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.976 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.976 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:21.977 DEBUG:botocore.hooks:Event before-call.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.977 DEBUG:botocore.hooks:Event before-call.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.977 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'PutGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone2', 'PolicyName': 'Allow', 'PolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.977 DEBUG:botocore.hooks:Event request-created.iam.PutGroupPolicy: calling handler > 2024-04-16T18:15:21.977 DEBUG:botocore.hooks:Event choose-signer.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.978 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.978 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date ab7d67234b7569246e67b8e19e7bdcd215174800a0c659b8f2e5f4ac095702b5 2024-04-16T18:15:21.978 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request 410400a4e8ffc70686b1439ecfc5059854154c7f89786c8fd62d70a4b843cefc 2024-04-16T18:15:21.978 DEBUG:botocore.auth:Signature: e6703e30e3a02e84fc7f938491a2cc0143e722048da6d7a8f8e3d3eaff54afc2 2024-04-16T18:15:21.978 DEBUG:botocore.hooks:Event request-created.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.978 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:21.988 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000003a95776eeb531279-00661ec039-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '247', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:21.988 DEBUG:botocore.parsers:Response body: b'tx000003a95776eeb531279-00661ec039-5447-test-zone2' 2024-04-16T18:15:21.988 DEBUG:botocore.hooks:Event needs-retry.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.988 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:21.988 DEBUG:botocore.hooks:Event after-call.iam.PutGroupPolicy: calling handler 2024-04-16T18:15:21.989 DEBUG:botocore.hooks:Event before-parameter-build.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.989 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:21.989 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:21.989 DEBUG:botocore.hooks:Event before-call.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.989 DEBUG:botocore.hooks:Event before-call.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.989 DEBUG:botocore.endpoint:Making request for OperationModel(name=AttachGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AttachGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone2', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:21.990 DEBUG:botocore.hooks:Event request-created.iam.AttachGroupPolicy: calling handler > 2024-04-16T18:15:21.990 DEBUG:botocore.hooks:Event choose-signer.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.990 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:21.990 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181521Z content-type;host;x-amz-date 08d5ff802492dc9987af66bd4af8637b58974f1703349e3edf09538e4f34ef3a 2024-04-16T18:15:21.991 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181521Z 20240416/test-zonegroup/iam/aws4_request c717acf9a6d9d4c8779576662c1fafb16a79aae792dc360f801ae196cc6042b8 2024-04-16T18:15:21.991 DEBUG:botocore.auth:Signature: 0db83ce3135c063a4f2440b907709f6df6e629496310df104d5ddc228d881147 2024-04-16T18:15:21.991 DEBUG:botocore.hooks:Event request-created.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:21.991 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:22.040 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000218656dfef4a20c9-00661ec039-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '253', 'Date': 'Tue, 16 Apr 2024 18:15:22 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:22.040 DEBUG:botocore.parsers:Response body: b'tx00000218656dfef4a20c9-00661ec039-5447-test-zone2' 2024-04-16T18:15:22.040 DEBUG:botocore.hooks:Event needs-retry.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:22.040 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:22.041 DEBUG:botocore.hooks:Event after-call.iam.AttachGroupPolicy: calling handler 2024-04-16T18:15:22.041 DEBUG:botocore.hooks:Event before-parameter-build.iam.AddUserToGroup: calling handler 2024-04-16T18:15:22.041 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:22.041 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:22.041 DEBUG:botocore.hooks:Event before-call.iam.AddUserToGroup: calling handler 2024-04-16T18:15:22.042 DEBUG:botocore.hooks:Event before-call.iam.AddUserToGroup: calling handler 2024-04-16T18:15:22.042 DEBUG:botocore.endpoint:Making request for OperationModel(name=AddUserToGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AddUserToGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone2', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:22.042 DEBUG:botocore.hooks:Event request-created.iam.AddUserToGroup: calling handler > 2024-04-16T18:15:22.042 DEBUG:botocore.hooks:Event choose-signer.iam.AddUserToGroup: calling handler 2024-04-16T18:15:22.043 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:22.043 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181522Z content-type;host;x-amz-date b1a71af0ad1d86e1dce0f1ed3358241dd82bb321ef00b4200a506a73f65811f4 2024-04-16T18:15:22.043 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181522Z 20240416/test-zonegroup/iam/aws4_request 571b95b7f0e5b9cf79934cfd8792ad7e756c2208c8ce3bbe6ef59bdb66f67c2d 2024-04-16T18:15:22.043 DEBUG:botocore.auth:Signature: 627baa5770f1304e84877a9eff20c5275c58616d58c17b4c6e65cb113862f1cf 2024-04-16T18:15:22.043 DEBUG:botocore.hooks:Event request-created.iam.AddUserToGroup: calling handler 2024-04-16T18:15:22.043 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:22.138 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000670b59c7983abc1b-00661ec03a-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '247', 'Date': 'Tue, 16 Apr 2024 18:15:22 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:22.139 DEBUG:botocore.parsers:Response body: b'tx00000670b59c7983abc1b-00661ec03a-5447-test-zone2' 2024-04-16T18:15:22.139 DEBUG:botocore.hooks:Event needs-retry.iam.AddUserToGroup: calling handler 2024-04-16T18:15:22.139 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:22.139 DEBUG:botocore.hooks:Event after-call.iam.AddUserToGroup: calling handler 2024-04-16T18:15:22.139 DEBUG:botocore.hooks:Event before-parameter-build.iam.CreateRole: calling handler 2024-04-16T18:15:22.139 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:22.140 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:22.140 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:22.140 DEBUG:botocore.hooks:Event before-call.iam.CreateRole: calling handler 2024-04-16T18:15:22.140 DEBUG:botocore.endpoint:Making request for OperationModel(name=CreateRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateRole', 'Version': '2010-05-08', 'RoleName': 'test-zone2', 'AssumeRolePolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:22.140 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler > 2024-04-16T18:15:22.140 DEBUG:botocore.hooks:Event choose-signer.iam.CreateRole: calling handler 2024-04-16T18:15:22.141 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:22.141 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181522Z content-type;host;x-amz-date 3b15dc3cd5d30d4e069c24bb6bdc8bba7e68b341ab2726d98d123919ff657ea8 2024-04-16T18:15:22.141 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181522Z 20240416/test-zonegroup/iam/aws4_request 7fe7e5b356c59b464a23c54ebdbc5d5421413d7a8ef1ddef1d6586b5629b958f 2024-04-16T18:15:22.141 DEBUG:botocore.auth:Signature: 2e3ed9fbd56572b96b02c4f140fc9bef95a62d4838ee78db3272181de1d87784 2024-04-16T18:15:22.141 DEBUG:botocore.hooks:Event request-created.iam.CreateRole: calling handler 2024-04-16T18:15:22.142 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:22.162 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e2f65a9b2b973cbe-00661ec03a-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '777', 'Date': 'Tue, 16 Apr 2024 18:15:22 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:22.162 DEBUG:botocore.parsers:Response body: b'8c8d8e61-db83-4064-8896-c957374b7681test-zone2/arn:aws:iam::RGW11111111111111111:role/test-zone22024-04-16T18:15:22.149Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}tx00000e2f65a9b2b973cbe-00661ec03a-5447-test-zone2' 2024-04-16T18:15:22.162 DEBUG:botocore.hooks:Event needs-retry.iam.CreateRole: calling handler 2024-04-16T18:15:22.163 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:22.163 DEBUG:botocore.hooks:Event after-call.iam.CreateRole: calling handler 2024-04-16T18:15:22.163 DEBUG:botocore.hooks:Event before-parameter-build.iam.PutRolePolicy: calling handler 2024-04-16T18:15:22.163 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:22.163 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:22.164 DEBUG:botocore.hooks:Event before-call.iam.PutRolePolicy: calling handler 2024-04-16T18:15:22.164 DEBUG:botocore.hooks:Event before-call.iam.PutRolePolicy: calling handler 2024-04-16T18:15:22.164 DEBUG:botocore.endpoint:Making request for OperationModel(name=PutRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'PutRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone2', 'PolicyName': 'Allow', 'PolicyDocument': '{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:22.164 DEBUG:botocore.hooks:Event request-created.iam.PutRolePolicy: calling handler > 2024-04-16T18:15:22.164 DEBUG:botocore.hooks:Event choose-signer.iam.PutRolePolicy: calling handler 2024-04-16T18:15:22.165 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:22.165 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181522Z content-type;host;x-amz-date d375b5364696b79344588bf03ce90d2c993e120cfc9ed210ac5505fa6b6852b7 2024-04-16T18:15:22.165 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181522Z 20240416/test-zonegroup/iam/aws4_request 9103983faab19ca206d67a881d24ed92e2707c04d920ffafd1016ce24cf007a0 2024-04-16T18:15:22.165 DEBUG:botocore.auth:Signature: e48ba2a895b49957ce3661e6dd1a2377ab0e446aed0ecef9d11e28fc6f3e61e5 2024-04-16T18:15:22.165 DEBUG:botocore.hooks:Event request-created.iam.PutRolePolicy: calling handler 2024-04-16T18:15:22.165 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:22.221 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000046892a57945252bd-00661ec03a-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '157', 'Date': 'Tue, 16 Apr 2024 18:15:22 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:22.222 DEBUG:botocore.parsers:Response body: b'tx0000046892a57945252bd-00661ec03a-5447-test-zone2' 2024-04-16T18:15:22.222 DEBUG:botocore.hooks:Event needs-retry.iam.PutRolePolicy: calling handler 2024-04-16T18:15:22.222 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:22.222 DEBUG:botocore.hooks:Event after-call.iam.PutRolePolicy: calling handler 2024-04-16T18:15:22.222 DEBUG:botocore.hooks:Event before-parameter-build.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:22.223 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:22.223 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:22.223 DEBUG:botocore.hooks:Event before-call.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:22.223 DEBUG:botocore.hooks:Event before-call.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:22.223 DEBUG:botocore.endpoint:Making request for OperationModel(name=AttachRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'AttachRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone2', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:22.224 DEBUG:botocore.hooks:Event request-created.iam.AttachRolePolicy: calling handler > 2024-04-16T18:15:22.224 DEBUG:botocore.hooks:Event choose-signer.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:22.224 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:22.224 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181522Z content-type;host;x-amz-date 769290fb146152a7afbdb9bd3a33d29951994cc1eb13e718908b74fc21378f03 2024-04-16T18:15:22.224 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181522Z 20240416/test-zonegroup/iam/aws4_request a229c9e5c45a4a550be291a37e72c4d40251fee10a42b7265fd1c485a02e842d 2024-04-16T18:15:22.224 DEBUG:botocore.auth:Signature: e8fb51f802d1fb4f296d399b983a0f730b6c249fcae444b772311657e9f851fd 2024-04-16T18:15:22.225 DEBUG:botocore.hooks:Event request-created.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:22.225 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:22.318 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000071085800f173af79-00661ec03a-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:22 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:22.319 DEBUG:botocore.parsers:Response body: b'tx0000071085800f173af79-00661ec03a-5447-test-zone2' 2024-04-16T18:15:22.319 DEBUG:botocore.hooks:Event needs-retry.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:22.319 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:22.319 DEBUG:botocore.hooks:Event after-call.iam.AttachRolePolicy: calling handler 2024-04-16T18:15:22.319 INFO:rgw_multi.tests:meta checkpoint 2024-04-16T18:15:22.320 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:22.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:22.320 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:22.374 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:22.431 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:22.456 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291322.235206_569.1","last_update":"2024-04-16T18:15:22.235206Z"},{"marker":"1_1713291322.053757_226.1","last_update":"2024-04-16T18:15:22.053757Z"},{"marker":"1_1713291321.655248_731.1","last_update":"2024-04-16T18:15:21.655248Z"},{"marker":"1_1713291321.512920_355.1","last_update":"2024-04-16T18:15:21.512920Z"}] 2024-04-16T18:15:22.456 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291322.235206_569.1', 1: '1_1713291322.053757_226.1', 2: '1_1713291321.655248_731.1', 3: '1_1713291321.512920_355.1'} 2024-04-16T18:15:22.456 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:22.456 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:22.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:22.456 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:22.511 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:22.511 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:22.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:22.574+0000 7f264992d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:22.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:22.575+0000 7f264992d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:22.596 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291322.149044_564.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:22.149044Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291321.998601_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.998601Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291321.655248_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.655248Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:22Z"} 2024-04-16T18:15:22.597 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291322.149044_564.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:22.149044Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291321.998601_224.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.998601Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291321.655248_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.655248Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:22Z"} 2024-04-16T18:15:22.597 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291322.149044_564.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:22.149044Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291321.998601_224.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:21.998601Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291321.655248_731.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:21.655248Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291319.732978_352.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:19.732978Z', 'realm_epoch': 2}}] 2024-04-16T18:15:22.597 DEBUG:rgw_multi.tests:log_status={0: '1_1713291322.235206_569.1', 1: '1_1713291322.053757_226.1', 2: '1_1713291321.655248_731.1', 3: '1_1713291321.512920_355.1'} 2024-04-16T18:15:22.597 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291322.149044_564.1', 1: '1_1713291321.998601_224.1', 2: '1_1713291321.655248_731.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T18:15:22.597 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1713291322.235206_569.1 target=1_1713291322.149044_564.1, shard=1 master=1_1713291322.053757_226.1 target=1_1713291321.998601_224.1, shard=3 master=1_1713291321.512920_355.1 target=1_1713291319.732978_352.1 2024-04-16T18:15:27.598 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:27.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:27.599 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:27.656 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:27.656 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:27.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:27.710+0000 7f8e48011800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:27.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:27.713+0000 7f8e48011800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:27.735 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291322.235206_569.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:22.235206Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291322.053757_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:22.053757Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291321.655248_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.655248Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291321.512920_355.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.512920Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:27Z"} 2024-04-16T18:15:27.735 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291322.235206_569.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:22.235206Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291322.053757_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:22.053757Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291321.655248_731.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.655248Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291321.512920_355.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:21.512920Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:27Z"} 2024-04-16T18:15:27.736 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291322.235206_569.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:22.235206Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291322.053757_226.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:22.053757Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291321.655248_731.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:21.655248Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291321.512920_355.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:21.512920Z', 'realm_epoch': 2}}] 2024-04-16T18:15:27.736 DEBUG:rgw_multi.tests:log_status={0: '1_1713291322.235206_569.1', 1: '1_1713291322.053757_226.1', 2: '1_1713291321.655248_731.1', 3: '1_1713291321.512920_355.1'} 2024-04-16T18:15:27.737 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291322.235206_569.1', 1: '1_1713291322.053757_226.1', 2: '1_1713291321.655248_731.1', 3: '1_1713291321.512920_355.1'} 2024-04-16T18:15:27.737 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:27.737 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRoles: calling handler 2024-04-16T18:15:27.738 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.738 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.739 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:27.739 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:27.739 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRoles) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRoles', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.739 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler > 2024-04-16T18:15:27.740 DEBUG:botocore.hooks:Event choose-signer.iam.ListRoles: calling handler 2024-04-16T18:15:27.740 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.741 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 8e689dc6b69b17003f0460011582254d8643f0dfb48ac46e093a24df58170b3f 2024-04-16T18:15:27.741 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 017d3066bc907a1ee15cece0b71e6d958914ee762a92a1cd2a4506a5554ad123 2024-04-16T18:15:27.741 DEBUG:botocore.auth:Signature: 6945323e4273051d66fafca43e82601925feb44475290382e09be3006f9e1cb3 2024-04-16T18:15:27.741 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler 2024-04-16T18:15:27.741 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.746 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e904c475cbecab9d-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '3633', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.746 DEBUG:botocore.parsers:Response body: b'b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111d5aaf93b-bda6-45e4-8d36-7778f10a91b7test-zone1/arn:aws:iam::RGW11111111111111111:role/test-zone12024-04-16T18:15:21.580Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111Allow{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}arn:aws:iam::aws:policy/AmazonS3FullAccess8c8d8e61-db83-4064-8896-c957374b7681test-zone2/arn:aws:iam::RGW11111111111111111:role/test-zone22024-04-16T18:15:22.149Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111Allow{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}arn:aws:iam::aws:policy/AmazonS3FullAccessfalsetx00000e904c475cbecab9d-00661ec03f-4816-test-zone1' 2024-04-16T18:15:27.747 DEBUG:botocore.hooks:Event needs-retry.iam.ListRoles: calling handler 2024-04-16T18:15:27.748 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.748 DEBUG:botocore.hooks:Event after-call.iam.ListRoles: calling handler 2024-04-16T18:15:27.748 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRoles: calling handler 2024-04-16T18:15:27.749 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.749 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.749 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:27.749 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:27.749 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRoles) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRoles', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.750 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler > 2024-04-16T18:15:27.750 DEBUG:botocore.hooks:Event choose-signer.iam.ListRoles: calling handler 2024-04-16T18:15:27.750 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.750 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 8e689dc6b69b17003f0460011582254d8643f0dfb48ac46e093a24df58170b3f 2024-04-16T18:15:27.751 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 23ac17a6aef90bd63a1513b1c4b5761bfedc8ea1c1aa9360c2bcc7815f132bcf 2024-04-16T18:15:27.751 DEBUG:botocore.auth:Signature: f84278e99b8f67595dbef127faedadc996de8d3b49a53a0a85229eab037e1e04 2024-04-16T18:15:27.751 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler 2024-04-16T18:15:27.751 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.756 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000582aed38f3ce1e82-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '3633', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.756 DEBUG:botocore.parsers:Response body: b'b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111d5aaf93b-bda6-45e4-8d36-7778f10a91b7test-zone1/arn:aws:iam::RGW11111111111111111:role/test-zone12024-04-16T18:15:21.580Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111Allow{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}arn:aws:iam::aws:policy/AmazonS3FullAccess8c8d8e61-db83-4064-8896-c957374b7681test-zone2/arn:aws:iam::RGW11111111111111111:role/test-zone22024-04-16T18:15:22.149Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111Allow{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Action": "s3:*", "Resource": "*"}]}arn:aws:iam::aws:policy/AmazonS3FullAccessfalsetx00000582aed38f3ce1e82-00661ec03f-5447-test-zone2' 2024-04-16T18:15:27.757 DEBUG:botocore.hooks:Event needs-retry.iam.ListRoles: calling handler 2024-04-16T18:15:27.757 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.757 DEBUG:botocore.hooks:Event after-call.iam.ListRoles: calling handler 2024-04-16T18:15:27.758 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.758 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.758 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.758 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.758 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.759 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.759 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.759 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.759 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.759 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 8f2a258f431de2df39c452e7aa57d388d9c943f7f8a70cbd5df98df5386c6953 2024-04-16T18:15:27.760 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 16268100ac1f2c1daddf629c3231c0db78557bd8ff81f70ca1f54b2aad6c80b9 2024-04-16T18:15:27.760 DEBUG:botocore.auth:Signature: b01e81a2e71edc1a24dbe5e06b59a67eef333ceee30fe4bbd9e57bc64f89dd35 2024-04-16T18:15:27.760 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.760 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.763 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005c5a14e1cabb14a7-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.763 DEBUG:botocore.parsers:Response body: b'tx000005c5a14e1cabb14a7-00661ec03f-4816-test-zone1b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.763 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.764 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.764 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.764 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.764 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.764 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.765 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.765 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.765 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.765 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.765 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.766 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.766 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 8f2a258f431de2df39c452e7aa57d388d9c943f7f8a70cbd5df98df5386c6953 2024-04-16T18:15:27.766 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 49990f6e63ed8ff9f9e2f034aa33137a295884d2c5e821d83342a49b1770b119 2024-04-16T18:15:27.766 DEBUG:botocore.auth:Signature: 79a6c36768a2ef34569a7240cbcdbc0374d73ed24559b1dc105737800045918c 2024-04-16T18:15:27.766 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.766 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.769 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000089eb7a6d5db9c52a-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.769 DEBUG:botocore.parsers:Response body: b'tx0000089eb7a6d5db9c52a-00661ec03f-5447-test-zone2b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.769 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.770 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.770 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.770 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.770 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.771 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.771 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.771 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.771 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.771 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.772 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.772 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.772 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 3db9fbb8864693f61061506a569aad4475c506e554d7919698e984bee122e2be 2024-04-16T18:15:27.772 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request abed97984ab1f416034a994483b04f27f029917ac2fd818ba824112c5feabbc7 2024-04-16T18:15:27.772 DEBUG:botocore.auth:Signature: d208b9fb0dc45928386ae31aa464e7572020f29c7d6e7823fdcc82bc825ce94a 2024-04-16T18:15:27.773 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.773 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.775 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000002e57741da5b35bdb-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.775 DEBUG:botocore.parsers:Response body: b'tx000002e57741da5b35bdb-00661ec03f-4816-test-zone1' 2024-04-16T18:15:27.776 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.776 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.776 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.776 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.776 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.776 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.777 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.777 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.777 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.777 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.777 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.778 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.778 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 3db9fbb8864693f61061506a569aad4475c506e554d7919698e984bee122e2be 2024-04-16T18:15:27.778 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 8d2b1e07caed6e942b1335420b3df25081c39a5b71685f353ce38247db687175 2024-04-16T18:15:27.778 DEBUG:botocore.auth:Signature: b0da0d5a0939d7e733c7924748c013612a6cc8faf8cce3ae9faa36496b1626ea 2024-04-16T18:15:27.778 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.779 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.781 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005ecabf4ea68221aa-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.781 DEBUG:botocore.parsers:Response body: b'tx000005ecabf4ea68221aa-00661ec03f-5447-test-zone2' 2024-04-16T18:15:27.781 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.781 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.781 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.782 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.782 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.782 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.783 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.783 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.783 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.783 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.783 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.784 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.784 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 2f314d397cbac9a588b92b4320c5a1127363dccb0d852931ea20d4eff1417de1 2024-04-16T18:15:27.784 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 7b9e125d691272ab90b2a04d1d440d6dd32a9fefb728e8a8d48edb667a3ff376 2024-04-16T18:15:27.784 DEBUG:botocore.auth:Signature: 30fc1b167995bfb44d53fa4271fc5e437cf3a541ab4bf0b7aa486ddf7c2f1f3d 2024-04-16T18:15:27.784 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.785 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.830 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000003fba13dea3f5a02-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.831 DEBUG:botocore.parsers:Response body: b'tx0000003fba13dea3f5a02-00661ec03f-4816-test-zone1' 2024-04-16T18:15:27.831 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.831 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.831 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.831 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.832 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.832 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.832 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.832 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.832 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.833 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.833 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.833 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.833 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 2f314d397cbac9a588b92b4320c5a1127363dccb0d852931ea20d4eff1417de1 2024-04-16T18:15:27.833 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request eb9faa25b00582983d2f3b40aa1a349009e6bb0f9a7349e0a15198e7b0cca80a 2024-04-16T18:15:27.833 DEBUG:botocore.auth:Signature: 58cf853f542e5a8e01703091e30af6a358996829b3441118ac7195152b191ea8 2024-04-16T18:15:27.834 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.834 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.836 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000008a66a74e094ba00d-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.836 DEBUG:botocore.parsers:Response body: b'tx000008a66a74e094ba00d-00661ec03f-5447-test-zone2' 2024-04-16T18:15:27.836 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.837 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.837 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.837 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.837 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.837 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.837 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.838 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.838 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.838 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.838 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.838 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.839 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 07892fd0c5c70e8192a39ae193652f7ff706efef8941ee3607681aa7e4b57d46 2024-04-16T18:15:27.839 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 85d77ab63904e0a2248fcb2d5e3e106e2112477193820ebe83df0fa70f7df9b9 2024-04-16T18:15:27.839 DEBUG:botocore.auth:Signature: a7c162b3398edc2149b89a5637482ec72fb42825726ccb152d18e75024edd6f1 2024-04-16T18:15:27.839 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.839 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.842 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b634c1742a415143-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.842 DEBUG:botocore.parsers:Response body: b'tx00000b634c1742a415143-00661ec03f-4816-test-zone1f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.842 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.842 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.843 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.843 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.843 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.843 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.843 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.843 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.844 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.844 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.844 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.844 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.844 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 07892fd0c5c70e8192a39ae193652f7ff706efef8941ee3607681aa7e4b57d46 2024-04-16T18:15:27.845 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request bdd53573cc00efeb000a0d05bbcad8d4b23c8c085dd3d1025dbf318c012d481c 2024-04-16T18:15:27.845 DEBUG:botocore.auth:Signature: 1025d9d53b14d8fc31b644fad3549fe604077fd9a090df9b34cd2e638a081f9d 2024-04-16T18:15:27.845 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.845 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.847 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e0643953a65204f0-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.847 DEBUG:botocore.parsers:Response body: b'tx00000e0643953a65204f0-00661ec03f-5447-test-zone2f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.848 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.848 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.848 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.849 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.849 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.849 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.849 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.849 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.850 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.850 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.850 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.850 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.850 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 197b347e25417624ba8adafc5e9b6c078cfb1e82b21f5895646d7316797be137 2024-04-16T18:15:27.851 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 5c961e30dbddf36a310a6f17a3d9fd27b92ac0018f779d5b2ade73ed62f1fe1d 2024-04-16T18:15:27.851 DEBUG:botocore.auth:Signature: b7a92af1ce60b9cf90b3e08a6d2ab7b7d5201ba54f870db079cc1f90bcd618d9 2024-04-16T18:15:27.851 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.851 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.853 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000081213b0bd4d443d1-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.854 DEBUG:botocore.parsers:Response body: b'tx0000081213b0bd4d443d1-00661ec03f-4816-test-zone1' 2024-04-16T18:15:27.854 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.854 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.854 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.854 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.854 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.855 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.855 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.855 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.855 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.855 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.855 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.856 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.856 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 197b347e25417624ba8adafc5e9b6c078cfb1e82b21f5895646d7316797be137 2024-04-16T18:15:27.856 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 96eca732fc149d0c285a274e582f561d0781d016020b6fd85a4ebdddc65a4366 2024-04-16T18:15:27.856 DEBUG:botocore.auth:Signature: cf723dbfe18cebb3135acc75844e386dbcb5deef2b637ebcbae75ddea82a86a3 2024-04-16T18:15:27.856 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.856 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.858 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000ce92fc326d8e227a-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.859 DEBUG:botocore.parsers:Response body: b'tx00000ce92fc326d8e227a-00661ec03f-5447-test-zone2' 2024-04-16T18:15:27.859 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.859 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.859 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.859 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.860 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.860 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.860 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.860 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.860 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.861 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.861 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.861 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.861 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 644da773af884f4ddfb182a1f2b84c9ed81edd210a431358216fc28d2d9bfe04 2024-04-16T18:15:27.861 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 5210b92e9112cd72a5b3d4feeba08c84b991c426567e4e9a8c778fd188c1f407 2024-04-16T18:15:27.861 DEBUG:botocore.auth:Signature: 33326cfc8d4d13231ccac12d3bd1b76cc51d41124c0273740f586628a7de34c1 2024-04-16T18:15:27.862 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.862 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.864 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000040aee10dafb83f58-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.864 DEBUG:botocore.parsers:Response body: b'tx0000040aee10dafb83f58-00661ec03f-4816-test-zone1' 2024-04-16T18:15:27.864 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.865 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.865 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.865 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.865 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.865 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.866 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.866 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.866 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.866 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.866 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.867 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.867 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 644da773af884f4ddfb182a1f2b84c9ed81edd210a431358216fc28d2d9bfe04 2024-04-16T18:15:27.867 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 36b4069ea100cae98f8f9186acf35d6d51aaf0e9b41ffc3dc5a0121257d1e39a 2024-04-16T18:15:27.867 DEBUG:botocore.auth:Signature: 47d89bf6dd5c1f7fbf9564480b41e64ef1fd8928ed3aadef982067cd2da980d2 2024-04-16T18:15:27.867 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.867 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.910 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000008e513db7b6131b10-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.911 DEBUG:botocore.parsers:Response body: b'tx000008e513db7b6131b10-00661ec03f-5447-test-zone2' 2024-04-16T18:15:27.911 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.911 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.911 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.911 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.912 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.912 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.912 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.912 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.912 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.913 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.913 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.913 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.913 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 7067bf4a2c2c30babee515f4ca93ddeff9e9141bcd70c45f18f5120d787f22f5 2024-04-16T18:15:27.913 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request ef962d23801718f5a5dbc6682f1750a6f48fde778c0365dd46d116b9704fde27 2024-04-16T18:15:27.913 DEBUG:botocore.auth:Signature: 45227288be18e2e150283ac97c78f073c78e57d6cafada2301767c2ce106765c 2024-04-16T18:15:27.914 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.914 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.916 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000ebcd15f01b85eb61-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '765', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.916 DEBUG:botocore.parsers:Response body: b'tx00000ebcd15f01b85eb61-00661ec03f-4816-test-zone1d5aaf93b-bda6-45e4-8d36-7778f10a91b7test-zone1/arn:aws:iam::RGW11111111111111111:role/test-zone12024-04-16T18:15:21.580Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.917 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.917 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.917 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.917 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.917 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.918 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.918 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.918 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.918 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.918 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.918 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.919 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.919 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 7067bf4a2c2c30babee515f4ca93ddeff9e9141bcd70c45f18f5120d787f22f5 2024-04-16T18:15:27.919 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 82f88fa6d07a82f28cca496fac61151145d9eb6994ee36c85ff839d656610e4e 2024-04-16T18:15:27.919 DEBUG:botocore.auth:Signature: dc8e5e334de822601779e2c2d45aef7ff4eb4574ee200556c1ede46f056d5eef 2024-04-16T18:15:27.919 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.920 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.922 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005d0e376f2c7b7ac7-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '765', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.922 DEBUG:botocore.parsers:Response body: b'tx000005d0e376f2c7b7ac7-00661ec03f-5447-test-zone2d5aaf93b-bda6-45e4-8d36-7778f10a91b7test-zone1/arn:aws:iam::RGW11111111111111111:role/test-zone12024-04-16T18:15:21.580Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.923 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.923 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.923 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.923 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.923 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.924 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.924 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.924 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.924 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.924 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.924 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.925 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.925 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 38569227d58e6809847b4e4238520661b8b38646b59cb058130b7fc6c1ed64be 2024-04-16T18:15:27.925 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request a78e4ad133450c50cbf677172e717068f69178cec12e0d3c3dc1e95998322051 2024-04-16T18:15:27.925 DEBUG:botocore.auth:Signature: 2f50d84b311b3c0125783c76c8d5def2b61b19aedb0a325e78f30c46e316ab54 2024-04-16T18:15:27.925 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.926 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.928 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000727b03910a63f895-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '261', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.928 DEBUG:botocore.parsers:Response body: b'tx00000727b03910a63f895-00661ec03f-4816-test-zone1Allow' 2024-04-16T18:15:27.928 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.928 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.928 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.928 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.929 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.929 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.929 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.929 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.929 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.929 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.930 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.930 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.930 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 38569227d58e6809847b4e4238520661b8b38646b59cb058130b7fc6c1ed64be 2024-04-16T18:15:27.930 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 36d1e163ceb485339def4ec3d1b85d77fd1aa6c4fd4e61c4529fc5facc56f5ad 2024-04-16T18:15:27.930 DEBUG:botocore.auth:Signature: b45c129f545f10cdaa749c0d0dc89525b86d529fea92f1d04b00c042eecb5068 2024-04-16T18:15:27.931 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.931 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.933 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000fb90db6058259f92-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '261', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.933 DEBUG:botocore.parsers:Response body: b'tx00000fb90db6058259f92-00661ec03f-5447-test-zone2Allow' 2024-04-16T18:15:27.933 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.933 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.934 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.934 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.934 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.934 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.935 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.935 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.935 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.935 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.935 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.935 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.936 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 8b09555836446b433b1809feb29e77128d8e49e7527669bc33c462424a43b8b4 2024-04-16T18:15:27.936 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request c30fae041bf41a3afa1c3a0c5ddea5a17c9872b809ac67f72753ab1eda9eb4cb 2024-04-16T18:15:27.936 DEBUG:botocore.auth:Signature: 6e31b0fa28bd01ff1228004cb2de753b4f3944182f0ff98566cd42fb45bae79b 2024-04-16T18:15:27.936 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.936 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.939 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000007d371431e1433522-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '456', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.939 DEBUG:botocore.parsers:Response body: b'tx000007d371431e1433522-00661ec03f-4816-test-zone1AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccess' 2024-04-16T18:15:27.939 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.939 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.939 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.940 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.940 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.940 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.940 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.940 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.940 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.941 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.941 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.941 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.941 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 8b09555836446b433b1809feb29e77128d8e49e7527669bc33c462424a43b8b4 2024-04-16T18:15:27.941 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 08733fc16ee0b8a03ddf12e8ec5d58b7df82cb6c695d1ef407a988b8ab2530b0 2024-04-16T18:15:27.941 DEBUG:botocore.auth:Signature: 360eb42c7f9026419cae23b49f2b79c899fa0532a5d4ac7e8d2b7c7af46cf1e8 2024-04-16T18:15:27.941 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.942 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.944 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000dda1ed776d563ede-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '456', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.944 DEBUG:botocore.parsers:Response body: b'tx00000dda1ed776d563ede-00661ec03f-5447-test-zone2AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccess' 2024-04-16T18:15:27.944 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.944 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.945 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.945 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.945 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.945 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.945 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.945 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.946 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.946 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.946 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.946 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.946 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date d1b3c02eab04a96ea4c1b62766790de704b6fcba4c966a27173500c60f5d6ff1 2024-04-16T18:15:27.947 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request f41187f4ef48d04153be7bdde23e39705d692645ca74effb94c2b35f90f20383 2024-04-16T18:15:27.947 DEBUG:botocore.auth:Signature: 1168e44e519540f5fe9f90a7f9b7e21bae37719f3645a2c97f584bd8d2d35369 2024-04-16T18:15:27.947 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.947 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.949 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000954db2b76aebf43b-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '765', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.950 DEBUG:botocore.parsers:Response body: b'tx00000954db2b76aebf43b-00661ec03f-4816-test-zone18c8d8e61-db83-4064-8896-c957374b7681test-zone2/arn:aws:iam::RGW11111111111111111:role/test-zone22024-04-16T18:15:22.149Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.950 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.950 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.950 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.951 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:27.951 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.951 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.951 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.951 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:27.951 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.952 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:27.952 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:27.952 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.952 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date d1b3c02eab04a96ea4c1b62766790de704b6fcba4c966a27173500c60f5d6ff1 2024-04-16T18:15:27.952 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 68dcd291ec4a7bbcd8e8268268375968ca6a35efb4a08b2190a0d38507bf39c1 2024-04-16T18:15:27.952 DEBUG:botocore.auth:Signature: d5a1713c3f1053c3a35cbd153a34b15bdd3439b575837b33ad048a0a9d450250 2024-04-16T18:15:27.952 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:27.953 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.955 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000022402c093d15fc07-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '765', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.955 DEBUG:botocore.parsers:Response body: b'tx0000022402c093d15fc07-00661ec03f-5447-test-zone28c8d8e61-db83-4064-8896-c957374b7681test-zone2/arn:aws:iam::RGW11111111111111111:role/test-zone22024-04-16T18:15:22.149Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:27.955 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:27.956 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.956 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:27.956 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.956 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.956 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.956 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.957 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.957 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.957 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.957 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.957 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.957 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 60679f059cf1aaaffeb2ba196691292bb365c33a340fc79c0064b5b350fd568f 2024-04-16T18:15:27.958 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 5005318fc12fcf27834521b8d605764d72f275657d312cbb5a3307064aa0cf1f 2024-04-16T18:15:27.958 DEBUG:botocore.auth:Signature: 45faba91c414c667e6e162bd4b936d1c6d4d0230d6ab547f67c603143961e100 2024-04-16T18:15:27.958 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.958 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.960 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000001f74241406094d57-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '261', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.961 DEBUG:botocore.parsers:Response body: b'tx000001f74241406094d57-00661ec03f-4816-test-zone1Allow' 2024-04-16T18:15:27.961 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.961 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.961 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.961 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.961 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.962 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.962 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.962 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.962 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.962 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:27.962 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.963 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.963 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date 60679f059cf1aaaffeb2ba196691292bb365c33a340fc79c0064b5b350fd568f 2024-04-16T18:15:27.963 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request 811f396784ce86cc5e3ceb0e9884305836efb026c36470616837a114d177d168 2024-04-16T18:15:27.963 DEBUG:botocore.auth:Signature: 3182f07e5545be5cf3a5c1794b08823ce4cdfcb1c35e089fb0d9687d82f585ab 2024-04-16T18:15:27.963 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.963 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.965 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000f50cca84e15866f0-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '261', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.965 DEBUG:botocore.parsers:Response body: b'tx00000f50cca84e15866f0-00661ec03f-5447-test-zone2Allow' 2024-04-16T18:15:27.966 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.966 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.966 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:27.966 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.966 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.966 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.967 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.967 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.967 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.967 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.967 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.968 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.968 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date e0f61ac7a0d39bc58cdbe7966ed858e3c10a35a6e4ff05a95164010ed084bae5 2024-04-16T18:15:27.968 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request fb2676668d635c7b7d3e0cc9799a472c35b8724033726323249b1d3ccb292258 2024-04-16T18:15:27.968 DEBUG:botocore.auth:Signature: 5f0a26b63c8b3d599120383f9f670cfcfb375a3c970adf950de61605e3ba7d65 2024-04-16T18:15:27.968 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.968 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.970 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e280ede3f303e8ba-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '456', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.971 DEBUG:botocore.parsers:Response body: b'tx00000e280ede3f303e8ba-00661ec03f-4816-test-zone1AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccess' 2024-04-16T18:15:27.971 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.971 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.971 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.971 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.971 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.971 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:27.972 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.972 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.972 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.972 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:27.972 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.973 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.973 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date e0f61ac7a0d39bc58cdbe7966ed858e3c10a35a6e4ff05a95164010ed084bae5 2024-04-16T18:15:27.973 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request aaf19393e6e0cce610ab186bd711c1fecf554273cbc87ab48738ddad09f21053 2024-04-16T18:15:27.973 DEBUG:botocore.auth:Signature: 488df17f6aa93d21b8dcc8cedcdeea5058780cc0b0342c625660e51d14c8e283 2024-04-16T18:15:27.973 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.973 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:27.975 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000082e3b9205d91350c-00661ec03f-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '456', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:27.975 DEBUG:botocore.parsers:Response body: b'tx0000082e3b9205d91350c-00661ec03f-5447-test-zone2AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccess' 2024-04-16T18:15:27.976 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.976 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:27.976 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:27.976 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUsers: calling handler 2024-04-16T18:15:27.977 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:27.977 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:27.977 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:27.977 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:27.977 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUsers) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUsers', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:27.978 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler > 2024-04-16T18:15:27.978 DEBUG:botocore.hooks:Event choose-signer.iam.ListUsers: calling handler 2024-04-16T18:15:27.978 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:27.979 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181527Z content-type;host;x-amz-date b6359072c78d70ebee1e81adcbab4f01bf2c23245fa365ef83fe8f1f955085e2 2024-04-16T18:15:27.979 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181527Z 20240416/test-zonegroup/iam/aws4_request eb9024c06ada6b4659f2854c967ee40edd2908658961ac64eb8cf9857b7e43e4 2024-04-16T18:15:27.979 DEBUG:botocore.auth:Signature: ed9122925008ffa6d9a5d3fa70bb6ac4809811bc1381d52aec7c11d6695ab9ea 2024-04-16T18:15:27.979 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler 2024-04-16T18:15:27.979 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.022 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx0000000884048e047f0a6-00661ec03f-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:27 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.023 DEBUG:botocore.parsers:Response body: b'/test-zone1255da143-d579-4866-8dd6-a847a953c645arn:aws:iam::RGW11111111111111111:user/test-zone12024-04-16T18:15:21.368818Z/test-zone2de998ef8-5f83-4daf-9eb5-916c39046d7aarn:aws:iam::RGW11111111111111111:user/test-zone22024-04-16T18:15:21.666013Zfalse' 2024-04-16T18:15:28.023 DEBUG:botocore.hooks:Event needs-retry.iam.ListUsers: calling handler 2024-04-16T18:15:28.024 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.024 DEBUG:botocore.hooks:Event after-call.iam.ListUsers: calling handler 2024-04-16T18:15:28.024 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUsers: calling handler 2024-04-16T18:15:28.024 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.024 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.025 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:28.025 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:28.025 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUsers) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUsers', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.025 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler > 2024-04-16T18:15:28.025 DEBUG:botocore.hooks:Event choose-signer.iam.ListUsers: calling handler 2024-04-16T18:15:28.026 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.026 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date b6359072c78d70ebee1e81adcbab4f01bf2c23245fa365ef83fe8f1f955085e2 2024-04-16T18:15:28.026 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 391913eddba2c3d8edc0e2cc087e4c4a16f62f69b769e2745693fd78b9a90943 2024-04-16T18:15:28.026 DEBUG:botocore.auth:Signature: 03e060ba75def519e84fcd225f73f13751c054a03bece762e040230d79fa271c 2024-04-16T18:15:28.026 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler 2024-04-16T18:15:28.027 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.030 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000e28de1f617a7eda1-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.030 DEBUG:botocore.parsers:Response body: b'/test-zone1255da143-d579-4866-8dd6-a847a953c645arn:aws:iam::RGW11111111111111111:user/test-zone12024-04-16T18:15:21.368818Z/test-zone2de998ef8-5f83-4daf-9eb5-916c39046d7aarn:aws:iam::RGW11111111111111111:user/test-zone22024-04-16T18:15:21.666013Zfalse' 2024-04-16T18:15:28.031 DEBUG:botocore.hooks:Event needs-retry.iam.ListUsers: calling handler 2024-04-16T18:15:28.031 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.031 DEBUG:botocore.hooks:Event after-call.iam.ListUsers: calling handler 2024-04-16T18:15:28.031 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetUser: calling handler 2024-04-16T18:15:28.032 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.032 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.032 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.032 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.032 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetUser', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.033 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler > 2024-04-16T18:15:28.033 DEBUG:botocore.hooks:Event choose-signer.iam.GetUser: calling handler 2024-04-16T18:15:28.034 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.034 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 36be43c886972026dc9392cd2c57a48595fcb211bd6cc645e01ae503a91b5b02 2024-04-16T18:15:28.034 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 57609f44ffd2f17f9a5ea3cd9074aabe03ceaf2063ca4e75e6328bbca71eafe3 2024-04-16T18:15:28.034 DEBUG:botocore.auth:Signature: 8ca8b798c2ffcd849c244876a8205bc7bd991b4009b46a947c6dabe298c49e69 2024-04-16T18:15:28.034 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler 2024-04-16T18:15:28.035 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.038 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000004952bb8287df4d07-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '487', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.038 DEBUG:botocore.parsers:Response body: b'/test-zone1255da143-d579-4866-8dd6-a847a953c645arn:aws:iam::RGW11111111111111111:user/test-zone12024-04-16T18:15:21.368818Ztx000004952bb8287df4d07-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.038 DEBUG:botocore.hooks:Event needs-retry.iam.GetUser: calling handler 2024-04-16T18:15:28.039 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.039 DEBUG:botocore.hooks:Event after-call.iam.GetUser: calling handler 2024-04-16T18:15:28.039 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetUser: calling handler 2024-04-16T18:15:28.039 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.039 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.040 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.040 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.040 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetUser', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.040 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler > 2024-04-16T18:15:28.040 DEBUG:botocore.hooks:Event choose-signer.iam.GetUser: calling handler 2024-04-16T18:15:28.041 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.041 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 36be43c886972026dc9392cd2c57a48595fcb211bd6cc645e01ae503a91b5b02 2024-04-16T18:15:28.041 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 93bba1b044d24cc45bdd19bad154144183d0c7e07e8c7e1117e8c500877f4e43 2024-04-16T18:15:28.041 DEBUG:botocore.auth:Signature: 8d4b4bbea03f5de13539b9de63337ed043331537a0d14536e71d99569c50a527 2024-04-16T18:15:28.041 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler 2024-04-16T18:15:28.042 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.044 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000a4f8549f4318895d-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '487', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.045 DEBUG:botocore.parsers:Response body: b'/test-zone1255da143-d579-4866-8dd6-a847a953c645arn:aws:iam::RGW11111111111111111:user/test-zone12024-04-16T18:15:21.368818Ztx00000a4f8549f4318895d-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.045 DEBUG:botocore.hooks:Event needs-retry.iam.GetUser: calling handler 2024-04-16T18:15:28.045 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.046 DEBUG:botocore.hooks:Event after-call.iam.GetUser: calling handler 2024-04-16T18:15:28.046 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.046 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.046 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.047 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.047 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.047 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAccessKeys) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAccessKeys', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.047 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler > 2024-04-16T18:15:28.047 DEBUG:botocore.hooks:Event choose-signer.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.048 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.048 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 919fd997a1071a9eb8adeb0d8e2a852ea3984fffd61b7a1dc133995556ffb778 2024-04-16T18:15:28.048 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 3f9d73901e939e692a9ace011b98d957b05d97a83731c9092fec6eec935fb71c 2024-04-16T18:15:28.048 DEBUG:botocore.auth:Signature: 78a413188e3c6af4d5a27f7140ffcc47aaeb20b2c13680efa48fa20ddc72b127 2024-04-16T18:15:28.048 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.049 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.051 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000ab8dfee8c07f65dd-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.051 DEBUG:botocore.parsers:Response body: b'test-zone1test-zone1L54B5JRY5QAP851HQA4CActive2024-04-16T18:15:21.386460Zfalse' 2024-04-16T18:15:28.052 DEBUG:botocore.hooks:Event needs-retry.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.052 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.052 DEBUG:botocore.hooks:Event after-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.053 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.053 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.053 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.053 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.053 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.053 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAccessKeys) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAccessKeys', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.054 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler > 2024-04-16T18:15:28.054 DEBUG:botocore.hooks:Event choose-signer.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.054 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.055 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 919fd997a1071a9eb8adeb0d8e2a852ea3984fffd61b7a1dc133995556ffb778 2024-04-16T18:15:28.055 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request e904310f03a093050c9e1615d4da573e60637978da5fec2a5f92b0208a7b7731 2024-04-16T18:15:28.055 DEBUG:botocore.auth:Signature: 1da5b10894fa2822dfa85bd905b4e09fb1cf0d3080a52478eea3d3ca7f739c89 2024-04-16T18:15:28.055 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.055 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.058 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000033020420c6b5dff-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.058 DEBUG:botocore.parsers:Response body: b'test-zone1test-zone1L54B5JRY5QAP851HQA4CActive2024-04-16T18:15:21.386460Zfalse' 2024-04-16T18:15:28.059 DEBUG:botocore.hooks:Event needs-retry.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.059 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.059 DEBUG:botocore.hooks:Event after-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.060 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.060 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.060 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.060 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.060 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.061 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupsForUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupsForUser', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.061 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler > 2024-04-16T18:15:28.061 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.062 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.062 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date d4742f49a0da68c5bb72a1260c8ca465b619be78c1f1b6a677d6fd1e87406c72 2024-04-16T18:15:28.062 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 19d209639694b6511fcca0b948575b9d853921651a8b539dc8e4b06d4da21801 2024-04-16T18:15:28.062 DEBUG:botocore.auth:Signature: ed9331b5c7afff2033d8acd91e15ec557b416f4b8cf5faeb6c61bb1e2203dd45 2024-04-16T18:15:28.062 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.063 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.066 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000054aa1d6e863d6ae1-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '533', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.066 DEBUG:botocore.parsers:Response body: b'/test-zone1708ed322-dd11-47ee-9731-07fa113c96dfarn:aws:iam::RGW11111111111111111:group/test-zone1falsetx0000054aa1d6e863d6ae1-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.066 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.066 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.067 DEBUG:botocore.hooks:Event after-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.067 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.067 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.067 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.067 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.068 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.068 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupsForUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupsForUser', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.068 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler > 2024-04-16T18:15:28.068 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.069 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.069 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date d4742f49a0da68c5bb72a1260c8ca465b619be78c1f1b6a677d6fd1e87406c72 2024-04-16T18:15:28.069 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 289b383d4d7efa4b9b8b1652dc3205585955ea8b7de54b233d88ebcf12a7a4d4 2024-04-16T18:15:28.069 DEBUG:botocore.auth:Signature: f9f984e79f178e73f813a937490481603e4d78a6fa00df10b93d8759ba66c284 2024-04-16T18:15:28.069 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.069 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.072 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000034f0164c28d00f90-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '533', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.072 DEBUG:botocore.parsers:Response body: b'/test-zone1708ed322-dd11-47ee-9731-07fa113c96dfarn:aws:iam::RGW11111111111111111:group/test-zone1falsetx0000034f0164c28d00f90-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.073 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.073 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.073 DEBUG:botocore.hooks:Event after-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.073 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.074 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.074 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.074 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.074 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.074 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.075 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler > 2024-04-16T18:15:28.075 DEBUG:botocore.hooks:Event choose-signer.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.075 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.075 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 4d3f921f2ff07e303538de70576b9876f48b3a5ab3f9a483a2b0b18fb63ec13d 2024-04-16T18:15:28.075 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 6ab6e47097a2cd2b26f68c1678e85455529b28dd365dc5b5268ca22b9293a901 2024-04-16T18:15:28.076 DEBUG:botocore.auth:Signature: f1331585545fc48d3e85d05157d3070df222b0e3e860515da82be225cab620fd 2024-04-16T18:15:28.076 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.076 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.079 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000098957ab99904ce2c-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '343', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.079 DEBUG:botocore.parsers:Response body: b'tx0000098957ab99904ce2c-00661ec040-4816-test-zone1Allowfalse' 2024-04-16T18:15:28.079 DEBUG:botocore.hooks:Event needs-retry.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.079 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.080 DEBUG:botocore.hooks:Event after-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.080 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.080 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.080 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.080 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.081 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.081 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.081 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler > 2024-04-16T18:15:28.081 DEBUG:botocore.hooks:Event choose-signer.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.082 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.082 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 4d3f921f2ff07e303538de70576b9876f48b3a5ab3f9a483a2b0b18fb63ec13d 2024-04-16T18:15:28.082 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 83be19bdfa985cdb7a6bb5d5ca10503c695de079150cd4bff81c656021ee2e8b 2024-04-16T18:15:28.082 DEBUG:botocore.auth:Signature: f67bfa7021ef4a72dfce15423ac57bffa12b331d601d55838536a1dd1d41bd09 2024-04-16T18:15:28.082 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.082 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.085 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000004e8025c1c45e458c-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '343', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.085 DEBUG:botocore.parsers:Response body: b'tx000004e8025c1c45e458c-00661ec040-5447-test-zone2Allowfalse' 2024-04-16T18:15:28.085 DEBUG:botocore.hooks:Event needs-retry.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.085 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.086 DEBUG:botocore.hooks:Event after-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.086 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.086 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.086 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.087 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.087 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.087 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.087 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler > 2024-04-16T18:15:28.088 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.088 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.088 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 49799e0d599ed5d7467f14f6a5435b14aad4e9b68dd234a6844ecab21760f18f 2024-04-16T18:15:28.088 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 48e9b59db6870b7b0c3d95b04cac5b060c58ca5080f84639cf02afd51eb9ccf2 2024-04-16T18:15:28.088 DEBUG:botocore.auth:Signature: 23fd2409f55badc75980b3b14d74976b412ccfb68bbd6a32a9acec8fa561937e 2024-04-16T18:15:28.088 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.089 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.134 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000009c9cd8d98850678e-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '488', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.135 DEBUG:botocore.parsers:Response body: b'tx000009c9cd8d98850678e-00661ec040-4816-test-zone1AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalse' 2024-04-16T18:15:28.135 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.135 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.135 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.136 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.136 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.136 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.136 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.136 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.136 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.137 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler > 2024-04-16T18:15:28.137 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.137 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.137 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 49799e0d599ed5d7467f14f6a5435b14aad4e9b68dd234a6844ecab21760f18f 2024-04-16T18:15:28.138 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request ff2bb9b33ec8c7d6568b0326af05613555d3d26f990a08ce77ac14c9028eeebf 2024-04-16T18:15:28.138 DEBUG:botocore.auth:Signature: a173c2599f3382a19b709df2ca83c0ac35b58dec22814362e7cad00d403d7ae3 2024-04-16T18:15:28.138 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.138 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.141 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000f496e345e9ee5141-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '488', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.141 DEBUG:botocore.parsers:Response body: b'tx00000f496e345e9ee5141-00661ec040-5447-test-zone2AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalse' 2024-04-16T18:15:28.142 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.142 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.142 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.142 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetUser: calling handler 2024-04-16T18:15:28.143 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.143 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.143 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.143 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.143 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetUser', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.143 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler > 2024-04-16T18:15:28.144 DEBUG:botocore.hooks:Event choose-signer.iam.GetUser: calling handler 2024-04-16T18:15:28.144 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.144 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 8d30a3f507fe42ace157bf649ae227bc4005724392fed2f2ba1e19ac20f57f65 2024-04-16T18:15:28.144 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 30293dfad80802d41d5278d634f8597a0e3f2ef9ff7aeb1cb19eb75352da2e0d 2024-04-16T18:15:28.144 DEBUG:botocore.auth:Signature: cbc67fb323a5cc8a613e9594fdc33c716749ee70f7c0fcbe35c88000a9c49a09 2024-04-16T18:15:28.144 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler 2024-04-16T18:15:28.145 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.147 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000072d8633ded56e65-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '487', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.148 DEBUG:botocore.parsers:Response body: b'/test-zone2de998ef8-5f83-4daf-9eb5-916c39046d7aarn:aws:iam::RGW11111111111111111:user/test-zone22024-04-16T18:15:21.666013Ztx00000072d8633ded56e65-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.148 DEBUG:botocore.hooks:Event needs-retry.iam.GetUser: calling handler 2024-04-16T18:15:28.148 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.148 DEBUG:botocore.hooks:Event after-call.iam.GetUser: calling handler 2024-04-16T18:15:28.148 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetUser: calling handler 2024-04-16T18:15:28.149 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.149 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.149 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.149 DEBUG:botocore.hooks:Event before-call.iam.GetUser: calling handler 2024-04-16T18:15:28.149 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetUser', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.149 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler > 2024-04-16T18:15:28.150 DEBUG:botocore.hooks:Event choose-signer.iam.GetUser: calling handler 2024-04-16T18:15:28.150 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.150 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 8d30a3f507fe42ace157bf649ae227bc4005724392fed2f2ba1e19ac20f57f65 2024-04-16T18:15:28.150 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 07487b7fa53aa817dd156981dd93eba8ffdb504dbc175f27012daaad9d08cfb2 2024-04-16T18:15:28.150 DEBUG:botocore.auth:Signature: d84ede7fab09c9bd1def5eb1347d734a3119754129a4dc469d4c711b074684c4 2024-04-16T18:15:28.150 DEBUG:botocore.hooks:Event request-created.iam.GetUser: calling handler 2024-04-16T18:15:28.151 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.153 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000055213a039c4bed6d-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '487', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.154 DEBUG:botocore.parsers:Response body: b'/test-zone2de998ef8-5f83-4daf-9eb5-916c39046d7aarn:aws:iam::RGW11111111111111111:user/test-zone22024-04-16T18:15:21.666013Ztx0000055213a039c4bed6d-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.154 DEBUG:botocore.hooks:Event needs-retry.iam.GetUser: calling handler 2024-04-16T18:15:28.154 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.154 DEBUG:botocore.hooks:Event after-call.iam.GetUser: calling handler 2024-04-16T18:15:28.155 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.155 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.155 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.155 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.155 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.156 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAccessKeys) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAccessKeys', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.156 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler > 2024-04-16T18:15:28.156 DEBUG:botocore.hooks:Event choose-signer.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.156 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.156 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 575b893e712663944c456f61f1aabd27df830cbe7212c952bf0cd211f66fc279 2024-04-16T18:15:28.156 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 0a0ec770a69fa4cc1b950862d1dc9ad60c402b330c1efb9e4ae7777ede387b12 2024-04-16T18:15:28.157 DEBUG:botocore.auth:Signature: 06d2da8ec0a2b775f1ab8d18bed9f73e06674884658f0188b6ab32309d77ef71 2024-04-16T18:15:28.157 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.157 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.160 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000087d9627b823e846-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.160 DEBUG:botocore.parsers:Response body: b'test-zone2test-zone2JK8ZAX4T5I1BOG34PU2IActive2024-04-16T18:15:21.687901Zfalse' 2024-04-16T18:15:28.160 DEBUG:botocore.hooks:Event needs-retry.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.161 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.161 DEBUG:botocore.hooks:Event after-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.161 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.161 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.161 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.161 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.161 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.162 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAccessKeys) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAccessKeys', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.162 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler > 2024-04-16T18:15:28.162 DEBUG:botocore.hooks:Event choose-signer.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.162 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.162 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 575b893e712663944c456f61f1aabd27df830cbe7212c952bf0cd211f66fc279 2024-04-16T18:15:28.162 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 3d800afaed8d95d72c6444b544eabfffc3f4531ce3a63f3d58311de5611c48c8 2024-04-16T18:15:28.163 DEBUG:botocore.auth:Signature: 393e2e86c3d87eccd3891a72dbe7e7166293d5244d300d03053016d7db820d07 2024-04-16T18:15:28.163 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.163 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.166 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000ab557f25c6c9ae45-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.166 DEBUG:botocore.parsers:Response body: b'test-zone2test-zone2JK8ZAX4T5I1BOG34PU2IActive2024-04-16T18:15:21.687901Zfalse' 2024-04-16T18:15:28.166 DEBUG:botocore.hooks:Event needs-retry.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.166 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.167 DEBUG:botocore.hooks:Event after-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.167 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.167 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.167 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.167 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.167 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.168 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupsForUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupsForUser', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.168 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler > 2024-04-16T18:15:28.168 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.168 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.168 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date ecf8aee7706b736153a5a7d48afdc1ac23c4def3724f6ced3ccd7e69933ba573 2024-04-16T18:15:28.168 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request fb96de1b76a480efb95deb3fafc305d5e7a073aed4cb76b24e65bf00a15ceeb5 2024-04-16T18:15:28.168 DEBUG:botocore.auth:Signature: 7b9121a667e85c838c92a68d046b6034e396715d47d34482f4cfd0a115226b2e 2024-04-16T18:15:28.169 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.169 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.214 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b95e822c71f131b1-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '533', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.215 DEBUG:botocore.parsers:Response body: b'/test-zone22458a53c-a367-43fe-b683-fe2f665bb6edarn:aws:iam::RGW11111111111111111:group/test-zone2falsetx00000b95e822c71f131b1-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.215 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.215 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.215 DEBUG:botocore.hooks:Event after-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.215 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.215 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.216 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.216 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.216 DEBUG:botocore.hooks:Event before-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.216 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupsForUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupsForUser', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.216 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler > 2024-04-16T18:15:28.216 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.217 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.217 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date ecf8aee7706b736153a5a7d48afdc1ac23c4def3724f6ced3ccd7e69933ba573 2024-04-16T18:15:28.217 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request f21d1c46b09711e84e234288e3732a4223d41cd3f793dd63e27e1450f9b69cc5 2024-04-16T18:15:28.217 DEBUG:botocore.auth:Signature: 93cd518045ad2cccab54a3ea09bf6cff65ba9c478d5101d6e56a5bf6f207a024 2024-04-16T18:15:28.217 DEBUG:botocore.hooks:Event request-created.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.217 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.220 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000007d9ddf4f18ea0493-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '533', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.220 DEBUG:botocore.parsers:Response body: b'/test-zone22458a53c-a367-43fe-b683-fe2f665bb6edarn:aws:iam::RGW11111111111111111:group/test-zone2falsetx000007d9ddf4f18ea0493-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.220 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.220 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.221 DEBUG:botocore.hooks:Event after-call.iam.ListGroupsForUser: calling handler 2024-04-16T18:15:28.221 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.221 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.221 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.221 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.221 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.222 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.222 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler > 2024-04-16T18:15:28.222 DEBUG:botocore.hooks:Event choose-signer.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.222 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.222 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 683bb38491391414b27b590de03643d3067ab3a39c7a8909fc0ae8ca88576c7c 2024-04-16T18:15:28.222 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 0281090931077c745454a7ec6fad559bd488f3023b595305312dc822e68e31cf 2024-04-16T18:15:28.223 DEBUG:botocore.auth:Signature: 7fe6c49097956df9f3be99281c0a635f71e17bc7ce85e239f991b2937d892351 2024-04-16T18:15:28.223 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.223 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.226 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e7149a765702c745-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '343', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.226 DEBUG:botocore.parsers:Response body: b'tx00000e7149a765702c745-00661ec040-4816-test-zone1Allowfalse' 2024-04-16T18:15:28.226 DEBUG:botocore.hooks:Event needs-retry.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.226 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.226 DEBUG:botocore.hooks:Event after-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.227 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.227 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.227 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.227 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.227 DEBUG:botocore.hooks:Event before-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.227 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.228 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler > 2024-04-16T18:15:28.228 DEBUG:botocore.hooks:Event choose-signer.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.228 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.228 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 683bb38491391414b27b590de03643d3067ab3a39c7a8909fc0ae8ca88576c7c 2024-04-16T18:15:28.228 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request f23fa82de1181a282b01a90b0bc5f05fcce8218550a1ca222f0a5d9d3066efb2 2024-04-16T18:15:28.228 DEBUG:botocore.auth:Signature: 3e13cf55f2b1c065abb3f33dfd51f05f521458ec564399b93d848e4a564416a9 2024-04-16T18:15:28.228 DEBUG:botocore.hooks:Event request-created.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.229 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.231 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000056722f51eb3a02f8-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '343', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.231 DEBUG:botocore.parsers:Response body: b'tx0000056722f51eb3a02f8-00661ec040-5447-test-zone2Allowfalse' 2024-04-16T18:15:28.232 DEBUG:botocore.hooks:Event needs-retry.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.232 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.232 DEBUG:botocore.hooks:Event after-call.iam.ListUserPolicies: calling handler 2024-04-16T18:15:28.232 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.232 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.232 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.233 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.233 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.233 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.233 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler > 2024-04-16T18:15:28.233 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.233 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.234 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 3dace716e8edf34ab8446c6b1da0096d88964c8d134639d581b86139d8c0a818 2024-04-16T18:15:28.234 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 9d9b1606608a293a05356fd525e8925c30b4df36c8e86e26da7bec363feb9771 2024-04-16T18:15:28.234 DEBUG:botocore.auth:Signature: 3c48a20eb798a67861914365501e256ad513754eda1940403966680da76b934a 2024-04-16T18:15:28.234 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.234 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.237 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000054fe65b73f97ab52-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '488', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.237 DEBUG:botocore.parsers:Response body: b'tx0000054fe65b73f97ab52-00661ec040-4816-test-zone1AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalse' 2024-04-16T18:15:28.237 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.237 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.238 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.238 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.238 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.238 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.238 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.238 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.238 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedUserPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedUserPolicies', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.239 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler > 2024-04-16T18:15:28.239 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.239 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.239 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 3dace716e8edf34ab8446c6b1da0096d88964c8d134639d581b86139d8c0a818 2024-04-16T18:15:28.239 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request bdd58cbb82384c50c4c622ac8baf54f326feb83025e0375886fc24db190323b5 2024-04-16T18:15:28.239 DEBUG:botocore.auth:Signature: d5e06a7913e5a5bfd7bca10d3b91ba2e1b179bb3c0f6416249d1ab8b80c88187 2024-04-16T18:15:28.240 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.240 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.282 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000004e5cff763d9c9115-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '488', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.282 DEBUG:botocore.parsers:Response body: b'tx000004e5cff763d9c9115-00661ec040-5447-test-zone2AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalse' 2024-04-16T18:15:28.283 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.283 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.283 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedUserPolicies: calling handler 2024-04-16T18:15:28.283 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroups: calling handler 2024-04-16T18:15:28.284 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.284 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.284 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:28.284 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:28.284 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroups) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroups', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.285 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler > 2024-04-16T18:15:28.285 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroups: calling handler 2024-04-16T18:15:28.285 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.285 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 5f776d91509b9c99b8cb5eb5d6d4a787a33ae41c8cd6e7b69effca69080e1e1f 2024-04-16T18:15:28.285 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 3e11829a725951971e7dbcdde3f213e790d4162c8ebac90727cd978cb6adef5e 2024-04-16T18:15:28.286 DEBUG:botocore.auth:Signature: 3df99c66d238cb3c25e61d57d4f2b0e088c788f6b98d471289f475d1e616ac13 2024-04-16T18:15:28.286 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler 2024-04-16T18:15:28.286 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.292 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000bd68bafbd7f7d051-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.292 DEBUG:botocore.parsers:Response body: b'/test-zone1708ed322-dd11-47ee-9731-07fa113c96dfarn:aws:iam::RGW11111111111111111:group/test-zone1/test-zone22458a53c-a367-43fe-b683-fe2f665bb6edarn:aws:iam::RGW11111111111111111:group/test-zone2false' 2024-04-16T18:15:28.293 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroups: calling handler 2024-04-16T18:15:28.293 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.293 DEBUG:botocore.hooks:Event after-call.iam.ListGroups: calling handler 2024-04-16T18:15:28.293 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroups: calling handler 2024-04-16T18:15:28.294 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.294 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.294 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:28.294 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:28.294 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroups) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroups', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.295 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler > 2024-04-16T18:15:28.295 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroups: calling handler 2024-04-16T18:15:28.295 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.295 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 5f776d91509b9c99b8cb5eb5d6d4a787a33ae41c8cd6e7b69effca69080e1e1f 2024-04-16T18:15:28.295 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request ebb305c133eb52afb5aff7b3fe092821a01fd0aebbc53f796e625bf5786fa644 2024-04-16T18:15:28.295 DEBUG:botocore.auth:Signature: 9c1ba6ac205c8872398805a98126534f0156a06f15647a08e00805dd233c00c5 2024-04-16T18:15:28.296 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler 2024-04-16T18:15:28.296 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.298 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000af4b3b012af35248-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.299 DEBUG:botocore.parsers:Response body: b'/test-zone1708ed322-dd11-47ee-9731-07fa113c96dfarn:aws:iam::RGW11111111111111111:group/test-zone1/test-zone22458a53c-a367-43fe-b683-fe2f665bb6edarn:aws:iam::RGW11111111111111111:group/test-zone2false' 2024-04-16T18:15:28.299 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroups: calling handler 2024-04-16T18:15:28.299 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.299 DEBUG:botocore.hooks:Event after-call.iam.ListGroups: calling handler 2024-04-16T18:15:28.300 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetGroup: calling handler 2024-04-16T18:15:28.300 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.300 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.300 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.300 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.301 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.301 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler > 2024-04-16T18:15:28.301 DEBUG:botocore.hooks:Event choose-signer.iam.GetGroup: calling handler 2024-04-16T18:15:28.302 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.302 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 96c30390354a0b67fe3fad2562a6dea8125351a0e25f82d61db2010f5b8b25a3 2024-04-16T18:15:28.302 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 4ae719a6815a1b719d36c13357d75be1e90c8c89b5b30b83707eba3e523f75f3 2024-04-16T18:15:28.302 DEBUG:botocore.auth:Signature: a6876b3112f6178a067d72717704149eb46bc21127c562de51aa8bd1423d3278 2024-04-16T18:15:28.302 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler 2024-04-16T18:15:28.302 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.305 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000000d26a16a91c4776c-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '668', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.305 DEBUG:botocore.parsers:Response body: b'/test-zone1708ed322-dd11-47ee-9731-07fa113c96dfarn:aws:iam::RGW11111111111111111:group/test-zone1/test-zone1255da143-d579-4866-8dd6-a847a953c645arn:aws:iam::RGW11111111111111111:user/test-zone1falsetx000000d26a16a91c4776c-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.306 DEBUG:botocore.hooks:Event needs-retry.iam.GetGroup: calling handler 2024-04-16T18:15:28.306 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.306 DEBUG:botocore.hooks:Event after-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.306 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetGroup: calling handler 2024-04-16T18:15:28.307 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.307 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.307 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.307 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.307 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.308 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler > 2024-04-16T18:15:28.308 DEBUG:botocore.hooks:Event choose-signer.iam.GetGroup: calling handler 2024-04-16T18:15:28.308 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.308 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 96c30390354a0b67fe3fad2562a6dea8125351a0e25f82d61db2010f5b8b25a3 2024-04-16T18:15:28.308 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request c68688cf773d01cf4fc48eb7de708541a6be590496a10b318711ea51890ef4eb 2024-04-16T18:15:28.308 DEBUG:botocore.auth:Signature: 57be36a45204620d8bee580b4c469ef1518104e605cdbd65bceafdac9720789f 2024-04-16T18:15:28.309 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler 2024-04-16T18:15:28.309 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.312 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000a935eeb282bf11da-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '668', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.312 DEBUG:botocore.parsers:Response body: b'/test-zone1708ed322-dd11-47ee-9731-07fa113c96dfarn:aws:iam::RGW11111111111111111:group/test-zone1/test-zone1255da143-d579-4866-8dd6-a847a953c645arn:aws:iam::RGW11111111111111111:user/test-zone1falsetx00000a935eeb282bf11da-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.312 DEBUG:botocore.hooks:Event needs-retry.iam.GetGroup: calling handler 2024-04-16T18:15:28.312 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.313 DEBUG:botocore.hooks:Event after-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.313 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.313 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.313 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.314 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.314 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.314 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.314 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler > 2024-04-16T18:15:28.314 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.315 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.315 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 7811b9d5c4ca8b1e9d0155d32c2077f72a8b205c19c3c2277df8f5e6e074f9aa 2024-04-16T18:15:28.315 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request b922b6a7d1258d6e1e0648be80b709612d8c4b2ccae5a28fcaa376eabf402811 2024-04-16T18:15:28.315 DEBUG:botocore.auth:Signature: ea23022f9fc93376d7df467a15af5215da0f8c5be118d650a599b5d346dd4a3e 2024-04-16T18:15:28.315 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.315 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.318 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e018ae42e8521eb8-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '385', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.318 DEBUG:botocore.parsers:Response body: b'Allowfalsetx00000e018ae42e8521eb8-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.318 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.318 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.318 DEBUG:botocore.hooks:Event after-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.319 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.319 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.319 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.319 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.319 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.319 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.320 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler > 2024-04-16T18:15:28.320 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.320 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.320 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 7811b9d5c4ca8b1e9d0155d32c2077f72a8b205c19c3c2277df8f5e6e074f9aa 2024-04-16T18:15:28.320 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 2b5e4e1b604b86dfc023321118c807610dce3c65a12eba4a196e0cfbf8262bc0 2024-04-16T18:15:28.321 DEBUG:botocore.auth:Signature: 6840d25b72de01a4a4f15850b0e4542cc2109e92f4ffc50e75efa594a330d48e 2024-04-16T18:15:28.321 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.321 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.366 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000c9a9917e907b2968-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '385', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.366 DEBUG:botocore.parsers:Response body: b'Allowfalsetx00000c9a9917e907b2968-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.367 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.367 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.367 DEBUG:botocore.hooks:Event after-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.368 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.368 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.368 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.368 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.368 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.368 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.369 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler > 2024-04-16T18:15:28.369 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.369 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.369 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date d3cad5863c5641759e4bcb9ff168c45d0bfbea13d35654ca45486df7605c4b98 2024-04-16T18:15:28.369 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request e82867e455fb6eb03f4dfcb5bda843404f37aebc25abaf05504f27bd6818a9d8 2024-04-16T18:15:28.370 DEBUG:botocore.auth:Signature: c15b87606b3a5e53e551fe6f1f932ee1982e1f52ece1adb99528a63ec6f6ad02 2024-04-16T18:15:28.370 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.370 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.372 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000081a06e7590e85ef8-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '530', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.372 DEBUG:botocore.parsers:Response body: b'AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalsetx0000081a06e7590e85ef8-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.373 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.373 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.373 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.373 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.374 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.374 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.374 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.374 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.374 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.375 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler > 2024-04-16T18:15:28.375 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.375 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.375 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date d3cad5863c5641759e4bcb9ff168c45d0bfbea13d35654ca45486df7605c4b98 2024-04-16T18:15:28.375 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 1a1e02fbd9e23e2ed493ad7b1f56cf2c11747e5818f3e4631cb6bbc9b3986606 2024-04-16T18:15:28.375 DEBUG:botocore.auth:Signature: 7f8bf67c181dcd1356b4c3c2b03fc7519cb989d1d0f88808701d2e707032e6f0 2024-04-16T18:15:28.376 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.376 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.378 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000006b3616e32b5a7cd4-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '530', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.378 DEBUG:botocore.parsers:Response body: b'AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalsetx000006b3616e32b5a7cd4-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.378 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.378 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.379 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.379 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetGroup: calling handler 2024-04-16T18:15:28.379 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.379 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.379 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.379 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.379 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.380 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler > 2024-04-16T18:15:28.380 DEBUG:botocore.hooks:Event choose-signer.iam.GetGroup: calling handler 2024-04-16T18:15:28.380 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.380 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 0de1abeeecebec53ce7c53e52f1ad78c5754c2ec5c9b2c6a3da55177a99211d3 2024-04-16T18:15:28.380 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request cf77aed8350c62183b8647ebea3a414be8cfd3fe9690991ff74f783bc0ea7d70 2024-04-16T18:15:28.380 DEBUG:botocore.auth:Signature: c098330ed248eb036991b94e2d84143108bbf27a0d1604cd9662a5c31264e149 2024-04-16T18:15:28.380 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler 2024-04-16T18:15:28.381 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.384 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000fd2b3b724dee9c6b-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '668', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.384 DEBUG:botocore.parsers:Response body: b'/test-zone22458a53c-a367-43fe-b683-fe2f665bb6edarn:aws:iam::RGW11111111111111111:group/test-zone2/test-zone2de998ef8-5f83-4daf-9eb5-916c39046d7aarn:aws:iam::RGW11111111111111111:user/test-zone2falsetx00000fd2b3b724dee9c6b-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.384 DEBUG:botocore.hooks:Event needs-retry.iam.GetGroup: calling handler 2024-04-16T18:15:28.384 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.384 DEBUG:botocore.hooks:Event after-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.384 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetGroup: calling handler 2024-04-16T18:15:28.385 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.385 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.385 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.385 DEBUG:botocore.hooks:Event before-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.385 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.385 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler > 2024-04-16T18:15:28.385 DEBUG:botocore.hooks:Event choose-signer.iam.GetGroup: calling handler 2024-04-16T18:15:28.386 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.386 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 0de1abeeecebec53ce7c53e52f1ad78c5754c2ec5c9b2c6a3da55177a99211d3 2024-04-16T18:15:28.386 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 8e6fa6f687d260157e2d0ed27ec3bbe4d12e9d180be5d4b6388298cad8f191d2 2024-04-16T18:15:28.386 DEBUG:botocore.auth:Signature: feab41969ee421bfe21714891313eae73518a9df99a5a2b44d6cfac72c400c95 2024-04-16T18:15:28.386 DEBUG:botocore.hooks:Event request-created.iam.GetGroup: calling handler 2024-04-16T18:15:28.386 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.388 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000349947bea405f1d0-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '668', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.389 DEBUG:botocore.parsers:Response body: b'/test-zone22458a53c-a367-43fe-b683-fe2f665bb6edarn:aws:iam::RGW11111111111111111:group/test-zone2/test-zone2de998ef8-5f83-4daf-9eb5-916c39046d7aarn:aws:iam::RGW11111111111111111:user/test-zone2falsetx00000349947bea405f1d0-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.389 DEBUG:botocore.hooks:Event needs-retry.iam.GetGroup: calling handler 2024-04-16T18:15:28.389 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.389 DEBUG:botocore.hooks:Event after-call.iam.GetGroup: calling handler 2024-04-16T18:15:28.389 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.390 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.390 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.390 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.390 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.390 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.390 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler > 2024-04-16T18:15:28.390 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.391 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.391 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date b8c9ebd42f207eccd0f1ac4735e5608d9b5aca42e16ba14ba414850016f19bb6 2024-04-16T18:15:28.391 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 82e45833d7e4e7cb5062792d544b3a354f757f9bab1c455ba5dc9ee637e1648c 2024-04-16T18:15:28.391 DEBUG:botocore.auth:Signature: b1d7bed8d61fb5e03d9d182f0ed088a31e038033bdbd1ba906bfc2fbd7ea6e3b 2024-04-16T18:15:28.391 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.391 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.394 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000071d9d1765f27ecc7-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '385', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.394 DEBUG:botocore.parsers:Response body: b'Allowfalsetx0000071d9d1765f27ecc7-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.394 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.394 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.394 DEBUG:botocore.hooks:Event after-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.395 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.395 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.395 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.395 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.395 DEBUG:botocore.hooks:Event before-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.395 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.395 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler > 2024-04-16T18:15:28.396 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.396 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.396 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date b8c9ebd42f207eccd0f1ac4735e5608d9b5aca42e16ba14ba414850016f19bb6 2024-04-16T18:15:28.396 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 15d0606267d4e3d545da2a9005e522f2a91c8abf911abfb5650f8c9becc6d29d 2024-04-16T18:15:28.396 DEBUG:botocore.auth:Signature: 8833a48b591cbc02bce26f29e68f0c130fe6e1c0002255fb8996ccfa9abb23a6 2024-04-16T18:15:28.396 DEBUG:botocore.hooks:Event request-created.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.397 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.398 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000002bf7c8b60155d701-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '385', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.399 DEBUG:botocore.parsers:Response body: b'Allowfalsetx000002bf7c8b60155d701-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.399 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.399 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.399 DEBUG:botocore.hooks:Event after-call.iam.ListGroupPolicies: calling handler 2024-04-16T18:15:28.399 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.399 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.399 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.400 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.400 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.400 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.400 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler > 2024-04-16T18:15:28.400 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.401 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.401 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 4cdafc9ca13a31ddd9a7a3bfb5e4a2230e855a4b6f877fc7873c6f03bf7ad991 2024-04-16T18:15:28.401 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 6a73006b0a6f7fc26bce248df9336fefa64cd7d7d58f481ba04f67238b8508ee 2024-04-16T18:15:28.401 DEBUG:botocore.auth:Signature: 72c68eefc371d901e4b537f42b22aad1f3ead7e3f1bc8ff01d47eff8902b4405 2024-04-16T18:15:28.401 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.401 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.403 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000069c1b9afb4062ff3-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '530', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.403 DEBUG:botocore.parsers:Response body: b'AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalsetx0000069c1b9afb4062ff3-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.404 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.404 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.404 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.404 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.404 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.404 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.404 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.405 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.405 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedGroupPolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedGroupPolicies', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.405 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler > 2024-04-16T18:15:28.405 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.405 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.405 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 4cdafc9ca13a31ddd9a7a3bfb5e4a2230e855a4b6f877fc7873c6f03bf7ad991 2024-04-16T18:15:28.405 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request d6e2502005bb734350129565c51ce69fbee37dc6c5482cfcb23dd4bd3f4eba84 2024-04-16T18:15:28.406 DEBUG:botocore.auth:Signature: a67f2cfdc605a145b4231946e7e00301ec9ad2b0cdb57edb754ea54d3a85c508 2024-04-16T18:15:28.406 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.406 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.408 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000d10042188be90b73-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '530', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.408 DEBUG:botocore.parsers:Response body: b'AmazonS3FullAccessarn:aws:iam::aws:policy/AmazonS3FullAccessfalsetx00000d10042188be90b73-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.408 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.408 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.408 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedGroupPolicies: calling handler 2024-04-16T18:15:28.409 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.409 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.409 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.409 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.409 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.409 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListOpenIDConnectProviders) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListOpenIDConnectProviders', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.410 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler > 2024-04-16T18:15:28.410 DEBUG:botocore.hooks:Event choose-signer.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.410 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.410 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 6be253d5bef7fe9cb4ed0d00d8a18351f59593888e86906ef784f147279adb10 2024-04-16T18:15:28.411 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request cc4eac639295f273c7ba0147a272e07b27c525b071f2e7405a74ac3b00331e3c 2024-04-16T18:15:28.411 DEBUG:botocore.auth:Signature: 0ce5125705a9ce56a8676270f468b22f4b4043bf773988a47e9b4813d5735a68 2024-04-16T18:15:28.411 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.411 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.425 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000007a3571152c527650-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '357', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.426 DEBUG:botocore.parsers:Response body: b'tx000007a3571152c527650-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.426 DEBUG:botocore.hooks:Event needs-retry.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.426 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.426 DEBUG:botocore.hooks:Event after-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.427 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.427 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.427 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.427 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.427 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.427 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListOpenIDConnectProviders) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListOpenIDConnectProviders', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.428 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler > 2024-04-16T18:15:28.428 DEBUG:botocore.hooks:Event choose-signer.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.428 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.428 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 6be253d5bef7fe9cb4ed0d00d8a18351f59593888e86906ef784f147279adb10 2024-04-16T18:15:28.428 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request d8304a2a3209e9e3a3037689a6829a25d646aad6e343ca8e7026b8e8914fd5b4 2024-04-16T18:15:28.428 DEBUG:botocore.auth:Signature: ba9f65d4c01f3f3b26a85bd61b1b6db59cbda790ba2a5083072e323e530923e7 2024-04-16T18:15:28.429 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.429 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.443 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000621af7f828b1428f-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '357', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.443 DEBUG:botocore.parsers:Response body: b'tx00000621af7f828b1428f-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.443 DEBUG:botocore.hooks:Event needs-retry.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.443 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.443 DEBUG:botocore.hooks:Event after-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:28.444 DEBUG:botocore.hooks:Event before-parameter-build.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.444 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.444 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.444 DEBUG:botocore.hooks:Event before-call.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.444 DEBUG:botocore.hooks:Event before-call.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.445 DEBUG:botocore.endpoint:Making request for OperationModel(name=DetachRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DetachRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone1', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.445 DEBUG:botocore.hooks:Event request-created.iam.DetachRolePolicy: calling handler > 2024-04-16T18:15:28.445 DEBUG:botocore.hooks:Event choose-signer.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.445 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.445 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date bd73383d5317fe146a37b32cc167dca318a97704e67083ae893e94c203174404 2024-04-16T18:15:28.446 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request cc382c3db7915d5f910c6184afdb65befaa7164176b1d6e0d992864e3f63b722 2024-04-16T18:15:28.446 DEBUG:botocore.auth:Signature: 31666ab632c923778821fa790265ad368189a2f2ca2bbc25474515d01e57ae70 2024-04-16T18:15:28.446 DEBUG:botocore.hooks:Event request-created.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.446 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.502 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000315638c261f8a5a0-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.502 DEBUG:botocore.parsers:Response body: b'tx00000315638c261f8a5a0-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.503 DEBUG:botocore.hooks:Event needs-retry.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.503 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.503 DEBUG:botocore.hooks:Event after-call.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.503 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.503 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.504 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.504 DEBUG:botocore.hooks:Event before-call.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.504 DEBUG:botocore.hooks:Event before-call.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.504 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone1', 'PolicyName': 'Allow'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.504 DEBUG:botocore.hooks:Event request-created.iam.DeleteRolePolicy: calling handler > 2024-04-16T18:15:28.505 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.505 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.505 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date ff2b8e08f5bd2f6e968bc5d2892f7a2005ce31351a054fa3113914bd584e4a51 2024-04-16T18:15:28.505 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 08ac78084cd5dee9dcc4df2213439b4e5590b9ac15288e9d096d62a68372935f 2024-04-16T18:15:28.505 DEBUG:botocore.auth:Signature: 4c2ff6aca78991a4ea4ba92d899c61e0c484579ef95c48d860db53a64c316986 2024-04-16T18:15:28.505 DEBUG:botocore.hooks:Event request-created.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.506 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.513 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000000a443c85e2b25cea-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '163', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.513 DEBUG:botocore.parsers:Response body: b'tx000000a443c85e2b25cea-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.514 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.514 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.514 DEBUG:botocore.hooks:Event after-call.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.514 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteRole: calling handler 2024-04-16T18:15:28.514 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.514 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.515 DEBUG:botocore.hooks:Event before-call.iam.DeleteRole: calling handler 2024-04-16T18:15:28.515 DEBUG:botocore.hooks:Event before-call.iam.DeleteRole: calling handler 2024-04-16T18:15:28.515 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteRole', 'Version': '2010-05-08', 'RoleName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.515 DEBUG:botocore.hooks:Event request-created.iam.DeleteRole: calling handler > 2024-04-16T18:15:28.515 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteRole: calling handler 2024-04-16T18:15:28.515 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.515 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date eb0db1c076fced9cc6f71d7a5176de1b17d1027791a1e35ab50e96286833a6ef 2024-04-16T18:15:28.516 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 0af9fc4d99844800d067c484d53895d4e14443384def7530cc74a9be12c511fa 2024-04-16T18:15:28.516 DEBUG:botocore.auth:Signature: 0eef3283cd125b6ba76ea62f0aa1575ab0a94f7b445b693a2e0555ac637f0517 2024-04-16T18:15:28.516 DEBUG:botocore.hooks:Event request-created.iam.DeleteRole: calling handler 2024-04-16T18:15:28.516 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.527 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000c4071d86ce2db5f0-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '151', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.527 DEBUG:botocore.parsers:Response body: b'tx00000c4071d86ce2db5f0-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.527 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteRole: calling handler 2024-04-16T18:15:28.527 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.527 DEBUG:botocore.hooks:Event after-call.iam.DeleteRole: calling handler 2024-04-16T18:15:28.528 DEBUG:botocore.hooks:Event before-parameter-build.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.528 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.528 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.528 DEBUG:botocore.hooks:Event before-call.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.528 DEBUG:botocore.hooks:Event before-call.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.529 DEBUG:botocore.endpoint:Making request for OperationModel(name=RemoveUserFromGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'RemoveUserFromGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone1', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.529 DEBUG:botocore.hooks:Event request-created.iam.RemoveUserFromGroup: calling handler > 2024-04-16T18:15:28.529 DEBUG:botocore.hooks:Event choose-signer.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.529 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.529 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 8101fbe751c2510228d0196ca3a189db821341cab247a56bf56b1a8de94be62f 2024-04-16T18:15:28.529 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request afed101c5cb2f89d2ba4983b185e5bb6db6c8c13d1f9acc4476bd491ab6cd2c3 2024-04-16T18:15:28.530 DEBUG:botocore.auth:Signature: 68448d7e67c7eacdb042a04074b9feeb990739246b553b59809328f14d40a781 2024-04-16T18:15:28.530 DEBUG:botocore.hooks:Event request-created.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.530 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.582 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000d9159c824f597462-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '257', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.582 DEBUG:botocore.parsers:Response body: b'tx00000d9159c824f597462-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.583 DEBUG:botocore.hooks:Event needs-retry.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.583 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.583 DEBUG:botocore.hooks:Event after-call.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.583 DEBUG:botocore.hooks:Event before-parameter-build.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.583 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.584 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.584 DEBUG:botocore.hooks:Event before-call.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.584 DEBUG:botocore.hooks:Event before-call.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.584 DEBUG:botocore.endpoint:Making request for OperationModel(name=DetachGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DetachGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone1', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.584 DEBUG:botocore.hooks:Event request-created.iam.DetachGroupPolicy: calling handler > 2024-04-16T18:15:28.585 DEBUG:botocore.hooks:Event choose-signer.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.585 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.585 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 93eba8cc47d76370fe5425ab749ce1edbed126d87b12ab5216df76b39f891c29 2024-04-16T18:15:28.585 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request aef04be81a3af25d99a42d21dbde86a08f5b61b7ac6f45702e20e219137065aa 2024-04-16T18:15:28.585 DEBUG:botocore.auth:Signature: 0864751947e9d5dccf35a5ebf632547b3c23039eab1c84b4129e657716643fe4 2024-04-16T18:15:28.585 DEBUG:botocore.hooks:Event request-created.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.586 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.592 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000858d6badf8fd7ed4-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '253', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.592 DEBUG:botocore.parsers:Response body: b'tx00000858d6badf8fd7ed4-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.592 DEBUG:botocore.hooks:Event needs-retry.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.593 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.593 DEBUG:botocore.hooks:Event after-call.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.593 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:28.593 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.593 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.594 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:28.594 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:28.594 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone1', 'PolicyName': 'Allow'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.594 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroupPolicy: calling handler > 2024-04-16T18:15:28.595 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:28.595 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.595 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date bcb6e0830d4e4b57d0c03ed18cd3a27f9eed72fb600ce4b187dfdf4f5a23a0f1 2024-04-16T18:15:28.595 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request accae0604c8ab703e74cf2058eb010529cd1ec329ffc85a5ba97d3a63c65abfd 2024-04-16T18:15:28.595 DEBUG:botocore.auth:Signature: 9cbffe359a34cfbfef83359bb3ab689b0af949c1ccbbed7b210e3f25c8fbd8eb 2024-04-16T18:15:28.595 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:28.596 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.602 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000070d5b77ffaaf46fb-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '253', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.602 DEBUG:botocore.parsers:Response body: b'tx0000070d5b77ffaaf46fb-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.602 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:28.602 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.603 DEBUG:botocore.hooks:Event after-call.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:28.603 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteGroup: calling handler 2024-04-16T18:15:28.603 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.603 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.603 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroup: calling handler 2024-04-16T18:15:28.604 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroup: calling handler 2024-04-16T18:15:28.604 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.604 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroup: calling handler > 2024-04-16T18:15:28.604 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteGroup: calling handler 2024-04-16T18:15:28.604 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.605 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date fe2ed6547b0314458d41caf46f8196bcd62a800e25af60d633b29183f00efad6 2024-04-16T18:15:28.605 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request d9103fce62a739555e61cbd80039d7fcca3f715938a6c7107bee719b556658b6 2024-04-16T18:15:28.605 DEBUG:botocore.auth:Signature: 96c8c41aa2c8101dcbc3eb67f9679fb00ac463a4a8ba7ccfabbbf432d069b70a 2024-04-16T18:15:28.605 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroup: calling handler 2024-04-16T18:15:28.605 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.658 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000f2008199b67acd3c-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '241', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.659 DEBUG:botocore.parsers:Response body: b'tx00000f2008199b67acd3c-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.659 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteGroup: calling handler 2024-04-16T18:15:28.659 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.659 DEBUG:botocore.hooks:Event after-call.iam.DeleteGroup: calling handler 2024-04-16T18:15:28.660 DEBUG:botocore.hooks:Event before-parameter-build.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:28.660 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.660 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.660 DEBUG:botocore.hooks:Event before-call.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:28.660 DEBUG:botocore.hooks:Event before-call.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:28.661 DEBUG:botocore.endpoint:Making request for OperationModel(name=DetachUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DetachUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone1', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.661 DEBUG:botocore.hooks:Event request-created.iam.DetachUserPolicy: calling handler > 2024-04-16T18:15:28.661 DEBUG:botocore.hooks:Event choose-signer.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:28.662 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.662 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date e4eb10f876ac99edb55b6e38ac859bdca8126307348276c5e6af1c89db67d5ef 2024-04-16T18:15:28.662 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request e5a78ca7573d7685238e4c86ac1dbbfaef733cc99ad2d14ea26ae3f74460f1e0 2024-04-16T18:15:28.662 DEBUG:botocore.auth:Signature: 15b8e6402ab426259ec3bf950346c8f3c4aff0ec1c1f35e04d6c22dfe1d77c62 2024-04-16T18:15:28.662 DEBUG:botocore.hooks:Event request-created.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:28.663 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.676 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000dd918ce98731abc1-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.676 DEBUG:botocore.parsers:Response body: b'tx00000dd918ce98731abc1-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.676 DEBUG:botocore.hooks:Event needs-retry.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:28.676 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.677 DEBUG:botocore.hooks:Event after-call.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:28.677 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:28.677 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.677 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.677 DEBUG:botocore.hooks:Event before-call.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:28.678 DEBUG:botocore.hooks:Event before-call.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:28.678 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone1', 'PolicyName': 'Allow'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.678 DEBUG:botocore.hooks:Event request-created.iam.DeleteUserPolicy: calling handler > 2024-04-16T18:15:28.678 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:28.678 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.679 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date a8978949ce38abd713a4ef1765a7b6091a66572aed9d67f96ac31a077d7e0d99 2024-04-16T18:15:28.679 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request f23d409932cdd7df48cf16098fb838782a23d5164683a62cca2a6204dbd582ff 2024-04-16T18:15:28.679 DEBUG:botocore.auth:Signature: 07b15384c459b894d7ee0a391f1e9ad242f356ed9dab6a10f5e429971c4ef6d3 2024-04-16T18:15:28.679 DEBUG:botocore.hooks:Event request-created.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:28.679 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.692 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e59e2b264fd0a8a5-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '217', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.692 DEBUG:botocore.parsers:Response body: b'tx00000e59e2b264fd0a8a5-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.693 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:28.693 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.693 DEBUG:botocore.hooks:Event after-call.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:28.693 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.693 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.693 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.694 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.694 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.694 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAccessKeys) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAccessKeys', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.694 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler > 2024-04-16T18:15:28.694 DEBUG:botocore.hooks:Event choose-signer.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.695 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.695 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 919fd997a1071a9eb8adeb0d8e2a852ea3984fffd61b7a1dc133995556ffb778 2024-04-16T18:15:28.695 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 3f9d73901e939e692a9ace011b98d957b05d97a83731c9092fec6eec935fb71c 2024-04-16T18:15:28.695 DEBUG:botocore.auth:Signature: 78a413188e3c6af4d5a27f7140ffcc47aaeb20b2c13680efa48fa20ddc72b127 2024-04-16T18:15:28.695 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.695 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.738 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000a121a470cae1cc7c-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.738 DEBUG:botocore.parsers:Response body: b'test-zone1test-zone1L54B5JRY5QAP851HQA4CActive2024-04-16T18:15:21.386460Zfalse' 2024-04-16T18:15:28.739 DEBUG:botocore.hooks:Event needs-retry.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.739 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.739 DEBUG:botocore.hooks:Event after-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:28.740 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:28.740 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.740 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.740 DEBUG:botocore.hooks:Event before-call.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:28.740 DEBUG:botocore.hooks:Event before-call.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:28.740 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteAccessKey) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteAccessKey', 'Version': '2010-05-08', 'UserName': 'test-zone1', 'AccessKeyId': 'L54B5JRY5QAP851HQA4C'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.741 DEBUG:botocore.hooks:Event request-created.iam.DeleteAccessKey: calling handler > 2024-04-16T18:15:28.741 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:28.741 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.741 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 91a92b66b96cea4c902f054d1c0e3275e724a30fcfdfaca5062dd7e9f967256b 2024-04-16T18:15:28.741 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request e959003de084f4b50699779287c08a434fdd9193d7ac3a5196dae5b00892123a 2024-04-16T18:15:28.741 DEBUG:botocore.auth:Signature: 0c79ceb5d4752a8214febc8a96774248b2a1e6c9a52ac3aecd5241821f754fe6 2024-04-16T18:15:28.742 DEBUG:botocore.hooks:Event request-created.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:28.742 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.752 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000060de15a02544cbda-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '249', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.753 DEBUG:botocore.parsers:Response body: b'tx0000060de15a02544cbda-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.753 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:28.753 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.753 DEBUG:botocore.hooks:Event after-call.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:28.754 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteUser: calling handler 2024-04-16T18:15:28.754 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.754 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:28.754 DEBUG:botocore.hooks:Event before-call.iam.DeleteUser: calling handler 2024-04-16T18:15:28.754 DEBUG:botocore.hooks:Event before-call.iam.DeleteUser: calling handler 2024-04-16T18:15:28.754 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteUser', 'Version': '2010-05-08', 'UserName': 'test-zone1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.755 DEBUG:botocore.hooks:Event request-created.iam.DeleteUser: calling handler > 2024-04-16T18:15:28.755 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteUser: calling handler 2024-04-16T18:15:28.755 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.755 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 73b6ad4b3e5d11fba46ac1e98e9ba27cc1964c1d8192f1fa1a1bf17be5282a09 2024-04-16T18:15:28.755 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 392e453d348d046eee3fd54e6315e0ff132f60730274811fe1cfba867849a81a 2024-04-16T18:15:28.755 DEBUG:botocore.auth:Signature: 4eafa94df0596a503b0c097a50652d02deb92f12bb34ff3cb1cbf9e6a28846ec 2024-04-16T18:15:28.756 DEBUG:botocore.hooks:Event request-created.iam.DeleteUser: calling handler 2024-04-16T18:15:28.756 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.765 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000013c8dd8081691e96-00661ec040-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.765 DEBUG:botocore.parsers:Response body: b'tx0000013c8dd8081691e96-00661ec040-4816-test-zone1' 2024-04-16T18:15:28.765 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteUser: calling handler 2024-04-16T18:15:28.765 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.766 DEBUG:botocore.hooks:Event after-call.iam.DeleteUser: calling handler 2024-04-16T18:15:28.766 DEBUG:botocore.hooks:Event before-parameter-build.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.766 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.766 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.767 DEBUG:botocore.hooks:Event before-call.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.767 DEBUG:botocore.hooks:Event before-call.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.767 DEBUG:botocore.endpoint:Making request for OperationModel(name=DetachRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DetachRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone2', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.767 DEBUG:botocore.hooks:Event request-created.iam.DetachRolePolicy: calling handler > 2024-04-16T18:15:28.767 DEBUG:botocore.hooks:Event choose-signer.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.768 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.768 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date c325a97cec49c93483b73d102a4ee669ab364fdbcde01894c7995f875c5e42ea 2024-04-16T18:15:28.768 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 5fbdbf73308ae1f8f2201ac81f69500abeed9ea2969ed493c9986615588f2233 2024-04-16T18:15:28.768 DEBUG:botocore.auth:Signature: c480c4c257f143def688c84802d7350892921b37d111c69a0d030fc50cf002cf 2024-04-16T18:15:28.768 DEBUG:botocore.hooks:Event request-created.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.768 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.779 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000d6f1271908ba8530-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.779 DEBUG:botocore.parsers:Response body: b'tx00000d6f1271908ba8530-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.780 DEBUG:botocore.hooks:Event needs-retry.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.780 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.780 DEBUG:botocore.hooks:Event after-call.iam.DetachRolePolicy: calling handler 2024-04-16T18:15:28.780 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.780 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.781 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.781 DEBUG:botocore.hooks:Event before-call.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.781 DEBUG:botocore.hooks:Event before-call.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.781 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteRolePolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteRolePolicy', 'Version': '2010-05-08', 'RoleName': 'test-zone2', 'PolicyName': 'Allow'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.781 DEBUG:botocore.hooks:Event request-created.iam.DeleteRolePolicy: calling handler > 2024-04-16T18:15:28.782 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.782 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.782 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 0e711179b95df7649427669dd02fc5b80c804175ee6ff14feb947361680d8f4c 2024-04-16T18:15:28.782 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request a097f93120a265b647c2af9ef1ba959e3c61daca3d58165d54538788ac4175c9 2024-04-16T18:15:28.782 DEBUG:botocore.auth:Signature: 557c198897e45b23d582b85f99e938cad27a76af8bc646bd21705de3ec789f1e 2024-04-16T18:15:28.782 DEBUG:botocore.hooks:Event request-created.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.783 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.874 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005a43493e85ef8abf-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '163', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.875 DEBUG:botocore.parsers:Response body: b'tx000005a43493e85ef8abf-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.875 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.875 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.875 DEBUG:botocore.hooks:Event after-call.iam.DeleteRolePolicy: calling handler 2024-04-16T18:15:28.875 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteRole: calling handler 2024-04-16T18:15:28.876 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.876 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.876 DEBUG:botocore.hooks:Event before-call.iam.DeleteRole: calling handler 2024-04-16T18:15:28.876 DEBUG:botocore.hooks:Event before-call.iam.DeleteRole: calling handler 2024-04-16T18:15:28.876 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteRole', 'Version': '2010-05-08', 'RoleName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.876 DEBUG:botocore.hooks:Event request-created.iam.DeleteRole: calling handler > 2024-04-16T18:15:28.877 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteRole: calling handler 2024-04-16T18:15:28.877 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.877 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date 832fae51b1d10776be58658abbb6e5d165d2e58ca758e9bedbbbabf3d441ea56 2024-04-16T18:15:28.877 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 0b2d7270aee3147d1f5ae051de266f38f6967a094af07c660300873bb68a962a 2024-04-16T18:15:28.877 DEBUG:botocore.auth:Signature: 935e7d0177985e162414ce27379e2f1715fbb9b3eae3edf76350c5833839b490 2024-04-16T18:15:28.877 DEBUG:botocore.hooks:Event request-created.iam.DeleteRole: calling handler 2024-04-16T18:15:28.878 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.896 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000002ff2bb1e91eb66cb-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '151', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.896 DEBUG:botocore.parsers:Response body: b'tx000002ff2bb1e91eb66cb-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.896 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteRole: calling handler 2024-04-16T18:15:28.896 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.897 DEBUG:botocore.hooks:Event after-call.iam.DeleteRole: calling handler 2024-04-16T18:15:28.897 DEBUG:botocore.hooks:Event before-parameter-build.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.897 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.897 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.898 DEBUG:botocore.hooks:Event before-call.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.898 DEBUG:botocore.hooks:Event before-call.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.898 DEBUG:botocore.endpoint:Making request for OperationModel(name=RemoveUserFromGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'RemoveUserFromGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone2', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.898 DEBUG:botocore.hooks:Event request-created.iam.RemoveUserFromGroup: calling handler > 2024-04-16T18:15:28.898 DEBUG:botocore.hooks:Event choose-signer.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.899 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.899 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date f37f0ec6c347966013e62f32fd007623cac80b2e0db8e71ca06331c77d3b3c28 2024-04-16T18:15:28.899 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request 2c079f8777514e6557a60d4d4aa3c795de69a6abca2d779279bc120f48565ab0 2024-04-16T18:15:28.899 DEBUG:botocore.auth:Signature: 620712ce3638ea2b5bd893816b3555012c47eb3bdde9eca29272de33278fb15d 2024-04-16T18:15:28.899 DEBUG:botocore.hooks:Event request-created.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.899 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:28.957 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000000a5a45bd2fc82be6-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '257', 'Date': 'Tue, 16 Apr 2024 18:15:28 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:28.957 DEBUG:botocore.parsers:Response body: b'tx000000a5a45bd2fc82be6-00661ec040-5447-test-zone2' 2024-04-16T18:15:28.958 DEBUG:botocore.hooks:Event needs-retry.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.958 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:28.958 DEBUG:botocore.hooks:Event after-call.iam.RemoveUserFromGroup: calling handler 2024-04-16T18:15:28.958 DEBUG:botocore.hooks:Event before-parameter-build.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.959 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:28.959 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:28.959 DEBUG:botocore.hooks:Event before-call.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.959 DEBUG:botocore.hooks:Event before-call.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.959 DEBUG:botocore.endpoint:Making request for OperationModel(name=DetachGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DetachGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone2', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:28.959 DEBUG:botocore.hooks:Event request-created.iam.DetachGroupPolicy: calling handler > 2024-04-16T18:15:28.960 DEBUG:botocore.hooks:Event choose-signer.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.960 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:28.960 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181528Z content-type;host;x-amz-date d10497e442384ad8daba8c183ca9a44d1658b63c4ded1005678646a32710f983 2024-04-16T18:15:28.960 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181528Z 20240416/test-zonegroup/iam/aws4_request f0174c7a784ba39cc2d219b268760b13974d34b1c2f93a7168478e16460727a5 2024-04-16T18:15:28.960 DEBUG:botocore.auth:Signature: 4111f77d27c27d1ce1a3d11779b80daa17f0894c9f52583b123c4ca032796558 2024-04-16T18:15:28.960 DEBUG:botocore.hooks:Event request-created.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:28.961 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.054 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000031a78a1f161c803-00661ec040-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '253', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.055 DEBUG:botocore.parsers:Response body: b'tx00000031a78a1f161c803-00661ec040-5447-test-zone2' 2024-04-16T18:15:29.055 DEBUG:botocore.hooks:Event needs-retry.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:29.055 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.055 DEBUG:botocore.hooks:Event after-call.iam.DetachGroupPolicy: calling handler 2024-04-16T18:15:29.055 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:29.056 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:29.056 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:29.056 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:29.056 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:29.056 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteGroupPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteGroupPolicy', 'Version': '2010-05-08', 'GroupName': 'test-zone2', 'PolicyName': 'Allow'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:29.057 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroupPolicy: calling handler > 2024-04-16T18:15:29.057 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:29.057 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:29.057 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181529Z content-type;host;x-amz-date bc90399dc585c9565b8e09c006ff5a452f25f284492b3177a00a6816d35ed452 2024-04-16T18:15:29.058 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181529Z 20240416/test-zonegroup/iam/aws4_request f750abbbd3f6b25b809c68730ce3d49aa70ce6d1b34ac78c345b58618b49093a 2024-04-16T18:15:29.058 DEBUG:botocore.auth:Signature: 119fa4f6ec10e1013487e0cfde12f3b3704a825e482b1f91d0ed268ff1029997 2024-04-16T18:15:29.058 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:29.058 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.068 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000e6476e079df76302-00661ec041-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '253', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.068 DEBUG:botocore.parsers:Response body: b'tx00000e6476e079df76302-00661ec041-5447-test-zone2' 2024-04-16T18:15:29.068 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:29.068 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.068 DEBUG:botocore.hooks:Event after-call.iam.DeleteGroupPolicy: calling handler 2024-04-16T18:15:29.069 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteGroup: calling handler 2024-04-16T18:15:29.069 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:29.069 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:29.069 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroup: calling handler 2024-04-16T18:15:29.069 DEBUG:botocore.hooks:Event before-call.iam.DeleteGroup: calling handler 2024-04-16T18:15:29.070 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteGroup) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteGroup', 'Version': '2010-05-08', 'GroupName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:29.070 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroup: calling handler > 2024-04-16T18:15:29.070 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteGroup: calling handler 2024-04-16T18:15:29.070 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:29.071 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181529Z content-type;host;x-amz-date 44bf744101969da17efb1509be4f7be6d0a4c5a9f8dcfdeffea997cc24d810c7 2024-04-16T18:15:29.071 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181529Z 20240416/test-zonegroup/iam/aws4_request a22a4bfed505096088ebdf3825b1d0db74c750068afaee563972dea30d17f155 2024-04-16T18:15:29.071 DEBUG:botocore.auth:Signature: 3f7668d73c6c891e4b693411d67a72fb8e41892c03cd411a3f31ac5d5cc8254a 2024-04-16T18:15:29.071 DEBUG:botocore.hooks:Event request-created.iam.DeleteGroup: calling handler 2024-04-16T18:15:29.071 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.131 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b3d6a8f8d48708a2-00661ec041-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '241', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.131 DEBUG:botocore.parsers:Response body: b'tx00000b3d6a8f8d48708a2-00661ec041-5447-test-zone2' 2024-04-16T18:15:29.131 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteGroup: calling handler 2024-04-16T18:15:29.131 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.132 DEBUG:botocore.hooks:Event after-call.iam.DeleteGroup: calling handler 2024-04-16T18:15:29.132 DEBUG:botocore.hooks:Event before-parameter-build.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:29.132 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:29.132 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:29.133 DEBUG:botocore.hooks:Event before-call.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:29.133 DEBUG:botocore.hooks:Event before-call.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:29.133 DEBUG:botocore.endpoint:Making request for OperationModel(name=DetachUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DetachUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone2', 'PolicyArn': 'arn:aws:iam::aws:policy/AmazonS3FullAccess'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:29.133 DEBUG:botocore.hooks:Event request-created.iam.DetachUserPolicy: calling handler > 2024-04-16T18:15:29.133 DEBUG:botocore.hooks:Event choose-signer.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:29.134 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:29.134 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181529Z content-type;host;x-amz-date e19d91a90ba0f4a2add980542fe58bb8ea7de111e90548b27ec9798cc678a117 2024-04-16T18:15:29.134 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181529Z 20240416/test-zonegroup/iam/aws4_request 9c23185099e07a3d8ffd1ddb73a0312dfff6107dde117c31c6b53bcccd1d0dfa 2024-04-16T18:15:29.134 DEBUG:botocore.auth:Signature: 18a9a683ec2a84913fee805644d5d55bb588b9b4832a10b827137fb4587e9e97 2024-04-16T18:15:29.134 DEBUG:botocore.hooks:Event request-created.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:29.135 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.238 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000ab467b8693984540-00661ec041-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '213', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.239 DEBUG:botocore.parsers:Response body: b'tx00000ab467b8693984540-00661ec041-5447-test-zone2' 2024-04-16T18:15:29.239 DEBUG:botocore.hooks:Event needs-retry.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:29.239 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.239 DEBUG:botocore.hooks:Event after-call.iam.DetachUserPolicy: calling handler 2024-04-16T18:15:29.240 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:29.240 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:29.240 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:29.240 DEBUG:botocore.hooks:Event before-call.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:29.241 DEBUG:botocore.hooks:Event before-call.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:29.241 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteUserPolicy) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteUserPolicy', 'Version': '2010-05-08', 'UserName': 'test-zone2', 'PolicyName': 'Allow'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:29.241 DEBUG:botocore.hooks:Event request-created.iam.DeleteUserPolicy: calling handler > 2024-04-16T18:15:29.241 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:29.242 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:29.242 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181529Z content-type;host;x-amz-date d2741fea5e8fde2129ad86dfc4cf8cd0689aa8930033a952888845632f37aeac 2024-04-16T18:15:29.242 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181529Z 20240416/test-zonegroup/iam/aws4_request 91ed79c219c569b6039bd15c502d2c71e70029bfda0a285c71e4e83621c57b15 2024-04-16T18:15:29.242 DEBUG:botocore.auth:Signature: 83d8f70072f02b1311e515d880847594d885887db1736a7dc942f4e0c76778c3 2024-04-16T18:15:29.242 DEBUG:botocore.hooks:Event request-created.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:29.242 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.264 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000001c0e4516e97b1c13-00661ec041-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '217', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.265 DEBUG:botocore.parsers:Response body: b'tx000001c0e4516e97b1c13-00661ec041-5447-test-zone2' 2024-04-16T18:15:29.265 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:29.265 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.265 DEBUG:botocore.hooks:Event after-call.iam.DeleteUserPolicy: calling handler 2024-04-16T18:15:29.266 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAccessKeys: calling handler 2024-04-16T18:15:29.266 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:29.266 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:29.266 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:29.266 DEBUG:botocore.hooks:Event before-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:29.266 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAccessKeys) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAccessKeys', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:29.267 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler > 2024-04-16T18:15:29.267 DEBUG:botocore.hooks:Event choose-signer.iam.ListAccessKeys: calling handler 2024-04-16T18:15:29.267 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:29.267 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181529Z content-type;host;x-amz-date 575b893e712663944c456f61f1aabd27df830cbe7212c952bf0cd211f66fc279 2024-04-16T18:15:29.267 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181529Z 20240416/test-zonegroup/iam/aws4_request ab2d9379221ca9cf85ed804c130f576a1d681bbe94126ba8c37054ed86959273 2024-04-16T18:15:29.267 DEBUG:botocore.auth:Signature: b0dda028084aeeb0d5a18b25f95c5137a283f87d5df81d51bc4ed0003d0b6063 2024-04-16T18:15:29.268 DEBUG:botocore.hooks:Event request-created.iam.ListAccessKeys: calling handler 2024-04-16T18:15:29.268 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.271 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000d3d03f47ca978c91-00661ec041-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.271 DEBUG:botocore.parsers:Response body: b'test-zone2test-zone2JK8ZAX4T5I1BOG34PU2IActive2024-04-16T18:15:21.687901Zfalse' 2024-04-16T18:15:29.271 DEBUG:botocore.hooks:Event needs-retry.iam.ListAccessKeys: calling handler 2024-04-16T18:15:29.271 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.272 DEBUG:botocore.hooks:Event after-call.iam.ListAccessKeys: calling handler 2024-04-16T18:15:29.272 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:29.272 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:29.272 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:29.273 DEBUG:botocore.hooks:Event before-call.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:29.273 DEBUG:botocore.hooks:Event before-call.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:29.273 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteAccessKey) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteAccessKey', 'Version': '2010-05-08', 'UserName': 'test-zone2', 'AccessKeyId': 'JK8ZAX4T5I1BOG34PU2I'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:29.273 DEBUG:botocore.hooks:Event request-created.iam.DeleteAccessKey: calling handler > 2024-04-16T18:15:29.273 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:29.274 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:29.274 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181529Z content-type;host;x-amz-date df11e991482cb8fe427f41b0bd47bcd93241eafe868c709ce0437851c751c4f4 2024-04-16T18:15:29.274 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181529Z 20240416/test-zonegroup/iam/aws4_request bb72caa09c71cc6eae890224391f7284f0ef8ea3c9d6eece585656eeb5e919ee 2024-04-16T18:15:29.274 DEBUG:botocore.auth:Signature: 4560b3f9b9dc13bf0808b9cf8a95d4799ab8208115f9c06d5ee94ae53f64972d 2024-04-16T18:15:29.274 DEBUG:botocore.hooks:Event request-created.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:29.275 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.374 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000006477bd6f508e3e61-00661ec041-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '249', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.375 DEBUG:botocore.parsers:Response body: b'tx000006477bd6f508e3e61-00661ec041-5447-test-zone2' 2024-04-16T18:15:29.375 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:29.375 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.376 DEBUG:botocore.hooks:Event after-call.iam.DeleteAccessKey: calling handler 2024-04-16T18:15:29.376 DEBUG:botocore.hooks:Event before-parameter-build.iam.DeleteUser: calling handler 2024-04-16T18:15:29.376 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:29.376 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:29.377 DEBUG:botocore.hooks:Event before-call.iam.DeleteUser: calling handler 2024-04-16T18:15:29.377 DEBUG:botocore.hooks:Event before-call.iam.DeleteUser: calling handler 2024-04-16T18:15:29.377 DEBUG:botocore.endpoint:Making request for OperationModel(name=DeleteUser) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'DeleteUser', 'Version': '2010-05-08', 'UserName': 'test-zone2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:29.377 DEBUG:botocore.hooks:Event request-created.iam.DeleteUser: calling handler > 2024-04-16T18:15:29.378 DEBUG:botocore.hooks:Event choose-signer.iam.DeleteUser: calling handler 2024-04-16T18:15:29.378 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:29.378 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181529Z content-type;host;x-amz-date 5cec3e80938f8d7af48456f647335d80c040d9c550731683093602f874824e23 2024-04-16T18:15:29.378 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181529Z 20240416/test-zonegroup/iam/aws4_request 76608362ff42c17d60bb51b705d02bb941beaddc111376cb231f18a4e8c42899 2024-04-16T18:15:29.379 DEBUG:botocore.auth:Signature: 7d935a1b59d6781b16068fe1778736a036dd2f884be233792e390f9d8da97942 2024-04-16T18:15:29.379 DEBUG:botocore.hooks:Event request-created.iam.DeleteUser: calling handler 2024-04-16T18:15:29.379 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:29.394 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000008176f2f4cab7a883-00661ec041-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:29 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:29.395 DEBUG:botocore.parsers:Response body: b'tx000008176f2f4cab7a883-00661ec041-5447-test-zone2' 2024-04-16T18:15:29.395 DEBUG:botocore.hooks:Event needs-retry.iam.DeleteUser: calling handler 2024-04-16T18:15:29.395 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:29.396 DEBUG:botocore.hooks:Event after-call.iam.DeleteUser: calling handler 2024-04-16T18:15:29.396 INFO:rgw_multi.tests:meta checkpoint 2024-04-16T18:15:29.396 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:29.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:29.397 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:29.451 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:29.452 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:29.508 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:29.533 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713291328.524733_737.1","last_update":"2024-04-16T18:15:28.524733Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:15:29.534 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291328.524733_737.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:29.534 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:29.534 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:29.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:29.535 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:29.590 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:29.590 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:29.646 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:29.647+0000 7feb37d4b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:29.647 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:29.648+0000 7feb37d4b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:29.671 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.684947_576.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.684947Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291328.524733_737.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.524733Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:29Z"} 2024-04-16T18:15:29.671 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.684947_576.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.684947Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291328.524733_737.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.524733Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:29Z"} 2024-04-16T18:15:29.671 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.684947_576.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.684947Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291328.524733_737.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.524733Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:15:29.671 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291328.524733_737.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:29.672 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.684947_576.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291328.524733_737.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:29.672 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1713291328.887167_587.1 target=1_1713291328.684947_576.1 2024-04-16T18:15:34.673 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:34.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:34.673 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:34.730 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:34.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:34.787+0000 7f74a9c67800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:34.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:34.789+0000 7f74a9c67800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:34.810 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291328.524733_737.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.524733Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:34Z"} 2024-04-16T18:15:34.811 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291328.524733_737.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.524733Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:34Z"} 2024-04-16T18:15:34.811 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291328.524733_737.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.524733Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:15:34.811 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291328.524733_737.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:34.811 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291328.524733_737.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:34.811 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:34.812 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRoles: calling handler 2024-04-16T18:15:34.812 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.812 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.812 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:34.812 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:34.812 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRoles) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRoles', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.813 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler > 2024-04-16T18:15:34.813 DEBUG:botocore.hooks:Event choose-signer.iam.ListRoles: calling handler 2024-04-16T18:15:34.813 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.813 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 8e689dc6b69b17003f0460011582254d8643f0dfb48ac46e093a24df58170b3f 2024-04-16T18:15:34.813 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 20ff308598ac7c72c7a776771cade2bf9fd0899c133614d7b3cf564ba5344df0 2024-04-16T18:15:34.813 DEBUG:botocore.auth:Signature: d001b4f86dc03104fad7348d36df5abe293ee8caf029f36bdb1f926bca3fcc63 2024-04-16T18:15:34.814 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler 2024-04-16T18:15:34.814 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.817 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000006ba7019494172917-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1519', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.817 DEBUG:botocore.parsers:Response body: b'b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111falsetx000006ba7019494172917-00661ec046-4816-test-zone1' 2024-04-16T18:15:34.818 DEBUG:botocore.hooks:Event needs-retry.iam.ListRoles: calling handler 2024-04-16T18:15:34.818 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.818 DEBUG:botocore.hooks:Event after-call.iam.ListRoles: calling handler 2024-04-16T18:15:34.818 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRoles: calling handler 2024-04-16T18:15:34.819 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.819 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.819 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:34.819 DEBUG:botocore.hooks:Event before-call.iam.ListRoles: calling handler 2024-04-16T18:15:34.819 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRoles) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRoles', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.819 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler > 2024-04-16T18:15:34.819 DEBUG:botocore.hooks:Event choose-signer.iam.ListRoles: calling handler 2024-04-16T18:15:34.820 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.820 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 8e689dc6b69b17003f0460011582254d8643f0dfb48ac46e093a24df58170b3f 2024-04-16T18:15:34.820 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request a19dae65eede816fdf84ae6a858f651017379d3cdfbdd91b7b519f7ab582590c 2024-04-16T18:15:34.820 DEBUG:botocore.auth:Signature: eb43cec027da6eeae7691f95260be6aa1808b4e4330fa2046efff6166de89c24 2024-04-16T18:15:34.820 DEBUG:botocore.hooks:Event request-created.iam.ListRoles: calling handler 2024-04-16T18:15:34.821 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.823 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000f5689cc5f87a7118-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1519', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.823 DEBUG:botocore.parsers:Response body: b'b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}RGW11111111111111111falsetx00000f5689cc5f87a7118-00661ec046-5447-test-zone2' 2024-04-16T18:15:34.824 DEBUG:botocore.hooks:Event needs-retry.iam.ListRoles: calling handler 2024-04-16T18:15:34.824 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.824 DEBUG:botocore.hooks:Event after-call.iam.ListRoles: calling handler 2024-04-16T18:15:34.824 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:34.824 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.825 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.825 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.825 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.825 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.825 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:34.825 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:34.826 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.826 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 8f2a258f431de2df39c452e7aa57d388d9c943f7f8a70cbd5df98df5386c6953 2024-04-16T18:15:34.826 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 37cb98ed1c1b71661dac4d55190f2548dfbfa48aee4bc469cd15a4b100e4719e 2024-04-16T18:15:34.826 DEBUG:botocore.auth:Signature: 3025c29809f71f5bcf61202595d6b570ecc66ceeadbfae557a4d44a51bd7d765 2024-04-16T18:15:34.826 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:34.826 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.828 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000be99bf8a45780e3b-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.829 DEBUG:botocore.parsers:Response body: b'tx00000be99bf8a45780e3b-00661ec046-4816-test-zone1b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:34.829 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:34.829 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.829 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:34.829 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:34.830 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.830 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.830 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.830 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.830 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.830 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:34.831 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:34.831 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.831 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 8f2a258f431de2df39c452e7aa57d388d9c943f7f8a70cbd5df98df5386c6953 2024-04-16T18:15:34.831 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request ec64175692d682b7f90c06f79c172b6de0a327e27eee2f5a101df4e6af2f85b6 2024-04-16T18:15:34.831 DEBUG:botocore.auth:Signature: 79acd044c0897eed6eed28146b1a8e65ba61646f2d0626c1dca58c7b52e75922 2024-04-16T18:15:34.831 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:34.832 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.833 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b8afe025e28d079d-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.834 DEBUG:botocore.parsers:Response body: b'tx00000b8afe025e28d079d-00661ec046-5447-test-zone2b8a87035-10be-4ec5-925b-3f5a0b5b8a09roles-cjqttm-1/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-12024-04-16T18:15:08.216Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:34.834 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:34.834 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.834 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:34.835 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.835 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.835 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.835 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.835 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.836 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.836 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:34.836 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.836 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.836 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 3db9fbb8864693f61061506a569aad4475c506e554d7919698e984bee122e2be 2024-04-16T18:15:34.836 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 2d874b26be98e1ec5caab1c8a96fa7562f94b2d56b86b644a71838e48c167ff3 2024-04-16T18:15:34.837 DEBUG:botocore.auth:Signature: 084d3d34d8ae67d0b4796cf052ea70b94ed1a6a00814c2ace0fb371205dffde4 2024-04-16T18:15:34.837 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.837 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.839 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000bcae9cc264b3a673-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.839 DEBUG:botocore.parsers:Response body: b'tx00000bcae9cc264b3a673-00661ec046-4816-test-zone1' 2024-04-16T18:15:34.839 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.839 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.840 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.840 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.840 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.840 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.840 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.840 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.841 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.841 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:34.841 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.841 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.841 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 3db9fbb8864693f61061506a569aad4475c506e554d7919698e984bee122e2be 2024-04-16T18:15:34.841 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 420be082465f8cf0ae9206a650de5d2eb714526f5395cd4dc03076e80963c583 2024-04-16T18:15:34.841 DEBUG:botocore.auth:Signature: 3412840ab74fc32508d11af8e5004119cc115e668204d42f5a04a1c762cf5add 2024-04-16T18:15:34.842 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.842 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.844 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000653670c71d741e95-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.844 DEBUG:botocore.parsers:Response body: b'tx00000653670c71d741e95-00661ec046-5447-test-zone2' 2024-04-16T18:15:34.844 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.844 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.844 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.845 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.845 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.845 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.845 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.845 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.845 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.846 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:34.846 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.846 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.846 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 2f314d397cbac9a588b92b4320c5a1127363dccb0d852931ea20d4eff1417de1 2024-04-16T18:15:34.846 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request e4bf8a46bc130892d69ee6903ac96f4f970914e6205d29e7175db54cadf7f6fd 2024-04-16T18:15:34.846 DEBUG:botocore.auth:Signature: b582760c52e0f23fbaf91d8de3d5e09c9e5cbea1838369a2e59b147aa048f644 2024-04-16T18:15:34.847 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.847 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.890 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b63b873a236a8ce0-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.891 DEBUG:botocore.parsers:Response body: b'tx00000b63b873a236a8ce0-00661ec046-4816-test-zone1' 2024-04-16T18:15:34.891 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.891 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.891 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.891 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.892 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.892 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.892 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.892 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.892 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-1'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.892 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:34.892 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.893 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.893 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 2f314d397cbac9a588b92b4320c5a1127363dccb0d852931ea20d4eff1417de1 2024-04-16T18:15:34.893 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request ac6b97f050d39db95ec40ff0c7d24168a35bc1a1afe730c4032f18f6def4df70 2024-04-16T18:15:34.893 DEBUG:botocore.auth:Signature: afc7b597dbcf01ebbdee4b7b9fe39d355564e0be4374ae3d06e5a22466080bba 2024-04-16T18:15:34.893 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.893 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.895 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000accd06e1ddcc61c4-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.895 DEBUG:botocore.parsers:Response body: b'tx00000accd06e1ddcc61c4-00661ec046-5447-test-zone2' 2024-04-16T18:15:34.895 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.896 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.896 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.896 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:34.896 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.896 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.896 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.896 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.897 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.897 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:34.897 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:34.897 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.897 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 07892fd0c5c70e8192a39ae193652f7ff706efef8941ee3607681aa7e4b57d46 2024-04-16T18:15:34.897 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 22afd8c18965e5c8bc34fb332faf9716cdc13da6068c7844cadb8eb594475d17 2024-04-16T18:15:34.897 DEBUG:botocore.auth:Signature: fe18798c22be1b670794b5caf886031fd7f75e42c5a4322a43677a7e4ce8f557 2024-04-16T18:15:34.898 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:34.898 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.900 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000c71893ad20af93b7-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.900 DEBUG:botocore.parsers:Response body: b'tx00000c71893ad20af93b7-00661ec046-4816-test-zone1f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:34.900 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:34.900 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.901 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:34.901 DEBUG:botocore.hooks:Event before-parameter-build.iam.GetRole: calling handler 2024-04-16T18:15:34.901 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.901 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.901 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.901 DEBUG:botocore.hooks:Event before-call.iam.GetRole: calling handler 2024-04-16T18:15:34.901 DEBUG:botocore.endpoint:Making request for OperationModel(name=GetRole) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'GetRole', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.902 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler > 2024-04-16T18:15:34.902 DEBUG:botocore.hooks:Event choose-signer.iam.GetRole: calling handler 2024-04-16T18:15:34.902 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.902 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 07892fd0c5c70e8192a39ae193652f7ff706efef8941ee3607681aa7e4b57d46 2024-04-16T18:15:34.902 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 8958c135b2d2d0f9440cb3066e29660cd45ddb4d9a04af8df1c4e20d05d77f2d 2024-04-16T18:15:34.902 DEBUG:botocore.auth:Signature: e4a96a4577effdbb3763941597cc0e802d2de8b6cdb99d6a7250c066051ad07e 2024-04-16T18:15:34.902 DEBUG:botocore.hooks:Event request-created.iam.GetRole: calling handler 2024-04-16T18:15:34.903 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.904 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx00000b938bcec13162b65-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '773', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.904 DEBUG:botocore.parsers:Response body: b'tx00000b938bcec13162b65-00661ec046-5447-test-zone2f11c639a-1627-4128-8098-ea4cffc45fceroles-cjqttm-2/arn:aws:iam::RGW11111111111111111:role/roles-cjqttm-22024-04-16T18:15:08.262Z3600{"Version": "2012-10-17", "Statement": [{"Effect": "Allow", "Principal": {"AWS": "arn:aws:iam:::user/testuser"}, "Action": ["sts:AssumeRole"]}]}' 2024-04-16T18:15:34.905 DEBUG:botocore.hooks:Event needs-retry.iam.GetRole: calling handler 2024-04-16T18:15:34.905 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.905 DEBUG:botocore.hooks:Event after-call.iam.GetRole: calling handler 2024-04-16T18:15:34.905 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.906 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.906 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.906 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.906 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.906 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.906 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:34.906 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.907 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.907 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 197b347e25417624ba8adafc5e9b6c078cfb1e82b21f5895646d7316797be137 2024-04-16T18:15:34.907 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request ac0308ffa19588f3c69d592bdfe463d33de8a8b6a077324f88db969bd92cc0de 2024-04-16T18:15:34.907 DEBUG:botocore.auth:Signature: d6afeef5bf7d4a1dd8256c8d80f6f5a79a2779003e736e3786cf1add5884eabc 2024-04-16T18:15:34.907 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.907 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.909 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000042155d3008ddca41-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.910 DEBUG:botocore.parsers:Response body: b'tx0000042155d3008ddca41-00661ec046-4816-test-zone1' 2024-04-16T18:15:34.910 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.910 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.910 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.910 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.910 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.910 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.911 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.911 DEBUG:botocore.hooks:Event before-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.911 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.911 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler > 2024-04-16T18:15:34.911 DEBUG:botocore.hooks:Event choose-signer.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.911 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.912 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 197b347e25417624ba8adafc5e9b6c078cfb1e82b21f5895646d7316797be137 2024-04-16T18:15:34.912 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 4403573fad5298439904040d859ed63c491d19c43d9d2ecd3eff51737cc35b3b 2024-04-16T18:15:34.912 DEBUG:botocore.auth:Signature: 2e4bf3988c334f32f80a7e49a0c70f693a2a636a68e6334581cfdef14d6c5ac5 2024-04-16T18:15:34.912 DEBUG:botocore.hooks:Event request-created.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.912 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.914 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005913e1656c1779ce-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '239', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.914 DEBUG:botocore.parsers:Response body: b'tx000005913e1656c1779ce-00661ec046-5447-test-zone2' 2024-04-16T18:15:34.914 DEBUG:botocore.hooks:Event needs-retry.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.914 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.915 DEBUG:botocore.hooks:Event after-call.iam.ListRolePolicies: calling handler 2024-04-16T18:15:34.915 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.915 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.915 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.915 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.916 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.916 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.916 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:34.916 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.916 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.916 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 644da773af884f4ddfb182a1f2b84c9ed81edd210a431358216fc28d2d9bfe04 2024-04-16T18:15:34.916 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 5c9a6789ccc7d9a3b52e8280d6c52c5eb7586a144872046225720008348b33f4 2024-04-16T18:15:34.917 DEBUG:botocore.auth:Signature: 52ced9d77db02ff819a852d1384052bbbf5506db7328d38ce71a6f93c5771c5f 2024-04-16T18:15:34.917 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.917 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.919 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx0000044ef64556d8c0e85-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.919 DEBUG:botocore.parsers:Response body: b'tx0000044ef64556d8c0e85-00661ec046-4816-test-zone1' 2024-04-16T18:15:34.919 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.919 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.919 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.919 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.920 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.920 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.920 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.920 DEBUG:botocore.hooks:Event before-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.920 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListAttachedRolePolicies) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListAttachedRolePolicies', 'Version': '2010-05-08', 'RoleName': 'roles-cjqttm-2'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.920 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler > 2024-04-16T18:15:34.920 DEBUG:botocore.hooks:Event choose-signer.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.921 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.921 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 644da773af884f4ddfb182a1f2b84c9ed81edd210a431358216fc28d2d9bfe04 2024-04-16T18:15:34.921 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 653e29c9f2fe8ae2af59902c8b6542b559bfa7ee249b9dc793b376449704b1fd 2024-04-16T18:15:34.921 DEBUG:botocore.auth:Signature: 24e760b490247f9883a22961f80bf1ec16d75c16cb3532a95e23e6b2514aff8d 2024-04-16T18:15:34.921 DEBUG:botocore.hooks:Event request-created.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.921 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.923 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000007d716f884ededfdf-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '331', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.923 DEBUG:botocore.parsers:Response body: b'tx000007d716f884ededfdf-00661ec046-5447-test-zone2' 2024-04-16T18:15:34.924 DEBUG:botocore.hooks:Event needs-retry.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.924 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.924 DEBUG:botocore.hooks:Event after-call.iam.ListAttachedRolePolicies: calling handler 2024-04-16T18:15:34.924 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUsers: calling handler 2024-04-16T18:15:34.925 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.925 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.925 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:34.925 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:34.925 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUsers) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUsers', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.925 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler > 2024-04-16T18:15:34.925 DEBUG:botocore.hooks:Event choose-signer.iam.ListUsers: calling handler 2024-04-16T18:15:34.926 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.926 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date b6359072c78d70ebee1e81adcbab4f01bf2c23245fa365ef83fe8f1f955085e2 2024-04-16T18:15:34.926 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 743be34c1d06735489914a42f69a66939efae83b7b641bf0eeddfdb806d29461 2024-04-16T18:15:34.926 DEBUG:botocore.auth:Signature: 23c22a696dc3a87dbe333871c84ad6afcdf1316ef6b35c565d7f010336a546d8 2024-04-16T18:15:34.926 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler 2024-04-16T18:15:34.927 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.929 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx0000058dfe11440e5ef2f-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.929 DEBUG:botocore.parsers:Response body: b'false' 2024-04-16T18:15:34.930 DEBUG:botocore.hooks:Event needs-retry.iam.ListUsers: calling handler 2024-04-16T18:15:34.930 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.930 DEBUG:botocore.hooks:Event after-call.iam.ListUsers: calling handler 2024-04-16T18:15:34.930 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListUsers: calling handler 2024-04-16T18:15:34.930 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.930 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.931 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:34.931 DEBUG:botocore.hooks:Event before-call.iam.ListUsers: calling handler 2024-04-16T18:15:34.931 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListUsers) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListUsers', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.931 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler > 2024-04-16T18:15:34.931 DEBUG:botocore.hooks:Event choose-signer.iam.ListUsers: calling handler 2024-04-16T18:15:34.931 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.932 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date b6359072c78d70ebee1e81adcbab4f01bf2c23245fa365ef83fe8f1f955085e2 2024-04-16T18:15:34.932 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 534bac9a5c47f113b9ab4121cf0f360edaef1edf590e6ef5b59f68d0cdc28d8d 2024-04-16T18:15:34.932 DEBUG:botocore.auth:Signature: 83ec7161b487be01f0d0fc812d9d99b9686d1f3ac5f957e1b63f9633693d41cf 2024-04-16T18:15:34.932 DEBUG:botocore.hooks:Event request-created.iam.ListUsers: calling handler 2024-04-16T18:15:34.932 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.935 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx000005ddcd5e3a34ae6c8-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.935 DEBUG:botocore.parsers:Response body: b'false' 2024-04-16T18:15:34.935 DEBUG:botocore.hooks:Event needs-retry.iam.ListUsers: calling handler 2024-04-16T18:15:34.935 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.935 DEBUG:botocore.hooks:Event after-call.iam.ListUsers: calling handler 2024-04-16T18:15:34.936 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroups: calling handler 2024-04-16T18:15:34.936 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.936 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.936 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:34.936 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:34.936 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroups) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroups', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.937 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler > 2024-04-16T18:15:34.937 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroups: calling handler 2024-04-16T18:15:34.937 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.937 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 5f776d91509b9c99b8cb5eb5d6d4a787a33ae41c8cd6e7b69effca69080e1e1f 2024-04-16T18:15:34.937 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request a61a3dc6a26689975ea7fb620b45004adef809f303f9187e962e6582a0d7866d 2024-04-16T18:15:34.937 DEBUG:botocore.auth:Signature: f5226b494900e07aea186246bd9c37591fa27215a4d35ed0caabca5de5041af2 2024-04-16T18:15:34.938 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler 2024-04-16T18:15:34.938 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.940 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000ab551d50949d67b3-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.940 DEBUG:botocore.parsers:Response body: b'false' 2024-04-16T18:15:34.940 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroups: calling handler 2024-04-16T18:15:34.941 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.941 DEBUG:botocore.hooks:Event after-call.iam.ListGroups: calling handler 2024-04-16T18:15:34.941 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListGroups: calling handler 2024-04-16T18:15:34.941 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.941 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:34.941 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:34.941 DEBUG:botocore.hooks:Event before-call.iam.ListGroups: calling handler 2024-04-16T18:15:34.942 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListGroups) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListGroups', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.942 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler > 2024-04-16T18:15:34.942 DEBUG:botocore.hooks:Event choose-signer.iam.ListGroups: calling handler 2024-04-16T18:15:34.942 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.942 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 5f776d91509b9c99b8cb5eb5d6d4a787a33ae41c8cd6e7b69effca69080e1e1f 2024-04-16T18:15:34.942 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 1794fbf87a5cad05cf32ea2a1f95eb16bbfc618d319c1e36f2dabebcde514402 2024-04-16T18:15:34.943 DEBUG:botocore.auth:Signature: 7ecfc911279c5a3eebd52764d9577ef269e0b9904a74edd3776e2a3beb47b829 2024-04-16T18:15:34.943 DEBUG:botocore.hooks:Event request-created.iam.ListGroups: calling handler 2024-04-16T18:15:34.943 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:34.986 DEBUG:botocore.parsers:Response headers: {'Transfer-Encoding': 'chunked', 'x-amz-request-id': 'tx00000c9fb4444769428f8-00661ec046-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:34 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:34.986 DEBUG:botocore.parsers:Response body: b'false' 2024-04-16T18:15:34.987 DEBUG:botocore.hooks:Event needs-retry.iam.ListGroups: calling handler 2024-04-16T18:15:34.987 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:34.987 DEBUG:botocore.hooks:Event after-call.iam.ListGroups: calling handler 2024-04-16T18:15:34.987 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:34.987 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T18:15:34.987 DEBUG:botocore.regions:Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:34.988 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:34.988 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:34.988 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListOpenIDConnectProviders) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListOpenIDConnectProviders', 'Version': '2010-05-08'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:34.988 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler > 2024-04-16T18:15:34.988 DEBUG:botocore.hooks:Event choose-signer.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:34.988 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:34.989 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi016.front.sepia.ceph.com:8000 x-amz-date:20240416T181534Z content-type;host;x-amz-date 6be253d5bef7fe9cb4ed0d00d8a18351f59593888e86906ef784f147279adb10 2024-04-16T18:15:34.989 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181534Z 20240416/test-zonegroup/iam/aws4_request 408dc8ec8de8a4f20e3c6ed1f7a9924210c62c0d74ab7eab165246bea6af4c17 2024-04-16T18:15:34.989 DEBUG:botocore.auth:Signature: 6f767e9c485965b3dca20fd04ee2733b3b22598a70456157caeec1a688076567 2024-04-16T18:15:34.989 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:34.989 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:35.003 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005895126be385f8ad-00661ec046-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '357', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:35.003 DEBUG:botocore.parsers:Response body: b'tx000005895126be385f8ad-00661ec046-4816-test-zone1' 2024-04-16T18:15:35.003 DEBUG:botocore.hooks:Event needs-retry.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.003 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:35.003 DEBUG:botocore.hooks:Event after-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.003 DEBUG:botocore.hooks:Event before-parameter-build.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.004 DEBUG:botocore.regions:Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T18:15:35.004 DEBUG:botocore.regions:Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:35.004 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.004 DEBUG:botocore.hooks:Event before-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.004 DEBUG:botocore.endpoint:Making request for OperationModel(name=ListOpenIDConnectProviders) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListOpenIDConnectProviders', 'Version': '2010-05-08'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T18:15:35.004 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler > 2024-04-16T18:15:35.004 DEBUG:botocore.hooks:Event choose-signer.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.005 DEBUG:botocore.auth:Calculating signature using v4 auth. 2024-04-16T18:15:35.005 DEBUG:botocore.auth:CanonicalRequest: POST / content-type:application/x-www-form-urlencoded; charset=utf-8 host:smithi139.front.sepia.ceph.com:8000 x-amz-date:20240416T181535Z content-type;host;x-amz-date 6be253d5bef7fe9cb4ed0d00d8a18351f59593888e86906ef784f147279adb10 2024-04-16T18:15:35.005 DEBUG:botocore.auth:StringToSign: AWS4-HMAC-SHA256 20240416T181535Z 20240416/test-zonegroup/iam/aws4_request e1dafe840b3457a189c5da2bc55104f277389783f0d75bf1a940bd252013ae0a 2024-04-16T18:15:35.005 DEBUG:botocore.auth:Signature: 4aad67074e5731d4992e79a8425d3a07979556940046a287b912b630f158088f 2024-04-16T18:15:35.005 DEBUG:botocore.hooks:Event request-created.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.005 DEBUG:botocore.endpoint:Sending http request: 2024-04-16T18:15:35.018 DEBUG:botocore.parsers:Response headers: {'x-amz-request-id': 'tx000005b82b01a53e5db9f-00661ec047-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '357', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T18:15:35.018 DEBUG:botocore.parsers:Response body: b'tx000005b82b01a53e5db9f-00661ec047-5447-test-zone2' 2024-04-16T18:15:35.018 DEBUG:botocore.hooks:Event needs-retry.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.018 DEBUG:botocore.retryhandler:No retry needed. 2024-04-16T18:15:35.018 DEBUG:botocore.hooks:Event after-call.iam.ListOpenIDConnectProviders: calling handler 2024-04-16T18:15:35.019 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_account_metadata_sync ... ok 2024-04-16T18:15:35.020 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=cjqttm-50 2024-04-16T18:15:35.020 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:35.020 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:35.020 DEBUG:boto:Method: PUT 2024-04-16T18:15:35.020 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:35.020 DEBUG:boto:Data: 2024-04-16T18:15:35.020 DEBUG:boto:Headers: {} 2024-04-16T18:15:35.020 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.021 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.021 DEBUG:boto:Params: {} 2024-04-16T18:15:35.021 DEBUG:boto:Token: None 2024-04-16T18:15:35.021 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/ 2024-04-16T18:15:35.021 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x9/bwrBaaZFNDc4MF7+mYYsA2p8= 2024-04-16T18:15:35.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x9/bwrBaaZFNDc4MF7+mYYsA2p8=', 'Content-Length': '0'} 2024-04-16T18:15:35.038 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000008e318adc746356a2-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.039 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:35.039 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:35.039 DEBUG:boto:Method: HEAD 2024-04-16T18:15:35.039 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:35.039 DEBUG:boto:Data: 2024-04-16T18:15:35.039 DEBUG:boto:Headers: {} 2024-04-16T18:15:35.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.039 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.039 DEBUG:boto:Params: {} 2024-04-16T18:15:35.039 DEBUG:boto:Token: None 2024-04-16T18:15:35.039 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/ 2024-04-16T18:15:35.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q= 2024-04-16T18:15:35.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q=', 'Content-Length': '0'} 2024-04-16T18:15:35.042 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000047e9ece5fdd97cd8-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.042 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:35.042 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:35.042 DEBUG:boto:Method: PUT 2024-04-16T18:15:35.043 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:15:35.043 DEBUG:boto:Data: 2024-04-16T18:15:35.043 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:35.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.043 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.043 DEBUG:boto:Params: {} 2024-04-16T18:15:35.043 DEBUG:boto:Token: None 2024-04-16T18:15:35.043 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/a 2024-04-16T18:15:35.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0IbTObvK44CnHKViTGxbTeti1e0= 2024-04-16T18:15:35.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0IbTObvK44CnHKViTGxbTeti1e0='} 2024-04-16T18:15:35.086 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fe2664019c49c568-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.087 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:35.087 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:35.087 DEBUG:boto:Method: HEAD 2024-04-16T18:15:35.087 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:35.087 DEBUG:boto:Data: 2024-04-16T18:15:35.087 DEBUG:boto:Headers: {} 2024-04-16T18:15:35.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.087 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.087 DEBUG:boto:Params: {} 2024-04-16T18:15:35.087 DEBUG:boto:Token: None 2024-04-16T18:15:35.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/ 2024-04-16T18:15:35.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q= 2024-04-16T18:15:35.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q=', 'Content-Length': '0'} 2024-04-16T18:15:35.090 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c481b8aa2f01b931-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.090 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:35.090 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:35.090 DEBUG:boto:Method: PUT 2024-04-16T18:15:35.090 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:15:35.090 DEBUG:boto:Data: 2024-04-16T18:15:35.090 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:35.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.091 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.091 DEBUG:boto:Params: {} 2024-04-16T18:15:35.091 DEBUG:boto:Token: None 2024-04-16T18:15:35.091 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/b 2024-04-16T18:15:35.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:miRJMCSOIfPau+p7GrVtLmKbu1s= 2024-04-16T18:15:35.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:miRJMCSOIfPau+p7GrVtLmKbu1s='} 2024-04-16T18:15:35.097 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006225d4e2bae11de3-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.097 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:35.097 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:35.097 DEBUG:boto:Method: HEAD 2024-04-16T18:15:35.098 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:35.098 DEBUG:boto:Data: 2024-04-16T18:15:35.098 DEBUG:boto:Headers: {} 2024-04-16T18:15:35.098 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.098 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.098 DEBUG:boto:Params: {} 2024-04-16T18:15:35.098 DEBUG:boto:Token: None 2024-04-16T18:15:35.098 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/ 2024-04-16T18:15:35.098 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q= 2024-04-16T18:15:35.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q=', 'Content-Length': '0'} 2024-04-16T18:15:35.100 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000003d5deb88ccb106a-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.101 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:35.101 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:35.101 DEBUG:boto:Method: PUT 2024-04-16T18:15:35.101 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:15:35.101 DEBUG:boto:Data: 2024-04-16T18:15:35.101 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:35.101 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.101 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.101 DEBUG:boto:Params: {} 2024-04-16T18:15:35.102 DEBUG:boto:Token: None 2024-04-16T18:15:35.102 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/c 2024-04-16T18:15:35.102 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dqIOo04NG+c7RgmdRJDcQwvdhS0= 2024-04-16T18:15:35.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dqIOo04NG+c7RgmdRJDcQwvdhS0='} 2024-04-16T18:15:35.108 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d2965b41d0429d5-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.108 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:35.108 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:35.108 DEBUG:boto:Method: HEAD 2024-04-16T18:15:35.108 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:35.108 DEBUG:boto:Data: 2024-04-16T18:15:35.109 DEBUG:boto:Headers: {} 2024-04-16T18:15:35.109 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.109 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.109 DEBUG:boto:Params: {} 2024-04-16T18:15:35.109 DEBUG:boto:Token: None 2024-04-16T18:15:35.109 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/ 2024-04-16T18:15:35.109 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q= 2024-04-16T18:15:35.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kaprK42K2bJxKMFrK0H+U11w6/Q=', 'Content-Length': '0'} 2024-04-16T18:15:35.111 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000350ac96e5a327f25-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.111 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:35.111 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:35.111 DEBUG:boto:Method: PUT 2024-04-16T18:15:35.111 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:15:35.112 DEBUG:boto:Data: 2024-04-16T18:15:35.112 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:35.112 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:35.112 DEBUG:boto:Port: 8000 2024-04-16T18:15:35.112 DEBUG:boto:Params: {} 2024-04-16T18:15:35.112 DEBUG:boto:Token: None 2024-04-16T18:15:35.112 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:35 GMT /cjqttm-50/d 2024-04-16T18:15:35.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JSZVkKv48TGO5IVM4GWD+KVGYcE= 2024-04-16T18:15:35.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:35 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JSZVkKv48TGO5IVM4GWD+KVGYcE='} 2024-04-16T18:15:35.159 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d00fe3c64629d0c9-00661ec047-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:35.159 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:35.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:35.159 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:35.210 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:35.210 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:35.265 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:15:35.288 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713291335.038417_753.1","last_update":"2024-04-16T18:15:35.038417Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:15:35.289 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291335.038417_753.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:35.289 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:15:35.289 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:35.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:35.289 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:35.341 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:35.341 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:35.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:35.400+0000 7fd953d2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:35.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:35.401+0000 7fd953d2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:15:35.422 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291335.038417_753.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:35.038417Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:35Z"} 2024-04-16T18:15:35.423 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291335.038417_753.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:35.038417Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:35Z"} 2024-04-16T18:15:35.423 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291335.038417_753.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:35.038417Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:15:35.423 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291335.038417_753.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:35.423 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291335.038417_753.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:15:35.423 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:15:35.423 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-50 2024-04-16T18:15:35.423 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:35.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:35.424 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:15:35.479 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:35.479 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:35.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:35.537+0000 7f21b9610800 1 waiting to reach incremental sync.. 2024-04-16T18:15:40.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:40.539+0000 7f21b9610800 1 bucket sync caught up with source: 2024-04-16T18:15:40.539 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.23.6, , , , 00000000001.25.6, , , 00000000001.35.6, , 00000000001.41.6] 2024-04-16T18:15:40.539 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, 00000000001.23.6, , , , 00000000001.25.6, , , 00000000001.35.6, , 00000000001.41.6] 2024-04-16T18:15:40.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:40.539+0000 7f21b9610800 0 bucket checkpoint complete 2024-04-16T18:15:40.563 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-50 2024-04-16T18:15:40.563 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:40.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:40.564 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:15:40.626 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:40.626 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:40.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:15:40.695+0000 7fc98ff33800 1 bucket sync caught up with source: 2024-04-16T18:15:40.694 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.240.6, , , , 00000000001.241.6, , , 00000000001.232.6, , 00000000001.328.6] 2024-04-16T18:15:40.694 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.240.6, , , , 00000000001.241.6, , , 00000000001.232.6, , 00000000001.328.6] 2024-04-16T18:15:40.694 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:15:40.695+0000 7fc98ff33800 0 bucket checkpoint complete 2024-04-16T18:15:40.715 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:15:40.715 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.715 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.716 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.716 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:40.716 DEBUG:boto:Data: 2024-04-16T18:15:40.716 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.716 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.716 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.716 DEBUG:boto:Params: {} 2024-04-16T18:15:40.716 DEBUG:boto:Token: None 2024-04-16T18:15:40.716 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.717 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H5vwZKEeR++8n6bgbGaRdsXLgGE= 2024-04-16T18:15:40.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H5vwZKEeR++8n6bgbGaRdsXLgGE=', 'Content-Length': '0'} 2024-04-16T18:15:40.719 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000075ee84b8a4de880a-00661ec04c-5447-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.719 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.719 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.720 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.720 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:40.720 DEBUG:boto:Data: 2024-04-16T18:15:40.720 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.720 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.720 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.720 DEBUG:boto:Params: {} 2024-04-16T18:15:40.720 DEBUG:boto:Token: None 2024-04-16T18:15:40.720 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.721 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H5vwZKEeR++8n6bgbGaRdsXLgGE= 2024-04-16T18:15:40.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H5vwZKEeR++8n6bgbGaRdsXLgGE=', 'Content-Length': '0'} 2024-04-16T18:15:40.723 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b954f1cd0a4c978c-00661ec04c-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.723 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:15:40.723 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.724 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.724 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.724 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.724 DEBUG:boto:Method: GET 2024-04-16T18:15:40.724 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.724 DEBUG:boto:Data: 2024-04-16T18:15:40.724 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.724 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.724 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.724 DEBUG:boto:Params: {} 2024-04-16T18:15:40.724 DEBUG:boto:Token: None 2024-04-16T18:15:40.725 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/?versions 2024-04-16T18:15:40.725 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8= 2024-04-16T18:15:40.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8=', 'Content-Length': '0'} 2024-04-16T18:15:40.727 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b7650cde38ce5d1f-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.727 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.728 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:15:40.728 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:15:40.728 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:15:40.728 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:15:40.728 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:15:40.728 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.729 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.729 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.729 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.729 DEBUG:boto:Method: GET 2024-04-16T18:15:40.729 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.729 DEBUG:boto:Data: 2024-04-16T18:15:40.729 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.729 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.729 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.729 DEBUG:boto:Params: {} 2024-04-16T18:15:40.729 DEBUG:boto:Token: None 2024-04-16T18:15:40.730 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/?versions 2024-04-16T18:15:40.730 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8= 2024-04-16T18:15:40.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8=', 'Content-Length': '0'} 2024-04-16T18:15:40.732 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b76c38e16688ba4-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.732 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.733 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:15:40.733 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:15:40.733 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:15:40.733 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:15:40.733 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.733 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.733 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.733 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.734 DEBUG:boto:Method: GET 2024-04-16T18:15:40.734 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.734 DEBUG:boto:Data: 2024-04-16T18:15:40.734 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.734 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.734 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.734 DEBUG:boto:Params: {} 2024-04-16T18:15:40.734 DEBUG:boto:Token: None 2024-04-16T18:15:40.734 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/?versions 2024-04-16T18:15:40.734 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8= 2024-04-16T18:15:40.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8=', 'Content-Length': '0'} 2024-04-16T18:15:40.737 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4e2ba7f2efca29f-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.737 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.738 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.738 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.738 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.738 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.738 DEBUG:boto:Method: GET 2024-04-16T18:15:40.738 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:15:40.738 DEBUG:boto:Data: 2024-04-16T18:15:40.739 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.739 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.739 DEBUG:boto:Params: {} 2024-04-16T18:15:40.739 DEBUG:boto:Token: None 2024-04-16T18:15:40.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/?versions 2024-04-16T18:15:40.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8= 2024-04-16T18:15:40.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:suwMV1tmbcXHZu9nDbAsWjB1Xz8=', 'Content-Length': '0'} 2024-04-16T18:15:40.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004aeba9643fcf7cf-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.741 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.742 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:15:40.742 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.742 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.742 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.742 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.742 DEBUG:boto:Method: GET 2024-04-16T18:15:40.743 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.743 DEBUG:boto:Data: 2024-04-16T18:15:40.743 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.743 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.743 DEBUG:boto:Params: {} 2024-04-16T18:15:40.743 DEBUG:boto:Token: None 2024-04-16T18:15:40.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI= 2024-04-16T18:15:40.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI=', 'Content-Length': '0'} 2024-04-16T18:15:40.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003310415e1426b6d8-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.746 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.746 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.746 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.746 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.746 DEBUG:boto:Method: GET 2024-04-16T18:15:40.746 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.746 DEBUG:boto:Data: 2024-04-16T18:15:40.746 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.746 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.746 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.746 DEBUG:boto:Params: {} 2024-04-16T18:15:40.747 DEBUG:boto:Token: None 2024-04-16T18:15:40.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI= 2024-04-16T18:15:40.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI=', 'Content-Length': '0'} 2024-04-16T18:15:40.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d98f56dd3d0a8fe-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.749 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.749 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.749 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.749 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.749 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.749 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.749 DEBUG:boto:Data: 2024-04-16T18:15:40.749 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.749 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.750 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.750 DEBUG:boto:Params: {} 2024-04-16T18:15:40.750 DEBUG:boto:Token: None 2024-04-16T18:15:40.750 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.750 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y6mTjKc0un2R99C36+HvE9bh3CI= 2024-04-16T18:15:40.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y6mTjKc0un2R99C36+HvE9bh3CI=', 'Content-Length': '0'} 2024-04-16T18:15:40.752 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a28bbe46fec60971-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.752 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.752 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.752 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.752 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.752 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.752 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.752 DEBUG:boto:Data: 2024-04-16T18:15:40.753 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.753 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.753 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.753 DEBUG:boto:Params: {} 2024-04-16T18:15:40.753 DEBUG:boto:Token: None 2024-04-16T18:15:40.753 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.753 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y6mTjKc0un2R99C36+HvE9bh3CI= 2024-04-16T18:15:40.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y6mTjKc0un2R99C36+HvE9bh3CI=', 'Content-Length': '0'} 2024-04-16T18:15:40.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008df6f6cf69b1e3a4-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.755 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:15:40.755 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.755 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.755 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.755 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.755 DEBUG:boto:Method: GET 2024-04-16T18:15:40.756 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.756 DEBUG:boto:Data: 2024-04-16T18:15:40.756 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.756 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.756 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.756 DEBUG:boto:Params: {} 2024-04-16T18:15:40.756 DEBUG:boto:Token: None 2024-04-16T18:15:40.756 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI= 2024-04-16T18:15:40.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI=', 'Content-Length': '0'} 2024-04-16T18:15:40.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5c618ae49e7ea1e-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.758 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.759 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.759 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.759 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:15:40.759 DEBUG:boto:Method: GET 2024-04-16T18:15:40.759 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.759 DEBUG:boto:Data: 2024-04-16T18:15:40.759 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.759 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.759 DEBUG:boto:Params: {} 2024-04-16T18:15:40.760 DEBUG:boto:Token: None 2024-04-16T18:15:40.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:15:40.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI= 2024-04-16T18:15:40.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g2zBPsPdjyJVrwHVMUl67WN9PRI=', 'Content-Length': '0'} 2024-04-16T18:15:40.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfbbcef7c73631ab-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.762 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.762 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.762 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.762 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.762 DEBUG:boto:Method: GET 2024-04-16T18:15:40.762 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:15:40.762 DEBUG:boto:Data: 2024-04-16T18:15:40.762 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.762 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.763 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.763 DEBUG:boto:Params: {} 2024-04-16T18:15:40.763 DEBUG:boto:Token: None 2024-04-16T18:15:40.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA= 2024-04-16T18:15:40.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA=', 'Content-Length': '0'} 2024-04-16T18:15:40.765 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008424f1ff1a85c3cc-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.806 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.807 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.807 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.807 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.807 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.807 DEBUG:boto:Method: GET 2024-04-16T18:15:40.807 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:15:40.807 DEBUG:boto:Data: 2024-04-16T18:15:40.807 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.808 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.808 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.808 DEBUG:boto:Params: {} 2024-04-16T18:15:40.808 DEBUG:boto:Token: None 2024-04-16T18:15:40.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA= 2024-04-16T18:15:40.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA=', 'Content-Length': '0'} 2024-04-16T18:15:40.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000087f453dbd38be6f1-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.810 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.811 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.811 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.811 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.811 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:15:40.811 DEBUG:boto:Data: 2024-04-16T18:15:40.811 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.811 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.811 DEBUG:boto:Params: {} 2024-04-16T18:15:40.812 DEBUG:boto:Token: None 2024-04-16T18:15:40.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a 2024-04-16T18:15:40.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vU8h2fd/Vo+HJ9EY0H8gOm/+1bg= 2024-04-16T18:15:40.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vU8h2fd/Vo+HJ9EY0H8gOm/+1bg=', 'Content-Length': '0'} 2024-04-16T18:15:40.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e054036dd611557-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.814 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.814 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.814 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.815 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:15:40.815 DEBUG:boto:Data: 2024-04-16T18:15:40.815 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.815 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.815 DEBUG:boto:Params: {} 2024-04-16T18:15:40.815 DEBUG:boto:Token: None 2024-04-16T18:15:40.815 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a 2024-04-16T18:15:40.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vU8h2fd/Vo+HJ9EY0H8gOm/+1bg= 2024-04-16T18:15:40.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vU8h2fd/Vo+HJ9EY0H8gOm/+1bg=', 'Content-Length': '0'} 2024-04-16T18:15:40.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb8876c40a3c74cc-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.817 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:15:40.817 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.817 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.817 DEBUG:boto:Method: GET 2024-04-16T18:15:40.818 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:15:40.818 DEBUG:boto:Data: 2024-04-16T18:15:40.818 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.818 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.818 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.818 DEBUG:boto:Params: {} 2024-04-16T18:15:40.818 DEBUG:boto:Token: None 2024-04-16T18:15:40.818 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a 2024-04-16T18:15:40.818 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5oN/cKPJsDBDAggQYTKJ8ZoHkFQ= 2024-04-16T18:15:40.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5oN/cKPJsDBDAggQYTKJ8ZoHkFQ=', 'Content-Length': '0'} 2024-04-16T18:15:40.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000520e09eae72379b1-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.862 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:15:40.863 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:15:40.863 DEBUG:boto:Method: GET 2024-04-16T18:15:40.863 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:15:40.863 DEBUG:boto:Data: 2024-04-16T18:15:40.863 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.863 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.863 DEBUG:boto:Params: {} 2024-04-16T18:15:40.863 DEBUG:boto:Token: None 2024-04-16T18:15:40.863 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/a 2024-04-16T18:15:40.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5oN/cKPJsDBDAggQYTKJ8ZoHkFQ= 2024-04-16T18:15:40.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5oN/cKPJsDBDAggQYTKJ8ZoHkFQ=', 'Content-Length': '0'} 2024-04-16T18:15:40.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081faae33599cc49b-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.866 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.866 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.866 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.866 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.866 DEBUG:boto:Method: GET 2024-04-16T18:15:40.867 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:15:40.867 DEBUG:boto:Data: 2024-04-16T18:15:40.867 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.867 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.867 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.867 DEBUG:boto:Params: {} 2024-04-16T18:15:40.867 DEBUG:boto:Token: None 2024-04-16T18:15:40.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA= 2024-04-16T18:15:40.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA=', 'Content-Length': '0'} 2024-04-16T18:15:40.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000947f3a8507bb5d4e-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.871 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.871 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.871 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.871 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.871 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:15:40.871 DEBUG:boto:Method: GET 2024-04-16T18:15:40.871 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:15:40.871 DEBUG:boto:Data: 2024-04-16T18:15:40.872 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.872 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.872 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.872 DEBUG:boto:Params: {} 2024-04-16T18:15:40.872 DEBUG:boto:Token: None 2024-04-16T18:15:40.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA= 2024-04-16T18:15:40.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA=', 'Content-Length': '0'} 2024-04-16T18:15:40.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f5a15eb894229f8-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.874 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.875 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:15:40.875 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.875 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.875 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.875 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.875 DEBUG:boto:Method: GET 2024-04-16T18:15:40.875 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.875 DEBUG:boto:Data: 2024-04-16T18:15:40.876 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.876 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.876 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.876 DEBUG:boto:Params: {} 2024-04-16T18:15:40.876 DEBUG:boto:Token: None 2024-04-16T18:15:40.876 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q= 2024-04-16T18:15:40.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q=', 'Content-Length': '0'} 2024-04-16T18:15:40.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff884d4d1cf8d926-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.922 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.923 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.923 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.923 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.923 DEBUG:boto:Method: GET 2024-04-16T18:15:40.923 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.923 DEBUG:boto:Data: 2024-04-16T18:15:40.923 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.923 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.923 DEBUG:boto:Params: {} 2024-04-16T18:15:40.924 DEBUG:boto:Token: None 2024-04-16T18:15:40.924 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q= 2024-04-16T18:15:40.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q=', 'Content-Length': '0'} 2024-04-16T18:15:40.926 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5a68e9fbd23e1c4-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.926 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.926 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.927 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.927 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.927 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.927 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.927 DEBUG:boto:Data: 2024-04-16T18:15:40.927 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.927 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.927 DEBUG:boto:Params: {} 2024-04-16T18:15:40.927 DEBUG:boto:Token: None 2024-04-16T18:15:40.928 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J9Kpmxjt+FqQuqkfiI9IqqU0wC8= 2024-04-16T18:15:40.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J9Kpmxjt+FqQuqkfiI9IqqU0wC8=', 'Content-Length': '0'} 2024-04-16T18:15:40.930 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000818322a48aa48170-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.930 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.930 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.930 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.930 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.931 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.931 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.931 DEBUG:boto:Data: 2024-04-16T18:15:40.931 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.931 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.931 DEBUG:boto:Params: {} 2024-04-16T18:15:40.931 DEBUG:boto:Token: None 2024-04-16T18:15:40.931 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J9Kpmxjt+FqQuqkfiI9IqqU0wC8= 2024-04-16T18:15:40.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J9Kpmxjt+FqQuqkfiI9IqqU0wC8=', 'Content-Length': '0'} 2024-04-16T18:15:40.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1391e1f34eff90e-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.933 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:15:40.934 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.934 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.934 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.934 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.934 DEBUG:boto:Method: GET 2024-04-16T18:15:40.934 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.934 DEBUG:boto:Data: 2024-04-16T18:15:40.934 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.935 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.935 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.935 DEBUG:boto:Params: {} 2024-04-16T18:15:40.935 DEBUG:boto:Token: None 2024-04-16T18:15:40.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q= 2024-04-16T18:15:40.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q=', 'Content-Length': '0'} 2024-04-16T18:15:40.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d38859b6eb55fd5d-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.978 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.978 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.979 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.979 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:15:40.979 DEBUG:boto:Method: GET 2024-04-16T18:15:40.979 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.979 DEBUG:boto:Data: 2024-04-16T18:15:40.979 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.979 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.979 DEBUG:boto:Params: {} 2024-04-16T18:15:40.979 DEBUG:boto:Token: None 2024-04-16T18:15:40.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:15:40.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q= 2024-04-16T18:15:40.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tAllvKYN2GZN1+ucow+/qSC1K9Q=', 'Content-Length': '0'} 2024-04-16T18:15:40.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cca13e79a9b935f-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.982 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.982 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.982 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:15:40.982 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:15:40.983 DEBUG:boto:Method: GET 2024-04-16T18:15:40.983 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:15:40.983 DEBUG:boto:Data: 2024-04-16T18:15:40.983 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.983 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.983 DEBUG:boto:Params: {} 2024-04-16T18:15:40.983 DEBUG:boto:Token: None 2024-04-16T18:15:40.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA= 2024-04-16T18:15:40.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA=', 'Content-Length': '0'} 2024-04-16T18:15:40.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028bd9f104f35d7b5-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.986 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.987 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:40.987 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:40.987 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:15:40.987 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:15:40.987 DEBUG:boto:Method: GET 2024-04-16T18:15:40.987 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:15:40.987 DEBUG:boto:Data: 2024-04-16T18:15:40.987 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.988 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.988 DEBUG:boto:Params: {} 2024-04-16T18:15:40.988 DEBUG:boto:Token: None 2024-04-16T18:15:40.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/ 2024-04-16T18:15:40.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA= 2024-04-16T18:15:40.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maBEAN8zPe36Ggpp+4p6wbv7JFA=', 'Content-Length': '0'} 2024-04-16T18:15:40.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008491e4dffa4d1c46-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.991 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:40.991 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.991 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.991 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.991 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:15:40.991 DEBUG:boto:Data: 2024-04-16T18:15:40.991 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.992 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.992 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.992 DEBUG:boto:Params: {} 2024-04-16T18:15:40.992 DEBUG:boto:Token: None 2024-04-16T18:15:40.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b 2024-04-16T18:15:40.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zHp53JSGesCZARkVi+JDygSdIek= 2024-04-16T18:15:40.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zHp53JSGesCZARkVi+JDygSdIek=', 'Content-Length': '0'} 2024-04-16T18:15:40.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ce0a1532b7e7709-00661ec04c-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.995 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.995 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.995 DEBUG:boto:Method: HEAD 2024-04-16T18:15:40.995 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:15:40.995 DEBUG:boto:Data: 2024-04-16T18:15:40.995 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:40.995 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.995 DEBUG:boto:Params: {} 2024-04-16T18:15:40.996 DEBUG:boto:Token: None 2024-04-16T18:15:40.996 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b 2024-04-16T18:15:40.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zHp53JSGesCZARkVi+JDygSdIek= 2024-04-16T18:15:40.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zHp53JSGesCZARkVi+JDygSdIek=', 'Content-Length': '0'} 2024-04-16T18:15:40.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000475588abe3aad57c-00661ec04c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:40.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:15:40.998 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:40.998 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:40.998 DEBUG:boto:Method: GET 2024-04-16T18:15:40.998 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:15:40.998 DEBUG:boto:Data: 2024-04-16T18:15:40.999 DEBUG:boto:Headers: {} 2024-04-16T18:15:40.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:40.999 DEBUG:boto:Port: 8000 2024-04-16T18:15:40.999 DEBUG:boto:Params: {} 2024-04-16T18:15:40.999 DEBUG:boto:Token: None 2024-04-16T18:15:40.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:40 GMT /cjqttm-50/b 2024-04-16T18:15:40.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hke7J9aac1dJ9rhJSRLYsYLWKTs= 2024-04-16T18:15:40.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hke7J9aac1dJ9rhJSRLYsYLWKTs=', 'Content-Length': '0'} 2024-04-16T18:15:41.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003785c34bff9b1437-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.042 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:15:41.043 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:15:41.043 DEBUG:boto:Method: GET 2024-04-16T18:15:41.043 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:15:41.043 DEBUG:boto:Data: 2024-04-16T18:15:41.043 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.043 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.043 DEBUG:boto:Params: {} 2024-04-16T18:15:41.043 DEBUG:boto:Token: None 2024-04-16T18:15:41.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/b 2024-04-16T18:15:41.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rU3SnIKIJ/hR/bB381G8agnP0GQ= 2024-04-16T18:15:41.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rU3SnIKIJ/hR/bB381G8agnP0GQ=', 'Content-Length': '0'} 2024-04-16T18:15:41.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b64ce84a0d1bcb92-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.046 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.046 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.046 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:15:41.047 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:15:41.047 DEBUG:boto:Method: GET 2024-04-16T18:15:41.047 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:15:41.047 DEBUG:boto:Data: 2024-04-16T18:15:41.047 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.047 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.047 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.047 DEBUG:boto:Params: {} 2024-04-16T18:15:41.047 DEBUG:boto:Token: None 2024-04-16T18:15:41.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000adecbf08ec339331-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.050 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.051 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.051 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.051 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:15:41.051 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:15:41.051 DEBUG:boto:Method: GET 2024-04-16T18:15:41.051 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:15:41.051 DEBUG:boto:Data: 2024-04-16T18:15:41.051 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.051 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.052 DEBUG:boto:Params: {} 2024-04-16T18:15:41.052 DEBUG:boto:Token: None 2024-04-16T18:15:41.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.054 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c3eaeed3da37e5e-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.054 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.055 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:15:41.055 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.055 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.055 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.055 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.055 DEBUG:boto:Method: GET 2024-04-16T18:15:41.055 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.055 DEBUG:boto:Data: 2024-04-16T18:15:41.055 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.056 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.056 DEBUG:boto:Params: {} 2024-04-16T18:15:41.056 DEBUG:boto:Token: None 2024-04-16T18:15:41.056 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M= 2024-04-16T18:15:41.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M=', 'Content-Length': '0'} 2024-04-16T18:15:41.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a23f206e33da5d68-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.098 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.098 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.099 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.099 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.099 DEBUG:boto:Method: GET 2024-04-16T18:15:41.099 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.099 DEBUG:boto:Data: 2024-04-16T18:15:41.099 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.099 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.099 DEBUG:boto:Params: {} 2024-04-16T18:15:41.099 DEBUG:boto:Token: None 2024-04-16T18:15:41.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M= 2024-04-16T18:15:41.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M=', 'Content-Length': '0'} 2024-04-16T18:15:41.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ac80558d88ed651-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.102 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.102 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.102 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.102 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.103 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.103 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.103 DEBUG:boto:Data: 2024-04-16T18:15:41.103 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.103 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.103 DEBUG:boto:Params: {} 2024-04-16T18:15:41.103 DEBUG:boto:Token: None 2024-04-16T18:15:41.103 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D0jDnF4CiyWxGDDxJ6Kv98dKCsk= 2024-04-16T18:15:41.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D0jDnF4CiyWxGDDxJ6Kv98dKCsk=', 'Content-Length': '0'} 2024-04-16T18:15:41.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abc1b9f4c82a9b8a-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.106 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.106 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.106 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.106 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.106 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.106 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.106 DEBUG:boto:Data: 2024-04-16T18:15:41.107 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.107 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.107 DEBUG:boto:Params: {} 2024-04-16T18:15:41.107 DEBUG:boto:Token: None 2024-04-16T18:15:41.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D0jDnF4CiyWxGDDxJ6Kv98dKCsk= 2024-04-16T18:15:41.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D0jDnF4CiyWxGDDxJ6Kv98dKCsk=', 'Content-Length': '0'} 2024-04-16T18:15:41.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b4eb0fce95266db-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:15:41.109 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.109 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.110 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.110 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.110 DEBUG:boto:Method: GET 2024-04-16T18:15:41.110 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.110 DEBUG:boto:Data: 2024-04-16T18:15:41.110 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.110 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.110 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.110 DEBUG:boto:Params: {} 2024-04-16T18:15:41.111 DEBUG:boto:Token: None 2024-04-16T18:15:41.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M= 2024-04-16T18:15:41.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M=', 'Content-Length': '0'} 2024-04-16T18:15:41.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009efa95662ee511be-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.154 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.155 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.155 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.155 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:15:41.155 DEBUG:boto:Method: GET 2024-04-16T18:15:41.155 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.155 DEBUG:boto:Data: 2024-04-16T18:15:41.155 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.155 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.155 DEBUG:boto:Params: {} 2024-04-16T18:15:41.156 DEBUG:boto:Token: None 2024-04-16T18:15:41.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:15:41.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M= 2024-04-16T18:15:41.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AUA2HT24CALQefvGFVYNPi3j97M=', 'Content-Length': '0'} 2024-04-16T18:15:41.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e9108448d2813f3-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.158 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.158 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.158 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.158 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.159 DEBUG:boto:Method: GET 2024-04-16T18:15:41.159 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:15:41.159 DEBUG:boto:Data: 2024-04-16T18:15:41.159 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.159 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.159 DEBUG:boto:Params: {} 2024-04-16T18:15:41.159 DEBUG:boto:Token: None 2024-04-16T18:15:41.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d04641d22806871-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.162 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.163 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.163 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.163 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.163 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.163 DEBUG:boto:Method: GET 2024-04-16T18:15:41.163 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:15:41.163 DEBUG:boto:Data: 2024-04-16T18:15:41.163 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.164 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.164 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.164 DEBUG:boto:Params: {} 2024-04-16T18:15:41.164 DEBUG:boto:Token: None 2024-04-16T18:15:41.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff90b9bceee53fe9-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.167 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.167 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.167 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.167 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.167 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:15:41.167 DEBUG:boto:Data: 2024-04-16T18:15:41.168 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.168 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.168 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.168 DEBUG:boto:Params: {} 2024-04-16T18:15:41.168 DEBUG:boto:Token: None 2024-04-16T18:15:41.168 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c 2024-04-16T18:15:41.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0dvek5rW1coTRt0fJfGKQWa/Tgs= 2024-04-16T18:15:41.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0dvek5rW1coTRt0fJfGKQWa/Tgs=', 'Content-Length': '0'} 2024-04-16T18:15:41.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c920cf426d8e4f84-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.171 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.171 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.171 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.171 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:15:41.171 DEBUG:boto:Data: 2024-04-16T18:15:41.171 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.171 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.171 DEBUG:boto:Params: {} 2024-04-16T18:15:41.171 DEBUG:boto:Token: None 2024-04-16T18:15:41.172 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c 2024-04-16T18:15:41.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0dvek5rW1coTRt0fJfGKQWa/Tgs= 2024-04-16T18:15:41.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0dvek5rW1coTRt0fJfGKQWa/Tgs=', 'Content-Length': '0'} 2024-04-16T18:15:41.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003420ef03ebd665d-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.174 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:15:41.174 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.174 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.174 DEBUG:boto:Method: GET 2024-04-16T18:15:41.174 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:15:41.174 DEBUG:boto:Data: 2024-04-16T18:15:41.175 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.175 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.175 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.175 DEBUG:boto:Params: {} 2024-04-16T18:15:41.175 DEBUG:boto:Token: None 2024-04-16T18:15:41.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c 2024-04-16T18:15:41.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o0X38CAbBrNghIk2Yz+iUW8oI8A= 2024-04-16T18:15:41.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o0X38CAbBrNghIk2Yz+iUW8oI8A=', 'Content-Length': '0'} 2024-04-16T18:15:41.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068f2ee91264edcce-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.218 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:15:41.219 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:15:41.219 DEBUG:boto:Method: GET 2024-04-16T18:15:41.219 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:15:41.219 DEBUG:boto:Data: 2024-04-16T18:15:41.219 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.219 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.219 DEBUG:boto:Params: {} 2024-04-16T18:15:41.219 DEBUG:boto:Token: None 2024-04-16T18:15:41.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/c 2024-04-16T18:15:41.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o0X38CAbBrNghIk2Yz+iUW8oI8A= 2024-04-16T18:15:41.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o0X38CAbBrNghIk2Yz+iUW8oI8A=', 'Content-Length': '0'} 2024-04-16T18:15:41.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9398f96df218803-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.222 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.222 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.222 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.222 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.223 DEBUG:boto:Method: GET 2024-04-16T18:15:41.223 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:15:41.223 DEBUG:boto:Data: 2024-04-16T18:15:41.223 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.223 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.223 DEBUG:boto:Params: {} 2024-04-16T18:15:41.223 DEBUG:boto:Token: None 2024-04-16T18:15:41.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.226 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc4b6d40c6b94a3e-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.226 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.227 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.227 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.227 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.227 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:15:41.227 DEBUG:boto:Method: GET 2024-04-16T18:15:41.227 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:15:41.227 DEBUG:boto:Data: 2024-04-16T18:15:41.227 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.228 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.228 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.228 DEBUG:boto:Params: {} 2024-04-16T18:15:41.228 DEBUG:boto:Token: None 2024-04-16T18:15:41.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.231 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6c64625ab382f98-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.231 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.231 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:15:41.231 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.231 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.232 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.232 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.232 DEBUG:boto:Method: GET 2024-04-16T18:15:41.232 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.232 DEBUG:boto:Data: 2024-04-16T18:15:41.232 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.232 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.232 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.232 DEBUG:boto:Params: {} 2024-04-16T18:15:41.232 DEBUG:boto:Token: None 2024-04-16T18:15:41.233 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.233 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4= 2024-04-16T18:15:41.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4=', 'Content-Length': '0'} 2024-04-16T18:15:41.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7080841848fb6f5-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.278 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.279 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.279 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.279 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.279 DEBUG:boto:Method: GET 2024-04-16T18:15:41.279 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.279 DEBUG:boto:Data: 2024-04-16T18:15:41.279 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.280 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.280 DEBUG:boto:Params: {} 2024-04-16T18:15:41.280 DEBUG:boto:Token: None 2024-04-16T18:15:41.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4= 2024-04-16T18:15:41.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4=', 'Content-Length': '0'} 2024-04-16T18:15:41.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c31f37b9608d1f1b-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.282 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.283 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.283 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.283 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.283 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.283 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.283 DEBUG:boto:Data: 2024-04-16T18:15:41.283 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.283 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.283 DEBUG:boto:Params: {} 2024-04-16T18:15:41.284 DEBUG:boto:Token: None 2024-04-16T18:15:41.284 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ix/kiTFGF+erMJwAGz7WzF0N1Ps= 2024-04-16T18:15:41.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ix/kiTFGF+erMJwAGz7WzF0N1Ps=', 'Content-Length': '0'} 2024-04-16T18:15:41.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc5b96b8d09e1177-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.286 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.286 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.286 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.286 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.287 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.287 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.287 DEBUG:boto:Data: 2024-04-16T18:15:41.287 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.287 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.287 DEBUG:boto:Params: {} 2024-04-16T18:15:41.287 DEBUG:boto:Token: None 2024-04-16T18:15:41.287 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ix/kiTFGF+erMJwAGz7WzF0N1Ps= 2024-04-16T18:15:41.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ix/kiTFGF+erMJwAGz7WzF0N1Ps=', 'Content-Length': '0'} 2024-04-16T18:15:41.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087e006f26a527083-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:15:41.290 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.290 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.290 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.290 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.290 DEBUG:boto:Method: GET 2024-04-16T18:15:41.290 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.291 DEBUG:boto:Data: 2024-04-16T18:15:41.291 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.291 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.291 DEBUG:boto:Params: {} 2024-04-16T18:15:41.291 DEBUG:boto:Token: None 2024-04-16T18:15:41.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4= 2024-04-16T18:15:41.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4=', 'Content-Length': '0'} 2024-04-16T18:15:41.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e38a176d7004ab3-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.334 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.335 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.335 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.335 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:15:41.335 DEBUG:boto:Method: GET 2024-04-16T18:15:41.335 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.335 DEBUG:boto:Data: 2024-04-16T18:15:41.335 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.335 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.336 DEBUG:boto:Params: {} 2024-04-16T18:15:41.336 DEBUG:boto:Token: None 2024-04-16T18:15:41.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:15:41.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4= 2024-04-16T18:15:41.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rr+CAIaq22tJBpbN78bLtIegSG4=', 'Content-Length': '0'} 2024-04-16T18:15:41.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c39cc58ec46c5fd3-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.338 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.339 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.339 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.339 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.339 DEBUG:boto:Method: GET 2024-04-16T18:15:41.339 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:15:41.339 DEBUG:boto:Data: 2024-04-16T18:15:41.339 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.339 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.340 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.340 DEBUG:boto:Params: {} 2024-04-16T18:15:41.340 DEBUG:boto:Token: None 2024-04-16T18:15:41.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.343 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb3f63dcb0701434-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.344 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.344 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.344 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.344 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.344 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.345 DEBUG:boto:Method: GET 2024-04-16T18:15:41.345 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:15:41.345 DEBUG:boto:Data: 2024-04-16T18:15:41.345 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.345 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.345 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.345 DEBUG:boto:Params: {} 2024-04-16T18:15:41.346 DEBUG:boto:Token: None 2024-04-16T18:15:41.346 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.346 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074ed0dd81a9d489d-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.390 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.391 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.391 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.391 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.391 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:15:41.391 DEBUG:boto:Data: 2024-04-16T18:15:41.391 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.392 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.392 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.392 DEBUG:boto:Params: {} 2024-04-16T18:15:41.392 DEBUG:boto:Token: None 2024-04-16T18:15:41.392 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d 2024-04-16T18:15:41.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IbAmpFd6EOcYWUX2Nd15QlwNIZs= 2024-04-16T18:15:41.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IbAmpFd6EOcYWUX2Nd15QlwNIZs=', 'Content-Length': '0'} 2024-04-16T18:15:41.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000799f42a52725b956-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.395 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.395 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.395 DEBUG:boto:Method: HEAD 2024-04-16T18:15:41.395 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:15:41.395 DEBUG:boto:Data: 2024-04-16T18:15:41.395 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.395 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.395 DEBUG:boto:Params: {} 2024-04-16T18:15:41.396 DEBUG:boto:Token: None 2024-04-16T18:15:41.396 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d 2024-04-16T18:15:41.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IbAmpFd6EOcYWUX2Nd15QlwNIZs= 2024-04-16T18:15:41.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IbAmpFd6EOcYWUX2Nd15QlwNIZs=', 'Content-Length': '0'} 2024-04-16T18:15:41.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000032bb8e8ca42b19b-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.398 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:15:41.399 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.399 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.399 DEBUG:boto:Method: GET 2024-04-16T18:15:41.399 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:15:41.399 DEBUG:boto:Data: 2024-04-16T18:15:41.399 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.399 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.399 DEBUG:boto:Params: {} 2024-04-16T18:15:41.400 DEBUG:boto:Token: None 2024-04-16T18:15:41.400 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d 2024-04-16T18:15:41.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9HEQTfIFY4Pp05rx9N/yRvrvcig= 2024-04-16T18:15:41.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9HEQTfIFY4Pp05rx9N/yRvrvcig=', 'Content-Length': '0'} 2024-04-16T18:15:41.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000352c70a41c7d353e-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.442 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:15:41.443 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:15:41.443 DEBUG:boto:Method: GET 2024-04-16T18:15:41.443 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:15:41.443 DEBUG:boto:Data: 2024-04-16T18:15:41.443 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.443 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.443 DEBUG:boto:Params: {} 2024-04-16T18:15:41.444 DEBUG:boto:Token: None 2024-04-16T18:15:41.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/d 2024-04-16T18:15:41.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9HEQTfIFY4Pp05rx9N/yRvrvcig= 2024-04-16T18:15:41.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9HEQTfIFY4Pp05rx9N/yRvrvcig=', 'Content-Length': '0'} 2024-04-16T18:15:41.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c183f74077ae8f7b-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.446 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.447 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.447 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.447 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.447 DEBUG:boto:Method: GET 2024-04-16T18:15:41.447 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:15:41.447 DEBUG:boto:Data: 2024-04-16T18:15:41.447 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:15:41.448 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.448 DEBUG:boto:Params: {} 2024-04-16T18:15:41.448 DEBUG:boto:Token: None 2024-04-16T18:15:41.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ce18f9ce5b18bb7-00661ec04d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.452 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.452 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:41.452 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:41.452 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.452 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:15:41.453 DEBUG:boto:Method: GET 2024-04-16T18:15:41.453 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:15:41.453 DEBUG:boto:Data: 2024-04-16T18:15:41.453 DEBUG:boto:Headers: {} 2024-04-16T18:15:41.453 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:41.453 DEBUG:boto:Port: 8000 2024-04-16T18:15:41.453 DEBUG:boto:Params: {} 2024-04-16T18:15:41.453 DEBUG:boto:Token: None 2024-04-16T18:15:41.454 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:15:41 GMT /cjqttm-50/ 2024-04-16T18:15:41.454 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE= 2024-04-16T18:15:41.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OdmOlLO0iumSVyhqwAxhEaayPkE=', 'Content-Length': '0'} 2024-04-16T18:15:41.456 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aaf2c056229a5765-00661ec04d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:41.456 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:15:41.457 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:15:41.457 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:15:41.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:15:41.458 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket cjqttm-50 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:15:41.506 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:41.507 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:41.585 INFO:teuthology.orchestra.run.smithi016.stdout:{"layout":{"resharding":"None","current_index":{"gen":0,"layout":{"type":"Normal","normal":{"num_shards":11,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}}]}} 2024-04-16T18:15:41.586 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'cjqttm-50', '--gen', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:41.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'cjqttm-50', '--gen', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:41.586 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket cjqttm-50 --gen 0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:41.634 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:41.635 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:41.710 INFO:teuthology.orchestra.run.smithi016.stdout:[{"op_id":"1#00000000001.23.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.18313434892828525928","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:15:35.047582514Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]},{"op_id":"5#00000000001.25.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.14992452125259845833","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:15:35.116313245Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]},{"op_id":"8#00000000001.35.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.6713008543827765717","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:15:35.106243370Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]},{"op_id":"10#00000000001.41.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.7072292860118244835","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:15:35.095206003Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]}] 2024-04-16T18:15:41.710 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'cjqttm-50', '--num-shards', '13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:15:41.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'cjqttm-50', '--num-shards', '13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:15:41.711 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket cjqttm-50 --num-shards 13 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:15:41.757 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:41.757 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:41.825 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:15:41.826 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-50 2024-04-16T18:15:41.831 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 4 2024-04-16T18:15:41.879 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:15:41.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:15:41.880 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket cjqttm-50 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:15:41.924 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:41.924 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:41.995 INFO:teuthology.orchestra.run.smithi016.stdout:{"layout":{"resharding":"None","current_index":{"gen":1,"layout":{"type":"Normal","normal":{"num_shards":13,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}},{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":13,"hash_type":"Mod"}}}}]}} 2024-04-16T18:15:41.996 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'cjqttm-50', '--gen', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:41.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'cjqttm-50', '--gen', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:15:41.996 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket cjqttm-50 --gen 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:15:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:42.043 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:42.116 INFO:teuthology.orchestra.run.smithi016.stdout:[] 2024-04-16T18:15:42.116 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:42.116 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:42.117 DEBUG:boto:Method: HEAD 2024-04-16T18:15:42.117 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:42.117 DEBUG:boto:Data: 2024-04-16T18:15:42.117 DEBUG:boto:Headers: {} 2024-04-16T18:15:42.117 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.117 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.117 DEBUG:boto:Params: {} 2024-04-16T18:15:42.118 DEBUG:boto:Token: None 2024-04-16T18:15:42.118 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/ 2024-04-16T18:15:42.118 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA= 2024-04-16T18:15:42.118 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA=', 'Content-Length': '0'} 2024-04-16T18:15:42.121 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092ce2de1711609cf-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.121 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:15:42.121 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:15:42.121 DEBUG:boto:Method: PUT 2024-04-16T18:15:42.121 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:15:42.121 DEBUG:boto:Data: 2024-04-16T18:15:42.122 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:42.122 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.122 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.122 DEBUG:boto:Params: {} 2024-04-16T18:15:42.122 DEBUG:boto:Token: None 2024-04-16T18:15:42.122 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/e 2024-04-16T18:15:42.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bf8gvqzKEI2wqu/8Z7DoqbTH6jU= 2024-04-16T18:15:42.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bf8gvqzKEI2wqu/8Z7DoqbTH6jU='} 2024-04-16T18:15:42.128 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad23b44ad1973d77-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.129 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:42.129 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:42.129 DEBUG:boto:Method: HEAD 2024-04-16T18:15:42.129 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:42.129 DEBUG:boto:Data: 2024-04-16T18:15:42.129 DEBUG:boto:Headers: {} 2024-04-16T18:15:42.129 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.129 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.129 DEBUG:boto:Params: {} 2024-04-16T18:15:42.130 DEBUG:boto:Token: None 2024-04-16T18:15:42.130 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/ 2024-04-16T18:15:42.130 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA= 2024-04-16T18:15:42.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA=', 'Content-Length': '0'} 2024-04-16T18:15:42.132 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000060d9d26775a3325b-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.133 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:15:42.133 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:15:42.133 DEBUG:boto:Method: PUT 2024-04-16T18:15:42.133 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:15:42.133 DEBUG:boto:Data: 2024-04-16T18:15:42.133 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:42.133 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.134 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.134 DEBUG:boto:Params: {} 2024-04-16T18:15:42.134 DEBUG:boto:Token: None 2024-04-16T18:15:42.134 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/f 2024-04-16T18:15:42.134 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6aF88KlxaeS1RIk0BmzBIo/P0J0= 2024-04-16T18:15:42.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6aF88KlxaeS1RIk0BmzBIo/P0J0='} 2024-04-16T18:15:42.140 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a8fae51ebbc790d5-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.140 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:42.140 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:42.140 DEBUG:boto:Method: HEAD 2024-04-16T18:15:42.141 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:42.141 DEBUG:boto:Data: 2024-04-16T18:15:42.141 DEBUG:boto:Headers: {} 2024-04-16T18:15:42.141 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.141 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.141 DEBUG:boto:Params: {} 2024-04-16T18:15:42.141 DEBUG:boto:Token: None 2024-04-16T18:15:42.141 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/ 2024-04-16T18:15:42.142 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA= 2024-04-16T18:15:42.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA=', 'Content-Length': '0'} 2024-04-16T18:15:42.144 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000384adc53946327ac-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.144 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:15:42.144 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:15:42.144 DEBUG:boto:Method: PUT 2024-04-16T18:15:42.144 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:15:42.145 DEBUG:boto:Data: 2024-04-16T18:15:42.145 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:42.145 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.145 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.145 DEBUG:boto:Params: {} 2024-04-16T18:15:42.145 DEBUG:boto:Token: None 2024-04-16T18:15:42.145 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/g 2024-04-16T18:15:42.145 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NRgpLdSYQJxdZ4gM+CpfHXx4bk4= 2024-04-16T18:15:42.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NRgpLdSYQJxdZ4gM+CpfHXx4bk4='} 2024-04-16T18:15:42.191 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ad3e3ce96d2bd6e3-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.191 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:15:42.191 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:15:42.191 DEBUG:boto:Method: HEAD 2024-04-16T18:15:42.191 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:15:42.191 DEBUG:boto:Data: 2024-04-16T18:15:42.191 DEBUG:boto:Headers: {} 2024-04-16T18:15:42.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.191 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.192 DEBUG:boto:Params: {} 2024-04-16T18:15:42.192 DEBUG:boto:Token: None 2024-04-16T18:15:42.192 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/ 2024-04-16T18:15:42.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA= 2024-04-16T18:15:42.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mG0zT8D6P2lTPRCLs1ueJbBM8UA=', 'Content-Length': '0'} 2024-04-16T18:15:42.194 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000906c9c9ed38d02a5-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.195 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:15:42.195 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:15:42.195 DEBUG:boto:Method: PUT 2024-04-16T18:15:42.195 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:15:42.195 DEBUG:boto:Data: 2024-04-16T18:15:42.195 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:15:42.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:15:42.195 DEBUG:boto:Port: 8000 2024-04-16T18:15:42.196 DEBUG:boto:Params: {} 2024-04-16T18:15:42.196 DEBUG:boto:Token: None 2024-04-16T18:15:42.196 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:15:42 GMT /cjqttm-50/h 2024-04-16T18:15:42.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rf2EzpPWF8/uU7U18ltMiSsbiUQ= 2024-04-16T18:15:42.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:15:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rf2EzpPWF8/uU7U18ltMiSsbiUQ='} 2024-04-16T18:15:42.201 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000029251d4ae2b8862e-00661ec04e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:15:42.201 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-50 2024-04-16T18:15:42.202 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:42.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:15:42.202 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:15:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:15:42.264 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:15:42.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:42.325+0000 7f22c352a800 1 waiting to reach latest gen 1, on 0.. 2024-04-16T18:15:47.326 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:47.327+0000 7f22c352a800 1 waiting for incremental sync to catch up: 2024-04-16T18:15:47.326 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , ] 2024-04-16T18:15:47.326 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000001.43.6, , , , , 00000000002.51.6, , , 00000000001.47.6, 00000000001.41.6, ] 2024-04-16T18:15:52.327 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:52.328+0000 7f22c352a800 1 waiting for incremental sync to catch up: 2024-04-16T18:15:52.328 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , ] 2024-04-16T18:15:52.328 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000001.43.6, , , , , 00000000002.51.6, , , 00000000001.47.6, 00000000001.41.6, ] 2024-04-16T18:15:57.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:15:57.330+0000 7f22c352a800 1 waiting for incremental sync to catch up: 2024-04-16T18:15:57.330 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , ] 2024-04-16T18:15:57.330 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000001.43.6, , , , , 00000000002.51.6, , , 00000000001.47.6, 00000000001.41.6, ] 2024-04-16T18:16:02.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:02.332+0000 7f22c352a800 1 bucket sync caught up with source: 2024-04-16T18:16:02.330 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , 00000000001.43.6, , , , , 00000000002.51.6, , , 00000000001.47.6, 00000000001.41.6, ] 2024-04-16T18:16:02.331 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000001.43.6, , , , , 00000000002.51.6, , , 00000000001.47.6, 00000000001.41.6, ] 2024-04-16T18:16:02.331 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:02.332+0000 7f22c352a800 0 bucket checkpoint complete 2024-04-16T18:16:02.357 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-50 2024-04-16T18:16:02.358 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:02.358 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:02.358 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:16:02.420 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:02.420 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:02.483 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:02.484+0000 7fe215b20800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:02.483 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.240.6, , , , 00000000001.241.6, , , 00000000001.232.6, , 00000000001.328.6] 2024-04-16T18:16:02.483 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:07.485 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:07.486+0000 7fe215b20800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:07.485 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.240.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000001.232.6, , 00000000001.328.6] 2024-04-16T18:16:07.485 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:12.486 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:12.487+0000 7fe215b20800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:12.486 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.240.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000001.232.6, , 00000000001.328.6] 2024-04-16T18:16:12.486 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:17.488 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:17.489+0000 7fe215b20800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:17.488 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.240.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000001.232.6, , 00000000001.328.6] 2024-04-16T18:16:17.489 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:22.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:22.491+0000 7fe215b20800 1 bucket sync caught up with source: 2024-04-16T18:16:22.490 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:22.490 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:22.490 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:22.491+0000 7fe215b20800 0 bucket checkpoint complete 2024-04-16T18:16:22.518 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:16:22.519 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.519 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.519 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.519 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:22.519 DEBUG:boto:Data: 2024-04-16T18:16:22.519 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.520 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.520 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.520 DEBUG:boto:Params: {} 2024-04-16T18:16:22.520 DEBUG:boto:Token: None 2024-04-16T18:16:22.520 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.521 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xxu32erRjUOVXugXWU8IOcylQ+I= 2024-04-16T18:16:22.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xxu32erRjUOVXugXWU8IOcylQ+I=', 'Content-Length': '0'} 2024-04-16T18:16:22.523 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f5eb9d85a7baa779-00661ec076-5447-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.524 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.524 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.524 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.524 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:22.524 DEBUG:boto:Data: 2024-04-16T18:16:22.524 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.524 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.524 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.524 DEBUG:boto:Params: {} 2024-04-16T18:16:22.525 DEBUG:boto:Token: None 2024-04-16T18:16:22.525 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.525 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xxu32erRjUOVXugXWU8IOcylQ+I= 2024-04-16T18:16:22.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xxu32erRjUOVXugXWU8IOcylQ+I=', 'Content-Length': '0'} 2024-04-16T18:16:22.527 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000a4880b792d367bd-00661ec076-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.527 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:16:22.528 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.528 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.528 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.528 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.528 DEBUG:boto:Method: GET 2024-04-16T18:16:22.528 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.528 DEBUG:boto:Data: 2024-04-16T18:16:22.528 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.528 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.528 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.529 DEBUG:boto:Params: {} 2024-04-16T18:16:22.529 DEBUG:boto:Token: None 2024-04-16T18:16:22.529 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/?versions 2024-04-16T18:16:22.529 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc= 2024-04-16T18:16:22.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc=', 'Content-Length': '0'} 2024-04-16T18:16:22.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000e6754db0a4d379-00661ec076-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.532 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.532 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:16:22.533 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:16:22.533 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.533 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.534 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.534 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.534 DEBUG:boto:Method: GET 2024-04-16T18:16:22.534 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.534 DEBUG:boto:Data: 2024-04-16T18:16:22.534 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.534 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.534 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.534 DEBUG:boto:Params: {} 2024-04-16T18:16:22.535 DEBUG:boto:Token: None 2024-04-16T18:16:22.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/?versions 2024-04-16T18:16:22.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc= 2024-04-16T18:16:22.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc=', 'Content-Length': '0'} 2024-04-16T18:16:22.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e02afd54cc1d71e-00661ec076-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.538 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.538 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:16:22.538 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:16:22.538 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:16:22.539 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:16:22.539 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:16:22.539 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:16:22.539 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:16:22.539 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:16:22.539 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.539 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.539 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.539 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.539 DEBUG:boto:Method: GET 2024-04-16T18:16:22.540 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.540 DEBUG:boto:Data: 2024-04-16T18:16:22.540 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.540 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.540 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.540 DEBUG:boto:Params: {} 2024-04-16T18:16:22.540 DEBUG:boto:Token: None 2024-04-16T18:16:22.540 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/?versions 2024-04-16T18:16:22.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc= 2024-04-16T18:16:22.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc=', 'Content-Length': '0'} 2024-04-16T18:16:22.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006770413bd7d6000a-00661ec076-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.543 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.544 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.544 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.544 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.544 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.544 DEBUG:boto:Method: GET 2024-04-16T18:16:22.544 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:22.544 DEBUG:boto:Data: 2024-04-16T18:16:22.544 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.545 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.545 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.545 DEBUG:boto:Params: {} 2024-04-16T18:16:22.545 DEBUG:boto:Token: None 2024-04-16T18:16:22.545 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/?versions 2024-04-16T18:16:22.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc= 2024-04-16T18:16:22.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OVtLZxQjxFFb+TRzHwdIYKtmXBc=', 'Content-Length': '0'} 2024-04-16T18:16:22.548 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004f9cec54504dab2-00661ec076-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.548 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:16:22.549 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.549 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.549 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.549 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.549 DEBUG:boto:Method: GET 2024-04-16T18:16:22.549 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.550 DEBUG:boto:Data: 2024-04-16T18:16:22.550 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.550 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.550 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.550 DEBUG:boto:Params: {} 2024-04-16T18:16:22.550 DEBUG:boto:Token: None 2024-04-16T18:16:22.550 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.551 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc= 2024-04-16T18:16:22.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc=', 'Content-Length': '0'} 2024-04-16T18:16:22.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022e9ae902be0ccbb-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.594 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.594 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.595 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.595 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.595 DEBUG:boto:Method: GET 2024-04-16T18:16:22.595 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.595 DEBUG:boto:Data: 2024-04-16T18:16:22.595 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.595 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.595 DEBUG:boto:Params: {} 2024-04-16T18:16:22.596 DEBUG:boto:Token: None 2024-04-16T18:16:22.596 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc= 2024-04-16T18:16:22.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc=', 'Content-Length': '0'} 2024-04-16T18:16:22.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000479cb10f61e76d08-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.598 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.598 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.599 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.599 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.599 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.599 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.599 DEBUG:boto:Data: 2024-04-16T18:16:22.599 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.599 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.600 DEBUG:boto:Params: {} 2024-04-16T18:16:22.600 DEBUG:boto:Token: None 2024-04-16T18:16:22.600 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tqWJHJJInOMvHgdvm2TyLWciqC0= 2024-04-16T18:16:22.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tqWJHJJInOMvHgdvm2TyLWciqC0=', 'Content-Length': '0'} 2024-04-16T18:16:22.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4ea0e0b50db5cb5-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.602 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.602 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.603 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.603 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.603 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.603 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.603 DEBUG:boto:Data: 2024-04-16T18:16:22.603 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.603 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.603 DEBUG:boto:Params: {} 2024-04-16T18:16:22.604 DEBUG:boto:Token: None 2024-04-16T18:16:22.604 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tqWJHJJInOMvHgdvm2TyLWciqC0= 2024-04-16T18:16:22.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tqWJHJJInOMvHgdvm2TyLWciqC0=', 'Content-Length': '0'} 2024-04-16T18:16:22.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003634140dd151b0f1-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.606 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:16:22.606 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.606 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.606 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.607 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.607 DEBUG:boto:Method: GET 2024-04-16T18:16:22.607 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.607 DEBUG:boto:Data: 2024-04-16T18:16:22.607 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.607 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.607 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.607 DEBUG:boto:Params: {} 2024-04-16T18:16:22.607 DEBUG:boto:Token: None 2024-04-16T18:16:22.608 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc= 2024-04-16T18:16:22.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc=', 'Content-Length': '0'} 2024-04-16T18:16:22.610 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a91826123c7f196-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.610 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.610 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.610 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.610 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:22.610 DEBUG:boto:Method: GET 2024-04-16T18:16:22.611 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.611 DEBUG:boto:Data: 2024-04-16T18:16:22.611 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.611 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.611 DEBUG:boto:Params: {} 2024-04-16T18:16:22.611 DEBUG:boto:Token: None 2024-04-16T18:16:22.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:22.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc= 2024-04-16T18:16:22.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yu+NRUqTCDlFA+4ubdBHIEJ6Wxc=', 'Content-Length': '0'} 2024-04-16T18:16:22.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa5211ae5ac93ad7-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.613 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.614 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.614 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.614 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.614 DEBUG:boto:Method: GET 2024-04-16T18:16:22.614 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:22.614 DEBUG:boto:Data: 2024-04-16T18:16:22.614 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.614 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.614 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.614 DEBUG:boto:Params: {} 2024-04-16T18:16:22.615 DEBUG:boto:Token: None 2024-04-16T18:16:22.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053a891bf71507c43-00661ec076-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.618 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.618 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.618 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.618 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.619 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.619 DEBUG:boto:Method: GET 2024-04-16T18:16:22.619 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:22.619 DEBUG:boto:Data: 2024-04-16T18:16:22.619 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.619 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.619 DEBUG:boto:Params: {} 2024-04-16T18:16:22.619 DEBUG:boto:Token: None 2024-04-16T18:16:22.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021d5e9e0be842265-00661ec076-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.622 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.623 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.623 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.623 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.623 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:22.623 DEBUG:boto:Data: 2024-04-16T18:16:22.623 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.623 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.624 DEBUG:boto:Params: {} 2024-04-16T18:16:22.624 DEBUG:boto:Token: None 2024-04-16T18:16:22.624 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a 2024-04-16T18:16:22.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GKKJtMdLLOgpXNsQ9hRsj6d95wA= 2024-04-16T18:16:22.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GKKJtMdLLOgpXNsQ9hRsj6d95wA=', 'Content-Length': '0'} 2024-04-16T18:16:22.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1da269c4ad4a67b-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.626 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.626 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.626 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.626 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:22.627 DEBUG:boto:Data: 2024-04-16T18:16:22.627 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.627 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.627 DEBUG:boto:Params: {} 2024-04-16T18:16:22.627 DEBUG:boto:Token: None 2024-04-16T18:16:22.627 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a 2024-04-16T18:16:22.627 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GKKJtMdLLOgpXNsQ9hRsj6d95wA= 2024-04-16T18:16:22.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GKKJtMdLLOgpXNsQ9hRsj6d95wA=', 'Content-Length': '0'} 2024-04-16T18:16:22.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004eaa72fd761e4d10-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:16:22.630 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.630 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.630 DEBUG:boto:Method: GET 2024-04-16T18:16:22.630 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:22.630 DEBUG:boto:Data: 2024-04-16T18:16:22.630 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.630 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.630 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.630 DEBUG:boto:Params: {} 2024-04-16T18:16:22.631 DEBUG:boto:Token: None 2024-04-16T18:16:22.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a 2024-04-16T18:16:22.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0ICvdMRGiUXcrjYkIHlNX7dRm18= 2024-04-16T18:16:22.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0ICvdMRGiUXcrjYkIHlNX7dRm18=', 'Content-Length': '0'} 2024-04-16T18:16:22.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006139229457382bb-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.674 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:22.674 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:22.675 DEBUG:boto:Method: GET 2024-04-16T18:16:22.675 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:22.675 DEBUG:boto:Data: 2024-04-16T18:16:22.675 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.675 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.675 DEBUG:boto:Params: {} 2024-04-16T18:16:22.675 DEBUG:boto:Token: None 2024-04-16T18:16:22.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/a 2024-04-16T18:16:22.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0ICvdMRGiUXcrjYkIHlNX7dRm18= 2024-04-16T18:16:22.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0ICvdMRGiUXcrjYkIHlNX7dRm18=', 'Content-Length': '0'} 2024-04-16T18:16:22.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ac6037f9108a50f-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.678 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.678 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.679 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.679 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.679 DEBUG:boto:Method: GET 2024-04-16T18:16:22.679 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:22.679 DEBUG:boto:Data: 2024-04-16T18:16:22.679 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.679 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.679 DEBUG:boto:Params: {} 2024-04-16T18:16:22.679 DEBUG:boto:Token: None 2024-04-16T18:16:22.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004032ad747d69c7f9-00661ec076-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.682 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.683 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.683 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.683 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.683 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:22.683 DEBUG:boto:Method: GET 2024-04-16T18:16:22.684 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:22.684 DEBUG:boto:Data: 2024-04-16T18:16:22.684 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.684 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.684 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.684 DEBUG:boto:Params: {} 2024-04-16T18:16:22.684 DEBUG:boto:Token: None 2024-04-16T18:16:22.684 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e005d7563ee4f8c8-00661ec076-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.687 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:16:22.688 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.688 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.688 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.688 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.688 DEBUG:boto:Method: GET 2024-04-16T18:16:22.688 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.688 DEBUG:boto:Data: 2024-04-16T18:16:22.688 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.689 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.689 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.689 DEBUG:boto:Params: {} 2024-04-16T18:16:22.689 DEBUG:boto:Token: None 2024-04-16T18:16:22.689 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.689 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8= 2024-04-16T18:16:22.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8=', 'Content-Length': '0'} 2024-04-16T18:16:22.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000437ff4befd3bc80b-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.734 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.735 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.735 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.735 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.735 DEBUG:boto:Method: GET 2024-04-16T18:16:22.735 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.735 DEBUG:boto:Data: 2024-04-16T18:16:22.735 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.735 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.735 DEBUG:boto:Params: {} 2024-04-16T18:16:22.736 DEBUG:boto:Token: None 2024-04-16T18:16:22.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8= 2024-04-16T18:16:22.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8=', 'Content-Length': '0'} 2024-04-16T18:16:22.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d510d41b33863dd-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.738 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.739 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.739 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.739 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.739 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.739 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.739 DEBUG:boto:Data: 2024-04-16T18:16:22.739 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.739 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.739 DEBUG:boto:Params: {} 2024-04-16T18:16:22.740 DEBUG:boto:Token: None 2024-04-16T18:16:22.740 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3Gk4RnuugCg1OOboGzi7mS74kzI= 2024-04-16T18:16:22.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3Gk4RnuugCg1OOboGzi7mS74kzI=', 'Content-Length': '0'} 2024-04-16T18:16:22.742 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005d72714c9311110-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.742 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.743 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.743 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.743 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.743 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.743 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.743 DEBUG:boto:Data: 2024-04-16T18:16:22.743 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.743 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.743 DEBUG:boto:Params: {} 2024-04-16T18:16:22.744 DEBUG:boto:Token: None 2024-04-16T18:16:22.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3Gk4RnuugCg1OOboGzi7mS74kzI= 2024-04-16T18:16:22.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3Gk4RnuugCg1OOboGzi7mS74kzI=', 'Content-Length': '0'} 2024-04-16T18:16:22.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea96ed1e8afae914-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.746 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:16:22.746 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.746 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.746 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.746 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.747 DEBUG:boto:Method: GET 2024-04-16T18:16:22.747 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.747 DEBUG:boto:Data: 2024-04-16T18:16:22.747 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.747 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.747 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.747 DEBUG:boto:Params: {} 2024-04-16T18:16:22.747 DEBUG:boto:Token: None 2024-04-16T18:16:22.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8= 2024-04-16T18:16:22.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8=', 'Content-Length': '0'} 2024-04-16T18:16:22.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6c7ebc6837479bc-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.794 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.794 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.795 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.795 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:22.795 DEBUG:boto:Method: GET 2024-04-16T18:16:22.795 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.795 DEBUG:boto:Data: 2024-04-16T18:16:22.795 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.795 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.795 DEBUG:boto:Params: {} 2024-04-16T18:16:22.795 DEBUG:boto:Token: None 2024-04-16T18:16:22.796 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:22.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8= 2024-04-16T18:16:22.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jltJWzxYNEdOqsRNvaA6miPc3v8=', 'Content-Length': '0'} 2024-04-16T18:16:22.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f06b697af60a374c-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.798 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.799 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.799 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.799 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.799 DEBUG:boto:Method: GET 2024-04-16T18:16:22.799 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:22.799 DEBUG:boto:Data: 2024-04-16T18:16:22.799 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.799 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.799 DEBUG:boto:Params: {} 2024-04-16T18:16:22.800 DEBUG:boto:Token: None 2024-04-16T18:16:22.800 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6b2870e4aba9058-00661ec076-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.802 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.803 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.803 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.803 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.803 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.803 DEBUG:boto:Method: GET 2024-04-16T18:16:22.803 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:22.803 DEBUG:boto:Data: 2024-04-16T18:16:22.804 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.804 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.804 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.804 DEBUG:boto:Params: {} 2024-04-16T18:16:22.804 DEBUG:boto:Token: None 2024-04-16T18:16:22.804 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.807 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3136d66549c2a11-00661ec076-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.807 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.807 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.807 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.807 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.807 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:22.808 DEBUG:boto:Data: 2024-04-16T18:16:22.808 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.808 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.808 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.808 DEBUG:boto:Params: {} 2024-04-16T18:16:22.808 DEBUG:boto:Token: None 2024-04-16T18:16:22.808 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b 2024-04-16T18:16:22.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qg04HDGYR47pWswzUDZ9/Y2u3rM= 2024-04-16T18:16:22.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qg04HDGYR47pWswzUDZ9/Y2u3rM=', 'Content-Length': '0'} 2024-04-16T18:16:22.811 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e294dc002b9f528c-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.811 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.811 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.811 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.811 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:22.811 DEBUG:boto:Data: 2024-04-16T18:16:22.811 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.812 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.812 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.812 DEBUG:boto:Params: {} 2024-04-16T18:16:22.812 DEBUG:boto:Token: None 2024-04-16T18:16:22.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b 2024-04-16T18:16:22.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qg04HDGYR47pWswzUDZ9/Y2u3rM= 2024-04-16T18:16:22.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qg04HDGYR47pWswzUDZ9/Y2u3rM=', 'Content-Length': '0'} 2024-04-16T18:16:22.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c8aeea718497451-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.814 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:16:22.814 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.815 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.815 DEBUG:boto:Method: GET 2024-04-16T18:16:22.815 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:22.815 DEBUG:boto:Data: 2024-04-16T18:16:22.815 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.815 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.815 DEBUG:boto:Params: {} 2024-04-16T18:16:22.815 DEBUG:boto:Token: None 2024-04-16T18:16:22.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b 2024-04-16T18:16:22.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iyLJH7WGFgXaAfN6lCoXL3FnhdE= 2024-04-16T18:16:22.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iyLJH7WGFgXaAfN6lCoXL3FnhdE=', 'Content-Length': '0'} 2024-04-16T18:16:22.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008700229797bfdc4f-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.858 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:22.859 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:22.859 DEBUG:boto:Method: GET 2024-04-16T18:16:22.859 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:22.859 DEBUG:boto:Data: 2024-04-16T18:16:22.859 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.859 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.859 DEBUG:boto:Params: {} 2024-04-16T18:16:22.860 DEBUG:boto:Token: None 2024-04-16T18:16:22.860 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/b 2024-04-16T18:16:22.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iyLJH7WGFgXaAfN6lCoXL3FnhdE= 2024-04-16T18:16:22.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iyLJH7WGFgXaAfN6lCoXL3FnhdE=', 'Content-Length': '0'} 2024-04-16T18:16:22.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d92bb3b023aa638-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.862 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.862 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.863 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.863 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.863 DEBUG:boto:Method: GET 2024-04-16T18:16:22.863 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:22.863 DEBUG:boto:Data: 2024-04-16T18:16:22.863 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.863 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.863 DEBUG:boto:Params: {} 2024-04-16T18:16:22.863 DEBUG:boto:Token: None 2024-04-16T18:16:22.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054fa22100fbd6662-00661ec076-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.866 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.867 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.867 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.867 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.867 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:22.867 DEBUG:boto:Method: GET 2024-04-16T18:16:22.867 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:22.867 DEBUG:boto:Data: 2024-04-16T18:16:22.867 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.868 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.868 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.868 DEBUG:boto:Params: {} 2024-04-16T18:16:22.868 DEBUG:boto:Token: None 2024-04-16T18:16:22.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.870 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f496fefc7824b782-00661ec076-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.871 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.871 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:16:22.871 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.871 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.871 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.871 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.872 DEBUG:boto:Method: GET 2024-04-16T18:16:22.872 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.872 DEBUG:boto:Data: 2024-04-16T18:16:22.872 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.872 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.872 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.872 DEBUG:boto:Params: {} 2024-04-16T18:16:22.872 DEBUG:boto:Token: None 2024-04-16T18:16:22.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE= 2024-04-16T18:16:22.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE=', 'Content-Length': '0'} 2024-04-16T18:16:22.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006c7564c76c86037-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.918 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.919 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.919 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.919 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.919 DEBUG:boto:Method: GET 2024-04-16T18:16:22.919 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.919 DEBUG:boto:Data: 2024-04-16T18:16:22.919 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.919 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.919 DEBUG:boto:Params: {} 2024-04-16T18:16:22.920 DEBUG:boto:Token: None 2024-04-16T18:16:22.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE= 2024-04-16T18:16:22.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE=', 'Content-Length': '0'} 2024-04-16T18:16:22.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000905a0f51cfe1c350-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.923 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.925 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.925 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.925 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.925 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.925 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.925 DEBUG:boto:Data: 2024-04-16T18:16:22.926 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.926 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.926 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.926 DEBUG:boto:Params: {} 2024-04-16T18:16:22.926 DEBUG:boto:Token: None 2024-04-16T18:16:22.926 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:235wG3eWt8Pg+kLUF5dg3U2uVv8= 2024-04-16T18:16:22.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:235wG3eWt8Pg+kLUF5dg3U2uVv8=', 'Content-Length': '0'} 2024-04-16T18:16:22.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5092721e3ae2aa7-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.928 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.928 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.929 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.929 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.929 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.929 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.929 DEBUG:boto:Data: 2024-04-16T18:16:22.929 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.929 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.929 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.929 DEBUG:boto:Params: {} 2024-04-16T18:16:22.929 DEBUG:boto:Token: None 2024-04-16T18:16:22.930 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:235wG3eWt8Pg+kLUF5dg3U2uVv8= 2024-04-16T18:16:22.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:235wG3eWt8Pg+kLUF5dg3U2uVv8=', 'Content-Length': '0'} 2024-04-16T18:16:22.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018bb52ca0183a768-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:16:22.932 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.933 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.933 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.933 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.933 DEBUG:boto:Method: GET 2024-04-16T18:16:22.933 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.933 DEBUG:boto:Data: 2024-04-16T18:16:22.933 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.933 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.933 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.933 DEBUG:boto:Params: {} 2024-04-16T18:16:22.933 DEBUG:boto:Token: None 2024-04-16T18:16:22.934 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.934 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE= 2024-04-16T18:16:22.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE=', 'Content-Length': '0'} 2024-04-16T18:16:22.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8f8eef8da42507e-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.978 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.978 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.979 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.979 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:22.979 DEBUG:boto:Method: GET 2024-04-16T18:16:22.979 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.979 DEBUG:boto:Data: 2024-04-16T18:16:22.979 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.979 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.979 DEBUG:boto:Params: {} 2024-04-16T18:16:22.980 DEBUG:boto:Token: None 2024-04-16T18:16:22.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:22.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE= 2024-04-16T18:16:22.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7tQK5mu/CLenTqbeiLA2S+kosCE=', 'Content-Length': '0'} 2024-04-16T18:16:22.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000307013605a50b060-00661ec076-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.982 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.982 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.983 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:22.983 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:22.983 DEBUG:boto:Method: GET 2024-04-16T18:16:22.983 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:22.983 DEBUG:boto:Data: 2024-04-16T18:16:22.983 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.983 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.983 DEBUG:boto:Params: {} 2024-04-16T18:16:22.983 DEBUG:boto:Token: None 2024-04-16T18:16:22.984 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096e83ac8f5383f6f-00661ec076-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.987 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.987 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:22.987 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:22.987 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:22.987 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:22.988 DEBUG:boto:Method: GET 2024-04-16T18:16:22.988 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:22.988 DEBUG:boto:Data: 2024-04-16T18:16:22.988 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.988 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.988 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.988 DEBUG:boto:Params: {} 2024-04-16T18:16:22.988 DEBUG:boto:Token: None 2024-04-16T18:16:22.989 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/ 2024-04-16T18:16:22.989 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg= 2024-04-16T18:16:22.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjHI81lBEXruJT83/lG+/Yktjvg=', 'Content-Length': '0'} 2024-04-16T18:16:22.991 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000700ae44375f6412e-00661ec076-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.991 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:22.992 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.992 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.992 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.992 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:22.992 DEBUG:boto:Data: 2024-04-16T18:16:22.992 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.992 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.992 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.993 DEBUG:boto:Params: {} 2024-04-16T18:16:22.993 DEBUG:boto:Token: None 2024-04-16T18:16:22.993 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c 2024-04-16T18:16:22.993 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wv31azDiuRaZkd3TBVaCSgKA4x4= 2024-04-16T18:16:22.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wv31azDiuRaZkd3TBVaCSgKA4x4=', 'Content-Length': '0'} 2024-04-16T18:16:22.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be9ada0256551cec-00661ec076-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.995 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.995 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.996 DEBUG:boto:Method: HEAD 2024-04-16T18:16:22.996 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:22.996 DEBUG:boto:Data: 2024-04-16T18:16:22.996 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.996 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:22.996 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.996 DEBUG:boto:Params: {} 2024-04-16T18:16:22.996 DEBUG:boto:Token: None 2024-04-16T18:16:22.996 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:22 GMT /cjqttm-50/c 2024-04-16T18:16:22.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wv31azDiuRaZkd3TBVaCSgKA4x4= 2024-04-16T18:16:22.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wv31azDiuRaZkd3TBVaCSgKA4x4=', 'Content-Length': '0'} 2024-04-16T18:16:22.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe20a503a9e495f6-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:22.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:16:22.999 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:22.999 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:22.999 DEBUG:boto:Method: GET 2024-04-16T18:16:22.999 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:22.999 DEBUG:boto:Data: 2024-04-16T18:16:22.999 DEBUG:boto:Headers: {} 2024-04-16T18:16:22.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:22.999 DEBUG:boto:Port: 8000 2024-04-16T18:16:22.999 DEBUG:boto:Params: {} 2024-04-16T18:16:23.000 DEBUG:boto:Token: None 2024-04-16T18:16:23.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/c 2024-04-16T18:16:23.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5AbWnprJlqu98U5Ltg5RHktg9ZY= 2024-04-16T18:16:23.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5AbWnprJlqu98U5Ltg5RHktg9ZY=', 'Content-Length': '0'} 2024-04-16T18:16:23.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018f4a0ff6519a39a-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.042 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:23.042 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:23.042 DEBUG:boto:Method: GET 2024-04-16T18:16:23.043 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:23.043 DEBUG:boto:Data: 2024-04-16T18:16:23.043 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.043 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.043 DEBUG:boto:Params: {} 2024-04-16T18:16:23.043 DEBUG:boto:Token: None 2024-04-16T18:16:23.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/c 2024-04-16T18:16:23.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5AbWnprJlqu98U5Ltg5RHktg9ZY= 2024-04-16T18:16:23.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5AbWnprJlqu98U5Ltg5RHktg9ZY=', 'Content-Length': '0'} 2024-04-16T18:16:23.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033c86f98090bc259-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.045 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.046 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.046 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:23.046 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:23.046 DEBUG:boto:Method: GET 2024-04-16T18:16:23.046 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:23.046 DEBUG:boto:Data: 2024-04-16T18:16:23.046 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.046 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.046 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.046 DEBUG:boto:Params: {} 2024-04-16T18:16:23.046 DEBUG:boto:Token: None 2024-04-16T18:16:23.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000053f44ff6498b5bd-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.050 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.050 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.050 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.050 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:23.050 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:23.051 DEBUG:boto:Method: GET 2024-04-16T18:16:23.051 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:23.051 DEBUG:boto:Data: 2024-04-16T18:16:23.051 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.051 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.051 DEBUG:boto:Params: {} 2024-04-16T18:16:23.051 DEBUG:boto:Token: None 2024-04-16T18:16:23.051 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.054 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9ca8a9f797f1014-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.054 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.054 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:16:23.054 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.055 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.055 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.055 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.055 DEBUG:boto:Method: GET 2024-04-16T18:16:23.055 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.055 DEBUG:boto:Data: 2024-04-16T18:16:23.055 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.055 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.055 DEBUG:boto:Params: {} 2024-04-16T18:16:23.055 DEBUG:boto:Token: None 2024-04-16T18:16:23.056 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA= 2024-04-16T18:16:23.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA=', 'Content-Length': '0'} 2024-04-16T18:16:23.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4cd48704f6b48aa-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.098 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.098 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.099 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.099 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.099 DEBUG:boto:Method: GET 2024-04-16T18:16:23.099 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.099 DEBUG:boto:Data: 2024-04-16T18:16:23.099 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.099 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.099 DEBUG:boto:Params: {} 2024-04-16T18:16:23.099 DEBUG:boto:Token: None 2024-04-16T18:16:23.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA= 2024-04-16T18:16:23.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA=', 'Content-Length': '0'} 2024-04-16T18:16:23.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027a63af9063b22f1-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.102 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.102 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.102 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.102 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.103 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.103 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.103 DEBUG:boto:Data: 2024-04-16T18:16:23.103 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.103 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.103 DEBUG:boto:Params: {} 2024-04-16T18:16:23.103 DEBUG:boto:Token: None 2024-04-16T18:16:23.103 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fdHBXaLD+/gca4yc39mxm9EK3ko= 2024-04-16T18:16:23.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fdHBXaLD+/gca4yc39mxm9EK3ko=', 'Content-Length': '0'} 2024-04-16T18:16:23.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cf73360debfdc66-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.106 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.106 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.106 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.106 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.106 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.106 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.106 DEBUG:boto:Data: 2024-04-16T18:16:23.106 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.106 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.107 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.107 DEBUG:boto:Params: {} 2024-04-16T18:16:23.107 DEBUG:boto:Token: None 2024-04-16T18:16:23.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fdHBXaLD+/gca4yc39mxm9EK3ko= 2024-04-16T18:16:23.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fdHBXaLD+/gca4yc39mxm9EK3ko=', 'Content-Length': '0'} 2024-04-16T18:16:23.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de6afa2b88f4495a-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:16:23.109 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.109 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.109 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.110 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.110 DEBUG:boto:Method: GET 2024-04-16T18:16:23.110 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.110 DEBUG:boto:Data: 2024-04-16T18:16:23.110 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.110 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.110 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.110 DEBUG:boto:Params: {} 2024-04-16T18:16:23.111 DEBUG:boto:Token: None 2024-04-16T18:16:23.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA= 2024-04-16T18:16:23.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA=', 'Content-Length': '0'} 2024-04-16T18:16:23.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2f49a9265d17131-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.154 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.154 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.155 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.155 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:23.155 DEBUG:boto:Method: GET 2024-04-16T18:16:23.155 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.155 DEBUG:boto:Data: 2024-04-16T18:16:23.155 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.155 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.155 DEBUG:boto:Params: {} 2024-04-16T18:16:23.156 DEBUG:boto:Token: None 2024-04-16T18:16:23.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:23.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA= 2024-04-16T18:16:23.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PvaaTHkn4XwnJT/UzNDnQbd8ssA=', 'Content-Length': '0'} 2024-04-16T18:16:23.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035429d5cfbc8cdcf-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.158 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.158 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.158 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.159 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.159 DEBUG:boto:Method: GET 2024-04-16T18:16:23.159 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:23.159 DEBUG:boto:Data: 2024-04-16T18:16:23.159 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.159 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.159 DEBUG:boto:Params: {} 2024-04-16T18:16:23.159 DEBUG:boto:Token: None 2024-04-16T18:16:23.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000359bee83ca213871-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.206 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.207 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.207 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.207 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.207 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.207 DEBUG:boto:Method: GET 2024-04-16T18:16:23.207 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:23.207 DEBUG:boto:Data: 2024-04-16T18:16:23.208 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.208 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.208 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.208 DEBUG:boto:Params: {} 2024-04-16T18:16:23.208 DEBUG:boto:Token: None 2024-04-16T18:16:23.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c3670640340077e-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.211 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.211 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.211 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.211 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.212 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:23.212 DEBUG:boto:Data: 2024-04-16T18:16:23.212 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.212 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.212 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.212 DEBUG:boto:Params: {} 2024-04-16T18:16:23.212 DEBUG:boto:Token: None 2024-04-16T18:16:23.212 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d 2024-04-16T18:16:23.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F3yXwSjDKJnTpoG8RUdwsDTuGf8= 2024-04-16T18:16:23.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F3yXwSjDKJnTpoG8RUdwsDTuGf8=', 'Content-Length': '0'} 2024-04-16T18:16:23.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4ff77e42c35ae76-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.215 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.215 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.215 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.215 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:23.215 DEBUG:boto:Data: 2024-04-16T18:16:23.215 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.215 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.215 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.215 DEBUG:boto:Params: {} 2024-04-16T18:16:23.215 DEBUG:boto:Token: None 2024-04-16T18:16:23.216 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d 2024-04-16T18:16:23.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F3yXwSjDKJnTpoG8RUdwsDTuGf8= 2024-04-16T18:16:23.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F3yXwSjDKJnTpoG8RUdwsDTuGf8=', 'Content-Length': '0'} 2024-04-16T18:16:23.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021d84ee478e66190-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.218 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:16:23.218 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.218 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.218 DEBUG:boto:Method: GET 2024-04-16T18:16:23.219 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:23.219 DEBUG:boto:Data: 2024-04-16T18:16:23.219 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.219 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.219 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.219 DEBUG:boto:Params: {} 2024-04-16T18:16:23.219 DEBUG:boto:Token: None 2024-04-16T18:16:23.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d 2024-04-16T18:16:23.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/GM7UujL3y03+4lt5TfqjVaInVU= 2024-04-16T18:16:23.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/GM7UujL3y03+4lt5TfqjVaInVU=', 'Content-Length': '0'} 2024-04-16T18:16:23.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009104e9876eee37f6-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.262 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:23.263 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:23.263 DEBUG:boto:Method: GET 2024-04-16T18:16:23.263 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:23.263 DEBUG:boto:Data: 2024-04-16T18:16:23.263 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.263 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.263 DEBUG:boto:Params: {} 2024-04-16T18:16:23.263 DEBUG:boto:Token: None 2024-04-16T18:16:23.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/d 2024-04-16T18:16:23.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/GM7UujL3y03+4lt5TfqjVaInVU= 2024-04-16T18:16:23.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/GM7UujL3y03+4lt5TfqjVaInVU=', 'Content-Length': '0'} 2024-04-16T18:16:23.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009afe22ccd9471f2-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.266 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.266 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.266 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.266 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.266 DEBUG:boto:Method: GET 2024-04-16T18:16:23.266 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:23.266 DEBUG:boto:Data: 2024-04-16T18:16:23.266 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.267 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.267 DEBUG:boto:Params: {} 2024-04-16T18:16:23.267 DEBUG:boto:Token: None 2024-04-16T18:16:23.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002a48e8ff88529fc-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.270 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.270 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.270 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.270 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.270 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:23.271 DEBUG:boto:Method: GET 2024-04-16T18:16:23.271 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:23.271 DEBUG:boto:Data: 2024-04-16T18:16:23.271 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.271 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.271 DEBUG:boto:Params: {} 2024-04-16T18:16:23.271 DEBUG:boto:Token: None 2024-04-16T18:16:23.271 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.274 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022ff960ce7aa6c4e-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.274 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:16:23.274 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.275 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.275 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.275 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.275 DEBUG:boto:Method: GET 2024-04-16T18:16:23.275 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.275 DEBUG:boto:Data: 2024-04-16T18:16:23.275 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.275 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.275 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.275 DEBUG:boto:Params: {} 2024-04-16T18:16:23.275 DEBUG:boto:Token: None 2024-04-16T18:16:23.276 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k= 2024-04-16T18:16:23.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k=', 'Content-Length': '0'} 2024-04-16T18:16:23.278 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000021173fe0766c531-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.318 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.318 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.318 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.319 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.319 DEBUG:boto:Method: GET 2024-04-16T18:16:23.319 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.319 DEBUG:boto:Data: 2024-04-16T18:16:23.319 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.319 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.319 DEBUG:boto:Params: {} 2024-04-16T18:16:23.319 DEBUG:boto:Token: None 2024-04-16T18:16:23.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k= 2024-04-16T18:16:23.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k=', 'Content-Length': '0'} 2024-04-16T18:16:23.322 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009323c77fd7708d78-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.322 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.322 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.322 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.322 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.322 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.322 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.323 DEBUG:boto:Data: 2024-04-16T18:16:23.323 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.323 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.323 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.323 DEBUG:boto:Params: {} 2024-04-16T18:16:23.323 DEBUG:boto:Token: None 2024-04-16T18:16:23.323 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MSFFbabTx5RW1qcLkDGdqkWxlTY= 2024-04-16T18:16:23.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MSFFbabTx5RW1qcLkDGdqkWxlTY=', 'Content-Length': '0'} 2024-04-16T18:16:23.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a60ad1db889d862-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.326 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.326 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.326 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.326 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.326 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.326 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.326 DEBUG:boto:Data: 2024-04-16T18:16:23.327 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.327 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.327 DEBUG:boto:Params: {} 2024-04-16T18:16:23.327 DEBUG:boto:Token: None 2024-04-16T18:16:23.327 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MSFFbabTx5RW1qcLkDGdqkWxlTY= 2024-04-16T18:16:23.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MSFFbabTx5RW1qcLkDGdqkWxlTY=', 'Content-Length': '0'} 2024-04-16T18:16:23.329 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d91a0c1315b8a5ab-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:16:23.330 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.330 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.330 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.330 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.330 DEBUG:boto:Method: GET 2024-04-16T18:16:23.330 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.330 DEBUG:boto:Data: 2024-04-16T18:16:23.331 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.331 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.331 DEBUG:boto:Params: {} 2024-04-16T18:16:23.331 DEBUG:boto:Token: None 2024-04-16T18:16:23.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k= 2024-04-16T18:16:23.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k=', 'Content-Length': '0'} 2024-04-16T18:16:23.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b05a014108ab61de-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.374 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.374 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.375 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.375 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:23.375 DEBUG:boto:Method: GET 2024-04-16T18:16:23.375 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.375 DEBUG:boto:Data: 2024-04-16T18:16:23.375 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.375 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.375 DEBUG:boto:Params: {} 2024-04-16T18:16:23.375 DEBUG:boto:Token: None 2024-04-16T18:16:23.376 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:23.376 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k= 2024-04-16T18:16:23.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KzHUbxV5rGT/1r+waPZpxWEtp7k=', 'Content-Length': '0'} 2024-04-16T18:16:23.378 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000534154677f14b869-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.378 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.378 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.378 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.378 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.379 DEBUG:boto:Method: GET 2024-04-16T18:16:23.379 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:23.379 DEBUG:boto:Data: 2024-04-16T18:16:23.379 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.379 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.379 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.379 DEBUG:boto:Params: {} 2024-04-16T18:16:23.379 DEBUG:boto:Token: None 2024-04-16T18:16:23.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.382 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007cdcc51290ab78d0-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.382 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.383 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.383 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.383 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.383 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.383 DEBUG:boto:Method: GET 2024-04-16T18:16:23.383 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:23.383 DEBUG:boto:Data: 2024-04-16T18:16:23.383 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.383 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.383 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.383 DEBUG:boto:Params: {} 2024-04-16T18:16:23.384 DEBUG:boto:Token: None 2024-04-16T18:16:23.384 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.386 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006cf485449ee24b4d-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.386 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.387 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.387 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.387 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.387 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:23.387 DEBUG:boto:Data: 2024-04-16T18:16:23.387 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.387 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.387 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.388 DEBUG:boto:Params: {} 2024-04-16T18:16:23.388 DEBUG:boto:Token: None 2024-04-16T18:16:23.388 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e 2024-04-16T18:16:23.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rlm8c6uXG08yhTqFyiSlZdeAbVE= 2024-04-16T18:16:23.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rlm8c6uXG08yhTqFyiSlZdeAbVE=', 'Content-Length': '0'} 2024-04-16T18:16:23.390 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000715e8e18280d1777-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.390 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.390 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.390 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.390 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:23.390 DEBUG:boto:Data: 2024-04-16T18:16:23.391 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.391 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.391 DEBUG:boto:Params: {} 2024-04-16T18:16:23.391 DEBUG:boto:Token: None 2024-04-16T18:16:23.391 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e 2024-04-16T18:16:23.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rlm8c6uXG08yhTqFyiSlZdeAbVE= 2024-04-16T18:16:23.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rlm8c6uXG08yhTqFyiSlZdeAbVE=', 'Content-Length': '0'} 2024-04-16T18:16:23.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d414187b967a419-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.393 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:16:23.394 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.394 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.394 DEBUG:boto:Method: GET 2024-04-16T18:16:23.394 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:23.394 DEBUG:boto:Data: 2024-04-16T18:16:23.394 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.394 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.394 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.394 DEBUG:boto:Params: {} 2024-04-16T18:16:23.394 DEBUG:boto:Token: None 2024-04-16T18:16:23.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e 2024-04-16T18:16:23.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SVsW3ZCflodUT/0n44sIQ0Ylv/E= 2024-04-16T18:16:23.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SVsW3ZCflodUT/0n44sIQ0Ylv/E=', 'Content-Length': '0'} 2024-04-16T18:16:23.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc7711a788773322-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.438 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:23.438 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:23.438 DEBUG:boto:Method: GET 2024-04-16T18:16:23.439 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:23.439 DEBUG:boto:Data: 2024-04-16T18:16:23.439 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.439 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.439 DEBUG:boto:Params: {} 2024-04-16T18:16:23.439 DEBUG:boto:Token: None 2024-04-16T18:16:23.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/e 2024-04-16T18:16:23.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SVsW3ZCflodUT/0n44sIQ0Ylv/E= 2024-04-16T18:16:23.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SVsW3ZCflodUT/0n44sIQ0Ylv/E=', 'Content-Length': '0'} 2024-04-16T18:16:23.442 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fd3e7ae22d0acd5-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.442 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.442 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.442 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.442 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.442 DEBUG:boto:Method: GET 2024-04-16T18:16:23.442 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:23.442 DEBUG:boto:Data: 2024-04-16T18:16:23.442 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.443 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.443 DEBUG:boto:Params: {} 2024-04-16T18:16:23.443 DEBUG:boto:Token: None 2024-04-16T18:16:23.443 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.445 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b5348378408aad0-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.486 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.487 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.487 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.487 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.487 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:23.487 DEBUG:boto:Method: GET 2024-04-16T18:16:23.487 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:23.487 DEBUG:boto:Data: 2024-04-16T18:16:23.487 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.487 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.487 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.488 DEBUG:boto:Params: {} 2024-04-16T18:16:23.488 DEBUG:boto:Token: None 2024-04-16T18:16:23.488 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.490 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ae3e07ac1bddfba-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.490 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.491 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:16:23.491 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.491 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.491 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.491 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.491 DEBUG:boto:Method: GET 2024-04-16T18:16:23.491 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.491 DEBUG:boto:Data: 2024-04-16T18:16:23.491 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.492 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.492 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.492 DEBUG:boto:Params: {} 2024-04-16T18:16:23.492 DEBUG:boto:Token: None 2024-04-16T18:16:23.492 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U= 2024-04-16T18:16:23.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U=', 'Content-Length': '0'} 2024-04-16T18:16:23.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000612c40163b977446-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.538 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.538 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.539 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.539 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.539 DEBUG:boto:Method: GET 2024-04-16T18:16:23.539 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.539 DEBUG:boto:Data: 2024-04-16T18:16:23.539 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.539 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.539 DEBUG:boto:Params: {} 2024-04-16T18:16:23.539 DEBUG:boto:Token: None 2024-04-16T18:16:23.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U= 2024-04-16T18:16:23.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U=', 'Content-Length': '0'} 2024-04-16T18:16:23.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000158768508385b080-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.542 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.542 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.542 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.542 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.542 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.542 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.542 DEBUG:boto:Data: 2024-04-16T18:16:23.542 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.542 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.542 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.543 DEBUG:boto:Params: {} 2024-04-16T18:16:23.543 DEBUG:boto:Token: None 2024-04-16T18:16:23.543 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aERxpCa3OQ1RPGK1rx6uX7cnFGo= 2024-04-16T18:16:23.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aERxpCa3OQ1RPGK1rx6uX7cnFGo=', 'Content-Length': '0'} 2024-04-16T18:16:23.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2ffb2233614bf9f-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.545 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.545 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.545 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.545 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.546 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.546 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.546 DEBUG:boto:Data: 2024-04-16T18:16:23.546 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.546 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.546 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.546 DEBUG:boto:Params: {} 2024-04-16T18:16:23.546 DEBUG:boto:Token: None 2024-04-16T18:16:23.546 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.546 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aERxpCa3OQ1RPGK1rx6uX7cnFGo= 2024-04-16T18:16:23.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aERxpCa3OQ1RPGK1rx6uX7cnFGo=', 'Content-Length': '0'} 2024-04-16T18:16:23.548 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c186a9bdd9d6608-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.548 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:16:23.548 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.549 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.549 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.549 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.549 DEBUG:boto:Method: GET 2024-04-16T18:16:23.549 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.549 DEBUG:boto:Data: 2024-04-16T18:16:23.549 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.549 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.549 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.549 DEBUG:boto:Params: {} 2024-04-16T18:16:23.549 DEBUG:boto:Token: None 2024-04-16T18:16:23.550 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.550 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U= 2024-04-16T18:16:23.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U=', 'Content-Length': '0'} 2024-04-16T18:16:23.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001adff5eb5f94f5ca-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.594 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.594 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.595 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.595 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:23.595 DEBUG:boto:Method: GET 2024-04-16T18:16:23.595 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.595 DEBUG:boto:Data: 2024-04-16T18:16:23.595 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.595 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.595 DEBUG:boto:Params: {} 2024-04-16T18:16:23.596 DEBUG:boto:Token: None 2024-04-16T18:16:23.596 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:23.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U= 2024-04-16T18:16:23.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OEesH3a3kcJ3SWhQckIqzfX9d6U=', 'Content-Length': '0'} 2024-04-16T18:16:23.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005592a70647ddf9c0-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.598 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.598 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.598 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.598 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.598 DEBUG:boto:Method: GET 2024-04-16T18:16:23.598 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:23.599 DEBUG:boto:Data: 2024-04-16T18:16:23.599 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.599 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.599 DEBUG:boto:Params: {} 2024-04-16T18:16:23.599 DEBUG:boto:Token: None 2024-04-16T18:16:23.599 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.602 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000146229639f8e37d1-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.642 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.642 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.643 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.643 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.643 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.643 DEBUG:boto:Method: GET 2024-04-16T18:16:23.643 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:23.643 DEBUG:boto:Data: 2024-04-16T18:16:23.643 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.643 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.644 DEBUG:boto:Params: {} 2024-04-16T18:16:23.644 DEBUG:boto:Token: None 2024-04-16T18:16:23.644 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7ab457abc13d6bc-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.646 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.647 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.647 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.647 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.647 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:23.647 DEBUG:boto:Data: 2024-04-16T18:16:23.647 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.647 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.647 DEBUG:boto:Params: {} 2024-04-16T18:16:23.648 DEBUG:boto:Token: None 2024-04-16T18:16:23.648 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f 2024-04-16T18:16:23.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P7DyOTCzRMvsUA8wrwseOsmnqQ0= 2024-04-16T18:16:23.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P7DyOTCzRMvsUA8wrwseOsmnqQ0=', 'Content-Length': '0'} 2024-04-16T18:16:23.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df239e66ba5df425-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.650 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.650 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.650 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.650 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:23.650 DEBUG:boto:Data: 2024-04-16T18:16:23.650 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.651 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.651 DEBUG:boto:Params: {} 2024-04-16T18:16:23.651 DEBUG:boto:Token: None 2024-04-16T18:16:23.651 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f 2024-04-16T18:16:23.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P7DyOTCzRMvsUA8wrwseOsmnqQ0= 2024-04-16T18:16:23.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P7DyOTCzRMvsUA8wrwseOsmnqQ0=', 'Content-Length': '0'} 2024-04-16T18:16:23.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e983953cd56adaa5-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.653 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:16:23.653 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.653 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.654 DEBUG:boto:Method: GET 2024-04-16T18:16:23.654 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:23.654 DEBUG:boto:Data: 2024-04-16T18:16:23.654 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.654 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.654 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.654 DEBUG:boto:Params: {} 2024-04-16T18:16:23.654 DEBUG:boto:Token: None 2024-04-16T18:16:23.654 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f 2024-04-16T18:16:23.654 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6Q1Aa4Wz+xatnmI6r5Lnc5V2OB4= 2024-04-16T18:16:23.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6Q1Aa4Wz+xatnmI6r5Lnc5V2OB4=', 'Content-Length': '0'} 2024-04-16T18:16:23.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059745c5466e35047-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.698 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:23.698 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:23.698 DEBUG:boto:Method: GET 2024-04-16T18:16:23.699 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:23.699 DEBUG:boto:Data: 2024-04-16T18:16:23.699 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.699 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.699 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.699 DEBUG:boto:Params: {} 2024-04-16T18:16:23.699 DEBUG:boto:Token: None 2024-04-16T18:16:23.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/f 2024-04-16T18:16:23.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6Q1Aa4Wz+xatnmI6r5Lnc5V2OB4= 2024-04-16T18:16:23.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6Q1Aa4Wz+xatnmI6r5Lnc5V2OB4=', 'Content-Length': '0'} 2024-04-16T18:16:23.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061658d861ec826e1-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.702 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.702 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.702 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.702 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.702 DEBUG:boto:Method: GET 2024-04-16T18:16:23.702 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:23.702 DEBUG:boto:Data: 2024-04-16T18:16:23.702 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.702 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.702 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.702 DEBUG:boto:Params: {} 2024-04-16T18:16:23.703 DEBUG:boto:Token: None 2024-04-16T18:16:23.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d22c03a1c6985ae6-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.706 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.706 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.706 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.706 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.706 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:23.706 DEBUG:boto:Method: GET 2024-04-16T18:16:23.707 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:23.707 DEBUG:boto:Data: 2024-04-16T18:16:23.707 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.707 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.707 DEBUG:boto:Params: {} 2024-04-16T18:16:23.707 DEBUG:boto:Token: None 2024-04-16T18:16:23.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000441f97a2dbbb48f1-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.710 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.710 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:16:23.710 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.710 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.711 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.711 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.711 DEBUG:boto:Method: GET 2024-04-16T18:16:23.711 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.711 DEBUG:boto:Data: 2024-04-16T18:16:23.711 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.711 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.711 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.711 DEBUG:boto:Params: {} 2024-04-16T18:16:23.711 DEBUG:boto:Token: None 2024-04-16T18:16:23.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA= 2024-04-16T18:16:23.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA=', 'Content-Length': '0'} 2024-04-16T18:16:23.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bee4fc9f5b79759a-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.754 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.754 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.754 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.755 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.755 DEBUG:boto:Method: GET 2024-04-16T18:16:23.755 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.755 DEBUG:boto:Data: 2024-04-16T18:16:23.755 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.755 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.755 DEBUG:boto:Params: {} 2024-04-16T18:16:23.755 DEBUG:boto:Token: None 2024-04-16T18:16:23.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA= 2024-04-16T18:16:23.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA=', 'Content-Length': '0'} 2024-04-16T18:16:23.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf613fe835d39644-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.758 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.758 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.758 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.758 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.758 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.758 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.758 DEBUG:boto:Data: 2024-04-16T18:16:23.758 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.758 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.759 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.759 DEBUG:boto:Params: {} 2024-04-16T18:16:23.759 DEBUG:boto:Token: None 2024-04-16T18:16:23.759 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yh64NSTkDd2jCv/miYtXSwFViBw= 2024-04-16T18:16:23.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yh64NSTkDd2jCv/miYtXSwFViBw=', 'Content-Length': '0'} 2024-04-16T18:16:23.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b649f6b30aa1b0e9-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.761 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.762 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.762 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.762 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.762 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.762 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.762 DEBUG:boto:Data: 2024-04-16T18:16:23.762 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.762 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.762 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.762 DEBUG:boto:Params: {} 2024-04-16T18:16:23.762 DEBUG:boto:Token: None 2024-04-16T18:16:23.763 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yh64NSTkDd2jCv/miYtXSwFViBw= 2024-04-16T18:16:23.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yh64NSTkDd2jCv/miYtXSwFViBw=', 'Content-Length': '0'} 2024-04-16T18:16:23.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fff948748e30a9c-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:16:23.765 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.765 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.765 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.765 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.765 DEBUG:boto:Method: GET 2024-04-16T18:16:23.766 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.766 DEBUG:boto:Data: 2024-04-16T18:16:23.766 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.766 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.766 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.766 DEBUG:boto:Params: {} 2024-04-16T18:16:23.766 DEBUG:boto:Token: None 2024-04-16T18:16:23.766 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA= 2024-04-16T18:16:23.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA=', 'Content-Length': '0'} 2024-04-16T18:16:23.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed769184d0c0e528-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.810 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.810 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.810 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.811 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:23.811 DEBUG:boto:Method: GET 2024-04-16T18:16:23.811 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.811 DEBUG:boto:Data: 2024-04-16T18:16:23.811 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.811 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.811 DEBUG:boto:Params: {} 2024-04-16T18:16:23.811 DEBUG:boto:Token: None 2024-04-16T18:16:23.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:23.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA= 2024-04-16T18:16:23.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YBwZF9Dpl37zuDmJaeDSf8Q55PA=', 'Content-Length': '0'} 2024-04-16T18:16:23.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000739f65a97d1ade56-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.814 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.814 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.814 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.814 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.814 DEBUG:boto:Method: GET 2024-04-16T18:16:23.814 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:23.814 DEBUG:boto:Data: 2024-04-16T18:16:23.815 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.815 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.815 DEBUG:boto:Params: {} 2024-04-16T18:16:23.815 DEBUG:boto:Token: None 2024-04-16T18:16:23.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.817 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c64e4c59e3b73a44-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.818 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.818 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.818 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.818 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.818 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.818 DEBUG:boto:Method: GET 2024-04-16T18:16:23.818 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:23.818 DEBUG:boto:Data: 2024-04-16T18:16:23.819 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.819 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.819 DEBUG:boto:Params: {} 2024-04-16T18:16:23.819 DEBUG:boto:Token: None 2024-04-16T18:16:23.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.822 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015a13b85c2111e92-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.822 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.822 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.822 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.822 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.823 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:23.823 DEBUG:boto:Data: 2024-04-16T18:16:23.823 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.823 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.823 DEBUG:boto:Params: {} 2024-04-16T18:16:23.823 DEBUG:boto:Token: None 2024-04-16T18:16:23.823 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g 2024-04-16T18:16:23.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wRFOal8Y+S2avkPWFWJ/stIfr2o= 2024-04-16T18:16:23.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wRFOal8Y+S2avkPWFWJ/stIfr2o=', 'Content-Length': '0'} 2024-04-16T18:16:23.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fc08c5f757e36cb-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.826 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.826 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.826 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.826 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:23.826 DEBUG:boto:Data: 2024-04-16T18:16:23.826 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.826 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.826 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.826 DEBUG:boto:Params: {} 2024-04-16T18:16:23.826 DEBUG:boto:Token: None 2024-04-16T18:16:23.827 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g 2024-04-16T18:16:23.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wRFOal8Y+S2avkPWFWJ/stIfr2o= 2024-04-16T18:16:23.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wRFOal8Y+S2avkPWFWJ/stIfr2o=', 'Content-Length': '0'} 2024-04-16T18:16:23.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060eab2139cf91fca-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:16:23.829 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.829 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.829 DEBUG:boto:Method: GET 2024-04-16T18:16:23.829 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:23.829 DEBUG:boto:Data: 2024-04-16T18:16:23.829 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.829 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.829 DEBUG:boto:Params: {} 2024-04-16T18:16:23.829 DEBUG:boto:Token: None 2024-04-16T18:16:23.830 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g 2024-04-16T18:16:23.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JuaL2wYRFKCwCEvMcQUrYKuVs/g= 2024-04-16T18:16:23.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JuaL2wYRFKCwCEvMcQUrYKuVs/g=', 'Content-Length': '0'} 2024-04-16T18:16:23.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0821f4d3ba4c935-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.874 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:23.874 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:23.875 DEBUG:boto:Method: GET 2024-04-16T18:16:23.875 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:23.875 DEBUG:boto:Data: 2024-04-16T18:16:23.875 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.875 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.875 DEBUG:boto:Params: {} 2024-04-16T18:16:23.875 DEBUG:boto:Token: None 2024-04-16T18:16:23.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/g 2024-04-16T18:16:23.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JuaL2wYRFKCwCEvMcQUrYKuVs/g= 2024-04-16T18:16:23.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JuaL2wYRFKCwCEvMcQUrYKuVs/g=', 'Content-Length': '0'} 2024-04-16T18:16:23.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093ec87d04be1570b-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.878 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.878 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.878 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.878 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.879 DEBUG:boto:Method: GET 2024-04-16T18:16:23.879 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:23.879 DEBUG:boto:Data: 2024-04-16T18:16:23.879 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.879 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.879 DEBUG:boto:Params: {} 2024-04-16T18:16:23.879 DEBUG:boto:Token: None 2024-04-16T18:16:23.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a5769df607214205-00661ec077-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.882 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.882 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.882 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.883 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.883 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:23.883 DEBUG:boto:Method: GET 2024-04-16T18:16:23.883 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:23.883 DEBUG:boto:Data: 2024-04-16T18:16:23.883 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.883 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.883 DEBUG:boto:Params: {} 2024-04-16T18:16:23.883 DEBUG:boto:Token: None 2024-04-16T18:16:23.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:23.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f865c2c5e03d989-00661ec077-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.886 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:23.887 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:16:23.887 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:23.887 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:23.887 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.887 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.887 DEBUG:boto:Method: GET 2024-04-16T18:16:23.887 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.887 DEBUG:boto:Data: 2024-04-16T18:16:23.887 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.887 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.887 DEBUG:boto:Params: {} 2024-04-16T18:16:23.888 DEBUG:boto:Token: None 2024-04-16T18:16:23.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg= 2024-04-16T18:16:23.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg=', 'Content-Length': '0'} 2024-04-16T18:16:23.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ee7f0839f1f7382-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.934 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:23.935 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:23.935 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.935 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.935 DEBUG:boto:Method: GET 2024-04-16T18:16:23.935 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.935 DEBUG:boto:Data: 2024-04-16T18:16:23.935 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.935 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.935 DEBUG:boto:Params: {} 2024-04-16T18:16:23.935 DEBUG:boto:Token: None 2024-04-16T18:16:23.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg= 2024-04-16T18:16:23.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg=', 'Content-Length': '0'} 2024-04-16T18:16:23.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c11c6ec3dee96594-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.938 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:23.938 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:23.938 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.938 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.938 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.939 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.939 DEBUG:boto:Data: 2024-04-16T18:16:23.939 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.939 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.939 DEBUG:boto:Params: {} 2024-04-16T18:16:23.939 DEBUG:boto:Token: None 2024-04-16T18:16:23.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hTC42aAeH7fdKoANReUSm3JiErw= 2024-04-16T18:16:23.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hTC42aAeH7fdKoANReUSm3JiErw=', 'Content-Length': '0'} 2024-04-16T18:16:23.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000059a488511b54cd7-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.942 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:23.942 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:23.942 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.942 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.942 DEBUG:boto:Method: HEAD 2024-04-16T18:16:23.942 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.942 DEBUG:boto:Data: 2024-04-16T18:16:23.942 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.943 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.943 DEBUG:boto:Params: {} 2024-04-16T18:16:23.943 DEBUG:boto:Token: None 2024-04-16T18:16:23.943 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.945 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hTC42aAeH7fdKoANReUSm3JiErw= 2024-04-16T18:16:23.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hTC42aAeH7fdKoANReUSm3JiErw=', 'Content-Length': '0'} 2024-04-16T18:16:23.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a7534963fcbaacc-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:16:23.947 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:23.947 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:23.947 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.947 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.948 DEBUG:boto:Method: GET 2024-04-16T18:16:23.948 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.948 DEBUG:boto:Data: 2024-04-16T18:16:23.948 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.948 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.948 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.948 DEBUG:boto:Params: {} 2024-04-16T18:16:23.948 DEBUG:boto:Token: None 2024-04-16T18:16:23.948 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg= 2024-04-16T18:16:23.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg=', 'Content-Length': '0'} 2024-04-16T18:16:23.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000853919663a82ddad-00661ec077-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.994 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:23.994 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:23.994 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.995 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:23.995 DEBUG:boto:Method: GET 2024-04-16T18:16:23.995 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.995 DEBUG:boto:Data: 2024-04-16T18:16:23.995 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:23.995 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.995 DEBUG:boto:Params: {} 2024-04-16T18:16:23.995 DEBUG:boto:Token: None 2024-04-16T18:16:23.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:23.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg= 2024-04-16T18:16:23.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CglSLVvhteCFWzEjr/L0O3nQ0Wg=', 'Content-Length': '0'} 2024-04-16T18:16:23.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c046ecbd5fa87b58-00661ec077-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:23.998 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:23.998 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:23.998 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:23.998 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:23.998 DEBUG:boto:Method: GET 2024-04-16T18:16:23.998 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:23.999 DEBUG:boto:Data: 2024-04-16T18:16:23.999 DEBUG:boto:Headers: {} 2024-04-16T18:16:23.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:23.999 DEBUG:boto:Port: 8000 2024-04-16T18:16:23.999 DEBUG:boto:Params: {} 2024-04-16T18:16:23.999 DEBUG:boto:Token: None 2024-04-16T18:16:23.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:23 GMT /cjqttm-50/ 2024-04-16T18:16:23.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc= 2024-04-16T18:16:23.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RvAneg17X/cC1JCvQDk0TLXRyMc=', 'Content-Length': '0'} 2024-04-16T18:16:24.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a53d1c56092ce98a-00661ec078-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.002 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:24.002 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:24.002 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:24.003 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:24.003 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:24.003 DEBUG:boto:Method: GET 2024-04-16T18:16:24.003 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:24.003 DEBUG:boto:Data: 2024-04-16T18:16:24.003 DEBUG:boto:Headers: {} 2024-04-16T18:16:24.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:24.003 DEBUG:boto:Port: 8000 2024-04-16T18:16:24.003 DEBUG:boto:Params: {} 2024-04-16T18:16:24.003 DEBUG:boto:Token: None 2024-04-16T18:16:24.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:24 GMT /cjqttm-50/ 2024-04-16T18:16:24.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tW0BjpqAdsFCK6yQeD36aVnypxw= 2024-04-16T18:16:24.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tW0BjpqAdsFCK6yQeD36aVnypxw=', 'Content-Length': '0'} 2024-04-16T18:16:24.006 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006006cffa3e66b701-00661ec078-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.006 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:24.006 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:24.006 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:24.007 DEBUG:boto:Method: HEAD 2024-04-16T18:16:24.007 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:24.007 DEBUG:boto:Data: 2024-04-16T18:16:24.007 DEBUG:boto:Headers: {} 2024-04-16T18:16:24.007 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:24.007 DEBUG:boto:Port: 8000 2024-04-16T18:16:24.007 DEBUG:boto:Params: {} 2024-04-16T18:16:24.007 DEBUG:boto:Token: None 2024-04-16T18:16:24.007 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:24 GMT /cjqttm-50/h 2024-04-16T18:16:24.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B95dJzcMmn/4hlRuT8S6H+uOnoE= 2024-04-16T18:16:24.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B95dJzcMmn/4hlRuT8S6H+uOnoE=', 'Content-Length': '0'} 2024-04-16T18:16:24.010 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a38aeece5e5f267c-00661ec078-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.010 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:24.010 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:24.010 DEBUG:boto:Method: HEAD 2024-04-16T18:16:24.010 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:24.010 DEBUG:boto:Data: 2024-04-16T18:16:24.010 DEBUG:boto:Headers: {} 2024-04-16T18:16:24.010 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:24.010 DEBUG:boto:Port: 8000 2024-04-16T18:16:24.010 DEBUG:boto:Params: {} 2024-04-16T18:16:24.011 DEBUG:boto:Token: None 2024-04-16T18:16:24.011 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:24 GMT /cjqttm-50/h 2024-04-16T18:16:24.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B95dJzcMmn/4hlRuT8S6H+uOnoE= 2024-04-16T18:16:24.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B95dJzcMmn/4hlRuT8S6H+uOnoE=', 'Content-Length': '0'} 2024-04-16T18:16:24.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005da0c8625705ba9b-00661ec078-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.013 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:16:24.013 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:24.013 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:24.013 DEBUG:boto:Method: GET 2024-04-16T18:16:24.013 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:24.013 DEBUG:boto:Data: 2024-04-16T18:16:24.014 DEBUG:boto:Headers: {} 2024-04-16T18:16:24.014 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:24.014 DEBUG:boto:Port: 8000 2024-04-16T18:16:24.014 DEBUG:boto:Params: {} 2024-04-16T18:16:24.014 DEBUG:boto:Token: None 2024-04-16T18:16:24.014 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:24 GMT /cjqttm-50/h 2024-04-16T18:16:24.014 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qM2ZUfQ2FTyL5Zb03UbHd0fND90= 2024-04-16T18:16:24.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qM2ZUfQ2FTyL5Zb03UbHd0fND90=', 'Content-Length': '0'} 2024-04-16T18:16:24.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061f220fe36e13021-00661ec078-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.058 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:24.058 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:24.059 DEBUG:boto:Method: GET 2024-04-16T18:16:24.059 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:24.059 DEBUG:boto:Data: 2024-04-16T18:16:24.059 DEBUG:boto:Headers: {} 2024-04-16T18:16:24.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:24.059 DEBUG:boto:Port: 8000 2024-04-16T18:16:24.059 DEBUG:boto:Params: {} 2024-04-16T18:16:24.059 DEBUG:boto:Token: None 2024-04-16T18:16:24.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:24 GMT /cjqttm-50/h 2024-04-16T18:16:24.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qM2ZUfQ2FTyL5Zb03UbHd0fND90= 2024-04-16T18:16:24.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qM2ZUfQ2FTyL5Zb03UbHd0fND90=', 'Content-Length': '0'} 2024-04-16T18:16:24.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ed9a141a86d7250-00661ec078-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.062 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:24.062 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:24.062 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:24.062 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:24.062 DEBUG:boto:Method: GET 2024-04-16T18:16:24.062 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:24.062 DEBUG:boto:Data: 2024-04-16T18:16:24.062 DEBUG:boto:Headers: {} 2024-04-16T18:16:24.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:24.063 DEBUG:boto:Port: 8000 2024-04-16T18:16:24.063 DEBUG:boto:Params: {} 2024-04-16T18:16:24.063 DEBUG:boto:Token: None 2024-04-16T18:16:24.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:24 GMT /cjqttm-50/ 2024-04-16T18:16:24.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tW0BjpqAdsFCK6yQeD36aVnypxw= 2024-04-16T18:16:24.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tW0BjpqAdsFCK6yQeD36aVnypxw=', 'Content-Length': '0'} 2024-04-16T18:16:24.066 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afecc15f816685bf-00661ec078-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.066 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:24.066 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:24.067 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:24.067 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:24.067 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:24.067 DEBUG:boto:Method: GET 2024-04-16T18:16:24.067 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:24.067 DEBUG:boto:Data: 2024-04-16T18:16:24.067 DEBUG:boto:Headers: {} 2024-04-16T18:16:24.067 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:24.067 DEBUG:boto:Port: 8000 2024-04-16T18:16:24.067 DEBUG:boto:Params: {} 2024-04-16T18:16:24.067 DEBUG:boto:Token: None 2024-04-16T18:16:24.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:24 GMT /cjqttm-50/ 2024-04-16T18:16:24.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tW0BjpqAdsFCK6yQeD36aVnypxw= 2024-04-16T18:16:24.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tW0BjpqAdsFCK6yQeD36aVnypxw=', 'Content-Length': '0'} 2024-04-16T18:16:24.070 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dafa1d904970ee5f-00661ec078-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:24.070 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:24.071 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:16:24.071 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--bucket', 'cjqttm-50', '--num-shards', '15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:24.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--bucket', 'cjqttm-50', '--num-shards', '15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:24.071 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --bucket cjqttm-50 --num-shards 15 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:16:24.125 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:24.126 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:24.196 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:16:24.196 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-50 2024-04-16T18:16:24.202 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 8 2024-04-16T18:16:24.258 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:24.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:24.258 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket cjqttm-50 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:16:24.303 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:24.303 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:24.375 INFO:teuthology.orchestra.run.smithi016.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":15,"hash_type":"Mod"}}},"logs":[{"gen":0,"layout":{"type":"InIndex","in_index":{"gen":0,"layout":{"num_shards":11,"hash_type":"Mod"}}}},{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":13,"hash_type":"Mod"}}}},{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":15,"hash_type":"Mod"}}}}]}} 2024-04-16T18:16:24.376 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-50 2024-04-16T18:16:24.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:24.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:24.376 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:16:24.439 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:24.439 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:24.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:24.501+0000 7f0732839800 1 waiting to reach latest gen 2, on 1.. 2024-04-16T18:16:29.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:29.502+0000 7f0732839800 1 bucket sync caught up with empty source 2024-04-16T18:16:29.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:29.502+0000 7f0732839800 0 bucket checkpoint complete 2024-04-16T18:16:29.529 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-50 2024-04-16T18:16:29.529 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:29.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:29.530 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:16:29.591 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:29.591 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:29.656+0000 7fab13d30800 1 bucket sync caught up with source: 2024-04-16T18:16:29.656 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:29.656 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.247.6, , , 00000000001.336.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:16:29.656 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:16:29.656+0000 7fab13d30800 0 bucket checkpoint complete 2024-04-16T18:16:29.678 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:16:29.679 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.679 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.679 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.679 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:29.679 DEBUG:boto:Data: 2024-04-16T18:16:29.679 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.679 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.679 DEBUG:boto:Params: {} 2024-04-16T18:16:29.680 DEBUG:boto:Token: None 2024-04-16T18:16:29.680 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rGFMTnOr3+QOcH1bH9SOfughLZo= 2024-04-16T18:16:29.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rGFMTnOr3+QOcH1bH9SOfughLZo=', 'Content-Length': '0'} 2024-04-16T18:16:29.683 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000b32e57c482516fa-00661ec07d-5447-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.683 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.683 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.683 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.683 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:29.683 DEBUG:boto:Data: 2024-04-16T18:16:29.683 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.683 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.684 DEBUG:boto:Params: {} 2024-04-16T18:16:29.684 DEBUG:boto:Token: None 2024-04-16T18:16:29.684 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rGFMTnOr3+QOcH1bH9SOfughLZo= 2024-04-16T18:16:29.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rGFMTnOr3+QOcH1bH9SOfughLZo=', 'Content-Length': '0'} 2024-04-16T18:16:29.687 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002cba8cbd63f25874-00661ec07d-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.687 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:16:29.687 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.687 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.687 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.687 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.687 DEBUG:boto:Method: GET 2024-04-16T18:16:29.687 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.687 DEBUG:boto:Data: 2024-04-16T18:16:29.687 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.688 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.688 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.688 DEBUG:boto:Params: {} 2024-04-16T18:16:29.688 DEBUG:boto:Token: None 2024-04-16T18:16:29.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/?versions 2024-04-16T18:16:29.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw= 2024-04-16T18:16:29.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw=', 'Content-Length': '0'} 2024-04-16T18:16:29.691 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0af7b3a9ecbf4f4-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.691 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:16:29.692 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:16:29.693 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.693 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.693 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.693 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.693 DEBUG:boto:Method: GET 2024-04-16T18:16:29.693 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.693 DEBUG:boto:Data: 2024-04-16T18:16:29.693 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.693 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.693 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.693 DEBUG:boto:Params: {} 2024-04-16T18:16:29.694 DEBUG:boto:Token: None 2024-04-16T18:16:29.694 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/?versions 2024-04-16T18:16:29.694 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw= 2024-04-16T18:16:29.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw=', 'Content-Length': '0'} 2024-04-16T18:16:29.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eec570ba8dc5cc76-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.697 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.697 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:16:29.697 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:16:29.698 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:16:29.698 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:16:29.698 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:16:29.698 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:16:29.698 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:16:29.698 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:16:29.698 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.698 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.698 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.698 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.698 DEBUG:boto:Method: GET 2024-04-16T18:16:29.699 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.699 DEBUG:boto:Data: 2024-04-16T18:16:29.699 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.699 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.699 DEBUG:boto:Params: {} 2024-04-16T18:16:29.699 DEBUG:boto:Token: None 2024-04-16T18:16:29.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/?versions 2024-04-16T18:16:29.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw= 2024-04-16T18:16:29.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw=', 'Content-Length': '0'} 2024-04-16T18:16:29.703 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000424ce2a88239daf-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.703 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.704 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.704 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.704 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.704 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.704 DEBUG:boto:Method: GET 2024-04-16T18:16:29.704 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:16:29.704 DEBUG:boto:Data: 2024-04-16T18:16:29.704 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.704 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.704 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.705 DEBUG:boto:Params: {} 2024-04-16T18:16:29.705 DEBUG:boto:Token: None 2024-04-16T18:16:29.705 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/?versions 2024-04-16T18:16:29.705 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw= 2024-04-16T18:16:29.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m+VH9ClFC3Ba5duyUysbsfpKKdw=', 'Content-Length': '0'} 2024-04-16T18:16:29.707 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e92ab1033eef752b-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.708 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:16:29.708 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.708 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.708 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.708 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.709 DEBUG:boto:Method: GET 2024-04-16T18:16:29.709 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.709 DEBUG:boto:Data: 2024-04-16T18:16:29.709 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.709 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.709 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.709 DEBUG:boto:Params: {} 2024-04-16T18:16:29.709 DEBUG:boto:Token: None 2024-04-16T18:16:29.709 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.710 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU= 2024-04-16T18:16:29.710 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU=', 'Content-Length': '0'} 2024-04-16T18:16:29.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039241697fbff0dd8-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.754 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.754 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.754 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.755 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.755 DEBUG:boto:Method: GET 2024-04-16T18:16:29.755 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.755 DEBUG:boto:Data: 2024-04-16T18:16:29.755 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.755 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.755 DEBUG:boto:Params: {} 2024-04-16T18:16:29.755 DEBUG:boto:Token: None 2024-04-16T18:16:29.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU= 2024-04-16T18:16:29.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU=', 'Content-Length': '0'} 2024-04-16T18:16:29.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032556b9342be4a10-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.758 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.758 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.758 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.758 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.758 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.758 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.758 DEBUG:boto:Data: 2024-04-16T18:16:29.758 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.758 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.759 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.759 DEBUG:boto:Params: {} 2024-04-16T18:16:29.759 DEBUG:boto:Token: None 2024-04-16T18:16:29.759 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C3UF9zAU9U3GPYvGgi1aReN59E0= 2024-04-16T18:16:29.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C3UF9zAU9U3GPYvGgi1aReN59E0=', 'Content-Length': '0'} 2024-04-16T18:16:29.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8031901c6b40a84-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.761 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.761 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.761 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.761 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.762 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.762 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.762 DEBUG:boto:Data: 2024-04-16T18:16:29.762 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.762 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.762 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.762 DEBUG:boto:Params: {} 2024-04-16T18:16:29.762 DEBUG:boto:Token: None 2024-04-16T18:16:29.762 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C3UF9zAU9U3GPYvGgi1aReN59E0= 2024-04-16T18:16:29.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C3UF9zAU9U3GPYvGgi1aReN59E0=', 'Content-Length': '0'} 2024-04-16T18:16:29.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056d545183c02e23f-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.764 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:16:29.765 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.765 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.765 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.765 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.765 DEBUG:boto:Method: GET 2024-04-16T18:16:29.765 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.765 DEBUG:boto:Data: 2024-04-16T18:16:29.765 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.765 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.765 DEBUG:boto:Params: {} 2024-04-16T18:16:29.765 DEBUG:boto:Token: None 2024-04-16T18:16:29.766 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU= 2024-04-16T18:16:29.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU=', 'Content-Length': '0'} 2024-04-16T18:16:29.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cffb8a5dd6a0a08-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.768 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.768 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.768 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.768 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:16:29.768 DEBUG:boto:Method: GET 2024-04-16T18:16:29.768 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.768 DEBUG:boto:Data: 2024-04-16T18:16:29.769 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.769 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.769 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.769 DEBUG:boto:Params: {} 2024-04-16T18:16:29.769 DEBUG:boto:Token: None 2024-04-16T18:16:29.769 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:16:29.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU= 2024-04-16T18:16:29.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqZ0sBtmwKqtB/8Eum0M9xE3ufU=', 'Content-Length': '0'} 2024-04-16T18:16:29.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d6ca6cffac704bb-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.771 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.771 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.771 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.771 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.771 DEBUG:boto:Method: GET 2024-04-16T18:16:29.772 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:29.772 DEBUG:boto:Data: 2024-04-16T18:16:29.772 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.772 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.772 DEBUG:boto:Params: {} 2024-04-16T18:16:29.772 DEBUG:boto:Token: None 2024-04-16T18:16:29.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU= 2024-04-16T18:16:29.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU=', 'Content-Length': '0'} 2024-04-16T18:16:29.775 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f8e6a4e7f9123481-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.775 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.775 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.775 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.775 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.775 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.776 DEBUG:boto:Method: GET 2024-04-16T18:16:29.776 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:29.776 DEBUG:boto:Data: 2024-04-16T18:16:29.776 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.776 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.776 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.776 DEBUG:boto:Params: {} 2024-04-16T18:16:29.776 DEBUG:boto:Token: None 2024-04-16T18:16:29.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU= 2024-04-16T18:16:29.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU=', 'Content-Length': '0'} 2024-04-16T18:16:29.779 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004bab2276721bac5-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.822 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.823 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.823 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.823 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.823 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:29.823 DEBUG:boto:Data: 2024-04-16T18:16:29.823 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.823 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.823 DEBUG:boto:Params: {} 2024-04-16T18:16:29.823 DEBUG:boto:Token: None 2024-04-16T18:16:29.823 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a 2024-04-16T18:16:29.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ywnP/ZEs5PKIrWgl1sw3/rJLS9E= 2024-04-16T18:16:29.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ywnP/ZEs5PKIrWgl1sw3/rJLS9E=', 'Content-Length': '0'} 2024-04-16T18:16:29.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090555d84e78a7709-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.826 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.826 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.826 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.826 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:29.826 DEBUG:boto:Data: 2024-04-16T18:16:29.826 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.826 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.826 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.826 DEBUG:boto:Params: {} 2024-04-16T18:16:29.827 DEBUG:boto:Token: None 2024-04-16T18:16:29.827 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a 2024-04-16T18:16:29.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ywnP/ZEs5PKIrWgl1sw3/rJLS9E= 2024-04-16T18:16:29.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ywnP/ZEs5PKIrWgl1sw3/rJLS9E=', 'Content-Length': '0'} 2024-04-16T18:16:29.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4c9aa7fb48e33c1-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.829 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:16:29.829 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.829 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.829 DEBUG:boto:Method: GET 2024-04-16T18:16:29.829 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:29.829 DEBUG:boto:Data: 2024-04-16T18:16:29.829 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.829 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.829 DEBUG:boto:Params: {} 2024-04-16T18:16:29.829 DEBUG:boto:Token: None 2024-04-16T18:16:29.830 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a 2024-04-16T18:16:29.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:axfVmdtXwUP7BfoMi6793wdflBg= 2024-04-16T18:16:29.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:axfVmdtXwUP7BfoMi6793wdflBg=', 'Content-Length': '0'} 2024-04-16T18:16:29.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080077ff458a72765-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.874 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:16:29.874 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:16:29.875 DEBUG:boto:Method: GET 2024-04-16T18:16:29.875 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:16:29.875 DEBUG:boto:Data: 2024-04-16T18:16:29.875 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.875 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.875 DEBUG:boto:Params: {} 2024-04-16T18:16:29.875 DEBUG:boto:Token: None 2024-04-16T18:16:29.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/a 2024-04-16T18:16:29.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:axfVmdtXwUP7BfoMi6793wdflBg= 2024-04-16T18:16:29.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:axfVmdtXwUP7BfoMi6793wdflBg=', 'Content-Length': '0'} 2024-04-16T18:16:29.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002913bc54f9149d00-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.878 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.878 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.878 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.878 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.878 DEBUG:boto:Method: GET 2024-04-16T18:16:29.878 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:29.878 DEBUG:boto:Data: 2024-04-16T18:16:29.878 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.878 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.878 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.878 DEBUG:boto:Params: {} 2024-04-16T18:16:29.878 DEBUG:boto:Token: None 2024-04-16T18:16:29.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU= 2024-04-16T18:16:29.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU=', 'Content-Length': '0'} 2024-04-16T18:16:29.881 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e2ced67167ab226-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.882 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.882 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.882 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.882 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.882 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:16:29.882 DEBUG:boto:Method: GET 2024-04-16T18:16:29.882 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:16:29.882 DEBUG:boto:Data: 2024-04-16T18:16:29.883 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.883 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.883 DEBUG:boto:Params: {} 2024-04-16T18:16:29.883 DEBUG:boto:Token: None 2024-04-16T18:16:29.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU= 2024-04-16T18:16:29.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU=', 'Content-Length': '0'} 2024-04-16T18:16:29.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7b1b69e89d5b585-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.886 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.886 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:16:29.886 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:29.886 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:29.886 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.886 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.886 DEBUG:boto:Method: GET 2024-04-16T18:16:29.886 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.887 DEBUG:boto:Data: 2024-04-16T18:16:29.887 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.887 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.887 DEBUG:boto:Params: {} 2024-04-16T18:16:29.887 DEBUG:boto:Token: None 2024-04-16T18:16:29.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk= 2024-04-16T18:16:29.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk=', 'Content-Length': '0'} 2024-04-16T18:16:29.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b93a4b865f95af3-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.930 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:29.930 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:29.931 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.931 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.931 DEBUG:boto:Method: GET 2024-04-16T18:16:29.931 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.931 DEBUG:boto:Data: 2024-04-16T18:16:29.931 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.931 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.931 DEBUG:boto:Params: {} 2024-04-16T18:16:29.931 DEBUG:boto:Token: None 2024-04-16T18:16:29.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk= 2024-04-16T18:16:29.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk=', 'Content-Length': '0'} 2024-04-16T18:16:29.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd470cb2120cd908-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.934 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:29.934 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:29.934 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.934 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.934 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.934 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.934 DEBUG:boto:Data: 2024-04-16T18:16:29.934 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.934 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.935 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.935 DEBUG:boto:Params: {} 2024-04-16T18:16:29.935 DEBUG:boto:Token: None 2024-04-16T18:16:29.935 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w+6cgkN7MhNeQEfk6E2KBASePUo= 2024-04-16T18:16:29.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w+6cgkN7MhNeQEfk6E2KBASePUo=', 'Content-Length': '0'} 2024-04-16T18:16:29.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000728567d2deb2b9b4-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.937 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:29.938 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:29.938 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.938 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.938 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.938 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.938 DEBUG:boto:Data: 2024-04-16T18:16:29.938 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.938 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.938 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.939 DEBUG:boto:Params: {} 2024-04-16T18:16:29.939 DEBUG:boto:Token: None 2024-04-16T18:16:29.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w+6cgkN7MhNeQEfk6E2KBASePUo= 2024-04-16T18:16:29.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w+6cgkN7MhNeQEfk6E2KBASePUo=', 'Content-Length': '0'} 2024-04-16T18:16:29.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac56b2c1ae8b6e65-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.941 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:16:29.941 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:29.941 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:29.941 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.941 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.941 DEBUG:boto:Method: GET 2024-04-16T18:16:29.942 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.942 DEBUG:boto:Data: 2024-04-16T18:16:29.942 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.942 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.942 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.942 DEBUG:boto:Params: {} 2024-04-16T18:16:29.942 DEBUG:boto:Token: None 2024-04-16T18:16:29.942 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.942 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk= 2024-04-16T18:16:29.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk=', 'Content-Length': '0'} 2024-04-16T18:16:29.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006a677319b1d1147-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.986 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:29.987 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:29.987 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.987 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:16:29.987 DEBUG:boto:Method: GET 2024-04-16T18:16:29.987 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.987 DEBUG:boto:Data: 2024-04-16T18:16:29.987 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.987 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.987 DEBUG:boto:Params: {} 2024-04-16T18:16:29.988 DEBUG:boto:Token: None 2024-04-16T18:16:29.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:16:29.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk= 2024-04-16T18:16:29.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t+BhCM99CHYl6pn4NGaxyljevKk=', 'Content-Length': '0'} 2024-04-16T18:16:29.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b86fa52a71e49e2-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.991 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.991 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.991 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:29.991 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:29.991 DEBUG:boto:Method: GET 2024-04-16T18:16:29.991 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:29.991 DEBUG:boto:Data: 2024-04-16T18:16:29.991 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.992 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.992 DEBUG:boto:Params: {} 2024-04-16T18:16:29.992 DEBUG:boto:Token: None 2024-04-16T18:16:29.992 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU= 2024-04-16T18:16:29.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU=', 'Content-Length': '0'} 2024-04-16T18:16:29.994 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000976f8e6fdc24e340-00661ec07d-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.994 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.995 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:29.995 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:29.995 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:29.995 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:29.995 DEBUG:boto:Method: GET 2024-04-16T18:16:29.995 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:29.995 DEBUG:boto:Data: 2024-04-16T18:16:29.995 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:29.995 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.996 DEBUG:boto:Params: {} 2024-04-16T18:16:29.996 DEBUG:boto:Token: None 2024-04-16T18:16:29.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:29 GMT /cjqttm-50/ 2024-04-16T18:16:29.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU= 2024-04-16T18:16:29.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:29 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G48L2hll3d1sawLmpnHL3beoYvU=', 'Content-Length': '0'} 2024-04-16T18:16:29.998 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f91589b205ba1e4-00661ec07d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:29 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:29.998 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:29.999 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:29.999 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:29.999 DEBUG:boto:Method: HEAD 2024-04-16T18:16:29.999 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:29.999 DEBUG:boto:Data: 2024-04-16T18:16:29.999 DEBUG:boto:Headers: {} 2024-04-16T18:16:29.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:29.999 DEBUG:boto:Port: 8000 2024-04-16T18:16:29.999 DEBUG:boto:Params: {} 2024-04-16T18:16:30.000 DEBUG:boto:Token: None 2024-04-16T18:16:30.000 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/b 2024-04-16T18:16:30.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nymUOTnBIj5IjyrGkrb0+Grv9/s= 2024-04-16T18:16:30.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nymUOTnBIj5IjyrGkrb0+Grv9/s=', 'Content-Length': '0'} 2024-04-16T18:16:30.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a38b4d838ef7d0a-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.003 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:30.003 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:30.003 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.003 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:30.003 DEBUG:boto:Data: 2024-04-16T18:16:30.003 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.003 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.003 DEBUG:boto:Params: {} 2024-04-16T18:16:30.003 DEBUG:boto:Token: None 2024-04-16T18:16:30.003 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/b 2024-04-16T18:16:30.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nymUOTnBIj5IjyrGkrb0+Grv9/s= 2024-04-16T18:16:30.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nymUOTnBIj5IjyrGkrb0+Grv9/s=', 'Content-Length': '0'} 2024-04-16T18:16:30.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fffef2a575e9651-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.006 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:16:30.006 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:30.006 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:30.006 DEBUG:boto:Method: GET 2024-04-16T18:16:30.006 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:30.006 DEBUG:boto:Data: 2024-04-16T18:16:30.006 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.006 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.006 DEBUG:boto:Params: {} 2024-04-16T18:16:30.007 DEBUG:boto:Token: None 2024-04-16T18:16:30.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/b 2024-04-16T18:16:30.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eVZ4UqJPCpYjFSCNaKaR47M/Z6g= 2024-04-16T18:16:30.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eVZ4UqJPCpYjFSCNaKaR47M/Z6g=', 'Content-Length': '0'} 2024-04-16T18:16:30.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb3b5b49fee31539-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.050 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:16:30.050 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:16:30.051 DEBUG:boto:Method: GET 2024-04-16T18:16:30.051 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:16:30.051 DEBUG:boto:Data: 2024-04-16T18:16:30.051 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.051 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.051 DEBUG:boto:Params: {} 2024-04-16T18:16:30.051 DEBUG:boto:Token: None 2024-04-16T18:16:30.051 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/b 2024-04-16T18:16:30.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eVZ4UqJPCpYjFSCNaKaR47M/Z6g= 2024-04-16T18:16:30.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eVZ4UqJPCpYjFSCNaKaR47M/Z6g=', 'Content-Length': '0'} 2024-04-16T18:16:30.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003b640c4d5d38bc1-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.054 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.054 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.054 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:30.054 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:30.054 DEBUG:boto:Method: GET 2024-04-16T18:16:30.055 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:30.055 DEBUG:boto:Data: 2024-04-16T18:16:30.055 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.055 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.055 DEBUG:boto:Params: {} 2024-04-16T18:16:30.055 DEBUG:boto:Token: None 2024-04-16T18:16:30.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.058 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000410b75ecaaa9652d-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.098 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.099 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.099 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.099 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:16:30.099 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:16:30.099 DEBUG:boto:Method: GET 2024-04-16T18:16:30.099 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:16:30.099 DEBUG:boto:Data: 2024-04-16T18:16:30.099 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.099 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.099 DEBUG:boto:Params: {} 2024-04-16T18:16:30.100 DEBUG:boto:Token: None 2024-04-16T18:16:30.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3b285a4cc00d635-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.102 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.103 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:16:30.103 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.103 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.103 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.103 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.103 DEBUG:boto:Method: GET 2024-04-16T18:16:30.103 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.103 DEBUG:boto:Data: 2024-04-16T18:16:30.103 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.104 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.104 DEBUG:boto:Params: {} 2024-04-16T18:16:30.104 DEBUG:boto:Token: None 2024-04-16T18:16:30.104 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0= 2024-04-16T18:16:30.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0=', 'Content-Length': '0'} 2024-04-16T18:16:30.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004607a69a287a522-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.146 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.146 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.147 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.147 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.147 DEBUG:boto:Method: GET 2024-04-16T18:16:30.147 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.147 DEBUG:boto:Data: 2024-04-16T18:16:30.147 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.147 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.147 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.147 DEBUG:boto:Params: {} 2024-04-16T18:16:30.147 DEBUG:boto:Token: None 2024-04-16T18:16:30.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0= 2024-04-16T18:16:30.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0=', 'Content-Length': '0'} 2024-04-16T18:16:30.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f7969daba4512d5-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.150 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.150 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.150 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.150 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.150 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.150 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.150 DEBUG:boto:Data: 2024-04-16T18:16:30.150 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.150 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.151 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.151 DEBUG:boto:Params: {} 2024-04-16T18:16:30.151 DEBUG:boto:Token: None 2024-04-16T18:16:30.151 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N3/c2EfhL4tdmM3+Pf0PssK0RVQ= 2024-04-16T18:16:30.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N3/c2EfhL4tdmM3+Pf0PssK0RVQ=', 'Content-Length': '0'} 2024-04-16T18:16:30.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020e724abca95011e-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.153 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.153 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.153 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.153 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.153 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.153 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.154 DEBUG:boto:Data: 2024-04-16T18:16:30.154 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.154 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.154 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.154 DEBUG:boto:Params: {} 2024-04-16T18:16:30.154 DEBUG:boto:Token: None 2024-04-16T18:16:30.154 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.154 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N3/c2EfhL4tdmM3+Pf0PssK0RVQ= 2024-04-16T18:16:30.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N3/c2EfhL4tdmM3+Pf0PssK0RVQ=', 'Content-Length': '0'} 2024-04-16T18:16:30.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5e365e7f0e3f4d2-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.156 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:16:30.156 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.157 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.157 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.157 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.157 DEBUG:boto:Method: GET 2024-04-16T18:16:30.157 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.157 DEBUG:boto:Data: 2024-04-16T18:16:30.157 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.157 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.157 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.157 DEBUG:boto:Params: {} 2024-04-16T18:16:30.157 DEBUG:boto:Token: None 2024-04-16T18:16:30.158 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.158 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0= 2024-04-16T18:16:30.158 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0=', 'Content-Length': '0'} 2024-04-16T18:16:30.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e03cf28a01be7209-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.202 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.202 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.203 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.203 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:16:30.203 DEBUG:boto:Method: GET 2024-04-16T18:16:30.203 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.203 DEBUG:boto:Data: 2024-04-16T18:16:30.203 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.203 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.203 DEBUG:boto:Params: {} 2024-04-16T18:16:30.203 DEBUG:boto:Token: None 2024-04-16T18:16:30.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:16:30.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0= 2024-04-16T18:16:30.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pEu0VHyip8ixhWJwHzMf7Ll6NK0=', 'Content-Length': '0'} 2024-04-16T18:16:30.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aefa9188ccf19eb-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.206 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.206 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.206 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.206 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.206 DEBUG:boto:Method: GET 2024-04-16T18:16:30.206 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:30.206 DEBUG:boto:Data: 2024-04-16T18:16:30.206 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.206 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.206 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.207 DEBUG:boto:Params: {} 2024-04-16T18:16:30.207 DEBUG:boto:Token: None 2024-04-16T18:16:30.207 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.210 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc80a39fd0ecfacb-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.250 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.251 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.251 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.251 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.251 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.251 DEBUG:boto:Method: GET 2024-04-16T18:16:30.251 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:30.251 DEBUG:boto:Data: 2024-04-16T18:16:30.251 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.252 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.252 DEBUG:boto:Params: {} 2024-04-16T18:16:30.252 DEBUG:boto:Token: None 2024-04-16T18:16:30.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.255 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095cfd7c72981db61-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.255 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.255 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.255 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.255 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.255 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:30.256 DEBUG:boto:Data: 2024-04-16T18:16:30.256 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.256 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.256 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.256 DEBUG:boto:Params: {} 2024-04-16T18:16:30.256 DEBUG:boto:Token: None 2024-04-16T18:16:30.256 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c 2024-04-16T18:16:30.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9OBYdrK9wcpGkghYsM88PeAsLZk= 2024-04-16T18:16:30.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9OBYdrK9wcpGkghYsM88PeAsLZk=', 'Content-Length': '0'} 2024-04-16T18:16:30.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b34eb90c1d756694-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.258 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.259 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.259 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.259 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:30.259 DEBUG:boto:Data: 2024-04-16T18:16:30.259 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.259 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.259 DEBUG:boto:Params: {} 2024-04-16T18:16:30.259 DEBUG:boto:Token: None 2024-04-16T18:16:30.259 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c 2024-04-16T18:16:30.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9OBYdrK9wcpGkghYsM88PeAsLZk= 2024-04-16T18:16:30.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9OBYdrK9wcpGkghYsM88PeAsLZk=', 'Content-Length': '0'} 2024-04-16T18:16:30.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4a4e9569b157cfc-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:16:30.262 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.262 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.262 DEBUG:boto:Method: GET 2024-04-16T18:16:30.262 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:30.262 DEBUG:boto:Data: 2024-04-16T18:16:30.262 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.262 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.262 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.262 DEBUG:boto:Params: {} 2024-04-16T18:16:30.263 DEBUG:boto:Token: None 2024-04-16T18:16:30.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c 2024-04-16T18:16:30.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0pAFZ0TOq2Fo6/yoAslViZ5Ho7Q= 2024-04-16T18:16:30.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0pAFZ0TOq2Fo6/yoAslViZ5Ho7Q=', 'Content-Length': '0'} 2024-04-16T18:16:30.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4f2e60359edb26e-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.306 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:16:30.306 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:16:30.307 DEBUG:boto:Method: GET 2024-04-16T18:16:30.307 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:16:30.307 DEBUG:boto:Data: 2024-04-16T18:16:30.307 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.307 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.307 DEBUG:boto:Params: {} 2024-04-16T18:16:30.307 DEBUG:boto:Token: None 2024-04-16T18:16:30.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/c 2024-04-16T18:16:30.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0pAFZ0TOq2Fo6/yoAslViZ5Ho7Q= 2024-04-16T18:16:30.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0pAFZ0TOq2Fo6/yoAslViZ5Ho7Q=', 'Content-Length': '0'} 2024-04-16T18:16:30.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b24c009bee4ac52b-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.310 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.310 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.310 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.310 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.310 DEBUG:boto:Method: GET 2024-04-16T18:16:30.310 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:30.310 DEBUG:boto:Data: 2024-04-16T18:16:30.310 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.310 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.310 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.311 DEBUG:boto:Params: {} 2024-04-16T18:16:30.311 DEBUG:boto:Token: None 2024-04-16T18:16:30.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acffe30bf329841c-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.314 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.314 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.314 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.314 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.314 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:16:30.314 DEBUG:boto:Method: GET 2024-04-16T18:16:30.315 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:16:30.315 DEBUG:boto:Data: 2024-04-16T18:16:30.315 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.315 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.315 DEBUG:boto:Params: {} 2024-04-16T18:16:30.315 DEBUG:boto:Token: None 2024-04-16T18:16:30.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f24c82a3311b882-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.318 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.318 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:16:30.318 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.319 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.319 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.319 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.319 DEBUG:boto:Method: GET 2024-04-16T18:16:30.319 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.319 DEBUG:boto:Data: 2024-04-16T18:16:30.319 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.319 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.319 DEBUG:boto:Params: {} 2024-04-16T18:16:30.319 DEBUG:boto:Token: None 2024-04-16T18:16:30.320 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0= 2024-04-16T18:16:30.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0=', 'Content-Length': '0'} 2024-04-16T18:16:30.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d3821a34b711571-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.362 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.363 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.363 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.363 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.363 DEBUG:boto:Method: GET 2024-04-16T18:16:30.363 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.363 DEBUG:boto:Data: 2024-04-16T18:16:30.363 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.363 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.363 DEBUG:boto:Params: {} 2024-04-16T18:16:30.364 DEBUG:boto:Token: None 2024-04-16T18:16:30.364 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0= 2024-04-16T18:16:30.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0=', 'Content-Length': '0'} 2024-04-16T18:16:30.366 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c8a0b1dc399aab9-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.366 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.366 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.367 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.367 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.367 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.367 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.367 DEBUG:boto:Data: 2024-04-16T18:16:30.367 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.367 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.367 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.367 DEBUG:boto:Params: {} 2024-04-16T18:16:30.367 DEBUG:boto:Token: None 2024-04-16T18:16:30.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cUhspFFzQlTEY9H+DLB35bcHuHM= 2024-04-16T18:16:30.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cUhspFFzQlTEY9H+DLB35bcHuHM=', 'Content-Length': '0'} 2024-04-16T18:16:30.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b5ea2c656a90bca-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.370 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.370 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.370 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.370 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.370 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.370 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.370 DEBUG:boto:Data: 2024-04-16T18:16:30.370 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.370 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.371 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.371 DEBUG:boto:Params: {} 2024-04-16T18:16:30.371 DEBUG:boto:Token: None 2024-04-16T18:16:30.371 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cUhspFFzQlTEY9H+DLB35bcHuHM= 2024-04-16T18:16:30.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cUhspFFzQlTEY9H+DLB35bcHuHM=', 'Content-Length': '0'} 2024-04-16T18:16:30.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051ca9f66d4252344-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:16:30.373 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.373 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.373 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.373 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.374 DEBUG:boto:Method: GET 2024-04-16T18:16:30.374 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.374 DEBUG:boto:Data: 2024-04-16T18:16:30.374 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.374 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.374 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.374 DEBUG:boto:Params: {} 2024-04-16T18:16:30.374 DEBUG:boto:Token: None 2024-04-16T18:16:30.374 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.374 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0= 2024-04-16T18:16:30.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0=', 'Content-Length': '0'} 2024-04-16T18:16:30.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072fcec3429fca138-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.418 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.418 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.419 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.419 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:16:30.419 DEBUG:boto:Method: GET 2024-04-16T18:16:30.419 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.419 DEBUG:boto:Data: 2024-04-16T18:16:30.419 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.419 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.419 DEBUG:boto:Params: {} 2024-04-16T18:16:30.419 DEBUG:boto:Token: None 2024-04-16T18:16:30.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:16:30.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0= 2024-04-16T18:16:30.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WbnvHZhfcpbrXhqgMJ00ItHGhn0=', 'Content-Length': '0'} 2024-04-16T18:16:30.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ac702a933e3ef06-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.422 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.422 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.422 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.422 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.422 DEBUG:boto:Method: GET 2024-04-16T18:16:30.423 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:30.423 DEBUG:boto:Data: 2024-04-16T18:16:30.423 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.423 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.423 DEBUG:boto:Params: {} 2024-04-16T18:16:30.423 DEBUG:boto:Token: None 2024-04-16T18:16:30.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1da8aab1e2449a3-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.426 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.426 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.426 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.427 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.427 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.427 DEBUG:boto:Method: GET 2024-04-16T18:16:30.427 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:30.427 DEBUG:boto:Data: 2024-04-16T18:16:30.427 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.427 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.427 DEBUG:boto:Params: {} 2024-04-16T18:16:30.427 DEBUG:boto:Token: None 2024-04-16T18:16:30.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a49e484214bd5f1f-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.431 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.431 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.431 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.431 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.431 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:30.431 DEBUG:boto:Data: 2024-04-16T18:16:30.431 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.432 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.432 DEBUG:boto:Params: {} 2024-04-16T18:16:30.432 DEBUG:boto:Token: None 2024-04-16T18:16:30.432 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d 2024-04-16T18:16:30.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T/FRwUh2YjzvKFjwwl9ff0hXeTw= 2024-04-16T18:16:30.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T/FRwUh2YjzvKFjwwl9ff0hXeTw=', 'Content-Length': '0'} 2024-04-16T18:16:30.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083db5e7cdec55847-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.434 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.434 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.434 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.435 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:30.435 DEBUG:boto:Data: 2024-04-16T18:16:30.435 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.435 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.435 DEBUG:boto:Params: {} 2024-04-16T18:16:30.435 DEBUG:boto:Token: None 2024-04-16T18:16:30.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d 2024-04-16T18:16:30.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T/FRwUh2YjzvKFjwwl9ff0hXeTw= 2024-04-16T18:16:30.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T/FRwUh2YjzvKFjwwl9ff0hXeTw=', 'Content-Length': '0'} 2024-04-16T18:16:30.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000324954a20f84a43-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:16:30.438 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.438 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.438 DEBUG:boto:Method: GET 2024-04-16T18:16:30.438 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:30.438 DEBUG:boto:Data: 2024-04-16T18:16:30.438 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.438 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.438 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.438 DEBUG:boto:Params: {} 2024-04-16T18:16:30.438 DEBUG:boto:Token: None 2024-04-16T18:16:30.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d 2024-04-16T18:16:30.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BD9o+r/ha72Nq25cYjfetq+TJcA= 2024-04-16T18:16:30.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BD9o+r/ha72Nq25cYjfetq+TJcA=', 'Content-Length': '0'} 2024-04-16T18:16:30.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d42b6bab8ca94c31-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.482 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:16:30.482 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:16:30.483 DEBUG:boto:Method: GET 2024-04-16T18:16:30.483 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:16:30.483 DEBUG:boto:Data: 2024-04-16T18:16:30.483 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.483 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.483 DEBUG:boto:Params: {} 2024-04-16T18:16:30.483 DEBUG:boto:Token: None 2024-04-16T18:16:30.483 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/d 2024-04-16T18:16:30.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BD9o+r/ha72Nq25cYjfetq+TJcA= 2024-04-16T18:16:30.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BD9o+r/ha72Nq25cYjfetq+TJcA=', 'Content-Length': '0'} 2024-04-16T18:16:30.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078d278272054b618-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.486 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.486 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.486 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.486 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.486 DEBUG:boto:Method: GET 2024-04-16T18:16:30.486 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:30.486 DEBUG:boto:Data: 2024-04-16T18:16:30.486 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.486 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.486 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.486 DEBUG:boto:Params: {} 2024-04-16T18:16:30.487 DEBUG:boto:Token: None 2024-04-16T18:16:30.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.490 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000caaf6aa55a4ae4bb-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.490 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.490 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.491 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.491 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.491 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:16:30.491 DEBUG:boto:Method: GET 2024-04-16T18:16:30.491 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:16:30.491 DEBUG:boto:Data: 2024-04-16T18:16:30.491 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.491 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.491 DEBUG:boto:Params: {} 2024-04-16T18:16:30.491 DEBUG:boto:Token: None 2024-04-16T18:16:30.492 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb65d28dc6305475-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.494 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.495 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:16:30.495 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.495 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.495 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.495 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.495 DEBUG:boto:Method: GET 2024-04-16T18:16:30.495 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.495 DEBUG:boto:Data: 2024-04-16T18:16:30.495 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.496 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.496 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.496 DEBUG:boto:Params: {} 2024-04-16T18:16:30.496 DEBUG:boto:Token: None 2024-04-16T18:16:30.496 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w= 2024-04-16T18:16:30.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w=', 'Content-Length': '0'} 2024-04-16T18:16:30.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db1c14e634d36f5e-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.538 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.538 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.539 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.539 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.539 DEBUG:boto:Method: GET 2024-04-16T18:16:30.539 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.539 DEBUG:boto:Data: 2024-04-16T18:16:30.539 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.539 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.539 DEBUG:boto:Params: {} 2024-04-16T18:16:30.539 DEBUG:boto:Token: None 2024-04-16T18:16:30.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w= 2024-04-16T18:16:30.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w=', 'Content-Length': '0'} 2024-04-16T18:16:30.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000731dc82504088804-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.542 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.542 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.542 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.542 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.542 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.542 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.542 DEBUG:boto:Data: 2024-04-16T18:16:30.542 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.542 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.543 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.543 DEBUG:boto:Params: {} 2024-04-16T18:16:30.543 DEBUG:boto:Token: None 2024-04-16T18:16:30.543 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OrgsCx3JFzVc6hjoqS1W9Ts1U0w= 2024-04-16T18:16:30.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OrgsCx3JFzVc6hjoqS1W9Ts1U0w=', 'Content-Length': '0'} 2024-04-16T18:16:30.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c3ae8216dd1f571-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.546 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.546 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.546 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.546 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.546 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.546 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.546 DEBUG:boto:Data: 2024-04-16T18:16:30.546 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.546 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.546 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.546 DEBUG:boto:Params: {} 2024-04-16T18:16:30.546 DEBUG:boto:Token: None 2024-04-16T18:16:30.547 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.547 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OrgsCx3JFzVc6hjoqS1W9Ts1U0w= 2024-04-16T18:16:30.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OrgsCx3JFzVc6hjoqS1W9Ts1U0w=', 'Content-Length': '0'} 2024-04-16T18:16:30.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6aa62f4bde76680-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:16:30.549 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.549 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.549 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.549 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.549 DEBUG:boto:Method: GET 2024-04-16T18:16:30.549 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.549 DEBUG:boto:Data: 2024-04-16T18:16:30.550 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.550 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.550 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.550 DEBUG:boto:Params: {} 2024-04-16T18:16:30.550 DEBUG:boto:Token: None 2024-04-16T18:16:30.550 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.550 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w= 2024-04-16T18:16:30.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w=', 'Content-Length': '0'} 2024-04-16T18:16:30.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc0210b10726c7e9-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.594 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.594 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.595 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.595 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:16:30.595 DEBUG:boto:Method: GET 2024-04-16T18:16:30.595 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.595 DEBUG:boto:Data: 2024-04-16T18:16:30.595 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.595 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.595 DEBUG:boto:Params: {} 2024-04-16T18:16:30.595 DEBUG:boto:Token: None 2024-04-16T18:16:30.596 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:16:30.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w= 2024-04-16T18:16:30.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zJ64Hyl8JqlTkmULG4YWnsCub2w=', 'Content-Length': '0'} 2024-04-16T18:16:30.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4bc1fe002b4a3eb-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.598 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.598 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.598 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.598 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.599 DEBUG:boto:Method: GET 2024-04-16T18:16:30.599 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:30.599 DEBUG:boto:Data: 2024-04-16T18:16:30.599 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.599 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.599 DEBUG:boto:Params: {} 2024-04-16T18:16:30.599 DEBUG:boto:Token: None 2024-04-16T18:16:30.599 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.602 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000492c4bd4519cb8ee-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.602 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.602 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.603 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.603 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.603 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.603 DEBUG:boto:Method: GET 2024-04-16T18:16:30.603 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:30.603 DEBUG:boto:Data: 2024-04-16T18:16:30.603 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.603 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.603 DEBUG:boto:Params: {} 2024-04-16T18:16:30.603 DEBUG:boto:Token: None 2024-04-16T18:16:30.603 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.606 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000241821a4c8318f5e-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.607 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.607 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.607 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.607 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.607 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:30.607 DEBUG:boto:Data: 2024-04-16T18:16:30.607 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.607 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.607 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.608 DEBUG:boto:Params: {} 2024-04-16T18:16:30.608 DEBUG:boto:Token: None 2024-04-16T18:16:30.608 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e 2024-04-16T18:16:30.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rofl0EYMn7O4aC2eHyKv+vaLPPE= 2024-04-16T18:16:30.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rofl0EYMn7O4aC2eHyKv+vaLPPE=', 'Content-Length': '0'} 2024-04-16T18:16:30.610 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043b1415245ab23bb-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.610 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.611 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.611 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.611 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:30.611 DEBUG:boto:Data: 2024-04-16T18:16:30.611 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.611 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.611 DEBUG:boto:Params: {} 2024-04-16T18:16:30.611 DEBUG:boto:Token: None 2024-04-16T18:16:30.611 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e 2024-04-16T18:16:30.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rofl0EYMn7O4aC2eHyKv+vaLPPE= 2024-04-16T18:16:30.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rofl0EYMn7O4aC2eHyKv+vaLPPE=', 'Content-Length': '0'} 2024-04-16T18:16:30.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9a18de33451ee65-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.614 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:16:30.614 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.614 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.614 DEBUG:boto:Method: GET 2024-04-16T18:16:30.614 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:30.614 DEBUG:boto:Data: 2024-04-16T18:16:30.614 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.614 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.614 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.614 DEBUG:boto:Params: {} 2024-04-16T18:16:30.614 DEBUG:boto:Token: None 2024-04-16T18:16:30.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e 2024-04-16T18:16:30.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J+qlx4z59YESO2/Z2X7jbzBal08= 2024-04-16T18:16:30.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J+qlx4z59YESO2/Z2X7jbzBal08=', 'Content-Length': '0'} 2024-04-16T18:16:30.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000191bf1a80ebd2df7-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.658 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:16:30.658 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:16:30.659 DEBUG:boto:Method: GET 2024-04-16T18:16:30.659 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:16:30.659 DEBUG:boto:Data: 2024-04-16T18:16:30.659 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.659 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.659 DEBUG:boto:Params: {} 2024-04-16T18:16:30.659 DEBUG:boto:Token: None 2024-04-16T18:16:30.659 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/e 2024-04-16T18:16:30.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J+qlx4z59YESO2/Z2X7jbzBal08= 2024-04-16T18:16:30.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J+qlx4z59YESO2/Z2X7jbzBal08=', 'Content-Length': '0'} 2024-04-16T18:16:30.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d3e4709d25b0689-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.662 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.662 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.662 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.662 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.662 DEBUG:boto:Method: GET 2024-04-16T18:16:30.662 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:30.662 DEBUG:boto:Data: 2024-04-16T18:16:30.662 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.662 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.662 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.662 DEBUG:boto:Params: {} 2024-04-16T18:16:30.663 DEBUG:boto:Token: None 2024-04-16T18:16:30.663 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.666 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8abdc9893933c51-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.666 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.666 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.666 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.666 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.666 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:16:30.667 DEBUG:boto:Method: GET 2024-04-16T18:16:30.667 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:16:30.667 DEBUG:boto:Data: 2024-04-16T18:16:30.667 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.667 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.667 DEBUG:boto:Params: {} 2024-04-16T18:16:30.667 DEBUG:boto:Token: None 2024-04-16T18:16:30.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.670 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d8aac85205e9f74-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.670 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.670 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:16:30.670 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.670 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.671 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.671 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.671 DEBUG:boto:Method: GET 2024-04-16T18:16:30.671 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.671 DEBUG:boto:Data: 2024-04-16T18:16:30.671 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.671 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.671 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.671 DEBUG:boto:Params: {} 2024-04-16T18:16:30.671 DEBUG:boto:Token: None 2024-04-16T18:16:30.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.672 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4= 2024-04-16T18:16:30.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4=', 'Content-Length': '0'} 2024-04-16T18:16:30.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af972011171ab936-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.714 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.714 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.714 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.715 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.715 DEBUG:boto:Method: GET 2024-04-16T18:16:30.715 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.715 DEBUG:boto:Data: 2024-04-16T18:16:30.715 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.715 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.715 DEBUG:boto:Params: {} 2024-04-16T18:16:30.715 DEBUG:boto:Token: None 2024-04-16T18:16:30.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4= 2024-04-16T18:16:30.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4=', 'Content-Length': '0'} 2024-04-16T18:16:30.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba5e4d45a0cff497-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.718 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.718 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.718 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.718 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.718 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.718 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.719 DEBUG:boto:Data: 2024-04-16T18:16:30.719 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.719 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.719 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.719 DEBUG:boto:Params: {} 2024-04-16T18:16:30.719 DEBUG:boto:Token: None 2024-04-16T18:16:30.719 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fpn38WelcMaPYUHPi+EQT1hFYYY= 2024-04-16T18:16:30.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fpn38WelcMaPYUHPi+EQT1hFYYY=', 'Content-Length': '0'} 2024-04-16T18:16:30.721 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dec43652cc87a1fb-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.721 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.721 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.721 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.722 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.722 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.722 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.722 DEBUG:boto:Data: 2024-04-16T18:16:30.722 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.722 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.722 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.722 DEBUG:boto:Params: {} 2024-04-16T18:16:30.722 DEBUG:boto:Token: None 2024-04-16T18:16:30.722 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fpn38WelcMaPYUHPi+EQT1hFYYY= 2024-04-16T18:16:30.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fpn38WelcMaPYUHPi+EQT1hFYYY=', 'Content-Length': '0'} 2024-04-16T18:16:30.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000352c0aace83256d8-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:16:30.725 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.725 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.725 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.725 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.725 DEBUG:boto:Method: GET 2024-04-16T18:16:30.726 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.726 DEBUG:boto:Data: 2024-04-16T18:16:30.726 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.726 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.726 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.726 DEBUG:boto:Params: {} 2024-04-16T18:16:30.726 DEBUG:boto:Token: None 2024-04-16T18:16:30.726 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.726 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4= 2024-04-16T18:16:30.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4=', 'Content-Length': '0'} 2024-04-16T18:16:30.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048075483125ec758-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.770 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.771 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.771 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.771 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:16:30.771 DEBUG:boto:Method: GET 2024-04-16T18:16:30.771 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.771 DEBUG:boto:Data: 2024-04-16T18:16:30.771 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.771 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.771 DEBUG:boto:Params: {} 2024-04-16T18:16:30.771 DEBUG:boto:Token: None 2024-04-16T18:16:30.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:16:30.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4= 2024-04-16T18:16:30.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/DI455Zd5oulvFZXUUTFG5AgIZ4=', 'Content-Length': '0'} 2024-04-16T18:16:30.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000893f5403144eef2-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.774 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.774 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.774 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.775 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.775 DEBUG:boto:Method: GET 2024-04-16T18:16:30.775 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:30.775 DEBUG:boto:Data: 2024-04-16T18:16:30.775 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.775 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.775 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.775 DEBUG:boto:Params: {} 2024-04-16T18:16:30.775 DEBUG:boto:Token: None 2024-04-16T18:16:30.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.778 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001262ad87cf5315d2-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.778 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.779 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.779 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.779 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.779 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.779 DEBUG:boto:Method: GET 2024-04-16T18:16:30.779 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:30.779 DEBUG:boto:Data: 2024-04-16T18:16:30.779 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.779 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.779 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.779 DEBUG:boto:Params: {} 2024-04-16T18:16:30.780 DEBUG:boto:Token: None 2024-04-16T18:16:30.780 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089aa7bc2889ea679-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.783 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.783 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.783 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.783 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.784 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:30.784 DEBUG:boto:Data: 2024-04-16T18:16:30.784 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.784 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.784 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.784 DEBUG:boto:Params: {} 2024-04-16T18:16:30.784 DEBUG:boto:Token: None 2024-04-16T18:16:30.784 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f 2024-04-16T18:16:30.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qga1XggmoZkMFCcToixkaqZ3xlE= 2024-04-16T18:16:30.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qga1XggmoZkMFCcToixkaqZ3xlE=', 'Content-Length': '0'} 2024-04-16T18:16:30.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f778aa78483d78e-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.786 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.787 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.787 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.787 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:30.787 DEBUG:boto:Data: 2024-04-16T18:16:30.787 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.787 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.787 DEBUG:boto:Params: {} 2024-04-16T18:16:30.787 DEBUG:boto:Token: None 2024-04-16T18:16:30.787 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f 2024-04-16T18:16:30.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qga1XggmoZkMFCcToixkaqZ3xlE= 2024-04-16T18:16:30.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qga1XggmoZkMFCcToixkaqZ3xlE=', 'Content-Length': '0'} 2024-04-16T18:16:30.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029ec4bf4892cc079-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.789 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:16:30.790 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.790 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.790 DEBUG:boto:Method: GET 2024-04-16T18:16:30.790 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:30.790 DEBUG:boto:Data: 2024-04-16T18:16:30.790 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.790 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.790 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.790 DEBUG:boto:Params: {} 2024-04-16T18:16:30.790 DEBUG:boto:Token: None 2024-04-16T18:16:30.791 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f 2024-04-16T18:16:30.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1mYsMCKbucj+Luj8ySEVR9v327k= 2024-04-16T18:16:30.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1mYsMCKbucj+Luj8ySEVR9v327k=', 'Content-Length': '0'} 2024-04-16T18:16:30.792 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000196334a51a9f4aa-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.834 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:16:30.834 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:16:30.834 DEBUG:boto:Method: GET 2024-04-16T18:16:30.835 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:16:30.835 DEBUG:boto:Data: 2024-04-16T18:16:30.835 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.835 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.835 DEBUG:boto:Params: {} 2024-04-16T18:16:30.835 DEBUG:boto:Token: None 2024-04-16T18:16:30.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/f 2024-04-16T18:16:30.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1mYsMCKbucj+Luj8ySEVR9v327k= 2024-04-16T18:16:30.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1mYsMCKbucj+Luj8ySEVR9v327k=', 'Content-Length': '0'} 2024-04-16T18:16:30.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e35358c55c883341-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.838 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.838 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.838 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.838 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.838 DEBUG:boto:Method: GET 2024-04-16T18:16:30.838 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:30.838 DEBUG:boto:Data: 2024-04-16T18:16:30.838 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.838 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.839 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.839 DEBUG:boto:Params: {} 2024-04-16T18:16:30.839 DEBUG:boto:Token: None 2024-04-16T18:16:30.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc7af9aa6951394e-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.886 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.887 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.887 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.887 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.887 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:16:30.887 DEBUG:boto:Method: GET 2024-04-16T18:16:30.887 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:16:30.887 DEBUG:boto:Data: 2024-04-16T18:16:30.887 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.887 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.888 DEBUG:boto:Params: {} 2024-04-16T18:16:30.888 DEBUG:boto:Token: None 2024-04-16T18:16:30.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:30.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:30.891 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f60a7b4d7c241b69-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.891 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:30.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:16:30.891 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:30.891 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:30.891 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.891 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.892 DEBUG:boto:Method: GET 2024-04-16T18:16:30.892 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.892 DEBUG:boto:Data: 2024-04-16T18:16:30.892 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.892 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.892 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.892 DEBUG:boto:Params: {} 2024-04-16T18:16:30.892 DEBUG:boto:Token: None 2024-04-16T18:16:30.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA= 2024-04-16T18:16:30.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA=', 'Content-Length': '0'} 2024-04-16T18:16:30.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044a586b50bc8dc54-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.938 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:30.938 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:30.939 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.939 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.939 DEBUG:boto:Method: GET 2024-04-16T18:16:30.939 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.939 DEBUG:boto:Data: 2024-04-16T18:16:30.939 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.939 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.939 DEBUG:boto:Params: {} 2024-04-16T18:16:30.939 DEBUG:boto:Token: None 2024-04-16T18:16:30.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA= 2024-04-16T18:16:30.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA=', 'Content-Length': '0'} 2024-04-16T18:16:30.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041069d76ae7e710c-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.942 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:30.942 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:30.942 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.942 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.942 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.942 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.943 DEBUG:boto:Data: 2024-04-16T18:16:30.943 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.943 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.943 DEBUG:boto:Params: {} 2024-04-16T18:16:30.943 DEBUG:boto:Token: None 2024-04-16T18:16:30.943 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G3Di402dAbL8Gt0kQ1C7vgaMD3A= 2024-04-16T18:16:30.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G3Di402dAbL8Gt0kQ1C7vgaMD3A=', 'Content-Length': '0'} 2024-04-16T18:16:30.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e42a04d974a46f8b-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.946 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:30.946 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:30.946 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.946 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.946 DEBUG:boto:Method: HEAD 2024-04-16T18:16:30.946 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.946 DEBUG:boto:Data: 2024-04-16T18:16:30.946 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.946 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.947 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.947 DEBUG:boto:Params: {} 2024-04-16T18:16:30.947 DEBUG:boto:Token: None 2024-04-16T18:16:30.947 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G3Di402dAbL8Gt0kQ1C7vgaMD3A= 2024-04-16T18:16:30.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G3Di402dAbL8Gt0kQ1C7vgaMD3A=', 'Content-Length': '0'} 2024-04-16T18:16:30.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e092edda1a3e91a-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.949 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:16:30.949 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:30.950 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:30.950 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.950 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.950 DEBUG:boto:Method: GET 2024-04-16T18:16:30.950 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.950 DEBUG:boto:Data: 2024-04-16T18:16:30.950 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.950 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.950 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.950 DEBUG:boto:Params: {} 2024-04-16T18:16:30.950 DEBUG:boto:Token: None 2024-04-16T18:16:30.951 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA= 2024-04-16T18:16:30.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA=', 'Content-Length': '0'} 2024-04-16T18:16:30.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f036af2f6b8072c-00661ec07e-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.994 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:30.994 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:30.995 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.995 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:16:30.995 DEBUG:boto:Method: GET 2024-04-16T18:16:30.995 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.995 DEBUG:boto:Data: 2024-04-16T18:16:30.995 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:30.995 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.995 DEBUG:boto:Params: {} 2024-04-16T18:16:30.995 DEBUG:boto:Token: None 2024-04-16T18:16:30.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:16:30.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA= 2024-04-16T18:16:30.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4ymrTojCN+QNx7cPZjvVh1q/FA=', 'Content-Length': '0'} 2024-04-16T18:16:30.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038f478809055545c-00661ec07e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:30.998 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:30.998 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:30.998 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:30.999 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:30.999 DEBUG:boto:Method: GET 2024-04-16T18:16:30.999 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:30.999 DEBUG:boto:Data: 2024-04-16T18:16:30.999 DEBUG:boto:Headers: {} 2024-04-16T18:16:30.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:30.999 DEBUG:boto:Port: 8000 2024-04-16T18:16:30.999 DEBUG:boto:Params: {} 2024-04-16T18:16:30.999 DEBUG:boto:Token: None 2024-04-16T18:16:30.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:30 GMT /cjqttm-50/ 2024-04-16T18:16:30.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk= 2024-04-16T18:16:31.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bnDYLWc/DQVK68g1fAv6BfqBDFk=', 'Content-Length': '0'} 2024-04-16T18:16:31.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f356343d73be5e9-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.042 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.043 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:31.043 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:31.043 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:31.043 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:31.043 DEBUG:boto:Method: GET 2024-04-16T18:16:31.043 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:31.043 DEBUG:boto:Data: 2024-04-16T18:16:31.043 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.043 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.043 DEBUG:boto:Params: {} 2024-04-16T18:16:31.044 DEBUG:boto:Token: None 2024-04-16T18:16:31.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/ 2024-04-16T18:16:31.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8= 2024-04-16T18:16:31.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8=', 'Content-Length': '0'} 2024-04-16T18:16:31.047 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c54368fa0437a118-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.047 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.047 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:31.047 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:31.048 DEBUG:boto:Method: HEAD 2024-04-16T18:16:31.048 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:31.048 DEBUG:boto:Data: 2024-04-16T18:16:31.048 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.048 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.048 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.048 DEBUG:boto:Params: {} 2024-04-16T18:16:31.048 DEBUG:boto:Token: None 2024-04-16T18:16:31.048 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/g 2024-04-16T18:16:31.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wf4YCVWJzaC28IxXkCr0Dnnm2EI= 2024-04-16T18:16:31.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wf4YCVWJzaC28IxXkCr0Dnnm2EI=', 'Content-Length': '0'} 2024-04-16T18:16:31.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ecb3809246bd2f4-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.051 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:31.051 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:31.051 DEBUG:boto:Method: HEAD 2024-04-16T18:16:31.051 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:31.051 DEBUG:boto:Data: 2024-04-16T18:16:31.051 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.051 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.051 DEBUG:boto:Params: {} 2024-04-16T18:16:31.051 DEBUG:boto:Token: None 2024-04-16T18:16:31.052 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/g 2024-04-16T18:16:31.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wf4YCVWJzaC28IxXkCr0Dnnm2EI= 2024-04-16T18:16:31.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wf4YCVWJzaC28IxXkCr0Dnnm2EI=', 'Content-Length': '0'} 2024-04-16T18:16:31.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4fe5ea3bbf8b25f-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.054 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:16:31.054 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:31.054 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:31.055 DEBUG:boto:Method: GET 2024-04-16T18:16:31.055 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:31.055 DEBUG:boto:Data: 2024-04-16T18:16:31.055 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.055 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.055 DEBUG:boto:Params: {} 2024-04-16T18:16:31.055 DEBUG:boto:Token: None 2024-04-16T18:16:31.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/g 2024-04-16T18:16:31.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hbkw1JATSIWD4PW9HVpXAkGC1Jw= 2024-04-16T18:16:31.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hbkw1JATSIWD4PW9HVpXAkGC1Jw=', 'Content-Length': '0'} 2024-04-16T18:16:31.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7a948b6f7281799-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.098 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:16:31.098 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:16:31.099 DEBUG:boto:Method: GET 2024-04-16T18:16:31.099 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:16:31.099 DEBUG:boto:Data: 2024-04-16T18:16:31.099 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.099 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.099 DEBUG:boto:Params: {} 2024-04-16T18:16:31.099 DEBUG:boto:Token: None 2024-04-16T18:16:31.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/g 2024-04-16T18:16:31.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hbkw1JATSIWD4PW9HVpXAkGC1Jw= 2024-04-16T18:16:31.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hbkw1JATSIWD4PW9HVpXAkGC1Jw=', 'Content-Length': '0'} 2024-04-16T18:16:31.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086d22d1705d6237b-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.102 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:31.102 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:31.102 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:31.102 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:31.102 DEBUG:boto:Method: GET 2024-04-16T18:16:31.102 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:31.102 DEBUG:boto:Data: 2024-04-16T18:16:31.102 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.103 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.103 DEBUG:boto:Params: {} 2024-04-16T18:16:31.103 DEBUG:boto:Token: None 2024-04-16T18:16:31.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/ 2024-04-16T18:16:31.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8= 2024-04-16T18:16:31.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8=', 'Content-Length': '0'} 2024-04-16T18:16:31.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7ae508aeb9dc67d-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.146 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.147 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:31.147 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:31.147 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:16:31.147 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:16:31.147 DEBUG:boto:Method: GET 2024-04-16T18:16:31.147 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:16:31.147 DEBUG:boto:Data: 2024-04-16T18:16:31.147 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.147 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.147 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.147 DEBUG:boto:Params: {} 2024-04-16T18:16:31.148 DEBUG:boto:Token: None 2024-04-16T18:16:31.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/ 2024-04-16T18:16:31.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8= 2024-04-16T18:16:31.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8=', 'Content-Length': '0'} 2024-04-16T18:16:31.150 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051d90dd63ad41e0e-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.151 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:16:31.151 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.151 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.151 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.151 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.151 DEBUG:boto:Method: GET 2024-04-16T18:16:31.151 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.151 DEBUG:boto:Data: 2024-04-16T18:16:31.152 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.152 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.152 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.152 DEBUG:boto:Params: {} 2024-04-16T18:16:31.152 DEBUG:boto:Token: None 2024-04-16T18:16:31.152 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw= 2024-04-16T18:16:31.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw=', 'Content-Length': '0'} 2024-04-16T18:16:31.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000381a207416297a5f-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.198 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.199 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.199 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.199 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.199 DEBUG:boto:Method: GET 2024-04-16T18:16:31.199 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.199 DEBUG:boto:Data: 2024-04-16T18:16:31.199 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.199 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.199 DEBUG:boto:Params: {} 2024-04-16T18:16:31.199 DEBUG:boto:Token: None 2024-04-16T18:16:31.200 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw= 2024-04-16T18:16:31.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw=', 'Content-Length': '0'} 2024-04-16T18:16:31.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085a131441cd05e44-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.203 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.203 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.203 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.203 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.203 DEBUG:boto:Method: HEAD 2024-04-16T18:16:31.203 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.203 DEBUG:boto:Data: 2024-04-16T18:16:31.203 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.203 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.204 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.204 DEBUG:boto:Params: {} 2024-04-16T18:16:31.204 DEBUG:boto:Token: None 2024-04-16T18:16:31.204 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tsa/RcfIdOoTR7UmUzsu9p6ai6Y= 2024-04-16T18:16:31.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tsa/RcfIdOoTR7UmUzsu9p6ai6Y=', 'Content-Length': '0'} 2024-04-16T18:16:31.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d6e6a5ce258a54f-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.206 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.206 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.206 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.206 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.206 DEBUG:boto:Method: HEAD 2024-04-16T18:16:31.207 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.207 DEBUG:boto:Data: 2024-04-16T18:16:31.207 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.207 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.207 DEBUG:boto:Params: {} 2024-04-16T18:16:31.207 DEBUG:boto:Token: None 2024-04-16T18:16:31.207 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tsa/RcfIdOoTR7UmUzsu9p6ai6Y= 2024-04-16T18:16:31.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tsa/RcfIdOoTR7UmUzsu9p6ai6Y=', 'Content-Length': '0'} 2024-04-16T18:16:31.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc96f6e7e3ff7968-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.210 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:16:31.210 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.210 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.210 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.210 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.210 DEBUG:boto:Method: GET 2024-04-16T18:16:31.210 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.210 DEBUG:boto:Data: 2024-04-16T18:16:31.210 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.210 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.210 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.211 DEBUG:boto:Params: {} 2024-04-16T18:16:31.211 DEBUG:boto:Token: None 2024-04-16T18:16:31.211 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw= 2024-04-16T18:16:31.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw=', 'Content-Length': '0'} 2024-04-16T18:16:31.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004522697e97ef8793-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.254 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.254 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.255 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.255 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:16:31.255 DEBUG:boto:Method: GET 2024-04-16T18:16:31.255 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.255 DEBUG:boto:Data: 2024-04-16T18:16:31.255 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.255 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.255 DEBUG:boto:Params: {} 2024-04-16T18:16:31.255 DEBUG:boto:Token: None 2024-04-16T18:16:31.255 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:16:31.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw= 2024-04-16T18:16:31.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:olf4odfSPPlfpIAhAeDENLfPHZw=', 'Content-Length': '0'} 2024-04-16T18:16:31.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddacb149f2a79142-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.258 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:31.258 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:31.259 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.259 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.259 DEBUG:boto:Method: GET 2024-04-16T18:16:31.259 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:31.259 DEBUG:boto:Data: 2024-04-16T18:16:31.259 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.259 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.259 DEBUG:boto:Params: {} 2024-04-16T18:16:31.259 DEBUG:boto:Token: None 2024-04-16T18:16:31.260 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/ 2024-04-16T18:16:31.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8= 2024-04-16T18:16:31.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8=', 'Content-Length': '0'} 2024-04-16T18:16:31.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000babfeff8334a5414-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.302 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.303 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:31.303 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:31.303 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.303 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.303 DEBUG:boto:Method: GET 2024-04-16T18:16:31.303 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:31.303 DEBUG:boto:Data: 2024-04-16T18:16:31.303 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.303 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.303 DEBUG:boto:Params: {} 2024-04-16T18:16:31.304 DEBUG:boto:Token: None 2024-04-16T18:16:31.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/ 2024-04-16T18:16:31.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8= 2024-04-16T18:16:31.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8=', 'Content-Length': '0'} 2024-04-16T18:16:31.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c74e5d58b6815a5-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.306 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.307 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.307 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.307 DEBUG:boto:Method: HEAD 2024-04-16T18:16:31.307 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:31.307 DEBUG:boto:Data: 2024-04-16T18:16:31.307 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.307 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.307 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.307 DEBUG:boto:Params: {} 2024-04-16T18:16:31.307 DEBUG:boto:Token: None 2024-04-16T18:16:31.308 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h 2024-04-16T18:16:31.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yRXNzHnnpXSUBP9O8AKnjHsABp0= 2024-04-16T18:16:31.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yRXNzHnnpXSUBP9O8AKnjHsABp0=', 'Content-Length': '0'} 2024-04-16T18:16:31.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5ff15d843ed3404-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.310 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.310 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.310 DEBUG:boto:Method: HEAD 2024-04-16T18:16:31.311 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:31.311 DEBUG:boto:Data: 2024-04-16T18:16:31.311 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.311 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.311 DEBUG:boto:Params: {} 2024-04-16T18:16:31.311 DEBUG:boto:Token: None 2024-04-16T18:16:31.311 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h 2024-04-16T18:16:31.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yRXNzHnnpXSUBP9O8AKnjHsABp0= 2024-04-16T18:16:31.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yRXNzHnnpXSUBP9O8AKnjHsABp0=', 'Content-Length': '0'} 2024-04-16T18:16:31.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000617dbc3905ab3fb8-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:16:31.314 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.314 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.314 DEBUG:boto:Method: GET 2024-04-16T18:16:31.314 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:31.314 DEBUG:boto:Data: 2024-04-16T18:16:31.314 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.314 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.314 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.314 DEBUG:boto:Params: {} 2024-04-16T18:16:31.314 DEBUG:boto:Token: None 2024-04-16T18:16:31.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h 2024-04-16T18:16:31.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:10en9kjYeoeJNKqgCqhd+CrJLEY= 2024-04-16T18:16:31.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:10en9kjYeoeJNKqgCqhd+CrJLEY=', 'Content-Length': '0'} 2024-04-16T18:16:31.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008496a3d1e961e299-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.358 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:16:31.358 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:16:31.358 DEBUG:boto:Method: GET 2024-04-16T18:16:31.359 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:16:31.359 DEBUG:boto:Data: 2024-04-16T18:16:31.359 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.359 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.359 DEBUG:boto:Params: {} 2024-04-16T18:16:31.359 DEBUG:boto:Token: None 2024-04-16T18:16:31.359 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/h 2024-04-16T18:16:31.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:10en9kjYeoeJNKqgCqhd+CrJLEY= 2024-04-16T18:16:31.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:10en9kjYeoeJNKqgCqhd+CrJLEY=', 'Content-Length': '0'} 2024-04-16T18:16:31.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b529770595e6ff1a-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.362 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:31.362 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:31.362 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.362 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.362 DEBUG:boto:Method: GET 2024-04-16T18:16:31.362 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:31.362 DEBUG:boto:Data: 2024-04-16T18:16:31.362 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.362 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:16:31.362 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.362 DEBUG:boto:Params: {} 2024-04-16T18:16:31.363 DEBUG:boto:Token: None 2024-04-16T18:16:31.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/ 2024-04-16T18:16:31.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8= 2024-04-16T18:16:31.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8=', 'Content-Length': '0'} 2024-04-16T18:16:31.365 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000700da13f5d78e9d-00661ec07f-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.365 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.366 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:31.366 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:31.366 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.366 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:16:31.366 DEBUG:boto:Method: GET 2024-04-16T18:16:31.366 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:16:31.366 DEBUG:boto:Data: 2024-04-16T18:16:31.366 DEBUG:boto:Headers: {} 2024-04-16T18:16:31.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:31.367 DEBUG:boto:Port: 8000 2024-04-16T18:16:31.367 DEBUG:boto:Params: {} 2024-04-16T18:16:31.367 DEBUG:boto:Token: None 2024-04-16T18:16:31.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:16:31 GMT /cjqttm-50/ 2024-04-16T18:16:31.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8= 2024-04-16T18:16:31.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:31 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mDBIxpxGvq79WVqEPKGrcJw+NG8=', 'Content-Length': '0'} 2024-04-16T18:16:31.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058edff1c7e58b58d-00661ec07f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:31 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:31.370 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:16:31.370 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:16:31.370 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:31.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:31.371 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:16:31.419 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:31.419 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:31.589 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:31.590+0000 7f870d8a0640 -1 req 1106480652489529967 0.002999936s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-32:9ba59572-f51c-4bce-9578-e6350e822996.4816.1,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-32:9ba59572-f51c-4bce-9578-e6350e822996.4816.1,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:31.603 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:31.604+0000 7f86f8075640 -1 req 15599715308987402090 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-21:9ba59572-f51c-4bce-9578-e6350e822996.4365.25,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-21:9ba59572-f51c-4bce-9578-e6350e822996.4365.25,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:31.642 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:31.643+0000 7f877a97a640 -1 req 10539317089644793848 0.001999958s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-43:9ba59572-f51c-4bce-9578-e6350e822996.4816.12,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-43:9ba59572-f51c-4bce-9578-e6350e822996.4816.12,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:31.649 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:31.650+0000 7f87d422d640 -1 req 3741056572461018721 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-33:9ba59572-f51c-4bce-9578-e6350e822996.4816.2,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-33:9ba59572-f51c-4bce-9578-e6350e822996.4816.2,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:31.651 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:31.652+0000 7f87df243640 -1 req 11066143678937396452 0.002999935s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-35:9ba59572-f51c-4bce-9578-e6350e822996.4816.4,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-35:9ba59572-f51c-4bce-9578-e6350e822996.4816.4,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:31.692 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:31.693+0000 7f87300e5640 -1 req 3236514286130493171 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-1:9ba59572-f51c-4bce-9578-e6350e822996.4365.1,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:31.694 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:31.695+0000 7f86ee061640 -1 req 2980888092269796156 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-23:9ba59572-f51c-4bce-9578-e6350e822996.4365.27,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-23:9ba59572-f51c-4bce-9578-e6350e822996.4365.27,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:31.763 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:31.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:31.763 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket cjqttm-50 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:16:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:31.808 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:31.878 INFO:teuthology.orchestra.run.smithi016.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":15,"hash_type":"Mod"}}},"logs":[{"gen":1,"layout":{"type":"InIndex","in_index":{"gen":1,"layout":{"num_shards":13,"hash_type":"Mod"}}}},{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":15,"hash_type":"Mod"}}}}]}} 2024-04-16T18:16:31.879 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:31.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:31.879 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:16:31.921 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:31.921 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:32.051 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:32.052+0000 7f87208c6640 -1 req 16462388381740010584 0.002999935s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-3:9ba59572-f51c-4bce-9578-e6350e822996.4365.3,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-3:9ba59572-f51c-4bce-9578-e6350e822996.4365.3,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:32.156 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:16:32.157+0000 7f876a95a640 -1 req 5441482858565555451 0.001999957s :get_bucket_index_log_status ERROR: rgw_read_bucket_full_sync_status() on pipe={s={b=cjqttm-5:9ba59572-f51c-4bce-9578-e6350e822996.4365.9,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=cjqttm-5:9ba59572-f51c-4bce-9578-e6350e822996.4365.9,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} returned ret=-2 2024-04-16T18:16:32.227 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:32.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'layout', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:16:32.227 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket layout --bucket cjqttm-50 --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:16:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:32.312 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:32.381 INFO:teuthology.orchestra.run.smithi016.stdout:{"layout":{"resharding":"None","current_index":{"gen":2,"layout":{"type":"Normal","normal":{"num_shards":15,"hash_type":"Mod"}}},"logs":[{"gen":2,"layout":{"type":"InIndex","in_index":{"gen":2,"layout":{"num_shards":15,"hash_type":"Mod"}}}}]}} 2024-04-16T18:16:37.382 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:37.382 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:37.382 DEBUG:boto:Method: HEAD 2024-04-16T18:16:37.382 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:37.382 DEBUG:boto:Data: 2024-04-16T18:16:37.383 DEBUG:boto:Headers: {} 2024-04-16T18:16:37.383 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.383 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.383 DEBUG:boto:Params: {} 2024-04-16T18:16:37.383 DEBUG:boto:Token: None 2024-04-16T18:16:37.383 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/ 2024-04-16T18:16:37.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE= 2024-04-16T18:16:37.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE=', 'Content-Length': '0'} 2024-04-16T18:16:37.386 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ed319f5174e2877e-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.386 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:16:37.386 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:16:37.387 DEBUG:boto:Method: PUT 2024-04-16T18:16:37.387 DEBUG:boto:Path: /cjqttm-50/i 2024-04-16T18:16:37.387 DEBUG:boto:Data: 2024-04-16T18:16:37.387 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:16:37.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.387 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.387 DEBUG:boto:Params: {} 2024-04-16T18:16:37.387 DEBUG:boto:Token: None 2024-04-16T18:16:37.387 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/i 2024-04-16T18:16:37.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wsisMyDwcktY/TIZ0gDsmMD1btg= 2024-04-16T18:16:37.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wsisMyDwcktY/TIZ0gDsmMD1btg='} 2024-04-16T18:16:37.395 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006654ab9e684d6886-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.395 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:37.395 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:37.395 DEBUG:boto:Method: HEAD 2024-04-16T18:16:37.395 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:37.395 DEBUG:boto:Data: 2024-04-16T18:16:37.395 DEBUG:boto:Headers: {} 2024-04-16T18:16:37.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.395 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.396 DEBUG:boto:Params: {} 2024-04-16T18:16:37.396 DEBUG:boto:Token: None 2024-04-16T18:16:37.396 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/ 2024-04-16T18:16:37.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE= 2024-04-16T18:16:37.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE=', 'Content-Length': '0'} 2024-04-16T18:16:37.398 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007352b121a68d16b7-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.398 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:16:37.399 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:16:37.399 DEBUG:boto:Method: PUT 2024-04-16T18:16:37.399 DEBUG:boto:Path: /cjqttm-50/j 2024-04-16T18:16:37.399 DEBUG:boto:Data: 2024-04-16T18:16:37.399 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:16:37.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.399 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.399 DEBUG:boto:Params: {} 2024-04-16T18:16:37.399 DEBUG:boto:Token: None 2024-04-16T18:16:37.400 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/j 2024-04-16T18:16:37.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gXiPGX5uj0XFZ5g65SYAk4Y302w= 2024-04-16T18:16:37.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gXiPGX5uj0XFZ5g65SYAk4Y302w='} 2024-04-16T18:16:37.406 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000033806017144843c5-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.406 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:37.406 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:37.407 DEBUG:boto:Method: HEAD 2024-04-16T18:16:37.407 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:37.407 DEBUG:boto:Data: 2024-04-16T18:16:37.407 DEBUG:boto:Headers: {} 2024-04-16T18:16:37.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.407 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.407 DEBUG:boto:Params: {} 2024-04-16T18:16:37.407 DEBUG:boto:Token: None 2024-04-16T18:16:37.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/ 2024-04-16T18:16:37.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE= 2024-04-16T18:16:37.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE=', 'Content-Length': '0'} 2024-04-16T18:16:37.410 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fab20738112b9178-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.410 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:16:37.410 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:16:37.410 DEBUG:boto:Method: PUT 2024-04-16T18:16:37.410 DEBUG:boto:Path: /cjqttm-50/k 2024-04-16T18:16:37.410 DEBUG:boto:Data: 2024-04-16T18:16:37.410 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:16:37.410 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.411 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.411 DEBUG:boto:Params: {} 2024-04-16T18:16:37.411 DEBUG:boto:Token: None 2024-04-16T18:16:37.411 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/k 2024-04-16T18:16:37.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K26MxOWoreM7CrZevc0NGCWPQLQ= 2024-04-16T18:16:37.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K26MxOWoreM7CrZevc0NGCWPQLQ='} 2024-04-16T18:16:37.454 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f2610e69ba723365-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.455 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:16:37.455 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:16:37.455 DEBUG:boto:Method: HEAD 2024-04-16T18:16:37.455 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:16:37.455 DEBUG:boto:Data: 2024-04-16T18:16:37.455 DEBUG:boto:Headers: {} 2024-04-16T18:16:37.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.455 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.455 DEBUG:boto:Params: {} 2024-04-16T18:16:37.455 DEBUG:boto:Token: None 2024-04-16T18:16:37.456 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/ 2024-04-16T18:16:37.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE= 2024-04-16T18:16:37.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xSEeG4L5VIS2UDEMbqdkCwoRJHE=', 'Content-Length': '0'} 2024-04-16T18:16:37.458 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006dad4de3e2f5e8a6-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.458 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:16:37.459 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:16:37.459 DEBUG:boto:Method: PUT 2024-04-16T18:16:37.459 DEBUG:boto:Path: /cjqttm-50/l 2024-04-16T18:16:37.459 DEBUG:boto:Data: 2024-04-16T18:16:37.459 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:16:37.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:16:37.459 DEBUG:boto:Port: 8000 2024-04-16T18:16:37.459 DEBUG:boto:Params: {} 2024-04-16T18:16:37.459 DEBUG:boto:Token: None 2024-04-16T18:16:37.460 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:16:37 GMT /cjqttm-50/l 2024-04-16T18:16:37.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qbD+AgQo042YKR1kUx/b/jLcQC0= 2024-04-16T18:16:37.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:16:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qbD+AgQo042YKR1kUx/b/jLcQC0='} 2024-04-16T18:16:37.466 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000320106b8fabd5310-00661ec085-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:16:37.466 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-50 2024-04-16T18:16:37.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:37.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:16:37.467 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:16:37.528 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:16:37.529 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:16:37.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:37.593+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:37.592 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , ] 2024-04-16T18:16:37.592 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:42.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:42.594+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:42.594 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:42.594 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:47.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:47.596+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:47.595 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:47.596 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:52.596 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:52.598+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:52.596 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:52.597 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:57.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:16:57.599+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:16:57.598 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:16:57.598 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:02.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:02.599+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:17:02.599 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:02.599 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:07.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:07.601+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:17:07.600 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:07.600 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:12.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:12.602+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:17:12.601 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:12.602 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:17.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:17.603+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:17:17.604 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:17.604 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:22.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:22.605+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:17:22.604 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:22.604 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:27.605 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:27.606+0000 7f772eee4800 1 waiting for incremental sync to catch up: 2024-04-16T18:17:27.606 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, , , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:27.606 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:32.607 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:32.608+0000 7f772eee4800 1 bucket sync caught up with source: 2024-04-16T18:17:32.607 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:32.608 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.60.6, 00000000002.39.6, , , , 00000000001.38.6, 00000000002.40.6, , , ] 2024-04-16T18:17:32.608 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:32.608+0000 7f772eee4800 0 bucket checkpoint complete 2024-04-16T18:17:32.634 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-50 2024-04-16T18:17:32.635 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:17:32.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-50', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:17:32.635 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-50 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:17:32.698 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:32.699 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:32.762 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:17:32.762+0000 7f090e72c800 1 waiting for incremental sync to catch up: 2024-04-16T18:17:32.762 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.90.6, 00000000002.247.6, 00000000001.749.6, , 00000000002.378.6, 00000000001.241.6, , , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:17:32.762 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000001.90.6, 00000000002.247.6, 00000000001.749.6, , 00000000002.378.6, 00000000001.241.6, 00000000001.324.6, , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:17:37.763 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:17:37.763+0000 7f090e72c800 1 bucket sync caught up with source: 2024-04-16T18:17:37.763 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.90.6, 00000000002.247.6, 00000000001.749.6, , 00000000002.378.6, 00000000001.241.6, 00000000001.324.6, , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:17:37.763 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000001.90.6, 00000000002.247.6, 00000000001.749.6, , 00000000002.378.6, 00000000001.241.6, 00000000001.324.6, , 00000000002.236.6, , 00000000002.334.6] 2024-04-16T18:17:37.764 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:17:37.763+0000 7f090e72c800 0 bucket checkpoint complete 2024-04-16T18:17:37.791 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:17:37.791 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.791 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.791 DEBUG:boto:Method: HEAD 2024-04-16T18:17:37.791 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:17:37.792 DEBUG:boto:Data: 2024-04-16T18:17:37.792 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.792 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.792 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.792 DEBUG:boto:Params: {} 2024-04-16T18:17:37.792 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:17:37.792 DEBUG:boto:Token: None 2024-04-16T18:17:37.793 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/ 2024-04-16T18:17:37.793 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MFFI+O7SYfiCrP70x/vbMPXrKQI= 2024-04-16T18:17:37.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MFFI+O7SYfiCrP70x/vbMPXrKQI=', 'Content-Length': '0'} 2024-04-16T18:17:37.798 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fcab4fceb35fd425-00661ec0c1-5447-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.799 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.799 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.799 DEBUG:boto:Method: HEAD 2024-04-16T18:17:37.799 DEBUG:boto:Path: /cjqttm-50/ 2024-04-16T18:17:37.799 DEBUG:boto:Data: 2024-04-16T18:17:37.799 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.799 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.799 DEBUG:boto:Params: {} 2024-04-16T18:17:37.800 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:17:37.800 DEBUG:boto:Token: None 2024-04-16T18:17:37.800 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/ 2024-04-16T18:17:37.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MFFI+O7SYfiCrP70x/vbMPXrKQI= 2024-04-16T18:17:37.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MFFI+O7SYfiCrP70x/vbMPXrKQI=', 'Content-Length': '0'} 2024-04-16T18:17:37.804 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000964102f1b34f159e-00661ec0c1-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.804 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:17:37.804 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.804 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.804 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.804 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.805 DEBUG:boto:Method: GET 2024-04-16T18:17:37.805 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.805 DEBUG:boto:Data: 2024-04-16T18:17:37.805 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.805 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.805 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.805 DEBUG:boto:Params: {} 2024-04-16T18:17:37.805 DEBUG:boto:Token: None 2024-04-16T18:17:37.805 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/?versions 2024-04-16T18:17:37.805 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w= 2024-04-16T18:17:37.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w=', 'Content-Length': '0'} 2024-04-16T18:17:37.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007011a0d56a677969-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.808 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalinulltrue2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaljnulltrue2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalknulltrue2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normallnulltrue2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:37.809 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:17:37.809 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=i 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=j 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=k 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:o=l 2024-04-16T18:17:37.810 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:17:37.811 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.811 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.811 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.811 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.811 DEBUG:boto:Method: GET 2024-04-16T18:17:37.811 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.811 DEBUG:boto:Data: 2024-04-16T18:17:37.811 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.811 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.811 DEBUG:boto:Params: {} 2024-04-16T18:17:37.811 DEBUG:boto:Token: None 2024-04-16T18:17:37.812 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/?versions 2024-04-16T18:17:37.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w= 2024-04-16T18:17:37.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w=', 'Content-Length': '0'} 2024-04-16T18:17:37.814 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acdec786f8828088-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.814 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalinulltrue2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaljnulltrue2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalknulltrue2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normallnulltrue2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:37.815 DEBUG:tasks.rgw_multi.zone_rados:o=a 2024-04-16T18:17:37.815 DEBUG:tasks.rgw_multi.zone_rados:o=b 2024-04-16T18:17:37.815 DEBUG:tasks.rgw_multi.zone_rados:o=c 2024-04-16T18:17:37.815 DEBUG:tasks.rgw_multi.zone_rados:o=d 2024-04-16T18:17:37.815 DEBUG:tasks.rgw_multi.zone_rados:o=e 2024-04-16T18:17:37.815 DEBUG:tasks.rgw_multi.zone_rados:o=f 2024-04-16T18:17:37.815 DEBUG:tasks.rgw_multi.zone_rados:o=g 2024-04-16T18:17:37.816 DEBUG:tasks.rgw_multi.zone_rados:o=h 2024-04-16T18:17:37.816 DEBUG:tasks.rgw_multi.zone_rados:o=i 2024-04-16T18:17:37.816 DEBUG:tasks.rgw_multi.zone_rados:o=j 2024-04-16T18:17:37.816 DEBUG:tasks.rgw_multi.zone_rados:o=k 2024-04-16T18:17:37.816 DEBUG:tasks.rgw_multi.zone_rados:o=l 2024-04-16T18:17:37.816 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.816 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.816 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.816 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.816 DEBUG:boto:Method: GET 2024-04-16T18:17:37.816 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.816 DEBUG:boto:Data: 2024-04-16T18:17:37.817 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.817 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.817 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.817 DEBUG:boto:Params: {} 2024-04-16T18:17:37.817 DEBUG:boto:Token: None 2024-04-16T18:17:37.817 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/?versions 2024-04-16T18:17:37.817 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w= 2024-04-16T18:17:37.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w=', 'Content-Length': '0'} 2024-04-16T18:17:37.820 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc0030b6f0ff8e85-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.820 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalinulltrue2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaljnulltrue2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalknulltrue2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normallnulltrue2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:37.821 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.821 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.821 DEBUG:boto:path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.821 DEBUG:boto:auth_path=/cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.821 DEBUG:boto:Method: GET 2024-04-16T18:17:37.821 DEBUG:boto:Path: /cjqttm-50/?versions&max-keys=999 2024-04-16T18:17:37.821 DEBUG:boto:Data: 2024-04-16T18:17:37.821 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.821 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.822 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.822 DEBUG:boto:Params: {} 2024-04-16T18:17:37.822 DEBUG:boto:Token: None 2024-04-16T18:17:37.822 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/?versions 2024-04-16T18:17:37.822 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w= 2024-04-16T18:17:37.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HXvMy4AZ7K44oKddfxLCmhDAb+w=', 'Content-Length': '0'} 2024-04-16T18:17:37.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4c8d42d46a40867-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.825 DEBUG:boto:b'cjqttm-50999falseanulltrue2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalbnulltrue2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalcnulltrue2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaldnulltrue2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalenulltrue2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalfnulltrue2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalgnulltrue2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalhnulltrue2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalinulltrue2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normaljnulltrue2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalknulltrue2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normallnulltrue2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:37.826 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:17:37.826 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.826 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.826 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.826 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.826 DEBUG:boto:Method: GET 2024-04-16T18:17:37.826 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.826 DEBUG:boto:Data: 2024-04-16T18:17:37.827 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.827 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.827 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.827 DEBUG:boto:Params: {} 2024-04-16T18:17:37.827 DEBUG:boto:Token: None 2024-04-16T18:17:37.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ= 2024-04-16T18:17:37.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ=', 'Content-Length': '0'} 2024-04-16T18:17:37.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007538fbca8b532884-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.870 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.870 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.871 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.871 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.871 DEBUG:boto:Method: GET 2024-04-16T18:17:37.871 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.871 DEBUG:boto:Data: 2024-04-16T18:17:37.871 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.871 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.871 DEBUG:boto:Params: {} 2024-04-16T18:17:37.871 DEBUG:boto:Token: None 2024-04-16T18:17:37.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ= 2024-04-16T18:17:37.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ=', 'Content-Length': '0'} 2024-04-16T18:17:37.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aa0e826a94f7da6-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.874 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.874 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.874 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.874 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.874 DEBUG:boto:Method: HEAD 2024-04-16T18:17:37.874 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.875 DEBUG:boto:Data: 2024-04-16T18:17:37.875 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.875 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.875 DEBUG:boto:Params: {} 2024-04-16T18:17:37.875 DEBUG:boto:Token: None 2024-04-16T18:17:37.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ASkGhdBRXAu46hYt2MexEOwUmgs= 2024-04-16T18:17:37.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ASkGhdBRXAu46hYt2MexEOwUmgs=', 'Content-Length': '0'} 2024-04-16T18:17:37.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e680b3f8fd502f8c-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.877 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.877 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.877 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.877 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.878 DEBUG:boto:Method: HEAD 2024-04-16T18:17:37.878 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.878 DEBUG:boto:Data: 2024-04-16T18:17:37.878 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.878 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.878 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.878 DEBUG:boto:Params: {} 2024-04-16T18:17:37.878 DEBUG:boto:Token: None 2024-04-16T18:17:37.878 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.878 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ASkGhdBRXAu46hYt2MexEOwUmgs= 2024-04-16T18:17:37.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ASkGhdBRXAu46hYt2MexEOwUmgs=', 'Content-Length': '0'} 2024-04-16T18:17:37.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ca6bce29add2ed8-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:17:37.880 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.881 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.881 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.881 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.881 DEBUG:boto:Method: GET 2024-04-16T18:17:37.881 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.881 DEBUG:boto:Data: 2024-04-16T18:17:37.881 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.881 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.881 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.881 DEBUG:boto:Params: {} 2024-04-16T18:17:37.881 DEBUG:boto:Token: None 2024-04-16T18:17:37.882 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.882 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ= 2024-04-16T18:17:37.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ=', 'Content-Length': '0'} 2024-04-16T18:17:37.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012dacf7c6b6d047a-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.884 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.884 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.884 DEBUG:boto:path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.884 DEBUG:boto:auth_path=/cjqttm-50/a?versionId=null 2024-04-16T18:17:37.884 DEBUG:boto:Method: GET 2024-04-16T18:17:37.884 DEBUG:boto:Path: /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.884 DEBUG:boto:Data: 2024-04-16T18:17:37.884 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.884 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.885 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.885 DEBUG:boto:Params: {} 2024-04-16T18:17:37.885 DEBUG:boto:Token: None 2024-04-16T18:17:37.885 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a?versionId=null 2024-04-16T18:17:37.885 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ= 2024-04-16T18:17:37.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T6Ul4PjHX5vDUQw27lhTiyW0xSQ=', 'Content-Length': '0'} 2024-04-16T18:17:37.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad5dd1f29f90869d-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.887 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.887 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.887 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.887 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.887 DEBUG:boto:Method: GET 2024-04-16T18:17:37.888 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:17:37.888 DEBUG:boto:Data: 2024-04-16T18:17:37.888 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.888 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.888 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.888 DEBUG:boto:Params: {} 2024-04-16T18:17:37.888 DEBUG:boto:Token: None 2024-04-16T18:17:37.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/ 2024-04-16T18:17:37.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0= 2024-04-16T18:17:37.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0=', 'Content-Length': '0'} 2024-04-16T18:17:37.891 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000977ce0b6b11900d4-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.891 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:37.891 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.891 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.891 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.891 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.892 DEBUG:boto:Method: GET 2024-04-16T18:17:37.892 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:17:37.892 DEBUG:boto:Data: 2024-04-16T18:17:37.892 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.892 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.892 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.892 DEBUG:boto:Params: {} 2024-04-16T18:17:37.892 DEBUG:boto:Token: None 2024-04-16T18:17:37.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/ 2024-04-16T18:17:37.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0= 2024-04-16T18:17:37.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0=', 'Content-Length': '0'} 2024-04-16T18:17:37.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000106a0b88028e3fcc-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.938 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:37.938 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.939 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.939 DEBUG:boto:Method: HEAD 2024-04-16T18:17:37.939 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:17:37.939 DEBUG:boto:Data: 2024-04-16T18:17:37.939 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.939 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.939 DEBUG:boto:Params: {} 2024-04-16T18:17:37.939 DEBUG:boto:Token: None 2024-04-16T18:17:37.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a 2024-04-16T18:17:37.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SwP9g0Sn1cIr3Jv3LNHgLGr9lX4= 2024-04-16T18:17:37.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SwP9g0Sn1cIr3Jv3LNHgLGr9lX4=', 'Content-Length': '0'} 2024-04-16T18:17:37.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f61def48763eeca-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.942 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.942 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.942 DEBUG:boto:Method: HEAD 2024-04-16T18:17:37.942 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:17:37.942 DEBUG:boto:Data: 2024-04-16T18:17:37.942 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.942 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.942 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.942 DEBUG:boto:Params: {} 2024-04-16T18:17:37.942 DEBUG:boto:Token: None 2024-04-16T18:17:37.943 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a 2024-04-16T18:17:37.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SwP9g0Sn1cIr3Jv3LNHgLGr9lX4= 2024-04-16T18:17:37.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SwP9g0Sn1cIr3Jv3LNHgLGr9lX4=', 'Content-Length': '0'} 2024-04-16T18:17:37.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bad5a7d6d6a855fb-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2024-04-16T18:17:37.945 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.945 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.945 DEBUG:boto:Method: GET 2024-04-16T18:17:37.945 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:17:37.945 DEBUG:boto:Data: 2024-04-16T18:17:37.945 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.945 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.945 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.946 DEBUG:boto:Params: {} 2024-04-16T18:17:37.946 DEBUG:boto:Token: None 2024-04-16T18:17:37.946 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a 2024-04-16T18:17:37.946 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bji++ZUp24dFLnQKRDxVydFhhFk= 2024-04-16T18:17:37.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bji++ZUp24dFLnQKRDxVydFhhFk=', 'Content-Length': '0'} 2024-04-16T18:17:37.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b13af14c6486a898-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.990 DEBUG:boto:path=/cjqttm-50/a 2024-04-16T18:17:37.990 DEBUG:boto:auth_path=/cjqttm-50/a 2024-04-16T18:17:37.991 DEBUG:boto:Method: GET 2024-04-16T18:17:37.991 DEBUG:boto:Path: /cjqttm-50/a 2024-04-16T18:17:37.991 DEBUG:boto:Data: 2024-04-16T18:17:37.991 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.991 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.991 DEBUG:boto:Params: {} 2024-04-16T18:17:37.991 DEBUG:boto:Token: None 2024-04-16T18:17:37.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/a 2024-04-16T18:17:37.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bji++ZUp24dFLnQKRDxVydFhhFk= 2024-04-16T18:17:37.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bji++ZUp24dFLnQKRDxVydFhhFk=', 'Content-Length': '0'} 2024-04-16T18:17:37.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000793d28fad7a80e28-00661ec0c1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.994 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.994 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.994 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.994 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.994 DEBUG:boto:Method: GET 2024-04-16T18:17:37.994 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:17:37.994 DEBUG:boto:Data: 2024-04-16T18:17:37.994 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.994 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:37.994 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.994 DEBUG:boto:Params: {} 2024-04-16T18:17:37.995 DEBUG:boto:Token: None 2024-04-16T18:17:37.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/ 2024-04-16T18:17:37.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0= 2024-04-16T18:17:37.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0=', 'Content-Length': '0'} 2024-04-16T18:17:37.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fdd7fbe166570a32-00661ec0c1-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:37 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:37.997 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:37.998 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:37.998 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:37.998 DEBUG:boto:path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.998 DEBUG:boto:auth_path=/cjqttm-50/?prefix=a 2024-04-16T18:17:37.998 DEBUG:boto:Method: GET 2024-04-16T18:17:37.998 DEBUG:boto:Path: /cjqttm-50/?prefix=a 2024-04-16T18:17:37.998 DEBUG:boto:Data: 2024-04-16T18:17:37.998 DEBUG:boto:Headers: {} 2024-04-16T18:17:37.998 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:37.998 DEBUG:boto:Port: 8000 2024-04-16T18:17:37.999 DEBUG:boto:Params: {} 2024-04-16T18:17:37.999 DEBUG:boto:Token: None 2024-04-16T18:17:37.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:37 GMT /cjqttm-50/ 2024-04-16T18:17:37.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0= 2024-04-16T18:17:37.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:37 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sZLTwq3q36J6CXmphPGSYnEiRE0=', 'Content-Length': '0'} 2024-04-16T18:17:38.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd14be6ec575aed1-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.002 DEBUG:boto:b'cjqttm-50a1000falsea2024-04-16T18:15:35.047Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.002 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:17:38.002 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.002 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.002 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.002 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.003 DEBUG:boto:Method: GET 2024-04-16T18:17:38.003 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.003 DEBUG:boto:Data: 2024-04-16T18:17:38.003 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.003 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.003 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.003 DEBUG:boto:Params: {} 2024-04-16T18:17:38.003 DEBUG:boto:Token: None 2024-04-16T18:17:38.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI= 2024-04-16T18:17:38.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI=', 'Content-Length': '0'} 2024-04-16T18:17:38.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b41d392d04c2192-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.046 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.047 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.047 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.047 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.047 DEBUG:boto:Method: GET 2024-04-16T18:17:38.047 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.047 DEBUG:boto:Data: 2024-04-16T18:17:38.047 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.047 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.047 DEBUG:boto:Params: {} 2024-04-16T18:17:38.047 DEBUG:boto:Token: None 2024-04-16T18:17:38.048 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI= 2024-04-16T18:17:38.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI=', 'Content-Length': '0'} 2024-04-16T18:17:38.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000000216a81232c638-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.051 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.051 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.051 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.051 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.051 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.051 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.051 DEBUG:boto:Data: 2024-04-16T18:17:38.051 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.051 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.052 DEBUG:boto:Params: {} 2024-04-16T18:17:38.052 DEBUG:boto:Token: None 2024-04-16T18:17:38.052 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oUEgrwylw2uLuknKkSxXHim8vG8= 2024-04-16T18:17:38.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oUEgrwylw2uLuknKkSxXHim8vG8=', 'Content-Length': '0'} 2024-04-16T18:17:38.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d64a63fe02d2b13-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.054 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.055 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.055 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.055 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.055 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.055 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.055 DEBUG:boto:Data: 2024-04-16T18:17:38.055 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.055 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.055 DEBUG:boto:Params: {} 2024-04-16T18:17:38.055 DEBUG:boto:Token: None 2024-04-16T18:17:38.056 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oUEgrwylw2uLuknKkSxXHim8vG8= 2024-04-16T18:17:38.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oUEgrwylw2uLuknKkSxXHim8vG8=', 'Content-Length': '0'} 2024-04-16T18:17:38.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044e80851275527b0-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.058 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:17:38.058 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.058 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.058 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.058 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.058 DEBUG:boto:Method: GET 2024-04-16T18:17:38.059 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.059 DEBUG:boto:Data: 2024-04-16T18:17:38.059 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.059 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.059 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.059 DEBUG:boto:Params: {} 2024-04-16T18:17:38.059 DEBUG:boto:Token: None 2024-04-16T18:17:38.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI= 2024-04-16T18:17:38.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI=', 'Content-Length': '0'} 2024-04-16T18:17:38.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f4ba8d0c3442e5a-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.102 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.102 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.102 DEBUG:boto:path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.103 DEBUG:boto:auth_path=/cjqttm-50/b?versionId=null 2024-04-16T18:17:38.103 DEBUG:boto:Method: GET 2024-04-16T18:17:38.103 DEBUG:boto:Path: /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.103 DEBUG:boto:Data: 2024-04-16T18:17:38.103 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.103 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.103 DEBUG:boto:Params: {} 2024-04-16T18:17:38.103 DEBUG:boto:Token: None 2024-04-16T18:17:38.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b?versionId=null 2024-04-16T18:17:38.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI= 2024-04-16T18:17:38.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kva7uCvPV1kFTOCeOrF9Cd0FleI=', 'Content-Length': '0'} 2024-04-16T18:17:38.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c71c751a1e29843d-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.106 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.106 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.106 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.106 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.106 DEBUG:boto:Method: GET 2024-04-16T18:17:38.106 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:17:38.106 DEBUG:boto:Data: 2024-04-16T18:17:38.107 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.107 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.107 DEBUG:boto:Params: {} 2024-04-16T18:17:38.107 DEBUG:boto:Token: None 2024-04-16T18:17:38.107 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.110 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009dc187d52275f193-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.110 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.110 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.111 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.111 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.111 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.111 DEBUG:boto:Method: GET 2024-04-16T18:17:38.111 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:17:38.111 DEBUG:boto:Data: 2024-04-16T18:17:38.111 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.111 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.111 DEBUG:boto:Params: {} 2024-04-16T18:17:38.111 DEBUG:boto:Token: None 2024-04-16T18:17:38.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000596471533d07deed-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.115 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.115 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.115 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.115 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.115 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:17:38.115 DEBUG:boto:Data: 2024-04-16T18:17:38.115 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.116 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.116 DEBUG:boto:Params: {} 2024-04-16T18:17:38.116 DEBUG:boto:Token: None 2024-04-16T18:17:38.116 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b 2024-04-16T18:17:38.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wByxRIOKaal7TtGUIaytq0awfNw= 2024-04-16T18:17:38.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wByxRIOKaal7TtGUIaytq0awfNw=', 'Content-Length': '0'} 2024-04-16T18:17:38.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f190a3bed7a5cf3-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.119 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.119 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.119 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.119 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:17:38.119 DEBUG:boto:Data: 2024-04-16T18:17:38.119 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.119 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.119 DEBUG:boto:Params: {} 2024-04-16T18:17:38.119 DEBUG:boto:Token: None 2024-04-16T18:17:38.120 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b 2024-04-16T18:17:38.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wByxRIOKaal7TtGUIaytq0awfNw= 2024-04-16T18:17:38.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wByxRIOKaal7TtGUIaytq0awfNw=', 'Content-Length': '0'} 2024-04-16T18:17:38.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a9b7d26a1ff3a58-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2024-04-16T18:17:38.122 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.122 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.122 DEBUG:boto:Method: GET 2024-04-16T18:17:38.122 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:17:38.122 DEBUG:boto:Data: 2024-04-16T18:17:38.123 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.123 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.123 DEBUG:boto:Params: {} 2024-04-16T18:17:38.123 DEBUG:boto:Token: None 2024-04-16T18:17:38.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b 2024-04-16T18:17:38.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMk/wNALUxZ4wURkC8w54P0i4Sc= 2024-04-16T18:17:38.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMk/wNALUxZ4wURkC8w54P0i4Sc=', 'Content-Length': '0'} 2024-04-16T18:17:38.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa4f78d965d2f741-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.166 DEBUG:boto:path=/cjqttm-50/b 2024-04-16T18:17:38.167 DEBUG:boto:auth_path=/cjqttm-50/b 2024-04-16T18:17:38.167 DEBUG:boto:Method: GET 2024-04-16T18:17:38.167 DEBUG:boto:Path: /cjqttm-50/b 2024-04-16T18:17:38.167 DEBUG:boto:Data: 2024-04-16T18:17:38.167 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.167 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.167 DEBUG:boto:Params: {} 2024-04-16T18:17:38.167 DEBUG:boto:Token: None 2024-04-16T18:17:38.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/b 2024-04-16T18:17:38.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMk/wNALUxZ4wURkC8w54P0i4Sc= 2024-04-16T18:17:38.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMk/wNALUxZ4wURkC8w54P0i4Sc=', 'Content-Length': '0'} 2024-04-16T18:17:38.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008619f9b48e4be0c5-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.170 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.170 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.170 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.170 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.170 DEBUG:boto:Method: GET 2024-04-16T18:17:38.170 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:17:38.171 DEBUG:boto:Data: 2024-04-16T18:17:38.171 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.171 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.171 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.171 DEBUG:boto:Params: {} 2024-04-16T18:17:38.171 DEBUG:boto:Token: None 2024-04-16T18:17:38.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000beb2e63fab8c1f4c-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.174 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.174 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.174 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.174 DEBUG:boto:path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.175 DEBUG:boto:auth_path=/cjqttm-50/?prefix=b 2024-04-16T18:17:38.175 DEBUG:boto:Method: GET 2024-04-16T18:17:38.175 DEBUG:boto:Path: /cjqttm-50/?prefix=b 2024-04-16T18:17:38.175 DEBUG:boto:Data: 2024-04-16T18:17:38.175 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.175 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.175 DEBUG:boto:Params: {} 2024-04-16T18:17:38.175 DEBUG:boto:Token: None 2024-04-16T18:17:38.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b6a6dcee2f5089b-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.178 DEBUG:boto:b'cjqttm-50b1000falseb2024-04-16T18:15:35.095Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.178 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:17:38.178 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.179 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.179 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.179 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.179 DEBUG:boto:Method: GET 2024-04-16T18:17:38.179 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.179 DEBUG:boto:Data: 2024-04-16T18:17:38.179 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.179 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.179 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.179 DEBUG:boto:Params: {} 2024-04-16T18:17:38.179 DEBUG:boto:Token: None 2024-04-16T18:17:38.179 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM= 2024-04-16T18:17:38.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM=', 'Content-Length': '0'} 2024-04-16T18:17:38.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012f16301ff70f9a8-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.222 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.222 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.223 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.223 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.223 DEBUG:boto:Method: GET 2024-04-16T18:17:38.223 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.223 DEBUG:boto:Data: 2024-04-16T18:17:38.223 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.223 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.223 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.223 DEBUG:boto:Params: {} 2024-04-16T18:17:38.223 DEBUG:boto:Token: None 2024-04-16T18:17:38.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM= 2024-04-16T18:17:38.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM=', 'Content-Length': '0'} 2024-04-16T18:17:38.226 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000103fe74365d0b654-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.226 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.226 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.226 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.226 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.226 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.226 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.226 DEBUG:boto:Data: 2024-04-16T18:17:38.227 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.227 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.227 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.227 DEBUG:boto:Params: {} 2024-04-16T18:17:38.227 DEBUG:boto:Token: None 2024-04-16T18:17:38.227 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.227 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6Gp+01vDsu4xDtonm2zKAz2czjc= 2024-04-16T18:17:38.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6Gp+01vDsu4xDtonm2zKAz2czjc=', 'Content-Length': '0'} 2024-04-16T18:17:38.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df85e76f22266a7f-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.229 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.230 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.230 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.230 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.230 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.230 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.230 DEBUG:boto:Data: 2024-04-16T18:17:38.230 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.230 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.230 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.230 DEBUG:boto:Params: {} 2024-04-16T18:17:38.231 DEBUG:boto:Token: None 2024-04-16T18:17:38.231 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6Gp+01vDsu4xDtonm2zKAz2czjc= 2024-04-16T18:17:38.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6Gp+01vDsu4xDtonm2zKAz2czjc=', 'Content-Length': '0'} 2024-04-16T18:17:38.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cdfc9c1fcf04fff-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:17:38.233 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.233 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.233 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.234 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.234 DEBUG:boto:Method: GET 2024-04-16T18:17:38.234 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.234 DEBUG:boto:Data: 2024-04-16T18:17:38.234 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.234 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.234 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.234 DEBUG:boto:Params: {} 2024-04-16T18:17:38.234 DEBUG:boto:Token: None 2024-04-16T18:17:38.234 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM= 2024-04-16T18:17:38.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM=', 'Content-Length': '0'} 2024-04-16T18:17:38.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e47299192d7bc8b0-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.278 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.278 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.279 DEBUG:boto:path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.279 DEBUG:boto:auth_path=/cjqttm-50/c?versionId=null 2024-04-16T18:17:38.279 DEBUG:boto:Method: GET 2024-04-16T18:17:38.279 DEBUG:boto:Path: /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.279 DEBUG:boto:Data: 2024-04-16T18:17:38.279 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.279 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.279 DEBUG:boto:Params: {} 2024-04-16T18:17:38.279 DEBUG:boto:Token: None 2024-04-16T18:17:38.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c?versionId=null 2024-04-16T18:17:38.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM= 2024-04-16T18:17:38.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XI5oS6wZzL8nxgm2kfps/S03ihM=', 'Content-Length': '0'} 2024-04-16T18:17:38.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7089f93f22a396d-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.282 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.282 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.282 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.282 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.282 DEBUG:boto:Method: GET 2024-04-16T18:17:38.282 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:17:38.282 DEBUG:boto:Data: 2024-04-16T18:17:38.282 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.282 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.283 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.283 DEBUG:boto:Params: {} 2024-04-16T18:17:38.283 DEBUG:boto:Token: None 2024-04-16T18:17:38.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea76189234b992d5-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.286 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.286 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.286 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.286 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.286 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.286 DEBUG:boto:Method: GET 2024-04-16T18:17:38.287 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:17:38.287 DEBUG:boto:Data: 2024-04-16T18:17:38.287 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.287 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.287 DEBUG:boto:Params: {} 2024-04-16T18:17:38.287 DEBUG:boto:Token: None 2024-04-16T18:17:38.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000373413479aebe516-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.290 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.290 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.290 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.290 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.291 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:17:38.291 DEBUG:boto:Data: 2024-04-16T18:17:38.291 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.291 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.291 DEBUG:boto:Params: {} 2024-04-16T18:17:38.291 DEBUG:boto:Token: None 2024-04-16T18:17:38.291 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c 2024-04-16T18:17:38.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3kErv5NFzisM7MLdCoHlyNUrPHs= 2024-04-16T18:17:38.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3kErv5NFzisM7MLdCoHlyNUrPHs=', 'Content-Length': '0'} 2024-04-16T18:17:38.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f77e25d397d5f9a2-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.294 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.294 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.294 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.294 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:17:38.294 DEBUG:boto:Data: 2024-04-16T18:17:38.294 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.294 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.294 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.294 DEBUG:boto:Params: {} 2024-04-16T18:17:38.295 DEBUG:boto:Token: None 2024-04-16T18:17:38.295 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c 2024-04-16T18:17:38.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3kErv5NFzisM7MLdCoHlyNUrPHs= 2024-04-16T18:17:38.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3kErv5NFzisM7MLdCoHlyNUrPHs=', 'Content-Length': '0'} 2024-04-16T18:17:38.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008493e5a201449a5c-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2024-04-16T18:17:38.298 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.298 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.298 DEBUG:boto:Method: GET 2024-04-16T18:17:38.298 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:17:38.298 DEBUG:boto:Data: 2024-04-16T18:17:38.298 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.298 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.298 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.298 DEBUG:boto:Params: {} 2024-04-16T18:17:38.298 DEBUG:boto:Token: None 2024-04-16T18:17:38.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c 2024-04-16T18:17:38.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4PimMNNiJ8YwD1zFAlxdLxPDA2w= 2024-04-16T18:17:38.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4PimMNNiJ8YwD1zFAlxdLxPDA2w=', 'Content-Length': '0'} 2024-04-16T18:17:38.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003595182bc8783afa-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.342 DEBUG:boto:path=/cjqttm-50/c 2024-04-16T18:17:38.342 DEBUG:boto:auth_path=/cjqttm-50/c 2024-04-16T18:17:38.343 DEBUG:boto:Method: GET 2024-04-16T18:17:38.343 DEBUG:boto:Path: /cjqttm-50/c 2024-04-16T18:17:38.343 DEBUG:boto:Data: 2024-04-16T18:17:38.343 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.343 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.343 DEBUG:boto:Params: {} 2024-04-16T18:17:38.343 DEBUG:boto:Token: None 2024-04-16T18:17:38.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/c 2024-04-16T18:17:38.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4PimMNNiJ8YwD1zFAlxdLxPDA2w= 2024-04-16T18:17:38.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4PimMNNiJ8YwD1zFAlxdLxPDA2w=', 'Content-Length': '0'} 2024-04-16T18:17:38.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fb768b26598f376-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.346 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.346 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.346 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.346 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.346 DEBUG:boto:Method: GET 2024-04-16T18:17:38.346 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:17:38.346 DEBUG:boto:Data: 2024-04-16T18:17:38.346 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.346 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.347 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.347 DEBUG:boto:Params: {} 2024-04-16T18:17:38.347 DEBUG:boto:Token: None 2024-04-16T18:17:38.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d998651b61cdbc22-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.349 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.350 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.350 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.350 DEBUG:boto:path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.350 DEBUG:boto:auth_path=/cjqttm-50/?prefix=c 2024-04-16T18:17:38.350 DEBUG:boto:Method: GET 2024-04-16T18:17:38.350 DEBUG:boto:Path: /cjqttm-50/?prefix=c 2024-04-16T18:17:38.350 DEBUG:boto:Data: 2024-04-16T18:17:38.350 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.350 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.351 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.351 DEBUG:boto:Params: {} 2024-04-16T18:17:38.351 DEBUG:boto:Token: None 2024-04-16T18:17:38.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.354 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e491be30a677881b-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.354 DEBUG:boto:b'cjqttm-50c1000falsec2024-04-16T18:15:35.106Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.354 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:17:38.354 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.354 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.354 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.354 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.355 DEBUG:boto:Method: GET 2024-04-16T18:17:38.355 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.355 DEBUG:boto:Data: 2024-04-16T18:17:38.355 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.355 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.355 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.355 DEBUG:boto:Params: {} 2024-04-16T18:17:38.355 DEBUG:boto:Token: None 2024-04-16T18:17:38.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8= 2024-04-16T18:17:38.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8=', 'Content-Length': '0'} 2024-04-16T18:17:38.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ac12101efb8e3da-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.402 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.402 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.403 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.403 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.403 DEBUG:boto:Method: GET 2024-04-16T18:17:38.403 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.403 DEBUG:boto:Data: 2024-04-16T18:17:38.403 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.403 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.403 DEBUG:boto:Params: {} 2024-04-16T18:17:38.403 DEBUG:boto:Token: None 2024-04-16T18:17:38.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8= 2024-04-16T18:17:38.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8=', 'Content-Length': '0'} 2024-04-16T18:17:38.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001824548c91c4b086-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.406 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.406 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.406 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.406 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.406 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.406 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.406 DEBUG:boto:Data: 2024-04-16T18:17:38.406 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.406 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.407 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.407 DEBUG:boto:Params: {} 2024-04-16T18:17:38.407 DEBUG:boto:Token: None 2024-04-16T18:17:38.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rz2NrHrHEtykwJcFhxKmWWnR+gs= 2024-04-16T18:17:38.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rz2NrHrHEtykwJcFhxKmWWnR+gs=', 'Content-Length': '0'} 2024-04-16T18:17:38.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffd24f309154cfb5-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.409 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.409 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.409 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.409 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.409 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.409 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.410 DEBUG:boto:Data: 2024-04-16T18:17:38.410 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.410 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.410 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.410 DEBUG:boto:Params: {} 2024-04-16T18:17:38.410 DEBUG:boto:Token: None 2024-04-16T18:17:38.410 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.410 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rz2NrHrHEtykwJcFhxKmWWnR+gs= 2024-04-16T18:17:38.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rz2NrHrHEtykwJcFhxKmWWnR+gs=', 'Content-Length': '0'} 2024-04-16T18:17:38.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008610c8efd7aef8c9-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.412 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:17:38.413 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.413 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.413 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.413 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.413 DEBUG:boto:Method: GET 2024-04-16T18:17:38.413 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.413 DEBUG:boto:Data: 2024-04-16T18:17:38.413 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.413 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.413 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.413 DEBUG:boto:Params: {} 2024-04-16T18:17:38.414 DEBUG:boto:Token: None 2024-04-16T18:17:38.414 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.414 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8= 2024-04-16T18:17:38.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8=', 'Content-Length': '0'} 2024-04-16T18:17:38.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078e7bf6909f1d39c-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.458 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.458 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.459 DEBUG:boto:path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.459 DEBUG:boto:auth_path=/cjqttm-50/d?versionId=null 2024-04-16T18:17:38.459 DEBUG:boto:Method: GET 2024-04-16T18:17:38.459 DEBUG:boto:Path: /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.459 DEBUG:boto:Data: 2024-04-16T18:17:38.459 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.459 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.459 DEBUG:boto:Params: {} 2024-04-16T18:17:38.459 DEBUG:boto:Token: None 2024-04-16T18:17:38.460 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d?versionId=null 2024-04-16T18:17:38.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8= 2024-04-16T18:17:38.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/ZtM+oCUzmGEhybIHZFxfh8gy8=', 'Content-Length': '0'} 2024-04-16T18:17:38.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078838cf42729a009-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.462 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.462 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.462 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.463 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.463 DEBUG:boto:Method: GET 2024-04-16T18:17:38.463 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:17:38.463 DEBUG:boto:Data: 2024-04-16T18:17:38.463 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.463 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.463 DEBUG:boto:Params: {} 2024-04-16T18:17:38.463 DEBUG:boto:Token: None 2024-04-16T18:17:38.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.466 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000953cf744d62a2d91-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.466 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.466 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.467 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.467 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.467 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.467 DEBUG:boto:Method: GET 2024-04-16T18:17:38.467 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:17:38.467 DEBUG:boto:Data: 2024-04-16T18:17:38.467 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.467 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.467 DEBUG:boto:Params: {} 2024-04-16T18:17:38.467 DEBUG:boto:Token: None 2024-04-16T18:17:38.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.470 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e8a26c225c633b4-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.470 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.470 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.471 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.471 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.471 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:17:38.471 DEBUG:boto:Data: 2024-04-16T18:17:38.471 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.471 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.471 DEBUG:boto:Params: {} 2024-04-16T18:17:38.471 DEBUG:boto:Token: None 2024-04-16T18:17:38.472 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d 2024-04-16T18:17:38.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vWPYHA+BVgem8bsnP62mPS8QP3Y= 2024-04-16T18:17:38.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vWPYHA+BVgem8bsnP62mPS8QP3Y=', 'Content-Length': '0'} 2024-04-16T18:17:38.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6533f03ed529f13-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.474 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.474 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.474 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.474 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:17:38.474 DEBUG:boto:Data: 2024-04-16T18:17:38.474 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.474 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.475 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.475 DEBUG:boto:Params: {} 2024-04-16T18:17:38.475 DEBUG:boto:Token: None 2024-04-16T18:17:38.475 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d 2024-04-16T18:17:38.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vWPYHA+BVgem8bsnP62mPS8QP3Y= 2024-04-16T18:17:38.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vWPYHA+BVgem8bsnP62mPS8QP3Y=', 'Content-Length': '0'} 2024-04-16T18:17:38.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048b9f8d03015ad51-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2024-04-16T18:17:38.477 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.477 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.477 DEBUG:boto:Method: GET 2024-04-16T18:17:38.477 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:17:38.477 DEBUG:boto:Data: 2024-04-16T18:17:38.478 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.478 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.478 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.478 DEBUG:boto:Params: {} 2024-04-16T18:17:38.478 DEBUG:boto:Token: None 2024-04-16T18:17:38.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d 2024-04-16T18:17:38.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2w/UnZi9+M1nf9KAyAFyBKvzfFc= 2024-04-16T18:17:38.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2w/UnZi9+M1nf9KAyAFyBKvzfFc=', 'Content-Length': '0'} 2024-04-16T18:17:38.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006681b6de82146934-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.522 DEBUG:boto:path=/cjqttm-50/d 2024-04-16T18:17:38.523 DEBUG:boto:auth_path=/cjqttm-50/d 2024-04-16T18:17:38.523 DEBUG:boto:Method: GET 2024-04-16T18:17:38.523 DEBUG:boto:Path: /cjqttm-50/d 2024-04-16T18:17:38.523 DEBUG:boto:Data: 2024-04-16T18:17:38.523 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.523 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.523 DEBUG:boto:Params: {} 2024-04-16T18:17:38.523 DEBUG:boto:Token: None 2024-04-16T18:17:38.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/d 2024-04-16T18:17:38.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2w/UnZi9+M1nf9KAyAFyBKvzfFc= 2024-04-16T18:17:38.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2w/UnZi9+M1nf9KAyAFyBKvzfFc=', 'Content-Length': '0'} 2024-04-16T18:17:38.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:35 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082bb03507cc37868-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.526 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.526 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.526 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.526 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.526 DEBUG:boto:Method: GET 2024-04-16T18:17:38.526 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:17:38.526 DEBUG:boto:Data: 2024-04-16T18:17:38.526 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.526 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.527 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.527 DEBUG:boto:Params: {} 2024-04-16T18:17:38.527 DEBUG:boto:Token: None 2024-04-16T18:17:38.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a1079b9b70e1c9f-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.530 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.530 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.530 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.530 DEBUG:boto:path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.530 DEBUG:boto:auth_path=/cjqttm-50/?prefix=d 2024-04-16T18:17:38.530 DEBUG:boto:Method: GET 2024-04-16T18:17:38.530 DEBUG:boto:Path: /cjqttm-50/?prefix=d 2024-04-16T18:17:38.530 DEBUG:boto:Data: 2024-04-16T18:17:38.531 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.531 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.531 DEBUG:boto:Params: {} 2024-04-16T18:17:38.531 DEBUG:boto:Token: None 2024-04-16T18:17:38.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.534 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a642fbd8563f0c2a-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.534 DEBUG:boto:b'cjqttm-50d1000falsed2024-04-16T18:15:35.116Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:17:38.534 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.535 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.535 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.535 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.535 DEBUG:boto:Method: GET 2024-04-16T18:17:38.535 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.535 DEBUG:boto:Data: 2024-04-16T18:17:38.535 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.535 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.535 DEBUG:boto:Params: {} 2024-04-16T18:17:38.535 DEBUG:boto:Token: None 2024-04-16T18:17:38.536 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao= 2024-04-16T18:17:38.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao=', 'Content-Length': '0'} 2024-04-16T18:17:38.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ae7690a11a6d4e9-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.578 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.578 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.578 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.579 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.579 DEBUG:boto:Method: GET 2024-04-16T18:17:38.579 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.579 DEBUG:boto:Data: 2024-04-16T18:17:38.579 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.579 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.579 DEBUG:boto:Params: {} 2024-04-16T18:17:38.579 DEBUG:boto:Token: None 2024-04-16T18:17:38.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao= 2024-04-16T18:17:38.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao=', 'Content-Length': '0'} 2024-04-16T18:17:38.582 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090691ff589c03d22-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.582 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.582 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.582 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.583 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.583 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.583 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.583 DEBUG:boto:Data: 2024-04-16T18:17:38.583 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.583 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.583 DEBUG:boto:Params: {} 2024-04-16T18:17:38.583 DEBUG:boto:Token: None 2024-04-16T18:17:38.583 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vRftVq+7ZwpNvyRC0It+b9aqc7M= 2024-04-16T18:17:38.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vRftVq+7ZwpNvyRC0It+b9aqc7M=', 'Content-Length': '0'} 2024-04-16T18:17:38.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7f3c99aaca605ce-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.586 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.586 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.586 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.586 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.587 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.587 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.587 DEBUG:boto:Data: 2024-04-16T18:17:38.587 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.587 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.587 DEBUG:boto:Params: {} 2024-04-16T18:17:38.587 DEBUG:boto:Token: None 2024-04-16T18:17:38.587 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vRftVq+7ZwpNvyRC0It+b9aqc7M= 2024-04-16T18:17:38.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vRftVq+7ZwpNvyRC0It+b9aqc7M=', 'Content-Length': '0'} 2024-04-16T18:17:38.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd3f03e3b3383f56-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:17:38.590 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.590 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.590 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.590 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.590 DEBUG:boto:Method: GET 2024-04-16T18:17:38.590 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.590 DEBUG:boto:Data: 2024-04-16T18:17:38.590 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.591 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.591 DEBUG:boto:Params: {} 2024-04-16T18:17:38.591 DEBUG:boto:Token: None 2024-04-16T18:17:38.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao= 2024-04-16T18:17:38.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao=', 'Content-Length': '0'} 2024-04-16T18:17:38.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000410b4651123f0fba-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.634 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.635 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.635 DEBUG:boto:path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.635 DEBUG:boto:auth_path=/cjqttm-50/e?versionId=null 2024-04-16T18:17:38.635 DEBUG:boto:Method: GET 2024-04-16T18:17:38.635 DEBUG:boto:Path: /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.635 DEBUG:boto:Data: 2024-04-16T18:17:38.635 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.635 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.635 DEBUG:boto:Params: {} 2024-04-16T18:17:38.635 DEBUG:boto:Token: None 2024-04-16T18:17:38.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e?versionId=null 2024-04-16T18:17:38.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao= 2024-04-16T18:17:38.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MUjrAelic7tttoSHkRzCsO2QUao=', 'Content-Length': '0'} 2024-04-16T18:17:38.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3d03749867e63f8-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.639 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.639 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.639 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.639 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.639 DEBUG:boto:Method: GET 2024-04-16T18:17:38.639 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:17:38.639 DEBUG:boto:Data: 2024-04-16T18:17:38.639 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.640 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.640 DEBUG:boto:Params: {} 2024-04-16T18:17:38.640 DEBUG:boto:Token: None 2024-04-16T18:17:38.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.643 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb763d0e116f93b4-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.643 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.643 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.643 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.644 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.644 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.644 DEBUG:boto:Method: GET 2024-04-16T18:17:38.644 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:17:38.644 DEBUG:boto:Data: 2024-04-16T18:17:38.644 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.644 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.644 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.644 DEBUG:boto:Params: {} 2024-04-16T18:17:38.644 DEBUG:boto:Token: None 2024-04-16T18:17:38.644 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.645 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.647 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009901c7f523d8d5f4-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.648 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.648 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.648 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.648 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.648 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:17:38.648 DEBUG:boto:Data: 2024-04-16T18:17:38.648 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.648 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.648 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.649 DEBUG:boto:Params: {} 2024-04-16T18:17:38.649 DEBUG:boto:Token: None 2024-04-16T18:17:38.649 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e 2024-04-16T18:17:38.649 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/bqr1QE2qGJCFHYqsOtthHngd/E= 2024-04-16T18:17:38.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/bqr1QE2qGJCFHYqsOtthHngd/E=', 'Content-Length': '0'} 2024-04-16T18:17:38.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2e2cfe2c5f50be4-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.652 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.652 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.652 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.652 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:17:38.652 DEBUG:boto:Data: 2024-04-16T18:17:38.652 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.652 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.652 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.652 DEBUG:boto:Params: {} 2024-04-16T18:17:38.652 DEBUG:boto:Token: None 2024-04-16T18:17:38.653 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e 2024-04-16T18:17:38.653 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/bqr1QE2qGJCFHYqsOtthHngd/E= 2024-04-16T18:17:38.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/bqr1QE2qGJCFHYqsOtthHngd/E=', 'Content-Length': '0'} 2024-04-16T18:17:38.655 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058c339bd8efc0aeb-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.655 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=e 2024-04-16T18:17:38.655 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.655 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.655 DEBUG:boto:Method: GET 2024-04-16T18:17:38.655 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:17:38.655 DEBUG:boto:Data: 2024-04-16T18:17:38.656 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.656 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.656 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.656 DEBUG:boto:Params: {} 2024-04-16T18:17:38.656 DEBUG:boto:Token: None 2024-04-16T18:17:38.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e 2024-04-16T18:17:38.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzoDp53GGLMQoPrg7m4+iEeok1o= 2024-04-16T18:17:38.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzoDp53GGLMQoPrg7m4+iEeok1o=', 'Content-Length': '0'} 2024-04-16T18:17:38.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004410de2d4e928c6b-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.702 DEBUG:boto:path=/cjqttm-50/e 2024-04-16T18:17:38.702 DEBUG:boto:auth_path=/cjqttm-50/e 2024-04-16T18:17:38.703 DEBUG:boto:Method: GET 2024-04-16T18:17:38.703 DEBUG:boto:Path: /cjqttm-50/e 2024-04-16T18:17:38.703 DEBUG:boto:Data: 2024-04-16T18:17:38.703 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.703 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.703 DEBUG:boto:Params: {} 2024-04-16T18:17:38.703 DEBUG:boto:Token: None 2024-04-16T18:17:38.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/e 2024-04-16T18:17:38.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzoDp53GGLMQoPrg7m4+iEeok1o= 2024-04-16T18:17:38.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzoDp53GGLMQoPrg7m4+iEeok1o=', 'Content-Length': '0'} 2024-04-16T18:17:38.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074ba4dcb93ab5f4c-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.706 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.706 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.706 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.706 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.706 DEBUG:boto:Method: GET 2024-04-16T18:17:38.706 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:17:38.706 DEBUG:boto:Data: 2024-04-16T18:17:38.707 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.707 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.707 DEBUG:boto:Params: {} 2024-04-16T18:17:38.707 DEBUG:boto:Token: None 2024-04-16T18:17:38.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a456d35fef47fcb-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.710 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.710 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.710 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.710 DEBUG:boto:path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.711 DEBUG:boto:auth_path=/cjqttm-50/?prefix=e 2024-04-16T18:17:38.711 DEBUG:boto:Method: GET 2024-04-16T18:17:38.711 DEBUG:boto:Path: /cjqttm-50/?prefix=e 2024-04-16T18:17:38.711 DEBUG:boto:Data: 2024-04-16T18:17:38.711 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.711 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.711 DEBUG:boto:Params: {} 2024-04-16T18:17:38.711 DEBUG:boto:Token: None 2024-04-16T18:17:38.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.714 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088247c53062cc02e-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.715 DEBUG:boto:b'cjqttm-50e1000falsee2024-04-16T18:15:42.126Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:17:38.715 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.715 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.715 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.715 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.715 DEBUG:boto:Method: GET 2024-04-16T18:17:38.715 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.716 DEBUG:boto:Data: 2024-04-16T18:17:38.716 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.716 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.716 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.716 DEBUG:boto:Params: {} 2024-04-16T18:17:38.716 DEBUG:boto:Token: None 2024-04-16T18:17:38.716 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI= 2024-04-16T18:17:38.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI=', 'Content-Length': '0'} 2024-04-16T18:17:38.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa5356f9619b8c85-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.762 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.763 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.763 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.763 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.763 DEBUG:boto:Method: GET 2024-04-16T18:17:38.763 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.763 DEBUG:boto:Data: 2024-04-16T18:17:38.763 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.763 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.763 DEBUG:boto:Params: {} 2024-04-16T18:17:38.764 DEBUG:boto:Token: None 2024-04-16T18:17:38.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI= 2024-04-16T18:17:38.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI=', 'Content-Length': '0'} 2024-04-16T18:17:38.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000899dd8ad0d8381b5-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.766 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.766 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.766 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.766 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.766 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.766 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.766 DEBUG:boto:Data: 2024-04-16T18:17:38.767 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.767 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.767 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.767 DEBUG:boto:Params: {} 2024-04-16T18:17:38.767 DEBUG:boto:Token: None 2024-04-16T18:17:38.767 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.767 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y42CKnkycppP7FDxl548faVYJts= 2024-04-16T18:17:38.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y42CKnkycppP7FDxl548faVYJts=', 'Content-Length': '0'} 2024-04-16T18:17:38.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008582f5361b57d819-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.769 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.770 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.770 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.770 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.770 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.770 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.770 DEBUG:boto:Data: 2024-04-16T18:17:38.770 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.770 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.770 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.770 DEBUG:boto:Params: {} 2024-04-16T18:17:38.771 DEBUG:boto:Token: None 2024-04-16T18:17:38.771 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y42CKnkycppP7FDxl548faVYJts= 2024-04-16T18:17:38.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y42CKnkycppP7FDxl548faVYJts=', 'Content-Length': '0'} 2024-04-16T18:17:38.773 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5c942c5695c1b6d-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.773 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:17:38.773 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.773 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.773 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.773 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.774 DEBUG:boto:Method: GET 2024-04-16T18:17:38.774 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.774 DEBUG:boto:Data: 2024-04-16T18:17:38.774 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.774 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.774 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.774 DEBUG:boto:Params: {} 2024-04-16T18:17:38.774 DEBUG:boto:Token: None 2024-04-16T18:17:38.774 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI= 2024-04-16T18:17:38.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI=', 'Content-Length': '0'} 2024-04-16T18:17:38.776 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cdcec7404dd6d70-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.818 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.819 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.819 DEBUG:boto:path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.819 DEBUG:boto:auth_path=/cjqttm-50/f?versionId=null 2024-04-16T18:17:38.819 DEBUG:boto:Method: GET 2024-04-16T18:17:38.819 DEBUG:boto:Path: /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.819 DEBUG:boto:Data: 2024-04-16T18:17:38.819 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.819 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.819 DEBUG:boto:Params: {} 2024-04-16T18:17:38.820 DEBUG:boto:Token: None 2024-04-16T18:17:38.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f?versionId=null 2024-04-16T18:17:38.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI= 2024-04-16T18:17:38.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9iFzYIjF78z4mL760ZCI1ANYznI=', 'Content-Length': '0'} 2024-04-16T18:17:38.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a1f5227b419ab03-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.822 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.823 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.823 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.823 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.823 DEBUG:boto:Method: GET 2024-04-16T18:17:38.823 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:17:38.823 DEBUG:boto:Data: 2024-04-16T18:17:38.823 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.823 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.824 DEBUG:boto:Params: {} 2024-04-16T18:17:38.824 DEBUG:boto:Token: None 2024-04-16T18:17:38.824 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c182f163f17e789-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.870 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.871 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.871 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.871 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.871 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.871 DEBUG:boto:Method: GET 2024-04-16T18:17:38.871 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:17:38.871 DEBUG:boto:Data: 2024-04-16T18:17:38.871 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.872 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.872 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.872 DEBUG:boto:Params: {} 2024-04-16T18:17:38.872 DEBUG:boto:Token: None 2024-04-16T18:17:38.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.875 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000455bb5b37a7eae20-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.875 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.875 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.875 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.876 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.876 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:17:38.876 DEBUG:boto:Data: 2024-04-16T18:17:38.876 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.876 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.876 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.876 DEBUG:boto:Params: {} 2024-04-16T18:17:38.876 DEBUG:boto:Token: None 2024-04-16T18:17:38.876 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f 2024-04-16T18:17:38.877 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iAa5wBDyD4MpCQl1YvXsaZsP9so= 2024-04-16T18:17:38.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iAa5wBDyD4MpCQl1YvXsaZsP9so=', 'Content-Length': '0'} 2024-04-16T18:17:38.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046abff1d7145261d-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.879 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.879 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.879 DEBUG:boto:Method: HEAD 2024-04-16T18:17:38.879 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:17:38.879 DEBUG:boto:Data: 2024-04-16T18:17:38.879 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.880 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.880 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.880 DEBUG:boto:Params: {} 2024-04-16T18:17:38.880 DEBUG:boto:Token: None 2024-04-16T18:17:38.880 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f 2024-04-16T18:17:38.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iAa5wBDyD4MpCQl1YvXsaZsP9so= 2024-04-16T18:17:38.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iAa5wBDyD4MpCQl1YvXsaZsP9so=', 'Content-Length': '0'} 2024-04-16T18:17:38.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9cc9d4049a0f673-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.882 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=f 2024-04-16T18:17:38.883 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.883 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.883 DEBUG:boto:Method: GET 2024-04-16T18:17:38.883 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:17:38.883 DEBUG:boto:Data: 2024-04-16T18:17:38.883 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.883 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.883 DEBUG:boto:Params: {} 2024-04-16T18:17:38.883 DEBUG:boto:Token: None 2024-04-16T18:17:38.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f 2024-04-16T18:17:38.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZokmMjYNUork+Ji/1bUJlCU8eEE= 2024-04-16T18:17:38.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZokmMjYNUork+Ji/1bUJlCU8eEE=', 'Content-Length': '0'} 2024-04-16T18:17:38.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fac087e60135cdd3-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.926 DEBUG:boto:path=/cjqttm-50/f 2024-04-16T18:17:38.926 DEBUG:boto:auth_path=/cjqttm-50/f 2024-04-16T18:17:38.927 DEBUG:boto:Method: GET 2024-04-16T18:17:38.927 DEBUG:boto:Path: /cjqttm-50/f 2024-04-16T18:17:38.927 DEBUG:boto:Data: 2024-04-16T18:17:38.927 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.927 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.927 DEBUG:boto:Params: {} 2024-04-16T18:17:38.927 DEBUG:boto:Token: None 2024-04-16T18:17:38.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/f 2024-04-16T18:17:38.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZokmMjYNUork+Ji/1bUJlCU8eEE= 2024-04-16T18:17:38.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZokmMjYNUork+Ji/1bUJlCU8eEE=', 'Content-Length': '0'} 2024-04-16T18:17:38.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dce605b40f6c76c0-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.930 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.930 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.930 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.930 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.930 DEBUG:boto:Method: GET 2024-04-16T18:17:38.930 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:17:38.930 DEBUG:boto:Data: 2024-04-16T18:17:38.930 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.930 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.931 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.931 DEBUG:boto:Params: {} 2024-04-16T18:17:38.931 DEBUG:boto:Token: None 2024-04-16T18:17:38.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.934 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f98f5e9e80e35b3-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.978 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.979 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:38.979 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:38.979 DEBUG:boto:path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.979 DEBUG:boto:auth_path=/cjqttm-50/?prefix=f 2024-04-16T18:17:38.979 DEBUG:boto:Method: GET 2024-04-16T18:17:38.979 DEBUG:boto:Path: /cjqttm-50/?prefix=f 2024-04-16T18:17:38.979 DEBUG:boto:Data: 2024-04-16T18:17:38.980 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.980 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:38.980 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.980 DEBUG:boto:Params: {} 2024-04-16T18:17:38.980 DEBUG:boto:Token: None 2024-04-16T18:17:38.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/ 2024-04-16T18:17:38.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc= 2024-04-16T18:17:38.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kd3gPX6mPuxr6RWf6IfKtQ7tsJc=', 'Content-Length': '0'} 2024-04-16T18:17:38.983 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040a59afc6e2f09bf-00661ec0c2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:38.983 DEBUG:boto:b'cjqttm-50f1000falsef2024-04-16T18:15:42.138Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:38.983 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:17:38.983 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:38.983 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:38.984 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:38.984 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:38.984 DEBUG:boto:Method: GET 2024-04-16T18:17:38.984 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:17:38.984 DEBUG:boto:Data: 2024-04-16T18:17:38.984 DEBUG:boto:Headers: {} 2024-04-16T18:17:38.984 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:38.984 DEBUG:boto:Port: 8000 2024-04-16T18:17:38.984 DEBUG:boto:Params: {} 2024-04-16T18:17:38.984 DEBUG:boto:Token: None 2024-04-16T18:17:38.985 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:38 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:17:38.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:405j/PSk5mXmrkv0IJ2IEzCKRgA= 2024-04-16T18:17:38.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:405j/PSk5mXmrkv0IJ2IEzCKRgA=', 'Content-Length': '0'} 2024-04-16T18:17:38.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000fb1c944836416f-00661ec0c2-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.030 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.030 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.031 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.031 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.031 DEBUG:boto:Method: GET 2024-04-16T18:17:39.031 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.031 DEBUG:boto:Data: 2024-04-16T18:17:39.031 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.031 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.031 DEBUG:boto:Params: {} 2024-04-16T18:17:39.032 DEBUG:boto:Token: None 2024-04-16T18:17:39.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:32DCaZ3/Zb0a1OLcdmXvbjqiIiw= 2024-04-16T18:17:39.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:32DCaZ3/Zb0a1OLcdmXvbjqiIiw=', 'Content-Length': '0'} 2024-04-16T18:17:39.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b93d606ff42c724-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.035 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.035 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.035 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.035 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.035 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.035 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.035 DEBUG:boto:Data: 2024-04-16T18:17:39.035 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.036 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.036 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.036 DEBUG:boto:Params: {} 2024-04-16T18:17:39.036 DEBUG:boto:Token: None 2024-04-16T18:17:39.036 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8EIFko8dXOxg9IktRbEjrZk+t8Y= 2024-04-16T18:17:39.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8EIFko8dXOxg9IktRbEjrZk+t8Y=', 'Content-Length': '0'} 2024-04-16T18:17:39.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079bc898d2ae4f084-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.039 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.039 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.039 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.039 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.039 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.039 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.039 DEBUG:boto:Data: 2024-04-16T18:17:39.039 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.040 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.040 DEBUG:boto:Params: {} 2024-04-16T18:17:39.040 DEBUG:boto:Token: None 2024-04-16T18:17:39.040 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8EIFko8dXOxg9IktRbEjrZk+t8Y= 2024-04-16T18:17:39.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8EIFko8dXOxg9IktRbEjrZk+t8Y=', 'Content-Length': '0'} 2024-04-16T18:17:39.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c93488c80b3140af-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.042 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:17:39.043 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.043 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.043 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.043 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.043 DEBUG:boto:Method: GET 2024-04-16T18:17:39.043 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.043 DEBUG:boto:Data: 2024-04-16T18:17:39.043 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.044 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.044 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.044 DEBUG:boto:Params: {} 2024-04-16T18:17:39.044 DEBUG:boto:Token: None 2024-04-16T18:17:39.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:32DCaZ3/Zb0a1OLcdmXvbjqiIiw= 2024-04-16T18:17:39.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:32DCaZ3/Zb0a1OLcdmXvbjqiIiw=', 'Content-Length': '0'} 2024-04-16T18:17:39.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e423462fff42b14-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.090 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.091 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.091 DEBUG:boto:path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.091 DEBUG:boto:auth_path=/cjqttm-50/g?versionId=null 2024-04-16T18:17:39.091 DEBUG:boto:Method: GET 2024-04-16T18:17:39.091 DEBUG:boto:Path: /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.091 DEBUG:boto:Data: 2024-04-16T18:17:39.091 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.091 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.091 DEBUG:boto:Params: {} 2024-04-16T18:17:39.092 DEBUG:boto:Token: None 2024-04-16T18:17:39.092 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g?versionId=null 2024-04-16T18:17:39.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:32DCaZ3/Zb0a1OLcdmXvbjqiIiw= 2024-04-16T18:17:39.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:32DCaZ3/Zb0a1OLcdmXvbjqiIiw=', 'Content-Length': '0'} 2024-04-16T18:17:39.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002573729fe7076a50-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.094 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.094 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.095 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.095 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.095 DEBUG:boto:Method: GET 2024-04-16T18:17:39.095 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:17:39.095 DEBUG:boto:Data: 2024-04-16T18:17:39.095 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.095 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.095 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.095 DEBUG:boto:Params: {} 2024-04-16T18:17:39.096 DEBUG:boto:Token: None 2024-04-16T18:17:39.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.098 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066bff2c3ecb82a4b-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.098 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.099 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.099 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.099 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.099 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.099 DEBUG:boto:Method: GET 2024-04-16T18:17:39.099 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:17:39.100 DEBUG:boto:Data: 2024-04-16T18:17:39.100 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.100 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.100 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.100 DEBUG:boto:Params: {} 2024-04-16T18:17:39.100 DEBUG:boto:Token: None 2024-04-16T18:17:39.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.103 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006781808a3037784d-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.104 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.104 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.104 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.104 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.104 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:17:39.104 DEBUG:boto:Data: 2024-04-16T18:17:39.104 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.105 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.105 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.105 DEBUG:boto:Params: {} 2024-04-16T18:17:39.105 DEBUG:boto:Token: None 2024-04-16T18:17:39.105 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g 2024-04-16T18:17:39.105 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r/dUhnD3hq4b5R88vi5hgTdw9Ac= 2024-04-16T18:17:39.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r/dUhnD3hq4b5R88vi5hgTdw9Ac=', 'Content-Length': '0'} 2024-04-16T18:17:39.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0583551fccacfb7-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.108 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.108 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.108 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.108 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:17:39.108 DEBUG:boto:Data: 2024-04-16T18:17:39.108 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.108 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.108 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.108 DEBUG:boto:Params: {} 2024-04-16T18:17:39.109 DEBUG:boto:Token: None 2024-04-16T18:17:39.109 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g 2024-04-16T18:17:39.109 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r/dUhnD3hq4b5R88vi5hgTdw9Ac= 2024-04-16T18:17:39.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r/dUhnD3hq4b5R88vi5hgTdw9Ac=', 'Content-Length': '0'} 2024-04-16T18:17:39.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009396fc42ecbd974c-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=g 2024-04-16T18:17:39.111 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.111 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.112 DEBUG:boto:Method: GET 2024-04-16T18:17:39.112 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:17:39.112 DEBUG:boto:Data: 2024-04-16T18:17:39.112 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.112 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.112 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.112 DEBUG:boto:Params: {} 2024-04-16T18:17:39.112 DEBUG:boto:Token: None 2024-04-16T18:17:39.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g 2024-04-16T18:17:39.113 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eeQF9UES3zyURmr8/cq+d99sxS4= 2024-04-16T18:17:39.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eeQF9UES3zyURmr8/cq+d99sxS4=', 'Content-Length': '0'} 2024-04-16T18:17:39.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086f25710049cb096-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.158 DEBUG:boto:path=/cjqttm-50/g 2024-04-16T18:17:39.158 DEBUG:boto:auth_path=/cjqttm-50/g 2024-04-16T18:17:39.159 DEBUG:boto:Method: GET 2024-04-16T18:17:39.159 DEBUG:boto:Path: /cjqttm-50/g 2024-04-16T18:17:39.159 DEBUG:boto:Data: 2024-04-16T18:17:39.159 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.159 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.159 DEBUG:boto:Params: {} 2024-04-16T18:17:39.159 DEBUG:boto:Token: None 2024-04-16T18:17:39.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/g 2024-04-16T18:17:39.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eeQF9UES3zyURmr8/cq+d99sxS4= 2024-04-16T18:17:39.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eeQF9UES3zyURmr8/cq+d99sxS4=', 'Content-Length': '0'} 2024-04-16T18:17:39.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026e6ab35484a4784-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.163 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.163 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.163 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.163 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.163 DEBUG:boto:Method: GET 2024-04-16T18:17:39.163 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:17:39.164 DEBUG:boto:Data: 2024-04-16T18:17:39.164 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.164 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.164 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.164 DEBUG:boto:Params: {} 2024-04-16T18:17:39.164 DEBUG:boto:Token: None 2024-04-16T18:17:39.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.167 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042785eb64f43cd62-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.168 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.168 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.168 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.168 DEBUG:boto:path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.168 DEBUG:boto:auth_path=/cjqttm-50/?prefix=g 2024-04-16T18:17:39.168 DEBUG:boto:Method: GET 2024-04-16T18:17:39.169 DEBUG:boto:Path: /cjqttm-50/?prefix=g 2024-04-16T18:17:39.169 DEBUG:boto:Data: 2024-04-16T18:17:39.169 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.169 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.169 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.169 DEBUG:boto:Params: {} 2024-04-16T18:17:39.169 DEBUG:boto:Token: None 2024-04-16T18:17:39.169 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.172 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000010e8efdb9612faf1-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.214 DEBUG:boto:b'cjqttm-50g1000falseg2024-04-16T18:15:42.149Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.215 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:17:39.215 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.215 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.215 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.215 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.215 DEBUG:boto:Method: GET 2024-04-16T18:17:39.216 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.216 DEBUG:boto:Data: 2024-04-16T18:17:39.216 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.216 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.216 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.216 DEBUG:boto:Params: {} 2024-04-16T18:17:39.216 DEBUG:boto:Token: None 2024-04-16T18:17:39.216 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.217 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw= 2024-04-16T18:17:39.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw=', 'Content-Length': '0'} 2024-04-16T18:17:39.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca1d0c22499e47a1-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.262 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.263 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.263 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.263 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.263 DEBUG:boto:Method: GET 2024-04-16T18:17:39.263 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.263 DEBUG:boto:Data: 2024-04-16T18:17:39.263 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.264 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.264 DEBUG:boto:Params: {} 2024-04-16T18:17:39.264 DEBUG:boto:Token: None 2024-04-16T18:17:39.264 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw= 2024-04-16T18:17:39.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw=', 'Content-Length': '0'} 2024-04-16T18:17:39.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccbc289c772f353b-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.267 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.267 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.267 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.267 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.268 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.268 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.268 DEBUG:boto:Data: 2024-04-16T18:17:39.268 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.268 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.268 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.268 DEBUG:boto:Params: {} 2024-04-16T18:17:39.268 DEBUG:boto:Token: None 2024-04-16T18:17:39.269 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.269 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M4nUggAEYnu9JD2Cu5i3h62o+bk= 2024-04-16T18:17:39.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M4nUggAEYnu9JD2Cu5i3h62o+bk=', 'Content-Length': '0'} 2024-04-16T18:17:39.271 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8a3b7e62671ed4e-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.271 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.271 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.271 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.272 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.272 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.272 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.272 DEBUG:boto:Data: 2024-04-16T18:17:39.272 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.272 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.272 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.272 DEBUG:boto:Params: {} 2024-04-16T18:17:39.273 DEBUG:boto:Token: None 2024-04-16T18:17:39.273 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.273 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M4nUggAEYnu9JD2Cu5i3h62o+bk= 2024-04-16T18:17:39.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M4nUggAEYnu9JD2Cu5i3h62o+bk=', 'Content-Length': '0'} 2024-04-16T18:17:39.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d9a9145a70636d8-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.276 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:17:39.276 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.276 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.276 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.276 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.276 DEBUG:boto:Method: GET 2024-04-16T18:17:39.277 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.277 DEBUG:boto:Data: 2024-04-16T18:17:39.277 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.277 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.277 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.277 DEBUG:boto:Params: {} 2024-04-16T18:17:39.277 DEBUG:boto:Token: None 2024-04-16T18:17:39.277 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.278 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw= 2024-04-16T18:17:39.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw=', 'Content-Length': '0'} 2024-04-16T18:17:39.280 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fc7bc2325045813-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.322 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.323 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.323 DEBUG:boto:path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.323 DEBUG:boto:auth_path=/cjqttm-50/h?versionId=null 2024-04-16T18:17:39.323 DEBUG:boto:Method: GET 2024-04-16T18:17:39.323 DEBUG:boto:Path: /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.323 DEBUG:boto:Data: 2024-04-16T18:17:39.323 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.323 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.324 DEBUG:boto:Params: {} 2024-04-16T18:17:39.324 DEBUG:boto:Token: None 2024-04-16T18:17:39.324 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h?versionId=null 2024-04-16T18:17:39.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw= 2024-04-16T18:17:39.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cEgLz866I+gTz30B/2oKK9SMrw=', 'Content-Length': '0'} 2024-04-16T18:17:39.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000681289e211ec3452-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.327 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.329 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.330 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.330 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.330 DEBUG:boto:Method: GET 2024-04-16T18:17:39.330 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:17:39.330 DEBUG:boto:Data: 2024-04-16T18:17:39.330 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.330 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.331 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.331 DEBUG:boto:Params: {} 2024-04-16T18:17:39.331 DEBUG:boto:Token: None 2024-04-16T18:17:39.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.334 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8a565ea82f93fdf-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.334 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.335 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.335 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.335 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.335 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.335 DEBUG:boto:Method: GET 2024-04-16T18:17:39.335 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:17:39.335 DEBUG:boto:Data: 2024-04-16T18:17:39.335 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.336 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.336 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.336 DEBUG:boto:Params: {} 2024-04-16T18:17:39.336 DEBUG:boto:Token: None 2024-04-16T18:17:39.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.339 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008fc5faf15ea67d53-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.339 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.339 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.339 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.339 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.340 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:17:39.340 DEBUG:boto:Data: 2024-04-16T18:17:39.340 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.340 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.340 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.340 DEBUG:boto:Params: {} 2024-04-16T18:17:39.340 DEBUG:boto:Token: None 2024-04-16T18:17:39.340 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h 2024-04-16T18:17:39.341 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WWaWCkTGp5ZID4fzJMvNRXyqpVE= 2024-04-16T18:17:39.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WWaWCkTGp5ZID4fzJMvNRXyqpVE=', 'Content-Length': '0'} 2024-04-16T18:17:39.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c466ebe17077eda1-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.343 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.343 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.343 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.343 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:17:39.343 DEBUG:boto:Data: 2024-04-16T18:17:39.343 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.344 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.344 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.344 DEBUG:boto:Params: {} 2024-04-16T18:17:39.344 DEBUG:boto:Token: None 2024-04-16T18:17:39.344 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h 2024-04-16T18:17:39.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WWaWCkTGp5ZID4fzJMvNRXyqpVE= 2024-04-16T18:17:39.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WWaWCkTGp5ZID4fzJMvNRXyqpVE=', 'Content-Length': '0'} 2024-04-16T18:17:39.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de70f121980d8e7c-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=h 2024-04-16T18:17:39.347 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.347 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.347 DEBUG:boto:Method: GET 2024-04-16T18:17:39.347 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:17:39.348 DEBUG:boto:Data: 2024-04-16T18:17:39.348 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.348 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.348 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.348 DEBUG:boto:Params: {} 2024-04-16T18:17:39.348 DEBUG:boto:Token: None 2024-04-16T18:17:39.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h 2024-04-16T18:17:39.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/8BIdk3JiiGCYWqZH7tFLKlkYxk= 2024-04-16T18:17:39.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/8BIdk3JiiGCYWqZH7tFLKlkYxk=', 'Content-Length': '0'} 2024-04-16T18:17:39.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045a83d44b9fd1158-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.394 DEBUG:boto:path=/cjqttm-50/h 2024-04-16T18:17:39.394 DEBUG:boto:auth_path=/cjqttm-50/h 2024-04-16T18:17:39.395 DEBUG:boto:Method: GET 2024-04-16T18:17:39.395 DEBUG:boto:Path: /cjqttm-50/h 2024-04-16T18:17:39.395 DEBUG:boto:Data: 2024-04-16T18:17:39.395 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.395 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.395 DEBUG:boto:Params: {} 2024-04-16T18:17:39.395 DEBUG:boto:Token: None 2024-04-16T18:17:39.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/h 2024-04-16T18:17:39.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/8BIdk3JiiGCYWqZH7tFLKlkYxk= 2024-04-16T18:17:39.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/8BIdk3JiiGCYWqZH7tFLKlkYxk=', 'Content-Length': '0'} 2024-04-16T18:17:39.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:15:42 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdadd749e96e7cda-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.398 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.398 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.398 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.398 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.398 DEBUG:boto:Method: GET 2024-04-16T18:17:39.399 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:17:39.399 DEBUG:boto:Data: 2024-04-16T18:17:39.399 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.399 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.399 DEBUG:boto:Params: {} 2024-04-16T18:17:39.399 DEBUG:boto:Token: None 2024-04-16T18:17:39.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f9851cb33e339cb-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.402 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.403 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.403 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.403 DEBUG:boto:path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.403 DEBUG:boto:auth_path=/cjqttm-50/?prefix=h 2024-04-16T18:17:39.403 DEBUG:boto:Method: GET 2024-04-16T18:17:39.403 DEBUG:boto:Path: /cjqttm-50/?prefix=h 2024-04-16T18:17:39.403 DEBUG:boto:Data: 2024-04-16T18:17:39.403 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.404 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.404 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.404 DEBUG:boto:Params: {} 2024-04-16T18:17:39.404 DEBUG:boto:Token: None 2024-04-16T18:17:39.404 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.407 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000de1847be9fc0fbb-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.407 DEBUG:boto:b'cjqttm-50h1000falseh2024-04-16T18:15:42.200Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2024-04-16T18:17:39.408 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.408 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.408 DEBUG:boto:path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.408 DEBUG:boto:auth_path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.408 DEBUG:boto:Method: GET 2024-04-16T18:17:39.408 DEBUG:boto:Path: /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.408 DEBUG:boto:Data: 2024-04-16T18:17:39.408 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.408 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.408 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.409 DEBUG:boto:Params: {} 2024-04-16T18:17:39.409 DEBUG:boto:Token: None 2024-04-16T18:17:39.409 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.409 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4= 2024-04-16T18:17:39.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4=', 'Content-Length': '0'} 2024-04-16T18:17:39.411 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000643df09aac084b39-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.454 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.454 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.454 DEBUG:boto:path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.455 DEBUG:boto:auth_path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.455 DEBUG:boto:Method: GET 2024-04-16T18:17:39.455 DEBUG:boto:Path: /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.455 DEBUG:boto:Data: 2024-04-16T18:17:39.455 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.455 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.455 DEBUG:boto:Params: {} 2024-04-16T18:17:39.455 DEBUG:boto:Token: None 2024-04-16T18:17:39.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4= 2024-04-16T18:17:39.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4=', 'Content-Length': '0'} 2024-04-16T18:17:39.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fca4e7616a161f4-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.458 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.458 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.458 DEBUG:boto:path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.459 DEBUG:boto:auth_path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.459 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.459 DEBUG:boto:Path: /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.459 DEBUG:boto:Data: 2024-04-16T18:17:39.459 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.459 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.459 DEBUG:boto:Params: {} 2024-04-16T18:17:39.459 DEBUG:boto:Token: None 2024-04-16T18:17:39.460 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2uW3+4GGqlWCnbbjxmC3GGV9Og= 2024-04-16T18:17:39.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2uW3+4GGqlWCnbbjxmC3GGV9Og=', 'Content-Length': '0'} 2024-04-16T18:17:39.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000031e1e235020e3f6-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.462 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.462 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.462 DEBUG:boto:path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.462 DEBUG:boto:auth_path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.463 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.463 DEBUG:boto:Path: /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.463 DEBUG:boto:Data: 2024-04-16T18:17:39.463 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.463 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.463 DEBUG:boto:Params: {} 2024-04-16T18:17:39.463 DEBUG:boto:Token: None 2024-04-16T18:17:39.463 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2uW3+4GGqlWCnbbjxmC3GGV9Og= 2024-04-16T18:17:39.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2uW3+4GGqlWCnbbjxmC3GGV9Og=', 'Content-Length': '0'} 2024-04-16T18:17:39.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da6a16bb6c4ff539-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.466 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2024-04-16T18:17:39.466 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.466 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.466 DEBUG:boto:path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.466 DEBUG:boto:auth_path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.466 DEBUG:boto:Method: GET 2024-04-16T18:17:39.466 DEBUG:boto:Path: /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.466 DEBUG:boto:Data: 2024-04-16T18:17:39.466 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.467 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.467 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.467 DEBUG:boto:Params: {} 2024-04-16T18:17:39.467 DEBUG:boto:Token: None 2024-04-16T18:17:39.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4= 2024-04-16T18:17:39.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4=', 'Content-Length': '0'} 2024-04-16T18:17:39.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b31b09c69bd42bc8-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.510 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.510 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.511 DEBUG:boto:path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.511 DEBUG:boto:auth_path=/cjqttm-50/i?versionId=null 2024-04-16T18:17:39.511 DEBUG:boto:Method: GET 2024-04-16T18:17:39.511 DEBUG:boto:Path: /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.511 DEBUG:boto:Data: 2024-04-16T18:17:39.511 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.511 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.511 DEBUG:boto:Params: {} 2024-04-16T18:17:39.511 DEBUG:boto:Token: None 2024-04-16T18:17:39.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i?versionId=null 2024-04-16T18:17:39.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4= 2024-04-16T18:17:39.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HYujK8NAZHy0Zugg77+BT1eQ9N4=', 'Content-Length': '0'} 2024-04-16T18:17:39.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1a29c796f16df8d-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.514 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.514 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.514 DEBUG:boto:path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.514 DEBUG:boto:auth_path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.514 DEBUG:boto:Method: GET 2024-04-16T18:17:39.514 DEBUG:boto:Path: /cjqttm-50/?prefix=i 2024-04-16T18:17:39.515 DEBUG:boto:Data: 2024-04-16T18:17:39.515 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.515 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.515 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.515 DEBUG:boto:Params: {} 2024-04-16T18:17:39.515 DEBUG:boto:Token: None 2024-04-16T18:17:39.515 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3a0af9f2653e666-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.558 DEBUG:boto:b'cjqttm-50i1000falsei2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.559 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.559 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.559 DEBUG:boto:path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.559 DEBUG:boto:auth_path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.559 DEBUG:boto:Method: GET 2024-04-16T18:17:39.559 DEBUG:boto:Path: /cjqttm-50/?prefix=i 2024-04-16T18:17:39.559 DEBUG:boto:Data: 2024-04-16T18:17:39.559 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.560 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.560 DEBUG:boto:Params: {} 2024-04-16T18:17:39.560 DEBUG:boto:Token: None 2024-04-16T18:17:39.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003472a71f54aa26b3-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.562 DEBUG:boto:b'cjqttm-50i1000falsei2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.563 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.563 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.563 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.563 DEBUG:boto:Path: /cjqttm-50/i 2024-04-16T18:17:39.563 DEBUG:boto:Data: 2024-04-16T18:17:39.563 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.563 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.563 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.564 DEBUG:boto:Params: {} 2024-04-16T18:17:39.564 DEBUG:boto:Token: None 2024-04-16T18:17:39.564 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i 2024-04-16T18:17:39.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3YBGbXtFXIDW4StXbE+2CKmfy0= 2024-04-16T18:17:39.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3YBGbXtFXIDW4StXbE+2CKmfy0=', 'Content-Length': '0'} 2024-04-16T18:17:39.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd30249b52a8f6b2-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.566 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.566 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.566 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.566 DEBUG:boto:Path: /cjqttm-50/i 2024-04-16T18:17:39.567 DEBUG:boto:Data: 2024-04-16T18:17:39.567 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.567 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.567 DEBUG:boto:Params: {} 2024-04-16T18:17:39.567 DEBUG:boto:Token: None 2024-04-16T18:17:39.567 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i 2024-04-16T18:17:39.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u3YBGbXtFXIDW4StXbE+2CKmfy0= 2024-04-16T18:17:39.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u3YBGbXtFXIDW4StXbE+2CKmfy0=', 'Content-Length': '0'} 2024-04-16T18:17:39.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c156af50bec83592-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.570 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=i 2024-04-16T18:17:39.570 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.570 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.570 DEBUG:boto:Method: GET 2024-04-16T18:17:39.570 DEBUG:boto:Path: /cjqttm-50/i 2024-04-16T18:17:39.570 DEBUG:boto:Data: 2024-04-16T18:17:39.570 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.570 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.570 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.570 DEBUG:boto:Params: {} 2024-04-16T18:17:39.571 DEBUG:boto:Token: None 2024-04-16T18:17:39.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i 2024-04-16T18:17:39.571 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W3/+mwd1XiBHgVzBw7RZgmsRxVc= 2024-04-16T18:17:39.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W3/+mwd1XiBHgVzBw7RZgmsRxVc=', 'Content-Length': '0'} 2024-04-16T18:17:39.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000366a53ce239f5ea8-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.614 DEBUG:boto:path=/cjqttm-50/i 2024-04-16T18:17:39.614 DEBUG:boto:auth_path=/cjqttm-50/i 2024-04-16T18:17:39.615 DEBUG:boto:Method: GET 2024-04-16T18:17:39.615 DEBUG:boto:Path: /cjqttm-50/i 2024-04-16T18:17:39.615 DEBUG:boto:Data: 2024-04-16T18:17:39.615 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.615 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.615 DEBUG:boto:Params: {} 2024-04-16T18:17:39.615 DEBUG:boto:Token: None 2024-04-16T18:17:39.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/i 2024-04-16T18:17:39.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W3/+mwd1XiBHgVzBw7RZgmsRxVc= 2024-04-16T18:17:39.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W3/+mwd1XiBHgVzBw7RZgmsRxVc=', 'Content-Length': '0'} 2024-04-16T18:17:39.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000653fe3a275f5a492-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.618 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.618 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.618 DEBUG:boto:path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.618 DEBUG:boto:auth_path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.618 DEBUG:boto:Method: GET 2024-04-16T18:17:39.618 DEBUG:boto:Path: /cjqttm-50/?prefix=i 2024-04-16T18:17:39.618 DEBUG:boto:Data: 2024-04-16T18:17:39.618 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.618 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.619 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.619 DEBUG:boto:Params: {} 2024-04-16T18:17:39.619 DEBUG:boto:Token: None 2024-04-16T18:17:39.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e109e4051c972b1-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.622 DEBUG:boto:b'cjqttm-50i1000falsei2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.622 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.622 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.622 DEBUG:boto:path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.622 DEBUG:boto:auth_path=/cjqttm-50/?prefix=i 2024-04-16T18:17:39.623 DEBUG:boto:Method: GET 2024-04-16T18:17:39.623 DEBUG:boto:Path: /cjqttm-50/?prefix=i 2024-04-16T18:17:39.623 DEBUG:boto:Data: 2024-04-16T18:17:39.623 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.623 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.623 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.623 DEBUG:boto:Params: {} 2024-04-16T18:17:39.623 DEBUG:boto:Token: None 2024-04-16T18:17:39.623 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c77346f3a4ca2c4-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.626 DEBUG:boto:b'cjqttm-50i1000falsei2024-04-16T18:16:37.391Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2024-04-16T18:17:39.627 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.627 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.627 DEBUG:boto:path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.627 DEBUG:boto:auth_path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.627 DEBUG:boto:Method: GET 2024-04-16T18:17:39.627 DEBUG:boto:Path: /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.627 DEBUG:boto:Data: 2024-04-16T18:17:39.627 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.627 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.628 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.628 DEBUG:boto:Params: {} 2024-04-16T18:17:39.628 DEBUG:boto:Token: None 2024-04-16T18:17:39.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU= 2024-04-16T18:17:39.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU=', 'Content-Length': '0'} 2024-04-16T18:17:39.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011248b5427dc9583-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.674 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.674 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.674 DEBUG:boto:path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.675 DEBUG:boto:auth_path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.675 DEBUG:boto:Method: GET 2024-04-16T18:17:39.675 DEBUG:boto:Path: /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.675 DEBUG:boto:Data: 2024-04-16T18:17:39.675 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.675 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.675 DEBUG:boto:Params: {} 2024-04-16T18:17:39.675 DEBUG:boto:Token: None 2024-04-16T18:17:39.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU= 2024-04-16T18:17:39.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU=', 'Content-Length': '0'} 2024-04-16T18:17:39.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd2670bed8d22a03-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.678 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.678 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.678 DEBUG:boto:path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.678 DEBUG:boto:auth_path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.678 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.678 DEBUG:boto:Path: /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.679 DEBUG:boto:Data: 2024-04-16T18:17:39.679 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.679 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.679 DEBUG:boto:Params: {} 2024-04-16T18:17:39.679 DEBUG:boto:Token: None 2024-04-16T18:17:39.679 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Oaldv+F0plM9Yzej4AqdM6EQbrk= 2024-04-16T18:17:39.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Oaldv+F0plM9Yzej4AqdM6EQbrk=', 'Content-Length': '0'} 2024-04-16T18:17:39.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009eba328729b2f08-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.682 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.682 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.682 DEBUG:boto:path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.682 DEBUG:boto:auth_path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.683 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.683 DEBUG:boto:Path: /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.683 DEBUG:boto:Data: 2024-04-16T18:17:39.683 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.683 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.683 DEBUG:boto:Params: {} 2024-04-16T18:17:39.683 DEBUG:boto:Token: None 2024-04-16T18:17:39.683 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Oaldv+F0plM9Yzej4AqdM6EQbrk= 2024-04-16T18:17:39.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Oaldv+F0plM9Yzej4AqdM6EQbrk=', 'Content-Length': '0'} 2024-04-16T18:17:39.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b496e7816c30cfa-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.686 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2024-04-16T18:17:39.686 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.686 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.686 DEBUG:boto:path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.686 DEBUG:boto:auth_path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.686 DEBUG:boto:Method: GET 2024-04-16T18:17:39.686 DEBUG:boto:Path: /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.686 DEBUG:boto:Data: 2024-04-16T18:17:39.686 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.687 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.687 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.687 DEBUG:boto:Params: {} 2024-04-16T18:17:39.687 DEBUG:boto:Token: None 2024-04-16T18:17:39.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU= 2024-04-16T18:17:39.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU=', 'Content-Length': '0'} 2024-04-16T18:17:39.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0f52adcdbd0e1b5-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.730 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.730 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.731 DEBUG:boto:path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.731 DEBUG:boto:auth_path=/cjqttm-50/j?versionId=null 2024-04-16T18:17:39.731 DEBUG:boto:Method: GET 2024-04-16T18:17:39.731 DEBUG:boto:Path: /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.731 DEBUG:boto:Data: 2024-04-16T18:17:39.731 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.731 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.731 DEBUG:boto:Params: {} 2024-04-16T18:17:39.731 DEBUG:boto:Token: None 2024-04-16T18:17:39.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j?versionId=null 2024-04-16T18:17:39.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU= 2024-04-16T18:17:39.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:COU6h4wVpv3dv7b00F/taW5tKfU=', 'Content-Length': '0'} 2024-04-16T18:17:39.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033c69a4b185db315-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.734 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.734 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.734 DEBUG:boto:path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.734 DEBUG:boto:auth_path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.734 DEBUG:boto:Method: GET 2024-04-16T18:17:39.735 DEBUG:boto:Path: /cjqttm-50/?prefix=j 2024-04-16T18:17:39.735 DEBUG:boto:Data: 2024-04-16T18:17:39.735 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.735 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.735 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.735 DEBUG:boto:Params: {} 2024-04-16T18:17:39.735 DEBUG:boto:Token: None 2024-04-16T18:17:39.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.738 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9907798f0f99ef0-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.738 DEBUG:boto:b'cjqttm-50j1000falsej2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.739 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.739 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.739 DEBUG:boto:path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.739 DEBUG:boto:auth_path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.739 DEBUG:boto:Method: GET 2024-04-16T18:17:39.739 DEBUG:boto:Path: /cjqttm-50/?prefix=j 2024-04-16T18:17:39.739 DEBUG:boto:Data: 2024-04-16T18:17:39.739 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.740 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.740 DEBUG:boto:Params: {} 2024-04-16T18:17:39.740 DEBUG:boto:Token: None 2024-04-16T18:17:39.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000438536ea2f9ce97e-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.743 DEBUG:boto:b'cjqttm-50j1000falsej2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.743 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.743 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.743 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.743 DEBUG:boto:Path: /cjqttm-50/j 2024-04-16T18:17:39.743 DEBUG:boto:Data: 2024-04-16T18:17:39.743 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.744 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.744 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.744 DEBUG:boto:Params: {} 2024-04-16T18:17:39.744 DEBUG:boto:Token: None 2024-04-16T18:17:39.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j 2024-04-16T18:17:39.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pkt58GTnExd573LxwWfIqMHAUCM= 2024-04-16T18:17:39.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pkt58GTnExd573LxwWfIqMHAUCM=', 'Content-Length': '0'} 2024-04-16T18:17:39.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0de1e91a9dbfcc1-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.747 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.747 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.747 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.747 DEBUG:boto:Path: /cjqttm-50/j 2024-04-16T18:17:39.747 DEBUG:boto:Data: 2024-04-16T18:17:39.747 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.747 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.748 DEBUG:boto:Params: {} 2024-04-16T18:17:39.748 DEBUG:boto:Token: None 2024-04-16T18:17:39.748 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j 2024-04-16T18:17:39.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pkt58GTnExd573LxwWfIqMHAUCM= 2024-04-16T18:17:39.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pkt58GTnExd573LxwWfIqMHAUCM=', 'Content-Length': '0'} 2024-04-16T18:17:39.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000243956244fa7fadb-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.750 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=j 2024-04-16T18:17:39.751 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.751 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.751 DEBUG:boto:Method: GET 2024-04-16T18:17:39.751 DEBUG:boto:Path: /cjqttm-50/j 2024-04-16T18:17:39.751 DEBUG:boto:Data: 2024-04-16T18:17:39.751 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.751 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.751 DEBUG:boto:Params: {} 2024-04-16T18:17:39.752 DEBUG:boto:Token: None 2024-04-16T18:17:39.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j 2024-04-16T18:17:39.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a1Phuk5WgyrqJGmYN6aw6GDEel4= 2024-04-16T18:17:39.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a1Phuk5WgyrqJGmYN6aw6GDEel4=', 'Content-Length': '0'} 2024-04-16T18:17:39.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f6ab95371b11793-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.794 DEBUG:boto:path=/cjqttm-50/j 2024-04-16T18:17:39.794 DEBUG:boto:auth_path=/cjqttm-50/j 2024-04-16T18:17:39.794 DEBUG:boto:Method: GET 2024-04-16T18:17:39.795 DEBUG:boto:Path: /cjqttm-50/j 2024-04-16T18:17:39.795 DEBUG:boto:Data: 2024-04-16T18:17:39.795 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.795 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.795 DEBUG:boto:Params: {} 2024-04-16T18:17:39.795 DEBUG:boto:Token: None 2024-04-16T18:17:39.795 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/j 2024-04-16T18:17:39.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a1Phuk5WgyrqJGmYN6aw6GDEel4= 2024-04-16T18:17:39.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a1Phuk5WgyrqJGmYN6aw6GDEel4=', 'Content-Length': '0'} 2024-04-16T18:17:39.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000433ee79aa0b44dbb-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.798 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.798 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.798 DEBUG:boto:path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.798 DEBUG:boto:auth_path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.798 DEBUG:boto:Method: GET 2024-04-16T18:17:39.798 DEBUG:boto:Path: /cjqttm-50/?prefix=j 2024-04-16T18:17:39.798 DEBUG:boto:Data: 2024-04-16T18:17:39.799 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.799 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.799 DEBUG:boto:Params: {} 2024-04-16T18:17:39.799 DEBUG:boto:Token: None 2024-04-16T18:17:39.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b403180d9e5088b-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.802 DEBUG:boto:b'cjqttm-50j1000falsej2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.802 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.802 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.802 DEBUG:boto:path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.802 DEBUG:boto:auth_path=/cjqttm-50/?prefix=j 2024-04-16T18:17:39.803 DEBUG:boto:Method: GET 2024-04-16T18:17:39.803 DEBUG:boto:Path: /cjqttm-50/?prefix=j 2024-04-16T18:17:39.803 DEBUG:boto:Data: 2024-04-16T18:17:39.803 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.803 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.803 DEBUG:boto:Params: {} 2024-04-16T18:17:39.803 DEBUG:boto:Token: None 2024-04-16T18:17:39.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd7ca08c4c31c1ca-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.807 DEBUG:boto:b'cjqttm-50j1000falsej2024-04-16T18:16:37.403Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.807 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2024-04-16T18:17:39.807 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.807 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.807 DEBUG:boto:path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.807 DEBUG:boto:auth_path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.807 DEBUG:boto:Method: GET 2024-04-16T18:17:39.807 DEBUG:boto:Path: /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.808 DEBUG:boto:Data: 2024-04-16T18:17:39.808 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.808 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.808 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.808 DEBUG:boto:Params: {} 2024-04-16T18:17:39.808 DEBUG:boto:Token: None 2024-04-16T18:17:39.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8= 2024-04-16T18:17:39.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8=', 'Content-Length': '0'} 2024-04-16T18:17:39.811 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002cb4b2c163b56196-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.858 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.858 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.859 DEBUG:boto:path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.859 DEBUG:boto:auth_path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.859 DEBUG:boto:Method: GET 2024-04-16T18:17:39.859 DEBUG:boto:Path: /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.859 DEBUG:boto:Data: 2024-04-16T18:17:39.859 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.859 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.859 DEBUG:boto:Params: {} 2024-04-16T18:17:39.860 DEBUG:boto:Token: None 2024-04-16T18:17:39.860 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8= 2024-04-16T18:17:39.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8=', 'Content-Length': '0'} 2024-04-16T18:17:39.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f6334fa36cb9ce2-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.863 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.863 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.863 DEBUG:boto:path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.863 DEBUG:boto:auth_path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.863 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.863 DEBUG:boto:Path: /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.863 DEBUG:boto:Data: 2024-04-16T18:17:39.863 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.863 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.864 DEBUG:boto:Params: {} 2024-04-16T18:17:39.864 DEBUG:boto:Token: None 2024-04-16T18:17:39.864 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OZ8E1MODhA415tvD+5dHCE0wf9k= 2024-04-16T18:17:39.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OZ8E1MODhA415tvD+5dHCE0wf9k=', 'Content-Length': '0'} 2024-04-16T18:17:39.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b4cf57305da92f5-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.867 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.867 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.867 DEBUG:boto:path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.867 DEBUG:boto:auth_path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.867 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.867 DEBUG:boto:Path: /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.867 DEBUG:boto:Data: 2024-04-16T18:17:39.867 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.867 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.867 DEBUG:boto:Params: {} 2024-04-16T18:17:39.868 DEBUG:boto:Token: None 2024-04-16T18:17:39.868 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OZ8E1MODhA415tvD+5dHCE0wf9k= 2024-04-16T18:17:39.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OZ8E1MODhA415tvD+5dHCE0wf9k=', 'Content-Length': '0'} 2024-04-16T18:17:39.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae14430ab02c8048-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.870 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2024-04-16T18:17:39.870 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.871 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.871 DEBUG:boto:path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.871 DEBUG:boto:auth_path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.871 DEBUG:boto:Method: GET 2024-04-16T18:17:39.871 DEBUG:boto:Path: /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.871 DEBUG:boto:Data: 2024-04-16T18:17:39.871 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.871 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.871 DEBUG:boto:Params: {} 2024-04-16T18:17:39.871 DEBUG:boto:Token: None 2024-04-16T18:17:39.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8= 2024-04-16T18:17:39.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8=', 'Content-Length': '0'} 2024-04-16T18:17:39.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ffcead34b46d028-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.914 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.915 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.915 DEBUG:boto:path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.915 DEBUG:boto:auth_path=/cjqttm-50/k?versionId=null 2024-04-16T18:17:39.915 DEBUG:boto:Method: GET 2024-04-16T18:17:39.915 DEBUG:boto:Path: /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.915 DEBUG:boto:Data: 2024-04-16T18:17:39.915 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.915 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.915 DEBUG:boto:Params: {} 2024-04-16T18:17:39.916 DEBUG:boto:Token: None 2024-04-16T18:17:39.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k?versionId=null 2024-04-16T18:17:39.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8= 2024-04-16T18:17:39.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NVrh6TlCSX5qdAxO+4k9aqg9dA8=', 'Content-Length': '0'} 2024-04-16T18:17:39.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f636db52be1aadae-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.918 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.919 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.919 DEBUG:boto:path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.919 DEBUG:boto:auth_path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.919 DEBUG:boto:Method: GET 2024-04-16T18:17:39.919 DEBUG:boto:Path: /cjqttm-50/?prefix=k 2024-04-16T18:17:39.919 DEBUG:boto:Data: 2024-04-16T18:17:39.919 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.919 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.919 DEBUG:boto:Params: {} 2024-04-16T18:17:39.919 DEBUG:boto:Token: None 2024-04-16T18:17:39.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.922 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006635366cc63cf1f1-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.922 DEBUG:boto:b'cjqttm-50k1000falsek2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.923 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.923 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.923 DEBUG:boto:path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.923 DEBUG:boto:auth_path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.923 DEBUG:boto:Method: GET 2024-04-16T18:17:39.923 DEBUG:boto:Path: /cjqttm-50/?prefix=k 2024-04-16T18:17:39.923 DEBUG:boto:Data: 2024-04-16T18:17:39.923 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.923 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.924 DEBUG:boto:Params: {} 2024-04-16T18:17:39.924 DEBUG:boto:Token: None 2024-04-16T18:17:39.924 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.927 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051cd685ec1ca22f7-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.927 DEBUG:boto:b'cjqttm-50k1000falsek2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.927 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.927 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.927 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.927 DEBUG:boto:Path: /cjqttm-50/k 2024-04-16T18:17:39.928 DEBUG:boto:Data: 2024-04-16T18:17:39.928 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.928 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.928 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.928 DEBUG:boto:Params: {} 2024-04-16T18:17:39.928 DEBUG:boto:Token: None 2024-04-16T18:17:39.928 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k 2024-04-16T18:17:39.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nXlQDB5ehJWifxaQLdWw9V5Ti+4= 2024-04-16T18:17:39.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nXlQDB5ehJWifxaQLdWw9V5Ti+4=', 'Content-Length': '0'} 2024-04-16T18:17:39.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099d7cb90e58e7442-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.931 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.931 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.931 DEBUG:boto:Method: HEAD 2024-04-16T18:17:39.931 DEBUG:boto:Path: /cjqttm-50/k 2024-04-16T18:17:39.931 DEBUG:boto:Data: 2024-04-16T18:17:39.931 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.932 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.932 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.932 DEBUG:boto:Params: {} 2024-04-16T18:17:39.932 DEBUG:boto:Token: None 2024-04-16T18:17:39.932 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k 2024-04-16T18:17:39.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nXlQDB5ehJWifxaQLdWw9V5Ti+4= 2024-04-16T18:17:39.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nXlQDB5ehJWifxaQLdWw9V5Ti+4=', 'Content-Length': '0'} 2024-04-16T18:17:39.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000174de287976f2b38-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.934 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=k 2024-04-16T18:17:39.934 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.935 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.935 DEBUG:boto:Method: GET 2024-04-16T18:17:39.935 DEBUG:boto:Path: /cjqttm-50/k 2024-04-16T18:17:39.935 DEBUG:boto:Data: 2024-04-16T18:17:39.935 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.935 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.935 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.935 DEBUG:boto:Params: {} 2024-04-16T18:17:39.935 DEBUG:boto:Token: None 2024-04-16T18:17:39.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k 2024-04-16T18:17:39.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lrZMHixjQPKrqQRsO3TW6P4rw0k= 2024-04-16T18:17:39.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lrZMHixjQPKrqQRsO3TW6P4rw0k=', 'Content-Length': '0'} 2024-04-16T18:17:39.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e388be52bf14ead-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.978 DEBUG:boto:path=/cjqttm-50/k 2024-04-16T18:17:39.978 DEBUG:boto:auth_path=/cjqttm-50/k 2024-04-16T18:17:39.979 DEBUG:boto:Method: GET 2024-04-16T18:17:39.979 DEBUG:boto:Path: /cjqttm-50/k 2024-04-16T18:17:39.979 DEBUG:boto:Data: 2024-04-16T18:17:39.979 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.979 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.979 DEBUG:boto:Params: {} 2024-04-16T18:17:39.979 DEBUG:boto:Token: None 2024-04-16T18:17:39.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/k 2024-04-16T18:17:39.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lrZMHixjQPKrqQRsO3TW6P4rw0k= 2024-04-16T18:17:39.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lrZMHixjQPKrqQRsO3TW6P4rw0k=', 'Content-Length': '0'} 2024-04-16T18:17:39.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2d1ad30dc3e95b7-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.982 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.982 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.982 DEBUG:boto:path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.982 DEBUG:boto:auth_path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.982 DEBUG:boto:Method: GET 2024-04-16T18:17:39.982 DEBUG:boto:Path: /cjqttm-50/?prefix=k 2024-04-16T18:17:39.982 DEBUG:boto:Data: 2024-04-16T18:17:39.983 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.983 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.983 DEBUG:boto:Params: {} 2024-04-16T18:17:39.983 DEBUG:boto:Token: None 2024-04-16T18:17:39.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e712a818576c9e17-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.986 DEBUG:boto:b'cjqttm-50k1000falsek2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.986 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:39.986 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:39.987 DEBUG:boto:path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.987 DEBUG:boto:auth_path=/cjqttm-50/?prefix=k 2024-04-16T18:17:39.987 DEBUG:boto:Method: GET 2024-04-16T18:17:39.987 DEBUG:boto:Path: /cjqttm-50/?prefix=k 2024-04-16T18:17:39.987 DEBUG:boto:Data: 2024-04-16T18:17:39.987 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:39.987 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.987 DEBUG:boto:Params: {} 2024-04-16T18:17:39.987 DEBUG:boto:Token: None 2024-04-16T18:17:39.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/ 2024-04-16T18:17:39.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM= 2024-04-16T18:17:39.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ+4XrqQVr2UE+GM8fMmFvc44YM=', 'Content-Length': '0'} 2024-04-16T18:17:39.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1d81e92c021773a-00661ec0c3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:39.990 DEBUG:boto:b'cjqttm-50k1000falsek2024-04-16T18:16:37.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:39.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2024-04-16T18:17:39.991 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:39.991 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:39.991 DEBUG:boto:path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:39.991 DEBUG:boto:auth_path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:39.991 DEBUG:boto:Method: GET 2024-04-16T18:17:39.991 DEBUG:boto:Path: /cjqttm-50/l?versionId=null 2024-04-16T18:17:39.991 DEBUG:boto:Data: 2024-04-16T18:17:39.991 DEBUG:boto:Headers: {} 2024-04-16T18:17:39.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:39.992 DEBUG:boto:Port: 8000 2024-04-16T18:17:39.992 DEBUG:boto:Params: {} 2024-04-16T18:17:39.992 DEBUG:boto:Token: None 2024-04-16T18:17:39.992 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:39 GMT /cjqttm-50/l?versionId=null 2024-04-16T18:17:39.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0ttHmGBLWBjRQzJcH4D8/ROhWSM= 2024-04-16T18:17:39.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0ttHmGBLWBjRQzJcH4D8/ROhWSM=', 'Content-Length': '0'} 2024-04-16T18:17:39.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d494526a590fbcd3-00661ec0c3-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.038 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.039 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.039 DEBUG:boto:path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.039 DEBUG:boto:auth_path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.039 DEBUG:boto:Method: GET 2024-04-16T18:17:40.039 DEBUG:boto:Path: /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.039 DEBUG:boto:Data: 2024-04-16T18:17:40.039 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.039 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.039 DEBUG:boto:Params: {} 2024-04-16T18:17:40.040 DEBUG:boto:Token: None 2024-04-16T18:17:40.040 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PHJTjl0iNJ0bMPwFrAUlXkk18hM= 2024-04-16T18:17:40.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PHJTjl0iNJ0bMPwFrAUlXkk18hM=', 'Content-Length': '0'} 2024-04-16T18:17:40.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a49514835c99acdf-00661ec0c4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.042 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.043 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.043 DEBUG:boto:path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.043 DEBUG:boto:auth_path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.043 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.043 DEBUG:boto:Path: /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.043 DEBUG:boto:Data: 2024-04-16T18:17:40.043 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:40.043 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.043 DEBUG:boto:Params: {} 2024-04-16T18:17:40.043 DEBUG:boto:Token: None 2024-04-16T18:17:40.044 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0kIW4ORhZK197C7KL5IqSJ/gLA= 2024-04-16T18:17:40.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0kIW4ORhZK197C7KL5IqSJ/gLA=', 'Content-Length': '0'} 2024-04-16T18:17:40.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d5a07280db1318f-00661ec0c4-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.046 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.046 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.046 DEBUG:boto:path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.046 DEBUG:boto:auth_path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.046 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.046 DEBUG:boto:Path: /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.046 DEBUG:boto:Data: 2024-04-16T18:17:40.047 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.047 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.047 DEBUG:boto:Params: {} 2024-04-16T18:17:40.047 DEBUG:boto:Token: None 2024-04-16T18:17:40.047 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C0kIW4ORhZK197C7KL5IqSJ/gLA= 2024-04-16T18:17:40.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C0kIW4ORhZK197C7KL5IqSJ/gLA=', 'Content-Length': '0'} 2024-04-16T18:17:40.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b79eb4e54a78e06-00661ec0c4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2024-04-16T18:17:40.050 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.050 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.050 DEBUG:boto:path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.050 DEBUG:boto:auth_path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.050 DEBUG:boto:Method: GET 2024-04-16T18:17:40.050 DEBUG:boto:Path: /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.051 DEBUG:boto:Data: 2024-04-16T18:17:40.051 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:40.051 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.051 DEBUG:boto:Params: {} 2024-04-16T18:17:40.051 DEBUG:boto:Token: None 2024-04-16T18:17:40.051 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PHJTjl0iNJ0bMPwFrAUlXkk18hM= 2024-04-16T18:17:40.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PHJTjl0iNJ0bMPwFrAUlXkk18hM=', 'Content-Length': '0'} 2024-04-16T18:17:40.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048a2bde84639ee29-00661ec0c4-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.094 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.095 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.095 DEBUG:boto:path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.095 DEBUG:boto:auth_path=/cjqttm-50/l?versionId=null 2024-04-16T18:17:40.095 DEBUG:boto:Method: GET 2024-04-16T18:17:40.095 DEBUG:boto:Path: /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.095 DEBUG:boto:Data: 2024-04-16T18:17:40.095 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.095 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.095 DEBUG:boto:Params: {} 2024-04-16T18:17:40.095 DEBUG:boto:Token: None 2024-04-16T18:17:40.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l?versionId=null 2024-04-16T18:17:40.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PHJTjl0iNJ0bMPwFrAUlXkk18hM= 2024-04-16T18:17:40.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PHJTjl0iNJ0bMPwFrAUlXkk18hM=', 'Content-Length': '0'} 2024-04-16T18:17:40.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000d29b078235e929-00661ec0c4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.098 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:40.098 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:40.098 DEBUG:boto:path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.098 DEBUG:boto:auth_path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.098 DEBUG:boto:Method: GET 2024-04-16T18:17:40.098 DEBUG:boto:Path: /cjqttm-50/?prefix=l 2024-04-16T18:17:40.098 DEBUG:boto:Data: 2024-04-16T18:17:40.098 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.099 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:40.099 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.099 DEBUG:boto:Params: {} 2024-04-16T18:17:40.099 DEBUG:boto:Token: None 2024-04-16T18:17:40.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/ 2024-04-16T18:17:40.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU= 2024-04-16T18:17:40.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU=', 'Content-Length': '0'} 2024-04-16T18:17:40.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3d9c5218cd67990-00661ec0c4-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.142 DEBUG:boto:b'cjqttm-50l1000falsel2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:40.143 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:40.143 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:40.143 DEBUG:boto:path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.143 DEBUG:boto:auth_path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.143 DEBUG:boto:Method: GET 2024-04-16T18:17:40.143 DEBUG:boto:Path: /cjqttm-50/?prefix=l 2024-04-16T18:17:40.143 DEBUG:boto:Data: 2024-04-16T18:17:40.143 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.143 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.143 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.144 DEBUG:boto:Params: {} 2024-04-16T18:17:40.144 DEBUG:boto:Token: None 2024-04-16T18:17:40.144 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/ 2024-04-16T18:17:40.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU= 2024-04-16T18:17:40.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU=', 'Content-Length': '0'} 2024-04-16T18:17:40.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d53468c1f2c4f942-00661ec0c4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.147 DEBUG:boto:b'cjqttm-50l1000falsel2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:40.147 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.147 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.147 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.147 DEBUG:boto:Path: /cjqttm-50/l 2024-04-16T18:17:40.147 DEBUG:boto:Data: 2024-04-16T18:17:40.147 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.147 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:40.147 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.148 DEBUG:boto:Params: {} 2024-04-16T18:17:40.148 DEBUG:boto:Token: None 2024-04-16T18:17:40.148 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l 2024-04-16T18:17:40.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZnBvnaIfeDX1Rn6S8suNf7oLnOg= 2024-04-16T18:17:40.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZnBvnaIfeDX1Rn6S8suNf7oLnOg=', 'Content-Length': '0'} 2024-04-16T18:17:40.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f56df288b4e8047c-00661ec0c4-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.151 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.151 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.151 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.151 DEBUG:boto:Path: /cjqttm-50/l 2024-04-16T18:17:40.151 DEBUG:boto:Data: 2024-04-16T18:17:40.151 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.151 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.151 DEBUG:boto:Params: {} 2024-04-16T18:17:40.151 DEBUG:boto:Token: None 2024-04-16T18:17:40.151 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l 2024-04-16T18:17:40.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZnBvnaIfeDX1Rn6S8suNf7oLnOg= 2024-04-16T18:17:40.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZnBvnaIfeDX1Rn6S8suNf7oLnOg=', 'Content-Length': '0'} 2024-04-16T18:17:40.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059e4c7bb8e581180-00661ec0c4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=l 2024-04-16T18:17:40.154 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.154 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.154 DEBUG:boto:Method: GET 2024-04-16T18:17:40.154 DEBUG:boto:Path: /cjqttm-50/l 2024-04-16T18:17:40.154 DEBUG:boto:Data: 2024-04-16T18:17:40.154 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.155 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:40.155 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.155 DEBUG:boto:Params: {} 2024-04-16T18:17:40.155 DEBUG:boto:Token: None 2024-04-16T18:17:40.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l 2024-04-16T18:17:40.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4drn8YSEsSJ4Ar+rPPSkzHhbGFM= 2024-04-16T18:17:40.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4drn8YSEsSJ4Ar+rPPSkzHhbGFM=', 'Content-Length': '0'} 2024-04-16T18:17:40.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:16:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000705bd397f7d3ad6e-00661ec0c4-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.198 DEBUG:boto:path=/cjqttm-50/l 2024-04-16T18:17:40.198 DEBUG:boto:auth_path=/cjqttm-50/l 2024-04-16T18:17:40.199 DEBUG:boto:Method: GET 2024-04-16T18:17:40.199 DEBUG:boto:Path: /cjqttm-50/l 2024-04-16T18:17:40.199 DEBUG:boto:Data: 2024-04-16T18:17:40.199 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.199 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.199 DEBUG:boto:Params: {} 2024-04-16T18:17:40.199 DEBUG:boto:Token: None 2024-04-16T18:17:40.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/l 2024-04-16T18:17:40.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4drn8YSEsSJ4Ar+rPPSkzHhbGFM= 2024-04-16T18:17:40.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4drn8YSEsSJ4Ar+rPPSkzHhbGFM=', 'Content-Length': '0'} 2024-04-16T18:17:40.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:16:37 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000265bc21c0adca4a-00661ec0c4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.202 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:40.202 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:40.202 DEBUG:boto:path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.202 DEBUG:boto:auth_path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.202 DEBUG:boto:Method: GET 2024-04-16T18:17:40.202 DEBUG:boto:Path: /cjqttm-50/?prefix=l 2024-04-16T18:17:40.202 DEBUG:boto:Data: 2024-04-16T18:17:40.202 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.202 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:40.202 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.203 DEBUG:boto:Params: {} 2024-04-16T18:17:40.203 DEBUG:boto:Token: None 2024-04-16T18:17:40.203 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/ 2024-04-16T18:17:40.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU= 2024-04-16T18:17:40.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU=', 'Content-Length': '0'} 2024-04-16T18:17:40.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059ced6e24dc167b0-00661ec0c4-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.205 DEBUG:boto:b'cjqttm-50l1000falsel2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:40.206 DEBUG:boto:path=/cjqttm-50/ 2024-04-16T18:17:40.206 DEBUG:boto:auth_path=/cjqttm-50/ 2024-04-16T18:17:40.206 DEBUG:boto:path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.206 DEBUG:boto:auth_path=/cjqttm-50/?prefix=l 2024-04-16T18:17:40.206 DEBUG:boto:Method: GET 2024-04-16T18:17:40.206 DEBUG:boto:Path: /cjqttm-50/?prefix=l 2024-04-16T18:17:40.206 DEBUG:boto:Data: 2024-04-16T18:17:40.206 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.207 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.207 DEBUG:boto:Params: {} 2024-04-16T18:17:40.207 DEBUG:boto:Token: None 2024-04-16T18:17:40.207 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-50/ 2024-04-16T18:17:40.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU= 2024-04-16T18:17:40.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dZq4V9Qm1KMdpF6B3ok/GVvuXrU=', 'Content-Length': '0'} 2024-04-16T18:17:40.210 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041bfbdf09fa0430e-00661ec0c4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.210 DEBUG:boto:b'cjqttm-50l1000falsel2024-04-16T18:16:37.463Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:40.210 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-50 zones={test-zone2, test-zone1} 2024-04-16T18:17:40.211 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'cjqttm-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.211 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket cjqttm-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:40.264 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:40.264 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:40.345 INFO:teuthology.orchestra.run.smithi016.stdout:[{"op_id":"5#00000000001.60.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.7373707186755430534","op":"write","object":"i","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:16:37.391809887Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]},{"op_id":"6#00000000002.39.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17465256677181895525","op":"write","object":"k","instance":"","state":"complete","index_ver":2,"timestamp":"2024-04-16T18:16:37.415198852Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]},{"op_id":"10#00000000001.38.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.3711071745194083269","op":"write","object":"j","instance":"","state":"complete","index_ver":1,"timestamp":"2024-04-16T18:16:37.403944717Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]},{"op_id":"11#00000000002.40.6","op_tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.3603168568423568144","op":"write","object":"l","instance":"","state":"complete","index_ver":2,"timestamp":"2024-04-16T18:16:37.463834640Z","ver":{"pool":9,"epoch":0},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-50:9ba59572-f51c-4bce-9578-e6350e822996.4816.19"}]}] 2024-04-16T18:17:40.346 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_reshard_index_log_trim ... ok 2024-04-16T18:17:40.348 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.348 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.348 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.348 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.348 DEBUG:boto:Data: 2024-04-16T18:17:40.348 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.348 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.349 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.349 DEBUG:boto:Params: {} 2024-04-16T18:17:40.349 DEBUG:boto:Token: None 2024-04-16T18:17:40.349 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.349 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LRp+K+WXckRSrarYGcs4XkmkAxM= 2024-04-16T18:17:40.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LRp+K+WXckRSrarYGcs4XkmkAxM=', 'Content-Length': '0'} 2024-04-16T18:17:40.365 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f0b1380ac2eb9d34-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.366 DEBUG:rgw_multi.tests:created bucket=cjqttm-51 2024-04-16T18:17:40.366 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.366 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:40.413 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:40.466 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:17:40.490 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713291460.365600_797.1","last_update":"2024-04-16T18:17:40.365600Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:17:40.491 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:17:40.491 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:17:40.491 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.491 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:40.545 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:40.545 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:40.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:40.602+0000 7f6a5692d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:17:40.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:40.603+0000 7f6a5692d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:17:40.623 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:17:40Z"} 2024-04-16T18:17:40.623 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:17:40Z"} 2024-04-16T18:17:40.623 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:17:40.624 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:17:40.624 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:17:40.624 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:17:40.624 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:40.624 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:40.674 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:40.674 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:40.750 INFO:teuthology.orchestra.run.smithi016.stdout:{"objs":["obj00000000000000000001","obj00000000000000000005","obj00000000000000000012","obj00000000000000000004","obj00000000000000000011","obj00000000000000000000","obj00000000000000000010","obj00000000000000000003","obj00000000000000000013","obj00000000000000000002","obj00000000000000000006"]} 2024-04-16T18:17:40.750 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.750 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.750 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.750 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.750 DEBUG:boto:Data: 2024-04-16T18:17:40.750 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.751 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.751 DEBUG:boto:Params: {} 2024-04-16T18:17:40.751 DEBUG:boto:Token: None 2024-04-16T18:17:40.751 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.753 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f987c3f29a87cf55-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.754 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:40.754 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:40.754 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.754 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:40.754 DEBUG:boto:Data: 2024-04-16T18:17:40.754 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.754 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.754 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.754 DEBUG:boto:Params: {} 2024-04-16T18:17:40.755 DEBUG:boto:Token: None 2024-04-16T18:17:40.755 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:40.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dhptj/WExBEsojon+elnecPKMQk= 2024-04-16T18:17:40.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dhptj/WExBEsojon+elnecPKMQk='} 2024-04-16T18:17:40.761 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d04609e90b547e79-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.762 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.762 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.762 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.762 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.762 DEBUG:boto:Data: 2024-04-16T18:17:40.762 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.762 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.762 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.763 DEBUG:boto:Params: {} 2024-04-16T18:17:40.763 DEBUG:boto:Token: None 2024-04-16T18:17:40.763 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.765 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005bf767172f463839-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.765 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:40.765 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:40.765 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.765 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:40.766 DEBUG:boto:Data: 2024-04-16T18:17:40.766 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.766 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.766 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.766 DEBUG:boto:Params: {} 2024-04-16T18:17:40.766 DEBUG:boto:Token: None 2024-04-16T18:17:40.766 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:40.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CMSd4Nxg/VqiexBSAnwaEaq3zAg= 2024-04-16T18:17:40.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CMSd4Nxg/VqiexBSAnwaEaq3zAg='} 2024-04-16T18:17:40.772 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd2485f91d20d9f2-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.772 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.772 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.772 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.772 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.772 DEBUG:boto:Data: 2024-04-16T18:17:40.772 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.772 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.772 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.773 DEBUG:boto:Params: {} 2024-04-16T18:17:40.773 DEBUG:boto:Token: None 2024-04-16T18:17:40.773 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.773 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.775 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d214795f340a1a6f-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.775 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:40.776 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:40.776 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.776 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:40.776 DEBUG:boto:Data: 2024-04-16T18:17:40.776 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.776 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.776 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.776 DEBUG:boto:Params: {} 2024-04-16T18:17:40.776 DEBUG:boto:Token: None 2024-04-16T18:17:40.776 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:40.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gnGCZnXIjShs4uUWVgJzhfP6fHg= 2024-04-16T18:17:40.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gnGCZnXIjShs4uUWVgJzhfP6fHg='} 2024-04-16T18:17:40.818 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000034b4fe2bda62b614-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.819 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.819 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.819 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.819 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.819 DEBUG:boto:Data: 2024-04-16T18:17:40.819 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.819 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.819 DEBUG:boto:Params: {} 2024-04-16T18:17:40.819 DEBUG:boto:Token: None 2024-04-16T18:17:40.820 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.822 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000871c418903b662bb-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.822 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:40.822 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:40.822 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.822 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:40.822 DEBUG:boto:Data: 2024-04-16T18:17:40.822 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.822 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.822 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.823 DEBUG:boto:Params: {} 2024-04-16T18:17:40.823 DEBUG:boto:Token: None 2024-04-16T18:17:40.823 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:40.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5b0ugWDn0/pxOzoc4IXfYfv4wb4= 2024-04-16T18:17:40.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5b0ugWDn0/pxOzoc4IXfYfv4wb4='} 2024-04-16T18:17:40.829 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000910b6f7ac75c8ae0-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.829 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.829 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.829 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.830 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.830 DEBUG:boto:Data: 2024-04-16T18:17:40.830 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.830 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.830 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.830 DEBUG:boto:Params: {} 2024-04-16T18:17:40.830 DEBUG:boto:Token: None 2024-04-16T18:17:40.830 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.832 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001510fee7495a7cad-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.832 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:40.833 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:40.833 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.833 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:40.833 DEBUG:boto:Data: 2024-04-16T18:17:40.833 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.833 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.833 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.833 DEBUG:boto:Params: {} 2024-04-16T18:17:40.833 DEBUG:boto:Token: None 2024-04-16T18:17:40.833 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:40.834 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ohq/J6SuvrY1TDfpytYoBMeXNm8= 2024-04-16T18:17:40.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ohq/J6SuvrY1TDfpytYoBMeXNm8='} 2024-04-16T18:17:40.839 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000163f91ba75f2e7e1-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.839 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.839 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.839 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.839 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.840 DEBUG:boto:Data: 2024-04-16T18:17:40.840 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.840 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.840 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.840 DEBUG:boto:Params: {} 2024-04-16T18:17:40.840 DEBUG:boto:Token: None 2024-04-16T18:17:40.840 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.842 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b78c582ddfb3d0c2-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.842 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:40.843 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:40.843 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.843 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:40.843 DEBUG:boto:Data: 2024-04-16T18:17:40.843 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.843 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.843 DEBUG:boto:Params: {} 2024-04-16T18:17:40.843 DEBUG:boto:Token: None 2024-04-16T18:17:40.844 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:40.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8DvKQs/XNaqAfXNn/Q9kxFpJK9I= 2024-04-16T18:17:40.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8DvKQs/XNaqAfXNn/Q9kxFpJK9I='} 2024-04-16T18:17:40.886 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bf249e677da791ab-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.887 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.887 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.887 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.887 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.887 DEBUG:boto:Data: 2024-04-16T18:17:40.887 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.887 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.887 DEBUG:boto:Params: {} 2024-04-16T18:17:40.887 DEBUG:boto:Token: None 2024-04-16T18:17:40.887 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.889 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000ed880c41479d588-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.890 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:40.890 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:40.890 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.890 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:40.890 DEBUG:boto:Data: 2024-04-16T18:17:40.890 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.890 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.890 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.890 DEBUG:boto:Params: {} 2024-04-16T18:17:40.891 DEBUG:boto:Token: None 2024-04-16T18:17:40.891 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:40.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:saCuTYcVn0YA3CjdQyqeZUFVbsw= 2024-04-16T18:17:40.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:saCuTYcVn0YA3CjdQyqeZUFVbsw='} 2024-04-16T18:17:40.896 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b14c6c80dba02357-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.896 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.897 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.897 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.897 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.897 DEBUG:boto:Data: 2024-04-16T18:17:40.897 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.897 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.897 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.897 DEBUG:boto:Params: {} 2024-04-16T18:17:40.897 DEBUG:boto:Token: None 2024-04-16T18:17:40.897 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.897 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.899 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001fbe35120224310f-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.900 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:40.900 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:40.900 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.900 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:40.900 DEBUG:boto:Data: 2024-04-16T18:17:40.900 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.900 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.900 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.900 DEBUG:boto:Params: {} 2024-04-16T18:17:40.900 DEBUG:boto:Token: None 2024-04-16T18:17:40.901 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:40.901 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A9T+Uw73NXwlT32J6+5Cy7Rv+5M= 2024-04-16T18:17:40.901 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A9T+Uw73NXwlT32J6+5Cy7Rv+5M='} 2024-04-16T18:17:40.942 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004562f60ab283cc4d-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.943 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.943 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.943 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.943 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.943 DEBUG:boto:Data: 2024-04-16T18:17:40.943 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.943 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.943 DEBUG:boto:Params: {} 2024-04-16T18:17:40.943 DEBUG:boto:Token: None 2024-04-16T18:17:40.943 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.946 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000075199c63746fdf9e-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.946 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:40.946 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:40.946 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.946 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:40.946 DEBUG:boto:Data: 2024-04-16T18:17:40.946 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.946 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.946 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.947 DEBUG:boto:Params: {} 2024-04-16T18:17:40.947 DEBUG:boto:Token: None 2024-04-16T18:17:40.947 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:40.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jbizAtUUMaZk1UieW7E4RDm5ftY= 2024-04-16T18:17:40.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jbizAtUUMaZk1UieW7E4RDm5ftY='} 2024-04-16T18:17:40.952 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000580d6351cdb30c9e-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.952 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:40.952 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:40.953 DEBUG:boto:Method: HEAD 2024-04-16T18:17:40.953 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:40.953 DEBUG:boto:Data: 2024-04-16T18:17:40.953 DEBUG:boto:Headers: {} 2024-04-16T18:17:40.953 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.953 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.953 DEBUG:boto:Params: {} 2024-04-16T18:17:40.953 DEBUG:boto:Token: None 2024-04-16T18:17:40.953 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/ 2024-04-16T18:17:40.954 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8= 2024-04-16T18:17:40.954 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EbOl6mgHMo7d52VT2+ATImGOGz8=', 'Content-Length': '0'} 2024-04-16T18:17:40.956 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002bef4f9928e8fd96-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:40.956 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:40.956 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:40.956 DEBUG:boto:Method: PUT 2024-04-16T18:17:40.956 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:40.956 DEBUG:boto:Data: 2024-04-16T18:17:40.957 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:40.957 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:40.957 DEBUG:boto:Port: 8000 2024-04-16T18:17:40.957 DEBUG:boto:Params: {} 2024-04-16T18:17:40.957 DEBUG:boto:Token: None 2024-04-16T18:17:40.957 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:40 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:40.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aTDFFwENilFfpsWrQp06qi1VGhA= 2024-04-16T18:17:40.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aTDFFwENilFfpsWrQp06qi1VGhA='} 2024-04-16T18:17:41.002 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000675ff90b7e30921a-00661ec0c4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:41.003 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-51 2024-04-16T18:17:41.003 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:17:41.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:17:41.003 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:17:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:41.061 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:41.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:41.124+0000 7f244e611800 1 waiting to reach incremental sync.. 2024-04-16T18:17:46.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:46.124+0000 7f244e611800 1 bucket sync caught up with source: 2024-04-16T18:17:46.124 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.63.6, 00000000001.60.6, 00000000001.31.6, 00000000001.43.6, 00000000001.53.6, 00000000001.46.6, 00000000001.42.6, , 00000000001.40.6, 00000000001.45.6, 00000000001.28.6] 2024-04-16T18:17:46.124 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.63.6, 00000000001.60.6, 00000000001.31.6, 00000000001.43.6, 00000000001.53.6, 00000000001.46.6, 00000000001.42.6, , 00000000001.40.6, 00000000001.45.6, 00000000001.28.6] 2024-04-16T18:17:46.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:17:46.124+0000 7f244e611800 0 bucket checkpoint complete 2024-04-16T18:17:46.150 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-51 2024-04-16T18:17:46.151 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:17:46.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:17:46.151 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:17:46.213 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:46.213 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:46.278 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:17:46.280+0000 7f45e6b3b800 1 bucket sync caught up with source: 2024-04-16T18:17:46.278 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000001.365.6, 00000000001.650.6, 00000000001.464.6, 00000000001.655.6, 00000000001.381.6, 00000000001.255.6, 00000000001.541.6, , 00000000001.93.6, 00000000001.510.6, 00000000001.509.6] 2024-04-16T18:17:46.279 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000001.365.6, 00000000001.650.6, 00000000001.464.6, 00000000001.655.6, 00000000001.381.6, 00000000001.255.6, 00000000001.541.6, , 00000000001.93.6, 00000000001.510.6, 00000000001.509.6] 2024-04-16T18:17:46.279 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:17:46.280+0000 7f45e6b3b800 0 bucket checkpoint complete 2024-04-16T18:17:46.302 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-51 zones={test-zone2, test-zone1} 2024-04-16T18:17:46.302 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.302 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.302 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.302 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:46.302 DEBUG:boto:Data: 2024-04-16T18:17:46.302 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.303 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.303 DEBUG:boto:Params: {} 2024-04-16T18:17:46.303 DEBUG:boto:Token: None 2024-04-16T18:17:46.303 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fAEpSt79RE+X0fzsaptMBJK1dDg= 2024-04-16T18:17:46.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fAEpSt79RE+X0fzsaptMBJK1dDg=', 'Content-Length': '0'} 2024-04-16T18:17:46.306 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000323bca359dc28ac9-00661ec0ca-5447-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.306 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.306 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.306 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.306 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:46.306 DEBUG:boto:Data: 2024-04-16T18:17:46.306 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.306 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.306 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.307 DEBUG:boto:Params: {} 2024-04-16T18:17:46.307 DEBUG:boto:Token: None 2024-04-16T18:17:46.307 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fAEpSt79RE+X0fzsaptMBJK1dDg= 2024-04-16T18:17:46.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fAEpSt79RE+X0fzsaptMBJK1dDg=', 'Content-Length': '0'} 2024-04-16T18:17:46.309 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d3e5d8e8de735831-00661ec0ca-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.309 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:17:46.309 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.310 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.310 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.310 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.310 DEBUG:boto:Method: GET 2024-04-16T18:17:46.310 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.310 DEBUG:boto:Data: 2024-04-16T18:17:46.310 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.310 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.310 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.310 DEBUG:boto:Params: {} 2024-04-16T18:17:46.311 DEBUG:boto:Token: None 2024-04-16T18:17:46.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/?versions 2024-04-16T18:17:46.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg= 2024-04-16T18:17:46.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg=', 'Content-Length': '0'} 2024-04-16T18:17:46.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca9a3c347d67a4fb-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.313 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.314 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-16T18:17:46.314 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2024-04-16T18:17:46.314 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-16T18:17:46.315 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:17:46.315 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.315 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.315 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.316 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.316 DEBUG:boto:Method: GET 2024-04-16T18:17:46.316 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.316 DEBUG:boto:Data: 2024-04-16T18:17:46.316 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.316 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.316 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.316 DEBUG:boto:Params: {} 2024-04-16T18:17:46.316 DEBUG:boto:Token: None 2024-04-16T18:17:46.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/?versions 2024-04-16T18:17:46.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg= 2024-04-16T18:17:46.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg=', 'Content-Length': '0'} 2024-04-16T18:17:46.319 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000439f893e2f59b1e1-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.319 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.319 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-16T18:17:46.320 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-16T18:17:46.320 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.321 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.321 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.321 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.321 DEBUG:boto:Method: GET 2024-04-16T18:17:46.321 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.321 DEBUG:boto:Data: 2024-04-16T18:17:46.321 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.321 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.321 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.321 DEBUG:boto:Params: {} 2024-04-16T18:17:46.321 DEBUG:boto:Token: None 2024-04-16T18:17:46.322 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/?versions 2024-04-16T18:17:46.322 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg= 2024-04-16T18:17:46.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg=', 'Content-Length': '0'} 2024-04-16T18:17:46.324 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009eedd2e3a3ac1078-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.324 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.325 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.325 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.325 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.325 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.325 DEBUG:boto:Method: GET 2024-04-16T18:17:46.325 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:17:46.326 DEBUG:boto:Data: 2024-04-16T18:17:46.326 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.326 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.326 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.326 DEBUG:boto:Params: {} 2024-04-16T18:17:46.326 DEBUG:boto:Token: None 2024-04-16T18:17:46.326 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/?versions 2024-04-16T18:17:46.326 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg= 2024-04-16T18:17:46.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xFJB8gIrVWocn/r2g9Oi6d6ebsg=', 'Content-Length': '0'} 2024-04-16T18:17:46.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049c8414dcd4edb2d-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.329 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.329 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-16T18:17:46.330 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.330 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.330 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.330 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.330 DEBUG:boto:Method: GET 2024-04-16T18:17:46.330 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.330 DEBUG:boto:Data: 2024-04-16T18:17:46.330 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.330 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.330 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.331 DEBUG:boto:Params: {} 2024-04-16T18:17:46.331 DEBUG:boto:Token: None 2024-04-16T18:17:46.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80= 2024-04-16T18:17:46.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80=', 'Content-Length': '0'} 2024-04-16T18:17:46.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ee7f371c0a12d4f-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.333 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.333 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.334 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.334 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.334 DEBUG:boto:Method: GET 2024-04-16T18:17:46.334 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.334 DEBUG:boto:Data: 2024-04-16T18:17:46.334 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.334 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.334 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.334 DEBUG:boto:Params: {} 2024-04-16T18:17:46.334 DEBUG:boto:Token: None 2024-04-16T18:17:46.334 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80= 2024-04-16T18:17:46.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80=', 'Content-Length': '0'} 2024-04-16T18:17:46.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb50d3762195e325-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.337 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.337 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.337 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.337 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.337 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.337 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.337 DEBUG:boto:Data: 2024-04-16T18:17:46.337 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.337 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.337 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.337 DEBUG:boto:Params: {} 2024-04-16T18:17:46.338 DEBUG:boto:Token: None 2024-04-16T18:17:46.338 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.338 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nDA1sqSQ5YHIDQR86pAKPvjtZV8= 2024-04-16T18:17:46.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nDA1sqSQ5YHIDQR86pAKPvjtZV8=', 'Content-Length': '0'} 2024-04-16T18:17:46.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c69b2974cf39246-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.340 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.340 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.340 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.341 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.341 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.341 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.341 DEBUG:boto:Data: 2024-04-16T18:17:46.341 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.341 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.341 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.341 DEBUG:boto:Params: {} 2024-04-16T18:17:46.341 DEBUG:boto:Token: None 2024-04-16T18:17:46.341 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.342 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nDA1sqSQ5YHIDQR86pAKPvjtZV8= 2024-04-16T18:17:46.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nDA1sqSQ5YHIDQR86pAKPvjtZV8=', 'Content-Length': '0'} 2024-04-16T18:17:46.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039306b61cef2ee49-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-16T18:17:46.344 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.344 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.344 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.344 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.344 DEBUG:boto:Method: GET 2024-04-16T18:17:46.344 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.345 DEBUG:boto:Data: 2024-04-16T18:17:46.345 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.345 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.345 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.345 DEBUG:boto:Params: {} 2024-04-16T18:17:46.345 DEBUG:boto:Token: None 2024-04-16T18:17:46.345 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.345 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80= 2024-04-16T18:17:46.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80=', 'Content-Length': '0'} 2024-04-16T18:17:46.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012bdc38b05eafc0d-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.390 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.390 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.391 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.391 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.391 DEBUG:boto:Method: GET 2024-04-16T18:17:46.391 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.391 DEBUG:boto:Data: 2024-04-16T18:17:46.391 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.391 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.391 DEBUG:boto:Params: {} 2024-04-16T18:17:46.391 DEBUG:boto:Token: None 2024-04-16T18:17:46.391 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:17:46.393 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80= 2024-04-16T18:17:46.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SMc3Deu9Wpl5h6WlMrjBmZ7Do80=', 'Content-Length': '0'} 2024-04-16T18:17:46.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec41fc628f3d2072-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.396 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.396 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.396 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.396 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.396 DEBUG:boto:Method: GET 2024-04-16T18:17:46.396 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.396 DEBUG:boto:Data: 2024-04-16T18:17:46.396 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.396 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.396 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.397 DEBUG:boto:Params: {} 2024-04-16T18:17:46.397 DEBUG:boto:Token: None 2024-04-16T18:17:46.397 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.399 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d0bb04580963caf-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.442 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.443 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.443 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.443 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.443 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.443 DEBUG:boto:Method: GET 2024-04-16T18:17:46.443 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.443 DEBUG:boto:Data: 2024-04-16T18:17:46.443 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.443 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.443 DEBUG:boto:Params: {} 2024-04-16T18:17:46.444 DEBUG:boto:Token: None 2024-04-16T18:17:46.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.446 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006bc4e18e6656d57a-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.446 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.446 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.447 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.447 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.447 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.447 DEBUG:boto:Data: 2024-04-16T18:17:46.447 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.447 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.447 DEBUG:boto:Params: {} 2024-04-16T18:17:46.447 DEBUG:boto:Token: None 2024-04-16T18:17:46.447 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XmDCUKLNzjhcpGmVk2tNCcWyFIs= 2024-04-16T18:17:46.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XmDCUKLNzjhcpGmVk2tNCcWyFIs=', 'Content-Length': '0'} 2024-04-16T18:17:46.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c4b849b32b0faa8-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.450 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.450 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.450 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.450 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.451 DEBUG:boto:Data: 2024-04-16T18:17:46.451 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.451 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.451 DEBUG:boto:Params: {} 2024-04-16T18:17:46.451 DEBUG:boto:Token: None 2024-04-16T18:17:46.451 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XmDCUKLNzjhcpGmVk2tNCcWyFIs= 2024-04-16T18:17:46.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XmDCUKLNzjhcpGmVk2tNCcWyFIs=', 'Content-Length': '0'} 2024-04-16T18:17:46.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003af823ca860bb7d1-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.453 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-16T18:17:46.453 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.453 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.454 DEBUG:boto:Method: GET 2024-04-16T18:17:46.454 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.454 DEBUG:boto:Data: 2024-04-16T18:17:46.454 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.454 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.454 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.454 DEBUG:boto:Params: {} 2024-04-16T18:17:46.454 DEBUG:boto:Token: None 2024-04-16T18:17:46.454 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.454 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d+ccbtBCZLTgfvl67AGzTxJViSI= 2024-04-16T18:17:46.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d+ccbtBCZLTgfvl67AGzTxJViSI=', 'Content-Length': '0'} 2024-04-16T18:17:46.456 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b31d5876cac33c50-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.498 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.498 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.499 DEBUG:boto:Method: GET 2024-04-16T18:17:46.499 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.499 DEBUG:boto:Data: 2024-04-16T18:17:46.499 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.499 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.499 DEBUG:boto:Params: {} 2024-04-16T18:17:46.499 DEBUG:boto:Token: None 2024-04-16T18:17:46.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:46.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d+ccbtBCZLTgfvl67AGzTxJViSI= 2024-04-16T18:17:46.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d+ccbtBCZLTgfvl67AGzTxJViSI=', 'Content-Length': '0'} 2024-04-16T18:17:46.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbde62871ab7a628-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.502 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.502 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.502 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.502 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.502 DEBUG:boto:Method: GET 2024-04-16T18:17:46.502 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.502 DEBUG:boto:Data: 2024-04-16T18:17:46.503 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.503 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.503 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.503 DEBUG:boto:Params: {} 2024-04-16T18:17:46.503 DEBUG:boto:Token: None 2024-04-16T18:17:46.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.503 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb859074ed8b648a-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.506 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.506 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.506 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.506 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.506 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.506 DEBUG:boto:Method: GET 2024-04-16T18:17:46.507 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:17:46.507 DEBUG:boto:Data: 2024-04-16T18:17:46.507 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.507 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.507 DEBUG:boto:Params: {} 2024-04-16T18:17:46.507 DEBUG:boto:Token: None 2024-04-16T18:17:46.507 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.507 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d8c3fa5af1e7312-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.509 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:40.837Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.510 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-16T18:17:46.510 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.510 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.510 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.510 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.510 DEBUG:boto:Method: GET 2024-04-16T18:17:46.510 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.511 DEBUG:boto:Data: 2024-04-16T18:17:46.511 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.511 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.511 DEBUG:boto:Params: {} 2024-04-16T18:17:46.511 DEBUG:boto:Token: None 2024-04-16T18:17:46.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w= 2024-04-16T18:17:46.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w=', 'Content-Length': '0'} 2024-04-16T18:17:46.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2b47c8463e744d4-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.554 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.554 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.554 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.555 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.555 DEBUG:boto:Method: GET 2024-04-16T18:17:46.555 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.555 DEBUG:boto:Data: 2024-04-16T18:17:46.555 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.555 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.555 DEBUG:boto:Params: {} 2024-04-16T18:17:46.555 DEBUG:boto:Token: None 2024-04-16T18:17:46.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w= 2024-04-16T18:17:46.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w=', 'Content-Length': '0'} 2024-04-16T18:17:46.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5581321fd43bb9f-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.558 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.558 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.558 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.558 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.559 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.559 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.559 DEBUG:boto:Data: 2024-04-16T18:17:46.559 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.559 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.559 DEBUG:boto:Params: {} 2024-04-16T18:17:46.560 DEBUG:boto:Token: None 2024-04-16T18:17:46.560 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:joIZlRdtnRP4eCfEjC0G+FHaCVk= 2024-04-16T18:17:46.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:joIZlRdtnRP4eCfEjC0G+FHaCVk=', 'Content-Length': '0'} 2024-04-16T18:17:46.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088c92c44fbd072cb-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.562 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.563 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.563 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.563 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.563 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.563 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.563 DEBUG:boto:Data: 2024-04-16T18:17:46.563 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.563 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.563 DEBUG:boto:Params: {} 2024-04-16T18:17:46.563 DEBUG:boto:Token: None 2024-04-16T18:17:46.564 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:joIZlRdtnRP4eCfEjC0G+FHaCVk= 2024-04-16T18:17:46.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:joIZlRdtnRP4eCfEjC0G+FHaCVk=', 'Content-Length': '0'} 2024-04-16T18:17:46.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a5edad4e9680655-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.566 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-16T18:17:46.566 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.567 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.567 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.567 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.567 DEBUG:boto:Method: GET 2024-04-16T18:17:46.567 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.567 DEBUG:boto:Data: 2024-04-16T18:17:46.567 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.568 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.568 DEBUG:boto:Params: {} 2024-04-16T18:17:46.568 DEBUG:boto:Token: None 2024-04-16T18:17:46.568 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w= 2024-04-16T18:17:46.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w=', 'Content-Length': '0'} 2024-04-16T18:17:46.571 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018c7eda9f8690c35-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.614 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.614 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.615 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.615 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.615 DEBUG:boto:Method: GET 2024-04-16T18:17:46.615 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.615 DEBUG:boto:Data: 2024-04-16T18:17:46.615 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.615 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.615 DEBUG:boto:Params: {} 2024-04-16T18:17:46.615 DEBUG:boto:Token: None 2024-04-16T18:17:46.616 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:17:46.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w= 2024-04-16T18:17:46.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6JZcmbF6P2NOoEx7VbgmHDyje8w=', 'Content-Length': '0'} 2024-04-16T18:17:46.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000505d616b83d9849a-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.618 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.618 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.619 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.619 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.619 DEBUG:boto:Method: GET 2024-04-16T18:17:46.619 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.619 DEBUG:boto:Data: 2024-04-16T18:17:46.619 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.619 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.619 DEBUG:boto:Params: {} 2024-04-16T18:17:46.619 DEBUG:boto:Token: None 2024-04-16T18:17:46.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000db2eda3055369d1-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.622 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.623 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.623 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.623 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.623 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.623 DEBUG:boto:Method: GET 2024-04-16T18:17:46.623 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.623 DEBUG:boto:Data: 2024-04-16T18:17:46.623 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.624 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.624 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.624 DEBUG:boto:Params: {} 2024-04-16T18:17:46.624 DEBUG:boto:Token: None 2024-04-16T18:17:46.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a8733b6ba8ca94b-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.627 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.627 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.627 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.627 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.627 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.627 DEBUG:boto:Data: 2024-04-16T18:17:46.627 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.627 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.628 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.628 DEBUG:boto:Params: {} 2024-04-16T18:17:46.628 DEBUG:boto:Token: None 2024-04-16T18:17:46.628 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QCntZLOgW4OYIKhfNLiR25yMpGk= 2024-04-16T18:17:46.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QCntZLOgW4OYIKhfNLiR25yMpGk=', 'Content-Length': '0'} 2024-04-16T18:17:46.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f56286aa598dee9-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.630 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.631 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.631 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.631 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.631 DEBUG:boto:Data: 2024-04-16T18:17:46.631 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.631 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.631 DEBUG:boto:Params: {} 2024-04-16T18:17:46.631 DEBUG:boto:Token: None 2024-04-16T18:17:46.631 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QCntZLOgW4OYIKhfNLiR25yMpGk= 2024-04-16T18:17:46.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QCntZLOgW4OYIKhfNLiR25yMpGk=', 'Content-Length': '0'} 2024-04-16T18:17:46.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce4d27779d82f324-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.634 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-16T18:17:46.634 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.634 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.634 DEBUG:boto:Method: GET 2024-04-16T18:17:46.634 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.634 DEBUG:boto:Data: 2024-04-16T18:17:46.634 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.634 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.634 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.635 DEBUG:boto:Params: {} 2024-04-16T18:17:46.635 DEBUG:boto:Token: None 2024-04-16T18:17:46.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xDHuUW/aPBk0NnwW3kV2eiEB/68= 2024-04-16T18:17:46.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xDHuUW/aPBk0NnwW3kV2eiEB/68=', 'Content-Length': '0'} 2024-04-16T18:17:46.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb9efffdb8f81920-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.678 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.678 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.679 DEBUG:boto:Method: GET 2024-04-16T18:17:46.679 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.679 DEBUG:boto:Data: 2024-04-16T18:17:46.679 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.679 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.679 DEBUG:boto:Params: {} 2024-04-16T18:17:46.679 DEBUG:boto:Token: None 2024-04-16T18:17:46.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:46.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xDHuUW/aPBk0NnwW3kV2eiEB/68= 2024-04-16T18:17:46.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xDHuUW/aPBk0NnwW3kV2eiEB/68=', 'Content-Length': '0'} 2024-04-16T18:17:46.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a95d5271b62ca438-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.682 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.682 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.683 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.683 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.683 DEBUG:boto:Method: GET 2024-04-16T18:17:46.683 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.683 DEBUG:boto:Data: 2024-04-16T18:17:46.683 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.683 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.683 DEBUG:boto:Params: {} 2024-04-16T18:17:46.683 DEBUG:boto:Token: None 2024-04-16T18:17:46.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.686 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bae6d7fa276402c-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.726 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.727 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.727 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.727 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.727 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.727 DEBUG:boto:Method: GET 2024-04-16T18:17:46.727 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:17:46.727 DEBUG:boto:Data: 2024-04-16T18:17:46.727 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.727 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.728 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.728 DEBUG:boto:Params: {} 2024-04-16T18:17:46.728 DEBUG:boto:Token: None 2024-04-16T18:17:46.728 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.730 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa63bf17cba0ff41-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.730 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:40.827Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-16T18:17:46.731 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.731 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.731 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.731 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.731 DEBUG:boto:Method: GET 2024-04-16T18:17:46.731 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.731 DEBUG:boto:Data: 2024-04-16T18:17:46.732 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.732 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.732 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.732 DEBUG:boto:Params: {} 2024-04-16T18:17:46.732 DEBUG:boto:Token: None 2024-04-16T18:17:46.732 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do= 2024-04-16T18:17:46.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do=', 'Content-Length': '0'} 2024-04-16T18:17:46.735 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4c4e223c0a53524-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.778 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.778 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.779 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.779 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.779 DEBUG:boto:Method: GET 2024-04-16T18:17:46.779 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.779 DEBUG:boto:Data: 2024-04-16T18:17:46.779 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.779 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.779 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.779 DEBUG:boto:Params: {} 2024-04-16T18:17:46.779 DEBUG:boto:Token: None 2024-04-16T18:17:46.780 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do= 2024-04-16T18:17:46.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do=', 'Content-Length': '0'} 2024-04-16T18:17:46.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081ff8e6c59c2c01a-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.782 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.782 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.783 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.783 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.783 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.783 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.783 DEBUG:boto:Data: 2024-04-16T18:17:46.783 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.783 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.783 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.783 DEBUG:boto:Params: {} 2024-04-16T18:17:46.783 DEBUG:boto:Token: None 2024-04-16T18:17:46.784 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jAXgNdysxfGTR4z/6j3tmyNHoIg= 2024-04-16T18:17:46.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jAXgNdysxfGTR4z/6j3tmyNHoIg=', 'Content-Length': '0'} 2024-04-16T18:17:46.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d66c10f94806507-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.786 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.786 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.786 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.786 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.787 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.787 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.787 DEBUG:boto:Data: 2024-04-16T18:17:46.787 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.787 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.787 DEBUG:boto:Params: {} 2024-04-16T18:17:46.787 DEBUG:boto:Token: None 2024-04-16T18:17:46.787 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jAXgNdysxfGTR4z/6j3tmyNHoIg= 2024-04-16T18:17:46.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jAXgNdysxfGTR4z/6j3tmyNHoIg=', 'Content-Length': '0'} 2024-04-16T18:17:46.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c8d869d8ccbd08d-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.790 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-16T18:17:46.790 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.790 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.790 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.790 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.790 DEBUG:boto:Method: GET 2024-04-16T18:17:46.790 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.790 DEBUG:boto:Data: 2024-04-16T18:17:46.791 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.791 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.791 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.791 DEBUG:boto:Params: {} 2024-04-16T18:17:46.791 DEBUG:boto:Token: None 2024-04-16T18:17:46.791 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do= 2024-04-16T18:17:46.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do=', 'Content-Length': '0'} 2024-04-16T18:17:46.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000764d9f8d6b1748fe-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.834 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.834 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.835 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.835 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.835 DEBUG:boto:Method: GET 2024-04-16T18:17:46.835 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.835 DEBUG:boto:Data: 2024-04-16T18:17:46.835 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.835 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.835 DEBUG:boto:Params: {} 2024-04-16T18:17:46.835 DEBUG:boto:Token: None 2024-04-16T18:17:46.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:17:46.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do= 2024-04-16T18:17:46.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UU7MjArK45soiL5lhtp5Ciow4Do=', 'Content-Length': '0'} 2024-04-16T18:17:46.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002cc44142de20d795-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.838 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.838 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.838 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.838 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.838 DEBUG:boto:Method: GET 2024-04-16T18:17:46.838 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.838 DEBUG:boto:Data: 2024-04-16T18:17:46.838 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.839 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.839 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.839 DEBUG:boto:Params: {} 2024-04-16T18:17:46.839 DEBUG:boto:Token: None 2024-04-16T18:17:46.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096e4bfbfac4113d2-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.882 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.883 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.883 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.883 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.883 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.883 DEBUG:boto:Method: GET 2024-04-16T18:17:46.883 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.883 DEBUG:boto:Data: 2024-04-16T18:17:46.883 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.883 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.883 DEBUG:boto:Params: {} 2024-04-16T18:17:46.883 DEBUG:boto:Token: None 2024-04-16T18:17:46.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b362e2ed74d2d36-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.886 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.887 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.887 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.887 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.887 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.887 DEBUG:boto:Data: 2024-04-16T18:17:46.887 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.887 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.887 DEBUG:boto:Params: {} 2024-04-16T18:17:46.888 DEBUG:boto:Token: None 2024-04-16T18:17:46.888 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e+RUvCSPh88VkFtIoXG+8981zW4= 2024-04-16T18:17:46.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e+RUvCSPh88VkFtIoXG+8981zW4=', 'Content-Length': '0'} 2024-04-16T18:17:46.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b63c6f979ab9b8d-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.890 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.890 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.890 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.891 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.891 DEBUG:boto:Data: 2024-04-16T18:17:46.891 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.891 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.891 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.891 DEBUG:boto:Params: {} 2024-04-16T18:17:46.891 DEBUG:boto:Token: None 2024-04-16T18:17:46.891 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e+RUvCSPh88VkFtIoXG+8981zW4= 2024-04-16T18:17:46.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e+RUvCSPh88VkFtIoXG+8981zW4=', 'Content-Length': '0'} 2024-04-16T18:17:46.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000508d1d627ed53f31-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.894 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-16T18:17:46.894 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.894 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.894 DEBUG:boto:Method: GET 2024-04-16T18:17:46.894 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.894 DEBUG:boto:Data: 2024-04-16T18:17:46.894 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.894 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.894 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.894 DEBUG:boto:Params: {} 2024-04-16T18:17:46.895 DEBUG:boto:Token: None 2024-04-16T18:17:46.895 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W9e+0zVbd2D53hm8qS686RXMc/4= 2024-04-16T18:17:46.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W9e+0zVbd2D53hm8qS686RXMc/4=', 'Content-Length': '0'} 2024-04-16T18:17:46.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd8188f5908a48af-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.938 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.938 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.939 DEBUG:boto:Method: GET 2024-04-16T18:17:46.939 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.939 DEBUG:boto:Data: 2024-04-16T18:17:46.939 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.939 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.939 DEBUG:boto:Params: {} 2024-04-16T18:17:46.939 DEBUG:boto:Token: None 2024-04-16T18:17:46.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:46.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W9e+0zVbd2D53hm8qS686RXMc/4= 2024-04-16T18:17:46.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W9e+0zVbd2D53hm8qS686RXMc/4=', 'Content-Length': '0'} 2024-04-16T18:17:46.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef6587c327d5cf0f-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.942 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.942 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.942 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.942 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.942 DEBUG:boto:Method: GET 2024-04-16T18:17:46.942 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.943 DEBUG:boto:Data: 2024-04-16T18:17:46.943 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.943 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.943 DEBUG:boto:Params: {} 2024-04-16T18:17:46.943 DEBUG:boto:Token: None 2024-04-16T18:17:46.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033265d85eaf3527f-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.946 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.946 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:46.946 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:46.947 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.947 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.947 DEBUG:boto:Method: GET 2024-04-16T18:17:46.947 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:17:46.947 DEBUG:boto:Data: 2024-04-16T18:17:46.947 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.947 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.947 DEBUG:boto:Params: {} 2024-04-16T18:17:46.947 DEBUG:boto:Token: None 2024-04-16T18:17:46.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/ 2024-04-16T18:17:46.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00= 2024-04-16T18:17:46.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NJ4ZdWr6KnjbGDsAD3yu169pN00=', 'Content-Length': '0'} 2024-04-16T18:17:46.950 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059f651aa8cff3da8-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.950 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:40.961Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:46.950 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-16T18:17:46.951 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:46.951 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:46.951 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.951 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.951 DEBUG:boto:Method: GET 2024-04-16T18:17:46.951 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.951 DEBUG:boto:Data: 2024-04-16T18:17:46.951 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.951 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.951 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.951 DEBUG:boto:Params: {} 2024-04-16T18:17:46.952 DEBUG:boto:Token: None 2024-04-16T18:17:46.952 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aQIAoMA09Q6v8G0+oHvf2f9kLbA= 2024-04-16T18:17:46.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aQIAoMA09Q6v8G0+oHvf2f9kLbA=', 'Content-Length': '0'} 2024-04-16T18:17:46.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000298deb05224a2c5d-00661ec0ca-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.994 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:46.994 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:46.994 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.994 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.995 DEBUG:boto:Method: GET 2024-04-16T18:17:46.995 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.995 DEBUG:boto:Data: 2024-04-16T18:17:46.995 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:46.995 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.995 DEBUG:boto:Params: {} 2024-04-16T18:17:46.995 DEBUG:boto:Token: None 2024-04-16T18:17:46.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aQIAoMA09Q6v8G0+oHvf2f9kLbA= 2024-04-16T18:17:46.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aQIAoMA09Q6v8G0+oHvf2f9kLbA=', 'Content-Length': '0'} 2024-04-16T18:17:46.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1deda4dd4237620-00661ec0ca-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:46.998 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:46.998 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:46.998 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.998 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.998 DEBUG:boto:Method: HEAD 2024-04-16T18:17:46.998 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.998 DEBUG:boto:Data: 2024-04-16T18:17:46.998 DEBUG:boto:Headers: {} 2024-04-16T18:17:46.998 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:46.999 DEBUG:boto:Port: 8000 2024-04-16T18:17:46.999 DEBUG:boto:Params: {} 2024-04-16T18:17:46.999 DEBUG:boto:Token: None 2024-04-16T18:17:46.999 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:46 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:46.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l8qpXnjkId5rhULhXcroT80HpKw= 2024-04-16T18:17:46.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l8qpXnjkId5rhULhXcroT80HpKw=', 'Content-Length': '0'} 2024-04-16T18:17:47.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000758a6a1ace503d9d-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.001 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.001 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.001 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.001 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.001 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.001 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.001 DEBUG:boto:Data: 2024-04-16T18:17:47.002 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.002 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.002 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.002 DEBUG:boto:Params: {} 2024-04-16T18:17:47.002 DEBUG:boto:Token: None 2024-04-16T18:17:47.002 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.002 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0eHARQuCb/lDQ9IAwZ9JRZn9Xqw= 2024-04-16T18:17:47.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0eHARQuCb/lDQ9IAwZ9JRZn9Xqw=', 'Content-Length': '0'} 2024-04-16T18:17:47.004 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f9e78b51b93d4fd-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.004 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-16T18:17:47.004 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.004 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.004 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.005 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.005 DEBUG:boto:Method: GET 2024-04-16T18:17:47.005 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.005 DEBUG:boto:Data: 2024-04-16T18:17:47.005 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.005 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.005 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.005 DEBUG:boto:Params: {} 2024-04-16T18:17:47.005 DEBUG:boto:Token: None 2024-04-16T18:17:47.006 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.006 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PfC8EFB2X663Ca+SpQwnv+tDdk0= 2024-04-16T18:17:47.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PfC8EFB2X663Ca+SpQwnv+tDdk0=', 'Content-Length': '0'} 2024-04-16T18:17:47.008 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7a95a6cc03dbaae-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.050 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.066 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.066 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.066 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.066 DEBUG:boto:Method: GET 2024-04-16T18:17:47.066 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.066 DEBUG:boto:Data: 2024-04-16T18:17:47.066 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.066 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.067 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.067 DEBUG:boto:Params: {} 2024-04-16T18:17:47.067 DEBUG:boto:Token: None 2024-04-16T18:17:47.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:17:47.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PfC8EFB2X663Ca+SpQwnv+tDdk0= 2024-04-16T18:17:47.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PfC8EFB2X663Ca+SpQwnv+tDdk0=', 'Content-Length': '0'} 2024-04-16T18:17:47.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2b2d15228d03c30-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.069 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.069 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.069 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.070 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.070 DEBUG:boto:Method: GET 2024-04-16T18:17:47.070 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.070 DEBUG:boto:Data: 2024-04-16T18:17:47.070 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.070 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.071 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.071 DEBUG:boto:Params: {} 2024-04-16T18:17:47.071 DEBUG:boto:Token: None 2024-04-16T18:17:47.071 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.074 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f33707b976dff3bb-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.074 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.074 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.074 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.075 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.075 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.075 DEBUG:boto:Method: GET 2024-04-16T18:17:47.075 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.075 DEBUG:boto:Data: 2024-04-16T18:17:47.075 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.075 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.075 DEBUG:boto:Params: {} 2024-04-16T18:17:47.075 DEBUG:boto:Token: None 2024-04-16T18:17:47.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.077 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccb7a682274e0a0d-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.078 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.078 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.078 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.078 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.078 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.078 DEBUG:boto:Data: 2024-04-16T18:17:47.079 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.079 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.079 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.079 DEBUG:boto:Params: {} 2024-04-16T18:17:47.079 DEBUG:boto:Token: None 2024-04-16T18:17:47.079 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xjNeMMQFnBfvmgwrL5J3SSIh6aU= 2024-04-16T18:17:47.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xjNeMMQFnBfvmgwrL5J3SSIh6aU=', 'Content-Length': '0'} 2024-04-16T18:17:47.082 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000830eb19ce724beb5-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.082 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.082 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.082 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.083 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.083 DEBUG:boto:Data: 2024-04-16T18:17:47.083 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.083 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.083 DEBUG:boto:Params: {} 2024-04-16T18:17:47.083 DEBUG:boto:Token: None 2024-04-16T18:17:47.083 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.083 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xjNeMMQFnBfvmgwrL5J3SSIh6aU= 2024-04-16T18:17:47.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xjNeMMQFnBfvmgwrL5J3SSIh6aU=', 'Content-Length': '0'} 2024-04-16T18:17:47.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aefa92d1cd92a760-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.085 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-16T18:17:47.085 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.085 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.085 DEBUG:boto:Method: GET 2024-04-16T18:17:47.085 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.086 DEBUG:boto:Data: 2024-04-16T18:17:47.086 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.086 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.086 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.086 DEBUG:boto:Params: {} 2024-04-16T18:17:47.086 DEBUG:boto:Token: None 2024-04-16T18:17:47.086 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.086 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vAUCHzTDfGq0t2s+7F/nrezBzi0= 2024-04-16T18:17:47.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vAUCHzTDfGq0t2s+7F/nrezBzi0=', 'Content-Length': '0'} 2024-04-16T18:17:47.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000033bfdf7224d135d-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.130 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.131 DEBUG:boto:Method: GET 2024-04-16T18:17:47.131 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.131 DEBUG:boto:Data: 2024-04-16T18:17:47.131 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.131 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.131 DEBUG:boto:Params: {} 2024-04-16T18:17:47.131 DEBUG:boto:Token: None 2024-04-16T18:17:47.131 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:47.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vAUCHzTDfGq0t2s+7F/nrezBzi0= 2024-04-16T18:17:47.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vAUCHzTDfGq0t2s+7F/nrezBzi0=', 'Content-Length': '0'} 2024-04-16T18:17:47.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002713e6e3fae81549-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.133 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.134 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.134 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.134 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.134 DEBUG:boto:Method: GET 2024-04-16T18:17:47.134 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.134 DEBUG:boto:Data: 2024-04-16T18:17:47.134 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.134 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.134 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.135 DEBUG:boto:Params: {} 2024-04-16T18:17:47.135 DEBUG:boto:Token: None 2024-04-16T18:17:47.135 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013ed28ee1e7ff4e2-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.137 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.138 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.138 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.138 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.138 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.138 DEBUG:boto:Method: GET 2024-04-16T18:17:47.138 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:17:47.138 DEBUG:boto:Data: 2024-04-16T18:17:47.138 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.139 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.139 DEBUG:boto:Params: {} 2024-04-16T18:17:47.139 DEBUG:boto:Token: None 2024-04-16T18:17:47.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df492079f6c546c9-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.141 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:40.904Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.142 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-16T18:17:47.142 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.142 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.142 DEBUG:boto:Method: GET 2024-04-16T18:17:47.142 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.143 DEBUG:boto:Data: 2024-04-16T18:17:47.143 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.143 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.143 DEBUG:boto:Params: {} 2024-04-16T18:17:47.143 DEBUG:boto:Token: None 2024-04-16T18:17:47.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE= 2024-04-16T18:17:47.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE=', 'Content-Length': '0'} 2024-04-16T18:17:47.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a897c71f66c767ba-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.186 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.186 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.187 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.187 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.187 DEBUG:boto:Method: GET 2024-04-16T18:17:47.187 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.187 DEBUG:boto:Data: 2024-04-16T18:17:47.187 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.187 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.187 DEBUG:boto:Params: {} 2024-04-16T18:17:47.187 DEBUG:boto:Token: None 2024-04-16T18:17:47.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE= 2024-04-16T18:17:47.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE=', 'Content-Length': '0'} 2024-04-16T18:17:47.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005949df6e1cb183a0-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.190 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.190 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.190 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.190 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.190 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.191 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.191 DEBUG:boto:Data: 2024-04-16T18:17:47.191 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.191 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.191 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.191 DEBUG:boto:Params: {} 2024-04-16T18:17:47.191 DEBUG:boto:Token: None 2024-04-16T18:17:47.191 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.191 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:08lVhooBglF8FZl01FA6SBpRWbE= 2024-04-16T18:17:47.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:08lVhooBglF8FZl01FA6SBpRWbE=', 'Content-Length': '0'} 2024-04-16T18:17:47.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c54875a51b2bdf5-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.193 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.194 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.194 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.194 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.194 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.194 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.194 DEBUG:boto:Data: 2024-04-16T18:17:47.194 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.194 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.194 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.194 DEBUG:boto:Params: {} 2024-04-16T18:17:47.195 DEBUG:boto:Token: None 2024-04-16T18:17:47.195 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:08lVhooBglF8FZl01FA6SBpRWbE= 2024-04-16T18:17:47.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:08lVhooBglF8FZl01FA6SBpRWbE=', 'Content-Length': '0'} 2024-04-16T18:17:47.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c122c61f9f72ba33-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.197 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-16T18:17:47.197 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.197 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.197 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.197 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.197 DEBUG:boto:Method: GET 2024-04-16T18:17:47.198 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.198 DEBUG:boto:Data: 2024-04-16T18:17:47.198 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.198 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.198 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.198 DEBUG:boto:Params: {} 2024-04-16T18:17:47.198 DEBUG:boto:Token: None 2024-04-16T18:17:47.198 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE= 2024-04-16T18:17:47.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE=', 'Content-Length': '0'} 2024-04-16T18:17:47.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000630f3292e94743b2-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.242 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.242 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.242 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.243 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.243 DEBUG:boto:Method: GET 2024-04-16T18:17:47.243 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.243 DEBUG:boto:Data: 2024-04-16T18:17:47.243 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.243 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.243 DEBUG:boto:Params: {} 2024-04-16T18:17:47.243 DEBUG:boto:Token: None 2024-04-16T18:17:47.243 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:17:47.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE= 2024-04-16T18:17:47.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:96w9p64u8qIbU3gE5tH29ujNvOE=', 'Content-Length': '0'} 2024-04-16T18:17:47.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005242e520829737de-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.246 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.246 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.246 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.246 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.246 DEBUG:boto:Method: GET 2024-04-16T18:17:47.246 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.246 DEBUG:boto:Data: 2024-04-16T18:17:47.247 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.247 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.247 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.247 DEBUG:boto:Params: {} 2024-04-16T18:17:47.247 DEBUG:boto:Token: None 2024-04-16T18:17:47.247 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.250 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac16264c9402f551-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.250 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.250 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.250 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.250 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.250 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.251 DEBUG:boto:Method: GET 2024-04-16T18:17:47.251 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.251 DEBUG:boto:Data: 2024-04-16T18:17:47.251 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.251 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.251 DEBUG:boto:Params: {} 2024-04-16T18:17:47.251 DEBUG:boto:Token: None 2024-04-16T18:17:47.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.254 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000726936cb6975b6ec-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.254 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.254 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.254 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.254 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.254 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.254 DEBUG:boto:Data: 2024-04-16T18:17:47.255 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.255 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.255 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.255 DEBUG:boto:Params: {} 2024-04-16T18:17:47.255 DEBUG:boto:Token: None 2024-04-16T18:17:47.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HkpokE4fGx1oVpy7F4bm2+KcG/s= 2024-04-16T18:17:47.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HkpokE4fGx1oVpy7F4bm2+KcG/s=', 'Content-Length': '0'} 2024-04-16T18:17:47.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028476fc9b2db195b-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.257 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.258 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.258 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.258 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.258 DEBUG:boto:Data: 2024-04-16T18:17:47.258 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.258 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.258 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.258 DEBUG:boto:Params: {} 2024-04-16T18:17:47.258 DEBUG:boto:Token: None 2024-04-16T18:17:47.258 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HkpokE4fGx1oVpy7F4bm2+KcG/s= 2024-04-16T18:17:47.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HkpokE4fGx1oVpy7F4bm2+KcG/s=', 'Content-Length': '0'} 2024-04-16T18:17:47.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000679eb22129081311-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-16T18:17:47.261 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.261 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.261 DEBUG:boto:Method: GET 2024-04-16T18:17:47.261 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.261 DEBUG:boto:Data: 2024-04-16T18:17:47.261 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.261 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.262 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.262 DEBUG:boto:Params: {} 2024-04-16T18:17:47.262 DEBUG:boto:Token: None 2024-04-16T18:17:47.262 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.262 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o5mBf6qV/r7KL6JaJcFc736l00c= 2024-04-16T18:17:47.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o5mBf6qV/r7KL6JaJcFc736l00c=', 'Content-Length': '0'} 2024-04-16T18:17:47.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db98a1d694f33ee3-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.306 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.307 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.307 DEBUG:boto:Method: GET 2024-04-16T18:17:47.307 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.307 DEBUG:boto:Data: 2024-04-16T18:17:47.307 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.307 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.307 DEBUG:boto:Params: {} 2024-04-16T18:17:47.307 DEBUG:boto:Token: None 2024-04-16T18:17:47.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:47.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o5mBf6qV/r7KL6JaJcFc736l00c= 2024-04-16T18:17:47.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o5mBf6qV/r7KL6JaJcFc736l00c=', 'Content-Length': '0'} 2024-04-16T18:17:47.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003de4ae6c695cb3a5-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.310 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.310 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.311 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.311 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.311 DEBUG:boto:Method: GET 2024-04-16T18:17:47.311 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.311 DEBUG:boto:Data: 2024-04-16T18:17:47.311 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.311 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.311 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.311 DEBUG:boto:Params: {} 2024-04-16T18:17:47.311 DEBUG:boto:Token: None 2024-04-16T18:17:47.312 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.314 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f510bb9d66dba189-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.314 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.314 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.315 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.315 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.315 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.315 DEBUG:boto:Method: GET 2024-04-16T18:17:47.315 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:17:47.315 DEBUG:boto:Data: 2024-04-16T18:17:47.315 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.315 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.315 DEBUG:boto:Params: {} 2024-04-16T18:17:47.315 DEBUG:boto:Token: None 2024-04-16T18:17:47.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.318 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e1fdf15e45f0e7f-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.318 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:40.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-16T18:17:47.319 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.319 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.319 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.319 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.319 DEBUG:boto:Method: GET 2024-04-16T18:17:47.319 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.319 DEBUG:boto:Data: 2024-04-16T18:17:47.319 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.319 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.319 DEBUG:boto:Params: {} 2024-04-16T18:17:47.320 DEBUG:boto:Token: None 2024-04-16T18:17:47.320 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA= 2024-04-16T18:17:47.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA=', 'Content-Length': '0'} 2024-04-16T18:17:47.322 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe1463bbe0f1df19-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.362 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.362 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.363 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.363 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.363 DEBUG:boto:Method: GET 2024-04-16T18:17:47.363 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.363 DEBUG:boto:Data: 2024-04-16T18:17:47.363 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.363 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.363 DEBUG:boto:Params: {} 2024-04-16T18:17:47.363 DEBUG:boto:Token: None 2024-04-16T18:17:47.364 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA= 2024-04-16T18:17:47.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA=', 'Content-Length': '0'} 2024-04-16T18:17:47.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a78e90bd63498856-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.366 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.366 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.366 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.366 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.366 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.366 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.366 DEBUG:boto:Data: 2024-04-16T18:17:47.367 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.367 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.367 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.367 DEBUG:boto:Params: {} 2024-04-16T18:17:47.367 DEBUG:boto:Token: None 2024-04-16T18:17:47.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bwBdKYU5NtxMY1jcQNSGEa128LQ= 2024-04-16T18:17:47.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bwBdKYU5NtxMY1jcQNSGEa128LQ=', 'Content-Length': '0'} 2024-04-16T18:17:47.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002d6ed7bcda71cc2-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.370 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.370 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.370 DEBUG:boto:Data: 2024-04-16T18:17:47.370 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.370 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.371 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.371 DEBUG:boto:Params: {} 2024-04-16T18:17:47.371 DEBUG:boto:Token: None 2024-04-16T18:17:47.371 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bwBdKYU5NtxMY1jcQNSGEa128LQ= 2024-04-16T18:17:47.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bwBdKYU5NtxMY1jcQNSGEa128LQ=', 'Content-Length': '0'} 2024-04-16T18:17:47.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091b6c2b4a47906ae-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-16T18:17:47.373 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.373 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.373 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.374 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.374 DEBUG:boto:Method: GET 2024-04-16T18:17:47.374 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.374 DEBUG:boto:Data: 2024-04-16T18:17:47.374 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.374 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.374 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.374 DEBUG:boto:Params: {} 2024-04-16T18:17:47.374 DEBUG:boto:Token: None 2024-04-16T18:17:47.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA= 2024-04-16T18:17:47.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA=', 'Content-Length': '0'} 2024-04-16T18:17:47.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d845248d65b467ba-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.418 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.418 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.418 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.419 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.419 DEBUG:boto:Method: GET 2024-04-16T18:17:47.419 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.419 DEBUG:boto:Data: 2024-04-16T18:17:47.419 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.419 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.419 DEBUG:boto:Params: {} 2024-04-16T18:17:47.419 DEBUG:boto:Token: None 2024-04-16T18:17:47.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:17:47.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA= 2024-04-16T18:17:47.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dtIxR8D8VNA1eimN0lg5FaKfqJA=', 'Content-Length': '0'} 2024-04-16T18:17:47.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8d0562f2856550e-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.422 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.422 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.422 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.422 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.422 DEBUG:boto:Method: GET 2024-04-16T18:17:47.423 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.423 DEBUG:boto:Data: 2024-04-16T18:17:47.423 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.423 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.423 DEBUG:boto:Params: {} 2024-04-16T18:17:47.423 DEBUG:boto:Token: None 2024-04-16T18:17:47.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5f7b7b25c9e38f0-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.426 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.426 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.426 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.427 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.427 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.427 DEBUG:boto:Method: GET 2024-04-16T18:17:47.427 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.427 DEBUG:boto:Data: 2024-04-16T18:17:47.427 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.427 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.427 DEBUG:boto:Params: {} 2024-04-16T18:17:47.428 DEBUG:boto:Token: None 2024-04-16T18:17:47.428 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089b0323df6a698b2-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.430 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.431 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.431 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.431 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.431 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.431 DEBUG:boto:Data: 2024-04-16T18:17:47.431 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.431 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.432 DEBUG:boto:Params: {} 2024-04-16T18:17:47.432 DEBUG:boto:Token: None 2024-04-16T18:17:47.432 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KRo9/1a5Z0Zl2IiAVxerF7k18x8= 2024-04-16T18:17:47.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KRo9/1a5Z0Zl2IiAVxerF7k18x8=', 'Content-Length': '0'} 2024-04-16T18:17:47.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae9ce4fec28b2d5c-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.434 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.434 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.435 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.435 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.435 DEBUG:boto:Data: 2024-04-16T18:17:47.435 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.435 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.435 DEBUG:boto:Params: {} 2024-04-16T18:17:47.435 DEBUG:boto:Token: None 2024-04-16T18:17:47.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KRo9/1a5Z0Zl2IiAVxerF7k18x8= 2024-04-16T18:17:47.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KRo9/1a5Z0Zl2IiAVxerF7k18x8=', 'Content-Length': '0'} 2024-04-16T18:17:47.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cda2efd6d1d7bc91-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-16T18:17:47.438 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.438 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.438 DEBUG:boto:Method: GET 2024-04-16T18:17:47.438 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.438 DEBUG:boto:Data: 2024-04-16T18:17:47.438 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.438 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.438 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.438 DEBUG:boto:Params: {} 2024-04-16T18:17:47.438 DEBUG:boto:Token: None 2024-04-16T18:17:47.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OAXW0lFCVEnOp0J6yDOKCV3ffRY= 2024-04-16T18:17:47.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OAXW0lFCVEnOp0J6yDOKCV3ffRY=', 'Content-Length': '0'} 2024-04-16T18:17:47.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005863dc64a6a6c575-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.482 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.482 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.483 DEBUG:boto:Method: GET 2024-04-16T18:17:47.483 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.483 DEBUG:boto:Data: 2024-04-16T18:17:47.483 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.483 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.483 DEBUG:boto:Params: {} 2024-04-16T18:17:47.483 DEBUG:boto:Token: None 2024-04-16T18:17:47.483 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:47.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OAXW0lFCVEnOp0J6yDOKCV3ffRY= 2024-04-16T18:17:47.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OAXW0lFCVEnOp0J6yDOKCV3ffRY=', 'Content-Length': '0'} 2024-04-16T18:17:47.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000021b30ec05e52c07-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.486 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.486 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.486 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.486 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.486 DEBUG:boto:Method: GET 2024-04-16T18:17:47.486 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.486 DEBUG:boto:Data: 2024-04-16T18:17:47.486 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.487 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.487 DEBUG:boto:Params: {} 2024-04-16T18:17:47.487 DEBUG:boto:Token: None 2024-04-16T18:17:47.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065a6e9fdcbfe0c49-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.490 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.490 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.490 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.490 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.490 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.491 DEBUG:boto:Method: GET 2024-04-16T18:17:47.491 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:17:47.491 DEBUG:boto:Data: 2024-04-16T18:17:47.491 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.491 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.491 DEBUG:boto:Params: {} 2024-04-16T18:17:47.491 DEBUG:boto:Token: None 2024-04-16T18:17:47.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e990628ee62f6c0c-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.494 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:40.770Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.494 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-16T18:17:47.495 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.495 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.495 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.495 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.495 DEBUG:boto:Method: GET 2024-04-16T18:17:47.495 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.495 DEBUG:boto:Data: 2024-04-16T18:17:47.495 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.495 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.495 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.496 DEBUG:boto:Params: {} 2024-04-16T18:17:47.496 DEBUG:boto:Token: None 2024-04-16T18:17:47.496 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk= 2024-04-16T18:17:47.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk=', 'Content-Length': '0'} 2024-04-16T18:17:47.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005212beef51246ff-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.538 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.538 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.538 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.538 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.539 DEBUG:boto:Method: GET 2024-04-16T18:17:47.539 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.539 DEBUG:boto:Data: 2024-04-16T18:17:47.539 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.539 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.539 DEBUG:boto:Params: {} 2024-04-16T18:17:47.539 DEBUG:boto:Token: None 2024-04-16T18:17:47.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk= 2024-04-16T18:17:47.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk=', 'Content-Length': '0'} 2024-04-16T18:17:47.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088ca01f3696682bd-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.542 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.542 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.542 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.543 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.543 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.543 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.543 DEBUG:boto:Data: 2024-04-16T18:17:47.543 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.543 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.543 DEBUG:boto:Params: {} 2024-04-16T18:17:47.543 DEBUG:boto:Token: None 2024-04-16T18:17:47.543 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:50haNKtboyxeDkbjEjLYrZjN+Yc= 2024-04-16T18:17:47.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:50haNKtboyxeDkbjEjLYrZjN+Yc=', 'Content-Length': '0'} 2024-04-16T18:17:47.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee5be25d6b690e28-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.546 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.546 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.546 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.546 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.546 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.546 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.546 DEBUG:boto:Data: 2024-04-16T18:17:47.546 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.546 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.546 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.547 DEBUG:boto:Params: {} 2024-04-16T18:17:47.547 DEBUG:boto:Token: None 2024-04-16T18:17:47.547 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.547 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:50haNKtboyxeDkbjEjLYrZjN+Yc= 2024-04-16T18:17:47.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:50haNKtboyxeDkbjEjLYrZjN+Yc=', 'Content-Length': '0'} 2024-04-16T18:17:47.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2723910e83aa415-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.549 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-16T18:17:47.549 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.550 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.550 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.550 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.550 DEBUG:boto:Method: GET 2024-04-16T18:17:47.550 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.550 DEBUG:boto:Data: 2024-04-16T18:17:47.550 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.550 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.550 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.550 DEBUG:boto:Params: {} 2024-04-16T18:17:47.550 DEBUG:boto:Token: None 2024-04-16T18:17:47.551 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.551 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk= 2024-04-16T18:17:47.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk=', 'Content-Length': '0'} 2024-04-16T18:17:47.553 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b68f60dc240b839-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.594 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.594 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.594 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.595 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.595 DEBUG:boto:Method: GET 2024-04-16T18:17:47.595 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.595 DEBUG:boto:Data: 2024-04-16T18:17:47.595 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.595 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.595 DEBUG:boto:Params: {} 2024-04-16T18:17:47.595 DEBUG:boto:Token: None 2024-04-16T18:17:47.596 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:17:47.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk= 2024-04-16T18:17:47.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yUEtEw47lNMV4FcSNZIGZmMeUpk=', 'Content-Length': '0'} 2024-04-16T18:17:47.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000829ef7201a6b20c6-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.598 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.598 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.598 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.598 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.598 DEBUG:boto:Method: GET 2024-04-16T18:17:47.599 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.599 DEBUG:boto:Data: 2024-04-16T18:17:47.599 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.599 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.599 DEBUG:boto:Params: {} 2024-04-16T18:17:47.599 DEBUG:boto:Token: None 2024-04-16T18:17:47.599 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.602 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b596cb1aa7880c9c-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.602 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.602 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.603 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.603 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.603 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.603 DEBUG:boto:Method: GET 2024-04-16T18:17:47.603 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.603 DEBUG:boto:Data: 2024-04-16T18:17:47.603 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.603 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.603 DEBUG:boto:Params: {} 2024-04-16T18:17:47.604 DEBUG:boto:Token: None 2024-04-16T18:17:47.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.606 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ba8fba897a1aee1-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.607 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.607 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.607 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.607 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.607 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.607 DEBUG:boto:Data: 2024-04-16T18:17:47.608 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.608 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.608 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.608 DEBUG:boto:Params: {} 2024-04-16T18:17:47.608 DEBUG:boto:Token: None 2024-04-16T18:17:47.608 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pCL+o1Z/Naa8UNhWIX+lpRbn9fk= 2024-04-16T18:17:47.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pCL+o1Z/Naa8UNhWIX+lpRbn9fk=', 'Content-Length': '0'} 2024-04-16T18:17:47.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078d644ae9316ea21-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.611 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.611 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.611 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.611 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.612 DEBUG:boto:Data: 2024-04-16T18:17:47.612 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.612 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.612 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.612 DEBUG:boto:Params: {} 2024-04-16T18:17:47.612 DEBUG:boto:Token: None 2024-04-16T18:17:47.612 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pCL+o1Z/Naa8UNhWIX+lpRbn9fk= 2024-04-16T18:17:47.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pCL+o1Z/Naa8UNhWIX+lpRbn9fk=', 'Content-Length': '0'} 2024-04-16T18:17:47.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d14b957fad5cdc86-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.614 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-16T18:17:47.615 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.615 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.615 DEBUG:boto:Method: GET 2024-04-16T18:17:47.615 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.615 DEBUG:boto:Data: 2024-04-16T18:17:47.615 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.615 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.615 DEBUG:boto:Params: {} 2024-04-16T18:17:47.615 DEBUG:boto:Token: None 2024-04-16T18:17:47.616 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:urjG5yrSwIqcCxLCfTDpW5eY1L4= 2024-04-16T18:17:47.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:urjG5yrSwIqcCxLCfTDpW5eY1L4=', 'Content-Length': '0'} 2024-04-16T18:17:47.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fff88df02e7ef1b7-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.658 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.658 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.659 DEBUG:boto:Method: GET 2024-04-16T18:17:47.659 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.659 DEBUG:boto:Data: 2024-04-16T18:17:47.659 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.659 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.659 DEBUG:boto:Params: {} 2024-04-16T18:17:47.659 DEBUG:boto:Token: None 2024-04-16T18:17:47.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:47.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:urjG5yrSwIqcCxLCfTDpW5eY1L4= 2024-04-16T18:17:47.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:urjG5yrSwIqcCxLCfTDpW5eY1L4=', 'Content-Length': '0'} 2024-04-16T18:17:47.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7a83675ca813bbf-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.662 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.662 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.662 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.662 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.662 DEBUG:boto:Method: GET 2024-04-16T18:17:47.663 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.663 DEBUG:boto:Data: 2024-04-16T18:17:47.663 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.663 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.663 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.663 DEBUG:boto:Params: {} 2024-04-16T18:17:47.663 DEBUG:boto:Token: None 2024-04-16T18:17:47.663 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.666 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb5068732ab4cdbf-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.706 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.707 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.707 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.707 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.707 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.707 DEBUG:boto:Method: GET 2024-04-16T18:17:47.707 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:17:47.707 DEBUG:boto:Data: 2024-04-16T18:17:47.707 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.708 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.708 DEBUG:boto:Params: {} 2024-04-16T18:17:47.708 DEBUG:boto:Token: None 2024-04-16T18:17:47.708 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.708 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f791cd08ac14afae-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.711 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:40.847Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.711 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-16T18:17:47.711 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.711 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.711 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.711 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.712 DEBUG:boto:Method: GET 2024-04-16T18:17:47.712 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.712 DEBUG:boto:Data: 2024-04-16T18:17:47.712 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.712 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.712 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.712 DEBUG:boto:Params: {} 2024-04-16T18:17:47.712 DEBUG:boto:Token: None 2024-04-16T18:17:47.713 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.713 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4= 2024-04-16T18:17:47.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4=', 'Content-Length': '0'} 2024-04-16T18:17:47.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8209c66e978b4d4-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.758 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.758 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.759 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.759 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.759 DEBUG:boto:Method: GET 2024-04-16T18:17:47.759 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.759 DEBUG:boto:Data: 2024-04-16T18:17:47.759 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.759 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.759 DEBUG:boto:Params: {} 2024-04-16T18:17:47.759 DEBUG:boto:Token: None 2024-04-16T18:17:47.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4= 2024-04-16T18:17:47.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4=', 'Content-Length': '0'} 2024-04-16T18:17:47.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e8f70a15c1aecd5-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.762 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.762 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.762 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.762 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.762 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.762 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.762 DEBUG:boto:Data: 2024-04-16T18:17:47.762 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.762 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.762 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.763 DEBUG:boto:Params: {} 2024-04-16T18:17:47.763 DEBUG:boto:Token: None 2024-04-16T18:17:47.763 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tyUg+/EYgIU0H3Kl6E6Iw2y3wLE= 2024-04-16T18:17:47.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tyUg+/EYgIU0H3Kl6E6Iw2y3wLE=', 'Content-Length': '0'} 2024-04-16T18:17:47.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090be39e2ae9e02fb-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.765 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.765 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.765 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.765 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.765 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.765 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.766 DEBUG:boto:Data: 2024-04-16T18:17:47.766 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.766 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.766 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.766 DEBUG:boto:Params: {} 2024-04-16T18:17:47.766 DEBUG:boto:Token: None 2024-04-16T18:17:47.766 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tyUg+/EYgIU0H3Kl6E6Iw2y3wLE= 2024-04-16T18:17:47.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tyUg+/EYgIU0H3Kl6E6Iw2y3wLE=', 'Content-Length': '0'} 2024-04-16T18:17:47.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063c11afb26a1ec1e-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.768 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-16T18:17:47.768 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.769 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.769 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.769 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.769 DEBUG:boto:Method: GET 2024-04-16T18:17:47.769 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.769 DEBUG:boto:Data: 2024-04-16T18:17:47.769 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.769 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.769 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.769 DEBUG:boto:Params: {} 2024-04-16T18:17:47.769 DEBUG:boto:Token: None 2024-04-16T18:17:47.770 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.770 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4= 2024-04-16T18:17:47.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4=', 'Content-Length': '0'} 2024-04-16T18:17:47.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019602df10d4ff657-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.814 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.814 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.814 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.815 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.815 DEBUG:boto:Method: GET 2024-04-16T18:17:47.815 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.815 DEBUG:boto:Data: 2024-04-16T18:17:47.815 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.815 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.815 DEBUG:boto:Params: {} 2024-04-16T18:17:47.815 DEBUG:boto:Token: None 2024-04-16T18:17:47.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:17:47.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4= 2024-04-16T18:17:47.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q223zoLvVnC+J3ly8SKOwQuVk+4=', 'Content-Length': '0'} 2024-04-16T18:17:47.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000240cb86fee0f0700-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.818 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.818 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.818 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.818 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.818 DEBUG:boto:Method: GET 2024-04-16T18:17:47.818 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.818 DEBUG:boto:Data: 2024-04-16T18:17:47.819 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.819 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.819 DEBUG:boto:Params: {} 2024-04-16T18:17:47.819 DEBUG:boto:Token: None 2024-04-16T18:17:47.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000300f163b9cbd944a-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.862 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.863 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.863 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.863 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.863 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.863 DEBUG:boto:Method: GET 2024-04-16T18:17:47.863 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.863 DEBUG:boto:Data: 2024-04-16T18:17:47.863 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.863 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.864 DEBUG:boto:Params: {} 2024-04-16T18:17:47.864 DEBUG:boto:Token: None 2024-04-16T18:17:47.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.867 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f2ac97bbf78cdb66-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.867 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.867 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.867 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.868 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.868 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.868 DEBUG:boto:Data: 2024-04-16T18:17:47.868 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.868 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.868 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.868 DEBUG:boto:Params: {} 2024-04-16T18:17:47.868 DEBUG:boto:Token: None 2024-04-16T18:17:47.868 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y+TMUJwCRpKXf70LFofH23jSjDc= 2024-04-16T18:17:47.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y+TMUJwCRpKXf70LFofH23jSjDc=', 'Content-Length': '0'} 2024-04-16T18:17:47.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c1f5460293c23e4-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.870 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.871 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.871 DEBUG:boto:Method: HEAD 2024-04-16T18:17:47.871 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.871 DEBUG:boto:Data: 2024-04-16T18:17:47.871 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.871 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.871 DEBUG:boto:Params: {} 2024-04-16T18:17:47.871 DEBUG:boto:Token: None 2024-04-16T18:17:47.871 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y+TMUJwCRpKXf70LFofH23jSjDc= 2024-04-16T18:17:47.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y+TMUJwCRpKXf70LFofH23jSjDc=', 'Content-Length': '0'} 2024-04-16T18:17:47.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038840a3967671e63-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.874 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-16T18:17:47.874 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.874 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.874 DEBUG:boto:Method: GET 2024-04-16T18:17:47.874 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.874 DEBUG:boto:Data: 2024-04-16T18:17:47.874 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.874 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.874 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.874 DEBUG:boto:Params: {} 2024-04-16T18:17:47.875 DEBUG:boto:Token: None 2024-04-16T18:17:47.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sia5C131qoeDp3nt/PHg24i6D+c= 2024-04-16T18:17:47.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sia5C131qoeDp3nt/PHg24i6D+c=', 'Content-Length': '0'} 2024-04-16T18:17:47.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000057bf302832ecd7f-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.922 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.922 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.923 DEBUG:boto:Method: GET 2024-04-16T18:17:47.923 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.923 DEBUG:boto:Data: 2024-04-16T18:17:47.923 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.923 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.923 DEBUG:boto:Params: {} 2024-04-16T18:17:47.923 DEBUG:boto:Token: None 2024-04-16T18:17:47.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:47.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sia5C131qoeDp3nt/PHg24i6D+c= 2024-04-16T18:17:47.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sia5C131qoeDp3nt/PHg24i6D+c=', 'Content-Length': '0'} 2024-04-16T18:17:47.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047146897fd6d5371-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.926 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.926 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.926 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.926 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.926 DEBUG:boto:Method: GET 2024-04-16T18:17:47.926 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.926 DEBUG:boto:Data: 2024-04-16T18:17:47.927 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.927 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.927 DEBUG:boto:Params: {} 2024-04-16T18:17:47.927 DEBUG:boto:Token: None 2024-04-16T18:17:47.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9e92dd46fddb866-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.970 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.971 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:47.971 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:47.971 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.971 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.971 DEBUG:boto:Method: GET 2024-04-16T18:17:47.971 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:17:47.971 DEBUG:boto:Data: 2024-04-16T18:17:47.971 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:47.971 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.971 DEBUG:boto:Params: {} 2024-04-16T18:17:47.972 DEBUG:boto:Token: None 2024-04-16T18:17:47.972 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/ 2024-04-16T18:17:47.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg= 2024-04-16T18:17:47.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QHr8cLnZSSyD6lKSFTN+VyBgLpg=', 'Content-Length': '0'} 2024-04-16T18:17:47.974 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008075386e1dc4e91a-00661ec0cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:47.975 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:40.894Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:47.975 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-16T18:17:47.975 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:47.975 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:47.975 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:47.975 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:47.975 DEBUG:boto:Method: GET 2024-04-16T18:17:47.975 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:47.975 DEBUG:boto:Data: 2024-04-16T18:17:47.976 DEBUG:boto:Headers: {} 2024-04-16T18:17:47.976 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:47.976 DEBUG:boto:Port: 8000 2024-04-16T18:17:47.976 DEBUG:boto:Params: {} 2024-04-16T18:17:47.976 DEBUG:boto:Token: None 2024-04-16T18:17:47.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:47 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:47.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Tk84dxc0QVXV0cV+oYIMhAyd7cc= 2024-04-16T18:17:47.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Tk84dxc0QVXV0cV+oYIMhAyd7cc=', 'Content-Length': '0'} 2024-04-16T18:17:47.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002870c663661ef00a-00661ec0cb-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.018 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.018 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.019 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.019 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.019 DEBUG:boto:Method: GET 2024-04-16T18:17:48.019 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.019 DEBUG:boto:Data: 2024-04-16T18:17:48.019 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.019 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.019 DEBUG:boto:Params: {} 2024-04-16T18:17:48.019 DEBUG:boto:Token: None 2024-04-16T18:17:48.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KZsSd/uO5pzarfyySUSftclEino= 2024-04-16T18:17:48.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KZsSd/uO5pzarfyySUSftclEino=', 'Content-Length': '0'} 2024-04-16T18:17:48.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1e2d612ff205e25-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.022 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.022 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.022 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.023 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.023 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.023 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.023 DEBUG:boto:Data: 2024-04-16T18:17:48.023 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.023 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.023 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.023 DEBUG:boto:Params: {} 2024-04-16T18:17:48.023 DEBUG:boto:Token: None 2024-04-16T18:17:48.024 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:txwzTPahF75f4qCxJ5HCgH8Cn8Y= 2024-04-16T18:17:48.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:txwzTPahF75f4qCxJ5HCgH8Cn8Y=', 'Content-Length': '0'} 2024-04-16T18:17:48.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd3b6cfbdbf5e842-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.026 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.026 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.026 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.026 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.027 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.027 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.027 DEBUG:boto:Data: 2024-04-16T18:17:48.027 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.027 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.027 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.027 DEBUG:boto:Params: {} 2024-04-16T18:17:48.027 DEBUG:boto:Token: None 2024-04-16T18:17:48.027 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:txwzTPahF75f4qCxJ5HCgH8Cn8Y= 2024-04-16T18:17:48.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:txwzTPahF75f4qCxJ5HCgH8Cn8Y=', 'Content-Length': '0'} 2024-04-16T18:17:48.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bcae1893a0e9a58-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.030 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-16T18:17:48.030 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.030 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.030 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.030 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.030 DEBUG:boto:Method: GET 2024-04-16T18:17:48.031 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.031 DEBUG:boto:Data: 2024-04-16T18:17:48.031 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.031 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.031 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.031 DEBUG:boto:Params: {} 2024-04-16T18:17:48.031 DEBUG:boto:Token: None 2024-04-16T18:17:48.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KZsSd/uO5pzarfyySUSftclEino= 2024-04-16T18:17:48.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KZsSd/uO5pzarfyySUSftclEino=', 'Content-Length': '0'} 2024-04-16T18:17:48.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da1485f40a7e04b6-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.074 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.074 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.075 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.075 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.075 DEBUG:boto:Method: GET 2024-04-16T18:17:48.075 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.075 DEBUG:boto:Data: 2024-04-16T18:17:48.075 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.075 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.075 DEBUG:boto:Params: {} 2024-04-16T18:17:48.075 DEBUG:boto:Token: None 2024-04-16T18:17:48.076 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:17:48.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KZsSd/uO5pzarfyySUSftclEino= 2024-04-16T18:17:48.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KZsSd/uO5pzarfyySUSftclEino=', 'Content-Length': '0'} 2024-04-16T18:17:48.078 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017b3fbff73faf051-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.078 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.078 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.078 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.078 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.078 DEBUG:boto:Method: GET 2024-04-16T18:17:48.079 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.079 DEBUG:boto:Data: 2024-04-16T18:17:48.079 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.079 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.079 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.079 DEBUG:boto:Params: {} 2024-04-16T18:17:48.079 DEBUG:boto:Token: None 2024-04-16T18:17:48.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.082 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8976760b5acfd83-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.122 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.123 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.123 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.123 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.123 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.123 DEBUG:boto:Method: GET 2024-04-16T18:17:48.123 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.123 DEBUG:boto:Data: 2024-04-16T18:17:48.123 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.123 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.123 DEBUG:boto:Params: {} 2024-04-16T18:17:48.124 DEBUG:boto:Token: None 2024-04-16T18:17:48.124 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d56409e7e0225d5-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.127 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.127 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.127 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.127 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.127 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.127 DEBUG:boto:Data: 2024-04-16T18:17:48.127 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.127 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.127 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.127 DEBUG:boto:Params: {} 2024-04-16T18:17:48.128 DEBUG:boto:Token: None 2024-04-16T18:17:48.128 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q+wydUcDaYzzYDXG0MhkwPaYqUA= 2024-04-16T18:17:48.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q+wydUcDaYzzYDXG0MhkwPaYqUA=', 'Content-Length': '0'} 2024-04-16T18:17:48.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c372542800202487-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.130 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.131 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.131 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.131 DEBUG:boto:Data: 2024-04-16T18:17:48.131 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.131 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.131 DEBUG:boto:Params: {} 2024-04-16T18:17:48.131 DEBUG:boto:Token: None 2024-04-16T18:17:48.131 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q+wydUcDaYzzYDXG0MhkwPaYqUA= 2024-04-16T18:17:48.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q+wydUcDaYzzYDXG0MhkwPaYqUA=', 'Content-Length': '0'} 2024-04-16T18:17:48.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e6a7aece7b08902-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.134 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-16T18:17:48.134 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.134 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.134 DEBUG:boto:Method: GET 2024-04-16T18:17:48.134 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.134 DEBUG:boto:Data: 2024-04-16T18:17:48.134 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.134 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.134 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.135 DEBUG:boto:Params: {} 2024-04-16T18:17:48.135 DEBUG:boto:Token: None 2024-04-16T18:17:48.135 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pEcSnNVwNZF8v6vUuzAZaXJOglQ= 2024-04-16T18:17:48.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pEcSnNVwNZF8v6vUuzAZaXJOglQ=', 'Content-Length': '0'} 2024-04-16T18:17:48.137 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de6c46653355be7a-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.182 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.182 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.182 DEBUG:boto:Method: GET 2024-04-16T18:17:48.183 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.183 DEBUG:boto:Data: 2024-04-16T18:17:48.183 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.183 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.183 DEBUG:boto:Params: {} 2024-04-16T18:17:48.183 DEBUG:boto:Token: None 2024-04-16T18:17:48.183 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:48.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pEcSnNVwNZF8v6vUuzAZaXJOglQ= 2024-04-16T18:17:48.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pEcSnNVwNZF8v6vUuzAZaXJOglQ=', 'Content-Length': '0'} 2024-04-16T18:17:48.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046f27ca197dffa8d-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.186 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.186 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.186 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.186 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.186 DEBUG:boto:Method: GET 2024-04-16T18:17:48.186 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.187 DEBUG:boto:Data: 2024-04-16T18:17:48.187 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.187 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.187 DEBUG:boto:Params: {} 2024-04-16T18:17:48.187 DEBUG:boto:Token: None 2024-04-16T18:17:48.187 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.190 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012b141219b914d01-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.190 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.190 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.190 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.190 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.191 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.191 DEBUG:boto:Method: GET 2024-04-16T18:17:48.191 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:17:48.191 DEBUG:boto:Data: 2024-04-16T18:17:48.191 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.191 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.191 DEBUG:boto:Params: {} 2024-04-16T18:17:48.191 DEBUG:boto:Token: None 2024-04-16T18:17:48.191 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.194 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000104492e6cafefe1c-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.194 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:17:40.951Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-16T18:17:48.195 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.195 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.195 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.195 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.195 DEBUG:boto:Method: GET 2024-04-16T18:17:48.195 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.195 DEBUG:boto:Data: 2024-04-16T18:17:48.195 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.195 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.195 DEBUG:boto:Params: {} 2024-04-16T18:17:48.196 DEBUG:boto:Token: None 2024-04-16T18:17:48.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8= 2024-04-16T18:17:48.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8=', 'Content-Length': '0'} 2024-04-16T18:17:48.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b42f94ee6f03deb-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.238 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.238 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.238 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.239 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.239 DEBUG:boto:Method: GET 2024-04-16T18:17:48.239 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.239 DEBUG:boto:Data: 2024-04-16T18:17:48.239 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.239 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.239 DEBUG:boto:Params: {} 2024-04-16T18:17:48.239 DEBUG:boto:Token: None 2024-04-16T18:17:48.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8= 2024-04-16T18:17:48.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8=', 'Content-Length': '0'} 2024-04-16T18:17:48.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7af1c1ab403c100-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.242 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.242 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.242 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.242 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.242 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.243 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.243 DEBUG:boto:Data: 2024-04-16T18:17:48.243 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.243 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.243 DEBUG:boto:Params: {} 2024-04-16T18:17:48.243 DEBUG:boto:Token: None 2024-04-16T18:17:48.243 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p870j4sN/qaTWid1YYp9u9rtXbM= 2024-04-16T18:17:48.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p870j4sN/qaTWid1YYp9u9rtXbM=', 'Content-Length': '0'} 2024-04-16T18:17:48.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2a4ac0ec7a8e24d-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.246 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.246 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.246 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.246 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.246 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.246 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.246 DEBUG:boto:Data: 2024-04-16T18:17:48.247 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.247 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.247 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.247 DEBUG:boto:Params: {} 2024-04-16T18:17:48.247 DEBUG:boto:Token: None 2024-04-16T18:17:48.247 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p870j4sN/qaTWid1YYp9u9rtXbM= 2024-04-16T18:17:48.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p870j4sN/qaTWid1YYp9u9rtXbM=', 'Content-Length': '0'} 2024-04-16T18:17:48.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f10f27306f73f58-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.250 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-16T18:17:48.250 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.250 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.250 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.250 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.250 DEBUG:boto:Method: GET 2024-04-16T18:17:48.250 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.250 DEBUG:boto:Data: 2024-04-16T18:17:48.251 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.251 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.251 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.251 DEBUG:boto:Params: {} 2024-04-16T18:17:48.251 DEBUG:boto:Token: None 2024-04-16T18:17:48.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8= 2024-04-16T18:17:48.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8=', 'Content-Length': '0'} 2024-04-16T18:17:48.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003db2276bffac6bcc-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.294 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.294 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.295 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.295 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.295 DEBUG:boto:Method: GET 2024-04-16T18:17:48.295 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.295 DEBUG:boto:Data: 2024-04-16T18:17:48.295 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.295 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.295 DEBUG:boto:Params: {} 2024-04-16T18:17:48.295 DEBUG:boto:Token: None 2024-04-16T18:17:48.296 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:17:48.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8= 2024-04-16T18:17:48.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XDcvu8t942Y0bO6oPP3ovmtuYu8=', 'Content-Length': '0'} 2024-04-16T18:17:48.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050908f6d432fd763-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.298 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.298 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.298 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.299 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.299 DEBUG:boto:Method: GET 2024-04-16T18:17:48.299 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.299 DEBUG:boto:Data: 2024-04-16T18:17:48.299 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.299 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.299 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.299 DEBUG:boto:Params: {} 2024-04-16T18:17:48.299 DEBUG:boto:Token: None 2024-04-16T18:17:48.300 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.302 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7e959a6b2577b2c-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.302 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.303 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.303 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.303 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.303 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.303 DEBUG:boto:Method: GET 2024-04-16T18:17:48.303 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.303 DEBUG:boto:Data: 2024-04-16T18:17:48.304 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.304 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.304 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.304 DEBUG:boto:Params: {} 2024-04-16T18:17:48.304 DEBUG:boto:Token: None 2024-04-16T18:17:48.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de8b1292feb80c40-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.307 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.307 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.307 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.307 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.307 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.307 DEBUG:boto:Data: 2024-04-16T18:17:48.307 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.308 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.308 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.308 DEBUG:boto:Params: {} 2024-04-16T18:17:48.308 DEBUG:boto:Token: None 2024-04-16T18:17:48.308 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zhHgiliwez/uUOrPMXrlDVtoI/w= 2024-04-16T18:17:48.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zhHgiliwez/uUOrPMXrlDVtoI/w=', 'Content-Length': '0'} 2024-04-16T18:17:48.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d506f60d23ef31c1-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.310 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.311 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.311 DEBUG:boto:Method: HEAD 2024-04-16T18:17:48.311 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.311 DEBUG:boto:Data: 2024-04-16T18:17:48.311 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.311 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.311 DEBUG:boto:Params: {} 2024-04-16T18:17:48.311 DEBUG:boto:Token: None 2024-04-16T18:17:48.312 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zhHgiliwez/uUOrPMXrlDVtoI/w= 2024-04-16T18:17:48.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zhHgiliwez/uUOrPMXrlDVtoI/w=', 'Content-Length': '0'} 2024-04-16T18:17:48.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ddba7f0686ff37a-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-16T18:17:48.314 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.314 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.314 DEBUG:boto:Method: GET 2024-04-16T18:17:48.314 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.314 DEBUG:boto:Data: 2024-04-16T18:17:48.315 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.315 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.315 DEBUG:boto:Params: {} 2024-04-16T18:17:48.315 DEBUG:boto:Token: None 2024-04-16T18:17:48.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hpTGQUsck5enYEil7xdUA0OLFd8= 2024-04-16T18:17:48.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hpTGQUsck5enYEil7xdUA0OLFd8=', 'Content-Length': '0'} 2024-04-16T18:17:48.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:17:42 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000708b48d4ce89c841-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.362 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.362 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.363 DEBUG:boto:Method: GET 2024-04-16T18:17:48.363 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.363 DEBUG:boto:Data: 2024-04-16T18:17:48.363 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.363 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.363 DEBUG:boto:Params: {} 2024-04-16T18:17:48.363 DEBUG:boto:Token: None 2024-04-16T18:17:48.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:48.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hpTGQUsck5enYEil7xdUA0OLFd8= 2024-04-16T18:17:48.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hpTGQUsck5enYEil7xdUA0OLFd8=', 'Content-Length': '0'} 2024-04-16T18:17:48.366 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:40 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fea10419ffa854d5-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.366 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.366 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.366 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.366 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.367 DEBUG:boto:Method: GET 2024-04-16T18:17:48.367 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.367 DEBUG:boto:Data: 2024-04-16T18:17:48.367 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.367 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:17:48.367 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.367 DEBUG:boto:Params: {} 2024-04-16T18:17:48.367 DEBUG:boto:Token: None 2024-04-16T18:17:48.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.370 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0f9e1b726bf3a54-00661ec0cc-5447-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.370 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.370 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:48.370 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:48.370 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.371 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.371 DEBUG:boto:Method: GET 2024-04-16T18:17:48.371 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:17:48.371 DEBUG:boto:Data: 2024-04-16T18:17:48.371 DEBUG:boto:Headers: {} 2024-04-16T18:17:48.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:48.371 DEBUG:boto:Port: 8000 2024-04-16T18:17:48.371 DEBUG:boto:Params: {} 2024-04-16T18:17:48.371 DEBUG:boto:Token: None 2024-04-16T18:17:48.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:17:48 GMT /cjqttm-51/ 2024-04-16T18:17:48.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM= 2024-04-16T18:17:48.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oxK5G9xkUhmbryZ2MlmaMQNZRoM=', 'Content-Length': '0'} 2024-04-16T18:17:48.374 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074353f3e56c30302-00661ec0cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:48.374 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:40.780Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:17:48.374 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-51 zones={test-zone2, test-zone1} 2024-04-16T18:17:48.375 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:17:48.375 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:17:48.376 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:17:48.377+0000 7f87ed25f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 136239) UID: 0 2024-04-16T18:17:48.376 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:17:48.377+0000 7f87f0ab8880 -1 shutting down 2024-04-16T18:17:52.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:17:54.475 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:17:54.475 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:54.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:54.475 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:17:54.535 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:54.535 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:54.610 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:17:54.610 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-51 2024-04-16T18:17:54.616 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 10 2024-04-16T18:17:54.665 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:54.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:54.665 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:54.715 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:54.715 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:54.786 INFO:teuthology.orchestra.run.smithi016.stdout:{"objs":["obj00000000000000000007","obj00000000000000000016","obj00000000000000000024","obj00000000000000000020","obj00000000000000000028","obj00000000000000000000","obj00000000000000000032","obj00000000000000000001","obj00000000000000000010","obj00000000000000000019","obj00000000000000000013","obj00000000000000000021","obj00000000000000000030","obj00000000000000000026","obj00000000000000000033","obj00000000000000000004","obj00000000000000000076"]} 2024-04-16T18:17:54.786 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.786 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.786 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.787 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.787 DEBUG:boto:Data: 2024-04-16T18:17:54.787 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.787 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.787 DEBUG:boto:Params: {} 2024-04-16T18:17:54.787 DEBUG:boto:Token: None 2024-04-16T18:17:54.787 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.790 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d0d044476f27b9d8-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.790 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:17:54.791 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:17:54.791 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.791 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020 2024-04-16T18:17:54.791 DEBUG:boto:Data: 2024-04-16T18:17:54.791 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.791 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.791 DEBUG:boto:Params: {} 2024-04-16T18:17:54.791 DEBUG:boto:Token: None 2024-04-16T18:17:54.792 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000020 2024-04-16T18:17:54.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ThiH0uLXtf9UfvFPDoPPkcxB744= 2024-04-16T18:17:54.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ThiH0uLXtf9UfvFPDoPPkcxB744='} 2024-04-16T18:17:54.797 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a31c947a46400dc3-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.797 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.797 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.798 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.798 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.798 DEBUG:boto:Data: 2024-04-16T18:17:54.798 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.798 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.798 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.798 DEBUG:boto:Params: {} 2024-04-16T18:17:54.798 DEBUG:boto:Token: None 2024-04-16T18:17:54.798 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.798 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.801 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000922c7e67058da040-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.801 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:54.801 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:54.801 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.801 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:54.801 DEBUG:boto:Data: 2024-04-16T18:17:54.801 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.801 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.802 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.802 DEBUG:boto:Params: {} 2024-04-16T18:17:54.802 DEBUG:boto:Token: None 2024-04-16T18:17:54.802 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:54.802 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U3U+gePRzuDPjJXrRlwBkbxOSyo= 2024-04-16T18:17:54.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U3U+gePRzuDPjJXrRlwBkbxOSyo='} 2024-04-16T18:17:54.846 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000764180c7b3d7535b-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.847 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.847 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.847 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.847 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.847 DEBUG:boto:Data: 2024-04-16T18:17:54.847 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.847 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.847 DEBUG:boto:Params: {} 2024-04-16T18:17:54.847 DEBUG:boto:Token: None 2024-04-16T18:17:54.848 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.850 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000085cdb94ff34dd5ea-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.850 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:17:54.850 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:17:54.850 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.850 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028 2024-04-16T18:17:54.850 DEBUG:boto:Data: 2024-04-16T18:17:54.851 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.851 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.851 DEBUG:boto:Params: {} 2024-04-16T18:17:54.851 DEBUG:boto:Token: None 2024-04-16T18:17:54.851 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000028 2024-04-16T18:17:54.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cPyfz6YUhGWCp7yhzPyLybbnNAM= 2024-04-16T18:17:54.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cPyfz6YUhGWCp7yhzPyLybbnNAM='} 2024-04-16T18:17:54.857 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009f7911b50d116e16-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.857 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.857 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.857 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.857 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.857 DEBUG:boto:Data: 2024-04-16T18:17:54.857 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.858 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.858 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.858 DEBUG:boto:Params: {} 2024-04-16T18:17:54.858 DEBUG:boto:Token: None 2024-04-16T18:17:54.858 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.858 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.860 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000db7a6958154e2eb3-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.860 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:54.860 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:54.861 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.861 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:54.861 DEBUG:boto:Data: 2024-04-16T18:17:54.861 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.861 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.861 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.861 DEBUG:boto:Params: {} 2024-04-16T18:17:54.861 DEBUG:boto:Token: None 2024-04-16T18:17:54.861 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:54.861 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8Nqbvmy8alRM5vEq+vkTETgBgtA= 2024-04-16T18:17:54.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8Nqbvmy8alRM5vEq+vkTETgBgtA='} 2024-04-16T18:17:54.867 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006d8e2e3decc4d08a-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.867 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.867 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.867 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.867 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.867 DEBUG:boto:Data: 2024-04-16T18:17:54.867 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.867 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.867 DEBUG:boto:Params: {} 2024-04-16T18:17:54.868 DEBUG:boto:Token: None 2024-04-16T18:17:54.868 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.870 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d058991f0ffa8628-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.870 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:17:54.871 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:17:54.871 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.871 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032 2024-04-16T18:17:54.871 DEBUG:boto:Data: 2024-04-16T18:17:54.871 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.871 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.871 DEBUG:boto:Params: {} 2024-04-16T18:17:54.871 DEBUG:boto:Token: None 2024-04-16T18:17:54.871 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000032 2024-04-16T18:17:54.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kVTaHFbzrQiITegQG6wokyiX11I= 2024-04-16T18:17:54.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kVTaHFbzrQiITegQG6wokyiX11I='} 2024-04-16T18:17:54.914 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009f07a6f462a7ced7-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.914 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.915 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.915 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.915 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.915 DEBUG:boto:Data: 2024-04-16T18:17:54.915 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.915 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.915 DEBUG:boto:Params: {} 2024-04-16T18:17:54.915 DEBUG:boto:Token: None 2024-04-16T18:17:54.915 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.918 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ad37b7b3953aa6e-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.918 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:54.918 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:54.918 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.918 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:54.919 DEBUG:boto:Data: 2024-04-16T18:17:54.919 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.919 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.919 DEBUG:boto:Params: {} 2024-04-16T18:17:54.919 DEBUG:boto:Token: None 2024-04-16T18:17:54.919 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:54.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IpBS/3WPNzSDCD7OFmhwAw+/meg= 2024-04-16T18:17:54.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IpBS/3WPNzSDCD7OFmhwAw+/meg='} 2024-04-16T18:17:54.925 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003363046605e02f7d-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.925 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.925 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.925 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.925 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.925 DEBUG:boto:Data: 2024-04-16T18:17:54.925 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.925 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.925 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.926 DEBUG:boto:Params: {} 2024-04-16T18:17:54.926 DEBUG:boto:Token: None 2024-04-16T18:17:54.926 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.928 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000020d78b464a93b937-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.928 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:54.929 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:54.929 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.929 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:54.929 DEBUG:boto:Data: 2024-04-16T18:17:54.929 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.929 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.929 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.929 DEBUG:boto:Params: {} 2024-04-16T18:17:54.929 DEBUG:boto:Token: None 2024-04-16T18:17:54.929 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:54.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e8nT6EdqL5BN2RqtaQEvGBBtdLg= 2024-04-16T18:17:54.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e8nT6EdqL5BN2RqtaQEvGBBtdLg='} 2024-04-16T18:17:54.936 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b28d65d7f7ffbcc6-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.936 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.937 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.937 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.937 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.937 DEBUG:boto:Data: 2024-04-16T18:17:54.937 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.937 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.937 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.937 DEBUG:boto:Params: {} 2024-04-16T18:17:54.938 DEBUG:boto:Token: None 2024-04-16T18:17:54.938 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.938 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.940 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000584c18b376a45f8d-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.940 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:17:54.941 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:17:54.941 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.941 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033 2024-04-16T18:17:54.941 DEBUG:boto:Data: 2024-04-16T18:17:54.941 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.941 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.941 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.941 DEBUG:boto:Params: {} 2024-04-16T18:17:54.941 DEBUG:boto:Token: None 2024-04-16T18:17:54.941 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000033 2024-04-16T18:17:54.942 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aAgWhizVyPshbbej33LN2/f8l2s= 2024-04-16T18:17:54.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aAgWhizVyPshbbej33LN2/f8l2s='} 2024-04-16T18:17:54.986 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000823d77d99a1b4281-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.987 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.987 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.987 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.987 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.987 DEBUG:boto:Data: 2024-04-16T18:17:54.987 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.987 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.987 DEBUG:boto:Params: {} 2024-04-16T18:17:54.987 DEBUG:boto:Token: None 2024-04-16T18:17:54.987 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:54.990 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000953421134e00eeb9-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.990 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:17:54.991 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:17:54.991 DEBUG:boto:Method: PUT 2024-04-16T18:17:54.991 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:17:54.991 DEBUG:boto:Data: 2024-04-16T18:17:54.991 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:54.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.991 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.991 DEBUG:boto:Params: {} 2024-04-16T18:17:54.991 DEBUG:boto:Token: None 2024-04-16T18:17:54.992 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:17:54.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0+ujrgKlm5BBkmpByQyvVR+rYE= 2024-04-16T18:17:54.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0+ujrgKlm5BBkmpByQyvVR+rYE='} 2024-04-16T18:17:54.997 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005688358d36c842c2-00661ec0d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:54.997 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:54.997 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:54.998 DEBUG:boto:Method: HEAD 2024-04-16T18:17:54.998 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:54.998 DEBUG:boto:Data: 2024-04-16T18:17:54.998 DEBUG:boto:Headers: {} 2024-04-16T18:17:54.998 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:54.998 DEBUG:boto:Port: 8000 2024-04-16T18:17:54.998 DEBUG:boto:Params: {} 2024-04-16T18:17:54.998 DEBUG:boto:Token: None 2024-04-16T18:17:54.998 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:54 GMT /cjqttm-51/ 2024-04-16T18:17:54.998 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk= 2024-04-16T18:17:54.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:54 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kmBpRpn22vuqDXVlXY0lU/ezxpk=', 'Content-Length': '0'} 2024-04-16T18:17:55.001 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e9eaa96a3289f8b6-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.001 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:17:55.001 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:17:55.001 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.001 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076 2024-04-16T18:17:55.002 DEBUG:boto:Data: 2024-04-16T18:17:55.002 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.002 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.002 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.002 DEBUG:boto:Params: {} 2024-04-16T18:17:55.002 DEBUG:boto:Token: None 2024-04-16T18:17:55.002 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000076 2024-04-16T18:17:55.002 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5a2AL3cEgabPpdmbML1cjeKHp+0= 2024-04-16T18:17:55.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5a2AL3cEgabPpdmbML1cjeKHp+0='} 2024-04-16T18:17:55.007 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008bd80cb3faf62304-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.007 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.008 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.008 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.008 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.008 DEBUG:boto:Data: 2024-04-16T18:17:55.008 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.008 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.008 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.008 DEBUG:boto:Params: {} 2024-04-16T18:17:55.008 DEBUG:boto:Token: None 2024-04-16T18:17:55.008 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.009 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.011 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005334af9483151a5e-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.011 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:17:55.011 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:17:55.011 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.011 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026 2024-04-16T18:17:55.011 DEBUG:boto:Data: 2024-04-16T18:17:55.012 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.012 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.012 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.012 DEBUG:boto:Params: {} 2024-04-16T18:17:55.012 DEBUG:boto:Token: None 2024-04-16T18:17:55.012 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000026 2024-04-16T18:17:55.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1zqXY7YDA6exSN92WnroHTOK5Vg= 2024-04-16T18:17:55.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1zqXY7YDA6exSN92WnroHTOK5Vg='} 2024-04-16T18:17:55.055 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006b073c4723f1778c-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.055 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.055 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.055 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.055 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.055 DEBUG:boto:Data: 2024-04-16T18:17:55.055 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.055 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.056 DEBUG:boto:Params: {} 2024-04-16T18:17:55.056 DEBUG:boto:Token: None 2024-04-16T18:17:55.056 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.058 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ce6e1c3c0465704-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.059 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:17:55.059 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:17:55.059 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.059 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024 2024-04-16T18:17:55.059 DEBUG:boto:Data: 2024-04-16T18:17:55.059 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.059 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.059 DEBUG:boto:Params: {} 2024-04-16T18:17:55.060 DEBUG:boto:Token: None 2024-04-16T18:17:55.060 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000024 2024-04-16T18:17:55.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3XRdqDbGg9kYIGZrn8+ADvZHeU8= 2024-04-16T18:17:55.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3XRdqDbGg9kYIGZrn8+ADvZHeU8='} 2024-04-16T18:17:55.066 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a9415c3bdf1a1825-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.066 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.066 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.066 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.066 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.066 DEBUG:boto:Data: 2024-04-16T18:17:55.066 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.066 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.067 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.067 DEBUG:boto:Params: {} 2024-04-16T18:17:55.067 DEBUG:boto:Token: None 2024-04-16T18:17:55.067 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.070 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000086708c807470b416-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.070 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:55.070 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:55.070 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.070 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:55.070 DEBUG:boto:Data: 2024-04-16T18:17:55.070 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.070 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.071 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.071 DEBUG:boto:Params: {} 2024-04-16T18:17:55.071 DEBUG:boto:Token: None 2024-04-16T18:17:55.071 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:55.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gY60qXHof96zXo3aY/BvJRfLKsQ= 2024-04-16T18:17:55.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gY60qXHof96zXo3aY/BvJRfLKsQ='} 2024-04-16T18:17:55.114 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000097e503cd1927679a-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.115 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.115 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.115 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.115 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.115 DEBUG:boto:Data: 2024-04-16T18:17:55.115 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.115 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.115 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.115 DEBUG:boto:Params: {} 2024-04-16T18:17:55.115 DEBUG:boto:Token: None 2024-04-16T18:17:55.116 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.118 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002de2d8b558783754-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.118 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.119 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.119 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.119 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.119 DEBUG:boto:Data: 2024-04-16T18:17:55.119 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.119 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.119 DEBUG:boto:Params: {} 2024-04-16T18:17:55.119 DEBUG:boto:Token: None 2024-04-16T18:17:55.120 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:84NAX5g+1G7DTrEoYIfidb9+uJg= 2024-04-16T18:17:55.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:84NAX5g+1G7DTrEoYIfidb9+uJg='} 2024-04-16T18:17:55.125 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c7125cbbf0c65f07-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.126 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.126 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.126 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.126 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.126 DEBUG:boto:Data: 2024-04-16T18:17:55.126 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.126 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.126 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.126 DEBUG:boto:Params: {} 2024-04-16T18:17:55.127 DEBUG:boto:Token: None 2024-04-16T18:17:55.127 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.129 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000924ba3f6fec72c00-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.129 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:55.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:55.130 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.130 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:55.130 DEBUG:boto:Data: 2024-04-16T18:17:55.130 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.130 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.130 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.130 DEBUG:boto:Params: {} 2024-04-16T18:17:55.130 DEBUG:boto:Token: None 2024-04-16T18:17:55.131 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:55.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PZCo03ss0kbDjYrDL8zWfooRHcA= 2024-04-16T18:17:55.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PZCo03ss0kbDjYrDL8zWfooRHcA='} 2024-04-16T18:17:55.178 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000077cca1a1d7de61f4-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.178 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.179 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.179 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.179 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.179 DEBUG:boto:Data: 2024-04-16T18:17:55.179 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.179 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.179 DEBUG:boto:Params: {} 2024-04-16T18:17:55.179 DEBUG:boto:Token: None 2024-04-16T18:17:55.179 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.182 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000044d33569f963fbd5-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.182 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.182 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.182 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.182 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.183 DEBUG:boto:Data: 2024-04-16T18:17:55.183 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.183 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.183 DEBUG:boto:Params: {} 2024-04-16T18:17:55.183 DEBUG:boto:Token: None 2024-04-16T18:17:55.183 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lguhOlvlCKotzBa9xJYD5Df0G5Q= 2024-04-16T18:17:55.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lguhOlvlCKotzBa9xJYD5Df0G5Q='} 2024-04-16T18:17:55.191 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007b85f63f41bd73cd-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.191 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:55.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:55.192 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:17:55.243 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:55.244 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:55.306 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:17:55.307 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-51 2024-04-16T18:17:55.314 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 21 2024-04-16T18:17:55.371 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:55.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:55.371 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:55.421 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:55.421 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:55.492 INFO:teuthology.orchestra.run.smithi016.stdout:{"objs":["obj00000000000000000005","obj00000000000000000010","obj00000000000000000016","obj00000000000000000021","obj00000000000000000004","obj00000000000000000025","obj00000000000000000030","obj00000000000000000015","obj00000000000000000019","obj00000000000000000003","obj00000000000000000009","obj00000000000000000014","obj00000000000000000012","obj00000000000000000002","obj00000000000000000000","obj00000000000000000006","obj00000000000000000011","obj00000000000000000001","obj00000000000000000007"]} 2024-04-16T18:17:55.493 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.493 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.494 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.494 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.494 DEBUG:boto:Data: 2024-04-16T18:17:55.494 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.494 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.495 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.495 DEBUG:boto:Params: {} 2024-04-16T18:17:55.495 DEBUG:boto:Token: None 2024-04-16T18:17:55.495 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.498 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000096e8d6d8c5418c10-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.498 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:17:55.498 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:17:55.498 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.498 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015 2024-04-16T18:17:55.498 DEBUG:boto:Data: 2024-04-16T18:17:55.499 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.499 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.499 DEBUG:boto:Params: {} 2024-04-16T18:17:55.499 DEBUG:boto:Token: None 2024-04-16T18:17:55.499 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000015 2024-04-16T18:17:55.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RsA2DaC1LOfxyiNU4jtIwG+/WUU= 2024-04-16T18:17:55.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RsA2DaC1LOfxyiNU4jtIwG+/WUU='} 2024-04-16T18:17:55.505 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d6ec54770f8cbc57-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.505 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.505 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.505 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.505 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.505 DEBUG:boto:Data: 2024-04-16T18:17:55.505 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.506 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.506 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.506 DEBUG:boto:Params: {} 2024-04-16T18:17:55.506 DEBUG:boto:Token: None 2024-04-16T18:17:55.506 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.506 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.509 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083dab6f008d8042a-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.509 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:55.509 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:55.509 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.509 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:55.509 DEBUG:boto:Data: 2024-04-16T18:17:55.509 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.510 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.510 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.510 DEBUG:boto:Params: {} 2024-04-16T18:17:55.510 DEBUG:boto:Token: None 2024-04-16T18:17:55.510 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:55.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bfD0tctYNupRAwvMbJBom3p9m7A= 2024-04-16T18:17:55.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bfD0tctYNupRAwvMbJBom3p9m7A='} 2024-04-16T18:17:55.515 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c55d0eda2b8333f2-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.515 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.515 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.516 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.516 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.516 DEBUG:boto:Data: 2024-04-16T18:17:55.516 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.516 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.516 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.516 DEBUG:boto:Params: {} 2024-04-16T18:17:55.516 DEBUG:boto:Token: None 2024-04-16T18:17:55.516 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.519 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008e75cf6c7734d888-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.519 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:55.519 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:55.519 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.519 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:55.519 DEBUG:boto:Data: 2024-04-16T18:17:55.519 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.520 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.520 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.520 DEBUG:boto:Params: {} 2024-04-16T18:17:55.520 DEBUG:boto:Token: None 2024-04-16T18:17:55.520 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:55.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RIIySwhycryAxA8UciQzXQopunM= 2024-04-16T18:17:55.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RIIySwhycryAxA8UciQzXQopunM='} 2024-04-16T18:17:55.562 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000df2cb58463d1f64-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.563 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.563 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.563 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.563 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.563 DEBUG:boto:Data: 2024-04-16T18:17:55.563 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.563 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.563 DEBUG:boto:Params: {} 2024-04-16T18:17:55.563 DEBUG:boto:Token: None 2024-04-16T18:17:55.564 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.566 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8aca0fa984a78b5-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.566 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.567 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.567 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.567 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.567 DEBUG:boto:Data: 2024-04-16T18:17:55.567 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.567 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.567 DEBUG:boto:Params: {} 2024-04-16T18:17:55.567 DEBUG:boto:Token: None 2024-04-16T18:17:55.568 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:55.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lguhOlvlCKotzBa9xJYD5Df0G5Q= 2024-04-16T18:17:55.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lguhOlvlCKotzBa9xJYD5Df0G5Q='} 2024-04-16T18:17:55.575 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fd26ac837778fe50-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.575 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.575 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.575 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.575 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.575 DEBUG:boto:Data: 2024-04-16T18:17:55.575 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.575 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.576 DEBUG:boto:Params: {} 2024-04-16T18:17:55.576 DEBUG:boto:Token: None 2024-04-16T18:17:55.576 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.578 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000088acb01e600cdc0d-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.579 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:55.579 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:55.579 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.579 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:55.579 DEBUG:boto:Data: 2024-04-16T18:17:55.579 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.579 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.579 DEBUG:boto:Params: {} 2024-04-16T18:17:55.580 DEBUG:boto:Token: None 2024-04-16T18:17:55.580 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:55.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3boBGUq8By2zbKLpO3mi78iifFA= 2024-04-16T18:17:55.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3boBGUq8By2zbKLpO3mi78iifFA='} 2024-04-16T18:17:55.622 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e30c547c70cf9ade-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.623 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.623 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.623 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.623 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.623 DEBUG:boto:Data: 2024-04-16T18:17:55.623 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.623 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.623 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.623 DEBUG:boto:Params: {} 2024-04-16T18:17:55.624 DEBUG:boto:Token: None 2024-04-16T18:17:55.624 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.626 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006050f94c46fb9f01-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.627 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:55.627 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:55.627 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.627 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:55.627 DEBUG:boto:Data: 2024-04-16T18:17:55.627 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.627 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.627 DEBUG:boto:Params: {} 2024-04-16T18:17:55.628 DEBUG:boto:Token: None 2024-04-16T18:17:55.628 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:55.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fs0nJVB5Vvw7BROI8VSNkmwdw2A= 2024-04-16T18:17:55.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fs0nJVB5Vvw7BROI8VSNkmwdw2A='} 2024-04-16T18:17:55.633 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006c76f3a4391110e7-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.633 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.634 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.634 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.634 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.634 DEBUG:boto:Data: 2024-04-16T18:17:55.634 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.634 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.634 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.634 DEBUG:boto:Params: {} 2024-04-16T18:17:55.634 DEBUG:boto:Token: None 2024-04-16T18:17:55.635 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.637 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000080ccd8528deb0f01-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.637 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:55.637 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:55.637 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.637 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:55.638 DEBUG:boto:Data: 2024-04-16T18:17:55.638 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.638 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.638 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.638 DEBUG:boto:Params: {} 2024-04-16T18:17:55.638 DEBUG:boto:Token: None 2024-04-16T18:17:55.638 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:55.638 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5NqW52QDAeppdupVSJ0rje7uLME= 2024-04-16T18:17:55.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NqW52QDAeppdupVSJ0rje7uLME='} 2024-04-16T18:17:55.682 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f42e266e3305740b-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.683 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.683 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.683 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.683 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.683 DEBUG:boto:Data: 2024-04-16T18:17:55.683 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.683 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.683 DEBUG:boto:Params: {} 2024-04-16T18:17:55.684 DEBUG:boto:Token: None 2024-04-16T18:17:55.684 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.686 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000079afda48298c880-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.687 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:55.687 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:55.687 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.687 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:55.687 DEBUG:boto:Data: 2024-04-16T18:17:55.687 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.687 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.687 DEBUG:boto:Params: {} 2024-04-16T18:17:55.687 DEBUG:boto:Token: None 2024-04-16T18:17:55.687 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:55.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMFHmwQyoQKpd3JboxHW7DgFB8c= 2024-04-16T18:17:55.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMFHmwQyoQKpd3JboxHW7DgFB8c='} 2024-04-16T18:17:55.695 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bd3508e654e55565-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.695 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.695 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.695 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.695 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.695 DEBUG:boto:Data: 2024-04-16T18:17:55.695 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.696 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.696 DEBUG:boto:Params: {} 2024-04-16T18:17:55.696 DEBUG:boto:Token: None 2024-04-16T18:17:55.696 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.698 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5ba94dce21f9b03-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.698 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:55.699 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:55.699 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.699 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:55.699 DEBUG:boto:Data: 2024-04-16T18:17:55.699 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.699 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.699 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.699 DEBUG:boto:Params: {} 2024-04-16T18:17:55.699 DEBUG:boto:Token: None 2024-04-16T18:17:55.699 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:55.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pOJOeGuNRQNLfekj84R2IwaG55w= 2024-04-16T18:17:55.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pOJOeGuNRQNLfekj84R2IwaG55w='} 2024-04-16T18:17:55.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d465169d9fce8c60-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.743 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.743 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.743 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.743 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.743 DEBUG:boto:Data: 2024-04-16T18:17:55.743 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.743 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.743 DEBUG:boto:Params: {} 2024-04-16T18:17:55.743 DEBUG:boto:Token: None 2024-04-16T18:17:55.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.746 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ab2751c61838b1fb-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.746 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:55.746 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:55.747 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.747 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:55.747 DEBUG:boto:Data: 2024-04-16T18:17:55.747 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.747 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.747 DEBUG:boto:Params: {} 2024-04-16T18:17:55.747 DEBUG:boto:Token: None 2024-04-16T18:17:55.747 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:55.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SD6leOtjwvfFEkMkU49WQ02H0nM= 2024-04-16T18:17:55.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SD6leOtjwvfFEkMkU49WQ02H0nM='} 2024-04-16T18:17:55.754 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000734c7925761af3d9-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.754 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.754 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.754 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.754 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.754 DEBUG:boto:Data: 2024-04-16T18:17:55.755 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.755 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.755 DEBUG:boto:Params: {} 2024-04-16T18:17:55.755 DEBUG:boto:Token: None 2024-04-16T18:17:55.755 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.758 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e49e131a797bd1cc-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.758 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:55.758 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:55.758 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.758 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:55.758 DEBUG:boto:Data: 2024-04-16T18:17:55.758 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.758 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.759 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.759 DEBUG:boto:Params: {} 2024-04-16T18:17:55.759 DEBUG:boto:Token: None 2024-04-16T18:17:55.759 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:55.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CwR8DXwGx1rfpiItFHFEYFwKgL0= 2024-04-16T18:17:55.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CwR8DXwGx1rfpiItFHFEYFwKgL0='} 2024-04-16T18:17:55.766 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ae71ebc9b89904de-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.766 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.766 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.766 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.766 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.766 DEBUG:boto:Data: 2024-04-16T18:17:55.767 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.767 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.767 DEBUG:boto:Params: {} 2024-04-16T18:17:55.767 DEBUG:boto:Token: None 2024-04-16T18:17:55.767 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.767 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.769 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001c98f1de87fb24cc-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.769 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:55.770 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:55.770 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.770 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:55.770 DEBUG:boto:Data: 2024-04-16T18:17:55.770 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.770 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.770 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.770 DEBUG:boto:Params: {} 2024-04-16T18:17:55.770 DEBUG:boto:Token: None 2024-04-16T18:17:55.771 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:55.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G6lz2tOzahr3fmuo61Z2tFtPEWU= 2024-04-16T18:17:55.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G6lz2tOzahr3fmuo61Z2tFtPEWU='} 2024-04-16T18:17:55.815 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000070f504a888374e50-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.815 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.815 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.815 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.815 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.815 DEBUG:boto:Data: 2024-04-16T18:17:55.815 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.815 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.816 DEBUG:boto:Params: {} 2024-04-16T18:17:55.816 DEBUG:boto:Token: None 2024-04-16T18:17:55.816 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.818 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dbdfed06a5088b0c-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.818 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.819 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.819 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.819 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.819 DEBUG:boto:Data: 2024-04-16T18:17:55.819 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.819 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.819 DEBUG:boto:Params: {} 2024-04-16T18:17:55.819 DEBUG:boto:Token: None 2024-04-16T18:17:55.820 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:55.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:84NAX5g+1G7DTrEoYIfidb9+uJg= 2024-04-16T18:17:55.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:84NAX5g+1G7DTrEoYIfidb9+uJg='} 2024-04-16T18:17:55.827 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a3de801639defda2-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.827 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.827 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.827 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.827 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.827 DEBUG:boto:Data: 2024-04-16T18:17:55.827 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.828 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.828 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.828 DEBUG:boto:Params: {} 2024-04-16T18:17:55.828 DEBUG:boto:Token: None 2024-04-16T18:17:55.828 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.830 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009573761a48d21800-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.830 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:55.831 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:55.831 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.831 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:55.831 DEBUG:boto:Data: 2024-04-16T18:17:55.831 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.831 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.831 DEBUG:boto:Params: {} 2024-04-16T18:17:55.831 DEBUG:boto:Token: None 2024-04-16T18:17:55.831 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:55.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7hnwdCGArSgKDLj9sAKHOf8jGYQ= 2024-04-16T18:17:55.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7hnwdCGArSgKDLj9sAKHOf8jGYQ='} 2024-04-16T18:17:55.874 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b2e79e77bd0dfb63-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.874 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.875 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.875 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.875 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.875 DEBUG:boto:Data: 2024-04-16T18:17:55.875 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.875 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.875 DEBUG:boto:Params: {} 2024-04-16T18:17:55.875 DEBUG:boto:Token: None 2024-04-16T18:17:55.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.878 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002cf05ad87bf7bd79-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:55.878 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:55.878 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.879 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:55.879 DEBUG:boto:Data: 2024-04-16T18:17:55.879 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.879 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.879 DEBUG:boto:Params: {} 2024-04-16T18:17:55.879 DEBUG:boto:Token: None 2024-04-16T18:17:55.879 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:55.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AOkpvgiiu/sYvxsUWvYQwSrKrLI= 2024-04-16T18:17:55.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AOkpvgiiu/sYvxsUWvYQwSrKrLI='} 2024-04-16T18:17:55.886 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000e36fc2abeeef403-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.886 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.887 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.887 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.887 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.887 DEBUG:boto:Data: 2024-04-16T18:17:55.887 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.887 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.887 DEBUG:boto:Params: {} 2024-04-16T18:17:55.887 DEBUG:boto:Token: None 2024-04-16T18:17:55.887 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.890 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ab784c221fe51f7-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.890 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:55.890 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:55.890 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.890 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:55.891 DEBUG:boto:Data: 2024-04-16T18:17:55.891 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.891 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.891 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.891 DEBUG:boto:Params: {} 2024-04-16T18:17:55.891 DEBUG:boto:Token: None 2024-04-16T18:17:55.891 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:55.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BVlxWT/D2V7VsTW7ZwrF7s/MI2Q= 2024-04-16T18:17:55.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BVlxWT/D2V7VsTW7ZwrF7s/MI2Q='} 2024-04-16T18:17:55.898 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b2b3ae3f9a31604-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.898 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.898 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.898 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.899 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.899 DEBUG:boto:Data: 2024-04-16T18:17:55.899 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.899 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.899 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.899 DEBUG:boto:Params: {} 2024-04-16T18:17:55.899 DEBUG:boto:Token: None 2024-04-16T18:17:55.899 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.901 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000054240ce445060474-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.901 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:17:55.902 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:17:55.902 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.902 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:17:55.902 DEBUG:boto:Data: 2024-04-16T18:17:55.902 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.902 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.902 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.902 DEBUG:boto:Params: {} 2024-04-16T18:17:55.902 DEBUG:boto:Token: None 2024-04-16T18:17:55.903 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:17:55.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YqXmbdrZcU7jI5im+Vxpd/XE1Es= 2024-04-16T18:17:55.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YqXmbdrZcU7jI5im+Vxpd/XE1Es='} 2024-04-16T18:17:55.946 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c7cb41cec3710e9d-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.947 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:55.947 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:55.947 DEBUG:boto:Method: HEAD 2024-04-16T18:17:55.947 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:55.947 DEBUG:boto:Data: 2024-04-16T18:17:55.947 DEBUG:boto:Headers: {} 2024-04-16T18:17:55.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.947 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.947 DEBUG:boto:Params: {} 2024-04-16T18:17:55.947 DEBUG:boto:Token: None 2024-04-16T18:17:55.948 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/ 2024-04-16T18:17:55.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE= 2024-04-16T18:17:55.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L6hQuoJh6LGxeaXeCXnD1nCdJwE=', 'Content-Length': '0'} 2024-04-16T18:17:55.950 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b368abe3ec3a211f-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.950 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:17:55.950 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:17:55.950 DEBUG:boto:Method: PUT 2024-04-16T18:17:55.951 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025 2024-04-16T18:17:55.951 DEBUG:boto:Data: 2024-04-16T18:17:55.951 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:55.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:55.951 DEBUG:boto:Port: 8000 2024-04-16T18:17:55.951 DEBUG:boto:Params: {} 2024-04-16T18:17:55.951 DEBUG:boto:Token: None 2024-04-16T18:17:55.951 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:55 GMT /cjqttm-51/obj00000000000000000025 2024-04-16T18:17:55.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:59DCifdaP9Np4JNs2SMJvYshyVM= 2024-04-16T18:17:55.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:59DCifdaP9Np4JNs2SMJvYshyVM='} 2024-04-16T18:17:55.957 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006f1fcd66654e8d5b-00661ec0d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:55.957 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:55.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:55.958 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:17:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:56.009 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:56.076 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:17:56.076 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-51 2024-04-16T18:17:56.085 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 27 2024-04-16T18:17:56.145 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '23', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:56.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '23', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:56.145 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 23 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:56.194 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:56.194 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:56.265 INFO:teuthology.orchestra.run.smithi016.stdout:{"objs":["obj00000000000000000058","obj00000000000000000026","obj00000000000000000011","obj00000000000000000046","obj00000000000000000014","obj00000000000000000050","obj00000000000000000032","obj00000000000000000002","obj00000000000000000039","obj00000000000000000007","obj00000000000000000006","obj00000000000000000040","obj00000000000000000009","obj00000000000000000045","obj00000000000000000013","obj00000000000000000012","obj00000000000000000033","obj00000000000000000001","obj00000000000000000000","obj00000000000000000021","obj00000000000000000003","obj00000000000000000055","obj00000000000000000008"]} 2024-04-16T18:17:56.265 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.265 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.265 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.265 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.265 DEBUG:boto:Data: 2024-04-16T18:17:56.265 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.266 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.266 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.266 DEBUG:boto:Params: {} 2024-04-16T18:17:56.266 DEBUG:boto:Token: None 2024-04-16T18:17:56.266 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.269 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d9fcbd2ad7df1f84-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.269 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:56.269 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:56.270 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.270 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:56.270 DEBUG:boto:Data: 2024-04-16T18:17:56.270 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.270 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.270 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.270 DEBUG:boto:Params: {} 2024-04-16T18:17:56.270 DEBUG:boto:Token: None 2024-04-16T18:17:56.270 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:56.270 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PltRt+PgWeDEPtYDMG93LU6QQXw= 2024-04-16T18:17:56.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PltRt+PgWeDEPtYDMG93LU6QQXw='} 2024-04-16T18:17:56.277 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000088cd8d223aa589b1-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.277 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.277 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.277 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.277 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.277 DEBUG:boto:Data: 2024-04-16T18:17:56.277 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.277 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.278 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.278 DEBUG:boto:Params: {} 2024-04-16T18:17:56.278 DEBUG:boto:Token: None 2024-04-16T18:17:56.278 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.278 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.280 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eabd6802c6fd1b23-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.280 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:17:56.280 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:17:56.281 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.281 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026 2024-04-16T18:17:56.281 DEBUG:boto:Data: 2024-04-16T18:17:56.281 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.281 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.281 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.281 DEBUG:boto:Params: {} 2024-04-16T18:17:56.281 DEBUG:boto:Token: None 2024-04-16T18:17:56.281 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000026 2024-04-16T18:17:56.281 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uSEdi1/6rEoxBGWxYKXSk0K0ObA= 2024-04-16T18:17:56.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uSEdi1/6rEoxBGWxYKXSk0K0ObA='} 2024-04-16T18:17:56.288 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000083dc87d677445a4d-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.288 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.288 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.288 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.288 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.288 DEBUG:boto:Data: 2024-04-16T18:17:56.288 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.288 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.288 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.288 DEBUG:boto:Params: {} 2024-04-16T18:17:56.289 DEBUG:boto:Token: None 2024-04-16T18:17:56.289 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.289 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.289 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.291 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007bcf85077b1111e8-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.291 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:56.292 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:56.292 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.292 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:56.292 DEBUG:boto:Data: 2024-04-16T18:17:56.292 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.292 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.292 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.292 DEBUG:boto:Params: {} 2024-04-16T18:17:56.292 DEBUG:boto:Token: None 2024-04-16T18:17:56.292 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:56.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iFZtUMPyI3wzF+JNaaCKJQqedTY= 2024-04-16T18:17:56.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iFZtUMPyI3wzF+JNaaCKJQqedTY='} 2024-04-16T18:17:56.334 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000046e2091a28024c0-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.334 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.335 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.335 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.335 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.335 DEBUG:boto:Data: 2024-04-16T18:17:56.335 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.335 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.335 DEBUG:boto:Params: {} 2024-04-16T18:17:56.335 DEBUG:boto:Token: None 2024-04-16T18:17:56.336 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.338 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083abd3847cea4467-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.339 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:56.339 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:56.339 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.339 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:56.339 DEBUG:boto:Data: 2024-04-16T18:17:56.339 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.339 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.339 DEBUG:boto:Params: {} 2024-04-16T18:17:56.339 DEBUG:boto:Token: None 2024-04-16T18:17:56.340 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:56.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:peOOlF4GGhTvt2JcGAczmUgbOnA= 2024-04-16T18:17:56.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:peOOlF4GGhTvt2JcGAczmUgbOnA='} 2024-04-16T18:17:56.347 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003ac99c52a9466897-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.347 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.347 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.347 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.347 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.347 DEBUG:boto:Data: 2024-04-16T18:17:56.348 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.348 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.348 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.348 DEBUG:boto:Params: {} 2024-04-16T18:17:56.348 DEBUG:boto:Token: None 2024-04-16T18:17:56.348 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.350 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ceefccab871050d3-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.351 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:17:56.351 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:17:56.351 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.351 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033 2024-04-16T18:17:56.351 DEBUG:boto:Data: 2024-04-16T18:17:56.351 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.351 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.351 DEBUG:boto:Params: {} 2024-04-16T18:17:56.352 DEBUG:boto:Token: None 2024-04-16T18:17:56.352 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000033 2024-04-16T18:17:56.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TatLv12sWz38hXOQk6lALlwvKZQ= 2024-04-16T18:17:56.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TatLv12sWz38hXOQk6lALlwvKZQ='} 2024-04-16T18:17:56.394 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c9b9c3d75eed4233-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.395 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.395 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.395 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.395 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.395 DEBUG:boto:Data: 2024-04-16T18:17:56.395 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.395 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.395 DEBUG:boto:Params: {} 2024-04-16T18:17:56.395 DEBUG:boto:Token: None 2024-04-16T18:17:56.396 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.398 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a589c050573d3e1c-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.398 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:56.399 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:56.399 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.399 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:56.399 DEBUG:boto:Data: 2024-04-16T18:17:56.399 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.399 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.399 DEBUG:boto:Params: {} 2024-04-16T18:17:56.399 DEBUG:boto:Token: None 2024-04-16T18:17:56.399 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:56.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/Hv+/XXAY+ZjYfeQco2wyVhAufY= 2024-04-16T18:17:56.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/Hv+/XXAY+ZjYfeQco2wyVhAufY='} 2024-04-16T18:17:56.406 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b80801aa4b2d84be-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.406 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.406 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.407 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.407 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.407 DEBUG:boto:Data: 2024-04-16T18:17:56.407 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.407 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.407 DEBUG:boto:Params: {} 2024-04-16T18:17:56.407 DEBUG:boto:Token: None 2024-04-16T18:17:56.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.410 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000315c97f5a6874364-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.410 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:17:56.410 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:17:56.410 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.411 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046 2024-04-16T18:17:56.411 DEBUG:boto:Data: 2024-04-16T18:17:56.411 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.411 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.411 DEBUG:boto:Params: {} 2024-04-16T18:17:56.411 DEBUG:boto:Token: None 2024-04-16T18:17:56.411 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000046 2024-04-16T18:17:56.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Iky6RKdb+WNFkBtJ+Q++8iKrkn8= 2024-04-16T18:17:56.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Iky6RKdb+WNFkBtJ+Q++8iKrkn8='} 2024-04-16T18:17:56.454 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bc9b5665821fb87d-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.454 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.455 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.455 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.455 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.455 DEBUG:boto:Data: 2024-04-16T18:17:56.455 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.455 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.455 DEBUG:boto:Params: {} 2024-04-16T18:17:56.455 DEBUG:boto:Token: None 2024-04-16T18:17:56.455 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.458 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f28aead83258355b-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.458 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:17:56.459 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:17:56.459 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.459 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039 2024-04-16T18:17:56.459 DEBUG:boto:Data: 2024-04-16T18:17:56.459 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.459 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.459 DEBUG:boto:Params: {} 2024-04-16T18:17:56.459 DEBUG:boto:Token: None 2024-04-16T18:17:56.459 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000039 2024-04-16T18:17:56.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+TV15NNn15AqmnwphgQkBIHAckA= 2024-04-16T18:17:56.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+TV15NNn15AqmnwphgQkBIHAckA='} 2024-04-16T18:17:56.465 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000006ac47a31675669c-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.465 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.465 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.466 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.466 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.466 DEBUG:boto:Data: 2024-04-16T18:17:56.466 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.466 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.466 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.466 DEBUG:boto:Params: {} 2024-04-16T18:17:56.466 DEBUG:boto:Token: None 2024-04-16T18:17:56.466 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.466 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.469 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001c5f07545438baad-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.469 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:56.469 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:56.469 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.469 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:56.469 DEBUG:boto:Data: 2024-04-16T18:17:56.470 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.470 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.470 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.470 DEBUG:boto:Params: {} 2024-04-16T18:17:56.470 DEBUG:boto:Token: None 2024-04-16T18:17:56.470 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:56.470 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ko9i9bEeoYh1nKlRS//fJhwveik= 2024-04-16T18:17:56.470 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ko9i9bEeoYh1nKlRS//fJhwveik='} 2024-04-16T18:17:56.477 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ce44fcb46d44cdbe-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.478 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.478 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.478 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.478 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.478 DEBUG:boto:Data: 2024-04-16T18:17:56.478 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.478 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.478 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.478 DEBUG:boto:Params: {} 2024-04-16T18:17:56.478 DEBUG:boto:Token: None 2024-04-16T18:17:56.479 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.481 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c62ba4cd9df627a9-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.481 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:56.481 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:56.482 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.482 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:56.482 DEBUG:boto:Data: 2024-04-16T18:17:56.482 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.482 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.482 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.482 DEBUG:boto:Params: {} 2024-04-16T18:17:56.482 DEBUG:boto:Token: None 2024-04-16T18:17:56.482 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:56.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:73rqibmnWo4jrOXoC6n4Olo3muE= 2024-04-16T18:17:56.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:73rqibmnWo4jrOXoC6n4Olo3muE='} 2024-04-16T18:17:56.526 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a70846ac84916be2-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.526 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.527 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.527 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.527 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.527 DEBUG:boto:Data: 2024-04-16T18:17:56.527 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.527 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.527 DEBUG:boto:Params: {} 2024-04-16T18:17:56.527 DEBUG:boto:Token: None 2024-04-16T18:17:56.527 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.530 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d929d4d82e05bf53-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.530 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:56.530 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:56.530 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.530 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:56.530 DEBUG:boto:Data: 2024-04-16T18:17:56.531 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.531 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.531 DEBUG:boto:Params: {} 2024-04-16T18:17:56.531 DEBUG:boto:Token: None 2024-04-16T18:17:56.531 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:56.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3EHjbrE7EkU5Qe0zEqFEsS6BWEI= 2024-04-16T18:17:56.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3EHjbrE7EkU5Qe0zEqFEsS6BWEI='} 2024-04-16T18:17:56.537 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002387eb22d29d4736-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.537 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.538 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.538 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.538 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.538 DEBUG:boto:Data: 2024-04-16T18:17:56.538 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.538 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.538 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.538 DEBUG:boto:Params: {} 2024-04-16T18:17:56.538 DEBUG:boto:Token: None 2024-04-16T18:17:56.538 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.541 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ccf0e50482fc128-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.541 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:17:56.541 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:17:56.541 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.542 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058 2024-04-16T18:17:56.542 DEBUG:boto:Data: 2024-04-16T18:17:56.542 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.542 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.542 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.542 DEBUG:boto:Params: {} 2024-04-16T18:17:56.542 DEBUG:boto:Token: None 2024-04-16T18:17:56.542 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000058 2024-04-16T18:17:56.542 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:llByFgMaXomt9iHNrqPL+wriDTo= 2024-04-16T18:17:56.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:llByFgMaXomt9iHNrqPL+wriDTo='} 2024-04-16T18:17:56.547 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b151c70d1a81f3d4-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.547 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.547 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.548 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.548 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.548 DEBUG:boto:Data: 2024-04-16T18:17:56.548 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.548 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.548 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.548 DEBUG:boto:Params: {} 2024-04-16T18:17:56.548 DEBUG:boto:Token: None 2024-04-16T18:17:56.548 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.551 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006a9c120bae5acf6b-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.551 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:56.551 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:56.551 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.551 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:56.551 DEBUG:boto:Data: 2024-04-16T18:17:56.551 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.552 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.552 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.552 DEBUG:boto:Params: {} 2024-04-16T18:17:56.552 DEBUG:boto:Token: None 2024-04-16T18:17:56.552 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:56.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qP3ijpobm04Ug8JS6UzKQRRO6SE= 2024-04-16T18:17:56.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qP3ijpobm04Ug8JS6UzKQRRO6SE='} 2024-04-16T18:17:56.594 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed153d4c6685a2ef-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.595 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.595 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.595 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.595 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.595 DEBUG:boto:Data: 2024-04-16T18:17:56.595 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.595 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.595 DEBUG:boto:Params: {} 2024-04-16T18:17:56.595 DEBUG:boto:Token: None 2024-04-16T18:17:56.596 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.598 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000051f502a7112f93ef-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.599 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:17:56.599 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:17:56.599 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.599 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050 2024-04-16T18:17:56.599 DEBUG:boto:Data: 2024-04-16T18:17:56.599 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.599 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.599 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.599 DEBUG:boto:Params: {} 2024-04-16T18:17:56.599 DEBUG:boto:Token: None 2024-04-16T18:17:56.600 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000050 2024-04-16T18:17:56.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F1xPMarMtgLABqYLt23rTrTEs0Y= 2024-04-16T18:17:56.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F1xPMarMtgLABqYLt23rTrTEs0Y='} 2024-04-16T18:17:56.605 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009ead67d61a4535cf-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.605 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.605 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.606 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.606 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.606 DEBUG:boto:Data: 2024-04-16T18:17:56.606 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.606 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.606 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.606 DEBUG:boto:Params: {} 2024-04-16T18:17:56.606 DEBUG:boto:Token: None 2024-04-16T18:17:56.606 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.606 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.609 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b7e04f04ef697ff-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.609 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:17:56.609 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:17:56.609 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.609 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055 2024-04-16T18:17:56.609 DEBUG:boto:Data: 2024-04-16T18:17:56.609 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.609 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.610 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.610 DEBUG:boto:Params: {} 2024-04-16T18:17:56.610 DEBUG:boto:Token: None 2024-04-16T18:17:56.610 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000055 2024-04-16T18:17:56.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iKJbftH0BD+kXM0W4fTP2GLtqtg= 2024-04-16T18:17:56.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iKJbftH0BD+kXM0W4fTP2GLtqtg='} 2024-04-16T18:17:56.654 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c60f5b299c19f224-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.655 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.655 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.655 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.655 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.655 DEBUG:boto:Data: 2024-04-16T18:17:56.655 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.655 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.655 DEBUG:boto:Params: {} 2024-04-16T18:17:56.655 DEBUG:boto:Token: None 2024-04-16T18:17:56.656 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.658 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000031f5f5a14dcb5bba-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.658 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:56.658 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:56.659 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.659 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:56.659 DEBUG:boto:Data: 2024-04-16T18:17:56.659 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.659 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.659 DEBUG:boto:Params: {} 2024-04-16T18:17:56.659 DEBUG:boto:Token: None 2024-04-16T18:17:56.659 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:56.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c7Wiv+UDsDMguYOPgGaD3Ci9Ozs= 2024-04-16T18:17:56.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c7Wiv+UDsDMguYOPgGaD3Ci9Ozs='} 2024-04-16T18:17:56.666 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000387e68f80441fcee-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.667 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.667 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.667 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.667 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.667 DEBUG:boto:Data: 2024-04-16T18:17:56.667 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.667 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.667 DEBUG:boto:Params: {} 2024-04-16T18:17:56.667 DEBUG:boto:Token: None 2024-04-16T18:17:56.668 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.670 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c00ad8e3902271bc-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.670 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:17:56.670 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:17:56.671 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.671 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032 2024-04-16T18:17:56.671 DEBUG:boto:Data: 2024-04-16T18:17:56.671 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.671 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.671 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.671 DEBUG:boto:Params: {} 2024-04-16T18:17:56.671 DEBUG:boto:Token: None 2024-04-16T18:17:56.672 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000032 2024-04-16T18:17:56.672 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U+ucEmF+s2AFyjaotg54CWSHkfM= 2024-04-16T18:17:56.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U+ucEmF+s2AFyjaotg54CWSHkfM='} 2024-04-16T18:17:56.679 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d64092ef79de73fc-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.679 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.679 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.679 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.679 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.679 DEBUG:boto:Data: 2024-04-16T18:17:56.679 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.679 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.680 DEBUG:boto:Params: {} 2024-04-16T18:17:56.680 DEBUG:boto:Token: None 2024-04-16T18:17:56.680 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.682 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000524b07952e92cb13-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.682 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:56.682 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:56.682 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.683 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:56.683 DEBUG:boto:Data: 2024-04-16T18:17:56.683 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.683 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.683 DEBUG:boto:Params: {} 2024-04-16T18:17:56.683 DEBUG:boto:Token: None 2024-04-16T18:17:56.683 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:56.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AsAQ1WkPNf8ldlZBddIkk1tAzvA= 2024-04-16T18:17:56.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AsAQ1WkPNf8ldlZBddIkk1tAzvA='} 2024-04-16T18:17:56.726 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000052b633d32532d95-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.727 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.727 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.727 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.727 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.727 DEBUG:boto:Data: 2024-04-16T18:17:56.727 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.727 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.727 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.727 DEBUG:boto:Params: {} 2024-04-16T18:17:56.727 DEBUG:boto:Token: None 2024-04-16T18:17:56.728 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.730 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b9c597a34fb94b81-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.730 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:56.731 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:56.731 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.731 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:56.731 DEBUG:boto:Data: 2024-04-16T18:17:56.731 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.731 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.731 DEBUG:boto:Params: {} 2024-04-16T18:17:56.731 DEBUG:boto:Token: None 2024-04-16T18:17:56.731 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:56.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RJ6nv2FcocFmDEuiSre9/EBy7xs= 2024-04-16T18:17:56.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RJ6nv2FcocFmDEuiSre9/EBy7xs='} 2024-04-16T18:17:56.738 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003e9a50f7900b1333-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.738 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.739 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.739 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.739 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.739 DEBUG:boto:Data: 2024-04-16T18:17:56.739 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.739 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.739 DEBUG:boto:Params: {} 2024-04-16T18:17:56.739 DEBUG:boto:Token: None 2024-04-16T18:17:56.740 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.742 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000792e97ebdf3772c3-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.742 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:17:56.742 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:17:56.742 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.743 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040 2024-04-16T18:17:56.743 DEBUG:boto:Data: 2024-04-16T18:17:56.743 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.743 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.743 DEBUG:boto:Params: {} 2024-04-16T18:17:56.743 DEBUG:boto:Token: None 2024-04-16T18:17:56.743 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000040 2024-04-16T18:17:56.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Vqfor8kIkGxBKksjemCgolSjFpo= 2024-04-16T18:17:56.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Vqfor8kIkGxBKksjemCgolSjFpo='} 2024-04-16T18:17:56.748 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c76a4ab688f8594a-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.749 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:56.749 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:56.749 DEBUG:boto:Method: HEAD 2024-04-16T18:17:56.749 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:56.749 DEBUG:boto:Data: 2024-04-16T18:17:56.749 DEBUG:boto:Headers: {} 2024-04-16T18:17:56.749 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.749 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.749 DEBUG:boto:Params: {} 2024-04-16T18:17:56.750 DEBUG:boto:Token: None 2024-04-16T18:17:56.750 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/ 2024-04-16T18:17:56.750 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ= 2024-04-16T18:17:56.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BnpvqHuiWSo3cIJuFNwHTOy8mQ=', 'Content-Length': '0'} 2024-04-16T18:17:56.752 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000006f77de4a8f69a58-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.752 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:17:56.753 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:17:56.753 DEBUG:boto:Method: PUT 2024-04-16T18:17:56.753 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045 2024-04-16T18:17:56.753 DEBUG:boto:Data: 2024-04-16T18:17:56.753 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:56.753 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:56.753 DEBUG:boto:Port: 8000 2024-04-16T18:17:56.753 DEBUG:boto:Params: {} 2024-04-16T18:17:56.754 DEBUG:boto:Token: None 2024-04-16T18:17:56.754 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:56 GMT /cjqttm-51/obj00000000000000000045 2024-04-16T18:17:56.754 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hv9LnRSP70kUpvpz1HDDYc70KWg= 2024-04-16T18:17:56.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:56 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hv9LnRSP70kUpvpz1HDDYc70KWg='} 2024-04-16T18:17:56.798 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001f256413230549bc-00661ec0d4-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:56.799 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:56.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:56.799 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:17:56.850 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:56.850 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:56.915 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:17:56.915 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-51 2024-04-16T18:17:56.925 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 34 2024-04-16T18:17:56.993 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '29', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:56.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '29', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:56.993 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 29 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:57.043 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:57.112 INFO:teuthology.orchestra.run.smithi016.stdout:{"objs":["obj00000000000000000006","obj00000000000000000059","obj00000000000000000027","obj00000000000000000004","obj00000000000000000011","obj00000000000000000002","obj00000000000000000019","obj00000000000000000049","obj00000000000000000017","obj00000000000000000008","obj00000000000000000015","obj00000000000000000031","obj00000000000000000022","obj00000000000000000013","obj00000000000000000020","obj00000000000000000037","obj00000000000000000005","obj00000000000000000012","obj00000000000000000003","obj00000000000000000042","obj00000000000000000010","obj00000000000000000001","obj00000000000000000009","obj00000000000000000025","obj00000000000000000016","obj00000000000000000000","obj00000000000000000014","obj00000000000000000030","obj00000000000000000021"]} 2024-04-16T18:17:57.112 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.112 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.112 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.113 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.113 DEBUG:boto:Data: 2024-04-16T18:17:57.113 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.113 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.113 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.113 DEBUG:boto:Params: {} 2024-04-16T18:17:57.113 DEBUG:boto:Token: None 2024-04-16T18:17:57.113 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.114 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.117 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000053f9de04a2d7d788-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.117 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:57.117 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:57.118 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.118 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:57.118 DEBUG:boto:Data: 2024-04-16T18:17:57.118 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.118 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.119 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.119 DEBUG:boto:Params: {} 2024-04-16T18:17:57.119 DEBUG:boto:Token: None 2024-04-16T18:17:57.119 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:57.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EvuzwIvnwuxmoKVAIgZargno9JQ= 2024-04-16T18:17:57.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EvuzwIvnwuxmoKVAIgZargno9JQ='} 2024-04-16T18:17:57.125 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eaa2d3e325822b6d-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.126 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.126 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.126 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.126 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.126 DEBUG:boto:Data: 2024-04-16T18:17:57.126 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.126 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.126 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.127 DEBUG:boto:Params: {} 2024-04-16T18:17:57.127 DEBUG:boto:Token: None 2024-04-16T18:17:57.127 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.129 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005aa9d0ba1ae72901-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.130 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:17:57.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:17:57.130 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.130 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022 2024-04-16T18:17:57.130 DEBUG:boto:Data: 2024-04-16T18:17:57.130 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.130 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.130 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.131 DEBUG:boto:Params: {} 2024-04-16T18:17:57.131 DEBUG:boto:Token: None 2024-04-16T18:17:57.131 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000022 2024-04-16T18:17:57.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6EZ9ljF2Hl9ht0LjTl1OlxBGb4Y= 2024-04-16T18:17:57.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6EZ9ljF2Hl9ht0LjTl1OlxBGb4Y='} 2024-04-16T18:17:57.136 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f799b34bb9318814-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.136 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.136 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.136 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.136 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.136 DEBUG:boto:Data: 2024-04-16T18:17:57.136 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.136 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.137 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.137 DEBUG:boto:Params: {} 2024-04-16T18:17:57.137 DEBUG:boto:Token: None 2024-04-16T18:17:57.137 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.137 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.139 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000001363cc71ac7a96a-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.140 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:57.140 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:57.140 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.140 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:57.140 DEBUG:boto:Data: 2024-04-16T18:17:57.140 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.140 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.140 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.140 DEBUG:boto:Params: {} 2024-04-16T18:17:57.141 DEBUG:boto:Token: None 2024-04-16T18:17:57.141 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:57.141 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+WrJD5CbsJOPYn1FhAfpiQPvYhM= 2024-04-16T18:17:57.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+WrJD5CbsJOPYn1FhAfpiQPvYhM='} 2024-04-16T18:17:57.182 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001b4eea6dc6c66b75-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.182 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.183 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.183 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.183 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.183 DEBUG:boto:Data: 2024-04-16T18:17:57.183 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.183 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.183 DEBUG:boto:Params: {} 2024-04-16T18:17:57.183 DEBUG:boto:Token: None 2024-04-16T18:17:57.183 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.186 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000014dd4541c2672221-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.186 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:57.186 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:57.187 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.187 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:57.187 DEBUG:boto:Data: 2024-04-16T18:17:57.187 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.187 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.187 DEBUG:boto:Params: {} 2024-04-16T18:17:57.187 DEBUG:boto:Token: None 2024-04-16T18:17:57.187 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:57.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPCVPeRhRnm1Fucg/UDrwfD/7+s= 2024-04-16T18:17:57.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPCVPeRhRnm1Fucg/UDrwfD/7+s='} 2024-04-16T18:17:57.195 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dae4f7ed7111a42b-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.195 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.195 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.195 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.195 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.195 DEBUG:boto:Data: 2024-04-16T18:17:57.195 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.195 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.195 DEBUG:boto:Params: {} 2024-04-16T18:17:57.196 DEBUG:boto:Token: None 2024-04-16T18:17:57.196 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.198 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b25f7021e5fa93fb-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.198 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:57.198 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:57.199 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.199 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:57.199 DEBUG:boto:Data: 2024-04-16T18:17:57.199 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.199 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.199 DEBUG:boto:Params: {} 2024-04-16T18:17:57.199 DEBUG:boto:Token: None 2024-04-16T18:17:57.199 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:57.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TP2xnckCOpmAdyrMP/LePdWG0OY= 2024-04-16T18:17:57.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TP2xnckCOpmAdyrMP/LePdWG0OY='} 2024-04-16T18:17:57.206 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e21cb5a50d43aac3-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.206 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.206 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.206 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.206 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.207 DEBUG:boto:Data: 2024-04-16T18:17:57.207 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.207 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.207 DEBUG:boto:Params: {} 2024-04-16T18:17:57.207 DEBUG:boto:Token: None 2024-04-16T18:17:57.207 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.210 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000037a6ff090ac80ffb-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.210 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:17:57.210 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:17:57.210 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.210 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042 2024-04-16T18:17:57.210 DEBUG:boto:Data: 2024-04-16T18:17:57.211 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.211 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.211 DEBUG:boto:Params: {} 2024-04-16T18:17:57.211 DEBUG:boto:Token: None 2024-04-16T18:17:57.211 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000042 2024-04-16T18:17:57.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IAX07gm4z+Le04G2fKAvkRpAYyY= 2024-04-16T18:17:57.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IAX07gm4z+Le04G2fKAvkRpAYyY='} 2024-04-16T18:17:57.254 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005e734ba1cd092a4e-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.254 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.255 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.255 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.255 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.255 DEBUG:boto:Data: 2024-04-16T18:17:57.255 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.255 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.255 DEBUG:boto:Params: {} 2024-04-16T18:17:57.255 DEBUG:boto:Token: None 2024-04-16T18:17:57.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.258 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000073ef547e7b6ce73a-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.258 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:17:57.258 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:17:57.259 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.259 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008 2024-04-16T18:17:57.259 DEBUG:boto:Data: 2024-04-16T18:17:57.259 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.259 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.259 DEBUG:boto:Params: {} 2024-04-16T18:17:57.259 DEBUG:boto:Token: None 2024-04-16T18:17:57.259 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000008 2024-04-16T18:17:57.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZhW1Qz22L3iCnOlgP4kJujgfNfo= 2024-04-16T18:17:57.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZhW1Qz22L3iCnOlgP4kJujgfNfo='} 2024-04-16T18:17:57.268 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fa72cc87a3dc8a58-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.268 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.268 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.269 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.269 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.269 DEBUG:boto:Data: 2024-04-16T18:17:57.269 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.269 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.269 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.269 DEBUG:boto:Params: {} 2024-04-16T18:17:57.269 DEBUG:boto:Token: None 2024-04-16T18:17:57.269 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.269 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.272 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000602321f54489daac-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.272 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:57.272 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:57.272 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.272 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:57.272 DEBUG:boto:Data: 2024-04-16T18:17:57.273 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.273 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.273 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.273 DEBUG:boto:Params: {} 2024-04-16T18:17:57.273 DEBUG:boto:Token: None 2024-04-16T18:17:57.273 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:57.273 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L8IvHcoh7vTk1TfEQIt84Q5xd68= 2024-04-16T18:17:57.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L8IvHcoh7vTk1TfEQIt84Q5xd68='} 2024-04-16T18:17:57.318 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000417a739f9691545d-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.319 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.319 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.319 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.319 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.319 DEBUG:boto:Data: 2024-04-16T18:17:57.319 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.319 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.319 DEBUG:boto:Params: {} 2024-04-16T18:17:57.320 DEBUG:boto:Token: None 2024-04-16T18:17:57.320 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.323 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002aaddcdb4e48a49-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.323 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:57.323 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:57.323 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.323 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:57.323 DEBUG:boto:Data: 2024-04-16T18:17:57.323 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.323 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.324 DEBUG:boto:Params: {} 2024-04-16T18:17:57.324 DEBUG:boto:Token: None 2024-04-16T18:17:57.324 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:57.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GG7ltjBJldtpDbb3PCCSoQbqXgo= 2024-04-16T18:17:57.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GG7ltjBJldtpDbb3PCCSoQbqXgo='} 2024-04-16T18:17:57.330 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000169cfad6ddbcdffe-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.331 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.331 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.331 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.331 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.331 DEBUG:boto:Data: 2024-04-16T18:17:57.331 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.331 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.331 DEBUG:boto:Params: {} 2024-04-16T18:17:57.331 DEBUG:boto:Token: None 2024-04-16T18:17:57.332 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.334 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '111'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001c74f5b5938b8773-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.335 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:17:57.335 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:17:57.335 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.335 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027 2024-04-16T18:17:57.335 DEBUG:boto:Data: 2024-04-16T18:17:57.335 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.335 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.335 DEBUG:boto:Params: {} 2024-04-16T18:17:57.336 DEBUG:boto:Token: None 2024-04-16T18:17:57.336 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000027 2024-04-16T18:17:57.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hmArxQSP0PWHCI7mrBuWPWDOPs0= 2024-04-16T18:17:57.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hmArxQSP0PWHCI7mrBuWPWDOPs0='} 2024-04-16T18:17:57.378 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c41834ee9218b212-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.379 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.379 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.379 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.379 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.379 DEBUG:boto:Data: 2024-04-16T18:17:57.379 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.379 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.380 DEBUG:boto:Params: {} 2024-04-16T18:17:57.380 DEBUG:boto:Token: None 2024-04-16T18:17:57.380 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.383 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000005ea7b1a32c62b3b-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.383 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:17:57.383 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:17:57.383 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.383 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037 2024-04-16T18:17:57.383 DEBUG:boto:Data: 2024-04-16T18:17:57.384 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.384 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.384 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.384 DEBUG:boto:Params: {} 2024-04-16T18:17:57.384 DEBUG:boto:Token: None 2024-04-16T18:17:57.384 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000037 2024-04-16T18:17:57.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xDJ79syrX8Aaoee8YMO1Vm80wTg= 2024-04-16T18:17:57.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xDJ79syrX8Aaoee8YMO1Vm80wTg='} 2024-04-16T18:17:57.390 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f0ffd378934f6d4-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.390 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.390 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.390 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.390 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.391 DEBUG:boto:Data: 2024-04-16T18:17:57.391 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.391 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.391 DEBUG:boto:Params: {} 2024-04-16T18:17:57.391 DEBUG:boto:Token: None 2024-04-16T18:17:57.391 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.394 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '117'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003328c15da4bb754c-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.394 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:17:57.394 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:17:57.395 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.395 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017 2024-04-16T18:17:57.395 DEBUG:boto:Data: 2024-04-16T18:17:57.395 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.395 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.395 DEBUG:boto:Params: {} 2024-04-16T18:17:57.395 DEBUG:boto:Token: None 2024-04-16T18:17:57.395 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000017 2024-04-16T18:17:57.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XTeNlsrT+CDODzfz2XOaVgTe9U8= 2024-04-16T18:17:57.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XTeNlsrT+CDODzfz2XOaVgTe9U8='} 2024-04-16T18:17:57.438 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000038f34a58f55fc670-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.439 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.439 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.439 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.439 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.439 DEBUG:boto:Data: 2024-04-16T18:17:57.439 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.439 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.439 DEBUG:boto:Params: {} 2024-04-16T18:17:57.439 DEBUG:boto:Token: None 2024-04-16T18:17:57.440 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.442 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ca568238c1a7eddd-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.442 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:57.443 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:57.443 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.443 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:57.443 DEBUG:boto:Data: 2024-04-16T18:17:57.443 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.443 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.443 DEBUG:boto:Params: {} 2024-04-16T18:17:57.443 DEBUG:boto:Token: None 2024-04-16T18:17:57.443 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:57.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pb9s7dp4Bnq1bm6e+aJzVAEL1bE= 2024-04-16T18:17:57.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pb9s7dp4Bnq1bm6e+aJzVAEL1bE='} 2024-04-16T18:17:57.449 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000927faff1aff3d21e-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.450 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.450 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.450 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.450 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.450 DEBUG:boto:Data: 2024-04-16T18:17:57.450 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.450 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.450 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.450 DEBUG:boto:Params: {} 2024-04-16T18:17:57.451 DEBUG:boto:Token: None 2024-04-16T18:17:57.451 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.453 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002ff4b110935754c1-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.453 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:57.454 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:57.454 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.454 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:57.454 DEBUG:boto:Data: 2024-04-16T18:17:57.454 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.454 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.454 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.454 DEBUG:boto:Params: {} 2024-04-16T18:17:57.454 DEBUG:boto:Token: None 2024-04-16T18:17:57.454 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:57.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JxwHHF5d1iSY6iswPVxkLsth6kQ= 2024-04-16T18:17:57.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JxwHHF5d1iSY6iswPVxkLsth6kQ='} 2024-04-16T18:17:57.461 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d0afb17f3aa0b241-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.462 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.462 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.462 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.462 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.462 DEBUG:boto:Data: 2024-04-16T18:17:57.462 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.462 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.462 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.462 DEBUG:boto:Params: {} 2024-04-16T18:17:57.463 DEBUG:boto:Token: None 2024-04-16T18:17:57.463 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.465 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000025c38e957c7e61bf-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.466 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:17:57.466 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:17:57.466 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.466 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:17:57.466 DEBUG:boto:Data: 2024-04-16T18:17:57.466 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.466 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.466 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.466 DEBUG:boto:Params: {} 2024-04-16T18:17:57.466 DEBUG:boto:Token: None 2024-04-16T18:17:57.467 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:17:57.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XfAhljMK70MIAayJlRyYQbu++uM= 2024-04-16T18:17:57.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XfAhljMK70MIAayJlRyYQbu++uM='} 2024-04-16T18:17:57.510 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f4f7ec76adaf0ccf-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.511 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.511 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.511 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.511 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.511 DEBUG:boto:Data: 2024-04-16T18:17:57.511 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.511 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.512 DEBUG:boto:Params: {} 2024-04-16T18:17:57.512 DEBUG:boto:Token: None 2024-04-16T18:17:57.512 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.515 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf637d765bf94cf8-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.515 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:17:57.516 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:17:57.516 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.516 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059 2024-04-16T18:17:57.516 DEBUG:boto:Data: 2024-04-16T18:17:57.516 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.516 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.516 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.516 DEBUG:boto:Params: {} 2024-04-16T18:17:57.517 DEBUG:boto:Token: None 2024-04-16T18:17:57.517 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000059 2024-04-16T18:17:57.517 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S8wrZBRHK138beKp0iH+USc3oQM= 2024-04-16T18:17:57.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S8wrZBRHK138beKp0iH+USc3oQM='} 2024-04-16T18:17:57.522 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a4058df541421d40-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.522 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.522 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.523 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.523 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.523 DEBUG:boto:Data: 2024-04-16T18:17:57.523 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.523 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.523 DEBUG:boto:Params: {} 2024-04-16T18:17:57.523 DEBUG:boto:Token: None 2024-04-16T18:17:57.523 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.526 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '123'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003e7e5b0db91f3f72-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.526 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:17:57.526 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:17:57.526 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.526 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031 2024-04-16T18:17:57.526 DEBUG:boto:Data: 2024-04-16T18:17:57.526 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.527 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.527 DEBUG:boto:Params: {} 2024-04-16T18:17:57.527 DEBUG:boto:Token: None 2024-04-16T18:17:57.527 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000031 2024-04-16T18:17:57.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NXa59PmajrMMMiiOaIt93TTjC2o= 2024-04-16T18:17:57.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NXa59PmajrMMMiiOaIt93TTjC2o='} 2024-04-16T18:17:57.570 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000155c07bf4491936a-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.571 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.571 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.571 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.571 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.571 DEBUG:boto:Data: 2024-04-16T18:17:57.571 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.571 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.571 DEBUG:boto:Params: {} 2024-04-16T18:17:57.571 DEBUG:boto:Token: None 2024-04-16T18:17:57.571 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.574 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0642e61c0b45073-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.574 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:57.574 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:57.574 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.574 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:57.575 DEBUG:boto:Data: 2024-04-16T18:17:57.575 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.575 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.575 DEBUG:boto:Params: {} 2024-04-16T18:17:57.575 DEBUG:boto:Token: None 2024-04-16T18:17:57.575 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:57.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NIY/aLfO0LkKvFSksx/foak8rGw= 2024-04-16T18:17:57.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NIY/aLfO0LkKvFSksx/foak8rGw='} 2024-04-16T18:17:57.582 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eae1107b1081779d-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.582 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.582 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.582 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.583 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.583 DEBUG:boto:Data: 2024-04-16T18:17:57.583 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.583 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.583 DEBUG:boto:Params: {} 2024-04-16T18:17:57.583 DEBUG:boto:Token: None 2024-04-16T18:17:57.583 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.586 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000028550b07ad3ab355-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.586 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:57.586 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:57.586 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.586 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:57.586 DEBUG:boto:Data: 2024-04-16T18:17:57.587 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.587 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.587 DEBUG:boto:Params: {} 2024-04-16T18:17:57.587 DEBUG:boto:Token: None 2024-04-16T18:17:57.587 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:57.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A5rTraO+XWebhbOV3XodwFvF3DY= 2024-04-16T18:17:57.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A5rTraO+XWebhbOV3XodwFvF3DY='} 2024-04-16T18:17:57.593 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000006ef0115cea49979-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.593 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.593 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.594 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.594 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.594 DEBUG:boto:Data: 2024-04-16T18:17:57.594 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.594 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.594 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.594 DEBUG:boto:Params: {} 2024-04-16T18:17:57.594 DEBUG:boto:Token: None 2024-04-16T18:17:57.594 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.597 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dc9d9a63eb933fb0-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.597 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:17:57.598 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:17:57.598 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.598 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025 2024-04-16T18:17:57.598 DEBUG:boto:Data: 2024-04-16T18:17:57.598 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.598 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.598 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.598 DEBUG:boto:Params: {} 2024-04-16T18:17:57.598 DEBUG:boto:Token: None 2024-04-16T18:17:57.598 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000025 2024-04-16T18:17:57.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iPb9zSqdj5as2Ovn/5D5VkwQ6zU= 2024-04-16T18:17:57.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iPb9zSqdj5as2Ovn/5D5VkwQ6zU='} 2024-04-16T18:17:57.642 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d5235c8ab4974c4b-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.642 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.643 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.643 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.643 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.643 DEBUG:boto:Data: 2024-04-16T18:17:57.643 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.643 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.643 DEBUG:boto:Params: {} 2024-04-16T18:17:57.643 DEBUG:boto:Token: None 2024-04-16T18:17:57.643 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.646 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000ce7d3a4dc50eb95-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.646 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:17:57.646 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:17:57.647 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.647 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049 2024-04-16T18:17:57.647 DEBUG:boto:Data: 2024-04-16T18:17:57.647 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.647 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.647 DEBUG:boto:Params: {} 2024-04-16T18:17:57.647 DEBUG:boto:Token: None 2024-04-16T18:17:57.647 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000049 2024-04-16T18:17:57.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qh1SG2k1bGDpyIiJx+5SUACFdcQ= 2024-04-16T18:17:57.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qh1SG2k1bGDpyIiJx+5SUACFdcQ='} 2024-04-16T18:17:57.652 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a6fac5a297a200f0-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.653 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.653 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.653 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.653 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.653 DEBUG:boto:Data: 2024-04-16T18:17:57.653 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.653 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.653 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.653 DEBUG:boto:Params: {} 2024-04-16T18:17:57.653 DEBUG:boto:Token: None 2024-04-16T18:17:57.654 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.654 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.656 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008165a14d68ed5786-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.656 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:17:57.656 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:17:57.656 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.657 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015 2024-04-16T18:17:57.657 DEBUG:boto:Data: 2024-04-16T18:17:57.657 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.657 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.657 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.657 DEBUG:boto:Params: {} 2024-04-16T18:17:57.657 DEBUG:boto:Token: None 2024-04-16T18:17:57.657 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000015 2024-04-16T18:17:57.657 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+ray83TwQ0sIJ6Gs1ukCiD28pWc= 2024-04-16T18:17:57.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+ray83TwQ0sIJ6Gs1ukCiD28pWc='} 2024-04-16T18:17:57.664 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000118d686def50cd73-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.664 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.664 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.664 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.664 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.664 DEBUG:boto:Data: 2024-04-16T18:17:57.665 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.665 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.665 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.665 DEBUG:boto:Params: {} 2024-04-16T18:17:57.665 DEBUG:boto:Token: None 2024-04-16T18:17:57.665 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.665 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.668 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092064ebef020e189-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.668 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:57.668 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:57.668 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.668 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:57.668 DEBUG:boto:Data: 2024-04-16T18:17:57.668 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.668 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.668 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.669 DEBUG:boto:Params: {} 2024-04-16T18:17:57.669 DEBUG:boto:Token: None 2024-04-16T18:17:57.669 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:57.669 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ypVfJW4NYXjUp3ZhTrFaq3n0yyI= 2024-04-16T18:17:57.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ypVfJW4NYXjUp3ZhTrFaq3n0yyI='} 2024-04-16T18:17:57.710 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bb3d4b147d25feac-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.710 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.711 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.711 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.711 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.711 DEBUG:boto:Data: 2024-04-16T18:17:57.711 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.711 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.711 DEBUG:boto:Params: {} 2024-04-16T18:17:57.711 DEBUG:boto:Token: None 2024-04-16T18:17:57.711 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.714 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f62d20b940ce30c5-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.714 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:57.715 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:57.715 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.715 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:57.715 DEBUG:boto:Data: 2024-04-16T18:17:57.715 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.715 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.715 DEBUG:boto:Params: {} 2024-04-16T18:17:57.715 DEBUG:boto:Token: None 2024-04-16T18:17:57.715 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:57.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YRVnmX+mqKwsMtFRfbOoPrYgKTs= 2024-04-16T18:17:57.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YRVnmX+mqKwsMtFRfbOoPrYgKTs='} 2024-04-16T18:17:57.722 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ba823d1c8eee0c3c-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.722 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.722 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.722 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.722 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.722 DEBUG:boto:Data: 2024-04-16T18:17:57.722 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.722 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.723 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.723 DEBUG:boto:Params: {} 2024-04-16T18:17:57.723 DEBUG:boto:Token: None 2024-04-16T18:17:57.723 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.725 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000024d72980406f2815-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.726 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:57.726 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:57.726 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.726 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:57.726 DEBUG:boto:Data: 2024-04-16T18:17:57.726 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.726 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.726 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.726 DEBUG:boto:Params: {} 2024-04-16T18:17:57.727 DEBUG:boto:Token: None 2024-04-16T18:17:57.727 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:57.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZbGTYc5Uqqydltg3yjo1icZxjMQ= 2024-04-16T18:17:57.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZbGTYc5Uqqydltg3yjo1icZxjMQ='} 2024-04-16T18:17:57.733 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000936ff76069f6462b-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.734 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.734 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.734 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.734 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.734 DEBUG:boto:Data: 2024-04-16T18:17:57.734 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.734 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.734 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.734 DEBUG:boto:Params: {} 2024-04-16T18:17:57.734 DEBUG:boto:Token: None 2024-04-16T18:17:57.735 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.737 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ad1b49d000ab84e0-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.737 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:17:57.737 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:17:57.737 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.737 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020 2024-04-16T18:17:57.738 DEBUG:boto:Data: 2024-04-16T18:17:57.738 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.738 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.738 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.738 DEBUG:boto:Params: {} 2024-04-16T18:17:57.738 DEBUG:boto:Token: None 2024-04-16T18:17:57.738 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000020 2024-04-16T18:17:57.738 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nd3MdMIUggxXI5HykD4ojmU4c1c= 2024-04-16T18:17:57.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nd3MdMIUggxXI5HykD4ojmU4c1c='} 2024-04-16T18:17:57.782 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003e5cb28d762ac8aa-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.783 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:57.783 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:57.783 DEBUG:boto:Method: HEAD 2024-04-16T18:17:57.783 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:57.783 DEBUG:boto:Data: 2024-04-16T18:17:57.783 DEBUG:boto:Headers: {} 2024-04-16T18:17:57.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.783 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.783 DEBUG:boto:Params: {} 2024-04-16T18:17:57.783 DEBUG:boto:Token: None 2024-04-16T18:17:57.784 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/ 2024-04-16T18:17:57.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg= 2024-04-16T18:17:57.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l667ZyvTGAPJRPoiWF0cRC9K2Gg=', 'Content-Length': '0'} 2024-04-16T18:17:57.786 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005b8cd0cb058da02e-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.787 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:57.787 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:57.787 DEBUG:boto:Method: PUT 2024-04-16T18:17:57.787 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:57.788 DEBUG:boto:Data: 2024-04-16T18:17:57.788 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:57.788 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:57.788 DEBUG:boto:Port: 8000 2024-04-16T18:17:57.788 DEBUG:boto:Params: {} 2024-04-16T18:17:57.789 DEBUG:boto:Token: None 2024-04-16T18:17:57.789 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:57 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:57.789 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lvUeR6zmE8f4/A/Ru/LVk1MSHAw= 2024-04-16T18:17:57.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:57 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lvUeR6zmE8f4/A/Ru/LVk1MSHAw='} 2024-04-16T18:17:57.795 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003c8a8215609b5c1c-00661ec0d5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:57.795 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:57.795 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:57.795 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:17:57.846 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:57.846 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:57.912 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:17:57.912 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-51 2024-04-16T18:17:57.926 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 43 2024-04-16T18:17:57.995 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '31', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:57.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '31', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:57.995 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 31 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:58.044 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:58.113 INFO:teuthology.orchestra.run.smithi016.stdout:{"objs":["obj00000000000000000019","obj00000000000000000006","obj00000000000000000467","obj00000000000000000005","obj00000000000000000056","obj00000000000000000004","obj00000000000000000023","obj00000000000000000317","obj00000000000000000022","obj00000000000000000000","obj00000000000000000021","obj00000000000000000009","obj00000000000000000271","obj00000000000000000008","obj00000000000000000018","obj00000000000000000007","obj00000000000000000017","obj00000000000000000162","obj00000000000000000016","obj00000000000000000003","obj00000000000000000423","obj00000000000000000002","obj00000000000000000012","obj00000000000000000001","obj00000000000000000011","obj00000000000000000283","obj00000000000000000010","obj00000000000000000061","obj00000000000000000050","obj00000000000000000029","obj00000000000000000133"]} 2024-04-16T18:17:58.113 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.114 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.114 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.114 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.114 DEBUG:boto:Data: 2024-04-16T18:17:58.114 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.114 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.114 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.114 DEBUG:boto:Params: {} 2024-04-16T18:17:58.114 DEBUG:boto:Token: None 2024-04-16T18:17:58.115 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.118 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006b651bf0488799c6-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.118 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:58.118 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:58.119 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.119 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:58.119 DEBUG:boto:Data: 2024-04-16T18:17:58.119 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.119 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.119 DEBUG:boto:Params: {} 2024-04-16T18:17:58.119 DEBUG:boto:Token: None 2024-04-16T18:17:58.119 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:58.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OLx9z6WpeT1/QXUb1mT/NsrmjtY= 2024-04-16T18:17:58.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OLx9z6WpeT1/QXUb1mT/NsrmjtY='} 2024-04-16T18:17:58.126 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f514b6297137b205-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.126 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.126 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.126 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.127 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.127 DEBUG:boto:Data: 2024-04-16T18:17:58.127 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.127 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.127 DEBUG:boto:Params: {} 2024-04-16T18:17:58.127 DEBUG:boto:Token: None 2024-04-16T18:17:58.127 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.130 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c92944a8c4137108-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.130 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:58.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:58.130 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.130 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:58.130 DEBUG:boto:Data: 2024-04-16T18:17:58.131 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.131 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.131 DEBUG:boto:Params: {} 2024-04-16T18:17:58.131 DEBUG:boto:Token: None 2024-04-16T18:17:58.131 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:58.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EopD+c1br3+w7gfX33GXwWo9Ivs= 2024-04-16T18:17:58.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EopD+c1br3+w7gfX33GXwWo9Ivs='} 2024-04-16T18:17:58.174 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000072aca3557d7db515-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.175 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.175 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.175 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.175 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.175 DEBUG:boto:Data: 2024-04-16T18:17:58.175 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.175 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.175 DEBUG:boto:Params: {} 2024-04-16T18:17:58.175 DEBUG:boto:Token: None 2024-04-16T18:17:58.175 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.178 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '129'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005876b37fd02bc456-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.178 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:17:58.179 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:17:58.179 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.179 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271 2024-04-16T18:17:58.179 DEBUG:boto:Data: 2024-04-16T18:17:58.179 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.179 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.179 DEBUG:boto:Params: {} 2024-04-16T18:17:58.179 DEBUG:boto:Token: None 2024-04-16T18:17:58.180 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000271 2024-04-16T18:17:58.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D8AmXmKiZC2Za93kJ7JePVjuUOA= 2024-04-16T18:17:58.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D8AmXmKiZC2Za93kJ7JePVjuUOA='} 2024-04-16T18:17:58.185 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000044f8f75b568c5ea5-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.185 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.185 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.185 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.185 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.185 DEBUG:boto:Data: 2024-04-16T18:17:58.185 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.185 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.185 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.186 DEBUG:boto:Params: {} 2024-04-16T18:17:58.186 DEBUG:boto:Token: None 2024-04-16T18:17:58.186 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.186 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.189 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '44'), ('X-RGW-Bytes-Used', '132'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000346ba1d8baef8ccb-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.189 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:17:58.189 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:17:58.189 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.189 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029 2024-04-16T18:17:58.189 DEBUG:boto:Data: 2024-04-16T18:17:58.190 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.190 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.190 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.190 DEBUG:boto:Params: {} 2024-04-16T18:17:58.190 DEBUG:boto:Token: None 2024-04-16T18:17:58.190 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000029 2024-04-16T18:17:58.190 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tztYyRMznFiQwJehHuQq00E3xPI= 2024-04-16T18:17:58.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tztYyRMznFiQwJehHuQq00E3xPI='} 2024-04-16T18:17:58.234 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003a961c99c007d1e8-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.237 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.237 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.237 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.237 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.237 DEBUG:boto:Data: 2024-04-16T18:17:58.237 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.237 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.237 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.238 DEBUG:boto:Params: {} 2024-04-16T18:17:58.238 DEBUG:boto:Token: None 2024-04-16T18:17:58.238 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.238 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.241 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d0654fde152b166b-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.241 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:58.241 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:17:58.242 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.242 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:58.242 DEBUG:boto:Data: 2024-04-16T18:17:58.242 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.242 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.242 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.242 DEBUG:boto:Params: {} 2024-04-16T18:17:58.242 DEBUG:boto:Token: None 2024-04-16T18:17:58.242 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:17:58.242 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3Wa5cpsN6xhlBTh3evBizKhmgMY= 2024-04-16T18:17:58.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3Wa5cpsN6xhlBTh3evBizKhmgMY='} 2024-04-16T18:17:58.249 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000419d9e241f7d6c4e-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.249 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.249 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.249 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.249 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.249 DEBUG:boto:Data: 2024-04-16T18:17:58.249 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.249 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.250 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.250 DEBUG:boto:Params: {} 2024-04-16T18:17:58.250 DEBUG:boto:Token: None 2024-04-16T18:17:58.250 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.250 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.253 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '135'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000038457295cdb69e60-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.253 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:17:58.253 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:17:58.253 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.253 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023 2024-04-16T18:17:58.253 DEBUG:boto:Data: 2024-04-16T18:17:58.254 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.254 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.254 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.254 DEBUG:boto:Params: {} 2024-04-16T18:17:58.254 DEBUG:boto:Token: None 2024-04-16T18:17:58.254 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000023 2024-04-16T18:17:58.254 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L/4FG9KFTs83er98YHn4FzXK4Js= 2024-04-16T18:17:58.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L/4FG9KFTs83er98YHn4FzXK4Js='} 2024-04-16T18:17:58.259 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000202265dae410e4ea-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.259 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.259 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.259 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.260 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.260 DEBUG:boto:Data: 2024-04-16T18:17:58.260 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.260 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.260 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.260 DEBUG:boto:Params: {} 2024-04-16T18:17:58.260 DEBUG:boto:Token: None 2024-04-16T18:17:58.260 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.263 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000154d811d5179c287-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.263 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:17:58.264 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:17:58.264 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.264 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050 2024-04-16T18:17:58.264 DEBUG:boto:Data: 2024-04-16T18:17:58.264 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.264 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.264 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.264 DEBUG:boto:Params: {} 2024-04-16T18:17:58.264 DEBUG:boto:Token: None 2024-04-16T18:17:58.264 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000050 2024-04-16T18:17:58.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MlepvFAuKOA2+oos5QkhLq8F/Ug= 2024-04-16T18:17:58.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MlepvFAuKOA2+oos5QkhLq8F/Ug='} 2024-04-16T18:17:58.306 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002d5595926647e5a5-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.307 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.307 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.307 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.307 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.307 DEBUG:boto:Data: 2024-04-16T18:17:58.307 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.307 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.307 DEBUG:boto:Params: {} 2024-04-16T18:17:58.307 DEBUG:boto:Token: None 2024-04-16T18:17:58.308 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.310 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000475c52985ef4f7ba-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.311 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:58.311 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:17:58.311 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.311 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:58.311 DEBUG:boto:Data: 2024-04-16T18:17:58.311 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.311 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.311 DEBUG:boto:Params: {} 2024-04-16T18:17:58.311 DEBUG:boto:Token: None 2024-04-16T18:17:58.312 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:17:58.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pWPbWzQvmw8cSZsm6TG0r3SHBZg= 2024-04-16T18:17:58.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pWPbWzQvmw8cSZsm6TG0r3SHBZg='} 2024-04-16T18:17:58.318 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000be345f8ac80a8f78-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.318 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.318 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.318 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.318 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.319 DEBUG:boto:Data: 2024-04-16T18:17:58.319 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.319 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.319 DEBUG:boto:Params: {} 2024-04-16T18:17:58.319 DEBUG:boto:Token: None 2024-04-16T18:17:58.319 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f443a2ef38046e6-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.322 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:17:58.322 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:17:58.323 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.323 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133 2024-04-16T18:17:58.323 DEBUG:boto:Data: 2024-04-16T18:17:58.323 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.323 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.323 DEBUG:boto:Params: {} 2024-04-16T18:17:58.323 DEBUG:boto:Token: None 2024-04-16T18:17:58.323 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000133 2024-04-16T18:17:58.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t0MjQBQYvYUMbQc1Mxmskc81uUA= 2024-04-16T18:17:58.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t0MjQBQYvYUMbQc1Mxmskc81uUA='} 2024-04-16T18:17:58.366 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001544c528d6c55051-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.366 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.367 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.367 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.367 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.367 DEBUG:boto:Data: 2024-04-16T18:17:58.367 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.367 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.367 DEBUG:boto:Params: {} 2024-04-16T18:17:58.367 DEBUG:boto:Token: None 2024-04-16T18:17:58.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.370 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000994bf2d92d3be828-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:58.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:17:58.371 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.371 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:58.371 DEBUG:boto:Data: 2024-04-16T18:17:58.371 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.371 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.371 DEBUG:boto:Params: {} 2024-04-16T18:17:58.371 DEBUG:boto:Token: None 2024-04-16T18:17:58.371 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:17:58.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B2ei6m46aYlydQl+3PkN3DMp96g= 2024-04-16T18:17:58.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B2ei6m46aYlydQl+3PkN3DMp96g='} 2024-04-16T18:17:58.378 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000017f7a65e27b8cd0d-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.378 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.378 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.379 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.379 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.379 DEBUG:boto:Data: 2024-04-16T18:17:58.379 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.379 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.379 DEBUG:boto:Params: {} 2024-04-16T18:17:58.379 DEBUG:boto:Token: None 2024-04-16T18:17:58.380 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.382 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005dbff78fd52da662-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.383 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:58.383 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:17:58.383 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.383 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:58.383 DEBUG:boto:Data: 2024-04-16T18:17:58.383 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.383 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.383 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.383 DEBUG:boto:Params: {} 2024-04-16T18:17:58.384 DEBUG:boto:Token: None 2024-04-16T18:17:58.384 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:17:58.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gXDHQL6T06bkpVGU2xCyqq7q3cA= 2024-04-16T18:17:58.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gXDHQL6T06bkpVGU2xCyqq7q3cA='} 2024-04-16T18:17:58.426 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a30ee57741bcedd7-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.427 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.427 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.427 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.427 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.427 DEBUG:boto:Data: 2024-04-16T18:17:58.427 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.427 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.427 DEBUG:boto:Params: {} 2024-04-16T18:17:58.427 DEBUG:boto:Token: None 2024-04-16T18:17:58.428 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.430 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f99dd5f36c1f4510-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.430 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:17:58.431 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:17:58.431 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.431 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017 2024-04-16T18:17:58.431 DEBUG:boto:Data: 2024-04-16T18:17:58.431 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.431 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.431 DEBUG:boto:Params: {} 2024-04-16T18:17:58.431 DEBUG:boto:Token: None 2024-04-16T18:17:58.431 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000017 2024-04-16T18:17:58.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wuhbl31Vn2bRzaHTTk+Dk0GeUxU= 2024-04-16T18:17:58.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wuhbl31Vn2bRzaHTTk+Dk0GeUxU='} 2024-04-16T18:17:58.438 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e6c3d4cd6a846abe-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.438 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.438 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.438 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.438 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.438 DEBUG:boto:Data: 2024-04-16T18:17:58.439 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.439 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.439 DEBUG:boto:Params: {} 2024-04-16T18:17:58.439 DEBUG:boto:Token: None 2024-04-16T18:17:58.439 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.442 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '141'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003ae2a1eafe5ecea0-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.442 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:17:58.442 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:17:58.442 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.442 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423 2024-04-16T18:17:58.442 DEBUG:boto:Data: 2024-04-16T18:17:58.442 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.443 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.443 DEBUG:boto:Params: {} 2024-04-16T18:17:58.443 DEBUG:boto:Token: None 2024-04-16T18:17:58.443 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000423 2024-04-16T18:17:58.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b7T3xYyyLmMSwNbYORKs3NV8jNY= 2024-04-16T18:17:58.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b7T3xYyyLmMSwNbYORKs3NV8jNY='} 2024-04-16T18:17:58.449 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009e490b00a1c11f31-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.449 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.449 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.449 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.449 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.449 DEBUG:boto:Data: 2024-04-16T18:17:58.449 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.449 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.449 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.450 DEBUG:boto:Params: {} 2024-04-16T18:17:58.450 DEBUG:boto:Token: None 2024-04-16T18:17:58.450 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.450 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.452 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000057dd39059a21accf-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.453 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:58.453 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:17:58.453 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.453 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:58.453 DEBUG:boto:Data: 2024-04-16T18:17:58.453 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.453 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.453 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.453 DEBUG:boto:Params: {} 2024-04-16T18:17:58.454 DEBUG:boto:Token: None 2024-04-16T18:17:58.454 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:17:58.454 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fxwuD+VV6mIiH9q+CoVMOUXr+0E= 2024-04-16T18:17:58.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fxwuD+VV6mIiH9q+CoVMOUXr+0E='} 2024-04-16T18:17:58.498 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000053ab50c0d9dc07b-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.499 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.499 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.499 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.499 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.499 DEBUG:boto:Data: 2024-04-16T18:17:58.499 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.499 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.499 DEBUG:boto:Params: {} 2024-04-16T18:17:58.499 DEBUG:boto:Token: None 2024-04-16T18:17:58.500 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.502 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d1c044f504e0b575-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.503 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:17:58.503 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:17:58.503 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.503 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283 2024-04-16T18:17:58.503 DEBUG:boto:Data: 2024-04-16T18:17:58.503 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.503 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.504 DEBUG:boto:Params: {} 2024-04-16T18:17:58.504 DEBUG:boto:Token: None 2024-04-16T18:17:58.504 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000283 2024-04-16T18:17:58.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DdiRat5rLe+Z2F6PjnqGbwGOxjk= 2024-04-16T18:17:58.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DdiRat5rLe+Z2F6PjnqGbwGOxjk='} 2024-04-16T18:17:58.509 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f42846c52fdf522b-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.509 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.509 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.509 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.509 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.509 DEBUG:boto:Data: 2024-04-16T18:17:58.509 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.509 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.510 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.510 DEBUG:boto:Params: {} 2024-04-16T18:17:58.510 DEBUG:boto:Token: None 2024-04-16T18:17:58.510 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.513 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d3dd6657096183f4-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.513 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:58.513 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:58.513 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.513 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:58.513 DEBUG:boto:Data: 2024-04-16T18:17:58.513 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.513 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.514 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.514 DEBUG:boto:Params: {} 2024-04-16T18:17:58.514 DEBUG:boto:Token: None 2024-04-16T18:17:58.514 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:58.514 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zXC2r2PPCxsO/T7Ia6hvS18iL5Q= 2024-04-16T18:17:58.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zXC2r2PPCxsO/T7Ia6hvS18iL5Q='} 2024-04-16T18:17:58.558 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000099ea69fff2030d6b-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.559 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.559 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.559 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.559 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.559 DEBUG:boto:Data: 2024-04-16T18:17:58.559 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.559 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.559 DEBUG:boto:Params: {} 2024-04-16T18:17:58.559 DEBUG:boto:Token: None 2024-04-16T18:17:58.560 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.562 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d589e54eca37215c-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.563 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:58.563 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:58.563 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.563 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:58.563 DEBUG:boto:Data: 2024-04-16T18:17:58.563 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.563 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.564 DEBUG:boto:Params: {} 2024-04-16T18:17:58.564 DEBUG:boto:Token: None 2024-04-16T18:17:58.564 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:58.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EamjaoAcGq0oceI8gNGYSfsiTG8= 2024-04-16T18:17:58.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EamjaoAcGq0oceI8gNGYSfsiTG8='} 2024-04-16T18:17:58.570 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e23d489341ddedb0-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.571 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.571 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.571 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.571 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.571 DEBUG:boto:Data: 2024-04-16T18:17:58.571 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.571 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.571 DEBUG:boto:Params: {} 2024-04-16T18:17:58.572 DEBUG:boto:Token: None 2024-04-16T18:17:58.572 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.575 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002f7c9292790409da-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.575 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:58.575 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:58.575 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.575 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:58.575 DEBUG:boto:Data: 2024-04-16T18:17:58.576 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.576 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.576 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.576 DEBUG:boto:Params: {} 2024-04-16T18:17:58.576 DEBUG:boto:Token: None 2024-04-16T18:17:58.576 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:58.577 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MxcppaZjm2M+5IBde/X7mZDeXe0= 2024-04-16T18:17:58.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MxcppaZjm2M+5IBde/X7mZDeXe0='} 2024-04-16T18:17:58.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:17:58.618 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005cafc9343ec76c58-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.618 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.619 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.619 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.619 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.619 DEBUG:boto:Data: 2024-04-16T18:17:58.619 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.619 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.619 DEBUG:boto:Params: {} 2024-04-16T18:17:58.619 DEBUG:boto:Token: None 2024-04-16T18:17:58.619 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.622 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000035d23f14a50e73ed-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.622 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:58.623 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:58.623 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.623 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:58.623 DEBUG:boto:Data: 2024-04-16T18:17:58.623 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.623 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.623 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.623 DEBUG:boto:Params: {} 2024-04-16T18:17:58.623 DEBUG:boto:Token: None 2024-04-16T18:17:58.623 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:58.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5cyP48S9Alov47E1sN3GgGYDxGY= 2024-04-16T18:17:58.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5cyP48S9Alov47E1sN3GgGYDxGY='} 2024-04-16T18:17:58.630 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c0bf1fc284830beb-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.630 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.630 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.630 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.630 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.631 DEBUG:boto:Data: 2024-04-16T18:17:58.631 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.631 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.631 DEBUG:boto:Params: {} 2024-04-16T18:17:58.631 DEBUG:boto:Token: None 2024-04-16T18:17:58.631 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.634 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '49'), ('X-RGW-Bytes-Used', '147'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000023ea71ac59f087da-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.634 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:17:58.634 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:17:58.634 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.634 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317 2024-04-16T18:17:58.634 DEBUG:boto:Data: 2024-04-16T18:17:58.635 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.635 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.635 DEBUG:boto:Params: {} 2024-04-16T18:17:58.635 DEBUG:boto:Token: None 2024-04-16T18:17:58.635 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000317 2024-04-16T18:17:58.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0Bw4SoYAFtj+R/NOeqq0A4LH/4= 2024-04-16T18:17:58.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0Bw4SoYAFtj+R/NOeqq0A4LH/4='} 2024-04-16T18:17:58.678 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a6ab84f1f2c0d5b-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.678 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.679 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.679 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.679 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.679 DEBUG:boto:Data: 2024-04-16T18:17:58.679 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.679 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.679 DEBUG:boto:Params: {} 2024-04-16T18:17:58.679 DEBUG:boto:Token: None 2024-04-16T18:17:58.679 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.682 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '50'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ac977acc67a2e2d6-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.682 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:58.682 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:58.683 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.683 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:58.683 DEBUG:boto:Data: 2024-04-16T18:17:58.683 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.683 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.683 DEBUG:boto:Params: {} 2024-04-16T18:17:58.683 DEBUG:boto:Token: None 2024-04-16T18:17:58.683 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:58.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VCQQIrgN70a4JqFqd4v2o7mUUYk= 2024-04-16T18:17:58.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VCQQIrgN70a4JqFqd4v2o7mUUYk='} 2024-04-16T18:17:58.689 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d45630c07be0036f-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.690 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.690 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.690 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.690 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.690 DEBUG:boto:Data: 2024-04-16T18:17:58.690 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.690 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.690 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.690 DEBUG:boto:Params: {} 2024-04-16T18:17:58.691 DEBUG:boto:Token: None 2024-04-16T18:17:58.691 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.693 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '50'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006dc6d01977f6ecb7-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.694 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:17:58.694 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:17:58.694 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.694 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018 2024-04-16T18:17:58.694 DEBUG:boto:Data: 2024-04-16T18:17:58.694 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.694 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.694 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.694 DEBUG:boto:Params: {} 2024-04-16T18:17:58.695 DEBUG:boto:Token: None 2024-04-16T18:17:58.695 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000018 2024-04-16T18:17:58.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V5QgmD4tFh8Cc8nYC/jmYJs1HG4= 2024-04-16T18:17:58.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V5QgmD4tFh8Cc8nYC/jmYJs1HG4='} 2024-04-16T18:17:58.700 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000050534b37d792bf2d-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.700 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.700 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.700 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.700 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.701 DEBUG:boto:Data: 2024-04-16T18:17:58.701 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.701 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.701 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.701 DEBUG:boto:Params: {} 2024-04-16T18:17:58.701 DEBUG:boto:Token: None 2024-04-16T18:17:58.701 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.701 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.704 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '51'), ('X-RGW-Bytes-Used', '153'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d3fe7bd080f02df-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.704 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:17:58.704 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:17:58.704 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.704 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061 2024-04-16T18:17:58.705 DEBUG:boto:Data: 2024-04-16T18:17:58.705 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.705 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.705 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.705 DEBUG:boto:Params: {} 2024-04-16T18:17:58.705 DEBUG:boto:Token: None 2024-04-16T18:17:58.705 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000061 2024-04-16T18:17:58.705 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Bl2XLLaBmb8IL0KdGNqY36XAKKM= 2024-04-16T18:17:58.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Bl2XLLaBmb8IL0KdGNqY36XAKKM='} 2024-04-16T18:17:58.750 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006d876eda76e19340-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.750 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.751 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.751 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.751 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.751 DEBUG:boto:Data: 2024-04-16T18:17:58.751 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.751 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.751 DEBUG:boto:Params: {} 2024-04-16T18:17:58.751 DEBUG:boto:Token: None 2024-04-16T18:17:58.751 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.754 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '52'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000043db1ad93c1419ec-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.754 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:17:58.754 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:17:58.755 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.755 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008 2024-04-16T18:17:58.755 DEBUG:boto:Data: 2024-04-16T18:17:58.755 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.755 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.755 DEBUG:boto:Params: {} 2024-04-16T18:17:58.755 DEBUG:boto:Token: None 2024-04-16T18:17:58.755 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000008 2024-04-16T18:17:58.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iAbeCZ7SWcc3TAY/+O+Y/B875Gg= 2024-04-16T18:17:58.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iAbeCZ7SWcc3TAY/+O+Y/B875Gg='} 2024-04-16T18:17:58.763 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009134b1f1f04ca670-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.763 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.763 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.763 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.763 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.763 DEBUG:boto:Data: 2024-04-16T18:17:58.763 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.764 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.764 DEBUG:boto:Params: {} 2024-04-16T18:17:58.764 DEBUG:boto:Token: None 2024-04-16T18:17:58.764 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.766 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '52'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cc4340cef59e0ad8-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.767 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:17:58.767 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:17:58.767 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.767 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022 2024-04-16T18:17:58.767 DEBUG:boto:Data: 2024-04-16T18:17:58.767 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.767 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.767 DEBUG:boto:Params: {} 2024-04-16T18:17:58.767 DEBUG:boto:Token: None 2024-04-16T18:17:58.768 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000022 2024-04-16T18:17:58.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h4v1i6tDcoHIuXh/3qojrfe6SfQ= 2024-04-16T18:17:58.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h4v1i6tDcoHIuXh/3qojrfe6SfQ='} 2024-04-16T18:17:58.810 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ba1b2ae232cf190f-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.811 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.811 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.811 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.811 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.811 DEBUG:boto:Data: 2024-04-16T18:17:58.811 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.811 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.811 DEBUG:boto:Params: {} 2024-04-16T18:17:58.811 DEBUG:boto:Token: None 2024-04-16T18:17:58.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.814 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '52'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002b2a4f96a0f5b493-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.815 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:58.815 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:58.815 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.815 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:58.815 DEBUG:boto:Data: 2024-04-16T18:17:58.815 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.816 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.816 DEBUG:boto:Params: {} 2024-04-16T18:17:58.816 DEBUG:boto:Token: None 2024-04-16T18:17:58.816 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:58.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HvXIrHaUxEV/XDEy/XMYaoiRMZ0= 2024-04-16T18:17:58.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HvXIrHaUxEV/XDEy/XMYaoiRMZ0='} 2024-04-16T18:17:58.822 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d7a470997b2a868d-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.823 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.823 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.823 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.823 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.823 DEBUG:boto:Data: 2024-04-16T18:17:58.823 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.823 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.823 DEBUG:boto:Params: {} 2024-04-16T18:17:58.823 DEBUG:boto:Token: None 2024-04-16T18:17:58.824 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.826 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '52'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e587bfbbd05e1c45-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.826 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:17:58.826 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:17:58.826 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.827 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056 2024-04-16T18:17:58.827 DEBUG:boto:Data: 2024-04-16T18:17:58.827 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.827 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.827 DEBUG:boto:Params: {} 2024-04-16T18:17:58.827 DEBUG:boto:Token: None 2024-04-16T18:17:58.827 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000056 2024-04-16T18:17:58.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kuq7w0N5S/5GVlUF0Pe2y9JoWgM= 2024-04-16T18:17:58.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kuq7w0N5S/5GVlUF0Pe2y9JoWgM='} 2024-04-16T18:17:58.870 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009dbb3a78670cfdaa-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.871 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:58.871 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:58.871 DEBUG:boto:Method: HEAD 2024-04-16T18:17:58.871 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:58.871 DEBUG:boto:Data: 2024-04-16T18:17:58.871 DEBUG:boto:Headers: {} 2024-04-16T18:17:58.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.871 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.871 DEBUG:boto:Params: {} 2024-04-16T18:17:58.871 DEBUG:boto:Token: None 2024-04-16T18:17:58.872 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/ 2024-04-16T18:17:58.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA= 2024-04-16T18:17:58.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d09F9ChbqNsffx+THT9f/bLdXlA=', 'Content-Length': '0'} 2024-04-16T18:17:58.874 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '53'), ('X-RGW-Bytes-Used', '159'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002ec5b633b163b8a8-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.875 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:17:58.875 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:17:58.875 DEBUG:boto:Method: PUT 2024-04-16T18:17:58.875 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162 2024-04-16T18:17:58.875 DEBUG:boto:Data: 2024-04-16T18:17:58.875 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:58.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:58.875 DEBUG:boto:Port: 8000 2024-04-16T18:17:58.875 DEBUG:boto:Params: {} 2024-04-16T18:17:58.876 DEBUG:boto:Token: None 2024-04-16T18:17:58.876 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:58 GMT /cjqttm-51/obj00000000000000000162 2024-04-16T18:17:58.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KEkWup/ku5ZOp0xd5DwKIbky2OM= 2024-04-16T18:17:58.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KEkWup/ku5ZOp0xd5DwKIbky2OM='} 2024-04-16T18:17:58.881 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d155f6bc001eed8e-00661ec0d6-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:58.881 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:58.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:17:58.881 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:17:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:58.932 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:58.998 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:17:58.998 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-51 2024-04-16T18:17:59.011 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 54 2024-04-16T18:17:59.086 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:59.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'shard', 'objects', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--num-shards', '37', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:17:59.086 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket shard objects --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --num-shards 37 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:17:59.136 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:17:59.137 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:17:59.207 INFO:teuthology.orchestra.run.smithi016.stdout:{"objs":["obj00000000000000000060","obj00000000000000000000","obj00000000000000000011","obj00000000000000000001","obj00000000000000000033","obj00000000000000000065","obj00000000000000000005","obj00000000000000000016","obj00000000000000000048","obj00000000000000000015","obj00000000000000000026","obj00000000000000000030","obj00000000000000000062","obj00000000000000000009","obj00000000000000000040","obj00000000000000000024","obj00000000000000000012","obj00000000000000000002","obj00000000000000000013","obj00000000000000000045","obj00000000000000000006","obj00000000000000000017","obj00000000000000000007","obj00000000000000000039","obj00000000000000000027","obj00000000000000000010","obj00000000000000000021","obj00000000000000000053","obj00000000000000000020","obj00000000000000000004","obj00000000000000000036","obj00000000000000000003","obj00000000000000000014","obj00000000000000000019","obj00000000000000000057","obj00000000000000000018","obj00000000000000000008"]} 2024-04-16T18:17:59.207 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.207 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.207 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.207 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.207 DEBUG:boto:Data: 2024-04-16T18:17:59.207 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.208 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.208 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.208 DEBUG:boto:Params: {} 2024-04-16T18:17:59.208 DEBUG:boto:Token: None 2024-04-16T18:17:59.208 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.211 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ae7158e66d680b6-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.211 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:59.212 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:17:59.212 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.212 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:59.212 DEBUG:boto:Data: 2024-04-16T18:17:59.212 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.212 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.212 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.212 DEBUG:boto:Params: {} 2024-04-16T18:17:59.212 DEBUG:boto:Token: None 2024-04-16T18:17:59.212 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:17:59.213 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W9d8FGwQ56O0zxAl1rv4hmuRc5I= 2024-04-16T18:17:59.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W9d8FGwQ56O0zxAl1rv4hmuRc5I='} 2024-04-16T18:17:59.254 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000067fbe3c6f4605f6d-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.255 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.255 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.255 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.255 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.255 DEBUG:boto:Data: 2024-04-16T18:17:59.255 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.255 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.255 DEBUG:boto:Params: {} 2024-04-16T18:17:59.255 DEBUG:boto:Token: None 2024-04-16T18:17:59.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.259 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b2b47755013dc210-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.259 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:59.259 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:17:59.259 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.259 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:59.259 DEBUG:boto:Data: 2024-04-16T18:17:59.259 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.259 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.260 DEBUG:boto:Params: {} 2024-04-16T18:17:59.260 DEBUG:boto:Token: None 2024-04-16T18:17:59.260 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:17:59.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ii332BRbSzsdyRe0GXw4UjuJ4+o= 2024-04-16T18:17:59.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ii332BRbSzsdyRe0GXw4UjuJ4+o='} 2024-04-16T18:17:59.266 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005db1e4301d322e39-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.266 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.267 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.267 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.267 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.267 DEBUG:boto:Data: 2024-04-16T18:17:59.267 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.267 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.267 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.267 DEBUG:boto:Params: {} 2024-04-16T18:17:59.267 DEBUG:boto:Token: None 2024-04-16T18:17:59.267 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.270 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fce5740e84bacd3b-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.270 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:17:59.271 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:17:59.271 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.271 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017 2024-04-16T18:17:59.271 DEBUG:boto:Data: 2024-04-16T18:17:59.271 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.271 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.271 DEBUG:boto:Params: {} 2024-04-16T18:17:59.271 DEBUG:boto:Token: None 2024-04-16T18:17:59.271 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000017 2024-04-16T18:17:59.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H6N3oYgzkH86HDhaZw43uUiR3O8= 2024-04-16T18:17:59.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H6N3oYgzkH86HDhaZw43uUiR3O8='} 2024-04-16T18:17:59.314 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000610fe1cdaf2519b4-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.315 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.315 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.315 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.315 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.315 DEBUG:boto:Data: 2024-04-16T18:17:59.315 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.315 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.315 DEBUG:boto:Params: {} 2024-04-16T18:17:59.315 DEBUG:boto:Token: None 2024-04-16T18:17:59.316 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.319 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000013258c033f8098cd-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.319 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:17:59.319 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:17:59.319 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.319 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040 2024-04-16T18:17:59.319 DEBUG:boto:Data: 2024-04-16T18:17:59.319 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.320 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.320 DEBUG:boto:Params: {} 2024-04-16T18:17:59.320 DEBUG:boto:Token: None 2024-04-16T18:17:59.320 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000040 2024-04-16T18:17:59.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iKxBqL+xzmlKkzKKp5+qDOgKbJg= 2024-04-16T18:17:59.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iKxBqL+xzmlKkzKKp5+qDOgKbJg='} 2024-04-16T18:17:59.326 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000073bf92c8fd7f0812-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.326 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.327 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.327 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.327 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.327 DEBUG:boto:Data: 2024-04-16T18:17:59.327 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.327 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.327 DEBUG:boto:Params: {} 2024-04-16T18:17:59.327 DEBUG:boto:Token: None 2024-04-16T18:17:59.327 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.330 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f9aae6fa9f9cc62-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.330 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:17:59.331 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:17:59.331 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.331 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045 2024-04-16T18:17:59.331 DEBUG:boto:Data: 2024-04-16T18:17:59.331 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.331 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.331 DEBUG:boto:Params: {} 2024-04-16T18:17:59.331 DEBUG:boto:Token: None 2024-04-16T18:17:59.331 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000045 2024-04-16T18:17:59.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ipY+Ia5sgidWrB/YPK6lrtgImYY= 2024-04-16T18:17:59.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ipY+Ia5sgidWrB/YPK6lrtgImYY='} 2024-04-16T18:17:59.374 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001e566e6b7f7d4e57-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.375 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.375 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.375 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.375 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.375 DEBUG:boto:Data: 2024-04-16T18:17:59.375 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.375 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.375 DEBUG:boto:Params: {} 2024-04-16T18:17:59.375 DEBUG:boto:Token: None 2024-04-16T18:17:59.376 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.376 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.378 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '54'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000048468d1ffe9d7bfb-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.379 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:17:59.379 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:17:59.379 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.379 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057 2024-04-16T18:17:59.379 DEBUG:boto:Data: 2024-04-16T18:17:59.379 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.379 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.379 DEBUG:boto:Params: {} 2024-04-16T18:17:59.380 DEBUG:boto:Token: None 2024-04-16T18:17:59.380 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000057 2024-04-16T18:17:59.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CF+pbTIfJVQ8ur5KkZLIye3CNIg= 2024-04-16T18:17:59.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CF+pbTIfJVQ8ur5KkZLIye3CNIg='} 2024-04-16T18:17:59.385 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000061c284bacc2903d-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.385 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.385 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.386 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.386 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.386 DEBUG:boto:Data: 2024-04-16T18:17:59.386 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.386 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.386 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.386 DEBUG:boto:Params: {} 2024-04-16T18:17:59.386 DEBUG:boto:Token: None 2024-04-16T18:17:59.386 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.389 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d238b8594abe7e7e-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.389 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:59.389 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:17:59.390 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.390 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:59.390 DEBUG:boto:Data: 2024-04-16T18:17:59.390 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.390 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.390 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.390 DEBUG:boto:Params: {} 2024-04-16T18:17:59.390 DEBUG:boto:Token: None 2024-04-16T18:17:59.390 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:17:59.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZRQh43tp+sQyBCrkZ980UsP7bCg= 2024-04-16T18:17:59.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZRQh43tp+sQyBCrkZ980UsP7bCg='} 2024-04-16T18:17:59.434 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dc0e48826b3f2f6e-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.435 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.435 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.435 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.435 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.435 DEBUG:boto:Data: 2024-04-16T18:17:59.435 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.435 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.435 DEBUG:boto:Params: {} 2024-04-16T18:17:59.435 DEBUG:boto:Token: None 2024-04-16T18:17:59.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.438 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d237ce98d2dd6b58-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.439 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:17:59.439 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:17:59.439 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.439 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033 2024-04-16T18:17:59.439 DEBUG:boto:Data: 2024-04-16T18:17:59.439 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.439 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.439 DEBUG:boto:Params: {} 2024-04-16T18:17:59.439 DEBUG:boto:Token: None 2024-04-16T18:17:59.440 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000033 2024-04-16T18:17:59.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ri/xQsC4DHBV1XlEYuMfxYTFFac= 2024-04-16T18:17:59.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ri/xQsC4DHBV1XlEYuMfxYTFFac='} 2024-04-16T18:17:59.446 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003e0dc5d87c39bd07-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.446 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.447 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.447 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.447 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.447 DEBUG:boto:Data: 2024-04-16T18:17:59.447 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.447 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.447 DEBUG:boto:Params: {} 2024-04-16T18:17:59.447 DEBUG:boto:Token: None 2024-04-16T18:17:59.447 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.450 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae6146582f201d7e-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.450 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:59.451 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:17:59.451 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.451 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:59.451 DEBUG:boto:Data: 2024-04-16T18:17:59.451 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.451 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.451 DEBUG:boto:Params: {} 2024-04-16T18:17:59.451 DEBUG:boto:Token: None 2024-04-16T18:17:59.452 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:17:59.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:toSF7nBHaCmOWy8m7Ihuw1TGEj8= 2024-04-16T18:17:59.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:toSF7nBHaCmOWy8m7Ihuw1TGEj8='} 2024-04-16T18:17:59.494 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006e99e3db3816a7fe-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.495 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.495 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.495 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.495 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.495 DEBUG:boto:Data: 2024-04-16T18:17:59.495 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.495 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.495 DEBUG:boto:Params: {} 2024-04-16T18:17:59.496 DEBUG:boto:Token: None 2024-04-16T18:17:59.496 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.499 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '55'), ('X-RGW-Bytes-Used', '165'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a2f8c683e98160dd-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.499 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:17:59.499 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:17:59.499 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.499 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065 2024-04-16T18:17:59.499 DEBUG:boto:Data: 2024-04-16T18:17:59.499 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.500 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.500 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.500 DEBUG:boto:Params: {} 2024-04-16T18:17:59.500 DEBUG:boto:Token: None 2024-04-16T18:17:59.500 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000065 2024-04-16T18:17:59.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4X7DU7kL5rBIAyPcd2Vxuw9nH5I= 2024-04-16T18:17:59.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4X7DU7kL5rBIAyPcd2Vxuw9nH5I='} 2024-04-16T18:17:59.506 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000039b447c9eed9dce0-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.506 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.506 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.506 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.506 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.506 DEBUG:boto:Data: 2024-04-16T18:17:59.506 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.506 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.507 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.507 DEBUG:boto:Params: {} 2024-04-16T18:17:59.507 DEBUG:boto:Token: None 2024-04-16T18:17:59.507 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.507 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.510 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f75de3628c8e3a5-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.510 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:59.510 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:17:59.510 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.510 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:59.510 DEBUG:boto:Data: 2024-04-16T18:17:59.510 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.511 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.511 DEBUG:boto:Params: {} 2024-04-16T18:17:59.511 DEBUG:boto:Token: None 2024-04-16T18:17:59.511 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:17:59.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fNjAOz9/fcm9ZOnkL/Kb0VEgx/s= 2024-04-16T18:17:59.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fNjAOz9/fcm9ZOnkL/Kb0VEgx/s='} 2024-04-16T18:17:59.554 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009a3a872e081a0709-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.555 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.555 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.555 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.555 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.555 DEBUG:boto:Data: 2024-04-16T18:17:59.555 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.555 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.555 DEBUG:boto:Params: {} 2024-04-16T18:17:59.555 DEBUG:boto:Token: None 2024-04-16T18:17:59.556 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.559 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b6049faa7b0d2ead-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.559 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:17:59.559 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:17:59.559 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.559 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024 2024-04-16T18:17:59.560 DEBUG:boto:Data: 2024-04-16T18:17:59.560 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.560 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.560 DEBUG:boto:Params: {} 2024-04-16T18:17:59.560 DEBUG:boto:Token: None 2024-04-16T18:17:59.560 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000024 2024-04-16T18:17:59.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7b99LWFUbhXMldVwGZErtSvBLs8= 2024-04-16T18:17:59.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7b99LWFUbhXMldVwGZErtSvBLs8='} 2024-04-16T18:17:59.566 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000def42c866561278f-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.567 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.567 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.567 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.567 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.567 DEBUG:boto:Data: 2024-04-16T18:17:59.567 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.567 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.567 DEBUG:boto:Params: {} 2024-04-16T18:17:59.567 DEBUG:boto:Token: None 2024-04-16T18:17:59.567 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.570 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009776532bd4c5f59f-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.571 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:59.571 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:17:59.571 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.571 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:59.571 DEBUG:boto:Data: 2024-04-16T18:17:59.571 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.571 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.572 DEBUG:boto:Params: {} 2024-04-16T18:17:59.572 DEBUG:boto:Token: None 2024-04-16T18:17:59.572 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:17:59.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jw0GZPm0n+M5PSYZP4s1Wm4ifQA= 2024-04-16T18:17:59.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jw0GZPm0n+M5PSYZP4s1Wm4ifQA='} 2024-04-16T18:17:59.614 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002a9909f0a053a002-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.615 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.615 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.615 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.615 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.615 DEBUG:boto:Data: 2024-04-16T18:17:59.615 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.615 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.616 DEBUG:boto:Params: {} 2024-04-16T18:17:59.616 DEBUG:boto:Token: None 2024-04-16T18:17:59.616 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.619 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '56'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000749a52a1ace64707-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.619 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:17:59.619 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:17:59.620 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.620 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036 2024-04-16T18:17:59.620 DEBUG:boto:Data: 2024-04-16T18:17:59.620 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.620 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.620 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.620 DEBUG:boto:Params: {} 2024-04-16T18:17:59.620 DEBUG:boto:Token: None 2024-04-16T18:17:59.620 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000036 2024-04-16T18:17:59.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y2n4O84p4hlrW/nRcolAupxGSZE= 2024-04-16T18:17:59.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y2n4O84p4hlrW/nRcolAupxGSZE='} 2024-04-16T18:17:59.626 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008b9583a7db996148-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.626 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.626 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.626 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.626 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.626 DEBUG:boto:Data: 2024-04-16T18:17:59.627 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.627 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.627 DEBUG:boto:Params: {} 2024-04-16T18:17:59.627 DEBUG:boto:Token: None 2024-04-16T18:17:59.627 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.627 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.630 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d4e627d751006ab-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.630 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:59.631 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:17:59.631 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.631 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:59.631 DEBUG:boto:Data: 2024-04-16T18:17:59.631 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.631 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.631 DEBUG:boto:Params: {} 2024-04-16T18:17:59.631 DEBUG:boto:Token: None 2024-04-16T18:17:59.632 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:17:59.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GYlkf23b+IUo8umwgkBhZpszqLc= 2024-04-16T18:17:59.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GYlkf23b+IUo8umwgkBhZpszqLc='} 2024-04-16T18:17:59.674 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000092d3c45bceb438be-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.675 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.675 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.675 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.675 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.675 DEBUG:boto:Data: 2024-04-16T18:17:59.675 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.675 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.675 DEBUG:boto:Params: {} 2024-04-16T18:17:59.675 DEBUG:boto:Token: None 2024-04-16T18:17:59.675 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.678 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '57'), ('X-RGW-Bytes-Used', '171'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000053a6dc0b10d69894-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.678 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:17:59.679 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:17:59.679 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.679 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048 2024-04-16T18:17:59.679 DEBUG:boto:Data: 2024-04-16T18:17:59.679 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.679 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.679 DEBUG:boto:Params: {} 2024-04-16T18:17:59.679 DEBUG:boto:Token: None 2024-04-16T18:17:59.679 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000048 2024-04-16T18:17:59.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2aG60tunRA9JY9M0sXw5xRpwuHA= 2024-04-16T18:17:59.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2aG60tunRA9JY9M0sXw5xRpwuHA='} 2024-04-16T18:17:59.685 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000df9297e9241fdbd0-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.685 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.685 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.685 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.685 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.685 DEBUG:boto:Data: 2024-04-16T18:17:59.685 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.686 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.686 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.686 DEBUG:boto:Params: {} 2024-04-16T18:17:59.686 DEBUG:boto:Token: None 2024-04-16T18:17:59.686 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.686 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.689 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005c1993a535f3c368-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.689 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:17:59.690 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:17:59.690 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.690 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027 2024-04-16T18:17:59.690 DEBUG:boto:Data: 2024-04-16T18:17:59.690 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.690 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.690 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.690 DEBUG:boto:Params: {} 2024-04-16T18:17:59.690 DEBUG:boto:Token: None 2024-04-16T18:17:59.691 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000027 2024-04-16T18:17:59.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TYGt7E/HMm9t9hmVdGMocDUYmns= 2024-04-16T18:17:59.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TYGt7E/HMm9t9hmVdGMocDUYmns='} 2024-04-16T18:17:59.697 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000104d28f532438830-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.697 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.697 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.697 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.698 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.698 DEBUG:boto:Data: 2024-04-16T18:17:59.698 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.698 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.698 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.698 DEBUG:boto:Params: {} 2024-04-16T18:17:59.698 DEBUG:boto:Token: None 2024-04-16T18:17:59.698 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.698 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.701 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d1363ab1b9b932e4-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.701 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:59.702 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:17:59.702 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.702 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:59.702 DEBUG:boto:Data: 2024-04-16T18:17:59.702 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.702 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.702 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.702 DEBUG:boto:Params: {} 2024-04-16T18:17:59.702 DEBUG:boto:Token: None 2024-04-16T18:17:59.702 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:17:59.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyUHsjE2ZvnziJezrBu8vKHeoX0= 2024-04-16T18:17:59.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyUHsjE2ZvnziJezrBu8vKHeoX0='} 2024-04-16T18:17:59.750 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ff616f27ae0f71a7-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.751 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.751 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.751 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.751 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.751 DEBUG:boto:Data: 2024-04-16T18:17:59.751 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.751 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.751 DEBUG:boto:Params: {} 2024-04-16T18:17:59.751 DEBUG:boto:Token: None 2024-04-16T18:17:59.752 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.754 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009d718b879d3b5a5a-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.755 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:59.755 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:17:59.755 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.755 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:59.755 DEBUG:boto:Data: 2024-04-16T18:17:59.755 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.755 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.755 DEBUG:boto:Params: {} 2024-04-16T18:17:59.756 DEBUG:boto:Token: None 2024-04-16T18:17:59.756 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:17:59.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J/QxKRgk3hTxZy4SlTNU1d7LFCY= 2024-04-16T18:17:59.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J/QxKRgk3hTxZy4SlTNU1d7LFCY='} 2024-04-16T18:17:59.762 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000273c3b2ea9b2927b-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.762 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.763 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.763 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.763 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.763 DEBUG:boto:Data: 2024-04-16T18:17:59.763 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.763 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.763 DEBUG:boto:Params: {} 2024-04-16T18:17:59.763 DEBUG:boto:Token: None 2024-04-16T18:17:59.763 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.766 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c3d24292b2db8f32-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.767 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:17:59.767 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:17:59.767 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.767 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018 2024-04-16T18:17:59.767 DEBUG:boto:Data: 2024-04-16T18:17:59.767 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.767 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.767 DEBUG:boto:Params: {} 2024-04-16T18:17:59.768 DEBUG:boto:Token: None 2024-04-16T18:17:59.768 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000018 2024-04-16T18:17:59.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lb2aaFDqYrR7jyNzV0H5nvWaHRM= 2024-04-16T18:17:59.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lb2aaFDqYrR7jyNzV0H5nvWaHRM='} 2024-04-16T18:17:59.810 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ede14a9e0c5231cf-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.811 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.811 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.811 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.811 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.811 DEBUG:boto:Data: 2024-04-16T18:17:59.811 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.811 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.811 DEBUG:boto:Params: {} 2024-04-16T18:17:59.811 DEBUG:boto:Token: None 2024-04-16T18:17:59.812 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.815 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bb0f26e6d34c40d6-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.815 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:17:59.815 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:17:59.815 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.816 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026 2024-04-16T18:17:59.816 DEBUG:boto:Data: 2024-04-16T18:17:59.816 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.816 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.816 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.816 DEBUG:boto:Params: {} 2024-04-16T18:17:59.816 DEBUG:boto:Token: None 2024-04-16T18:17:59.816 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000026 2024-04-16T18:17:59.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PkAqmYMp3DUTgM6l82acHtAsuL4= 2024-04-16T18:17:59.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PkAqmYMp3DUTgM6l82acHtAsuL4='} 2024-04-16T18:17:59.823 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af18cb004d0eb070-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.823 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.823 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.823 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.823 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.823 DEBUG:boto:Data: 2024-04-16T18:17:59.823 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.824 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.824 DEBUG:boto:Params: {} 2024-04-16T18:17:59.824 DEBUG:boto:Token: None 2024-04-16T18:17:59.824 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.827 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001fd094e2ee7b94e6-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.827 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:59.827 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:17:59.827 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.828 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:59.828 DEBUG:boto:Data: 2024-04-16T18:17:59.828 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.828 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.828 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.828 DEBUG:boto:Params: {} 2024-04-16T18:17:59.828 DEBUG:boto:Token: None 2024-04-16T18:17:59.828 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:17:59.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dNb5XTuIwl4Fl6nNyXINWG+mBEM= 2024-04-16T18:17:59.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dNb5XTuIwl4Fl6nNyXINWG+mBEM='} 2024-04-16T18:17:59.870 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c4db3b4116b4be33-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.871 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.871 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.871 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.871 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.871 DEBUG:boto:Data: 2024-04-16T18:17:59.871 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.871 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.871 DEBUG:boto:Params: {} 2024-04-16T18:17:59.871 DEBUG:boto:Token: None 2024-04-16T18:17:59.872 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.875 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f59309a33a7341cb-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.875 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:59.875 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:17:59.875 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.875 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:59.875 DEBUG:boto:Data: 2024-04-16T18:17:59.876 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.876 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.876 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.876 DEBUG:boto:Params: {} 2024-04-16T18:17:59.876 DEBUG:boto:Token: None 2024-04-16T18:17:59.876 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:17:59.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CauYoQCh9Hu57FsMWZzcszUTAac= 2024-04-16T18:17:59.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CauYoQCh9Hu57FsMWZzcszUTAac='} 2024-04-16T18:17:59.883 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b276296e0d5e080a-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.883 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.883 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.883 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.883 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.883 DEBUG:boto:Data: 2024-04-16T18:17:59.884 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.884 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.884 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.884 DEBUG:boto:Params: {} 2024-04-16T18:17:59.884 DEBUG:boto:Token: None 2024-04-16T18:17:59.884 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.887 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004db046ba2926f60c-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.888 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:17:59.888 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:17:59.888 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.888 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015 2024-04-16T18:17:59.888 DEBUG:boto:Data: 2024-04-16T18:17:59.888 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.888 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.888 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.888 DEBUG:boto:Params: {} 2024-04-16T18:17:59.889 DEBUG:boto:Token: None 2024-04-16T18:17:59.889 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000015 2024-04-16T18:17:59.889 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hqt6jqgyHnrjjZdn9oX64B6QO9U= 2024-04-16T18:17:59.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hqt6jqgyHnrjjZdn9oX64B6QO9U='} 2024-04-16T18:17:59.930 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cee19ef54192b683-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.931 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.931 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.931 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.931 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.931 DEBUG:boto:Data: 2024-04-16T18:17:59.931 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.931 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.931 DEBUG:boto:Params: {} 2024-04-16T18:17:59.931 DEBUG:boto:Token: None 2024-04-16T18:17:59.932 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.935 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003dfb28c170758f4e-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.935 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:59.935 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:17:59.935 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.935 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:59.935 DEBUG:boto:Data: 2024-04-16T18:17:59.935 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.936 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.936 DEBUG:boto:Params: {} 2024-04-16T18:17:59.936 DEBUG:boto:Token: None 2024-04-16T18:17:59.936 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:17:59.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jt2AWgRD78BBR2DKpgme1FCk5F0= 2024-04-16T18:17:59.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jt2AWgRD78BBR2DKpgme1FCk5F0='} 2024-04-16T18:17:59.943 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d81d51e7f966d33a-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.943 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.943 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.943 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.943 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.943 DEBUG:boto:Data: 2024-04-16T18:17:59.943 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.943 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.943 DEBUG:boto:Params: {} 2024-04-16T18:17:59.944 DEBUG:boto:Token: None 2024-04-16T18:17:59.944 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.947 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '58'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004a649f73feafc66f-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.947 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:17:59.947 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:17:59.947 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.947 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060 2024-04-16T18:17:59.948 DEBUG:boto:Data: 2024-04-16T18:17:59.948 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:17:59.948 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.948 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.948 DEBUG:boto:Params: {} 2024-04-16T18:17:59.948 DEBUG:boto:Token: None 2024-04-16T18:17:59.948 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/obj00000000000000000060 2024-04-16T18:17:59.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WRe+AxXDoz/3EB8kecxU41wFujc= 2024-04-16T18:17:59.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WRe+AxXDoz/3EB8kecxU41wFujc='} 2024-04-16T18:17:59.994 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fdfd4ccf898a7aca-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.995 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:17:59.995 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:17:59.995 DEBUG:boto:Method: HEAD 2024-04-16T18:17:59.995 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:17:59.995 DEBUG:boto:Data: 2024-04-16T18:17:59.995 DEBUG:boto:Headers: {} 2024-04-16T18:17:59.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:17:59.995 DEBUG:boto:Port: 8000 2024-04-16T18:17:59.995 DEBUG:boto:Params: {} 2024-04-16T18:17:59.995 DEBUG:boto:Token: None 2024-04-16T18:17:59.996 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:17:59 GMT /cjqttm-51/ 2024-04-16T18:17:59.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM= 2024-04-16T18:17:59.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:17:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4v+aN2kyrjKKGglitRIE5koj2xM=', 'Content-Length': '0'} 2024-04-16T18:17:59.999 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '59'), ('X-RGW-Bytes-Used', '177'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d1294ba497b816a-00661ec0d7-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:17:59.999 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:17:59.999 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:17:59.999 DEBUG:boto:Method: PUT 2024-04-16T18:17:59.999 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062 2024-04-16T18:17:59.999 DEBUG:boto:Data: 2024-04-16T18:17:59.999 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.000 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.000 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.000 DEBUG:boto:Params: {} 2024-04-16T18:18:00.000 DEBUG:boto:Token: None 2024-04-16T18:18:00.000 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:00.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q5rHoqu3MzX24jRR8Lys+1bE7p4= 2024-04-16T18:18:00.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q5rHoqu3MzX24jRR8Lys+1bE7p4='} 2024-04-16T18:18:00.005 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000072682cb9e101d95c-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.006 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:00.006 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:00.006 DEBUG:boto:Method: HEAD 2024-04-16T18:18:00.006 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:00.006 DEBUG:boto:Data: 2024-04-16T18:18:00.006 DEBUG:boto:Headers: {} 2024-04-16T18:18:00.006 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.006 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.006 DEBUG:boto:Params: {} 2024-04-16T18:18:00.007 DEBUG:boto:Token: None 2024-04-16T18:18:00.007 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/ 2024-04-16T18:18:00.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs= 2024-04-16T18:18:00.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs=', 'Content-Length': '0'} 2024-04-16T18:18:00.010 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '60'), ('X-RGW-Bytes-Used', '180'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002e20102fbd91879-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.010 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:00.010 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:00.011 DEBUG:boto:Method: PUT 2024-04-16T18:18:00.011 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:00.011 DEBUG:boto:Data: 2024-04-16T18:18:00.011 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.011 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.011 DEBUG:boto:Params: {} 2024-04-16T18:18:00.011 DEBUG:boto:Token: None 2024-04-16T18:18:00.011 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:00.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+aV/wOa7SI3NOiozFH84hYG9iX0= 2024-04-16T18:18:00.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+aV/wOa7SI3NOiozFH84hYG9iX0='} 2024-04-16T18:18:00.058 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000957c3e3849c34ab5-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.058 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:00.059 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:00.059 DEBUG:boto:Method: HEAD 2024-04-16T18:18:00.059 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:00.059 DEBUG:boto:Data: 2024-04-16T18:18:00.059 DEBUG:boto:Headers: {} 2024-04-16T18:18:00.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.059 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.059 DEBUG:boto:Params: {} 2024-04-16T18:18:00.059 DEBUG:boto:Token: None 2024-04-16T18:18:00.060 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/ 2024-04-16T18:18:00.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs= 2024-04-16T18:18:00.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs=', 'Content-Length': '0'} 2024-04-16T18:18:00.063 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a8d2119e4bbfac06-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.063 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:00.063 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:00.063 DEBUG:boto:Method: PUT 2024-04-16T18:18:00.063 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:00.064 DEBUG:boto:Data: 2024-04-16T18:18:00.064 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.064 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.064 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.064 DEBUG:boto:Params: {} 2024-04-16T18:18:00.064 DEBUG:boto:Token: None 2024-04-16T18:18:00.064 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:00.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5eb+oVT+STKeqTTmhMSBb6rV9xI= 2024-04-16T18:18:00.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5eb+oVT+STKeqTTmhMSBb6rV9xI='} 2024-04-16T18:18:00.070 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b758f64605bfcb7d-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.070 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:00.071 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:00.071 DEBUG:boto:Method: HEAD 2024-04-16T18:18:00.071 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:00.071 DEBUG:boto:Data: 2024-04-16T18:18:00.071 DEBUG:boto:Headers: {} 2024-04-16T18:18:00.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.071 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.071 DEBUG:boto:Params: {} 2024-04-16T18:18:00.073 DEBUG:boto:Token: None 2024-04-16T18:18:00.073 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/ 2024-04-16T18:18:00.073 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs= 2024-04-16T18:18:00.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs=', 'Content-Length': '0'} 2024-04-16T18:18:00.076 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003c046fbc1e7682d9-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.076 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:00.077 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:00.077 DEBUG:boto:Method: PUT 2024-04-16T18:18:00.077 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:00.077 DEBUG:boto:Data: 2024-04-16T18:18:00.077 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.077 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.077 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.077 DEBUG:boto:Params: {} 2024-04-16T18:18:00.077 DEBUG:boto:Token: None 2024-04-16T18:18:00.077 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:00.078 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:awLPx9O91iOa7QZW8N/Kb1YzN4I= 2024-04-16T18:18:00.078 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:awLPx9O91iOa7QZW8N/Kb1YzN4I='} 2024-04-16T18:18:00.126 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000891451ae85ae4017-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.127 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:00.127 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:00.127 DEBUG:boto:Method: HEAD 2024-04-16T18:18:00.127 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:00.127 DEBUG:boto:Data: 2024-04-16T18:18:00.127 DEBUG:boto:Headers: {} 2024-04-16T18:18:00.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.127 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.127 DEBUG:boto:Params: {} 2024-04-16T18:18:00.127 DEBUG:boto:Token: None 2024-04-16T18:18:00.128 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/ 2024-04-16T18:18:00.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs= 2024-04-16T18:18:00.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs=', 'Content-Length': '0'} 2024-04-16T18:18:00.131 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002fb6f2a3690c8200-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.131 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:00.131 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:00.131 DEBUG:boto:Method: PUT 2024-04-16T18:18:00.131 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:00.131 DEBUG:boto:Data: 2024-04-16T18:18:00.131 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.132 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.132 DEBUG:boto:Params: {} 2024-04-16T18:18:00.132 DEBUG:boto:Token: None 2024-04-16T18:18:00.132 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:00.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A5B5aXPpXqBdc7PZ+LnsbIX6o9U= 2024-04-16T18:18:00.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A5B5aXPpXqBdc7PZ+LnsbIX6o9U='} 2024-04-16T18:18:00.139 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007b6ef225f3fd37d6-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.139 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:00.139 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:00.139 DEBUG:boto:Method: HEAD 2024-04-16T18:18:00.139 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:00.139 DEBUG:boto:Data: 2024-04-16T18:18:00.139 DEBUG:boto:Headers: {} 2024-04-16T18:18:00.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.139 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.140 DEBUG:boto:Params: {} 2024-04-16T18:18:00.140 DEBUG:boto:Token: None 2024-04-16T18:18:00.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/ 2024-04-16T18:18:00.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs= 2024-04-16T18:18:00.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs=', 'Content-Length': '0'} 2024-04-16T18:18:00.143 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e6af38ef58cc80d7-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.143 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:00.143 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:00.143 DEBUG:boto:Method: PUT 2024-04-16T18:18:00.144 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:00.144 DEBUG:boto:Data: 2024-04-16T18:18:00.144 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.144 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.144 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.144 DEBUG:boto:Params: {} 2024-04-16T18:18:00.144 DEBUG:boto:Token: None 2024-04-16T18:18:00.144 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:00.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3RQqGX5oxcU2Sar5+i/5REa6xho= 2024-04-16T18:18:00.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3RQqGX5oxcU2Sar5+i/5REa6xho='} 2024-04-16T18:18:00.186 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000013c3b6d5dd22b1c8-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.186 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:00.187 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:00.187 DEBUG:boto:Method: HEAD 2024-04-16T18:18:00.187 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:00.187 DEBUG:boto:Data: 2024-04-16T18:18:00.187 DEBUG:boto:Headers: {} 2024-04-16T18:18:00.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.187 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.187 DEBUG:boto:Params: {} 2024-04-16T18:18:00.187 DEBUG:boto:Token: None 2024-04-16T18:18:00.187 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/ 2024-04-16T18:18:00.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs= 2024-04-16T18:18:00.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs=', 'Content-Length': '0'} 2024-04-16T18:18:00.190 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f8886b8c267bcd2e-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.191 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:00.191 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:00.191 DEBUG:boto:Method: PUT 2024-04-16T18:18:00.191 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:00.191 DEBUG:boto:Data: 2024-04-16T18:18:00.191 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.192 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.192 DEBUG:boto:Params: {} 2024-04-16T18:18:00.192 DEBUG:boto:Token: None 2024-04-16T18:18:00.192 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:00.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ADlk4oMPNvnKUuzHFT+A2w+CAwE= 2024-04-16T18:18:00.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ADlk4oMPNvnKUuzHFT+A2w+CAwE='} 2024-04-16T18:18:00.198 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000097c4a3fdfec4c8a3-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.198 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:00.198 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:00.199 DEBUG:boto:Method: HEAD 2024-04-16T18:18:00.199 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:00.199 DEBUG:boto:Data: 2024-04-16T18:18:00.199 DEBUG:boto:Headers: {} 2024-04-16T18:18:00.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.199 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.199 DEBUG:boto:Params: {} 2024-04-16T18:18:00.199 DEBUG:boto:Token: None 2024-04-16T18:18:00.199 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/ 2024-04-16T18:18:00.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs= 2024-04-16T18:18:00.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTBpOaVMHo+HYiFmKvbuh39gaUs=', 'Content-Length': '0'} 2024-04-16T18:18:00.202 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fda8cd8b33fda326-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.202 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:00.203 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:00.203 DEBUG:boto:Method: PUT 2024-04-16T18:18:00.203 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:00.203 DEBUG:boto:Data: 2024-04-16T18:18:00.203 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:18:00.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:00.203 DEBUG:boto:Port: 8000 2024-04-16T18:18:00.203 DEBUG:boto:Params: {} 2024-04-16T18:18:00.203 DEBUG:boto:Token: None 2024-04-16T18:18:00.203 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:18:00 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:00.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nz0BZq6zODXBtnrGKqLdcidpiQg= 2024-04-16T18:18:00.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:18:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nz0BZq6zODXBtnrGKqLdcidpiQg='} 2024-04-16T18:18:00.246 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ae1c7ce36827440b-00661ec0d8-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:00.247 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:18:00.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:18:00.247 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync run --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:18:00.305 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:00.306 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:00.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.412 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket shard: 2 2024-04-16T18:18:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position=00000000001.63.6 2024-04-16T18:18:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket shard: 2 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.413+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position=00000000001.46.6 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 2 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000001.60.6 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket shard: 2 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position=00000000001.43.6 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 2 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position=00000000001.31.6 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket shard: 2 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.414+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position=00000000001.42.6 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket shard: 2 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket shard: 2 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position=00000000001.53.6 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position=00000000001.40.6 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 2 2024-04-16T18:18:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.415+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket shard: 2 2024-04-16T18:18:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.416+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position=00000000001.28.6 2024-04-16T18:18:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.416+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 2 2024-04-16T18:18:00.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.416+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000001.45.6 2024-04-16T18:18:00.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.455+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket shard: 0 2024-04-16T18:18:00.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.464 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket shard: 0 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.456+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket shard: 0 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.465 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket shard: 0 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket shard: 0 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.457+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket shard: 0 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5/obj00000000000000000000 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: entry->timestamp=2024-04-16T18:17:55.187306+0000 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000000]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000000[0] 2024-04-16T18:18:00.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: parsed entry: id=00000000001.55.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2/obj00000000000000000024 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: entry->timestamp=2024-04-16T18:17:55.063679+0000 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.55.6 op=0 op_state=1 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.458+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: : injecting data sync error on key=obj00000000000000000024 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position=00000000001.55.6 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: parsed entry: id=00000000001.74.6 iter->object=obj00000000000000000028 iter->instance= name=obj00000000000000000028 instance= ns= 2024-04-16T18:18:00.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4/obj00000000000000000028 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: entry->timestamp=2024-04-16T18:17:54.855118+0000 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000028]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.74.6 op=0 op_state=1 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2/obj00000000000000000024 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000028]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000028[0] 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position=00000000001.74.6 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket shard: 0 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: parsed entry: id=00000000002.64.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8/obj00000000000000000010 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: entry->timestamp=2024-04-16T18:17:54.806054+0000 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.64.6 op=0 op_state=1 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000010]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000010[0] 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position=00000000002.64.6 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: parsed entry: id=00000000001.37.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2024-04-16T18:18:00.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3/obj00000000000000000020 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: entry->timestamp=2024-04-16T18:17:54.796049+0000 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.37.6 op=0 op_state=1 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000020]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000020[0] 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.459+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position=00000000001.37.6 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket shard: 0 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:00.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket shard: 0 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket shard: 0 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket shard: 0 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.460+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.461+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: parsed entry: id=00000000001.75.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-16T18:18:00.472 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.461+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12/obj00000000000000000030 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.461+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: entry->timestamp=2024-04-16T18:17:54.995974+0000 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.461+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.75.6 op=0 op_state=1 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.461+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000030]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000030[0] 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.461+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position=00000000001.75.6 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10/obj00000000000000000013 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: entry->timestamp=2024-04-16T18:17:55.075074+0000 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000013]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000013[0] 2024-04-16T18:18:00.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000001.70.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000021 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:17:55.123946+0000 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.70.6 op=0 op_state=1 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000021]: : injecting data sync error on key=obj00000000000000000021 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000001.70.6 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000021]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000021]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000021 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: parsed entry: id=00000000002.26.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15/obj00000000000000000004 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: entry->timestamp=2024-04-16T18:17:54.933901+0000 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.26.6 op=0 op_state=1 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000004]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000004[0] 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.462+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position=00000000002.26.6 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: parsed entry: id=00000000001.53.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14/obj00000000000000000033 2024-04-16T18:18:00.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: entry->timestamp=2024-04-16T18:17:54.945581+0000 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.53.6 op=0 op_state=1 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000033]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000033[0] 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position=00000000001.53.6 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000001.48.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000026 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:17:55.016088+0000 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.48.6 op=0 op_state=1 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000026]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000026[0] 2024-04-16T18:18:00.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000001.48.6 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.470+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000028]: success 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.470+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4:1 marker=00000000001.74.6 timestamp=2024-04-16T18:17:54.855118+0000 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.470+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000013]: success 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.470+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10:1 marker=00000000002.41.6 timestamp=2024-04-16T18:17:55.075074+0000 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.471+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000000]: success 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5:1 marker=00000000002.65.6 timestamp=2024-04-16T18:17:55.187306+0000 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.471+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000020]: success 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3:1 marker=00000000001.37.6 timestamp=2024-04-16T18:17:54.796049+0000 2024-04-16T18:18:00.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.471+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000030]: success 2024-04-16T18:18:00.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12:1 marker=00000000001.75.6 timestamp=2024-04-16T18:17:54.995974+0000 2024-04-16T18:18:00.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.473+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000010]: success 2024-04-16T18:18:00.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.473+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8:1 marker=00000000002.64.6 timestamp=2024-04-16T18:17:54.806054+0000 2024-04-16T18:18:00.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.474+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000033]: success 2024-04-16T18:18:00.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14:1 marker=00000000001.53.6 timestamp=2024-04-16T18:17:54.945581+0000 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: parsed entry: id=00000000001.39.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000016 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: entry->timestamp=2024-04-16T18:17:54.923399+0000 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.39.6 op=0 op_state=1 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000016]: : injecting data sync error on key=obj00000000000000000016 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000001.39.6 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000016]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.498+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000016]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000016 2024-04-16T18:18:00.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: parsed entry: id=00000000001.66.6 iter->object=obj00000000000000000032 iter->instance= name=obj00000000000000000032 instance= ns= 2024-04-16T18:18:00.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6/obj00000000000000000032 2024-04-16T18:18:00.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: entry->timestamp=2024-04-16T18:17:54.875617+0000 2024-04-16T18:18:00.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000032]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.66.6 op=0 op_state=1 2024-04-16T18:18:00.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000032]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000032[0] 2024-04-16T18:18:00.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position=00000000001.66.6 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000001.66.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000019 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:54.865396+0000 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.66.6 op=0 op_state=1 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000002.68.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000001 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:17:55.134952+0000 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.68.6 op=0 op_state=1 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000019]: : injecting data sync error on key=obj00000000000000000019 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000001.66.6 2024-04-16T18:18:00.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000001]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000001[0] 2024-04-16T18:18:00.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000002.68.6 2024-04-16T18:18:00.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000019]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.500+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000019]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000019 2024-04-16T18:18:00.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.501+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: a sync operation returned error 2024-04-16T18:18:00.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.501+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: backing out with sync_status=-5 2024-04-16T18:18:00.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.501+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.501+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.502+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:00.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: parsed entry: id=00000000001.68.6 iter->object=obj00000000000000000076 iter->instance= name=obj00000000000000000076 instance= ns= 2024-04-16T18:18:00.503 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000076 2024-04-16T18:18:00.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: entry->timestamp=2024-04-16T18:17:55.006241+0000 2024-04-16T18:18:00.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000076]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.68.6 op=0 op_state=1 2024-04-16T18:18:00.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000076]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000076[0] 2024-04-16T18:18:00.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.503+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position=00000000001.68.6 2024-04-16T18:18:00.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.505+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: a sync operation returned error 2024-04-16T18:18:00.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.505+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000032]: success 2024-04-16T18:18:00.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.505+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6:1 marker=00000000001.66.6 timestamp=2024-04-16T18:17:54.875617+0000 2024-04-16T18:18:00.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.505+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: backing out with sync_status=-5 2024-04-16T18:18:00.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.505+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.505+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.506+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.506+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:00.506 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.506+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.510+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000004]: success 2024-04-16T18:18:00.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.510+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15:1 marker=00000000002.26.6 timestamp=2024-04-16T18:17:54.933901+0000 2024-04-16T18:18:00.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.510+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000026]: success 2024-04-16T18:18:00.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.510+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13:1 marker=00000000001.48.6 timestamp=2024-04-16T18:17:55.016088+0000 2024-04-16T18:18:00.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.540+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: a sync operation returned error 2024-04-16T18:18:00.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.540+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: backing out with sync_status=-5 2024-04-16T18:18:00.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.540+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.540+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.540+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.541+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:00.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.541+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.543+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: a sync operation returned error 2024-04-16T18:18:00.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.543+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: backing out with sync_status=-5 2024-04-16T18:18:00.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.543+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.543+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.543+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.544+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:00.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.544+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: parsed entry: id=00000000001.55.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2024-04-16T18:18:00.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2/obj00000000000000000024 2024-04-16T18:18:00.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: entry->timestamp=2024-04-16T18:17:55.063679+0000 2024-04-16T18:18:00.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.55.6 op=0 op_state=1 2024-04-16T18:18:00.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: : injecting data sync error on key=obj00000000000000000024 2024-04-16T18:18:00.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position=00000000001.55.6 2024-04-16T18:18:00.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.545+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2/obj00000000000000000024 2024-04-16T18:18:00.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.546+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000001]: success 2024-04-16T18:18:00.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.546+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7:1 marker=00000000002.68.6 timestamp=2024-04-16T18:17:55.134952+0000 2024-04-16T18:18:00.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.547+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000076]: success 2024-04-16T18:18:00.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.547+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16:1 marker=00000000001.68.6 timestamp=2024-04-16T18:17:55.006241+0000 2024-04-16T18:18:00.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.548+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000001.70.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-16T18:18:00.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.548+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000021 2024-04-16T18:18:00.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.548+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:17:55.123946+0000 2024-04-16T18:18:00.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.548+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.70.6 op=0 op_state=1 2024-04-16T18:18:00.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.548+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000021]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000021[0] 2024-04-16T18:18:00.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.548+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000001.70.6 2024-04-16T18:18:00.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.583+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: parsed entry: id=00000000001.39.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-16T18:18:00.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.583+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000016 2024-04-16T18:18:00.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.583+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: entry->timestamp=2024-04-16T18:17:54.923399+0000 2024-04-16T18:18:00.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.583+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.39.6 op=0 op_state=1 2024-04-16T18:18:00.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.583+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000016]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000016[0] 2024-04-16T18:18:00.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.583+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000001.39.6 2024-04-16T18:18:00.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.586+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000001.66.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-16T18:18:00.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.586+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000019 2024-04-16T18:18:00.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.586+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:54.865396+0000 2024-04-16T18:18:00.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.586+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.66.6 op=0 op_state=1 2024-04-16T18:18:00.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.586+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000019]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000019[0] 2024-04-16T18:18:00.586 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.586+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000001.66.6 2024-04-16T18:18:00.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.587+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: a sync operation returned error 2024-04-16T18:18:00.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.587+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: backing out with sync_status=-5 2024-04-16T18:18:00.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.587+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.587+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.587+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.587+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:00.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.587+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.588+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000016]: success 2024-04-16T18:18:00.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.588+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1:1 marker=00000000001.39.6 timestamp=2024-04-16T18:17:54.923399+0000 2024-04-16T18:18:00.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.590+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000019]: success 2024-04-16T18:18:00.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.590+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9:1 marker=00000000001.66.6 timestamp=2024-04-16T18:17:54.865396+0000 2024-04-16T18:18:00.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.593+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000021]: success 2024-04-16T18:18:00.593 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.593+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11:1 marker=00000000001.70.6 timestamp=2024-04-16T18:17:55.123946+0000 2024-04-16T18:18:00.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.630+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: parsed entry: id=00000000001.55.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2024-04-16T18:18:00.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.630+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2/obj00000000000000000024 2024-04-16T18:18:00.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.630+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: entry->timestamp=2024-04-16T18:17:55.063679+0000 2024-04-16T18:18:00.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.630+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.55.6 op=0 op_state=1 2024-04-16T18:18:00.629 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.630+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000024[0] 2024-04-16T18:18:00.630 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.630+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position=00000000001.55.6 2024-04-16T18:18:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.677+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000024]: success 2024-04-16T18:18:00.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.677+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2:1 marker=00000000001.55.6 timestamp=2024-04-16T18:17:55.063679+0000 2024-04-16T18:18:00.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.682+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.691 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.682+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.682+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket shard: 0 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.682+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.692 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket shard: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket shard: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket shard: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.683+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket shard: 0 2024-04-16T18:18:00.693 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000010 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: entry->timestamp=2024-04-16T18:17:55.895316+0000 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.51.6 op=0 op_state=1 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000010]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000010[0] 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000002.51.6 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.684+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket shard: 0 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: parsed entry: id=00000000002.51.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3/obj00000000000000000021 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: entry->timestamp=2024-04-16T18:17:55.823649+0000 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.51.6 op=0 op_state=1 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000021]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000021[0] 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position=00000000002.51.6 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: parsed entry: id=00000000002.79.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-16T18:18:00.695 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2/obj00000000000000000016 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: entry->timestamp=2024-04-16T18:17:55.642271+0000 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.79.6 op=0 op_state=1 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: parsed entry: id=00000000001.58.6 iter->object=obj00000000000000000025 iter->instance= name=obj00000000000000000025 instance= ns= 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5/obj00000000000000000025 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: entry->timestamp=2024-04-16T18:17:55.955498+0000 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000025]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.58.6 op=0 op_state=1 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000016]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000016[0] 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position=00000000002.79.6 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000025]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000025[0] 2024-04-16T18:18:00.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position=00000000001.58.6 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: parsed entry: id=00000000002.60.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4/obj00000000000000000004 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: entry->timestamp=2024-04-16T18:17:55.751501+0000 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.60.6 op=0 op_state=1 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.685+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000004]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000004[0] 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position=00000000002.60.6 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.697 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket shard: 0 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket shard: 0 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: parsed entry: id=00000000002.58.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6/obj00000000000000000030 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: entry->timestamp=2024-04-16T18:17:55.906690+0000 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.686+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.58.6 op=0 op_state=1 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket shard: 0 2024-04-16T18:18:00.698 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000030]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000030[0] 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position=00000000002.58.6 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000010]: success 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1:2 marker=00000000002.51.6 timestamp=2024-04-16T18:17:55.895316+0000 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket shard: 0 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket shard: 0 2024-04-16T18:18:00.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket shard: 0 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.687+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000001.60.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000014 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:17:55.632135+0000 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.60.6 op=0 op_state=1 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000014]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000014[0] 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000001.60.6 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: parsed entry: id=00000000001.58.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-16T18:18:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10/obj00000000000000000009 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: entry->timestamp=2024-04-16T18:17:55.514108+0000 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.58.6 op=0 op_state=1 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000009]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000009[0] 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position=00000000001.58.6 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000016]: success 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2:2 marker=00000000002.79.6 timestamp=2024-04-16T18:17:55.642271+0000 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000004]: success 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4:2 marker=00000000002.60.6 timestamp=2024-04-16T18:17:55.751501+0000 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: parsed entry: id=00000000002.49.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12/obj00000000000000000012 2024-04-16T18:18:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: entry->timestamp=2024-04-16T18:17:55.883504+0000 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.49.6 op=0 op_state=1 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000012]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000012[0] 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.689+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position=00000000002.49.6 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000021]: success 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3:2 marker=00000000002.51.6 timestamp=2024-04-16T18:17:55.823649+0000 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000002.63.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000002 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:17:55.691568+0000 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.63.6 op=0 op_state=1 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: parsed entry: id=00000000002.79.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2024-04-16T18:18:00.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15/obj00000000000000000006 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: entry->timestamp=2024-04-16T18:17:55.583877+0000 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.79.6 op=0 op_state=1 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14/obj00000000000000000000 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: entry->timestamp=2024-04-16T18:17:55.571625+0000 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.57.6 op=0 op_state=1 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000002]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000002[0] 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000002.63.6 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000006]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000006[0] 2024-04-16T18:18:00.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position=00000000002.79.6 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000030]: success 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6:2 marker=00000000002.58.6 timestamp=2024-04-16T18:17:55.906690+0000 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000000]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000000[0] 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.690+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position=00000000002.57.6 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.691+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: parsed entry: id=00000000001.147.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.691+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18/obj00000000000000000007 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.691+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: entry->timestamp=2024-04-16T18:17:55.774718+0000 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.691+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.147.6 op=0 op_state=1 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.691+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000007]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000007[0] 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.691+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position=00000000001.147.6 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.692+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000025]: success 2024-04-16T18:18:00.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.692+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5:2 marker=00000000001.58.6 timestamp=2024-04-16T18:17:55.955498+0000 2024-04-16T18:18:00.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.694+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000000]: success 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.694+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14:2 marker=00000000002.57.6 timestamp=2024-04-16T18:17:55.571625+0000 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.697+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000009]: success 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.697+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10:2 marker=00000000001.58.6 timestamp=2024-04-16T18:17:55.514108+0000 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.697+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000002]: success 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.697+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13:2 marker=00000000002.63.6 timestamp=2024-04-16T18:17:55.691568+0000 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.701+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000007]: success 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.701+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18:2 marker=00000000001.147.6 timestamp=2024-04-16T18:17:55.774718+0000 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.702+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000012]: success 2024-04-16T18:18:00.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.702+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12:2 marker=00000000002.49.6 timestamp=2024-04-16T18:17:55.883504+0000 2024-04-16T18:18:00.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.708+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000006]: success 2024-04-16T18:18:00.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.708+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15:2 marker=00000000002.79.6 timestamp=2024-04-16T18:17:55.583877+0000 2024-04-16T18:18:00.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.725+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: parsed entry: id=00000000002.74.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-16T18:18:00.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.725+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0/obj00000000000000000005 2024-04-16T18:18:00.724 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.725+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: entry->timestamp=2024-04-16T18:17:55.703341+0000 2024-04-16T18:18:00.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.725+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.74.6 op=0 op_state=1 2024-04-16T18:18:00.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.725+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000005]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000005[0] 2024-04-16T18:18:00.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.725+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position=00000000002.74.6 2024-04-16T18:18:00.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.726+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000002.32.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2024-04-16T18:18:00.725 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.726+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000015 2024-04-16T18:18:00.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.726+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:17:55.503184+0000 2024-04-16T18:18:00.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.726+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.32.6 op=0 op_state=1 2024-04-16T18:18:00.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.726+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000015]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000015[0] 2024-04-16T18:18:00.726 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.726+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000002.32.6 2024-04-16T18:18:00.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.728+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: parsed entry: id=00000000002.68.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-16T18:18:00.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.728+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8/obj00000000000000000019 2024-04-16T18:18:00.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.728+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: entry->timestamp=2024-04-16T18:17:55.835684+0000 2024-04-16T18:18:00.727 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.728+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.68.6 op=0 op_state=1 2024-04-16T18:18:00.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.728+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000019]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000019[0] 2024-04-16T18:18:00.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.728+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position=00000000002.68.6 2024-04-16T18:18:00.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.729+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000002.55.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-16T18:18:00.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.729+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000003 2024-04-16T18:18:00.728 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.729+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:55.524070+0000 2024-04-16T18:18:00.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.729+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.55.6 op=0 op_state=1 2024-04-16T18:18:00.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.729+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000003]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000003[0] 2024-04-16T18:18:00.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.729+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000002.55.6 2024-04-16T18:18:00.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000019]: success 2024-04-16T18:18:00.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8:2 marker=00000000002.68.6 timestamp=2024-04-16T18:17:55.835684+0000 2024-04-16T18:18:00.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: parsed entry: id=00000000002.57.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-16T18:18:00.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000011 2024-04-16T18:18:00.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: entry->timestamp=2024-04-16T18:17:55.763085+0000 2024-04-16T18:18:00.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.57.6 op=0 op_state=1 2024-04-16T18:18:00.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000011]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000011[0] 2024-04-16T18:18:00.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.730+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position=00000000002.57.6 2024-04-16T18:18:00.730 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.731+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000005]: success 2024-04-16T18:18:00.731 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.731+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0:2 marker=00000000002.74.6 timestamp=2024-04-16T18:17:55.703341+0000 2024-04-16T18:18:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.736+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000014]: success 2024-04-16T18:18:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.736+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11:2 marker=00000000001.60.6 timestamp=2024-04-16T18:17:55.632135+0000 2024-04-16T18:18:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.737+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000003]: success 2024-04-16T18:18:00.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.737+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9:2 marker=00000000002.55.6 timestamp=2024-04-16T18:17:55.524070+0000 2024-04-16T18:18:00.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.738+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000011]: success 2024-04-16T18:18:00.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.738+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16:2 marker=00000000002.57.6 timestamp=2024-04-16T18:17:55.763085+0000 2024-04-16T18:18:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.770+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000015]: success 2024-04-16T18:18:00.770 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.770+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7:2 marker=00000000002.32.6 timestamp=2024-04-16T18:17:55.503184+0000 2024-04-16T18:18:00.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.783+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.783+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.783+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.783+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:00.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.783+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket shard: 0 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket shard: 0 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket shard: 0 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket shard: 0 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.784+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket shard: 0 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket shard: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.785+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.786+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.786+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket shard: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.786+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.786+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.786+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:00.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.786+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.786+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket shard: 0 2024-04-16T18:18:00.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: parsed entry: id=00000000002.69.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4/obj00000000000000000014 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: entry->timestamp=2024-04-16T18:17:56.687430+0000 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.69.6 op=0 op_state=1 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: parsed entry: id=00000000001.37.6 iter->object=obj00000000000000000039 iter->instance= name=obj00000000000000000039 instance= ns= 2024-04-16T18:18:00.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8/obj00000000000000000039 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: entry->timestamp=2024-04-16T18:17:56.463819+0000 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000039]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.37.6 op=0 op_state=1 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000014]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000014[0] 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position=00000000002.69.6 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000039]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000039[0] 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position=00000000001.37.6 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000002.86.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000002 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:17:56.486725+0000 2024-04-16T18:18:00.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.86.6 op=0 op_state=1 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.787+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket shard: 0 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000002]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000002[0] 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000002.86.6 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: parsed entry: id=00000000002.88.6 iter->object=obj00000000000000000032 iter->instance= name=obj00000000000000000032 instance= ns= 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6/obj00000000000000000032 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: entry->timestamp=2024-04-16T18:17:56.675841+0000 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000032]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.88.6 op=0 op_state=1 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.799 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000032]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000032[0] 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position=00000000002.88.6 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000002.48.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000007 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:56.735614+0000 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.48.6 op=0 op_state=1 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: parsed entry: id=00000000002.34.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10/obj00000000000000000006 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: entry->timestamp=2024-04-16T18:17:56.555938+0000 2024-04-16T18:18:00.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.34.6 op=0 op_state=1 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000007]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000007[0] 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000002.48.6 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000006]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000006[0] 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.788+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position=00000000002.34.6 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket shard: 0 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket shard: 0 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket shard: 0 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.801 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket shard: 0 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket shard: 0 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket shard: 0 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket shard: 0 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.789+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000014]: success 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4:3 marker=00000000002.69.6 timestamp=2024-04-16T18:17:56.687430+0000 2024-04-16T18:18:00.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: parsed entry: id=00000000002.70.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14/obj00000000000000000013 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: entry->timestamp=2024-04-16T18:17:56.274405+0000 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.70.6 op=0 op_state=1 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000013]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000013[0] 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.790+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position=00000000002.70.6 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.791+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000002]: success 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.791+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7:3 marker=00000000002.86.6 timestamp=2024-04-16T18:17:56.486725+0000 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.791+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000007]: success 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.791+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9:3 marker=00000000002.48.6 timestamp=2024-04-16T18:17:56.735614+0000 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2024-04-16T18:18:00.803 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000033 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: entry->timestamp=2024-04-16T18:17:56.355899+0000 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.67.6 op=0 op_state=1 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000033]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000033[0] 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position=00000000002.67.6 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000032]: success 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6:3 marker=00000000002.88.6 timestamp=2024-04-16T18:17:56.675841+0000 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15/obj00000000000000000012 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: entry->timestamp=2024-04-16T18:17:56.343636+0000 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.45.6 op=0 op_state=1 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000012]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000012[0] 2024-04-16T18:18:00.804 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position=00000000002.45.6 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000006]: success 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10:3 marker=00000000002.34.6 timestamp=2024-04-16T18:17:56.555938+0000 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: parsed entry: id=00000000002.63.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18/obj00000000000000000000 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: entry->timestamp=2024-04-16T18:17:56.403483+0000 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.63.6 op=0 op_state=1 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: parsed entry: id=00000000002.67.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-16T18:18:00.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000001 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: entry->timestamp=2024-04-16T18:17:56.663434+0000 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.67.6 op=0 op_state=1 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20/obj00000000000000000003 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: entry->timestamp=2024-04-16T18:17:56.474730+0000 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000000]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000000[0] 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position=00000000002.63.6 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000001]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000001[0] 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position=00000000002.67.6 2024-04-16T18:18:00.806 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000003]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000003[0] 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: parsed entry: id=00000000002.39.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19/obj00000000000000000021 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: entry->timestamp=2024-04-16T18:17:56.535109+0000 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.39.6 op=0 op_state=1 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: parsed entry: id=00000000001.32.6 iter->object=obj00000000000000000055 iter->instance= name=obj00000000000000000055 instance= ns= 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21/obj00000000000000000055 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: entry->timestamp=2024-04-16T18:17:56.614380+0000 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000055]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.32.6 op=0 op_state=1 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000021]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000021[0] 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position=00000000002.39.6 2024-04-16T18:18:00.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000013]: success 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14:3 marker=00000000002.70.6 timestamp=2024-04-16T18:17:56.274405+0000 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000055]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000055[0] 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.793+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position=00000000001.32.6 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.795+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000033]: success 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.795+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16:3 marker=00000000002.67.6 timestamp=2024-04-16T18:17:56.355899+0000 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.795+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000012]: success 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.795+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15:3 marker=00000000002.45.6 timestamp=2024-04-16T18:17:56.343636+0000 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.795+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000001]: success 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.795+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17:3 marker=00000000002.67.6 timestamp=2024-04-16T18:17:56.663434+0000 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000000]: success 2024-04-16T18:18:00.808 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18:3 marker=00000000002.63.6 timestamp=2024-04-16T18:17:56.403483+0000 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000003]: success 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20:3 marker=00000000002.65.6 timestamp=2024-04-16T18:17:56.474730+0000 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000039]: success 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8:3 marker=00000000001.37.6 timestamp=2024-04-16T18:17:56.463819+0000 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000021]: success 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.796+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19:3 marker=00000000002.39.6 timestamp=2024-04-16T18:17:56.535109+0000 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.800+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000055]: success 2024-04-16T18:18:00.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.800+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21:3 marker=00000000001.32.6 timestamp=2024-04-16T18:17:56.614380+0000 2024-04-16T18:18:00.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: parsed entry: id=00000000002.56.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2024-04-16T18:18:00.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000026 2024-04-16T18:18:00.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: entry->timestamp=2024-04-16T18:17:56.285474+0000 2024-04-16T18:18:00.826 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.56.6 op=0 op_state=1 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000026]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000026[0] 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000002.56.6 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: parsed entry: id=00000000001.56.6 iter->object=obj00000000000000000058 iter->instance= name=obj00000000000000000058 instance= ns= 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0/obj00000000000000000058 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: entry->timestamp=2024-04-16T18:17:56.546296+0000 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000058]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.56.6 op=0 op_state=1 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: parsed entry: id=00000000001.77.6 iter->object=obj00000000000000000046 iter->instance= name=obj00000000000000000046 instance= ns= 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3/obj00000000000000000046 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: entry->timestamp=2024-04-16T18:17:56.415556+0000 2024-04-16T18:18:00.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000046]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.77.6 op=0 op_state=1 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000058]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000058[0] 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position=00000000001.56.6 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000046]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000046[0] 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.826+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position=00000000001.77.6 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.827+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: parsed entry: id=00000000001.41.6 iter->object=obj00000000000000000050 iter->instance= name=obj00000000000000000050 instance= ns= 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.827+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5/obj00000000000000000050 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.827+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: entry->timestamp=2024-04-16T18:17:56.603879+0000 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.827+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000050]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.41.6 op=0 op_state=1 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.827+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000050]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000050[0] 2024-04-16T18:18:00.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.827+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position=00000000001.41.6 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.828+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000026]: success 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.828+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1:3 marker=00000000002.56.6 timestamp=2024-04-16T18:17:56.285474+0000 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.829+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000001.79.6 iter->object=obj00000000000000000040 iter->instance= name=obj00000000000000000040 instance= ns= 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.829+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000040 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.829+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:17:56.747440+0000 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.829+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000040]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.79.6 op=0 op_state=1 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.829+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000040]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000040[0] 2024-04-16T18:18:00.830 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.829+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000001.79.6 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: parsed entry: id=00000000002.79.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12/obj00000000000000000009 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: entry->timestamp=2024-04-16T18:17:56.296426+0000 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.79.6 op=0 op_state=1 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000009]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000009[0] 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position=00000000002.79.6 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000001.151.6 iter->object=obj00000000000000000045 iter->instance= name=obj00000000000000000045 instance= ns= 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000045 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:17:56.757929+0000 2024-04-16T18:18:00.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000045]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.151.6 op=0 op_state=1 2024-04-16T18:18:00.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000045]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000045[0] 2024-04-16T18:18:00.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.830+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000001.151.6 2024-04-16T18:18:00.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.832+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000009]: success 2024-04-16T18:18:00.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.832+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12:3 marker=00000000002.79.6 timestamp=2024-04-16T18:17:56.296426+0000 2024-04-16T18:18:00.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.832+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000046]: success 2024-04-16T18:18:00.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.832+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3:3 marker=00000000001.77.6 timestamp=2024-04-16T18:17:56.415556+0000 2024-04-16T18:18:00.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.832+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000050]: success 2024-04-16T18:18:00.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.832+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5:3 marker=00000000001.41.6 timestamp=2024-04-16T18:17:56.603879+0000 2024-04-16T18:18:00.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.834+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000040]: success 2024-04-16T18:18:00.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.834+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11:3 marker=00000000001.79.6 timestamp=2024-04-16T18:17:56.747440+0000 2024-04-16T18:18:00.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.837+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000045]: success 2024-04-16T18:18:00.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.837+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13:3 marker=00000000001.151.6 timestamp=2024-04-16T18:17:56.757929+0000 2024-04-16T18:18:00.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.876+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000058]: success 2024-04-16T18:18:00.875 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.876+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0:3 marker=00000000001.56.6 timestamp=2024-04-16T18:17:56.546296+0000 2024-04-16T18:18:00.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.903 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket shard: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.890+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket shard: 0 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.904 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket shard: 0 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket shard: 0 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket shard: 0 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket shard: 0 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.905 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.891+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket shard: 0 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.906 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket shard: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket shard: 0 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.892+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.907 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket shard: 0 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket shard: 0 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: parsed entry: id=00000000001.52.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8/obj00000000000000000017 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: entry->timestamp=2024-04-16T18:17:57.399556+0000 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.52.6 op=0 op_state=1 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000017]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000017[0] 2024-04-16T18:18:00.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position=00000000001.52.6 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000001.75.6 iter->object=obj00000000000000000049 iter->instance= name=obj00000000000000000049 instance= ns= 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000049 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:17:57.651491+0000 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000049]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.75.6 op=0 op_state=1 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.893+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000049]: : injecting data sync error on key=obj00000000000000000049 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000001.75.6 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000049]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000049]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000049 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000001.74.6 iter->object=obj00000000000000000031 iter->instance= name=obj00000000000000000031 instance= ns= 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000031 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:17:57.531449+0000 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000031]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.74.6 op=0 op_state=1 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: parsed entry: id=00000000002.80.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10/obj00000000000000000015 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: entry->timestamp=2024-04-16T18:17:57.661273+0000 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.80.6 op=0 op_state=1 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.894+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000031]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000031[0] 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000001.74.6 2024-04-16T18:18:00.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000015]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000015[0] 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position=00000000002.80.6 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000001.76.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000008 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:57.263535+0000 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.76.6 op=0 op_state=1 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: parsed entry: id=00000000002.43.6 iter->object=obj00000000000000000022 iter->instance= name=obj00000000000000000022 instance= ns= 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12/obj00000000000000000022 2024-04-16T18:18:00.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: entry->timestamp=2024-04-16T18:17:57.134878+0000 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000022]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.43.6 op=0 op_state=1 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000002.73.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000013 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:17:57.458618+0000 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.73.6 op=0 op_state=1 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket shard: 0 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000008]: : injecting data sync error on key=obj00000000000000000008 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000001.76.6 2024-04-16T18:18:00.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000022]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000022[0] 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position=00000000002.43.6 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000013]: : injecting data sync error on key=obj00000000000000000013 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000002.73.6 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000008]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000008]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000008 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000013]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000013]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000013 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.895+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket shard: 0 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket shard: 0 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket shard: 0 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket shard: 0 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket shard: 0 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.896+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: sync status for source bucket shard: 0 2024-04-16T18:18:00.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: sync status for source bucket shard: 0 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: sync status for source bucket shard: 0 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: sync status for source bucket shard: 0 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: sync status for source bucket shard: 0 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: a sync operation returned error 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: backing out with sync_status=-5 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.897+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: parsed entry: id=00000000002.49.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18/obj00000000000000000003 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: entry->timestamp=2024-04-16T18:17:57.591239+0000 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.49.6 op=0 op_state=1 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000003]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000003[0] 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position=00000000002.49.6 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: parsed entry: id=00000000002.71.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20/obj00000000000000000010 2024-04-16T18:18:00.916 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: entry->timestamp=2024-04-16T18:17:57.327803+0000 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.71.6 op=0 op_state=1 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000010]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000010[0] 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position=00000000002.71.6 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000015]: success 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.898+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10:4 marker=00000000002.80.6 timestamp=2024-04-16T18:17:57.661273+0000 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.899+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: a sync operation returned error 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.899+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: backing out with sync_status=-5 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.899+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: parsed entry: id=00000000002.53.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22/obj00000000000000000009 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: entry->timestamp=2024-04-16T18:17:57.730879+0000 2024-04-16T18:18:00.917 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.53.6 op=0 op_state=1 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000009]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000009[0] 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position=00000000002.53.6 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: parsed entry: id=00000000002.94.6 iter->object=obj00000000000000000025 iter->instance= name=obj00000000000000000025 instance= ns= 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23/obj00000000000000000025 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: entry->timestamp=2024-04-16T18:17:57.602638+0000 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000025]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.94.6 op=0 op_state=1 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000025]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000025[0] 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position=00000000002.94.6 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: parsed entry: id=00000000002.62.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-16T18:18:00.918 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25/obj00000000000000000000 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: entry->timestamp=2024-04-16T18:17:57.579192+0000 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.62.6 op=0 op_state=1 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: parsed entry: id=00000000002.72.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24/obj00000000000000000016 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: entry->timestamp=2024-04-16T18:17:57.277556+0000 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.72.6 op=0 op_state=1 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: parsed entry: id=00000000001.43.6 iter->object=obj00000000000000000042 iter->instance= name=obj00000000000000000042 instance= ns= 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19/obj00000000000000000042 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: entry->timestamp=2024-04-16T18:17:57.215258+0000 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000042]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.43.6 op=0 op_state=1 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000000]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000000[0] 2024-04-16T18:18:00.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: listing bilog for incremental sync; position=00000000002.62.6 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000016]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000016[0] 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: listing bilog for incremental sync; position=00000000002.72.6 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000042]: : injecting data sync error on key=obj00000000000000000042 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position=00000000001.43.6 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: parsed entry: id=00000000002.156.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28/obj00000000000000000021 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: entry->timestamp=2024-04-16T18:17:57.203461+0000 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.156.6 op=0 op_state=1 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: parsed entry: id=00000000002.47.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27/obj00000000000000000030 2024-04-16T18:18:00.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: entry->timestamp=2024-04-16T18:17:57.470644+0000 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.47.6 op=0 op_state=1 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000042]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000042]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19/obj00000000000000000042 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000021]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000021[0] 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: listing bilog for incremental sync; position=00000000002.156.6 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: parsed entry: id=00000000002.68.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26/obj00000000000000000014 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.900+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: entry->timestamp=2024-04-16T18:17:57.719448+0000 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.68.6 op=0 op_state=1 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000030]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000030[0] 2024-04-16T18:18:00.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: listing bilog for incremental sync; position=00000000002.47.6 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000014]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000014[0] 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: listing bilog for incremental sync; position=00000000002.68.6 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000003]: success 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18:4 marker=00000000002.49.6 timestamp=2024-04-16T18:17:57.591239+0000 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000010]: success 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20:4 marker=00000000002.71.6 timestamp=2024-04-16T18:17:57.327803+0000 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000031]: success 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.901+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11:4 marker=00000000001.74.6 timestamp=2024-04-16T18:17:57.531449+0000 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.902+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000022]: success 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.902+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12:4 marker=00000000002.43.6 timestamp=2024-04-16T18:17:57.134878+0000 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.902+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000025]: success 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23:4 marker=00000000002.94.6 timestamp=2024-04-16T18:17:57.602638+0000 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000009]: success 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22:4 marker=00000000002.53.6 timestamp=2024-04-16T18:17:57.730879+0000 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000016]: success 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24:4 marker=00000000002.72.6 timestamp=2024-04-16T18:17:57.277556+0000 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000000]: success 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.903+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25:4 marker=00000000002.62.6 timestamp=2024-04-16T18:17:57.579192+0000 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.904+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000030]: success 2024-04-16T18:18:00.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.904+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27:4 marker=00000000002.47.6 timestamp=2024-04-16T18:17:57.470644+0000 2024-04-16T18:18:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.904+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000021]: success 2024-04-16T18:18:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.904+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28:4 marker=00000000002.156.6 timestamp=2024-04-16T18:17:57.203461+0000 2024-04-16T18:18:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.904+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000014]: success 2024-04-16T18:18:00.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.904+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26:4 marker=00000000002.68.6 timestamp=2024-04-16T18:17:57.719448+0000 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: parsed entry: id=00000000001.44.6 iter->object=obj00000000000000000059 iter->instance= name=obj00000000000000000059 instance= ns= 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000059 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: entry->timestamp=2024-04-16T18:17:57.521340+0000 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000059]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.44.6 op=0 op_state=1 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: parsed entry: id=00000000002.63.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6/obj00000000000000000019 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: entry->timestamp=2024-04-16T18:17:57.672837+0000 2024-04-16T18:18:00.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.63.6 op=0 op_state=1 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: parsed entry: id=00000000002.80.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3/obj00000000000000000004 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: entry->timestamp=2024-04-16T18:17:57.792935+0000 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.80.6 op=0 op_state=1 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: parsed entry: id=00000000001.66.6 iter->object=obj00000000000000000027 iter->instance= name=obj00000000000000000027 instance= ns= 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2/obj00000000000000000027 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: entry->timestamp=2024-04-16T18:17:57.339789+0000 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000027]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.66.6 op=0 op_state=1 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: parsed entry: id=00000000002.45.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5/obj00000000000000000002 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: entry->timestamp=2024-04-16T18:17:57.144817+0000 2024-04-16T18:18:00.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.45.6 op=0 op_state=1 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000059]: : injecting data sync error on key=obj00000000000000000059 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000001.44.6 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000019]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000019[0] 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position=00000000002.63.6 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000004]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000004[0] 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position=00000000002.80.6 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000027]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000027[0] 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position=00000000001.66.6 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000002]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000002[0] 2024-04-16T18:18:00.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position=00000000002.45.6 2024-04-16T18:18:00.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000059]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:00.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.933+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000059]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000059 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.934+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: parsed entry: id=00000000001.74.6 iter->object=obj00000000000000000037 iter->instance= name=obj00000000000000000037 instance= ns= 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.934+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15/obj00000000000000000037 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.934+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: entry->timestamp=2024-04-16T18:17:57.388713+0000 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.934+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000037]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.74.6 op=0 op_state=1 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.934+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000037]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000037[0] 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.934+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position=00000000001.74.6 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.935+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: parsed entry: id=00000000002.61.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.935+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000005 2024-04-16T18:18:00.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.935+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: entry->timestamp=2024-04-16T18:17:57.123263+0000 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.935+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.61.6 op=0 op_state=1 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.935+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000005]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000005[0] 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.935+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position=00000000002.61.6 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: parsed entry: id=00000000002.78.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000012 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: entry->timestamp=2024-04-16T18:17:57.447560+0000 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.78.6 op=0 op_state=1 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: parsed entry: id=00000000002.65.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14/obj00000000000000000020 2024-04-16T18:18:00.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: entry->timestamp=2024-04-16T18:17:57.742231+0000 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.65.6 op=0 op_state=1 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000012]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000012[0] 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position=00000000002.78.6 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000020]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000020[0] 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position=00000000002.65.6 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000019]: success 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6:4 marker=00000000002.63.6 timestamp=2024-04-16T18:17:57.672837+0000 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: a sync operation returned error 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: backing out with sync_status=-5 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000004]: success 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.936+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3:4 marker=00000000002.80.6 timestamp=2024-04-16T18:17:57.792935+0000 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.937+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000002]: success 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.937+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5:4 marker=00000000002.45.6 timestamp=2024-04-16T18:17:57.144817+0000 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.937+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000005]: success 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.937+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16:4 marker=00000000002.61.6 timestamp=2024-04-16T18:17:57.123263+0000 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.938+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.938+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000012]: success 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.938+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17:4 marker=00000000002.78.6 timestamp=2024-04-16T18:17:57.447560+0000 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.938+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.938+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.938+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000020]: success 2024-04-16T18:18:00.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.938+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14:4 marker=00000000002.65.6 timestamp=2024-04-16T18:17:57.742231+0000 2024-04-16T18:18:00.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.939+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: parsed entry: id=00000000002.64.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-16T18:18:00.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.939+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21/obj00000000000000000001 2024-04-16T18:18:00.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.939+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: entry->timestamp=2024-04-16T18:17:57.191711+0000 2024-04-16T18:18:00.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.939+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.64.6 op=0 op_state=1 2024-04-16T18:18:00.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.939+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000001]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000001[0] 2024-04-16T18:18:00.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.939+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position=00000000002.64.6 2024-04-16T18:18:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.940+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:entry[obj00000000000000000027]: success 2024-04-16T18:18:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.940+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2:4 marker=00000000001.66.6 timestamp=2024-04-16T18:17:57.339789+0000 2024-04-16T18:18:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000001]: success 2024-04-16T18:18:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21:4 marker=00000000002.64.6 timestamp=2024-04-16T18:17:57.191711+0000 2024-04-16T18:18:00.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000017]: success 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8:4 marker=00000000001.52.6 timestamp=2024-04-16T18:17:57.399556+0000 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000001.76.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000008 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:57.263535+0000 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.76.6 op=0 op_state=1 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000008]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000008[0] 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.941+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000001.76.6 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.942+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000037]: success 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.942+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15:4 marker=00000000001.74.6 timestamp=2024-04-16T18:17:57.388713+0000 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.944+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: a sync operation returned error 2024-04-16T18:18:00.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.944+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: backing out with sync_status=-5 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.944+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.944+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.945+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000002.73.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.945+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000013 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.945+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:17:57.458618+0000 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.945+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.73.6 op=0 op_state=1 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.945+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000013]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000013[0] 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.945+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000002.73.6 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.946+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000008]: success 2024-04-16T18:18:00.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.946+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9:4 marker=00000000001.76.6 timestamp=2024-04-16T18:17:57.263535+0000 2024-04-16T18:18:00.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.947+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000013]: success 2024-04-16T18:18:00.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.947+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13:4 marker=00000000002.73.6 timestamp=2024-04-16T18:17:57.458618+0000 2024-04-16T18:18:00.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.948+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.948+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket shard: 0 2024-04-16T18:18:00.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.948+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.976+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: a sync operation returned error 2024-04-16T18:18:00.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.976+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: backing out with sync_status=-5 2024-04-16T18:18:00.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.976+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:00.975 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.976+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:00.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.977+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:00.976 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.977+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:00.977 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.977+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:00.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.980+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000001.75.6 iter->object=obj00000000000000000049 iter->instance= name=obj00000000000000000049 instance= ns= 2024-04-16T18:18:00.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.980+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000049 2024-04-16T18:18:00.979 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.980+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:17:57.651491+0000 2024-04-16T18:18:00.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.980+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000049]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.75.6 op=0 op_state=1 2024-04-16T18:18:00.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.980+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000049]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000049[0] 2024-04-16T18:18:00.980 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.980+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000001.75.6 2024-04-16T18:18:00.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.984+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000049]: success 2024-04-16T18:18:00.984 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.984+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7:4 marker=00000000001.75.6 timestamp=2024-04-16T18:17:57.651491+0000 2024-04-16T18:18:00.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.990+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: parsed entry: id=00000000001.43.6 iter->object=obj00000000000000000042 iter->instance= name=obj00000000000000000042 instance= ns= 2024-04-16T18:18:00.989 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.990+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19/obj00000000000000000042 2024-04-16T18:18:00.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.990+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: entry->timestamp=2024-04-16T18:17:57.215258+0000 2024-04-16T18:18:00.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.990+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000042]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.43.6 op=0 op_state=1 2024-04-16T18:18:00.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.990+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000042]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000042[0] 2024-04-16T18:18:00.990 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.990+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position=00000000001.43.6 2024-04-16T18:18:00.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.994+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000042]: success 2024-04-16T18:18:00.994 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:00.994+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19:4 marker=00000000001.43.6 timestamp=2024-04-16T18:17:57.215258+0000 2024-04-16T18:18:01.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.020+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: parsed entry: id=00000000001.44.6 iter->object=obj00000000000000000059 iter->instance= name=obj00000000000000000059 instance= ns= 2024-04-16T18:18:01.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.020+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000059 2024-04-16T18:18:01.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.020+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: entry->timestamp=2024-04-16T18:17:57.521340+0000 2024-04-16T18:18:01.019 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.020+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000059]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.44.6 op=0 op_state=1 2024-04-16T18:18:01.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.020+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000059]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000059[0] 2024-04-16T18:18:01.020 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.020+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000001.44.6 2024-04-16T18:18:01.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.025+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000059]: success 2024-04-16T18:18:01.024 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.025+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1:4 marker=00000000001.44.6 timestamp=2024-04-16T18:17:57.521340+0000 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.067+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.067+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.067+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.067+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket shard: 0 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.067+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.067+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.067+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.081 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket shard: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket shard: 0 2024-04-16T18:18:01.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.068+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket shard: 0 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket shard: 0 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket shard: 0 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.083 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: parsed entry: id=00000000002.75.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1/obj00000000000000000006 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: entry->timestamp=2024-04-16T18:17:58.580775+0000 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.75.6 op=0 op_state=1 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000006]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000006[0] 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position=00000000002.75.6 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.069+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.084 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: parsed entry: id=00000000001.60.6 iter->object=obj00000000000000000056 iter->instance= name=obj00000000000000000056 instance= ns= 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4/obj00000000000000000056 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: entry->timestamp=2024-04-16T18:17:58.831272+0000 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000056]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.60.6 op=0 op_state=1 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000056]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000056[0] 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position=00000000001.60.6 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket shard: 0 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.070+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.085 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket shard: 0 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: parsed entry: id=00000000002.84.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3/obj00000000000000000005 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: entry->timestamp=2024-04-16T18:17:58.123478+0000 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.84.6 op=0 op_state=1 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000005]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000005[0] 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position=00000000002.84.6 2024-04-16T18:18:01.086 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000002.66.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000000 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:58.246384+0000 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.66.6 op=0 op_state=1 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000000]: : injecting data sync error on key=obj00000000000000000000 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000002.66.6 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: parsed entry: id=00000000002.58.6 iter->object=obj00000000000000000022 iter->instance= name=obj00000000000000000022 instance= ns= 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8/obj00000000000000000022 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: entry->timestamp=2024-04-16T18:17:58.771672+0000 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000022]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.58.6 op=0 op_state=1 2024-04-16T18:18:01.087 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket shard: 0 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000000]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000000]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000000 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000022]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000022[0] 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position=00000000002.58.6 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket shard: 0 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.071+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.088 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket shard: 0 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:entry[obj00000000000000000006]: success 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1:5 marker=00000000002.75.6 timestamp=2024-04-16T18:17:58.580775+0000 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket shard: 0 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.072+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:01.089 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket shard: 0 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket shard: 0 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket shard: 0 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket shard: 0 2024-04-16T18:18:01.090 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.073+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: parsed entry: id=00000000001.68.6 iter->object=obj00000000000000000271 iter->instance= name=obj00000000000000000271 instance= ns= 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12/obj00000000000000000271 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: entry->timestamp=2024-04-16T18:17:58.183693+0000 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000271]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.68.6 op=0 op_state=1 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000005]: success 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3:5 marker=00000000002.84.6 timestamp=2024-04-16T18:17:58.123478+0000 2024-04-16T18:18:01.091 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000271]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000271[0] 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position=00000000001.68.6 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: a sync operation returned error 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: backing out with sync_status=-5 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: sync status for source bucket shard: 0 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket shard: 0 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.074+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: sync status for source bucket shard: 0 2024-04-16T18:18:01.092 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: sync status for source bucket shard: 0 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: sync status for source bucket shard: 0 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: sync status for source bucket shard: 0 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.075+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: sync status for source bucket shard: 0 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: parsed entry: id=00000000002.50.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-16T18:18:01.093 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15/obj00000000000000000007 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: entry->timestamp=2024-04-16T18:17:58.687445+0000 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.50.6 op=0 op_state=1 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000022]: success 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8:5 marker=00000000002.58.6 timestamp=2024-04-16T18:17:58.771672+0000 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000007]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000007[0] 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position=00000000002.50.6 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: parsed entry: id=00000000002.34.6 iter->object=obj00000000000000000018 iter->instance= name=obj00000000000000000018 instance= ns= 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14/obj00000000000000000018 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: entry->timestamp=2024-04-16T18:17:58.699120+0000 2024-04-16T18:18:01.094 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000018]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.34.6 op=0 op_state=1 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: sync status for source bucket shard: 0 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000018]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000018[0] 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position=00000000002.34.6 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: parsed entry: id=00000000002.40.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000017 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: entry->timestamp=2024-04-16T18:17:58.435448+0000 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.40.6 op=0 op_state=1 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000002.87.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000008 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:17:58.759366+0000 2024-04-16T18:18:01.095 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.87.6 op=0 op_state=1 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000017]: : injecting data sync error on key=obj00000000000000000017 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position=00000000002.40.6 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: parsed entry: id=00000000002.86.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18/obj00000000000000000016 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: entry->timestamp=2024-04-16T18:17:58.375376+0000 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.86.6 op=0 op_state=1 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000008]: : injecting data sync error on key=obj00000000000000000008 2024-04-16T18:18:01.096 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000002.87.6 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: parsed entry: id=00000000002.70.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22/obj00000000000000000012 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: entry->timestamp=2024-04-16T18:17:58.387736+0000 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.70.6 op=0 op_state=1 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000017]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000017]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000017 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000016]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000016[0] 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position=00000000002.86.6 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000008]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000008]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000008 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000012]: : injecting data sync error on key=obj00000000000000000012 2024-04-16T18:18:01.097 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.076+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position=00000000002.70.6 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.077+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000012]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.077+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000012]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22/obj00000000000000000012 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.077+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000056]: success 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.077+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4:5 marker=00000000001.60.6 timestamp=2024-04-16T18:17:58.831272+0000 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: parsed entry: id=00000000002.80.6 iter->object=obj00000000000000000050 iter->instance= name=obj00000000000000000050 instance= ns= 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28/obj00000000000000000050 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: entry->timestamp=2024-04-16T18:17:58.268419+0000 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000050]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.80.6 op=0 op_state=1 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000050]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000050[0] 2024-04-16T18:18:01.098 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: listing bilog for incremental sync; position=00000000002.80.6 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: parsed entry: id=00000000001.65.6 iter->object=obj00000000000000000029 iter->instance= name=obj00000000000000000029 instance= ns= 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29/obj00000000000000000029 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: entry->timestamp=2024-04-16T18:17:58.194240+0000 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:entry[obj00000000000000000029]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.65.6 op=0 op_state=1 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:entry[obj00000000000000000029]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000029[0] 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: listing bilog for incremental sync; position=00000000001.65.6 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: parsed entry: id=00000000001.57.6 iter->object=obj00000000000000000133 iter->instance= name=obj00000000000000000133 instance= ns= 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30/obj00000000000000000133 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: entry->timestamp=2024-04-16T18:17:58.327273+0000 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.079+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000133]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.57.6 op=0 op_state=1 2024-04-16T18:18:01.099 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000133]: : injecting data sync error on key=obj00000000000000000133 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: listing bilog for incremental sync; position=00000000001.57.6 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000007]: success 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15:5 marker=00000000002.50.6 timestamp=2024-04-16T18:17:58.687445+0000 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000133]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000133]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30/obj00000000000000000133 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: a sync operation returned error 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: a sync operation returned error 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: a sync operation returned error 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: backing out with sync_status=-5 2024-04-16T18:18:01.100 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: backing out with sync_status=-5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: backing out with sync_status=-5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000016]: success 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18:5 marker=00000000002.86.6 timestamp=2024-04-16T18:17:58.375376+0000 2024-04-16T18:18:01.101 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000271]: success 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.080+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12:5 marker=00000000001.68.6 timestamp=2024-04-16T18:17:58.183693+0000 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.081+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.081+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.081+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.081+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.081+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.081+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000050]: success 2024-04-16T18:18:01.102 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.081+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28:5 marker=00000000002.80.6 timestamp=2024-04-16T18:17:58.268419+0000 2024-04-16T18:18:01.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.083+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket shard: 0 2024-04-16T18:18:01.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.083+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.083+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket shard: 0 2024-04-16T18:18:01.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.083+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.084+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000018]: success 2024-04-16T18:18:01.103 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.084+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14:5 marker=00000000002.34.6 timestamp=2024-04-16T18:17:58.699120+0000 2024-04-16T18:18:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.110+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: parsed entry: id=00000000002.49.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-16T18:18:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.110+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0/obj00000000000000000019 2024-04-16T18:18:01.109 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.110+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: entry->timestamp=2024-04-16T18:17:58.567967+0000 2024-04-16T18:18:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.110+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.49.6 op=0 op_state=1 2024-04-16T18:18:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.110+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000019]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000019[0] 2024-04-16T18:18:01.110 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.110+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position=00000000002.49.6 2024-04-16T18:18:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.111+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: parsed entry: id=00000000002.99.6 iter->object=obj00000000000000000023 iter->instance= name=obj00000000000000000023 instance= ns= 2024-04-16T18:18:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.111+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6/obj00000000000000000023 2024-04-16T18:18:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.111+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: entry->timestamp=2024-04-16T18:17:58.258235+0000 2024-04-16T18:18:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.111+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000023]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.99.6 op=0 op_state=1 2024-04-16T18:18:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.111+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000023]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000023[0] 2024-04-16T18:18:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.111+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position=00000000002.99.6 2024-04-16T18:18:01.111 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.112+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000019]: success 2024-04-16T18:18:01.112 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.112+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0:5 marker=00000000002.49.6 timestamp=2024-04-16T18:17:58.567967+0000 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000001.49.6 iter->object=obj00000000000000000317 iter->instance= name=obj00000000000000000317 instance= ns= 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000317 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:17:58.639221+0000 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000317]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.49.6 op=0 op_state=1 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: parsed entry: id=00000000002.84.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10/obj00000000000000000021 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: entry->timestamp=2024-04-16T18:17:58.627659+0000 2024-04-16T18:18:01.113 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.84.6 op=0 op_state=1 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000002.70.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000009 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:17:58.458079+0000 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.70.6 op=0 op_state=1 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000317]: : injecting data sync error on key=obj00000000000000000317 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000001.49.6 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000021]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000021[0] 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position=00000000002.84.6 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000009]: : injecting data sync error on key=obj00000000000000000009 2024-04-16T18:18:01.114 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000002.70.6 2024-04-16T18:18:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000317]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000317]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000317 2024-04-16T18:18:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000009]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.115 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.113+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000009]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000009 2024-04-16T18:18:01.116 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: parsed entry: id=00000000001.77.6 iter->object=obj00000000000000000423 iter->instance= name=obj00000000000000000423 instance= ns= 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20/obj00000000000000000423 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: entry->timestamp=2024-04-16T18:17:58.447251+0000 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000423]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.77.6 op=0 op_state=1 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000423]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000423[0] 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position=00000000001.77.6 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000021]: success 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.115+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10:5 marker=00000000002.84.6 timestamp=2024-04-16T18:17:58.627659+0000 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: parsed entry: id=00000000001.79.6 iter->object=obj00000000000000000162 iter->instance= name=obj00000000000000000162 instance= ns= 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000162 2024-04-16T18:18:01.117 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: entry->timestamp=2024-04-16T18:17:58.879808+0000 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.79.6 op=0 op_state=1 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: : injecting data sync error on key=obj00000000000000000162 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position=00000000001.79.6 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000023]: success 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6:5 marker=00000000002.99.6 timestamp=2024-04-16T18:17:58.258235+0000 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.116+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000162 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.117+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: parsed entry: id=00000000002.84.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.117+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21/obj00000000000000000002 2024-04-16T18:18:01.118 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.117+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: entry->timestamp=2024-04-16T18:17:58.518109+0000 2024-04-16T18:18:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.117+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.84.6 op=0 op_state=1 2024-04-16T18:18:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.117+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000002]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000002[0] 2024-04-16T18:18:01.119 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.117+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position=00000000002.84.6 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: parsed entry: id=00000000002.68.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23/obj00000000000000000001 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: entry->timestamp=2024-04-16T18:17:58.819915+0000 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.68.6 op=0 op_state=1 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000001]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000001[0] 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position=00000000002.68.6 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: parsed entry: id=00000000001.77.6 iter->object=obj00000000000000000061 iter->instance= name=obj00000000000000000061 instance= ns= 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27/obj00000000000000000061 2024-04-16T18:18:01.121 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: entry->timestamp=2024-04-16T18:17:58.709389+0000 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000061]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.77.6 op=0 op_state=1 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: parsed entry: id=00000000002.75.6 iter->object=obj00000000000000000011 iter->instance= name=obj00000000000000000011 instance= ns= 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24/obj00000000000000000011 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: entry->timestamp=2024-04-16T18:17:58.315626+0000 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000011]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.75.6 op=0 op_state=1 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: parsed entry: id=00000000001.36.6 iter->object=obj00000000000000000283 iter->instance= name=obj00000000000000000283 instance= ns= 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25/obj00000000000000000283 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: entry->timestamp=2024-04-16T18:17:58.507818+0000 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000283]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.36.6 op=0 op_state=1 2024-04-16T18:18:01.122 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: parsed entry: id=00000000002.161.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26/obj00000000000000000010 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: entry->timestamp=2024-04-16T18:17:58.135132+0000 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.161.6 op=0 op_state=1 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000061]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000061[0] 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: listing bilog for incremental sync; position=00000000001.77.6 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000011]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000011[0] 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: listing bilog for incremental sync; position=00000000002.75.6 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000002]: success 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21:5 marker=00000000002.84.6 timestamp=2024-04-16T18:17:58.518109+0000 2024-04-16T18:18:01.123 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000283]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000283[0] 2024-04-16T18:18:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: listing bilog for incremental sync; position=00000000001.36.6 2024-04-16T18:18:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000010]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000010[0] 2024-04-16T18:18:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.119+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: listing bilog for incremental sync; position=00000000002.161.6 2024-04-16T18:18:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.120+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000423]: success 2024-04-16T18:18:01.124 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.120+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20:5 marker=00000000001.77.6 timestamp=2024-04-16T18:17:58.447251+0000 2024-04-16T18:18:01.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000002.66.6 iter->object=obj00000000000000000000 iter->instance= name=obj00000000000000000000 instance= ns= 2024-04-16T18:18:01.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000000 2024-04-16T18:18:01.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:58.246384+0000 2024-04-16T18:18:01.127 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000000]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.66.6 op=0 op_state=1 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: a sync operation returned error 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000000]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000000[0] 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000002.66.6 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: backing out with sync_status=-5 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000001]: success 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23:5 marker=00000000002.68.6 timestamp=2024-04-16T18:17:58.819915+0000 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000011]: success 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24:5 marker=00000000002.75.6 timestamp=2024-04-16T18:17:58.315626+0000 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000010]: success 2024-04-16T18:18:01.128 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.122+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26:5 marker=00000000002.161.6 timestamp=2024-04-16T18:17:58.135132+0000 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.123+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000002.87.6 iter->object=obj00000000000000000008 iter->instance= name=obj00000000000000000008 instance= ns= 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000008 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:17:58.759366+0000 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000008]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.87.6 op=0 op_state=1 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000008]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000008[0] 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000002.87.6 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: sync status for source bucket shard: 0 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.124+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000000]: success 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9:5 marker=00000000002.66.6 timestamp=2024-04-16T18:17:58.246384+0000 2024-04-16T18:18:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: parsed entry: id=00000000002.40.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000017 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: entry->timestamp=2024-04-16T18:17:58.435448+0000 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.40.6 op=0 op_state=1 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000017]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000017[0] 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position=00000000002.40.6 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: parsed entry: id=00000000002.70.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22/obj00000000000000000012 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: entry->timestamp=2024-04-16T18:17:58.387736+0000 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.70.6 op=0 op_state=1 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000012]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000012[0] 2024-04-16T18:18:01.130 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.125+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position=00000000002.70.6 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.126+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000008]: success 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.126+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13:5 marker=00000000002.87.6 timestamp=2024-04-16T18:17:58.759366+0000 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000283]: success 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25:5 marker=00000000001.36.6 timestamp=2024-04-16T18:17:58.507818+0000 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:entry[obj00000000000000000029]: success 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29:5 marker=00000000001.65.6 timestamp=2024-04-16T18:17:58.194240+0000 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000017]: success 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16:5 marker=00000000002.40.6 timestamp=2024-04-16T18:17:58.435448+0000 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000012]: success 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.127+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22:5 marker=00000000002.70.6 timestamp=2024-04-16T18:17:58.387736+0000 2024-04-16T18:18:01.131 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.128+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000061]: success 2024-04-16T18:18:01.132 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.128+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27:5 marker=00000000001.77.6 timestamp=2024-04-16T18:17:58.709389+0000 2024-04-16T18:18:01.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: a sync operation returned error 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: a sync operation returned error 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: backing out with sync_status=-5 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: backing out with sync_status=-5 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.156 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.156+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.157+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:01.157 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.157+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.157+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:01.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.157+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.158+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: a sync operation returned error 2024-04-16T18:18:01.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.158+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: backing out with sync_status=-5 2024-04-16T18:18:01.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.158+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.158 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.158+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.159 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.160+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.161+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:01.160 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.161+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.167+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: parsed entry: id=00000000001.57.6 iter->object=obj00000000000000000133 iter->instance= name=obj00000000000000000133 instance= ns= 2024-04-16T18:18:01.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.167+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30/obj00000000000000000133 2024-04-16T18:18:01.166 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.167+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: entry->timestamp=2024-04-16T18:17:58.327273+0000 2024-04-16T18:18:01.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.167+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000133]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.57.6 op=0 op_state=1 2024-04-16T18:18:01.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.167+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000133]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000133[0] 2024-04-16T18:18:01.167 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.167+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: listing bilog for incremental sync; position=00000000001.57.6 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000001.49.6 iter->object=obj00000000000000000317 iter->instance= name=obj00000000000000000317 instance= ns= 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000317 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:17:58.639221+0000 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000317]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.49.6 op=0 op_state=1 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000317]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000317[0] 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000001.49.6 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000002.70.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000009 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:17:58.458079+0000 2024-04-16T18:18:01.199 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.70.6 op=0 op_state=1 2024-04-16T18:18:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000009]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000009[0] 2024-04-16T18:18:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.199+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000002.70.6 2024-04-16T18:18:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.201+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000009]: success 2024-04-16T18:18:01.200 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.201+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11:5 marker=00000000002.70.6 timestamp=2024-04-16T18:17:58.458079+0000 2024-04-16T18:18:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: parsed entry: id=00000000001.79.6 iter->object=obj00000000000000000162 iter->instance= name=obj00000000000000000162 instance= ns= 2024-04-16T18:18:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000162 2024-04-16T18:18:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: entry->timestamp=2024-04-16T18:17:58.879808+0000 2024-04-16T18:18:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.79.6 op=0 op_state=1 2024-04-16T18:18:01.202 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: : injecting data sync error on key=obj00000000000000000162 2024-04-16T18:18:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position=00000000001.79.6 2024-04-16T18:18:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.203+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000162 2024-04-16T18:18:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.204+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000317]: success 2024-04-16T18:18:01.203 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.204+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7:5 marker=00000000001.49.6 timestamp=2024-04-16T18:17:58.639221+0000 2024-04-16T18:18:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.214+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000133]: success 2024-04-16T18:18:01.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.214+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30:5 marker=00000000001.57.6 timestamp=2024-04-16T18:17:58.327273+0000 2024-04-16T18:18:01.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.245+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: a sync operation returned error 2024-04-16T18:18:01.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.245+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: backing out with sync_status=-5 2024-04-16T18:18:01.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.245+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.244 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.245+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.246+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.246+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:01.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.246+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: parsed entry: id=00000000001.79.6 iter->object=obj00000000000000000162 iter->instance= name=obj00000000000000000162 instance= ns= 2024-04-16T18:18:01.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000162 2024-04-16T18:18:01.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: entry->timestamp=2024-04-16T18:17:58.879808+0000 2024-04-16T18:18:01.287 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.79.6 op=0 op_state=1 2024-04-16T18:18:01.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: : injecting data sync error on key=obj00000000000000000162 2024-04-16T18:18:01.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position=00000000001.79.6 2024-04-16T18:18:01.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.288+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000162 2024-04-16T18:18:01.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.330+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: a sync operation returned error 2024-04-16T18:18:01.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.330+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: backing out with sync_status=-5 2024-04-16T18:18:01.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.330+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.329 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.330+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.330+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.331+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:01.330 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.331+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.373+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: parsed entry: id=00000000001.79.6 iter->object=obj00000000000000000162 iter->instance= name=obj00000000000000000162 instance= ns= 2024-04-16T18:18:01.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.373+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000162 2024-04-16T18:18:01.372 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.373+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: entry->timestamp=2024-04-16T18:17:58.879808+0000 2024-04-16T18:18:01.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.373+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.79.6 op=0 op_state=1 2024-04-16T18:18:01.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.373+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000162[0] 2024-04-16T18:18:01.373 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.373+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position=00000000001.79.6 2024-04-16T18:18:01.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.379+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000162]: success 2024-04-16T18:18:01.379 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.379+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17:5 marker=00000000001.79.6 timestamp=2024-04-16T18:17:58.879808+0000 2024-04-16T18:18:01.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.420+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.420+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: sync status for source bucket shard: 0 2024-04-16T18:18:01.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.420+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.420+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.422 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: sync status for source bucket shard: 0 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:1]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: sync status for source bucket shard: 0 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: sync status for source bucket shard: 0 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: sync status for source bucket shard: 0 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:2]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: sync status for source bucket shard: 0 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.421+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: sync status for source bucket shard: 0 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: sync status for source bucket shard: 0 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: sync status for source bucket shard: 0 2024-04-16T18:18:01.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: sync status for source bucket shard: 0 2024-04-16T18:18:01.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.422+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.425 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: sync status for source bucket shard: 0 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: sync status for source bucket shard: 0 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: parsed entry: id=00000000002.63.6 iter->object=obj00000000000000000001 iter->instance= name=obj00000000000000000001 instance= ns= 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3/obj00000000000000000001 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: entry->timestamp=2024-04-16T18:17:59.940151+0000 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.423+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000001]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.63.6 op=0 op_state=1 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000001]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000001[0] 2024-04-16T18:18:01.440 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: listing bilog for incremental sync; position=00000000002.63.6 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: parsed entry: id=00000000002.85.6 iter->object=obj00000000000000000005 iter->instance= name=obj00000000000000000005 instance= ns= 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6/obj00000000000000000005 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: entry->timestamp=2024-04-16T18:17:59.515328+0000 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000005]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.85.6 op=0 op_state=1 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: parsed entry: id=00000000002.61.6 iter->object=obj00000000000000000033 iter->instance= name=obj00000000000000000033 instance= ns= 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4/obj00000000000000000033 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: entry->timestamp=2024-04-16T18:17:59.443653+0000 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000033]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.61.6 op=0 op_state=1 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000005]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000005[0] 2024-04-16T18:18:01.441 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: listing bilog for incremental sync; position=00000000002.85.6 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000033]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000033[0] 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: listing bilog for incremental sync; position=00000000002.61.6 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: parsed entry: id=00000000002.75.6 iter->object=obj00000000000000000016 iter->instance= name=obj00000000000000000016 instance= ns= 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7/obj00000000000000000016 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: entry->timestamp=2024-04-16T18:18:00.068281+0000 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000016]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.75.6 op=0 op_state=1 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000016]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000016[0] 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: listing bilog for incremental sync; position=00000000002.75.6 2024-04-16T18:18:01.442 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: parsed entry: id=00000000001.86.6 iter->object=obj00000000000000000065 iter->instance= name=obj00000000000000000065 instance= ns= 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5/obj00000000000000000065 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: entry->timestamp=2024-04-16T18:17:59.504122+0000 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000065]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.86.6 op=0 op_state=1 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.424+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000065]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000065[0] 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: listing bilog for incremental sync; position=00000000001.86.6 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: parsed entry: id=00000000001.165.6 iter->object=obj00000000000000000048 iter->instance= name=obj00000000000000000048 instance= ns= 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8/obj00000000000000000048 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: entry->timestamp=2024-04-16T18:17:59.683498+0000 2024-04-16T18:18:01.443 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000048]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.165.6 op=0 op_state=1 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: sync status for source bucket shard: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000048]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000048[0] 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: listing bilog for incremental sync; position=00000000001.165.6 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.425+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: sync status for source bucket shard: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: sync status for source bucket shard: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: sync status for source bucket shard: 0 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: sync status for source bucket shard: 0 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: sync status for source bucket shard: 0 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: sync status for source bucket shard: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.426+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: sync status for source bucket shard: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: sync status for source bucket shard: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket shard: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: sync status for source bucket shard: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket shard: 0 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.446 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: sync status for source bucket shard: 0 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.427+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: sync status for source bucket shard: 0 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:entry[obj00000000000000000001]: success 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:3:6 marker=00000000002.63.6 timestamp=2024-04-16T18:17:59.940151+0000 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: sync status for source bucket shard: 0 2024-04-16T18:18:01.447 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:entry[obj00000000000000000005]: success 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:6:6 marker=00000000002.85.6 timestamp=2024-04-16T18:17:59.515328+0000 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: sync status for source bucket shard: 0 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: sync status for source bucket shard: 0 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:entry[obj00000000000000000033]: success 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:4:6 marker=00000000002.61.6 timestamp=2024-04-16T18:17:59.443653+0000 2024-04-16T18:18:01.448 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:entry[obj00000000000000000016]: success 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:7:6 marker=00000000002.75.6 timestamp=2024-04-16T18:18:00.068281+0000 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:36]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: sync status for source bucket shard: 0 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.428+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: sync status for source bucket shard: 0 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.429+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.429+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: sync status for source bucket shard: 0 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: parsed entry: id=00000000001.88.6 iter->object=obj00000000000000000062 iter->instance= name=obj00000000000000000062 instance= ns= 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12/obj00000000000000000062 2024-04-16T18:18:01.449 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: entry->timestamp=2024-04-16T18:18:00.004168+0000 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000062]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.88.6 op=0 op_state=1 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: sync status for source bucket shard: 0 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: sync status for source bucket shard: 0 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000062]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000062[0] 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: listing bilog for incremental sync; position=00000000001.88.6 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.430+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: sync status for source bucket shard: 0 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: parsed entry: id=00000000002.77.6 iter->object=obj00000000000000000040 iter->instance= name=obj00000000000000000040 instance= ns= 2024-04-16T18:18:01.450 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14/obj00000000000000000040 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: entry->timestamp=2024-04-16T18:17:59.324049+0000 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000040]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.77.6 op=0 op_state=1 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: sync status for source bucket shard: 0 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000040]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000040[0] 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: listing bilog for incremental sync; position=00000000002.77.6 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: parsed entry: id=00000000002.54.6 iter->object=obj00000000000000000024 iter->instance= name=obj00000000000000000024 instance= ns= 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15/obj00000000000000000024 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: entry->timestamp=2024-04-16T18:17:59.564292+0000 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000024]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.54.6 op=0 op_state=1 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: parsed entry: id=00000000002.93.6 iter->object=obj00000000000000000002 iter->instance= name=obj00000000000000000002 instance= ns= 2024-04-16T18:18:01.451 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17/obj00000000000000000002 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: entry->timestamp=2024-04-16T18:17:59.394560+0000 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000002]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.93.6 op=0 op_state=1 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: parsed entry: id=00000000002.92.6 iter->object=obj00000000000000000012 iter->instance= name=obj00000000000000000012 instance= ns= 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16/obj00000000000000000012 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: entry->timestamp=2024-04-16T18:18:00.081596+0000 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000012]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.92.6 op=0 op_state=1 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000024]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000024[0] 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: listing bilog for incremental sync; position=00000000002.54.6 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000002]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000002[0] 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.431+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: listing bilog for incremental sync; position=00000000002.93.6 2024-04-16T18:18:01.452 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000012]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000012[0] 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: listing bilog for incremental sync; position=00000000002.92.6 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: parsed entry: id=00000000002.80.6 iter->object=obj00000000000000000045 iter->instance= name=obj00000000000000000045 instance= ns= 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19/obj00000000000000000045 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: entry->timestamp=2024-04-16T18:17:59.335609+0000 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000045]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.80.6 op=0 op_state=1 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:36]: sync status for source bucket shard: 0 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: parsed entry: id=00000000002.66.6 iter->object=obj00000000000000000009 iter->instance= name=obj00000000000000000009 instance= ns= 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13/obj00000000000000000009 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: entry->timestamp=2024-04-16T18:18:00.195996+0000 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000009]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.66.6 op=0 op_state=1 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000013 iter->instance= name=obj00000000000000000013 instance= ns= 2024-04-16T18:18:01.453 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18/obj00000000000000000013 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: entry->timestamp=2024-04-16T18:17:59.455563+0000 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000013]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000045]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000045[0] 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: listing bilog for incremental sync; position=00000000002.80.6 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: parsed entry: id=00000000002.54.6 iter->object=obj00000000000000000007 iter->instance= name=obj00000000000000000007 instance= ns= 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22/obj00000000000000000007 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: entry->timestamp=2024-04-16T18:17:59.263928+0000 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000007]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.54.6 op=0 op_state=1 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: parsed entry: id=00000000002.78.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21/obj00000000000000000017 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: entry->timestamp=2024-04-16T18:17:59.275429+0000 2024-04-16T18:18:01.454 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.78.6 op=0 op_state=1 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:36]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:36]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000009]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000009[0] 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: listing bilog for incremental sync; position=00000000002.66.6 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000013]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000013[0] 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000007]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000007[0] 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: listing bilog for incremental sync; position=00000000002.54.6 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000017]: : injecting data sync error on key=obj00000000000000000017 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position=00000000002.78.6 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: parsed entry: id=00000000002.95.6 iter->object=obj00000000000000000010 iter->instance= name=obj00000000000000000010 instance= ns= 2024-04-16T18:18:01.455 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25/obj00000000000000000010 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: entry->timestamp=2024-04-16T18:17:59.635663+0000 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.432+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000010]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.95.6 op=0 op_state=1 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.433+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000017]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.433+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000017]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21/obj00000000000000000017 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.433+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000010]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000010[0] 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.433+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: listing bilog for incremental sync; position=00000000002.95.6 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.433+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:entry[obj00000000000000000048]: success 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.433+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:8:6 marker=00000000001.165.6 timestamp=2024-04-16T18:17:59.683498+0000 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.434+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:entry[obj00000000000000000065]: success 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.434+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:5:6 marker=00000000001.86.6 timestamp=2024-04-16T18:17:59.504122+0000 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: parsed entry: id=00000000002.88.6 iter->object=obj00000000000000000018 iter->instance= name=obj00000000000000000018 instance= ns= 2024-04-16T18:18:01.456 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35/obj00000000000000000018 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: entry->timestamp=2024-04-16T18:17:59.771847+0000 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:entry[obj00000000000000000018]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.88.6 op=0 op_state=1 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:entry[obj00000000000000000018]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000018[0] 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: listing bilog for incremental sync; position=00000000002.88.6 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: parsed entry: id=00000000001.73.6 iter->object=obj00000000000000000057 iter->instance= name=obj00000000000000000057 instance= ns= 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34/obj00000000000000000057 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: entry->timestamp=2024-04-16T18:17:59.383780+0000 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:entry[obj00000000000000000057]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.73.6 op=0 op_state=1 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:entry[obj00000000000000000057]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000057[0] 2024-04-16T18:18:01.457 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.435+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: listing bilog for incremental sync; position=00000000001.73.6 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.436+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:entry[obj00000000000000000009]: success 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.436+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:13:6 marker=00000000002.66.6 timestamp=2024-04-16T18:18:00.195996+0000 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.436+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:entry[obj00000000000000000013]: success 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.436+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:18:6 marker=00000000002.41.6 timestamp=2024-04-16T18:17:59.455563+0000 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.436+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:entry[obj00000000000000000040]: success 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.436+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:14:6 marker=00000000002.77.6 timestamp=2024-04-16T18:17:59.324049+0000 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:entry[obj00000000000000000002]: success 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:17:6 marker=00000000002.93.6 timestamp=2024-04-16T18:17:59.394560+0000 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: a sync operation returned error 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:entry[obj00000000000000000010]: success 2024-04-16T18:18:01.458 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:25:6 marker=00000000002.95.6 timestamp=2024-04-16T18:17:59.635663+0000 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:entry[obj00000000000000000012]: success 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:16:6 marker=00000000002.92.6 timestamp=2024-04-16T18:18:00.081596+0000 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: backing out with sync_status=-5 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:entry[obj00000000000000000007]: success 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:22:6 marker=00000000002.54.6 timestamp=2024-04-16T18:17:59.263928+0000 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:entry[obj00000000000000000024]: success 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:15:6 marker=00000000002.54.6 timestamp=2024-04-16T18:17:59.564292+0000 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:entry[obj00000000000000000045]: success 2024-04-16T18:18:01.459 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.437+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:19:6 marker=00000000002.80.6 timestamp=2024-04-16T18:17:59.335609+0000 2024-04-16T18:18:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.438+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.438+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:entry[obj00000000000000000018]: success 2024-04-16T18:18:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.438+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:35:6 marker=00000000002.88.6 timestamp=2024-04-16T18:17:59.771847+0000 2024-04-16T18:18:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.439+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: sync status for source bucket shard: 0 2024-04-16T18:18:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.439+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.441+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:entry[obj00000000000000000057]: success 2024-04-16T18:18:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.441+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:34:6 marker=00000000001.73.6 timestamp=2024-04-16T18:17:59.383780+0000 2024-04-16T18:18:01.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: parsed entry: id=00000000001.47.6 iter->object=obj00000000000000000060 iter->instance= name=obj00000000000000000060 instance= ns= 2024-04-16T18:18:01.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0/obj00000000000000000060 2024-04-16T18:18:01.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: entry->timestamp=2024-04-16T18:17:59.952294+0000 2024-04-16T18:18:01.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000060]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.47.6 op=0 op_state=1 2024-04-16T18:18:01.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.463+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000060]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000060[0] 2024-04-16T18:18:01.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.463+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: listing bilog for incremental sync; position=00000000001.47.6 2024-04-16T18:18:01.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: parsed entry: id=00000000002.82.6 iter->object=obj00000000000000000015 iter->instance= name=obj00000000000000000015 instance= ns= 2024-04-16T18:18:01.466 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9/obj00000000000000000015 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: entry->timestamp=2024-04-16T18:17:59.893052+0000 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000015]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.82.6 op=0 op_state=1 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000015]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000015[0] 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: listing bilog for incremental sync; position=00000000002.82.6 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: parsed entry: id=00000000002.62.6 iter->object=obj00000000000000000026 iter->instance= name=obj00000000000000000026 instance= ns= 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10/obj00000000000000000026 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: entry->timestamp=2024-04-16T18:17:59.820483+0000 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000026]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.62.6 op=0 op_state=1 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: parsed entry: id=00000000002.77.6 iter->object=obj00000000000000000030 iter->instance= name=obj00000000000000000030 instance= ns= 2024-04-16T18:18:01.467 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11/obj00000000000000000030 2024-04-16T18:18:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: entry->timestamp=2024-04-16T18:18:00.207764+0000 2024-04-16T18:18:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000030]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.77.6 op=0 op_state=1 2024-04-16T18:18:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000026]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000026[0] 2024-04-16T18:18:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: listing bilog for incremental sync; position=00000000002.62.6 2024-04-16T18:18:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000030]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000030[0] 2024-04-16T18:18:01.468 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.466+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: listing bilog for incremental sync; position=00000000002.77.6 2024-04-16T18:18:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.468+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:entry[obj00000000000000000060]: success 2024-04-16T18:18:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.468+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:0:6 marker=00000000001.47.6 timestamp=2024-04-16T18:17:59.952294+0000 2024-04-16T18:18:01.469 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.468+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:entry[obj00000000000000000026]: success 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.468+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:10:6 marker=00000000002.62.6 timestamp=2024-04-16T18:17:59.820483+0000 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.469+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:entry[obj00000000000000000030]: success 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.469+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:11:6 marker=00000000002.77.6 timestamp=2024-04-16T18:18:00.207764+0000 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.469+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:entry[obj00000000000000000015]: success 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.469+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:9:6 marker=00000000002.82.6 timestamp=2024-04-16T18:17:59.893052+0000 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: parsed entry: id=00000000002.84.6 iter->object=obj00000000000000000039 iter->instance= name=obj00000000000000000039 instance= ns= 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23/obj00000000000000000039 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: entry->timestamp=2024-04-16T18:18:00.148588+0000 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000039]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.84.6 op=0 op_state=1 2024-04-16T18:18:01.470 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000039]: : injecting data sync error on key=obj00000000000000000039 2024-04-16T18:18:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position=00000000002.84.6 2024-04-16T18:18:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000039]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:18:01.471 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.470+0000 7f30eb311800 0 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000039]: ERROR: failed to sync object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23/obj00000000000000000039 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: parsed entry: id=00000000002.59.6 iter->object=obj00000000000000000006 iter->instance= name=obj00000000000000000006 instance= ns= 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20/obj00000000000000000006 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: entry->timestamp=2024-04-16T18:17:59.880531+0000 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000006]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.59.6 op=0 op_state=1 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000006]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000006[0] 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: listing bilog for incremental sync; position=00000000002.59.6 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: parsed entry: id=00000000002.75.6 iter->object=obj00000000000000000027 iter->instance= name=obj00000000000000000027 instance= ns= 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24/obj00000000000000000027 2024-04-16T18:18:01.473 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: entry->timestamp=2024-04-16T18:17:59.694635+0000 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000027]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.75.6 op=0 op_state=1 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000027]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000027[0] 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.471+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: listing bilog for incremental sync; position=00000000002.75.6 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: parsed entry: id=00000000002.99.6 iter->object=obj00000000000000000053 iter->instance= name=obj00000000000000000053 instance= ns= 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27/obj00000000000000000053 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: entry->timestamp=2024-04-16T18:18:00.015487+0000 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000053]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.99.6 op=0 op_state=1 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000053]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000053[0] 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: listing bilog for incremental sync; position=00000000002.99.6 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: parsed entry: id=00000000002.41.6 iter->object=obj00000000000000000021 iter->instance= name=obj00000000000000000021 instance= ns= 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26/obj00000000000000000021 2024-04-16T18:18:01.474 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: entry->timestamp=2024-04-16T18:17:59.759798+0000 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000021]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.41.6 op=0 op_state=1 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: parsed entry: id=00000000002.59.6 iter->object=obj00000000000000000004 iter->instance= name=obj00000000000000000004 instance= ns= 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29/obj00000000000000000004 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: entry->timestamp=2024-04-16T18:17:59.216627+0000 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:entry[obj00000000000000000004]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.59.6 op=0 op_state=1 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000021]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000021[0] 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: listing bilog for incremental sync; position=00000000002.41.6 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:entry[obj00000000000000000004]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000004[0] 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.472+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: listing bilog for incremental sync; position=00000000002.59.6 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.473+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:entry[obj00000000000000000027]: success 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.473+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:24:6 marker=00000000002.75.6 timestamp=2024-04-16T18:17:59.694635+0000 2024-04-16T18:18:01.475 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.473+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:entry[obj00000000000000000006]: success 2024-04-16T18:18:01.476 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.473+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:20:6 marker=00000000002.59.6 timestamp=2024-04-16T18:17:59.880531+0000 2024-04-16T18:18:01.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: parsed entry: id=00000000002.58.6 iter->object=obj00000000000000000020 iter->instance= name=obj00000000000000000020 instance= ns= 2024-04-16T18:18:01.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28/obj00000000000000000020 2024-04-16T18:18:01.478 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: entry->timestamp=2024-04-16T18:18:00.136139+0000 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000020]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.58.6 op=0 op_state=1 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000020]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000020[0] 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: listing bilog for incremental sync; position=00000000002.58.6 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: parsed entry: id=00000000001.44.6 iter->object=obj00000000000000000036 iter->instance= name=obj00000000000000000036 instance= ns= 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30/obj00000000000000000036 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: entry->timestamp=2024-04-16T18:17:59.624389+0000 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000036]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000001.44.6 op=0 op_state=1 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: parsed entry: id=00000000002.56.6 iter->object=obj00000000000000000003 iter->instance= name=obj00000000000000000003 instance= ns= 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31/obj00000000000000000003 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: entry->timestamp=2024-04-16T18:17:59.576105+0000 2024-04-16T18:18:01.479 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:entry[obj00000000000000000003]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.56.6 op=0 op_state=1 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: parsed entry: id=00000000002.97.6 iter->object=obj00000000000000000014 iter->instance= name=obj00000000000000000014 instance= ns= 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32/obj00000000000000000014 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: entry->timestamp=2024-04-16T18:17:59.832359+0000 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:entry[obj00000000000000000014]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.97.6 op=0 op_state=1 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: parsed entry: id=00000000002.77.6 iter->object=obj00000000000000000019 iter->instance= name=obj00000000000000000019 instance= ns= 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33/obj00000000000000000019 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: entry->timestamp=2024-04-16T18:17:59.706832+0000 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:entry[obj00000000000000000019]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.77.6 op=0 op_state=1 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000036]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000036[0] 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: listing bilog for incremental sync; position=00000000001.44.6 2024-04-16T18:18:01.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:entry[obj00000000000000000003]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000003[0] 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: listing bilog for incremental sync; position=00000000002.56.6 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:entry[obj00000000000000000004]: success 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:29:6 marker=00000000002.59.6 timestamp=2024-04-16T18:17:59.216627+0000 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:entry[obj00000000000000000014]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000014[0] 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: listing bilog for incremental sync; position=00000000002.97.6 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:entry[obj00000000000000000021]: success 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:26:6 marker=00000000002.41.6 timestamp=2024-04-16T18:17:59.759798+0000 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:entry[obj00000000000000000019]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000019[0] 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.474+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: listing bilog for incremental sync; position=00000000002.77.6 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:entry[obj00000000000000000020]: success 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:28:6 marker=00000000002.58.6 timestamp=2024-04-16T18:18:00.136139+0000 2024-04-16T18:18:01.481 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:entry[obj00000000000000000053]: success 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:27:6 marker=00000000002.99.6 timestamp=2024-04-16T18:18:00.015487+0000 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:entry[obj00000000000000000003]: success 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:31:6 marker=00000000002.56.6 timestamp=2024-04-16T18:17:59.576105+0000 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:entry[obj00000000000000000014]: success 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:32:6 marker=00000000002.97.6 timestamp=2024-04-16T18:17:59.832359+0000 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:entry[obj00000000000000000019]: success 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.477+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:33:6 marker=00000000002.77.6 timestamp=2024-04-16T18:17:59.706832+0000 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.479+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:entry[obj00000000000000000062]: success 2024-04-16T18:18:01.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.479+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:12:6 marker=00000000001.88.6 timestamp=2024-04-16T18:18:00.004168+0000 2024-04-16T18:18:01.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.480+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:entry[obj00000000000000000036]: success 2024-04-16T18:18:01.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.480+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:30:6 marker=00000000001.44.6 timestamp=2024-04-16T18:17:59.624389+0000 2024-04-16T18:18:01.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.481+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: parsed entry: id=00000000002.78.6 iter->object=obj00000000000000000017 iter->instance= name=obj00000000000000000017 instance= ns= 2024-04-16T18:18:01.483 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.481+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21/obj00000000000000000017 2024-04-16T18:18:01.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.481+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: entry->timestamp=2024-04-16T18:17:59.275429+0000 2024-04-16T18:18:01.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.481+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000017]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.78.6 op=0 op_state=1 2024-04-16T18:18:01.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.481+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000017]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000017[0] 2024-04-16T18:18:01.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.481+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: listing bilog for incremental sync; position=00000000002.78.6 2024-04-16T18:18:01.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.482+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:entry[obj00000000000000000017]: success 2024-04-16T18:18:01.484 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.482+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:21:6 marker=00000000002.78.6 timestamp=2024-04-16T18:17:59.275429+0000 2024-04-16T18:18:01.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.512+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: a sync operation returned error 2024-04-16T18:18:01.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.512+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: backing out with sync_status=-5 2024-04-16T18:18:01.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.512+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: incremental sync on bucket failed, retcode=-5 2024-04-16T18:18:01.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.512+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: ERROR: incremental sync failed. error: -5 2024-04-16T18:18:01.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.512+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:18:01.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.513+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: sync status for source bucket shard: 0 2024-04-16T18:18:01.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.513+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position= 2024-04-16T18:18:01.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.555+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: parsed entry: id=00000000002.84.6 iter->object=obj00000000000000000039 iter->instance= name=obj00000000000000000039 instance= ns= 2024-04-16T18:18:01.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.555+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: syncing object: cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23/obj00000000000000000039 2024-04-16T18:18:01.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.555+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: entry->timestamp=2024-04-16T18:18:00.148588+0000 2024-04-16T18:18:01.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.555+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000039]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=00000000002.84.6 op=0 op_state=1 2024-04-16T18:18:01.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.555+0000 7f30eb311800 5 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000039]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-51[9ba59572-f51c-4bce-9578-e6350e822996.4816.20])/obj00000000000000000039[0] 2024-04-16T18:18:01.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.555+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: listing bilog for incremental sync; position=00000000002.84.6 2024-04-16T18:18:01.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.557+0000 7f30eb311800 10 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:entry[obj00000000000000000039]: success 2024-04-16T18:18:01.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:01.557+0000 7f30eb311800 20 RGW-SYNC:bucket[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20<-cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]:inc_sync[cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23]: updating marker marker_oid=bucket.sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20:23:6 marker=00000000002.84.6 timestamp=2024-04-16T18:18:00.148588+0000 2024-04-16T18:18:01.627 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:01.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:01.627 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket list --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --max-entries 10000 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:01.678 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:01.678 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:01.753 INFO:teuthology.orchestra.run.smithi016.stdout:[{"name":"obj00000000000000000000","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:58.246384Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.4728109061793213518","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000001","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.940151Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.15572693143280603962","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000002","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.394560Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.15856691063000346478","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000003","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.576105Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.3069495550116339714","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000004","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.216627Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.7492832848703938413","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000005","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.515328Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.11113343662264289033","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000006","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.880531Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.12859511338650437642","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000007","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.263928Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.6751428211704475193","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000008","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:58.759366Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10463183486965294704","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000009","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:18:00.195996Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10936046106458769571","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000010","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.635663Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10580015848212412606","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000011","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:58.315626Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.13705684615661522808","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000012","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:18:00.081596Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.9877609692739289111","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000013","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.455563Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.7969651546287155198","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000014","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.832359Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.14184996602073366067","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000015","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.893052Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.14907371017777362563","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000016","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:18:00.068281Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.13211580287495949181","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000017","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.275429Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.6994057019852659124","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000018","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.771847Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17141063699420819919","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000019","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.706832Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.18402111768627212711","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000020","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:18:00.136139Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.8894312558924478422","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000021","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.759798Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.2827199737683415675","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000022","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.771672Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.13410359466429192463","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000023","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.258235Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.2315525149225444586","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000024","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.564292Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.16065514726475507599","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000025","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:57.602638Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.15358220905068579915","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000026","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.820483Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.12617057558231691376","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000027","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.694635Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1174640111388952624","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000028","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:54.855118Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.11491235393518530070","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000029","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:58.194240Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.4221593147383730664","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000030","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:18:00.207764Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.12546039978094183435","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000031","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.531449Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1539113690724406122","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000032","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:56.675841Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.15438501079865521148","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000033","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:59.443653Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.4471447538636537095","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000036","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.624389Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10058090099768910152","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000037","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.388713Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10308736487041332948","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000039","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:18:00.148588Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1424182936833536456","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000040","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.324049Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.8340546426857523218","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000042","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:57.215258Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.6805866620188699214","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000045","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.335609Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.2186056077114429015","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000046","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:56.415556Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.13590551294495406205","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000048","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.683498Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.16110105844646927312","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000049","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.651491Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.12032146656593051888","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000050","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:58.268419Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.3266681560740914597","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000053","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:18:00.015487Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10771552820240009909","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000055","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:56.614380Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.14271725978431124004","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000056","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.831272Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.11365742373398969770","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000057","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:59.383780Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.440271169061556285","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000058","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:56.546296Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.12777212476920034260","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000059","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.521340Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.11819008881605090624","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000060","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.952294Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.18301868914953059018","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000061","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:58.709389Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.7892398756566504256","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000062","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:18:00.004168Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.8243888294757259612","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000065","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.504122Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.4158027288591064288","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000076","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:55.006241Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.10076818133390598916","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000133","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:58.327273Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1532566552405430353","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000162","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.879808Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.15084233814263655822","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000271","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.183693Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.4969994160469466789","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000283","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.507818Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17593389757048508971","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000317","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:58.639221Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.9973986974730292571","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000423","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.447251Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.11405659628634185521","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-16T18:18:01.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:01.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-51', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:01.755 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-51 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:01.806 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:01.806 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:01.876 INFO:teuthology.orchestra.run.smithi139.stdout:[{"name":"obj00000000000000000000","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.246384Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_PXkizfQWWbI9hVlmkpzRRmnFq-4qZfA","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000001","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.940151Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_IhLCM0VXMv_Vj-iPYXTCFXqmV_ehirM","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000002","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.394560Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_4cOUQLgj_0WIyeFXWMoXKvEvGYAmpCL","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000003","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.576105Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_hWhOjQs0jWMmhPVNj16X4TDNgRoX44r","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000004","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:59.216627Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_BzjiGllwJE4PktDdo1qZt7OSGOjopWV","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000005","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.515328Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_bXOl-Mt_W_Fifn7xipAl00HWXZ8Tfvo","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000006","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.880531Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_nG0judD1iNFoQB7zNfMdrA7xkt__Bxa","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000007","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.263928Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_DyDv5tiWci-kY8W7Q5PBzy9BUpNY--_","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000008","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.759366Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_aydrHngNyNbc872543YPHGAWIUHNvze","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000009","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:18:00.195996Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ZthsEkOq5dOcJUDruSCzk80RGZ-1Lmh","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000010","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.635663Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_E50WkqlarL4yHCfEzSCSfaNvqhAbq-j","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000011","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:58.315626Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Jfx2bp7Q8N1UKF41-ZoWd4HK8tXtvD9","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000012","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:18:00.081596Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_spqbxaXOSJroJBF7m5A9Z0oMc8wbmdm","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000013","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:59.455563Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_q9biuP-vYYTz2DbxUcJ-_g-f29FId60","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000014","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.832359Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_NfEBg5AtGJYFFEV_RXV6JaHefa9oan8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000015","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.893052Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_pqC-weJTjs-xUseenqXVzgK9Q-rT5Oc","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000016","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:18:00.068281Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_UXLrjBabYSx5V3cBUUc2yz8TgDZ4w-R","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000017","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:59.275429Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_z78R6w-_25Ru61ovgKeNMFdLdIMFqhs","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000018","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:59.771847Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_xvRfOyg5JbD94T4zO4MHuN8T6c7qzRm","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000019","instance":"","ver":{"pool":9,"epoch":13},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.706832Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_N76XWUUiTka-QlRizLKBxotVTmm66Tm","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000020","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:18:00.136139Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_jyCSbtEr-O5B7ZZB2oeV1hFfJjwO7v_","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000021","instance":"","ver":{"pool":9,"epoch":38},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.759798Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ZR-YqNLYysN4Rygrct6s2JEZEMw2Afn","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000022","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.771672Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_BoqOeAnG5GXzUR9T7l6uEhq6eMcfhJI","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000023","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:58.258235Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_KaqcJo07f7a6rVsGvwYXeC5l_AGWgzH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000024","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:59.564292Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_bDzaFQRkscvNySbHE2YfDKDue9CLH8e","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000025","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:57.602638Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Mknrurmo4lxZRxZlLeKqLxbfZOYiOMf","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000026","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.820483Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_BbMC3YnS9jEZTle3HMDkrOVBShxHwsp","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000027","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.694635Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_BKU89o7ksqr-7CPT5C2p47vQ7eLOWwA","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000028","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:54.855118Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Bg7scrm7udPavElfFjaYWRs8y6Fujoq","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000029","instance":"","ver":{"pool":9,"epoch":1},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.194240Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_v3bYYnisHyLGJ1ARRZVCAMLYXF4GxKZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000030","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:18:00.207764Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_W6XlcrfMSKyUnyp9gx0jcJ6Z3VvdarB","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000031","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.531449Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3IkdANgbaC4RymmYdbAEiHL1mtXhod7","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000032","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:56.675841Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_kGyiLyvVKxckkhBaatpJmGhpnwYjypN","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000033","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.443653Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_G8lUQaJNGG53qlQK3e-MysXEo0WEmE4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000036","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.624389Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Fr9gNbKd2072W1ikaXIWrq3cPEisp9c","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000037","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.388713Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_jcr-RZL44Hf3AH7JZKGpMcYXEoRSTiy","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000039","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:18:00.148588Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_AuK9H1IFtHaupRAMsDnqDVWqHu2j8ua","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000040","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.324049Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_d5TKVUNYXNcSUE1_ViLhJNDn-PWsYxl","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000042","instance":"","ver":{"pool":9,"epoch":14},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.215258Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_8MUsTYo_BiY7zkG0w4vxQ4m8MvYDW7m","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000045","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.335609Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_rp7UwIoeQseebyp9YF6cKudmAHbaa6Z","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000046","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:56.415556Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_pM5nUkJRcOnJPYG65lQewfcQKYJaojp","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000048","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.683498Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3Uw82lF9IKCY-jNmbJ0wkqG616w3zWq","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000049","instance":"","ver":{"pool":9,"epoch":2},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:57.651491Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_CcPqzeXWJB2zo0h5kCH_5EEPgEd8Bt9","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000050","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.268419Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_jyWoZmKTK39dEhyokKrRQGQg015ZrWg","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000053","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:18:00.015487Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3TzgqzzwD10ZF_t449XEtqMOGd136Gm","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000055","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:56.614380Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_9aUfBufwuICj09JFWFKfS5xEks4BxI0","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000056","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.831272Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_MEtThDFegSRW2bS8qYI2eGUTwM4BN10","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000057","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:17:59.383780Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_QbE02u23MAcHMP8Jiz2bPounU3zfwX8","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000058","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:56.546296Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_rABLigbIpcCf6jh3QWy1flYgr8VdC3X","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000059","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:57.521340Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_jD1lbEbizqDyxas79EIbZ_bvAk7RHEH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000060","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:59.952294Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_nZeL96PnDfHe_AB9GNM9nSGbPqLCR98","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000061","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.709389Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_cvTvoh2jI8INaJttXPBIDCavLfhl189","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000062","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:18:00.004168Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_hJPhR1aMb5iAPx4tDwPYLo15WpH2g0-","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000065","instance":"","ver":{"pool":9,"epoch":14},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:59.504122Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_PCX8PYvlLhL1tp35EqfxsV8p3lo8INf","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000076","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:55.006241Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_y4z_73DUaWu0JQJo5PpyTzdYUO0GRZl","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000133","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.327273Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Z71j_MKuGpoTnrPg4iGxSCGgvPbwa2f","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000162","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:58.879808Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ZeB3batiianw7iMW2mmZQkWRsIHJjqu","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000271","instance":"","ver":{"pool":9,"epoch":16},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.183693Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_2PwEww_Sbva9G2P1EAoe6A53nFPVSn0","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000283","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:17:58.507818Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_yIWNRnLyJDfTX24fFAoMUzJOiV3kkrY","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000317","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:17:58.639221Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_JnhH6hmtzkja1qh2FcBs6FQeQlCeQOv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj00000000000000000423","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:17:58.447251Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_hHEnIfce5dG7qXE1wM-2Lsi8j95Hf2m","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-16T18:18:01.876 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:18:01.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:18:01.879 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:18:01.879 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:01.898 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:18:01.898 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:18:01.898 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:18:01.898 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:18:01.898 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:18:02.066 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:18:02.067+0000 7f80efa52880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:18:02.899 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:02.920 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:18:02.920 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:18:02.921 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:18:02.921 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:18:02.922 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-51 2024-04-16T18:18:02.922 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:18:02.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:18:02.922 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-51 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:18:03.022 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:03.022 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:03.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:03.083+0000 7f631c633800 1 bucket sync caught up with source: 2024-04-16T18:18:03.082 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.47.6, , , 00000000002.63.6, 00000000002.61.6, 00000000001.86.6, 00000000002.85.6, 00000000002.75.6, 00000000001.165.6, 00000000002.82.6, 00000000002.62.6, 00000000002.77.6, 00000000001.88.6, 00000000002.66.6, 00000000002.77.6, 00000000002.54.6, 00000000002.92.6, 00000000002.93.6, 00000000002.41.6, 00000000002.80.6, 00000000002.59.6, 00000000002.78.6, 00000000002.54.6, 00000000002.84.6, 00000000002.75.6, 00000000002.95.6, 00000000002.41.6, 00000000002.99.6, 00000000002.58.6, 00000000002.59.6, 00000000001.44.6, 00000000002.56.6, 00000000002.97.6, 00000000002.77.6, 00000000001.73.6, 00000000002.88.6, ] 2024-04-16T18:18:03.082 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.47.6, , , 00000000002.63.6, 00000000002.61.6, 00000000001.86.6, 00000000002.85.6, 00000000002.75.6, 00000000001.165.6, 00000000002.82.6, 00000000002.62.6, 00000000002.77.6, 00000000001.88.6, 00000000002.66.6, 00000000002.77.6, 00000000002.54.6, 00000000002.92.6, 00000000002.93.6, 00000000002.41.6, 00000000002.80.6, 00000000002.59.6, 00000000002.78.6, 00000000002.54.6, 00000000002.84.6, 00000000002.75.6, 00000000002.95.6, 00000000002.41.6, 00000000002.99.6, 00000000002.58.6, 00000000002.59.6, 00000000001.44.6, 00000000002.56.6, 00000000002.97.6, 00000000002.77.6, 00000000001.73.6, 00000000002.88.6, ] 2024-04-16T18:18:03.082 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:03.083+0000 7f631c633800 0 bucket checkpoint complete 2024-04-16T18:18:03.102 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-51 2024-04-16T18:18:03.102 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:18:03.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-51', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:18:03.102 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-51 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:18:03.166 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:03.166 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:03.229 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:18:03.230+0000 7ff238c44800 1 bucket sync caught up with source: 2024-04-16T18:18:03.229 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [00000000005.373.6, 00000000006.660.6, 00000000006.474.6, 00000000010.673.6, 00000000005.389.6, 00000000008.269.6, 00000000008.555.6, 00000000005.525.6, 00000000007.105.6, 00000000007.522.6, 00000000004.521.6] 2024-04-16T18:18:03.229 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [00000000005.373.6, 00000000006.660.6, 00000000006.474.6, 00000000010.673.6, 00000000005.389.6, 00000000008.269.6, 00000000008.555.6, 00000000005.525.6, 00000000007.105.6, 00000000007.522.6, 00000000004.521.6] 2024-04-16T18:18:03.230 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:18:03.230+0000 7ff238c44800 0 bucket checkpoint complete 2024-04-16T18:18:03.252 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-51 zones={test-zone2, test-zone1} 2024-04-16T18:18:03.252 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.252 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.252 DEBUG:boto:Method: HEAD 2024-04-16T18:18:03.252 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:03.252 DEBUG:boto:Data: 2024-04-16T18:18:03.252 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.252 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.253 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.253 DEBUG:boto:Params: {} 2024-04-16T18:18:03.253 DEBUG:boto:Token: None 2024-04-16T18:18:03.253 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/ 2024-04-16T18:18:03.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UxbKIrRwJA8zBzDtYkNdHrc7AOQ= 2024-04-16T18:18:03.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UxbKIrRwJA8zBzDtYkNdHrc7AOQ=', 'Content-Length': '0'} 2024-04-16T18:18:03.254 DEBUG:boto:encountered RemoteDisconnected exception, reconnecting 2024-04-16T18:18:03.254 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:18:03.764 DEBUG:boto:Token: None 2024-04-16T18:18:03.764 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/ 2024-04-16T18:18:03.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UxbKIrRwJA8zBzDtYkNdHrc7AOQ= 2024-04-16T18:18:03.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UxbKIrRwJA8zBzDtYkNdHrc7AOQ=', 'Content-Length': '0'} 2024-04-16T18:18:03.772 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c7633c906ab0d047-00661ec0db-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.772 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.772 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.772 DEBUG:boto:Method: HEAD 2024-04-16T18:18:03.772 DEBUG:boto:Path: /cjqttm-51/ 2024-04-16T18:18:03.773 DEBUG:boto:Data: 2024-04-16T18:18:03.773 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.773 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.773 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.773 DEBUG:boto:Params: {} 2024-04-16T18:18:03.773 DEBUG:boto:Token: None 2024-04-16T18:18:03.773 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/ 2024-04-16T18:18:03.773 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UxbKIrRwJA8zBzDtYkNdHrc7AOQ= 2024-04-16T18:18:03.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UxbKIrRwJA8zBzDtYkNdHrc7AOQ=', 'Content-Length': '0'} 2024-04-16T18:18:03.777 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '61'), ('X-RGW-Bytes-Used', '183'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a6cdca7b061c30d7-00661ec0db-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.777 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:18:03.777 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.777 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.777 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.777 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.777 DEBUG:boto:Method: GET 2024-04-16T18:18:03.778 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.778 DEBUG:boto:Data: 2024-04-16T18:18:03.778 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.778 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.778 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.778 DEBUG:boto:Params: {} 2024-04-16T18:18:03.778 DEBUG:boto:Token: None 2024-04-16T18:18:03.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/?versions 2024-04-16T18:18:03.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A= 2024-04-16T18:18:03.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A=', 'Content-Length': '0'} 2024-04-16T18:18:03.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e130a1dafaf09a4-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.782 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000003nulltrue2024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000007nulltrue2024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000008nulltrue2024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000009nulltrue2024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000014nulltrue2024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000015nulltrue2024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000016nulltrue2024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000017nulltrue2024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000018nulltrue2024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000019nulltrue2024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000020nulltrue2024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000021nulltrue2024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000022nulltrue2024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000023nulltrue2024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000024nulltrue2024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000025nulltrue2024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000026nulltrue2024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000027nulltrue2024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000028nulltrue2024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000029nulltrue2024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000030nulltrue2024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000031nulltrue2024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000032nulltrue2024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000033nulltrue2024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000036nulltrue2024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000037nulltrue2024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000039nulltrue2024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000040nulltrue2024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000042nulltrue2024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000045nulltrue2024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000046nulltrue2024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000048nulltrue2024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000049nulltrue2024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000050nulltrue2024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000053nulltrue2024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000055nulltrue2024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000056nulltrue2024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000057nulltrue2024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000058nulltrue2024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000059nulltrue2024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000060nulltrue2024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000061nulltrue2024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000062nulltrue2024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000065nulltrue2024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000076nulltrue2024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000133nulltrue2024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000162nulltrue2024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000271nulltrue2024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000283nulltrue2024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000317nulltrue2024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000423nulltrue2024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000007 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000008 2024-04-16T18:18:03.785 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000009 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000014 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000015 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000016 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000017 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000018 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000019 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000020 2024-04-16T18:18:03.786 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000021 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000022 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000023 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000024 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000025 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000026 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000027 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000028 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000029 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000030 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000031 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000032 2024-04-16T18:18:03.787 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000033 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000036 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000037 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000039 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000040 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000042 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000045 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000046 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000048 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000049 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000050 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000053 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000055 2024-04-16T18:18:03.788 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000056 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000057 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000058 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000059 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000060 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000061 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000062 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000065 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000076 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000133 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000162 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000271 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000283 2024-04-16T18:18:03.789 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000317 2024-04-16T18:18:03.790 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000423 2024-04-16T18:18:03.790 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:18:03.790 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.790 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.790 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.790 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.790 DEBUG:boto:Method: GET 2024-04-16T18:18:03.790 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.790 DEBUG:boto:Data: 2024-04-16T18:18:03.791 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.791 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.791 DEBUG:boto:Params: {} 2024-04-16T18:18:03.791 DEBUG:boto:Token: None 2024-04-16T18:18:03.791 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/?versions 2024-04-16T18:18:03.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A= 2024-04-16T18:18:03.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A=', 'Content-Length': '0'} 2024-04-16T18:18:03.796 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000515c0c911f0b2ef6-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.796 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000003nulltrue2024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000007nulltrue2024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000008nulltrue2024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000009nulltrue2024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000014nulltrue2024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000015nulltrue2024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000016nulltrue2024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000017nulltrue2024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000018nulltrue2024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000019nulltrue2024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000020nulltrue2024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000021nulltrue2024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000022nulltrue2024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000023nulltrue2024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000024nulltrue2024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000025nulltrue2024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000026nulltrue2024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000027nulltrue2024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000028nulltrue2024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000029nulltrue2024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000030nulltrue2024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000031nulltrue2024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000032nulltrue2024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000033nulltrue2024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000036nulltrue2024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000037nulltrue2024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000039nulltrue2024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000040nulltrue2024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000042nulltrue2024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000045nulltrue2024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000046nulltrue2024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000048nulltrue2024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000049nulltrue2024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000050nulltrue2024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000053nulltrue2024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000055nulltrue2024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000056nulltrue2024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000057nulltrue2024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000058nulltrue2024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000059nulltrue2024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000060nulltrue2024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000061nulltrue2024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000062nulltrue2024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000065nulltrue2024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000076nulltrue2024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000133nulltrue2024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000162nulltrue2024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000271nulltrue2024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000283nulltrue2024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000317nulltrue2024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000423nulltrue2024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:03.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000000 2024-04-16T18:18:03.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000001 2024-04-16T18:18:03.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000002 2024-04-16T18:18:03.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000003 2024-04-16T18:18:03.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000004 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000005 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000006 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000007 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000008 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000009 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000010 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000011 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000012 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000013 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000014 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000015 2024-04-16T18:18:03.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000016 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000017 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000018 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000019 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000020 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000021 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000022 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000023 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000024 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000025 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000026 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000027 2024-04-16T18:18:03.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000028 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000029 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000030 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000031 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000032 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000033 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000036 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000037 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000039 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000040 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000042 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000045 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000046 2024-04-16T18:18:03.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000048 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000049 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000050 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000053 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000055 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000056 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000057 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000058 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000059 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000060 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000061 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000062 2024-04-16T18:18:03.802 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000065 2024-04-16T18:18:03.803 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000076 2024-04-16T18:18:03.803 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000133 2024-04-16T18:18:03.803 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000162 2024-04-16T18:18:03.803 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000271 2024-04-16T18:18:03.803 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000283 2024-04-16T18:18:03.803 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000317 2024-04-16T18:18:03.803 DEBUG:tasks.rgw_multi.zone_rados:o=obj00000000000000000423 2024-04-16T18:18:03.803 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.803 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.803 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.803 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.804 DEBUG:boto:Method: GET 2024-04-16T18:18:03.804 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.804 DEBUG:boto:Data: 2024-04-16T18:18:03.804 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.804 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.804 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.804 DEBUG:boto:Params: {} 2024-04-16T18:18:03.804 DEBUG:boto:Token: None 2024-04-16T18:18:03.804 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/?versions 2024-04-16T18:18:03.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A= 2024-04-16T18:18:03.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A=', 'Content-Length': '0'} 2024-04-16T18:18:03.807 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0306f5d96ffbb07-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.807 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000003nulltrue2024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000007nulltrue2024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000008nulltrue2024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000009nulltrue2024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000014nulltrue2024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000015nulltrue2024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000016nulltrue2024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000017nulltrue2024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000018nulltrue2024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000019nulltrue2024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000020nulltrue2024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000021nulltrue2024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000022nulltrue2024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000023nulltrue2024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000024nulltrue2024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000025nulltrue2024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000026nulltrue2024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000027nulltrue2024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000028nulltrue2024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000029nulltrue2024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000030nulltrue2024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000031nulltrue2024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000032nulltrue2024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000033nulltrue2024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000036nulltrue2024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000037nulltrue2024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000039nulltrue2024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000040nulltrue2024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000042nulltrue2024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000045nulltrue2024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000046nulltrue2024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000048nulltrue2024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000049nulltrue2024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000050nulltrue2024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000053nulltrue2024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000055nulltrue2024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000056nulltrue2024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000057nulltrue2024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000058nulltrue2024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000059nulltrue2024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000060nulltrue2024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000061nulltrue2024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000062nulltrue2024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000065nulltrue2024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000076nulltrue2024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000133nulltrue2024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000162nulltrue2024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000271nulltrue2024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000283nulltrue2024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000317nulltrue2024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000423nulltrue2024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:03.810 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.810 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.810 DEBUG:boto:path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.810 DEBUG:boto:auth_path=/cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.810 DEBUG:boto:Method: GET 2024-04-16T18:18:03.810 DEBUG:boto:Path: /cjqttm-51/?versions&max-keys=999 2024-04-16T18:18:03.810 DEBUG:boto:Data: 2024-04-16T18:18:03.810 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.810 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.810 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.811 DEBUG:boto:Params: {} 2024-04-16T18:18:03.811 DEBUG:boto:Token: None 2024-04-16T18:18:03.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/?versions 2024-04-16T18:18:03.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A= 2024-04-16T18:18:03.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihe+ks6GE7M/IPTX75/JFqj8f0A=', 'Content-Length': '0'} 2024-04-16T18:18:03.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b24373778b984b15-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.816 DEBUG:boto:b'cjqttm-51999falseobj00000000000000000000nulltrue2024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000001nulltrue2024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000002nulltrue2024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000003nulltrue2024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000004nulltrue2024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000005nulltrue2024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000006nulltrue2024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000007nulltrue2024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000008nulltrue2024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000009nulltrue2024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000010nulltrue2024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000011nulltrue2024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000012nulltrue2024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000013nulltrue2024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000014nulltrue2024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000015nulltrue2024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000016nulltrue2024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000017nulltrue2024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000018nulltrue2024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000019nulltrue2024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000020nulltrue2024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000021nulltrue2024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000022nulltrue2024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000023nulltrue2024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000024nulltrue2024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000025nulltrue2024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000026nulltrue2024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000027nulltrue2024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000028nulltrue2024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000029nulltrue2024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000030nulltrue2024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000031nulltrue2024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000032nulltrue2024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000033nulltrue2024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000036nulltrue2024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000037nulltrue2024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000039nulltrue2024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000040nulltrue2024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000042nulltrue2024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000045nulltrue2024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000046nulltrue2024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000048nulltrue2024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000049nulltrue2024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000050nulltrue2024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000053nulltrue2024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000055nulltrue2024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000056nulltrue2024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000057nulltrue2024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000058nulltrue2024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000059nulltrue2024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000060nulltrue2024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000061nulltrue2024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000062nulltrue2024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000065nulltrue2024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000076nulltrue2024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000133nulltrue2024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000162nulltrue2024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000271nulltrue2024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000283nulltrue2024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000317nulltrue2024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj00000000000000000423nulltrue2024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:03.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-16T18:18:03.819 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.819 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.819 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.820 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.820 DEBUG:boto:Method: GET 2024-04-16T18:18:03.820 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.820 DEBUG:boto:Data: 2024-04-16T18:18:03.820 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.820 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.820 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.820 DEBUG:boto:Params: {} 2024-04-16T18:18:03.820 DEBUG:boto:Token: None 2024-04-16T18:18:03.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.821 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI= 2024-04-16T18:18:03.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI=', 'Content-Length': '0'} 2024-04-16T18:18:03.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d24b07672e96e5c-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.866 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.867 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.867 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.867 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.867 DEBUG:boto:Method: GET 2024-04-16T18:18:03.867 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.867 DEBUG:boto:Data: 2024-04-16T18:18:03.867 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.867 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.867 DEBUG:boto:Params: {} 2024-04-16T18:18:03.868 DEBUG:boto:Token: None 2024-04-16T18:18:03.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI= 2024-04-16T18:18:03.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI=', 'Content-Length': '0'} 2024-04-16T18:18:03.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0dee54bafc6acef-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.870 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.871 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.871 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.871 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.871 DEBUG:boto:Method: HEAD 2024-04-16T18:18:03.871 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.871 DEBUG:boto:Data: 2024-04-16T18:18:03.871 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.871 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.871 DEBUG:boto:Params: {} 2024-04-16T18:18:03.871 DEBUG:boto:Token: None 2024-04-16T18:18:03.872 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d9voyTUnfA+Hi655v6sq5YbxoZ8= 2024-04-16T18:18:03.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d9voyTUnfA+Hi655v6sq5YbxoZ8=', 'Content-Length': '0'} 2024-04-16T18:18:03.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008dcbc149c0d0d8bb-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.874 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.874 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.874 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.874 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.874 DEBUG:boto:Method: HEAD 2024-04-16T18:18:03.874 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.875 DEBUG:boto:Data: 2024-04-16T18:18:03.875 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.875 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.875 DEBUG:boto:Params: {} 2024-04-16T18:18:03.875 DEBUG:boto:Token: None 2024-04-16T18:18:03.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d9voyTUnfA+Hi655v6sq5YbxoZ8= 2024-04-16T18:18:03.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d9voyTUnfA+Hi655v6sq5YbxoZ8=', 'Content-Length': '0'} 2024-04-16T18:18:03.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079888b0a00a013cb-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.878 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-16T18:18:03.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.878 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.878 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.878 DEBUG:boto:Method: GET 2024-04-16T18:18:03.878 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.879 DEBUG:boto:Data: 2024-04-16T18:18:03.879 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.879 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.879 DEBUG:boto:Params: {} 2024-04-16T18:18:03.879 DEBUG:boto:Token: None 2024-04-16T18:18:03.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI= 2024-04-16T18:18:03.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI=', 'Content-Length': '0'} 2024-04-16T18:18:03.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c186d3beef57078f-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.882 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.882 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.883 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.883 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.883 DEBUG:boto:Method: GET 2024-04-16T18:18:03.883 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.883 DEBUG:boto:Data: 2024-04-16T18:18:03.883 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.883 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.883 DEBUG:boto:Params: {} 2024-04-16T18:18:03.883 DEBUG:boto:Token: None 2024-04-16T18:18:03.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000?versionId=null 2024-04-16T18:18:03.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI= 2024-04-16T18:18:03.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O/zaFs3zS6X2SsGICYEud0509gI=', 'Content-Length': '0'} 2024-04-16T18:18:03.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef07d47b9a026584-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.926 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.926 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.927 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.927 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.927 DEBUG:boto:Method: GET 2024-04-16T18:18:03.927 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.927 DEBUG:boto:Data: 2024-04-16T18:18:03.927 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.927 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.927 DEBUG:boto:Params: {} 2024-04-16T18:18:03.927 DEBUG:boto:Token: None 2024-04-16T18:18:03.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/ 2024-04-16T18:18:03.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9huBTKMEyxDAzj2RVou6f36wZS0= 2024-04-16T18:18:03.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9huBTKMEyxDAzj2RVou6f36wZS0=', 'Content-Length': '0'} 2024-04-16T18:18:03.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a1d5968713da453-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.930 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:03.931 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.931 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.931 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.931 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.931 DEBUG:boto:Method: GET 2024-04-16T18:18:03.931 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.931 DEBUG:boto:Data: 2024-04-16T18:18:03.931 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.932 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.932 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.932 DEBUG:boto:Params: {} 2024-04-16T18:18:03.932 DEBUG:boto:Token: None 2024-04-16T18:18:03.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/ 2024-04-16T18:18:03.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9huBTKMEyxDAzj2RVou6f36wZS0= 2024-04-16T18:18:03.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9huBTKMEyxDAzj2RVou6f36wZS0=', 'Content-Length': '0'} 2024-04-16T18:18:03.936 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a1334963d7747ef-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.936 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:03.936 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.937 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.937 DEBUG:boto:Method: HEAD 2024-04-16T18:18:03.937 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.937 DEBUG:boto:Data: 2024-04-16T18:18:03.937 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.937 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.937 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.937 DEBUG:boto:Params: {} 2024-04-16T18:18:03.937 DEBUG:boto:Token: None 2024-04-16T18:18:03.938 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.938 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4EsHjoyaSGXBugnG1QZSktJjtTk= 2024-04-16T18:18:03.938 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4EsHjoyaSGXBugnG1QZSktJjtTk=', 'Content-Length': '0'} 2024-04-16T18:18:03.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afc75cca541f3387-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.940 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.940 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.941 DEBUG:boto:Method: HEAD 2024-04-16T18:18:03.941 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.941 DEBUG:boto:Data: 2024-04-16T18:18:03.941 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.941 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.941 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.941 DEBUG:boto:Params: {} 2024-04-16T18:18:03.941 DEBUG:boto:Token: None 2024-04-16T18:18:03.941 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.941 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4EsHjoyaSGXBugnG1QZSktJjtTk= 2024-04-16T18:18:03.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4EsHjoyaSGXBugnG1QZSktJjtTk=', 'Content-Length': '0'} 2024-04-16T18:18:03.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000884a04d2c5df73af-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.944 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000000 2024-04-16T18:18:03.944 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.944 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.944 DEBUG:boto:Method: GET 2024-04-16T18:18:03.944 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.945 DEBUG:boto:Data: 2024-04-16T18:18:03.945 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.945 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.945 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.945 DEBUG:boto:Params: {} 2024-04-16T18:18:03.945 DEBUG:boto:Token: None 2024-04-16T18:18:03.945 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.945 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:meDq1hBHUtDcL4waTK+qqmxXAvw= 2024-04-16T18:18:03.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:meDq1hBHUtDcL4waTK+qqmxXAvw=', 'Content-Length': '0'} 2024-04-16T18:18:03.947 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c88c3063b54c4575-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.948 DEBUG:boto:path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.948 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.948 DEBUG:boto:Method: GET 2024-04-16T18:18:03.948 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.948 DEBUG:boto:Data: 2024-04-16T18:18:03.948 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.948 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:03.948 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.949 DEBUG:boto:Params: {} 2024-04-16T18:18:03.949 DEBUG:boto:Token: None 2024-04-16T18:18:03.949 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/obj00000000000000000000 2024-04-16T18:18:03.949 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:meDq1hBHUtDcL4waTK+qqmxXAvw= 2024-04-16T18:18:03.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:meDq1hBHUtDcL4waTK+qqmxXAvw=', 'Content-Length': '0'} 2024-04-16T18:18:03.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e3b552199b7627d-00661ec0db-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.994 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.994 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.995 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.995 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.995 DEBUG:boto:Method: GET 2024-04-16T18:18:03.995 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.995 DEBUG:boto:Data: 2024-04-16T18:18:03.995 DEBUG:boto:Headers: {} 2024-04-16T18:18:03.995 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:03.995 DEBUG:boto:Port: 8000 2024-04-16T18:18:03.995 DEBUG:boto:Params: {} 2024-04-16T18:18:03.996 DEBUG:boto:Token: None 2024-04-16T18:18:03.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:03 GMT /cjqttm-51/ 2024-04-16T18:18:03.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9huBTKMEyxDAzj2RVou6f36wZS0= 2024-04-16T18:18:03.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9huBTKMEyxDAzj2RVou6f36wZS0=', 'Content-Length': '0'} 2024-04-16T18:18:03.998 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5394e2dd5953c70-00661ec0db-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:03.998 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:03.999 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:03.999 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:03.999 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.999 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.999 DEBUG:boto:Method: GET 2024-04-16T18:18:03.999 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000000 2024-04-16T18:18:03.999 DEBUG:boto:Data: 2024-04-16T18:18:04.000 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.000 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.000 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.000 DEBUG:boto:Params: {} 2024-04-16T18:18:04.000 DEBUG:boto:Token: None 2024-04-16T18:18:04.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c9cfaa6b9a458af-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.005 DEBUG:boto:b'cjqttm-51obj000000000000000000001000falseobj000000000000000000002024-04-16T18:17:58.246Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-16T18:18:04.005 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.005 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.005 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.005 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.005 DEBUG:boto:Method: GET 2024-04-16T18:18:04.006 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.006 DEBUG:boto:Data: 2024-04-16T18:18:04.006 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.006 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.006 DEBUG:boto:Params: {} 2024-04-16T18:18:04.006 DEBUG:boto:Token: None 2024-04-16T18:18:04.006 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o= 2024-04-16T18:18:04.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o=', 'Content-Length': '0'} 2024-04-16T18:18:04.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063acda72c3c16b14-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.050 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.051 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.051 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.051 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.051 DEBUG:boto:Method: GET 2024-04-16T18:18:04.051 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.051 DEBUG:boto:Data: 2024-04-16T18:18:04.051 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.051 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.052 DEBUG:boto:Params: {} 2024-04-16T18:18:04.052 DEBUG:boto:Token: None 2024-04-16T18:18:04.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o= 2024-04-16T18:18:04.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o=', 'Content-Length': '0'} 2024-04-16T18:18:04.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d367540cfc09497-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.055 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.055 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.055 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.055 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.055 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.055 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.055 DEBUG:boto:Data: 2024-04-16T18:18:04.055 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.056 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.056 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.056 DEBUG:boto:Params: {} 2024-04-16T18:18:04.056 DEBUG:boto:Token: None 2024-04-16T18:18:04.056 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zz4oiqhQZLz4hAKoyKDunX2JTA= 2024-04-16T18:18:04.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zz4oiqhQZLz4hAKoyKDunX2JTA=', 'Content-Length': '0'} 2024-04-16T18:18:04.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080bee7b767c3ef7f-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.059 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.059 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.059 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.059 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.059 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.059 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.059 DEBUG:boto:Data: 2024-04-16T18:18:04.060 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.060 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.060 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.060 DEBUG:boto:Params: {} 2024-04-16T18:18:04.060 DEBUG:boto:Token: None 2024-04-16T18:18:04.060 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zz4oiqhQZLz4hAKoyKDunX2JTA= 2024-04-16T18:18:04.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zz4oiqhQZLz4hAKoyKDunX2JTA=', 'Content-Length': '0'} 2024-04-16T18:18:04.063 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001df66742c01182c0-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.063 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-16T18:18:04.063 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.063 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.063 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.063 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.063 DEBUG:boto:Method: GET 2024-04-16T18:18:04.064 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.064 DEBUG:boto:Data: 2024-04-16T18:18:04.064 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.064 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.064 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.064 DEBUG:boto:Params: {} 2024-04-16T18:18:04.064 DEBUG:boto:Token: None 2024-04-16T18:18:04.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o= 2024-04-16T18:18:04.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o=', 'Content-Length': '0'} 2024-04-16T18:18:04.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5545f34f71e5b18-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.067 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.067 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.067 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.068 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.068 DEBUG:boto:Method: GET 2024-04-16T18:18:04.068 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.068 DEBUG:boto:Data: 2024-04-16T18:18:04.068 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.068 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.068 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.068 DEBUG:boto:Params: {} 2024-04-16T18:18:04.068 DEBUG:boto:Token: None 2024-04-16T18:18:04.069 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001?versionId=null 2024-04-16T18:18:04.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o= 2024-04-16T18:18:04.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBHzogkT7ALxYC/kcePhOL7pg7o=', 'Content-Length': '0'} 2024-04-16T18:18:04.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfa97d0561fb69ff-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.114 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.115 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.115 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.115 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.115 DEBUG:boto:Method: GET 2024-04-16T18:18:04.115 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.115 DEBUG:boto:Data: 2024-04-16T18:18:04.115 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.115 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.116 DEBUG:boto:Params: {} 2024-04-16T18:18:04.116 DEBUG:boto:Token: None 2024-04-16T18:18:04.116 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdce377a84031c80-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.119 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.119 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.119 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.119 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.119 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.120 DEBUG:boto:Method: GET 2024-04-16T18:18:04.120 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.120 DEBUG:boto:Data: 2024-04-16T18:18:04.120 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.120 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.120 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.120 DEBUG:boto:Params: {} 2024-04-16T18:18:04.120 DEBUG:boto:Token: None 2024-04-16T18:18:04.120 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.121 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.124 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8629c3fe2794888-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.125 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.125 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.125 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.126 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.126 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.126 DEBUG:boto:Data: 2024-04-16T18:18:04.126 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.126 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.127 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.127 DEBUG:boto:Params: {} 2024-04-16T18:18:04.127 DEBUG:boto:Token: None 2024-04-16T18:18:04.127 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vVVz5fh79ObztlzAVa4p62GQtUA= 2024-04-16T18:18:04.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vVVz5fh79ObztlzAVa4p62GQtUA=', 'Content-Length': '0'} 2024-04-16T18:18:04.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cd340336eed55ca-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.130 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.130 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.130 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.130 DEBUG:boto:Data: 2024-04-16T18:18:04.130 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.130 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.131 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.131 DEBUG:boto:Params: {} 2024-04-16T18:18:04.131 DEBUG:boto:Token: None 2024-04-16T18:18:04.131 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vVVz5fh79ObztlzAVa4p62GQtUA= 2024-04-16T18:18:04.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vVVz5fh79ObztlzAVa4p62GQtUA=', 'Content-Length': '0'} 2024-04-16T18:18:04.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000050d388739bfb2da-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.133 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000001 2024-04-16T18:18:04.133 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.134 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.134 DEBUG:boto:Method: GET 2024-04-16T18:18:04.134 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.134 DEBUG:boto:Data: 2024-04-16T18:18:04.134 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.134 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.134 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.134 DEBUG:boto:Params: {} 2024-04-16T18:18:04.134 DEBUG:boto:Token: None 2024-04-16T18:18:04.135 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k/WUdVllZTLx4/IkJ9ooprFCiZA= 2024-04-16T18:18:04.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k/WUdVllZTLx4/IkJ9ooprFCiZA=', 'Content-Length': '0'} 2024-04-16T18:18:04.137 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db5f4fe92f750781-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.178 DEBUG:boto:path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.179 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.179 DEBUG:boto:Method: GET 2024-04-16T18:18:04.179 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.179 DEBUG:boto:Data: 2024-04-16T18:18:04.179 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.179 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.179 DEBUG:boto:Params: {} 2024-04-16T18:18:04.179 DEBUG:boto:Token: None 2024-04-16T18:18:04.179 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000001 2024-04-16T18:18:04.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k/WUdVllZTLx4/IkJ9ooprFCiZA= 2024-04-16T18:18:04.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k/WUdVllZTLx4/IkJ9ooprFCiZA=', 'Content-Length': '0'} 2024-04-16T18:18:04.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000847ac1111c49d558-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.183 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.183 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.183 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.183 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.183 DEBUG:boto:Method: GET 2024-04-16T18:18:04.183 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.183 DEBUG:boto:Data: 2024-04-16T18:18:04.183 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.183 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.183 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.183 DEBUG:boto:Params: {} 2024-04-16T18:18:04.184 DEBUG:boto:Token: None 2024-04-16T18:18:04.184 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.186 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e2c2643505a07cc-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.186 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.187 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.187 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.187 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.187 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.187 DEBUG:boto:Method: GET 2024-04-16T18:18:04.187 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000001 2024-04-16T18:18:04.187 DEBUG:boto:Data: 2024-04-16T18:18:04.187 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.188 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.188 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.188 DEBUG:boto:Params: {} 2024-04-16T18:18:04.188 DEBUG:boto:Token: None 2024-04-16T18:18:04.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.191 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c580407c381572ea-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.234 DEBUG:boto:b'cjqttm-51obj000000000000000000011000falseobj000000000000000000012024-04-16T18:17:59.940Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.235 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-16T18:18:04.235 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.235 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.235 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.235 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.235 DEBUG:boto:Method: GET 2024-04-16T18:18:04.235 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.235 DEBUG:boto:Data: 2024-04-16T18:18:04.235 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.236 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.236 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.236 DEBUG:boto:Params: {} 2024-04-16T18:18:04.236 DEBUG:boto:Token: None 2024-04-16T18:18:04.236 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY= 2024-04-16T18:18:04.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY=', 'Content-Length': '0'} 2024-04-16T18:18:04.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3f04112b4c2f260-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.239 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.239 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.239 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.239 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.239 DEBUG:boto:Method: GET 2024-04-16T18:18:04.240 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.240 DEBUG:boto:Data: 2024-04-16T18:18:04.240 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.240 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.240 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.240 DEBUG:boto:Params: {} 2024-04-16T18:18:04.240 DEBUG:boto:Token: None 2024-04-16T18:18:04.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY= 2024-04-16T18:18:04.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY=', 'Content-Length': '0'} 2024-04-16T18:18:04.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da25c099607ba91f-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.243 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.243 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.243 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.243 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.243 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.243 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.243 DEBUG:boto:Data: 2024-04-16T18:18:04.244 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.244 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.244 DEBUG:boto:Params: {} 2024-04-16T18:18:04.244 DEBUG:boto:Token: None 2024-04-16T18:18:04.244 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ymXtql47q4xuJt0WqeIdySsohA= 2024-04-16T18:18:04.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ymXtql47q4xuJt0WqeIdySsohA=', 'Content-Length': '0'} 2024-04-16T18:18:04.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c97686b7633636ae-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.247 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.247 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.247 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.247 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.247 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.247 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.248 DEBUG:boto:Data: 2024-04-16T18:18:04.248 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.248 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.248 DEBUG:boto:Params: {} 2024-04-16T18:18:04.248 DEBUG:boto:Token: None 2024-04-16T18:18:04.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5ymXtql47q4xuJt0WqeIdySsohA= 2024-04-16T18:18:04.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ymXtql47q4xuJt0WqeIdySsohA=', 'Content-Length': '0'} 2024-04-16T18:18:04.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7863cf3fe01e817-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-16T18:18:04.251 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.251 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.251 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.251 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.252 DEBUG:boto:Method: GET 2024-04-16T18:18:04.252 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.252 DEBUG:boto:Data: 2024-04-16T18:18:04.252 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.252 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.252 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.252 DEBUG:boto:Params: {} 2024-04-16T18:18:04.252 DEBUG:boto:Token: None 2024-04-16T18:18:04.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY= 2024-04-16T18:18:04.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY=', 'Content-Length': '0'} 2024-04-16T18:18:04.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a95c851a4cdd826c-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.298 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.299 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.299 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.299 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.299 DEBUG:boto:Method: GET 2024-04-16T18:18:04.299 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.299 DEBUG:boto:Data: 2024-04-16T18:18:04.299 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.299 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.299 DEBUG:boto:Params: {} 2024-04-16T18:18:04.300 DEBUG:boto:Token: None 2024-04-16T18:18:04.300 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002?versionId=null 2024-04-16T18:18:04.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY= 2024-04-16T18:18:04.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MPl8fpIcnjKqIQItvc1OldrpQcY=', 'Content-Length': '0'} 2024-04-16T18:18:04.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2e9c084d51980bf-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.303 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.303 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.303 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.303 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.303 DEBUG:boto:Method: GET 2024-04-16T18:18:04.303 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.303 DEBUG:boto:Data: 2024-04-16T18:18:04.303 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.304 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.304 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.304 DEBUG:boto:Params: {} 2024-04-16T18:18:04.304 DEBUG:boto:Token: None 2024-04-16T18:18:04.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003219d2ee3267797b-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.307 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.307 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.307 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.307 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.307 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.307 DEBUG:boto:Method: GET 2024-04-16T18:18:04.307 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.308 DEBUG:boto:Data: 2024-04-16T18:18:04.308 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.308 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.308 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.308 DEBUG:boto:Params: {} 2024-04-16T18:18:04.308 DEBUG:boto:Token: None 2024-04-16T18:18:04.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.312 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4afba0987025ff4-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.354 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.355 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.355 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.355 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.355 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.355 DEBUG:boto:Data: 2024-04-16T18:18:04.355 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.355 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.355 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.356 DEBUG:boto:Params: {} 2024-04-16T18:18:04.356 DEBUG:boto:Token: None 2024-04-16T18:18:04.356 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Op4ZGKWPB+LhZz5ltyaCVW8RqAI= 2024-04-16T18:18:04.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Op4ZGKWPB+LhZz5ltyaCVW8RqAI=', 'Content-Length': '0'} 2024-04-16T18:18:04.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000665c6b1be187b9af-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.359 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.359 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.359 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.359 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.359 DEBUG:boto:Data: 2024-04-16T18:18:04.359 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.359 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.359 DEBUG:boto:Params: {} 2024-04-16T18:18:04.360 DEBUG:boto:Token: None 2024-04-16T18:18:04.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Op4ZGKWPB+LhZz5ltyaCVW8RqAI= 2024-04-16T18:18:04.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Op4ZGKWPB+LhZz5ltyaCVW8RqAI=', 'Content-Length': '0'} 2024-04-16T18:18:04.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffc1378bcd4a8af1-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.365 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000002 2024-04-16T18:18:04.366 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.366 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.366 DEBUG:boto:Method: GET 2024-04-16T18:18:04.366 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.366 DEBUG:boto:Data: 2024-04-16T18:18:04.366 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.366 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.366 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.366 DEBUG:boto:Params: {} 2024-04-16T18:18:04.367 DEBUG:boto:Token: None 2024-04-16T18:18:04.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MDJVvTQPkKdqwfo0pPfTPc5sHIE= 2024-04-16T18:18:04.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MDJVvTQPkKdqwfo0pPfTPc5sHIE=', 'Content-Length': '0'} 2024-04-16T18:18:04.370 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c99cb22ef67cede0-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.370 DEBUG:boto:Method: GET 2024-04-16T18:18:04.370 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.370 DEBUG:boto:Data: 2024-04-16T18:18:04.371 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.371 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.371 DEBUG:boto:Params: {} 2024-04-16T18:18:04.371 DEBUG:boto:Token: None 2024-04-16T18:18:04.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000002 2024-04-16T18:18:04.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MDJVvTQPkKdqwfo0pPfTPc5sHIE= 2024-04-16T18:18:04.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MDJVvTQPkKdqwfo0pPfTPc5sHIE=', 'Content-Length': '0'} 2024-04-16T18:18:04.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006120d47e603b924a-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.373 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.374 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.374 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.374 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.374 DEBUG:boto:Method: GET 2024-04-16T18:18:04.374 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.374 DEBUG:boto:Data: 2024-04-16T18:18:04.374 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.374 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.374 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.375 DEBUG:boto:Params: {} 2024-04-16T18:18:04.375 DEBUG:boto:Token: None 2024-04-16T18:18:04.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000233387c88b6180dc-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.378 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.378 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.378 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.378 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.378 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.379 DEBUG:boto:Method: GET 2024-04-16T18:18:04.379 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000002 2024-04-16T18:18:04.379 DEBUG:boto:Data: 2024-04-16T18:18:04.379 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.379 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.379 DEBUG:boto:Params: {} 2024-04-16T18:18:04.379 DEBUG:boto:Token: None 2024-04-16T18:18:04.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.383 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e876e5c689f6bf76-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.384 DEBUG:boto:b'cjqttm-51obj000000000000000000021000falseobj000000000000000000022024-04-16T18:17:59.394Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-16T18:18:04.384 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.384 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.384 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.385 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.385 DEBUG:boto:Method: GET 2024-04-16T18:18:04.385 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.385 DEBUG:boto:Data: 2024-04-16T18:18:04.385 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.385 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.385 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.385 DEBUG:boto:Params: {} 2024-04-16T18:18:04.385 DEBUG:boto:Token: None 2024-04-16T18:18:04.386 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84= 2024-04-16T18:18:04.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84=', 'Content-Length': '0'} 2024-04-16T18:18:04.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057c1c5db8643e48f-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.389 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.389 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.389 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.389 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.390 DEBUG:boto:Method: GET 2024-04-16T18:18:04.390 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.390 DEBUG:boto:Data: 2024-04-16T18:18:04.390 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.390 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.390 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.390 DEBUG:boto:Params: {} 2024-04-16T18:18:04.390 DEBUG:boto:Token: None 2024-04-16T18:18:04.390 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84= 2024-04-16T18:18:04.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84=', 'Content-Length': '0'} 2024-04-16T18:18:04.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba9ea4c820310812-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.434 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.435 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.435 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.435 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.435 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.435 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.435 DEBUG:boto:Data: 2024-04-16T18:18:04.435 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.435 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.435 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.435 DEBUG:boto:Params: {} 2024-04-16T18:18:04.436 DEBUG:boto:Token: None 2024-04-16T18:18:04.436 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R66U0WiaPSz26AnVE0sxHnn+GdE= 2024-04-16T18:18:04.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R66U0WiaPSz26AnVE0sxHnn+GdE=', 'Content-Length': '0'} 2024-04-16T18:18:04.438 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a018d3637b5b7505-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.438 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.439 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.439 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.439 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.439 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.439 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.439 DEBUG:boto:Data: 2024-04-16T18:18:04.439 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.439 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.439 DEBUG:boto:Params: {} 2024-04-16T18:18:04.440 DEBUG:boto:Token: None 2024-04-16T18:18:04.440 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R66U0WiaPSz26AnVE0sxHnn+GdE= 2024-04-16T18:18:04.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R66U0WiaPSz26AnVE0sxHnn+GdE=', 'Content-Length': '0'} 2024-04-16T18:18:04.442 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091dc181349f3514b-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.442 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-16T18:18:04.443 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.443 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.443 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.443 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.443 DEBUG:boto:Method: GET 2024-04-16T18:18:04.443 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.443 DEBUG:boto:Data: 2024-04-16T18:18:04.443 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.444 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.444 DEBUG:boto:Params: {} 2024-04-16T18:18:04.444 DEBUG:boto:Token: None 2024-04-16T18:18:04.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84= 2024-04-16T18:18:04.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84=', 'Content-Length': '0'} 2024-04-16T18:18:04.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000352f239c7eda1a96-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.446 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.447 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.447 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.447 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.447 DEBUG:boto:Method: GET 2024-04-16T18:18:04.447 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.447 DEBUG:boto:Data: 2024-04-16T18:18:04.447 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.447 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.447 DEBUG:boto:Params: {} 2024-04-16T18:18:04.447 DEBUG:boto:Token: None 2024-04-16T18:18:04.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003?versionId=null 2024-04-16T18:18:04.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84= 2024-04-16T18:18:04.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2005rXdNkGtuB446NYAveoBKW84=', 'Content-Length': '0'} 2024-04-16T18:18:04.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f99f074d88b89715-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.450 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.451 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.451 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.451 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.451 DEBUG:boto:Method: GET 2024-04-16T18:18:04.451 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.451 DEBUG:boto:Data: 2024-04-16T18:18:04.451 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.451 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.451 DEBUG:boto:Params: {} 2024-04-16T18:18:04.451 DEBUG:boto:Token: None 2024-04-16T18:18:04.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007165f7a7f5391d4-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.454 DEBUG:boto:b'cjqttm-51obj000000000000000000031000falseobj000000000000000000032024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.455 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.455 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.455 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.455 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.455 DEBUG:boto:Method: GET 2024-04-16T18:18:04.455 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.455 DEBUG:boto:Data: 2024-04-16T18:18:04.455 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.456 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.456 DEBUG:boto:Params: {} 2024-04-16T18:18:04.456 DEBUG:boto:Token: None 2024-04-16T18:18:04.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.460 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dac9a56a6e0eb4d-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.460 DEBUG:boto:b'cjqttm-51obj000000000000000000031000falseobj000000000000000000032024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.460 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.461 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.461 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.461 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.461 DEBUG:boto:Data: 2024-04-16T18:18:04.461 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.461 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.461 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.461 DEBUG:boto:Params: {} 2024-04-16T18:18:04.461 DEBUG:boto:Token: None 2024-04-16T18:18:04.461 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.462 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9mbtA1qztenGyH3HGnxOCi3YO3g= 2024-04-16T18:18:04.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9mbtA1qztenGyH3HGnxOCi3YO3g=', 'Content-Length': '0'} 2024-04-16T18:18:04.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000516acb22aed2b994-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.464 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.464 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.464 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.464 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.464 DEBUG:boto:Data: 2024-04-16T18:18:04.465 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.465 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.465 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.465 DEBUG:boto:Params: {} 2024-04-16T18:18:04.465 DEBUG:boto:Token: None 2024-04-16T18:18:04.465 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.465 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9mbtA1qztenGyH3HGnxOCi3YO3g= 2024-04-16T18:18:04.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9mbtA1qztenGyH3HGnxOCi3YO3g=', 'Content-Length': '0'} 2024-04-16T18:18:04.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd5d8f2fbd54155e-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000003 2024-04-16T18:18:04.468 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.468 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.468 DEBUG:boto:Method: GET 2024-04-16T18:18:04.468 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.468 DEBUG:boto:Data: 2024-04-16T18:18:04.468 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.468 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.468 DEBUG:boto:Params: {} 2024-04-16T18:18:04.468 DEBUG:boto:Token: None 2024-04-16T18:18:04.469 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4fWlIfRCZgKipbbDNTIi4la/vSM= 2024-04-16T18:18:04.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4fWlIfRCZgKipbbDNTIi4la/vSM=', 'Content-Length': '0'} 2024-04-16T18:18:04.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001354669246e2f353-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.514 DEBUG:boto:path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.515 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.515 DEBUG:boto:Method: GET 2024-04-16T18:18:04.515 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.515 DEBUG:boto:Data: 2024-04-16T18:18:04.515 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.515 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.515 DEBUG:boto:Params: {} 2024-04-16T18:18:04.515 DEBUG:boto:Token: None 2024-04-16T18:18:04.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000003 2024-04-16T18:18:04.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4fWlIfRCZgKipbbDNTIi4la/vSM= 2024-04-16T18:18:04.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4fWlIfRCZgKipbbDNTIi4la/vSM=', 'Content-Length': '0'} 2024-04-16T18:18:04.518 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5e4bc7e8095ef6b-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.518 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.519 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.519 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.519 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.519 DEBUG:boto:Method: GET 2024-04-16T18:18:04.519 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.519 DEBUG:boto:Data: 2024-04-16T18:18:04.519 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.519 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.519 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.519 DEBUG:boto:Params: {} 2024-04-16T18:18:04.519 DEBUG:boto:Token: None 2024-04-16T18:18:04.520 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.522 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a49d2b2702862450-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.522 DEBUG:boto:b'cjqttm-51obj000000000000000000031000falseobj000000000000000000032024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.523 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.523 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.523 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.523 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.523 DEBUG:boto:Method: GET 2024-04-16T18:18:04.523 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000003 2024-04-16T18:18:04.523 DEBUG:boto:Data: 2024-04-16T18:18:04.523 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.523 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.523 DEBUG:boto:Params: {} 2024-04-16T18:18:04.524 DEBUG:boto:Token: None 2024-04-16T18:18:04.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e260cfd2fa7e78a-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.528 DEBUG:boto:b'cjqttm-51obj000000000000000000031000falseobj000000000000000000032024-04-16T18:17:59.576Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.529 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-16T18:18:04.529 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.529 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.529 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.529 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.529 DEBUG:boto:Method: GET 2024-04-16T18:18:04.529 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.529 DEBUG:boto:Data: 2024-04-16T18:18:04.530 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.530 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.530 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.530 DEBUG:boto:Params: {} 2024-04-16T18:18:04.530 DEBUG:boto:Token: None 2024-04-16T18:18:04.530 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.530 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM= 2024-04-16T18:18:04.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM=', 'Content-Length': '0'} 2024-04-16T18:18:04.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb3251e77c788455-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.533 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.533 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.533 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.533 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.534 DEBUG:boto:Method: GET 2024-04-16T18:18:04.534 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.534 DEBUG:boto:Data: 2024-04-16T18:18:04.534 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.534 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.534 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.534 DEBUG:boto:Params: {} 2024-04-16T18:18:04.534 DEBUG:boto:Token: None 2024-04-16T18:18:04.534 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.534 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM= 2024-04-16T18:18:04.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM=', 'Content-Length': '0'} 2024-04-16T18:18:04.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8d2c6d7a8b07b26-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.537 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.537 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.537 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.537 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.537 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.537 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.537 DEBUG:boto:Data: 2024-04-16T18:18:04.537 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.537 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.537 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.537 DEBUG:boto:Params: {} 2024-04-16T18:18:04.538 DEBUG:boto:Token: None 2024-04-16T18:18:04.538 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.538 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ItiJ/KlbBaE+UX/j8e5RUhhfy9Y= 2024-04-16T18:18:04.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ItiJ/KlbBaE+UX/j8e5RUhhfy9Y=', 'Content-Length': '0'} 2024-04-16T18:18:04.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea0b340862e12629-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.540 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.540 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.540 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.541 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.541 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.541 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.541 DEBUG:boto:Data: 2024-04-16T18:18:04.541 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.541 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.541 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.541 DEBUG:boto:Params: {} 2024-04-16T18:18:04.541 DEBUG:boto:Token: None 2024-04-16T18:18:04.541 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.542 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ItiJ/KlbBaE+UX/j8e5RUhhfy9Y= 2024-04-16T18:18:04.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ItiJ/KlbBaE+UX/j8e5RUhhfy9Y=', 'Content-Length': '0'} 2024-04-16T18:18:04.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005409439a0846b54f-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.544 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-16T18:18:04.544 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.544 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.544 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.544 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.544 DEBUG:boto:Method: GET 2024-04-16T18:18:04.544 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.545 DEBUG:boto:Data: 2024-04-16T18:18:04.545 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.545 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.545 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.545 DEBUG:boto:Params: {} 2024-04-16T18:18:04.545 DEBUG:boto:Token: None 2024-04-16T18:18:04.545 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM= 2024-04-16T18:18:04.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM=', 'Content-Length': '0'} 2024-04-16T18:18:04.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009565961e2b31651a-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.548 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.548 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.548 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.548 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.548 DEBUG:boto:Method: GET 2024-04-16T18:18:04.548 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.548 DEBUG:boto:Data: 2024-04-16T18:18:04.548 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.549 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.549 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.549 DEBUG:boto:Params: {} 2024-04-16T18:18:04.549 DEBUG:boto:Token: None 2024-04-16T18:18:04.549 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004?versionId=null 2024-04-16T18:18:04.549 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM= 2024-04-16T18:18:04.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j67m49QSXcaB7aFmP30FoWj+WgM=', 'Content-Length': '0'} 2024-04-16T18:18:04.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000305ff63896bccabf-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.551 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.551 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.551 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.552 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.552 DEBUG:boto:Method: GET 2024-04-16T18:18:04.552 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.552 DEBUG:boto:Data: 2024-04-16T18:18:04.552 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.552 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.552 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.552 DEBUG:boto:Params: {} 2024-04-16T18:18:04.552 DEBUG:boto:Token: None 2024-04-16T18:18:04.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000788202735cd793bd-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.555 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.555 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.555 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.555 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.555 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.556 DEBUG:boto:Method: GET 2024-04-16T18:18:04.556 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.556 DEBUG:boto:Data: 2024-04-16T18:18:04.556 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.556 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.556 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.556 DEBUG:boto:Params: {} 2024-04-16T18:18:04.556 DEBUG:boto:Token: None 2024-04-16T18:18:04.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.560 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6b59d21bfea9a6e-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.560 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.561 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.561 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.561 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.561 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.561 DEBUG:boto:Data: 2024-04-16T18:18:04.561 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.561 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.561 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.561 DEBUG:boto:Params: {} 2024-04-16T18:18:04.561 DEBUG:boto:Token: None 2024-04-16T18:18:04.562 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.562 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1+b0Sw/YyOXKVNMdowMvMQaYCPE= 2024-04-16T18:18:04.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1+b0Sw/YyOXKVNMdowMvMQaYCPE=', 'Content-Length': '0'} 2024-04-16T18:18:04.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000308ebd21140b43a4-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.564 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.564 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.564 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.564 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.564 DEBUG:boto:Data: 2024-04-16T18:18:04.564 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.564 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.565 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.565 DEBUG:boto:Params: {} 2024-04-16T18:18:04.565 DEBUG:boto:Token: None 2024-04-16T18:18:04.565 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.565 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1+b0Sw/YyOXKVNMdowMvMQaYCPE= 2024-04-16T18:18:04.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1+b0Sw/YyOXKVNMdowMvMQaYCPE=', 'Content-Length': '0'} 2024-04-16T18:18:04.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9061bc1bbfb691e-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.569 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000004 2024-04-16T18:18:04.570 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.570 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.570 DEBUG:boto:Method: GET 2024-04-16T18:18:04.570 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.570 DEBUG:boto:Data: 2024-04-16T18:18:04.570 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.570 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.570 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.570 DEBUG:boto:Params: {} 2024-04-16T18:18:04.570 DEBUG:boto:Token: None 2024-04-16T18:18:04.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.571 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mxfTuYmgVCOtW7qWPdHhFUzyD2c= 2024-04-16T18:18:04.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mxfTuYmgVCOtW7qWPdHhFUzyD2c=', 'Content-Length': '0'} 2024-04-16T18:18:04.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000175d74fa13e017e1-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.614 DEBUG:boto:path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.615 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.615 DEBUG:boto:Method: GET 2024-04-16T18:18:04.615 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.615 DEBUG:boto:Data: 2024-04-16T18:18:04.615 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.615 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.615 DEBUG:boto:Params: {} 2024-04-16T18:18:04.615 DEBUG:boto:Token: None 2024-04-16T18:18:04.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000004 2024-04-16T18:18:04.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mxfTuYmgVCOtW7qWPdHhFUzyD2c= 2024-04-16T18:18:04.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mxfTuYmgVCOtW7qWPdHhFUzyD2c=', 'Content-Length': '0'} 2024-04-16T18:18:04.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c622e5fb21e4f94-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.618 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.618 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.618 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.618 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.618 DEBUG:boto:Method: GET 2024-04-16T18:18:04.618 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.618 DEBUG:boto:Data: 2024-04-16T18:18:04.618 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.619 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.619 DEBUG:boto:Params: {} 2024-04-16T18:18:04.619 DEBUG:boto:Token: None 2024-04-16T18:18:04.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059088dcd1d0a87d3-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.622 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.622 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.622 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.622 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.622 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.622 DEBUG:boto:Method: GET 2024-04-16T18:18:04.622 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000004 2024-04-16T18:18:04.623 DEBUG:boto:Data: 2024-04-16T18:18:04.623 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.623 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.623 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.623 DEBUG:boto:Params: {} 2024-04-16T18:18:04.623 DEBUG:boto:Token: None 2024-04-16T18:18:04.623 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.627 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000032cfbf477eef9895-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.627 DEBUG:boto:b'cjqttm-51obj000000000000000000041000falseobj000000000000000000042024-04-16T18:17:59.216Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-16T18:18:04.627 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.627 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.628 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.628 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.628 DEBUG:boto:Method: GET 2024-04-16T18:18:04.628 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.628 DEBUG:boto:Data: 2024-04-16T18:18:04.628 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.628 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.628 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.628 DEBUG:boto:Params: {} 2024-04-16T18:18:04.628 DEBUG:boto:Token: None 2024-04-16T18:18:04.629 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.629 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk= 2024-04-16T18:18:04.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk=', 'Content-Length': '0'} 2024-04-16T18:18:04.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000534a2ce20869fb5b-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.632 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.632 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.632 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.632 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.632 DEBUG:boto:Method: GET 2024-04-16T18:18:04.632 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.632 DEBUG:boto:Data: 2024-04-16T18:18:04.632 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.633 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.633 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.633 DEBUG:boto:Params: {} 2024-04-16T18:18:04.633 DEBUG:boto:Token: None 2024-04-16T18:18:04.633 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.633 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk= 2024-04-16T18:18:04.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk=', 'Content-Length': '0'} 2024-04-16T18:18:04.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ad18c4ddb5fcbe3-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.636 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.636 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.636 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.636 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.636 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.636 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.636 DEBUG:boto:Data: 2024-04-16T18:18:04.636 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.636 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.637 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.637 DEBUG:boto:Params: {} 2024-04-16T18:18:04.637 DEBUG:boto:Token: None 2024-04-16T18:18:04.637 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.637 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xJd6kJaY1I9MxEVV72isXNn+9SU= 2024-04-16T18:18:04.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xJd6kJaY1I9MxEVV72isXNn+9SU=', 'Content-Length': '0'} 2024-04-16T18:18:04.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb7eb9006b507f56-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.639 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.639 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.640 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.640 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.640 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.640 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.640 DEBUG:boto:Data: 2024-04-16T18:18:04.640 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.640 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.640 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.640 DEBUG:boto:Params: {} 2024-04-16T18:18:04.640 DEBUG:boto:Token: None 2024-04-16T18:18:04.640 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.641 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xJd6kJaY1I9MxEVV72isXNn+9SU= 2024-04-16T18:18:04.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xJd6kJaY1I9MxEVV72isXNn+9SU=', 'Content-Length': '0'} 2024-04-16T18:18:04.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8f933e45d99a810-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-16T18:18:04.643 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.643 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.643 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.643 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.643 DEBUG:boto:Method: GET 2024-04-16T18:18:04.643 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.643 DEBUG:boto:Data: 2024-04-16T18:18:04.643 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.644 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.644 DEBUG:boto:Params: {} 2024-04-16T18:18:04.644 DEBUG:boto:Token: None 2024-04-16T18:18:04.644 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk= 2024-04-16T18:18:04.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk=', 'Content-Length': '0'} 2024-04-16T18:18:04.646 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2626905cc33e66f-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.686 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.687 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.687 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.687 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.687 DEBUG:boto:Method: GET 2024-04-16T18:18:04.687 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.687 DEBUG:boto:Data: 2024-04-16T18:18:04.687 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.687 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.687 DEBUG:boto:Params: {} 2024-04-16T18:18:04.687 DEBUG:boto:Token: None 2024-04-16T18:18:04.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005?versionId=null 2024-04-16T18:18:04.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk= 2024-04-16T18:18:04.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjiElub0CM2grtAQM5yFvOV9xHk=', 'Content-Length': '0'} 2024-04-16T18:18:04.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a934dd54f697f98-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.690 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.690 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.691 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.691 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.691 DEBUG:boto:Method: GET 2024-04-16T18:18:04.691 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.691 DEBUG:boto:Data: 2024-04-16T18:18:04.691 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.691 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.691 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.691 DEBUG:boto:Params: {} 2024-04-16T18:18:04.691 DEBUG:boto:Token: None 2024-04-16T18:18:04.691 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.694 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085e9165f7bd5ab01-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.694 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.694 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.694 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.695 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.695 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.695 DEBUG:boto:Method: GET 2024-04-16T18:18:04.695 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.695 DEBUG:boto:Data: 2024-04-16T18:18:04.695 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.695 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.695 DEBUG:boto:Params: {} 2024-04-16T18:18:04.695 DEBUG:boto:Token: None 2024-04-16T18:18:04.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.699 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b35942ac04ee0edf-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.700 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.700 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.700 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.700 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.700 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.700 DEBUG:boto:Data: 2024-04-16T18:18:04.700 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.700 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.701 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.701 DEBUG:boto:Params: {} 2024-04-16T18:18:04.701 DEBUG:boto:Token: None 2024-04-16T18:18:04.701 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.701 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+b3D+wpRd7+TQgjvc68obwdXZMA= 2024-04-16T18:18:04.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+b3D+wpRd7+TQgjvc68obwdXZMA=', 'Content-Length': '0'} 2024-04-16T18:18:04.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000866d29f13806c817-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.704 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.704 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.704 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.704 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.704 DEBUG:boto:Data: 2024-04-16T18:18:04.704 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.704 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.704 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.704 DEBUG:boto:Params: {} 2024-04-16T18:18:04.704 DEBUG:boto:Token: None 2024-04-16T18:18:04.705 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.705 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+b3D+wpRd7+TQgjvc68obwdXZMA= 2024-04-16T18:18:04.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+b3D+wpRd7+TQgjvc68obwdXZMA=', 'Content-Length': '0'} 2024-04-16T18:18:04.707 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb4ff5550fab3d7c-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.707 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000005 2024-04-16T18:18:04.707 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.707 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.708 DEBUG:boto:Method: GET 2024-04-16T18:18:04.708 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.708 DEBUG:boto:Data: 2024-04-16T18:18:04.708 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.708 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.708 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.708 DEBUG:boto:Params: {} 2024-04-16T18:18:04.708 DEBUG:boto:Token: None 2024-04-16T18:18:04.708 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.709 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kCiaUMi7EFnUQqbOIZfBa4mVapg= 2024-04-16T18:18:04.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kCiaUMi7EFnUQqbOIZfBa4mVapg=', 'Content-Length': '0'} 2024-04-16T18:18:04.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041c1d00eaf7ed9bc-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.754 DEBUG:boto:path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.754 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.755 DEBUG:boto:Method: GET 2024-04-16T18:18:04.755 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.755 DEBUG:boto:Data: 2024-04-16T18:18:04.755 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.755 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.755 DEBUG:boto:Params: {} 2024-04-16T18:18:04.755 DEBUG:boto:Token: None 2024-04-16T18:18:04.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000005 2024-04-16T18:18:04.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kCiaUMi7EFnUQqbOIZfBa4mVapg= 2024-04-16T18:18:04.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kCiaUMi7EFnUQqbOIZfBa4mVapg=', 'Content-Length': '0'} 2024-04-16T18:18:04.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041ba9b16fd4ee3aa-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.758 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.758 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.758 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.758 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.759 DEBUG:boto:Method: GET 2024-04-16T18:18:04.759 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.759 DEBUG:boto:Data: 2024-04-16T18:18:04.759 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.759 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.759 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.759 DEBUG:boto:Params: {} 2024-04-16T18:18:04.759 DEBUG:boto:Token: None 2024-04-16T18:18:04.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.762 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d01c66fb30eb9b82-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.802 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.803 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.803 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.803 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.803 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.803 DEBUG:boto:Method: GET 2024-04-16T18:18:04.803 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000005 2024-04-16T18:18:04.804 DEBUG:boto:Data: 2024-04-16T18:18:04.804 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.804 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.804 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.804 DEBUG:boto:Params: {} 2024-04-16T18:18:04.804 DEBUG:boto:Token: None 2024-04-16T18:18:04.804 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.808 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057668d5e3dfd9910-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.809 DEBUG:boto:b'cjqttm-51obj000000000000000000051000falseobj000000000000000000052024-04-16T18:17:59.515Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.809 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-16T18:18:04.809 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.809 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.809 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.809 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.809 DEBUG:boto:Method: GET 2024-04-16T18:18:04.809 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.810 DEBUG:boto:Data: 2024-04-16T18:18:04.810 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.810 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.810 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.810 DEBUG:boto:Params: {} 2024-04-16T18:18:04.810 DEBUG:boto:Token: None 2024-04-16T18:18:04.810 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.810 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4= 2024-04-16T18:18:04.810 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4=', 'Content-Length': '0'} 2024-04-16T18:18:04.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0d8a0da58f1c5c8-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.854 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.855 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.855 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.855 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.855 DEBUG:boto:Method: GET 2024-04-16T18:18:04.855 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.855 DEBUG:boto:Data: 2024-04-16T18:18:04.855 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.855 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.855 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.855 DEBUG:boto:Params: {} 2024-04-16T18:18:04.855 DEBUG:boto:Token: None 2024-04-16T18:18:04.856 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.856 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4= 2024-04-16T18:18:04.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4=', 'Content-Length': '0'} 2024-04-16T18:18:04.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029df762f7413267a-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.858 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.858 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.858 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.858 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.858 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.859 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.859 DEBUG:boto:Data: 2024-04-16T18:18:04.859 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.859 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.859 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.859 DEBUG:boto:Params: {} 2024-04-16T18:18:04.859 DEBUG:boto:Token: None 2024-04-16T18:18:04.859 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.859 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JqsfYdT9MMJGY7ScXp91gbuDNRM= 2024-04-16T18:18:04.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JqsfYdT9MMJGY7ScXp91gbuDNRM=', 'Content-Length': '0'} 2024-04-16T18:18:04.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002559d749c523815a-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.862 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.862 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.862 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.862 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.863 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.863 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.863 DEBUG:boto:Data: 2024-04-16T18:18:04.863 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.863 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.863 DEBUG:boto:Params: {} 2024-04-16T18:18:04.863 DEBUG:boto:Token: None 2024-04-16T18:18:04.863 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JqsfYdT9MMJGY7ScXp91gbuDNRM= 2024-04-16T18:18:04.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JqsfYdT9MMJGY7ScXp91gbuDNRM=', 'Content-Length': '0'} 2024-04-16T18:18:04.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087b548cc7eaa075b-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-16T18:18:04.866 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.866 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.866 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.866 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.866 DEBUG:boto:Method: GET 2024-04-16T18:18:04.866 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.866 DEBUG:boto:Data: 2024-04-16T18:18:04.866 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.866 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.866 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.866 DEBUG:boto:Params: {} 2024-04-16T18:18:04.867 DEBUG:boto:Token: None 2024-04-16T18:18:04.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4= 2024-04-16T18:18:04.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4=', 'Content-Length': '0'} 2024-04-16T18:18:04.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003233a19e6ea18a1b-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.910 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.911 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.911 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.911 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.911 DEBUG:boto:Method: GET 2024-04-16T18:18:04.911 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.911 DEBUG:boto:Data: 2024-04-16T18:18:04.911 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.911 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.911 DEBUG:boto:Params: {} 2024-04-16T18:18:04.911 DEBUG:boto:Token: None 2024-04-16T18:18:04.912 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006?versionId=null 2024-04-16T18:18:04.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4= 2024-04-16T18:18:04.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iOG2rPusnJc1Iypazjpti6gWbu4=', 'Content-Length': '0'} 2024-04-16T18:18:04.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051f9c7e6037fd52a-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.914 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.914 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.914 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:04.914 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:04.914 DEBUG:boto:Method: GET 2024-04-16T18:18:04.914 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:04.915 DEBUG:boto:Data: 2024-04-16T18:18:04.915 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.915 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.915 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.915 DEBUG:boto:Params: {} 2024-04-16T18:18:04.915 DEBUG:boto:Token: None 2024-04-16T18:18:04.915 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.915 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.918 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d40666c590742f8f-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.958 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.959 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:04.959 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:04.959 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:04.959 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:04.959 DEBUG:boto:Method: GET 2024-04-16T18:18:04.959 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:04.959 DEBUG:boto:Data: 2024-04-16T18:18:04.959 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.959 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.959 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.960 DEBUG:boto:Params: {} 2024-04-16T18:18:04.960 DEBUG:boto:Token: None 2024-04-16T18:18:04.960 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/ 2024-04-16T18:18:04.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc= 2024-04-16T18:18:04.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4BYUIX2ikm93Sxiv+P3AWbsnrJc=', 'Content-Length': '0'} 2024-04-16T18:18:04.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f3ee912f97451293-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.964 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:04.964 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.964 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.965 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.965 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.965 DEBUG:boto:Data: 2024-04-16T18:18:04.965 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.965 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.965 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.965 DEBUG:boto:Params: {} 2024-04-16T18:18:04.965 DEBUG:boto:Token: None 2024-04-16T18:18:04.965 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.966 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iGTKGyfX/Ik9y/Q8ouRacvMHlMI= 2024-04-16T18:18:04.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iGTKGyfX/Ik9y/Q8ouRacvMHlMI=', 'Content-Length': '0'} 2024-04-16T18:18:04.968 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2a5e9736a6f0edb-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.968 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.969 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.969 DEBUG:boto:Method: HEAD 2024-04-16T18:18:04.969 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.969 DEBUG:boto:Data: 2024-04-16T18:18:04.969 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.969 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:04.969 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.969 DEBUG:boto:Params: {} 2024-04-16T18:18:04.969 DEBUG:boto:Token: None 2024-04-16T18:18:04.969 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.970 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iGTKGyfX/Ik9y/Q8ouRacvMHlMI= 2024-04-16T18:18:04.970 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iGTKGyfX/Ik9y/Q8ouRacvMHlMI=', 'Content-Length': '0'} 2024-04-16T18:18:04.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063a29c1282e0434a-00661ec0dc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:04.972 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000006 2024-04-16T18:18:04.972 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.972 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.972 DEBUG:boto:Method: GET 2024-04-16T18:18:04.972 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.972 DEBUG:boto:Data: 2024-04-16T18:18:04.972 DEBUG:boto:Headers: {} 2024-04-16T18:18:04.972 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:04.972 DEBUG:boto:Port: 8000 2024-04-16T18:18:04.972 DEBUG:boto:Params: {} 2024-04-16T18:18:04.973 DEBUG:boto:Token: None 2024-04-16T18:18:04.973 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:04 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:04.973 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m+bpRMHv6soAtdJ/ggG01Q4iNvg= 2024-04-16T18:18:04.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m+bpRMHv6soAtdJ/ggG01Q4iNvg=', 'Content-Length': '0'} 2024-04-16T18:18:04.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000133ecd8b33562237-00661ec0dc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.018 DEBUG:boto:path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:05.018 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000006 2024-04-16T18:18:05.019 DEBUG:boto:Method: GET 2024-04-16T18:18:05.019 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:05.019 DEBUG:boto:Data: 2024-04-16T18:18:05.019 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.019 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.019 DEBUG:boto:Params: {} 2024-04-16T18:18:05.019 DEBUG:boto:Token: None 2024-04-16T18:18:05.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000006 2024-04-16T18:18:05.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KLoYfHGUcVPT5QwZHGhyQUBNyzI= 2024-04-16T18:18:05.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KLoYfHGUcVPT5QwZHGhyQUBNyzI=', 'Content-Length': '0'} 2024-04-16T18:18:05.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ca396fe1d8f5719-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.022 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.022 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.022 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:05.022 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:05.022 DEBUG:boto:Method: GET 2024-04-16T18:18:05.022 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:05.023 DEBUG:boto:Data: 2024-04-16T18:18:05.023 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.023 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.023 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.023 DEBUG:boto:Params: {} 2024-04-16T18:18:05.023 DEBUG:boto:Token: None 2024-04-16T18:18:05.023 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.026 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000015ac864e8c995612-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.066 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.067 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.067 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.067 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:05.067 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:05.067 DEBUG:boto:Method: GET 2024-04-16T18:18:05.067 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000006 2024-04-16T18:18:05.067 DEBUG:boto:Data: 2024-04-16T18:18:05.067 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.067 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.067 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.067 DEBUG:boto:Params: {} 2024-04-16T18:18:05.068 DEBUG:boto:Token: None 2024-04-16T18:18:05.068 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.072 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005df2f6e1fc926a4a-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.072 DEBUG:boto:b'cjqttm-51obj000000000000000000061000falseobj000000000000000000062024-04-16T18:17:59.880Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.072 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2024-04-16T18:18:05.073 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.073 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.073 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.073 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.073 DEBUG:boto:Method: GET 2024-04-16T18:18:05.073 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.073 DEBUG:boto:Data: 2024-04-16T18:18:05.073 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.073 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.073 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.074 DEBUG:boto:Params: {} 2024-04-16T18:18:05.074 DEBUG:boto:Token: None 2024-04-16T18:18:05.074 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.074 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM= 2024-04-16T18:18:05.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM=', 'Content-Length': '0'} 2024-04-16T18:18:05.076 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000940dc9a9da30ac8c-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.118 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.118 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.119 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.119 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.119 DEBUG:boto:Method: GET 2024-04-16T18:18:05.119 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.119 DEBUG:boto:Data: 2024-04-16T18:18:05.119 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.119 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.119 DEBUG:boto:Params: {} 2024-04-16T18:18:05.120 DEBUG:boto:Token: None 2024-04-16T18:18:05.120 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM= 2024-04-16T18:18:05.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM=', 'Content-Length': '0'} 2024-04-16T18:18:05.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c39230dc57460caf-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.122 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.122 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.122 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.122 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.122 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.122 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.123 DEBUG:boto:Data: 2024-04-16T18:18:05.123 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.123 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.123 DEBUG:boto:Params: {} 2024-04-16T18:18:05.123 DEBUG:boto:Token: None 2024-04-16T18:18:05.123 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R0l3juLL8TKgUlbG/gWrTiN0Wes= 2024-04-16T18:18:05.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R0l3juLL8TKgUlbG/gWrTiN0Wes=', 'Content-Length': '0'} 2024-04-16T18:18:05.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055ee37493d27f67c-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.125 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.125 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.126 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.126 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.126 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.126 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.126 DEBUG:boto:Data: 2024-04-16T18:18:05.126 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.126 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.126 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.126 DEBUG:boto:Params: {} 2024-04-16T18:18:05.126 DEBUG:boto:Token: None 2024-04-16T18:18:05.127 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R0l3juLL8TKgUlbG/gWrTiN0Wes= 2024-04-16T18:18:05.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R0l3juLL8TKgUlbG/gWrTiN0Wes=', 'Content-Length': '0'} 2024-04-16T18:18:05.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd4e3a6960844213-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.129 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2024-04-16T18:18:05.129 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.129 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.129 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.129 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.130 DEBUG:boto:Method: GET 2024-04-16T18:18:05.130 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.130 DEBUG:boto:Data: 2024-04-16T18:18:05.130 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.130 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.130 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.130 DEBUG:boto:Params: {} 2024-04-16T18:18:05.130 DEBUG:boto:Token: None 2024-04-16T18:18:05.130 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM= 2024-04-16T18:18:05.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM=', 'Content-Length': '0'} 2024-04-16T18:18:05.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d197aa1b31e66447-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.174 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.174 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.175 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.175 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.175 DEBUG:boto:Method: GET 2024-04-16T18:18:05.175 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.175 DEBUG:boto:Data: 2024-04-16T18:18:05.175 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.175 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.175 DEBUG:boto:Params: {} 2024-04-16T18:18:05.175 DEBUG:boto:Token: None 2024-04-16T18:18:05.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007?versionId=null 2024-04-16T18:18:05.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM= 2024-04-16T18:18:05.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PFHV36XaEiFhlPwe0Oh5Kt6b7kM=', 'Content-Length': '0'} 2024-04-16T18:18:05.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0067b67d308f7df-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.178 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.178 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.178 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.178 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.178 DEBUG:boto:Method: GET 2024-04-16T18:18:05.181 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.181 DEBUG:boto:Data: 2024-04-16T18:18:05.181 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.181 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.181 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.181 DEBUG:boto:Params: {} 2024-04-16T18:18:05.182 DEBUG:boto:Token: None 2024-04-16T18:18:05.182 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.182 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.184 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6eb7fe522889422-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.226 DEBUG:boto:b'cjqttm-51obj000000000000000000071000falseobj000000000000000000072024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.227 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.227 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.227 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.227 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.227 DEBUG:boto:Method: GET 2024-04-16T18:18:05.227 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.227 DEBUG:boto:Data: 2024-04-16T18:18:05.227 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.228 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.228 DEBUG:boto:Params: {} 2024-04-16T18:18:05.228 DEBUG:boto:Token: None 2024-04-16T18:18:05.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.232 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b5a02ceb776839b-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.232 DEBUG:boto:b'cjqttm-51obj000000000000000000071000falseobj000000000000000000072024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.232 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.232 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.232 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.233 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.233 DEBUG:boto:Data: 2024-04-16T18:18:05.233 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.233 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.233 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.233 DEBUG:boto:Params: {} 2024-04-16T18:18:05.233 DEBUG:boto:Token: None 2024-04-16T18:18:05.233 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.233 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7vi4ckBI0ZM5/7tuPdjAkf/1/+g= 2024-04-16T18:18:05.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7vi4ckBI0ZM5/7tuPdjAkf/1/+g=', 'Content-Length': '0'} 2024-04-16T18:18:05.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df64d415abb005fe-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.235 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.236 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.236 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.236 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.236 DEBUG:boto:Data: 2024-04-16T18:18:05.236 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.236 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.236 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.236 DEBUG:boto:Params: {} 2024-04-16T18:18:05.236 DEBUG:boto:Token: None 2024-04-16T18:18:05.236 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7vi4ckBI0ZM5/7tuPdjAkf/1/+g= 2024-04-16T18:18:05.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7vi4ckBI0ZM5/7tuPdjAkf/1/+g=', 'Content-Length': '0'} 2024-04-16T18:18:05.238 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ae16c1bbf997f4-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000007 2024-04-16T18:18:05.239 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.239 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.239 DEBUG:boto:Method: GET 2024-04-16T18:18:05.239 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.239 DEBUG:boto:Data: 2024-04-16T18:18:05.239 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.239 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.239 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.240 DEBUG:boto:Params: {} 2024-04-16T18:18:05.240 DEBUG:boto:Token: None 2024-04-16T18:18:05.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9gNLX654D2/qwTr49kgJ5+ZrH4Y= 2024-04-16T18:18:05.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9gNLX654D2/qwTr49kgJ5+ZrH4Y=', 'Content-Length': '0'} 2024-04-16T18:18:05.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b729a1593fb30c2-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.282 DEBUG:boto:path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.282 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.283 DEBUG:boto:Method: GET 2024-04-16T18:18:05.283 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.283 DEBUG:boto:Data: 2024-04-16T18:18:05.283 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.283 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.283 DEBUG:boto:Params: {} 2024-04-16T18:18:05.283 DEBUG:boto:Token: None 2024-04-16T18:18:05.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000007 2024-04-16T18:18:05.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9gNLX654D2/qwTr49kgJ5+ZrH4Y= 2024-04-16T18:18:05.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9gNLX654D2/qwTr49kgJ5+ZrH4Y=', 'Content-Length': '0'} 2024-04-16T18:18:05.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e260bc88f07519e-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.286 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.286 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.286 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.286 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.286 DEBUG:boto:Method: GET 2024-04-16T18:18:05.286 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.286 DEBUG:boto:Data: 2024-04-16T18:18:05.286 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.286 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.286 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.286 DEBUG:boto:Params: {} 2024-04-16T18:18:05.287 DEBUG:boto:Token: None 2024-04-16T18:18:05.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.289 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da68a0dbac92841d-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.330 DEBUG:boto:b'cjqttm-51obj000000000000000000071000falseobj000000000000000000072024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.331 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.331 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.331 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.331 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.331 DEBUG:boto:Method: GET 2024-04-16T18:18:05.331 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000007 2024-04-16T18:18:05.331 DEBUG:boto:Data: 2024-04-16T18:18:05.331 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.331 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.331 DEBUG:boto:Params: {} 2024-04-16T18:18:05.332 DEBUG:boto:Token: None 2024-04-16T18:18:05.332 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.336 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009642479f59d1b846-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.336 DEBUG:boto:b'cjqttm-51obj000000000000000000071000falseobj000000000000000000072024-04-16T18:17:59.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2024-04-16T18:18:05.337 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.337 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.337 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.337 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.337 DEBUG:boto:Method: GET 2024-04-16T18:18:05.337 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.337 DEBUG:boto:Data: 2024-04-16T18:18:05.337 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.337 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.337 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.337 DEBUG:boto:Params: {} 2024-04-16T18:18:05.338 DEBUG:boto:Token: None 2024-04-16T18:18:05.338 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.338 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY= 2024-04-16T18:18:05.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY=', 'Content-Length': '0'} 2024-04-16T18:18:05.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044e9f4dca3eeea85-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.382 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.383 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.385 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.385 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.385 DEBUG:boto:Method: GET 2024-04-16T18:18:05.385 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.386 DEBUG:boto:Data: 2024-04-16T18:18:05.386 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.386 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.386 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.386 DEBUG:boto:Params: {} 2024-04-16T18:18:05.386 DEBUG:boto:Token: None 2024-04-16T18:18:05.386 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY= 2024-04-16T18:18:05.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY=', 'Content-Length': '0'} 2024-04-16T18:18:05.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000684604ea78c31e7c-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.389 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.389 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.389 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.389 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.389 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.389 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.389 DEBUG:boto:Data: 2024-04-16T18:18:05.389 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.390 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.390 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.390 DEBUG:boto:Params: {} 2024-04-16T18:18:05.390 DEBUG:boto:Token: None 2024-04-16T18:18:05.390 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.390 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+TFbCTqwjC4++FlQ8/tdGR+7YV4= 2024-04-16T18:18:05.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+TFbCTqwjC4++FlQ8/tdGR+7YV4=', 'Content-Length': '0'} 2024-04-16T18:18:05.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077873c4cc0f4981b-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.392 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.392 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.393 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.393 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.393 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.393 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.393 DEBUG:boto:Data: 2024-04-16T18:18:05.393 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.393 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.393 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.393 DEBUG:boto:Params: {} 2024-04-16T18:18:05.393 DEBUG:boto:Token: None 2024-04-16T18:18:05.394 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.394 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+TFbCTqwjC4++FlQ8/tdGR+7YV4= 2024-04-16T18:18:05.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+TFbCTqwjC4++FlQ8/tdGR+7YV4=', 'Content-Length': '0'} 2024-04-16T18:18:05.396 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2a355c6381f29e6-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2024-04-16T18:18:05.396 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.396 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.396 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.396 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.397 DEBUG:boto:Method: GET 2024-04-16T18:18:05.397 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.397 DEBUG:boto:Data: 2024-04-16T18:18:05.397 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.397 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.397 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.397 DEBUG:boto:Params: {} 2024-04-16T18:18:05.397 DEBUG:boto:Token: None 2024-04-16T18:18:05.397 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY= 2024-04-16T18:18:05.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY=', 'Content-Length': '0'} 2024-04-16T18:18:05.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6583ad51b9f6ceb-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.442 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.442 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.443 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.443 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.443 DEBUG:boto:Method: GET 2024-04-16T18:18:05.443 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.443 DEBUG:boto:Data: 2024-04-16T18:18:05.443 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.443 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.443 DEBUG:boto:Params: {} 2024-04-16T18:18:05.443 DEBUG:boto:Token: None 2024-04-16T18:18:05.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008?versionId=null 2024-04-16T18:18:05.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY= 2024-04-16T18:18:05.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wn9n2/axQkzlAZce4/+Kfncg/PY=', 'Content-Length': '0'} 2024-04-16T18:18:05.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b879982a8c068632-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.446 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.446 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.446 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.446 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.446 DEBUG:boto:Method: GET 2024-04-16T18:18:05.447 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.447 DEBUG:boto:Data: 2024-04-16T18:18:05.447 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.447 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.447 DEBUG:boto:Params: {} 2024-04-16T18:18:05.447 DEBUG:boto:Token: None 2024-04-16T18:18:05.447 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.447 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.450 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0e6566be0d0afcd-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.490 DEBUG:boto:b'cjqttm-51obj000000000000000000081000falseobj000000000000000000082024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.491 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.491 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.491 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.491 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.491 DEBUG:boto:Method: GET 2024-04-16T18:18:05.491 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.491 DEBUG:boto:Data: 2024-04-16T18:18:05.491 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.491 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.491 DEBUG:boto:Params: {} 2024-04-16T18:18:05.492 DEBUG:boto:Token: None 2024-04-16T18:18:05.492 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.496 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4d9b2724d41455b-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.496 DEBUG:boto:b'cjqttm-51obj000000000000000000081000falseobj000000000000000000082024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.496 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.496 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.496 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.496 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.496 DEBUG:boto:Data: 2024-04-16T18:18:05.497 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.497 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.497 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.497 DEBUG:boto:Params: {} 2024-04-16T18:18:05.497 DEBUG:boto:Token: None 2024-04-16T18:18:05.497 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.497 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tJGYCwPhdSALzS4+wEW32DxwyV4= 2024-04-16T18:18:05.497 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tJGYCwPhdSALzS4+wEW32DxwyV4=', 'Content-Length': '0'} 2024-04-16T18:18:05.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003abfc4811d00a3a-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.499 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.499 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.499 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.499 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.499 DEBUG:boto:Data: 2024-04-16T18:18:05.500 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.500 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.500 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.500 DEBUG:boto:Params: {} 2024-04-16T18:18:05.500 DEBUG:boto:Token: None 2024-04-16T18:18:05.500 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tJGYCwPhdSALzS4+wEW32DxwyV4= 2024-04-16T18:18:05.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tJGYCwPhdSALzS4+wEW32DxwyV4=', 'Content-Length': '0'} 2024-04-16T18:18:05.502 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002750524277507a58-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000008 2024-04-16T18:18:05.503 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.503 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.503 DEBUG:boto:Method: GET 2024-04-16T18:18:05.503 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.503 DEBUG:boto:Data: 2024-04-16T18:18:05.503 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.503 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.503 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.503 DEBUG:boto:Params: {} 2024-04-16T18:18:05.504 DEBUG:boto:Token: None 2024-04-16T18:18:05.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IpdT1tUSuLxhx47DIhKCJXUN9oQ= 2024-04-16T18:18:05.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IpdT1tUSuLxhx47DIhKCJXUN9oQ=', 'Content-Length': '0'} 2024-04-16T18:18:05.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e231a0bec79dacb7-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.546 DEBUG:boto:path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.546 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.547 DEBUG:boto:Method: GET 2024-04-16T18:18:05.547 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.547 DEBUG:boto:Data: 2024-04-16T18:18:05.547 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.547 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.547 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.547 DEBUG:boto:Params: {} 2024-04-16T18:18:05.547 DEBUG:boto:Token: None 2024-04-16T18:18:05.547 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000008 2024-04-16T18:18:05.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IpdT1tUSuLxhx47DIhKCJXUN9oQ= 2024-04-16T18:18:05.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IpdT1tUSuLxhx47DIhKCJXUN9oQ=', 'Content-Length': '0'} 2024-04-16T18:18:05.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec16d5dc6e0d6b8a-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.550 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.550 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.550 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.550 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.550 DEBUG:boto:Method: GET 2024-04-16T18:18:05.550 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.550 DEBUG:boto:Data: 2024-04-16T18:18:05.550 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.551 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.551 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.551 DEBUG:boto:Params: {} 2024-04-16T18:18:05.551 DEBUG:boto:Token: None 2024-04-16T18:18:05.551 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.551 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.553 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa31052dc7d48369-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.594 DEBUG:boto:b'cjqttm-51obj000000000000000000081000falseobj000000000000000000082024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.595 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.595 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.595 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.595 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.595 DEBUG:boto:Method: GET 2024-04-16T18:18:05.595 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000008 2024-04-16T18:18:05.595 DEBUG:boto:Data: 2024-04-16T18:18:05.595 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.595 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.596 DEBUG:boto:Params: {} 2024-04-16T18:18:05.596 DEBUG:boto:Token: None 2024-04-16T18:18:05.596 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.600 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009466bebe79510254-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.600 DEBUG:boto:b'cjqttm-51obj000000000000000000081000falseobj000000000000000000082024-04-16T18:17:58.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.600 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2024-04-16T18:18:05.601 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.601 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.601 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.601 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.601 DEBUG:boto:Method: GET 2024-04-16T18:18:05.601 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.601 DEBUG:boto:Data: 2024-04-16T18:18:05.601 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.601 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.601 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.601 DEBUG:boto:Params: {} 2024-04-16T18:18:05.602 DEBUG:boto:Token: None 2024-04-16T18:18:05.602 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.602 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ= 2024-04-16T18:18:05.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ=', 'Content-Length': '0'} 2024-04-16T18:18:05.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006fab717882a1311e-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.646 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.646 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.647 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.647 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.647 DEBUG:boto:Method: GET 2024-04-16T18:18:05.647 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.647 DEBUG:boto:Data: 2024-04-16T18:18:05.647 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.647 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.647 DEBUG:boto:Params: {} 2024-04-16T18:18:05.647 DEBUG:boto:Token: None 2024-04-16T18:18:05.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ= 2024-04-16T18:18:05.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ=', 'Content-Length': '0'} 2024-04-16T18:18:05.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012b756e03a74533e-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.650 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.650 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.650 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.650 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.650 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.651 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.651 DEBUG:boto:Data: 2024-04-16T18:18:05.651 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.651 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.651 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.651 DEBUG:boto:Params: {} 2024-04-16T18:18:05.651 DEBUG:boto:Token: None 2024-04-16T18:18:05.651 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0SFmPBrFdDrh6IwsNOMb4m4yitA= 2024-04-16T18:18:05.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0SFmPBrFdDrh6IwsNOMb4m4yitA=', 'Content-Length': '0'} 2024-04-16T18:18:05.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef20d707ed8b07bb-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.653 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.653 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.654 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.654 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.654 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.654 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.654 DEBUG:boto:Data: 2024-04-16T18:18:05.654 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.654 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.654 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.654 DEBUG:boto:Params: {} 2024-04-16T18:18:05.654 DEBUG:boto:Token: None 2024-04-16T18:18:05.655 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0SFmPBrFdDrh6IwsNOMb4m4yitA= 2024-04-16T18:18:05.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0SFmPBrFdDrh6IwsNOMb4m4yitA=', 'Content-Length': '0'} 2024-04-16T18:18:05.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea54c57f1d94d635-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.657 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2024-04-16T18:18:05.657 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.657 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.657 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.657 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.657 DEBUG:boto:Method: GET 2024-04-16T18:18:05.657 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.658 DEBUG:boto:Data: 2024-04-16T18:18:05.658 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.658 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.658 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.658 DEBUG:boto:Params: {} 2024-04-16T18:18:05.658 DEBUG:boto:Token: None 2024-04-16T18:18:05.658 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.658 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ= 2024-04-16T18:18:05.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ=', 'Content-Length': '0'} 2024-04-16T18:18:05.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc436d19ec54a5d0-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.702 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.702 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.703 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.703 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.703 DEBUG:boto:Method: GET 2024-04-16T18:18:05.703 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.703 DEBUG:boto:Data: 2024-04-16T18:18:05.703 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.703 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.703 DEBUG:boto:Params: {} 2024-04-16T18:18:05.703 DEBUG:boto:Token: None 2024-04-16T18:18:05.704 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009?versionId=null 2024-04-16T18:18:05.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ= 2024-04-16T18:18:05.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fou8ggOnlR5PbY553e2ptbAd/GQ=', 'Content-Length': '0'} 2024-04-16T18:18:05.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000728afa73ba577f44-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.706 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.706 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.706 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.706 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.706 DEBUG:boto:Method: GET 2024-04-16T18:18:05.707 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.707 DEBUG:boto:Data: 2024-04-16T18:18:05.707 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.707 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.707 DEBUG:boto:Params: {} 2024-04-16T18:18:05.707 DEBUG:boto:Token: None 2024-04-16T18:18:05.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000664a7f47b0ac1255-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.750 DEBUG:boto:b'cjqttm-51obj000000000000000000091000falseobj000000000000000000092024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.751 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.751 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.751 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.751 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.751 DEBUG:boto:Method: GET 2024-04-16T18:18:05.751 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.751 DEBUG:boto:Data: 2024-04-16T18:18:05.751 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.751 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.752 DEBUG:boto:Params: {} 2024-04-16T18:18:05.752 DEBUG:boto:Token: None 2024-04-16T18:18:05.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.755 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6d882c705845ada-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.756 DEBUG:boto:b'cjqttm-51obj000000000000000000091000falseobj000000000000000000092024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.756 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.756 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.756 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.756 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.757 DEBUG:boto:Data: 2024-04-16T18:18:05.757 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.757 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.757 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.757 DEBUG:boto:Params: {} 2024-04-16T18:18:05.757 DEBUG:boto:Token: None 2024-04-16T18:18:05.757 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.757 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QoYQKDi2VT2lqcITo3u2Dd9/9Sw= 2024-04-16T18:18:05.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QoYQKDi2VT2lqcITo3u2Dd9/9Sw=', 'Content-Length': '0'} 2024-04-16T18:18:05.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cae6b4f3b54c497f-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.759 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.759 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.760 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.760 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.760 DEBUG:boto:Data: 2024-04-16T18:18:05.760 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.760 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.760 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.760 DEBUG:boto:Params: {} 2024-04-16T18:18:05.760 DEBUG:boto:Token: None 2024-04-16T18:18:05.760 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QoYQKDi2VT2lqcITo3u2Dd9/9Sw= 2024-04-16T18:18:05.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QoYQKDi2VT2lqcITo3u2Dd9/9Sw=', 'Content-Length': '0'} 2024-04-16T18:18:05.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009b7c3d6d855ab1e-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.762 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000009 2024-04-16T18:18:05.762 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.763 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.763 DEBUG:boto:Method: GET 2024-04-16T18:18:05.763 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.763 DEBUG:boto:Data: 2024-04-16T18:18:05.763 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.763 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.763 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.763 DEBUG:boto:Params: {} 2024-04-16T18:18:05.763 DEBUG:boto:Token: None 2024-04-16T18:18:05.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tHtUXyf13b9YCAXC7El8PuhzZC4= 2024-04-16T18:18:05.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tHtUXyf13b9YCAXC7El8PuhzZC4=', 'Content-Length': '0'} 2024-04-16T18:18:05.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009900b72b17f25be9-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.806 DEBUG:boto:path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.807 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.807 DEBUG:boto:Method: GET 2024-04-16T18:18:05.807 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.807 DEBUG:boto:Data: 2024-04-16T18:18:05.807 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.808 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.808 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.808 DEBUG:boto:Params: {} 2024-04-16T18:18:05.808 DEBUG:boto:Token: None 2024-04-16T18:18:05.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000009 2024-04-16T18:18:05.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tHtUXyf13b9YCAXC7El8PuhzZC4= 2024-04-16T18:18:05.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tHtUXyf13b9YCAXC7El8PuhzZC4=', 'Content-Length': '0'} 2024-04-16T18:18:05.810 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043c81943fcc665c7-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.811 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.811 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.811 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.811 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.811 DEBUG:boto:Method: GET 2024-04-16T18:18:05.811 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.811 DEBUG:boto:Data: 2024-04-16T18:18:05.811 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.811 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.812 DEBUG:boto:Params: {} 2024-04-16T18:18:05.812 DEBUG:boto:Token: None 2024-04-16T18:18:05.812 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.814 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000087bffc467b9c6a7-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.858 DEBUG:boto:b'cjqttm-51obj000000000000000000091000falseobj000000000000000000092024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.859 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.859 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.859 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.859 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.859 DEBUG:boto:Method: GET 2024-04-16T18:18:05.859 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000009 2024-04-16T18:18:05.859 DEBUG:boto:Data: 2024-04-16T18:18:05.859 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.859 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.860 DEBUG:boto:Params: {} 2024-04-16T18:18:05.860 DEBUG:boto:Token: None 2024-04-16T18:18:05.860 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.864 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c54f6274a85cd0a-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.864 DEBUG:boto:b'cjqttm-51obj000000000000000000091000falseobj000000000000000000092024-04-16T18:18:00.195Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:05.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-16T18:18:05.864 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.864 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.864 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.864 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.865 DEBUG:boto:Method: GET 2024-04-16T18:18:05.865 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.865 DEBUG:boto:Data: 2024-04-16T18:18:05.865 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.865 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.865 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.865 DEBUG:boto:Params: {} 2024-04-16T18:18:05.865 DEBUG:boto:Token: None 2024-04-16T18:18:05.865 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.865 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y= 2024-04-16T18:18:05.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y=', 'Content-Length': '0'} 2024-04-16T18:18:05.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccb51f8adb82a1a5-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.910 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.911 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.911 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.911 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.911 DEBUG:boto:Method: GET 2024-04-16T18:18:05.911 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.911 DEBUG:boto:Data: 2024-04-16T18:18:05.911 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.911 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.911 DEBUG:boto:Params: {} 2024-04-16T18:18:05.911 DEBUG:boto:Token: None 2024-04-16T18:18:05.912 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y= 2024-04-16T18:18:05.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y=', 'Content-Length': '0'} 2024-04-16T18:18:05.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000090b0293bf80840f-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.915 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.915 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.915 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.915 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.915 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.915 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.915 DEBUG:boto:Data: 2024-04-16T18:18:05.915 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.915 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.915 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.916 DEBUG:boto:Params: {} 2024-04-16T18:18:05.916 DEBUG:boto:Token: None 2024-04-16T18:18:05.916 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdKQ5Hof7306EL6kis5Wz4IcWFM= 2024-04-16T18:18:05.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdKQ5Hof7306EL6kis5Wz4IcWFM=', 'Content-Length': '0'} 2024-04-16T18:18:05.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a24a6c62fefd349-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.918 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.918 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.918 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.918 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.918 DEBUG:boto:Method: HEAD 2024-04-16T18:18:05.918 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.918 DEBUG:boto:Data: 2024-04-16T18:18:05.919 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.919 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.919 DEBUG:boto:Params: {} 2024-04-16T18:18:05.919 DEBUG:boto:Token: None 2024-04-16T18:18:05.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdKQ5Hof7306EL6kis5Wz4IcWFM= 2024-04-16T18:18:05.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdKQ5Hof7306EL6kis5Wz4IcWFM=', 'Content-Length': '0'} 2024-04-16T18:18:05.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca61b498ffabdf4e-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-16T18:18:05.921 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.922 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.922 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.922 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.922 DEBUG:boto:Method: GET 2024-04-16T18:18:05.922 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.922 DEBUG:boto:Data: 2024-04-16T18:18:05.922 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.922 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.922 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.922 DEBUG:boto:Params: {} 2024-04-16T18:18:05.923 DEBUG:boto:Token: None 2024-04-16T18:18:05.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y= 2024-04-16T18:18:05.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y=', 'Content-Length': '0'} 2024-04-16T18:18:05.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033cbc7c140207adc-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.966 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.966 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:05.967 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.967 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.967 DEBUG:boto:Method: GET 2024-04-16T18:18:05.967 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.967 DEBUG:boto:Data: 2024-04-16T18:18:05.967 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:05.967 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.967 DEBUG:boto:Params: {} 2024-04-16T18:18:05.967 DEBUG:boto:Token: None 2024-04-16T18:18:05.967 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/obj00000000000000000010?versionId=null 2024-04-16T18:18:05.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y= 2024-04-16T18:18:05.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F5f8Y5f//C7cThQTJSBpuCsuf1Y=', 'Content-Length': '0'} 2024-04-16T18:18:05.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dae1356a8377c3e-00661ec0dd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:05.970 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:05.970 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:05.970 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:05.970 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:05.970 DEBUG:boto:Method: GET 2024-04-16T18:18:05.971 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:05.971 DEBUG:boto:Data: 2024-04-16T18:18:05.971 DEBUG:boto:Headers: {} 2024-04-16T18:18:05.971 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:05.971 DEBUG:boto:Port: 8000 2024-04-16T18:18:05.971 DEBUG:boto:Params: {} 2024-04-16T18:18:05.971 DEBUG:boto:Token: None 2024-04-16T18:18:05.971 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:05 GMT /cjqttm-51/ 2024-04-16T18:18:05.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo= 2024-04-16T18:18:05.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v7lKMfLZq0fo8d7XXdcwzH5mkQo=', 'Content-Length': '0'} 2024-04-16T18:18:05.974 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f068b7f4946b12e8-00661ec0dd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.014 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.015 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.015 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.015 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.015 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.015 DEBUG:boto:Method: GET 2024-04-16T18:18:06.015 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.015 DEBUG:boto:Data: 2024-04-16T18:18:06.015 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.015 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.015 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.015 DEBUG:boto:Params: {} 2024-04-16T18:18:06.016 DEBUG:boto:Token: None 2024-04-16T18:18:06.016 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049d909e6e8cf641e-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.020 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.020 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.020 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.020 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.020 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.021 DEBUG:boto:Data: 2024-04-16T18:18:06.021 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.021 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.021 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.021 DEBUG:boto:Params: {} 2024-04-16T18:18:06.021 DEBUG:boto:Token: None 2024-04-16T18:18:06.021 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.021 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pV3FBxWTOWQ8Y4PiozWoMSzfk/8= 2024-04-16T18:18:06.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pV3FBxWTOWQ8Y4PiozWoMSzfk/8=', 'Content-Length': '0'} 2024-04-16T18:18:06.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da5992cb740601c8-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.023 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.023 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.024 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.024 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.024 DEBUG:boto:Data: 2024-04-16T18:18:06.024 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.024 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.024 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.024 DEBUG:boto:Params: {} 2024-04-16T18:18:06.024 DEBUG:boto:Token: None 2024-04-16T18:18:06.024 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pV3FBxWTOWQ8Y4PiozWoMSzfk/8= 2024-04-16T18:18:06.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pV3FBxWTOWQ8Y4PiozWoMSzfk/8=', 'Content-Length': '0'} 2024-04-16T18:18:06.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009ef40a14d3b5d60-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.027 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000010 2024-04-16T18:18:06.027 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.027 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.027 DEBUG:boto:Method: GET 2024-04-16T18:18:06.027 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.027 DEBUG:boto:Data: 2024-04-16T18:18:06.027 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.027 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.028 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.028 DEBUG:boto:Params: {} 2024-04-16T18:18:06.028 DEBUG:boto:Token: None 2024-04-16T18:18:06.028 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.028 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+4AVeHc8RQDX+bIX0PMDWqIexQg= 2024-04-16T18:18:06.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+4AVeHc8RQDX+bIX0PMDWqIexQg=', 'Content-Length': '0'} 2024-04-16T18:18:06.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078d3f687e46e9f7e-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.070 DEBUG:boto:path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.070 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.071 DEBUG:boto:Method: GET 2024-04-16T18:18:06.071 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.071 DEBUG:boto:Data: 2024-04-16T18:18:06.071 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.071 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.071 DEBUG:boto:Params: {} 2024-04-16T18:18:06.071 DEBUG:boto:Token: None 2024-04-16T18:18:06.071 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000010 2024-04-16T18:18:06.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+4AVeHc8RQDX+bIX0PMDWqIexQg= 2024-04-16T18:18:06.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+4AVeHc8RQDX+bIX0PMDWqIexQg=', 'Content-Length': '0'} 2024-04-16T18:18:06.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e3a85540f26e3b6-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.074 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.074 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.074 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.074 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.075 DEBUG:boto:Method: GET 2024-04-16T18:18:06.075 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.075 DEBUG:boto:Data: 2024-04-16T18:18:06.075 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.075 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.075 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.075 DEBUG:boto:Params: {} 2024-04-16T18:18:06.075 DEBUG:boto:Token: None 2024-04-16T18:18:06.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6a493ccc3380cea-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.118 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.119 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.119 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.119 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.119 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.119 DEBUG:boto:Method: GET 2024-04-16T18:18:06.119 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000010 2024-04-16T18:18:06.119 DEBUG:boto:Data: 2024-04-16T18:18:06.119 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.120 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.120 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.120 DEBUG:boto:Params: {} 2024-04-16T18:18:06.120 DEBUG:boto:Token: None 2024-04-16T18:18:06.120 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.124 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004afb8e1fe672c8c2-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.124 DEBUG:boto:b'cjqttm-51obj000000000000000000101000falseobj000000000000000000102024-04-16T18:17:59.635Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.125 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-16T18:18:06.125 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.125 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.125 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.126 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.126 DEBUG:boto:Method: GET 2024-04-16T18:18:06.126 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.126 DEBUG:boto:Data: 2024-04-16T18:18:06.126 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.126 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.127 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.127 DEBUG:boto:Params: {} 2024-04-16T18:18:06.127 DEBUG:boto:Token: None 2024-04-16T18:18:06.127 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE= 2024-04-16T18:18:06.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE=', 'Content-Length': '0'} 2024-04-16T18:18:06.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d07771d6e1cb5378-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.170 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.170 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.170 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.171 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.171 DEBUG:boto:Method: GET 2024-04-16T18:18:06.171 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.171 DEBUG:boto:Data: 2024-04-16T18:18:06.171 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.171 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.171 DEBUG:boto:Params: {} 2024-04-16T18:18:06.171 DEBUG:boto:Token: None 2024-04-16T18:18:06.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE= 2024-04-16T18:18:06.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE=', 'Content-Length': '0'} 2024-04-16T18:18:06.174 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd8673da16291c41-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.174 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.175 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.175 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.175 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.175 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.175 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.175 DEBUG:boto:Data: 2024-04-16T18:18:06.175 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.175 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.175 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.175 DEBUG:boto:Params: {} 2024-04-16T18:18:06.176 DEBUG:boto:Token: None 2024-04-16T18:18:06.176 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e6bVMwgqxyl1ryzhBMixGrx7OgY= 2024-04-16T18:18:06.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e6bVMwgqxyl1ryzhBMixGrx7OgY=', 'Content-Length': '0'} 2024-04-16T18:18:06.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083af6fc556ea708f-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.178 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.178 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.178 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.178 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.178 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.179 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.179 DEBUG:boto:Data: 2024-04-16T18:18:06.179 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.179 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.179 DEBUG:boto:Params: {} 2024-04-16T18:18:06.179 DEBUG:boto:Token: None 2024-04-16T18:18:06.179 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e6bVMwgqxyl1ryzhBMixGrx7OgY= 2024-04-16T18:18:06.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e6bVMwgqxyl1ryzhBMixGrx7OgY=', 'Content-Length': '0'} 2024-04-16T18:18:06.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043da2e2a42b22255-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.181 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-16T18:18:06.181 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.181 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.182 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.182 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.182 DEBUG:boto:Method: GET 2024-04-16T18:18:06.182 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.182 DEBUG:boto:Data: 2024-04-16T18:18:06.182 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.182 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.182 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.182 DEBUG:boto:Params: {} 2024-04-16T18:18:06.182 DEBUG:boto:Token: None 2024-04-16T18:18:06.183 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE= 2024-04-16T18:18:06.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE=', 'Content-Length': '0'} 2024-04-16T18:18:06.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000194baac50842878a-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.226 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.226 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.227 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.227 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.227 DEBUG:boto:Method: GET 2024-04-16T18:18:06.227 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.227 DEBUG:boto:Data: 2024-04-16T18:18:06.227 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.227 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.227 DEBUG:boto:Params: {} 2024-04-16T18:18:06.227 DEBUG:boto:Token: None 2024-04-16T18:18:06.227 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011?versionId=null 2024-04-16T18:18:06.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE= 2024-04-16T18:18:06.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hP+sFkPJdPpBSSmURTqxIV9NdAE=', 'Content-Length': '0'} 2024-04-16T18:18:06.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab463264ee16fd11-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.230 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.230 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.230 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.230 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.230 DEBUG:boto:Method: GET 2024-04-16T18:18:06.230 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.230 DEBUG:boto:Data: 2024-04-16T18:18:06.230 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.230 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.230 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.231 DEBUG:boto:Params: {} 2024-04-16T18:18:06.231 DEBUG:boto:Token: None 2024-04-16T18:18:06.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.233 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4d6b70c05bfca55-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.274 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.275 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.275 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.275 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.275 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.275 DEBUG:boto:Method: GET 2024-04-16T18:18:06.275 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.275 DEBUG:boto:Data: 2024-04-16T18:18:06.276 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.276 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.276 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.276 DEBUG:boto:Params: {} 2024-04-16T18:18:06.276 DEBUG:boto:Token: None 2024-04-16T18:18:06.276 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a7e262335fb8d96-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.280 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.280 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.280 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.281 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.281 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.281 DEBUG:boto:Data: 2024-04-16T18:18:06.281 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.281 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.281 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.281 DEBUG:boto:Params: {} 2024-04-16T18:18:06.281 DEBUG:boto:Token: None 2024-04-16T18:18:06.281 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.281 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UhrCuyJ1R7EVbTLpCGz52Z/a8Y4= 2024-04-16T18:18:06.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UhrCuyJ1R7EVbTLpCGz52Z/a8Y4=', 'Content-Length': '0'} 2024-04-16T18:18:06.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9340db1ac10d69d-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.284 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.284 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.284 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.284 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.284 DEBUG:boto:Data: 2024-04-16T18:18:06.284 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.284 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.284 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.284 DEBUG:boto:Params: {} 2024-04-16T18:18:06.284 DEBUG:boto:Token: None 2024-04-16T18:18:06.285 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UhrCuyJ1R7EVbTLpCGz52Z/a8Y4= 2024-04-16T18:18:06.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UhrCuyJ1R7EVbTLpCGz52Z/a8Y4=', 'Content-Length': '0'} 2024-04-16T18:18:06.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb865aa5553ca810-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.287 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000011 2024-04-16T18:18:06.287 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.287 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.287 DEBUG:boto:Method: GET 2024-04-16T18:18:06.287 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.287 DEBUG:boto:Data: 2024-04-16T18:18:06.288 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.288 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.288 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.288 DEBUG:boto:Params: {} 2024-04-16T18:18:06.288 DEBUG:boto:Token: None 2024-04-16T18:18:06.288 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tukgvMHf0D72t2YG+SvFn4TPeJM= 2024-04-16T18:18:06.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tukgvMHf0D72t2YG+SvFn4TPeJM=', 'Content-Length': '0'} 2024-04-16T18:18:06.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a73d2fd8a72e56d0-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.330 DEBUG:boto:path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.330 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.331 DEBUG:boto:Method: GET 2024-04-16T18:18:06.331 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.331 DEBUG:boto:Data: 2024-04-16T18:18:06.331 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.331 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.331 DEBUG:boto:Params: {} 2024-04-16T18:18:06.331 DEBUG:boto:Token: None 2024-04-16T18:18:06.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000011 2024-04-16T18:18:06.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tukgvMHf0D72t2YG+SvFn4TPeJM= 2024-04-16T18:18:06.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tukgvMHf0D72t2YG+SvFn4TPeJM=', 'Content-Length': '0'} 2024-04-16T18:18:06.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000950ebb90a03f8db4-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.334 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.334 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.334 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.334 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.334 DEBUG:boto:Method: GET 2024-04-16T18:18:06.334 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.334 DEBUG:boto:Data: 2024-04-16T18:18:06.334 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.335 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.335 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.335 DEBUG:boto:Params: {} 2024-04-16T18:18:06.335 DEBUG:boto:Token: None 2024-04-16T18:18:06.335 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.338 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000077f5d6067996f4ab-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.378 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.379 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.379 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.379 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.379 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.379 DEBUG:boto:Method: GET 2024-04-16T18:18:06.379 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000011 2024-04-16T18:18:06.379 DEBUG:boto:Data: 2024-04-16T18:18:06.379 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.379 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.379 DEBUG:boto:Params: {} 2024-04-16T18:18:06.380 DEBUG:boto:Token: None 2024-04-16T18:18:06.380 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.384 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ffeaaef11165a33-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.384 DEBUG:boto:b'cjqttm-51obj000000000000000000111000falseobj000000000000000000112024-04-16T18:17:58.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-16T18:18:06.384 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.384 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.385 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.385 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.385 DEBUG:boto:Method: GET 2024-04-16T18:18:06.385 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.385 DEBUG:boto:Data: 2024-04-16T18:18:06.385 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.385 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.385 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.385 DEBUG:boto:Params: {} 2024-04-16T18:18:06.385 DEBUG:boto:Token: None 2024-04-16T18:18:06.386 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc= 2024-04-16T18:18:06.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc=', 'Content-Length': '0'} 2024-04-16T18:18:06.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000894710760bf97c76-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.430 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.431 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.431 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.431 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.431 DEBUG:boto:Method: GET 2024-04-16T18:18:06.431 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.431 DEBUG:boto:Data: 2024-04-16T18:18:06.431 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.431 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.431 DEBUG:boto:Params: {} 2024-04-16T18:18:06.431 DEBUG:boto:Token: None 2024-04-16T18:18:06.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc= 2024-04-16T18:18:06.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc=', 'Content-Length': '0'} 2024-04-16T18:18:06.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091c22a857de4fc24-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.434 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.434 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.434 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.434 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.435 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.435 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.435 DEBUG:boto:Data: 2024-04-16T18:18:06.435 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.435 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.435 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.435 DEBUG:boto:Params: {} 2024-04-16T18:18:06.435 DEBUG:boto:Token: None 2024-04-16T18:18:06.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fzA7TraQBikp4UuIHi8TAe3YN5Q= 2024-04-16T18:18:06.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fzA7TraQBikp4UuIHi8TAe3YN5Q=', 'Content-Length': '0'} 2024-04-16T18:18:06.438 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c002be5268324f24-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.438 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.438 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.439 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.439 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.439 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.439 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.439 DEBUG:boto:Data: 2024-04-16T18:18:06.439 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.439 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.439 DEBUG:boto:Params: {} 2024-04-16T18:18:06.439 DEBUG:boto:Token: None 2024-04-16T18:18:06.439 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fzA7TraQBikp4UuIHi8TAe3YN5Q= 2024-04-16T18:18:06.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fzA7TraQBikp4UuIHi8TAe3YN5Q=', 'Content-Length': '0'} 2024-04-16T18:18:06.442 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098f11f5a18c0866f-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.442 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-16T18:18:06.442 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.443 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.443 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.443 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.443 DEBUG:boto:Method: GET 2024-04-16T18:18:06.443 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.443 DEBUG:boto:Data: 2024-04-16T18:18:06.443 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.443 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.443 DEBUG:boto:Params: {} 2024-04-16T18:18:06.443 DEBUG:boto:Token: None 2024-04-16T18:18:06.443 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc= 2024-04-16T18:18:06.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc=', 'Content-Length': '0'} 2024-04-16T18:18:06.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0ff1ac334734eb3-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.486 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.486 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.486 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.487 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.487 DEBUG:boto:Method: GET 2024-04-16T18:18:06.487 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.487 DEBUG:boto:Data: 2024-04-16T18:18:06.487 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.487 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.487 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.487 DEBUG:boto:Params: {} 2024-04-16T18:18:06.487 DEBUG:boto:Token: None 2024-04-16T18:18:06.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012?versionId=null 2024-04-16T18:18:06.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc= 2024-04-16T18:18:06.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0SCScjYMqW6w5H4vC62/IEvFcyc=', 'Content-Length': '0'} 2024-04-16T18:18:06.490 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008d12b5c15a6e749-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.490 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.490 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.491 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.491 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.491 DEBUG:boto:Method: GET 2024-04-16T18:18:06.491 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.491 DEBUG:boto:Data: 2024-04-16T18:18:06.491 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.491 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.491 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.491 DEBUG:boto:Params: {} 2024-04-16T18:18:06.491 DEBUG:boto:Token: None 2024-04-16T18:18:06.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.494 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002454b2cb57fa383d-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.534 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.535 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.535 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.535 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.535 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.535 DEBUG:boto:Method: GET 2024-04-16T18:18:06.535 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.535 DEBUG:boto:Data: 2024-04-16T18:18:06.535 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.535 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.535 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.536 DEBUG:boto:Params: {} 2024-04-16T18:18:06.536 DEBUG:boto:Token: None 2024-04-16T18:18:06.536 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.540 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b657a8ab90ca60f-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.540 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.541 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.541 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.541 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.541 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.541 DEBUG:boto:Data: 2024-04-16T18:18:06.541 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.541 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.541 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.541 DEBUG:boto:Params: {} 2024-04-16T18:18:06.541 DEBUG:boto:Token: None 2024-04-16T18:18:06.542 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.542 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:toi8qc2QucrtIJ9T9xaIfoG73GI= 2024-04-16T18:18:06.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:toi8qc2QucrtIJ9T9xaIfoG73GI=', 'Content-Length': '0'} 2024-04-16T18:18:06.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f874441f5083520-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.544 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.544 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.544 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.545 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.545 DEBUG:boto:Data: 2024-04-16T18:18:06.545 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.545 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.545 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.545 DEBUG:boto:Params: {} 2024-04-16T18:18:06.545 DEBUG:boto:Token: None 2024-04-16T18:18:06.545 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:toi8qc2QucrtIJ9T9xaIfoG73GI= 2024-04-16T18:18:06.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:toi8qc2QucrtIJ9T9xaIfoG73GI=', 'Content-Length': '0'} 2024-04-16T18:18:06.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea8dc695599daa71-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.548 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000012 2024-04-16T18:18:06.548 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.548 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.548 DEBUG:boto:Method: GET 2024-04-16T18:18:06.548 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.548 DEBUG:boto:Data: 2024-04-16T18:18:06.548 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.548 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.548 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.548 DEBUG:boto:Params: {} 2024-04-16T18:18:06.549 DEBUG:boto:Token: None 2024-04-16T18:18:06.549 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.549 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xnKCnju/myJK6YRYazuLe1Sizw= 2024-04-16T18:18:06.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xnKCnju/myJK6YRYazuLe1Sizw=', 'Content-Length': '0'} 2024-04-16T18:18:06.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006229267e6e994759-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.594 DEBUG:boto:path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.594 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.595 DEBUG:boto:Method: GET 2024-04-16T18:18:06.595 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.595 DEBUG:boto:Data: 2024-04-16T18:18:06.595 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.595 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.595 DEBUG:boto:Params: {} 2024-04-16T18:18:06.595 DEBUG:boto:Token: None 2024-04-16T18:18:06.595 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000012 2024-04-16T18:18:06.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xnKCnju/myJK6YRYazuLe1Sizw= 2024-04-16T18:18:06.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xnKCnju/myJK6YRYazuLe1Sizw=', 'Content-Length': '0'} 2024-04-16T18:18:06.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8b81c50dbb91133-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.598 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.598 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.598 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.598 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.598 DEBUG:boto:Method: GET 2024-04-16T18:18:06.598 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.598 DEBUG:boto:Data: 2024-04-16T18:18:06.598 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.599 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.599 DEBUG:boto:Params: {} 2024-04-16T18:18:06.599 DEBUG:boto:Token: None 2024-04-16T18:18:06.599 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.601 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f400c2e26bf60964-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.601 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.602 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.602 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.602 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.602 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.602 DEBUG:boto:Method: GET 2024-04-16T18:18:06.602 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000012 2024-04-16T18:18:06.602 DEBUG:boto:Data: 2024-04-16T18:18:06.602 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.602 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.603 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.603 DEBUG:boto:Params: {} 2024-04-16T18:18:06.603 DEBUG:boto:Token: None 2024-04-16T18:18:06.603 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce732c231ce40f5e-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.607 DEBUG:boto:b'cjqttm-51obj000000000000000000121000falseobj000000000000000000122024-04-16T18:18:00.081Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.607 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-16T18:18:06.608 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.608 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.608 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.608 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.608 DEBUG:boto:Method: GET 2024-04-16T18:18:06.608 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.608 DEBUG:boto:Data: 2024-04-16T18:18:06.608 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.608 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.608 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.608 DEBUG:boto:Params: {} 2024-04-16T18:18:06.608 DEBUG:boto:Token: None 2024-04-16T18:18:06.609 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.609 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU= 2024-04-16T18:18:06.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU=', 'Content-Length': '0'} 2024-04-16T18:18:06.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009671e44ac4c0c48a-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.654 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.654 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.655 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.655 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.655 DEBUG:boto:Method: GET 2024-04-16T18:18:06.655 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.655 DEBUG:boto:Data: 2024-04-16T18:18:06.655 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.655 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.655 DEBUG:boto:Params: {} 2024-04-16T18:18:06.655 DEBUG:boto:Token: None 2024-04-16T18:18:06.655 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU= 2024-04-16T18:18:06.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU=', 'Content-Length': '0'} 2024-04-16T18:18:06.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034d3bbe89e5d0430-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.658 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.659 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.659 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.659 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.659 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.659 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.659 DEBUG:boto:Data: 2024-04-16T18:18:06.659 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.659 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.659 DEBUG:boto:Params: {} 2024-04-16T18:18:06.659 DEBUG:boto:Token: None 2024-04-16T18:18:06.660 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4sRWpqV2p6xLWK1Nyuij1s0DZc8= 2024-04-16T18:18:06.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4sRWpqV2p6xLWK1Nyuij1s0DZc8=', 'Content-Length': '0'} 2024-04-16T18:18:06.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f134e12dc89b29c-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.662 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.663 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.663 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.663 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.663 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.663 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.663 DEBUG:boto:Data: 2024-04-16T18:18:06.663 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.663 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.663 DEBUG:boto:Params: {} 2024-04-16T18:18:06.663 DEBUG:boto:Token: None 2024-04-16T18:18:06.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4sRWpqV2p6xLWK1Nyuij1s0DZc8= 2024-04-16T18:18:06.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4sRWpqV2p6xLWK1Nyuij1s0DZc8=', 'Content-Length': '0'} 2024-04-16T18:18:06.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e018efcf8a03327-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-16T18:18:06.666 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.666 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.666 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.666 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.666 DEBUG:boto:Method: GET 2024-04-16T18:18:06.666 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.666 DEBUG:boto:Data: 2024-04-16T18:18:06.666 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.667 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.667 DEBUG:boto:Params: {} 2024-04-16T18:18:06.667 DEBUG:boto:Token: None 2024-04-16T18:18:06.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU= 2024-04-16T18:18:06.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU=', 'Content-Length': '0'} 2024-04-16T18:18:06.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009389a4b215145c9-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.710 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.710 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.710 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.711 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.711 DEBUG:boto:Method: GET 2024-04-16T18:18:06.711 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.711 DEBUG:boto:Data: 2024-04-16T18:18:06.711 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.711 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.711 DEBUG:boto:Params: {} 2024-04-16T18:18:06.711 DEBUG:boto:Token: None 2024-04-16T18:18:06.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013?versionId=null 2024-04-16T18:18:06.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU= 2024-04-16T18:18:06.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1kGWFI1OFGnuj7a/XRh0uYaGJAU=', 'Content-Length': '0'} 2024-04-16T18:18:06.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e6fd46506037510-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.714 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.714 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.714 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.714 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.714 DEBUG:boto:Method: GET 2024-04-16T18:18:06.715 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.715 DEBUG:boto:Data: 2024-04-16T18:18:06.715 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.715 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.715 DEBUG:boto:Params: {} 2024-04-16T18:18:06.715 DEBUG:boto:Token: None 2024-04-16T18:18:06.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006bc4abe54ad195fa-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.718 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.718 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.718 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.718 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.719 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.719 DEBUG:boto:Method: GET 2024-04-16T18:18:06.719 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.719 DEBUG:boto:Data: 2024-04-16T18:18:06.719 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.719 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.719 DEBUG:boto:Params: {} 2024-04-16T18:18:06.719 DEBUG:boto:Token: None 2024-04-16T18:18:06.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.723 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe78f5b574b6be1f-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.723 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.724 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.724 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.724 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.724 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.724 DEBUG:boto:Data: 2024-04-16T18:18:06.724 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.724 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.724 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.724 DEBUG:boto:Params: {} 2024-04-16T18:18:06.724 DEBUG:boto:Token: None 2024-04-16T18:18:06.725 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.725 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jfVrbD0tLHTK3BE3eY/c4ErIkpo= 2024-04-16T18:18:06.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jfVrbD0tLHTK3BE3eY/c4ErIkpo=', 'Content-Length': '0'} 2024-04-16T18:18:06.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f94b9babc0ad049-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.727 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.727 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.727 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.727 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.728 DEBUG:boto:Data: 2024-04-16T18:18:06.728 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.728 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.728 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.728 DEBUG:boto:Params: {} 2024-04-16T18:18:06.728 DEBUG:boto:Token: None 2024-04-16T18:18:06.728 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jfVrbD0tLHTK3BE3eY/c4ErIkpo= 2024-04-16T18:18:06.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jfVrbD0tLHTK3BE3eY/c4ErIkpo=', 'Content-Length': '0'} 2024-04-16T18:18:06.730 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e11cd3fb52d27098-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000013 2024-04-16T18:18:06.731 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.731 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.731 DEBUG:boto:Method: GET 2024-04-16T18:18:06.731 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.731 DEBUG:boto:Data: 2024-04-16T18:18:06.731 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.731 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.731 DEBUG:boto:Params: {} 2024-04-16T18:18:06.731 DEBUG:boto:Token: None 2024-04-16T18:18:06.732 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z+jWzeYwzORh3rGYv8cRCHTp0AA= 2024-04-16T18:18:06.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z+jWzeYwzORh3rGYv8cRCHTp0AA=', 'Content-Length': '0'} 2024-04-16T18:18:06.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f368b43af08d1cb-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.774 DEBUG:boto:path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.774 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.775 DEBUG:boto:Method: GET 2024-04-16T18:18:06.775 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.775 DEBUG:boto:Data: 2024-04-16T18:18:06.775 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.775 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.775 DEBUG:boto:Params: {} 2024-04-16T18:18:06.775 DEBUG:boto:Token: None 2024-04-16T18:18:06.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000013 2024-04-16T18:18:06.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z+jWzeYwzORh3rGYv8cRCHTp0AA= 2024-04-16T18:18:06.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z+jWzeYwzORh3rGYv8cRCHTp0AA=', 'Content-Length': '0'} 2024-04-16T18:18:06.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c1a7d060da38a64-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.778 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.778 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.778 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.778 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.778 DEBUG:boto:Method: GET 2024-04-16T18:18:06.778 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.779 DEBUG:boto:Data: 2024-04-16T18:18:06.779 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.779 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.779 DEBUG:boto:Params: {} 2024-04-16T18:18:06.779 DEBUG:boto:Token: None 2024-04-16T18:18:06.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005041fd24779e32f8-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.822 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.823 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.823 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.823 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.823 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.823 DEBUG:boto:Method: GET 2024-04-16T18:18:06.823 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000013 2024-04-16T18:18:06.823 DEBUG:boto:Data: 2024-04-16T18:18:06.823 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.823 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.823 DEBUG:boto:Params: {} 2024-04-16T18:18:06.824 DEBUG:boto:Token: None 2024-04-16T18:18:06.824 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.827 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039fbf363b06145ae-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.828 DEBUG:boto:b'cjqttm-51obj000000000000000000131000falseobj000000000000000000132024-04-16T18:17:59.455Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.828 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2024-04-16T18:18:06.828 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.828 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.828 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.828 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.828 DEBUG:boto:Method: GET 2024-04-16T18:18:06.828 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.829 DEBUG:boto:Data: 2024-04-16T18:18:06.829 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.829 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.829 DEBUG:boto:Params: {} 2024-04-16T18:18:06.829 DEBUG:boto:Token: None 2024-04-16T18:18:06.829 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.829 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ= 2024-04-16T18:18:06.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ=', 'Content-Length': '0'} 2024-04-16T18:18:06.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ddcd569a30c5584-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.874 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.874 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.875 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.875 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.875 DEBUG:boto:Method: GET 2024-04-16T18:18:06.875 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.875 DEBUG:boto:Data: 2024-04-16T18:18:06.875 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.875 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.875 DEBUG:boto:Params: {} 2024-04-16T18:18:06.875 DEBUG:boto:Token: None 2024-04-16T18:18:06.876 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ= 2024-04-16T18:18:06.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ=', 'Content-Length': '0'} 2024-04-16T18:18:06.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000044a1caf2a1a1da2-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.878 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.879 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.879 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.879 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.879 DEBUG:boto:Data: 2024-04-16T18:18:06.879 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.879 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.879 DEBUG:boto:Params: {} 2024-04-16T18:18:06.879 DEBUG:boto:Token: None 2024-04-16T18:18:06.879 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UkyRXckYdD/ViCXWRepqy2Tr8ro= 2024-04-16T18:18:06.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UkyRXckYdD/ViCXWRepqy2Tr8ro=', 'Content-Length': '0'} 2024-04-16T18:18:06.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d1d27a855bb1ce8-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.881 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.882 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.882 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.882 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.882 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.882 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.882 DEBUG:boto:Data: 2024-04-16T18:18:06.882 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.882 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.882 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.882 DEBUG:boto:Params: {} 2024-04-16T18:18:06.882 DEBUG:boto:Token: None 2024-04-16T18:18:06.883 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UkyRXckYdD/ViCXWRepqy2Tr8ro= 2024-04-16T18:18:06.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UkyRXckYdD/ViCXWRepqy2Tr8ro=', 'Content-Length': '0'} 2024-04-16T18:18:06.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b89cd1989c986a22-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.885 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2024-04-16T18:18:06.885 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.885 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.885 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.885 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.885 DEBUG:boto:Method: GET 2024-04-16T18:18:06.885 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.885 DEBUG:boto:Data: 2024-04-16T18:18:06.885 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.886 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.886 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.886 DEBUG:boto:Params: {} 2024-04-16T18:18:06.886 DEBUG:boto:Token: None 2024-04-16T18:18:06.886 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.886 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ= 2024-04-16T18:18:06.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ=', 'Content-Length': '0'} 2024-04-16T18:18:06.888 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bef9f4449c42bc07-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.930 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.930 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.931 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.931 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.931 DEBUG:boto:Method: GET 2024-04-16T18:18:06.931 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.931 DEBUG:boto:Data: 2024-04-16T18:18:06.931 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.931 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.931 DEBUG:boto:Params: {} 2024-04-16T18:18:06.931 DEBUG:boto:Token: None 2024-04-16T18:18:06.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014?versionId=null 2024-04-16T18:18:06.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ= 2024-04-16T18:18:06.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ijXDPkOhltAygO59QAKF7GoTVBQ=', 'Content-Length': '0'} 2024-04-16T18:18:06.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b7904003e087c02-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.934 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.934 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.934 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:06.934 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:06.934 DEBUG:boto:Method: GET 2024-04-16T18:18:06.934 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:06.934 DEBUG:boto:Data: 2024-04-16T18:18:06.934 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.934 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.934 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.935 DEBUG:boto:Params: {} 2024-04-16T18:18:06.935 DEBUG:boto:Token: None 2024-04-16T18:18:06.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b78ff3e1b96beece-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.978 DEBUG:boto:b'cjqttm-51obj000000000000000000141000falseobj000000000000000000142024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.979 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:06.979 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:06.979 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:06.979 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:06.979 DEBUG:boto:Method: GET 2024-04-16T18:18:06.979 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:06.979 DEBUG:boto:Data: 2024-04-16T18:18:06.979 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.980 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.980 DEBUG:boto:Params: {} 2024-04-16T18:18:06.980 DEBUG:boto:Token: None 2024-04-16T18:18:06.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/ 2024-04-16T18:18:06.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g= 2024-04-16T18:18:06.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJIoduOaqEa7MilUUZMeGlnJv9g=', 'Content-Length': '0'} 2024-04-16T18:18:06.984 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036437770359fd2fa-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.984 DEBUG:boto:b'cjqttm-51obj000000000000000000141000falseobj000000000000000000142024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:06.984 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.984 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.984 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.984 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.985 DEBUG:boto:Data: 2024-04-16T18:18:06.985 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.985 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.985 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.985 DEBUG:boto:Params: {} 2024-04-16T18:18:06.985 DEBUG:boto:Token: None 2024-04-16T18:18:06.985 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uRastgW6oi0v4ikKR3kMxewaLso= 2024-04-16T18:18:06.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uRastgW6oi0v4ikKR3kMxewaLso=', 'Content-Length': '0'} 2024-04-16T18:18:06.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e8c15cbc3a6746c-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.987 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.988 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.988 DEBUG:boto:Method: HEAD 2024-04-16T18:18:06.988 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.988 DEBUG:boto:Data: 2024-04-16T18:18:06.988 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.988 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:06.988 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.988 DEBUG:boto:Params: {} 2024-04-16T18:18:06.988 DEBUG:boto:Token: None 2024-04-16T18:18:06.989 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.989 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uRastgW6oi0v4ikKR3kMxewaLso= 2024-04-16T18:18:06.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uRastgW6oi0v4ikKR3kMxewaLso=', 'Content-Length': '0'} 2024-04-16T18:18:06.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a3cfc33eab1383f-00661ec0de-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:06.991 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000014 2024-04-16T18:18:06.991 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.991 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.991 DEBUG:boto:Method: GET 2024-04-16T18:18:06.991 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.991 DEBUG:boto:Data: 2024-04-16T18:18:06.991 DEBUG:boto:Headers: {} 2024-04-16T18:18:06.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:06.992 DEBUG:boto:Port: 8000 2024-04-16T18:18:06.992 DEBUG:boto:Params: {} 2024-04-16T18:18:06.992 DEBUG:boto:Token: None 2024-04-16T18:18:06.992 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:06 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:06.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f08kc9sHdi/hWoZ/57uWmBllAL8= 2024-04-16T18:18:06.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f08kc9sHdi/hWoZ/57uWmBllAL8=', 'Content-Length': '0'} 2024-04-16T18:18:06.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037c1b7c83f0b75f2-00661ec0de-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.034 DEBUG:boto:path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:07.034 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000014 2024-04-16T18:18:07.034 DEBUG:boto:Method: GET 2024-04-16T18:18:07.035 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:07.035 DEBUG:boto:Data: 2024-04-16T18:18:07.035 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.035 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.035 DEBUG:boto:Params: {} 2024-04-16T18:18:07.035 DEBUG:boto:Token: None 2024-04-16T18:18:07.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000014 2024-04-16T18:18:07.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NktEuRGY8cpxXtRRRCi6fmUloas= 2024-04-16T18:18:07.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NktEuRGY8cpxXtRRRCi6fmUloas=', 'Content-Length': '0'} 2024-04-16T18:18:07.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000610534a735745908-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.038 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.038 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.038 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:07.038 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:07.038 DEBUG:boto:Method: GET 2024-04-16T18:18:07.038 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:07.038 DEBUG:boto:Data: 2024-04-16T18:18:07.038 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.038 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.038 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.039 DEBUG:boto:Params: {} 2024-04-16T18:18:07.039 DEBUG:boto:Token: None 2024-04-16T18:18:07.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f87081b56302517-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.082 DEBUG:boto:b'cjqttm-51obj000000000000000000141000falseobj000000000000000000142024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.083 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.083 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.083 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:07.083 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:07.083 DEBUG:boto:Method: GET 2024-04-16T18:18:07.083 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000014 2024-04-16T18:18:07.083 DEBUG:boto:Data: 2024-04-16T18:18:07.083 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.083 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.083 DEBUG:boto:Params: {} 2024-04-16T18:18:07.084 DEBUG:boto:Token: None 2024-04-16T18:18:07.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6b844a1fc657507-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.088 DEBUG:boto:b'cjqttm-51obj000000000000000000141000falseobj000000000000000000142024-04-16T18:17:59.832Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2024-04-16T18:18:07.088 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.088 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.089 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.089 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.089 DEBUG:boto:Method: GET 2024-04-16T18:18:07.089 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.089 DEBUG:boto:Data: 2024-04-16T18:18:07.089 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.089 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.089 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.089 DEBUG:boto:Params: {} 2024-04-16T18:18:07.089 DEBUG:boto:Token: None 2024-04-16T18:18:07.089 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.089 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk= 2024-04-16T18:18:07.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk=', 'Content-Length': '0'} 2024-04-16T18:18:07.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a50b2a91ec05baaf-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.134 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.135 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.135 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.135 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.135 DEBUG:boto:Method: GET 2024-04-16T18:18:07.135 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.135 DEBUG:boto:Data: 2024-04-16T18:18:07.135 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.135 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.135 DEBUG:boto:Params: {} 2024-04-16T18:18:07.136 DEBUG:boto:Token: None 2024-04-16T18:18:07.136 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk= 2024-04-16T18:18:07.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk=', 'Content-Length': '0'} 2024-04-16T18:18:07.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c208f513ac0329a7-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.138 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.139 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.139 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.139 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.139 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.139 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.139 DEBUG:boto:Data: 2024-04-16T18:18:07.139 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.139 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.139 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.139 DEBUG:boto:Params: {} 2024-04-16T18:18:07.140 DEBUG:boto:Token: None 2024-04-16T18:18:07.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EiuEufOFxJ4843sfMacR4S0Evo4= 2024-04-16T18:18:07.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EiuEufOFxJ4843sfMacR4S0Evo4=', 'Content-Length': '0'} 2024-04-16T18:18:07.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013ef1acf9dd64493-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.142 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.142 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.143 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.143 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.143 DEBUG:boto:Data: 2024-04-16T18:18:07.143 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.143 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.143 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.143 DEBUG:boto:Params: {} 2024-04-16T18:18:07.143 DEBUG:boto:Token: None 2024-04-16T18:18:07.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EiuEufOFxJ4843sfMacR4S0Evo4= 2024-04-16T18:18:07.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EiuEufOFxJ4843sfMacR4S0Evo4=', 'Content-Length': '0'} 2024-04-16T18:18:07.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd227f71f3338fdb-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.146 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2024-04-16T18:18:07.146 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.146 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.146 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.146 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.146 DEBUG:boto:Method: GET 2024-04-16T18:18:07.146 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.146 DEBUG:boto:Data: 2024-04-16T18:18:07.146 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.147 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.147 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.147 DEBUG:boto:Params: {} 2024-04-16T18:18:07.147 DEBUG:boto:Token: None 2024-04-16T18:18:07.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk= 2024-04-16T18:18:07.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk=', 'Content-Length': '0'} 2024-04-16T18:18:07.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086d2871db4017cdc-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.190 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.191 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.191 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.191 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.191 DEBUG:boto:Method: GET 2024-04-16T18:18:07.191 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.191 DEBUG:boto:Data: 2024-04-16T18:18:07.191 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.191 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.191 DEBUG:boto:Params: {} 2024-04-16T18:18:07.191 DEBUG:boto:Token: None 2024-04-16T18:18:07.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015?versionId=null 2024-04-16T18:18:07.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk= 2024-04-16T18:18:07.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:02An3p6kRtGaMvNGh1heWr7zbYk=', 'Content-Length': '0'} 2024-04-16T18:18:07.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b68c6de6a0eabc3-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.194 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.194 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.194 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.194 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.195 DEBUG:boto:Method: GET 2024-04-16T18:18:07.195 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.195 DEBUG:boto:Data: 2024-04-16T18:18:07.195 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.195 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.195 DEBUG:boto:Params: {} 2024-04-16T18:18:07.195 DEBUG:boto:Token: None 2024-04-16T18:18:07.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017a6ab909ff8e32d-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.238 DEBUG:boto:b'cjqttm-51obj000000000000000000151000falseobj000000000000000000152024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.239 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.239 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.239 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.239 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.239 DEBUG:boto:Method: GET 2024-04-16T18:18:07.239 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.239 DEBUG:boto:Data: 2024-04-16T18:18:07.239 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.239 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.240 DEBUG:boto:Params: {} 2024-04-16T18:18:07.240 DEBUG:boto:Token: None 2024-04-16T18:18:07.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0cdce714c253863-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.244 DEBUG:boto:b'cjqttm-51obj000000000000000000151000falseobj000000000000000000152024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.244 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.244 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.244 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.244 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.245 DEBUG:boto:Data: 2024-04-16T18:18:07.245 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.245 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.245 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.245 DEBUG:boto:Params: {} 2024-04-16T18:18:07.245 DEBUG:boto:Token: None 2024-04-16T18:18:07.245 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.245 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TWyJs7dLHpJOvpRgxMEatqqUUTQ= 2024-04-16T18:18:07.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TWyJs7dLHpJOvpRgxMEatqqUUTQ=', 'Content-Length': '0'} 2024-04-16T18:18:07.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006050a35a9ae832b2-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.248 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.248 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.248 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.248 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.248 DEBUG:boto:Data: 2024-04-16T18:18:07.248 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.248 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.248 DEBUG:boto:Params: {} 2024-04-16T18:18:07.249 DEBUG:boto:Token: None 2024-04-16T18:18:07.249 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TWyJs7dLHpJOvpRgxMEatqqUUTQ= 2024-04-16T18:18:07.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TWyJs7dLHpJOvpRgxMEatqqUUTQ=', 'Content-Length': '0'} 2024-04-16T18:18:07.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a673f2fd72f26ca-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000015 2024-04-16T18:18:07.252 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.252 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.252 DEBUG:boto:Method: GET 2024-04-16T18:18:07.252 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.252 DEBUG:boto:Data: 2024-04-16T18:18:07.252 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.252 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.252 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.252 DEBUG:boto:Params: {} 2024-04-16T18:18:07.252 DEBUG:boto:Token: None 2024-04-16T18:18:07.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TkCVlXOeDnBMik5sIEpbZ6Xzn0E= 2024-04-16T18:18:07.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TkCVlXOeDnBMik5sIEpbZ6Xzn0E=', 'Content-Length': '0'} 2024-04-16T18:18:07.256 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ab746954219a73d-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.298 DEBUG:boto:path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.298 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.299 DEBUG:boto:Method: GET 2024-04-16T18:18:07.299 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.299 DEBUG:boto:Data: 2024-04-16T18:18:07.299 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.299 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.299 DEBUG:boto:Params: {} 2024-04-16T18:18:07.299 DEBUG:boto:Token: None 2024-04-16T18:18:07.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000015 2024-04-16T18:18:07.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TkCVlXOeDnBMik5sIEpbZ6Xzn0E= 2024-04-16T18:18:07.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TkCVlXOeDnBMik5sIEpbZ6Xzn0E=', 'Content-Length': '0'} 2024-04-16T18:18:07.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c42ba1e60878d831-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.302 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.302 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.302 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.302 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.302 DEBUG:boto:Method: GET 2024-04-16T18:18:07.302 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.302 DEBUG:boto:Data: 2024-04-16T18:18:07.303 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.303 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.303 DEBUG:boto:Params: {} 2024-04-16T18:18:07.303 DEBUG:boto:Token: None 2024-04-16T18:18:07.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e90a0475fd316d48-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.346 DEBUG:boto:b'cjqttm-51obj000000000000000000151000falseobj000000000000000000152024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.347 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.347 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.347 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.347 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.347 DEBUG:boto:Method: GET 2024-04-16T18:18:07.347 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000015 2024-04-16T18:18:07.347 DEBUG:boto:Data: 2024-04-16T18:18:07.347 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.347 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.348 DEBUG:boto:Params: {} 2024-04-16T18:18:07.348 DEBUG:boto:Token: None 2024-04-16T18:18:07.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.351 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec0a67a98e1177bf-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.352 DEBUG:boto:b'cjqttm-51obj000000000000000000151000falseobj000000000000000000152024-04-16T18:17:59.893Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.352 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2024-04-16T18:18:07.352 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.352 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.352 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.352 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.353 DEBUG:boto:Method: GET 2024-04-16T18:18:07.353 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.353 DEBUG:boto:Data: 2024-04-16T18:18:07.353 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.353 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.353 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.353 DEBUG:boto:Params: {} 2024-04-16T18:18:07.353 DEBUG:boto:Token: None 2024-04-16T18:18:07.353 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo= 2024-04-16T18:18:07.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo=', 'Content-Length': '0'} 2024-04-16T18:18:07.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005aadc0891fc167db-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.398 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.398 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.398 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.399 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.399 DEBUG:boto:Method: GET 2024-04-16T18:18:07.399 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.399 DEBUG:boto:Data: 2024-04-16T18:18:07.399 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.399 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.399 DEBUG:boto:Params: {} 2024-04-16T18:18:07.399 DEBUG:boto:Token: None 2024-04-16T18:18:07.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo= 2024-04-16T18:18:07.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo=', 'Content-Length': '0'} 2024-04-16T18:18:07.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a3a05f8c5d68eb7-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.402 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.402 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.402 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.403 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.403 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.403 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.403 DEBUG:boto:Data: 2024-04-16T18:18:07.403 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.403 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.403 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.403 DEBUG:boto:Params: {} 2024-04-16T18:18:07.403 DEBUG:boto:Token: None 2024-04-16T18:18:07.403 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2RPmbtWNKWzJAj5RInw0/lFE8tY= 2024-04-16T18:18:07.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2RPmbtWNKWzJAj5RInw0/lFE8tY=', 'Content-Length': '0'} 2024-04-16T18:18:07.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034d299a0897e435f-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.406 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.406 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.406 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.406 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.407 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.407 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.407 DEBUG:boto:Data: 2024-04-16T18:18:07.407 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.407 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.407 DEBUG:boto:Params: {} 2024-04-16T18:18:07.407 DEBUG:boto:Token: None 2024-04-16T18:18:07.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2RPmbtWNKWzJAj5RInw0/lFE8tY= 2024-04-16T18:18:07.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2RPmbtWNKWzJAj5RInw0/lFE8tY=', 'Content-Length': '0'} 2024-04-16T18:18:07.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f707cfef67ad7941-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.410 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2024-04-16T18:18:07.410 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.410 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.410 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.410 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.410 DEBUG:boto:Method: GET 2024-04-16T18:18:07.411 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.411 DEBUG:boto:Data: 2024-04-16T18:18:07.411 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.411 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.411 DEBUG:boto:Params: {} 2024-04-16T18:18:07.411 DEBUG:boto:Token: None 2024-04-16T18:18:07.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo= 2024-04-16T18:18:07.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo=', 'Content-Length': '0'} 2024-04-16T18:18:07.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cab6926b85b6b5fe-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.454 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.454 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.455 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.455 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.455 DEBUG:boto:Method: GET 2024-04-16T18:18:07.455 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.455 DEBUG:boto:Data: 2024-04-16T18:18:07.455 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.455 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.455 DEBUG:boto:Params: {} 2024-04-16T18:18:07.455 DEBUG:boto:Token: None 2024-04-16T18:18:07.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016?versionId=null 2024-04-16T18:18:07.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo= 2024-04-16T18:18:07.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Jpr54oENJtpihp3AG2W1okxCNOo=', 'Content-Length': '0'} 2024-04-16T18:18:07.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c27a3f08c59ae9ed-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.458 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.458 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.458 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.458 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.458 DEBUG:boto:Method: GET 2024-04-16T18:18:07.458 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.459 DEBUG:boto:Data: 2024-04-16T18:18:07.459 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.459 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.459 DEBUG:boto:Params: {} 2024-04-16T18:18:07.459 DEBUG:boto:Token: None 2024-04-16T18:18:07.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.462 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000148fe82c9568391a-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.502 DEBUG:boto:b'cjqttm-51obj000000000000000000161000falseobj000000000000000000162024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.503 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.503 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.503 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.503 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.503 DEBUG:boto:Method: GET 2024-04-16T18:18:07.503 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.503 DEBUG:boto:Data: 2024-04-16T18:18:07.503 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.504 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.504 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.504 DEBUG:boto:Params: {} 2024-04-16T18:18:07.504 DEBUG:boto:Token: None 2024-04-16T18:18:07.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.508 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000993bcc5564db39ef-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.508 DEBUG:boto:b'cjqttm-51obj000000000000000000161000falseobj000000000000000000162024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.509 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.509 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.509 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.509 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.509 DEBUG:boto:Data: 2024-04-16T18:18:07.509 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.509 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.509 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.509 DEBUG:boto:Params: {} 2024-04-16T18:18:07.509 DEBUG:boto:Token: None 2024-04-16T18:18:07.510 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvN5d9C7boX75iu+IkyM2QopUKQ= 2024-04-16T18:18:07.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvN5d9C7boX75iu+IkyM2QopUKQ=', 'Content-Length': '0'} 2024-04-16T18:18:07.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003bea1d921ed1937-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.512 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.512 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.513 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.513 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.513 DEBUG:boto:Data: 2024-04-16T18:18:07.513 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.513 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.513 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.513 DEBUG:boto:Params: {} 2024-04-16T18:18:07.513 DEBUG:boto:Token: None 2024-04-16T18:18:07.513 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.513 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bvN5d9C7boX75iu+IkyM2QopUKQ= 2024-04-16T18:18:07.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bvN5d9C7boX75iu+IkyM2QopUKQ=', 'Content-Length': '0'} 2024-04-16T18:18:07.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000327506bbf846dd65-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.516 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000016 2024-04-16T18:18:07.516 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.516 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.516 DEBUG:boto:Method: GET 2024-04-16T18:18:07.516 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.516 DEBUG:boto:Data: 2024-04-16T18:18:07.517 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.517 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.517 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.517 DEBUG:boto:Params: {} 2024-04-16T18:18:07.517 DEBUG:boto:Token: None 2024-04-16T18:18:07.517 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.517 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqyuLk886Xr9uFYf6muN36VsWVg= 2024-04-16T18:18:07.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqyuLk886Xr9uFYf6muN36VsWVg=', 'Content-Length': '0'} 2024-04-16T18:18:07.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d51120bb5ac1da9-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.562 DEBUG:boto:path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.563 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.563 DEBUG:boto:Method: GET 2024-04-16T18:18:07.563 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.563 DEBUG:boto:Data: 2024-04-16T18:18:07.563 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.563 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.563 DEBUG:boto:Params: {} 2024-04-16T18:18:07.563 DEBUG:boto:Token: None 2024-04-16T18:18:07.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000016 2024-04-16T18:18:07.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqyuLk886Xr9uFYf6muN36VsWVg= 2024-04-16T18:18:07.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqyuLk886Xr9uFYf6muN36VsWVg=', 'Content-Length': '0'} 2024-04-16T18:18:07.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c237010ec9741164-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.566 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.566 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.566 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.566 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.566 DEBUG:boto:Method: GET 2024-04-16T18:18:07.567 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.567 DEBUG:boto:Data: 2024-04-16T18:18:07.567 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.567 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.567 DEBUG:boto:Params: {} 2024-04-16T18:18:07.567 DEBUG:boto:Token: None 2024-04-16T18:18:07.567 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009272647b5e7e9ff5-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.570 DEBUG:boto:b'cjqttm-51obj000000000000000000161000falseobj000000000000000000162024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.570 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.570 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.571 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.571 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.571 DEBUG:boto:Method: GET 2024-04-16T18:18:07.571 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000016 2024-04-16T18:18:07.571 DEBUG:boto:Data: 2024-04-16T18:18:07.571 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.571 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.571 DEBUG:boto:Params: {} 2024-04-16T18:18:07.571 DEBUG:boto:Token: None 2024-04-16T18:18:07.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.575 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a15b2afb4b5b9040-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.575 DEBUG:boto:b'cjqttm-51obj000000000000000000161000falseobj000000000000000000162024-04-16T18:18:00.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.575 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2024-04-16T18:18:07.576 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.576 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.576 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.576 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.576 DEBUG:boto:Method: GET 2024-04-16T18:18:07.576 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.576 DEBUG:boto:Data: 2024-04-16T18:18:07.576 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.576 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.576 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.577 DEBUG:boto:Params: {} 2024-04-16T18:18:07.577 DEBUG:boto:Token: None 2024-04-16T18:18:07.577 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.577 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE= 2024-04-16T18:18:07.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE=', 'Content-Length': '0'} 2024-04-16T18:18:07.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090116bf50f49f323-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.622 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.622 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.623 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.623 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.623 DEBUG:boto:Method: GET 2024-04-16T18:18:07.623 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.623 DEBUG:boto:Data: 2024-04-16T18:18:07.623 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.623 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.623 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.623 DEBUG:boto:Params: {} 2024-04-16T18:18:07.623 DEBUG:boto:Token: None 2024-04-16T18:18:07.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE= 2024-04-16T18:18:07.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE=', 'Content-Length': '0'} 2024-04-16T18:18:07.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee364ce1250d2284-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.626 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.626 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.626 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.626 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.626 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.626 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.626 DEBUG:boto:Data: 2024-04-16T18:18:07.626 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.627 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.627 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.627 DEBUG:boto:Params: {} 2024-04-16T18:18:07.627 DEBUG:boto:Token: None 2024-04-16T18:18:07.627 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.627 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ktBBVBadbQuhTH6VtQ1anlwqt+w= 2024-04-16T18:18:07.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ktBBVBadbQuhTH6VtQ1anlwqt+w=', 'Content-Length': '0'} 2024-04-16T18:18:07.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077880d252c0fc031-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.630 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.630 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.630 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.630 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.630 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.630 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.630 DEBUG:boto:Data: 2024-04-16T18:18:07.630 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.630 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.630 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.631 DEBUG:boto:Params: {} 2024-04-16T18:18:07.631 DEBUG:boto:Token: None 2024-04-16T18:18:07.631 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ktBBVBadbQuhTH6VtQ1anlwqt+w= 2024-04-16T18:18:07.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ktBBVBadbQuhTH6VtQ1anlwqt+w=', 'Content-Length': '0'} 2024-04-16T18:18:07.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd610d1967c4a550-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.633 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2024-04-16T18:18:07.633 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.633 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.633 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.634 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.634 DEBUG:boto:Method: GET 2024-04-16T18:18:07.634 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.634 DEBUG:boto:Data: 2024-04-16T18:18:07.634 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.634 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.634 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.634 DEBUG:boto:Params: {} 2024-04-16T18:18:07.634 DEBUG:boto:Token: None 2024-04-16T18:18:07.634 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE= 2024-04-16T18:18:07.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE=', 'Content-Length': '0'} 2024-04-16T18:18:07.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4bf86b2e14da165-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.678 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.678 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.678 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.679 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.679 DEBUG:boto:Method: GET 2024-04-16T18:18:07.679 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.679 DEBUG:boto:Data: 2024-04-16T18:18:07.679 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.679 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.679 DEBUG:boto:Params: {} 2024-04-16T18:18:07.679 DEBUG:boto:Token: None 2024-04-16T18:18:07.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017?versionId=null 2024-04-16T18:18:07.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE= 2024-04-16T18:18:07.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t4iajoQeUmaI2tCbNTFPbXj/ZtE=', 'Content-Length': '0'} 2024-04-16T18:18:07.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f65014a22db8ed43-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.682 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.682 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.682 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.682 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.682 DEBUG:boto:Method: GET 2024-04-16T18:18:07.682 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.682 DEBUG:boto:Data: 2024-04-16T18:18:07.683 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.683 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.683 DEBUG:boto:Params: {} 2024-04-16T18:18:07.683 DEBUG:boto:Token: None 2024-04-16T18:18:07.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.685 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000053e861682b08d08-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.686 DEBUG:boto:b'cjqttm-51obj000000000000000000171000falseobj000000000000000000172024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.686 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.686 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.687 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.687 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.687 DEBUG:boto:Method: GET 2024-04-16T18:18:07.687 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.687 DEBUG:boto:Data: 2024-04-16T18:18:07.687 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.687 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.687 DEBUG:boto:Params: {} 2024-04-16T18:18:07.687 DEBUG:boto:Token: None 2024-04-16T18:18:07.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.691 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000251e9ee5e62a0835-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.691 DEBUG:boto:b'cjqttm-51obj000000000000000000171000falseobj000000000000000000172024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.692 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.692 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.692 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.692 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.692 DEBUG:boto:Data: 2024-04-16T18:18:07.692 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.692 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.692 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.692 DEBUG:boto:Params: {} 2024-04-16T18:18:07.693 DEBUG:boto:Token: None 2024-04-16T18:18:07.693 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.693 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q0xEmu7aSWrS2m7HDuEJlB4uXOY= 2024-04-16T18:18:07.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q0xEmu7aSWrS2m7HDuEJlB4uXOY=', 'Content-Length': '0'} 2024-04-16T18:18:07.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005df504820a237c32-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.695 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.695 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.695 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.695 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.696 DEBUG:boto:Data: 2024-04-16T18:18:07.696 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.696 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.696 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.696 DEBUG:boto:Params: {} 2024-04-16T18:18:07.696 DEBUG:boto:Token: None 2024-04-16T18:18:07.696 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q0xEmu7aSWrS2m7HDuEJlB4uXOY= 2024-04-16T18:18:07.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q0xEmu7aSWrS2m7HDuEJlB4uXOY=', 'Content-Length': '0'} 2024-04-16T18:18:07.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab3305a898a79900-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.699 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000017 2024-04-16T18:18:07.699 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.699 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.699 DEBUG:boto:Method: GET 2024-04-16T18:18:07.699 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.699 DEBUG:boto:Data: 2024-04-16T18:18:07.699 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.699 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.700 DEBUG:boto:Params: {} 2024-04-16T18:18:07.700 DEBUG:boto:Token: None 2024-04-16T18:18:07.700 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Pu2JVtxfL54TW2P8IqfM9TGdIg= 2024-04-16T18:18:07.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Pu2JVtxfL54TW2P8IqfM9TGdIg=', 'Content-Length': '0'} 2024-04-16T18:18:07.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046c690ef9191c2ec-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.742 DEBUG:boto:path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.743 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.743 DEBUG:boto:Method: GET 2024-04-16T18:18:07.743 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.743 DEBUG:boto:Data: 2024-04-16T18:18:07.743 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.743 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.743 DEBUG:boto:Params: {} 2024-04-16T18:18:07.743 DEBUG:boto:Token: None 2024-04-16T18:18:07.744 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000017 2024-04-16T18:18:07.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Pu2JVtxfL54TW2P8IqfM9TGdIg= 2024-04-16T18:18:07.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Pu2JVtxfL54TW2P8IqfM9TGdIg=', 'Content-Length': '0'} 2024-04-16T18:18:07.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ea7a783872f0731-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.746 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.746 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.746 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.747 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.747 DEBUG:boto:Method: GET 2024-04-16T18:18:07.747 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.747 DEBUG:boto:Data: 2024-04-16T18:18:07.747 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.747 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.747 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.747 DEBUG:boto:Params: {} 2024-04-16T18:18:07.747 DEBUG:boto:Token: None 2024-04-16T18:18:07.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000166b8dec04b722dd-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.790 DEBUG:boto:b'cjqttm-51obj000000000000000000171000falseobj000000000000000000172024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.791 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.791 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.791 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.791 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.791 DEBUG:boto:Method: GET 2024-04-16T18:18:07.791 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000017 2024-04-16T18:18:07.792 DEBUG:boto:Data: 2024-04-16T18:18:07.792 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.792 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.792 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.792 DEBUG:boto:Params: {} 2024-04-16T18:18:07.792 DEBUG:boto:Token: None 2024-04-16T18:18:07.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.797 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c801782f90f069df-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.797 DEBUG:boto:b'cjqttm-51obj000000000000000000171000falseobj000000000000000000172024-04-16T18:17:59.275Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.797 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2024-04-16T18:18:07.797 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.797 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.798 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.798 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.798 DEBUG:boto:Method: GET 2024-04-16T18:18:07.798 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.798 DEBUG:boto:Data: 2024-04-16T18:18:07.798 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.798 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.798 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.798 DEBUG:boto:Params: {} 2024-04-16T18:18:07.798 DEBUG:boto:Token: None 2024-04-16T18:18:07.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI= 2024-04-16T18:18:07.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI=', 'Content-Length': '0'} 2024-04-16T18:18:07.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb41ef19de6d3f60-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.843 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.843 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.843 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.844 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.844 DEBUG:boto:Method: GET 2024-04-16T18:18:07.844 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.844 DEBUG:boto:Data: 2024-04-16T18:18:07.844 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.844 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.844 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.844 DEBUG:boto:Params: {} 2024-04-16T18:18:07.844 DEBUG:boto:Token: None 2024-04-16T18:18:07.844 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.845 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI= 2024-04-16T18:18:07.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI=', 'Content-Length': '0'} 2024-04-16T18:18:07.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ac64db4971726f8-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.847 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.847 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.847 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.847 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.847 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.847 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.847 DEBUG:boto:Data: 2024-04-16T18:18:07.848 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.848 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.848 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.848 DEBUG:boto:Params: {} 2024-04-16T18:18:07.848 DEBUG:boto:Token: None 2024-04-16T18:18:07.848 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mYqXR8NTI1U5eYc4RkhqNdumOZo= 2024-04-16T18:18:07.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mYqXR8NTI1U5eYc4RkhqNdumOZo=', 'Content-Length': '0'} 2024-04-16T18:18:07.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000730a9716ac61ee3f-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.850 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.851 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.851 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.851 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.851 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.851 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.851 DEBUG:boto:Data: 2024-04-16T18:18:07.851 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.851 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.851 DEBUG:boto:Params: {} 2024-04-16T18:18:07.852 DEBUG:boto:Token: None 2024-04-16T18:18:07.852 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mYqXR8NTI1U5eYc4RkhqNdumOZo= 2024-04-16T18:18:07.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mYqXR8NTI1U5eYc4RkhqNdumOZo=', 'Content-Length': '0'} 2024-04-16T18:18:07.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f6825873f514ca9-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.854 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2024-04-16T18:18:07.854 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.854 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.854 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.854 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.855 DEBUG:boto:Method: GET 2024-04-16T18:18:07.855 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.855 DEBUG:boto:Data: 2024-04-16T18:18:07.855 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.855 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.855 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.855 DEBUG:boto:Params: {} 2024-04-16T18:18:07.855 DEBUG:boto:Token: None 2024-04-16T18:18:07.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI= 2024-04-16T18:18:07.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI=', 'Content-Length': '0'} 2024-04-16T18:18:07.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001eac1203eaf5a244-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.898 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.898 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.898 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.899 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.899 DEBUG:boto:Method: GET 2024-04-16T18:18:07.899 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.899 DEBUG:boto:Data: 2024-04-16T18:18:07.899 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.899 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.899 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.899 DEBUG:boto:Params: {} 2024-04-16T18:18:07.899 DEBUG:boto:Token: None 2024-04-16T18:18:07.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018?versionId=null 2024-04-16T18:18:07.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI= 2024-04-16T18:18:07.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ylqV91/IIt9SE9+S+BvxutDJHWI=', 'Content-Length': '0'} 2024-04-16T18:18:07.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9e2ae24baa6118e-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.902 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.902 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.902 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:07.902 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:07.902 DEBUG:boto:Method: GET 2024-04-16T18:18:07.902 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:07.902 DEBUG:boto:Data: 2024-04-16T18:18:07.902 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.903 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.903 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.903 DEBUG:boto:Params: {} 2024-04-16T18:18:07.903 DEBUG:boto:Token: None 2024-04-16T18:18:07.903 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.905 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcc5163b6b5cb51c-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.946 DEBUG:boto:b'cjqttm-51obj000000000000000000181000falseobj000000000000000000182024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.947 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:07.947 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:07.947 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:07.947 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:07.947 DEBUG:boto:Method: GET 2024-04-16T18:18:07.947 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:07.947 DEBUG:boto:Data: 2024-04-16T18:18:07.947 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.947 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.947 DEBUG:boto:Params: {} 2024-04-16T18:18:07.948 DEBUG:boto:Token: None 2024-04-16T18:18:07.948 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/ 2024-04-16T18:18:07.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw= 2024-04-16T18:18:07.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SCF6tIwVbAkqFf3B7Z00tPwduw=', 'Content-Length': '0'} 2024-04-16T18:18:07.952 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae22f3c238d97be2-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.952 DEBUG:boto:b'cjqttm-51obj000000000000000000181000falseobj000000000000000000182024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:07.952 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.952 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.952 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.953 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.953 DEBUG:boto:Data: 2024-04-16T18:18:07.953 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.953 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.953 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.953 DEBUG:boto:Params: {} 2024-04-16T18:18:07.953 DEBUG:boto:Token: None 2024-04-16T18:18:07.953 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.953 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eNI6A/tBuhwvFzxOfOtpXdEr2jM= 2024-04-16T18:18:07.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eNI6A/tBuhwvFzxOfOtpXdEr2jM=', 'Content-Length': '0'} 2024-04-16T18:18:07.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c09a637cad8ccd89-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.956 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.956 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.956 DEBUG:boto:Method: HEAD 2024-04-16T18:18:07.956 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.956 DEBUG:boto:Data: 2024-04-16T18:18:07.956 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.956 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:07.956 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.956 DEBUG:boto:Params: {} 2024-04-16T18:18:07.956 DEBUG:boto:Token: None 2024-04-16T18:18:07.956 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eNI6A/tBuhwvFzxOfOtpXdEr2jM= 2024-04-16T18:18:07.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eNI6A/tBuhwvFzxOfOtpXdEr2jM=', 'Content-Length': '0'} 2024-04-16T18:18:07.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0bec16e7422dc0c-00661ec0df-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:07.959 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000018 2024-04-16T18:18:07.959 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.959 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.959 DEBUG:boto:Method: GET 2024-04-16T18:18:07.959 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.959 DEBUG:boto:Data: 2024-04-16T18:18:07.959 DEBUG:boto:Headers: {} 2024-04-16T18:18:07.959 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:07.959 DEBUG:boto:Port: 8000 2024-04-16T18:18:07.959 DEBUG:boto:Params: {} 2024-04-16T18:18:07.960 DEBUG:boto:Token: None 2024-04-16T18:18:07.960 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:07 GMT /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:07.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:849CreF2pAGLCb8VaFBwTnOc7uo= 2024-04-16T18:18:07.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:849CreF2pAGLCb8VaFBwTnOc7uo=', 'Content-Length': '0'} 2024-04-16T18:18:07.961 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa09652c9580d6f8-00661ec0df-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.002 DEBUG:boto:path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:08.002 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000018 2024-04-16T18:18:08.003 DEBUG:boto:Method: GET 2024-04-16T18:18:08.003 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:08.003 DEBUG:boto:Data: 2024-04-16T18:18:08.003 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.003 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.003 DEBUG:boto:Params: {} 2024-04-16T18:18:08.003 DEBUG:boto:Token: None 2024-04-16T18:18:08.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000018 2024-04-16T18:18:08.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wIdJwhDTWEPGvJjNX57tdsDOkbM= 2024-04-16T18:18:08.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wIdJwhDTWEPGvJjNX57tdsDOkbM=', 'Content-Length': '0'} 2024-04-16T18:18:08.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000194caef68db3125a-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.005 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.006 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.006 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:08.006 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:08.006 DEBUG:boto:Method: GET 2024-04-16T18:18:08.006 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:08.006 DEBUG:boto:Data: 2024-04-16T18:18:08.006 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.006 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.006 DEBUG:boto:Params: {} 2024-04-16T18:18:08.007 DEBUG:boto:Token: None 2024-04-16T18:18:08.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095dfb1e74ab548b1-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.050 DEBUG:boto:b'cjqttm-51obj000000000000000000181000falseobj000000000000000000182024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.051 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.051 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.051 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:08.051 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:08.051 DEBUG:boto:Method: GET 2024-04-16T18:18:08.051 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000018 2024-04-16T18:18:08.051 DEBUG:boto:Data: 2024-04-16T18:18:08.051 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.052 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.052 DEBUG:boto:Params: {} 2024-04-16T18:18:08.052 DEBUG:boto:Token: None 2024-04-16T18:18:08.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.056 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f8f2d1de37bd3e1-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.056 DEBUG:boto:b'cjqttm-51obj000000000000000000181000falseobj000000000000000000182024-04-16T18:17:59.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2024-04-16T18:18:08.056 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.057 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.057 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.057 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.057 DEBUG:boto:Method: GET 2024-04-16T18:18:08.057 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.057 DEBUG:boto:Data: 2024-04-16T18:18:08.057 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.057 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.057 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.057 DEBUG:boto:Params: {} 2024-04-16T18:18:08.057 DEBUG:boto:Token: None 2024-04-16T18:18:08.057 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.058 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM= 2024-04-16T18:18:08.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM=', 'Content-Length': '0'} 2024-04-16T18:18:08.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3412bcdea447cba-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.102 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.102 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.103 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.103 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.103 DEBUG:boto:Method: GET 2024-04-16T18:18:08.103 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.103 DEBUG:boto:Data: 2024-04-16T18:18:08.103 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.103 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.103 DEBUG:boto:Params: {} 2024-04-16T18:18:08.104 DEBUG:boto:Token: None 2024-04-16T18:18:08.104 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM= 2024-04-16T18:18:08.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM=', 'Content-Length': '0'} 2024-04-16T18:18:08.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037b6ee82b6eeb750-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.106 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.106 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.106 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.106 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.106 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.106 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.106 DEBUG:boto:Data: 2024-04-16T18:18:08.107 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.107 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.107 DEBUG:boto:Params: {} 2024-04-16T18:18:08.107 DEBUG:boto:Token: None 2024-04-16T18:18:08.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zbjUbQcw7qMmTwW+YAQfVMjhUQo= 2024-04-16T18:18:08.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zbjUbQcw7qMmTwW+YAQfVMjhUQo=', 'Content-Length': '0'} 2024-04-16T18:18:08.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fff503945dabdf1b-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.109 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.109 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.109 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.109 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.110 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.110 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.110 DEBUG:boto:Data: 2024-04-16T18:18:08.110 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.110 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.110 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.110 DEBUG:boto:Params: {} 2024-04-16T18:18:08.110 DEBUG:boto:Token: None 2024-04-16T18:18:08.110 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zbjUbQcw7qMmTwW+YAQfVMjhUQo= 2024-04-16T18:18:08.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zbjUbQcw7qMmTwW+YAQfVMjhUQo=', 'Content-Length': '0'} 2024-04-16T18:18:08.112 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3916b3bd1ec7f51-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.113 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2024-04-16T18:18:08.113 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.113 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.113 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.113 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.113 DEBUG:boto:Method: GET 2024-04-16T18:18:08.113 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.113 DEBUG:boto:Data: 2024-04-16T18:18:08.113 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.114 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.114 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.114 DEBUG:boto:Params: {} 2024-04-16T18:18:08.114 DEBUG:boto:Token: None 2024-04-16T18:18:08.114 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.114 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM= 2024-04-16T18:18:08.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM=', 'Content-Length': '0'} 2024-04-16T18:18:08.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3cfcb65af2977a6-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.158 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.159 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.159 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.159 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.159 DEBUG:boto:Method: GET 2024-04-16T18:18:08.159 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.159 DEBUG:boto:Data: 2024-04-16T18:18:08.159 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.159 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.160 DEBUG:boto:Params: {} 2024-04-16T18:18:08.160 DEBUG:boto:Token: None 2024-04-16T18:18:08.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019?versionId=null 2024-04-16T18:18:08.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM= 2024-04-16T18:18:08.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jbyX+RRftCLohJKB/S3bUjKehPM=', 'Content-Length': '0'} 2024-04-16T18:18:08.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000316fe12a8a92daa-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.162 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.162 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.163 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.163 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.163 DEBUG:boto:Method: GET 2024-04-16T18:18:08.163 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.163 DEBUG:boto:Data: 2024-04-16T18:18:08.163 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.163 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.163 DEBUG:boto:Params: {} 2024-04-16T18:18:08.163 DEBUG:boto:Token: None 2024-04-16T18:18:08.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e8ad2c47dfc2d56-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.206 DEBUG:boto:b'cjqttm-51obj000000000000000000191000falseobj000000000000000000192024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.207 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.207 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.207 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.207 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.207 DEBUG:boto:Method: GET 2024-04-16T18:18:08.207 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.207 DEBUG:boto:Data: 2024-04-16T18:18:08.207 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.208 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.208 DEBUG:boto:Params: {} 2024-04-16T18:18:08.208 DEBUG:boto:Token: None 2024-04-16T18:18:08.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d59045e30f7ac82a-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.212 DEBUG:boto:b'cjqttm-51obj000000000000000000191000falseobj000000000000000000192024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.212 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.212 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.212 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.213 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.213 DEBUG:boto:Data: 2024-04-16T18:18:08.213 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.213 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.213 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.213 DEBUG:boto:Params: {} 2024-04-16T18:18:08.213 DEBUG:boto:Token: None 2024-04-16T18:18:08.213 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.213 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Em3RMfXMUosNyK9+UU8Tf4BbYH0= 2024-04-16T18:18:08.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Em3RMfXMUosNyK9+UU8Tf4BbYH0=', 'Content-Length': '0'} 2024-04-16T18:18:08.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e165fb77572c4ebb-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.216 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.216 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.216 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.216 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.216 DEBUG:boto:Data: 2024-04-16T18:18:08.216 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.216 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.216 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.217 DEBUG:boto:Params: {} 2024-04-16T18:18:08.217 DEBUG:boto:Token: None 2024-04-16T18:18:08.217 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.217 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Em3RMfXMUosNyK9+UU8Tf4BbYH0= 2024-04-16T18:18:08.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Em3RMfXMUosNyK9+UU8Tf4BbYH0=', 'Content-Length': '0'} 2024-04-16T18:18:08.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ab69a8da9e1c149-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.219 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000019 2024-04-16T18:18:08.219 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.219 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.219 DEBUG:boto:Method: GET 2024-04-16T18:18:08.219 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.220 DEBUG:boto:Data: 2024-04-16T18:18:08.220 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.220 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.220 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.220 DEBUG:boto:Params: {} 2024-04-16T18:18:08.220 DEBUG:boto:Token: None 2024-04-16T18:18:08.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:folQUt2PeX974Piv5L55jS7Bqzo= 2024-04-16T18:18:08.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:folQUt2PeX974Piv5L55jS7Bqzo=', 'Content-Length': '0'} 2024-04-16T18:18:08.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098e50743e4ee4e07-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.266 DEBUG:boto:path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.266 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.267 DEBUG:boto:Method: GET 2024-04-16T18:18:08.267 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.267 DEBUG:boto:Data: 2024-04-16T18:18:08.267 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.267 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.267 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.267 DEBUG:boto:Params: {} 2024-04-16T18:18:08.267 DEBUG:boto:Token: None 2024-04-16T18:18:08.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000019 2024-04-16T18:18:08.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:folQUt2PeX974Piv5L55jS7Bqzo= 2024-04-16T18:18:08.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:folQUt2PeX974Piv5L55jS7Bqzo=', 'Content-Length': '0'} 2024-04-16T18:18:08.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056cda847d490dc72-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.270 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.270 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.270 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.270 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.270 DEBUG:boto:Method: GET 2024-04-16T18:18:08.271 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.271 DEBUG:boto:Data: 2024-04-16T18:18:08.271 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.271 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.271 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.271 DEBUG:boto:Params: {} 2024-04-16T18:18:08.271 DEBUG:boto:Token: None 2024-04-16T18:18:08.271 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.274 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000069f03da48eff374-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.314 DEBUG:boto:b'cjqttm-51obj000000000000000000191000falseobj000000000000000000192024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.315 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.315 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.315 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.315 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.315 DEBUG:boto:Method: GET 2024-04-16T18:18:08.315 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000019 2024-04-16T18:18:08.315 DEBUG:boto:Data: 2024-04-16T18:18:08.315 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.315 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.316 DEBUG:boto:Params: {} 2024-04-16T18:18:08.316 DEBUG:boto:Token: None 2024-04-16T18:18:08.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.320 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b232e6478ea8cb0-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.320 DEBUG:boto:b'cjqttm-51obj000000000000000000191000falseobj000000000000000000192024-04-16T18:17:59.706Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.320 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2024-04-16T18:18:08.320 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.321 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.321 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.321 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.321 DEBUG:boto:Method: GET 2024-04-16T18:18:08.321 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.321 DEBUG:boto:Data: 2024-04-16T18:18:08.321 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.321 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.321 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.321 DEBUG:boto:Params: {} 2024-04-16T18:18:08.321 DEBUG:boto:Token: None 2024-04-16T18:18:08.322 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.322 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc= 2024-04-16T18:18:08.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc=', 'Content-Length': '0'} 2024-04-16T18:18:08.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a3bac30de5e9ec9-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.366 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.366 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.366 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.367 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.367 DEBUG:boto:Method: GET 2024-04-16T18:18:08.367 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.367 DEBUG:boto:Data: 2024-04-16T18:18:08.367 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.367 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.367 DEBUG:boto:Params: {} 2024-04-16T18:18:08.367 DEBUG:boto:Token: None 2024-04-16T18:18:08.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc= 2024-04-16T18:18:08.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc=', 'Content-Length': '0'} 2024-04-16T18:18:08.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e835b78e9c7ac83-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.370 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.370 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.371 DEBUG:boto:Data: 2024-04-16T18:18:08.371 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.371 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.371 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.371 DEBUG:boto:Params: {} 2024-04-16T18:18:08.371 DEBUG:boto:Token: None 2024-04-16T18:18:08.371 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPD2XcjzYZmDNH8pNQCxp5Tgw7w= 2024-04-16T18:18:08.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPD2XcjzYZmDNH8pNQCxp5Tgw7w=', 'Content-Length': '0'} 2024-04-16T18:18:08.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac302624697271dc-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.373 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.373 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.374 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.374 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.374 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.374 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.374 DEBUG:boto:Data: 2024-04-16T18:18:08.374 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.374 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.374 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.374 DEBUG:boto:Params: {} 2024-04-16T18:18:08.375 DEBUG:boto:Token: None 2024-04-16T18:18:08.375 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPD2XcjzYZmDNH8pNQCxp5Tgw7w= 2024-04-16T18:18:08.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPD2XcjzYZmDNH8pNQCxp5Tgw7w=', 'Content-Length': '0'} 2024-04-16T18:18:08.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000348f1c156cbdd7ec-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.377 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2024-04-16T18:18:08.377 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.377 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.377 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.378 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.378 DEBUG:boto:Method: GET 2024-04-16T18:18:08.378 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.378 DEBUG:boto:Data: 2024-04-16T18:18:08.378 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.378 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.378 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.378 DEBUG:boto:Params: {} 2024-04-16T18:18:08.378 DEBUG:boto:Token: None 2024-04-16T18:18:08.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc= 2024-04-16T18:18:08.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc=', 'Content-Length': '0'} 2024-04-16T18:18:08.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000227da056c15d432d-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.422 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.422 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.423 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.423 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.423 DEBUG:boto:Method: GET 2024-04-16T18:18:08.423 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.423 DEBUG:boto:Data: 2024-04-16T18:18:08.423 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.423 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.423 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.423 DEBUG:boto:Params: {} 2024-04-16T18:18:08.423 DEBUG:boto:Token: None 2024-04-16T18:18:08.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020?versionId=null 2024-04-16T18:18:08.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc= 2024-04-16T18:18:08.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:diBdkMooCYtORVTx1pZaFaOu+vc=', 'Content-Length': '0'} 2024-04-16T18:18:08.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7c47cdceab49cb1-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.426 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.426 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.426 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.426 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.426 DEBUG:boto:Method: GET 2024-04-16T18:18:08.426 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.426 DEBUG:boto:Data: 2024-04-16T18:18:08.426 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.427 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.427 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.427 DEBUG:boto:Params: {} 2024-04-16T18:18:08.427 DEBUG:boto:Token: None 2024-04-16T18:18:08.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.427 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.429 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc294cb7a6357572-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.470 DEBUG:boto:b'cjqttm-51obj000000000000000000201000falseobj000000000000000000202024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.471 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.471 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.471 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.471 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.471 DEBUG:boto:Method: GET 2024-04-16T18:18:08.471 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.471 DEBUG:boto:Data: 2024-04-16T18:18:08.471 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.472 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.472 DEBUG:boto:Params: {} 2024-04-16T18:18:08.472 DEBUG:boto:Token: None 2024-04-16T18:18:08.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000667ff1c719b669e7-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.476 DEBUG:boto:b'cjqttm-51obj000000000000000000201000falseobj000000000000000000202024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.477 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.477 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.477 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.477 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.477 DEBUG:boto:Data: 2024-04-16T18:18:08.477 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.477 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.478 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.478 DEBUG:boto:Params: {} 2024-04-16T18:18:08.478 DEBUG:boto:Token: None 2024-04-16T18:18:08.478 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BAeUhKj4QVsM81Bb1an9hWVVCf8= 2024-04-16T18:18:08.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BAeUhKj4QVsM81Bb1an9hWVVCf8=', 'Content-Length': '0'} 2024-04-16T18:18:08.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b512ab82e548991-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.481 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.481 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.481 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.481 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.481 DEBUG:boto:Data: 2024-04-16T18:18:08.481 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.481 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.481 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.482 DEBUG:boto:Params: {} 2024-04-16T18:18:08.482 DEBUG:boto:Token: None 2024-04-16T18:18:08.482 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.482 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BAeUhKj4QVsM81Bb1an9hWVVCf8= 2024-04-16T18:18:08.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BAeUhKj4QVsM81Bb1an9hWVVCf8=', 'Content-Length': '0'} 2024-04-16T18:18:08.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f99ad0945f8434f-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000020 2024-04-16T18:18:08.484 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.485 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.485 DEBUG:boto:Method: GET 2024-04-16T18:18:08.485 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.485 DEBUG:boto:Data: 2024-04-16T18:18:08.485 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.485 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.485 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.485 DEBUG:boto:Params: {} 2024-04-16T18:18:08.486 DEBUG:boto:Token: None 2024-04-16T18:18:08.486 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.486 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5RC2rSYjU2tYdwWsPim4hCApajo= 2024-04-16T18:18:08.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5RC2rSYjU2tYdwWsPim4hCApajo=', 'Content-Length': '0'} 2024-04-16T18:18:08.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003501a491a9b0c039-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.530 DEBUG:boto:path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.530 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.531 DEBUG:boto:Method: GET 2024-04-16T18:18:08.531 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.531 DEBUG:boto:Data: 2024-04-16T18:18:08.531 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.531 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.531 DEBUG:boto:Params: {} 2024-04-16T18:18:08.531 DEBUG:boto:Token: None 2024-04-16T18:18:08.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000020 2024-04-16T18:18:08.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5RC2rSYjU2tYdwWsPim4hCApajo= 2024-04-16T18:18:08.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5RC2rSYjU2tYdwWsPim4hCApajo=', 'Content-Length': '0'} 2024-04-16T18:18:08.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fe2b357f94ea443-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.534 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.534 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.534 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.534 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.534 DEBUG:boto:Method: GET 2024-04-16T18:18:08.534 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.534 DEBUG:boto:Data: 2024-04-16T18:18:08.534 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.534 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.535 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.535 DEBUG:boto:Params: {} 2024-04-16T18:18:08.535 DEBUG:boto:Token: None 2024-04-16T18:18:08.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.537 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000edcbe6ab13fdf47b-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.538 DEBUG:boto:b'cjqttm-51obj000000000000000000201000falseobj000000000000000000202024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.538 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.538 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.538 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.538 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.539 DEBUG:boto:Method: GET 2024-04-16T18:18:08.539 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000020 2024-04-16T18:18:08.539 DEBUG:boto:Data: 2024-04-16T18:18:08.539 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.539 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.539 DEBUG:boto:Params: {} 2024-04-16T18:18:08.539 DEBUG:boto:Token: None 2024-04-16T18:18:08.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee7138c25cc9b670-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.544 DEBUG:boto:b'cjqttm-51obj000000000000000000201000falseobj000000000000000000202024-04-16T18:18:00.136Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.544 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2024-04-16T18:18:08.544 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.544 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.544 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.544 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.545 DEBUG:boto:Method: GET 2024-04-16T18:18:08.545 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.545 DEBUG:boto:Data: 2024-04-16T18:18:08.545 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.545 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.545 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.545 DEBUG:boto:Params: {} 2024-04-16T18:18:08.545 DEBUG:boto:Token: None 2024-04-16T18:18:08.545 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y= 2024-04-16T18:18:08.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y=', 'Content-Length': '0'} 2024-04-16T18:18:08.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088bd7ae9fcad9d71-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.590 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.591 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.591 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.591 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.591 DEBUG:boto:Method: GET 2024-04-16T18:18:08.591 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.591 DEBUG:boto:Data: 2024-04-16T18:18:08.591 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.591 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.591 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.591 DEBUG:boto:Params: {} 2024-04-16T18:18:08.591 DEBUG:boto:Token: None 2024-04-16T18:18:08.592 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y= 2024-04-16T18:18:08.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y=', 'Content-Length': '0'} 2024-04-16T18:18:08.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007118bf385b02ec15-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.594 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.594 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.594 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.594 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.595 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.595 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.595 DEBUG:boto:Data: 2024-04-16T18:18:08.595 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.595 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.595 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.595 DEBUG:boto:Params: {} 2024-04-16T18:18:08.595 DEBUG:boto:Token: None 2024-04-16T18:18:08.595 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jk8TAOe2ogEvijS+altc2rK4VEE= 2024-04-16T18:18:08.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jk8TAOe2ogEvijS+altc2rK4VEE=', 'Content-Length': '0'} 2024-04-16T18:18:08.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000388f96b353a027b3-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.598 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.598 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.598 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.598 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.598 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.598 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.598 DEBUG:boto:Data: 2024-04-16T18:18:08.599 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.599 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.599 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.599 DEBUG:boto:Params: {} 2024-04-16T18:18:08.599 DEBUG:boto:Token: None 2024-04-16T18:18:08.599 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jk8TAOe2ogEvijS+altc2rK4VEE= 2024-04-16T18:18:08.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jk8TAOe2ogEvijS+altc2rK4VEE=', 'Content-Length': '0'} 2024-04-16T18:18:08.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083e01c41cd40023e-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.601 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2024-04-16T18:18:08.601 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.601 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.601 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.601 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.602 DEBUG:boto:Method: GET 2024-04-16T18:18:08.602 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.602 DEBUG:boto:Data: 2024-04-16T18:18:08.602 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.602 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.602 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.602 DEBUG:boto:Params: {} 2024-04-16T18:18:08.602 DEBUG:boto:Token: None 2024-04-16T18:18:08.602 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.602 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y= 2024-04-16T18:18:08.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y=', 'Content-Length': '0'} 2024-04-16T18:18:08.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079a7986fed752567-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.646 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.646 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.647 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.647 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.647 DEBUG:boto:Method: GET 2024-04-16T18:18:08.647 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.647 DEBUG:boto:Data: 2024-04-16T18:18:08.647 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.647 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.647 DEBUG:boto:Params: {} 2024-04-16T18:18:08.647 DEBUG:boto:Token: None 2024-04-16T18:18:08.649 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021?versionId=null 2024-04-16T18:18:08.649 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y= 2024-04-16T18:18:08.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N5XkVOOsVREsp0LTuSbhrXKFv+Y=', 'Content-Length': '0'} 2024-04-16T18:18:08.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003fc9900014f4a65f-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.652 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.652 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.652 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.652 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.652 DEBUG:boto:Method: GET 2024-04-16T18:18:08.653 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.653 DEBUG:boto:Data: 2024-04-16T18:18:08.653 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.653 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.653 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.653 DEBUG:boto:Params: {} 2024-04-16T18:18:08.653 DEBUG:boto:Token: None 2024-04-16T18:18:08.653 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.653 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.656 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000022c623ccf198a593-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.656 DEBUG:boto:b'cjqttm-51obj000000000000000000211000falseobj000000000000000000212024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.656 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.656 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.656 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.657 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.657 DEBUG:boto:Method: GET 2024-04-16T18:18:08.657 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.657 DEBUG:boto:Data: 2024-04-16T18:18:08.657 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.657 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.657 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.657 DEBUG:boto:Params: {} 2024-04-16T18:18:08.657 DEBUG:boto:Token: None 2024-04-16T18:18:08.657 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.657 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.661 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a59210499a92510-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.662 DEBUG:boto:b'cjqttm-51obj000000000000000000211000falseobj000000000000000000212024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.662 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.662 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.662 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.662 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.663 DEBUG:boto:Data: 2024-04-16T18:18:08.663 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.663 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.663 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.663 DEBUG:boto:Params: {} 2024-04-16T18:18:08.663 DEBUG:boto:Token: None 2024-04-16T18:18:08.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B5XFlTzsyPbSs6UfueUWiOO9WYM= 2024-04-16T18:18:08.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B5XFlTzsyPbSs6UfueUWiOO9WYM=', 'Content-Length': '0'} 2024-04-16T18:18:08.666 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5c2b0d82ac8afb6-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.666 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.666 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.666 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.666 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.666 DEBUG:boto:Data: 2024-04-16T18:18:08.666 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.666 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.666 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.667 DEBUG:boto:Params: {} 2024-04-16T18:18:08.667 DEBUG:boto:Token: None 2024-04-16T18:18:08.667 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B5XFlTzsyPbSs6UfueUWiOO9WYM= 2024-04-16T18:18:08.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B5XFlTzsyPbSs6UfueUWiOO9WYM=', 'Content-Length': '0'} 2024-04-16T18:18:08.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed7df31699d08dbe-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000021 2024-04-16T18:18:08.669 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.669 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.670 DEBUG:boto:Method: GET 2024-04-16T18:18:08.670 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.670 DEBUG:boto:Data: 2024-04-16T18:18:08.670 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.670 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.670 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.670 DEBUG:boto:Params: {} 2024-04-16T18:18:08.670 DEBUG:boto:Token: None 2024-04-16T18:18:08.670 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.670 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2+fXhBts1UwAWqzr7ptewPeSRiY= 2024-04-16T18:18:08.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2+fXhBts1UwAWqzr7ptewPeSRiY=', 'Content-Length': '0'} 2024-04-16T18:18:08.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046010e1c4687b67e-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.714 DEBUG:boto:path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.714 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.714 DEBUG:boto:Method: GET 2024-04-16T18:18:08.715 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.715 DEBUG:boto:Data: 2024-04-16T18:18:08.715 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.715 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.715 DEBUG:boto:Params: {} 2024-04-16T18:18:08.715 DEBUG:boto:Token: None 2024-04-16T18:18:08.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000021 2024-04-16T18:18:08.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2+fXhBts1UwAWqzr7ptewPeSRiY= 2024-04-16T18:18:08.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2+fXhBts1UwAWqzr7ptewPeSRiY=', 'Content-Length': '0'} 2024-04-16T18:18:08.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c95805a4be582e10-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.718 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.718 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.718 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.718 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.718 DEBUG:boto:Method: GET 2024-04-16T18:18:08.718 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.718 DEBUG:boto:Data: 2024-04-16T18:18:08.718 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.718 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.718 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.719 DEBUG:boto:Params: {} 2024-04-16T18:18:08.719 DEBUG:boto:Token: None 2024-04-16T18:18:08.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057d74caf907b59ed-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.762 DEBUG:boto:b'cjqttm-51obj000000000000000000211000falseobj000000000000000000212024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.763 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.763 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.763 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.763 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.763 DEBUG:boto:Method: GET 2024-04-16T18:18:08.763 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000021 2024-04-16T18:18:08.763 DEBUG:boto:Data: 2024-04-16T18:18:08.763 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.763 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.763 DEBUG:boto:Params: {} 2024-04-16T18:18:08.764 DEBUG:boto:Token: None 2024-04-16T18:18:08.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.767 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000180a34a92be64fce-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.768 DEBUG:boto:b'cjqttm-51obj000000000000000000211000falseobj000000000000000000212024-04-16T18:17:59.759Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.768 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2024-04-16T18:18:08.768 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.768 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.768 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.769 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.769 DEBUG:boto:Method: GET 2024-04-16T18:18:08.769 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.769 DEBUG:boto:Data: 2024-04-16T18:18:08.769 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.769 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.769 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.769 DEBUG:boto:Params: {} 2024-04-16T18:18:08.769 DEBUG:boto:Token: None 2024-04-16T18:18:08.769 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ= 2024-04-16T18:18:08.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ=', 'Content-Length': '0'} 2024-04-16T18:18:08.772 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000293a47efbda90750-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.814 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.814 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.815 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.815 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.815 DEBUG:boto:Method: GET 2024-04-16T18:18:08.815 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.815 DEBUG:boto:Data: 2024-04-16T18:18:08.815 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.815 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.815 DEBUG:boto:Params: {} 2024-04-16T18:18:08.815 DEBUG:boto:Token: None 2024-04-16T18:18:08.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ= 2024-04-16T18:18:08.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ=', 'Content-Length': '0'} 2024-04-16T18:18:08.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b67a258740894d7-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.818 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.818 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.818 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.818 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.818 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.818 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.818 DEBUG:boto:Data: 2024-04-16T18:18:08.818 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.819 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.819 DEBUG:boto:Params: {} 2024-04-16T18:18:08.819 DEBUG:boto:Token: None 2024-04-16T18:18:08.819 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UiKkvzg7QfMRtg+VuIbY5vpB2xY= 2024-04-16T18:18:08.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UiKkvzg7QfMRtg+VuIbY5vpB2xY=', 'Content-Length': '0'} 2024-04-16T18:18:08.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b02752af0ad398f-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.821 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.821 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.822 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.822 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.822 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.822 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.822 DEBUG:boto:Data: 2024-04-16T18:18:08.822 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.822 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.822 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.822 DEBUG:boto:Params: {} 2024-04-16T18:18:08.822 DEBUG:boto:Token: None 2024-04-16T18:18:08.822 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UiKkvzg7QfMRtg+VuIbY5vpB2xY= 2024-04-16T18:18:08.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UiKkvzg7QfMRtg+VuIbY5vpB2xY=', 'Content-Length': '0'} 2024-04-16T18:18:08.824 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9d9cadf8bc8c51c-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.825 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2024-04-16T18:18:08.825 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.825 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.825 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.825 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.825 DEBUG:boto:Method: GET 2024-04-16T18:18:08.825 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.825 DEBUG:boto:Data: 2024-04-16T18:18:08.825 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.825 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.826 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.826 DEBUG:boto:Params: {} 2024-04-16T18:18:08.826 DEBUG:boto:Token: None 2024-04-16T18:18:08.826 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.826 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ= 2024-04-16T18:18:08.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ=', 'Content-Length': '0'} 2024-04-16T18:18:08.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df0deb311963c618-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.870 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.870 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.870 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.871 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.871 DEBUG:boto:Method: GET 2024-04-16T18:18:08.871 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.871 DEBUG:boto:Data: 2024-04-16T18:18:08.871 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.871 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.871 DEBUG:boto:Params: {} 2024-04-16T18:18:08.871 DEBUG:boto:Token: None 2024-04-16T18:18:08.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022?versionId=null 2024-04-16T18:18:08.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ= 2024-04-16T18:18:08.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9KRuR6ELq5uvGtjtKdvl3BelKfQ=', 'Content-Length': '0'} 2024-04-16T18:18:08.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000560c868248750815-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.874 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.874 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.874 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.874 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.874 DEBUG:boto:Method: GET 2024-04-16T18:18:08.874 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.874 DEBUG:boto:Data: 2024-04-16T18:18:08.874 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.874 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.874 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.875 DEBUG:boto:Params: {} 2024-04-16T18:18:08.875 DEBUG:boto:Token: None 2024-04-16T18:18:08.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.877 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d125366eff9ff01a-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.918 DEBUG:boto:b'cjqttm-51obj000000000000000000221000falseobj000000000000000000222024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.919 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.919 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.919 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.919 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.919 DEBUG:boto:Method: GET 2024-04-16T18:18:08.919 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.919 DEBUG:boto:Data: 2024-04-16T18:18:08.919 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.919 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.919 DEBUG:boto:Params: {} 2024-04-16T18:18:08.920 DEBUG:boto:Token: None 2024-04-16T18:18:08.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.924 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d168ec0db9228bb0-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.924 DEBUG:boto:b'cjqttm-51obj000000000000000000221000falseobj000000000000000000222024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:08.924 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.924 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.925 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.925 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.925 DEBUG:boto:Data: 2024-04-16T18:18:08.925 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.925 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.925 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.925 DEBUG:boto:Params: {} 2024-04-16T18:18:08.925 DEBUG:boto:Token: None 2024-04-16T18:18:08.925 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fHyTcTYaRKcdZ/SnviMgqL+iZc8= 2024-04-16T18:18:08.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fHyTcTYaRKcdZ/SnviMgqL+iZc8=', 'Content-Length': '0'} 2024-04-16T18:18:08.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b95db8628a8aceb-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.928 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.928 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.928 DEBUG:boto:Method: HEAD 2024-04-16T18:18:08.928 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.928 DEBUG:boto:Data: 2024-04-16T18:18:08.928 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.928 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.929 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.929 DEBUG:boto:Params: {} 2024-04-16T18:18:08.929 DEBUG:boto:Token: None 2024-04-16T18:18:08.929 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.929 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fHyTcTYaRKcdZ/SnviMgqL+iZc8= 2024-04-16T18:18:08.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fHyTcTYaRKcdZ/SnviMgqL+iZc8=', 'Content-Length': '0'} 2024-04-16T18:18:08.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089519a55f392f741-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.931 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000022 2024-04-16T18:18:08.931 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.931 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.931 DEBUG:boto:Method: GET 2024-04-16T18:18:08.931 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.931 DEBUG:boto:Data: 2024-04-16T18:18:08.931 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.932 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.932 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.932 DEBUG:boto:Params: {} 2024-04-16T18:18:08.932 DEBUG:boto:Token: None 2024-04-16T18:18:08.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5I1QKBH1F7jbz3VHxNTiP72Ct04= 2024-04-16T18:18:08.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5I1QKBH1F7jbz3VHxNTiP72Ct04=', 'Content-Length': '0'} 2024-04-16T18:18:08.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000437d10038159b755-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.974 DEBUG:boto:path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.974 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.975 DEBUG:boto:Method: GET 2024-04-16T18:18:08.975 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.975 DEBUG:boto:Data: 2024-04-16T18:18:08.975 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:08.975 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.975 DEBUG:boto:Params: {} 2024-04-16T18:18:08.975 DEBUG:boto:Token: None 2024-04-16T18:18:08.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/obj00000000000000000022 2024-04-16T18:18:08.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5I1QKBH1F7jbz3VHxNTiP72Ct04= 2024-04-16T18:18:08.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5I1QKBH1F7jbz3VHxNTiP72Ct04=', 'Content-Length': '0'} 2024-04-16T18:18:08.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc641aae2e9ad6f7-00661ec0e0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:08.978 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:08.978 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:08.978 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.978 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.978 DEBUG:boto:Method: GET 2024-04-16T18:18:08.978 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:08.978 DEBUG:boto:Data: 2024-04-16T18:18:08.978 DEBUG:boto:Headers: {} 2024-04-16T18:18:08.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:08.979 DEBUG:boto:Port: 8000 2024-04-16T18:18:08.979 DEBUG:boto:Params: {} 2024-04-16T18:18:08.979 DEBUG:boto:Token: None 2024-04-16T18:18:08.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:08 GMT /cjqttm-51/ 2024-04-16T18:18:08.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8= 2024-04-16T18:18:08.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0fVf2iE2hLr4anMGgT57LDVfwK8=', 'Content-Length': '0'} 2024-04-16T18:18:08.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc4eb02372e4873a-00661ec0e0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.022 DEBUG:boto:b'cjqttm-51obj000000000000000000221000falseobj000000000000000000222024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.023 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.023 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.023 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:09.023 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:09.023 DEBUG:boto:Method: GET 2024-04-16T18:18:09.023 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000022 2024-04-16T18:18:09.023 DEBUG:boto:Data: 2024-04-16T18:18:09.023 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.024 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.024 DEBUG:boto:Params: {} 2024-04-16T18:18:09.024 DEBUG:boto:Token: None 2024-04-16T18:18:09.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.029 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a800e25c84197dc1-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.029 DEBUG:boto:b'cjqttm-51obj000000000000000000221000falseobj000000000000000000222024-04-16T18:17:58.771Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2024-04-16T18:18:09.029 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.029 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.029 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.030 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.030 DEBUG:boto:Method: GET 2024-04-16T18:18:09.030 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.030 DEBUG:boto:Data: 2024-04-16T18:18:09.030 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.030 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.030 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.030 DEBUG:boto:Params: {} 2024-04-16T18:18:09.030 DEBUG:boto:Token: None 2024-04-16T18:18:09.030 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE= 2024-04-16T18:18:09.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE=', 'Content-Length': '0'} 2024-04-16T18:18:09.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002778d342bd08c481-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.074 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.074 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.074 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.075 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.075 DEBUG:boto:Method: GET 2024-04-16T18:18:09.075 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.075 DEBUG:boto:Data: 2024-04-16T18:18:09.075 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.075 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.075 DEBUG:boto:Params: {} 2024-04-16T18:18:09.075 DEBUG:boto:Token: None 2024-04-16T18:18:09.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE= 2024-04-16T18:18:09.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE=', 'Content-Length': '0'} 2024-04-16T18:18:09.078 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b6d8b945c17a3cc-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.078 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.078 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.078 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.078 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.078 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.078 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.078 DEBUG:boto:Data: 2024-04-16T18:18:09.079 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.079 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.079 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.079 DEBUG:boto:Params: {} 2024-04-16T18:18:09.079 DEBUG:boto:Token: None 2024-04-16T18:18:09.079 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:04Di390xy3UgXHeFuJQDq+nzxWA= 2024-04-16T18:18:09.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:04Di390xy3UgXHeFuJQDq+nzxWA=', 'Content-Length': '0'} 2024-04-16T18:18:09.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068786ed5d388fd9d-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.081 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.082 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.082 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.082 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.082 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.082 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.082 DEBUG:boto:Data: 2024-04-16T18:18:09.082 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.082 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.083 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.083 DEBUG:boto:Params: {} 2024-04-16T18:18:09.083 DEBUG:boto:Token: None 2024-04-16T18:18:09.083 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.083 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:04Di390xy3UgXHeFuJQDq+nzxWA= 2024-04-16T18:18:09.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:04Di390xy3UgXHeFuJQDq+nzxWA=', 'Content-Length': '0'} 2024-04-16T18:18:09.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038202567ac6fc4ee-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.086 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2024-04-16T18:18:09.086 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.087 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.087 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.087 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.087 DEBUG:boto:Method: GET 2024-04-16T18:18:09.087 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.087 DEBUG:boto:Data: 2024-04-16T18:18:09.087 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.087 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.087 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.087 DEBUG:boto:Params: {} 2024-04-16T18:18:09.087 DEBUG:boto:Token: None 2024-04-16T18:18:09.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE= 2024-04-16T18:18:09.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE=', 'Content-Length': '0'} 2024-04-16T18:18:09.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3eb04e6a5741374-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.130 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.131 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.131 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.131 DEBUG:boto:Method: GET 2024-04-16T18:18:09.131 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.131 DEBUG:boto:Data: 2024-04-16T18:18:09.131 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.131 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.131 DEBUG:boto:Params: {} 2024-04-16T18:18:09.131 DEBUG:boto:Token: None 2024-04-16T18:18:09.131 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023?versionId=null 2024-04-16T18:18:09.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE= 2024-04-16T18:18:09.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CH3uukoI8N2g6H0ftUH/PFgySsE=', 'Content-Length': '0'} 2024-04-16T18:18:09.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9ded5ee01e610c3-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.134 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.134 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.134 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.134 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.134 DEBUG:boto:Method: GET 2024-04-16T18:18:09.134 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.134 DEBUG:boto:Data: 2024-04-16T18:18:09.135 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.135 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.135 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.135 DEBUG:boto:Params: {} 2024-04-16T18:18:09.135 DEBUG:boto:Token: None 2024-04-16T18:18:09.135 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.138 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062e14a39de1c8ec9-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.178 DEBUG:boto:b'cjqttm-51obj000000000000000000231000falseobj000000000000000000232024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.179 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.179 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.179 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.179 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.179 DEBUG:boto:Method: GET 2024-04-16T18:18:09.179 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.179 DEBUG:boto:Data: 2024-04-16T18:18:09.179 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.179 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.180 DEBUG:boto:Params: {} 2024-04-16T18:18:09.180 DEBUG:boto:Token: None 2024-04-16T18:18:09.180 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.184 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000018445389fa82f09-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.184 DEBUG:boto:b'cjqttm-51obj000000000000000000231000falseobj000000000000000000232024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.184 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.185 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.185 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.185 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.185 DEBUG:boto:Data: 2024-04-16T18:18:09.185 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.185 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.185 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.185 DEBUG:boto:Params: {} 2024-04-16T18:18:09.185 DEBUG:boto:Token: None 2024-04-16T18:18:09.185 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.186 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TPHNURHjRlk2MLNnr0ycF2OVLrA= 2024-04-16T18:18:09.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TPHNURHjRlk2MLNnr0ycF2OVLrA=', 'Content-Length': '0'} 2024-04-16T18:18:09.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d35fdf4f2922435-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.188 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.188 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.188 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.188 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.188 DEBUG:boto:Data: 2024-04-16T18:18:09.188 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.189 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.189 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.189 DEBUG:boto:Params: {} 2024-04-16T18:18:09.189 DEBUG:boto:Token: None 2024-04-16T18:18:09.189 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.189 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TPHNURHjRlk2MLNnr0ycF2OVLrA= 2024-04-16T18:18:09.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TPHNURHjRlk2MLNnr0ycF2OVLrA=', 'Content-Length': '0'} 2024-04-16T18:18:09.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007cd4c6c47739ca96-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.191 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000023 2024-04-16T18:18:09.191 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.192 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.192 DEBUG:boto:Method: GET 2024-04-16T18:18:09.192 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.192 DEBUG:boto:Data: 2024-04-16T18:18:09.192 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.192 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.192 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.192 DEBUG:boto:Params: {} 2024-04-16T18:18:09.192 DEBUG:boto:Token: None 2024-04-16T18:18:09.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VGxZmUunu4qS3dwRVL7aBTjvm1Q= 2024-04-16T18:18:09.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VGxZmUunu4qS3dwRVL7aBTjvm1Q=', 'Content-Length': '0'} 2024-04-16T18:18:09.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e80ca7518d4ad237-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.238 DEBUG:boto:path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.238 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.239 DEBUG:boto:Method: GET 2024-04-16T18:18:09.239 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.239 DEBUG:boto:Data: 2024-04-16T18:18:09.239 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.239 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.239 DEBUG:boto:Params: {} 2024-04-16T18:18:09.239 DEBUG:boto:Token: None 2024-04-16T18:18:09.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000023 2024-04-16T18:18:09.239 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VGxZmUunu4qS3dwRVL7aBTjvm1Q= 2024-04-16T18:18:09.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VGxZmUunu4qS3dwRVL7aBTjvm1Q=', 'Content-Length': '0'} 2024-04-16T18:18:09.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c07324b30d138aa2-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.242 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.242 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.243 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.243 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.243 DEBUG:boto:Method: GET 2024-04-16T18:18:09.243 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.243 DEBUG:boto:Data: 2024-04-16T18:18:09.243 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.244 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.244 DEBUG:boto:Params: {} 2024-04-16T18:18:09.244 DEBUG:boto:Token: None 2024-04-16T18:18:09.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.246 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfaf41b05749c473-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.290 DEBUG:boto:b'cjqttm-51obj000000000000000000231000falseobj000000000000000000232024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.291 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.291 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.291 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.291 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.291 DEBUG:boto:Method: GET 2024-04-16T18:18:09.291 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000023 2024-04-16T18:18:09.291 DEBUG:boto:Data: 2024-04-16T18:18:09.291 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.292 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.292 DEBUG:boto:Params: {} 2024-04-16T18:18:09.292 DEBUG:boto:Token: None 2024-04-16T18:18:09.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b93921bc46ca012b-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.296 DEBUG:boto:b'cjqttm-51obj000000000000000000231000falseobj000000000000000000232024-04-16T18:17:58.258Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2024-04-16T18:18:09.296 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.296 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.297 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.297 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.297 DEBUG:boto:Method: GET 2024-04-16T18:18:09.297 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.297 DEBUG:boto:Data: 2024-04-16T18:18:09.297 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.297 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.297 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.297 DEBUG:boto:Params: {} 2024-04-16T18:18:09.297 DEBUG:boto:Token: None 2024-04-16T18:18:09.298 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.298 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU= 2024-04-16T18:18:09.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU=', 'Content-Length': '0'} 2024-04-16T18:18:09.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000649562458479a801-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.342 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.342 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.343 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.343 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.343 DEBUG:boto:Method: GET 2024-04-16T18:18:09.343 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.343 DEBUG:boto:Data: 2024-04-16T18:18:09.343 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.343 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.343 DEBUG:boto:Params: {} 2024-04-16T18:18:09.343 DEBUG:boto:Token: None 2024-04-16T18:18:09.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU= 2024-04-16T18:18:09.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU=', 'Content-Length': '0'} 2024-04-16T18:18:09.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2cc14fb1dbe4cbc-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.347 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.347 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.347 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.347 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.347 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.347 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.347 DEBUG:boto:Data: 2024-04-16T18:18:09.347 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.347 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.347 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.347 DEBUG:boto:Params: {} 2024-04-16T18:18:09.348 DEBUG:boto:Token: None 2024-04-16T18:18:09.348 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMyiHTOwoqBwFSoYeK3asj8FvNQ= 2024-04-16T18:18:09.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMyiHTOwoqBwFSoYeK3asj8FvNQ=', 'Content-Length': '0'} 2024-04-16T18:18:09.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b57239eae6aac63c-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.350 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.351 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.351 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.351 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.351 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.351 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.351 DEBUG:boto:Data: 2024-04-16T18:18:09.351 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.351 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.351 DEBUG:boto:Params: {} 2024-04-16T18:18:09.351 DEBUG:boto:Token: None 2024-04-16T18:18:09.351 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMyiHTOwoqBwFSoYeK3asj8FvNQ= 2024-04-16T18:18:09.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMyiHTOwoqBwFSoYeK3asj8FvNQ=', 'Content-Length': '0'} 2024-04-16T18:18:09.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005200a9ef0b27c6cb-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.354 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2024-04-16T18:18:09.354 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.354 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.354 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.354 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.355 DEBUG:boto:Method: GET 2024-04-16T18:18:09.355 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.355 DEBUG:boto:Data: 2024-04-16T18:18:09.355 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.355 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.355 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.355 DEBUG:boto:Params: {} 2024-04-16T18:18:09.355 DEBUG:boto:Token: None 2024-04-16T18:18:09.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU= 2024-04-16T18:18:09.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU=', 'Content-Length': '0'} 2024-04-16T18:18:09.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dd6f4cf5f69b535-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.398 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.398 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.399 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.399 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.399 DEBUG:boto:Method: GET 2024-04-16T18:18:09.399 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.399 DEBUG:boto:Data: 2024-04-16T18:18:09.399 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.399 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.399 DEBUG:boto:Params: {} 2024-04-16T18:18:09.399 DEBUG:boto:Token: None 2024-04-16T18:18:09.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024?versionId=null 2024-04-16T18:18:09.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU= 2024-04-16T18:18:09.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VDfEjFZYuISovjysc7epTSoeecU=', 'Content-Length': '0'} 2024-04-16T18:18:09.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000158e0a42ea4f9820-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.402 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.403 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.403 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.403 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.403 DEBUG:boto:Method: GET 2024-04-16T18:18:09.404 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.404 DEBUG:boto:Data: 2024-04-16T18:18:09.404 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.404 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.404 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.405 DEBUG:boto:Params: {} 2024-04-16T18:18:09.405 DEBUG:boto:Token: None 2024-04-16T18:18:09.405 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.405 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.407 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c7a7988c7994fff-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.450 DEBUG:boto:b'cjqttm-51obj000000000000000000241000falseobj000000000000000000242024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.451 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.451 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.451 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.451 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.451 DEBUG:boto:Method: GET 2024-04-16T18:18:09.451 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.451 DEBUG:boto:Data: 2024-04-16T18:18:09.451 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.451 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.451 DEBUG:boto:Params: {} 2024-04-16T18:18:09.452 DEBUG:boto:Token: None 2024-04-16T18:18:09.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f83be26de6318e8e-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.456 DEBUG:boto:b'cjqttm-51obj000000000000000000241000falseobj000000000000000000242024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.456 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.456 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.456 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.456 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.456 DEBUG:boto:Data: 2024-04-16T18:18:09.456 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.456 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.456 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.457 DEBUG:boto:Params: {} 2024-04-16T18:18:09.457 DEBUG:boto:Token: None 2024-04-16T18:18:09.457 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.457 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q0W6bOghWa/8HoPkKu6eFrAcxdI= 2024-04-16T18:18:09.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q0W6bOghWa/8HoPkKu6eFrAcxdI=', 'Content-Length': '0'} 2024-04-16T18:18:09.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007210e5179e22105-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.459 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.459 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.460 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.460 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.460 DEBUG:boto:Data: 2024-04-16T18:18:09.460 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.460 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.460 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.460 DEBUG:boto:Params: {} 2024-04-16T18:18:09.460 DEBUG:boto:Token: None 2024-04-16T18:18:09.460 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q0W6bOghWa/8HoPkKu6eFrAcxdI= 2024-04-16T18:18:09.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q0W6bOghWa/8HoPkKu6eFrAcxdI=', 'Content-Length': '0'} 2024-04-16T18:18:09.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ee79dc394af586b-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.465 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000024 2024-04-16T18:18:09.465 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.466 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.466 DEBUG:boto:Method: GET 2024-04-16T18:18:09.466 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.466 DEBUG:boto:Data: 2024-04-16T18:18:09.466 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.466 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.466 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.466 DEBUG:boto:Params: {} 2024-04-16T18:18:09.466 DEBUG:boto:Token: None 2024-04-16T18:18:09.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v55pXMe9GVoW41m6+KIM0cUm/rw= 2024-04-16T18:18:09.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v55pXMe9GVoW41m6+KIM0cUm/rw=', 'Content-Length': '0'} 2024-04-16T18:18:09.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020768eb50d4c83ea-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.510 DEBUG:boto:path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.510 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.511 DEBUG:boto:Method: GET 2024-04-16T18:18:09.511 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.511 DEBUG:boto:Data: 2024-04-16T18:18:09.511 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.511 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.511 DEBUG:boto:Params: {} 2024-04-16T18:18:09.511 DEBUG:boto:Token: None 2024-04-16T18:18:09.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000024 2024-04-16T18:18:09.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v55pXMe9GVoW41m6+KIM0cUm/rw= 2024-04-16T18:18:09.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v55pXMe9GVoW41m6+KIM0cUm/rw=', 'Content-Length': '0'} 2024-04-16T18:18:09.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5c99deb781a945a-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.514 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.514 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.514 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.515 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.515 DEBUG:boto:Method: GET 2024-04-16T18:18:09.515 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.515 DEBUG:boto:Data: 2024-04-16T18:18:09.515 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.515 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.515 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.515 DEBUG:boto:Params: {} 2024-04-16T18:18:09.516 DEBUG:boto:Token: None 2024-04-16T18:18:09.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000701fb03ba0591ef3-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.558 DEBUG:boto:b'cjqttm-51obj000000000000000000241000falseobj000000000000000000242024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.559 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.559 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.559 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.559 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.559 DEBUG:boto:Method: GET 2024-04-16T18:18:09.559 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000024 2024-04-16T18:18:09.559 DEBUG:boto:Data: 2024-04-16T18:18:09.559 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.560 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.560 DEBUG:boto:Params: {} 2024-04-16T18:18:09.560 DEBUG:boto:Token: None 2024-04-16T18:18:09.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000729e8aba42d34739-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.564 DEBUG:boto:b'cjqttm-51obj000000000000000000241000falseobj000000000000000000242024-04-16T18:17:59.564Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.564 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2024-04-16T18:18:09.564 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.565 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.565 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.565 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.565 DEBUG:boto:Method: GET 2024-04-16T18:18:09.565 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.565 DEBUG:boto:Data: 2024-04-16T18:18:09.565 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.565 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.565 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.565 DEBUG:boto:Params: {} 2024-04-16T18:18:09.565 DEBUG:boto:Token: None 2024-04-16T18:18:09.566 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY= 2024-04-16T18:18:09.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY=', 'Content-Length': '0'} 2024-04-16T18:18:09.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0d40631bc787516-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.610 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.611 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.611 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.611 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.611 DEBUG:boto:Method: GET 2024-04-16T18:18:09.611 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.611 DEBUG:boto:Data: 2024-04-16T18:18:09.611 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.611 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.611 DEBUG:boto:Params: {} 2024-04-16T18:18:09.611 DEBUG:boto:Token: None 2024-04-16T18:18:09.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY= 2024-04-16T18:18:09.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY=', 'Content-Length': '0'} 2024-04-16T18:18:09.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000969bc4453e78b29e-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.614 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.614 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.615 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.615 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.615 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.615 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.615 DEBUG:boto:Data: 2024-04-16T18:18:09.615 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.615 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.615 DEBUG:boto:Params: {} 2024-04-16T18:18:09.615 DEBUG:boto:Token: None 2024-04-16T18:18:09.616 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5B2NlOn7VzgpPQvHzq9BMG9cDu0= 2024-04-16T18:18:09.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5B2NlOn7VzgpPQvHzq9BMG9cDu0=', 'Content-Length': '0'} 2024-04-16T18:18:09.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f54e130fdc6938b-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.618 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.618 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.618 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.618 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.618 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.619 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.619 DEBUG:boto:Data: 2024-04-16T18:18:09.619 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.619 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.619 DEBUG:boto:Params: {} 2024-04-16T18:18:09.619 DEBUG:boto:Token: None 2024-04-16T18:18:09.619 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5B2NlOn7VzgpPQvHzq9BMG9cDu0= 2024-04-16T18:18:09.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5B2NlOn7VzgpPQvHzq9BMG9cDu0=', 'Content-Length': '0'} 2024-04-16T18:18:09.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001da565c5b4e41d4b-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.622 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2024-04-16T18:18:09.622 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.622 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.622 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.622 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.622 DEBUG:boto:Method: GET 2024-04-16T18:18:09.622 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.622 DEBUG:boto:Data: 2024-04-16T18:18:09.623 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.623 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.623 DEBUG:boto:Params: {} 2024-04-16T18:18:09.623 DEBUG:boto:Token: None 2024-04-16T18:18:09.623 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY= 2024-04-16T18:18:09.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY=', 'Content-Length': '0'} 2024-04-16T18:18:09.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074febebe2d405ed1-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.666 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.667 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.667 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.667 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.667 DEBUG:boto:Method: GET 2024-04-16T18:18:09.667 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.668 DEBUG:boto:Data: 2024-04-16T18:18:09.668 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.668 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.668 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.668 DEBUG:boto:Params: {} 2024-04-16T18:18:09.669 DEBUG:boto:Token: None 2024-04-16T18:18:09.669 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025?versionId=null 2024-04-16T18:18:09.669 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY= 2024-04-16T18:18:09.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lim27VL6ER31+v9j8tmlHcJRJJY=', 'Content-Length': '0'} 2024-04-16T18:18:09.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dad6b6532171077-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.671 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.671 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.672 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.672 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.672 DEBUG:boto:Method: GET 2024-04-16T18:18:09.672 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.672 DEBUG:boto:Data: 2024-04-16T18:18:09.672 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.672 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.672 DEBUG:boto:Params: {} 2024-04-16T18:18:09.672 DEBUG:boto:Token: None 2024-04-16T18:18:09.673 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.675 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f24ef29871118be-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.718 DEBUG:boto:b'cjqttm-51obj000000000000000000251000falseobj000000000000000000252024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.719 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.719 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.719 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.719 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.719 DEBUG:boto:Method: GET 2024-04-16T18:18:09.719 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.719 DEBUG:boto:Data: 2024-04-16T18:18:09.719 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.719 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.720 DEBUG:boto:Params: {} 2024-04-16T18:18:09.720 DEBUG:boto:Token: None 2024-04-16T18:18:09.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.724 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a5c0b3ab85bd356-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.725 DEBUG:boto:b'cjqttm-51obj000000000000000000251000falseobj000000000000000000252024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.725 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.725 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.725 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.725 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.725 DEBUG:boto:Data: 2024-04-16T18:18:09.725 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.725 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.726 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.726 DEBUG:boto:Params: {} 2024-04-16T18:18:09.726 DEBUG:boto:Token: None 2024-04-16T18:18:09.726 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.726 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0VqMol7m31ggPefyL3xzPm7VQ8w= 2024-04-16T18:18:09.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0VqMol7m31ggPefyL3xzPm7VQ8w=', 'Content-Length': '0'} 2024-04-16T18:18:09.728 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002969634ce648cfa-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.729 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.729 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.729 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.729 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.729 DEBUG:boto:Data: 2024-04-16T18:18:09.729 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.729 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.729 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.729 DEBUG:boto:Params: {} 2024-04-16T18:18:09.729 DEBUG:boto:Token: None 2024-04-16T18:18:09.730 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.730 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0VqMol7m31ggPefyL3xzPm7VQ8w= 2024-04-16T18:18:09.730 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0VqMol7m31ggPefyL3xzPm7VQ8w=', 'Content-Length': '0'} 2024-04-16T18:18:09.732 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003205d981f3ff1c2f-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.732 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000025 2024-04-16T18:18:09.732 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.732 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.732 DEBUG:boto:Method: GET 2024-04-16T18:18:09.732 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.732 DEBUG:boto:Data: 2024-04-16T18:18:09.732 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.732 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.733 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.733 DEBUG:boto:Params: {} 2024-04-16T18:18:09.733 DEBUG:boto:Token: None 2024-04-16T18:18:09.733 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.733 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v9Wh0oU6ka1EDsRpPeRYLhWE9S8= 2024-04-16T18:18:09.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v9Wh0oU6ka1EDsRpPeRYLhWE9S8=', 'Content-Length': '0'} 2024-04-16T18:18:09.735 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ff34079b65180e0-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.778 DEBUG:boto:path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.779 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.779 DEBUG:boto:Method: GET 2024-04-16T18:18:09.779 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.779 DEBUG:boto:Data: 2024-04-16T18:18:09.779 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.779 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.779 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.779 DEBUG:boto:Params: {} 2024-04-16T18:18:09.779 DEBUG:boto:Token: None 2024-04-16T18:18:09.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000025 2024-04-16T18:18:09.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v9Wh0oU6ka1EDsRpPeRYLhWE9S8= 2024-04-16T18:18:09.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v9Wh0oU6ka1EDsRpPeRYLhWE9S8=', 'Content-Length': '0'} 2024-04-16T18:18:09.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077d2108da1333632-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.782 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.782 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.782 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.782 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.782 DEBUG:boto:Method: GET 2024-04-16T18:18:09.783 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.783 DEBUG:boto:Data: 2024-04-16T18:18:09.783 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.783 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.783 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.783 DEBUG:boto:Params: {} 2024-04-16T18:18:09.783 DEBUG:boto:Token: None 2024-04-16T18:18:09.783 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.783 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.786 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058402bd0d8f9fe88-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.786 DEBUG:boto:b'cjqttm-51obj000000000000000000251000falseobj000000000000000000252024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.786 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.786 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.786 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.786 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.787 DEBUG:boto:Method: GET 2024-04-16T18:18:09.787 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000025 2024-04-16T18:18:09.787 DEBUG:boto:Data: 2024-04-16T18:18:09.787 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.787 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.787 DEBUG:boto:Params: {} 2024-04-16T18:18:09.787 DEBUG:boto:Token: None 2024-04-16T18:18:09.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.791 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000210f498de10f509b-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.791 DEBUG:boto:b'cjqttm-51obj000000000000000000251000falseobj000000000000000000252024-04-16T18:17:57.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.791 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2024-04-16T18:18:09.791 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.792 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.792 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.792 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.792 DEBUG:boto:Method: GET 2024-04-16T18:18:09.792 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.792 DEBUG:boto:Data: 2024-04-16T18:18:09.792 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.792 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.792 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.792 DEBUG:boto:Params: {} 2024-04-16T18:18:09.792 DEBUG:boto:Token: None 2024-04-16T18:18:09.793 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.793 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I= 2024-04-16T18:18:09.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I=', 'Content-Length': '0'} 2024-04-16T18:18:09.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057a2c2ce1ebd1a08-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.838 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.838 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.838 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.839 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.839 DEBUG:boto:Method: GET 2024-04-16T18:18:09.839 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.839 DEBUG:boto:Data: 2024-04-16T18:18:09.839 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.839 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.839 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.839 DEBUG:boto:Params: {} 2024-04-16T18:18:09.839 DEBUG:boto:Token: None 2024-04-16T18:18:09.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I= 2024-04-16T18:18:09.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I=', 'Content-Length': '0'} 2024-04-16T18:18:09.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e2361a3b13133e9-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.841 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.842 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.842 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.842 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.842 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.842 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.842 DEBUG:boto:Data: 2024-04-16T18:18:09.842 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.842 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.842 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.842 DEBUG:boto:Params: {} 2024-04-16T18:18:09.843 DEBUG:boto:Token: None 2024-04-16T18:18:09.843 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XAJYjM5qcKev7RPyK8X3t5N4Ik4= 2024-04-16T18:18:09.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XAJYjM5qcKev7RPyK8X3t5N4Ik4=', 'Content-Length': '0'} 2024-04-16T18:18:09.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ed1430b9dccf724-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.845 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.845 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.846 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.846 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.846 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.846 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.846 DEBUG:boto:Data: 2024-04-16T18:18:09.846 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.846 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.846 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.846 DEBUG:boto:Params: {} 2024-04-16T18:18:09.846 DEBUG:boto:Token: None 2024-04-16T18:18:09.846 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XAJYjM5qcKev7RPyK8X3t5N4Ik4= 2024-04-16T18:18:09.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XAJYjM5qcKev7RPyK8X3t5N4Ik4=', 'Content-Length': '0'} 2024-04-16T18:18:09.848 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009094a9115d7f3367-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.849 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2024-04-16T18:18:09.849 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.849 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.849 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.849 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.849 DEBUG:boto:Method: GET 2024-04-16T18:18:09.849 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.849 DEBUG:boto:Data: 2024-04-16T18:18:09.849 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.849 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.850 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.850 DEBUG:boto:Params: {} 2024-04-16T18:18:09.850 DEBUG:boto:Token: None 2024-04-16T18:18:09.850 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.850 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I= 2024-04-16T18:18:09.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I=', 'Content-Length': '0'} 2024-04-16T18:18:09.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051248f76a9fc7594-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.894 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.894 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.895 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.895 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.895 DEBUG:boto:Method: GET 2024-04-16T18:18:09.895 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.895 DEBUG:boto:Data: 2024-04-16T18:18:09.895 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.895 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.895 DEBUG:boto:Params: {} 2024-04-16T18:18:09.896 DEBUG:boto:Token: None 2024-04-16T18:18:09.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026?versionId=null 2024-04-16T18:18:09.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I= 2024-04-16T18:18:09.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4TzvQ4LZBMzpaMQWwA5B/Q8Fo8I=', 'Content-Length': '0'} 2024-04-16T18:18:09.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f891b9546bfdbb6-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.899 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.899 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.899 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.899 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.899 DEBUG:boto:Method: GET 2024-04-16T18:18:09.899 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.899 DEBUG:boto:Data: 2024-04-16T18:18:09.900 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.900 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.900 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.900 DEBUG:boto:Params: {} 2024-04-16T18:18:09.900 DEBUG:boto:Token: None 2024-04-16T18:18:09.900 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.903 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086b5c911f672aaec-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.903 DEBUG:boto:b'cjqttm-51obj000000000000000000261000falseobj000000000000000000262024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.903 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.904 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.904 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.904 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.904 DEBUG:boto:Method: GET 2024-04-16T18:18:09.904 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.904 DEBUG:boto:Data: 2024-04-16T18:18:09.904 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.904 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.904 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.904 DEBUG:boto:Params: {} 2024-04-16T18:18:09.904 DEBUG:boto:Token: None 2024-04-16T18:18:09.905 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.905 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.908 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096c00d9fda7f366c-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.909 DEBUG:boto:b'cjqttm-51obj000000000000000000261000falseobj000000000000000000262024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:09.909 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.909 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.909 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.909 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.909 DEBUG:boto:Data: 2024-04-16T18:18:09.909 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.909 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.910 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.910 DEBUG:boto:Params: {} 2024-04-16T18:18:09.910 DEBUG:boto:Token: None 2024-04-16T18:18:09.910 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.910 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IFj8fiD9sxIC+RR7mY8HwHRao8c= 2024-04-16T18:18:09.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IFj8fiD9sxIC+RR7mY8HwHRao8c=', 'Content-Length': '0'} 2024-04-16T18:18:09.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bee946ed0ebcda2b-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.912 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.912 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.912 DEBUG:boto:Method: HEAD 2024-04-16T18:18:09.912 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.912 DEBUG:boto:Data: 2024-04-16T18:18:09.913 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.913 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.913 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.913 DEBUG:boto:Params: {} 2024-04-16T18:18:09.913 DEBUG:boto:Token: None 2024-04-16T18:18:09.913 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.913 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IFj8fiD9sxIC+RR7mY8HwHRao8c= 2024-04-16T18:18:09.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IFj8fiD9sxIC+RR7mY8HwHRao8c=', 'Content-Length': '0'} 2024-04-16T18:18:09.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1eb70ce68cb0ae1-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000026 2024-04-16T18:18:09.915 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.916 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.916 DEBUG:boto:Method: GET 2024-04-16T18:18:09.916 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.916 DEBUG:boto:Data: 2024-04-16T18:18:09.916 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.916 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.916 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.916 DEBUG:boto:Params: {} 2024-04-16T18:18:09.916 DEBUG:boto:Token: None 2024-04-16T18:18:09.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WB6YU8eCGbg8XAw1UDsLwJR+Z0U= 2024-04-16T18:18:09.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WB6YU8eCGbg8XAw1UDsLwJR+Z0U=', 'Content-Length': '0'} 2024-04-16T18:18:09.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047d7e6723f56433d-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.962 DEBUG:boto:path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.962 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.963 DEBUG:boto:Method: GET 2024-04-16T18:18:09.963 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.963 DEBUG:boto:Data: 2024-04-16T18:18:09.963 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.963 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:09.963 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.963 DEBUG:boto:Params: {} 2024-04-16T18:18:09.963 DEBUG:boto:Token: None 2024-04-16T18:18:09.963 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/obj00000000000000000026 2024-04-16T18:18:09.963 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WB6YU8eCGbg8XAw1UDsLwJR+Z0U= 2024-04-16T18:18:09.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WB6YU8eCGbg8XAw1UDsLwJR+Z0U=', 'Content-Length': '0'} 2024-04-16T18:18:09.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041f299c7b4d2d468-00661ec0e1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:09.966 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:09.966 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:09.966 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.966 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.966 DEBUG:boto:Method: GET 2024-04-16T18:18:09.966 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:09.966 DEBUG:boto:Data: 2024-04-16T18:18:09.966 DEBUG:boto:Headers: {} 2024-04-16T18:18:09.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:09.967 DEBUG:boto:Port: 8000 2024-04-16T18:18:09.967 DEBUG:boto:Params: {} 2024-04-16T18:18:09.967 DEBUG:boto:Token: None 2024-04-16T18:18:09.967 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:09 GMT /cjqttm-51/ 2024-04-16T18:18:09.967 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk= 2024-04-16T18:18:09.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o41MgEYI0jLXCpk7EUvinc2iAjk=', 'Content-Length': '0'} 2024-04-16T18:18:09.969 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c5ad78d6e90789b-00661ec0e1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.010 DEBUG:boto:b'cjqttm-51obj000000000000000000261000falseobj000000000000000000262024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.011 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.011 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.011 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:10.011 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:10.011 DEBUG:boto:Method: GET 2024-04-16T18:18:10.011 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000026 2024-04-16T18:18:10.011 DEBUG:boto:Data: 2024-04-16T18:18:10.011 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.011 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.011 DEBUG:boto:Params: {} 2024-04-16T18:18:10.012 DEBUG:boto:Token: None 2024-04-16T18:18:10.012 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.016 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ea8748770545cf2-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.016 DEBUG:boto:b'cjqttm-51obj000000000000000000261000falseobj000000000000000000262024-04-16T18:17:59.820Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.016 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2024-04-16T18:18:10.016 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.016 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.016 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.017 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.017 DEBUG:boto:Method: GET 2024-04-16T18:18:10.017 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.017 DEBUG:boto:Data: 2024-04-16T18:18:10.017 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.017 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.017 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.017 DEBUG:boto:Params: {} 2024-04-16T18:18:10.017 DEBUG:boto:Token: None 2024-04-16T18:18:10.017 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.018 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY= 2024-04-16T18:18:10.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY=', 'Content-Length': '0'} 2024-04-16T18:18:10.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1dd2698f4b0eb64-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.062 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.062 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.063 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.063 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.063 DEBUG:boto:Method: GET 2024-04-16T18:18:10.063 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.063 DEBUG:boto:Data: 2024-04-16T18:18:10.063 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.063 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.063 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.063 DEBUG:boto:Params: {} 2024-04-16T18:18:10.063 DEBUG:boto:Token: None 2024-04-16T18:18:10.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY= 2024-04-16T18:18:10.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY=', 'Content-Length': '0'} 2024-04-16T18:18:10.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081f342888b5f65cb-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.066 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.066 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.066 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.066 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.066 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.066 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.067 DEBUG:boto:Data: 2024-04-16T18:18:10.067 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.067 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.067 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.067 DEBUG:boto:Params: {} 2024-04-16T18:18:10.067 DEBUG:boto:Token: None 2024-04-16T18:18:10.067 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m8O0Cz0knoLRhNe07N1UrcFj9qQ= 2024-04-16T18:18:10.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m8O0Cz0knoLRhNe07N1UrcFj9qQ=', 'Content-Length': '0'} 2024-04-16T18:18:10.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040416485095865f3-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.069 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.069 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.070 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.070 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.070 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.070 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.070 DEBUG:boto:Data: 2024-04-16T18:18:10.070 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.070 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.070 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.070 DEBUG:boto:Params: {} 2024-04-16T18:18:10.070 DEBUG:boto:Token: None 2024-04-16T18:18:10.071 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m8O0Cz0knoLRhNe07N1UrcFj9qQ= 2024-04-16T18:18:10.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m8O0Cz0knoLRhNe07N1UrcFj9qQ=', 'Content-Length': '0'} 2024-04-16T18:18:10.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000467d10ce5fc19471-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2024-04-16T18:18:10.073 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.073 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.073 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.073 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.074 DEBUG:boto:Method: GET 2024-04-16T18:18:10.074 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.074 DEBUG:boto:Data: 2024-04-16T18:18:10.074 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.074 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.074 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.074 DEBUG:boto:Params: {} 2024-04-16T18:18:10.074 DEBUG:boto:Token: None 2024-04-16T18:18:10.074 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY= 2024-04-16T18:18:10.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY=', 'Content-Length': '0'} 2024-04-16T18:18:10.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bd1f5dffb851e1f-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.118 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.118 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.119 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.119 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.119 DEBUG:boto:Method: GET 2024-04-16T18:18:10.119 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.119 DEBUG:boto:Data: 2024-04-16T18:18:10.119 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.119 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.119 DEBUG:boto:Params: {} 2024-04-16T18:18:10.119 DEBUG:boto:Token: None 2024-04-16T18:18:10.119 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027?versionId=null 2024-04-16T18:18:10.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY= 2024-04-16T18:18:10.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GlgDNsMqdoUHBJG2MZ+PrDapwQY=', 'Content-Length': '0'} 2024-04-16T18:18:10.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d3f28a2660e9ec6-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.122 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.122 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.122 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.122 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.123 DEBUG:boto:Method: GET 2024-04-16T18:18:10.123 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.123 DEBUG:boto:Data: 2024-04-16T18:18:10.123 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.123 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.123 DEBUG:boto:Params: {} 2024-04-16T18:18:10.123 DEBUG:boto:Token: None 2024-04-16T18:18:10.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.126 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000232b53ccd66885fb-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.166 DEBUG:boto:b'cjqttm-51obj000000000000000000271000falseobj000000000000000000272024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.167 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.167 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.167 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.167 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.167 DEBUG:boto:Method: GET 2024-04-16T18:18:10.167 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.167 DEBUG:boto:Data: 2024-04-16T18:18:10.167 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.168 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.168 DEBUG:boto:Params: {} 2024-04-16T18:18:10.168 DEBUG:boto:Token: None 2024-04-16T18:18:10.168 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.172 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002461a08879623f0-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.172 DEBUG:boto:b'cjqttm-51obj000000000000000000271000falseobj000000000000000000272024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.173 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.173 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.173 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.173 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.173 DEBUG:boto:Data: 2024-04-16T18:18:10.173 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.173 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.173 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.173 DEBUG:boto:Params: {} 2024-04-16T18:18:10.173 DEBUG:boto:Token: None 2024-04-16T18:18:10.174 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.174 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WRjfx6lwQ+3n85OVcRH1cEPL1kI= 2024-04-16T18:18:10.174 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WRjfx6lwQ+3n85OVcRH1cEPL1kI=', 'Content-Length': '0'} 2024-04-16T18:18:10.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000053518bf2d032b33-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.176 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.176 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.176 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.176 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.176 DEBUG:boto:Data: 2024-04-16T18:18:10.177 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.177 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.177 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.177 DEBUG:boto:Params: {} 2024-04-16T18:18:10.177 DEBUG:boto:Token: None 2024-04-16T18:18:10.177 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.177 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WRjfx6lwQ+3n85OVcRH1cEPL1kI= 2024-04-16T18:18:10.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WRjfx6lwQ+3n85OVcRH1cEPL1kI=', 'Content-Length': '0'} 2024-04-16T18:18:10.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072fb0f15354c1ae6-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000027 2024-04-16T18:18:10.179 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.179 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.180 DEBUG:boto:Method: GET 2024-04-16T18:18:10.180 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.180 DEBUG:boto:Data: 2024-04-16T18:18:10.180 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.180 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.180 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.180 DEBUG:boto:Params: {} 2024-04-16T18:18:10.180 DEBUG:boto:Token: None 2024-04-16T18:18:10.180 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aXephWhrLqYufQk/RnhSKqHnT5g= 2024-04-16T18:18:10.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aXephWhrLqYufQk/RnhSKqHnT5g=', 'Content-Length': '0'} 2024-04-16T18:18:10.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a147693a297fcb62-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.226 DEBUG:boto:path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.226 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.227 DEBUG:boto:Method: GET 2024-04-16T18:18:10.227 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.227 DEBUG:boto:Data: 2024-04-16T18:18:10.227 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.227 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.227 DEBUG:boto:Params: {} 2024-04-16T18:18:10.227 DEBUG:boto:Token: None 2024-04-16T18:18:10.227 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000027 2024-04-16T18:18:10.227 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aXephWhrLqYufQk/RnhSKqHnT5g= 2024-04-16T18:18:10.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aXephWhrLqYufQk/RnhSKqHnT5g=', 'Content-Length': '0'} 2024-04-16T18:18:10.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000190e7610a4992f44-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.230 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.230 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.230 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.230 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.230 DEBUG:boto:Method: GET 2024-04-16T18:18:10.230 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.230 DEBUG:boto:Data: 2024-04-16T18:18:10.230 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.230 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.230 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.230 DEBUG:boto:Params: {} 2024-04-16T18:18:10.231 DEBUG:boto:Token: None 2024-04-16T18:18:10.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.233 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000434caa72af632839-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.233 DEBUG:boto:b'cjqttm-51obj000000000000000000271000falseobj000000000000000000272024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.234 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.234 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.234 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.234 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.234 DEBUG:boto:Method: GET 2024-04-16T18:18:10.234 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000027 2024-04-16T18:18:10.234 DEBUG:boto:Data: 2024-04-16T18:18:10.234 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.234 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.235 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.235 DEBUG:boto:Params: {} 2024-04-16T18:18:10.235 DEBUG:boto:Token: None 2024-04-16T18:18:10.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.239 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0120cc981c58020-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.239 DEBUG:boto:b'cjqttm-51obj000000000000000000271000falseobj000000000000000000272024-04-16T18:17:59.694Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000028 2024-04-16T18:18:10.239 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.240 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.240 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.240 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.240 DEBUG:boto:Method: GET 2024-04-16T18:18:10.240 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.240 DEBUG:boto:Data: 2024-04-16T18:18:10.240 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.240 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.240 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.240 DEBUG:boto:Params: {} 2024-04-16T18:18:10.240 DEBUG:boto:Token: None 2024-04-16T18:18:10.241 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.241 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8= 2024-04-16T18:18:10.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8=', 'Content-Length': '0'} 2024-04-16T18:18:10.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011c54e0119f3632a-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.286 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.287 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.287 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.287 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.287 DEBUG:boto:Method: GET 2024-04-16T18:18:10.287 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.287 DEBUG:boto:Data: 2024-04-16T18:18:10.287 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.288 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.288 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.288 DEBUG:boto:Params: {} 2024-04-16T18:18:10.288 DEBUG:boto:Token: None 2024-04-16T18:18:10.288 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8= 2024-04-16T18:18:10.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8=', 'Content-Length': '0'} 2024-04-16T18:18:10.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046dbc751f287e2fb-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.290 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.290 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.290 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.291 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.291 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.291 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.291 DEBUG:boto:Data: 2024-04-16T18:18:10.291 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.291 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.291 DEBUG:boto:Params: {} 2024-04-16T18:18:10.291 DEBUG:boto:Token: None 2024-04-16T18:18:10.292 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w5J12zJt1yOLxACkV2fZLj2Cmio= 2024-04-16T18:18:10.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w5J12zJt1yOLxACkV2fZLj2Cmio=', 'Content-Length': '0'} 2024-04-16T18:18:10.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ddc45d539687e6f-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.294 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.294 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.294 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.294 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.294 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.294 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.294 DEBUG:boto:Data: 2024-04-16T18:18:10.294 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.295 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.295 DEBUG:boto:Params: {} 2024-04-16T18:18:10.295 DEBUG:boto:Token: None 2024-04-16T18:18:10.295 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w5J12zJt1yOLxACkV2fZLj2Cmio= 2024-04-16T18:18:10.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w5J12zJt1yOLxACkV2fZLj2Cmio=', 'Content-Length': '0'} 2024-04-16T18:18:10.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006165964a2346fb89-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000028 2024-04-16T18:18:10.297 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.297 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.298 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.298 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.298 DEBUG:boto:Method: GET 2024-04-16T18:18:10.298 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.298 DEBUG:boto:Data: 2024-04-16T18:18:10.298 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.298 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.298 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.298 DEBUG:boto:Params: {} 2024-04-16T18:18:10.298 DEBUG:boto:Token: None 2024-04-16T18:18:10.298 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8= 2024-04-16T18:18:10.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8=', 'Content-Length': '0'} 2024-04-16T18:18:10.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e62b066e8cbe25ab-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.342 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.342 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.343 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.343 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.343 DEBUG:boto:Method: GET 2024-04-16T18:18:10.343 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.343 DEBUG:boto:Data: 2024-04-16T18:18:10.343 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.343 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.343 DEBUG:boto:Params: {} 2024-04-16T18:18:10.343 DEBUG:boto:Token: None 2024-04-16T18:18:10.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028?versionId=null 2024-04-16T18:18:10.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8= 2024-04-16T18:18:10.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vbPnvW3kRK8W5SxR8BYrDn5paY8=', 'Content-Length': '0'} 2024-04-16T18:18:10.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096b5edfa2960600b-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.346 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.346 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.346 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.346 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.346 DEBUG:boto:Method: GET 2024-04-16T18:18:10.346 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.346 DEBUG:boto:Data: 2024-04-16T18:18:10.346 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.347 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.347 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.347 DEBUG:boto:Params: {} 2024-04-16T18:18:10.347 DEBUG:boto:Token: None 2024-04-16T18:18:10.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008566d7f5303f2032-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.349 DEBUG:boto:b'cjqttm-51obj000000000000000000281000falseobj000000000000000000282024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.350 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.350 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.350 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.350 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.350 DEBUG:boto:Method: GET 2024-04-16T18:18:10.350 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.350 DEBUG:boto:Data: 2024-04-16T18:18:10.350 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.350 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.350 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.351 DEBUG:boto:Params: {} 2024-04-16T18:18:10.351 DEBUG:boto:Token: None 2024-04-16T18:18:10.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.355 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c20cdc64aca2882-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.355 DEBUG:boto:b'cjqttm-51obj000000000000000000281000falseobj000000000000000000282024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.355 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.355 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.355 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.355 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.355 DEBUG:boto:Data: 2024-04-16T18:18:10.355 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.356 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.356 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.356 DEBUG:boto:Params: {} 2024-04-16T18:18:10.356 DEBUG:boto:Token: None 2024-04-16T18:18:10.356 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jS1J3fNKP+1yCEvNc+nyYUDSWfY= 2024-04-16T18:18:10.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jS1J3fNKP+1yCEvNc+nyYUDSWfY=', 'Content-Length': '0'} 2024-04-16T18:18:10.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7dc2f7ef1f71534-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.358 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.358 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.358 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.359 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.359 DEBUG:boto:Data: 2024-04-16T18:18:10.359 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.359 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.359 DEBUG:boto:Params: {} 2024-04-16T18:18:10.359 DEBUG:boto:Token: None 2024-04-16T18:18:10.359 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jS1J3fNKP+1yCEvNc+nyYUDSWfY= 2024-04-16T18:18:10.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jS1J3fNKP+1yCEvNc+nyYUDSWfY=', 'Content-Length': '0'} 2024-04-16T18:18:10.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f6d1dc74bc90a3c-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000028 2024-04-16T18:18:10.361 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.362 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.362 DEBUG:boto:Method: GET 2024-04-16T18:18:10.362 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.362 DEBUG:boto:Data: 2024-04-16T18:18:10.362 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.362 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.362 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.362 DEBUG:boto:Params: {} 2024-04-16T18:18:10.362 DEBUG:boto:Token: None 2024-04-16T18:18:10.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:obwZw1znSU9oE8M8Ncie7w9soTQ= 2024-04-16T18:18:10.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:obwZw1znSU9oE8M8Ncie7w9soTQ=', 'Content-Length': '0'} 2024-04-16T18:18:10.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008deb26845ab14cea-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.406 DEBUG:boto:path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.406 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.407 DEBUG:boto:Method: GET 2024-04-16T18:18:10.407 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.407 DEBUG:boto:Data: 2024-04-16T18:18:10.407 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.407 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.407 DEBUG:boto:Params: {} 2024-04-16T18:18:10.407 DEBUG:boto:Token: None 2024-04-16T18:18:10.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000028 2024-04-16T18:18:10.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:obwZw1znSU9oE8M8Ncie7w9soTQ= 2024-04-16T18:18:10.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:obwZw1znSU9oE8M8Ncie7w9soTQ=', 'Content-Length': '0'} 2024-04-16T18:18:10.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:54 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003be24bd21c376312-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.409 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.409 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.410 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.410 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.410 DEBUG:boto:Method: GET 2024-04-16T18:18:10.410 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.410 DEBUG:boto:Data: 2024-04-16T18:18:10.411 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.411 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.411 DEBUG:boto:Params: {} 2024-04-16T18:18:10.411 DEBUG:boto:Token: None 2024-04-16T18:18:10.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000368c3d7187fb928e-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.414 DEBUG:boto:b'cjqttm-51obj000000000000000000281000falseobj000000000000000000282024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.414 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.414 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.414 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.415 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.415 DEBUG:boto:Method: GET 2024-04-16T18:18:10.415 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000028 2024-04-16T18:18:10.415 DEBUG:boto:Data: 2024-04-16T18:18:10.415 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.415 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.415 DEBUG:boto:Params: {} 2024-04-16T18:18:10.415 DEBUG:boto:Token: None 2024-04-16T18:18:10.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.419 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e453c4b65de3baf2-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.419 DEBUG:boto:b'cjqttm-51obj000000000000000000281000falseobj000000000000000000282024-04-16T18:17:54.855Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.419 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2024-04-16T18:18:10.420 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.420 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.420 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.420 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.420 DEBUG:boto:Method: GET 2024-04-16T18:18:10.420 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.420 DEBUG:boto:Data: 2024-04-16T18:18:10.420 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.420 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.421 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.421 DEBUG:boto:Params: {} 2024-04-16T18:18:10.421 DEBUG:boto:Token: None 2024-04-16T18:18:10.421 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.421 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE= 2024-04-16T18:18:10.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE=', 'Content-Length': '0'} 2024-04-16T18:18:10.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f37f8416a39122b-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.466 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.466 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.467 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.467 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.467 DEBUG:boto:Method: GET 2024-04-16T18:18:10.467 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.467 DEBUG:boto:Data: 2024-04-16T18:18:10.467 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.467 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.467 DEBUG:boto:Params: {} 2024-04-16T18:18:10.467 DEBUG:boto:Token: None 2024-04-16T18:18:10.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE= 2024-04-16T18:18:10.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE=', 'Content-Length': '0'} 2024-04-16T18:18:10.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a521d8148d5da9ff-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.470 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.470 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.470 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.470 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.470 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.470 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.471 DEBUG:boto:Data: 2024-04-16T18:18:10.471 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.471 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.471 DEBUG:boto:Params: {} 2024-04-16T18:18:10.471 DEBUG:boto:Token: None 2024-04-16T18:18:10.471 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NObPYWqMTvUC24d1ECFK86MjxSI= 2024-04-16T18:18:10.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NObPYWqMTvUC24d1ECFK86MjxSI=', 'Content-Length': '0'} 2024-04-16T18:18:10.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a858ffa43498d3c-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.473 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.473 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.473 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.474 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.474 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.474 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.474 DEBUG:boto:Data: 2024-04-16T18:18:10.474 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.474 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.474 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.474 DEBUG:boto:Params: {} 2024-04-16T18:18:10.474 DEBUG:boto:Token: None 2024-04-16T18:18:10.474 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NObPYWqMTvUC24d1ECFK86MjxSI= 2024-04-16T18:18:10.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NObPYWqMTvUC24d1ECFK86MjxSI=', 'Content-Length': '0'} 2024-04-16T18:18:10.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000982879c1b203dfb2-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2024-04-16T18:18:10.477 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.477 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.477 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.477 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.477 DEBUG:boto:Method: GET 2024-04-16T18:18:10.477 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.477 DEBUG:boto:Data: 2024-04-16T18:18:10.477 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.477 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.478 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.478 DEBUG:boto:Params: {} 2024-04-16T18:18:10.478 DEBUG:boto:Token: None 2024-04-16T18:18:10.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE= 2024-04-16T18:18:10.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE=', 'Content-Length': '0'} 2024-04-16T18:18:10.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030ee930c3a365af4-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.522 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.522 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.523 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.523 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.523 DEBUG:boto:Method: GET 2024-04-16T18:18:10.523 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.523 DEBUG:boto:Data: 2024-04-16T18:18:10.523 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.523 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.523 DEBUG:boto:Params: {} 2024-04-16T18:18:10.523 DEBUG:boto:Token: None 2024-04-16T18:18:10.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029?versionId=null 2024-04-16T18:18:10.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE= 2024-04-16T18:18:10.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JhYMEQff8rhSNng4f/l3+jD5vkE=', 'Content-Length': '0'} 2024-04-16T18:18:10.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d5fb0a1f50c549b-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.526 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.526 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.526 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.526 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.526 DEBUG:boto:Method: GET 2024-04-16T18:18:10.526 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.526 DEBUG:boto:Data: 2024-04-16T18:18:10.526 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.527 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.527 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.527 DEBUG:boto:Params: {} 2024-04-16T18:18:10.527 DEBUG:boto:Token: None 2024-04-16T18:18:10.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c509040e91d61ab-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.530 DEBUG:boto:b'cjqttm-51obj000000000000000000291000falseobj000000000000000000292024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.530 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.530 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.530 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.530 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.530 DEBUG:boto:Method: GET 2024-04-16T18:18:10.530 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.530 DEBUG:boto:Data: 2024-04-16T18:18:10.530 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.531 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.531 DEBUG:boto:Params: {} 2024-04-16T18:18:10.531 DEBUG:boto:Token: None 2024-04-16T18:18:10.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000816b1f1fb9e66de5-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.535 DEBUG:boto:b'cjqttm-51obj000000000000000000291000falseobj000000000000000000292024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.535 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.535 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.536 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.536 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.536 DEBUG:boto:Data: 2024-04-16T18:18:10.536 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.536 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.536 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.536 DEBUG:boto:Params: {} 2024-04-16T18:18:10.536 DEBUG:boto:Token: None 2024-04-16T18:18:10.536 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mGG7EOv3G3r4x4f3vk6AvtdtWPs= 2024-04-16T18:18:10.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mGG7EOv3G3r4x4f3vk6AvtdtWPs=', 'Content-Length': '0'} 2024-04-16T18:18:10.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d21fd4fe87353516-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.538 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.538 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.539 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.539 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.539 DEBUG:boto:Data: 2024-04-16T18:18:10.539 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.539 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.539 DEBUG:boto:Params: {} 2024-04-16T18:18:10.539 DEBUG:boto:Token: None 2024-04-16T18:18:10.539 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mGG7EOv3G3r4x4f3vk6AvtdtWPs= 2024-04-16T18:18:10.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mGG7EOv3G3r4x4f3vk6AvtdtWPs=', 'Content-Length': '0'} 2024-04-16T18:18:10.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033e9ad211524a715-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000029 2024-04-16T18:18:10.542 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.542 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.542 DEBUG:boto:Method: GET 2024-04-16T18:18:10.543 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.543 DEBUG:boto:Data: 2024-04-16T18:18:10.543 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.543 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.543 DEBUG:boto:Params: {} 2024-04-16T18:18:10.543 DEBUG:boto:Token: None 2024-04-16T18:18:10.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ZPP692L5mOHJ8WS2sFo5hmVYBg= 2024-04-16T18:18:10.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ZPP692L5mOHJ8WS2sFo5hmVYBg=', 'Content-Length': '0'} 2024-04-16T18:18:10.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b98995378923540b-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.586 DEBUG:boto:path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.586 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.587 DEBUG:boto:Method: GET 2024-04-16T18:18:10.587 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.587 DEBUG:boto:Data: 2024-04-16T18:18:10.587 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.587 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.587 DEBUG:boto:Params: {} 2024-04-16T18:18:10.587 DEBUG:boto:Token: None 2024-04-16T18:18:10.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000029 2024-04-16T18:18:10.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ZPP692L5mOHJ8WS2sFo5hmVYBg= 2024-04-16T18:18:10.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ZPP692L5mOHJ8WS2sFo5hmVYBg=', 'Content-Length': '0'} 2024-04-16T18:18:10.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd4fd2bc11ec2f5d-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.590 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.590 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.590 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.590 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.590 DEBUG:boto:Method: GET 2024-04-16T18:18:10.590 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.590 DEBUG:boto:Data: 2024-04-16T18:18:10.590 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.590 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.590 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.590 DEBUG:boto:Params: {} 2024-04-16T18:18:10.591 DEBUG:boto:Token: None 2024-04-16T18:18:10.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.593 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000680fe54d36f0623d-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.594 DEBUG:boto:b'cjqttm-51obj000000000000000000291000falseobj000000000000000000292024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.594 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.594 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.594 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.594 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.594 DEBUG:boto:Method: GET 2024-04-16T18:18:10.594 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000029 2024-04-16T18:18:10.594 DEBUG:boto:Data: 2024-04-16T18:18:10.595 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.595 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.595 DEBUG:boto:Params: {} 2024-04-16T18:18:10.595 DEBUG:boto:Token: None 2024-04-16T18:18:10.595 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.599 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eeddc7640927960e-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.599 DEBUG:boto:b'cjqttm-51obj000000000000000000291000falseobj000000000000000000292024-04-16T18:17:58.194Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2024-04-16T18:18:10.600 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.600 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.600 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.600 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.600 DEBUG:boto:Method: GET 2024-04-16T18:18:10.600 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.600 DEBUG:boto:Data: 2024-04-16T18:18:10.600 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.600 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.601 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.601 DEBUG:boto:Params: {} 2024-04-16T18:18:10.601 DEBUG:boto:Token: None 2024-04-16T18:18:10.601 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.601 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI= 2024-04-16T18:18:10.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI=', 'Content-Length': '0'} 2024-04-16T18:18:10.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026b2f416c2a2bcfe-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.646 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.647 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.647 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.647 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.647 DEBUG:boto:Method: GET 2024-04-16T18:18:10.647 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.647 DEBUG:boto:Data: 2024-04-16T18:18:10.647 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.647 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.647 DEBUG:boto:Params: {} 2024-04-16T18:18:10.647 DEBUG:boto:Token: None 2024-04-16T18:18:10.648 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI= 2024-04-16T18:18:10.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI=', 'Content-Length': '0'} 2024-04-16T18:18:10.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b3f7607d9be93e9-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.650 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.650 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.650 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.650 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.651 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.651 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.651 DEBUG:boto:Data: 2024-04-16T18:18:10.651 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.651 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.651 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.651 DEBUG:boto:Params: {} 2024-04-16T18:18:10.651 DEBUG:boto:Token: None 2024-04-16T18:18:10.652 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DRyHP/LkOOt3Zd/R+T5Z0VPaR0k= 2024-04-16T18:18:10.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DRyHP/LkOOt3Zd/R+T5Z0VPaR0k=', 'Content-Length': '0'} 2024-04-16T18:18:10.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd7790bb13a2ea4c-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.654 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.654 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.654 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.654 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.654 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.654 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.655 DEBUG:boto:Data: 2024-04-16T18:18:10.655 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.655 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.655 DEBUG:boto:Params: {} 2024-04-16T18:18:10.655 DEBUG:boto:Token: None 2024-04-16T18:18:10.655 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DRyHP/LkOOt3Zd/R+T5Z0VPaR0k= 2024-04-16T18:18:10.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DRyHP/LkOOt3Zd/R+T5Z0VPaR0k=', 'Content-Length': '0'} 2024-04-16T18:18:10.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c884a6afd7aa2d8-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.657 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2024-04-16T18:18:10.657 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.657 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.658 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.658 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.658 DEBUG:boto:Method: GET 2024-04-16T18:18:10.658 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.658 DEBUG:boto:Data: 2024-04-16T18:18:10.658 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.658 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.658 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.658 DEBUG:boto:Params: {} 2024-04-16T18:18:10.658 DEBUG:boto:Token: None 2024-04-16T18:18:10.658 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI= 2024-04-16T18:18:10.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI=', 'Content-Length': '0'} 2024-04-16T18:18:10.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030671dea421e5a3b-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.702 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.702 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.703 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.703 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.703 DEBUG:boto:Method: GET 2024-04-16T18:18:10.703 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.703 DEBUG:boto:Data: 2024-04-16T18:18:10.703 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.703 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.703 DEBUG:boto:Params: {} 2024-04-16T18:18:10.703 DEBUG:boto:Token: None 2024-04-16T18:18:10.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030?versionId=null 2024-04-16T18:18:10.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI= 2024-04-16T18:18:10.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LVsKraHWh2+tsXhx3+c2Ry2+DRI=', 'Content-Length': '0'} 2024-04-16T18:18:10.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc47894d87f32737-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.706 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.706 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.706 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.706 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.706 DEBUG:boto:Method: GET 2024-04-16T18:18:10.707 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.707 DEBUG:boto:Data: 2024-04-16T18:18:10.707 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.707 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.707 DEBUG:boto:Params: {} 2024-04-16T18:18:10.707 DEBUG:boto:Token: None 2024-04-16T18:18:10.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d643fd973a6f4090-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.710 DEBUG:boto:b'cjqttm-51obj000000000000000000301000falseobj000000000000000000302024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.711 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.711 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.711 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.711 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.711 DEBUG:boto:Method: GET 2024-04-16T18:18:10.711 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.711 DEBUG:boto:Data: 2024-04-16T18:18:10.711 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.711 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.711 DEBUG:boto:Params: {} 2024-04-16T18:18:10.712 DEBUG:boto:Token: None 2024-04-16T18:18:10.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.716 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ec3ef15e7fc2209-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.716 DEBUG:boto:b'cjqttm-51obj000000000000000000301000falseobj000000000000000000302024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.716 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.716 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.716 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.717 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.717 DEBUG:boto:Data: 2024-04-16T18:18:10.717 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.717 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.717 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.717 DEBUG:boto:Params: {} 2024-04-16T18:18:10.717 DEBUG:boto:Token: None 2024-04-16T18:18:10.717 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.717 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wc5CKH1vUA6/lTvGDT/UlI+ZA1w= 2024-04-16T18:18:10.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wc5CKH1vUA6/lTvGDT/UlI+ZA1w=', 'Content-Length': '0'} 2024-04-16T18:18:10.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc83ad411fbc0c1d-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.719 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.720 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.720 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.720 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.720 DEBUG:boto:Data: 2024-04-16T18:18:10.720 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.720 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.720 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.720 DEBUG:boto:Params: {} 2024-04-16T18:18:10.720 DEBUG:boto:Token: None 2024-04-16T18:18:10.720 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wc5CKH1vUA6/lTvGDT/UlI+ZA1w= 2024-04-16T18:18:10.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wc5CKH1vUA6/lTvGDT/UlI+ZA1w=', 'Content-Length': '0'} 2024-04-16T18:18:10.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd4ac55b9a9e4203-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.722 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000030 2024-04-16T18:18:10.723 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.723 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.723 DEBUG:boto:Method: GET 2024-04-16T18:18:10.723 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.723 DEBUG:boto:Data: 2024-04-16T18:18:10.723 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.723 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.723 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.723 DEBUG:boto:Params: {} 2024-04-16T18:18:10.723 DEBUG:boto:Token: None 2024-04-16T18:18:10.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3iuPq3qXRPBlZ7ljbj7aIAW0l3o= 2024-04-16T18:18:10.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3iuPq3qXRPBlZ7ljbj7aIAW0l3o=', 'Content-Length': '0'} 2024-04-16T18:18:10.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000528fabe9e281caec-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.766 DEBUG:boto:path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.766 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.767 DEBUG:boto:Method: GET 2024-04-16T18:18:10.767 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.767 DEBUG:boto:Data: 2024-04-16T18:18:10.767 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.767 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.767 DEBUG:boto:Params: {} 2024-04-16T18:18:10.767 DEBUG:boto:Token: None 2024-04-16T18:18:10.767 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000030 2024-04-16T18:18:10.767 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3iuPq3qXRPBlZ7ljbj7aIAW0l3o= 2024-04-16T18:18:10.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3iuPq3qXRPBlZ7ljbj7aIAW0l3o=', 'Content-Length': '0'} 2024-04-16T18:18:10.769 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072b3af389a9c4dba-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.770 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.770 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.770 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.770 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.770 DEBUG:boto:Method: GET 2024-04-16T18:18:10.770 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.770 DEBUG:boto:Data: 2024-04-16T18:18:10.770 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.770 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.771 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.771 DEBUG:boto:Params: {} 2024-04-16T18:18:10.771 DEBUG:boto:Token: None 2024-04-16T18:18:10.771 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000099410cb09650727-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.814 DEBUG:boto:b'cjqttm-51obj000000000000000000301000falseobj000000000000000000302024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.815 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.815 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.815 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.815 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.815 DEBUG:boto:Method: GET 2024-04-16T18:18:10.815 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000030 2024-04-16T18:18:10.815 DEBUG:boto:Data: 2024-04-16T18:18:10.815 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.815 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.815 DEBUG:boto:Params: {} 2024-04-16T18:18:10.816 DEBUG:boto:Token: None 2024-04-16T18:18:10.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.819 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009b27b7922c6e792-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.820 DEBUG:boto:b'cjqttm-51obj000000000000000000301000falseobj000000000000000000302024-04-16T18:18:00.207Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.820 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2024-04-16T18:18:10.820 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.820 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.820 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.820 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.820 DEBUG:boto:Method: GET 2024-04-16T18:18:10.821 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.821 DEBUG:boto:Data: 2024-04-16T18:18:10.821 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.821 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.821 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.821 DEBUG:boto:Params: {} 2024-04-16T18:18:10.821 DEBUG:boto:Token: None 2024-04-16T18:18:10.821 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.821 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg= 2024-04-16T18:18:10.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg=', 'Content-Length': '0'} 2024-04-16T18:18:10.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcdab39cc124b569-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.870 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.870 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.871 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.871 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.871 DEBUG:boto:Method: GET 2024-04-16T18:18:10.871 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.871 DEBUG:boto:Data: 2024-04-16T18:18:10.871 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.871 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.871 DEBUG:boto:Params: {} 2024-04-16T18:18:10.871 DEBUG:boto:Token: None 2024-04-16T18:18:10.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg= 2024-04-16T18:18:10.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg=', 'Content-Length': '0'} 2024-04-16T18:18:10.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbb08370144c6453-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.874 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.874 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.875 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.875 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.875 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.875 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.875 DEBUG:boto:Data: 2024-04-16T18:18:10.875 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.875 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.875 DEBUG:boto:Params: {} 2024-04-16T18:18:10.875 DEBUG:boto:Token: None 2024-04-16T18:18:10.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0T3ZN16uRQMV0StBHbXvVd0p4mY= 2024-04-16T18:18:10.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0T3ZN16uRQMV0StBHbXvVd0p4mY=', 'Content-Length': '0'} 2024-04-16T18:18:10.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4e0e67ddef7e125-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.878 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.878 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.878 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.878 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.878 DEBUG:boto:Data: 2024-04-16T18:18:10.878 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.878 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.878 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.878 DEBUG:boto:Params: {} 2024-04-16T18:18:10.879 DEBUG:boto:Token: None 2024-04-16T18:18:10.879 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0T3ZN16uRQMV0StBHbXvVd0p4mY= 2024-04-16T18:18:10.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0T3ZN16uRQMV0StBHbXvVd0p4mY=', 'Content-Length': '0'} 2024-04-16T18:18:10.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e329b656027a587-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2024-04-16T18:18:10.881 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.881 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.881 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.881 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.881 DEBUG:boto:Method: GET 2024-04-16T18:18:10.881 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.882 DEBUG:boto:Data: 2024-04-16T18:18:10.882 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.882 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.882 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.882 DEBUG:boto:Params: {} 2024-04-16T18:18:10.882 DEBUG:boto:Token: None 2024-04-16T18:18:10.882 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.882 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg= 2024-04-16T18:18:10.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg=', 'Content-Length': '0'} 2024-04-16T18:18:10.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d4e6d035a761649-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.926 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.927 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.927 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.927 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.927 DEBUG:boto:Method: GET 2024-04-16T18:18:10.927 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.927 DEBUG:boto:Data: 2024-04-16T18:18:10.927 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.927 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.927 DEBUG:boto:Params: {} 2024-04-16T18:18:10.927 DEBUG:boto:Token: None 2024-04-16T18:18:10.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031?versionId=null 2024-04-16T18:18:10.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg= 2024-04-16T18:18:10.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QuuY5QU6F21JkCY7EPVul6i69lg=', 'Content-Length': '0'} 2024-04-16T18:18:10.930 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000619e42ae33dffcab-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.930 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.931 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.931 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:10.931 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:10.931 DEBUG:boto:Method: GET 2024-04-16T18:18:10.931 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:10.931 DEBUG:boto:Data: 2024-04-16T18:18:10.931 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.931 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.931 DEBUG:boto:Params: {} 2024-04-16T18:18:10.932 DEBUG:boto:Token: None 2024-04-16T18:18:10.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.935 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000293df7bb21aefaa7-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.978 DEBUG:boto:b'cjqttm-51obj000000000000000000311000falseobj000000000000000000312024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.979 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:10.979 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:10.979 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:10.979 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:10.979 DEBUG:boto:Method: GET 2024-04-16T18:18:10.979 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:10.979 DEBUG:boto:Data: 2024-04-16T18:18:10.979 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.979 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.979 DEBUG:boto:Params: {} 2024-04-16T18:18:10.980 DEBUG:boto:Token: None 2024-04-16T18:18:10.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/ 2024-04-16T18:18:10.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k= 2024-04-16T18:18:10.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sW2dIukBB84lefsP4TmW4DPSz8k=', 'Content-Length': '0'} 2024-04-16T18:18:10.984 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f405bab37840640-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.984 DEBUG:boto:b'cjqttm-51obj000000000000000000311000falseobj000000000000000000312024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:10.984 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.984 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.984 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.984 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.985 DEBUG:boto:Data: 2024-04-16T18:18:10.985 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.985 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.985 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.985 DEBUG:boto:Params: {} 2024-04-16T18:18:10.985 DEBUG:boto:Token: None 2024-04-16T18:18:10.985 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HsFuBE8RSxys2MFBsdHM3lbsKcI= 2024-04-16T18:18:10.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HsFuBE8RSxys2MFBsdHM3lbsKcI=', 'Content-Length': '0'} 2024-04-16T18:18:10.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021ba11c1f6dfcc52-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.987 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.987 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.988 DEBUG:boto:Method: HEAD 2024-04-16T18:18:10.988 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.988 DEBUG:boto:Data: 2024-04-16T18:18:10.988 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.988 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:10.988 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.988 DEBUG:boto:Params: {} 2024-04-16T18:18:10.988 DEBUG:boto:Token: None 2024-04-16T18:18:10.988 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HsFuBE8RSxys2MFBsdHM3lbsKcI= 2024-04-16T18:18:10.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HsFuBE8RSxys2MFBsdHM3lbsKcI=', 'Content-Length': '0'} 2024-04-16T18:18:10.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdb438d62f315358-00661ec0e2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:10.990 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000031 2024-04-16T18:18:10.991 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.991 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.991 DEBUG:boto:Method: GET 2024-04-16T18:18:10.991 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.991 DEBUG:boto:Data: 2024-04-16T18:18:10.991 DEBUG:boto:Headers: {} 2024-04-16T18:18:10.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:10.991 DEBUG:boto:Port: 8000 2024-04-16T18:18:10.991 DEBUG:boto:Params: {} 2024-04-16T18:18:10.991 DEBUG:boto:Token: None 2024-04-16T18:18:10.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:10 GMT /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:10.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0FAduRUhJusyqRzRptfDml7+pnk= 2024-04-16T18:18:10.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0FAduRUhJusyqRzRptfDml7+pnk=', 'Content-Length': '0'} 2024-04-16T18:18:10.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c50df8b91c7ae5a-00661ec0e2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.034 DEBUG:boto:path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:11.034 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000031 2024-04-16T18:18:11.035 DEBUG:boto:Method: GET 2024-04-16T18:18:11.035 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:11.035 DEBUG:boto:Data: 2024-04-16T18:18:11.035 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.035 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.035 DEBUG:boto:Params: {} 2024-04-16T18:18:11.035 DEBUG:boto:Token: None 2024-04-16T18:18:11.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000031 2024-04-16T18:18:11.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nsjmnO7NdtbD5O15J+RiiiuEnxY= 2024-04-16T18:18:11.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nsjmnO7NdtbD5O15J+RiiiuEnxY=', 'Content-Length': '0'} 2024-04-16T18:18:11.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bda977d70b52ba87-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.038 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.038 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.038 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:11.038 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:11.038 DEBUG:boto:Method: GET 2024-04-16T18:18:11.038 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:11.038 DEBUG:boto:Data: 2024-04-16T18:18:11.038 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.038 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.039 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.039 DEBUG:boto:Params: {} 2024-04-16T18:18:11.039 DEBUG:boto:Token: None 2024-04-16T18:18:11.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033710e903922df55-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.082 DEBUG:boto:b'cjqttm-51obj000000000000000000311000falseobj000000000000000000312024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.083 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.083 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.083 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:11.083 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:11.083 DEBUG:boto:Method: GET 2024-04-16T18:18:11.083 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000031 2024-04-16T18:18:11.083 DEBUG:boto:Data: 2024-04-16T18:18:11.083 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.083 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.084 DEBUG:boto:Params: {} 2024-04-16T18:18:11.084 DEBUG:boto:Token: None 2024-04-16T18:18:11.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.089 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c31363234f69533-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.089 DEBUG:boto:b'cjqttm-51obj000000000000000000311000falseobj000000000000000000312024-04-16T18:17:57.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.089 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2024-04-16T18:18:11.089 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.089 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.090 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.090 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.090 DEBUG:boto:Method: GET 2024-04-16T18:18:11.090 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.090 DEBUG:boto:Data: 2024-04-16T18:18:11.090 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.090 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.090 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.090 DEBUG:boto:Params: {} 2024-04-16T18:18:11.090 DEBUG:boto:Token: None 2024-04-16T18:18:11.090 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8= 2024-04-16T18:18:11.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8=', 'Content-Length': '0'} 2024-04-16T18:18:11.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087bd13667d9765e7-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.134 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.134 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.134 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.135 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.135 DEBUG:boto:Method: GET 2024-04-16T18:18:11.135 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.135 DEBUG:boto:Data: 2024-04-16T18:18:11.135 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.135 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.135 DEBUG:boto:Params: {} 2024-04-16T18:18:11.135 DEBUG:boto:Token: None 2024-04-16T18:18:11.135 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8= 2024-04-16T18:18:11.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8=', 'Content-Length': '0'} 2024-04-16T18:18:11.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000322f9c05de9ae282-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.138 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.138 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.138 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.138 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.138 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.139 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.139 DEBUG:boto:Data: 2024-04-16T18:18:11.139 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.139 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.139 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.139 DEBUG:boto:Params: {} 2024-04-16T18:18:11.139 DEBUG:boto:Token: None 2024-04-16T18:18:11.139 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NO74+RpZrxAjEjUA5zDPNmduB8= 2024-04-16T18:18:11.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NO74+RpZrxAjEjUA5zDPNmduB8=', 'Content-Length': '0'} 2024-04-16T18:18:11.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094076db6974c7da2-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.141 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.142 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.142 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.142 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.142 DEBUG:boto:Data: 2024-04-16T18:18:11.142 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.142 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.142 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.142 DEBUG:boto:Params: {} 2024-04-16T18:18:11.142 DEBUG:boto:Token: None 2024-04-16T18:18:11.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NO74+RpZrxAjEjUA5zDPNmduB8= 2024-04-16T18:18:11.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NO74+RpZrxAjEjUA5zDPNmduB8=', 'Content-Length': '0'} 2024-04-16T18:18:11.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d8c57625b4b171e-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2024-04-16T18:18:11.145 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.145 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.145 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.145 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.145 DEBUG:boto:Method: GET 2024-04-16T18:18:11.146 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.146 DEBUG:boto:Data: 2024-04-16T18:18:11.146 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.146 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.146 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.146 DEBUG:boto:Params: {} 2024-04-16T18:18:11.146 DEBUG:boto:Token: None 2024-04-16T18:18:11.146 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.146 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8= 2024-04-16T18:18:11.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8=', 'Content-Length': '0'} 2024-04-16T18:18:11.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c365efce25311476-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.194 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.194 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.195 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.195 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.195 DEBUG:boto:Method: GET 2024-04-16T18:18:11.195 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.195 DEBUG:boto:Data: 2024-04-16T18:18:11.195 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.195 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.195 DEBUG:boto:Params: {} 2024-04-16T18:18:11.195 DEBUG:boto:Token: None 2024-04-16T18:18:11.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032?versionId=null 2024-04-16T18:18:11.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8= 2024-04-16T18:18:11.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:78WnjR3XI7I7csjzbCpdBvOUML8=', 'Content-Length': '0'} 2024-04-16T18:18:11.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005245c6567caaf37d-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.198 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.198 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.198 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.198 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.199 DEBUG:boto:Method: GET 2024-04-16T18:18:11.199 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.199 DEBUG:boto:Data: 2024-04-16T18:18:11.199 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.199 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.199 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.199 DEBUG:boto:Params: {} 2024-04-16T18:18:11.199 DEBUG:boto:Token: None 2024-04-16T18:18:11.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000980e6fdf576e1c9e-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.242 DEBUG:boto:b'cjqttm-51obj000000000000000000321000falseobj000000000000000000322024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.243 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.243 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.243 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.243 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.243 DEBUG:boto:Method: GET 2024-04-16T18:18:11.243 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.243 DEBUG:boto:Data: 2024-04-16T18:18:11.243 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.244 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.244 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.244 DEBUG:boto:Params: {} 2024-04-16T18:18:11.244 DEBUG:boto:Token: None 2024-04-16T18:18:11.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.248 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000849e0760b376d6f7-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.248 DEBUG:boto:b'cjqttm-51obj000000000000000000321000falseobj000000000000000000322024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.249 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.249 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.249 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.249 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.249 DEBUG:boto:Data: 2024-04-16T18:18:11.249 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.249 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.249 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.249 DEBUG:boto:Params: {} 2024-04-16T18:18:11.249 DEBUG:boto:Token: None 2024-04-16T18:18:11.249 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.250 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H5axjA95ZVlH1pn5IE9dZVNPoB0= 2024-04-16T18:18:11.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H5axjA95ZVlH1pn5IE9dZVNPoB0=', 'Content-Length': '0'} 2024-04-16T18:18:11.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7b01cf177bb6009-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.252 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.252 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.252 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.252 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.252 DEBUG:boto:Data: 2024-04-16T18:18:11.252 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.252 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.252 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.252 DEBUG:boto:Params: {} 2024-04-16T18:18:11.252 DEBUG:boto:Token: None 2024-04-16T18:18:11.253 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H5axjA95ZVlH1pn5IE9dZVNPoB0= 2024-04-16T18:18:11.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H5axjA95ZVlH1pn5IE9dZVNPoB0=', 'Content-Length': '0'} 2024-04-16T18:18:11.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002ca7806e9f249e3-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.254 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000032 2024-04-16T18:18:11.255 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.255 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.255 DEBUG:boto:Method: GET 2024-04-16T18:18:11.255 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.255 DEBUG:boto:Data: 2024-04-16T18:18:11.255 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.255 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.255 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.255 DEBUG:boto:Params: {} 2024-04-16T18:18:11.255 DEBUG:boto:Token: None 2024-04-16T18:18:11.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3yLaH4v/zy442vCw5WeBaGwPUBg= 2024-04-16T18:18:11.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3yLaH4v/zy442vCw5WeBaGwPUBg=', 'Content-Length': '0'} 2024-04-16T18:18:11.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ecaa09d36c47e44-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.298 DEBUG:boto:path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.298 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.298 DEBUG:boto:Method: GET 2024-04-16T18:18:11.299 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.299 DEBUG:boto:Data: 2024-04-16T18:18:11.299 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.299 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.299 DEBUG:boto:Params: {} 2024-04-16T18:18:11.299 DEBUG:boto:Token: None 2024-04-16T18:18:11.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000032 2024-04-16T18:18:11.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3yLaH4v/zy442vCw5WeBaGwPUBg= 2024-04-16T18:18:11.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3yLaH4v/zy442vCw5WeBaGwPUBg=', 'Content-Length': '0'} 2024-04-16T18:18:11.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8b19e7fa775c994-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.301 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.302 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.302 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.302 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.302 DEBUG:boto:Method: GET 2024-04-16T18:18:11.302 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.302 DEBUG:boto:Data: 2024-04-16T18:18:11.302 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.302 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.302 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.302 DEBUG:boto:Params: {} 2024-04-16T18:18:11.303 DEBUG:boto:Token: None 2024-04-16T18:18:11.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.305 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d25f61311e519370-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.305 DEBUG:boto:b'cjqttm-51obj000000000000000000321000falseobj000000000000000000322024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.306 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.306 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.306 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.306 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.306 DEBUG:boto:Method: GET 2024-04-16T18:18:11.306 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000032 2024-04-16T18:18:11.306 DEBUG:boto:Data: 2024-04-16T18:18:11.306 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.307 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.307 DEBUG:boto:Params: {} 2024-04-16T18:18:11.307 DEBUG:boto:Token: None 2024-04-16T18:18:11.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d4973e58d8c9f5d-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.311 DEBUG:boto:b'cjqttm-51obj000000000000000000321000falseobj000000000000000000322024-04-16T18:17:56.675Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2024-04-16T18:18:11.311 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.311 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.311 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.312 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.312 DEBUG:boto:Method: GET 2024-04-16T18:18:11.312 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.312 DEBUG:boto:Data: 2024-04-16T18:18:11.312 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.312 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.312 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.312 DEBUG:boto:Params: {} 2024-04-16T18:18:11.312 DEBUG:boto:Token: None 2024-04-16T18:18:11.313 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.313 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q= 2024-04-16T18:18:11.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q=', 'Content-Length': '0'} 2024-04-16T18:18:11.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087f3fa74a5b25a2b-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.358 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.359 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.359 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.359 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.359 DEBUG:boto:Method: GET 2024-04-16T18:18:11.359 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.359 DEBUG:boto:Data: 2024-04-16T18:18:11.359 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.359 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.359 DEBUG:boto:Params: {} 2024-04-16T18:18:11.359 DEBUG:boto:Token: None 2024-04-16T18:18:11.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q= 2024-04-16T18:18:11.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q=', 'Content-Length': '0'} 2024-04-16T18:18:11.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000800ea6028331931e-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.362 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.363 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.363 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.363 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.363 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.363 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.363 DEBUG:boto:Data: 2024-04-16T18:18:11.363 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.363 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.363 DEBUG:boto:Params: {} 2024-04-16T18:18:11.364 DEBUG:boto:Token: None 2024-04-16T18:18:11.364 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bUz5S4HqqBoLw9/WiVd1MG6ZOtE= 2024-04-16T18:18:11.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bUz5S4HqqBoLw9/WiVd1MG6ZOtE=', 'Content-Length': '0'} 2024-04-16T18:18:11.366 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000621c67b26547bc54-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.366 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.366 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.366 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.366 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.367 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.367 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.367 DEBUG:boto:Data: 2024-04-16T18:18:11.367 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.367 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.367 DEBUG:boto:Params: {} 2024-04-16T18:18:11.367 DEBUG:boto:Token: None 2024-04-16T18:18:11.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bUz5S4HqqBoLw9/WiVd1MG6ZOtE= 2024-04-16T18:18:11.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bUz5S4HqqBoLw9/WiVd1MG6ZOtE=', 'Content-Length': '0'} 2024-04-16T18:18:11.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e1ddad5db9f212d-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2024-04-16T18:18:11.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.370 DEBUG:boto:Method: GET 2024-04-16T18:18:11.370 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.370 DEBUG:boto:Data: 2024-04-16T18:18:11.370 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.370 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.371 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.371 DEBUG:boto:Params: {} 2024-04-16T18:18:11.371 DEBUG:boto:Token: None 2024-04-16T18:18:11.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q= 2024-04-16T18:18:11.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q=', 'Content-Length': '0'} 2024-04-16T18:18:11.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000471e22e8fa94a1e5-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.414 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.414 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.415 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.415 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.415 DEBUG:boto:Method: GET 2024-04-16T18:18:11.415 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.415 DEBUG:boto:Data: 2024-04-16T18:18:11.415 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.415 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.415 DEBUG:boto:Params: {} 2024-04-16T18:18:11.415 DEBUG:boto:Token: None 2024-04-16T18:18:11.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033?versionId=null 2024-04-16T18:18:11.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q= 2024-04-16T18:18:11.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VUA9tpBsYWqIQKFf3gSa0QPpM8Q=', 'Content-Length': '0'} 2024-04-16T18:18:11.418 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c2e63d5c281778b-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.418 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.418 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.418 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.419 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.419 DEBUG:boto:Method: GET 2024-04-16T18:18:11.419 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.419 DEBUG:boto:Data: 2024-04-16T18:18:11.419 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.419 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.419 DEBUG:boto:Params: {} 2024-04-16T18:18:11.419 DEBUG:boto:Token: None 2024-04-16T18:18:11.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b54cfb5acce30076-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.423 DEBUG:boto:b'cjqttm-51obj000000000000000000331000falseobj000000000000000000332024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.423 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.423 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.423 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.423 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.423 DEBUG:boto:Method: GET 2024-04-16T18:18:11.423 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.423 DEBUG:boto:Data: 2024-04-16T18:18:11.424 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.424 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.424 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.424 DEBUG:boto:Params: {} 2024-04-16T18:18:11.424 DEBUG:boto:Token: None 2024-04-16T18:18:11.424 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.428 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a07949d7f3db5095-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.428 DEBUG:boto:b'cjqttm-51obj000000000000000000331000falseobj000000000000000000332024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.429 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.429 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.429 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.429 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.429 DEBUG:boto:Data: 2024-04-16T18:18:11.429 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.429 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.429 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.430 DEBUG:boto:Params: {} 2024-04-16T18:18:11.430 DEBUG:boto:Token: None 2024-04-16T18:18:11.430 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.430 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1D1osOk5kXSeDm9Wh48Muhtukzs= 2024-04-16T18:18:11.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1D1osOk5kXSeDm9Wh48Muhtukzs=', 'Content-Length': '0'} 2024-04-16T18:18:11.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed15ad66a0035873-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.432 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.432 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.433 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.433 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.433 DEBUG:boto:Data: 2024-04-16T18:18:11.433 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.433 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.433 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.433 DEBUG:boto:Params: {} 2024-04-16T18:18:11.433 DEBUG:boto:Token: None 2024-04-16T18:18:11.433 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.433 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1D1osOk5kXSeDm9Wh48Muhtukzs= 2024-04-16T18:18:11.434 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1D1osOk5kXSeDm9Wh48Muhtukzs=', 'Content-Length': '0'} 2024-04-16T18:18:11.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d7de90b54a89c80-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.436 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000033 2024-04-16T18:18:11.436 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.436 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.436 DEBUG:boto:Method: GET 2024-04-16T18:18:11.436 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.436 DEBUG:boto:Data: 2024-04-16T18:18:11.437 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.437 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.437 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.437 DEBUG:boto:Params: {} 2024-04-16T18:18:11.437 DEBUG:boto:Token: None 2024-04-16T18:18:11.437 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.437 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:awOj5utlarlNU6D1ZZPewvtU1Ww= 2024-04-16T18:18:11.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:awOj5utlarlNU6D1ZZPewvtU1Ww=', 'Content-Length': '0'} 2024-04-16T18:18:11.439 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000933177c4dc98d078-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.482 DEBUG:boto:path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.483 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.483 DEBUG:boto:Method: GET 2024-04-16T18:18:11.483 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.483 DEBUG:boto:Data: 2024-04-16T18:18:11.483 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.483 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.483 DEBUG:boto:Params: {} 2024-04-16T18:18:11.483 DEBUG:boto:Token: None 2024-04-16T18:18:11.484 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000033 2024-04-16T18:18:11.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:awOj5utlarlNU6D1ZZPewvtU1Ww= 2024-04-16T18:18:11.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:awOj5utlarlNU6D1ZZPewvtU1Ww=', 'Content-Length': '0'} 2024-04-16T18:18:11.486 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef30324bcdaf3573-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.486 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.486 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.486 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.486 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.486 DEBUG:boto:Method: GET 2024-04-16T18:18:11.487 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.487 DEBUG:boto:Data: 2024-04-16T18:18:11.487 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.487 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.487 DEBUG:boto:Params: {} 2024-04-16T18:18:11.487 DEBUG:boto:Token: None 2024-04-16T18:18:11.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.490 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005caec9403b8393cf-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.530 DEBUG:boto:b'cjqttm-51obj000000000000000000331000falseobj000000000000000000332024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.531 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.531 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.531 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.531 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.531 DEBUG:boto:Method: GET 2024-04-16T18:18:11.531 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000033 2024-04-16T18:18:11.531 DEBUG:boto:Data: 2024-04-16T18:18:11.531 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.531 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.531 DEBUG:boto:Params: {} 2024-04-16T18:18:11.531 DEBUG:boto:Token: None 2024-04-16T18:18:11.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004f54ec1f63650d0-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.536 DEBUG:boto:b'cjqttm-51obj000000000000000000331000falseobj000000000000000000332024-04-16T18:17:59.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.536 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2024-04-16T18:18:11.536 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.536 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.536 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.536 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.537 DEBUG:boto:Method: GET 2024-04-16T18:18:11.537 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.537 DEBUG:boto:Data: 2024-04-16T18:18:11.537 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.537 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.537 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.537 DEBUG:boto:Params: {} 2024-04-16T18:18:11.537 DEBUG:boto:Token: None 2024-04-16T18:18:11.537 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA= 2024-04-16T18:18:11.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA=', 'Content-Length': '0'} 2024-04-16T18:18:11.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070f191154313accf-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.582 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.582 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.583 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.583 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.583 DEBUG:boto:Method: GET 2024-04-16T18:18:11.583 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.583 DEBUG:boto:Data: 2024-04-16T18:18:11.583 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.583 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.583 DEBUG:boto:Params: {} 2024-04-16T18:18:11.583 DEBUG:boto:Token: None 2024-04-16T18:18:11.584 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA= 2024-04-16T18:18:11.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA=', 'Content-Length': '0'} 2024-04-16T18:18:11.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8049d9a6dfe57b1-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.586 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.586 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.589 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.589 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.589 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.590 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.590 DEBUG:boto:Data: 2024-04-16T18:18:11.590 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.590 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.590 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.590 DEBUG:boto:Params: {} 2024-04-16T18:18:11.590 DEBUG:boto:Token: None 2024-04-16T18:18:11.590 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nkcsLDLVKHL/mioTgmhAuYXlO+0= 2024-04-16T18:18:11.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nkcsLDLVKHL/mioTgmhAuYXlO+0=', 'Content-Length': '0'} 2024-04-16T18:18:11.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009601ddd5d1110745-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.593 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.593 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.593 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.593 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.593 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.594 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.594 DEBUG:boto:Data: 2024-04-16T18:18:11.594 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.594 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.594 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.594 DEBUG:boto:Params: {} 2024-04-16T18:18:11.594 DEBUG:boto:Token: None 2024-04-16T18:18:11.594 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.594 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nkcsLDLVKHL/mioTgmhAuYXlO+0= 2024-04-16T18:18:11.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nkcsLDLVKHL/mioTgmhAuYXlO+0=', 'Content-Length': '0'} 2024-04-16T18:18:11.596 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4f05cd68d000469-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.597 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2024-04-16T18:18:11.597 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.597 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.597 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.597 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.597 DEBUG:boto:Method: GET 2024-04-16T18:18:11.597 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.597 DEBUG:boto:Data: 2024-04-16T18:18:11.597 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.598 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.598 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.598 DEBUG:boto:Params: {} 2024-04-16T18:18:11.598 DEBUG:boto:Token: None 2024-04-16T18:18:11.598 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.598 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA= 2024-04-16T18:18:11.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA=', 'Content-Length': '0'} 2024-04-16T18:18:11.600 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d67ce4b3e93bb24-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.642 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.643 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.643 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.643 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.643 DEBUG:boto:Method: GET 2024-04-16T18:18:11.643 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.643 DEBUG:boto:Data: 2024-04-16T18:18:11.643 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.643 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.643 DEBUG:boto:Params: {} 2024-04-16T18:18:11.644 DEBUG:boto:Token: None 2024-04-16T18:18:11.644 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036?versionId=null 2024-04-16T18:18:11.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA= 2024-04-16T18:18:11.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BIMhjJ+LZ0M5e7jq3WOaldNFBpA=', 'Content-Length': '0'} 2024-04-16T18:18:11.646 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cf4c4c57f73471f-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.646 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.646 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.646 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.647 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.647 DEBUG:boto:Method: GET 2024-04-16T18:18:11.647 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.647 DEBUG:boto:Data: 2024-04-16T18:18:11.647 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.647 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.647 DEBUG:boto:Params: {} 2024-04-16T18:18:11.647 DEBUG:boto:Token: None 2024-04-16T18:18:11.648 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.650 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7d26752edb4b472-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.690 DEBUG:boto:b'cjqttm-51obj000000000000000000361000falseobj000000000000000000362024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.691 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.691 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.691 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.691 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.691 DEBUG:boto:Method: GET 2024-04-16T18:18:11.691 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.691 DEBUG:boto:Data: 2024-04-16T18:18:11.691 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.691 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.691 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.691 DEBUG:boto:Params: {} 2024-04-16T18:18:11.692 DEBUG:boto:Token: None 2024-04-16T18:18:11.692 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.696 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb6faa9552949d2a-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.696 DEBUG:boto:b'cjqttm-51obj000000000000000000361000falseobj000000000000000000362024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.696 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.696 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.696 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.697 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.697 DEBUG:boto:Data: 2024-04-16T18:18:11.697 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.697 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.697 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.697 DEBUG:boto:Params: {} 2024-04-16T18:18:11.697 DEBUG:boto:Token: None 2024-04-16T18:18:11.697 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.697 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mWQ6XRGFBUGjXWO88xqbQEJIev0= 2024-04-16T18:18:11.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mWQ6XRGFBUGjXWO88xqbQEJIev0=', 'Content-Length': '0'} 2024-04-16T18:18:11.699 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e61a0c2dd7c68bcf-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.699 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.700 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.700 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.700 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.700 DEBUG:boto:Data: 2024-04-16T18:18:11.700 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.700 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.700 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.700 DEBUG:boto:Params: {} 2024-04-16T18:18:11.700 DEBUG:boto:Token: None 2024-04-16T18:18:11.701 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.701 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mWQ6XRGFBUGjXWO88xqbQEJIev0= 2024-04-16T18:18:11.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mWQ6XRGFBUGjXWO88xqbQEJIev0=', 'Content-Length': '0'} 2024-04-16T18:18:11.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000207706b3cad66efb-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.703 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000036 2024-04-16T18:18:11.703 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.703 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.703 DEBUG:boto:Method: GET 2024-04-16T18:18:11.703 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.703 DEBUG:boto:Data: 2024-04-16T18:18:11.703 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.703 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.703 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.703 DEBUG:boto:Params: {} 2024-04-16T18:18:11.704 DEBUG:boto:Token: None 2024-04-16T18:18:11.704 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W81LPdTlaHlOSUJvc8yf1MQVFa0= 2024-04-16T18:18:11.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W81LPdTlaHlOSUJvc8yf1MQVFa0=', 'Content-Length': '0'} 2024-04-16T18:18:11.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1f0c82ba60be960-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.746 DEBUG:boto:path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.747 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.747 DEBUG:boto:Method: GET 2024-04-16T18:18:11.747 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.747 DEBUG:boto:Data: 2024-04-16T18:18:11.747 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.747 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.747 DEBUG:boto:Params: {} 2024-04-16T18:18:11.747 DEBUG:boto:Token: None 2024-04-16T18:18:11.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000036 2024-04-16T18:18:11.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W81LPdTlaHlOSUJvc8yf1MQVFa0= 2024-04-16T18:18:11.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W81LPdTlaHlOSUJvc8yf1MQVFa0=', 'Content-Length': '0'} 2024-04-16T18:18:11.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076c4dc4691a181f2-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.750 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.750 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.750 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.750 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.750 DEBUG:boto:Method: GET 2024-04-16T18:18:11.750 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.750 DEBUG:boto:Data: 2024-04-16T18:18:11.751 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.751 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.751 DEBUG:boto:Params: {} 2024-04-16T18:18:11.751 DEBUG:boto:Token: None 2024-04-16T18:18:11.751 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd4aab9fad6befba-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.794 DEBUG:boto:b'cjqttm-51obj000000000000000000361000falseobj000000000000000000362024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.795 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.795 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.795 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.795 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.795 DEBUG:boto:Method: GET 2024-04-16T18:18:11.795 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000036 2024-04-16T18:18:11.795 DEBUG:boto:Data: 2024-04-16T18:18:11.795 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.795 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.796 DEBUG:boto:Params: {} 2024-04-16T18:18:11.796 DEBUG:boto:Token: None 2024-04-16T18:18:11.796 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.800 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ebc1ef08e3647790-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.800 DEBUG:boto:b'cjqttm-51obj000000000000000000361000falseobj000000000000000000362024-04-16T18:17:59.624Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2024-04-16T18:18:11.800 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.801 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.801 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.801 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.801 DEBUG:boto:Method: GET 2024-04-16T18:18:11.801 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.801 DEBUG:boto:Data: 2024-04-16T18:18:11.801 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.801 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.801 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.801 DEBUG:boto:Params: {} 2024-04-16T18:18:11.802 DEBUG:boto:Token: None 2024-04-16T18:18:11.802 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.802 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA= 2024-04-16T18:18:11.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA=', 'Content-Length': '0'} 2024-04-16T18:18:11.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099176383b8b1b8bb-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.846 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.846 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.846 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.847 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.847 DEBUG:boto:Method: GET 2024-04-16T18:18:11.847 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.847 DEBUG:boto:Data: 2024-04-16T18:18:11.847 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.847 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.847 DEBUG:boto:Params: {} 2024-04-16T18:18:11.847 DEBUG:boto:Token: None 2024-04-16T18:18:11.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA= 2024-04-16T18:18:11.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA=', 'Content-Length': '0'} 2024-04-16T18:18:11.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f34878aa68c134f-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.850 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.850 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.850 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.850 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.850 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.850 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.850 DEBUG:boto:Data: 2024-04-16T18:18:11.850 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.851 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.851 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.851 DEBUG:boto:Params: {} 2024-04-16T18:18:11.851 DEBUG:boto:Token: None 2024-04-16T18:18:11.851 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Doza7RWjTp61dPKZ/AsmL9Wfbc= 2024-04-16T18:18:11.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Doza7RWjTp61dPKZ/AsmL9Wfbc=', 'Content-Length': '0'} 2024-04-16T18:18:11.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c762565af4b66ec-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.854 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.854 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.854 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.854 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.854 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.854 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.854 DEBUG:boto:Data: 2024-04-16T18:18:11.854 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.854 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.855 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.855 DEBUG:boto:Params: {} 2024-04-16T18:18:11.855 DEBUG:boto:Token: None 2024-04-16T18:18:11.855 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Doza7RWjTp61dPKZ/AsmL9Wfbc= 2024-04-16T18:18:11.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Doza7RWjTp61dPKZ/AsmL9Wfbc=', 'Content-Length': '0'} 2024-04-16T18:18:11.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e550e0a92c5b2934-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.857 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2024-04-16T18:18:11.857 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.858 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.858 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.858 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.858 DEBUG:boto:Method: GET 2024-04-16T18:18:11.858 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.858 DEBUG:boto:Data: 2024-04-16T18:18:11.858 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.858 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.858 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.858 DEBUG:boto:Params: {} 2024-04-16T18:18:11.859 DEBUG:boto:Token: None 2024-04-16T18:18:11.859 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.859 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA= 2024-04-16T18:18:11.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA=', 'Content-Length': '0'} 2024-04-16T18:18:11.861 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000549c003bc93822ba-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.902 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.903 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.903 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.903 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.903 DEBUG:boto:Method: GET 2024-04-16T18:18:11.903 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.903 DEBUG:boto:Data: 2024-04-16T18:18:11.903 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.903 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.903 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.903 DEBUG:boto:Params: {} 2024-04-16T18:18:11.903 DEBUG:boto:Token: None 2024-04-16T18:18:11.904 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037?versionId=null 2024-04-16T18:18:11.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA= 2024-04-16T18:18:11.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Odl8I82EnpBmypsx7Ns9Q4cRSZA=', 'Content-Length': '0'} 2024-04-16T18:18:11.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001035e8fb45ce5d7a-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.906 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.906 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.906 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:11.907 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:11.907 DEBUG:boto:Method: GET 2024-04-16T18:18:11.907 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:11.907 DEBUG:boto:Data: 2024-04-16T18:18:11.907 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.907 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.907 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.907 DEBUG:boto:Params: {} 2024-04-16T18:18:11.907 DEBUG:boto:Token: None 2024-04-16T18:18:11.907 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.910 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7f8f083b10c2e1e-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.950 DEBUG:boto:b'cjqttm-51obj000000000000000000371000falseobj000000000000000000372024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.951 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:11.951 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:11.951 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:11.951 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:11.951 DEBUG:boto:Method: GET 2024-04-16T18:18:11.951 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:11.951 DEBUG:boto:Data: 2024-04-16T18:18:11.951 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.952 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.952 DEBUG:boto:Params: {} 2024-04-16T18:18:11.952 DEBUG:boto:Token: None 2024-04-16T18:18:11.952 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/ 2024-04-16T18:18:11.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ= 2024-04-16T18:18:11.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W6aWdBguqebbxky4Li3Cr9KxlyQ=', 'Content-Length': '0'} 2024-04-16T18:18:11.956 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f62e7ccff35252c7-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.956 DEBUG:boto:b'cjqttm-51obj000000000000000000371000falseobj000000000000000000372024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:11.956 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.956 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.956 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.956 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.957 DEBUG:boto:Data: 2024-04-16T18:18:11.957 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.957 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.957 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.957 DEBUG:boto:Params: {} 2024-04-16T18:18:11.957 DEBUG:boto:Token: None 2024-04-16T18:18:11.957 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7yvlJAIEP5tYYeun7uP4Qp7M1qs= 2024-04-16T18:18:11.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7yvlJAIEP5tYYeun7uP4Qp7M1qs=', 'Content-Length': '0'} 2024-04-16T18:18:11.960 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086a42c55ee272882-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.960 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.960 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.960 DEBUG:boto:Method: HEAD 2024-04-16T18:18:11.960 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.960 DEBUG:boto:Data: 2024-04-16T18:18:11.960 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.960 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:11.960 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.961 DEBUG:boto:Params: {} 2024-04-16T18:18:11.961 DEBUG:boto:Token: None 2024-04-16T18:18:11.961 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7yvlJAIEP5tYYeun7uP4Qp7M1qs= 2024-04-16T18:18:11.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7yvlJAIEP5tYYeun7uP4Qp7M1qs=', 'Content-Length': '0'} 2024-04-16T18:18:11.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1af5bb0f89f8c25-00661ec0e3-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:11.963 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000037 2024-04-16T18:18:11.963 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.963 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.964 DEBUG:boto:Method: GET 2024-04-16T18:18:11.964 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.964 DEBUG:boto:Data: 2024-04-16T18:18:11.964 DEBUG:boto:Headers: {} 2024-04-16T18:18:11.964 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:11.964 DEBUG:boto:Port: 8000 2024-04-16T18:18:11.964 DEBUG:boto:Params: {} 2024-04-16T18:18:11.964 DEBUG:boto:Token: None 2024-04-16T18:18:11.964 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:11 GMT /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:11.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3Tsk4HF3Mi6z8xXzyqDE628YeUE= 2024-04-16T18:18:11.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3Tsk4HF3Mi6z8xXzyqDE628YeUE=', 'Content-Length': '0'} 2024-04-16T18:18:11.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f344d2188987c8d-00661ec0e3-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.010 DEBUG:boto:path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:12.011 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000037 2024-04-16T18:18:12.011 DEBUG:boto:Method: GET 2024-04-16T18:18:12.011 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:12.011 DEBUG:boto:Data: 2024-04-16T18:18:12.011 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.011 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.011 DEBUG:boto:Params: {} 2024-04-16T18:18:12.011 DEBUG:boto:Token: None 2024-04-16T18:18:12.011 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000037 2024-04-16T18:18:12.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jZcVvH/A+hH+LM0bfRncBY99m7c= 2024-04-16T18:18:12.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jZcVvH/A+hH+LM0bfRncBY99m7c=', 'Content-Length': '0'} 2024-04-16T18:18:12.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002725205ad04a551b-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.014 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.015 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.015 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:12.015 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:12.015 DEBUG:boto:Method: GET 2024-04-16T18:18:12.015 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:12.015 DEBUG:boto:Data: 2024-04-16T18:18:12.015 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.015 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.015 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.015 DEBUG:boto:Params: {} 2024-04-16T18:18:12.015 DEBUG:boto:Token: None 2024-04-16T18:18:12.016 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.018 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000313cbf47d171d89d-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.058 DEBUG:boto:b'cjqttm-51obj000000000000000000371000falseobj000000000000000000372024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.059 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.059 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.059 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:12.059 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:12.059 DEBUG:boto:Method: GET 2024-04-16T18:18:12.059 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000037 2024-04-16T18:18:12.059 DEBUG:boto:Data: 2024-04-16T18:18:12.059 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.060 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.060 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.060 DEBUG:boto:Params: {} 2024-04-16T18:18:12.060 DEBUG:boto:Token: None 2024-04-16T18:18:12.060 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.064 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4eba31460936831-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.064 DEBUG:boto:b'cjqttm-51obj000000000000000000371000falseobj000000000000000000372024-04-16T18:17:57.388Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2024-04-16T18:18:12.065 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.065 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.065 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.065 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.065 DEBUG:boto:Method: GET 2024-04-16T18:18:12.065 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.065 DEBUG:boto:Data: 2024-04-16T18:18:12.065 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.065 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.065 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.065 DEBUG:boto:Params: {} 2024-04-16T18:18:12.066 DEBUG:boto:Token: None 2024-04-16T18:18:12.066 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.066 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc= 2024-04-16T18:18:12.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc=', 'Content-Length': '0'} 2024-04-16T18:18:12.068 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000090ff5ddc96db578-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.110 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.110 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.111 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.111 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.111 DEBUG:boto:Method: GET 2024-04-16T18:18:12.111 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.111 DEBUG:boto:Data: 2024-04-16T18:18:12.111 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.111 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.111 DEBUG:boto:Params: {} 2024-04-16T18:18:12.111 DEBUG:boto:Token: None 2024-04-16T18:18:12.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc= 2024-04-16T18:18:12.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc=', 'Content-Length': '0'} 2024-04-16T18:18:12.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f3844003110ffda-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.115 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.115 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.115 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.115 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.115 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.115 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.115 DEBUG:boto:Data: 2024-04-16T18:18:12.115 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.115 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.115 DEBUG:boto:Params: {} 2024-04-16T18:18:12.116 DEBUG:boto:Token: None 2024-04-16T18:18:12.116 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tjKD5xzssF/eUWSbbnVpPo5pBrw= 2024-04-16T18:18:12.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tjKD5xzssF/eUWSbbnVpPo5pBrw=', 'Content-Length': '0'} 2024-04-16T18:18:12.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd1396ab2dc725cd-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.118 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.118 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.118 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.119 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.119 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.119 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.119 DEBUG:boto:Data: 2024-04-16T18:18:12.119 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.119 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.119 DEBUG:boto:Params: {} 2024-04-16T18:18:12.119 DEBUG:boto:Token: None 2024-04-16T18:18:12.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tjKD5xzssF/eUWSbbnVpPo5pBrw= 2024-04-16T18:18:12.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tjKD5xzssF/eUWSbbnVpPo5pBrw=', 'Content-Length': '0'} 2024-04-16T18:18:12.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065bb2398ab51042c-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2024-04-16T18:18:12.122 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.122 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.122 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.122 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.122 DEBUG:boto:Method: GET 2024-04-16T18:18:12.122 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.122 DEBUG:boto:Data: 2024-04-16T18:18:12.122 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.122 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.123 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.123 DEBUG:boto:Params: {} 2024-04-16T18:18:12.123 DEBUG:boto:Token: None 2024-04-16T18:18:12.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc= 2024-04-16T18:18:12.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc=', 'Content-Length': '0'} 2024-04-16T18:18:12.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a224bb1baa76aea-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.166 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.166 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.167 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.167 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.167 DEBUG:boto:Method: GET 2024-04-16T18:18:12.167 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.167 DEBUG:boto:Data: 2024-04-16T18:18:12.167 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.167 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.167 DEBUG:boto:Params: {} 2024-04-16T18:18:12.167 DEBUG:boto:Token: None 2024-04-16T18:18:12.168 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039?versionId=null 2024-04-16T18:18:12.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc= 2024-04-16T18:18:12.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nApT/F44iIRmP535+C9rJ+DFcuc=', 'Content-Length': '0'} 2024-04-16T18:18:12.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001981fb39e321a894-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.171 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.171 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.171 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.171 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.171 DEBUG:boto:Method: GET 2024-04-16T18:18:12.171 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.171 DEBUG:boto:Data: 2024-04-16T18:18:12.171 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.171 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.171 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.171 DEBUG:boto:Params: {} 2024-04-16T18:18:12.172 DEBUG:boto:Token: None 2024-04-16T18:18:12.172 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d22136b7bcb57c2-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.218 DEBUG:boto:b'cjqttm-51obj000000000000000000391000falseobj000000000000000000392024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.219 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.219 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.219 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.219 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.219 DEBUG:boto:Method: GET 2024-04-16T18:18:12.219 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.219 DEBUG:boto:Data: 2024-04-16T18:18:12.219 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.219 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.220 DEBUG:boto:Params: {} 2024-04-16T18:18:12.220 DEBUG:boto:Token: None 2024-04-16T18:18:12.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.224 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023fbd49cc49832f1-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.224 DEBUG:boto:b'cjqttm-51obj000000000000000000391000falseobj000000000000000000392024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.224 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.224 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.224 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.224 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.225 DEBUG:boto:Data: 2024-04-16T18:18:12.225 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.225 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.225 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.225 DEBUG:boto:Params: {} 2024-04-16T18:18:12.225 DEBUG:boto:Token: None 2024-04-16T18:18:12.225 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.225 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1OiGIN5KF+ZNvc9DEXwwgDKaUcI= 2024-04-16T18:18:12.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1OiGIN5KF+ZNvc9DEXwwgDKaUcI=', 'Content-Length': '0'} 2024-04-16T18:18:12.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4031718bdb99020-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.228 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.228 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.228 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.228 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.228 DEBUG:boto:Data: 2024-04-16T18:18:12.228 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.228 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.228 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.228 DEBUG:boto:Params: {} 2024-04-16T18:18:12.228 DEBUG:boto:Token: None 2024-04-16T18:18:12.229 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.229 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1OiGIN5KF+ZNvc9DEXwwgDKaUcI= 2024-04-16T18:18:12.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1OiGIN5KF+ZNvc9DEXwwgDKaUcI=', 'Content-Length': '0'} 2024-04-16T18:18:12.231 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6c83113c6fe3475-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.231 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000039 2024-04-16T18:18:12.231 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.232 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.232 DEBUG:boto:Method: GET 2024-04-16T18:18:12.232 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.232 DEBUG:boto:Data: 2024-04-16T18:18:12.232 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.232 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.232 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.232 DEBUG:boto:Params: {} 2024-04-16T18:18:12.232 DEBUG:boto:Token: None 2024-04-16T18:18:12.232 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xw9QhIQt8mFDN2ihDCqXVSHaCcQ= 2024-04-16T18:18:12.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xw9QhIQt8mFDN2ihDCqXVSHaCcQ=', 'Content-Length': '0'} 2024-04-16T18:18:12.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e53937ca0a1a3ba6-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.278 DEBUG:boto:path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.278 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.279 DEBUG:boto:Method: GET 2024-04-16T18:18:12.279 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.279 DEBUG:boto:Data: 2024-04-16T18:18:12.279 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.279 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.279 DEBUG:boto:Params: {} 2024-04-16T18:18:12.279 DEBUG:boto:Token: None 2024-04-16T18:18:12.279 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000039 2024-04-16T18:18:12.279 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xw9QhIQt8mFDN2ihDCqXVSHaCcQ= 2024-04-16T18:18:12.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xw9QhIQt8mFDN2ihDCqXVSHaCcQ=', 'Content-Length': '0'} 2024-04-16T18:18:12.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b27bc030eb3358d-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.282 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.282 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.282 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.282 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.282 DEBUG:boto:Method: GET 2024-04-16T18:18:12.282 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.283 DEBUG:boto:Data: 2024-04-16T18:18:12.283 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.283 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.283 DEBUG:boto:Params: {} 2024-04-16T18:18:12.283 DEBUG:boto:Token: None 2024-04-16T18:18:12.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.286 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000233c703d1ce85012-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.326 DEBUG:boto:b'cjqttm-51obj000000000000000000391000falseobj000000000000000000392024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.326 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.327 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.327 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.327 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.327 DEBUG:boto:Method: GET 2024-04-16T18:18:12.327 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000039 2024-04-16T18:18:12.327 DEBUG:boto:Data: 2024-04-16T18:18:12.327 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.327 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.327 DEBUG:boto:Params: {} 2024-04-16T18:18:12.327 DEBUG:boto:Token: None 2024-04-16T18:18:12.328 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.332 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a4f7180420dfa78-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.332 DEBUG:boto:b'cjqttm-51obj000000000000000000391000falseobj000000000000000000392024-04-16T18:18:00.148Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2024-04-16T18:18:12.332 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.332 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.333 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.333 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.333 DEBUG:boto:Method: GET 2024-04-16T18:18:12.333 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.333 DEBUG:boto:Data: 2024-04-16T18:18:12.333 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.333 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.333 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.333 DEBUG:boto:Params: {} 2024-04-16T18:18:12.333 DEBUG:boto:Token: None 2024-04-16T18:18:12.334 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.334 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o= 2024-04-16T18:18:12.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o=', 'Content-Length': '0'} 2024-04-16T18:18:12.336 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000180deec09533df77-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.378 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.378 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.379 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.379 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.379 DEBUG:boto:Method: GET 2024-04-16T18:18:12.379 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.379 DEBUG:boto:Data: 2024-04-16T18:18:12.379 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.379 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.379 DEBUG:boto:Params: {} 2024-04-16T18:18:12.379 DEBUG:boto:Token: None 2024-04-16T18:18:12.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o= 2024-04-16T18:18:12.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o=', 'Content-Length': '0'} 2024-04-16T18:18:12.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4fb7f6682e70df5-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.382 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.382 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.382 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.382 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.383 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.383 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.383 DEBUG:boto:Data: 2024-04-16T18:18:12.383 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.383 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.383 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.383 DEBUG:boto:Params: {} 2024-04-16T18:18:12.383 DEBUG:boto:Token: None 2024-04-16T18:18:12.383 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IbPRrZ+zsf+LeBNLcucQYdnxoO4= 2024-04-16T18:18:12.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IbPRrZ+zsf+LeBNLcucQYdnxoO4=', 'Content-Length': '0'} 2024-04-16T18:18:12.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe5c777057dcef10-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.386 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.386 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.386 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.386 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.386 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.386 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.386 DEBUG:boto:Data: 2024-04-16T18:18:12.387 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.387 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.387 DEBUG:boto:Params: {} 2024-04-16T18:18:12.387 DEBUG:boto:Token: None 2024-04-16T18:18:12.387 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IbPRrZ+zsf+LeBNLcucQYdnxoO4= 2024-04-16T18:18:12.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IbPRrZ+zsf+LeBNLcucQYdnxoO4=', 'Content-Length': '0'} 2024-04-16T18:18:12.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d3dacb0033467b4-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2024-04-16T18:18:12.390 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.390 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.390 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.390 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.390 DEBUG:boto:Method: GET 2024-04-16T18:18:12.390 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.390 DEBUG:boto:Data: 2024-04-16T18:18:12.390 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.390 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.390 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.391 DEBUG:boto:Params: {} 2024-04-16T18:18:12.391 DEBUG:boto:Token: None 2024-04-16T18:18:12.391 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o= 2024-04-16T18:18:12.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o=', 'Content-Length': '0'} 2024-04-16T18:18:12.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f344727458836c3-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.434 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.434 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.434 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.435 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.435 DEBUG:boto:Method: GET 2024-04-16T18:18:12.435 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.435 DEBUG:boto:Data: 2024-04-16T18:18:12.435 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.435 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.435 DEBUG:boto:Params: {} 2024-04-16T18:18:12.435 DEBUG:boto:Token: None 2024-04-16T18:18:12.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040?versionId=null 2024-04-16T18:18:12.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o= 2024-04-16T18:18:12.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7FjjxLSC+w8Ah1LosE+x0XXUE+o=', 'Content-Length': '0'} 2024-04-16T18:18:12.438 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c923b38c69362aeb-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.438 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.438 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.438 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.438 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.438 DEBUG:boto:Method: GET 2024-04-16T18:18:12.438 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.438 DEBUG:boto:Data: 2024-04-16T18:18:12.439 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.439 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.439 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.439 DEBUG:boto:Params: {} 2024-04-16T18:18:12.439 DEBUG:boto:Token: None 2024-04-16T18:18:12.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a42f9a5cd1c2a9d6-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.482 DEBUG:boto:b'cjqttm-51obj000000000000000000401000falseobj000000000000000000402024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.483 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.483 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.483 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.483 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.483 DEBUG:boto:Method: GET 2024-04-16T18:18:12.483 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.483 DEBUG:boto:Data: 2024-04-16T18:18:12.483 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.483 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.484 DEBUG:boto:Params: {} 2024-04-16T18:18:12.484 DEBUG:boto:Token: None 2024-04-16T18:18:12.484 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a4814dabb82d762-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.490 DEBUG:boto:b'cjqttm-51obj000000000000000000401000falseobj000000000000000000402024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.490 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.490 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.490 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.490 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.490 DEBUG:boto:Data: 2024-04-16T18:18:12.490 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.491 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.491 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.491 DEBUG:boto:Params: {} 2024-04-16T18:18:12.491 DEBUG:boto:Token: None 2024-04-16T18:18:12.491 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iSrEZjKpXaIQax3hNmOfmC67wKY= 2024-04-16T18:18:12.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iSrEZjKpXaIQax3hNmOfmC67wKY=', 'Content-Length': '0'} 2024-04-16T18:18:12.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000361f3d60a170da34-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.493 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.493 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.494 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.494 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.494 DEBUG:boto:Data: 2024-04-16T18:18:12.494 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.494 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.494 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.494 DEBUG:boto:Params: {} 2024-04-16T18:18:12.494 DEBUG:boto:Token: None 2024-04-16T18:18:12.494 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.494 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iSrEZjKpXaIQax3hNmOfmC67wKY= 2024-04-16T18:18:12.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iSrEZjKpXaIQax3hNmOfmC67wKY=', 'Content-Length': '0'} 2024-04-16T18:18:12.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dcc54aeec66ca45-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.497 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000040 2024-04-16T18:18:12.497 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.497 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.497 DEBUG:boto:Method: GET 2024-04-16T18:18:12.497 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.497 DEBUG:boto:Data: 2024-04-16T18:18:12.497 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.497 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.497 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.497 DEBUG:boto:Params: {} 2024-04-16T18:18:12.498 DEBUG:boto:Token: None 2024-04-16T18:18:12.498 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.498 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oZdj/i3sge5K4XqubWaRmbNCLWY= 2024-04-16T18:18:12.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oZdj/i3sge5K4XqubWaRmbNCLWY=', 'Content-Length': '0'} 2024-04-16T18:18:12.500 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8774ed4bfd74782-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.542 DEBUG:boto:path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.542 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.543 DEBUG:boto:Method: GET 2024-04-16T18:18:12.543 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.543 DEBUG:boto:Data: 2024-04-16T18:18:12.543 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.543 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.543 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.543 DEBUG:boto:Params: {} 2024-04-16T18:18:12.543 DEBUG:boto:Token: None 2024-04-16T18:18:12.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000040 2024-04-16T18:18:12.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oZdj/i3sge5K4XqubWaRmbNCLWY= 2024-04-16T18:18:12.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oZdj/i3sge5K4XqubWaRmbNCLWY=', 'Content-Length': '0'} 2024-04-16T18:18:12.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092d90065fdf0b1a7-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.546 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.546 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.546 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.547 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.547 DEBUG:boto:Method: GET 2024-04-16T18:18:12.547 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.547 DEBUG:boto:Data: 2024-04-16T18:18:12.547 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.547 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.547 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.547 DEBUG:boto:Params: {} 2024-04-16T18:18:12.547 DEBUG:boto:Token: None 2024-04-16T18:18:12.547 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.547 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.550 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001249bf95865b361f-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.550 DEBUG:boto:b'cjqttm-51obj000000000000000000401000falseobj000000000000000000402024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.551 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.551 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.551 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.551 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.551 DEBUG:boto:Method: GET 2024-04-16T18:18:12.551 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000040 2024-04-16T18:18:12.551 DEBUG:boto:Data: 2024-04-16T18:18:12.551 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.551 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.551 DEBUG:boto:Params: {} 2024-04-16T18:18:12.552 DEBUG:boto:Token: None 2024-04-16T18:18:12.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e2ea30716e85747-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.556 DEBUG:boto:b'cjqttm-51obj000000000000000000401000falseobj000000000000000000402024-04-16T18:17:59.324Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.556 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000042 2024-04-16T18:18:12.556 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.556 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.557 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.557 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.557 DEBUG:boto:Method: GET 2024-04-16T18:18:12.557 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.557 DEBUG:boto:Data: 2024-04-16T18:18:12.557 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.557 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.557 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.557 DEBUG:boto:Params: {} 2024-04-16T18:18:12.557 DEBUG:boto:Token: None 2024-04-16T18:18:12.557 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk= 2024-04-16T18:18:12.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk=', 'Content-Length': '0'} 2024-04-16T18:18:12.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030164d7bd0198e77-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.602 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.602 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.602 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.603 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.603 DEBUG:boto:Method: GET 2024-04-16T18:18:12.603 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.603 DEBUG:boto:Data: 2024-04-16T18:18:12.603 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.603 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.603 DEBUG:boto:Params: {} 2024-04-16T18:18:12.603 DEBUG:boto:Token: None 2024-04-16T18:18:12.603 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk= 2024-04-16T18:18:12.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk=', 'Content-Length': '0'} 2024-04-16T18:18:12.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2716062991b0832-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.606 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.606 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.606 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.606 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.606 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.606 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.606 DEBUG:boto:Data: 2024-04-16T18:18:12.607 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.607 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.607 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.607 DEBUG:boto:Params: {} 2024-04-16T18:18:12.607 DEBUG:boto:Token: None 2024-04-16T18:18:12.607 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ieTuA9m9MJxTFpAqjt+bM9an0wc= 2024-04-16T18:18:12.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ieTuA9m9MJxTFpAqjt+bM9an0wc=', 'Content-Length': '0'} 2024-04-16T18:18:12.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000befdbe100d9e335e-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.609 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.609 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.610 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.610 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.610 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.610 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.610 DEBUG:boto:Data: 2024-04-16T18:18:12.610 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.610 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.610 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.610 DEBUG:boto:Params: {} 2024-04-16T18:18:12.610 DEBUG:boto:Token: None 2024-04-16T18:18:12.611 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ieTuA9m9MJxTFpAqjt+bM9an0wc= 2024-04-16T18:18:12.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ieTuA9m9MJxTFpAqjt+bM9an0wc=', 'Content-Length': '0'} 2024-04-16T18:18:12.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007eb2866a7a65247c-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.613 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000042 2024-04-16T18:18:12.613 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.613 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.613 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.613 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.613 DEBUG:boto:Method: GET 2024-04-16T18:18:12.614 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.614 DEBUG:boto:Data: 2024-04-16T18:18:12.614 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.614 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.614 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.614 DEBUG:boto:Params: {} 2024-04-16T18:18:12.614 DEBUG:boto:Token: None 2024-04-16T18:18:12.614 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.614 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk= 2024-04-16T18:18:12.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk=', 'Content-Length': '0'} 2024-04-16T18:18:12.616 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e091e7ab93cd58c-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.658 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.658 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.659 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.659 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.659 DEBUG:boto:Method: GET 2024-04-16T18:18:12.659 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.659 DEBUG:boto:Data: 2024-04-16T18:18:12.659 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.659 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.659 DEBUG:boto:Params: {} 2024-04-16T18:18:12.659 DEBUG:boto:Token: None 2024-04-16T18:18:12.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042?versionId=null 2024-04-16T18:18:12.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk= 2024-04-16T18:18:12.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M31WepqSWVtP1yFOfdCYvY67Qrk=', 'Content-Length': '0'} 2024-04-16T18:18:12.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000151539e274c1fa3f-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.662 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.662 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.662 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.662 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.662 DEBUG:boto:Method: GET 2024-04-16T18:18:12.663 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.663 DEBUG:boto:Data: 2024-04-16T18:18:12.663 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.663 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.663 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.663 DEBUG:boto:Params: {} 2024-04-16T18:18:12.663 DEBUG:boto:Token: None 2024-04-16T18:18:12.663 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.666 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1413a7cbdcbf434-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.666 DEBUG:boto:b'cjqttm-51obj000000000000000000421000falseobj000000000000000000422024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.666 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.666 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.666 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.666 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.667 DEBUG:boto:Method: GET 2024-04-16T18:18:12.667 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.667 DEBUG:boto:Data: 2024-04-16T18:18:12.667 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.667 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.667 DEBUG:boto:Params: {} 2024-04-16T18:18:12.667 DEBUG:boto:Token: None 2024-04-16T18:18:12.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007abc1b5dbc62c94f-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.672 DEBUG:boto:b'cjqttm-51obj000000000000000000421000falseobj000000000000000000422024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.672 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.672 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.672 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.672 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.672 DEBUG:boto:Data: 2024-04-16T18:18:12.672 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.673 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.673 DEBUG:boto:Params: {} 2024-04-16T18:18:12.673 DEBUG:boto:Token: None 2024-04-16T18:18:12.673 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4yM36UDX36crijrBywoh7R4HXNQ= 2024-04-16T18:18:12.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4yM36UDX36crijrBywoh7R4HXNQ=', 'Content-Length': '0'} 2024-04-16T18:18:12.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000170982658679fb1e-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.675 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.675 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.675 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.675 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.675 DEBUG:boto:Data: 2024-04-16T18:18:12.675 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.675 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.676 DEBUG:boto:Params: {} 2024-04-16T18:18:12.676 DEBUG:boto:Token: None 2024-04-16T18:18:12.676 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4yM36UDX36crijrBywoh7R4HXNQ= 2024-04-16T18:18:12.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4yM36UDX36crijrBywoh7R4HXNQ=', 'Content-Length': '0'} 2024-04-16T18:18:12.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb8a984321fe622a-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000042 2024-04-16T18:18:12.678 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.679 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.679 DEBUG:boto:Method: GET 2024-04-16T18:18:12.679 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.679 DEBUG:boto:Data: 2024-04-16T18:18:12.679 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.679 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.679 DEBUG:boto:Params: {} 2024-04-16T18:18:12.679 DEBUG:boto:Token: None 2024-04-16T18:18:12.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qmqdrs6WnapzTDm9Cfxgo3rFjXg= 2024-04-16T18:18:12.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qmqdrs6WnapzTDm9Cfxgo3rFjXg=', 'Content-Length': '0'} 2024-04-16T18:18:12.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd704893379b44a4-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.722 DEBUG:boto:path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.722 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.722 DEBUG:boto:Method: GET 2024-04-16T18:18:12.723 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.723 DEBUG:boto:Data: 2024-04-16T18:18:12.723 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.723 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.723 DEBUG:boto:Params: {} 2024-04-16T18:18:12.723 DEBUG:boto:Token: None 2024-04-16T18:18:12.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000042 2024-04-16T18:18:12.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qmqdrs6WnapzTDm9Cfxgo3rFjXg= 2024-04-16T18:18:12.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qmqdrs6WnapzTDm9Cfxgo3rFjXg=', 'Content-Length': '0'} 2024-04-16T18:18:12.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c99587cdc9d42c5-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.726 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.726 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.726 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.726 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.726 DEBUG:boto:Method: GET 2024-04-16T18:18:12.726 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.726 DEBUG:boto:Data: 2024-04-16T18:18:12.726 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.726 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.726 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.727 DEBUG:boto:Params: {} 2024-04-16T18:18:12.727 DEBUG:boto:Token: None 2024-04-16T18:18:12.727 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.729 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000075a09d83310a9a0-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.770 DEBUG:boto:b'cjqttm-51obj000000000000000000421000falseobj000000000000000000422024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.771 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.771 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.771 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.771 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.771 DEBUG:boto:Method: GET 2024-04-16T18:18:12.771 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000042 2024-04-16T18:18:12.771 DEBUG:boto:Data: 2024-04-16T18:18:12.771 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.771 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.772 DEBUG:boto:Params: {} 2024-04-16T18:18:12.772 DEBUG:boto:Token: None 2024-04-16T18:18:12.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.776 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000067b119f4997b50c7-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.776 DEBUG:boto:b'cjqttm-51obj000000000000000000421000falseobj000000000000000000422024-04-16T18:17:57.215Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.776 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2024-04-16T18:18:12.776 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.776 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.776 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.777 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.777 DEBUG:boto:Method: GET 2024-04-16T18:18:12.777 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.777 DEBUG:boto:Data: 2024-04-16T18:18:12.777 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.777 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.777 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.777 DEBUG:boto:Params: {} 2024-04-16T18:18:12.777 DEBUG:boto:Token: None 2024-04-16T18:18:12.777 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0= 2024-04-16T18:18:12.778 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0=', 'Content-Length': '0'} 2024-04-16T18:18:12.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000194ff5c23bdfed56-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.822 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.822 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.823 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.823 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.823 DEBUG:boto:Method: GET 2024-04-16T18:18:12.823 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.823 DEBUG:boto:Data: 2024-04-16T18:18:12.823 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.823 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.823 DEBUG:boto:Params: {} 2024-04-16T18:18:12.823 DEBUG:boto:Token: None 2024-04-16T18:18:12.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0= 2024-04-16T18:18:12.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0=', 'Content-Length': '0'} 2024-04-16T18:18:12.826 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000775fff52a168c809-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.826 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.826 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.826 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.826 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.827 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.827 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.827 DEBUG:boto:Data: 2024-04-16T18:18:12.827 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.827 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.827 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.827 DEBUG:boto:Params: {} 2024-04-16T18:18:12.827 DEBUG:boto:Token: None 2024-04-16T18:18:12.827 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6M+Z+j8YBYH5xyJaO2F6e1sivAs= 2024-04-16T18:18:12.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6M+Z+j8YBYH5xyJaO2F6e1sivAs=', 'Content-Length': '0'} 2024-04-16T18:18:12.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023da8cfab35197fb-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.829 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.830 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.830 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.830 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.830 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.830 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.830 DEBUG:boto:Data: 2024-04-16T18:18:12.830 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.830 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.830 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.830 DEBUG:boto:Params: {} 2024-04-16T18:18:12.830 DEBUG:boto:Token: None 2024-04-16T18:18:12.831 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6M+Z+j8YBYH5xyJaO2F6e1sivAs= 2024-04-16T18:18:12.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6M+Z+j8YBYH5xyJaO2F6e1sivAs=', 'Content-Length': '0'} 2024-04-16T18:18:12.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002342ae94509cda3e-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.833 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2024-04-16T18:18:12.833 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.833 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.833 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.833 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.834 DEBUG:boto:Method: GET 2024-04-16T18:18:12.834 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.834 DEBUG:boto:Data: 2024-04-16T18:18:12.834 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.834 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.834 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.834 DEBUG:boto:Params: {} 2024-04-16T18:18:12.834 DEBUG:boto:Token: None 2024-04-16T18:18:12.834 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.834 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0= 2024-04-16T18:18:12.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0=', 'Content-Length': '0'} 2024-04-16T18:18:12.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099aca172c286ed6a-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.879 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.879 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.879 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.879 DEBUG:boto:Method: GET 2024-04-16T18:18:12.879 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.879 DEBUG:boto:Data: 2024-04-16T18:18:12.879 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.880 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.880 DEBUG:boto:Params: {} 2024-04-16T18:18:12.880 DEBUG:boto:Token: None 2024-04-16T18:18:12.880 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045?versionId=null 2024-04-16T18:18:12.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0= 2024-04-16T18:18:12.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jikjxrMMuqmNwUWuCYoL8dXr1i0=', 'Content-Length': '0'} 2024-04-16T18:18:12.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b34d1b6cc955799d-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.883 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.883 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.883 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.883 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.883 DEBUG:boto:Method: GET 2024-04-16T18:18:12.883 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.883 DEBUG:boto:Data: 2024-04-16T18:18:12.883 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.883 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.883 DEBUG:boto:Params: {} 2024-04-16T18:18:12.884 DEBUG:boto:Token: None 2024-04-16T18:18:12.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054072a14749c0436-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.926 DEBUG:boto:b'cjqttm-51obj000000000000000000451000falseobj000000000000000000452024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.927 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.927 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.927 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.927 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.927 DEBUG:boto:Method: GET 2024-04-16T18:18:12.927 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.927 DEBUG:boto:Data: 2024-04-16T18:18:12.927 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.927 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.928 DEBUG:boto:Params: {} 2024-04-16T18:18:12.928 DEBUG:boto:Token: None 2024-04-16T18:18:12.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.932 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb69b398a378b730-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.932 DEBUG:boto:b'cjqttm-51obj000000000000000000451000falseobj000000000000000000452024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:12.932 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.932 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.933 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.933 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.933 DEBUG:boto:Data: 2024-04-16T18:18:12.933 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.933 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.933 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.933 DEBUG:boto:Params: {} 2024-04-16T18:18:12.933 DEBUG:boto:Token: None 2024-04-16T18:18:12.933 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.933 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7kN0Gi21TmUye7ztt8nC0ZwVIp4= 2024-04-16T18:18:12.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7kN0Gi21TmUye7ztt8nC0ZwVIp4=', 'Content-Length': '0'} 2024-04-16T18:18:12.935 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000749538190ed8c20d-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.936 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.936 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.936 DEBUG:boto:Method: HEAD 2024-04-16T18:18:12.936 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.936 DEBUG:boto:Data: 2024-04-16T18:18:12.936 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.936 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.936 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.936 DEBUG:boto:Params: {} 2024-04-16T18:18:12.937 DEBUG:boto:Token: None 2024-04-16T18:18:12.937 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.937 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7kN0Gi21TmUye7ztt8nC0ZwVIp4= 2024-04-16T18:18:12.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7kN0Gi21TmUye7ztt8nC0ZwVIp4=', 'Content-Length': '0'} 2024-04-16T18:18:12.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d7ab0ed6e015f19-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.939 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000045 2024-04-16T18:18:12.939 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.939 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.939 DEBUG:boto:Method: GET 2024-04-16T18:18:12.939 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.939 DEBUG:boto:Data: 2024-04-16T18:18:12.940 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.940 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.940 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.940 DEBUG:boto:Params: {} 2024-04-16T18:18:12.940 DEBUG:boto:Token: None 2024-04-16T18:18:12.940 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F4O+6vWd5nLdwTaSiZKYOWeBULo= 2024-04-16T18:18:12.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F4O+6vWd5nLdwTaSiZKYOWeBULo=', 'Content-Length': '0'} 2024-04-16T18:18:12.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1633f43f0138d55-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.982 DEBUG:boto:path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.983 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.983 DEBUG:boto:Method: GET 2024-04-16T18:18:12.983 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.983 DEBUG:boto:Data: 2024-04-16T18:18:12.983 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:12.983 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.983 DEBUG:boto:Params: {} 2024-04-16T18:18:12.983 DEBUG:boto:Token: None 2024-04-16T18:18:12.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/obj00000000000000000045 2024-04-16T18:18:12.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F4O+6vWd5nLdwTaSiZKYOWeBULo= 2024-04-16T18:18:12.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F4O+6vWd5nLdwTaSiZKYOWeBULo=', 'Content-Length': '0'} 2024-04-16T18:18:12.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b475dcb87a0ef03-00661ec0e4-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:12.986 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:12.986 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:12.986 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.986 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.986 DEBUG:boto:Method: GET 2024-04-16T18:18:12.986 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:12.986 DEBUG:boto:Data: 2024-04-16T18:18:12.987 DEBUG:boto:Headers: {} 2024-04-16T18:18:12.987 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:12.987 DEBUG:boto:Port: 8000 2024-04-16T18:18:12.987 DEBUG:boto:Params: {} 2024-04-16T18:18:12.987 DEBUG:boto:Token: None 2024-04-16T18:18:12.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:12 GMT /cjqttm-51/ 2024-04-16T18:18:12.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30= 2024-04-16T18:18:12.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TXjw/ErDP/lprOgUMBgNTnCaE30=', 'Content-Length': '0'} 2024-04-16T18:18:12.989 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7dc8f6f832b551b-00661ec0e4-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.030 DEBUG:boto:b'cjqttm-51obj000000000000000000451000falseobj000000000000000000452024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.031 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.031 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.031 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:13.031 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:13.031 DEBUG:boto:Method: GET 2024-04-16T18:18:13.031 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000045 2024-04-16T18:18:13.031 DEBUG:boto:Data: 2024-04-16T18:18:13.031 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.032 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.032 DEBUG:boto:Params: {} 2024-04-16T18:18:13.032 DEBUG:boto:Token: None 2024-04-16T18:18:13.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.036 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa210b6216632c06-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.036 DEBUG:boto:b'cjqttm-51obj000000000000000000451000falseobj000000000000000000452024-04-16T18:17:59.335Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.036 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000046 2024-04-16T18:18:13.037 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.037 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.037 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.037 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.037 DEBUG:boto:Method: GET 2024-04-16T18:18:13.037 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.037 DEBUG:boto:Data: 2024-04-16T18:18:13.037 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.037 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.038 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.038 DEBUG:boto:Params: {} 2024-04-16T18:18:13.038 DEBUG:boto:Token: None 2024-04-16T18:18:13.038 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.038 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU= 2024-04-16T18:18:13.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU=', 'Content-Length': '0'} 2024-04-16T18:18:13.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a970fcf9cc1f879c-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.082 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.082 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.083 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.083 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.083 DEBUG:boto:Method: GET 2024-04-16T18:18:13.083 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.083 DEBUG:boto:Data: 2024-04-16T18:18:13.083 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.083 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.083 DEBUG:boto:Params: {} 2024-04-16T18:18:13.083 DEBUG:boto:Token: None 2024-04-16T18:18:13.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU= 2024-04-16T18:18:13.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU=', 'Content-Length': '0'} 2024-04-16T18:18:13.086 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000160ca02c559d6aa1-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.086 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.086 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.087 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.087 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.087 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.087 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.087 DEBUG:boto:Data: 2024-04-16T18:18:13.087 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.087 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.087 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.087 DEBUG:boto:Params: {} 2024-04-16T18:18:13.087 DEBUG:boto:Token: None 2024-04-16T18:18:13.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:23vEAnD1abol41JSthr8x8Ze3d4= 2024-04-16T18:18:13.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:23vEAnD1abol41JSthr8x8Ze3d4=', 'Content-Length': '0'} 2024-04-16T18:18:13.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085c62f69958f05c1-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.090 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.090 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.090 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.090 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.090 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.090 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.090 DEBUG:boto:Data: 2024-04-16T18:18:13.090 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.090 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.091 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.091 DEBUG:boto:Params: {} 2024-04-16T18:18:13.091 DEBUG:boto:Token: None 2024-04-16T18:18:13.091 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:23vEAnD1abol41JSthr8x8Ze3d4= 2024-04-16T18:18:13.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:23vEAnD1abol41JSthr8x8Ze3d4=', 'Content-Length': '0'} 2024-04-16T18:18:13.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a24b0fdb52d259f6-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000046 2024-04-16T18:18:13.093 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.093 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.094 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.094 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.094 DEBUG:boto:Method: GET 2024-04-16T18:18:13.094 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.094 DEBUG:boto:Data: 2024-04-16T18:18:13.094 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.094 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.094 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.094 DEBUG:boto:Params: {} 2024-04-16T18:18:13.095 DEBUG:boto:Token: None 2024-04-16T18:18:13.095 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.095 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU= 2024-04-16T18:18:13.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU=', 'Content-Length': '0'} 2024-04-16T18:18:13.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094129859d1587b71-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.138 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.139 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.139 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.139 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.139 DEBUG:boto:Method: GET 2024-04-16T18:18:13.139 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.139 DEBUG:boto:Data: 2024-04-16T18:18:13.139 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.139 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.139 DEBUG:boto:Params: {} 2024-04-16T18:18:13.140 DEBUG:boto:Token: None 2024-04-16T18:18:13.140 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046?versionId=null 2024-04-16T18:18:13.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU= 2024-04-16T18:18:13.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q6iwqURVKKSN620mr/GWr9AqUtU=', 'Content-Length': '0'} 2024-04-16T18:18:13.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000200a617492df6d56-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.142 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.142 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.142 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.143 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.143 DEBUG:boto:Method: GET 2024-04-16T18:18:13.143 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.143 DEBUG:boto:Data: 2024-04-16T18:18:13.143 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.143 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.143 DEBUG:boto:Params: {} 2024-04-16T18:18:13.143 DEBUG:boto:Token: None 2024-04-16T18:18:13.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.146 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042881b6e616282a2-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.186 DEBUG:boto:b'cjqttm-51obj000000000000000000461000falseobj000000000000000000462024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.187 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.187 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.187 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.187 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.187 DEBUG:boto:Method: GET 2024-04-16T18:18:13.187 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.187 DEBUG:boto:Data: 2024-04-16T18:18:13.187 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.187 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.187 DEBUG:boto:Params: {} 2024-04-16T18:18:13.188 DEBUG:boto:Token: None 2024-04-16T18:18:13.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.192 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e40765cbb353528-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.192 DEBUG:boto:b'cjqttm-51obj000000000000000000461000falseobj000000000000000000462024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.192 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.193 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.193 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.193 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.193 DEBUG:boto:Data: 2024-04-16T18:18:13.193 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.193 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.193 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.193 DEBUG:boto:Params: {} 2024-04-16T18:18:13.193 DEBUG:boto:Token: None 2024-04-16T18:18:13.193 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.194 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AI/GOxw5uClqe57z1NtKbG8beF0= 2024-04-16T18:18:13.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AI/GOxw5uClqe57z1NtKbG8beF0=', 'Content-Length': '0'} 2024-04-16T18:18:13.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074b54e8f839de3ef-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.196 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.196 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.196 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.196 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.196 DEBUG:boto:Data: 2024-04-16T18:18:13.196 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.196 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.196 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.196 DEBUG:boto:Params: {} 2024-04-16T18:18:13.196 DEBUG:boto:Token: None 2024-04-16T18:18:13.197 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.197 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AI/GOxw5uClqe57z1NtKbG8beF0= 2024-04-16T18:18:13.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AI/GOxw5uClqe57z1NtKbG8beF0=', 'Content-Length': '0'} 2024-04-16T18:18:13.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfe861cbe33a7b01-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000046 2024-04-16T18:18:13.199 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.199 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.199 DEBUG:boto:Method: GET 2024-04-16T18:18:13.199 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.199 DEBUG:boto:Data: 2024-04-16T18:18:13.199 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.199 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.199 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.199 DEBUG:boto:Params: {} 2024-04-16T18:18:13.199 DEBUG:boto:Token: None 2024-04-16T18:18:13.200 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iMgnPLU0Pc83CjZJi0R/9JPLjwE= 2024-04-16T18:18:13.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMgnPLU0Pc83CjZJi0R/9JPLjwE=', 'Content-Length': '0'} 2024-04-16T18:18:13.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0ab0bfe3897c789-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.242 DEBUG:boto:path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.243 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.243 DEBUG:boto:Method: GET 2024-04-16T18:18:13.243 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.243 DEBUG:boto:Data: 2024-04-16T18:18:13.243 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.243 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.243 DEBUG:boto:Params: {} 2024-04-16T18:18:13.243 DEBUG:boto:Token: None 2024-04-16T18:18:13.243 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000046 2024-04-16T18:18:13.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iMgnPLU0Pc83CjZJi0R/9JPLjwE= 2024-04-16T18:18:13.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMgnPLU0Pc83CjZJi0R/9JPLjwE=', 'Content-Length': '0'} 2024-04-16T18:18:13.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011275045937117d5-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.246 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.246 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.246 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.246 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.246 DEBUG:boto:Method: GET 2024-04-16T18:18:13.246 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.246 DEBUG:boto:Data: 2024-04-16T18:18:13.246 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.246 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.247 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.247 DEBUG:boto:Params: {} 2024-04-16T18:18:13.247 DEBUG:boto:Token: None 2024-04-16T18:18:13.247 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.249 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001925c04d96519a58-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.249 DEBUG:boto:b'cjqttm-51obj000000000000000000461000falseobj000000000000000000462024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.250 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.250 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.250 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.250 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.250 DEBUG:boto:Method: GET 2024-04-16T18:18:13.250 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000046 2024-04-16T18:18:13.250 DEBUG:boto:Data: 2024-04-16T18:18:13.251 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.251 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.251 DEBUG:boto:Params: {} 2024-04-16T18:18:13.251 DEBUG:boto:Token: None 2024-04-16T18:18:13.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.255 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001001398640cac672-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.255 DEBUG:boto:b'cjqttm-51obj000000000000000000461000falseobj000000000000000000462024-04-16T18:17:56.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.255 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000048 2024-04-16T18:18:13.255 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.255 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.256 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.256 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.256 DEBUG:boto:Method: GET 2024-04-16T18:18:13.256 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.256 DEBUG:boto:Data: 2024-04-16T18:18:13.256 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.256 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.256 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.256 DEBUG:boto:Params: {} 2024-04-16T18:18:13.257 DEBUG:boto:Token: None 2024-04-16T18:18:13.257 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.257 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI= 2024-04-16T18:18:13.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI=', 'Content-Length': '0'} 2024-04-16T18:18:13.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005091564ba92ced8f-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.302 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.302 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.303 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.303 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.303 DEBUG:boto:Method: GET 2024-04-16T18:18:13.303 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.303 DEBUG:boto:Data: 2024-04-16T18:18:13.303 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.303 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.303 DEBUG:boto:Params: {} 2024-04-16T18:18:13.303 DEBUG:boto:Token: None 2024-04-16T18:18:13.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI= 2024-04-16T18:18:13.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI=', 'Content-Length': '0'} 2024-04-16T18:18:13.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a8ff16516237735-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.306 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.306 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.306 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.306 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.306 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.306 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.306 DEBUG:boto:Data: 2024-04-16T18:18:13.306 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.307 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.307 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.307 DEBUG:boto:Params: {} 2024-04-16T18:18:13.307 DEBUG:boto:Token: None 2024-04-16T18:18:13.307 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3bNOH8Z/PFOv+i6i4oCffO1v4mk= 2024-04-16T18:18:13.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3bNOH8Z/PFOv+i6i4oCffO1v4mk=', 'Content-Length': '0'} 2024-04-16T18:18:13.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4151ec61cdda143-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.309 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.310 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.310 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.310 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.310 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.310 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.310 DEBUG:boto:Data: 2024-04-16T18:18:13.310 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.310 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.310 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.310 DEBUG:boto:Params: {} 2024-04-16T18:18:13.310 DEBUG:boto:Token: None 2024-04-16T18:18:13.311 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3bNOH8Z/PFOv+i6i4oCffO1v4mk= 2024-04-16T18:18:13.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3bNOH8Z/PFOv+i6i4oCffO1v4mk=', 'Content-Length': '0'} 2024-04-16T18:18:13.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008837945a50fd4747-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000048 2024-04-16T18:18:13.313 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.314 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.314 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.314 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.314 DEBUG:boto:Method: GET 2024-04-16T18:18:13.314 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.314 DEBUG:boto:Data: 2024-04-16T18:18:13.314 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.314 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.314 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.314 DEBUG:boto:Params: {} 2024-04-16T18:18:13.315 DEBUG:boto:Token: None 2024-04-16T18:18:13.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI= 2024-04-16T18:18:13.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI=', 'Content-Length': '0'} 2024-04-16T18:18:13.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f844ab32677824e4-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.358 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.359 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.359 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.359 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.359 DEBUG:boto:Method: GET 2024-04-16T18:18:13.359 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.359 DEBUG:boto:Data: 2024-04-16T18:18:13.359 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.359 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.359 DEBUG:boto:Params: {} 2024-04-16T18:18:13.360 DEBUG:boto:Token: None 2024-04-16T18:18:13.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048?versionId=null 2024-04-16T18:18:13.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI= 2024-04-16T18:18:13.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7+SbpNF4n8NMu0Vxzjnq/1SfZnI=', 'Content-Length': '0'} 2024-04-16T18:18:13.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3a174446b2d1caf-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.362 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.362 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.362 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.363 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.363 DEBUG:boto:Method: GET 2024-04-16T18:18:13.363 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.363 DEBUG:boto:Data: 2024-04-16T18:18:13.363 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.363 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.363 DEBUG:boto:Params: {} 2024-04-16T18:18:13.363 DEBUG:boto:Token: None 2024-04-16T18:18:13.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.366 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4a65277b44ab9b6-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.366 DEBUG:boto:b'cjqttm-51obj000000000000000000481000falseobj000000000000000000482024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.367 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.367 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.367 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.367 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.367 DEBUG:boto:Method: GET 2024-04-16T18:18:13.367 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.367 DEBUG:boto:Data: 2024-04-16T18:18:13.367 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.368 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.368 DEBUG:boto:Params: {} 2024-04-16T18:18:13.368 DEBUG:boto:Token: None 2024-04-16T18:18:13.368 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003286e9b824996e4f-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.372 DEBUG:boto:b'cjqttm-51obj000000000000000000481000falseobj000000000000000000482024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.372 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.372 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.373 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.373 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.373 DEBUG:boto:Data: 2024-04-16T18:18:13.373 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.373 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.373 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.373 DEBUG:boto:Params: {} 2024-04-16T18:18:13.373 DEBUG:boto:Token: None 2024-04-16T18:18:13.373 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.373 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l/XWRmxeBhiB9a5QCz/z1ZMd3eI= 2024-04-16T18:18:13.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l/XWRmxeBhiB9a5QCz/z1ZMd3eI=', 'Content-Length': '0'} 2024-04-16T18:18:13.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000897f59b169b81a63-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.376 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.376 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.376 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.376 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.376 DEBUG:boto:Data: 2024-04-16T18:18:13.376 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.376 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.376 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.377 DEBUG:boto:Params: {} 2024-04-16T18:18:13.377 DEBUG:boto:Token: None 2024-04-16T18:18:13.377 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.377 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l/XWRmxeBhiB9a5QCz/z1ZMd3eI= 2024-04-16T18:18:13.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l/XWRmxeBhiB9a5QCz/z1ZMd3eI=', 'Content-Length': '0'} 2024-04-16T18:18:13.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a4fe6157dd7ec8a-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000048 2024-04-16T18:18:13.380 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.380 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.380 DEBUG:boto:Method: GET 2024-04-16T18:18:13.380 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.380 DEBUG:boto:Data: 2024-04-16T18:18:13.380 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.380 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.380 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.380 DEBUG:boto:Params: {} 2024-04-16T18:18:13.380 DEBUG:boto:Token: None 2024-04-16T18:18:13.380 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.381 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:anR8FVfzXV5t8EF0wdKN1Sv4fs0= 2024-04-16T18:18:13.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:anR8FVfzXV5t8EF0wdKN1Sv4fs0=', 'Content-Length': '0'} 2024-04-16T18:18:13.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff9d66946f017cc1-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.426 DEBUG:boto:path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.427 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.427 DEBUG:boto:Method: GET 2024-04-16T18:18:13.427 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.427 DEBUG:boto:Data: 2024-04-16T18:18:13.428 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.428 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.428 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.428 DEBUG:boto:Params: {} 2024-04-16T18:18:13.429 DEBUG:boto:Token: None 2024-04-16T18:18:13.429 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000048 2024-04-16T18:18:13.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:anR8FVfzXV5t8EF0wdKN1Sv4fs0= 2024-04-16T18:18:13.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:anR8FVfzXV5t8EF0wdKN1Sv4fs0=', 'Content-Length': '0'} 2024-04-16T18:18:13.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058e4638490f2f393-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.431 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.432 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.432 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.432 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.432 DEBUG:boto:Method: GET 2024-04-16T18:18:13.432 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.432 DEBUG:boto:Data: 2024-04-16T18:18:13.432 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.432 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.432 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.432 DEBUG:boto:Params: {} 2024-04-16T18:18:13.432 DEBUG:boto:Token: None 2024-04-16T18:18:13.433 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.433 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.433 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.435 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057c75e85e501455e-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.435 DEBUG:boto:b'cjqttm-51obj000000000000000000481000falseobj000000000000000000482024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.435 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.435 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.436 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.436 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.436 DEBUG:boto:Method: GET 2024-04-16T18:18:13.436 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000048 2024-04-16T18:18:13.436 DEBUG:boto:Data: 2024-04-16T18:18:13.436 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.436 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.436 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.436 DEBUG:boto:Params: {} 2024-04-16T18:18:13.436 DEBUG:boto:Token: None 2024-04-16T18:18:13.437 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.437 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.440 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b168e0407314974f-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.482 DEBUG:boto:b'cjqttm-51obj000000000000000000481000falseobj000000000000000000482024-04-16T18:17:59.683Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.483 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2024-04-16T18:18:13.483 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.483 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.483 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.483 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.483 DEBUG:boto:Method: GET 2024-04-16T18:18:13.483 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.483 DEBUG:boto:Data: 2024-04-16T18:18:13.483 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.484 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.484 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.484 DEBUG:boto:Params: {} 2024-04-16T18:18:13.484 DEBUG:boto:Token: None 2024-04-16T18:18:13.484 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU= 2024-04-16T18:18:13.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU=', 'Content-Length': '0'} 2024-04-16T18:18:13.486 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b953eee7858ec71-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.530 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.531 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.531 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.531 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.531 DEBUG:boto:Method: GET 2024-04-16T18:18:13.531 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.531 DEBUG:boto:Data: 2024-04-16T18:18:13.531 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.531 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.531 DEBUG:boto:Params: {} 2024-04-16T18:18:13.532 DEBUG:boto:Token: None 2024-04-16T18:18:13.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU= 2024-04-16T18:18:13.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU=', 'Content-Length': '0'} 2024-04-16T18:18:13.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080ea00fd02280fe8-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.534 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.534 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.534 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.534 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.535 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.535 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.535 DEBUG:boto:Data: 2024-04-16T18:18:13.535 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.535 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.535 DEBUG:boto:Params: {} 2024-04-16T18:18:13.535 DEBUG:boto:Token: None 2024-04-16T18:18:13.535 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L4QRHPGWN3DhXTesl1gcrJEeyXE= 2024-04-16T18:18:13.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L4QRHPGWN3DhXTesl1gcrJEeyXE=', 'Content-Length': '0'} 2024-04-16T18:18:13.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fde96f47596f97c0-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.537 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.538 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.538 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.538 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.538 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.538 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.538 DEBUG:boto:Data: 2024-04-16T18:18:13.538 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.538 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.539 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.539 DEBUG:boto:Params: {} 2024-04-16T18:18:13.539 DEBUG:boto:Token: None 2024-04-16T18:18:13.539 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L4QRHPGWN3DhXTesl1gcrJEeyXE= 2024-04-16T18:18:13.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L4QRHPGWN3DhXTesl1gcrJEeyXE=', 'Content-Length': '0'} 2024-04-16T18:18:13.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000323ce16e2cf52a9f-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.541 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2024-04-16T18:18:13.541 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.541 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.541 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.541 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.541 DEBUG:boto:Method: GET 2024-04-16T18:18:13.542 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.542 DEBUG:boto:Data: 2024-04-16T18:18:13.542 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.542 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.542 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.542 DEBUG:boto:Params: {} 2024-04-16T18:18:13.542 DEBUG:boto:Token: None 2024-04-16T18:18:13.542 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.542 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU= 2024-04-16T18:18:13.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU=', 'Content-Length': '0'} 2024-04-16T18:18:13.544 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003633a43b17f864f2-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.586 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.587 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.587 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.587 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.587 DEBUG:boto:Method: GET 2024-04-16T18:18:13.587 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.587 DEBUG:boto:Data: 2024-04-16T18:18:13.587 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.587 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.587 DEBUG:boto:Params: {} 2024-04-16T18:18:13.588 DEBUG:boto:Token: None 2024-04-16T18:18:13.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049?versionId=null 2024-04-16T18:18:13.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU= 2024-04-16T18:18:13.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDCQ0QscNRV5vE/Z1+GRBAiyphU=', 'Content-Length': '0'} 2024-04-16T18:18:13.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d838a7fdfe5af7b2-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.590 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.590 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.590 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.591 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.591 DEBUG:boto:Method: GET 2024-04-16T18:18:13.591 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.591 DEBUG:boto:Data: 2024-04-16T18:18:13.591 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.591 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.591 DEBUG:boto:Params: {} 2024-04-16T18:18:13.591 DEBUG:boto:Token: None 2024-04-16T18:18:13.592 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e76de1d2a055bdde-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.634 DEBUG:boto:b'cjqttm-51obj000000000000000000491000falseobj000000000000000000492024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.635 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.635 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.635 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.635 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.635 DEBUG:boto:Method: GET 2024-04-16T18:18:13.635 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.635 DEBUG:boto:Data: 2024-04-16T18:18:13.635 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.635 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.635 DEBUG:boto:Params: {} 2024-04-16T18:18:13.636 DEBUG:boto:Token: None 2024-04-16T18:18:13.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005135df678ae5e450-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.640 DEBUG:boto:b'cjqttm-51obj000000000000000000491000falseobj000000000000000000492024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.640 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.641 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.641 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.641 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.641 DEBUG:boto:Data: 2024-04-16T18:18:13.641 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.641 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.641 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.641 DEBUG:boto:Params: {} 2024-04-16T18:18:13.641 DEBUG:boto:Token: None 2024-04-16T18:18:13.641 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.642 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pYuuIQ6O6M0l3K8YEOpqUDNW0Jk= 2024-04-16T18:18:13.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pYuuIQ6O6M0l3K8YEOpqUDNW0Jk=', 'Content-Length': '0'} 2024-04-16T18:18:13.643 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfb2b9581e855307-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.644 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.644 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.644 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.644 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.644 DEBUG:boto:Data: 2024-04-16T18:18:13.644 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.644 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.644 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.645 DEBUG:boto:Params: {} 2024-04-16T18:18:13.645 DEBUG:boto:Token: None 2024-04-16T18:18:13.645 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.645 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pYuuIQ6O6M0l3K8YEOpqUDNW0Jk= 2024-04-16T18:18:13.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pYuuIQ6O6M0l3K8YEOpqUDNW0Jk=', 'Content-Length': '0'} 2024-04-16T18:18:13.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ba2993b916b11e0-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.647 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000049 2024-04-16T18:18:13.647 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.647 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.647 DEBUG:boto:Method: GET 2024-04-16T18:18:13.648 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.648 DEBUG:boto:Data: 2024-04-16T18:18:13.648 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.648 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.648 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.648 DEBUG:boto:Params: {} 2024-04-16T18:18:13.648 DEBUG:boto:Token: None 2024-04-16T18:18:13.648 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T5LZ/W3n2Otb/l/Vw/GnZRz5w5A= 2024-04-16T18:18:13.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T5LZ/W3n2Otb/l/Vw/GnZRz5w5A=', 'Content-Length': '0'} 2024-04-16T18:18:13.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c7e521f608c47ab-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.690 DEBUG:boto:path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.691 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.691 DEBUG:boto:Method: GET 2024-04-16T18:18:13.691 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.691 DEBUG:boto:Data: 2024-04-16T18:18:13.691 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.691 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.691 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.691 DEBUG:boto:Params: {} 2024-04-16T18:18:13.691 DEBUG:boto:Token: None 2024-04-16T18:18:13.691 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000049 2024-04-16T18:18:13.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T5LZ/W3n2Otb/l/Vw/GnZRz5w5A= 2024-04-16T18:18:13.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T5LZ/W3n2Otb/l/Vw/GnZRz5w5A=', 'Content-Length': '0'} 2024-04-16T18:18:13.694 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f555810cabc4c28b-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.694 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.694 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.694 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.694 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.694 DEBUG:boto:Method: GET 2024-04-16T18:18:13.695 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.695 DEBUG:boto:Data: 2024-04-16T18:18:13.695 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.695 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.695 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.695 DEBUG:boto:Params: {} 2024-04-16T18:18:13.695 DEBUG:boto:Token: None 2024-04-16T18:18:13.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd6296ec51be0906-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.738 DEBUG:boto:b'cjqttm-51obj000000000000000000491000falseobj000000000000000000492024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.739 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.739 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.739 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.739 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.739 DEBUG:boto:Method: GET 2024-04-16T18:18:13.739 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000049 2024-04-16T18:18:13.739 DEBUG:boto:Data: 2024-04-16T18:18:13.739 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.740 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.740 DEBUG:boto:Params: {} 2024-04-16T18:18:13.740 DEBUG:boto:Token: None 2024-04-16T18:18:13.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009878b435571ddfe7-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.745 DEBUG:boto:b'cjqttm-51obj000000000000000000491000falseobj000000000000000000492024-04-16T18:17:57.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2024-04-16T18:18:13.745 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.745 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.745 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.746 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.746 DEBUG:boto:Method: GET 2024-04-16T18:18:13.746 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.746 DEBUG:boto:Data: 2024-04-16T18:18:13.746 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.746 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.746 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.746 DEBUG:boto:Params: {} 2024-04-16T18:18:13.746 DEBUG:boto:Token: None 2024-04-16T18:18:13.746 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks= 2024-04-16T18:18:13.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks=', 'Content-Length': '0'} 2024-04-16T18:18:13.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000728041b3bab3d7b9-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.790 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.790 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.791 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.791 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.791 DEBUG:boto:Method: GET 2024-04-16T18:18:13.791 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.791 DEBUG:boto:Data: 2024-04-16T18:18:13.791 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.791 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.791 DEBUG:boto:Params: {} 2024-04-16T18:18:13.791 DEBUG:boto:Token: None 2024-04-16T18:18:13.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks= 2024-04-16T18:18:13.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks=', 'Content-Length': '0'} 2024-04-16T18:18:13.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014dd3709bb1c5df1-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.794 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.795 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.795 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.795 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.795 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.795 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.795 DEBUG:boto:Data: 2024-04-16T18:18:13.795 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.795 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.795 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.795 DEBUG:boto:Params: {} 2024-04-16T18:18:13.795 DEBUG:boto:Token: None 2024-04-16T18:18:13.796 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMcvwWeUKALuadGXCX/gKJWYnAc= 2024-04-16T18:18:13.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMcvwWeUKALuadGXCX/gKJWYnAc=', 'Content-Length': '0'} 2024-04-16T18:18:13.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000384fe5af29a1f04a-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.798 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.798 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.798 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.799 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.799 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.799 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.799 DEBUG:boto:Data: 2024-04-16T18:18:13.799 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.799 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.799 DEBUG:boto:Params: {} 2024-04-16T18:18:13.799 DEBUG:boto:Token: None 2024-04-16T18:18:13.800 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMcvwWeUKALuadGXCX/gKJWYnAc= 2024-04-16T18:18:13.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMcvwWeUKALuadGXCX/gKJWYnAc=', 'Content-Length': '0'} 2024-04-16T18:18:13.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033fca74e50a640d0-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.802 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2024-04-16T18:18:13.802 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.802 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.802 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.802 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.802 DEBUG:boto:Method: GET 2024-04-16T18:18:13.803 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.803 DEBUG:boto:Data: 2024-04-16T18:18:13.803 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.803 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.803 DEBUG:boto:Params: {} 2024-04-16T18:18:13.803 DEBUG:boto:Token: None 2024-04-16T18:18:13.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks= 2024-04-16T18:18:13.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks=', 'Content-Length': '0'} 2024-04-16T18:18:13.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ba015e8c77da2df-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.846 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.846 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.846 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.847 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.847 DEBUG:boto:Method: GET 2024-04-16T18:18:13.847 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.847 DEBUG:boto:Data: 2024-04-16T18:18:13.847 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.847 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.847 DEBUG:boto:Params: {} 2024-04-16T18:18:13.847 DEBUG:boto:Token: None 2024-04-16T18:18:13.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050?versionId=null 2024-04-16T18:18:13.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks= 2024-04-16T18:18:13.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zOqmbj/9AgKnfcDJpKjfY0SK2Ks=', 'Content-Length': '0'} 2024-04-16T18:18:13.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9a37f439365c3bd-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.850 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.850 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.850 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.850 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.850 DEBUG:boto:Method: GET 2024-04-16T18:18:13.850 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.851 DEBUG:boto:Data: 2024-04-16T18:18:13.851 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.851 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.851 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.851 DEBUG:boto:Params: {} 2024-04-16T18:18:13.851 DEBUG:boto:Token: None 2024-04-16T18:18:13.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.854 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000507ff1253d62fcdc-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.894 DEBUG:boto:b'cjqttm-51obj000000000000000000501000falseobj000000000000000000502024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.895 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.895 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.895 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.895 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.895 DEBUG:boto:Method: GET 2024-04-16T18:18:13.895 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.895 DEBUG:boto:Data: 2024-04-16T18:18:13.895 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.896 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.896 DEBUG:boto:Params: {} 2024-04-16T18:18:13.896 DEBUG:boto:Token: None 2024-04-16T18:18:13.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096abc83cf5217eb9-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.900 DEBUG:boto:b'cjqttm-51obj000000000000000000501000falseobj000000000000000000502024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.900 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.901 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.901 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.901 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.901 DEBUG:boto:Data: 2024-04-16T18:18:13.901 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.901 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.901 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.901 DEBUG:boto:Params: {} 2024-04-16T18:18:13.901 DEBUG:boto:Token: None 2024-04-16T18:18:13.901 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.902 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UD85HoyYxiHWmUVtRWsCxWQ7hpg= 2024-04-16T18:18:13.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UD85HoyYxiHWmUVtRWsCxWQ7hpg=', 'Content-Length': '0'} 2024-04-16T18:18:13.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e09312e02d2fcd3d-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.904 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.904 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.904 DEBUG:boto:Method: HEAD 2024-04-16T18:18:13.904 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.904 DEBUG:boto:Data: 2024-04-16T18:18:13.904 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.904 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.904 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.904 DEBUG:boto:Params: {} 2024-04-16T18:18:13.904 DEBUG:boto:Token: None 2024-04-16T18:18:13.905 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.905 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UD85HoyYxiHWmUVtRWsCxWQ7hpg= 2024-04-16T18:18:13.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UD85HoyYxiHWmUVtRWsCxWQ7hpg=', 'Content-Length': '0'} 2024-04-16T18:18:13.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecb263d034a80f0c-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.907 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000050 2024-04-16T18:18:13.907 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.907 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.907 DEBUG:boto:Method: GET 2024-04-16T18:18:13.907 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.907 DEBUG:boto:Data: 2024-04-16T18:18:13.907 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.907 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.907 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.908 DEBUG:boto:Params: {} 2024-04-16T18:18:13.908 DEBUG:boto:Token: None 2024-04-16T18:18:13.908 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H60axB8gkPEu/6yafk2NVMd7IjE= 2024-04-16T18:18:13.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H60axB8gkPEu/6yafk2NVMd7IjE=', 'Content-Length': '0'} 2024-04-16T18:18:13.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e48c17624079a4e4-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.950 DEBUG:boto:path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.951 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.951 DEBUG:boto:Method: GET 2024-04-16T18:18:13.951 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.951 DEBUG:boto:Data: 2024-04-16T18:18:13.951 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.951 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.951 DEBUG:boto:Params: {} 2024-04-16T18:18:13.951 DEBUG:boto:Token: None 2024-04-16T18:18:13.952 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/obj00000000000000000050 2024-04-16T18:18:13.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H60axB8gkPEu/6yafk2NVMd7IjE= 2024-04-16T18:18:13.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H60axB8gkPEu/6yafk2NVMd7IjE=', 'Content-Length': '0'} 2024-04-16T18:18:13.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043402364c2a7f420-00661ec0e5-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.954 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.954 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.954 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.954 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.954 DEBUG:boto:Method: GET 2024-04-16T18:18:13.955 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.955 DEBUG:boto:Data: 2024-04-16T18:18:13.955 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.955 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:13.955 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.955 DEBUG:boto:Params: {} 2024-04-16T18:18:13.955 DEBUG:boto:Token: None 2024-04-16T18:18:13.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:13 GMT /cjqttm-51/ 2024-04-16T18:18:13.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME= 2024-04-16T18:18:13.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aHg9Zc+B7yCajZuX0Abdg/8GKME=', 'Content-Length': '0'} 2024-04-16T18:18:13.957 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec7360fde3ffc818-00661ec0e5-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:13.998 DEBUG:boto:b'cjqttm-51obj000000000000000000501000falseobj000000000000000000502024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:13.999 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:13.999 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:13.999 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.999 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.999 DEBUG:boto:Method: GET 2024-04-16T18:18:13.999 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000050 2024-04-16T18:18:13.999 DEBUG:boto:Data: 2024-04-16T18:18:13.999 DEBUG:boto:Headers: {} 2024-04-16T18:18:13.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:13.999 DEBUG:boto:Port: 8000 2024-04-16T18:18:13.999 DEBUG:boto:Params: {} 2024-04-16T18:18:14.000 DEBUG:boto:Token: None 2024-04-16T18:18:14.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc7434b930959cbd-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.004 DEBUG:boto:b'cjqttm-51obj000000000000000000501000falseobj000000000000000000502024-04-16T18:17:58.268Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2024-04-16T18:18:14.005 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.005 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.005 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.005 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.005 DEBUG:boto:Method: GET 2024-04-16T18:18:14.005 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.005 DEBUG:boto:Data: 2024-04-16T18:18:14.005 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.005 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.006 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.006 DEBUG:boto:Params: {} 2024-04-16T18:18:14.006 DEBUG:boto:Token: None 2024-04-16T18:18:14.006 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.006 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8= 2024-04-16T18:18:14.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8=', 'Content-Length': '0'} 2024-04-16T18:18:14.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0fba8380fd69ea0-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.050 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.050 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.051 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.051 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.051 DEBUG:boto:Method: GET 2024-04-16T18:18:14.051 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.051 DEBUG:boto:Data: 2024-04-16T18:18:14.051 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.051 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.051 DEBUG:boto:Params: {} 2024-04-16T18:18:14.051 DEBUG:boto:Token: None 2024-04-16T18:18:14.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8= 2024-04-16T18:18:14.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8=', 'Content-Length': '0'} 2024-04-16T18:18:14.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d634885acd09d10-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.054 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.054 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.054 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.055 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.055 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.055 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.055 DEBUG:boto:Data: 2024-04-16T18:18:14.055 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.055 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.055 DEBUG:boto:Params: {} 2024-04-16T18:18:14.055 DEBUG:boto:Token: None 2024-04-16T18:18:14.056 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tzfv7RHSlTp2psKzVX5atqDhJmM= 2024-04-16T18:18:14.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tzfv7RHSlTp2psKzVX5atqDhJmM=', 'Content-Length': '0'} 2024-04-16T18:18:14.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007b9830ae9ae9669b-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.058 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.058 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.059 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.059 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.059 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.059 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.059 DEBUG:boto:Data: 2024-04-16T18:18:14.059 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.059 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.059 DEBUG:boto:Params: {} 2024-04-16T18:18:14.059 DEBUG:boto:Token: None 2024-04-16T18:18:14.060 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tzfv7RHSlTp2psKzVX5atqDhJmM= 2024-04-16T18:18:14.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tzfv7RHSlTp2psKzVX5atqDhJmM=', 'Content-Length': '0'} 2024-04-16T18:18:14.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db08319281bfbd01-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.062 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2024-04-16T18:18:14.062 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.062 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.063 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.063 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.063 DEBUG:boto:Method: GET 2024-04-16T18:18:14.063 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.063 DEBUG:boto:Data: 2024-04-16T18:18:14.063 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.063 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.063 DEBUG:boto:Params: {} 2024-04-16T18:18:14.064 DEBUG:boto:Token: None 2024-04-16T18:18:14.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8= 2024-04-16T18:18:14.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8=', 'Content-Length': '0'} 2024-04-16T18:18:14.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5964544e2e51c65-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.110 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.110 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.110 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.111 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.111 DEBUG:boto:Method: GET 2024-04-16T18:18:14.111 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.111 DEBUG:boto:Data: 2024-04-16T18:18:14.111 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.111 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.111 DEBUG:boto:Params: {} 2024-04-16T18:18:14.111 DEBUG:boto:Token: None 2024-04-16T18:18:14.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053?versionId=null 2024-04-16T18:18:14.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8= 2024-04-16T18:18:14.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cvpZ64u+6XAkq6VBsXTJ+dBn+s8=', 'Content-Length': '0'} 2024-04-16T18:18:14.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004be7d7b914695aee-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.114 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.114 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.114 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.114 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.115 DEBUG:boto:Method: GET 2024-04-16T18:18:14.115 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.115 DEBUG:boto:Data: 2024-04-16T18:18:14.115 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.115 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.115 DEBUG:boto:Params: {} 2024-04-16T18:18:14.115 DEBUG:boto:Token: None 2024-04-16T18:18:14.115 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041c3c49d3034766f-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.158 DEBUG:boto:b'cjqttm-51obj000000000000000000531000falseobj000000000000000000532024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.159 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.159 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.159 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.160 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.160 DEBUG:boto:Method: GET 2024-04-16T18:18:14.160 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.160 DEBUG:boto:Data: 2024-04-16T18:18:14.160 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.160 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.160 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.160 DEBUG:boto:Params: {} 2024-04-16T18:18:14.160 DEBUG:boto:Token: None 2024-04-16T18:18:14.161 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.161 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a71d3bbac4066c03-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.165 DEBUG:boto:b'cjqttm-51obj000000000000000000531000falseobj000000000000000000532024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.165 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.165 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.165 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.166 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.166 DEBUG:boto:Data: 2024-04-16T18:18:14.166 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.166 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.166 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.166 DEBUG:boto:Params: {} 2024-04-16T18:18:14.166 DEBUG:boto:Token: None 2024-04-16T18:18:14.166 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nYdGQTx5v9znM/+3qPss46SVdXU= 2024-04-16T18:18:14.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nYdGQTx5v9znM/+3qPss46SVdXU=', 'Content-Length': '0'} 2024-04-16T18:18:14.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd7573279de43536-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.169 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.169 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.169 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.169 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.169 DEBUG:boto:Data: 2024-04-16T18:18:14.169 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.169 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.169 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.170 DEBUG:boto:Params: {} 2024-04-16T18:18:14.170 DEBUG:boto:Token: None 2024-04-16T18:18:14.170 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nYdGQTx5v9znM/+3qPss46SVdXU= 2024-04-16T18:18:14.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nYdGQTx5v9znM/+3qPss46SVdXU=', 'Content-Length': '0'} 2024-04-16T18:18:14.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a58adfb26a9fb817-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.173 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000053 2024-04-16T18:18:14.173 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.174 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.174 DEBUG:boto:Method: GET 2024-04-16T18:18:14.174 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.174 DEBUG:boto:Data: 2024-04-16T18:18:14.174 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.174 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.174 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.174 DEBUG:boto:Params: {} 2024-04-16T18:18:14.175 DEBUG:boto:Token: None 2024-04-16T18:18:14.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yKlGnRLjqy4d57+ZlK63rgfriEM= 2024-04-16T18:18:14.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yKlGnRLjqy4d57+ZlK63rgfriEM=', 'Content-Length': '0'} 2024-04-16T18:18:14.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd9a00155c927a82-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.218 DEBUG:boto:path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.218 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.218 DEBUG:boto:Method: GET 2024-04-16T18:18:14.219 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.219 DEBUG:boto:Data: 2024-04-16T18:18:14.219 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.219 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.219 DEBUG:boto:Params: {} 2024-04-16T18:18:14.219 DEBUG:boto:Token: None 2024-04-16T18:18:14.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000053 2024-04-16T18:18:14.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yKlGnRLjqy4d57+ZlK63rgfriEM= 2024-04-16T18:18:14.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yKlGnRLjqy4d57+ZlK63rgfriEM=', 'Content-Length': '0'} 2024-04-16T18:18:14.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000644d089469a9e5e7-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.222 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.222 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.222 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.222 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.222 DEBUG:boto:Method: GET 2024-04-16T18:18:14.222 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.223 DEBUG:boto:Data: 2024-04-16T18:18:14.223 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.223 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.223 DEBUG:boto:Params: {} 2024-04-16T18:18:14.223 DEBUG:boto:Token: None 2024-04-16T18:18:14.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.226 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000074cda8c300d0516b-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.226 DEBUG:boto:b'cjqttm-51obj000000000000000000531000falseobj000000000000000000532024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.226 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.226 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.227 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.227 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.227 DEBUG:boto:Method: GET 2024-04-16T18:18:14.227 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000053 2024-04-16T18:18:14.227 DEBUG:boto:Data: 2024-04-16T18:18:14.227 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.227 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.227 DEBUG:boto:Params: {} 2024-04-16T18:18:14.227 DEBUG:boto:Token: None 2024-04-16T18:18:14.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.232 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d139876b6af08eac-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.232 DEBUG:boto:b'cjqttm-51obj000000000000000000531000falseobj000000000000000000532024-04-16T18:18:00.015Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.232 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000055 2024-04-16T18:18:14.232 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.233 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.233 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.233 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.233 DEBUG:boto:Method: GET 2024-04-16T18:18:14.233 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.233 DEBUG:boto:Data: 2024-04-16T18:18:14.233 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.233 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.233 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.233 DEBUG:boto:Params: {} 2024-04-16T18:18:14.234 DEBUG:boto:Token: None 2024-04-16T18:18:14.234 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.234 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys= 2024-04-16T18:18:14.234 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys=', 'Content-Length': '0'} 2024-04-16T18:18:14.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068ae278ae09542cc-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.278 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.278 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.279 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.279 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.279 DEBUG:boto:Method: GET 2024-04-16T18:18:14.279 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.279 DEBUG:boto:Data: 2024-04-16T18:18:14.279 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.279 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.279 DEBUG:boto:Params: {} 2024-04-16T18:18:14.279 DEBUG:boto:Token: None 2024-04-16T18:18:14.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys= 2024-04-16T18:18:14.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys=', 'Content-Length': '0'} 2024-04-16T18:18:14.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6a12fd34613d628-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.282 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.282 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.282 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.282 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.283 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.283 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.283 DEBUG:boto:Data: 2024-04-16T18:18:14.283 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.283 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.283 DEBUG:boto:Params: {} 2024-04-16T18:18:14.283 DEBUG:boto:Token: None 2024-04-16T18:18:14.283 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vZY0StQyfxVa/kAZi0Z1R7kCCbs= 2024-04-16T18:18:14.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vZY0StQyfxVa/kAZi0Z1R7kCCbs=', 'Content-Length': '0'} 2024-04-16T18:18:14.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c83207d5f87c23b2-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.286 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.286 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.286 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.286 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.286 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.286 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.286 DEBUG:boto:Data: 2024-04-16T18:18:14.287 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.287 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.287 DEBUG:boto:Params: {} 2024-04-16T18:18:14.287 DEBUG:boto:Token: None 2024-04-16T18:18:14.287 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vZY0StQyfxVa/kAZi0Z1R7kCCbs= 2024-04-16T18:18:14.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vZY0StQyfxVa/kAZi0Z1R7kCCbs=', 'Content-Length': '0'} 2024-04-16T18:18:14.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073abf104ec0af956-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000055 2024-04-16T18:18:14.290 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.290 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.290 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.290 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.290 DEBUG:boto:Method: GET 2024-04-16T18:18:14.290 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.290 DEBUG:boto:Data: 2024-04-16T18:18:14.290 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.291 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.291 DEBUG:boto:Params: {} 2024-04-16T18:18:14.291 DEBUG:boto:Token: None 2024-04-16T18:18:14.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys= 2024-04-16T18:18:14.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys=', 'Content-Length': '0'} 2024-04-16T18:18:14.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d32e8699da571f9f-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.334 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.334 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.335 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.335 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.335 DEBUG:boto:Method: GET 2024-04-16T18:18:14.335 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.335 DEBUG:boto:Data: 2024-04-16T18:18:14.335 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.335 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.335 DEBUG:boto:Params: {} 2024-04-16T18:18:14.335 DEBUG:boto:Token: None 2024-04-16T18:18:14.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055?versionId=null 2024-04-16T18:18:14.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys= 2024-04-16T18:18:14.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPcazPiIIWngVdVrKmGgs+6GPys=', 'Content-Length': '0'} 2024-04-16T18:18:14.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f335771229666cce-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.338 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.338 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.338 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.338 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.338 DEBUG:boto:Method: GET 2024-04-16T18:18:14.338 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.339 DEBUG:boto:Data: 2024-04-16T18:18:14.339 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.339 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.339 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.339 DEBUG:boto:Params: {} 2024-04-16T18:18:14.339 DEBUG:boto:Token: None 2024-04-16T18:18:14.339 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.339 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.342 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3bb247bf7c76983-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.342 DEBUG:boto:b'cjqttm-51obj000000000000000000551000falseobj000000000000000000552024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.342 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.342 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.342 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.343 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.343 DEBUG:boto:Method: GET 2024-04-16T18:18:14.343 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.343 DEBUG:boto:Data: 2024-04-16T18:18:14.343 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.343 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.343 DEBUG:boto:Params: {} 2024-04-16T18:18:14.344 DEBUG:boto:Token: None 2024-04-16T18:18:14.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051a557d935c0ca11-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.348 DEBUG:boto:b'cjqttm-51obj000000000000000000551000falseobj000000000000000000552024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.348 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.349 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.349 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.349 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.349 DEBUG:boto:Data: 2024-04-16T18:18:14.349 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.349 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.349 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.349 DEBUG:boto:Params: {} 2024-04-16T18:18:14.349 DEBUG:boto:Token: None 2024-04-16T18:18:14.350 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwF3ehWQAoImM6y4gwvpPax5o0Q= 2024-04-16T18:18:14.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwF3ehWQAoImM6y4gwvpPax5o0Q=', 'Content-Length': '0'} 2024-04-16T18:18:14.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064a399d84f05afe8-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.352 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.352 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.352 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.352 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.353 DEBUG:boto:Data: 2024-04-16T18:18:14.353 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.353 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.353 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.353 DEBUG:boto:Params: {} 2024-04-16T18:18:14.353 DEBUG:boto:Token: None 2024-04-16T18:18:14.353 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwF3ehWQAoImM6y4gwvpPax5o0Q= 2024-04-16T18:18:14.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwF3ehWQAoImM6y4gwvpPax5o0Q=', 'Content-Length': '0'} 2024-04-16T18:18:14.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8855a5ef3cd7682-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.355 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000055 2024-04-16T18:18:14.355 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.356 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.356 DEBUG:boto:Method: GET 2024-04-16T18:18:14.356 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.356 DEBUG:boto:Data: 2024-04-16T18:18:14.356 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.356 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.356 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.356 DEBUG:boto:Params: {} 2024-04-16T18:18:14.356 DEBUG:boto:Token: None 2024-04-16T18:18:14.356 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.357 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k8SfPsPTN3Psah3mbr+PE1ZzTp0= 2024-04-16T18:18:14.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k8SfPsPTN3Psah3mbr+PE1ZzTp0=', 'Content-Length': '0'} 2024-04-16T18:18:14.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f741812bfe27978-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.406 DEBUG:boto:path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.406 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.407 DEBUG:boto:Method: GET 2024-04-16T18:18:14.407 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.407 DEBUG:boto:Data: 2024-04-16T18:18:14.407 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.407 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.407 DEBUG:boto:Params: {} 2024-04-16T18:18:14.407 DEBUG:boto:Token: None 2024-04-16T18:18:14.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000055 2024-04-16T18:18:14.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k8SfPsPTN3Psah3mbr+PE1ZzTp0= 2024-04-16T18:18:14.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k8SfPsPTN3Psah3mbr+PE1ZzTp0=', 'Content-Length': '0'} 2024-04-16T18:18:14.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef0b55bf662b8f30-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.410 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.410 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.410 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.410 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.410 DEBUG:boto:Method: GET 2024-04-16T18:18:14.410 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.410 DEBUG:boto:Data: 2024-04-16T18:18:14.411 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.411 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.411 DEBUG:boto:Params: {} 2024-04-16T18:18:14.411 DEBUG:boto:Token: None 2024-04-16T18:18:14.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000790a236dad114c32-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.414 DEBUG:boto:b'cjqttm-51obj000000000000000000551000falseobj000000000000000000552024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.414 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.414 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.415 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.415 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.415 DEBUG:boto:Method: GET 2024-04-16T18:18:14.415 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000055 2024-04-16T18:18:14.415 DEBUG:boto:Data: 2024-04-16T18:18:14.415 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.415 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.415 DEBUG:boto:Params: {} 2024-04-16T18:18:14.415 DEBUG:boto:Token: None 2024-04-16T18:18:14.416 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.419 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000836acfa3a523021a-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.420 DEBUG:boto:b'cjqttm-51obj000000000000000000551000falseobj000000000000000000552024-04-16T18:17:56.614Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2024-04-16T18:18:14.420 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.420 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.420 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.421 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.421 DEBUG:boto:Method: GET 2024-04-16T18:18:14.421 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.421 DEBUG:boto:Data: 2024-04-16T18:18:14.421 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.421 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.421 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.421 DEBUG:boto:Params: {} 2024-04-16T18:18:14.421 DEBUG:boto:Token: None 2024-04-16T18:18:14.421 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.422 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng= 2024-04-16T18:18:14.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng=', 'Content-Length': '0'} 2024-04-16T18:18:14.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5da89acc5a1c8ac-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.466 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.466 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.467 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.467 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.467 DEBUG:boto:Method: GET 2024-04-16T18:18:14.467 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.467 DEBUG:boto:Data: 2024-04-16T18:18:14.467 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.467 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.467 DEBUG:boto:Params: {} 2024-04-16T18:18:14.467 DEBUG:boto:Token: None 2024-04-16T18:18:14.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng= 2024-04-16T18:18:14.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng=', 'Content-Length': '0'} 2024-04-16T18:18:14.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045fd34dc4d3f29fa-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.470 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.470 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.470 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.470 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.470 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.471 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.471 DEBUG:boto:Data: 2024-04-16T18:18:14.471 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.471 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.471 DEBUG:boto:Params: {} 2024-04-16T18:18:14.471 DEBUG:boto:Token: None 2024-04-16T18:18:14.471 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rpK38B45f18mMSHw9IAwMiV+6Gc= 2024-04-16T18:18:14.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rpK38B45f18mMSHw9IAwMiV+6Gc=', 'Content-Length': '0'} 2024-04-16T18:18:14.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005aca77b8d9cbaa33-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.474 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.474 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.474 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.474 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.474 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.474 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.474 DEBUG:boto:Data: 2024-04-16T18:18:14.474 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.475 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.475 DEBUG:boto:Params: {} 2024-04-16T18:18:14.475 DEBUG:boto:Token: None 2024-04-16T18:18:14.475 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rpK38B45f18mMSHw9IAwMiV+6Gc= 2024-04-16T18:18:14.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rpK38B45f18mMSHw9IAwMiV+6Gc=', 'Content-Length': '0'} 2024-04-16T18:18:14.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d305ba70ee14273-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2024-04-16T18:18:14.478 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.478 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.478 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.478 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.478 DEBUG:boto:Method: GET 2024-04-16T18:18:14.478 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.478 DEBUG:boto:Data: 2024-04-16T18:18:14.478 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.478 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.478 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.479 DEBUG:boto:Params: {} 2024-04-16T18:18:14.479 DEBUG:boto:Token: None 2024-04-16T18:18:14.479 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng= 2024-04-16T18:18:14.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng=', 'Content-Length': '0'} 2024-04-16T18:18:14.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b94f7f5b3f4fa3d-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.522 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.523 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.523 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.523 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.523 DEBUG:boto:Method: GET 2024-04-16T18:18:14.523 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.523 DEBUG:boto:Data: 2024-04-16T18:18:14.523 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.523 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.523 DEBUG:boto:Params: {} 2024-04-16T18:18:14.523 DEBUG:boto:Token: None 2024-04-16T18:18:14.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056?versionId=null 2024-04-16T18:18:14.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng= 2024-04-16T18:18:14.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6U3dpWcBB07otBPIdvG37VbDGng=', 'Content-Length': '0'} 2024-04-16T18:18:14.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083f342169f24f0e4-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.526 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.526 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.526 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.526 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.526 DEBUG:boto:Method: GET 2024-04-16T18:18:14.527 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.527 DEBUG:boto:Data: 2024-04-16T18:18:14.527 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.527 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.527 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.527 DEBUG:boto:Params: {} 2024-04-16T18:18:14.527 DEBUG:boto:Token: None 2024-04-16T18:18:14.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4a3c49364f1c826-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.530 DEBUG:boto:b'cjqttm-51obj000000000000000000561000falseobj000000000000000000562024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.530 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.530 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.530 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.530 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.531 DEBUG:boto:Method: GET 2024-04-16T18:18:14.531 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.531 DEBUG:boto:Data: 2024-04-16T18:18:14.531 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.531 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.531 DEBUG:boto:Params: {} 2024-04-16T18:18:14.531 DEBUG:boto:Token: None 2024-04-16T18:18:14.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d8414addec4cd49-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.535 DEBUG:boto:b'cjqttm-51obj000000000000000000561000falseobj000000000000000000562024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.536 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.536 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.536 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.536 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.536 DEBUG:boto:Data: 2024-04-16T18:18:14.536 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.536 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.537 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.537 DEBUG:boto:Params: {} 2024-04-16T18:18:14.537 DEBUG:boto:Token: None 2024-04-16T18:18:14.537 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fzt6f6M8ziMwi3YMRn0AsxpcPtc= 2024-04-16T18:18:14.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fzt6f6M8ziMwi3YMRn0AsxpcPtc=', 'Content-Length': '0'} 2024-04-16T18:18:14.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d33444e6cc6188e7-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.539 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.539 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.539 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.539 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.539 DEBUG:boto:Data: 2024-04-16T18:18:14.539 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.540 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.540 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.540 DEBUG:boto:Params: {} 2024-04-16T18:18:14.540 DEBUG:boto:Token: None 2024-04-16T18:18:14.540 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fzt6f6M8ziMwi3YMRn0AsxpcPtc= 2024-04-16T18:18:14.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fzt6f6M8ziMwi3YMRn0AsxpcPtc=', 'Content-Length': '0'} 2024-04-16T18:18:14.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019e779df7046f553-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000056 2024-04-16T18:18:14.542 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.543 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.543 DEBUG:boto:Method: GET 2024-04-16T18:18:14.543 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.543 DEBUG:boto:Data: 2024-04-16T18:18:14.543 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.543 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.543 DEBUG:boto:Params: {} 2024-04-16T18:18:14.543 DEBUG:boto:Token: None 2024-04-16T18:18:14.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wtuKE2RC1OBu0XpBBCQ10wD5MME= 2024-04-16T18:18:14.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wtuKE2RC1OBu0XpBBCQ10wD5MME=', 'Content-Length': '0'} 2024-04-16T18:18:14.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012995458567bffcf-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.586 DEBUG:boto:path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.587 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.587 DEBUG:boto:Method: GET 2024-04-16T18:18:14.587 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.587 DEBUG:boto:Data: 2024-04-16T18:18:14.587 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.587 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.587 DEBUG:boto:Params: {} 2024-04-16T18:18:14.588 DEBUG:boto:Token: None 2024-04-16T18:18:14.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000056 2024-04-16T18:18:14.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wtuKE2RC1OBu0XpBBCQ10wD5MME= 2024-04-16T18:18:14.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wtuKE2RC1OBu0XpBBCQ10wD5MME=', 'Content-Length': '0'} 2024-04-16T18:18:14.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056a40f1e7f2a59c8-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.591 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.591 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.591 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.591 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.591 DEBUG:boto:Method: GET 2024-04-16T18:18:14.591 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.591 DEBUG:boto:Data: 2024-04-16T18:18:14.591 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.591 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.591 DEBUG:boto:Params: {} 2024-04-16T18:18:14.592 DEBUG:boto:Token: None 2024-04-16T18:18:14.592 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d604ed3ce2d636a6-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.634 DEBUG:boto:b'cjqttm-51obj000000000000000000561000falseobj000000000000000000562024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.635 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.635 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.635 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.635 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.635 DEBUG:boto:Method: GET 2024-04-16T18:18:14.635 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000056 2024-04-16T18:18:14.635 DEBUG:boto:Data: 2024-04-16T18:18:14.635 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.635 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.636 DEBUG:boto:Params: {} 2024-04-16T18:18:14.636 DEBUG:boto:Token: None 2024-04-16T18:18:14.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045a758f744e76a70-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.640 DEBUG:boto:b'cjqttm-51obj000000000000000000561000falseobj000000000000000000562024-04-16T18:17:58.831Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.640 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000057 2024-04-16T18:18:14.641 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.641 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.641 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.641 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.641 DEBUG:boto:Method: GET 2024-04-16T18:18:14.641 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.641 DEBUG:boto:Data: 2024-04-16T18:18:14.641 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.641 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.641 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.641 DEBUG:boto:Params: {} 2024-04-16T18:18:14.642 DEBUG:boto:Token: None 2024-04-16T18:18:14.642 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.642 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU= 2024-04-16T18:18:14.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU=', 'Content-Length': '0'} 2024-04-16T18:18:14.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048d25c78322173fa-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.686 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.686 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.686 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.687 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.687 DEBUG:boto:Method: GET 2024-04-16T18:18:14.687 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.687 DEBUG:boto:Data: 2024-04-16T18:18:14.687 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.687 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.687 DEBUG:boto:Params: {} 2024-04-16T18:18:14.687 DEBUG:boto:Token: None 2024-04-16T18:18:14.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU= 2024-04-16T18:18:14.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU=', 'Content-Length': '0'} 2024-04-16T18:18:14.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023422ce80e1c5a86-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.690 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.691 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.691 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.691 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.691 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.691 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.691 DEBUG:boto:Data: 2024-04-16T18:18:14.691 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.691 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.691 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.691 DEBUG:boto:Params: {} 2024-04-16T18:18:14.692 DEBUG:boto:Token: None 2024-04-16T18:18:14.692 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nO62qUDYj+0Azj2TS4nXVK1xNjE= 2024-04-16T18:18:14.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nO62qUDYj+0Azj2TS4nXVK1xNjE=', 'Content-Length': '0'} 2024-04-16T18:18:14.694 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccac22053f2dc6df-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.694 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.694 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.694 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.694 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.694 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.694 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.695 DEBUG:boto:Data: 2024-04-16T18:18:14.695 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.695 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.695 DEBUG:boto:Params: {} 2024-04-16T18:18:14.695 DEBUG:boto:Token: None 2024-04-16T18:18:14.695 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nO62qUDYj+0Azj2TS4nXVK1xNjE= 2024-04-16T18:18:14.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nO62qUDYj+0Azj2TS4nXVK1xNjE=', 'Content-Length': '0'} 2024-04-16T18:18:14.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003863bf1d57a2142a-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.697 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000057 2024-04-16T18:18:14.698 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.698 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.698 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.698 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.698 DEBUG:boto:Method: GET 2024-04-16T18:18:14.698 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.698 DEBUG:boto:Data: 2024-04-16T18:18:14.698 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.698 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.698 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.699 DEBUG:boto:Params: {} 2024-04-16T18:18:14.699 DEBUG:boto:Token: None 2024-04-16T18:18:14.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU= 2024-04-16T18:18:14.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU=', 'Content-Length': '0'} 2024-04-16T18:18:14.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009fba9a72a8fcb29-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.742 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.742 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.743 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.743 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.743 DEBUG:boto:Method: GET 2024-04-16T18:18:14.743 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.743 DEBUG:boto:Data: 2024-04-16T18:18:14.743 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.743 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.743 DEBUG:boto:Params: {} 2024-04-16T18:18:14.743 DEBUG:boto:Token: None 2024-04-16T18:18:14.744 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057?versionId=null 2024-04-16T18:18:14.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU= 2024-04-16T18:18:14.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SjTZSXcmjw6ED2KtXI93HV2FkQU=', 'Content-Length': '0'} 2024-04-16T18:18:14.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8373b096330ad93-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.746 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.746 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.746 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.746 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.746 DEBUG:boto:Method: GET 2024-04-16T18:18:14.747 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.747 DEBUG:boto:Data: 2024-04-16T18:18:14.747 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.747 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.747 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.747 DEBUG:boto:Params: {} 2024-04-16T18:18:14.747 DEBUG:boto:Token: None 2024-04-16T18:18:14.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc39f84592d16b17-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.790 DEBUG:boto:b'cjqttm-51obj000000000000000000571000falseobj000000000000000000572024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.791 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.791 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.791 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.791 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.791 DEBUG:boto:Method: GET 2024-04-16T18:18:14.791 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.791 DEBUG:boto:Data: 2024-04-16T18:18:14.791 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.791 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.791 DEBUG:boto:Params: {} 2024-04-16T18:18:14.792 DEBUG:boto:Token: None 2024-04-16T18:18:14.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.796 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000086af127c8513632e-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.796 DEBUG:boto:b'cjqttm-51obj000000000000000000571000falseobj000000000000000000572024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.796 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.796 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.797 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.797 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.797 DEBUG:boto:Data: 2024-04-16T18:18:14.797 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.797 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.797 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.797 DEBUG:boto:Params: {} 2024-04-16T18:18:14.797 DEBUG:boto:Token: None 2024-04-16T18:18:14.798 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.798 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5qADcuC6rKhZ/z2losMlv9uh13Q= 2024-04-16T18:18:14.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5qADcuC6rKhZ/z2losMlv9uh13Q=', 'Content-Length': '0'} 2024-04-16T18:18:14.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9aa1849759c1180-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.800 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.800 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.800 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.800 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.801 DEBUG:boto:Data: 2024-04-16T18:18:14.801 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.801 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.801 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.801 DEBUG:boto:Params: {} 2024-04-16T18:18:14.801 DEBUG:boto:Token: None 2024-04-16T18:18:14.801 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.801 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5qADcuC6rKhZ/z2losMlv9uh13Q= 2024-04-16T18:18:14.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5qADcuC6rKhZ/z2losMlv9uh13Q=', 'Content-Length': '0'} 2024-04-16T18:18:14.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000779879889845bddf-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.804 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000057 2024-04-16T18:18:14.804 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.804 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.804 DEBUG:boto:Method: GET 2024-04-16T18:18:14.804 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.804 DEBUG:boto:Data: 2024-04-16T18:18:14.805 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.805 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.805 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.805 DEBUG:boto:Params: {} 2024-04-16T18:18:14.805 DEBUG:boto:Token: None 2024-04-16T18:18:14.805 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.805 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T04Jopjd0/rKFPqjLCfuMvH/KHE= 2024-04-16T18:18:14.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T04Jopjd0/rKFPqjLCfuMvH/KHE=', 'Content-Length': '0'} 2024-04-16T18:18:14.808 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a84c8a835103ccaf-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.850 DEBUG:boto:path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.850 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.851 DEBUG:boto:Method: GET 2024-04-16T18:18:14.851 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.851 DEBUG:boto:Data: 2024-04-16T18:18:14.851 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.851 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.851 DEBUG:boto:Params: {} 2024-04-16T18:18:14.851 DEBUG:boto:Token: None 2024-04-16T18:18:14.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000057 2024-04-16T18:18:14.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T04Jopjd0/rKFPqjLCfuMvH/KHE= 2024-04-16T18:18:14.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T04Jopjd0/rKFPqjLCfuMvH/KHE=', 'Content-Length': '0'} 2024-04-16T18:18:14.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047aa6f386e2f5ff0-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.854 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.854 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.854 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.854 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.854 DEBUG:boto:Method: GET 2024-04-16T18:18:14.855 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.855 DEBUG:boto:Data: 2024-04-16T18:18:14.855 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.855 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.855 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.855 DEBUG:boto:Params: {} 2024-04-16T18:18:14.855 DEBUG:boto:Token: None 2024-04-16T18:18:14.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005487c05e66af541e-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.858 DEBUG:boto:b'cjqttm-51obj000000000000000000571000falseobj000000000000000000572024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.858 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.858 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.859 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.859 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.859 DEBUG:boto:Method: GET 2024-04-16T18:18:14.859 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000057 2024-04-16T18:18:14.859 DEBUG:boto:Data: 2024-04-16T18:18:14.859 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.860 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.860 DEBUG:boto:Params: {} 2024-04-16T18:18:14.860 DEBUG:boto:Token: None 2024-04-16T18:18:14.860 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.864 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034fe1577d66f5657-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.864 DEBUG:boto:b'cjqttm-51obj000000000000000000571000falseobj000000000000000000572024-04-16T18:17:59.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2024-04-16T18:18:14.865 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.865 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.865 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.865 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.865 DEBUG:boto:Method: GET 2024-04-16T18:18:14.865 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.865 DEBUG:boto:Data: 2024-04-16T18:18:14.866 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.866 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.866 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.866 DEBUG:boto:Params: {} 2024-04-16T18:18:14.866 DEBUG:boto:Token: None 2024-04-16T18:18:14.866 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.866 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM= 2024-04-16T18:18:14.866 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM=', 'Content-Length': '0'} 2024-04-16T18:18:14.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcc39469257db1cf-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.910 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.911 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.911 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.911 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.911 DEBUG:boto:Method: GET 2024-04-16T18:18:14.911 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.911 DEBUG:boto:Data: 2024-04-16T18:18:14.911 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.911 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.911 DEBUG:boto:Params: {} 2024-04-16T18:18:14.912 DEBUG:boto:Token: None 2024-04-16T18:18:14.912 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM= 2024-04-16T18:18:14.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM=', 'Content-Length': '0'} 2024-04-16T18:18:14.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b5165ec0cb09e7b-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.914 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.914 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.914 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.914 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.914 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.915 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.915 DEBUG:boto:Data: 2024-04-16T18:18:14.915 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.915 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.915 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.915 DEBUG:boto:Params: {} 2024-04-16T18:18:14.915 DEBUG:boto:Token: None 2024-04-16T18:18:14.915 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.915 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GyJGW5wmOF6XXT6oizBLMf+ZAXo= 2024-04-16T18:18:14.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GyJGW5wmOF6XXT6oizBLMf+ZAXo=', 'Content-Length': '0'} 2024-04-16T18:18:14.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0fd6f48b937fd5f-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.917 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.918 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.918 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.918 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.918 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.918 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.918 DEBUG:boto:Data: 2024-04-16T18:18:14.918 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.918 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.918 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.918 DEBUG:boto:Params: {} 2024-04-16T18:18:14.919 DEBUG:boto:Token: None 2024-04-16T18:18:14.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GyJGW5wmOF6XXT6oizBLMf+ZAXo= 2024-04-16T18:18:14.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GyJGW5wmOF6XXT6oizBLMf+ZAXo=', 'Content-Length': '0'} 2024-04-16T18:18:14.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004572db29595aa2ae-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2024-04-16T18:18:14.921 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.921 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.921 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.921 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.921 DEBUG:boto:Method: GET 2024-04-16T18:18:14.922 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.922 DEBUG:boto:Data: 2024-04-16T18:18:14.922 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.922 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.922 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.922 DEBUG:boto:Params: {} 2024-04-16T18:18:14.922 DEBUG:boto:Token: None 2024-04-16T18:18:14.922 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.922 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM= 2024-04-16T18:18:14.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM=', 'Content-Length': '0'} 2024-04-16T18:18:14.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005f4637447896349-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.966 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.966 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.966 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.967 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.967 DEBUG:boto:Method: GET 2024-04-16T18:18:14.967 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.967 DEBUG:boto:Data: 2024-04-16T18:18:14.967 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.967 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.967 DEBUG:boto:Params: {} 2024-04-16T18:18:14.967 DEBUG:boto:Token: None 2024-04-16T18:18:14.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058?versionId=null 2024-04-16T18:18:14.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM= 2024-04-16T18:18:14.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GubokS2OZ0qdYNgw/5asSbtIyOM=', 'Content-Length': '0'} 2024-04-16T18:18:14.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bbecfdc29885689-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.970 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.970 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.970 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:14.970 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:14.971 DEBUG:boto:Method: GET 2024-04-16T18:18:14.971 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:14.971 DEBUG:boto:Data: 2024-04-16T18:18:14.971 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.971 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.971 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.971 DEBUG:boto:Params: {} 2024-04-16T18:18:14.971 DEBUG:boto:Token: None 2024-04-16T18:18:14.971 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.974 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014cfc75657113980-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.974 DEBUG:boto:b'cjqttm-51obj000000000000000000581000falseobj000000000000000000582024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.974 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:14.975 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:14.975 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:14.975 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:14.975 DEBUG:boto:Method: GET 2024-04-16T18:18:14.975 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:14.975 DEBUG:boto:Data: 2024-04-16T18:18:14.975 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.975 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.975 DEBUG:boto:Params: {} 2024-04-16T18:18:14.975 DEBUG:boto:Token: None 2024-04-16T18:18:14.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/ 2024-04-16T18:18:14.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo= 2024-04-16T18:18:14.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aqght9z3wEeAvbL0bf3t/ijIKjo=', 'Content-Length': '0'} 2024-04-16T18:18:14.979 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007479b86cf490d639-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.980 DEBUG:boto:b'cjqttm-51obj000000000000000000581000falseobj000000000000000000582024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:14.980 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.980 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.980 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.980 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.980 DEBUG:boto:Data: 2024-04-16T18:18:14.981 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.981 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.981 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.981 DEBUG:boto:Params: {} 2024-04-16T18:18:14.981 DEBUG:boto:Token: None 2024-04-16T18:18:14.981 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.981 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y+pY8pwG943koahryU0aPK4yVso= 2024-04-16T18:18:14.981 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y+pY8pwG943koahryU0aPK4yVso=', 'Content-Length': '0'} 2024-04-16T18:18:14.983 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000611549d974f30f8c-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.983 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.983 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.984 DEBUG:boto:Method: HEAD 2024-04-16T18:18:14.984 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.984 DEBUG:boto:Data: 2024-04-16T18:18:14.984 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.984 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:14.984 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.984 DEBUG:boto:Params: {} 2024-04-16T18:18:14.984 DEBUG:boto:Token: None 2024-04-16T18:18:14.984 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y+pY8pwG943koahryU0aPK4yVso= 2024-04-16T18:18:14.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y+pY8pwG943koahryU0aPK4yVso=', 'Content-Length': '0'} 2024-04-16T18:18:14.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e45160da24194958-00661ec0e6-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:14.987 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000058 2024-04-16T18:18:14.987 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.987 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.987 DEBUG:boto:Method: GET 2024-04-16T18:18:14.987 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.987 DEBUG:boto:Data: 2024-04-16T18:18:14.987 DEBUG:boto:Headers: {} 2024-04-16T18:18:14.987 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:14.987 DEBUG:boto:Port: 8000 2024-04-16T18:18:14.988 DEBUG:boto:Params: {} 2024-04-16T18:18:14.988 DEBUG:boto:Token: None 2024-04-16T18:18:14.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:14 GMT /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:14.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sJn2ks16vhFPtuK2Gk7kXyjIMxQ= 2024-04-16T18:18:14.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sJn2ks16vhFPtuK2Gk7kXyjIMxQ=', 'Content-Length': '0'} 2024-04-16T18:18:14.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f98689edf97c7ae1-00661ec0e6-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.030 DEBUG:boto:path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:15.030 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000058 2024-04-16T18:18:15.031 DEBUG:boto:Method: GET 2024-04-16T18:18:15.031 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:15.031 DEBUG:boto:Data: 2024-04-16T18:18:15.031 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.031 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.031 DEBUG:boto:Params: {} 2024-04-16T18:18:15.031 DEBUG:boto:Token: None 2024-04-16T18:18:15.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000058 2024-04-16T18:18:15.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NB8rgFRugICrqQ5538y+KWtkHgM= 2024-04-16T18:18:15.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NB8rgFRugICrqQ5538y+KWtkHgM=', 'Content-Length': '0'} 2024-04-16T18:18:15.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:56 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089f1dca223d305dd-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.034 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.034 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.034 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:15.034 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:15.034 DEBUG:boto:Method: GET 2024-04-16T18:18:15.034 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:15.034 DEBUG:boto:Data: 2024-04-16T18:18:15.034 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.034 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.034 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.034 DEBUG:boto:Params: {} 2024-04-16T18:18:15.035 DEBUG:boto:Token: None 2024-04-16T18:18:15.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1e97fa309d2a582-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.078 DEBUG:boto:b'cjqttm-51obj000000000000000000581000falseobj000000000000000000582024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.079 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.079 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.079 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:15.079 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:15.079 DEBUG:boto:Method: GET 2024-04-16T18:18:15.079 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000058 2024-04-16T18:18:15.079 DEBUG:boto:Data: 2024-04-16T18:18:15.080 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.080 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.080 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.080 DEBUG:boto:Params: {} 2024-04-16T18:18:15.080 DEBUG:boto:Token: None 2024-04-16T18:18:15.080 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.084 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b180d9823e95506-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.084 DEBUG:boto:b'cjqttm-51obj000000000000000000581000falseobj000000000000000000582024-04-16T18:17:56.546Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.085 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2024-04-16T18:18:15.085 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.085 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.085 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.085 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.085 DEBUG:boto:Method: GET 2024-04-16T18:18:15.085 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.085 DEBUG:boto:Data: 2024-04-16T18:18:15.085 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.085 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.086 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.086 DEBUG:boto:Params: {} 2024-04-16T18:18:15.086 DEBUG:boto:Token: None 2024-04-16T18:18:15.086 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.086 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ= 2024-04-16T18:18:15.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ=', 'Content-Length': '0'} 2024-04-16T18:18:15.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000531a29a2e8dfcdf4-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.130 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.130 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.131 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.131 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.131 DEBUG:boto:Method: GET 2024-04-16T18:18:15.131 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.131 DEBUG:boto:Data: 2024-04-16T18:18:15.131 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.131 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.131 DEBUG:boto:Params: {} 2024-04-16T18:18:15.131 DEBUG:boto:Token: None 2024-04-16T18:18:15.131 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ= 2024-04-16T18:18:15.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ=', 'Content-Length': '0'} 2024-04-16T18:18:15.134 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d37b03351449f30-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.134 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.134 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.134 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.134 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.134 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.135 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.135 DEBUG:boto:Data: 2024-04-16T18:18:15.135 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.135 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.135 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.135 DEBUG:boto:Params: {} 2024-04-16T18:18:15.135 DEBUG:boto:Token: None 2024-04-16T18:18:15.135 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:80lbxhngKsci/WVg1qOweleWDyE= 2024-04-16T18:18:15.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:80lbxhngKsci/WVg1qOweleWDyE=', 'Content-Length': '0'} 2024-04-16T18:18:15.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d9c14dcadcbe160-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.138 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.138 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.138 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.138 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.138 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.138 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.138 DEBUG:boto:Data: 2024-04-16T18:18:15.139 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.139 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.139 DEBUG:boto:Params: {} 2024-04-16T18:18:15.139 DEBUG:boto:Token: None 2024-04-16T18:18:15.139 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:80lbxhngKsci/WVg1qOweleWDyE= 2024-04-16T18:18:15.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:80lbxhngKsci/WVg1qOweleWDyE=', 'Content-Length': '0'} 2024-04-16T18:18:15.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a39e3033be66fe67-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.142 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2024-04-16T18:18:15.142 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.142 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.142 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.142 DEBUG:boto:Method: GET 2024-04-16T18:18:15.142 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.142 DEBUG:boto:Data: 2024-04-16T18:18:15.142 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.143 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.143 DEBUG:boto:Params: {} 2024-04-16T18:18:15.143 DEBUG:boto:Token: None 2024-04-16T18:18:15.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ= 2024-04-16T18:18:15.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ=', 'Content-Length': '0'} 2024-04-16T18:18:15.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042a5412054197e34-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.186 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.187 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.187 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.187 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.187 DEBUG:boto:Method: GET 2024-04-16T18:18:15.187 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.187 DEBUG:boto:Data: 2024-04-16T18:18:15.187 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.187 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.187 DEBUG:boto:Params: {} 2024-04-16T18:18:15.188 DEBUG:boto:Token: None 2024-04-16T18:18:15.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059?versionId=null 2024-04-16T18:18:15.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ= 2024-04-16T18:18:15.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZI3M77gL3pjFrp/GoL9ubcEy9xQ=', 'Content-Length': '0'} 2024-04-16T18:18:15.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f392782fdbdb19da-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.191 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.191 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.191 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.191 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.191 DEBUG:boto:Method: GET 2024-04-16T18:18:15.191 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.191 DEBUG:boto:Data: 2024-04-16T18:18:15.191 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.192 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.192 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.192 DEBUG:boto:Params: {} 2024-04-16T18:18:15.192 DEBUG:boto:Token: None 2024-04-16T18:18:15.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.195 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047f6664ce39449ab-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.238 DEBUG:boto:b'cjqttm-51obj000000000000000000591000falseobj000000000000000000592024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.239 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.239 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.239 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.239 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.239 DEBUG:boto:Method: GET 2024-04-16T18:18:15.239 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.239 DEBUG:boto:Data: 2024-04-16T18:18:15.239 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.239 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.239 DEBUG:boto:Params: {} 2024-04-16T18:18:15.240 DEBUG:boto:Token: None 2024-04-16T18:18:15.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d150f7ae70294b22-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.244 DEBUG:boto:b'cjqttm-51obj000000000000000000591000falseobj000000000000000000592024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.244 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.244 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.244 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.244 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.244 DEBUG:boto:Data: 2024-04-16T18:18:15.244 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.245 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.245 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.245 DEBUG:boto:Params: {} 2024-04-16T18:18:15.245 DEBUG:boto:Token: None 2024-04-16T18:18:15.245 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.245 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EiK5+SGQ5Zq/qsaUDDzrFN4haOw= 2024-04-16T18:18:15.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EiK5+SGQ5Zq/qsaUDDzrFN4haOw=', 'Content-Length': '0'} 2024-04-16T18:18:15.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ba09cbbeca34965-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.247 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.247 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.247 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.247 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.248 DEBUG:boto:Data: 2024-04-16T18:18:15.248 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.248 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.248 DEBUG:boto:Params: {} 2024-04-16T18:18:15.248 DEBUG:boto:Token: None 2024-04-16T18:18:15.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EiK5+SGQ5Zq/qsaUDDzrFN4haOw= 2024-04-16T18:18:15.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EiK5+SGQ5Zq/qsaUDDzrFN4haOw=', 'Content-Length': '0'} 2024-04-16T18:18:15.250 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038a5fcd1d05b481b-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.251 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000059 2024-04-16T18:18:15.251 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.251 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.251 DEBUG:boto:Method: GET 2024-04-16T18:18:15.251 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.251 DEBUG:boto:Data: 2024-04-16T18:18:15.251 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.251 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.251 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.251 DEBUG:boto:Params: {} 2024-04-16T18:18:15.252 DEBUG:boto:Token: None 2024-04-16T18:18:15.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MHywB8qTM5FZHOw6Vi8E03Ob9T4= 2024-04-16T18:18:15.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MHywB8qTM5FZHOw6Vi8E03Ob9T4=', 'Content-Length': '0'} 2024-04-16T18:18:15.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000404f088408354ab7-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.294 DEBUG:boto:path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.295 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.295 DEBUG:boto:Method: GET 2024-04-16T18:18:15.295 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.295 DEBUG:boto:Data: 2024-04-16T18:18:15.295 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.295 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.295 DEBUG:boto:Params: {} 2024-04-16T18:18:15.295 DEBUG:boto:Token: None 2024-04-16T18:18:15.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000059 2024-04-16T18:18:15.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MHywB8qTM5FZHOw6Vi8E03Ob9T4= 2024-04-16T18:18:15.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MHywB8qTM5FZHOw6Vi8E03Ob9T4=', 'Content-Length': '0'} 2024-04-16T18:18:15.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:57 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001be0ec03a7caa367-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.298 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.298 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.298 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.298 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.298 DEBUG:boto:Method: GET 2024-04-16T18:18:15.298 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.298 DEBUG:boto:Data: 2024-04-16T18:18:15.298 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.298 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.299 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.299 DEBUG:boto:Params: {} 2024-04-16T18:18:15.299 DEBUG:boto:Token: None 2024-04-16T18:18:15.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bb014e3fb980a23-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.342 DEBUG:boto:b'cjqttm-51obj000000000000000000591000falseobj000000000000000000592024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.343 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.343 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.343 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.343 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.343 DEBUG:boto:Method: GET 2024-04-16T18:18:15.343 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000059 2024-04-16T18:18:15.343 DEBUG:boto:Data: 2024-04-16T18:18:15.343 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.343 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.343 DEBUG:boto:Params: {} 2024-04-16T18:18:15.344 DEBUG:boto:Token: None 2024-04-16T18:18:15.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068eb42a3371c5ffa-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.348 DEBUG:boto:b'cjqttm-51obj000000000000000000591000falseobj000000000000000000592024-04-16T18:17:57.521Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2024-04-16T18:18:15.349 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.349 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.349 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.349 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.349 DEBUG:boto:Method: GET 2024-04-16T18:18:15.349 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.349 DEBUG:boto:Data: 2024-04-16T18:18:15.349 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.349 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.349 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.349 DEBUG:boto:Params: {} 2024-04-16T18:18:15.350 DEBUG:boto:Token: None 2024-04-16T18:18:15.350 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw= 2024-04-16T18:18:15.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw=', 'Content-Length': '0'} 2024-04-16T18:18:15.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d33cfc2544ab7c81-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.394 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.395 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.395 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.395 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.395 DEBUG:boto:Method: GET 2024-04-16T18:18:15.395 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.395 DEBUG:boto:Data: 2024-04-16T18:18:15.395 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.395 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.395 DEBUG:boto:Params: {} 2024-04-16T18:18:15.395 DEBUG:boto:Token: None 2024-04-16T18:18:15.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw= 2024-04-16T18:18:15.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw=', 'Content-Length': '0'} 2024-04-16T18:18:15.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098cbf8688b15affa-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.398 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.398 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.398 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.398 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.399 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.399 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.399 DEBUG:boto:Data: 2024-04-16T18:18:15.399 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.399 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.399 DEBUG:boto:Params: {} 2024-04-16T18:18:15.399 DEBUG:boto:Token: None 2024-04-16T18:18:15.399 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gEtgQTB7H+XMmKGTQ8uZFNg2wNE= 2024-04-16T18:18:15.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gEtgQTB7H+XMmKGTQ8uZFNg2wNE=', 'Content-Length': '0'} 2024-04-16T18:18:15.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a908a95d4b2e4674-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.402 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.402 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.402 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.402 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.402 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.402 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.402 DEBUG:boto:Data: 2024-04-16T18:18:15.403 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.403 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.403 DEBUG:boto:Params: {} 2024-04-16T18:18:15.403 DEBUG:boto:Token: None 2024-04-16T18:18:15.403 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gEtgQTB7H+XMmKGTQ8uZFNg2wNE= 2024-04-16T18:18:15.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gEtgQTB7H+XMmKGTQ8uZFNg2wNE=', 'Content-Length': '0'} 2024-04-16T18:18:15.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c065b0bda6d9651d-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.405 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2024-04-16T18:18:15.405 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.405 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.406 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.406 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.406 DEBUG:boto:Method: GET 2024-04-16T18:18:15.406 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.406 DEBUG:boto:Data: 2024-04-16T18:18:15.406 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.406 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.406 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.406 DEBUG:boto:Params: {} 2024-04-16T18:18:15.406 DEBUG:boto:Token: None 2024-04-16T18:18:15.406 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw= 2024-04-16T18:18:15.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw=', 'Content-Length': '0'} 2024-04-16T18:18:15.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d96b3f25ba54227d-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.450 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.451 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.451 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.451 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.451 DEBUG:boto:Method: GET 2024-04-16T18:18:15.451 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.451 DEBUG:boto:Data: 2024-04-16T18:18:15.451 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.451 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.451 DEBUG:boto:Params: {} 2024-04-16T18:18:15.452 DEBUG:boto:Token: None 2024-04-16T18:18:15.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060?versionId=null 2024-04-16T18:18:15.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw= 2024-04-16T18:18:15.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPj+BFI0x0GSIF231Z1Nen0rGHw=', 'Content-Length': '0'} 2024-04-16T18:18:15.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037486f450be134f2-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.454 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.454 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.455 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.455 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.455 DEBUG:boto:Method: GET 2024-04-16T18:18:15.455 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.455 DEBUG:boto:Data: 2024-04-16T18:18:15.455 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.455 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.455 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.455 DEBUG:boto:Params: {} 2024-04-16T18:18:15.455 DEBUG:boto:Token: None 2024-04-16T18:18:15.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.458 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf25eaf54834f06f-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.498 DEBUG:boto:b'cjqttm-51obj000000000000000000601000falseobj000000000000000000602024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.499 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.499 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.499 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.499 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.499 DEBUG:boto:Method: GET 2024-04-16T18:18:15.499 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.499 DEBUG:boto:Data: 2024-04-16T18:18:15.499 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.499 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.500 DEBUG:boto:Params: {} 2024-04-16T18:18:15.500 DEBUG:boto:Token: None 2024-04-16T18:18:15.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.504 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e809c225112ecdd7-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.504 DEBUG:boto:b'cjqttm-51obj000000000000000000601000falseobj000000000000000000602024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.504 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.504 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.504 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.504 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.505 DEBUG:boto:Data: 2024-04-16T18:18:15.505 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.505 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.505 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.505 DEBUG:boto:Params: {} 2024-04-16T18:18:15.505 DEBUG:boto:Token: None 2024-04-16T18:18:15.505 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.505 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dyT/QNg3DrsvdfatV1WoyfCWKZo= 2024-04-16T18:18:15.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dyT/QNg3DrsvdfatV1WoyfCWKZo=', 'Content-Length': '0'} 2024-04-16T18:18:15.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0a65d8671f642e3-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.507 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.507 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.508 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.508 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.508 DEBUG:boto:Data: 2024-04-16T18:18:15.508 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.508 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.508 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.508 DEBUG:boto:Params: {} 2024-04-16T18:18:15.508 DEBUG:boto:Token: None 2024-04-16T18:18:15.508 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dyT/QNg3DrsvdfatV1WoyfCWKZo= 2024-04-16T18:18:15.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dyT/QNg3DrsvdfatV1WoyfCWKZo=', 'Content-Length': '0'} 2024-04-16T18:18:15.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d857bd7b6f76f7f-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000060 2024-04-16T18:18:15.511 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.511 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.511 DEBUG:boto:Method: GET 2024-04-16T18:18:15.511 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.511 DEBUG:boto:Data: 2024-04-16T18:18:15.511 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.511 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.511 DEBUG:boto:Params: {} 2024-04-16T18:18:15.511 DEBUG:boto:Token: None 2024-04-16T18:18:15.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:61kEUry3w5aLKcVi0G+9Lb996A0= 2024-04-16T18:18:15.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:61kEUry3w5aLKcVi0G+9Lb996A0=', 'Content-Length': '0'} 2024-04-16T18:18:15.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef3af96dd4b32b52-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.554 DEBUG:boto:path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.554 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.555 DEBUG:boto:Method: GET 2024-04-16T18:18:15.555 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.555 DEBUG:boto:Data: 2024-04-16T18:18:15.555 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.555 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.555 DEBUG:boto:Params: {} 2024-04-16T18:18:15.555 DEBUG:boto:Token: None 2024-04-16T18:18:15.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000060 2024-04-16T18:18:15.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:61kEUry3w5aLKcVi0G+9Lb996A0= 2024-04-16T18:18:15.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:61kEUry3w5aLKcVi0G+9Lb996A0=', 'Content-Length': '0'} 2024-04-16T18:18:15.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af5edcbb3c624020-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.558 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.558 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.559 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.559 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.559 DEBUG:boto:Method: GET 2024-04-16T18:18:15.559 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.559 DEBUG:boto:Data: 2024-04-16T18:18:15.559 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.559 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.559 DEBUG:boto:Params: {} 2024-04-16T18:18:15.559 DEBUG:boto:Token: None 2024-04-16T18:18:15.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e6319435e95359b-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.602 DEBUG:boto:b'cjqttm-51obj000000000000000000601000falseobj000000000000000000602024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.603 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.603 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.603 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.603 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.603 DEBUG:boto:Method: GET 2024-04-16T18:18:15.603 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000060 2024-04-16T18:18:15.603 DEBUG:boto:Data: 2024-04-16T18:18:15.603 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.604 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.604 DEBUG:boto:Params: {} 2024-04-16T18:18:15.604 DEBUG:boto:Token: None 2024-04-16T18:18:15.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000184ac97f4abad7ec-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.608 DEBUG:boto:b'cjqttm-51obj000000000000000000601000falseobj000000000000000000602024-04-16T18:17:59.952Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.608 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2024-04-16T18:18:15.608 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.609 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.609 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.609 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.609 DEBUG:boto:Method: GET 2024-04-16T18:18:15.609 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.609 DEBUG:boto:Data: 2024-04-16T18:18:15.609 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.609 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.609 DEBUG:boto:Params: {} 2024-04-16T18:18:15.609 DEBUG:boto:Token: None 2024-04-16T18:18:15.610 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo= 2024-04-16T18:18:15.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo=', 'Content-Length': '0'} 2024-04-16T18:18:15.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e19f79e3537c1e2e-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.654 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.654 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.655 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.655 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.655 DEBUG:boto:Method: GET 2024-04-16T18:18:15.655 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.655 DEBUG:boto:Data: 2024-04-16T18:18:15.655 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.655 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.655 DEBUG:boto:Params: {} 2024-04-16T18:18:15.656 DEBUG:boto:Token: None 2024-04-16T18:18:15.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo= 2024-04-16T18:18:15.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo=', 'Content-Length': '0'} 2024-04-16T18:18:15.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d10c07e51587de1c-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.658 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.658 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.658 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.658 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.659 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.659 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.659 DEBUG:boto:Data: 2024-04-16T18:18:15.659 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.659 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.659 DEBUG:boto:Params: {} 2024-04-16T18:18:15.659 DEBUG:boto:Token: None 2024-04-16T18:18:15.659 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IAN7e1rX7sBSd5JF2xE5PoGW1eY= 2024-04-16T18:18:15.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IAN7e1rX7sBSd5JF2xE5PoGW1eY=', 'Content-Length': '0'} 2024-04-16T18:18:15.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000863df3588173038-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.662 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.662 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.662 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.662 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.662 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.662 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.662 DEBUG:boto:Data: 2024-04-16T18:18:15.662 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.662 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.662 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.662 DEBUG:boto:Params: {} 2024-04-16T18:18:15.663 DEBUG:boto:Token: None 2024-04-16T18:18:15.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IAN7e1rX7sBSd5JF2xE5PoGW1eY= 2024-04-16T18:18:15.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IAN7e1rX7sBSd5JF2xE5PoGW1eY=', 'Content-Length': '0'} 2024-04-16T18:18:15.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c57b68bb3c5de32-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2024-04-16T18:18:15.665 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.665 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.666 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.666 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.666 DEBUG:boto:Method: GET 2024-04-16T18:18:15.666 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.666 DEBUG:boto:Data: 2024-04-16T18:18:15.666 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.666 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.666 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.666 DEBUG:boto:Params: {} 2024-04-16T18:18:15.666 DEBUG:boto:Token: None 2024-04-16T18:18:15.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo= 2024-04-16T18:18:15.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo=', 'Content-Length': '0'} 2024-04-16T18:18:15.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8cbd904dafd6740-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.710 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.711 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.711 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.711 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.711 DEBUG:boto:Method: GET 2024-04-16T18:18:15.711 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.711 DEBUG:boto:Data: 2024-04-16T18:18:15.711 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.711 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.711 DEBUG:boto:Params: {} 2024-04-16T18:18:15.711 DEBUG:boto:Token: None 2024-04-16T18:18:15.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061?versionId=null 2024-04-16T18:18:15.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo= 2024-04-16T18:18:15.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/dh962ExGIK/K32Gkn9ynDolqo=', 'Content-Length': '0'} 2024-04-16T18:18:15.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5486d21f6cbbf8f-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.714 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.714 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.714 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.714 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.714 DEBUG:boto:Method: GET 2024-04-16T18:18:15.714 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.714 DEBUG:boto:Data: 2024-04-16T18:18:15.714 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.715 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.715 DEBUG:boto:Params: {} 2024-04-16T18:18:15.715 DEBUG:boto:Token: None 2024-04-16T18:18:15.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001003dc129abb66ec-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.758 DEBUG:boto:b'cjqttm-51obj000000000000000000611000falseobj000000000000000000612024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.759 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.759 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.759 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.759 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.759 DEBUG:boto:Method: GET 2024-04-16T18:18:15.759 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.759 DEBUG:boto:Data: 2024-04-16T18:18:15.759 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.759 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.759 DEBUG:boto:Params: {} 2024-04-16T18:18:15.760 DEBUG:boto:Token: None 2024-04-16T18:18:15.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6e71468fe416055-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.764 DEBUG:boto:b'cjqttm-51obj000000000000000000611000falseobj000000000000000000612024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.765 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.765 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.765 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.765 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.765 DEBUG:boto:Data: 2024-04-16T18:18:15.765 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.765 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.765 DEBUG:boto:Params: {} 2024-04-16T18:18:15.765 DEBUG:boto:Token: None 2024-04-16T18:18:15.765 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1N2u9uz/VdCUt3ufP3Tv4Dymcjo= 2024-04-16T18:18:15.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1N2u9uz/VdCUt3ufP3Tv4Dymcjo=', 'Content-Length': '0'} 2024-04-16T18:18:15.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ad9cb6d960e22ee-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.768 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.768 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.768 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.768 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.768 DEBUG:boto:Data: 2024-04-16T18:18:15.769 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.769 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.769 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.769 DEBUG:boto:Params: {} 2024-04-16T18:18:15.769 DEBUG:boto:Token: None 2024-04-16T18:18:15.769 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1N2u9uz/VdCUt3ufP3Tv4Dymcjo= 2024-04-16T18:18:15.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1N2u9uz/VdCUt3ufP3Tv4Dymcjo=', 'Content-Length': '0'} 2024-04-16T18:18:15.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077f9b42c75629dab-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000061 2024-04-16T18:18:15.771 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.771 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.772 DEBUG:boto:Method: GET 2024-04-16T18:18:15.772 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.772 DEBUG:boto:Data: 2024-04-16T18:18:15.772 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.772 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.772 DEBUG:boto:Params: {} 2024-04-16T18:18:15.772 DEBUG:boto:Token: None 2024-04-16T18:18:15.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AFLHsxLvlpKD/HK2kTAYRqQM77w= 2024-04-16T18:18:15.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AFLHsxLvlpKD/HK2kTAYRqQM77w=', 'Content-Length': '0'} 2024-04-16T18:18:15.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3b6c21758299b5b-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.818 DEBUG:boto:path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.819 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.819 DEBUG:boto:Method: GET 2024-04-16T18:18:15.819 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.819 DEBUG:boto:Data: 2024-04-16T18:18:15.819 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.819 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.819 DEBUG:boto:Params: {} 2024-04-16T18:18:15.819 DEBUG:boto:Token: None 2024-04-16T18:18:15.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000061 2024-04-16T18:18:15.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AFLHsxLvlpKD/HK2kTAYRqQM77w= 2024-04-16T18:18:15.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AFLHsxLvlpKD/HK2kTAYRqQM77w=', 'Content-Length': '0'} 2024-04-16T18:18:15.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000141f2e99c5df6ef-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.822 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.822 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.822 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.822 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.822 DEBUG:boto:Method: GET 2024-04-16T18:18:15.822 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.823 DEBUG:boto:Data: 2024-04-16T18:18:15.823 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.823 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.823 DEBUG:boto:Params: {} 2024-04-16T18:18:15.823 DEBUG:boto:Token: None 2024-04-16T18:18:15.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f33d07bc0a9d3bfa-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.826 DEBUG:boto:b'cjqttm-51obj000000000000000000611000falseobj000000000000000000612024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.826 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.826 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.826 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.827 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.827 DEBUG:boto:Method: GET 2024-04-16T18:18:15.827 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000061 2024-04-16T18:18:15.827 DEBUG:boto:Data: 2024-04-16T18:18:15.827 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.827 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.827 DEBUG:boto:Params: {} 2024-04-16T18:18:15.827 DEBUG:boto:Token: None 2024-04-16T18:18:15.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.831 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000102eb73b15447a4d-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.831 DEBUG:boto:b'cjqttm-51obj000000000000000000611000falseobj000000000000000000612024-04-16T18:17:58.709Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000062 2024-04-16T18:18:15.832 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.832 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.832 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.832 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.832 DEBUG:boto:Method: GET 2024-04-16T18:18:15.833 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.833 DEBUG:boto:Data: 2024-04-16T18:18:15.833 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.833 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.833 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.833 DEBUG:boto:Params: {} 2024-04-16T18:18:15.833 DEBUG:boto:Token: None 2024-04-16T18:18:15.833 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0= 2024-04-16T18:18:15.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0=', 'Content-Length': '0'} 2024-04-16T18:18:15.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e819177dee63eb1-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.878 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.878 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.879 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.879 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.879 DEBUG:boto:Method: GET 2024-04-16T18:18:15.879 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.879 DEBUG:boto:Data: 2024-04-16T18:18:15.879 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.879 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.879 DEBUG:boto:Params: {} 2024-04-16T18:18:15.879 DEBUG:boto:Token: None 2024-04-16T18:18:15.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0= 2024-04-16T18:18:15.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0=', 'Content-Length': '0'} 2024-04-16T18:18:15.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006957c9135f46ce6f-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.882 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.882 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.882 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.882 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.882 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.883 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.883 DEBUG:boto:Data: 2024-04-16T18:18:15.883 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.883 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.883 DEBUG:boto:Params: {} 2024-04-16T18:18:15.883 DEBUG:boto:Token: None 2024-04-16T18:18:15.883 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OcUCF4Q42KIEAG1S87TBjH6Eyw8= 2024-04-16T18:18:15.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OcUCF4Q42KIEAG1S87TBjH6Eyw8=', 'Content-Length': '0'} 2024-04-16T18:18:15.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081812f270a7ae6a7-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.886 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.886 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.886 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.886 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.887 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.887 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.887 DEBUG:boto:Data: 2024-04-16T18:18:15.887 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.887 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.887 DEBUG:boto:Params: {} 2024-04-16T18:18:15.887 DEBUG:boto:Token: None 2024-04-16T18:18:15.887 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OcUCF4Q42KIEAG1S87TBjH6Eyw8= 2024-04-16T18:18:15.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OcUCF4Q42KIEAG1S87TBjH6Eyw8=', 'Content-Length': '0'} 2024-04-16T18:18:15.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3b81ea34ae99d5c-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.890 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000062 2024-04-16T18:18:15.890 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.891 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.891 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.891 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.891 DEBUG:boto:Method: GET 2024-04-16T18:18:15.891 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.891 DEBUG:boto:Data: 2024-04-16T18:18:15.891 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.891 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.891 DEBUG:boto:Params: {} 2024-04-16T18:18:15.891 DEBUG:boto:Token: None 2024-04-16T18:18:15.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0= 2024-04-16T18:18:15.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0=', 'Content-Length': '0'} 2024-04-16T18:18:15.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc2f6c416a1e41c6-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.934 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.934 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.935 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.935 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.935 DEBUG:boto:Method: GET 2024-04-16T18:18:15.935 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.935 DEBUG:boto:Data: 2024-04-16T18:18:15.935 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.935 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.935 DEBUG:boto:Params: {} 2024-04-16T18:18:15.935 DEBUG:boto:Token: None 2024-04-16T18:18:15.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062?versionId=null 2024-04-16T18:18:15.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0= 2024-04-16T18:18:15.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MM0IJYZ56rzEFbZ3gwfG6KZ03j0=', 'Content-Length': '0'} 2024-04-16T18:18:15.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090221afa1dac19a6-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.938 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.938 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.939 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:15.939 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:15.939 DEBUG:boto:Method: GET 2024-04-16T18:18:15.939 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:15.939 DEBUG:boto:Data: 2024-04-16T18:18:15.939 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.939 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.939 DEBUG:boto:Params: {} 2024-04-16T18:18:15.939 DEBUG:boto:Token: None 2024-04-16T18:18:15.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.942 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000aa45514ab0a61fd-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.942 DEBUG:boto:b'cjqttm-51obj000000000000000000621000falseobj000000000000000000622024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.943 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:15.943 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:15.943 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:15.943 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:15.943 DEBUG:boto:Method: GET 2024-04-16T18:18:15.943 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:15.943 DEBUG:boto:Data: 2024-04-16T18:18:15.943 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.943 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.943 DEBUG:boto:Params: {} 2024-04-16T18:18:15.944 DEBUG:boto:Token: None 2024-04-16T18:18:15.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/ 2024-04-16T18:18:15.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI= 2024-04-16T18:18:15.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x4SnFB0zpNtAoQ7hUaxRp8K+dfI=', 'Content-Length': '0'} 2024-04-16T18:18:15.948 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b39314342bdd386a-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.948 DEBUG:boto:b'cjqttm-51obj000000000000000000621000falseobj000000000000000000622024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:15.948 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.949 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.949 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.949 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.949 DEBUG:boto:Data: 2024-04-16T18:18:15.949 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.949 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.949 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.949 DEBUG:boto:Params: {} 2024-04-16T18:18:15.949 DEBUG:boto:Token: None 2024-04-16T18:18:15.949 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GoawN9BrO/AWr2V9eLRqjMT6VJM= 2024-04-16T18:18:15.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GoawN9BrO/AWr2V9eLRqjMT6VJM=', 'Content-Length': '0'} 2024-04-16T18:18:15.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aea92e690fa9e5b2-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.952 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.952 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.952 DEBUG:boto:Method: HEAD 2024-04-16T18:18:15.952 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.952 DEBUG:boto:Data: 2024-04-16T18:18:15.952 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.952 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:15.953 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.953 DEBUG:boto:Params: {} 2024-04-16T18:18:15.953 DEBUG:boto:Token: None 2024-04-16T18:18:15.953 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.953 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GoawN9BrO/AWr2V9eLRqjMT6VJM= 2024-04-16T18:18:15.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GoawN9BrO/AWr2V9eLRqjMT6VJM=', 'Content-Length': '0'} 2024-04-16T18:18:15.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ff084e1af882cde-00661ec0e7-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:15.955 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000062 2024-04-16T18:18:15.956 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.956 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.956 DEBUG:boto:Method: GET 2024-04-16T18:18:15.956 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.956 DEBUG:boto:Data: 2024-04-16T18:18:15.956 DEBUG:boto:Headers: {} 2024-04-16T18:18:15.956 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:15.956 DEBUG:boto:Port: 8000 2024-04-16T18:18:15.956 DEBUG:boto:Params: {} 2024-04-16T18:18:15.956 DEBUG:boto:Token: None 2024-04-16T18:18:15.957 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:15 GMT /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:15.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4KBjUkpNrgj5a4eO66CQu4NcwRc= 2024-04-16T18:18:15.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4KBjUkpNrgj5a4eO66CQu4NcwRc=', 'Content-Length': '0'} 2024-04-16T18:18:15.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7ea910f320ba6d2-00661ec0e7-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.002 DEBUG:boto:path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:16.003 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000062 2024-04-16T18:18:16.003 DEBUG:boto:Method: GET 2024-04-16T18:18:16.003 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:16.003 DEBUG:boto:Data: 2024-04-16T18:18:16.003 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.003 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.003 DEBUG:boto:Params: {} 2024-04-16T18:18:16.003 DEBUG:boto:Token: None 2024-04-16T18:18:16.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000062 2024-04-16T18:18:16.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MSJWowwQULMomM2Tzk81Cagrfh8= 2024-04-16T18:18:16.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MSJWowwQULMomM2Tzk81Cagrfh8=', 'Content-Length': '0'} 2024-04-16T18:18:16.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000757bd1c9d226c324-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.006 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.006 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.006 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:16.007 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:16.007 DEBUG:boto:Method: GET 2024-04-16T18:18:16.007 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:16.007 DEBUG:boto:Data: 2024-04-16T18:18:16.007 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.007 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.007 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.007 DEBUG:boto:Params: {} 2024-04-16T18:18:16.007 DEBUG:boto:Token: None 2024-04-16T18:18:16.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eecf1b8882f8960c-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.050 DEBUG:boto:b'cjqttm-51obj000000000000000000621000falseobj000000000000000000622024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.051 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.051 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.051 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:16.051 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:16.051 DEBUG:boto:Method: GET 2024-04-16T18:18:16.051 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000062 2024-04-16T18:18:16.051 DEBUG:boto:Data: 2024-04-16T18:18:16.051 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.052 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.052 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.052 DEBUG:boto:Params: {} 2024-04-16T18:18:16.052 DEBUG:boto:Token: None 2024-04-16T18:18:16.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.056 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b6c9d1ea1cdbcbf-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.056 DEBUG:boto:b'cjqttm-51obj000000000000000000621000falseobj000000000000000000622024-04-16T18:18:00.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2024-04-16T18:18:16.056 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.057 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.057 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.057 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.057 DEBUG:boto:Method: GET 2024-04-16T18:18:16.057 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.057 DEBUG:boto:Data: 2024-04-16T18:18:16.057 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.057 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.057 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.057 DEBUG:boto:Params: {} 2024-04-16T18:18:16.057 DEBUG:boto:Token: None 2024-04-16T18:18:16.058 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.058 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA= 2024-04-16T18:18:16.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA=', 'Content-Length': '0'} 2024-04-16T18:18:16.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecff90054895f5ad-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.102 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.102 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.102 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.103 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.103 DEBUG:boto:Method: GET 2024-04-16T18:18:16.103 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.103 DEBUG:boto:Data: 2024-04-16T18:18:16.103 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.103 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.103 DEBUG:boto:Params: {} 2024-04-16T18:18:16.103 DEBUG:boto:Token: None 2024-04-16T18:18:16.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA= 2024-04-16T18:18:16.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA=', 'Content-Length': '0'} 2024-04-16T18:18:16.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b734cde4faa27c4e-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.106 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.106 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.106 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.107 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.107 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.107 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.107 DEBUG:boto:Data: 2024-04-16T18:18:16.107 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.107 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.107 DEBUG:boto:Params: {} 2024-04-16T18:18:16.107 DEBUG:boto:Token: None 2024-04-16T18:18:16.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JIsAm+rc9to5hYVINOixYwfoLqQ= 2024-04-16T18:18:16.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JIsAm+rc9to5hYVINOixYwfoLqQ=', 'Content-Length': '0'} 2024-04-16T18:18:16.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000879db00764ab0f51-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.110 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.110 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.110 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.110 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.110 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.110 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.110 DEBUG:boto:Data: 2024-04-16T18:18:16.110 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.111 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.111 DEBUG:boto:Params: {} 2024-04-16T18:18:16.111 DEBUG:boto:Token: None 2024-04-16T18:18:16.111 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JIsAm+rc9to5hYVINOixYwfoLqQ= 2024-04-16T18:18:16.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JIsAm+rc9to5hYVINOixYwfoLqQ=', 'Content-Length': '0'} 2024-04-16T18:18:16.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afcfba581e69a6f6-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.114 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2024-04-16T18:18:16.114 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.114 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.114 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.114 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.115 DEBUG:boto:Method: GET 2024-04-16T18:18:16.115 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.115 DEBUG:boto:Data: 2024-04-16T18:18:16.115 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.115 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.115 DEBUG:boto:Params: {} 2024-04-16T18:18:16.115 DEBUG:boto:Token: None 2024-04-16T18:18:16.115 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA= 2024-04-16T18:18:16.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA=', 'Content-Length': '0'} 2024-04-16T18:18:16.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f140ed14f61a10ab-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.158 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.158 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.159 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.159 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.159 DEBUG:boto:Method: GET 2024-04-16T18:18:16.159 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.159 DEBUG:boto:Data: 2024-04-16T18:18:16.159 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.159 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.159 DEBUG:boto:Params: {} 2024-04-16T18:18:16.160 DEBUG:boto:Token: None 2024-04-16T18:18:16.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065?versionId=null 2024-04-16T18:18:16.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA= 2024-04-16T18:18:16.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6RUBJ10bqDbTQU3q1zAWaQQCCXA=', 'Content-Length': '0'} 2024-04-16T18:18:16.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a24f7de21867bd01-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.163 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.163 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.163 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.163 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.163 DEBUG:boto:Method: GET 2024-04-16T18:18:16.163 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.163 DEBUG:boto:Data: 2024-04-16T18:18:16.163 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.164 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.164 DEBUG:boto:Params: {} 2024-04-16T18:18:16.164 DEBUG:boto:Token: None 2024-04-16T18:18:16.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bddefe95febf294e-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.206 DEBUG:boto:b'cjqttm-51obj000000000000000000651000falseobj000000000000000000652024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.207 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.207 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.207 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.207 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.207 DEBUG:boto:Method: GET 2024-04-16T18:18:16.207 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.207 DEBUG:boto:Data: 2024-04-16T18:18:16.207 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.207 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.207 DEBUG:boto:Params: {} 2024-04-16T18:18:16.208 DEBUG:boto:Token: None 2024-04-16T18:18:16.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d09753c7bba9ae4-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.212 DEBUG:boto:b'cjqttm-51obj000000000000000000651000falseobj000000000000000000652024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.212 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.213 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.213 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.213 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.213 DEBUG:boto:Data: 2024-04-16T18:18:16.213 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.213 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.213 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.213 DEBUG:boto:Params: {} 2024-04-16T18:18:16.213 DEBUG:boto:Token: None 2024-04-16T18:18:16.213 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.214 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VvNoY4EErD9yjkRof/bKV5rqQzI= 2024-04-16T18:18:16.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VvNoY4EErD9yjkRof/bKV5rqQzI=', 'Content-Length': '0'} 2024-04-16T18:18:16.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000354e1d46619043da-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.216 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.216 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.216 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.216 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.216 DEBUG:boto:Data: 2024-04-16T18:18:16.216 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.216 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.216 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.216 DEBUG:boto:Params: {} 2024-04-16T18:18:16.217 DEBUG:boto:Token: None 2024-04-16T18:18:16.217 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.217 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VvNoY4EErD9yjkRof/bKV5rqQzI= 2024-04-16T18:18:16.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VvNoY4EErD9yjkRof/bKV5rqQzI=', 'Content-Length': '0'} 2024-04-16T18:18:16.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000148f3bef3d133878-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000065 2024-04-16T18:18:16.220 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.220 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.220 DEBUG:boto:Method: GET 2024-04-16T18:18:16.220 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.220 DEBUG:boto:Data: 2024-04-16T18:18:16.220 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.220 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.220 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.220 DEBUG:boto:Params: {} 2024-04-16T18:18:16.221 DEBUG:boto:Token: None 2024-04-16T18:18:16.221 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.221 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9GRxFOKoWaY7CQCaYyeNw4yXEIM= 2024-04-16T18:18:16.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9GRxFOKoWaY7CQCaYyeNw4yXEIM=', 'Content-Length': '0'} 2024-04-16T18:18:16.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0792e6e65cc6796-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.270 DEBUG:boto:path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.270 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.270 DEBUG:boto:Method: GET 2024-04-16T18:18:16.271 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.271 DEBUG:boto:Data: 2024-04-16T18:18:16.271 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.271 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.271 DEBUG:boto:Params: {} 2024-04-16T18:18:16.271 DEBUG:boto:Token: None 2024-04-16T18:18:16.271 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000065 2024-04-16T18:18:16.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9GRxFOKoWaY7CQCaYyeNw4yXEIM= 2024-04-16T18:18:16.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9GRxFOKoWaY7CQCaYyeNw4yXEIM=', 'Content-Length': '0'} 2024-04-16T18:18:16.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:59 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8d573dda800e2f4-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.274 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.274 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.274 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.274 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.274 DEBUG:boto:Method: GET 2024-04-16T18:18:16.274 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.274 DEBUG:boto:Data: 2024-04-16T18:18:16.274 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.274 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.275 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.275 DEBUG:boto:Params: {} 2024-04-16T18:18:16.275 DEBUG:boto:Token: None 2024-04-16T18:18:16.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfc27e3e34d5ef93-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.318 DEBUG:boto:b'cjqttm-51obj000000000000000000651000falseobj000000000000000000652024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.319 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.319 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.319 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.319 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.319 DEBUG:boto:Method: GET 2024-04-16T18:18:16.319 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000065 2024-04-16T18:18:16.319 DEBUG:boto:Data: 2024-04-16T18:18:16.319 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.320 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.320 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.320 DEBUG:boto:Params: {} 2024-04-16T18:18:16.320 DEBUG:boto:Token: None 2024-04-16T18:18:16.320 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.324 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb42fa4d6775d6c4-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.324 DEBUG:boto:b'cjqttm-51obj000000000000000000651000falseobj000000000000000000652024-04-16T18:17:59.504Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.324 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2024-04-16T18:18:16.325 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.325 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.325 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.325 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.325 DEBUG:boto:Method: GET 2024-04-16T18:18:16.325 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.325 DEBUG:boto:Data: 2024-04-16T18:18:16.325 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.325 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.325 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.325 DEBUG:boto:Params: {} 2024-04-16T18:18:16.326 DEBUG:boto:Token: None 2024-04-16T18:18:16.326 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.326 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM= 2024-04-16T18:18:16.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM=', 'Content-Length': '0'} 2024-04-16T18:18:16.328 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d175f0d3e656fd5-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.370 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.370 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.371 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.371 DEBUG:boto:Method: GET 2024-04-16T18:18:16.371 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.371 DEBUG:boto:Data: 2024-04-16T18:18:16.371 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.371 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.371 DEBUG:boto:Params: {} 2024-04-16T18:18:16.371 DEBUG:boto:Token: None 2024-04-16T18:18:16.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM= 2024-04-16T18:18:16.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM=', 'Content-Length': '0'} 2024-04-16T18:18:16.374 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e4c7834239e5fe0-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.374 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.374 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.374 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.374 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.374 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.374 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.374 DEBUG:boto:Data: 2024-04-16T18:18:16.375 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.375 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.375 DEBUG:boto:Params: {} 2024-04-16T18:18:16.375 DEBUG:boto:Token: None 2024-04-16T18:18:16.375 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EqJUA+3eFGaEyHj5eNFAtrHN0vM= 2024-04-16T18:18:16.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EqJUA+3eFGaEyHj5eNFAtrHN0vM=', 'Content-Length': '0'} 2024-04-16T18:18:16.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c901b3cb798279fe-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.378 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.378 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.378 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.378 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.378 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.378 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.378 DEBUG:boto:Data: 2024-04-16T18:18:16.378 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.378 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.378 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.378 DEBUG:boto:Params: {} 2024-04-16T18:18:16.379 DEBUG:boto:Token: None 2024-04-16T18:18:16.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EqJUA+3eFGaEyHj5eNFAtrHN0vM= 2024-04-16T18:18:16.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EqJUA+3eFGaEyHj5eNFAtrHN0vM=', 'Content-Length': '0'} 2024-04-16T18:18:16.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006531d1473e7f8390-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.381 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2024-04-16T18:18:16.381 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.381 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.381 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.381 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.381 DEBUG:boto:Method: GET 2024-04-16T18:18:16.381 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.382 DEBUG:boto:Data: 2024-04-16T18:18:16.382 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.382 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.382 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.382 DEBUG:boto:Params: {} 2024-04-16T18:18:16.382 DEBUG:boto:Token: None 2024-04-16T18:18:16.382 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.382 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM= 2024-04-16T18:18:16.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM=', 'Content-Length': '0'} 2024-04-16T18:18:16.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b37061ea60a0ff0-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.426 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.426 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.427 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.427 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.427 DEBUG:boto:Method: GET 2024-04-16T18:18:16.427 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.427 DEBUG:boto:Data: 2024-04-16T18:18:16.427 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.427 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.427 DEBUG:boto:Params: {} 2024-04-16T18:18:16.427 DEBUG:boto:Token: None 2024-04-16T18:18:16.428 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076?versionId=null 2024-04-16T18:18:16.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM= 2024-04-16T18:18:16.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8HEPyyllv7cZQ2WUtpyUpfrnguM=', 'Content-Length': '0'} 2024-04-16T18:18:16.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc9d41383dd8369d-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.431 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.431 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.431 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.431 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.431 DEBUG:boto:Method: GET 2024-04-16T18:18:16.431 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.431 DEBUG:boto:Data: 2024-04-16T18:18:16.431 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.431 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.432 DEBUG:boto:Params: {} 2024-04-16T18:18:16.432 DEBUG:boto:Token: None 2024-04-16T18:18:16.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.434 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbaad2b229350cc9-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.474 DEBUG:boto:b'cjqttm-51obj000000000000000000761000falseobj000000000000000000762024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.475 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.475 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.475 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.475 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.475 DEBUG:boto:Method: GET 2024-04-16T18:18:16.475 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.475 DEBUG:boto:Data: 2024-04-16T18:18:16.475 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.475 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.476 DEBUG:boto:Params: {} 2024-04-16T18:18:16.476 DEBUG:boto:Token: None 2024-04-16T18:18:16.476 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.480 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dacde1c69a22002-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.480 DEBUG:boto:b'cjqttm-51obj000000000000000000761000falseobj000000000000000000762024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.481 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.481 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.481 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.481 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.481 DEBUG:boto:Data: 2024-04-16T18:18:16.481 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.481 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.481 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.481 DEBUG:boto:Params: {} 2024-04-16T18:18:16.481 DEBUG:boto:Token: None 2024-04-16T18:18:16.482 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.482 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A0dVs4v6lo5O78HzFKsu4m7oQ8Q= 2024-04-16T18:18:16.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A0dVs4v6lo5O78HzFKsu4m7oQ8Q=', 'Content-Length': '0'} 2024-04-16T18:18:16.484 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d2c547bbe0d566c-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.485 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.485 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.485 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.485 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.485 DEBUG:boto:Data: 2024-04-16T18:18:16.485 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.485 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.485 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.485 DEBUG:boto:Params: {} 2024-04-16T18:18:16.485 DEBUG:boto:Token: None 2024-04-16T18:18:16.485 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.486 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A0dVs4v6lo5O78HzFKsu4m7oQ8Q= 2024-04-16T18:18:16.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A0dVs4v6lo5O78HzFKsu4m7oQ8Q=', 'Content-Length': '0'} 2024-04-16T18:18:16.488 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f43bd890b9229992-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.488 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000076 2024-04-16T18:18:16.488 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.488 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.488 DEBUG:boto:Method: GET 2024-04-16T18:18:16.488 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.489 DEBUG:boto:Data: 2024-04-16T18:18:16.489 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.489 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.489 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.489 DEBUG:boto:Params: {} 2024-04-16T18:18:16.489 DEBUG:boto:Token: None 2024-04-16T18:18:16.489 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.489 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL://XFVAJ7hVv4L5uLShJcMlRJ9j0= 2024-04-16T18:18:16.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL://XFVAJ7hVv4L5uLShJcMlRJ9j0=', 'Content-Length': '0'} 2024-04-16T18:18:16.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f0a9b39e681fb71-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.534 DEBUG:boto:path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.534 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.535 DEBUG:boto:Method: GET 2024-04-16T18:18:16.535 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.535 DEBUG:boto:Data: 2024-04-16T18:18:16.535 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.535 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.535 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.535 DEBUG:boto:Params: {} 2024-04-16T18:18:16.535 DEBUG:boto:Token: None 2024-04-16T18:18:16.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000076 2024-04-16T18:18:16.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL://XFVAJ7hVv4L5uLShJcMlRJ9j0= 2024-04-16T18:18:16.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL://XFVAJ7hVv4L5uLShJcMlRJ9j0=', 'Content-Length': '0'} 2024-04-16T18:18:16.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000652b83f8831dff59-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.538 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.538 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.538 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.538 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.538 DEBUG:boto:Method: GET 2024-04-16T18:18:16.539 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.539 DEBUG:boto:Data: 2024-04-16T18:18:16.539 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.539 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.539 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.539 DEBUG:boto:Params: {} 2024-04-16T18:18:16.539 DEBUG:boto:Token: None 2024-04-16T18:18:16.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.541 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc9cf685d788a364-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.542 DEBUG:boto:b'cjqttm-51obj000000000000000000761000falseobj000000000000000000762024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.542 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.542 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.542 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.542 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.542 DEBUG:boto:Method: GET 2024-04-16T18:18:16.542 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000076 2024-04-16T18:18:16.543 DEBUG:boto:Data: 2024-04-16T18:18:16.543 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.543 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.543 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.543 DEBUG:boto:Params: {} 2024-04-16T18:18:16.543 DEBUG:boto:Token: None 2024-04-16T18:18:16.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.547 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea083579d9c0a575-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.548 DEBUG:boto:b'cjqttm-51obj000000000000000000761000falseobj000000000000000000762024-04-16T18:17:55.006Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.548 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2024-04-16T18:18:16.548 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.548 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.548 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.548 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.548 DEBUG:boto:Method: GET 2024-04-16T18:18:16.548 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.548 DEBUG:boto:Data: 2024-04-16T18:18:16.549 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.549 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.549 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.549 DEBUG:boto:Params: {} 2024-04-16T18:18:16.549 DEBUG:boto:Token: None 2024-04-16T18:18:16.549 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.549 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8= 2024-04-16T18:18:16.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8=', 'Content-Length': '0'} 2024-04-16T18:18:16.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000528ef035823e2b3e-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.594 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.594 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.595 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.595 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.595 DEBUG:boto:Method: GET 2024-04-16T18:18:16.595 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.595 DEBUG:boto:Data: 2024-04-16T18:18:16.595 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.595 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.595 DEBUG:boto:Params: {} 2024-04-16T18:18:16.595 DEBUG:boto:Token: None 2024-04-16T18:18:16.596 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8= 2024-04-16T18:18:16.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8=', 'Content-Length': '0'} 2024-04-16T18:18:16.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098bc72dc15422fcd-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.598 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.598 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.598 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.598 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.598 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.599 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.599 DEBUG:boto:Data: 2024-04-16T18:18:16.599 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.599 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.599 DEBUG:boto:Params: {} 2024-04-16T18:18:16.599 DEBUG:boto:Token: None 2024-04-16T18:18:16.599 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J5xrR7HIbvwQaTrAq0Eu6E5UlR0= 2024-04-16T18:18:16.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J5xrR7HIbvwQaTrAq0Eu6E5UlR0=', 'Content-Length': '0'} 2024-04-16T18:18:16.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d109d8de76d9482-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.601 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.602 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.602 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.602 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.602 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.602 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.602 DEBUG:boto:Data: 2024-04-16T18:18:16.602 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.602 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.602 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.603 DEBUG:boto:Params: {} 2024-04-16T18:18:16.603 DEBUG:boto:Token: None 2024-04-16T18:18:16.603 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J5xrR7HIbvwQaTrAq0Eu6E5UlR0= 2024-04-16T18:18:16.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J5xrR7HIbvwQaTrAq0Eu6E5UlR0=', 'Content-Length': '0'} 2024-04-16T18:18:16.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ede38831327a374f-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.606 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2024-04-16T18:18:16.606 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.606 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.606 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.606 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.606 DEBUG:boto:Method: GET 2024-04-16T18:18:16.607 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.607 DEBUG:boto:Data: 2024-04-16T18:18:16.607 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.607 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.607 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.607 DEBUG:boto:Params: {} 2024-04-16T18:18:16.607 DEBUG:boto:Token: None 2024-04-16T18:18:16.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8= 2024-04-16T18:18:16.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8=', 'Content-Length': '0'} 2024-04-16T18:18:16.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005834b77df923e57e-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.650 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.651 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.651 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.651 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.651 DEBUG:boto:Method: GET 2024-04-16T18:18:16.651 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.651 DEBUG:boto:Data: 2024-04-16T18:18:16.651 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.651 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.651 DEBUG:boto:Params: {} 2024-04-16T18:18:16.651 DEBUG:boto:Token: None 2024-04-16T18:18:16.652 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133?versionId=null 2024-04-16T18:18:16.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8= 2024-04-16T18:18:16.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ImfqvAs9+ShkQ/9Hs4446e1sOI8=', 'Content-Length': '0'} 2024-04-16T18:18:16.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b0462b12dc6d02d-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.654 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.654 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.654 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.654 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.654 DEBUG:boto:Method: GET 2024-04-16T18:18:16.654 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.654 DEBUG:boto:Data: 2024-04-16T18:18:16.654 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.655 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.655 DEBUG:boto:Params: {} 2024-04-16T18:18:16.655 DEBUG:boto:Token: None 2024-04-16T18:18:16.655 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002230e44d66f60b9f-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.658 DEBUG:boto:b'cjqttm-51obj000000000000000001331000falseobj000000000000000001332024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.658 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.658 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.658 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.658 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.658 DEBUG:boto:Method: GET 2024-04-16T18:18:16.658 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.659 DEBUG:boto:Data: 2024-04-16T18:18:16.659 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.659 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.659 DEBUG:boto:Params: {} 2024-04-16T18:18:16.659 DEBUG:boto:Token: None 2024-04-16T18:18:16.659 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.663 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091ff7cd770bebe17-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.663 DEBUG:boto:b'cjqttm-51obj000000000000000001331000falseobj000000000000000001332024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.663 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.663 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.663 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.663 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.663 DEBUG:boto:Data: 2024-04-16T18:18:16.664 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.664 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.664 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.664 DEBUG:boto:Params: {} 2024-04-16T18:18:16.664 DEBUG:boto:Token: None 2024-04-16T18:18:16.664 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s3s/cz+2N86nLz1Pvvb6yvQ8Y/s= 2024-04-16T18:18:16.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s3s/cz+2N86nLz1Pvvb6yvQ8Y/s=', 'Content-Length': '0'} 2024-04-16T18:18:16.666 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067cf5e351f280d0b-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.666 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.666 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.666 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.666 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.667 DEBUG:boto:Data: 2024-04-16T18:18:16.667 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.667 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.667 DEBUG:boto:Params: {} 2024-04-16T18:18:16.667 DEBUG:boto:Token: None 2024-04-16T18:18:16.667 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s3s/cz+2N86nLz1Pvvb6yvQ8Y/s= 2024-04-16T18:18:16.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s3s/cz+2N86nLz1Pvvb6yvQ8Y/s=', 'Content-Length': '0'} 2024-04-16T18:18:16.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fd86da914ade239-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.670 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000133 2024-04-16T18:18:16.670 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.670 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.670 DEBUG:boto:Method: GET 2024-04-16T18:18:16.670 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.670 DEBUG:boto:Data: 2024-04-16T18:18:16.670 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.670 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.670 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.670 DEBUG:boto:Params: {} 2024-04-16T18:18:16.671 DEBUG:boto:Token: None 2024-04-16T18:18:16.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WgB03JC4zBx3wzVLftO4eVgazc0= 2024-04-16T18:18:16.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WgB03JC4zBx3wzVLftO4eVgazc0=', 'Content-Length': '0'} 2024-04-16T18:18:16.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8480678a0259ac9-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.714 DEBUG:boto:path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.714 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.715 DEBUG:boto:Method: GET 2024-04-16T18:18:16.715 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.715 DEBUG:boto:Data: 2024-04-16T18:18:16.715 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.715 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.715 DEBUG:boto:Params: {} 2024-04-16T18:18:16.715 DEBUG:boto:Token: None 2024-04-16T18:18:16.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000133 2024-04-16T18:18:16.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WgB03JC4zBx3wzVLftO4eVgazc0= 2024-04-16T18:18:16.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WgB03JC4zBx3wzVLftO4eVgazc0=', 'Content-Length': '0'} 2024-04-16T18:18:16.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2b9830b97b18856-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.717 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.718 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.718 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.718 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.718 DEBUG:boto:Method: GET 2024-04-16T18:18:16.718 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.718 DEBUG:boto:Data: 2024-04-16T18:18:16.718 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.718 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.718 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.719 DEBUG:boto:Params: {} 2024-04-16T18:18:16.719 DEBUG:boto:Token: None 2024-04-16T18:18:16.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e4b61ab54c76bfc-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.721 DEBUG:boto:b'cjqttm-51obj000000000000000001331000falseobj000000000000000001332024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.722 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.722 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.722 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.722 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.722 DEBUG:boto:Method: GET 2024-04-16T18:18:16.722 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000133 2024-04-16T18:18:16.722 DEBUG:boto:Data: 2024-04-16T18:18:16.722 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.722 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.723 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.723 DEBUG:boto:Params: {} 2024-04-16T18:18:16.723 DEBUG:boto:Token: None 2024-04-16T18:18:16.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.727 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4cd80a34c3e54f1-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.727 DEBUG:boto:b'cjqttm-51obj000000000000000001331000falseobj000000000000000001332024-04-16T18:17:58.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2024-04-16T18:18:16.727 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.727 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.728 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.728 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.728 DEBUG:boto:Method: GET 2024-04-16T18:18:16.728 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.728 DEBUG:boto:Data: 2024-04-16T18:18:16.728 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.728 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.728 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.728 DEBUG:boto:Params: {} 2024-04-16T18:18:16.728 DEBUG:boto:Token: None 2024-04-16T18:18:16.729 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.729 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8= 2024-04-16T18:18:16.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8=', 'Content-Length': '0'} 2024-04-16T18:18:16.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000166389d6684ef41e-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.774 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.775 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.775 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.775 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.775 DEBUG:boto:Method: GET 2024-04-16T18:18:16.775 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.775 DEBUG:boto:Data: 2024-04-16T18:18:16.775 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.775 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.775 DEBUG:boto:Params: {} 2024-04-16T18:18:16.775 DEBUG:boto:Token: None 2024-04-16T18:18:16.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8= 2024-04-16T18:18:16.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8=', 'Content-Length': '0'} 2024-04-16T18:18:16.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c8348092bd0709d-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.778 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.778 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.778 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.778 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.779 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.779 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.779 DEBUG:boto:Data: 2024-04-16T18:18:16.779 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.779 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.779 DEBUG:boto:Params: {} 2024-04-16T18:18:16.779 DEBUG:boto:Token: None 2024-04-16T18:18:16.779 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mg3gJtyT7PjAiAY3zz/zgc/rKio= 2024-04-16T18:18:16.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mg3gJtyT7PjAiAY3zz/zgc/rKio=', 'Content-Length': '0'} 2024-04-16T18:18:16.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b4c34a842f97dcc-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.782 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.782 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.782 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.782 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.782 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.782 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.783 DEBUG:boto:Data: 2024-04-16T18:18:16.783 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.783 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.783 DEBUG:boto:Params: {} 2024-04-16T18:18:16.783 DEBUG:boto:Token: None 2024-04-16T18:18:16.783 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.783 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mg3gJtyT7PjAiAY3zz/zgc/rKio= 2024-04-16T18:18:16.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mg3gJtyT7PjAiAY3zz/zgc/rKio=', 'Content-Length': '0'} 2024-04-16T18:18:16.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056061d07fea0db25-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2024-04-16T18:18:16.786 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.786 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.786 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.786 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.786 DEBUG:boto:Method: GET 2024-04-16T18:18:16.786 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.786 DEBUG:boto:Data: 2024-04-16T18:18:16.787 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.787 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.787 DEBUG:boto:Params: {} 2024-04-16T18:18:16.787 DEBUG:boto:Token: None 2024-04-16T18:18:16.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8= 2024-04-16T18:18:16.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8=', 'Content-Length': '0'} 2024-04-16T18:18:16.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad6f10f577cb468d-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.830 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.830 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.831 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.831 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.831 DEBUG:boto:Method: GET 2024-04-16T18:18:16.831 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.831 DEBUG:boto:Data: 2024-04-16T18:18:16.831 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.831 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.831 DEBUG:boto:Params: {} 2024-04-16T18:18:16.831 DEBUG:boto:Token: None 2024-04-16T18:18:16.831 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162?versionId=null 2024-04-16T18:18:16.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8= 2024-04-16T18:18:16.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F0s9uq7fRyfsSGpgV470Pe9lns8=', 'Content-Length': '0'} 2024-04-16T18:18:16.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a2828f3dc91717b-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.834 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.834 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.834 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.834 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.834 DEBUG:boto:Method: GET 2024-04-16T18:18:16.834 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.834 DEBUG:boto:Data: 2024-04-16T18:18:16.834 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.835 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.835 DEBUG:boto:Params: {} 2024-04-16T18:18:16.835 DEBUG:boto:Token: None 2024-04-16T18:18:16.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.838 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000806779ae112f858c-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.838 DEBUG:boto:b'cjqttm-51obj000000000000000001621000falseobj000000000000000001622024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.838 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.838 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.839 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.839 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.839 DEBUG:boto:Method: GET 2024-04-16T18:18:16.839 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.839 DEBUG:boto:Data: 2024-04-16T18:18:16.839 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.839 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.839 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.839 DEBUG:boto:Params: {} 2024-04-16T18:18:16.839 DEBUG:boto:Token: None 2024-04-16T18:18:16.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.843 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000789248de3594afbc-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.844 DEBUG:boto:b'cjqttm-51obj000000000000000001621000falseobj000000000000000001622024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.844 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.844 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.844 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.844 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.844 DEBUG:boto:Data: 2024-04-16T18:18:16.844 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.844 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.844 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.845 DEBUG:boto:Params: {} 2024-04-16T18:18:16.845 DEBUG:boto:Token: None 2024-04-16T18:18:16.845 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.845 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eTi5/lGq+5T6+84mcggWIMgdHps= 2024-04-16T18:18:16.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eTi5/lGq+5T6+84mcggWIMgdHps=', 'Content-Length': '0'} 2024-04-16T18:18:16.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000911a6dbcf7cdd003-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.847 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.847 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.847 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.847 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.848 DEBUG:boto:Data: 2024-04-16T18:18:16.848 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.848 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.848 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.848 DEBUG:boto:Params: {} 2024-04-16T18:18:16.848 DEBUG:boto:Token: None 2024-04-16T18:18:16.848 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eTi5/lGq+5T6+84mcggWIMgdHps= 2024-04-16T18:18:16.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eTi5/lGq+5T6+84mcggWIMgdHps=', 'Content-Length': '0'} 2024-04-16T18:18:16.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be82ca9cff7fb8fc-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.851 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000162 2024-04-16T18:18:16.851 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.851 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.851 DEBUG:boto:Method: GET 2024-04-16T18:18:16.851 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.851 DEBUG:boto:Data: 2024-04-16T18:18:16.851 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.851 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.851 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.852 DEBUG:boto:Params: {} 2024-04-16T18:18:16.852 DEBUG:boto:Token: None 2024-04-16T18:18:16.852 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+NNIp0zwe22cxACNx0ZV7m0e0tg= 2024-04-16T18:18:16.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+NNIp0zwe22cxACNx0ZV7m0e0tg=', 'Content-Length': '0'} 2024-04-16T18:18:16.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000193cb3b5db827025-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.894 DEBUG:boto:path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.894 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.895 DEBUG:boto:Method: GET 2024-04-16T18:18:16.895 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.895 DEBUG:boto:Data: 2024-04-16T18:18:16.895 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.895 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.895 DEBUG:boto:Params: {} 2024-04-16T18:18:16.895 DEBUG:boto:Token: None 2024-04-16T18:18:16.895 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000162 2024-04-16T18:18:16.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+NNIp0zwe22cxACNx0ZV7m0e0tg= 2024-04-16T18:18:16.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+NNIp0zwe22cxACNx0ZV7m0e0tg=', 'Content-Length': '0'} 2024-04-16T18:18:16.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021d28ba78453bae8-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.898 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.898 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.898 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.898 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.898 DEBUG:boto:Method: GET 2024-04-16T18:18:16.898 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.898 DEBUG:boto:Data: 2024-04-16T18:18:16.898 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.898 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.899 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.899 DEBUG:boto:Params: {} 2024-04-16T18:18:16.899 DEBUG:boto:Token: None 2024-04-16T18:18:16.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.901 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047701d880586712f-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.942 DEBUG:boto:b'cjqttm-51obj000000000000000001621000falseobj000000000000000001622024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.943 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:16.943 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:16.943 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.943 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.943 DEBUG:boto:Method: GET 2024-04-16T18:18:16.943 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000162 2024-04-16T18:18:16.943 DEBUG:boto:Data: 2024-04-16T18:18:16.943 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.943 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.943 DEBUG:boto:Params: {} 2024-04-16T18:18:16.944 DEBUG:boto:Token: None 2024-04-16T18:18:16.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/ 2024-04-16T18:18:16.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE= 2024-04-16T18:18:16.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I6dMONz3CljKadFiW6pyirOWgSE=', 'Content-Length': '0'} 2024-04-16T18:18:16.947 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1c6dbcd25f833cc-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.947 DEBUG:boto:b'cjqttm-51obj000000000000000001621000falseobj000000000000000001622024-04-16T18:17:58.879Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:16.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2024-04-16T18:18:16.948 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:16.948 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:16.948 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.948 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.948 DEBUG:boto:Method: GET 2024-04-16T18:18:16.948 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.948 DEBUG:boto:Data: 2024-04-16T18:18:16.948 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.948 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.948 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.948 DEBUG:boto:Params: {} 2024-04-16T18:18:16.949 DEBUG:boto:Token: None 2024-04-16T18:18:16.949 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.949 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9oVJYWmlrhksEUVX/q89ogA05R4= 2024-04-16T18:18:16.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9oVJYWmlrhksEUVX/q89ogA05R4=', 'Content-Length': '0'} 2024-04-16T18:18:16.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003131dc9abc4fd8c-00661ec0e8-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.994 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:16.994 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:16.994 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.995 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.995 DEBUG:boto:Method: GET 2024-04-16T18:18:16.995 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.995 DEBUG:boto:Data: 2024-04-16T18:18:16.995 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:16.995 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.995 DEBUG:boto:Params: {} 2024-04-16T18:18:16.995 DEBUG:boto:Token: None 2024-04-16T18:18:16.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9oVJYWmlrhksEUVX/q89ogA05R4= 2024-04-16T18:18:16.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9oVJYWmlrhksEUVX/q89ogA05R4=', 'Content-Length': '0'} 2024-04-16T18:18:16.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096282b2775b4157b-00661ec0e8-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:16.998 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:16.998 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:16.998 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.998 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.998 DEBUG:boto:Method: HEAD 2024-04-16T18:18:16.998 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.998 DEBUG:boto:Data: 2024-04-16T18:18:16.998 DEBUG:boto:Headers: {} 2024-04-16T18:18:16.998 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:16.998 DEBUG:boto:Port: 8000 2024-04-16T18:18:16.998 DEBUG:boto:Params: {} 2024-04-16T18:18:16.999 DEBUG:boto:Token: None 2024-04-16T18:18:16.999 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:16 GMT /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:16.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9/SZB5Kj8nZfA8/2H8/VVEAZxuU= 2024-04-16T18:18:16.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9/SZB5Kj8nZfA8/2H8/VVEAZxuU=', 'Content-Length': '0'} 2024-04-16T18:18:17.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bfd66e4c2e958be-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.001 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.001 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.001 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.001 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.001 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.001 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.001 DEBUG:boto:Data: 2024-04-16T18:18:17.002 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.002 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.002 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.002 DEBUG:boto:Params: {} 2024-04-16T18:18:17.002 DEBUG:boto:Token: None 2024-04-16T18:18:17.002 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.002 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zFtZnOxaynnqhHaMjWUOBUnaEmU= 2024-04-16T18:18:17.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zFtZnOxaynnqhHaMjWUOBUnaEmU=', 'Content-Length': '0'} 2024-04-16T18:18:17.004 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e937882ed4d9888-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.004 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2024-04-16T18:18:17.004 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.004 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.004 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.005 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.005 DEBUG:boto:Method: GET 2024-04-16T18:18:17.005 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.005 DEBUG:boto:Data: 2024-04-16T18:18:17.005 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.005 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.005 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.005 DEBUG:boto:Params: {} 2024-04-16T18:18:17.005 DEBUG:boto:Token: None 2024-04-16T18:18:17.006 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.006 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0KkLm4GgXYnmESUuxZNWPwC14uM= 2024-04-16T18:18:17.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0KkLm4GgXYnmESUuxZNWPwC14uM=', 'Content-Length': '0'} 2024-04-16T18:18:17.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abfc0c96314f22f5-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.050 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.050 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.051 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.051 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.051 DEBUG:boto:Method: GET 2024-04-16T18:18:17.051 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.051 DEBUG:boto:Data: 2024-04-16T18:18:17.051 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.051 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.051 DEBUG:boto:Params: {} 2024-04-16T18:18:17.051 DEBUG:boto:Token: None 2024-04-16T18:18:17.051 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000271?versionId=null 2024-04-16T18:18:17.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0KkLm4GgXYnmESUuxZNWPwC14uM= 2024-04-16T18:18:17.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0KkLm4GgXYnmESUuxZNWPwC14uM=', 'Content-Length': '0'} 2024-04-16T18:18:17.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c8e8553ef6d47b1-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.054 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.054 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.054 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.054 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.054 DEBUG:boto:Method: GET 2024-04-16T18:18:17.054 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.055 DEBUG:boto:Data: 2024-04-16T18:18:17.055 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.055 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.055 DEBUG:boto:Params: {} 2024-04-16T18:18:17.055 DEBUG:boto:Token: None 2024-04-16T18:18:17.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb09aace8336ded3-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.098 DEBUG:boto:b'cjqttm-51obj000000000000000002711000falseobj000000000000000002712024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.099 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.099 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.099 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.099 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.099 DEBUG:boto:Method: GET 2024-04-16T18:18:17.099 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.099 DEBUG:boto:Data: 2024-04-16T18:18:17.099 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.099 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.100 DEBUG:boto:Params: {} 2024-04-16T18:18:17.100 DEBUG:boto:Token: None 2024-04-16T18:18:17.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e07b950aa1012cee-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.104 DEBUG:boto:b'cjqttm-51obj000000000000000002711000falseobj000000000000000002712024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.104 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.104 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.104 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.105 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.105 DEBUG:boto:Data: 2024-04-16T18:18:17.105 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.105 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.105 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.105 DEBUG:boto:Params: {} 2024-04-16T18:18:17.105 DEBUG:boto:Token: None 2024-04-16T18:18:17.105 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.105 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fg+UWoXL0Gf1LgDUJi0ejjv9hlk= 2024-04-16T18:18:17.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fg+UWoXL0Gf1LgDUJi0ejjv9hlk=', 'Content-Length': '0'} 2024-04-16T18:18:17.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052899ba4c66dc7f4-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.108 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.108 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.108 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.108 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.108 DEBUG:boto:Data: 2024-04-16T18:18:17.108 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.108 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.108 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.108 DEBUG:boto:Params: {} 2024-04-16T18:18:17.109 DEBUG:boto:Token: None 2024-04-16T18:18:17.109 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.109 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fg+UWoXL0Gf1LgDUJi0ejjv9hlk= 2024-04-16T18:18:17.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fg+UWoXL0Gf1LgDUJi0ejjv9hlk=', 'Content-Length': '0'} 2024-04-16T18:18:17.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000426690e8adce2769-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000271 2024-04-16T18:18:17.112 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.112 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.112 DEBUG:boto:Method: GET 2024-04-16T18:18:17.112 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.112 DEBUG:boto:Data: 2024-04-16T18:18:17.112 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.112 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.112 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.112 DEBUG:boto:Params: {} 2024-04-16T18:18:17.112 DEBUG:boto:Token: None 2024-04-16T18:18:17.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.113 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K/Fl0O0cExu7BvC2hGVjfrWjasU= 2024-04-16T18:18:17.113 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K/Fl0O0cExu7BvC2hGVjfrWjasU=', 'Content-Length': '0'} 2024-04-16T18:18:17.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004652c411ae42f049-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.158 DEBUG:boto:path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.158 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.158 DEBUG:boto:Method: GET 2024-04-16T18:18:17.159 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.159 DEBUG:boto:Data: 2024-04-16T18:18:17.159 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.159 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.159 DEBUG:boto:Params: {} 2024-04-16T18:18:17.159 DEBUG:boto:Token: None 2024-04-16T18:18:17.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000271 2024-04-16T18:18:17.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K/Fl0O0cExu7BvC2hGVjfrWjasU= 2024-04-16T18:18:17.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K/Fl0O0cExu7BvC2hGVjfrWjasU=', 'Content-Length': '0'} 2024-04-16T18:18:17.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007510b5286389d787-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.162 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.162 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.162 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.162 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.162 DEBUG:boto:Method: GET 2024-04-16T18:18:17.162 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.162 DEBUG:boto:Data: 2024-04-16T18:18:17.162 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.163 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.163 DEBUG:boto:Params: {} 2024-04-16T18:18:17.163 DEBUG:boto:Token: None 2024-04-16T18:18:17.163 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.165 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f6ba11a888e7938-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.206 DEBUG:boto:b'cjqttm-51obj000000000000000002711000falseobj000000000000000002712024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.207 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.207 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.207 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.207 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.207 DEBUG:boto:Method: GET 2024-04-16T18:18:17.207 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000271 2024-04-16T18:18:17.207 DEBUG:boto:Data: 2024-04-16T18:18:17.207 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.208 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.208 DEBUG:boto:Params: {} 2024-04-16T18:18:17.208 DEBUG:boto:Token: None 2024-04-16T18:18:17.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.212 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016edebdd6078dfb2-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.212 DEBUG:boto:b'cjqttm-51obj000000000000000002711000falseobj000000000000000002712024-04-16T18:17:58.183Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.212 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2024-04-16T18:18:17.212 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.212 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.213 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.213 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.213 DEBUG:boto:Method: GET 2024-04-16T18:18:17.213 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.213 DEBUG:boto:Data: 2024-04-16T18:18:17.213 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.213 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.213 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.213 DEBUG:boto:Params: {} 2024-04-16T18:18:17.213 DEBUG:boto:Token: None 2024-04-16T18:18:17.213 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.214 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E= 2024-04-16T18:18:17.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E=', 'Content-Length': '0'} 2024-04-16T18:18:17.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c01ddf6a51f92830-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.258 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.258 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.259 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.259 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.259 DEBUG:boto:Method: GET 2024-04-16T18:18:17.259 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.259 DEBUG:boto:Data: 2024-04-16T18:18:17.259 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.259 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.259 DEBUG:boto:Params: {} 2024-04-16T18:18:17.259 DEBUG:boto:Token: None 2024-04-16T18:18:17.260 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E= 2024-04-16T18:18:17.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E=', 'Content-Length': '0'} 2024-04-16T18:18:17.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b2d69b5183ad9ae-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.262 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.263 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.263 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.263 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.263 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.263 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.263 DEBUG:boto:Data: 2024-04-16T18:18:17.263 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.263 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.263 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.263 DEBUG:boto:Params: {} 2024-04-16T18:18:17.263 DEBUG:boto:Token: None 2024-04-16T18:18:17.264 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SuLzayNM1DQhdx0IPqw4+a8LLno= 2024-04-16T18:18:17.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SuLzayNM1DQhdx0IPqw4+a8LLno=', 'Content-Length': '0'} 2024-04-16T18:18:17.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce5bcc2d2007702a-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.266 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.266 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.266 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.266 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.266 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.266 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.267 DEBUG:boto:Data: 2024-04-16T18:18:17.267 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.267 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.267 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.267 DEBUG:boto:Params: {} 2024-04-16T18:18:17.267 DEBUG:boto:Token: None 2024-04-16T18:18:17.267 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SuLzayNM1DQhdx0IPqw4+a8LLno= 2024-04-16T18:18:17.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SuLzayNM1DQhdx0IPqw4+a8LLno=', 'Content-Length': '0'} 2024-04-16T18:18:17.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005998d28c99ec6642-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.270 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2024-04-16T18:18:17.270 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.270 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.270 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.270 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.270 DEBUG:boto:Method: GET 2024-04-16T18:18:17.270 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.270 DEBUG:boto:Data: 2024-04-16T18:18:17.271 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.271 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.271 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.271 DEBUG:boto:Params: {} 2024-04-16T18:18:17.271 DEBUG:boto:Token: None 2024-04-16T18:18:17.271 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E= 2024-04-16T18:18:17.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E=', 'Content-Length': '0'} 2024-04-16T18:18:17.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023051cd8bd3dc74c-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.314 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.315 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.315 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.315 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.315 DEBUG:boto:Method: GET 2024-04-16T18:18:17.315 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.315 DEBUG:boto:Data: 2024-04-16T18:18:17.315 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.315 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.315 DEBUG:boto:Params: {} 2024-04-16T18:18:17.315 DEBUG:boto:Token: None 2024-04-16T18:18:17.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283?versionId=null 2024-04-16T18:18:17.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E= 2024-04-16T18:18:17.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C92tpeKs2CgVNYE5PTEn7fxxV1E=', 'Content-Length': '0'} 2024-04-16T18:18:17.318 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe0723dd956ecee0-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.318 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.318 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.318 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.319 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.319 DEBUG:boto:Method: GET 2024-04-16T18:18:17.319 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.319 DEBUG:boto:Data: 2024-04-16T18:18:17.319 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.319 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.319 DEBUG:boto:Params: {} 2024-04-16T18:18:17.319 DEBUG:boto:Token: None 2024-04-16T18:18:17.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.322 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000853eb245195b2b29-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.362 DEBUG:boto:b'cjqttm-51obj000000000000000002831000falseobj000000000000000002832024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.363 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.363 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.363 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.363 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.363 DEBUG:boto:Method: GET 2024-04-16T18:18:17.363 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.363 DEBUG:boto:Data: 2024-04-16T18:18:17.363 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.363 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.364 DEBUG:boto:Params: {} 2024-04-16T18:18:17.364 DEBUG:boto:Token: None 2024-04-16T18:18:17.364 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.368 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffc0a7ba83890587-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.368 DEBUG:boto:b'cjqttm-51obj000000000000000002831000falseobj000000000000000002832024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.368 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.368 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.368 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.368 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.369 DEBUG:boto:Data: 2024-04-16T18:18:17.369 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.369 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.369 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.369 DEBUG:boto:Params: {} 2024-04-16T18:18:17.369 DEBUG:boto:Token: None 2024-04-16T18:18:17.369 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.369 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vRnD9A/QyL1I06F2qD7B6IU6kvc= 2024-04-16T18:18:17.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vRnD9A/QyL1I06F2qD7B6IU6kvc=', 'Content-Length': '0'} 2024-04-16T18:18:17.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7bf5c05496ad7e1-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.371 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.372 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.372 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.372 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.372 DEBUG:boto:Data: 2024-04-16T18:18:17.372 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.372 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.372 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.373 DEBUG:boto:Params: {} 2024-04-16T18:18:17.373 DEBUG:boto:Token: None 2024-04-16T18:18:17.373 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.373 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vRnD9A/QyL1I06F2qD7B6IU6kvc= 2024-04-16T18:18:17.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vRnD9A/QyL1I06F2qD7B6IU6kvc=', 'Content-Length': '0'} 2024-04-16T18:18:17.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce0b686d65bf9bfd-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000283 2024-04-16T18:18:17.376 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.376 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.376 DEBUG:boto:Method: GET 2024-04-16T18:18:17.376 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.376 DEBUG:boto:Data: 2024-04-16T18:18:17.376 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.376 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.376 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.376 DEBUG:boto:Params: {} 2024-04-16T18:18:17.376 DEBUG:boto:Token: None 2024-04-16T18:18:17.377 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.377 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o9Zq+kRn+LMH0MS6KZUqpHBk4xI= 2024-04-16T18:18:17.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o9Zq+kRn+LMH0MS6KZUqpHBk4xI=', 'Content-Length': '0'} 2024-04-16T18:18:17.379 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0cb4f85c479a355-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.422 DEBUG:boto:path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.422 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.423 DEBUG:boto:Method: GET 2024-04-16T18:18:17.423 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.423 DEBUG:boto:Data: 2024-04-16T18:18:17.423 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.423 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.423 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.423 DEBUG:boto:Params: {} 2024-04-16T18:18:17.423 DEBUG:boto:Token: None 2024-04-16T18:18:17.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000283 2024-04-16T18:18:17.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o9Zq+kRn+LMH0MS6KZUqpHBk4xI= 2024-04-16T18:18:17.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o9Zq+kRn+LMH0MS6KZUqpHBk4xI=', 'Content-Length': '0'} 2024-04-16T18:18:17.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002eefab9a361aac7-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.426 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.426 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.426 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.426 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.426 DEBUG:boto:Method: GET 2024-04-16T18:18:17.426 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.426 DEBUG:boto:Data: 2024-04-16T18:18:17.427 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.427 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.427 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.427 DEBUG:boto:Params: {} 2024-04-16T18:18:17.427 DEBUG:boto:Token: None 2024-04-16T18:18:17.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.427 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007cae859758d0ec6d-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.470 DEBUG:boto:b'cjqttm-51obj000000000000000002831000falseobj000000000000000002832024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.471 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.471 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.471 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.471 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.471 DEBUG:boto:Method: GET 2024-04-16T18:18:17.471 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000283 2024-04-16T18:18:17.471 DEBUG:boto:Data: 2024-04-16T18:18:17.471 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.471 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.471 DEBUG:boto:Params: {} 2024-04-16T18:18:17.472 DEBUG:boto:Token: None 2024-04-16T18:18:17.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000059e5ad7704296c34-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.476 DEBUG:boto:b'cjqttm-51obj000000000000000002831000falseobj000000000000000002832024-04-16T18:17:58.507Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2024-04-16T18:18:17.477 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.477 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.477 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.477 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.477 DEBUG:boto:Method: GET 2024-04-16T18:18:17.477 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.477 DEBUG:boto:Data: 2024-04-16T18:18:17.477 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.477 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.477 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.478 DEBUG:boto:Params: {} 2024-04-16T18:18:17.478 DEBUG:boto:Token: None 2024-04-16T18:18:17.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A= 2024-04-16T18:18:17.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A=', 'Content-Length': '0'} 2024-04-16T18:18:17.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000045b7c3b9304a1d1-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.522 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.523 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.523 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.523 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.523 DEBUG:boto:Method: GET 2024-04-16T18:18:17.523 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.523 DEBUG:boto:Data: 2024-04-16T18:18:17.523 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.523 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.523 DEBUG:boto:Params: {} 2024-04-16T18:18:17.523 DEBUG:boto:Token: None 2024-04-16T18:18:17.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A= 2024-04-16T18:18:17.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A=', 'Content-Length': '0'} 2024-04-16T18:18:17.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041580c3cf1b7c89b-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.526 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.526 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.527 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.527 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.527 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.527 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.527 DEBUG:boto:Data: 2024-04-16T18:18:17.527 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.527 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.527 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.527 DEBUG:boto:Params: {} 2024-04-16T18:18:17.528 DEBUG:boto:Token: None 2024-04-16T18:18:17.528 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SRFxTlWNSczAbf5KjiesXabi72M= 2024-04-16T18:18:17.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SRFxTlWNSczAbf5KjiesXabi72M=', 'Content-Length': '0'} 2024-04-16T18:18:17.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001801d222df0f0164-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.531 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.531 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.531 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.531 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.531 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.531 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.531 DEBUG:boto:Data: 2024-04-16T18:18:17.531 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.531 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.531 DEBUG:boto:Params: {} 2024-04-16T18:18:17.532 DEBUG:boto:Token: None 2024-04-16T18:18:17.532 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SRFxTlWNSczAbf5KjiesXabi72M= 2024-04-16T18:18:17.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SRFxTlWNSczAbf5KjiesXabi72M=', 'Content-Length': '0'} 2024-04-16T18:18:17.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f195c519792acfcf-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2024-04-16T18:18:17.534 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.534 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.534 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.534 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.535 DEBUG:boto:Method: GET 2024-04-16T18:18:17.535 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.535 DEBUG:boto:Data: 2024-04-16T18:18:17.535 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.535 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.535 DEBUG:boto:Params: {} 2024-04-16T18:18:17.535 DEBUG:boto:Token: None 2024-04-16T18:18:17.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A= 2024-04-16T18:18:17.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A=', 'Content-Length': '0'} 2024-04-16T18:18:17.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004107257df4415812-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.578 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.578 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.579 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.579 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.579 DEBUG:boto:Method: GET 2024-04-16T18:18:17.579 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.579 DEBUG:boto:Data: 2024-04-16T18:18:17.579 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.579 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.579 DEBUG:boto:Params: {} 2024-04-16T18:18:17.580 DEBUG:boto:Token: None 2024-04-16T18:18:17.580 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317?versionId=null 2024-04-16T18:18:17.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A= 2024-04-16T18:18:17.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I4mUxlPoodJzavdxz5LgOSm9s6A=', 'Content-Length': '0'} 2024-04-16T18:18:17.582 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f35e86afb8547c6-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.582 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.582 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.582 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.582 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.582 DEBUG:boto:Method: GET 2024-04-16T18:18:17.582 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.583 DEBUG:boto:Data: 2024-04-16T18:18:17.583 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.583 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.583 DEBUG:boto:Params: {} 2024-04-16T18:18:17.583 DEBUG:boto:Token: None 2024-04-16T18:18:17.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052188346c644a254-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.586 DEBUG:boto:b'cjqttm-51obj000000000000000003171000falseobj000000000000000003172024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.586 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.586 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.586 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.586 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.586 DEBUG:boto:Method: GET 2024-04-16T18:18:17.587 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.587 DEBUG:boto:Data: 2024-04-16T18:18:17.587 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.587 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.587 DEBUG:boto:Params: {} 2024-04-16T18:18:17.587 DEBUG:boto:Token: None 2024-04-16T18:18:17.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ab7fee3209fde62-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.591 DEBUG:boto:b'cjqttm-51obj000000000000000003171000falseobj000000000000000003172024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.592 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.592 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.592 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.592 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.592 DEBUG:boto:Data: 2024-04-16T18:18:17.592 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.592 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.592 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.592 DEBUG:boto:Params: {} 2024-04-16T18:18:17.592 DEBUG:boto:Token: None 2024-04-16T18:18:17.593 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.593 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qsAGN9jFHh29j7rYG4qMu3CenGI= 2024-04-16T18:18:17.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qsAGN9jFHh29j7rYG4qMu3CenGI=', 'Content-Length': '0'} 2024-04-16T18:18:17.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b473f6518093ae58-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.595 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.595 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.595 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.595 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.596 DEBUG:boto:Data: 2024-04-16T18:18:17.596 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.596 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.596 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.596 DEBUG:boto:Params: {} 2024-04-16T18:18:17.596 DEBUG:boto:Token: None 2024-04-16T18:18:17.596 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qsAGN9jFHh29j7rYG4qMu3CenGI= 2024-04-16T18:18:17.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qsAGN9jFHh29j7rYG4qMu3CenGI=', 'Content-Length': '0'} 2024-04-16T18:18:17.599 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000292d6a3f247fa0be-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000317 2024-04-16T18:18:17.599 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.599 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.599 DEBUG:boto:Method: GET 2024-04-16T18:18:17.599 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.600 DEBUG:boto:Data: 2024-04-16T18:18:17.600 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.600 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.600 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.600 DEBUG:boto:Params: {} 2024-04-16T18:18:17.600 DEBUG:boto:Token: None 2024-04-16T18:18:17.600 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bXilsM//C/thh6wWfal0MU5gbS8= 2024-04-16T18:18:17.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bXilsM//C/thh6wWfal0MU5gbS8=', 'Content-Length': '0'} 2024-04-16T18:18:17.603 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cc9d41399dff626-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.646 DEBUG:boto:path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.647 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.647 DEBUG:boto:Method: GET 2024-04-16T18:18:17.647 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.647 DEBUG:boto:Data: 2024-04-16T18:18:17.647 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.647 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.647 DEBUG:boto:Params: {} 2024-04-16T18:18:17.647 DEBUG:boto:Token: None 2024-04-16T18:18:17.648 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000317 2024-04-16T18:18:17.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bXilsM//C/thh6wWfal0MU5gbS8= 2024-04-16T18:18:17.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bXilsM//C/thh6wWfal0MU5gbS8=', 'Content-Length': '0'} 2024-04-16T18:18:17.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb471d0f86702244-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.650 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.651 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.651 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.651 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.651 DEBUG:boto:Method: GET 2024-04-16T18:18:17.651 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.651 DEBUG:boto:Data: 2024-04-16T18:18:17.651 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.651 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.651 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.651 DEBUG:boto:Params: {} 2024-04-16T18:18:17.652 DEBUG:boto:Token: None 2024-04-16T18:18:17.652 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006a55bff89e09ed2-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.694 DEBUG:boto:b'cjqttm-51obj000000000000000003171000falseobj000000000000000003172024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.695 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.695 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.695 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.695 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.695 DEBUG:boto:Method: GET 2024-04-16T18:18:17.695 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000317 2024-04-16T18:18:17.695 DEBUG:boto:Data: 2024-04-16T18:18:17.695 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.695 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.695 DEBUG:boto:Params: {} 2024-04-16T18:18:17.696 DEBUG:boto:Token: None 2024-04-16T18:18:17.696 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.700 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ce2d2a3cb5be338-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.700 DEBUG:boto:b'cjqttm-51obj000000000000000003171000falseobj000000000000000003172024-04-16T18:17:58.639Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2024-04-16T18:18:17.700 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.700 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.701 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.701 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.701 DEBUG:boto:Method: GET 2024-04-16T18:18:17.701 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.701 DEBUG:boto:Data: 2024-04-16T18:18:17.701 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.701 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.701 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.701 DEBUG:boto:Params: {} 2024-04-16T18:18:17.701 DEBUG:boto:Token: None 2024-04-16T18:18:17.701 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.702 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ= 2024-04-16T18:18:17.702 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ=', 'Content-Length': '0'} 2024-04-16T18:18:17.704 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e18c1e11e5f32ad-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.746 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.746 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.747 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.747 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.747 DEBUG:boto:Method: GET 2024-04-16T18:18:17.747 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.747 DEBUG:boto:Data: 2024-04-16T18:18:17.747 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.747 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.747 DEBUG:boto:Params: {} 2024-04-16T18:18:17.747 DEBUG:boto:Token: None 2024-04-16T18:18:17.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ= 2024-04-16T18:18:17.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ=', 'Content-Length': '0'} 2024-04-16T18:18:17.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f97cc586f7290011-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.750 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.750 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.750 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.750 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.750 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.750 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.750 DEBUG:boto:Data: 2024-04-16T18:18:17.750 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.751 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.751 DEBUG:boto:Params: {} 2024-04-16T18:18:17.751 DEBUG:boto:Token: None 2024-04-16T18:18:17.751 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yjTLTmHlRu0BJzWlaDECZ554p3g= 2024-04-16T18:18:17.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yjTLTmHlRu0BJzWlaDECZ554p3g=', 'Content-Length': '0'} 2024-04-16T18:18:17.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003aa4816ea1c9f689-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.753 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.753 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.753 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.753 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.753 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.754 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.754 DEBUG:boto:Data: 2024-04-16T18:18:17.754 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.754 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.754 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.754 DEBUG:boto:Params: {} 2024-04-16T18:18:17.754 DEBUG:boto:Token: None 2024-04-16T18:18:17.754 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.754 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yjTLTmHlRu0BJzWlaDECZ554p3g= 2024-04-16T18:18:17.754 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yjTLTmHlRu0BJzWlaDECZ554p3g=', 'Content-Length': '0'} 2024-04-16T18:18:17.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f326bc171b8e4bc-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.756 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2024-04-16T18:18:17.756 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.756 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.756 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.757 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.757 DEBUG:boto:Method: GET 2024-04-16T18:18:17.757 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.757 DEBUG:boto:Data: 2024-04-16T18:18:17.757 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.757 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.757 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.757 DEBUG:boto:Params: {} 2024-04-16T18:18:17.757 DEBUG:boto:Token: None 2024-04-16T18:18:17.757 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.757 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ= 2024-04-16T18:18:17.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ=', 'Content-Length': '0'} 2024-04-16T18:18:17.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c64cacd60e9ed3c0-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.802 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.802 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.803 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.803 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.803 DEBUG:boto:Method: GET 2024-04-16T18:18:17.803 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.803 DEBUG:boto:Data: 2024-04-16T18:18:17.803 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.803 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.803 DEBUG:boto:Params: {} 2024-04-16T18:18:17.803 DEBUG:boto:Token: None 2024-04-16T18:18:17.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423?versionId=null 2024-04-16T18:18:17.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ= 2024-04-16T18:18:17.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZbrB+rZ96wEvxZgf6YlFUtrBIQ=', 'Content-Length': '0'} 2024-04-16T18:18:17.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ce716f31b8ca2c7-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.806 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.806 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.806 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.806 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.806 DEBUG:boto:Method: GET 2024-04-16T18:18:17.806 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.806 DEBUG:boto:Data: 2024-04-16T18:18:17.807 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.807 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.807 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.807 DEBUG:boto:Params: {} 2024-04-16T18:18:17.807 DEBUG:boto:Token: None 2024-04-16T18:18:17.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a723e241ad29a410-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.850 DEBUG:boto:b'cjqttm-51obj000000000000000004231000falseobj000000000000000004232024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.851 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.851 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.851 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.851 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.851 DEBUG:boto:Method: GET 2024-04-16T18:18:17.851 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.851 DEBUG:boto:Data: 2024-04-16T18:18:17.851 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.851 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.852 DEBUG:boto:Params: {} 2024-04-16T18:18:17.852 DEBUG:boto:Token: None 2024-04-16T18:18:17.852 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.855 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac894a71a0ca5779-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.856 DEBUG:boto:b'cjqttm-51obj000000000000000004231000falseobj000000000000000004232024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.856 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.856 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.856 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.856 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.856 DEBUG:boto:Data: 2024-04-16T18:18:17.857 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.857 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.857 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.857 DEBUG:boto:Params: {} 2024-04-16T18:18:17.857 DEBUG:boto:Token: None 2024-04-16T18:18:17.857 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.857 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:liCH0MphT4rr9vW8K2pAQaEG6dg= 2024-04-16T18:18:17.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:liCH0MphT4rr9vW8K2pAQaEG6dg=', 'Content-Length': '0'} 2024-04-16T18:18:17.859 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021afc5b22ef9e14d-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.859 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.859 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.859 DEBUG:boto:Method: HEAD 2024-04-16T18:18:17.860 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.860 DEBUG:boto:Data: 2024-04-16T18:18:17.860 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.860 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.860 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.860 DEBUG:boto:Params: {} 2024-04-16T18:18:17.860 DEBUG:boto:Token: None 2024-04-16T18:18:17.860 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:liCH0MphT4rr9vW8K2pAQaEG6dg= 2024-04-16T18:18:17.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:liCH0MphT4rr9vW8K2pAQaEG6dg=', 'Content-Length': '0'} 2024-04-16T18:18:17.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006f1617c06a8ea9d-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.862 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj00000000000000000423 2024-04-16T18:18:17.863 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.863 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.863 DEBUG:boto:Method: GET 2024-04-16T18:18:17.863 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.863 DEBUG:boto:Data: 2024-04-16T18:18:17.863 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.863 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.863 DEBUG:boto:Params: {} 2024-04-16T18:18:17.863 DEBUG:boto:Token: None 2024-04-16T18:18:17.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Arm7eAsOIeavTXucXy9K/i1TqEg= 2024-04-16T18:18:17.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Arm7eAsOIeavTXucXy9K/i1TqEg=', 'Content-Length': '0'} 2024-04-16T18:18:17.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-51:9ba59572-f51c-4bce-9578-e6350e822996.4816.20'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:18:01 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d865db84acce0c4-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.910 DEBUG:boto:path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.910 DEBUG:boto:auth_path=/cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.911 DEBUG:boto:Method: GET 2024-04-16T18:18:17.911 DEBUG:boto:Path: /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.911 DEBUG:boto:Data: 2024-04-16T18:18:17.911 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.911 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.911 DEBUG:boto:Params: {} 2024-04-16T18:18:17.911 DEBUG:boto:Token: None 2024-04-16T18:18:17.911 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/obj00000000000000000423 2024-04-16T18:18:17.911 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Arm7eAsOIeavTXucXy9K/i1TqEg= 2024-04-16T18:18:17.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Arm7eAsOIeavTXucXy9K/i1TqEg=', 'Content-Length': '0'} 2024-04-16T18:18:17.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:17:58 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000dfb246c8e3c5cda-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.914 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.914 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.914 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.914 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.914 DEBUG:boto:Method: GET 2024-04-16T18:18:17.914 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.914 DEBUG:boto:Data: 2024-04-16T18:18:17.914 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.914 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:18:17.914 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.914 DEBUG:boto:Params: {} 2024-04-16T18:18:17.915 DEBUG:boto:Token: None 2024-04-16T18:18:17.915 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.915 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002cf91f687b163f22-00661ec0e9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.958 DEBUG:boto:b'cjqttm-51obj000000000000000004231000falseobj000000000000000004232024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.959 DEBUG:boto:path=/cjqttm-51/ 2024-04-16T18:18:17.959 DEBUG:boto:auth_path=/cjqttm-51/ 2024-04-16T18:18:17.959 DEBUG:boto:path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.959 DEBUG:boto:auth_path=/cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.959 DEBUG:boto:Method: GET 2024-04-16T18:18:17.959 DEBUG:boto:Path: /cjqttm-51/?prefix=obj00000000000000000423 2024-04-16T18:18:17.959 DEBUG:boto:Data: 2024-04-16T18:18:17.959 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.959 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.959 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.959 DEBUG:boto:Params: {} 2024-04-16T18:18:17.960 DEBUG:boto:Token: None 2024-04-16T18:18:17.960 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-51/ 2024-04-16T18:18:17.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI= 2024-04-16T18:18:17.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:62YoG4e1NxriNYMTTPokFF4FTcI=', 'Content-Length': '0'} 2024-04-16T18:18:17.964 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7cca64d7a451855-00661ec0e9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.964 DEBUG:boto:b'cjqttm-51obj000000000000000004231000falseobj000000000000000004232024-04-16T18:17:58.447Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:18:17.964 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-51 zones={test-zone2, test-zone1} 2024-04-16T18:18:17.965 INFO:tasks.rgw_multisite_tests:Create several generations of objects, then run bucket sync ... ok 2024-04-16T18:18:17.967 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:18:17.967 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:18:17.967 DEBUG:boto:Method: PUT 2024-04-16T18:18:17.968 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:18:17.968 DEBUG:boto:Data: 2024-04-16T18:18:17.968 DEBUG:boto:Headers: {} 2024-04-16T18:18:17.968 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:18:17.968 DEBUG:boto:Port: 8000 2024-04-16T18:18:17.968 DEBUG:boto:Params: {} 2024-04-16T18:18:17.968 DEBUG:boto:Token: None 2024-04-16T18:18:17.968 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:18:17 GMT /cjqttm-52/ 2024-04-16T18:18:17.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xgi88yZ9ZQpg5Epzf48t8DO3oXU= 2024-04-16T18:18:17.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:18:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xgi88yZ9ZQpg5Epzf48t8DO3oXU=', 'Content-Length': '0'} 2024-04-16T18:18:17.986 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f25a70bdd5d99ba6-00661ec0e9-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:18:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:18:17.986 DEBUG:rgw_multi.tests:created bucket=cjqttm-52 2024-04-16T18:18:17.987 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:17.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:17.987 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:18.092 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:18:18.115 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713291497.986314_854.1","last_update":"2024-04-16T18:18:17.986314Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:18:18.115 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:18.115 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:18:18.116 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:18.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:18.116 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:18.171 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:18.171 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:18.226 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:18.228+0000 7f291968c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:18.228 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:18.230+0000 7f291968c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:18.250 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:18Z"} 2024-04-16T18:18:18.251 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:18Z"} 2024-04-16T18:18:18.251 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:18.251 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:18.251 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:18.251 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:23.252 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:23.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:23.252 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:23.307 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:23.307 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:23.363 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:23.365+0000 7f2462610800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:23.364 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:23.366+0000 7f2462610800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:23.387 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:23Z"} 2024-04-16T18:18:23.387 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:23Z"} 2024-04-16T18:18:23.387 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:23.387 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:23.388 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:23.388 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:28.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:28.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:28.389 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:28.444 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:28.444 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:28.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:28.500+0000 7f8979624800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:28.499 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:28.501+0000 7f8979624800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:28.522 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:28Z"} 2024-04-16T18:18:28.522 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:28Z"} 2024-04-16T18:18:28.522 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:28.522 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:28.522 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:28.522 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:33.524 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:33.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:33.524 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:33.580 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:33.580 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:33.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:33.636+0000 7f87e520f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:33.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:33.637+0000 7f87e520f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:33.659 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:33Z"} 2024-04-16T18:18:33.659 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:33Z"} 2024-04-16T18:18:33.660 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:33.660 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:33.660 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:33.660 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:38.661 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:38.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:38.662 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:38.718 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:38.718 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:38.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:38.773+0000 7fb631f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:38.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:38.775+0000 7fb631f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:38.797 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:38Z"} 2024-04-16T18:18:38.797 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:38Z"} 2024-04-16T18:18:38.798 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:38.798 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:38.798 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:38.798 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:43.799 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:43.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:43.800 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:43.857 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:43.857 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:43.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:43.914+0000 7f4a5242e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:43.915 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:43.916+0000 7f4a5242e800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:43.938 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:43Z"} 2024-04-16T18:18:43.938 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:43Z"} 2024-04-16T18:18:43.938 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:43.939 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:43.939 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:43.939 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:48.940 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:48.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:48.941 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:48.996 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:48.996 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:49.050 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:49.051+0000 7f4e789a2800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:49.051 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:49.052+0000 7f4e789a2800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:49.075 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:49Z"} 2024-04-16T18:18:49.075 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:49Z"} 2024-04-16T18:18:49.075 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:49.076 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:49.076 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:49.076 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:54.077 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:54.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:54.077 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:54.132 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:54.132 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:54.186 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:54.187+0000 7f0d72a8c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:54.187 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:54.188+0000 7f0d72a8c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:54.211 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:54Z"} 2024-04-16T18:18:54.211 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:54Z"} 2024-04-16T18:18:54.211 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:54.211 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:54.211 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:54.211 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:18:59.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:59.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:18:59.213 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:18:59.267 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:18:59.267 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:18:59.321 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:59.322+0000 7f8570210800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:59.322 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:18:59.323+0000 7f8570210800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:18:59.345 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:59Z"} 2024-04-16T18:18:59.345 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:18:59Z"} 2024-04-16T18:18:59.345 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:18:59.346 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:59.346 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:18:59.346 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:04.347 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:04.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:04.348 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:04.406 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:04.406 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:04.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:04.462+0000 7fae81844800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:04.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:04.464+0000 7fae81844800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:04.485 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:04Z"} 2024-04-16T18:19:04.486 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:04Z"} 2024-04-16T18:19:04.486 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:04.486 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:04.486 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:04.487 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:09.488 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:09.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:09.488 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:09.545 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:09.546 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:09.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:09.603+0000 7f2690947800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:09.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:09.604+0000 7f2690947800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:09.624 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:09Z"} 2024-04-16T18:19:09.625 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:09Z"} 2024-04-16T18:19:09.625 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:09.625 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:09.625 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:09.625 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:14.626 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:14.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:14.627 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:14.682 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:14.682 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:14.736 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:14.738+0000 7fa124824800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:14.737 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:14.739+0000 7fa124824800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:14.760 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:14Z"} 2024-04-16T18:19:14.760 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:14Z"} 2024-04-16T18:19:14.760 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:14.761 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:14.761 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:14.761 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:19.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:19.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:19.763 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:19.818 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:19.819 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:19.895 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:19.896+0000 7fef63011800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:19.897 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:19.898+0000 7fef63011800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:19.919 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:19Z"} 2024-04-16T18:19:19.919 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:19Z"} 2024-04-16T18:19:19.920 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:19.920 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:19.920 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:19.920 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:24.921 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:24.922 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:24.922 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:24.978 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:24.978 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:25.032 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:25.033+0000 7f031e124800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:25.033 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:25.034+0000 7f031e124800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:25.057 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:25Z"} 2024-04-16T18:19:25.057 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:25Z"} 2024-04-16T18:19:25.057 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:25.057 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:25.057 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:25.058 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:30.058 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:30.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:30.059 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:30.113 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:30.114 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:30.169 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:30.170+0000 7f948f424800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:30.170 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:30.171+0000 7f948f424800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:30.193 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:30Z"} 2024-04-16T18:19:30.193 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:30Z"} 2024-04-16T18:19:30.193 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:30.193 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:30.193 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:30.193 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:35.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:35.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:35.195 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:35.251 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:35.251 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:35.306 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:35.307+0000 7f962fd26800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:35.308 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:35.308+0000 7f962fd26800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:35.330 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:35Z"} 2024-04-16T18:19:35.331 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:35Z"} 2024-04-16T18:19:35.331 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:35.331 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:35.331 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:35.331 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:40.332 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:40.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:40.333 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:40.389 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:40.389 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:40.444 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:40.444+0000 7f0685320800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:40.445 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:40.446+0000 7f0685320800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:40.467 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:40Z"} 2024-04-16T18:19:40.467 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:40Z"} 2024-04-16T18:19:40.467 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:40.467 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:40.467 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:40.468 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:45.468 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:45.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:45.469 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:45.524 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:45.524 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:45.579 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:45.580+0000 7f4bf4931800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:45.580 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:45.581+0000 7f4bf4931800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:45.603 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:45Z"} 2024-04-16T18:19:45.603 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291460.365600_797.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:40.365600Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:45Z"} 2024-04-16T18:19:45.603 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291460.365600_797.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:40.365600Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:45.603 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:45.603 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291460.365600_797.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:45.603 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291460.365600_797.1 2024-04-16T18:19:50.604 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:50.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:50.604 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:50.659 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:50.660 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:50.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:50.715+0000 7f7edad26800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:50.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:50.718+0000 7f7edad26800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:50.738 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291474.602276_809.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:54.602276Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:50Z"} 2024-04-16T18:19:50.738 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291474.602276_809.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:17:54.602276Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:50Z"} 2024-04-16T18:19:50.738 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291474.602276_809.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:17:54.602276Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:50.739 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:50.739 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291474.602276_809.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:50.739 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713291497.986314_854.1 target=1_1713291474.602276_809.1 2024-04-16T18:19:55.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:55.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:19:55.740 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:19:55.796 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:55.796 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:55.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:55.852+0000 7fc745d4b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:55.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:55.854+0000 7fc745d4b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:19:55.873 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291497.986314_854.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:18:17.986314Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:55Z"} 2024-04-16T18:19:55.874 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291497.986314_854.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:18:17.986314Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:19:55Z"} 2024-04-16T18:19:55.874 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291497.986314_854.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:18:17.986314Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:19:55.874 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:55.874 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713291497.986314_854.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:19:55.874 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:19:55.875 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:19:55.875 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:19:55.875 DEBUG:boto:Method: HEAD 2024-04-16T18:19:55.875 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:19:55.875 DEBUG:boto:Data: 2024-04-16T18:19:55.875 DEBUG:boto:Headers: {} 2024-04-16T18:19:55.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.875 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.875 DEBUG:boto:Params: {} 2024-04-16T18:19:55.876 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:19:55.876 DEBUG:boto:Token: None 2024-04-16T18:19:55.876 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/ 2024-04-16T18:19:55.877 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc= 2024-04-16T18:19:55.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc=', 'Content-Length': '0'} 2024-04-16T18:19:55.882 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd3d145cf5174fc6-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.883 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:19:55.883 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:19:55.883 DEBUG:boto:Method: PUT 2024-04-16T18:19:55.883 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:19:55.883 DEBUG:boto:Data: 2024-04-16T18:19:55.883 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:19:55.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.883 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.883 DEBUG:boto:Params: {} 2024-04-16T18:19:55.883 DEBUG:boto:Token: None 2024-04-16T18:19:55.884 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/obj11 2024-04-16T18:19:55.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zsT/y8+I3l1+FNC1ctQpwdOpXvs= 2024-04-16T18:19:55.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zsT/y8+I3l1+FNC1ctQpwdOpXvs='} 2024-04-16T18:19:55.891 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000022afd348fff214fa-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.892 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:19:55.892 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:19:55.892 DEBUG:boto:Method: HEAD 2024-04-16T18:19:55.892 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:19:55.892 DEBUG:boto:Data: 2024-04-16T18:19:55.892 DEBUG:boto:Headers: {} 2024-04-16T18:19:55.892 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.892 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.892 DEBUG:boto:Params: {} 2024-04-16T18:19:55.892 DEBUG:boto:Token: None 2024-04-16T18:19:55.892 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/ 2024-04-16T18:19:55.893 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc= 2024-04-16T18:19:55.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc=', 'Content-Length': '0'} 2024-04-16T18:19:55.894 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001ba3a0adb885da4c-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.895 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:19:55.895 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:19:55.895 DEBUG:boto:Method: PUT 2024-04-16T18:19:55.895 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:19:55.895 DEBUG:boto:Data: 2024-04-16T18:19:55.895 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:19:55.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.895 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.895 DEBUG:boto:Params: {} 2024-04-16T18:19:55.896 DEBUG:boto:Token: None 2024-04-16T18:19:55.896 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/obj22 2024-04-16T18:19:55.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uj/HczL2rkrkRQIj5UbFPez3c4E= 2024-04-16T18:19:55.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uj/HczL2rkrkRQIj5UbFPez3c4E='} 2024-04-16T18:19:55.901 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004cc6038a050df93c-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.901 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:19:55.901 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:19:55.901 DEBUG:boto:Method: HEAD 2024-04-16T18:19:55.901 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:19:55.901 DEBUG:boto:Data: 2024-04-16T18:19:55.901 DEBUG:boto:Headers: {} 2024-04-16T18:19:55.901 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.902 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.902 DEBUG:boto:Params: {} 2024-04-16T18:19:55.902 DEBUG:boto:Token: None 2024-04-16T18:19:55.902 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/ 2024-04-16T18:19:55.902 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc= 2024-04-16T18:19:55.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc=', 'Content-Length': '0'} 2024-04-16T18:19:55.904 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000042d3547c75536ca1-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.904 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:19:55.904 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:19:55.905 DEBUG:boto:Method: PUT 2024-04-16T18:19:55.905 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:19:55.905 DEBUG:boto:Data: 2024-04-16T18:19:55.905 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:19:55.905 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.905 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.905 DEBUG:boto:Params: {} 2024-04-16T18:19:55.905 DEBUG:boto:Token: None 2024-04-16T18:19:55.905 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/obj33 2024-04-16T18:19:55.905 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4TAMg2linwy2CIQX4DHmMpDaV0w= 2024-04-16T18:19:55.906 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4TAMg2linwy2CIQX4DHmMpDaV0w='} 2024-04-16T18:19:55.950 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000158416464f94db99-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.951 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:19:55.951 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:19:55.951 DEBUG:boto:Method: HEAD 2024-04-16T18:19:55.951 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:19:55.951 DEBUG:boto:Data: 2024-04-16T18:19:55.951 DEBUG:boto:Headers: {} 2024-04-16T18:19:55.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.951 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.951 DEBUG:boto:Params: {} 2024-04-16T18:19:55.951 DEBUG:boto:Token: None 2024-04-16T18:19:55.952 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/ 2024-04-16T18:19:55.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc= 2024-04-16T18:19:55.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc=', 'Content-Length': '0'} 2024-04-16T18:19:55.954 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008a3cfaee2a0aac22-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.954 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:19:55.955 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:19:55.955 DEBUG:boto:Method: PUT 2024-04-16T18:19:55.955 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:19:55.955 DEBUG:boto:Data: 2024-04-16T18:19:55.955 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:19:55.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.955 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.955 DEBUG:boto:Params: {} 2024-04-16T18:19:55.955 DEBUG:boto:Token: None 2024-04-16T18:19:55.955 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/obj44 2024-04-16T18:19:55.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0ih0F/u0db5B0sAmiEcHYWIaEyg= 2024-04-16T18:19:55.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0ih0F/u0db5B0sAmiEcHYWIaEyg='} 2024-04-16T18:19:55.967 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001a70823737286750-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.967 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:19:55.967 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:19:55.968 DEBUG:boto:Method: HEAD 2024-04-16T18:19:55.968 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:19:55.968 DEBUG:boto:Data: 2024-04-16T18:19:55.968 DEBUG:boto:Headers: {} 2024-04-16T18:19:55.968 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.968 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.968 DEBUG:boto:Params: {} 2024-04-16T18:19:55.968 DEBUG:boto:Token: None 2024-04-16T18:19:55.968 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/ 2024-04-16T18:19:55.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc= 2024-04-16T18:19:55.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aMNLpMQeUhzvce8ynYGO9P/ipyc=', 'Content-Length': '0'} 2024-04-16T18:19:55.971 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000095153454f1eac26-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:55.971 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:19:55.971 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:19:55.971 DEBUG:boto:Method: PUT 2024-04-16T18:19:55.971 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:19:55.971 DEBUG:boto:Data: 2024-04-16T18:19:55.971 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:19:55.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:19:55.971 DEBUG:boto:Port: 8000 2024-04-16T18:19:55.972 DEBUG:boto:Params: {} 2024-04-16T18:19:55.972 DEBUG:boto:Token: None 2024-04-16T18:19:55.972 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:19:55 GMT /cjqttm-52/obj55 2024-04-16T18:19:55.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TNdksBLbWPyptJmP+kupVUh580s= 2024-04-16T18:19:55.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:19:55 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TNdksBLbWPyptJmP+kupVUh580s='} 2024-04-16T18:19:56.014 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001abb31fa04afbd55-00661ec14b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:19:56.015 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:19:56.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:19:56.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:19:56.015 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:19:56.071 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:19:56.071 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:19:56.126 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:19:56.128+0000 7f937b133800 1 waiting to reach incremental sync.. 2024-04-16T18:20:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:01.130+0000 7f937b133800 1 bucket sync caught up with source: 2024-04-16T18:20:01.129 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000001.47.6, 00000000002.59.6, 00000000002.63.6] 2024-04-16T18:20:01.129 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000001.47.6, 00000000002.59.6, 00000000002.63.6] 2024-04-16T18:20:01.129 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:01.130+0000 7f937b133800 0 bucket checkpoint complete 2024-04-16T18:20:01.156 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:20:01.156 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:20:01.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:20:01.157 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:20:01.219 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:20:01.220 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:20:01.281 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:20:01.282+0000 7f480a51f800 1 waiting to reach incremental sync.. 2024-04-16T18:20:06.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:20:06.284+0000 7f480a51f800 1 bucket sync caught up with source: 2024-04-16T18:20:06.284 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000001.871.6, 00000000002.154.6, 00000000002.757.6] 2024-04-16T18:20:06.284 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000001.871.6, 00000000002.154.6, 00000000002.757.6] 2024-04-16T18:20:06.284 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:20:06.284+0000 7f480a51f800 0 bucket checkpoint complete 2024-04-16T18:20:06.312 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:20:06.312 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.312 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.312 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.312 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:20:06.312 DEBUG:boto:Data: 2024-04-16T18:20:06.312 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.312 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.313 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.313 DEBUG:boto:Params: {} 2024-04-16T18:20:06.313 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:20:06.313 DEBUG:boto:Token: None 2024-04-16T18:20:06.313 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.314 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n0RNhp+6KlVhhbgyybHj5bKEHzs= 2024-04-16T18:20:06.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n0RNhp+6KlVhhbgyybHj5bKEHzs=', 'Content-Length': '0'} 2024-04-16T18:20:06.318 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fc4fabe53401f5c8-00661ec156-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.319 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.319 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.319 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.319 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:20:06.319 DEBUG:boto:Data: 2024-04-16T18:20:06.319 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.319 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.319 DEBUG:boto:Params: {} 2024-04-16T18:20:06.320 DEBUG:boto:Token: None 2024-04-16T18:20:06.320 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n0RNhp+6KlVhhbgyybHj5bKEHzs= 2024-04-16T18:20:06.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n0RNhp+6KlVhhbgyybHj5bKEHzs=', 'Content-Length': '0'} 2024-04-16T18:20:06.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087451e69f88d5eef-00661ec156-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.322 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:20:06.323 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.323 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.323 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.323 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.323 DEBUG:boto:Method: GET 2024-04-16T18:20:06.323 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.323 DEBUG:boto:Data: 2024-04-16T18:20:06.323 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.323 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.323 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.324 DEBUG:boto:Params: {} 2024-04-16T18:20:06.324 DEBUG:boto:Token: None 2024-04-16T18:20:06.324 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/?versions 2024-04-16T18:20:06.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64= 2024-04-16T18:20:06.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64=', 'Content-Length': '0'} 2024-04-16T18:20:06.326 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033c4f6f4c14f7a38-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.326 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.327 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:20:06.328 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:20:06.328 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:20:06.328 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:20:06.328 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:20:06.328 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:20:06.328 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.328 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.328 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.328 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.328 DEBUG:boto:Method: GET 2024-04-16T18:20:06.329 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.329 DEBUG:boto:Data: 2024-04-16T18:20:06.329 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.329 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.329 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.329 DEBUG:boto:Params: {} 2024-04-16T18:20:06.329 DEBUG:boto:Token: None 2024-04-16T18:20:06.329 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/?versions 2024-04-16T18:20:06.329 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64= 2024-04-16T18:20:06.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64=', 'Content-Length': '0'} 2024-04-16T18:20:06.332 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e79a5bf8efb8a69-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.332 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.333 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:20:06.333 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:20:06.333 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:20:06.333 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:20:06.333 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:20:06.333 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.333 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.333 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.333 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.333 DEBUG:boto:Method: GET 2024-04-16T18:20:06.334 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.334 DEBUG:boto:Data: 2024-04-16T18:20:06.334 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.334 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.334 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.334 DEBUG:boto:Params: {} 2024-04-16T18:20:06.334 DEBUG:boto:Token: None 2024-04-16T18:20:06.334 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/?versions 2024-04-16T18:20:06.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64= 2024-04-16T18:20:06.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64=', 'Content-Length': '0'} 2024-04-16T18:20:06.337 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004244bc32542d4705-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.337 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.338 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.338 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.338 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.338 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.338 DEBUG:boto:Method: GET 2024-04-16T18:20:06.338 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:20:06.338 DEBUG:boto:Data: 2024-04-16T18:20:06.338 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.338 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.338 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.339 DEBUG:boto:Params: {} 2024-04-16T18:20:06.339 DEBUG:boto:Token: None 2024-04-16T18:20:06.339 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/?versions 2024-04-16T18:20:06.339 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64= 2024-04-16T18:20:06.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bc6emuVQtpRCBRBZH8ZbIv6xZ64=', 'Content-Length': '0'} 2024-04-16T18:20:06.341 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e0f2bd973d359da-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.341 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.342 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:20:06.342 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.342 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.342 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.343 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.343 DEBUG:boto:Method: GET 2024-04-16T18:20:06.343 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.343 DEBUG:boto:Data: 2024-04-16T18:20:06.343 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.343 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.343 DEBUG:boto:Params: {} 2024-04-16T18:20:06.343 DEBUG:boto:Token: None 2024-04-16T18:20:06.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg= 2024-04-16T18:20:06.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg=', 'Content-Length': '0'} 2024-04-16T18:20:06.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f09f0540edc1e02-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.346 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.347 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.347 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.347 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.347 DEBUG:boto:Method: GET 2024-04-16T18:20:06.347 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.347 DEBUG:boto:Data: 2024-04-16T18:20:06.347 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.347 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.347 DEBUG:boto:Params: {} 2024-04-16T18:20:06.348 DEBUG:boto:Token: None 2024-04-16T18:20:06.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg= 2024-04-16T18:20:06.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg=', 'Content-Length': '0'} 2024-04-16T18:20:06.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000881896e1ec539a78-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.350 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.350 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.351 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.351 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.351 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.351 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.351 DEBUG:boto:Data: 2024-04-16T18:20:06.351 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.351 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.351 DEBUG:boto:Params: {} 2024-04-16T18:20:06.352 DEBUG:boto:Token: None 2024-04-16T18:20:06.352 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fy2V6THJVeKsSu0k7jZSaOzIwwA= 2024-04-16T18:20:06.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fy2V6THJVeKsSu0k7jZSaOzIwwA=', 'Content-Length': '0'} 2024-04-16T18:20:06.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f1d7f59b6b24ffe-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.354 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.354 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.354 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.355 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.355 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.355 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.355 DEBUG:boto:Data: 2024-04-16T18:20:06.355 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.355 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.355 DEBUG:boto:Params: {} 2024-04-16T18:20:06.355 DEBUG:boto:Token: None 2024-04-16T18:20:06.355 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fy2V6THJVeKsSu0k7jZSaOzIwwA= 2024-04-16T18:20:06.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fy2V6THJVeKsSu0k7jZSaOzIwwA=', 'Content-Length': '0'} 2024-04-16T18:20:06.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080d0275e4052cad7-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.358 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:20:06.358 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.358 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.358 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.358 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.359 DEBUG:boto:Method: GET 2024-04-16T18:20:06.359 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.359 DEBUG:boto:Data: 2024-04-16T18:20:06.359 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.359 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.359 DEBUG:boto:Params: {} 2024-04-16T18:20:06.359 DEBUG:boto:Token: None 2024-04-16T18:20:06.359 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg= 2024-04-16T18:20:06.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg=', 'Content-Length': '0'} 2024-04-16T18:20:06.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000722e168896dc1a51-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.362 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.362 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.362 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.362 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.362 DEBUG:boto:Method: GET 2024-04-16T18:20:06.362 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.363 DEBUG:boto:Data: 2024-04-16T18:20:06.363 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.363 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.363 DEBUG:boto:Params: {} 2024-04-16T18:20:06.363 DEBUG:boto:Token: None 2024-04-16T18:20:06.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:20:06.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg= 2024-04-16T18:20:06.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s1w3FaGpRHBCMR5W1gy7XYl9tOg=', 'Content-Length': '0'} 2024-04-16T18:20:06.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000239bf6479a1c6efd-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.366 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.366 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.366 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.366 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.366 DEBUG:boto:Method: GET 2024-04-16T18:20:06.366 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.366 DEBUG:boto:Data: 2024-04-16T18:20:06.367 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.367 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.367 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.367 DEBUG:boto:Params: {} 2024-04-16T18:20:06.367 DEBUG:boto:Token: None 2024-04-16T18:20:06.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f4465ca01dc072f2-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.370 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.370 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.370 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.370 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.370 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.371 DEBUG:boto:Method: GET 2024-04-16T18:20:06.371 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.371 DEBUG:boto:Data: 2024-04-16T18:20:06.371 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.371 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.371 DEBUG:boto:Params: {} 2024-04-16T18:20:06.371 DEBUG:boto:Token: None 2024-04-16T18:20:06.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.374 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065b163a52b45ed3f-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.374 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.374 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.374 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.375 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.375 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:20:06.375 DEBUG:boto:Data: 2024-04-16T18:20:06.375 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.375 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.375 DEBUG:boto:Params: {} 2024-04-16T18:20:06.375 DEBUG:boto:Token: None 2024-04-16T18:20:06.375 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11 2024-04-16T18:20:06.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JjY+DWc7iFwVcz4RcVTaeezSR5Q= 2024-04-16T18:20:06.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JjY+DWc7iFwVcz4RcVTaeezSR5Q=', 'Content-Length': '0'} 2024-04-16T18:20:06.378 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d98194762e7452c-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.378 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.378 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.378 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.378 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:20:06.378 DEBUG:boto:Data: 2024-04-16T18:20:06.378 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.379 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.379 DEBUG:boto:Params: {} 2024-04-16T18:20:06.379 DEBUG:boto:Token: None 2024-04-16T18:20:06.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11 2024-04-16T18:20:06.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JjY+DWc7iFwVcz4RcVTaeezSR5Q= 2024-04-16T18:20:06.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JjY+DWc7iFwVcz4RcVTaeezSR5Q=', 'Content-Length': '0'} 2024-04-16T18:20:06.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b30abc2a3f88809-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.381 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:20:06.382 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.382 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.382 DEBUG:boto:Method: GET 2024-04-16T18:20:06.382 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:20:06.382 DEBUG:boto:Data: 2024-04-16T18:20:06.382 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.382 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.382 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.382 DEBUG:boto:Params: {} 2024-04-16T18:20:06.383 DEBUG:boto:Token: None 2024-04-16T18:20:06.383 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11 2024-04-16T18:20:06.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J/qeezdEZ6EUz4Fb/QhhoHZKAzk= 2024-04-16T18:20:06.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J/qeezdEZ6EUz4Fb/QhhoHZKAzk=', 'Content-Length': '0'} 2024-04-16T18:20:06.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f9ff365ddc9df29-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.426 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:20:06.426 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:20:06.427 DEBUG:boto:Method: GET 2024-04-16T18:20:06.427 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:20:06.427 DEBUG:boto:Data: 2024-04-16T18:20:06.427 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.427 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.427 DEBUG:boto:Params: {} 2024-04-16T18:20:06.427 DEBUG:boto:Token: None 2024-04-16T18:20:06.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj11 2024-04-16T18:20:06.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J/qeezdEZ6EUz4Fb/QhhoHZKAzk= 2024-04-16T18:20:06.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J/qeezdEZ6EUz4Fb/QhhoHZKAzk=', 'Content-Length': '0'} 2024-04-16T18:20:06.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b98db1fa250b6d6e-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.430 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.430 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.430 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.430 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.430 DEBUG:boto:Method: GET 2024-04-16T18:20:06.430 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.431 DEBUG:boto:Data: 2024-04-16T18:20:06.431 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.431 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.431 DEBUG:boto:Params: {} 2024-04-16T18:20:06.431 DEBUG:boto:Token: None 2024-04-16T18:20:06.431 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.431 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.433 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee44136fb5a37343-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.474 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.475 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.475 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.475 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.475 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.475 DEBUG:boto:Method: GET 2024-04-16T18:20:06.475 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:20:06.475 DEBUG:boto:Data: 2024-04-16T18:20:06.475 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.475 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.476 DEBUG:boto:Params: {} 2024-04-16T18:20:06.476 DEBUG:boto:Token: None 2024-04-16T18:20:06.476 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.478 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bdd18dd29a28c7e3-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.479 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:20:06.479 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.479 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.479 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.479 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.479 DEBUG:boto:Method: GET 2024-04-16T18:20:06.479 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.480 DEBUG:boto:Data: 2024-04-16T18:20:06.480 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.480 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.480 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.480 DEBUG:boto:Params: {} 2024-04-16T18:20:06.480 DEBUG:boto:Token: None 2024-04-16T18:20:06.480 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU= 2024-04-16T18:20:06.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU=', 'Content-Length': '0'} 2024-04-16T18:20:06.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1ec06f595cd5d56-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.526 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.526 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.527 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.527 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.527 DEBUG:boto:Method: GET 2024-04-16T18:20:06.527 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.527 DEBUG:boto:Data: 2024-04-16T18:20:06.527 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.527 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.527 DEBUG:boto:Params: {} 2024-04-16T18:20:06.527 DEBUG:boto:Token: None 2024-04-16T18:20:06.528 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU= 2024-04-16T18:20:06.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU=', 'Content-Length': '0'} 2024-04-16T18:20:06.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb4967ea13688b1e-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.530 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.530 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.530 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.530 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.530 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.530 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.530 DEBUG:boto:Data: 2024-04-16T18:20:06.530 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.531 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.531 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.531 DEBUG:boto:Params: {} 2024-04-16T18:20:06.531 DEBUG:boto:Token: None 2024-04-16T18:20:06.531 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qOu0l2WQUA9Oo9u6l2tcI7VpcCY= 2024-04-16T18:20:06.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qOu0l2WQUA9Oo9u6l2tcI7VpcCY=', 'Content-Length': '0'} 2024-04-16T18:20:06.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce51747dd22b8a8a-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.533 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.533 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.533 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.533 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.534 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.534 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.534 DEBUG:boto:Data: 2024-04-16T18:20:06.534 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.534 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.534 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.534 DEBUG:boto:Params: {} 2024-04-16T18:20:06.534 DEBUG:boto:Token: None 2024-04-16T18:20:06.534 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qOu0l2WQUA9Oo9u6l2tcI7VpcCY= 2024-04-16T18:20:06.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qOu0l2WQUA9Oo9u6l2tcI7VpcCY=', 'Content-Length': '0'} 2024-04-16T18:20:06.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028b7708f23a06365-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:20:06.537 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.537 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.537 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.537 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.537 DEBUG:boto:Method: GET 2024-04-16T18:20:06.537 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.537 DEBUG:boto:Data: 2024-04-16T18:20:06.538 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.538 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.538 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.538 DEBUG:boto:Params: {} 2024-04-16T18:20:06.538 DEBUG:boto:Token: None 2024-04-16T18:20:06.538 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.538 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU= 2024-04-16T18:20:06.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU=', 'Content-Length': '0'} 2024-04-16T18:20:06.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089b11456ea9abeed-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.582 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.582 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.582 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.583 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.583 DEBUG:boto:Method: GET 2024-04-16T18:20:06.583 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.583 DEBUG:boto:Data: 2024-04-16T18:20:06.583 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.583 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.583 DEBUG:boto:Params: {} 2024-04-16T18:20:06.583 DEBUG:boto:Token: None 2024-04-16T18:20:06.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:20:06.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU= 2024-04-16T18:20:06.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/zMq7PLV3xlaOiydaG1nV0PyExU=', 'Content-Length': '0'} 2024-04-16T18:20:06.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082d1223454f6d0c1-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.586 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.586 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.586 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.586 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.586 DEBUG:boto:Method: GET 2024-04-16T18:20:06.586 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.587 DEBUG:boto:Data: 2024-04-16T18:20:06.587 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.587 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.587 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.587 DEBUG:boto:Params: {} 2024-04-16T18:20:06.587 DEBUG:boto:Token: None 2024-04-16T18:20:06.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.590 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ff3df9f67ed949e-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.630 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.631 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.631 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.631 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.631 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.631 DEBUG:boto:Method: GET 2024-04-16T18:20:06.631 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.631 DEBUG:boto:Data: 2024-04-16T18:20:06.631 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.631 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.631 DEBUG:boto:Params: {} 2024-04-16T18:20:06.632 DEBUG:boto:Token: None 2024-04-16T18:20:06.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.634 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fcd6a5976ccc39c6-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.634 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.635 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.635 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.635 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.635 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:20:06.635 DEBUG:boto:Data: 2024-04-16T18:20:06.635 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.635 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.635 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.635 DEBUG:boto:Params: {} 2024-04-16T18:20:06.635 DEBUG:boto:Token: None 2024-04-16T18:20:06.636 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22 2024-04-16T18:20:06.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mY3R+u3zkSoDi3uO7iqFoR191Tg= 2024-04-16T18:20:06.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mY3R+u3zkSoDi3uO7iqFoR191Tg=', 'Content-Length': '0'} 2024-04-16T18:20:06.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000f0b80cf3c3dbb9-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.638 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.638 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.638 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.639 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:20:06.639 DEBUG:boto:Data: 2024-04-16T18:20:06.639 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.639 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.639 DEBUG:boto:Params: {} 2024-04-16T18:20:06.639 DEBUG:boto:Token: None 2024-04-16T18:20:06.639 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22 2024-04-16T18:20:06.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mY3R+u3zkSoDi3uO7iqFoR191Tg= 2024-04-16T18:20:06.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mY3R+u3zkSoDi3uO7iqFoR191Tg=', 'Content-Length': '0'} 2024-04-16T18:20:06.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a83ef9c3dc05f6c6-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.642 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:20:06.642 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.642 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.642 DEBUG:boto:Method: GET 2024-04-16T18:20:06.642 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:20:06.642 DEBUG:boto:Data: 2024-04-16T18:20:06.642 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.642 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.643 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.643 DEBUG:boto:Params: {} 2024-04-16T18:20:06.643 DEBUG:boto:Token: None 2024-04-16T18:20:06.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22 2024-04-16T18:20:06.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k84RtWy3C5Xj/tcyjUr+ULgqS6c= 2024-04-16T18:20:06.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k84RtWy3C5Xj/tcyjUr+ULgqS6c=', 'Content-Length': '0'} 2024-04-16T18:20:06.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002527fa95b2c9991f-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.690 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:20:06.690 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:20:06.691 DEBUG:boto:Method: GET 2024-04-16T18:20:06.691 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:20:06.691 DEBUG:boto:Data: 2024-04-16T18:20:06.691 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.691 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.691 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.691 DEBUG:boto:Params: {} 2024-04-16T18:20:06.691 DEBUG:boto:Token: None 2024-04-16T18:20:06.691 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj22 2024-04-16T18:20:06.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k84RtWy3C5Xj/tcyjUr+ULgqS6c= 2024-04-16T18:20:06.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k84RtWy3C5Xj/tcyjUr+ULgqS6c=', 'Content-Length': '0'} 2024-04-16T18:20:06.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5f2a67b8358be24-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.694 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.694 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.694 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.694 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.694 DEBUG:boto:Method: GET 2024-04-16T18:20:06.694 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.694 DEBUG:boto:Data: 2024-04-16T18:20:06.695 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.695 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.695 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.695 DEBUG:boto:Params: {} 2024-04-16T18:20:06.695 DEBUG:boto:Token: None 2024-04-16T18:20:06.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.697 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000684f8514d817a8a9-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.698 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.698 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.698 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.698 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.698 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.698 DEBUG:boto:Method: GET 2024-04-16T18:20:06.699 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:20:06.699 DEBUG:boto:Data: 2024-04-16T18:20:06.699 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.699 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.699 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.699 DEBUG:boto:Params: {} 2024-04-16T18:20:06.699 DEBUG:boto:Token: None 2024-04-16T18:20:06.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.702 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e164a64fa8367acf-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.702 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.702 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:20:06.703 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.703 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.703 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.703 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.703 DEBUG:boto:Method: GET 2024-04-16T18:20:06.703 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.703 DEBUG:boto:Data: 2024-04-16T18:20:06.703 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.703 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.703 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.704 DEBUG:boto:Params: {} 2024-04-16T18:20:06.704 DEBUG:boto:Token: None 2024-04-16T18:20:06.704 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ= 2024-04-16T18:20:06.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ=', 'Content-Length': '0'} 2024-04-16T18:20:06.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd15443e0a14430f-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.746 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.746 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.746 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.747 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.747 DEBUG:boto:Method: GET 2024-04-16T18:20:06.747 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.747 DEBUG:boto:Data: 2024-04-16T18:20:06.747 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.747 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.747 DEBUG:boto:Params: {} 2024-04-16T18:20:06.747 DEBUG:boto:Token: None 2024-04-16T18:20:06.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ= 2024-04-16T18:20:06.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ=', 'Content-Length': '0'} 2024-04-16T18:20:06.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea71c4f37caf4b80-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.750 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.750 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.750 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.750 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.750 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.750 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.750 DEBUG:boto:Data: 2024-04-16T18:20:06.751 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.751 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.751 DEBUG:boto:Params: {} 2024-04-16T18:20:06.751 DEBUG:boto:Token: None 2024-04-16T18:20:06.751 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O2Hd3YZa93yYM0XSPih4bOh6CVQ= 2024-04-16T18:20:06.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O2Hd3YZa93yYM0XSPih4bOh6CVQ=', 'Content-Length': '0'} 2024-04-16T18:20:06.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085dbf7e0416f9b98-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.754 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.754 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.754 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.754 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.754 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.754 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.754 DEBUG:boto:Data: 2024-04-16T18:20:06.755 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.755 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.755 DEBUG:boto:Params: {} 2024-04-16T18:20:06.755 DEBUG:boto:Token: None 2024-04-16T18:20:06.755 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O2Hd3YZa93yYM0XSPih4bOh6CVQ= 2024-04-16T18:20:06.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O2Hd3YZa93yYM0XSPih4bOh6CVQ=', 'Content-Length': '0'} 2024-04-16T18:20:06.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fb9ca7c9e5395dc-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:20:06.758 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.758 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.758 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.758 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.758 DEBUG:boto:Method: GET 2024-04-16T18:20:06.758 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.758 DEBUG:boto:Data: 2024-04-16T18:20:06.758 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.759 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.759 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.759 DEBUG:boto:Params: {} 2024-04-16T18:20:06.759 DEBUG:boto:Token: None 2024-04-16T18:20:06.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ= 2024-04-16T18:20:06.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ=', 'Content-Length': '0'} 2024-04-16T18:20:06.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005bdb989bec945c8-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.802 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.802 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.803 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.803 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.803 DEBUG:boto:Method: GET 2024-04-16T18:20:06.803 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.803 DEBUG:boto:Data: 2024-04-16T18:20:06.803 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.803 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.803 DEBUG:boto:Params: {} 2024-04-16T18:20:06.803 DEBUG:boto:Token: None 2024-04-16T18:20:06.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:20:06.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ= 2024-04-16T18:20:06.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OpGOeVNard+AS4jxX1zTViSTUOQ=', 'Content-Length': '0'} 2024-04-16T18:20:06.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1ed2e7ded5d002e-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.806 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.806 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.806 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.806 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.807 DEBUG:boto:Method: GET 2024-04-16T18:20:06.807 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.807 DEBUG:boto:Data: 2024-04-16T18:20:06.807 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.807 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.807 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.807 DEBUG:boto:Params: {} 2024-04-16T18:20:06.807 DEBUG:boto:Token: None 2024-04-16T18:20:06.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.810 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000edf1ab1f7271e5b-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.810 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.811 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.811 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.811 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.811 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.811 DEBUG:boto:Method: GET 2024-04-16T18:20:06.811 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.811 DEBUG:boto:Data: 2024-04-16T18:20:06.811 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.812 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.812 DEBUG:boto:Params: {} 2024-04-16T18:20:06.812 DEBUG:boto:Token: None 2024-04-16T18:20:06.812 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c74b9fd14eaeb07-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.815 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.815 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.815 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.815 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.815 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:20:06.816 DEBUG:boto:Data: 2024-04-16T18:20:06.816 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.816 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.816 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.816 DEBUG:boto:Params: {} 2024-04-16T18:20:06.816 DEBUG:boto:Token: None 2024-04-16T18:20:06.816 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33 2024-04-16T18:20:06.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oG2hRLje3wKqqSnX9b8AGF/eUos= 2024-04-16T18:20:06.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oG2hRLje3wKqqSnX9b8AGF/eUos=', 'Content-Length': '0'} 2024-04-16T18:20:06.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd85bb6bb7944767-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.819 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.819 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.819 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.819 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:20:06.819 DEBUG:boto:Data: 2024-04-16T18:20:06.819 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.819 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.819 DEBUG:boto:Params: {} 2024-04-16T18:20:06.819 DEBUG:boto:Token: None 2024-04-16T18:20:06.819 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33 2024-04-16T18:20:06.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oG2hRLje3wKqqSnX9b8AGF/eUos= 2024-04-16T18:20:06.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oG2hRLje3wKqqSnX9b8AGF/eUos=', 'Content-Length': '0'} 2024-04-16T18:20:06.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054d73c36aa08a8df-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.822 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:20:06.822 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.822 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.822 DEBUG:boto:Method: GET 2024-04-16T18:20:06.822 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:20:06.822 DEBUG:boto:Data: 2024-04-16T18:20:06.823 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.823 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.823 DEBUG:boto:Params: {} 2024-04-16T18:20:06.823 DEBUG:boto:Token: None 2024-04-16T18:20:06.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33 2024-04-16T18:20:06.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2v/UjYzFesvhKUDvwlxtpMJB+b8= 2024-04-16T18:20:06.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2v/UjYzFesvhKUDvwlxtpMJB+b8=', 'Content-Length': '0'} 2024-04-16T18:20:06.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b148d5620441975d-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.866 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:20:06.866 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:20:06.867 DEBUG:boto:Method: GET 2024-04-16T18:20:06.867 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:20:06.867 DEBUG:boto:Data: 2024-04-16T18:20:06.867 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.867 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.867 DEBUG:boto:Params: {} 2024-04-16T18:20:06.867 DEBUG:boto:Token: None 2024-04-16T18:20:06.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj33 2024-04-16T18:20:06.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2v/UjYzFesvhKUDvwlxtpMJB+b8= 2024-04-16T18:20:06.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2v/UjYzFesvhKUDvwlxtpMJB+b8=', 'Content-Length': '0'} 2024-04-16T18:20:06.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053c050681ebdd290-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.870 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.870 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.870 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.870 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.870 DEBUG:boto:Method: GET 2024-04-16T18:20:06.871 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.871 DEBUG:boto:Data: 2024-04-16T18:20:06.871 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.871 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.871 DEBUG:boto:Params: {} 2024-04-16T18:20:06.871 DEBUG:boto:Token: None 2024-04-16T18:20:06.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.874 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e14367a69b8bf00-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.874 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.875 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.875 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.875 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.875 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.875 DEBUG:boto:Method: GET 2024-04-16T18:20:06.875 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:20:06.876 DEBUG:boto:Data: 2024-04-16T18:20:06.876 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.876 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.876 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.876 DEBUG:boto:Params: {} 2024-04-16T18:20:06.876 DEBUG:boto:Token: None 2024-04-16T18:20:06.876 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.879 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf2313f3d35d057d-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.879 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.880 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:20:06.880 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:06.880 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:06.880 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.880 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.880 DEBUG:boto:Method: GET 2024-04-16T18:20:06.880 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.881 DEBUG:boto:Data: 2024-04-16T18:20:06.881 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.881 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.881 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.881 DEBUG:boto:Params: {} 2024-04-16T18:20:06.881 DEBUG:boto:Token: None 2024-04-16T18:20:06.881 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.881 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0= 2024-04-16T18:20:06.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0=', 'Content-Length': '0'} 2024-04-16T18:20:06.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d73d31f6884d786-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.926 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:06.926 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:06.927 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.927 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.927 DEBUG:boto:Method: GET 2024-04-16T18:20:06.927 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.927 DEBUG:boto:Data: 2024-04-16T18:20:06.927 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.927 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.927 DEBUG:boto:Params: {} 2024-04-16T18:20:06.927 DEBUG:boto:Token: None 2024-04-16T18:20:06.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0= 2024-04-16T18:20:06.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0=', 'Content-Length': '0'} 2024-04-16T18:20:06.930 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcbae5a5b18d22c3-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.930 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:06.930 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:06.930 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.930 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.931 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.931 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.931 DEBUG:boto:Data: 2024-04-16T18:20:06.931 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.931 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.931 DEBUG:boto:Params: {} 2024-04-16T18:20:06.931 DEBUG:boto:Token: None 2024-04-16T18:20:06.931 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dx32wHd47zJFtBZTh14L/9SLWkk= 2024-04-16T18:20:06.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dx32wHd47zJFtBZTh14L/9SLWkk=', 'Content-Length': '0'} 2024-04-16T18:20:06.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098b85e0a7d6cf6ba-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.933 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:06.934 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:06.934 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.934 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.934 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.934 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.934 DEBUG:boto:Data: 2024-04-16T18:20:06.934 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.934 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.934 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.935 DEBUG:boto:Params: {} 2024-04-16T18:20:06.935 DEBUG:boto:Token: None 2024-04-16T18:20:06.935 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dx32wHd47zJFtBZTh14L/9SLWkk= 2024-04-16T18:20:06.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dx32wHd47zJFtBZTh14L/9SLWkk=', 'Content-Length': '0'} 2024-04-16T18:20:06.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044f576b80ab5c684-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.937 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:20:06.938 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:06.938 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:06.938 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.938 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.938 DEBUG:boto:Method: GET 2024-04-16T18:20:06.938 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.938 DEBUG:boto:Data: 2024-04-16T18:20:06.938 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.938 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.938 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.938 DEBUG:boto:Params: {} 2024-04-16T18:20:06.939 DEBUG:boto:Token: None 2024-04-16T18:20:06.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0= 2024-04-16T18:20:06.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0=', 'Content-Length': '0'} 2024-04-16T18:20:06.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000515fa222759ddf89-00661ec156-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.986 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:06.986 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:06.987 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.987 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.987 DEBUG:boto:Method: GET 2024-04-16T18:20:06.987 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.987 DEBUG:boto:Data: 2024-04-16T18:20:06.987 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.987 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.987 DEBUG:boto:Params: {} 2024-04-16T18:20:06.987 DEBUG:boto:Token: None 2024-04-16T18:20:06.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:20:06.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0= 2024-04-16T18:20:06.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O6kl8G/TXBgHiw60kC4btK55BO0=', 'Content-Length': '0'} 2024-04-16T18:20:06.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ed6b6b58991bcf5-00661ec156-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.990 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.990 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.990 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:06.990 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:06.990 DEBUG:boto:Method: GET 2024-04-16T18:20:06.991 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:20:06.991 DEBUG:boto:Data: 2024-04-16T18:20:06.991 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.991 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.991 DEBUG:boto:Params: {} 2024-04-16T18:20:06.991 DEBUG:boto:Token: None 2024-04-16T18:20:06.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.994 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e18533f55a1b1d47-00661ec156-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.994 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.994 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:06.994 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:06.995 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:06.995 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:06.995 DEBUG:boto:Method: GET 2024-04-16T18:20:06.995 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:20:06.995 DEBUG:boto:Data: 2024-04-16T18:20:06.995 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:06.995 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.995 DEBUG:boto:Params: {} 2024-04-16T18:20:06.995 DEBUG:boto:Token: None 2024-04-16T18:20:06.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:06 GMT /cjqttm-52/ 2024-04-16T18:20:06.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA= 2024-04-16T18:20:06.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SqRH+1W0PTCwK4N7p6YCp4hvUiA=', 'Content-Length': '0'} 2024-04-16T18:20:06.998 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069dfb1d792ac63a2-00661ec156-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:06.998 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:06.999 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:06.999 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:06.999 DEBUG:boto:Method: HEAD 2024-04-16T18:20:06.999 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:20:06.999 DEBUG:boto:Data: 2024-04-16T18:20:06.999 DEBUG:boto:Headers: {} 2024-04-16T18:20:06.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:06.999 DEBUG:boto:Port: 8000 2024-04-16T18:20:06.999 DEBUG:boto:Params: {} 2024-04-16T18:20:06.999 DEBUG:boto:Token: None 2024-04-16T18:20:07.000 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj44 2024-04-16T18:20:07.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jN/yaoYL0qJH31+TrzwSMz5PY3Q= 2024-04-16T18:20:07.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jN/yaoYL0qJH31+TrzwSMz5PY3Q=', 'Content-Length': '0'} 2024-04-16T18:20:07.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9c6e7277bcbda42-00661ec157-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.002 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:07.002 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:07.002 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.002 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:20:07.002 DEBUG:boto:Data: 2024-04-16T18:20:07.002 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.003 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.003 DEBUG:boto:Params: {} 2024-04-16T18:20:07.003 DEBUG:boto:Token: None 2024-04-16T18:20:07.003 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj44 2024-04-16T18:20:07.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jN/yaoYL0qJH31+TrzwSMz5PY3Q= 2024-04-16T18:20:07.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jN/yaoYL0qJH31+TrzwSMz5PY3Q=', 'Content-Length': '0'} 2024-04-16T18:20:07.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc3837d5acd67ab5-00661ec157-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:20:07.006 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:07.006 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:07.006 DEBUG:boto:Method: GET 2024-04-16T18:20:07.006 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:20:07.006 DEBUG:boto:Data: 2024-04-16T18:20:07.006 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.006 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.006 DEBUG:boto:Params: {} 2024-04-16T18:20:07.006 DEBUG:boto:Token: None 2024-04-16T18:20:07.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj44 2024-04-16T18:20:07.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b2GvSL1d0rc6pjTg3LGdtQe85pM= 2024-04-16T18:20:07.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b2GvSL1d0rc6pjTg3LGdtQe85pM=', 'Content-Length': '0'} 2024-04-16T18:20:07.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9e2861ee62011f1-00661ec157-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.050 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:20:07.051 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:20:07.051 DEBUG:boto:Method: GET 2024-04-16T18:20:07.051 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:20:07.051 DEBUG:boto:Data: 2024-04-16T18:20:07.051 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.051 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.051 DEBUG:boto:Params: {} 2024-04-16T18:20:07.051 DEBUG:boto:Token: None 2024-04-16T18:20:07.051 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj44 2024-04-16T18:20:07.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b2GvSL1d0rc6pjTg3LGdtQe85pM= 2024-04-16T18:20:07.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b2GvSL1d0rc6pjTg3LGdtQe85pM=', 'Content-Length': '0'} 2024-04-16T18:20:07.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5833af1ff1b96ea-00661ec157-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.054 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.054 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.054 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:07.054 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:07.054 DEBUG:boto:Method: GET 2024-04-16T18:20:07.054 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:20:07.054 DEBUG:boto:Data: 2024-04-16T18:20:07.054 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.055 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.055 DEBUG:boto:Params: {} 2024-04-16T18:20:07.055 DEBUG:boto:Token: None 2024-04-16T18:20:07.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs= 2024-04-16T18:20:07.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs=', 'Content-Length': '0'} 2024-04-16T18:20:07.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ec3f4ab0ad87acfb-00661ec157-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.058 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:07.058 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.058 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.058 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:07.058 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:20:07.058 DEBUG:boto:Method: GET 2024-04-16T18:20:07.058 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:20:07.059 DEBUG:boto:Data: 2024-04-16T18:20:07.059 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.059 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.059 DEBUG:boto:Params: {} 2024-04-16T18:20:07.059 DEBUG:boto:Token: None 2024-04-16T18:20:07.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs= 2024-04-16T18:20:07.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs=', 'Content-Length': '0'} 2024-04-16T18:20:07.062 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000226a020c31b16210-00661ec157-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.062 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:07.062 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:20:07.062 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.063 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.063 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.063 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.063 DEBUG:boto:Method: GET 2024-04-16T18:20:07.063 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.063 DEBUG:boto:Data: 2024-04-16T18:20:07.063 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.063 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.063 DEBUG:boto:Params: {} 2024-04-16T18:20:07.064 DEBUG:boto:Token: None 2024-04-16T18:20:07.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk= 2024-04-16T18:20:07.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk=', 'Content-Length': '0'} 2024-04-16T18:20:07.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045477bed1b15672a-00661ec157-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.110 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.110 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.111 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.111 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.111 DEBUG:boto:Method: GET 2024-04-16T18:20:07.111 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.111 DEBUG:boto:Data: 2024-04-16T18:20:07.111 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.111 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.111 DEBUG:boto:Params: {} 2024-04-16T18:20:07.111 DEBUG:boto:Token: None 2024-04-16T18:20:07.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk= 2024-04-16T18:20:07.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk=', 'Content-Length': '0'} 2024-04-16T18:20:07.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa8568930f162f97-00661ec157-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.114 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.114 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.114 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.114 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.114 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.114 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.114 DEBUG:boto:Data: 2024-04-16T18:20:07.115 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.115 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.115 DEBUG:boto:Params: {} 2024-04-16T18:20:07.115 DEBUG:boto:Token: None 2024-04-16T18:20:07.115 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ahh9swTHcrAgPuLvN8f1Khk9cBQ= 2024-04-16T18:20:07.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ahh9swTHcrAgPuLvN8f1Khk9cBQ=', 'Content-Length': '0'} 2024-04-16T18:20:07.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ea1e060909d94a5-00661ec157-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.118 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.118 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.118 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.118 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.118 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.118 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.119 DEBUG:boto:Data: 2024-04-16T18:20:07.119 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.119 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.119 DEBUG:boto:Params: {} 2024-04-16T18:20:07.119 DEBUG:boto:Token: None 2024-04-16T18:20:07.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ahh9swTHcrAgPuLvN8f1Khk9cBQ= 2024-04-16T18:20:07.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ahh9swTHcrAgPuLvN8f1Khk9cBQ=', 'Content-Length': '0'} 2024-04-16T18:20:07.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ae25e669bbf6298-00661ec157-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:20:07.122 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.122 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.122 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.122 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.122 DEBUG:boto:Method: GET 2024-04-16T18:20:07.122 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.122 DEBUG:boto:Data: 2024-04-16T18:20:07.122 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.122 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.122 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.123 DEBUG:boto:Params: {} 2024-04-16T18:20:07.123 DEBUG:boto:Token: None 2024-04-16T18:20:07.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk= 2024-04-16T18:20:07.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk=', 'Content-Length': '0'} 2024-04-16T18:20:07.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd95588f59806b58-00661ec157-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.166 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.166 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.166 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.167 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.167 DEBUG:boto:Method: GET 2024-04-16T18:20:07.167 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.167 DEBUG:boto:Data: 2024-04-16T18:20:07.167 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.167 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.167 DEBUG:boto:Params: {} 2024-04-16T18:20:07.167 DEBUG:boto:Token: None 2024-04-16T18:20:07.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:20:07.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk= 2024-04-16T18:20:07.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7BquL7LKyW5Y4C7hYz9okZsIFnk=', 'Content-Length': '0'} 2024-04-16T18:20:07.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006610eef42b2d9f77-00661ec157-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.170 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.170 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.170 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.170 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.170 DEBUG:boto:Method: GET 2024-04-16T18:20:07.170 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.170 DEBUG:boto:Data: 2024-04-16T18:20:07.170 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.171 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.171 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.171 DEBUG:boto:Params: {} 2024-04-16T18:20:07.171 DEBUG:boto:Token: None 2024-04-16T18:20:07.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs= 2024-04-16T18:20:07.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs=', 'Content-Length': '0'} 2024-04-16T18:20:07.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b74eb403c2e0de5f-00661ec157-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.173 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:07.174 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.174 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.174 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.174 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.174 DEBUG:boto:Method: GET 2024-04-16T18:20:07.174 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.174 DEBUG:boto:Data: 2024-04-16T18:20:07.175 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.175 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.175 DEBUG:boto:Params: {} 2024-04-16T18:20:07.175 DEBUG:boto:Token: None 2024-04-16T18:20:07.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs= 2024-04-16T18:20:07.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs=', 'Content-Length': '0'} 2024-04-16T18:20:07.177 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cac145fa02b088ba-00661ec157-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.178 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:07.178 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.178 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.178 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.178 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:20:07.178 DEBUG:boto:Data: 2024-04-16T18:20:07.178 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.178 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.179 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.179 DEBUG:boto:Params: {} 2024-04-16T18:20:07.179 DEBUG:boto:Token: None 2024-04-16T18:20:07.179 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55 2024-04-16T18:20:07.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:50MBFXpzxsBpkjqMSjIUk1wtNek= 2024-04-16T18:20:07.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:50MBFXpzxsBpkjqMSjIUk1wtNek=', 'Content-Length': '0'} 2024-04-16T18:20:07.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063ed7451e52b02cc-00661ec157-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.181 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.181 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.182 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.182 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:20:07.182 DEBUG:boto:Data: 2024-04-16T18:20:07.182 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.182 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.182 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.182 DEBUG:boto:Params: {} 2024-04-16T18:20:07.182 DEBUG:boto:Token: None 2024-04-16T18:20:07.182 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55 2024-04-16T18:20:07.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:50MBFXpzxsBpkjqMSjIUk1wtNek= 2024-04-16T18:20:07.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:50MBFXpzxsBpkjqMSjIUk1wtNek=', 'Content-Length': '0'} 2024-04-16T18:20:07.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a07a9d0721d241e-00661ec157-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:20:07.185 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.185 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.185 DEBUG:boto:Method: GET 2024-04-16T18:20:07.185 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:20:07.185 DEBUG:boto:Data: 2024-04-16T18:20:07.185 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.185 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.185 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.186 DEBUG:boto:Params: {} 2024-04-16T18:20:07.186 DEBUG:boto:Token: None 2024-04-16T18:20:07.186 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55 2024-04-16T18:20:07.186 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9brwueONpwFgBHHA4DVP3VGvdmA= 2024-04-16T18:20:07.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9brwueONpwFgBHHA4DVP3VGvdmA=', 'Content-Length': '0'} 2024-04-16T18:20:07.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042412c02005d0922-00661ec157-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.230 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:20:07.230 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:20:07.231 DEBUG:boto:Method: GET 2024-04-16T18:20:07.231 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:20:07.231 DEBUG:boto:Data: 2024-04-16T18:20:07.231 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.231 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.231 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.231 DEBUG:boto:Params: {} 2024-04-16T18:20:07.231 DEBUG:boto:Token: None 2024-04-16T18:20:07.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj55 2024-04-16T18:20:07.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9brwueONpwFgBHHA4DVP3VGvdmA= 2024-04-16T18:20:07.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9brwueONpwFgBHHA4DVP3VGvdmA=', 'Content-Length': '0'} 2024-04-16T18:20:07.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bd199ff0c64c15d-00661ec157-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.234 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.234 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.234 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.234 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.234 DEBUG:boto:Method: GET 2024-04-16T18:20:07.234 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.235 DEBUG:boto:Data: 2024-04-16T18:20:07.235 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.235 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:20:07.235 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.235 DEBUG:boto:Params: {} 2024-04-16T18:20:07.235 DEBUG:boto:Token: None 2024-04-16T18:20:07.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs= 2024-04-16T18:20:07.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs=', 'Content-Length': '0'} 2024-04-16T18:20:07.238 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df05b61763d81e8b-00661ec157-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.238 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:07.238 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.238 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.239 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.239 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.239 DEBUG:boto:Method: GET 2024-04-16T18:20:07.239 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:20:07.239 DEBUG:boto:Data: 2024-04-16T18:20:07.239 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.239 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.239 DEBUG:boto:Params: {} 2024-04-16T18:20:07.239 DEBUG:boto:Token: None 2024-04-16T18:20:07.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs= 2024-04-16T18:20:07.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXjCYKdeelSGS96oPQIJSVOQJfs=', 'Content-Length': '0'} 2024-04-16T18:20:07.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002109a7cd7da94f16-00661ec157-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.242 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:20:07.243 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:20:07.243 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:20:07.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:20:07.243 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:20:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:20:07.301 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:20:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:20:07.370 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-52 2024-04-16T18:20:07.375 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 5 2024-04-16T18:20:07.425 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.425 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.425 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.425 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:20:07.425 DEBUG:boto:Data: 2024-04-16T18:20:07.426 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.426 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.426 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.426 DEBUG:boto:Params: {} 2024-04-16T18:20:07.426 DEBUG:boto:Token: None 2024-04-16T18:20:07.426 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.426 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4= 2024-04-16T18:20:07.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4=', 'Content-Length': '0'} 2024-04-16T18:20:07.429 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000094b06af041ba5f14-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.429 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:20:07.429 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:20:07.429 DEBUG:boto:Method: PUT 2024-04-16T18:20:07.430 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:20:07.430 DEBUG:boto:Data: 2024-04-16T18:20:07.430 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:20:07.430 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.430 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.430 DEBUG:boto:Params: {} 2024-04-16T18:20:07.430 DEBUG:boto:Token: None 2024-04-16T18:20:07.430 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj17 2024-04-16T18:20:07.431 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ua0WM90FUX++Pf2JgmwSAnfVeK4= 2024-04-16T18:20:07.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ua0WM90FUX++Pf2JgmwSAnfVeK4='} 2024-04-16T18:20:07.436 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c7eb8a09d1bc20cc-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.436 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.437 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.437 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.437 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:20:07.437 DEBUG:boto:Data: 2024-04-16T18:20:07.437 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.437 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.437 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.437 DEBUG:boto:Params: {} 2024-04-16T18:20:07.437 DEBUG:boto:Token: None 2024-04-16T18:20:07.437 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.437 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4= 2024-04-16T18:20:07.438 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4=', 'Content-Length': '0'} 2024-04-16T18:20:07.439 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000067226c08ed3d87a2-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.440 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:20:07.440 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:20:07.440 DEBUG:boto:Method: PUT 2024-04-16T18:20:07.440 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:20:07.440 DEBUG:boto:Data: 2024-04-16T18:20:07.440 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:20:07.440 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.440 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.440 DEBUG:boto:Params: {} 2024-04-16T18:20:07.440 DEBUG:boto:Token: None 2024-04-16T18:20:07.441 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj34 2024-04-16T18:20:07.441 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z2UI6wduM7gFMeJWA3uYfqC5q+w= 2024-04-16T18:20:07.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z2UI6wduM7gFMeJWA3uYfqC5q+w='} 2024-04-16T18:20:07.482 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005dd45a55499d440e-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.483 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.483 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.483 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.483 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:20:07.483 DEBUG:boto:Data: 2024-04-16T18:20:07.483 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.483 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.483 DEBUG:boto:Params: {} 2024-04-16T18:20:07.483 DEBUG:boto:Token: None 2024-04-16T18:20:07.484 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4= 2024-04-16T18:20:07.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4=', 'Content-Length': '0'} 2024-04-16T18:20:07.486 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003ef08177c3c6988b-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.486 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:20:07.486 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:20:07.486 DEBUG:boto:Method: PUT 2024-04-16T18:20:07.486 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:20:07.486 DEBUG:boto:Data: 2024-04-16T18:20:07.487 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:20:07.487 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.487 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.487 DEBUG:boto:Params: {} 2024-04-16T18:20:07.487 DEBUG:boto:Token: None 2024-04-16T18:20:07.487 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj51 2024-04-16T18:20:07.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l8pkKdHMB2f5Kznp8P8FLWsq4mU= 2024-04-16T18:20:07.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l8pkKdHMB2f5Kznp8P8FLWsq4mU='} 2024-04-16T18:20:07.493 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000003056980a48d8564-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.493 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.493 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.493 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.493 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:20:07.493 DEBUG:boto:Data: 2024-04-16T18:20:07.494 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.494 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.494 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.494 DEBUG:boto:Params: {} 2024-04-16T18:20:07.494 DEBUG:boto:Token: None 2024-04-16T18:20:07.494 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.494 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4= 2024-04-16T18:20:07.494 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4=', 'Content-Length': '0'} 2024-04-16T18:20:07.497 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f5cfbb705b0bfe6-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.497 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:20:07.497 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:20:07.497 DEBUG:boto:Method: PUT 2024-04-16T18:20:07.497 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:20:07.498 DEBUG:boto:Data: 2024-04-16T18:20:07.498 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:20:07.498 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.498 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.498 DEBUG:boto:Params: {} 2024-04-16T18:20:07.498 DEBUG:boto:Token: None 2024-04-16T18:20:07.498 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj68 2024-04-16T18:20:07.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F+qt31cHBJWXuEwdVinVgishDPU= 2024-04-16T18:20:07.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F+qt31cHBJWXuEwdVinVgishDPU='} 2024-04-16T18:20:07.504 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a581d7ccc8f8bd91-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.504 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:20:07.504 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:20:07.504 DEBUG:boto:Method: HEAD 2024-04-16T18:20:07.504 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:20:07.505 DEBUG:boto:Data: 2024-04-16T18:20:07.505 DEBUG:boto:Headers: {} 2024-04-16T18:20:07.505 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.505 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.505 DEBUG:boto:Params: {} 2024-04-16T18:20:07.505 DEBUG:boto:Token: None 2024-04-16T18:20:07.505 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/ 2024-04-16T18:20:07.505 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4= 2024-04-16T18:20:07.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3V4TiWZiqgkJlzc9uB8R+9ltoH4=', 'Content-Length': '0'} 2024-04-16T18:20:07.508 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bb6da80bcab384e9-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.508 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:20:07.508 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:20:07.508 DEBUG:boto:Method: PUT 2024-04-16T18:20:07.508 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:20:07.508 DEBUG:boto:Data: 2024-04-16T18:20:07.508 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:20:07.508 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:20:07.509 DEBUG:boto:Port: 8000 2024-04-16T18:20:07.509 DEBUG:boto:Params: {} 2024-04-16T18:20:07.509 DEBUG:boto:Token: None 2024-04-16T18:20:07.509 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:20:07 GMT /cjqttm-52/obj85 2024-04-16T18:20:07.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Kp/mkOIv4i0PBvgwKP7t3E5VYqU= 2024-04-16T18:20:07.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:20:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Kp/mkOIv4i0PBvgwKP7t3E5VYqU='} 2024-04-16T18:20:07.554 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000dbf5fe7e765c0d0-00661ec157-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:20:07.554 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:20:07.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:20:07.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:20:07.555 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:20:07.619 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:20:07.619 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:20:07.678 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:07.679+0000 7f8324323800 1 waiting to reach latest gen 1, on 0.. 2024-04-16T18:20:12.681 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:12.681+0000 7f8324323800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:12.681 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-16T18:20:12.681 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:17.682 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:17.683+0000 7f8324323800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:17.682 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-16T18:20:17.682 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:22.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:22.684+0000 7f8324323800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:22.684 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-16T18:20:22.684 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:27.685 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:27.685+0000 7f8324323800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:27.685 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-16T18:20:27.685 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:32.687 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:32.687+0000 7f8324323800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:32.687 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , ] 2024-04-16T18:20:32.687 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:37.688 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:37.690+0000 7f8324323800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:37.688 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000001.70.6, , , , , , , 00000000001.72.6, , , ] 2024-04-16T18:20:37.688 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:42.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:42.691+0000 7f8324323800 1 bucket sync caught up with source: 2024-04-16T18:20:42.690 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:42.690 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000001.64.6, , , , , , 00000000001.70.6, , 00000000001.68.6, , , , 00000000001.86.6, 00000000001.72.6, , , ] 2024-04-16T18:20:42.690 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:20:42.691+0000 7f8324323800 0 bucket checkpoint complete 2024-04-16T18:20:42.717 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:20:42.718 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:20:42.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:20:42.718 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:20:42.780 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:20:42.781 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:20:42.843 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:20:42.843+0000 7febac016800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:42.843 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000002.154.6, 00000000003.761.6] 2024-04-16T18:20:42.843 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000003.158.6, 00000000003.761.6] 2024-04-16T18:20:47.844 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:20:47.844+0000 7febac016800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:47.845 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000002.154.6, 00000000003.761.6] 2024-04-16T18:20:47.845 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000003.158.6, 00000000003.761.6] 2024-04-16T18:20:52.846 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:20:52.846+0000 7febac016800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:52.846 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000002.154.6, 00000000003.761.6] 2024-04-16T18:20:52.846 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000003.158.6, 00000000003.761.6] 2024-04-16T18:20:57.847 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:20:57.848+0000 7febac016800 1 waiting for incremental sync to catch up: 2024-04-16T18:20:57.847 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000002.154.6, 00000000003.761.6] 2024-04-16T18:20:57.847 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000003.158.6, 00000000003.761.6] 2024-04-16T18:21:02.848 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:21:02.849+0000 7febac016800 1 bucket sync caught up with source: 2024-04-16T18:21:02.849 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000003.158.6, 00000000003.761.6] 2024-04-16T18:21:02.849 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000001.540.6, 00000000001.667.6, , , 00000000001.265.6, , , 00000000001.871.6, 00000000003.158.6, 00000000003.761.6] 2024-04-16T18:21:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:21:02.849+0000 7febac016800 0 bucket checkpoint complete 2024-04-16T18:21:02.876 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:21:02.876 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.877 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.877 DEBUG:boto:Method: HEAD 2024-04-16T18:21:02.877 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:02.877 DEBUG:boto:Data: 2024-04-16T18:21:02.877 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.877 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.877 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.877 DEBUG:boto:Params: {} 2024-04-16T18:21:02.878 DEBUG:boto:Token: None 2024-04-16T18:21:02.878 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/ 2024-04-16T18:21:02.878 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8nVu/IgyO6Baj8o3p9il36c4ZEk= 2024-04-16T18:21:02.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8nVu/IgyO6Baj8o3p9il36c4ZEk=', 'Content-Length': '0'} 2024-04-16T18:21:02.881 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000097f58e7394e2af4c-00661ec18e-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.882 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.882 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.882 DEBUG:boto:Method: HEAD 2024-04-16T18:21:02.882 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:02.882 DEBUG:boto:Data: 2024-04-16T18:21:02.882 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.882 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.883 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.883 DEBUG:boto:Params: {} 2024-04-16T18:21:02.883 DEBUG:boto:Token: None 2024-04-16T18:21:02.883 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/ 2024-04-16T18:21:02.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8nVu/IgyO6Baj8o3p9il36c4ZEk= 2024-04-16T18:21:02.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8nVu/IgyO6Baj8o3p9il36c4ZEk=', 'Content-Length': '0'} 2024-04-16T18:21:02.888 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bfd3e1c0dfc7d6be-00661ec18e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.888 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:21:02.888 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.888 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.888 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.888 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.888 DEBUG:boto:Method: GET 2024-04-16T18:21:02.889 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.889 DEBUG:boto:Data: 2024-04-16T18:21:02.889 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.889 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.889 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.889 DEBUG:boto:Params: {} 2024-04-16T18:21:02.889 DEBUG:boto:Token: None 2024-04-16T18:21:02.889 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/?versions 2024-04-16T18:21:02.889 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4= 2024-04-16T18:21:02.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4=', 'Content-Length': '0'} 2024-04-16T18:21:02.892 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6019e4f907dcd12-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.892 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:21:02.894 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:21:02.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:21:02.895 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:21:02.895 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:21:02.895 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.895 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.895 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.895 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.895 DEBUG:boto:Method: GET 2024-04-16T18:21:02.896 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.896 DEBUG:boto:Data: 2024-04-16T18:21:02.896 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.896 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.897 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.897 DEBUG:boto:Params: {} 2024-04-16T18:21:02.897 DEBUG:boto:Token: None 2024-04-16T18:21:02.897 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/?versions 2024-04-16T18:21:02.897 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4= 2024-04-16T18:21:02.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4=', 'Content-Length': '0'} 2024-04-16T18:21:02.900 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3c4652f56900859-00661ec18e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.900 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:02.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:21:02.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:21:02.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:21:02.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:21:02.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:21:02.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:21:02.902 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:21:02.902 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:21:02.902 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:21:02.902 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:21:02.902 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.902 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.902 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.902 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.903 DEBUG:boto:Method: GET 2024-04-16T18:21:02.903 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.903 DEBUG:boto:Data: 2024-04-16T18:21:02.903 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.903 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.903 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.903 DEBUG:boto:Params: {} 2024-04-16T18:21:02.903 DEBUG:boto:Token: None 2024-04-16T18:21:02.903 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/?versions 2024-04-16T18:21:02.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4= 2024-04-16T18:21:02.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4=', 'Content-Length': '0'} 2024-04-16T18:21:02.906 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b19580ed5633907f-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.907 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:02.907 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.908 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.908 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.908 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.908 DEBUG:boto:Method: GET 2024-04-16T18:21:02.908 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:02.908 DEBUG:boto:Data: 2024-04-16T18:21:02.908 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.908 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.908 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.908 DEBUG:boto:Params: {} 2024-04-16T18:21:02.909 DEBUG:boto:Token: None 2024-04-16T18:21:02.909 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/?versions 2024-04-16T18:21:02.909 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4= 2024-04-16T18:21:02.909 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8sZnOH5Uc6iqvgRNmc2Y0NWBgH4=', 'Content-Length': '0'} 2024-04-16T18:21:02.911 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb55c9630cddb38e-00661ec18e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.912 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:02.912 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:21:02.912 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.913 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.913 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.913 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.913 DEBUG:boto:Method: GET 2024-04-16T18:21:02.913 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.913 DEBUG:boto:Data: 2024-04-16T18:21:02.913 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.913 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.913 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.913 DEBUG:boto:Params: {} 2024-04-16T18:21:02.914 DEBUG:boto:Token: None 2024-04-16T18:21:02.914 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.914 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34= 2024-04-16T18:21:02.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34=', 'Content-Length': '0'} 2024-04-16T18:21:02.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd016ffc1ebc07ac-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.958 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.959 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.959 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.959 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.959 DEBUG:boto:Method: GET 2024-04-16T18:21:02.959 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.959 DEBUG:boto:Data: 2024-04-16T18:21:02.959 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.959 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.959 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.959 DEBUG:boto:Params: {} 2024-04-16T18:21:02.960 DEBUG:boto:Token: None 2024-04-16T18:21:02.960 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34= 2024-04-16T18:21:02.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34=', 'Content-Length': '0'} 2024-04-16T18:21:02.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f05a20a998d3c1f-00661ec18e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.962 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.963 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.963 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.963 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.963 DEBUG:boto:Method: HEAD 2024-04-16T18:21:02.963 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.963 DEBUG:boto:Data: 2024-04-16T18:21:02.963 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.963 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.964 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.964 DEBUG:boto:Params: {} 2024-04-16T18:21:02.964 DEBUG:boto:Token: None 2024-04-16T18:21:02.964 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPno2EChcfpY4tqdQO51CTFKJCc= 2024-04-16T18:21:02.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPno2EChcfpY4tqdQO51CTFKJCc=', 'Content-Length': '0'} 2024-04-16T18:21:02.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008ad3459a3db38eb-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.967 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.967 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.967 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.967 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.967 DEBUG:boto:Method: HEAD 2024-04-16T18:21:02.967 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.967 DEBUG:boto:Data: 2024-04-16T18:21:02.967 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.967 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.967 DEBUG:boto:Params: {} 2024-04-16T18:21:02.968 DEBUG:boto:Token: None 2024-04-16T18:21:02.968 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FPno2EChcfpY4tqdQO51CTFKJCc= 2024-04-16T18:21:02.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FPno2EChcfpY4tqdQO51CTFKJCc=', 'Content-Length': '0'} 2024-04-16T18:21:02.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cbbe8777646b82a-00661ec18e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:21:02.970 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.970 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.971 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.971 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.971 DEBUG:boto:Method: GET 2024-04-16T18:21:02.971 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.971 DEBUG:boto:Data: 2024-04-16T18:21:02.971 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.971 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.971 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.971 DEBUG:boto:Params: {} 2024-04-16T18:21:02.971 DEBUG:boto:Token: None 2024-04-16T18:21:02.972 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34= 2024-04-16T18:21:02.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34=', 'Content-Length': '0'} 2024-04-16T18:21:02.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3cbefc9d4ab7a99-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.974 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.974 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.974 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.974 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.975 DEBUG:boto:Method: GET 2024-04-16T18:21:02.975 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.975 DEBUG:boto:Data: 2024-04-16T18:21:02.975 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.975 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.975 DEBUG:boto:Params: {} 2024-04-16T18:21:02.975 DEBUG:boto:Token: None 2024-04-16T18:21:02.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:02.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34= 2024-04-16T18:21:02.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jDcxr3O9QfdrhuaU5QPCpi+ZV34=', 'Content-Length': '0'} 2024-04-16T18:21:02.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001448c9e39c5a1cb7-00661ec18e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.978 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.978 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.978 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:02.978 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:02.978 DEBUG:boto:Method: GET 2024-04-16T18:21:02.978 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:02.979 DEBUG:boto:Data: 2024-04-16T18:21:02.979 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.979 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.979 DEBUG:boto:Params: {} 2024-04-16T18:21:02.979 DEBUG:boto:Token: None 2024-04-16T18:21:02.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/ 2024-04-16T18:21:02.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IrkJCpmkS1pbq95Qq9swpu/Pe/Y= 2024-04-16T18:21:02.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IrkJCpmkS1pbq95Qq9swpu/Pe/Y=', 'Content-Length': '0'} 2024-04-16T18:21:02.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005be76139f7a42da1-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.982 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:02.983 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:02.983 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:02.983 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:02.983 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:02.983 DEBUG:boto:Method: GET 2024-04-16T18:21:02.983 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:02.983 DEBUG:boto:Data: 2024-04-16T18:21:02.983 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.983 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.984 DEBUG:boto:Params: {} 2024-04-16T18:21:02.984 DEBUG:boto:Token: None 2024-04-16T18:21:02.984 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/ 2024-04-16T18:21:02.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IrkJCpmkS1pbq95Qq9swpu/Pe/Y= 2024-04-16T18:21:02.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IrkJCpmkS1pbq95Qq9swpu/Pe/Y=', 'Content-Length': '0'} 2024-04-16T18:21:02.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e4b70ef5c9a9b0c-00661ec18e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.987 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:02.987 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.987 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.988 DEBUG:boto:Method: HEAD 2024-04-16T18:21:02.988 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:02.988 DEBUG:boto:Data: 2024-04-16T18:21:02.988 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.988 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.988 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.988 DEBUG:boto:Params: {} 2024-04-16T18:21:02.988 DEBUG:boto:Token: None 2024-04-16T18:21:02.988 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11 2024-04-16T18:21:02.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NuMZGjHvLCChUcZtvRvK8gXUDc= 2024-04-16T18:21:02.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NuMZGjHvLCChUcZtvRvK8gXUDc=', 'Content-Length': '0'} 2024-04-16T18:21:02.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b91e3009f551cbf6-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.991 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.991 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.991 DEBUG:boto:Method: HEAD 2024-04-16T18:21:02.991 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:02.991 DEBUG:boto:Data: 2024-04-16T18:21:02.991 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:02.991 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.992 DEBUG:boto:Params: {} 2024-04-16T18:21:02.992 DEBUG:boto:Token: None 2024-04-16T18:21:02.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11 2024-04-16T18:21:02.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NuMZGjHvLCChUcZtvRvK8gXUDc= 2024-04-16T18:21:02.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NuMZGjHvLCChUcZtvRvK8gXUDc=', 'Content-Length': '0'} 2024-04-16T18:21:02.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccb04fe163dade21-00661ec18e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:02.994 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:21:02.995 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:02.995 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:02.995 DEBUG:boto:Method: GET 2024-04-16T18:21:02.995 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:02.995 DEBUG:boto:Data: 2024-04-16T18:21:02.995 DEBUG:boto:Headers: {} 2024-04-16T18:21:02.995 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:02.995 DEBUG:boto:Port: 8000 2024-04-16T18:21:02.995 DEBUG:boto:Params: {} 2024-04-16T18:21:02.996 DEBUG:boto:Token: None 2024-04-16T18:21:02.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:02 GMT /cjqttm-52/obj11 2024-04-16T18:21:02.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JKfbX7g4qWkgjVqk3TDXQe3YTv0= 2024-04-16T18:21:02.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:02 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JKfbX7g4qWkgjVqk3TDXQe3YTv0=', 'Content-Length': '0'} 2024-04-16T18:21:02.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000718037596b648909-00661ec18e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:02 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.038 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:03.038 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:03.039 DEBUG:boto:Method: GET 2024-04-16T18:21:03.039 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:03.039 DEBUG:boto:Data: 2024-04-16T18:21:03.039 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.039 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.039 DEBUG:boto:Params: {} 2024-04-16T18:21:03.039 DEBUG:boto:Token: None 2024-04-16T18:21:03.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj11 2024-04-16T18:21:03.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZgNwYZV/9MjC9vY7mTBbfQwZwrw= 2024-04-16T18:21:03.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZgNwYZV/9MjC9vY7mTBbfQwZwrw=', 'Content-Length': '0'} 2024-04-16T18:21:03.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000926217fe02a44b1d-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.042 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.042 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.042 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:03.042 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:03.042 DEBUG:boto:Method: GET 2024-04-16T18:21:03.042 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:03.042 DEBUG:boto:Data: 2024-04-16T18:21:03.042 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.043 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.043 DEBUG:boto:Params: {} 2024-04-16T18:21:03.043 DEBUG:boto:Token: None 2024-04-16T18:21:03.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001de4c485b4b1c10c-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.046 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.046 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.046 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.046 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:03.046 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:03.046 DEBUG:boto:Method: GET 2024-04-16T18:21:03.047 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:03.047 DEBUG:boto:Data: 2024-04-16T18:21:03.047 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.047 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.047 DEBUG:boto:Params: {} 2024-04-16T18:21:03.047 DEBUG:boto:Token: None 2024-04-16T18:21:03.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000094aa8aa63e44bf7-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.050 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.050 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:21:03.050 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.051 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.051 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.051 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.051 DEBUG:boto:Method: GET 2024-04-16T18:21:03.051 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.051 DEBUG:boto:Data: 2024-04-16T18:21:03.051 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.051 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.051 DEBUG:boto:Params: {} 2024-04-16T18:21:03.052 DEBUG:boto:Token: None 2024-04-16T18:21:03.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU= 2024-04-16T18:21:03.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU=', 'Content-Length': '0'} 2024-04-16T18:21:03.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000032a889e2e349c91-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.094 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.095 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.095 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.095 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.095 DEBUG:boto:Method: GET 2024-04-16T18:21:03.095 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.095 DEBUG:boto:Data: 2024-04-16T18:21:03.095 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.095 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.095 DEBUG:boto:Params: {} 2024-04-16T18:21:03.095 DEBUG:boto:Token: None 2024-04-16T18:21:03.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU= 2024-04-16T18:21:03.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU=', 'Content-Length': '0'} 2024-04-16T18:21:03.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005171da88cdbea0bd-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.098 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.098 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.099 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.099 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.099 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.099 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.099 DEBUG:boto:Data: 2024-04-16T18:21:03.099 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.099 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.099 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.099 DEBUG:boto:Params: {} 2024-04-16T18:21:03.099 DEBUG:boto:Token: None 2024-04-16T18:21:03.099 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m/fl2dEqZzUOHNI2j06F4Slwvi4= 2024-04-16T18:21:03.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m/fl2dEqZzUOHNI2j06F4Slwvi4=', 'Content-Length': '0'} 2024-04-16T18:21:03.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000782404ed28f0b8a-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.102 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.102 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.102 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.103 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.103 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.103 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.103 DEBUG:boto:Data: 2024-04-16T18:21:03.103 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.103 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.103 DEBUG:boto:Params: {} 2024-04-16T18:21:03.103 DEBUG:boto:Token: None 2024-04-16T18:21:03.103 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m/fl2dEqZzUOHNI2j06F4Slwvi4= 2024-04-16T18:21:03.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m/fl2dEqZzUOHNI2j06F4Slwvi4=', 'Content-Length': '0'} 2024-04-16T18:21:03.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de579f271bc8ac79-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.106 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:21:03.107 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.107 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.107 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.107 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.107 DEBUG:boto:Method: GET 2024-04-16T18:21:03.107 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.107 DEBUG:boto:Data: 2024-04-16T18:21:03.107 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.107 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.107 DEBUG:boto:Params: {} 2024-04-16T18:21:03.108 DEBUG:boto:Token: None 2024-04-16T18:21:03.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU= 2024-04-16T18:21:03.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU=', 'Content-Length': '0'} 2024-04-16T18:21:03.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc06dc8d9cdbdd3a-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.154 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.154 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.155 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.155 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.155 DEBUG:boto:Method: GET 2024-04-16T18:21:03.155 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.155 DEBUG:boto:Data: 2024-04-16T18:21:03.155 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.155 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.155 DEBUG:boto:Params: {} 2024-04-16T18:21:03.155 DEBUG:boto:Token: None 2024-04-16T18:21:03.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:03.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU= 2024-04-16T18:21:03.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+fkKWq8d7CDVGfAGj7lXOJz/vBU=', 'Content-Length': '0'} 2024-04-16T18:21:03.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bdc4950e73254b3-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.158 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.159 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.159 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.159 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.159 DEBUG:boto:Method: GET 2024-04-16T18:21:03.159 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.159 DEBUG:boto:Data: 2024-04-16T18:21:03.159 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.159 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.159 DEBUG:boto:Params: {} 2024-04-16T18:21:03.160 DEBUG:boto:Token: None 2024-04-16T18:21:03.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d9580b22e140219-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.202 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.203 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.203 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.203 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.203 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.203 DEBUG:boto:Method: GET 2024-04-16T18:21:03.203 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.203 DEBUG:boto:Data: 2024-04-16T18:21:03.203 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.204 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.204 DEBUG:boto:Params: {} 2024-04-16T18:21:03.204 DEBUG:boto:Token: None 2024-04-16T18:21:03.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afe9e37c0906f779-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.207 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.207 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.207 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.207 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.207 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:03.207 DEBUG:boto:Data: 2024-04-16T18:21:03.208 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.208 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.208 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.208 DEBUG:boto:Params: {} 2024-04-16T18:21:03.208 DEBUG:boto:Token: None 2024-04-16T18:21:03.208 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17 2024-04-16T18:21:03.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+D4A2R3jgGcmG2gH2TWw+4vKD8I= 2024-04-16T18:21:03.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+D4A2R3jgGcmG2gH2TWw+4vKD8I=', 'Content-Length': '0'} 2024-04-16T18:21:03.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aaf07adbf864d41f-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.211 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.211 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.211 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.211 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:03.211 DEBUG:boto:Data: 2024-04-16T18:21:03.211 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.211 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.211 DEBUG:boto:Params: {} 2024-04-16T18:21:03.212 DEBUG:boto:Token: None 2024-04-16T18:21:03.212 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17 2024-04-16T18:21:03.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+D4A2R3jgGcmG2gH2TWw+4vKD8I= 2024-04-16T18:21:03.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+D4A2R3jgGcmG2gH2TWw+4vKD8I=', 'Content-Length': '0'} 2024-04-16T18:21:03.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ad60316e57258e2-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.214 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:21:03.214 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.214 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.215 DEBUG:boto:Method: GET 2024-04-16T18:21:03.215 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:03.215 DEBUG:boto:Data: 2024-04-16T18:21:03.215 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.215 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.215 DEBUG:boto:Params: {} 2024-04-16T18:21:03.215 DEBUG:boto:Token: None 2024-04-16T18:21:03.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17 2024-04-16T18:21:03.215 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:om7C1UbswdLhYlq/qVMgaZ9rj1g= 2024-04-16T18:21:03.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:om7C1UbswdLhYlq/qVMgaZ9rj1g=', 'Content-Length': '0'} 2024-04-16T18:21:03.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4f40ec7f22008bc-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.258 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:03.258 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:03.259 DEBUG:boto:Method: GET 2024-04-16T18:21:03.259 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:03.259 DEBUG:boto:Data: 2024-04-16T18:21:03.259 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.259 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.259 DEBUG:boto:Params: {} 2024-04-16T18:21:03.259 DEBUG:boto:Token: None 2024-04-16T18:21:03.259 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj17 2024-04-16T18:21:03.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:om7C1UbswdLhYlq/qVMgaZ9rj1g= 2024-04-16T18:21:03.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:om7C1UbswdLhYlq/qVMgaZ9rj1g=', 'Content-Length': '0'} 2024-04-16T18:21:03.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000223b11851f0ac5da-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.262 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.262 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.262 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.262 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.262 DEBUG:boto:Method: GET 2024-04-16T18:21:03.263 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.263 DEBUG:boto:Data: 2024-04-16T18:21:03.263 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.263 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.263 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.263 DEBUG:boto:Params: {} 2024-04-16T18:21:03.263 DEBUG:boto:Token: None 2024-04-16T18:21:03.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020dadadb7d423af2-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.306 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.307 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.307 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.307 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.307 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.307 DEBUG:boto:Method: GET 2024-04-16T18:21:03.307 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:03.307 DEBUG:boto:Data: 2024-04-16T18:21:03.307 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.308 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.308 DEBUG:boto:Params: {} 2024-04-16T18:21:03.308 DEBUG:boto:Token: None 2024-04-16T18:21:03.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065c4b37412b1ec29-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.311 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.311 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:21:03.311 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.311 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.312 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.312 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.312 DEBUG:boto:Method: GET 2024-04-16T18:21:03.312 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.312 DEBUG:boto:Data: 2024-04-16T18:21:03.312 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.312 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.312 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.312 DEBUG:boto:Params: {} 2024-04-16T18:21:03.312 DEBUG:boto:Token: None 2024-04-16T18:21:03.312 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.313 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4= 2024-04-16T18:21:03.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4=', 'Content-Length': '0'} 2024-04-16T18:21:03.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b09a701e142029d-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.358 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.358 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.359 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.359 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.359 DEBUG:boto:Method: GET 2024-04-16T18:21:03.359 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.359 DEBUG:boto:Data: 2024-04-16T18:21:03.359 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.359 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.359 DEBUG:boto:Params: {} 2024-04-16T18:21:03.359 DEBUG:boto:Token: None 2024-04-16T18:21:03.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4= 2024-04-16T18:21:03.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4=', 'Content-Length': '0'} 2024-04-16T18:21:03.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c66fef71a3e5a757-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.362 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.362 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.362 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.362 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.362 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.363 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.363 DEBUG:boto:Data: 2024-04-16T18:21:03.363 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.363 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.363 DEBUG:boto:Params: {} 2024-04-16T18:21:03.363 DEBUG:boto:Token: None 2024-04-16T18:21:03.363 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UkB5yDD1K2DMkxCQ4CcQppHFm5c= 2024-04-16T18:21:03.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UkB5yDD1K2DMkxCQ4CcQppHFm5c=', 'Content-Length': '0'} 2024-04-16T18:21:03.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f9eb0d7985f7196-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.366 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.366 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.366 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.366 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.366 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.366 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.366 DEBUG:boto:Data: 2024-04-16T18:21:03.366 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.366 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.366 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.366 DEBUG:boto:Params: {} 2024-04-16T18:21:03.367 DEBUG:boto:Token: None 2024-04-16T18:21:03.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UkB5yDD1K2DMkxCQ4CcQppHFm5c= 2024-04-16T18:21:03.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UkB5yDD1K2DMkxCQ4CcQppHFm5c=', 'Content-Length': '0'} 2024-04-16T18:21:03.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bdb9a835d8c11168-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:21:03.369 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.369 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.370 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.370 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.370 DEBUG:boto:Method: GET 2024-04-16T18:21:03.370 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.370 DEBUG:boto:Data: 2024-04-16T18:21:03.370 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.370 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.370 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.370 DEBUG:boto:Params: {} 2024-04-16T18:21:03.373 DEBUG:boto:Token: None 2024-04-16T18:21:03.373 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.374 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4= 2024-04-16T18:21:03.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4=', 'Content-Length': '0'} 2024-04-16T18:21:03.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e12cace4f36abb0-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.418 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.419 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.419 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.419 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.419 DEBUG:boto:Method: GET 2024-04-16T18:21:03.419 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.419 DEBUG:boto:Data: 2024-04-16T18:21:03.419 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.419 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.419 DEBUG:boto:Params: {} 2024-04-16T18:21:03.419 DEBUG:boto:Token: None 2024-04-16T18:21:03.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:03.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4= 2024-04-16T18:21:03.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xqQNwR7/XDwqQsXxTDHRZgqAnw4=', 'Content-Length': '0'} 2024-04-16T18:21:03.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c71b84eea321fd9-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.422 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.422 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.422 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.422 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.422 DEBUG:boto:Method: GET 2024-04-16T18:21:03.422 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.423 DEBUG:boto:Data: 2024-04-16T18:21:03.423 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.423 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.423 DEBUG:boto:Params: {} 2024-04-16T18:21:03.423 DEBUG:boto:Token: None 2024-04-16T18:21:03.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4464080ef546493-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.466 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.467 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.467 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.467 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.467 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.467 DEBUG:boto:Method: GET 2024-04-16T18:21:03.467 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.467 DEBUG:boto:Data: 2024-04-16T18:21:03.467 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.468 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.468 DEBUG:boto:Params: {} 2024-04-16T18:21:03.468 DEBUG:boto:Token: None 2024-04-16T18:21:03.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.471 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004cf458e64820ba03-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.471 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.471 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.471 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.472 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.472 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:03.472 DEBUG:boto:Data: 2024-04-16T18:21:03.472 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.472 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.472 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.472 DEBUG:boto:Params: {} 2024-04-16T18:21:03.472 DEBUG:boto:Token: None 2024-04-16T18:21:03.472 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22 2024-04-16T18:21:03.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wWSxz81NwDUSgq6eD7WMwerHWFc= 2024-04-16T18:21:03.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wWSxz81NwDUSgq6eD7WMwerHWFc=', 'Content-Length': '0'} 2024-04-16T18:21:03.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007dc4962ef3af3fd5-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.474 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.475 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.475 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.475 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:03.475 DEBUG:boto:Data: 2024-04-16T18:21:03.475 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.475 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.475 DEBUG:boto:Params: {} 2024-04-16T18:21:03.475 DEBUG:boto:Token: None 2024-04-16T18:21:03.475 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22 2024-04-16T18:21:03.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wWSxz81NwDUSgq6eD7WMwerHWFc= 2024-04-16T18:21:03.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wWSxz81NwDUSgq6eD7WMwerHWFc=', 'Content-Length': '0'} 2024-04-16T18:21:03.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047d137ecd219801f-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.478 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:21:03.478 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.478 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.478 DEBUG:boto:Method: GET 2024-04-16T18:21:03.478 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:03.478 DEBUG:boto:Data: 2024-04-16T18:21:03.478 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.478 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.478 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.478 DEBUG:boto:Params: {} 2024-04-16T18:21:03.479 DEBUG:boto:Token: None 2024-04-16T18:21:03.479 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22 2024-04-16T18:21:03.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bJPj/e/jOSe1WqVYri8mKVzxgUE= 2024-04-16T18:21:03.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bJPj/e/jOSe1WqVYri8mKVzxgUE=', 'Content-Length': '0'} 2024-04-16T18:21:03.481 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9024e8a28de5e7f-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.522 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:03.522 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:03.523 DEBUG:boto:Method: GET 2024-04-16T18:21:03.523 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:03.523 DEBUG:boto:Data: 2024-04-16T18:21:03.523 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.523 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.523 DEBUG:boto:Params: {} 2024-04-16T18:21:03.523 DEBUG:boto:Token: None 2024-04-16T18:21:03.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj22 2024-04-16T18:21:03.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bJPj/e/jOSe1WqVYri8mKVzxgUE= 2024-04-16T18:21:03.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bJPj/e/jOSe1WqVYri8mKVzxgUE=', 'Content-Length': '0'} 2024-04-16T18:21:03.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9a111e3f4ba99af-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.526 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.526 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.526 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.526 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.526 DEBUG:boto:Method: GET 2024-04-16T18:21:03.526 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.526 DEBUG:boto:Data: 2024-04-16T18:21:03.526 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.526 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.527 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.527 DEBUG:boto:Params: {} 2024-04-16T18:21:03.527 DEBUG:boto:Token: None 2024-04-16T18:21:03.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009094f5240482a840-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.529 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.530 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.530 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.530 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.530 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.530 DEBUG:boto:Method: GET 2024-04-16T18:21:03.530 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:03.530 DEBUG:boto:Data: 2024-04-16T18:21:03.530 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.530 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.530 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.531 DEBUG:boto:Params: {} 2024-04-16T18:21:03.531 DEBUG:boto:Token: None 2024-04-16T18:21:03.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.534 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4aea9d75b69c970-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.534 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:21:03.535 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.535 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.535 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.535 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.535 DEBUG:boto:Method: GET 2024-04-16T18:21:03.535 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.535 DEBUG:boto:Data: 2024-04-16T18:21:03.535 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.535 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.535 DEBUG:boto:Params: {} 2024-04-16T18:21:03.535 DEBUG:boto:Token: None 2024-04-16T18:21:03.536 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU= 2024-04-16T18:21:03.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU=', 'Content-Length': '0'} 2024-04-16T18:21:03.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acdae60cfb01e540-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.578 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.579 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.579 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.579 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.579 DEBUG:boto:Method: GET 2024-04-16T18:21:03.579 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.579 DEBUG:boto:Data: 2024-04-16T18:21:03.579 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.579 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.579 DEBUG:boto:Params: {} 2024-04-16T18:21:03.579 DEBUG:boto:Token: None 2024-04-16T18:21:03.580 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU= 2024-04-16T18:21:03.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU=', 'Content-Length': '0'} 2024-04-16T18:21:03.582 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be3b0185aed8d30d-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.582 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.582 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.582 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.583 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.583 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.583 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.583 DEBUG:boto:Data: 2024-04-16T18:21:03.583 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.583 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.583 DEBUG:boto:Params: {} 2024-04-16T18:21:03.583 DEBUG:boto:Token: None 2024-04-16T18:21:03.583 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HhQE8bsiZDVi69K1XO7LdZopb64= 2024-04-16T18:21:03.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HhQE8bsiZDVi69K1XO7LdZopb64=', 'Content-Length': '0'} 2024-04-16T18:21:03.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000295502b672f6d9f2-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.586 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.586 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.586 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.586 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.586 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.586 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.587 DEBUG:boto:Data: 2024-04-16T18:21:03.587 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.587 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.587 DEBUG:boto:Params: {} 2024-04-16T18:21:03.587 DEBUG:boto:Token: None 2024-04-16T18:21:03.587 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HhQE8bsiZDVi69K1XO7LdZopb64= 2024-04-16T18:21:03.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HhQE8bsiZDVi69K1XO7LdZopb64=', 'Content-Length': '0'} 2024-04-16T18:21:03.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036ba4dc9a7a995d3-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.590 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:21:03.590 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.590 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.590 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.590 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.590 DEBUG:boto:Method: GET 2024-04-16T18:21:03.590 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.591 DEBUG:boto:Data: 2024-04-16T18:21:03.591 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.591 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.591 DEBUG:boto:Params: {} 2024-04-16T18:21:03.591 DEBUG:boto:Token: None 2024-04-16T18:21:03.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU= 2024-04-16T18:21:03.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU=', 'Content-Length': '0'} 2024-04-16T18:21:03.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8ae4768f0ef2028-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.634 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.634 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.635 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.635 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.635 DEBUG:boto:Method: GET 2024-04-16T18:21:03.635 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.635 DEBUG:boto:Data: 2024-04-16T18:21:03.635 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.635 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.635 DEBUG:boto:Params: {} 2024-04-16T18:21:03.635 DEBUG:boto:Token: None 2024-04-16T18:21:03.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:03.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU= 2024-04-16T18:21:03.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CGA3sHLN+0a9oOf6StpH3P5nhgU=', 'Content-Length': '0'} 2024-04-16T18:21:03.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c991e3756b943fb6-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.638 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.638 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.638 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.638 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.638 DEBUG:boto:Method: GET 2024-04-16T18:21:03.639 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.639 DEBUG:boto:Data: 2024-04-16T18:21:03.639 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.639 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.639 DEBUG:boto:Params: {} 2024-04-16T18:21:03.639 DEBUG:boto:Token: None 2024-04-16T18:21:03.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009baaf296798f8e38-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.642 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.642 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.642 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.642 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.642 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.643 DEBUG:boto:Method: GET 2024-04-16T18:21:03.643 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.643 DEBUG:boto:Data: 2024-04-16T18:21:03.643 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.643 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.643 DEBUG:boto:Params: {} 2024-04-16T18:21:03.643 DEBUG:boto:Token: None 2024-04-16T18:21:03.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0ac62c6c86324ef-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.646 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.647 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.647 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.647 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.647 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:03.647 DEBUG:boto:Data: 2024-04-16T18:21:03.647 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.647 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.647 DEBUG:boto:Params: {} 2024-04-16T18:21:03.648 DEBUG:boto:Token: None 2024-04-16T18:21:03.648 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33 2024-04-16T18:21:03.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xLZRHi2FwHNVru/Jlsatn1muHow= 2024-04-16T18:21:03.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xLZRHi2FwHNVru/Jlsatn1muHow=', 'Content-Length': '0'} 2024-04-16T18:21:03.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a8f15390538fc6d-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.650 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.650 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.650 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.650 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:03.650 DEBUG:boto:Data: 2024-04-16T18:21:03.650 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.650 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.650 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.651 DEBUG:boto:Params: {} 2024-04-16T18:21:03.651 DEBUG:boto:Token: None 2024-04-16T18:21:03.651 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33 2024-04-16T18:21:03.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xLZRHi2FwHNVru/Jlsatn1muHow= 2024-04-16T18:21:03.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xLZRHi2FwHNVru/Jlsatn1muHow=', 'Content-Length': '0'} 2024-04-16T18:21:03.653 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2c1e25a02e2d446-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.653 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:21:03.653 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.653 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.654 DEBUG:boto:Method: GET 2024-04-16T18:21:03.654 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:03.654 DEBUG:boto:Data: 2024-04-16T18:21:03.654 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.654 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.654 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.654 DEBUG:boto:Params: {} 2024-04-16T18:21:03.654 DEBUG:boto:Token: None 2024-04-16T18:21:03.654 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33 2024-04-16T18:21:03.654 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kcoQAYioTpjYo8qUX3x4iubDbHE= 2024-04-16T18:21:03.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kcoQAYioTpjYo8qUX3x4iubDbHE=', 'Content-Length': '0'} 2024-04-16T18:21:03.656 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005afa675eef48e260-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.698 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:03.698 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:03.699 DEBUG:boto:Method: GET 2024-04-16T18:21:03.699 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:03.699 DEBUG:boto:Data: 2024-04-16T18:21:03.699 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.699 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.699 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.699 DEBUG:boto:Params: {} 2024-04-16T18:21:03.699 DEBUG:boto:Token: None 2024-04-16T18:21:03.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj33 2024-04-16T18:21:03.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kcoQAYioTpjYo8qUX3x4iubDbHE= 2024-04-16T18:21:03.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kcoQAYioTpjYo8qUX3x4iubDbHE=', 'Content-Length': '0'} 2024-04-16T18:21:03.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd544fb2df2b78ba-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.702 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.702 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.702 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.702 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.702 DEBUG:boto:Method: GET 2024-04-16T18:21:03.702 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.702 DEBUG:boto:Data: 2024-04-16T18:21:03.702 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.702 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.702 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.703 DEBUG:boto:Params: {} 2024-04-16T18:21:03.703 DEBUG:boto:Token: None 2024-04-16T18:21:03.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.705 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000967030b0e55b0c04-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.706 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.706 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.706 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.706 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.706 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.706 DEBUG:boto:Method: GET 2024-04-16T18:21:03.706 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:03.706 DEBUG:boto:Data: 2024-04-16T18:21:03.707 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.707 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.707 DEBUG:boto:Params: {} 2024-04-16T18:21:03.707 DEBUG:boto:Token: None 2024-04-16T18:21:03.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.710 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbc1bbbe8916220e-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.710 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.710 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:21:03.710 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.710 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.711 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.711 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.711 DEBUG:boto:Method: GET 2024-04-16T18:21:03.711 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.711 DEBUG:boto:Data: 2024-04-16T18:21:03.711 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.711 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.711 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.711 DEBUG:boto:Params: {} 2024-04-16T18:21:03.711 DEBUG:boto:Token: None 2024-04-16T18:21:03.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4= 2024-04-16T18:21:03.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4=', 'Content-Length': '0'} 2024-04-16T18:21:03.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce0fa46511a8980c-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.754 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.754 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.755 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.755 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.755 DEBUG:boto:Method: GET 2024-04-16T18:21:03.755 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.755 DEBUG:boto:Data: 2024-04-16T18:21:03.755 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.755 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.755 DEBUG:boto:Params: {} 2024-04-16T18:21:03.755 DEBUG:boto:Token: None 2024-04-16T18:21:03.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4= 2024-04-16T18:21:03.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4=', 'Content-Length': '0'} 2024-04-16T18:21:03.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000caa68a69ccfb5f59-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.758 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.758 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.758 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.758 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.758 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.759 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.759 DEBUG:boto:Data: 2024-04-16T18:21:03.759 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.759 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.759 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.759 DEBUG:boto:Params: {} 2024-04-16T18:21:03.759 DEBUG:boto:Token: None 2024-04-16T18:21:03.759 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9GsBEoF8u0iY4m/LKzLp7BqRx6E= 2024-04-16T18:21:03.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9GsBEoF8u0iY4m/LKzLp7BqRx6E=', 'Content-Length': '0'} 2024-04-16T18:21:03.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec5f2c51873448a6-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.761 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.762 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.762 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.762 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.762 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.762 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.762 DEBUG:boto:Data: 2024-04-16T18:21:03.762 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.762 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.762 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.762 DEBUG:boto:Params: {} 2024-04-16T18:21:03.763 DEBUG:boto:Token: None 2024-04-16T18:21:03.763 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9GsBEoF8u0iY4m/LKzLp7BqRx6E= 2024-04-16T18:21:03.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9GsBEoF8u0iY4m/LKzLp7BqRx6E=', 'Content-Length': '0'} 2024-04-16T18:21:03.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052d6f6c8726d4b06-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:21:03.765 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.765 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.765 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.765 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.766 DEBUG:boto:Method: GET 2024-04-16T18:21:03.766 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.766 DEBUG:boto:Data: 2024-04-16T18:21:03.766 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.766 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.766 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.766 DEBUG:boto:Params: {} 2024-04-16T18:21:03.766 DEBUG:boto:Token: None 2024-04-16T18:21:03.766 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4= 2024-04-16T18:21:03.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4=', 'Content-Length': '0'} 2024-04-16T18:21:03.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e2bffd0fca1af13-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.810 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.811 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.811 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.811 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.811 DEBUG:boto:Method: GET 2024-04-16T18:21:03.811 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.811 DEBUG:boto:Data: 2024-04-16T18:21:03.811 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.811 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.811 DEBUG:boto:Params: {} 2024-04-16T18:21:03.811 DEBUG:boto:Token: None 2024-04-16T18:21:03.812 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:03.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4= 2024-04-16T18:21:03.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fweO1juhtOayS1T4PaxenbS+P+4=', 'Content-Length': '0'} 2024-04-16T18:21:03.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ca7453b20c83736-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.814 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.814 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.814 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.814 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.814 DEBUG:boto:Method: GET 2024-04-16T18:21:03.815 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.815 DEBUG:boto:Data: 2024-04-16T18:21:03.815 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.815 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.815 DEBUG:boto:Params: {} 2024-04-16T18:21:03.815 DEBUG:boto:Token: None 2024-04-16T18:21:03.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.818 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000226a70a8ea6b70cd-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.818 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.818 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.818 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.818 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.818 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.819 DEBUG:boto:Method: GET 2024-04-16T18:21:03.819 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.819 DEBUG:boto:Data: 2024-04-16T18:21:03.819 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.819 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.819 DEBUG:boto:Params: {} 2024-04-16T18:21:03.819 DEBUG:boto:Token: None 2024-04-16T18:21:03.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.822 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffd8e01f6f64c02c-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.823 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.823 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.823 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.823 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.823 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:03.823 DEBUG:boto:Data: 2024-04-16T18:21:03.824 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.824 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.824 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.824 DEBUG:boto:Params: {} 2024-04-16T18:21:03.824 DEBUG:boto:Token: None 2024-04-16T18:21:03.824 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34 2024-04-16T18:21:03.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A6LBOlVNSqpM+Q4WbYCaO2dWX4s= 2024-04-16T18:21:03.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A6LBOlVNSqpM+Q4WbYCaO2dWX4s=', 'Content-Length': '0'} 2024-04-16T18:21:03.826 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9d01adad3e8f227-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.826 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.827 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.827 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.827 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:03.827 DEBUG:boto:Data: 2024-04-16T18:21:03.827 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.827 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.827 DEBUG:boto:Params: {} 2024-04-16T18:21:03.827 DEBUG:boto:Token: None 2024-04-16T18:21:03.827 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34 2024-04-16T18:21:03.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A6LBOlVNSqpM+Q4WbYCaO2dWX4s= 2024-04-16T18:21:03.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A6LBOlVNSqpM+Q4WbYCaO2dWX4s=', 'Content-Length': '0'} 2024-04-16T18:21:03.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0a9b9676af250d1-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.830 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:21:03.830 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.830 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.830 DEBUG:boto:Method: GET 2024-04-16T18:21:03.830 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:03.830 DEBUG:boto:Data: 2024-04-16T18:21:03.830 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.830 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.831 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.831 DEBUG:boto:Params: {} 2024-04-16T18:21:03.831 DEBUG:boto:Token: None 2024-04-16T18:21:03.831 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34 2024-04-16T18:21:03.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8dLPBgqCWPA4MNjxrhYGMUm1NSE= 2024-04-16T18:21:03.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8dLPBgqCWPA4MNjxrhYGMUm1NSE=', 'Content-Length': '0'} 2024-04-16T18:21:03.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098b119f3c37bc4b2-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.874 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:03.874 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:03.875 DEBUG:boto:Method: GET 2024-04-16T18:21:03.875 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:03.875 DEBUG:boto:Data: 2024-04-16T18:21:03.875 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.875 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.875 DEBUG:boto:Params: {} 2024-04-16T18:21:03.875 DEBUG:boto:Token: None 2024-04-16T18:21:03.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj34 2024-04-16T18:21:03.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8dLPBgqCWPA4MNjxrhYGMUm1NSE= 2024-04-16T18:21:03.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8dLPBgqCWPA4MNjxrhYGMUm1NSE=', 'Content-Length': '0'} 2024-04-16T18:21:03.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015c3931a5ecf6d22-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.878 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.878 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.878 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.878 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.878 DEBUG:boto:Method: GET 2024-04-16T18:21:03.878 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.879 DEBUG:boto:Data: 2024-04-16T18:21:03.879 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.879 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.879 DEBUG:boto:Params: {} 2024-04-16T18:21:03.879 DEBUG:boto:Token: None 2024-04-16T18:21:03.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.882 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7290029ccf20125-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.882 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.882 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.882 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.883 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.883 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.883 DEBUG:boto:Method: GET 2024-04-16T18:21:03.883 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:03.883 DEBUG:boto:Data: 2024-04-16T18:21:03.883 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.883 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.883 DEBUG:boto:Params: {} 2024-04-16T18:21:03.883 DEBUG:boto:Token: None 2024-04-16T18:21:03.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.887 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057790cbeba84cc88-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.887 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.887 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:21:03.887 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:03.887 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:03.887 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.887 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.888 DEBUG:boto:Method: GET 2024-04-16T18:21:03.888 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.888 DEBUG:boto:Data: 2024-04-16T18:21:03.888 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.888 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.888 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.888 DEBUG:boto:Params: {} 2024-04-16T18:21:03.888 DEBUG:boto:Token: None 2024-04-16T18:21:03.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs= 2024-04-16T18:21:03.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs=', 'Content-Length': '0'} 2024-04-16T18:21:03.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fae4b89390b4f85-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.934 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:03.934 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:03.935 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.935 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.935 DEBUG:boto:Method: GET 2024-04-16T18:21:03.935 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.935 DEBUG:boto:Data: 2024-04-16T18:21:03.935 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.935 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.935 DEBUG:boto:Params: {} 2024-04-16T18:21:03.935 DEBUG:boto:Token: None 2024-04-16T18:21:03.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs= 2024-04-16T18:21:03.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs=', 'Content-Length': '0'} 2024-04-16T18:21:03.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b157f59d4623b72-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.938 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:03.938 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:03.938 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.938 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.938 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.938 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.939 DEBUG:boto:Data: 2024-04-16T18:21:03.939 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.939 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.939 DEBUG:boto:Params: {} 2024-04-16T18:21:03.939 DEBUG:boto:Token: None 2024-04-16T18:21:03.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4lHZqM9FIDnD6dWbH/WCTFF9p0M= 2024-04-16T18:21:03.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4lHZqM9FIDnD6dWbH/WCTFF9p0M=', 'Content-Length': '0'} 2024-04-16T18:21:03.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000144f76d588c7f0b2-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.942 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:03.942 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:03.942 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.942 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.942 DEBUG:boto:Method: HEAD 2024-04-16T18:21:03.942 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.942 DEBUG:boto:Data: 2024-04-16T18:21:03.942 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.942 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.942 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.942 DEBUG:boto:Params: {} 2024-04-16T18:21:03.943 DEBUG:boto:Token: None 2024-04-16T18:21:03.943 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4lHZqM9FIDnD6dWbH/WCTFF9p0M= 2024-04-16T18:21:03.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4lHZqM9FIDnD6dWbH/WCTFF9p0M=', 'Content-Length': '0'} 2024-04-16T18:21:03.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e71796835eda4a0a-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.945 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:21:03.945 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:03.945 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:03.945 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.945 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.946 DEBUG:boto:Method: GET 2024-04-16T18:21:03.946 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.946 DEBUG:boto:Data: 2024-04-16T18:21:03.946 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.946 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.946 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.946 DEBUG:boto:Params: {} 2024-04-16T18:21:03.946 DEBUG:boto:Token: None 2024-04-16T18:21:03.946 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs= 2024-04-16T18:21:03.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs=', 'Content-Length': '0'} 2024-04-16T18:21:03.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b19ccde914b483b9-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.990 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:03.991 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:03.991 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.991 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.991 DEBUG:boto:Method: GET 2024-04-16T18:21:03.991 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.991 DEBUG:boto:Data: 2024-04-16T18:21:03.991 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.991 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.991 DEBUG:boto:Params: {} 2024-04-16T18:21:03.992 DEBUG:boto:Token: None 2024-04-16T18:21:03.992 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:03.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs= 2024-04-16T18:21:03.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Busly4eodczKDhxDzbJlF7vOcs=', 'Content-Length': '0'} 2024-04-16T18:21:03.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efe2d6f86b971587-00661ec18f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.994 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.994 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.994 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:03.994 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:03.995 DEBUG:boto:Method: GET 2024-04-16T18:21:03.995 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:03.995 DEBUG:boto:Data: 2024-04-16T18:21:03.995 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.995 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:03.995 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.995 DEBUG:boto:Params: {} 2024-04-16T18:21:03.995 DEBUG:boto:Token: None 2024-04-16T18:21:03.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:03 GMT /cjqttm-52/ 2024-04-16T18:21:03.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y= 2024-04-16T18:21:03.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:03 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+CzNs89po8UZMBR/8twEtjH139Y=', 'Content-Length': '0'} 2024-04-16T18:21:03.998 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c976312d37579d24-00661ec18f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:03 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:03.998 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:03.998 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:03.999 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:03.999 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:03.999 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:03.999 DEBUG:boto:Method: GET 2024-04-16T18:21:03.999 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:03.999 DEBUG:boto:Data: 2024-04-16T18:21:03.999 DEBUG:boto:Headers: {} 2024-04-16T18:21:03.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:03.999 DEBUG:boto:Port: 8000 2024-04-16T18:21:03.999 DEBUG:boto:Params: {} 2024-04-16T18:21:04.000 DEBUG:boto:Token: None 2024-04-16T18:21:04.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002afc81b1a35c0132-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.003 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.003 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:04.003 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:04.003 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.003 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:04.003 DEBUG:boto:Data: 2024-04-16T18:21:04.003 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.003 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.003 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.003 DEBUG:boto:Params: {} 2024-04-16T18:21:04.004 DEBUG:boto:Token: None 2024-04-16T18:21:04.004 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj44 2024-04-16T18:21:04.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cPkNvSJMEioktYsu2K/qJhEAbKg= 2024-04-16T18:21:04.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cPkNvSJMEioktYsu2K/qJhEAbKg=', 'Content-Length': '0'} 2024-04-16T18:21:04.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e219605fd7aa7428-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.006 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:04.006 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:04.006 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.007 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:04.007 DEBUG:boto:Data: 2024-04-16T18:21:04.007 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.007 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.007 DEBUG:boto:Params: {} 2024-04-16T18:21:04.007 DEBUG:boto:Token: None 2024-04-16T18:21:04.007 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj44 2024-04-16T18:21:04.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cPkNvSJMEioktYsu2K/qJhEAbKg= 2024-04-16T18:21:04.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cPkNvSJMEioktYsu2K/qJhEAbKg=', 'Content-Length': '0'} 2024-04-16T18:21:04.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074264f0aad86f7ea-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.009 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:21:04.009 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:04.010 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:04.010 DEBUG:boto:Method: GET 2024-04-16T18:21:04.010 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:04.010 DEBUG:boto:Data: 2024-04-16T18:21:04.010 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.010 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.010 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.010 DEBUG:boto:Params: {} 2024-04-16T18:21:04.010 DEBUG:boto:Token: None 2024-04-16T18:21:04.010 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj44 2024-04-16T18:21:04.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aBY+n/Zm7g22Mv5edSM7eBdM29s= 2024-04-16T18:21:04.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aBY+n/Zm7g22Mv5edSM7eBdM29s=', 'Content-Length': '0'} 2024-04-16T18:21:04.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000645d8003db8a7ab3-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.054 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:04.055 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:04.055 DEBUG:boto:Method: GET 2024-04-16T18:21:04.055 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:04.055 DEBUG:boto:Data: 2024-04-16T18:21:04.055 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.055 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.055 DEBUG:boto:Params: {} 2024-04-16T18:21:04.055 DEBUG:boto:Token: None 2024-04-16T18:21:04.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj44 2024-04-16T18:21:04.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aBY+n/Zm7g22Mv5edSM7eBdM29s= 2024-04-16T18:21:04.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aBY+n/Zm7g22Mv5edSM7eBdM29s=', 'Content-Length': '0'} 2024-04-16T18:21:04.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079a1f4d00918f921-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.057 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.057 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.058 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:04.058 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:04.058 DEBUG:boto:Method: GET 2024-04-16T18:21:04.058 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:04.058 DEBUG:boto:Data: 2024-04-16T18:21:04.058 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.058 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.058 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.058 DEBUG:boto:Params: {} 2024-04-16T18:21:04.058 DEBUG:boto:Token: None 2024-04-16T18:21:04.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.061 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001fb8fa5d539699b7-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.061 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.062 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.062 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.062 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:04.062 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:04.062 DEBUG:boto:Method: GET 2024-04-16T18:21:04.062 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:04.062 DEBUG:boto:Data: 2024-04-16T18:21:04.062 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.062 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.063 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.063 DEBUG:boto:Params: {} 2024-04-16T18:21:04.063 DEBUG:boto:Token: None 2024-04-16T18:21:04.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.066 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c41a5de62dc851a-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.066 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.066 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:21:04.067 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.067 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.067 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.067 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.067 DEBUG:boto:Method: GET 2024-04-16T18:21:04.067 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.067 DEBUG:boto:Data: 2024-04-16T18:21:04.067 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.067 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.067 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.067 DEBUG:boto:Params: {} 2024-04-16T18:21:04.067 DEBUG:boto:Token: None 2024-04-16T18:21:04.068 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A= 2024-04-16T18:21:04.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A=', 'Content-Length': '0'} 2024-04-16T18:21:04.070 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5c4831f19ea9230-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.110 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.111 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.111 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.111 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.111 DEBUG:boto:Method: GET 2024-04-16T18:21:04.111 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.111 DEBUG:boto:Data: 2024-04-16T18:21:04.111 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.111 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.111 DEBUG:boto:Params: {} 2024-04-16T18:21:04.111 DEBUG:boto:Token: None 2024-04-16T18:21:04.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A= 2024-04-16T18:21:04.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A=', 'Content-Length': '0'} 2024-04-16T18:21:04.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2e21f864b8162ff-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.114 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.114 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.114 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.114 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.114 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.115 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.115 DEBUG:boto:Data: 2024-04-16T18:21:04.115 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.115 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.115 DEBUG:boto:Params: {} 2024-04-16T18:21:04.115 DEBUG:boto:Token: None 2024-04-16T18:21:04.115 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+V4+5MEqIur/1/N8gMUIy5S4yek= 2024-04-16T18:21:04.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+V4+5MEqIur/1/N8gMUIy5S4yek=', 'Content-Length': '0'} 2024-04-16T18:21:04.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013d9e8cebf1f8ed9-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.118 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.118 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.118 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.118 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.118 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.118 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.118 DEBUG:boto:Data: 2024-04-16T18:21:04.119 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.119 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.119 DEBUG:boto:Params: {} 2024-04-16T18:21:04.119 DEBUG:boto:Token: None 2024-04-16T18:21:04.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+V4+5MEqIur/1/N8gMUIy5S4yek= 2024-04-16T18:21:04.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+V4+5MEqIur/1/N8gMUIy5S4yek=', 'Content-Length': '0'} 2024-04-16T18:21:04.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdcf88fcb11a3215-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.122 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:21:04.122 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.122 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.122 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.122 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.122 DEBUG:boto:Method: GET 2024-04-16T18:21:04.122 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.122 DEBUG:boto:Data: 2024-04-16T18:21:04.122 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.122 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.122 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.123 DEBUG:boto:Params: {} 2024-04-16T18:21:04.123 DEBUG:boto:Token: None 2024-04-16T18:21:04.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A= 2024-04-16T18:21:04.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A=', 'Content-Length': '0'} 2024-04-16T18:21:04.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b12fcc57ad649aba-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.166 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.166 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.167 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.167 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.167 DEBUG:boto:Method: GET 2024-04-16T18:21:04.167 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.167 DEBUG:boto:Data: 2024-04-16T18:21:04.167 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.167 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.167 DEBUG:boto:Params: {} 2024-04-16T18:21:04.167 DEBUG:boto:Token: None 2024-04-16T18:21:04.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:04.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A= 2024-04-16T18:21:04.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RH5+q9BM4uw1vbbLVzix2+kPQ8A=', 'Content-Length': '0'} 2024-04-16T18:21:04.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081709ff48c6aaa7d-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.170 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.170 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.170 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.170 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.171 DEBUG:boto:Method: GET 2024-04-16T18:21:04.171 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.171 DEBUG:boto:Data: 2024-04-16T18:21:04.171 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.171 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.171 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.171 DEBUG:boto:Params: {} 2024-04-16T18:21:04.171 DEBUG:boto:Token: None 2024-04-16T18:21:04.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058c586393cc99ac6-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.174 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.174 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.174 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.174 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.174 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.174 DEBUG:boto:Method: GET 2024-04-16T18:21:04.175 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.175 DEBUG:boto:Data: 2024-04-16T18:21:04.175 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.175 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.175 DEBUG:boto:Params: {} 2024-04-16T18:21:04.175 DEBUG:boto:Token: None 2024-04-16T18:21:04.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a48f5e64eec12ae-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.178 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.179 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.179 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.179 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.179 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:04.179 DEBUG:boto:Data: 2024-04-16T18:21:04.179 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.179 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.179 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.179 DEBUG:boto:Params: {} 2024-04-16T18:21:04.179 DEBUG:boto:Token: None 2024-04-16T18:21:04.179 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51 2024-04-16T18:21:04.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nc/asoCD/lhkoW6O8UkiNF5erls= 2024-04-16T18:21:04.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nc/asoCD/lhkoW6O8UkiNF5erls=', 'Content-Length': '0'} 2024-04-16T18:21:04.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cedbcc604521da11-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.182 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.182 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.182 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.182 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:04.182 DEBUG:boto:Data: 2024-04-16T18:21:04.183 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.183 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.183 DEBUG:boto:Params: {} 2024-04-16T18:21:04.183 DEBUG:boto:Token: None 2024-04-16T18:21:04.183 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51 2024-04-16T18:21:04.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nc/asoCD/lhkoW6O8UkiNF5erls= 2024-04-16T18:21:04.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nc/asoCD/lhkoW6O8UkiNF5erls=', 'Content-Length': '0'} 2024-04-16T18:21:04.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064460a79d39ce2b7-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:21:04.186 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.186 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.186 DEBUG:boto:Method: GET 2024-04-16T18:21:04.186 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:04.186 DEBUG:boto:Data: 2024-04-16T18:21:04.186 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.187 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.187 DEBUG:boto:Params: {} 2024-04-16T18:21:04.187 DEBUG:boto:Token: None 2024-04-16T18:21:04.187 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51 2024-04-16T18:21:04.187 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ga1lV16zdN2FsHK80LR+RgXFWjo= 2024-04-16T18:21:04.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ga1lV16zdN2FsHK80LR+RgXFWjo=', 'Content-Length': '0'} 2024-04-16T18:21:04.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbfa110fcd06eca1-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.230 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:04.231 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:04.231 DEBUG:boto:Method: GET 2024-04-16T18:21:04.231 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:04.231 DEBUG:boto:Data: 2024-04-16T18:21:04.231 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.231 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.231 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.231 DEBUG:boto:Params: {} 2024-04-16T18:21:04.231 DEBUG:boto:Token: None 2024-04-16T18:21:04.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj51 2024-04-16T18:21:04.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ga1lV16zdN2FsHK80LR+RgXFWjo= 2024-04-16T18:21:04.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ga1lV16zdN2FsHK80LR+RgXFWjo=', 'Content-Length': '0'} 2024-04-16T18:21:04.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c1f04992053565f-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.234 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.234 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.234 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.234 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.234 DEBUG:boto:Method: GET 2024-04-16T18:21:04.234 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.234 DEBUG:boto:Data: 2024-04-16T18:21:04.235 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.235 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.235 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.235 DEBUG:boto:Params: {} 2024-04-16T18:21:04.235 DEBUG:boto:Token: None 2024-04-16T18:21:04.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c2cceccd2c875df-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.238 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.238 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.238 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.238 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.238 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.238 DEBUG:boto:Method: GET 2024-04-16T18:21:04.238 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:04.239 DEBUG:boto:Data: 2024-04-16T18:21:04.239 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.239 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.239 DEBUG:boto:Params: {} 2024-04-16T18:21:04.239 DEBUG:boto:Token: None 2024-04-16T18:21:04.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.239 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a0060605d6d53f6b-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.242 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:21:04.243 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.243 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.243 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.243 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.243 DEBUG:boto:Method: GET 2024-04-16T18:21:04.243 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.243 DEBUG:boto:Data: 2024-04-16T18:21:04.243 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.244 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.244 DEBUG:boto:Params: {} 2024-04-16T18:21:04.244 DEBUG:boto:Token: None 2024-04-16T18:21:04.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc= 2024-04-16T18:21:04.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc=', 'Content-Length': '0'} 2024-04-16T18:21:04.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa8ab5b46717b6cd-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.286 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.286 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.287 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.287 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.287 DEBUG:boto:Method: GET 2024-04-16T18:21:04.287 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.287 DEBUG:boto:Data: 2024-04-16T18:21:04.287 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.287 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.287 DEBUG:boto:Params: {} 2024-04-16T18:21:04.287 DEBUG:boto:Token: None 2024-04-16T18:21:04.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc= 2024-04-16T18:21:04.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc=', 'Content-Length': '0'} 2024-04-16T18:21:04.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de281c17bdfbdb4d-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.290 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.290 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.290 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.290 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.290 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.291 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.291 DEBUG:boto:Data: 2024-04-16T18:21:04.291 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.291 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.291 DEBUG:boto:Params: {} 2024-04-16T18:21:04.291 DEBUG:boto:Token: None 2024-04-16T18:21:04.291 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:60sbB/ZDGxvHlsBvhAQSQDTOGUc= 2024-04-16T18:21:04.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:60sbB/ZDGxvHlsBvhAQSQDTOGUc=', 'Content-Length': '0'} 2024-04-16T18:21:04.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007641c58d571c44f2-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.294 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.294 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.294 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.294 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.294 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.294 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.294 DEBUG:boto:Data: 2024-04-16T18:21:04.294 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.294 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.294 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.295 DEBUG:boto:Params: {} 2024-04-16T18:21:04.295 DEBUG:boto:Token: None 2024-04-16T18:21:04.295 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:60sbB/ZDGxvHlsBvhAQSQDTOGUc= 2024-04-16T18:21:04.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:60sbB/ZDGxvHlsBvhAQSQDTOGUc=', 'Content-Length': '0'} 2024-04-16T18:21:04.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e28519d416b4adc4-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:21:04.297 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.297 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.297 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.298 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.298 DEBUG:boto:Method: GET 2024-04-16T18:21:04.298 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.298 DEBUG:boto:Data: 2024-04-16T18:21:04.298 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.298 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.298 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.298 DEBUG:boto:Params: {} 2024-04-16T18:21:04.298 DEBUG:boto:Token: None 2024-04-16T18:21:04.298 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc= 2024-04-16T18:21:04.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc=', 'Content-Length': '0'} 2024-04-16T18:21:04.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1fc576373ab9ef5-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.342 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.342 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.343 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.343 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.343 DEBUG:boto:Method: GET 2024-04-16T18:21:04.343 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.343 DEBUG:boto:Data: 2024-04-16T18:21:04.343 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.343 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.343 DEBUG:boto:Params: {} 2024-04-16T18:21:04.343 DEBUG:boto:Token: None 2024-04-16T18:21:04.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:04.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc= 2024-04-16T18:21:04.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kZrZcYPMb5HpWPTlJ+svATQfKMc=', 'Content-Length': '0'} 2024-04-16T18:21:04.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b0318b044877fd1-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.346 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.346 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.346 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.346 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.346 DEBUG:boto:Method: GET 2024-04-16T18:21:04.346 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.346 DEBUG:boto:Data: 2024-04-16T18:21:04.347 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.347 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.347 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.347 DEBUG:boto:Params: {} 2024-04-16T18:21:04.347 DEBUG:boto:Token: None 2024-04-16T18:21:04.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.349 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a6e1066d6368411-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.350 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.350 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.350 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.350 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.350 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.350 DEBUG:boto:Method: GET 2024-04-16T18:21:04.351 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.351 DEBUG:boto:Data: 2024-04-16T18:21:04.351 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.351 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.351 DEBUG:boto:Params: {} 2024-04-16T18:21:04.351 DEBUG:boto:Token: None 2024-04-16T18:21:04.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.354 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca684a0ae00c6849-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.354 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.354 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.355 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.355 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.355 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:04.355 DEBUG:boto:Data: 2024-04-16T18:21:04.355 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.355 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.355 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.355 DEBUG:boto:Params: {} 2024-04-16T18:21:04.355 DEBUG:boto:Token: None 2024-04-16T18:21:04.356 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55 2024-04-16T18:21:04.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XzbcI6mQf7DoHgKNctkv+qLbGls= 2024-04-16T18:21:04.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XzbcI6mQf7DoHgKNctkv+qLbGls=', 'Content-Length': '0'} 2024-04-16T18:21:04.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cc1102ebb1830bc-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.358 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.358 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.358 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.359 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:04.359 DEBUG:boto:Data: 2024-04-16T18:21:04.359 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.359 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.359 DEBUG:boto:Params: {} 2024-04-16T18:21:04.359 DEBUG:boto:Token: None 2024-04-16T18:21:04.359 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55 2024-04-16T18:21:04.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XzbcI6mQf7DoHgKNctkv+qLbGls= 2024-04-16T18:21:04.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XzbcI6mQf7DoHgKNctkv+qLbGls=', 'Content-Length': '0'} 2024-04-16T18:21:04.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e10d945300f7a35-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.362 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:21:04.362 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.362 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.362 DEBUG:boto:Method: GET 2024-04-16T18:21:04.362 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:04.362 DEBUG:boto:Data: 2024-04-16T18:21:04.362 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.362 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.362 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.363 DEBUG:boto:Params: {} 2024-04-16T18:21:04.363 DEBUG:boto:Token: None 2024-04-16T18:21:04.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55 2024-04-16T18:21:04.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fwZt6JasBEEc/VBfG/4w9USAvzc= 2024-04-16T18:21:04.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fwZt6JasBEEc/VBfG/4w9USAvzc=', 'Content-Length': '0'} 2024-04-16T18:21:04.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005beac4de349c28b2-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.406 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:04.406 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:04.407 DEBUG:boto:Method: GET 2024-04-16T18:21:04.407 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:04.407 DEBUG:boto:Data: 2024-04-16T18:21:04.407 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.407 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.407 DEBUG:boto:Params: {} 2024-04-16T18:21:04.407 DEBUG:boto:Token: None 2024-04-16T18:21:04.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj55 2024-04-16T18:21:04.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fwZt6JasBEEc/VBfG/4w9USAvzc= 2024-04-16T18:21:04.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fwZt6JasBEEc/VBfG/4w9USAvzc=', 'Content-Length': '0'} 2024-04-16T18:21:04.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ec3d36c79cbf3a8-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.411 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.411 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.411 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.411 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.411 DEBUG:boto:Method: GET 2024-04-16T18:21:04.411 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.411 DEBUG:boto:Data: 2024-04-16T18:21:04.411 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.412 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.412 DEBUG:boto:Params: {} 2024-04-16T18:21:04.412 DEBUG:boto:Token: None 2024-04-16T18:21:04.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a6f8cadc13bbf00d-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.415 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.415 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.415 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.415 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.415 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.415 DEBUG:boto:Method: GET 2024-04-16T18:21:04.415 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:04.416 DEBUG:boto:Data: 2024-04-16T18:21:04.416 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.416 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.416 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.416 DEBUG:boto:Params: {} 2024-04-16T18:21:04.416 DEBUG:boto:Token: None 2024-04-16T18:21:04.416 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.419 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1e28fc37b11f060-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.419 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.419 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:21:04.420 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.420 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.420 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.420 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.420 DEBUG:boto:Method: GET 2024-04-16T18:21:04.420 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.420 DEBUG:boto:Data: 2024-04-16T18:21:04.420 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.420 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.420 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.420 DEBUG:boto:Params: {} 2024-04-16T18:21:04.421 DEBUG:boto:Token: None 2024-04-16T18:21:04.421 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.421 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA= 2024-04-16T18:21:04.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA=', 'Content-Length': '0'} 2024-04-16T18:21:04.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bdfa844a1c36831-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.466 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.467 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.467 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.467 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.467 DEBUG:boto:Method: GET 2024-04-16T18:21:04.467 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.467 DEBUG:boto:Data: 2024-04-16T18:21:04.467 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.467 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.467 DEBUG:boto:Params: {} 2024-04-16T18:21:04.468 DEBUG:boto:Token: None 2024-04-16T18:21:04.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA= 2024-04-16T18:21:04.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA=', 'Content-Length': '0'} 2024-04-16T18:21:04.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9b1f6649e8961cd-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.470 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.470 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.470 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.470 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.470 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.470 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.471 DEBUG:boto:Data: 2024-04-16T18:21:04.471 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.471 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.471 DEBUG:boto:Params: {} 2024-04-16T18:21:04.471 DEBUG:boto:Token: None 2024-04-16T18:21:04.471 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WY8QdKOz8DZlD7fUBJPQkIUucQ8= 2024-04-16T18:21:04.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WY8QdKOz8DZlD7fUBJPQkIUucQ8=', 'Content-Length': '0'} 2024-04-16T18:21:04.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000618050db58791c8e-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.473 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.473 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.473 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.473 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.474 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.474 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.474 DEBUG:boto:Data: 2024-04-16T18:21:04.474 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.474 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.474 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.474 DEBUG:boto:Params: {} 2024-04-16T18:21:04.474 DEBUG:boto:Token: None 2024-04-16T18:21:04.474 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.474 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WY8QdKOz8DZlD7fUBJPQkIUucQ8= 2024-04-16T18:21:04.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WY8QdKOz8DZlD7fUBJPQkIUucQ8=', 'Content-Length': '0'} 2024-04-16T18:21:04.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a52527033fb68673-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.476 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:21:04.477 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.477 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.477 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.477 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.477 DEBUG:boto:Method: GET 2024-04-16T18:21:04.477 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.477 DEBUG:boto:Data: 2024-04-16T18:21:04.477 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.477 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.477 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.477 DEBUG:boto:Params: {} 2024-04-16T18:21:04.477 DEBUG:boto:Token: None 2024-04-16T18:21:04.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA= 2024-04-16T18:21:04.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA=', 'Content-Length': '0'} 2024-04-16T18:21:04.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f12a5edde4cecfae-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.522 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.523 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.523 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.523 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.523 DEBUG:boto:Method: GET 2024-04-16T18:21:04.523 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.523 DEBUG:boto:Data: 2024-04-16T18:21:04.523 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.523 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.523 DEBUG:boto:Params: {} 2024-04-16T18:21:04.523 DEBUG:boto:Token: None 2024-04-16T18:21:04.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:04.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA= 2024-04-16T18:21:04.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:00/M4y9clIglFYndPncOoRpHrIA=', 'Content-Length': '0'} 2024-04-16T18:21:04.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4ef28beaefe4afe-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.526 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.526 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.526 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.526 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.526 DEBUG:boto:Method: GET 2024-04-16T18:21:04.526 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.527 DEBUG:boto:Data: 2024-04-16T18:21:04.527 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.527 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.527 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.527 DEBUG:boto:Params: {} 2024-04-16T18:21:04.527 DEBUG:boto:Token: None 2024-04-16T18:21:04.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.530 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b9405bc77bae4fd-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.530 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.530 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.530 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.530 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.531 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.531 DEBUG:boto:Method: GET 2024-04-16T18:21:04.531 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.531 DEBUG:boto:Data: 2024-04-16T18:21:04.531 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.531 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.531 DEBUG:boto:Params: {} 2024-04-16T18:21:04.531 DEBUG:boto:Token: None 2024-04-16T18:21:04.531 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.534 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001eef7d61fe63c5b5-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.534 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.535 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.535 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.535 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.535 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:04.535 DEBUG:boto:Data: 2024-04-16T18:21:04.535 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.535 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.535 DEBUG:boto:Params: {} 2024-04-16T18:21:04.535 DEBUG:boto:Token: None 2024-04-16T18:21:04.536 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68 2024-04-16T18:21:04.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PJsQpMeOS3Uam2IyW83uw0ATwSs= 2024-04-16T18:21:04.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PJsQpMeOS3Uam2IyW83uw0ATwSs=', 'Content-Length': '0'} 2024-04-16T18:21:04.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b22d46732c25fa31-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.538 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.538 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.538 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.538 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:04.538 DEBUG:boto:Data: 2024-04-16T18:21:04.538 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.538 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.538 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.538 DEBUG:boto:Params: {} 2024-04-16T18:21:04.539 DEBUG:boto:Token: None 2024-04-16T18:21:04.539 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68 2024-04-16T18:21:04.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PJsQpMeOS3Uam2IyW83uw0ATwSs= 2024-04-16T18:21:04.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PJsQpMeOS3Uam2IyW83uw0ATwSs=', 'Content-Length': '0'} 2024-04-16T18:21:04.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053f2adb5f30bb550-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.541 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:21:04.541 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.541 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.541 DEBUG:boto:Method: GET 2024-04-16T18:21:04.542 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:04.542 DEBUG:boto:Data: 2024-04-16T18:21:04.542 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.542 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.542 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.542 DEBUG:boto:Params: {} 2024-04-16T18:21:04.542 DEBUG:boto:Token: None 2024-04-16T18:21:04.542 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68 2024-04-16T18:21:04.542 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hcjOAVzzgbPD0iEgtE0yYkpoRM8= 2024-04-16T18:21:04.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hcjOAVzzgbPD0iEgtE0yYkpoRM8=', 'Content-Length': '0'} 2024-04-16T18:21:04.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061f791750100978d-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.586 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:04.587 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:04.587 DEBUG:boto:Method: GET 2024-04-16T18:21:04.587 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:04.587 DEBUG:boto:Data: 2024-04-16T18:21:04.587 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.587 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.587 DEBUG:boto:Params: {} 2024-04-16T18:21:04.587 DEBUG:boto:Token: None 2024-04-16T18:21:04.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj68 2024-04-16T18:21:04.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hcjOAVzzgbPD0iEgtE0yYkpoRM8= 2024-04-16T18:21:04.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hcjOAVzzgbPD0iEgtE0yYkpoRM8=', 'Content-Length': '0'} 2024-04-16T18:21:04.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a6fa9ca482a10cd-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.590 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.590 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.590 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.590 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.590 DEBUG:boto:Method: GET 2024-04-16T18:21:04.590 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.591 DEBUG:boto:Data: 2024-04-16T18:21:04.591 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.591 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.591 DEBUG:boto:Params: {} 2024-04-16T18:21:04.591 DEBUG:boto:Token: None 2024-04-16T18:21:04.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.593 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000186f8ebba649d10f-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.634 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.635 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.635 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.635 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.635 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.635 DEBUG:boto:Method: GET 2024-04-16T18:21:04.635 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:04.635 DEBUG:boto:Data: 2024-04-16T18:21:04.635 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.636 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.636 DEBUG:boto:Params: {} 2024-04-16T18:21:04.636 DEBUG:boto:Token: None 2024-04-16T18:21:04.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.638 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a6343b02c56a84d-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.639 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:21:04.639 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.639 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.639 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.639 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.640 DEBUG:boto:Method: GET 2024-04-16T18:21:04.640 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.640 DEBUG:boto:Data: 2024-04-16T18:21:04.640 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.640 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.640 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.640 DEBUG:boto:Params: {} 2024-04-16T18:21:04.640 DEBUG:boto:Token: None 2024-04-16T18:21:04.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es= 2024-04-16T18:21:04.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es=', 'Content-Length': '0'} 2024-04-16T18:21:04.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083650ad32fc16c4f-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.686 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.686 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.687 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.687 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.687 DEBUG:boto:Method: GET 2024-04-16T18:21:04.687 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.687 DEBUG:boto:Data: 2024-04-16T18:21:04.687 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.687 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.687 DEBUG:boto:Params: {} 2024-04-16T18:21:04.687 DEBUG:boto:Token: None 2024-04-16T18:21:04.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es= 2024-04-16T18:21:04.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es=', 'Content-Length': '0'} 2024-04-16T18:21:04.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a588615e2341f627-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.690 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.690 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.690 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.690 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.690 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.690 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.690 DEBUG:boto:Data: 2024-04-16T18:21:04.690 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.691 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.691 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.691 DEBUG:boto:Params: {} 2024-04-16T18:21:04.691 DEBUG:boto:Token: None 2024-04-16T18:21:04.691 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zzy9Hp+MtlXbG7ddqKVg4FKMYHQ= 2024-04-16T18:21:04.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zzy9Hp+MtlXbG7ddqKVg4FKMYHQ=', 'Content-Length': '0'} 2024-04-16T18:21:04.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f76088afe7f01b1-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.693 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.694 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.694 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.694 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.694 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.694 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.694 DEBUG:boto:Data: 2024-04-16T18:21:04.694 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.694 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.694 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.694 DEBUG:boto:Params: {} 2024-04-16T18:21:04.694 DEBUG:boto:Token: None 2024-04-16T18:21:04.695 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zzy9Hp+MtlXbG7ddqKVg4FKMYHQ= 2024-04-16T18:21:04.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zzy9Hp+MtlXbG7ddqKVg4FKMYHQ=', 'Content-Length': '0'} 2024-04-16T18:21:04.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008eb8209d79ec63f6-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.697 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:21:04.697 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.697 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.697 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.697 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.697 DEBUG:boto:Method: GET 2024-04-16T18:21:04.697 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.698 DEBUG:boto:Data: 2024-04-16T18:21:04.698 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.698 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.698 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.698 DEBUG:boto:Params: {} 2024-04-16T18:21:04.698 DEBUG:boto:Token: None 2024-04-16T18:21:04.698 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.698 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es= 2024-04-16T18:21:04.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es=', 'Content-Length': '0'} 2024-04-16T18:21:04.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df861b4b3cbefc17-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.742 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.742 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.742 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.742 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.743 DEBUG:boto:Method: GET 2024-04-16T18:21:04.743 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.743 DEBUG:boto:Data: 2024-04-16T18:21:04.743 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.743 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.743 DEBUG:boto:Params: {} 2024-04-16T18:21:04.743 DEBUG:boto:Token: None 2024-04-16T18:21:04.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:04.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es= 2024-04-16T18:21:04.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r6N+dnT3XFFvbcBmmRFdqlpR4Es=', 'Content-Length': '0'} 2024-04-16T18:21:04.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005909acc8b0382f07-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.746 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.746 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.746 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.746 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.746 DEBUG:boto:Method: GET 2024-04-16T18:21:04.746 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.746 DEBUG:boto:Data: 2024-04-16T18:21:04.746 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.746 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.746 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.747 DEBUG:boto:Params: {} 2024-04-16T18:21:04.747 DEBUG:boto:Token: None 2024-04-16T18:21:04.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.749 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b065ed1925e0105-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.790 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.791 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.791 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.791 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.791 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.791 DEBUG:boto:Method: GET 2024-04-16T18:21:04.791 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.791 DEBUG:boto:Data: 2024-04-16T18:21:04.791 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.792 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.792 DEBUG:boto:Params: {} 2024-04-16T18:21:04.792 DEBUG:boto:Token: None 2024-04-16T18:21:04.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.795 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d57460a2411a81e9-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.795 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.795 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.795 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.795 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.796 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:04.796 DEBUG:boto:Data: 2024-04-16T18:21:04.796 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.796 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.796 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.796 DEBUG:boto:Params: {} 2024-04-16T18:21:04.796 DEBUG:boto:Token: None 2024-04-16T18:21:04.796 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85 2024-04-16T18:21:04.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nXWjfmAFOiTHREkocRGB6IFmjGI= 2024-04-16T18:21:04.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nXWjfmAFOiTHREkocRGB6IFmjGI=', 'Content-Length': '0'} 2024-04-16T18:21:04.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0af409ce0bc18de-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.798 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.799 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.799 DEBUG:boto:Method: HEAD 2024-04-16T18:21:04.799 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:04.799 DEBUG:boto:Data: 2024-04-16T18:21:04.799 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.799 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.799 DEBUG:boto:Params: {} 2024-04-16T18:21:04.799 DEBUG:boto:Token: None 2024-04-16T18:21:04.799 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85 2024-04-16T18:21:04.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nXWjfmAFOiTHREkocRGB6IFmjGI= 2024-04-16T18:21:04.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nXWjfmAFOiTHREkocRGB6IFmjGI=', 'Content-Length': '0'} 2024-04-16T18:21:04.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005625c699bb8d957a-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:21:04.802 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.802 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.802 DEBUG:boto:Method: GET 2024-04-16T18:21:04.802 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:04.802 DEBUG:boto:Data: 2024-04-16T18:21:04.802 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.802 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.802 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.802 DEBUG:boto:Params: {} 2024-04-16T18:21:04.803 DEBUG:boto:Token: None 2024-04-16T18:21:04.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85 2024-04-16T18:21:04.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BmUq+Fa0fE4M+kgZqYmm21Rl4Ig= 2024-04-16T18:21:04.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BmUq+Fa0fE4M+kgZqYmm21Rl4Ig=', 'Content-Length': '0'} 2024-04-16T18:21:04.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022d04f45a8c82198-00661ec190-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.846 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:04.846 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:04.847 DEBUG:boto:Method: GET 2024-04-16T18:21:04.847 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:04.847 DEBUG:boto:Data: 2024-04-16T18:21:04.847 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.847 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.847 DEBUG:boto:Params: {} 2024-04-16T18:21:04.847 DEBUG:boto:Token: None 2024-04-16T18:21:04.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/obj85 2024-04-16T18:21:04.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BmUq+Fa0fE4M+kgZqYmm21Rl4Ig= 2024-04-16T18:21:04.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BmUq+Fa0fE4M+kgZqYmm21Rl4Ig=', 'Content-Length': '0'} 2024-04-16T18:21:04.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065e30cb32322f57e-00661ec190-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.850 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.850 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.850 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.850 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.850 DEBUG:boto:Method: GET 2024-04-16T18:21:04.850 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.850 DEBUG:boto:Data: 2024-04-16T18:21:04.850 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.850 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:04.850 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.850 DEBUG:boto:Params: {} 2024-04-16T18:21:04.851 DEBUG:boto:Token: None 2024-04-16T18:21:04.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.853 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae394a752dac24b7-00661ec190-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.854 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.854 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:04.854 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:04.854 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.854 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.854 DEBUG:boto:Method: GET 2024-04-16T18:21:04.854 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:04.855 DEBUG:boto:Data: 2024-04-16T18:21:04.855 DEBUG:boto:Headers: {} 2024-04-16T18:21:04.855 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:04.855 DEBUG:boto:Port: 8000 2024-04-16T18:21:04.855 DEBUG:boto:Params: {} 2024-04-16T18:21:04.855 DEBUG:boto:Token: None 2024-04-16T18:21:04.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:04 GMT /cjqttm-52/ 2024-04-16T18:21:04.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E= 2024-04-16T18:21:04.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s+6GcGcj8bvyBbJbD/dA7Vd768E=', 'Content-Length': '0'} 2024-04-16T18:21:04.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002bbbd7c943b8eb41-00661ec190-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:04.858 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:04.858 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:21:04.859 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:21:04.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:21:04.859 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:21:04.917 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:21:04.917 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:21:04.986 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:21:04.987 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-52 2024-04-16T18:21:04.994 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 10 2024-04-16T18:21:05.052 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:05.052 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:05.052 DEBUG:boto:Method: HEAD 2024-04-16T18:21:05.052 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:05.052 DEBUG:boto:Data: 2024-04-16T18:21:05.052 DEBUG:boto:Headers: {} 2024-04-16T18:21:05.052 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.052 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.052 DEBUG:boto:Params: {} 2024-04-16T18:21:05.052 DEBUG:boto:Token: None 2024-04-16T18:21:05.053 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/ 2024-04-16T18:21:05.053 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo= 2024-04-16T18:21:05.053 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo=', 'Content-Length': '0'} 2024-04-16T18:21:05.055 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005c04d12c106fa159-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.056 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:05.056 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:05.056 DEBUG:boto:Method: PUT 2024-04-16T18:21:05.056 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:21:05.056 DEBUG:boto:Data: 2024-04-16T18:21:05.056 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:05.057 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.057 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.057 DEBUG:boto:Params: {} 2024-04-16T18:21:05.057 DEBUG:boto:Token: None 2024-04-16T18:21:05.057 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/obj19 2024-04-16T18:21:05.057 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nvbk51uxjRh6eekCW2VArc7h0zw= 2024-04-16T18:21:05.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nvbk51uxjRh6eekCW2VArc7h0zw='} 2024-04-16T18:21:05.062 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001620d10330718ddc-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.062 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:05.062 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:05.063 DEBUG:boto:Method: HEAD 2024-04-16T18:21:05.063 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:05.063 DEBUG:boto:Data: 2024-04-16T18:21:05.063 DEBUG:boto:Headers: {} 2024-04-16T18:21:05.063 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.063 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.063 DEBUG:boto:Params: {} 2024-04-16T18:21:05.063 DEBUG:boto:Token: None 2024-04-16T18:21:05.063 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/ 2024-04-16T18:21:05.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo= 2024-04-16T18:21:05.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo=', 'Content-Length': '0'} 2024-04-16T18:21:05.065 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005e015bac5e4f2c62-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.066 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:05.066 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:05.066 DEBUG:boto:Method: PUT 2024-04-16T18:21:05.066 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:21:05.066 DEBUG:boto:Data: 2024-04-16T18:21:05.066 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:05.066 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.066 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.067 DEBUG:boto:Params: {} 2024-04-16T18:21:05.067 DEBUG:boto:Token: None 2024-04-16T18:21:05.067 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/obj38 2024-04-16T18:21:05.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x+5UYrblX9j8jdgX67nLf5Ca3z8= 2024-04-16T18:21:05.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x+5UYrblX9j8jdgX67nLf5Ca3z8='} 2024-04-16T18:21:05.071 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000085654666e24f217f-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.071 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:05.071 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:05.071 DEBUG:boto:Method: HEAD 2024-04-16T18:21:05.071 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:05.071 DEBUG:boto:Data: 2024-04-16T18:21:05.071 DEBUG:boto:Headers: {} 2024-04-16T18:21:05.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.071 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.072 DEBUG:boto:Params: {} 2024-04-16T18:21:05.072 DEBUG:boto:Token: None 2024-04-16T18:21:05.072 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/ 2024-04-16T18:21:05.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo= 2024-04-16T18:21:05.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo=', 'Content-Length': '0'} 2024-04-16T18:21:05.074 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000250cdf78cc13eba1-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.074 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:05.074 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:05.074 DEBUG:boto:Method: PUT 2024-04-16T18:21:05.074 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:21:05.075 DEBUG:boto:Data: 2024-04-16T18:21:05.075 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:05.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.075 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.075 DEBUG:boto:Params: {} 2024-04-16T18:21:05.075 DEBUG:boto:Token: None 2024-04-16T18:21:05.075 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/obj57 2024-04-16T18:21:05.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WiM2+6ab9Da3jdI0xf1/n5IUMbE= 2024-04-16T18:21:05.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WiM2+6ab9Da3jdI0xf1/n5IUMbE='} 2024-04-16T18:21:05.119 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000061b0766e899e73e3-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.119 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:05.119 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:05.119 DEBUG:boto:Method: HEAD 2024-04-16T18:21:05.119 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:05.119 DEBUG:boto:Data: 2024-04-16T18:21:05.119 DEBUG:boto:Headers: {} 2024-04-16T18:21:05.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.119 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.120 DEBUG:boto:Params: {} 2024-04-16T18:21:05.120 DEBUG:boto:Token: None 2024-04-16T18:21:05.120 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/ 2024-04-16T18:21:05.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo= 2024-04-16T18:21:05.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo=', 'Content-Length': '0'} 2024-04-16T18:21:05.122 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000debbfdf4954f3cc7-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.122 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:05.123 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:05.123 DEBUG:boto:Method: PUT 2024-04-16T18:21:05.123 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:21:05.123 DEBUG:boto:Data: 2024-04-16T18:21:05.123 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:05.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.123 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.123 DEBUG:boto:Params: {} 2024-04-16T18:21:05.123 DEBUG:boto:Token: None 2024-04-16T18:21:05.123 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/obj76 2024-04-16T18:21:05.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E8UTK1fkd8B81exSmPaqzj56k4I= 2024-04-16T18:21:05.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E8UTK1fkd8B81exSmPaqzj56k4I='} 2024-04-16T18:21:05.128 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b6531c5f3b8dda50-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.129 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:05.129 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:05.129 DEBUG:boto:Method: HEAD 2024-04-16T18:21:05.129 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:05.129 DEBUG:boto:Data: 2024-04-16T18:21:05.129 DEBUG:boto:Headers: {} 2024-04-16T18:21:05.129 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.129 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.129 DEBUG:boto:Params: {} 2024-04-16T18:21:05.129 DEBUG:boto:Token: None 2024-04-16T18:21:05.130 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/ 2024-04-16T18:21:05.130 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo= 2024-04-16T18:21:05.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kdpPr5vhWeS63RYLhR4GBGXL/bo=', 'Content-Length': '0'} 2024-04-16T18:21:05.132 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ff06e17bbd637992-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.132 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:05.133 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:05.133 DEBUG:boto:Method: PUT 2024-04-16T18:21:05.133 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:21:05.133 DEBUG:boto:Data: 2024-04-16T18:21:05.133 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:05.133 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:05.133 DEBUG:boto:Port: 8000 2024-04-16T18:21:05.133 DEBUG:boto:Params: {} 2024-04-16T18:21:05.133 DEBUG:boto:Token: None 2024-04-16T18:21:05.133 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:05 GMT /cjqttm-52/obj95 2024-04-16T18:21:05.134 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KZI5/JjfuSJdZO2aCzXR0hvx0wg= 2024-04-16T18:21:05.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KZI5/JjfuSJdZO2aCzXR0hvx0wg='} 2024-04-16T18:21:05.137 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ee2389298579a8e6-00661ec191-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:05.138 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:21:05.138 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:21:05.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:21:05.138 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:21:05.200 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:21:05.200 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:21:05.260 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:05.261+0000 7f612da10800 1 waiting to reach latest gen 2, on 1.. 2024-04-16T18:21:10.262 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:10.263+0000 7f612da10800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:10.263 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2024-04-16T18:21:10.263 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:15.264 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:15.264+0000 7f612da10800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:15.264 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2024-04-16T18:21:15.264 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:20.265 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:20.266+0000 7f612da10800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:20.265 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , ] 2024-04-16T18:21:20.265 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:25.267 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:25.268+0000 7f612da10800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:25.267 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:25.267 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:30.268 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:30.270+0000 7f612da10800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:30.269 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:30.269 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:35.270 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:35.271+0000 7f612da10800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:35.270 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:35.270 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:40.271 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:40.272+0000 7f612da10800 1 bucket sync caught up with source: 2024-04-16T18:21:40.272 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:40.272 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.47.6, 00000000004.93.6, , , , , , , , , , , ] 2024-04-16T18:21:40.272 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:40.272+0000 7f612da10800 0 bucket checkpoint complete 2024-04-16T18:21:40.298 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:21:40.299 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:21:40.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:21:40.299 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:21:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:21:40.363 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:21:40.426 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:21:40.427+0000 7fd245833800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:40.426 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.544.6, 00000000001.667.6, 00000000001.1301.6, , 00000000001.265.6, , , 00000000002.877.6, 00000000003.158.6, 00000000003.761.6] 2024-04-16T18:21:40.426 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.544.6, 00000000001.667.6, 00000000001.1301.6, 00000000001.424.6, 00000000001.265.6, , , 00000000002.877.6, 00000000004.162.6, 00000000003.761.6] 2024-04-16T18:21:45.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:21:45.428+0000 7fd245833800 1 bucket sync caught up with source: 2024-04-16T18:21:45.428 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.544.6, 00000000001.667.6, 00000000001.1301.6, 00000000001.424.6, 00000000001.265.6, , , 00000000002.877.6, 00000000004.162.6, 00000000003.761.6] 2024-04-16T18:21:45.428 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.544.6, 00000000001.667.6, 00000000001.1301.6, 00000000001.424.6, 00000000001.265.6, , , 00000000002.877.6, 00000000004.162.6, 00000000003.761.6] 2024-04-16T18:21:45.428 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:21:45.428+0000 7fd245833800 0 bucket checkpoint complete 2024-04-16T18:21:45.455 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:21:45.456 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.456 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.456 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.456 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:45.456 DEBUG:boto:Data: 2024-04-16T18:21:45.456 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.456 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.456 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.456 DEBUG:boto:Params: {} 2024-04-16T18:21:45.457 DEBUG:boto:Token: None 2024-04-16T18:21:45.457 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.457 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tYfP3Ur2ImU8EF4i1ZRWPfXMmcQ= 2024-04-16T18:21:45.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tYfP3Ur2ImU8EF4i1ZRWPfXMmcQ=', 'Content-Length': '0'} 2024-04-16T18:21:45.460 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000767501521d811973-00661ec1b9-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.460 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.460 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.460 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.461 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:45.461 DEBUG:boto:Data: 2024-04-16T18:21:45.461 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.461 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.461 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.461 DEBUG:boto:Params: {} 2024-04-16T18:21:45.461 DEBUG:boto:Token: None 2024-04-16T18:21:45.461 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.461 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tYfP3Ur2ImU8EF4i1ZRWPfXMmcQ= 2024-04-16T18:21:45.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tYfP3Ur2ImU8EF4i1ZRWPfXMmcQ=', 'Content-Length': '0'} 2024-04-16T18:21:45.465 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000026a91695336f7105-00661ec1b9-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.465 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:21:45.465 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.465 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.465 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.465 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.465 DEBUG:boto:Method: GET 2024-04-16T18:21:45.465 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.466 DEBUG:boto:Data: 2024-04-16T18:21:45.466 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.466 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.466 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.466 DEBUG:boto:Params: {} 2024-04-16T18:21:45.466 DEBUG:boto:Token: None 2024-04-16T18:21:45.466 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/?versions 2024-04-16T18:21:45.466 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw= 2024-04-16T18:21:45.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw=', 'Content-Length': '0'} 2024-04-16T18:21:45.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014e6b5bf19b19d4c-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.469 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:21:45.471 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:21:45.472 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:21:45.472 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:21:45.472 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:21:45.472 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:21:45.472 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:21:45.472 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:21:45.472 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.472 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.472 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.472 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.473 DEBUG:boto:Method: GET 2024-04-16T18:21:45.473 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.473 DEBUG:boto:Data: 2024-04-16T18:21:45.473 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.473 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.473 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.473 DEBUG:boto:Params: {} 2024-04-16T18:21:45.473 DEBUG:boto:Token: None 2024-04-16T18:21:45.473 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/?versions 2024-04-16T18:21:45.474 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw= 2024-04-16T18:21:45.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw=', 'Content-Length': '0'} 2024-04-16T18:21:45.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062085ac29cdd7085-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.477 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.477 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:21:45.478 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:21:45.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:21:45.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:21:45.479 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:21:45.479 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.479 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.479 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.479 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.479 DEBUG:boto:Method: GET 2024-04-16T18:21:45.479 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.479 DEBUG:boto:Data: 2024-04-16T18:21:45.480 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.480 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.480 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.480 DEBUG:boto:Params: {} 2024-04-16T18:21:45.480 DEBUG:boto:Token: None 2024-04-16T18:21:45.480 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/?versions 2024-04-16T18:21:45.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw= 2024-04-16T18:21:45.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw=', 'Content-Length': '0'} 2024-04-16T18:21:45.483 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e99abbbdb4e2f90-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.483 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.484 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.484 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.484 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.484 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.485 DEBUG:boto:Method: GET 2024-04-16T18:21:45.485 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:21:45.485 DEBUG:boto:Data: 2024-04-16T18:21:45.485 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.485 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.485 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.485 DEBUG:boto:Params: {} 2024-04-16T18:21:45.485 DEBUG:boto:Token: None 2024-04-16T18:21:45.485 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/?versions 2024-04-16T18:21:45.485 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw= 2024-04-16T18:21:45.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KToBgl6ptH3jcvb5r6qAvbQfhcw=', 'Content-Length': '0'} 2024-04-16T18:21:45.488 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000717f5097750c8ef4-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.489 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.489 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:21:45.490 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.490 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.490 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.490 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.490 DEBUG:boto:Method: GET 2024-04-16T18:21:45.490 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.490 DEBUG:boto:Data: 2024-04-16T18:21:45.490 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.490 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.491 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.491 DEBUG:boto:Params: {} 2024-04-16T18:21:45.491 DEBUG:boto:Token: None 2024-04-16T18:21:45.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec= 2024-04-16T18:21:45.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec=', 'Content-Length': '0'} 2024-04-16T18:21:45.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc4cc207b57cfca6-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.534 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.535 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.535 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.535 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.535 DEBUG:boto:Method: GET 2024-04-16T18:21:45.535 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.535 DEBUG:boto:Data: 2024-04-16T18:21:45.535 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.535 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.535 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.535 DEBUG:boto:Params: {} 2024-04-16T18:21:45.536 DEBUG:boto:Token: None 2024-04-16T18:21:45.536 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec= 2024-04-16T18:21:45.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec=', 'Content-Length': '0'} 2024-04-16T18:21:45.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031c5f6abb073c66c-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.538 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.538 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.538 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.539 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.539 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.539 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.539 DEBUG:boto:Data: 2024-04-16T18:21:45.539 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.539 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.539 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.539 DEBUG:boto:Params: {} 2024-04-16T18:21:45.539 DEBUG:boto:Token: None 2024-04-16T18:21:45.540 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PfnN4fu1/V3VOdAREt1OPUOBM8Y= 2024-04-16T18:21:45.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PfnN4fu1/V3VOdAREt1OPUOBM8Y=', 'Content-Length': '0'} 2024-04-16T18:21:45.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f57a42ea0598e392-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.542 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.542 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.542 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.543 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.543 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.543 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.543 DEBUG:boto:Data: 2024-04-16T18:21:45.543 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.543 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.543 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.543 DEBUG:boto:Params: {} 2024-04-16T18:21:45.543 DEBUG:boto:Token: None 2024-04-16T18:21:45.544 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PfnN4fu1/V3VOdAREt1OPUOBM8Y= 2024-04-16T18:21:45.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PfnN4fu1/V3VOdAREt1OPUOBM8Y=', 'Content-Length': '0'} 2024-04-16T18:21:45.546 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2119f13dd82b028-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.547 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:21:45.547 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.547 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.547 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.547 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.547 DEBUG:boto:Method: GET 2024-04-16T18:21:45.547 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.547 DEBUG:boto:Data: 2024-04-16T18:21:45.547 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.548 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.548 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.548 DEBUG:boto:Params: {} 2024-04-16T18:21:45.548 DEBUG:boto:Token: None 2024-04-16T18:21:45.548 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec= 2024-04-16T18:21:45.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec=', 'Content-Length': '0'} 2024-04-16T18:21:45.551 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1bd8f7ca13b971d-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.551 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.551 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.551 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.551 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.551 DEBUG:boto:Method: GET 2024-04-16T18:21:45.552 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.552 DEBUG:boto:Data: 2024-04-16T18:21:45.552 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.552 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.552 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.552 DEBUG:boto:Params: {} 2024-04-16T18:21:45.552 DEBUG:boto:Token: None 2024-04-16T18:21:45.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:21:45.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec= 2024-04-16T18:21:45.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9MWG1pc/4fqevyxqFl5QoIZNQec=', 'Content-Length': '0'} 2024-04-16T18:21:45.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eed8ec910bc65c0b-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.555 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.555 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.555 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.555 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.556 DEBUG:boto:Method: GET 2024-04-16T18:21:45.556 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.556 DEBUG:boto:Data: 2024-04-16T18:21:45.556 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.556 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.556 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.556 DEBUG:boto:Params: {} 2024-04-16T18:21:45.556 DEBUG:boto:Token: None 2024-04-16T18:21:45.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.557 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.559 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea6658cf210b5b67-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.559 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.559 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.560 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.560 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.560 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.560 DEBUG:boto:Method: GET 2024-04-16T18:21:45.560 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.560 DEBUG:boto:Data: 2024-04-16T18:21:45.560 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.560 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.561 DEBUG:boto:Params: {} 2024-04-16T18:21:45.561 DEBUG:boto:Token: None 2024-04-16T18:21:45.561 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.561 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e0d3aa2f4d48f755-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.564 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.565 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.565 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.565 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.565 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:45.565 DEBUG:boto:Data: 2024-04-16T18:21:45.565 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.565 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.565 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.565 DEBUG:boto:Params: {} 2024-04-16T18:21:45.566 DEBUG:boto:Token: None 2024-04-16T18:21:45.566 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11 2024-04-16T18:21:45.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yhUPHN4Lk+dWGBTk/RkdrQFGygw= 2024-04-16T18:21:45.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yhUPHN4Lk+dWGBTk/RkdrQFGygw=', 'Content-Length': '0'} 2024-04-16T18:21:45.568 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a84b8773cc27fbb3-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.568 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.568 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.569 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.569 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:45.569 DEBUG:boto:Data: 2024-04-16T18:21:45.569 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.569 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.569 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.569 DEBUG:boto:Params: {} 2024-04-16T18:21:45.569 DEBUG:boto:Token: None 2024-04-16T18:21:45.569 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11 2024-04-16T18:21:45.569 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yhUPHN4Lk+dWGBTk/RkdrQFGygw= 2024-04-16T18:21:45.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yhUPHN4Lk+dWGBTk/RkdrQFGygw=', 'Content-Length': '0'} 2024-04-16T18:21:45.572 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6921df00b92466d-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:21:45.572 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.572 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.572 DEBUG:boto:Method: GET 2024-04-16T18:21:45.572 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:45.573 DEBUG:boto:Data: 2024-04-16T18:21:45.573 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.573 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.573 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.573 DEBUG:boto:Params: {} 2024-04-16T18:21:45.573 DEBUG:boto:Token: None 2024-04-16T18:21:45.573 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11 2024-04-16T18:21:45.573 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iUrksAvA7egoW4S/SksLClOmZAc= 2024-04-16T18:21:45.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iUrksAvA7egoW4S/SksLClOmZAc=', 'Content-Length': '0'} 2024-04-16T18:21:45.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c580776dd442e939-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.618 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:21:45.619 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:21:45.619 DEBUG:boto:Method: GET 2024-04-16T18:21:45.619 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:21:45.619 DEBUG:boto:Data: 2024-04-16T18:21:45.619 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.619 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.619 DEBUG:boto:Params: {} 2024-04-16T18:21:45.620 DEBUG:boto:Token: None 2024-04-16T18:21:45.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj11 2024-04-16T18:21:45.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iUrksAvA7egoW4S/SksLClOmZAc= 2024-04-16T18:21:45.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iUrksAvA7egoW4S/SksLClOmZAc=', 'Content-Length': '0'} 2024-04-16T18:21:45.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f460cff82e73424-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.622 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.622 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.623 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.623 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.623 DEBUG:boto:Method: GET 2024-04-16T18:21:45.623 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.623 DEBUG:boto:Data: 2024-04-16T18:21:45.623 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.623 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.623 DEBUG:boto:Params: {} 2024-04-16T18:21:45.623 DEBUG:boto:Token: None 2024-04-16T18:21:45.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cba72d4a6a83986b-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.627 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.627 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.627 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.627 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.627 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.627 DEBUG:boto:Method: GET 2024-04-16T18:21:45.627 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:21:45.627 DEBUG:boto:Data: 2024-04-16T18:21:45.628 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.628 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.628 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.628 DEBUG:boto:Params: {} 2024-04-16T18:21:45.628 DEBUG:boto:Token: None 2024-04-16T18:21:45.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.631 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c093a9c93a94451f-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.631 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:21:45.632 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.632 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.632 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.632 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.632 DEBUG:boto:Method: GET 2024-04-16T18:21:45.632 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.633 DEBUG:boto:Data: 2024-04-16T18:21:45.633 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.633 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.633 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.633 DEBUG:boto:Params: {} 2024-04-16T18:21:45.633 DEBUG:boto:Token: None 2024-04-16T18:21:45.633 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.633 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA= 2024-04-16T18:21:45.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA=', 'Content-Length': '0'} 2024-04-16T18:21:45.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000941b35b23c5a408f-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.678 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.678 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.679 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.679 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.679 DEBUG:boto:Method: GET 2024-04-16T18:21:45.679 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.679 DEBUG:boto:Data: 2024-04-16T18:21:45.679 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.679 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.679 DEBUG:boto:Params: {} 2024-04-16T18:21:45.679 DEBUG:boto:Token: None 2024-04-16T18:21:45.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA= 2024-04-16T18:21:45.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA=', 'Content-Length': '0'} 2024-04-16T18:21:45.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c3db391fcba5f4a-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.682 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.682 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.683 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.683 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.683 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.683 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.683 DEBUG:boto:Data: 2024-04-16T18:21:45.683 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.683 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.683 DEBUG:boto:Params: {} 2024-04-16T18:21:45.683 DEBUG:boto:Token: None 2024-04-16T18:21:45.684 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qM3KU6BNBOhMFAqq7AXOILA0tbg= 2024-04-16T18:21:45.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qM3KU6BNBOhMFAqq7AXOILA0tbg=', 'Content-Length': '0'} 2024-04-16T18:21:45.686 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d79bf4bb2153dcb-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.686 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.686 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.686 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.686 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.686 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.687 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.687 DEBUG:boto:Data: 2024-04-16T18:21:45.687 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.687 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.687 DEBUG:boto:Params: {} 2024-04-16T18:21:45.687 DEBUG:boto:Token: None 2024-04-16T18:21:45.687 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qM3KU6BNBOhMFAqq7AXOILA0tbg= 2024-04-16T18:21:45.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qM3KU6BNBOhMFAqq7AXOILA0tbg=', 'Content-Length': '0'} 2024-04-16T18:21:45.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000067d2eadef12d09a-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.690 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:21:45.690 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.690 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.690 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.690 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.690 DEBUG:boto:Method: GET 2024-04-16T18:21:45.690 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.691 DEBUG:boto:Data: 2024-04-16T18:21:45.691 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.691 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.691 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.691 DEBUG:boto:Params: {} 2024-04-16T18:21:45.691 DEBUG:boto:Token: None 2024-04-16T18:21:45.691 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA= 2024-04-16T18:21:45.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA=', 'Content-Length': '0'} 2024-04-16T18:21:45.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beddbba423203c05-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.734 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.735 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.735 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.735 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.735 DEBUG:boto:Method: GET 2024-04-16T18:21:45.735 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.735 DEBUG:boto:Data: 2024-04-16T18:21:45.735 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.735 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.735 DEBUG:boto:Params: {} 2024-04-16T18:21:45.735 DEBUG:boto:Token: None 2024-04-16T18:21:45.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:21:45.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA= 2024-04-16T18:21:45.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I0xSSoGFIUCo4loUl0brPY8FyhA=', 'Content-Length': '0'} 2024-04-16T18:21:45.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9521d5db6c6b484-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.738 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.739 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.739 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.739 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.739 DEBUG:boto:Method: GET 2024-04-16T18:21:45.739 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.739 DEBUG:boto:Data: 2024-04-16T18:21:45.739 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.739 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.739 DEBUG:boto:Params: {} 2024-04-16T18:21:45.739 DEBUG:boto:Token: None 2024-04-16T18:21:45.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a442726cfbc5902f-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.743 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.743 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.743 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.743 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.743 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.743 DEBUG:boto:Method: GET 2024-04-16T18:21:45.743 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.744 DEBUG:boto:Data: 2024-04-16T18:21:45.744 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.744 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.744 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.744 DEBUG:boto:Params: {} 2024-04-16T18:21:45.744 DEBUG:boto:Token: None 2024-04-16T18:21:45.744 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.747 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002978ff24678a1be3-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.790 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.791 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.791 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.791 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.791 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:45.791 DEBUG:boto:Data: 2024-04-16T18:21:45.791 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.791 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.791 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.791 DEBUG:boto:Params: {} 2024-04-16T18:21:45.792 DEBUG:boto:Token: None 2024-04-16T18:21:45.792 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17 2024-04-16T18:21:45.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uFPKswNy3X1+QZDLK9f5py4uPc8= 2024-04-16T18:21:45.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uFPKswNy3X1+QZDLK9f5py4uPc8=', 'Content-Length': '0'} 2024-04-16T18:21:45.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f28c21ddd1fe578-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.794 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.795 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.795 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.795 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:45.795 DEBUG:boto:Data: 2024-04-16T18:21:45.795 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.795 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.795 DEBUG:boto:Params: {} 2024-04-16T18:21:45.795 DEBUG:boto:Token: None 2024-04-16T18:21:45.796 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17 2024-04-16T18:21:45.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uFPKswNy3X1+QZDLK9f5py4uPc8= 2024-04-16T18:21:45.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uFPKswNy3X1+QZDLK9f5py4uPc8=', 'Content-Length': '0'} 2024-04-16T18:21:45.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1d890689a81eae8-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:21:45.798 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.799 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.799 DEBUG:boto:Method: GET 2024-04-16T18:21:45.799 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:45.799 DEBUG:boto:Data: 2024-04-16T18:21:45.799 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.799 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.799 DEBUG:boto:Params: {} 2024-04-16T18:21:45.799 DEBUG:boto:Token: None 2024-04-16T18:21:45.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17 2024-04-16T18:21:45.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1zVk8HmZWzY6Q7pPHhgnOyJUOd8= 2024-04-16T18:21:45.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1zVk8HmZWzY6Q7pPHhgnOyJUOd8=', 'Content-Length': '0'} 2024-04-16T18:21:45.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce9e7ad6d2aeeb93-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.842 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:21:45.842 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:21:45.843 DEBUG:boto:Method: GET 2024-04-16T18:21:45.843 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:21:45.843 DEBUG:boto:Data: 2024-04-16T18:21:45.843 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.843 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.843 DEBUG:boto:Params: {} 2024-04-16T18:21:45.843 DEBUG:boto:Token: None 2024-04-16T18:21:45.843 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj17 2024-04-16T18:21:45.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1zVk8HmZWzY6Q7pPHhgnOyJUOd8= 2024-04-16T18:21:45.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1zVk8HmZWzY6Q7pPHhgnOyJUOd8=', 'Content-Length': '0'} 2024-04-16T18:21:45.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab9cf3346bd4e7e5-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.846 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.846 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.846 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.846 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.846 DEBUG:boto:Method: GET 2024-04-16T18:21:45.846 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.846 DEBUG:boto:Data: 2024-04-16T18:21:45.846 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.846 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.847 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.847 DEBUG:boto:Params: {} 2024-04-16T18:21:45.847 DEBUG:boto:Token: None 2024-04-16T18:21:45.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b72a17897c38f350-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.890 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.891 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:45.891 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:45.891 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.891 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.891 DEBUG:boto:Method: GET 2024-04-16T18:21:45.891 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:21:45.891 DEBUG:boto:Data: 2024-04-16T18:21:45.891 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.891 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.892 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.892 DEBUG:boto:Params: {} 2024-04-16T18:21:45.892 DEBUG:boto:Token: None 2024-04-16T18:21:45.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/ 2024-04-16T18:21:45.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE= 2024-04-16T18:21:45.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c09LKwB7v9OGjYG2w2x5ePuJSpE=', 'Content-Length': '0'} 2024-04-16T18:21:45.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007133a504a660bd28-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.895 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:45.896 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:21:45.896 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:45.896 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:45.896 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.896 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.896 DEBUG:boto:Method: GET 2024-04-16T18:21:45.896 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.896 DEBUG:boto:Data: 2024-04-16T18:21:45.897 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.897 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.897 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.897 DEBUG:boto:Params: {} 2024-04-16T18:21:45.897 DEBUG:boto:Token: None 2024-04-16T18:21:45.897 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.897 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:abope2xJeKqBSTz52Uw6z9iQoKk= 2024-04-16T18:21:45.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:abope2xJeKqBSTz52Uw6z9iQoKk=', 'Content-Length': '0'} 2024-04-16T18:21:45.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013ea1f700fc3bc73-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.942 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:45.943 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:45.943 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.943 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.943 DEBUG:boto:Method: GET 2024-04-16T18:21:45.943 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.943 DEBUG:boto:Data: 2024-04-16T18:21:45.943 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.943 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.943 DEBUG:boto:Params: {} 2024-04-16T18:21:45.943 DEBUG:boto:Token: None 2024-04-16T18:21:45.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:abope2xJeKqBSTz52Uw6z9iQoKk= 2024-04-16T18:21:45.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:abope2xJeKqBSTz52Uw6z9iQoKk=', 'Content-Length': '0'} 2024-04-16T18:21:45.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a3cca57f11e4478-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.946 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:45.946 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:45.946 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.947 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.947 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.947 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.947 DEBUG:boto:Data: 2024-04-16T18:21:45.947 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.947 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.947 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.947 DEBUG:boto:Params: {} 2024-04-16T18:21:45.947 DEBUG:boto:Token: None 2024-04-16T18:21:45.947 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ls03HjCnFykENc+ZODmDQhYc94U= 2024-04-16T18:21:45.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ls03HjCnFykENc+ZODmDQhYc94U=', 'Content-Length': '0'} 2024-04-16T18:21:45.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c120d8f8a28937eb-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.950 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:45.950 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:45.950 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.950 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.950 DEBUG:boto:Method: HEAD 2024-04-16T18:21:45.950 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.951 DEBUG:boto:Data: 2024-04-16T18:21:45.951 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.951 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.951 DEBUG:boto:Params: {} 2024-04-16T18:21:45.951 DEBUG:boto:Token: None 2024-04-16T18:21:45.951 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ls03HjCnFykENc+ZODmDQhYc94U= 2024-04-16T18:21:45.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ls03HjCnFykENc+ZODmDQhYc94U=', 'Content-Length': '0'} 2024-04-16T18:21:45.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0979aa33ff77227-00661ec1b9-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.953 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:21:45.954 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:45.954 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:45.954 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.954 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.954 DEBUG:boto:Method: GET 2024-04-16T18:21:45.954 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.954 DEBUG:boto:Data: 2024-04-16T18:21:45.954 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.954 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:45.954 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.955 DEBUG:boto:Params: {} 2024-04-16T18:21:45.955 DEBUG:boto:Token: None 2024-04-16T18:21:45.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:45 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:abope2xJeKqBSTz52Uw6z9iQoKk= 2024-04-16T18:21:45.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:abope2xJeKqBSTz52Uw6z9iQoKk=', 'Content-Length': '0'} 2024-04-16T18:21:45.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b7c7e6b26aff89b-00661ec1b9-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:45.998 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:45.999 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:45.999 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.999 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.999 DEBUG:boto:Method: GET 2024-04-16T18:21:45.999 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:45.999 DEBUG:boto:Data: 2024-04-16T18:21:45.999 DEBUG:boto:Headers: {} 2024-04-16T18:21:45.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:45.999 DEBUG:boto:Port: 8000 2024-04-16T18:21:45.999 DEBUG:boto:Params: {} 2024-04-16T18:21:46.000 DEBUG:boto:Token: None 2024-04-16T18:21:46.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:21:46.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jRocv/BmEByNLlAJ7N1jYTMJbrA= 2024-04-16T18:21:46.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jRocv/BmEByNLlAJ7N1jYTMJbrA=', 'Content-Length': '0'} 2024-04-16T18:21:46.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e5672e981cc1b5b-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.002 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.002 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.003 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.003 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.003 DEBUG:boto:Method: GET 2024-04-16T18:21:46.003 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.003 DEBUG:boto:Data: 2024-04-16T18:21:46.003 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.003 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.003 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.003 DEBUG:boto:Params: {} 2024-04-16T18:21:46.003 DEBUG:boto:Token: None 2024-04-16T18:21:46.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b3ef29f9659f9460-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.050 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.051 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.051 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.051 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.051 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.051 DEBUG:boto:Method: GET 2024-04-16T18:21:46.051 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.051 DEBUG:boto:Data: 2024-04-16T18:21:46.051 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.051 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.052 DEBUG:boto:Params: {} 2024-04-16T18:21:46.052 DEBUG:boto:Token: None 2024-04-16T18:21:46.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.055 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b1c0a676f6eb858-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.055 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.055 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:46.055 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:46.056 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.056 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:21:46.056 DEBUG:boto:Data: 2024-04-16T18:21:46.056 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.056 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.056 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.056 DEBUG:boto:Params: {} 2024-04-16T18:21:46.056 DEBUG:boto:Token: None 2024-04-16T18:21:46.056 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj19 2024-04-16T18:21:46.057 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9EJ1OgSs08KwTIKj9bmrZS4/R4g= 2024-04-16T18:21:46.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9EJ1OgSs08KwTIKj9bmrZS4/R4g=', 'Content-Length': '0'} 2024-04-16T18:21:46.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d2e02f63ad1c0ce-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.059 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:46.059 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:46.059 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.059 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:21:46.059 DEBUG:boto:Data: 2024-04-16T18:21:46.059 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.060 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.060 DEBUG:boto:Params: {} 2024-04-16T18:21:46.060 DEBUG:boto:Token: None 2024-04-16T18:21:46.060 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj19 2024-04-16T18:21:46.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9EJ1OgSs08KwTIKj9bmrZS4/R4g= 2024-04-16T18:21:46.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9EJ1OgSs08KwTIKj9bmrZS4/R4g=', 'Content-Length': '0'} 2024-04-16T18:21:46.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098f4975be02a3d07-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.062 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:21:46.062 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:46.062 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:46.063 DEBUG:boto:Method: GET 2024-04-16T18:21:46.063 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:21:46.063 DEBUG:boto:Data: 2024-04-16T18:21:46.063 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.063 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.063 DEBUG:boto:Params: {} 2024-04-16T18:21:46.063 DEBUG:boto:Token: None 2024-04-16T18:21:46.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj19 2024-04-16T18:21:46.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ekoMzvIiuhptlcKDkStmcSfr2TM= 2024-04-16T18:21:46.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ekoMzvIiuhptlcKDkStmcSfr2TM=', 'Content-Length': '0'} 2024-04-16T18:21:46.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e15d0f6fc3d7ef7-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.106 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:21:46.107 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:21:46.107 DEBUG:boto:Method: GET 2024-04-16T18:21:46.107 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:21:46.107 DEBUG:boto:Data: 2024-04-16T18:21:46.107 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.107 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.107 DEBUG:boto:Params: {} 2024-04-16T18:21:46.107 DEBUG:boto:Token: None 2024-04-16T18:21:46.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj19 2024-04-16T18:21:46.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ekoMzvIiuhptlcKDkStmcSfr2TM= 2024-04-16T18:21:46.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ekoMzvIiuhptlcKDkStmcSfr2TM=', 'Content-Length': '0'} 2024-04-16T18:21:46.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f51a37fc443e3209-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.110 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.110 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.110 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.110 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.110 DEBUG:boto:Method: GET 2024-04-16T18:21:46.111 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.111 DEBUG:boto:Data: 2024-04-16T18:21:46.111 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.111 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.111 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.111 DEBUG:boto:Params: {} 2024-04-16T18:21:46.111 DEBUG:boto:Token: None 2024-04-16T18:21:46.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008627aee295f8ca1f-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.154 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.155 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.155 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.155 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.155 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.155 DEBUG:boto:Method: GET 2024-04-16T18:21:46.155 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:21:46.155 DEBUG:boto:Data: 2024-04-16T18:21:46.155 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.155 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.155 DEBUG:boto:Params: {} 2024-04-16T18:21:46.156 DEBUG:boto:Token: None 2024-04-16T18:21:46.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.159 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fa1ab1bc74aea8aa-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.159 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.159 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:21:46.160 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.160 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.160 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.160 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.160 DEBUG:boto:Method: GET 2024-04-16T18:21:46.160 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.160 DEBUG:boto:Data: 2024-04-16T18:21:46.160 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.160 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.160 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.160 DEBUG:boto:Params: {} 2024-04-16T18:21:46.161 DEBUG:boto:Token: None 2024-04-16T18:21:46.161 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.161 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw= 2024-04-16T18:21:46.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw=', 'Content-Length': '0'} 2024-04-16T18:21:46.163 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d363e8313ab5dc21-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.206 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.207 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.207 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.207 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.207 DEBUG:boto:Method: GET 2024-04-16T18:21:46.207 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.207 DEBUG:boto:Data: 2024-04-16T18:21:46.207 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.207 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.208 DEBUG:boto:Params: {} 2024-04-16T18:21:46.208 DEBUG:boto:Token: None 2024-04-16T18:21:46.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw= 2024-04-16T18:21:46.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw=', 'Content-Length': '0'} 2024-04-16T18:21:46.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ec3c491d22e4be1-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.210 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.211 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.211 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.211 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.211 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.211 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.211 DEBUG:boto:Data: 2024-04-16T18:21:46.211 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.211 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.211 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.211 DEBUG:boto:Params: {} 2024-04-16T18:21:46.211 DEBUG:boto:Token: None 2024-04-16T18:21:46.212 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X74qcJUNO06Bw750Bnllj+eazmM= 2024-04-16T18:21:46.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X74qcJUNO06Bw750Bnllj+eazmM=', 'Content-Length': '0'} 2024-04-16T18:21:46.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000302bd472da62f6f3-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.214 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.214 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.214 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.214 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.214 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.214 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.214 DEBUG:boto:Data: 2024-04-16T18:21:46.214 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.214 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.215 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.215 DEBUG:boto:Params: {} 2024-04-16T18:21:46.215 DEBUG:boto:Token: None 2024-04-16T18:21:46.215 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.215 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X74qcJUNO06Bw750Bnllj+eazmM= 2024-04-16T18:21:46.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X74qcJUNO06Bw750Bnllj+eazmM=', 'Content-Length': '0'} 2024-04-16T18:21:46.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a09a70f07472274c-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.217 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:21:46.217 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.218 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.218 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.218 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.218 DEBUG:boto:Method: GET 2024-04-16T18:21:46.218 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.218 DEBUG:boto:Data: 2024-04-16T18:21:46.218 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.218 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.218 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.218 DEBUG:boto:Params: {} 2024-04-16T18:21:46.218 DEBUG:boto:Token: None 2024-04-16T18:21:46.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw= 2024-04-16T18:21:46.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw=', 'Content-Length': '0'} 2024-04-16T18:21:46.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca1299496dd44b82-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.262 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.262 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.263 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.263 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.263 DEBUG:boto:Method: GET 2024-04-16T18:21:46.263 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.263 DEBUG:boto:Data: 2024-04-16T18:21:46.263 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.263 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.263 DEBUG:boto:Params: {} 2024-04-16T18:21:46.263 DEBUG:boto:Token: None 2024-04-16T18:21:46.264 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:21:46.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw= 2024-04-16T18:21:46.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVnQHrYNAfJ7IbUuJ7OuFuwrYDw=', 'Content-Length': '0'} 2024-04-16T18:21:46.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7e2e57f230a13b3-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.266 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.266 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.266 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.266 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.267 DEBUG:boto:Method: GET 2024-04-16T18:21:46.267 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.267 DEBUG:boto:Data: 2024-04-16T18:21:46.267 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.267 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.267 DEBUG:boto:Params: {} 2024-04-16T18:21:46.267 DEBUG:boto:Token: None 2024-04-16T18:21:46.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000feeb115579d59ad4-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.314 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.315 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.315 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.315 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.315 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.315 DEBUG:boto:Method: GET 2024-04-16T18:21:46.315 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.315 DEBUG:boto:Data: 2024-04-16T18:21:46.315 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.316 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.316 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.316 DEBUG:boto:Params: {} 2024-04-16T18:21:46.316 DEBUG:boto:Token: None 2024-04-16T18:21:46.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.319 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091dfd23db34a9f72-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.319 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.320 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.320 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.320 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.320 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:46.320 DEBUG:boto:Data: 2024-04-16T18:21:46.320 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.320 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.320 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.321 DEBUG:boto:Params: {} 2024-04-16T18:21:46.321 DEBUG:boto:Token: None 2024-04-16T18:21:46.321 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22 2024-04-16T18:21:46.321 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JfzmcZkkKWuVW/YaR3qUnPqvg7s= 2024-04-16T18:21:46.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JfzmcZkkKWuVW/YaR3qUnPqvg7s=', 'Content-Length': '0'} 2024-04-16T18:21:46.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cdb0eccffe564799-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.323 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.323 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.324 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.324 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:46.324 DEBUG:boto:Data: 2024-04-16T18:21:46.324 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.324 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.324 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.324 DEBUG:boto:Params: {} 2024-04-16T18:21:46.324 DEBUG:boto:Token: None 2024-04-16T18:21:46.324 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22 2024-04-16T18:21:46.325 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JfzmcZkkKWuVW/YaR3qUnPqvg7s= 2024-04-16T18:21:46.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JfzmcZkkKWuVW/YaR3qUnPqvg7s=', 'Content-Length': '0'} 2024-04-16T18:21:46.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c694f1039e65d1b1-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:21:46.327 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.327 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.327 DEBUG:boto:Method: GET 2024-04-16T18:21:46.327 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:46.327 DEBUG:boto:Data: 2024-04-16T18:21:46.327 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.327 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.328 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.328 DEBUG:boto:Params: {} 2024-04-16T18:21:46.328 DEBUG:boto:Token: None 2024-04-16T18:21:46.328 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22 2024-04-16T18:21:46.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jocQWqi7RodgYsVSvgjr5Pfq1fE= 2024-04-16T18:21:46.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jocQWqi7RodgYsVSvgjr5Pfq1fE=', 'Content-Length': '0'} 2024-04-16T18:21:46.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a453c614de96752b-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.370 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:21:46.371 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:21:46.371 DEBUG:boto:Method: GET 2024-04-16T18:21:46.371 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:21:46.371 DEBUG:boto:Data: 2024-04-16T18:21:46.371 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.371 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.371 DEBUG:boto:Params: {} 2024-04-16T18:21:46.371 DEBUG:boto:Token: None 2024-04-16T18:21:46.372 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj22 2024-04-16T18:21:46.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jocQWqi7RodgYsVSvgjr5Pfq1fE= 2024-04-16T18:21:46.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jocQWqi7RodgYsVSvgjr5Pfq1fE=', 'Content-Length': '0'} 2024-04-16T18:21:46.374 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018b58d9c8bf25fbb-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.374 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.374 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.374 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.374 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.375 DEBUG:boto:Method: GET 2024-04-16T18:21:46.375 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.375 DEBUG:boto:Data: 2024-04-16T18:21:46.375 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.375 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.375 DEBUG:boto:Params: {} 2024-04-16T18:21:46.375 DEBUG:boto:Token: None 2024-04-16T18:21:46.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.378 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b57644e7f977779-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.418 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.419 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.419 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.419 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.419 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.419 DEBUG:boto:Method: GET 2024-04-16T18:21:46.419 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:21:46.419 DEBUG:boto:Data: 2024-04-16T18:21:46.420 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.420 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.420 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.420 DEBUG:boto:Params: {} 2024-04-16T18:21:46.420 DEBUG:boto:Token: None 2024-04-16T18:21:46.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.423 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000296846b0d4516e49-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.423 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:21:46.424 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.424 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.424 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.424 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.424 DEBUG:boto:Method: GET 2024-04-16T18:21:46.424 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.425 DEBUG:boto:Data: 2024-04-16T18:21:46.425 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.425 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.425 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.425 DEBUG:boto:Params: {} 2024-04-16T18:21:46.425 DEBUG:boto:Token: None 2024-04-16T18:21:46.425 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.425 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c= 2024-04-16T18:21:46.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c=', 'Content-Length': '0'} 2024-04-16T18:21:46.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d897540c0bd3c45-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.470 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.471 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.471 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.471 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.471 DEBUG:boto:Method: GET 2024-04-16T18:21:46.471 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.471 DEBUG:boto:Data: 2024-04-16T18:21:46.471 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.471 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.472 DEBUG:boto:Params: {} 2024-04-16T18:21:46.472 DEBUG:boto:Token: None 2024-04-16T18:21:46.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c= 2024-04-16T18:21:46.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c=', 'Content-Length': '0'} 2024-04-16T18:21:46.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001aca3266363d6242-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.475 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.475 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.475 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.475 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.475 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.475 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.476 DEBUG:boto:Data: 2024-04-16T18:21:46.476 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.476 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.476 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.476 DEBUG:boto:Params: {} 2024-04-16T18:21:46.476 DEBUG:boto:Token: None 2024-04-16T18:21:46.476 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:53d99Ask+mcvFzjwKb1MGwpR05E= 2024-04-16T18:21:46.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:53d99Ask+mcvFzjwKb1MGwpR05E=', 'Content-Length': '0'} 2024-04-16T18:21:46.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8d1304958300a73-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.479 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.479 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.479 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.480 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.480 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.480 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.480 DEBUG:boto:Data: 2024-04-16T18:21:46.480 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.480 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.480 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.480 DEBUG:boto:Params: {} 2024-04-16T18:21:46.480 DEBUG:boto:Token: None 2024-04-16T18:21:46.481 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.481 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:53d99Ask+mcvFzjwKb1MGwpR05E= 2024-04-16T18:21:46.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:53d99Ask+mcvFzjwKb1MGwpR05E=', 'Content-Length': '0'} 2024-04-16T18:21:46.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8cc081a93235606-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.483 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:21:46.483 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.484 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.484 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.484 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.484 DEBUG:boto:Method: GET 2024-04-16T18:21:46.484 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.484 DEBUG:boto:Data: 2024-04-16T18:21:46.484 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.484 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.484 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.484 DEBUG:boto:Params: {} 2024-04-16T18:21:46.485 DEBUG:boto:Token: None 2024-04-16T18:21:46.485 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.485 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c= 2024-04-16T18:21:46.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c=', 'Content-Length': '0'} 2024-04-16T18:21:46.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0c47ab5c399af2e-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.531 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.531 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.531 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.531 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.531 DEBUG:boto:Method: GET 2024-04-16T18:21:46.531 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.531 DEBUG:boto:Data: 2024-04-16T18:21:46.532 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.532 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.532 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.532 DEBUG:boto:Params: {} 2024-04-16T18:21:46.532 DEBUG:boto:Token: None 2024-04-16T18:21:46.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:21:46.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c= 2024-04-16T18:21:46.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eBS4a2IvHHecGQhtOEaKv4zTP/c=', 'Content-Length': '0'} 2024-04-16T18:21:46.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bef41cfe1d7ca9c-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.535 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.535 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.535 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.535 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.536 DEBUG:boto:Method: GET 2024-04-16T18:21:46.536 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.536 DEBUG:boto:Data: 2024-04-16T18:21:46.536 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.536 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.536 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.536 DEBUG:boto:Params: {} 2024-04-16T18:21:46.536 DEBUG:boto:Token: None 2024-04-16T18:21:46.537 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.539 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014e8d371af80cc0d-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.540 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.540 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.540 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.540 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.540 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.541 DEBUG:boto:Method: GET 2024-04-16T18:21:46.541 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.541 DEBUG:boto:Data: 2024-04-16T18:21:46.541 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.541 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.541 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.541 DEBUG:boto:Params: {} 2024-04-16T18:21:46.541 DEBUG:boto:Token: None 2024-04-16T18:21:46.541 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.542 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.542 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.545 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008619cee678581739-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.545 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.545 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.545 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.546 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.546 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:46.546 DEBUG:boto:Data: 2024-04-16T18:21:46.546 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.546 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.546 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.546 DEBUG:boto:Params: {} 2024-04-16T18:21:46.546 DEBUG:boto:Token: None 2024-04-16T18:21:46.547 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33 2024-04-16T18:21:46.547 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AVwI2/GZ2lXjuEst8Zf2K8piipg= 2024-04-16T18:21:46.547 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AVwI2/GZ2lXjuEst8Zf2K8piipg=', 'Content-Length': '0'} 2024-04-16T18:21:46.549 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1e8e1cd98e03194-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.549 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.549 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.549 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.550 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:46.550 DEBUG:boto:Data: 2024-04-16T18:21:46.550 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.550 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.550 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.550 DEBUG:boto:Params: {} 2024-04-16T18:21:46.550 DEBUG:boto:Token: None 2024-04-16T18:21:46.550 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33 2024-04-16T18:21:46.551 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AVwI2/GZ2lXjuEst8Zf2K8piipg= 2024-04-16T18:21:46.551 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AVwI2/GZ2lXjuEst8Zf2K8piipg=', 'Content-Length': '0'} 2024-04-16T18:21:46.553 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001567e5905a81a4e0-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:21:46.553 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.553 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.553 DEBUG:boto:Method: GET 2024-04-16T18:21:46.554 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:46.554 DEBUG:boto:Data: 2024-04-16T18:21:46.554 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.554 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.554 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.554 DEBUG:boto:Params: {} 2024-04-16T18:21:46.554 DEBUG:boto:Token: None 2024-04-16T18:21:46.554 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33 2024-04-16T18:21:46.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d19B6sW0zQgFJH0cMESw7ntv6p8= 2024-04-16T18:21:46.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d19B6sW0zQgFJH0cMESw7ntv6p8=', 'Content-Length': '0'} 2024-04-16T18:21:46.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005637bfa0f32e2692-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.598 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:21:46.599 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:21:46.599 DEBUG:boto:Method: GET 2024-04-16T18:21:46.599 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:21:46.599 DEBUG:boto:Data: 2024-04-16T18:21:46.599 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.599 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.599 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.599 DEBUG:boto:Params: {} 2024-04-16T18:21:46.599 DEBUG:boto:Token: None 2024-04-16T18:21:46.600 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj33 2024-04-16T18:21:46.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d19B6sW0zQgFJH0cMESw7ntv6p8= 2024-04-16T18:21:46.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d19B6sW0zQgFJH0cMESw7ntv6p8=', 'Content-Length': '0'} 2024-04-16T18:21:46.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b442681016750ab6-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.602 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.603 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.603 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.603 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.603 DEBUG:boto:Method: GET 2024-04-16T18:21:46.603 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.603 DEBUG:boto:Data: 2024-04-16T18:21:46.603 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.603 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.603 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.604 DEBUG:boto:Params: {} 2024-04-16T18:21:46.604 DEBUG:boto:Token: None 2024-04-16T18:21:46.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008236b3fea1ed942c-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.650 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.651 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.651 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.651 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.651 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.652 DEBUG:boto:Method: GET 2024-04-16T18:21:46.652 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:21:46.652 DEBUG:boto:Data: 2024-04-16T18:21:46.652 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.652 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.652 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.652 DEBUG:boto:Params: {} 2024-04-16T18:21:46.652 DEBUG:boto:Token: None 2024-04-16T18:21:46.653 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.653 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.653 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.656 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6034c5fad0cb02c-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.656 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.656 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:21:46.656 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.657 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.657 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.657 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.657 DEBUG:boto:Method: GET 2024-04-16T18:21:46.657 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.657 DEBUG:boto:Data: 2024-04-16T18:21:46.657 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.657 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.657 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.658 DEBUG:boto:Params: {} 2024-04-16T18:21:46.658 DEBUG:boto:Token: None 2024-04-16T18:21:46.658 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.658 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA= 2024-04-16T18:21:46.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA=', 'Content-Length': '0'} 2024-04-16T18:21:46.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000604d2f055560d177-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.702 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.703 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.703 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.703 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.703 DEBUG:boto:Method: GET 2024-04-16T18:21:46.703 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.703 DEBUG:boto:Data: 2024-04-16T18:21:46.703 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.704 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.704 DEBUG:boto:Params: {} 2024-04-16T18:21:46.704 DEBUG:boto:Token: None 2024-04-16T18:21:46.704 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA= 2024-04-16T18:21:46.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA=', 'Content-Length': '0'} 2024-04-16T18:21:46.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002bcd9936ded61f2-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.707 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.707 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.707 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.707 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.707 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.708 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.708 DEBUG:boto:Data: 2024-04-16T18:21:46.708 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.708 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.708 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.708 DEBUG:boto:Params: {} 2024-04-16T18:21:46.708 DEBUG:boto:Token: None 2024-04-16T18:21:46.708 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.709 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RlcaPIm2iRZaYDJXH/Uu4r/3Wko= 2024-04-16T18:21:46.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RlcaPIm2iRZaYDJXH/Uu4r/3Wko=', 'Content-Length': '0'} 2024-04-16T18:21:46.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa12229c10f7a7bc-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.711 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.711 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.711 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.712 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.712 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.712 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.712 DEBUG:boto:Data: 2024-04-16T18:21:46.712 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.712 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.712 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.712 DEBUG:boto:Params: {} 2024-04-16T18:21:46.712 DEBUG:boto:Token: None 2024-04-16T18:21:46.713 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.713 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RlcaPIm2iRZaYDJXH/Uu4r/3Wko= 2024-04-16T18:21:46.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RlcaPIm2iRZaYDJXH/Uu4r/3Wko=', 'Content-Length': '0'} 2024-04-16T18:21:46.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a4ac9c47edf9592-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.715 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:21:46.715 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.715 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.716 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.716 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.716 DEBUG:boto:Method: GET 2024-04-16T18:21:46.716 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.716 DEBUG:boto:Data: 2024-04-16T18:21:46.716 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.716 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.716 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.716 DEBUG:boto:Params: {} 2024-04-16T18:21:46.717 DEBUG:boto:Token: None 2024-04-16T18:21:46.717 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.717 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA= 2024-04-16T18:21:46.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA=', 'Content-Length': '0'} 2024-04-16T18:21:46.719 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082e08e363db10f65-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.762 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.763 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.763 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.763 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.763 DEBUG:boto:Method: GET 2024-04-16T18:21:46.763 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.763 DEBUG:boto:Data: 2024-04-16T18:21:46.763 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.764 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.764 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.764 DEBUG:boto:Params: {} 2024-04-16T18:21:46.764 DEBUG:boto:Token: None 2024-04-16T18:21:46.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:21:46.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA= 2024-04-16T18:21:46.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LWijy8yWRDGtGs13quN94u/R2cA=', 'Content-Length': '0'} 2024-04-16T18:21:46.766 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061d7af82a72a2fd3-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.767 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.767 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.767 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.767 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.767 DEBUG:boto:Method: GET 2024-04-16T18:21:46.767 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.767 DEBUG:boto:Data: 2024-04-16T18:21:46.768 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.768 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.768 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.768 DEBUG:boto:Params: {} 2024-04-16T18:21:46.768 DEBUG:boto:Token: None 2024-04-16T18:21:46.768 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.771 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024b816cbd0e16248-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.771 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.772 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.772 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.772 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.772 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.772 DEBUG:boto:Method: GET 2024-04-16T18:21:46.772 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.773 DEBUG:boto:Data: 2024-04-16T18:21:46.773 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.773 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.773 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.773 DEBUG:boto:Params: {} 2024-04-16T18:21:46.773 DEBUG:boto:Token: None 2024-04-16T18:21:46.773 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.773 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.774 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.776 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bb251e3c17368024-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.777 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.777 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.777 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.777 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.778 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:46.778 DEBUG:boto:Data: 2024-04-16T18:21:46.778 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.778 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.778 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.778 DEBUG:boto:Params: {} 2024-04-16T18:21:46.778 DEBUG:boto:Token: None 2024-04-16T18:21:46.778 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34 2024-04-16T18:21:46.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8GkAfWUvuWxqAdub1nvkHnXmTyE= 2024-04-16T18:21:46.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8GkAfWUvuWxqAdub1nvkHnXmTyE=', 'Content-Length': '0'} 2024-04-16T18:21:46.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b35694c6a52b5a05-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.781 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.781 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.782 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.782 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:46.782 DEBUG:boto:Data: 2024-04-16T18:21:46.782 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.782 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.782 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.782 DEBUG:boto:Params: {} 2024-04-16T18:21:46.782 DEBUG:boto:Token: None 2024-04-16T18:21:46.783 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34 2024-04-16T18:21:46.783 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8GkAfWUvuWxqAdub1nvkHnXmTyE= 2024-04-16T18:21:46.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8GkAfWUvuWxqAdub1nvkHnXmTyE=', 'Content-Length': '0'} 2024-04-16T18:21:46.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd4d54caeac1c6c1-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.785 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:21:46.785 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.785 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.785 DEBUG:boto:Method: GET 2024-04-16T18:21:46.785 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:46.786 DEBUG:boto:Data: 2024-04-16T18:21:46.786 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.786 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.786 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.786 DEBUG:boto:Params: {} 2024-04-16T18:21:46.786 DEBUG:boto:Token: None 2024-04-16T18:21:46.786 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34 2024-04-16T18:21:46.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zpTG8JmLJid4l8pgOAVaoSDslro= 2024-04-16T18:21:46.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zpTG8JmLJid4l8pgOAVaoSDslro=', 'Content-Length': '0'} 2024-04-16T18:21:46.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000739b89d682805a54-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.830 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:21:46.831 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:21:46.831 DEBUG:boto:Method: GET 2024-04-16T18:21:46.831 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:21:46.831 DEBUG:boto:Data: 2024-04-16T18:21:46.831 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.831 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.832 DEBUG:boto:Params: {} 2024-04-16T18:21:46.832 DEBUG:boto:Token: None 2024-04-16T18:21:46.832 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj34 2024-04-16T18:21:46.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zpTG8JmLJid4l8pgOAVaoSDslro= 2024-04-16T18:21:46.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zpTG8JmLJid4l8pgOAVaoSDslro=', 'Content-Length': '0'} 2024-04-16T18:21:46.834 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba6bc9e80b7ce178-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.835 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.835 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.835 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.835 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.835 DEBUG:boto:Method: GET 2024-04-16T18:21:46.835 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.836 DEBUG:boto:Data: 2024-04-16T18:21:46.836 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.836 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.836 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.836 DEBUG:boto:Params: {} 2024-04-16T18:21:46.836 DEBUG:boto:Token: None 2024-04-16T18:21:46.836 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.837 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.839 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058dff0a748e2a8ad-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.882 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.883 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.883 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.883 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.883 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.883 DEBUG:boto:Method: GET 2024-04-16T18:21:46.883 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:21:46.884 DEBUG:boto:Data: 2024-04-16T18:21:46.884 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.884 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.884 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.884 DEBUG:boto:Params: {} 2024-04-16T18:21:46.884 DEBUG:boto:Token: None 2024-04-16T18:21:46.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/ 2024-04-16T18:21:46.885 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g= 2024-04-16T18:21:46.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jkwEMG18oAN644TTAM5C15V9w6g=', 'Content-Length': '0'} 2024-04-16T18:21:46.888 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da49cbd7dca7e4d5-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.888 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:46.888 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:21:46.889 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:46.889 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:46.889 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.889 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.889 DEBUG:boto:Method: GET 2024-04-16T18:21:46.889 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.889 DEBUG:boto:Data: 2024-04-16T18:21:46.889 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.890 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.890 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.890 DEBUG:boto:Params: {} 2024-04-16T18:21:46.890 DEBUG:boto:Token: None 2024-04-16T18:21:46.890 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.890 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo= 2024-04-16T18:21:46.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo=', 'Content-Length': '0'} 2024-04-16T18:21:46.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2ae9fd56247ed38-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.934 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:46.935 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:46.935 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.935 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.935 DEBUG:boto:Method: GET 2024-04-16T18:21:46.935 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.935 DEBUG:boto:Data: 2024-04-16T18:21:46.935 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.936 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.936 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.936 DEBUG:boto:Params: {} 2024-04-16T18:21:46.936 DEBUG:boto:Token: None 2024-04-16T18:21:46.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo= 2024-04-16T18:21:46.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo=', 'Content-Length': '0'} 2024-04-16T18:21:46.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5a99a732d133bf3-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.939 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:46.939 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:46.940 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.940 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.940 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.940 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.940 DEBUG:boto:Data: 2024-04-16T18:21:46.940 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.940 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.940 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.941 DEBUG:boto:Params: {} 2024-04-16T18:21:46.941 DEBUG:boto:Token: None 2024-04-16T18:21:46.941 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.941 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LO+7U3QElsvteMHYoF6oaICeUxY= 2024-04-16T18:21:46.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LO+7U3QElsvteMHYoF6oaICeUxY=', 'Content-Length': '0'} 2024-04-16T18:21:46.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fdc46b36ddaacb7-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.944 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:46.944 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:46.944 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.944 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.944 DEBUG:boto:Method: HEAD 2024-04-16T18:21:46.945 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.945 DEBUG:boto:Data: 2024-04-16T18:21:46.945 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.945 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.945 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.945 DEBUG:boto:Params: {} 2024-04-16T18:21:46.945 DEBUG:boto:Token: None 2024-04-16T18:21:46.945 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.946 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LO+7U3QElsvteMHYoF6oaICeUxY= 2024-04-16T18:21:46.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LO+7U3QElsvteMHYoF6oaICeUxY=', 'Content-Length': '0'} 2024-04-16T18:21:46.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d65934799badb07-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:21:46.948 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:46.948 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:46.949 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.949 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.949 DEBUG:boto:Method: GET 2024-04-16T18:21:46.949 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.949 DEBUG:boto:Data: 2024-04-16T18:21:46.949 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.949 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:46.949 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.950 DEBUG:boto:Params: {} 2024-04-16T18:21:46.950 DEBUG:boto:Token: None 2024-04-16T18:21:46.950 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo= 2024-04-16T18:21:46.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo=', 'Content-Length': '0'} 2024-04-16T18:21:46.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3b80ff78362f92a-00661ec1ba-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.995 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:46.995 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:46.995 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.995 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.995 DEBUG:boto:Method: GET 2024-04-16T18:21:46.995 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.995 DEBUG:boto:Data: 2024-04-16T18:21:46.996 DEBUG:boto:Headers: {} 2024-04-16T18:21:46.996 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:46.996 DEBUG:boto:Port: 8000 2024-04-16T18:21:46.996 DEBUG:boto:Params: {} 2024-04-16T18:21:46.996 DEBUG:boto:Token: None 2024-04-16T18:21:46.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:46 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:21:46.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo= 2024-04-16T18:21:46.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yDY11DTWBnDNV7XVkYG4BUhSLfo=', 'Content-Length': '0'} 2024-04-16T18:21:46.999 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c2cc4098d43f2fb-00661ec1ba-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:46.999 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:46.999 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:46.999 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.000 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.000 DEBUG:boto:Method: GET 2024-04-16T18:21:47.000 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.000 DEBUG:boto:Data: 2024-04-16T18:21:47.000 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.000 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.000 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.000 DEBUG:boto:Params: {} 2024-04-16T18:21:47.001 DEBUG:boto:Token: None 2024-04-16T18:21:47.001 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092b7b7c16c258478-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.004 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.005 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.005 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.005 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.005 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.005 DEBUG:boto:Method: GET 2024-04-16T18:21:47.005 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.006 DEBUG:boto:Data: 2024-04-16T18:21:47.006 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.006 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.006 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.006 DEBUG:boto:Params: {} 2024-04-16T18:21:47.006 DEBUG:boto:Token: None 2024-04-16T18:21:47.006 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc46bf8bc07b22d8-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.010 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.011 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:47.011 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:47.011 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.011 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:21:47.011 DEBUG:boto:Data: 2024-04-16T18:21:47.011 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.011 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.011 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.012 DEBUG:boto:Params: {} 2024-04-16T18:21:47.012 DEBUG:boto:Token: None 2024-04-16T18:21:47.012 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj38 2024-04-16T18:21:47.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AhHKlf08FLmubnbB6AGP2zIxRbg= 2024-04-16T18:21:47.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AhHKlf08FLmubnbB6AGP2zIxRbg=', 'Content-Length': '0'} 2024-04-16T18:21:47.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018f61fdb2972e334-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.015 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:47.015 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:47.015 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.015 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:21:47.015 DEBUG:boto:Data: 2024-04-16T18:21:47.015 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.015 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.016 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.016 DEBUG:boto:Params: {} 2024-04-16T18:21:47.016 DEBUG:boto:Token: None 2024-04-16T18:21:47.016 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj38 2024-04-16T18:21:47.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AhHKlf08FLmubnbB6AGP2zIxRbg= 2024-04-16T18:21:47.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AhHKlf08FLmubnbB6AGP2zIxRbg=', 'Content-Length': '0'} 2024-04-16T18:21:47.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023635992118e41cc-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:21:47.019 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:47.019 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:47.019 DEBUG:boto:Method: GET 2024-04-16T18:21:47.019 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:21:47.019 DEBUG:boto:Data: 2024-04-16T18:21:47.019 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.020 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.020 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.020 DEBUG:boto:Params: {} 2024-04-16T18:21:47.020 DEBUG:boto:Token: None 2024-04-16T18:21:47.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj38 2024-04-16T18:21:47.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3rcWgYePm9ZzxJHOHOTr7258suk= 2024-04-16T18:21:47.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3rcWgYePm9ZzxJHOHOTr7258suk=', 'Content-Length': '0'} 2024-04-16T18:21:47.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000592eb8752fe6d48a-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.066 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:21:47.067 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:21:47.067 DEBUG:boto:Method: GET 2024-04-16T18:21:47.067 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:21:47.067 DEBUG:boto:Data: 2024-04-16T18:21:47.067 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.067 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.067 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.068 DEBUG:boto:Params: {} 2024-04-16T18:21:47.068 DEBUG:boto:Token: None 2024-04-16T18:21:47.068 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj38 2024-04-16T18:21:47.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3rcWgYePm9ZzxJHOHOTr7258suk= 2024-04-16T18:21:47.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3rcWgYePm9ZzxJHOHOTr7258suk=', 'Content-Length': '0'} 2024-04-16T18:21:47.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f2f6a5fa723ef54-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.071 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.071 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.071 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.072 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.072 DEBUG:boto:Method: GET 2024-04-16T18:21:47.072 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.072 DEBUG:boto:Data: 2024-04-16T18:21:47.072 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.072 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.072 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.072 DEBUG:boto:Params: {} 2024-04-16T18:21:47.073 DEBUG:boto:Token: None 2024-04-16T18:21:47.073 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.073 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092b4816ac6698bf4-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.122 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.123 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.123 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.123 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.123 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.123 DEBUG:boto:Method: GET 2024-04-16T18:21:47.124 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:21:47.124 DEBUG:boto:Data: 2024-04-16T18:21:47.124 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.124 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.124 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.124 DEBUG:boto:Params: {} 2024-04-16T18:21:47.124 DEBUG:boto:Token: None 2024-04-16T18:21:47.124 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.125 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.125 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.128 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b50eca67e7dc80f8-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.128 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.129 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:21:47.129 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.129 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.129 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.129 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.129 DEBUG:boto:Method: GET 2024-04-16T18:21:47.130 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.130 DEBUG:boto:Data: 2024-04-16T18:21:47.130 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.130 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.130 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.130 DEBUG:boto:Params: {} 2024-04-16T18:21:47.130 DEBUG:boto:Token: None 2024-04-16T18:21:47.131 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE= 2024-04-16T18:21:47.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE=', 'Content-Length': '0'} 2024-04-16T18:21:47.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a916540e4d7a30ac-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.175 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.175 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.175 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.175 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.175 DEBUG:boto:Method: GET 2024-04-16T18:21:47.175 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.176 DEBUG:boto:Data: 2024-04-16T18:21:47.176 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.176 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.176 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.176 DEBUG:boto:Params: {} 2024-04-16T18:21:47.176 DEBUG:boto:Token: None 2024-04-16T18:21:47.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.177 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE= 2024-04-16T18:21:47.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE=', 'Content-Length': '0'} 2024-04-16T18:21:47.179 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001adf65631575967a-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.180 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.180 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.180 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.180 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.180 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.180 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.180 DEBUG:boto:Data: 2024-04-16T18:21:47.181 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.181 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.181 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.181 DEBUG:boto:Params: {} 2024-04-16T18:21:47.181 DEBUG:boto:Token: None 2024-04-16T18:21:47.181 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qKJIwkL7MlzLoJjghsNBifar36o= 2024-04-16T18:21:47.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qKJIwkL7MlzLoJjghsNBifar36o=', 'Content-Length': '0'} 2024-04-16T18:21:47.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c18d82575c9d892b-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.184 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.184 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.184 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.184 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.185 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.185 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.185 DEBUG:boto:Data: 2024-04-16T18:21:47.185 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.185 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.185 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.185 DEBUG:boto:Params: {} 2024-04-16T18:21:47.185 DEBUG:boto:Token: None 2024-04-16T18:21:47.186 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.186 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qKJIwkL7MlzLoJjghsNBifar36o= 2024-04-16T18:21:47.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qKJIwkL7MlzLoJjghsNBifar36o=', 'Content-Length': '0'} 2024-04-16T18:21:47.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082f595b5869b78d6-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.188 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:21:47.189 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.189 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.189 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.189 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.189 DEBUG:boto:Method: GET 2024-04-16T18:21:47.189 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.189 DEBUG:boto:Data: 2024-04-16T18:21:47.189 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.189 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.190 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.190 DEBUG:boto:Params: {} 2024-04-16T18:21:47.190 DEBUG:boto:Token: None 2024-04-16T18:21:47.190 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.190 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE= 2024-04-16T18:21:47.190 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE=', 'Content-Length': '0'} 2024-04-16T18:21:47.192 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000716d957add2ce325-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.234 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.235 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.235 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.235 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.235 DEBUG:boto:Method: GET 2024-04-16T18:21:47.235 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.235 DEBUG:boto:Data: 2024-04-16T18:21:47.235 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.236 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.236 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.236 DEBUG:boto:Params: {} 2024-04-16T18:21:47.236 DEBUG:boto:Token: None 2024-04-16T18:21:47.236 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:21:47.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE= 2024-04-16T18:21:47.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0SHErHx40pnDWRwjh9a7N/8CdE=', 'Content-Length': '0'} 2024-04-16T18:21:47.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007736f59915920bc0-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.239 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.239 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.239 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.240 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.240 DEBUG:boto:Method: GET 2024-04-16T18:21:47.240 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.240 DEBUG:boto:Data: 2024-04-16T18:21:47.240 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.240 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.240 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.240 DEBUG:boto:Params: {} 2024-04-16T18:21:47.241 DEBUG:boto:Token: None 2024-04-16T18:21:47.241 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.241 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6ac62dbe46ea4b1-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.244 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.244 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.245 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.245 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.245 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.245 DEBUG:boto:Method: GET 2024-04-16T18:21:47.245 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.245 DEBUG:boto:Data: 2024-04-16T18:21:47.245 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.245 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.245 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.245 DEBUG:boto:Params: {} 2024-04-16T18:21:47.246 DEBUG:boto:Token: None 2024-04-16T18:21:47.246 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.246 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.249 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d37f5b3a4e82b7d7-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.290 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.291 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.291 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.291 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.292 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:47.292 DEBUG:boto:Data: 2024-04-16T18:21:47.292 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.292 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.292 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.292 DEBUG:boto:Params: {} 2024-04-16T18:21:47.292 DEBUG:boto:Token: None 2024-04-16T18:21:47.293 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44 2024-04-16T18:21:47.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1iAGWcDGl0ONy0idK7qYSz73ryw= 2024-04-16T18:21:47.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1iAGWcDGl0ONy0idK7qYSz73ryw=', 'Content-Length': '0'} 2024-04-16T18:21:47.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4d625305af25ecb-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.295 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.295 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.296 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.296 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:47.296 DEBUG:boto:Data: 2024-04-16T18:21:47.296 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.296 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.296 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.296 DEBUG:boto:Params: {} 2024-04-16T18:21:47.297 DEBUG:boto:Token: None 2024-04-16T18:21:47.297 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44 2024-04-16T18:21:47.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1iAGWcDGl0ONy0idK7qYSz73ryw= 2024-04-16T18:21:47.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1iAGWcDGl0ONy0idK7qYSz73ryw=', 'Content-Length': '0'} 2024-04-16T18:21:47.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011b9dd5a3bff9f7e-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:21:47.300 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.300 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.300 DEBUG:boto:Method: GET 2024-04-16T18:21:47.300 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:47.300 DEBUG:boto:Data: 2024-04-16T18:21:47.300 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.300 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.301 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.301 DEBUG:boto:Params: {} 2024-04-16T18:21:47.301 DEBUG:boto:Token: None 2024-04-16T18:21:47.301 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44 2024-04-16T18:21:47.301 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VcLVHDRJAko+mUbj3Ww0CcRxmKA= 2024-04-16T18:21:47.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VcLVHDRJAko+mUbj3Ww0CcRxmKA=', 'Content-Length': '0'} 2024-04-16T18:21:47.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008902c0a0836027f9-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.346 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:21:47.347 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:21:47.347 DEBUG:boto:Method: GET 2024-04-16T18:21:47.347 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:21:47.347 DEBUG:boto:Data: 2024-04-16T18:21:47.347 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.348 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.348 DEBUG:boto:Params: {} 2024-04-16T18:21:47.348 DEBUG:boto:Token: None 2024-04-16T18:21:47.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj44 2024-04-16T18:21:47.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VcLVHDRJAko+mUbj3Ww0CcRxmKA= 2024-04-16T18:21:47.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VcLVHDRJAko+mUbj3Ww0CcRxmKA=', 'Content-Length': '0'} 2024-04-16T18:21:47.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c972fef413b7eda7-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.351 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.351 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.351 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.351 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.351 DEBUG:boto:Method: GET 2024-04-16T18:21:47.352 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.352 DEBUG:boto:Data: 2024-04-16T18:21:47.352 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.352 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.352 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.352 DEBUG:boto:Params: {} 2024-04-16T18:21:47.352 DEBUG:boto:Token: None 2024-04-16T18:21:47.353 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.355 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001266bdbd64cb25cd-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.398 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.399 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.399 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.399 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.399 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.400 DEBUG:boto:Method: GET 2024-04-16T18:21:47.400 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:21:47.400 DEBUG:boto:Data: 2024-04-16T18:21:47.400 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.400 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.400 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.400 DEBUG:boto:Params: {} 2024-04-16T18:21:47.400 DEBUG:boto:Token: None 2024-04-16T18:21:47.401 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.401 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000072f948974c364078-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.404 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.405 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:21:47.405 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.405 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.405 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.405 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.406 DEBUG:boto:Method: GET 2024-04-16T18:21:47.406 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.406 DEBUG:boto:Data: 2024-04-16T18:21:47.406 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.406 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.406 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.406 DEBUG:boto:Params: {} 2024-04-16T18:21:47.406 DEBUG:boto:Token: None 2024-04-16T18:21:47.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE= 2024-04-16T18:21:47.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE=', 'Content-Length': '0'} 2024-04-16T18:21:47.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e65dda2d1dc9d670-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.451 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.451 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.451 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.451 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.451 DEBUG:boto:Method: GET 2024-04-16T18:21:47.451 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.451 DEBUG:boto:Data: 2024-04-16T18:21:47.452 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.452 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.452 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.452 DEBUG:boto:Params: {} 2024-04-16T18:21:47.452 DEBUG:boto:Token: None 2024-04-16T18:21:47.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.453 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE= 2024-04-16T18:21:47.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE=', 'Content-Length': '0'} 2024-04-16T18:21:47.455 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a83996dc18f69b5-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.457 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.457 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.458 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.458 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.458 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.458 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.458 DEBUG:boto:Data: 2024-04-16T18:21:47.458 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.458 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.458 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.459 DEBUG:boto:Params: {} 2024-04-16T18:21:47.459 DEBUG:boto:Token: None 2024-04-16T18:21:47.459 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yspiKKxFtbtqGX2+rQNuMlzzhgs= 2024-04-16T18:21:47.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yspiKKxFtbtqGX2+rQNuMlzzhgs=', 'Content-Length': '0'} 2024-04-16T18:21:47.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a778d82fbf918533-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.462 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.462 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.462 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.462 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.462 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.462 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.462 DEBUG:boto:Data: 2024-04-16T18:21:47.463 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.463 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.463 DEBUG:boto:Params: {} 2024-04-16T18:21:47.463 DEBUG:boto:Token: None 2024-04-16T18:21:47.463 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yspiKKxFtbtqGX2+rQNuMlzzhgs= 2024-04-16T18:21:47.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yspiKKxFtbtqGX2+rQNuMlzzhgs=', 'Content-Length': '0'} 2024-04-16T18:21:47.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000919375f88a00a432-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.466 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:21:47.466 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.467 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.467 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.467 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.467 DEBUG:boto:Method: GET 2024-04-16T18:21:47.467 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.467 DEBUG:boto:Data: 2024-04-16T18:21:47.467 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.467 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.468 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.468 DEBUG:boto:Params: {} 2024-04-16T18:21:47.468 DEBUG:boto:Token: None 2024-04-16T18:21:47.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE= 2024-04-16T18:21:47.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE=', 'Content-Length': '0'} 2024-04-16T18:21:47.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045c6856041a3fbea-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.515 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.515 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.515 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.515 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.515 DEBUG:boto:Method: GET 2024-04-16T18:21:47.515 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.515 DEBUG:boto:Data: 2024-04-16T18:21:47.515 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.516 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.516 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.516 DEBUG:boto:Params: {} 2024-04-16T18:21:47.516 DEBUG:boto:Token: None 2024-04-16T18:21:47.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:21:47.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE= 2024-04-16T18:21:47.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2vKVb5RV4Gg04r1Sbb29tc8CsWE=', 'Content-Length': '0'} 2024-04-16T18:21:47.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a1ea88b9d1c66da-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.519 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.519 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.519 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.520 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.520 DEBUG:boto:Method: GET 2024-04-16T18:21:47.520 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.520 DEBUG:boto:Data: 2024-04-16T18:21:47.520 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.520 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.520 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.520 DEBUG:boto:Params: {} 2024-04-16T18:21:47.521 DEBUG:boto:Token: None 2024-04-16T18:21:47.521 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.521 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.521 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001226e733278e4202-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.566 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.567 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.567 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.567 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.567 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.568 DEBUG:boto:Method: GET 2024-04-16T18:21:47.568 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.568 DEBUG:boto:Data: 2024-04-16T18:21:47.568 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.568 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.568 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.568 DEBUG:boto:Params: {} 2024-04-16T18:21:47.568 DEBUG:boto:Token: None 2024-04-16T18:21:47.569 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.569 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.572 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5eeeab0b92be681-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.573 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.573 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.573 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.573 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.573 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:47.573 DEBUG:boto:Data: 2024-04-16T18:21:47.574 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.574 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.574 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.574 DEBUG:boto:Params: {} 2024-04-16T18:21:47.574 DEBUG:boto:Token: None 2024-04-16T18:21:47.574 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51 2024-04-16T18:21:47.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:idbhK3PSGB/tWnXXqUCm0r5YrrI= 2024-04-16T18:21:47.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:idbhK3PSGB/tWnXXqUCm0r5YrrI=', 'Content-Length': '0'} 2024-04-16T18:21:47.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006849e024f30f6ce9-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.577 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.577 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.578 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.578 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:47.578 DEBUG:boto:Data: 2024-04-16T18:21:47.578 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.578 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.578 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.578 DEBUG:boto:Params: {} 2024-04-16T18:21:47.579 DEBUG:boto:Token: None 2024-04-16T18:21:47.579 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51 2024-04-16T18:21:47.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:idbhK3PSGB/tWnXXqUCm0r5YrrI= 2024-04-16T18:21:47.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:idbhK3PSGB/tWnXXqUCm0r5YrrI=', 'Content-Length': '0'} 2024-04-16T18:21:47.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4c6f6b7d1c6e3ee-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.582 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:21:47.582 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.582 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.582 DEBUG:boto:Method: GET 2024-04-16T18:21:47.582 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:47.583 DEBUG:boto:Data: 2024-04-16T18:21:47.583 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.583 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.583 DEBUG:boto:Params: {} 2024-04-16T18:21:47.583 DEBUG:boto:Token: None 2024-04-16T18:21:47.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51 2024-04-16T18:21:47.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O1mKi+YV+xoZiqmrDNO5lxoGLbk= 2024-04-16T18:21:47.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O1mKi+YV+xoZiqmrDNO5lxoGLbk=', 'Content-Length': '0'} 2024-04-16T18:21:47.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004952c1df0b227944-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.626 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:21:47.627 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:21:47.627 DEBUG:boto:Method: GET 2024-04-16T18:21:47.627 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:21:47.627 DEBUG:boto:Data: 2024-04-16T18:21:47.627 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.627 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.627 DEBUG:boto:Params: {} 2024-04-16T18:21:47.628 DEBUG:boto:Token: None 2024-04-16T18:21:47.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj51 2024-04-16T18:21:47.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O1mKi+YV+xoZiqmrDNO5lxoGLbk= 2024-04-16T18:21:47.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O1mKi+YV+xoZiqmrDNO5lxoGLbk=', 'Content-Length': '0'} 2024-04-16T18:21:47.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005324c2a5d83c91dd-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.631 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.631 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.631 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.631 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.631 DEBUG:boto:Method: GET 2024-04-16T18:21:47.631 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.632 DEBUG:boto:Data: 2024-04-16T18:21:47.632 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.632 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.632 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.632 DEBUG:boto:Params: {} 2024-04-16T18:21:47.632 DEBUG:boto:Token: None 2024-04-16T18:21:47.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.633 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.636 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2724b02d16fa038-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.637 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.637 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.638 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.638 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.638 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.638 DEBUG:boto:Method: GET 2024-04-16T18:21:47.638 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:21:47.638 DEBUG:boto:Data: 2024-04-16T18:21:47.638 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.639 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.639 DEBUG:boto:Params: {} 2024-04-16T18:21:47.639 DEBUG:boto:Token: None 2024-04-16T18:21:47.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc031284eb60377c-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.643 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:21:47.643 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.643 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.644 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.644 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.644 DEBUG:boto:Method: GET 2024-04-16T18:21:47.644 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.644 DEBUG:boto:Data: 2024-04-16T18:21:47.644 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.644 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.644 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.645 DEBUG:boto:Params: {} 2024-04-16T18:21:47.645 DEBUG:boto:Token: None 2024-04-16T18:21:47.645 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.645 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc= 2024-04-16T18:21:47.645 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc=', 'Content-Length': '0'} 2024-04-16T18:21:47.647 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb767524ae334db5-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.690 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.711 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.711 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.711 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.712 DEBUG:boto:Method: GET 2024-04-16T18:21:47.712 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.712 DEBUG:boto:Data: 2024-04-16T18:21:47.712 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.712 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.712 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.712 DEBUG:boto:Params: {} 2024-04-16T18:21:47.712 DEBUG:boto:Token: None 2024-04-16T18:21:47.713 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.713 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc= 2024-04-16T18:21:47.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc=', 'Content-Length': '0'} 2024-04-16T18:21:47.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095e3d6e2ead4abe8-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.716 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.716 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.716 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.716 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.716 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.716 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.716 DEBUG:boto:Data: 2024-04-16T18:21:47.716 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.717 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.717 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.717 DEBUG:boto:Params: {} 2024-04-16T18:21:47.717 DEBUG:boto:Token: None 2024-04-16T18:21:47.717 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.717 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PlXkRbrzwqxgdhKmZkrMpxvl7Ek= 2024-04-16T18:21:47.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PlXkRbrzwqxgdhKmZkrMpxvl7Ek=', 'Content-Length': '0'} 2024-04-16T18:21:47.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8bd316af6fd78bc-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.720 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.721 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.721 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.721 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.721 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.721 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.721 DEBUG:boto:Data: 2024-04-16T18:21:47.721 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.721 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.722 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.722 DEBUG:boto:Params: {} 2024-04-16T18:21:47.722 DEBUG:boto:Token: None 2024-04-16T18:21:47.722 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.722 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PlXkRbrzwqxgdhKmZkrMpxvl7Ek= 2024-04-16T18:21:47.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PlXkRbrzwqxgdhKmZkrMpxvl7Ek=', 'Content-Length': '0'} 2024-04-16T18:21:47.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a917ebf61eabd1be-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:21:47.725 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.725 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.725 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.725 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.726 DEBUG:boto:Method: GET 2024-04-16T18:21:47.726 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.726 DEBUG:boto:Data: 2024-04-16T18:21:47.726 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.726 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.726 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.726 DEBUG:boto:Params: {} 2024-04-16T18:21:47.726 DEBUG:boto:Token: None 2024-04-16T18:21:47.727 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc= 2024-04-16T18:21:47.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc=', 'Content-Length': '0'} 2024-04-16T18:21:47.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000664acd3958a52ea4-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.770 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.771 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.771 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.771 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.771 DEBUG:boto:Method: GET 2024-04-16T18:21:47.771 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.771 DEBUG:boto:Data: 2024-04-16T18:21:47.771 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.771 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.772 DEBUG:boto:Params: {} 2024-04-16T18:21:47.772 DEBUG:boto:Token: None 2024-04-16T18:21:47.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:21:47.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc= 2024-04-16T18:21:47.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sCmQhCu/qTR+vDC5aSljyj1dBrc=', 'Content-Length': '0'} 2024-04-16T18:21:47.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056a66eacb6bfe47c-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.775 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.775 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.776 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.776 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.776 DEBUG:boto:Method: GET 2024-04-16T18:21:47.776 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.776 DEBUG:boto:Data: 2024-04-16T18:21:47.776 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.776 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.776 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.776 DEBUG:boto:Params: {} 2024-04-16T18:21:47.777 DEBUG:boto:Token: None 2024-04-16T18:21:47.777 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.780 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000013a0a990e339e22-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.822 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.823 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.823 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.823 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.823 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.823 DEBUG:boto:Method: GET 2024-04-16T18:21:47.824 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.824 DEBUG:boto:Data: 2024-04-16T18:21:47.824 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.824 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.824 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.824 DEBUG:boto:Params: {} 2024-04-16T18:21:47.824 DEBUG:boto:Token: None 2024-04-16T18:21:47.825 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.825 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.828 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092f09bc119432b0d-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.828 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.829 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.829 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.829 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.829 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:47.829 DEBUG:boto:Data: 2024-04-16T18:21:47.829 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.830 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.830 DEBUG:boto:Params: {} 2024-04-16T18:21:47.830 DEBUG:boto:Token: None 2024-04-16T18:21:47.830 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55 2024-04-16T18:21:47.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8hXX9kMcoJ5Gf6DD5C5wmb5WQEc= 2024-04-16T18:21:47.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8hXX9kMcoJ5Gf6DD5C5wmb5WQEc=', 'Content-Length': '0'} 2024-04-16T18:21:47.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015692513fe5e4b64-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.833 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.833 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.833 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.834 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:47.834 DEBUG:boto:Data: 2024-04-16T18:21:47.834 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.834 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.834 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.834 DEBUG:boto:Params: {} 2024-04-16T18:21:47.834 DEBUG:boto:Token: None 2024-04-16T18:21:47.835 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55 2024-04-16T18:21:47.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8hXX9kMcoJ5Gf6DD5C5wmb5WQEc= 2024-04-16T18:21:47.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8hXX9kMcoJ5Gf6DD5C5wmb5WQEc=', 'Content-Length': '0'} 2024-04-16T18:21:47.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000045dbb43b9ebf223-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.837 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:21:47.838 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.838 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.838 DEBUG:boto:Method: GET 2024-04-16T18:21:47.838 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:47.838 DEBUG:boto:Data: 2024-04-16T18:21:47.838 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.839 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.839 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.839 DEBUG:boto:Params: {} 2024-04-16T18:21:47.839 DEBUG:boto:Token: None 2024-04-16T18:21:47.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55 2024-04-16T18:21:47.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pPIu2W6Z65bnmPklzwpzW8xFUxk= 2024-04-16T18:21:47.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pPIu2W6Z65bnmPklzwpzW8xFUxk=', 'Content-Length': '0'} 2024-04-16T18:21:47.842 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051a2fc8f805bca50-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.882 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:21:47.883 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:21:47.883 DEBUG:boto:Method: GET 2024-04-16T18:21:47.883 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:21:47.883 DEBUG:boto:Data: 2024-04-16T18:21:47.883 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.883 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.884 DEBUG:boto:Params: {} 2024-04-16T18:21:47.884 DEBUG:boto:Token: None 2024-04-16T18:21:47.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj55 2024-04-16T18:21:47.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pPIu2W6Z65bnmPklzwpzW8xFUxk= 2024-04-16T18:21:47.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pPIu2W6Z65bnmPklzwpzW8xFUxk=', 'Content-Length': '0'} 2024-04-16T18:21:47.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc5e9732dab99c26-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.887 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.887 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.887 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.887 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.887 DEBUG:boto:Method: GET 2024-04-16T18:21:47.887 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.888 DEBUG:boto:Data: 2024-04-16T18:21:47.888 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.888 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.888 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.888 DEBUG:boto:Params: {} 2024-04-16T18:21:47.888 DEBUG:boto:Token: None 2024-04-16T18:21:47.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.889 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.891 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a3d39a33a315a29e-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.892 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.892 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:47.892 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:47.892 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.893 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.893 DEBUG:boto:Method: GET 2024-04-16T18:21:47.893 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:21:47.893 DEBUG:boto:Data: 2024-04-16T18:21:47.893 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.893 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.893 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.894 DEBUG:boto:Params: {} 2024-04-16T18:21:47.894 DEBUG:boto:Token: None 2024-04-16T18:21:47.894 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/ 2024-04-16T18:21:47.894 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc= 2024-04-16T18:21:47.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OQ+nBgLCgb6FfH0h2GMonnzf5Dc=', 'Content-Length': '0'} 2024-04-16T18:21:47.897 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000514de42a5c48d95-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.898 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:47.898 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:21:47.898 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:47.899 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:47.899 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.899 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.899 DEBUG:boto:Method: GET 2024-04-16T18:21:47.899 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.899 DEBUG:boto:Data: 2024-04-16T18:21:47.899 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.899 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.900 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.900 DEBUG:boto:Params: {} 2024-04-16T18:21:47.900 DEBUG:boto:Token: None 2024-04-16T18:21:47.900 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fdsN9GN9jA9oyQSjbUJUmns3kpk= 2024-04-16T18:21:47.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fdsN9GN9jA9oyQSjbUJUmns3kpk=', 'Content-Length': '0'} 2024-04-16T18:21:47.903 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a213ffb515bf6b7-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.946 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:47.947 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:47.947 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.947 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.947 DEBUG:boto:Method: GET 2024-04-16T18:21:47.947 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.947 DEBUG:boto:Data: 2024-04-16T18:21:47.947 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.948 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.948 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.948 DEBUG:boto:Params: {} 2024-04-16T18:21:47.948 DEBUG:boto:Token: None 2024-04-16T18:21:47.948 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fdsN9GN9jA9oyQSjbUJUmns3kpk= 2024-04-16T18:21:47.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fdsN9GN9jA9oyQSjbUJUmns3kpk=', 'Content-Length': '0'} 2024-04-16T18:21:47.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eeb1db4f82a6da74-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.951 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:47.951 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:47.951 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.951 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.952 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.952 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.952 DEBUG:boto:Data: 2024-04-16T18:21:47.952 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.952 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.952 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.952 DEBUG:boto:Params: {} 2024-04-16T18:21:47.953 DEBUG:boto:Token: None 2024-04-16T18:21:47.953 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.953 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0hA/1SqmqZFO1hosjufSRxiScFQ= 2024-04-16T18:21:47.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0hA/1SqmqZFO1hosjufSRxiScFQ=', 'Content-Length': '0'} 2024-04-16T18:21:47.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d6525e441a34e8a-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.956 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:47.956 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:47.956 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.956 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.956 DEBUG:boto:Method: HEAD 2024-04-16T18:21:47.957 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.957 DEBUG:boto:Data: 2024-04-16T18:21:47.957 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.957 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:47.957 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.957 DEBUG:boto:Params: {} 2024-04-16T18:21:47.957 DEBUG:boto:Token: None 2024-04-16T18:21:47.957 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.958 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0hA/1SqmqZFO1hosjufSRxiScFQ= 2024-04-16T18:21:47.958 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0hA/1SqmqZFO1hosjufSRxiScFQ=', 'Content-Length': '0'} 2024-04-16T18:21:47.960 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf38b8946cdcbd78-00661ec1bb-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:47.960 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:21:47.961 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:47.961 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:47.961 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.961 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.961 DEBUG:boto:Method: GET 2024-04-16T18:21:47.961 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.961 DEBUG:boto:Data: 2024-04-16T18:21:47.961 DEBUG:boto:Headers: {} 2024-04-16T18:21:47.962 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:47.962 DEBUG:boto:Port: 8000 2024-04-16T18:21:47.962 DEBUG:boto:Params: {} 2024-04-16T18:21:47.962 DEBUG:boto:Token: None 2024-04-16T18:21:47.962 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:47 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:47.962 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fdsN9GN9jA9oyQSjbUJUmns3kpk= 2024-04-16T18:21:47.963 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fdsN9GN9jA9oyQSjbUJUmns3kpk=', 'Content-Length': '0'} 2024-04-16T18:21:47.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000841c038105e65957-00661ec1bb-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.006 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:48.007 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:48.007 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:48.007 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:21:48.007 DEBUG:boto:Method: GET 2024-04-16T18:21:48.007 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:48.007 DEBUG:boto:Data: 2024-04-16T18:21:48.008 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.008 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.008 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.008 DEBUG:boto:Params: {} 2024-04-16T18:21:48.008 DEBUG:boto:Token: None 2024-04-16T18:21:48.008 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:21:48.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jwISYyefP6qFxSqDTo5BUcqoRjQ= 2024-04-16T18:21:48.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jwISYyefP6qFxSqDTo5BUcqoRjQ=', 'Content-Length': '0'} 2024-04-16T18:21:48.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000829ff09d9a5e778e-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.011 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.011 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.012 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.012 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.012 DEBUG:boto:Method: GET 2024-04-16T18:21:48.012 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.012 DEBUG:boto:Data: 2024-04-16T18:21:48.012 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.012 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.012 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.012 DEBUG:boto:Params: {} 2024-04-16T18:21:48.013 DEBUG:boto:Token: None 2024-04-16T18:21:48.013 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.013 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.016 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f18d24d28ca82640-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.058 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.059 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.059 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.059 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.059 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.060 DEBUG:boto:Method: GET 2024-04-16T18:21:48.060 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.060 DEBUG:boto:Data: 2024-04-16T18:21:48.060 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.060 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.060 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.060 DEBUG:boto:Params: {} 2024-04-16T18:21:48.061 DEBUG:boto:Token: None 2024-04-16T18:21:48.061 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.061 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.064 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc9a48faf7f55ecb-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.065 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.065 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:48.065 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:48.065 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.066 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:21:48.066 DEBUG:boto:Data: 2024-04-16T18:21:48.066 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.066 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.066 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.066 DEBUG:boto:Params: {} 2024-04-16T18:21:48.066 DEBUG:boto:Token: None 2024-04-16T18:21:48.067 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj57 2024-04-16T18:21:48.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hB4uzfXyT+oKFtzoB1/UUPk1HOs= 2024-04-16T18:21:48.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hB4uzfXyT+oKFtzoB1/UUPk1HOs=', 'Content-Length': '0'} 2024-04-16T18:21:48.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ee33d0a15ed1a67-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.069 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:48.070 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:48.070 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.070 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:21:48.070 DEBUG:boto:Data: 2024-04-16T18:21:48.070 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.070 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.070 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.070 DEBUG:boto:Params: {} 2024-04-16T18:21:48.071 DEBUG:boto:Token: None 2024-04-16T18:21:48.071 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj57 2024-04-16T18:21:48.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hB4uzfXyT+oKFtzoB1/UUPk1HOs= 2024-04-16T18:21:48.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hB4uzfXyT+oKFtzoB1/UUPk1HOs=', 'Content-Length': '0'} 2024-04-16T18:21:48.073 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e932e928760ae08b-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.074 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:21:48.074 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:48.074 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:48.074 DEBUG:boto:Method: GET 2024-04-16T18:21:48.074 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:21:48.074 DEBUG:boto:Data: 2024-04-16T18:21:48.075 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.075 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.075 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.075 DEBUG:boto:Params: {} 2024-04-16T18:21:48.075 DEBUG:boto:Token: None 2024-04-16T18:21:48.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj57 2024-04-16T18:21:48.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:duSXT5YGmqvFCJPCJkHHOXOnAp8= 2024-04-16T18:21:48.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:duSXT5YGmqvFCJPCJkHHOXOnAp8=', 'Content-Length': '0'} 2024-04-16T18:21:48.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b121ceba8091f44a-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.122 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:21:48.123 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:21:48.123 DEBUG:boto:Method: GET 2024-04-16T18:21:48.123 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:21:48.123 DEBUG:boto:Data: 2024-04-16T18:21:48.123 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.123 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.124 DEBUG:boto:Params: {} 2024-04-16T18:21:48.124 DEBUG:boto:Token: None 2024-04-16T18:21:48.124 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj57 2024-04-16T18:21:48.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:duSXT5YGmqvFCJPCJkHHOXOnAp8= 2024-04-16T18:21:48.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:duSXT5YGmqvFCJPCJkHHOXOnAp8=', 'Content-Length': '0'} 2024-04-16T18:21:48.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e37b2efbcaaa02ab-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.127 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.127 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.127 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.127 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.127 DEBUG:boto:Method: GET 2024-04-16T18:21:48.128 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.128 DEBUG:boto:Data: 2024-04-16T18:21:48.128 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.128 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.128 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.128 DEBUG:boto:Params: {} 2024-04-16T18:21:48.128 DEBUG:boto:Token: None 2024-04-16T18:21:48.129 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.129 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000709e19c074e2aee7-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.132 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.132 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.133 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.133 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.133 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.133 DEBUG:boto:Method: GET 2024-04-16T18:21:48.133 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:21:48.133 DEBUG:boto:Data: 2024-04-16T18:21:48.133 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.133 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.134 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.134 DEBUG:boto:Params: {} 2024-04-16T18:21:48.134 DEBUG:boto:Token: None 2024-04-16T18:21:48.134 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.134 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.138 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000061fd5dbe7a374152-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.138 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.138 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:21:48.139 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.139 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.139 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.139 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.139 DEBUG:boto:Method: GET 2024-04-16T18:21:48.139 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.139 DEBUG:boto:Data: 2024-04-16T18:21:48.139 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.139 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.140 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.140 DEBUG:boto:Params: {} 2024-04-16T18:21:48.140 DEBUG:boto:Token: None 2024-04-16T18:21:48.140 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M= 2024-04-16T18:21:48.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M=', 'Content-Length': '0'} 2024-04-16T18:21:48.143 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000570e54927f6cc9bd-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.186 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.187 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.187 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.187 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.187 DEBUG:boto:Method: GET 2024-04-16T18:21:48.187 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.187 DEBUG:boto:Data: 2024-04-16T18:21:48.187 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.188 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.188 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.188 DEBUG:boto:Params: {} 2024-04-16T18:21:48.188 DEBUG:boto:Token: None 2024-04-16T18:21:48.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M= 2024-04-16T18:21:48.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M=', 'Content-Length': '0'} 2024-04-16T18:21:48.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a1f2638fd919a83-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.191 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.191 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.191 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.191 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.192 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.192 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.192 DEBUG:boto:Data: 2024-04-16T18:21:48.192 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.192 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.192 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.192 DEBUG:boto:Params: {} 2024-04-16T18:21:48.192 DEBUG:boto:Token: None 2024-04-16T18:21:48.193 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.193 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bmA2Luq8+REjUTJXXyVjPaxN65g= 2024-04-16T18:21:48.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bmA2Luq8+REjUTJXXyVjPaxN65g=', 'Content-Length': '0'} 2024-04-16T18:21:48.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030e3a755a06fd4a8-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.195 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.196 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.196 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.196 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.196 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.196 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.196 DEBUG:boto:Data: 2024-04-16T18:21:48.196 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.196 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.197 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.197 DEBUG:boto:Params: {} 2024-04-16T18:21:48.197 DEBUG:boto:Token: None 2024-04-16T18:21:48.197 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.197 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bmA2Luq8+REjUTJXXyVjPaxN65g= 2024-04-16T18:21:48.197 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bmA2Luq8+REjUTJXXyVjPaxN65g=', 'Content-Length': '0'} 2024-04-16T18:21:48.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012f6b09937adedf9-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.199 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:21:48.200 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.200 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.200 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.200 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.200 DEBUG:boto:Method: GET 2024-04-16T18:21:48.200 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.200 DEBUG:boto:Data: 2024-04-16T18:21:48.200 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.201 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.201 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.201 DEBUG:boto:Params: {} 2024-04-16T18:21:48.201 DEBUG:boto:Token: None 2024-04-16T18:21:48.201 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M= 2024-04-16T18:21:48.202 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M=', 'Content-Length': '0'} 2024-04-16T18:21:48.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb82712e53a346a6-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.246 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.247 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.247 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.247 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.247 DEBUG:boto:Method: GET 2024-04-16T18:21:48.247 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.247 DEBUG:boto:Data: 2024-04-16T18:21:48.247 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.248 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.248 DEBUG:boto:Params: {} 2024-04-16T18:21:48.248 DEBUG:boto:Token: None 2024-04-16T18:21:48.248 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:21:48.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M= 2024-04-16T18:21:48.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huEYM7lpBEkw/M60+wM/EHiGu3M=', 'Content-Length': '0'} 2024-04-16T18:21:48.250 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085ea26d0078dfd07-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.251 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.251 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.251 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.251 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.252 DEBUG:boto:Method: GET 2024-04-16T18:21:48.252 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.252 DEBUG:boto:Data: 2024-04-16T18:21:48.252 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.252 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.252 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.252 DEBUG:boto:Params: {} 2024-04-16T18:21:48.253 DEBUG:boto:Token: None 2024-04-16T18:21:48.253 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.256 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c74a28e90e626b42-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.298 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.299 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.299 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.299 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.299 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.299 DEBUG:boto:Method: GET 2024-04-16T18:21:48.300 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.300 DEBUG:boto:Data: 2024-04-16T18:21:48.300 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.300 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.300 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.300 DEBUG:boto:Params: {} 2024-04-16T18:21:48.300 DEBUG:boto:Token: None 2024-04-16T18:21:48.301 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.301 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.304 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6672362c0ef5007-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.304 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.304 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.304 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.305 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.305 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:48.305 DEBUG:boto:Data: 2024-04-16T18:21:48.305 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.305 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.305 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.305 DEBUG:boto:Params: {} 2024-04-16T18:21:48.305 DEBUG:boto:Token: None 2024-04-16T18:21:48.306 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68 2024-04-16T18:21:48.306 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oeuT6tTE1lMJWZguSWgRlmMupew= 2024-04-16T18:21:48.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oeuT6tTE1lMJWZguSWgRlmMupew=', 'Content-Length': '0'} 2024-04-16T18:21:48.308 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a9643bf141bb5b9-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.308 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.308 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.308 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.308 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:48.308 DEBUG:boto:Data: 2024-04-16T18:21:48.309 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.309 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.309 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.309 DEBUG:boto:Params: {} 2024-04-16T18:21:48.309 DEBUG:boto:Token: None 2024-04-16T18:21:48.309 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68 2024-04-16T18:21:48.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oeuT6tTE1lMJWZguSWgRlmMupew= 2024-04-16T18:21:48.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oeuT6tTE1lMJWZguSWgRlmMupew=', 'Content-Length': '0'} 2024-04-16T18:21:48.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e72bb6c43147ccf-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.312 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:21:48.312 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.312 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.312 DEBUG:boto:Method: GET 2024-04-16T18:21:48.312 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:48.312 DEBUG:boto:Data: 2024-04-16T18:21:48.312 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.313 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.313 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.313 DEBUG:boto:Params: {} 2024-04-16T18:21:48.313 DEBUG:boto:Token: None 2024-04-16T18:21:48.313 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68 2024-04-16T18:21:48.313 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3+s2mxsCpaAbfK357OLSWNPtWvg= 2024-04-16T18:21:48.313 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3+s2mxsCpaAbfK357OLSWNPtWvg=', 'Content-Length': '0'} 2024-04-16T18:21:48.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a58d9eda533c3004-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.358 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:21:48.359 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:21:48.359 DEBUG:boto:Method: GET 2024-04-16T18:21:48.359 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:21:48.359 DEBUG:boto:Data: 2024-04-16T18:21:48.359 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.359 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.359 DEBUG:boto:Params: {} 2024-04-16T18:21:48.360 DEBUG:boto:Token: None 2024-04-16T18:21:48.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj68 2024-04-16T18:21:48.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3+s2mxsCpaAbfK357OLSWNPtWvg= 2024-04-16T18:21:48.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3+s2mxsCpaAbfK357OLSWNPtWvg=', 'Content-Length': '0'} 2024-04-16T18:21:48.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d52f616a5e8f1372-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.363 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.363 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.363 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.363 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.363 DEBUG:boto:Method: GET 2024-04-16T18:21:48.363 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.363 DEBUG:boto:Data: 2024-04-16T18:21:48.363 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.364 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.364 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.364 DEBUG:boto:Params: {} 2024-04-16T18:21:48.364 DEBUG:boto:Token: None 2024-04-16T18:21:48.364 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.366 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000365bb4f8241df2bd-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.367 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.367 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.367 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.367 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.367 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.368 DEBUG:boto:Method: GET 2024-04-16T18:21:48.368 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:21:48.368 DEBUG:boto:Data: 2024-04-16T18:21:48.368 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.368 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.368 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.368 DEBUG:boto:Params: {} 2024-04-16T18:21:48.368 DEBUG:boto:Token: None 2024-04-16T18:21:48.368 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.369 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.371 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006360df334c394beb-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.371 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:21:48.372 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.372 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.372 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.372 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.372 DEBUG:boto:Method: GET 2024-04-16T18:21:48.372 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.373 DEBUG:boto:Data: 2024-04-16T18:21:48.373 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.373 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.373 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.373 DEBUG:boto:Params: {} 2024-04-16T18:21:48.373 DEBUG:boto:Token: None 2024-04-16T18:21:48.373 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.373 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw= 2024-04-16T18:21:48.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw=', 'Content-Length': '0'} 2024-04-16T18:21:48.376 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccbd659319bcf7fd-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.418 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.419 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.419 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.419 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.419 DEBUG:boto:Method: GET 2024-04-16T18:21:48.419 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.419 DEBUG:boto:Data: 2024-04-16T18:21:48.419 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.419 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.419 DEBUG:boto:Params: {} 2024-04-16T18:21:48.420 DEBUG:boto:Token: None 2024-04-16T18:21:48.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw= 2024-04-16T18:21:48.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw=', 'Content-Length': '0'} 2024-04-16T18:21:48.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000317c71827c0f4d47-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.423 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.423 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.423 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.423 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.423 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.423 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.423 DEBUG:boto:Data: 2024-04-16T18:21:48.423 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.423 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.424 DEBUG:boto:Params: {} 2024-04-16T18:21:48.424 DEBUG:boto:Token: None 2024-04-16T18:21:48.424 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B2w5IciLQ5DnkY3HAPI3Sj7eO2E= 2024-04-16T18:21:48.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B2w5IciLQ5DnkY3HAPI3Sj7eO2E=', 'Content-Length': '0'} 2024-04-16T18:21:48.426 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d43cc74a73b65ad-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.426 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.426 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.427 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.427 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.427 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.427 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.427 DEBUG:boto:Data: 2024-04-16T18:21:48.427 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.427 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.427 DEBUG:boto:Params: {} 2024-04-16T18:21:48.428 DEBUG:boto:Token: None 2024-04-16T18:21:48.428 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B2w5IciLQ5DnkY3HAPI3Sj7eO2E= 2024-04-16T18:21:48.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B2w5IciLQ5DnkY3HAPI3Sj7eO2E=', 'Content-Length': '0'} 2024-04-16T18:21:48.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000809629d902d4732a-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.430 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:21:48.430 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.430 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.430 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.430 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.431 DEBUG:boto:Method: GET 2024-04-16T18:21:48.431 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.431 DEBUG:boto:Data: 2024-04-16T18:21:48.431 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.431 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.431 DEBUG:boto:Params: {} 2024-04-16T18:21:48.431 DEBUG:boto:Token: None 2024-04-16T18:21:48.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw= 2024-04-16T18:21:48.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw=', 'Content-Length': '0'} 2024-04-16T18:21:48.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001574af9a699729d1-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.474 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.474 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.475 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.475 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.475 DEBUG:boto:Method: GET 2024-04-16T18:21:48.475 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.475 DEBUG:boto:Data: 2024-04-16T18:21:48.475 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.475 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.475 DEBUG:boto:Params: {} 2024-04-16T18:21:48.475 DEBUG:boto:Token: None 2024-04-16T18:21:48.476 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:21:48.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw= 2024-04-16T18:21:48.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdBySXM4Zphmu7L5NhGwCsi32bw=', 'Content-Length': '0'} 2024-04-16T18:21:48.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000876632576f4faa38-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.478 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.478 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.478 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.478 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.478 DEBUG:boto:Method: GET 2024-04-16T18:21:48.478 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.478 DEBUG:boto:Data: 2024-04-16T18:21:48.479 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.479 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.479 DEBUG:boto:Params: {} 2024-04-16T18:21:48.479 DEBUG:boto:Token: None 2024-04-16T18:21:48.479 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.481 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d15b3a4c335253e-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.482 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.482 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.482 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.482 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.482 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.482 DEBUG:boto:Method: GET 2024-04-16T18:21:48.483 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.483 DEBUG:boto:Data: 2024-04-16T18:21:48.483 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.483 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.483 DEBUG:boto:Params: {} 2024-04-16T18:21:48.483 DEBUG:boto:Token: None 2024-04-16T18:21:48.483 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.486 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004addb68d18823f25-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.487 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.487 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.487 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.487 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.487 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:21:48.487 DEBUG:boto:Data: 2024-04-16T18:21:48.487 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.488 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.488 DEBUG:boto:Params: {} 2024-04-16T18:21:48.488 DEBUG:boto:Token: None 2024-04-16T18:21:48.488 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76 2024-04-16T18:21:48.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iTA/yd8CySnY/ZG4F7HPd8sghvM= 2024-04-16T18:21:48.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iTA/yd8CySnY/ZG4F7HPd8sghvM=', 'Content-Length': '0'} 2024-04-16T18:21:48.490 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c513faee313a657-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.490 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.491 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.491 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.491 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:21:48.491 DEBUG:boto:Data: 2024-04-16T18:21:48.491 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.491 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.491 DEBUG:boto:Params: {} 2024-04-16T18:21:48.491 DEBUG:boto:Token: None 2024-04-16T18:21:48.492 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76 2024-04-16T18:21:48.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iTA/yd8CySnY/ZG4F7HPd8sghvM= 2024-04-16T18:21:48.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iTA/yd8CySnY/ZG4F7HPd8sghvM=', 'Content-Length': '0'} 2024-04-16T18:21:48.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a45eba877cd7f775-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.494 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:21:48.494 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.494 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.494 DEBUG:boto:Method: GET 2024-04-16T18:21:48.494 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:21:48.494 DEBUG:boto:Data: 2024-04-16T18:21:48.494 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.495 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.495 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.495 DEBUG:boto:Params: {} 2024-04-16T18:21:48.495 DEBUG:boto:Token: None 2024-04-16T18:21:48.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76 2024-04-16T18:21:48.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EQ5Ha04fT0bp2VQVWG8l+349hr4= 2024-04-16T18:21:48.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EQ5Ha04fT0bp2VQVWG8l+349hr4=', 'Content-Length': '0'} 2024-04-16T18:21:48.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5ee3c6adfcbb444-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.538 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:21:48.538 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:21:48.539 DEBUG:boto:Method: GET 2024-04-16T18:21:48.539 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:21:48.539 DEBUG:boto:Data: 2024-04-16T18:21:48.539 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.539 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.539 DEBUG:boto:Params: {} 2024-04-16T18:21:48.539 DEBUG:boto:Token: None 2024-04-16T18:21:48.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj76 2024-04-16T18:21:48.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EQ5Ha04fT0bp2VQVWG8l+349hr4= 2024-04-16T18:21:48.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EQ5Ha04fT0bp2VQVWG8l+349hr4=', 'Content-Length': '0'} 2024-04-16T18:21:48.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a56fd3648b823f6f-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.542 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.542 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.542 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.542 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.542 DEBUG:boto:Method: GET 2024-04-16T18:21:48.542 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.543 DEBUG:boto:Data: 2024-04-16T18:21:48.543 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.543 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.543 DEBUG:boto:Params: {} 2024-04-16T18:21:48.543 DEBUG:boto:Token: None 2024-04-16T18:21:48.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.546 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001e3b20997ec65987-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.586 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.587 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.587 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.587 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.587 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.587 DEBUG:boto:Method: GET 2024-04-16T18:21:48.587 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:21:48.587 DEBUG:boto:Data: 2024-04-16T18:21:48.587 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.588 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.588 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.588 DEBUG:boto:Params: {} 2024-04-16T18:21:48.588 DEBUG:boto:Token: None 2024-04-16T18:21:48.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd435d026e149dab-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.591 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:21:48.592 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.592 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.592 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.592 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.592 DEBUG:boto:Method: GET 2024-04-16T18:21:48.592 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.592 DEBUG:boto:Data: 2024-04-16T18:21:48.592 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.593 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.593 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.593 DEBUG:boto:Params: {} 2024-04-16T18:21:48.593 DEBUG:boto:Token: None 2024-04-16T18:21:48.593 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.593 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000= 2024-04-16T18:21:48.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000=', 'Content-Length': '0'} 2024-04-16T18:21:48.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000385eaebf3ecb3ef9-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.638 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.638 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.639 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.639 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.639 DEBUG:boto:Method: GET 2024-04-16T18:21:48.639 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.639 DEBUG:boto:Data: 2024-04-16T18:21:48.639 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.639 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.640 DEBUG:boto:Params: {} 2024-04-16T18:21:48.640 DEBUG:boto:Token: None 2024-04-16T18:21:48.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000= 2024-04-16T18:21:48.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000=', 'Content-Length': '0'} 2024-04-16T18:21:48.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008882151b0669425e-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.642 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.642 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.642 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.643 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.643 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.643 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.643 DEBUG:boto:Data: 2024-04-16T18:21:48.643 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.643 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.643 DEBUG:boto:Params: {} 2024-04-16T18:21:48.643 DEBUG:boto:Token: None 2024-04-16T18:21:48.644 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UtoRx3Khx3SijijnxKoHJW06j6s= 2024-04-16T18:21:48.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UtoRx3Khx3SijijnxKoHJW06j6s=', 'Content-Length': '0'} 2024-04-16T18:21:48.646 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055a0053ca2f0d769-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.646 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.646 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.646 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.647 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.647 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.647 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.647 DEBUG:boto:Data: 2024-04-16T18:21:48.647 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.647 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.647 DEBUG:boto:Params: {} 2024-04-16T18:21:48.647 DEBUG:boto:Token: None 2024-04-16T18:21:48.648 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UtoRx3Khx3SijijnxKoHJW06j6s= 2024-04-16T18:21:48.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UtoRx3Khx3SijijnxKoHJW06j6s=', 'Content-Length': '0'} 2024-04-16T18:21:48.650 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092213a9d3e9beb76-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.650 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:21:48.650 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.650 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.650 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.650 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.650 DEBUG:boto:Method: GET 2024-04-16T18:21:48.651 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.651 DEBUG:boto:Data: 2024-04-16T18:21:48.651 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.651 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.651 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.651 DEBUG:boto:Params: {} 2024-04-16T18:21:48.651 DEBUG:boto:Token: None 2024-04-16T18:21:48.651 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000= 2024-04-16T18:21:48.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000=', 'Content-Length': '0'} 2024-04-16T18:21:48.654 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df1fa79431eae3c8-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.694 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.695 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.695 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.695 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.695 DEBUG:boto:Method: GET 2024-04-16T18:21:48.695 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.695 DEBUG:boto:Data: 2024-04-16T18:21:48.695 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.695 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.695 DEBUG:boto:Params: {} 2024-04-16T18:21:48.696 DEBUG:boto:Token: None 2024-04-16T18:21:48.696 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:21:48.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000= 2024-04-16T18:21:48.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fIxgrgw+Dj4XFBQJxS5k3c7J000=', 'Content-Length': '0'} 2024-04-16T18:21:48.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000244810f65d83719e-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.698 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.698 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.699 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.699 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.699 DEBUG:boto:Method: GET 2024-04-16T18:21:48.699 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.699 DEBUG:boto:Data: 2024-04-16T18:21:48.699 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.699 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.699 DEBUG:boto:Params: {} 2024-04-16T18:21:48.699 DEBUG:boto:Token: None 2024-04-16T18:21:48.700 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.702 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f48ad2efba2e763-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.746 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.747 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.747 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.747 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.747 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.747 DEBUG:boto:Method: GET 2024-04-16T18:21:48.747 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.747 DEBUG:boto:Data: 2024-04-16T18:21:48.747 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.748 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.748 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.748 DEBUG:boto:Params: {} 2024-04-16T18:21:48.748 DEBUG:boto:Token: None 2024-04-16T18:21:48.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.751 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b801de8125695fde-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.751 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.751 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.752 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.752 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.752 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:48.752 DEBUG:boto:Data: 2024-04-16T18:21:48.752 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.752 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.752 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.752 DEBUG:boto:Params: {} 2024-04-16T18:21:48.752 DEBUG:boto:Token: None 2024-04-16T18:21:48.753 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85 2024-04-16T18:21:48.753 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nqvgnxhpdNrrpY2Yy1HNZagZXbw= 2024-04-16T18:21:48.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nqvgnxhpdNrrpY2Yy1HNZagZXbw=', 'Content-Length': '0'} 2024-04-16T18:21:48.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017bc8659d53f3e03-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.755 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.755 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.755 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.755 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:48.755 DEBUG:boto:Data: 2024-04-16T18:21:48.755 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.756 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.756 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.756 DEBUG:boto:Params: {} 2024-04-16T18:21:48.756 DEBUG:boto:Token: None 2024-04-16T18:21:48.756 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85 2024-04-16T18:21:48.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nqvgnxhpdNrrpY2Yy1HNZagZXbw= 2024-04-16T18:21:48.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nqvgnxhpdNrrpY2Yy1HNZagZXbw=', 'Content-Length': '0'} 2024-04-16T18:21:48.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049ec0208a3444260-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:21:48.758 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.759 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.759 DEBUG:boto:Method: GET 2024-04-16T18:21:48.759 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:48.759 DEBUG:boto:Data: 2024-04-16T18:21:48.759 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.759 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.759 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.759 DEBUG:boto:Params: {} 2024-04-16T18:21:48.759 DEBUG:boto:Token: None 2024-04-16T18:21:48.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85 2024-04-16T18:21:48.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TPJli8/AM4nhExkf3KiqZ5aeoIs= 2024-04-16T18:21:48.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TPJli8/AM4nhExkf3KiqZ5aeoIs=', 'Content-Length': '0'} 2024-04-16T18:21:48.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ace1cdbb85a4f55-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.802 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:21:48.802 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:21:48.803 DEBUG:boto:Method: GET 2024-04-16T18:21:48.803 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:21:48.803 DEBUG:boto:Data: 2024-04-16T18:21:48.803 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.803 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.803 DEBUG:boto:Params: {} 2024-04-16T18:21:48.803 DEBUG:boto:Token: None 2024-04-16T18:21:48.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj85 2024-04-16T18:21:48.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TPJli8/AM4nhExkf3KiqZ5aeoIs= 2024-04-16T18:21:48.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TPJli8/AM4nhExkf3KiqZ5aeoIs=', 'Content-Length': '0'} 2024-04-16T18:21:48.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a33af28f592bfef4-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.806 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.806 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.806 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.806 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.806 DEBUG:boto:Method: GET 2024-04-16T18:21:48.806 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.806 DEBUG:boto:Data: 2024-04-16T18:21:48.806 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.806 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.807 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.807 DEBUG:boto:Params: {} 2024-04-16T18:21:48.807 DEBUG:boto:Token: None 2024-04-16T18:21:48.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092b168dcaff3873f-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.850 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.851 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.851 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.851 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.851 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.851 DEBUG:boto:Method: GET 2024-04-16T18:21:48.851 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:21:48.851 DEBUG:boto:Data: 2024-04-16T18:21:48.852 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.852 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.852 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.852 DEBUG:boto:Params: {} 2024-04-16T18:21:48.852 DEBUG:boto:Token: None 2024-04-16T18:21:48.852 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.855 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e71429499cf84ae8-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.855 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.856 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:21:48.856 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.856 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.856 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.856 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.857 DEBUG:boto:Method: GET 2024-04-16T18:21:48.857 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.857 DEBUG:boto:Data: 2024-04-16T18:21:48.857 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.857 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.857 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.858 DEBUG:boto:Params: {} 2024-04-16T18:21:48.858 DEBUG:boto:Token: None 2024-04-16T18:21:48.858 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.858 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw= 2024-04-16T18:21:48.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw=', 'Content-Length': '0'} 2024-04-16T18:21:48.861 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d833d7cc066d3339-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.902 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.903 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.903 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.903 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.903 DEBUG:boto:Method: GET 2024-04-16T18:21:48.903 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.903 DEBUG:boto:Data: 2024-04-16T18:21:48.903 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.903 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.903 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.904 DEBUG:boto:Params: {} 2024-04-16T18:21:48.904 DEBUG:boto:Token: None 2024-04-16T18:21:48.904 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw= 2024-04-16T18:21:48.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw=', 'Content-Length': '0'} 2024-04-16T18:21:48.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db6474f8d2e8ac81-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.907 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.907 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.907 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.907 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.907 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.907 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.907 DEBUG:boto:Data: 2024-04-16T18:21:48.907 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.907 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.908 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.908 DEBUG:boto:Params: {} 2024-04-16T18:21:48.908 DEBUG:boto:Token: None 2024-04-16T18:21:48.908 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HJ0kyCqrh40isPEfl6G27sNT4so= 2024-04-16T18:21:48.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HJ0kyCqrh40isPEfl6G27sNT4so=', 'Content-Length': '0'} 2024-04-16T18:21:48.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000929c90647f278c7a-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.911 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.911 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.911 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.911 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.911 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.911 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.911 DEBUG:boto:Data: 2024-04-16T18:21:48.911 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.912 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.912 DEBUG:boto:Params: {} 2024-04-16T18:21:48.912 DEBUG:boto:Token: None 2024-04-16T18:21:48.912 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HJ0kyCqrh40isPEfl6G27sNT4so= 2024-04-16T18:21:48.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HJ0kyCqrh40isPEfl6G27sNT4so=', 'Content-Length': '0'} 2024-04-16T18:21:48.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e48b1ad53f59c8-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:21:48.915 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.915 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.915 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.915 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.915 DEBUG:boto:Method: GET 2024-04-16T18:21:48.915 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.915 DEBUG:boto:Data: 2024-04-16T18:21:48.915 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.915 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.916 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.916 DEBUG:boto:Params: {} 2024-04-16T18:21:48.916 DEBUG:boto:Token: None 2024-04-16T18:21:48.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw= 2024-04-16T18:21:48.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw=', 'Content-Length': '0'} 2024-04-16T18:21:48.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f93cda382f62883-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.958 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.959 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.959 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.959 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.959 DEBUG:boto:Method: GET 2024-04-16T18:21:48.959 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.959 DEBUG:boto:Data: 2024-04-16T18:21:48.959 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.959 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.959 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.959 DEBUG:boto:Params: {} 2024-04-16T18:21:48.960 DEBUG:boto:Token: None 2024-04-16T18:21:48.960 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:21:48.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw= 2024-04-16T18:21:48.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DkCD3MZC4QZsK98z/GBiGw01sNw=', 'Content-Length': '0'} 2024-04-16T18:21:48.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000435f223a2804de77-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.962 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.963 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.963 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:48.963 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:48.963 DEBUG:boto:Method: GET 2024-04-16T18:21:48.963 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:21:48.963 DEBUG:boto:Data: 2024-04-16T18:21:48.963 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.963 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.963 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.963 DEBUG:boto:Params: {} 2024-04-16T18:21:48.963 DEBUG:boto:Token: None 2024-04-16T18:21:48.964 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.966 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002288fb87944fb263-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.966 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.967 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:48.967 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:48.967 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:48.967 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:48.967 DEBUG:boto:Method: GET 2024-04-16T18:21:48.967 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:21:48.967 DEBUG:boto:Data: 2024-04-16T18:21:48.967 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.968 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.968 DEBUG:boto:Params: {} 2024-04-16T18:21:48.968 DEBUG:boto:Token: None 2024-04-16T18:21:48.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/ 2024-04-16T18:21:48.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg= 2024-04-16T18:21:48.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Rg2wRHkRha7D01aqK91aTq6J9Hg=', 'Content-Length': '0'} 2024-04-16T18:21:48.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000091dcc136a0b11e69-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.971 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:48.971 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.972 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.972 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.972 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:21:48.972 DEBUG:boto:Data: 2024-04-16T18:21:48.972 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.972 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.972 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.972 DEBUG:boto:Params: {} 2024-04-16T18:21:48.972 DEBUG:boto:Token: None 2024-04-16T18:21:48.972 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95 2024-04-16T18:21:48.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nVUq82DZaoDGQlb10EjsWsnJk8o= 2024-04-16T18:21:48.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nVUq82DZaoDGQlb10EjsWsnJk8o=', 'Content-Length': '0'} 2024-04-16T18:21:48.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e80a2e8848d67d3-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.975 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.975 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.975 DEBUG:boto:Method: HEAD 2024-04-16T18:21:48.975 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:21:48.975 DEBUG:boto:Data: 2024-04-16T18:21:48.975 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.976 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:48.976 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.976 DEBUG:boto:Params: {} 2024-04-16T18:21:48.976 DEBUG:boto:Token: None 2024-04-16T18:21:48.976 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95 2024-04-16T18:21:48.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nVUq82DZaoDGQlb10EjsWsnJk8o= 2024-04-16T18:21:48.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nVUq82DZaoDGQlb10EjsWsnJk8o=', 'Content-Length': '0'} 2024-04-16T18:21:48.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007eb7eea7404c7d24-00661ec1bc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:48.978 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:21:48.978 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:48.978 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:48.978 DEBUG:boto:Method: GET 2024-04-16T18:21:48.979 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:21:48.979 DEBUG:boto:Data: 2024-04-16T18:21:48.979 DEBUG:boto:Headers: {} 2024-04-16T18:21:48.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:48.979 DEBUG:boto:Port: 8000 2024-04-16T18:21:48.979 DEBUG:boto:Params: {} 2024-04-16T18:21:48.979 DEBUG:boto:Token: None 2024-04-16T18:21:48.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:48 GMT /cjqttm-52/obj95 2024-04-16T18:21:48.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j1xaIgQqmlkBsQPB4OwlzsDOWFg= 2024-04-16T18:21:48.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j1xaIgQqmlkBsQPB4OwlzsDOWFg=', 'Content-Length': '0'} 2024-04-16T18:21:48.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008319b0bc8adfde01-00661ec1bc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.022 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:21:49.022 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:21:49.022 DEBUG:boto:Method: GET 2024-04-16T18:21:49.023 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:21:49.023 DEBUG:boto:Data: 2024-04-16T18:21:49.023 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.023 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.023 DEBUG:boto:Params: {} 2024-04-16T18:21:49.023 DEBUG:boto:Token: None 2024-04-16T18:21:49.023 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/obj95 2024-04-16T18:21:49.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BLXvWAKl5sa4GWStszjy4X42VWQ= 2024-04-16T18:21:49.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BLXvWAKl5sa4GWStszjy4X42VWQ=', 'Content-Length': '0'} 2024-04-16T18:21:49.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a28b7eb0de29a46f-00661ec1bd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.026 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:49.026 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:49.026 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:49.026 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:49.026 DEBUG:boto:Method: GET 2024-04-16T18:21:49.027 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:21:49.027 DEBUG:boto:Data: 2024-04-16T18:21:49.027 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.027 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:21:49.027 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.027 DEBUG:boto:Params: {} 2024-04-16T18:21:49.027 DEBUG:boto:Token: None 2024-04-16T18:21:49.027 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/ 2024-04-16T18:21:49.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E9uUFdsqSWnIxPYKQIHSzRG31S0= 2024-04-16T18:21:49.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E9uUFdsqSWnIxPYKQIHSzRG31S0=', 'Content-Length': '0'} 2024-04-16T18:21:49.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9d84e28c8891334-00661ec1bd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.030 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:49.030 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:49.030 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:49.030 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:49.031 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:21:49.031 DEBUG:boto:Method: GET 2024-04-16T18:21:49.031 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:21:49.031 DEBUG:boto:Data: 2024-04-16T18:21:49.031 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.031 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.031 DEBUG:boto:Params: {} 2024-04-16T18:21:49.031 DEBUG:boto:Token: None 2024-04-16T18:21:49.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/ 2024-04-16T18:21:49.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E9uUFdsqSWnIxPYKQIHSzRG31S0= 2024-04-16T18:21:49.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E9uUFdsqSWnIxPYKQIHSzRG31S0=', 'Content-Length': '0'} 2024-04-16T18:21:49.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de93f9320f4e54e5-00661ec1bd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.035 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:21:49.035 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:21:49.035 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:21:49.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:21:49.035 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:21:49.093 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:21:49.094 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:21:49.164 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:21:49.164 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-52 2024-04-16T18:21:49.173 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 15 2024-04-16T18:21:49.233 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:49.233 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:49.234 DEBUG:boto:Method: HEAD 2024-04-16T18:21:49.234 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:49.234 DEBUG:boto:Data: 2024-04-16T18:21:49.234 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.234 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.234 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.234 DEBUG:boto:Params: {} 2024-04-16T18:21:49.234 DEBUG:boto:Token: None 2024-04-16T18:21:49.234 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/ 2024-04-16T18:21:49.234 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg= 2024-04-16T18:21:49.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg=', 'Content-Length': '0'} 2024-04-16T18:21:49.237 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fa7027e148d7beb4-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.238 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:21:49.238 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:21:49.238 DEBUG:boto:Method: PUT 2024-04-16T18:21:49.238 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:21:49.238 DEBUG:boto:Data: 2024-04-16T18:21:49.238 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:49.238 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.238 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.238 DEBUG:boto:Params: {} 2024-04-16T18:21:49.239 DEBUG:boto:Token: None 2024-04-16T18:21:49.239 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/obj23 2024-04-16T18:21:49.239 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cw/eMLq+5T8b6fIjAwIei1UMv98= 2024-04-16T18:21:49.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cw/eMLq+5T8b6fIjAwIei1UMv98='} 2024-04-16T18:21:49.244 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000078038584fe596aca-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.245 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:49.245 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:49.245 DEBUG:boto:Method: HEAD 2024-04-16T18:21:49.245 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:49.245 DEBUG:boto:Data: 2024-04-16T18:21:49.245 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.245 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.245 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.245 DEBUG:boto:Params: {} 2024-04-16T18:21:49.245 DEBUG:boto:Token: None 2024-04-16T18:21:49.246 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/ 2024-04-16T18:21:49.246 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg= 2024-04-16T18:21:49.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg=', 'Content-Length': '0'} 2024-04-16T18:21:49.248 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f4eb9f615eaec40b-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.248 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:21:49.248 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:21:49.249 DEBUG:boto:Method: PUT 2024-04-16T18:21:49.249 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:21:49.249 DEBUG:boto:Data: 2024-04-16T18:21:49.249 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:49.249 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.249 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.249 DEBUG:boto:Params: {} 2024-04-16T18:21:49.249 DEBUG:boto:Token: None 2024-04-16T18:21:49.249 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/obj46 2024-04-16T18:21:49.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDw1i5nu0hwtRrdxm0APbMyVX+0= 2024-04-16T18:21:49.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDw1i5nu0hwtRrdxm0APbMyVX+0='} 2024-04-16T18:21:49.294 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e4217e9f957df4be-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.295 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:49.295 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:49.295 DEBUG:boto:Method: HEAD 2024-04-16T18:21:49.295 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:49.295 DEBUG:boto:Data: 2024-04-16T18:21:49.295 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.295 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.296 DEBUG:boto:Params: {} 2024-04-16T18:21:49.296 DEBUG:boto:Token: None 2024-04-16T18:21:49.297 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/ 2024-04-16T18:21:49.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg= 2024-04-16T18:21:49.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg=', 'Content-Length': '0'} 2024-04-16T18:21:49.300 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000830bc42966ca00cf-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.300 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:21:49.300 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:21:49.300 DEBUG:boto:Method: PUT 2024-04-16T18:21:49.301 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:21:49.301 DEBUG:boto:Data: 2024-04-16T18:21:49.301 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:49.301 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.301 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.301 DEBUG:boto:Params: {} 2024-04-16T18:21:49.301 DEBUG:boto:Token: None 2024-04-16T18:21:49.301 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/obj69 2024-04-16T18:21:49.301 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NectY8vrz8qFOi/qovQ+KmLoAi0= 2024-04-16T18:21:49.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NectY8vrz8qFOi/qovQ+KmLoAi0='} 2024-04-16T18:21:49.307 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f1c074435d23f01f-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.307 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:49.307 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:49.307 DEBUG:boto:Method: HEAD 2024-04-16T18:21:49.308 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:49.308 DEBUG:boto:Data: 2024-04-16T18:21:49.308 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.308 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.308 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.308 DEBUG:boto:Params: {} 2024-04-16T18:21:49.308 DEBUG:boto:Token: None 2024-04-16T18:21:49.308 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/ 2024-04-16T18:21:49.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg= 2024-04-16T18:21:49.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg=', 'Content-Length': '0'} 2024-04-16T18:21:49.311 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000074dd48d2043c42d1-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.311 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:21:49.311 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:21:49.311 DEBUG:boto:Method: PUT 2024-04-16T18:21:49.311 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:21:49.311 DEBUG:boto:Data: 2024-04-16T18:21:49.311 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:49.312 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.312 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.312 DEBUG:boto:Params: {} 2024-04-16T18:21:49.312 DEBUG:boto:Token: None 2024-04-16T18:21:49.312 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/obj92 2024-04-16T18:21:49.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GS2EU9+P7Ct++5bvzlQa2RQwlz4= 2024-04-16T18:21:49.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GS2EU9+P7Ct++5bvzlQa2RQwlz4='} 2024-04-16T18:21:49.354 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a787b00bdc517eda-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.355 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:21:49.355 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:21:49.355 DEBUG:boto:Method: HEAD 2024-04-16T18:21:49.355 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:21:49.355 DEBUG:boto:Data: 2024-04-16T18:21:49.355 DEBUG:boto:Headers: {} 2024-04-16T18:21:49.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.355 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.355 DEBUG:boto:Params: {} 2024-04-16T18:21:49.355 DEBUG:boto:Token: None 2024-04-16T18:21:49.356 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/ 2024-04-16T18:21:49.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg= 2024-04-16T18:21:49.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yQbENlGoN5dmbLgyIua4gA9uUIg=', 'Content-Length': '0'} 2024-04-16T18:21:49.358 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002596c5198471afb9-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.358 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:21:49.359 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:21:49.359 DEBUG:boto:Method: PUT 2024-04-16T18:21:49.359 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:21:49.359 DEBUG:boto:Data: 2024-04-16T18:21:49.359 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:21:49.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:21:49.359 DEBUG:boto:Port: 8000 2024-04-16T18:21:49.359 DEBUG:boto:Params: {} 2024-04-16T18:21:49.359 DEBUG:boto:Token: None 2024-04-16T18:21:49.360 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:21:49 GMT /cjqttm-52/obj115 2024-04-16T18:21:49.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k1EXhAfBRGKEJWmZoAgQx3a5yoE= 2024-04-16T18:21:49.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:21:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1EXhAfBRGKEJWmZoAgQx3a5yoE='} 2024-04-16T18:21:49.366 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000519722af6c712f84-00661ec1bd-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:21:49.366 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:21:49.366 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:21:49.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:21:49.366 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:21:49.427 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:21:49.427 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:21:49.486 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:49.486+0000 7fbf88375800 1 waiting to reach latest gen 3, on 2.. 2024-04-16T18:21:54.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:54.488+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:54.488 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:21:54.488 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:21:59.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:21:59.490+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:21:59.490 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:21:59.490 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:04.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:04.492+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:04.492 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:22:04.492 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:09.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:09.495+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:09.494 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:22:09.494 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:14.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:14.496+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:14.495 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:14.495 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:19.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:19.498+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:19.497 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:19.497 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:24.498 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:24.499+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:24.498 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:24.499 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:29.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:29.500+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:29.500 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:29.500 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:34.502 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:34.502+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:34.503 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:34.503 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:39.504 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:39.504+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:39.504 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:39.504 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:44.505 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:44.506+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:44.506 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:44.506 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:49.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:49.507+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:49.507 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , , , , , , , 00000000001.84.6, , , , , , ] 2024-04-16T18:22:49.507 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:54.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:54.509+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:54.509 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:54.509 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:59.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:22:59.512+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:22:59.511 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:22:59.511 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:04.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:04.513+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:04.512 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:04.512 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:09.514 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:09.515+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:09.514 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:09.514 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:14.515 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:14.516+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:14.516 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:14.516 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:19.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:19.518+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:19.518 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:19.518 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:24.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:24.519+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:24.519 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:24.519 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:29.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:29.521+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:29.521 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:29.521 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:34.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:34.523+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:34.522 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:34.522 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:39.524+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:39.524 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:39.524 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:44.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:44.527+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:44.526 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:44.526 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:49.528 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:49.529+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:49.528 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:49.528 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:54.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:54.530+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:54.529 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:54.529 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:59.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:23:59.531+0000 7fbf88375800 1 waiting for incremental sync to catch up: 2024-04-16T18:23:59.531 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:23:59.531 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:24:04.532 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:04.533+0000 7fbf88375800 1 bucket sync caught up with source: 2024-04-16T18:24:04.533 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:24:04.533 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.96.6, , , 00000000002.84.6, , 00000000002.86.6, , , , , , 00000000001.84.6, , 00000000001.49.6, , , , ] 2024-04-16T18:24:04.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:04.533+0000 7fbf88375800 0 bucket checkpoint complete 2024-04-16T18:24:04.559 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:24:04.560 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:24:04.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:24:04.560 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:24:04.623 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:24:04.623 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:24:04.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:24:04.687+0000 7f2dffa3d800 1 bucket sync caught up with source: 2024-04-16T18:24:04.686 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.544.6, 00000000002.673.6, 00000000001.1301.6, 00000000002.428.6, 00000000002.271.6, , , 00000000002.877.6, 00000000005.166.6, 00000000004.767.6] 2024-04-16T18:24:04.686 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.544.6, 00000000002.673.6, 00000000001.1301.6, 00000000002.428.6, 00000000002.271.6, , , 00000000002.877.6, 00000000005.166.6, 00000000004.767.6] 2024-04-16T18:24:04.686 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:24:04.687+0000 7f2dffa3d800 0 bucket checkpoint complete 2024-04-16T18:24:04.708 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:24:04.708 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.708 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.709 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.709 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:24:04.709 DEBUG:boto:Data: 2024-04-16T18:24:04.709 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.709 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.709 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.709 DEBUG:boto:Params: {} 2024-04-16T18:24:04.710 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:24:04.710 DEBUG:boto:Token: None 2024-04-16T18:24:04.710 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.710 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l00q0X8Npg9XXPHa6KTrs69hDZM= 2024-04-16T18:24:04.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l00q0X8Npg9XXPHa6KTrs69hDZM=', 'Content-Length': '0'} 2024-04-16T18:24:04.716 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000467d003d57429787-00661ec244-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.716 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.716 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.716 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.716 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:24:04.716 DEBUG:boto:Data: 2024-04-16T18:24:04.716 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.716 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.716 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.717 DEBUG:boto:Params: {} 2024-04-16T18:24:04.717 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:24:04.717 DEBUG:boto:Token: None 2024-04-16T18:24:04.717 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.717 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l00q0X8Npg9XXPHa6KTrs69hDZM= 2024-04-16T18:24:04.717 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l00q0X8Npg9XXPHa6KTrs69hDZM=', 'Content-Length': '0'} 2024-04-16T18:24:04.721 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000076d2db623f389419-00661ec244-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.722 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:24:04.722 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.722 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.722 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.722 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.722 DEBUG:boto:Method: GET 2024-04-16T18:24:04.722 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.722 DEBUG:boto:Data: 2024-04-16T18:24:04.722 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.722 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.723 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.723 DEBUG:boto:Params: {} 2024-04-16T18:24:04.723 DEBUG:boto:Token: None 2024-04-16T18:24:04.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/?versions 2024-04-16T18:24:04.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc= 2024-04-16T18:24:04.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc=', 'Content-Length': '0'} 2024-04-16T18:24:04.725 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009164c5c098550bd2-00661ec244-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.726 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:24:04.727 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:24:04.728 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:24:04.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:24:04.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:24:04.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:24:04.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:24:04.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:24:04.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:24:04.729 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:24:04.729 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.729 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.729 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.729 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.729 DEBUG:boto:Method: GET 2024-04-16T18:24:04.730 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.730 DEBUG:boto:Data: 2024-04-16T18:24:04.730 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.730 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.730 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.730 DEBUG:boto:Params: {} 2024-04-16T18:24:04.730 DEBUG:boto:Token: None 2024-04-16T18:24:04.730 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/?versions 2024-04-16T18:24:04.730 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc= 2024-04-16T18:24:04.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc=', 'Content-Length': '0'} 2024-04-16T18:24:04.733 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a3c30bac257debe-00661ec244-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.733 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.734 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:24:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:24:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:24:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:24:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:24:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:24:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:24:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:24:04.736 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.736 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.736 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.736 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.736 DEBUG:boto:Method: GET 2024-04-16T18:24:04.737 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.737 DEBUG:boto:Data: 2024-04-16T18:24:04.737 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.737 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.737 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.737 DEBUG:boto:Params: {} 2024-04-16T18:24:04.737 DEBUG:boto:Token: None 2024-04-16T18:24:04.737 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/?versions 2024-04-16T18:24:04.737 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc= 2024-04-16T18:24:04.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc=', 'Content-Length': '0'} 2024-04-16T18:24:04.740 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060af1f1c8f8c3f27-00661ec244-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.740 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.741 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.741 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.741 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.741 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.742 DEBUG:boto:Method: GET 2024-04-16T18:24:04.742 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:24:04.742 DEBUG:boto:Data: 2024-04-16T18:24:04.742 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.742 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.742 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.742 DEBUG:boto:Params: {} 2024-04-16T18:24:04.742 DEBUG:boto:Token: None 2024-04-16T18:24:04.742 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/?versions 2024-04-16T18:24:04.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc= 2024-04-16T18:24:04.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZWm98xCQ1o12Uy/jt9NiRge0YRc=', 'Content-Length': '0'} 2024-04-16T18:24:04.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000597e4d187ff734f9-00661ec244-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.746 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:24:04.747 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.747 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.747 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.747 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.747 DEBUG:boto:Method: GET 2024-04-16T18:24:04.748 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.748 DEBUG:boto:Data: 2024-04-16T18:24:04.748 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.748 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.748 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.748 DEBUG:boto:Params: {} 2024-04-16T18:24:04.748 DEBUG:boto:Token: None 2024-04-16T18:24:04.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ= 2024-04-16T18:24:04.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ=', 'Content-Length': '0'} 2024-04-16T18:24:04.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6338539a8144ae9-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.751 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.751 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.751 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.751 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.751 DEBUG:boto:Method: GET 2024-04-16T18:24:04.751 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.751 DEBUG:boto:Data: 2024-04-16T18:24:04.752 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.752 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.752 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.752 DEBUG:boto:Params: {} 2024-04-16T18:24:04.752 DEBUG:boto:Token: None 2024-04-16T18:24:04.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ= 2024-04-16T18:24:04.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ=', 'Content-Length': '0'} 2024-04-16T18:24:04.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b0e8c1843e66c94-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.754 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.754 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.754 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.755 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.755 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.755 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.755 DEBUG:boto:Data: 2024-04-16T18:24:04.755 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.755 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.755 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.755 DEBUG:boto:Params: {} 2024-04-16T18:24:04.755 DEBUG:boto:Token: None 2024-04-16T18:24:04.755 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u/gd45HW+rUDZ8s5K302GsACECo= 2024-04-16T18:24:04.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u/gd45HW+rUDZ8s5K302GsACECo=', 'Content-Length': '0'} 2024-04-16T18:24:04.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000855c3fb04143cd35-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.758 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.758 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.758 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.758 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.758 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.758 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.758 DEBUG:boto:Data: 2024-04-16T18:24:04.758 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.758 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.759 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.759 DEBUG:boto:Params: {} 2024-04-16T18:24:04.759 DEBUG:boto:Token: None 2024-04-16T18:24:04.759 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u/gd45HW+rUDZ8s5K302GsACECo= 2024-04-16T18:24:04.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u/gd45HW+rUDZ8s5K302GsACECo=', 'Content-Length': '0'} 2024-04-16T18:24:04.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096362c75a46b6015-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.761 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:24:04.761 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.761 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.762 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.762 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.762 DEBUG:boto:Method: GET 2024-04-16T18:24:04.762 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.762 DEBUG:boto:Data: 2024-04-16T18:24:04.762 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.762 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.762 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.762 DEBUG:boto:Params: {} 2024-04-16T18:24:04.763 DEBUG:boto:Token: None 2024-04-16T18:24:04.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ= 2024-04-16T18:24:04.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ=', 'Content-Length': '0'} 2024-04-16T18:24:04.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053bd03086d319672-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.806 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.806 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.806 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.807 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.807 DEBUG:boto:Method: GET 2024-04-16T18:24:04.807 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.807 DEBUG:boto:Data: 2024-04-16T18:24:04.807 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.807 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.807 DEBUG:boto:Params: {} 2024-04-16T18:24:04.807 DEBUG:boto:Token: None 2024-04-16T18:24:04.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:24:04.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ= 2024-04-16T18:24:04.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gkac5CeAlNGNEamKzRKhIgO+byQ=', 'Content-Length': '0'} 2024-04-16T18:24:04.810 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af1758e50f3fa1fb-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.810 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.810 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.810 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.810 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.810 DEBUG:boto:Method: GET 2024-04-16T18:24:04.810 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.811 DEBUG:boto:Data: 2024-04-16T18:24:04.811 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.811 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.811 DEBUG:boto:Params: {} 2024-04-16T18:24:04.811 DEBUG:boto:Token: None 2024-04-16T18:24:04.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.814 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba9595227a90900c-00661ec244-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.814 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.814 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.815 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.815 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.815 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.815 DEBUG:boto:Method: GET 2024-04-16T18:24:04.815 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.815 DEBUG:boto:Data: 2024-04-16T18:24:04.815 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.815 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.815 DEBUG:boto:Params: {} 2024-04-16T18:24:04.816 DEBUG:boto:Token: None 2024-04-16T18:24:04.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.818 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006cca3a3e6e448966-00661ec244-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.818 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.819 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.819 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.819 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.819 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:24:04.819 DEBUG:boto:Data: 2024-04-16T18:24:04.819 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.819 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.819 DEBUG:boto:Params: {} 2024-04-16T18:24:04.820 DEBUG:boto:Token: None 2024-04-16T18:24:04.820 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11 2024-04-16T18:24:04.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Vag6T41EGNFTn5blDizqzEH+jU= 2024-04-16T18:24:04.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Vag6T41EGNFTn5blDizqzEH+jU=', 'Content-Length': '0'} 2024-04-16T18:24:04.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca2066060195ef8d-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.822 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.822 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.823 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.823 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:24:04.823 DEBUG:boto:Data: 2024-04-16T18:24:04.823 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.823 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.823 DEBUG:boto:Params: {} 2024-04-16T18:24:04.823 DEBUG:boto:Token: None 2024-04-16T18:24:04.823 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11 2024-04-16T18:24:04.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Vag6T41EGNFTn5blDizqzEH+jU= 2024-04-16T18:24:04.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Vag6T41EGNFTn5blDizqzEH+jU=', 'Content-Length': '0'} 2024-04-16T18:24:04.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008dd5b488db2aa7a1-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.825 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:24:04.826 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.826 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.826 DEBUG:boto:Method: GET 2024-04-16T18:24:04.826 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:24:04.826 DEBUG:boto:Data: 2024-04-16T18:24:04.826 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.826 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.826 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.826 DEBUG:boto:Params: {} 2024-04-16T18:24:04.827 DEBUG:boto:Token: None 2024-04-16T18:24:04.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11 2024-04-16T18:24:04.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4TJ/Nd1TxyaKgVO6v0oIBMXRhYw= 2024-04-16T18:24:04.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4TJ/Nd1TxyaKgVO6v0oIBMXRhYw=', 'Content-Length': '0'} 2024-04-16T18:24:04.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d899f7bee64bc8e0-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.829 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:24:04.829 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:24:04.829 DEBUG:boto:Method: GET 2024-04-16T18:24:04.829 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:24:04.830 DEBUG:boto:Data: 2024-04-16T18:24:04.830 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.830 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.830 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.830 DEBUG:boto:Params: {} 2024-04-16T18:24:04.830 DEBUG:boto:Token: None 2024-04-16T18:24:04.830 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj11 2024-04-16T18:24:04.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4TJ/Nd1TxyaKgVO6v0oIBMXRhYw= 2024-04-16T18:24:04.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4TJ/Nd1TxyaKgVO6v0oIBMXRhYw=', 'Content-Length': '0'} 2024-04-16T18:24:04.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ee26234c5b1e3a6-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.833 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.833 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.833 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.833 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.833 DEBUG:boto:Method: GET 2024-04-16T18:24:04.833 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.833 DEBUG:boto:Data: 2024-04-16T18:24:04.833 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.833 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.834 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.834 DEBUG:boto:Params: {} 2024-04-16T18:24:04.834 DEBUG:boto:Token: None 2024-04-16T18:24:04.834 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.834 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000576cd91f789341e0-00661ec244-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.837 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.837 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.837 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.837 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.838 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.838 DEBUG:boto:Method: GET 2024-04-16T18:24:04.838 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:24:04.838 DEBUG:boto:Data: 2024-04-16T18:24:04.838 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.838 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.838 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.838 DEBUG:boto:Params: {} 2024-04-16T18:24:04.838 DEBUG:boto:Token: None 2024-04-16T18:24:04.838 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.838 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.841 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3f8ab8505aa0d5c-00661ec244-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.841 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.842 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:24:04.842 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.842 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.842 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.842 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.842 DEBUG:boto:Method: GET 2024-04-16T18:24:04.842 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.842 DEBUG:boto:Data: 2024-04-16T18:24:04.842 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.842 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.843 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.843 DEBUG:boto:Params: {} 2024-04-16T18:24:04.843 DEBUG:boto:Token: None 2024-04-16T18:24:04.843 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw= 2024-04-16T18:24:04.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw=', 'Content-Length': '0'} 2024-04-16T18:24:04.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ece89b5602bdae00-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.845 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.846 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.846 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.846 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.846 DEBUG:boto:Method: GET 2024-04-16T18:24:04.846 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.846 DEBUG:boto:Data: 2024-04-16T18:24:04.846 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.846 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.846 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.846 DEBUG:boto:Params: {} 2024-04-16T18:24:04.847 DEBUG:boto:Token: None 2024-04-16T18:24:04.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw= 2024-04-16T18:24:04.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw=', 'Content-Length': '0'} 2024-04-16T18:24:04.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b73d6e716748ca74-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.849 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.849 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.849 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.849 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.849 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.850 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.850 DEBUG:boto:Data: 2024-04-16T18:24:04.850 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.850 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.850 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.850 DEBUG:boto:Params: {} 2024-04-16T18:24:04.850 DEBUG:boto:Token: None 2024-04-16T18:24:04.850 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.850 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3MDuWnqt2P+jmZN9q24O2VTaea0= 2024-04-16T18:24:04.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3MDuWnqt2P+jmZN9q24O2VTaea0=', 'Content-Length': '0'} 2024-04-16T18:24:04.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d0888e2c286273c-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.853 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.853 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.853 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.853 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.853 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.853 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.853 DEBUG:boto:Data: 2024-04-16T18:24:04.853 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.853 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.853 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.853 DEBUG:boto:Params: {} 2024-04-16T18:24:04.854 DEBUG:boto:Token: None 2024-04-16T18:24:04.854 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.854 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3MDuWnqt2P+jmZN9q24O2VTaea0= 2024-04-16T18:24:04.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3MDuWnqt2P+jmZN9q24O2VTaea0=', 'Content-Length': '0'} 2024-04-16T18:24:04.856 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba3ace5d6c9c4bbd-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.856 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:24:04.856 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.856 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.857 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.857 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.857 DEBUG:boto:Method: GET 2024-04-16T18:24:04.857 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.857 DEBUG:boto:Data: 2024-04-16T18:24:04.857 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.857 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.857 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.857 DEBUG:boto:Params: {} 2024-04-16T18:24:04.857 DEBUG:boto:Token: None 2024-04-16T18:24:04.857 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.858 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw= 2024-04-16T18:24:04.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw=', 'Content-Length': '0'} 2024-04-16T18:24:04.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f494e536e46b68f-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.860 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.860 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.860 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.860 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.860 DEBUG:boto:Method: GET 2024-04-16T18:24:04.860 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.860 DEBUG:boto:Data: 2024-04-16T18:24:04.861 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.861 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.861 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.861 DEBUG:boto:Params: {} 2024-04-16T18:24:04.861 DEBUG:boto:Token: None 2024-04-16T18:24:04.861 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:24:04.861 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw= 2024-04-16T18:24:04.861 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RuGASZWQynUix/c7zQfu3woyPhw=', 'Content-Length': '0'} 2024-04-16T18:24:04.863 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009eb262f1a834de47-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.863 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.863 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.863 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.864 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.864 DEBUG:boto:Method: GET 2024-04-16T18:24:04.864 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.864 DEBUG:boto:Data: 2024-04-16T18:24:04.864 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.864 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.864 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.864 DEBUG:boto:Params: {} 2024-04-16T18:24:04.864 DEBUG:boto:Token: None 2024-04-16T18:24:04.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.865 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.867 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df03403520cf6535-00661ec244-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.867 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.868 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.868 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.868 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.868 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.868 DEBUG:boto:Method: GET 2024-04-16T18:24:04.868 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.868 DEBUG:boto:Data: 2024-04-16T18:24:04.869 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.869 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.869 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.869 DEBUG:boto:Params: {} 2024-04-16T18:24:04.869 DEBUG:boto:Token: None 2024-04-16T18:24:04.869 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.869 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.872 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000069498eff1374dc6-00661ec244-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.872 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.872 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.873 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.873 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.873 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:24:04.873 DEBUG:boto:Data: 2024-04-16T18:24:04.873 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.873 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.873 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.873 DEBUG:boto:Params: {} 2024-04-16T18:24:04.873 DEBUG:boto:Token: None 2024-04-16T18:24:04.873 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115 2024-04-16T18:24:04.874 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yxAvYbhTGAoJsELTr2IgY52+Vu4= 2024-04-16T18:24:04.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yxAvYbhTGAoJsELTr2IgY52+Vu4=', 'Content-Length': '0'} 2024-04-16T18:24:04.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dd1069e14d172bd-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.876 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.876 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.876 DEBUG:boto:Method: HEAD 2024-04-16T18:24:04.876 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:24:04.876 DEBUG:boto:Data: 2024-04-16T18:24:04.877 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.877 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.877 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.877 DEBUG:boto:Params: {} 2024-04-16T18:24:04.877 DEBUG:boto:Token: None 2024-04-16T18:24:04.877 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115 2024-04-16T18:24:04.877 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yxAvYbhTGAoJsELTr2IgY52+Vu4= 2024-04-16T18:24:04.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yxAvYbhTGAoJsELTr2IgY52+Vu4=', 'Content-Length': '0'} 2024-04-16T18:24:04.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fead0b44aacd6850-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.879 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:24:04.879 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.879 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.879 DEBUG:boto:Method: GET 2024-04-16T18:24:04.879 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:24:04.879 DEBUG:boto:Data: 2024-04-16T18:24:04.880 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.880 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.880 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.880 DEBUG:boto:Params: {} 2024-04-16T18:24:04.880 DEBUG:boto:Token: None 2024-04-16T18:24:04.880 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115 2024-04-16T18:24:04.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OIdwEic37IabMzvLrWV3Apyl26w= 2024-04-16T18:24:04.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OIdwEic37IabMzvLrWV3Apyl26w=', 'Content-Length': '0'} 2024-04-16T18:24:04.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f93859b5e03f5f5-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.926 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:24:04.926 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:24:04.927 DEBUG:boto:Method: GET 2024-04-16T18:24:04.927 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:24:04.927 DEBUG:boto:Data: 2024-04-16T18:24:04.927 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.927 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.927 DEBUG:boto:Params: {} 2024-04-16T18:24:04.927 DEBUG:boto:Token: None 2024-04-16T18:24:04.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj115 2024-04-16T18:24:04.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OIdwEic37IabMzvLrWV3Apyl26w= 2024-04-16T18:24:04.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OIdwEic37IabMzvLrWV3Apyl26w=', 'Content-Length': '0'} 2024-04-16T18:24:04.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009118acb091829ce4-00661ec244-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.930 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.930 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.930 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.930 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.930 DEBUG:boto:Method: GET 2024-04-16T18:24:04.930 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.930 DEBUG:boto:Data: 2024-04-16T18:24:04.930 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.931 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.931 DEBUG:boto:Params: {} 2024-04-16T18:24:04.931 DEBUG:boto:Token: None 2024-04-16T18:24:04.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b74082bc7b8f0925-00661ec244-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.974 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.975 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:04.975 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:04.975 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.975 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.975 DEBUG:boto:Method: GET 2024-04-16T18:24:04.975 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:24:04.975 DEBUG:boto:Data: 2024-04-16T18:24:04.975 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:04.975 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.976 DEBUG:boto:Params: {} 2024-04-16T18:24:04.976 DEBUG:boto:Token: None 2024-04-16T18:24:04.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/ 2024-04-16T18:24:04.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg= 2024-04-16T18:24:04.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FiXzLlMPHyZ6H4sZw6SkxBTFaOg=', 'Content-Length': '0'} 2024-04-16T18:24:04.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e48f40c5df91862a-00661ec244-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:04.979 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:04.979 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:24:04.979 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:04.979 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:04.979 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:04.979 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:04.979 DEBUG:boto:Method: GET 2024-04-16T18:24:04.980 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:04.980 DEBUG:boto:Data: 2024-04-16T18:24:04.980 DEBUG:boto:Headers: {} 2024-04-16T18:24:04.980 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:04.980 DEBUG:boto:Port: 8000 2024-04-16T18:24:04.980 DEBUG:boto:Params: {} 2024-04-16T18:24:04.980 DEBUG:boto:Token: None 2024-04-16T18:24:04.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:04 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:04.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vTXLEqRm/ftxPNXtBVVzd9h0bzs= 2024-04-16T18:24:04.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:04 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vTXLEqRm/ftxPNXtBVVzd9h0bzs=', 'Content-Length': '0'} 2024-04-16T18:24:04.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f3f8bbc0ce03bb1-00661ec244-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:04 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.026 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.026 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.027 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.027 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.027 DEBUG:boto:Method: GET 2024-04-16T18:24:05.027 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.027 DEBUG:boto:Data: 2024-04-16T18:24:05.027 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.027 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.027 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.027 DEBUG:boto:Params: {} 2024-04-16T18:24:05.027 DEBUG:boto:Token: None 2024-04-16T18:24:05.028 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.028 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPutxgtqqaRwKD9FXmCsUb4t1wY= 2024-04-16T18:24:05.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPutxgtqqaRwKD9FXmCsUb4t1wY=', 'Content-Length': '0'} 2024-04-16T18:24:05.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a474f602e3b51a19-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.030 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.030 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.030 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.030 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.030 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.030 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.030 DEBUG:boto:Data: 2024-04-16T18:24:05.030 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.031 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.031 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.031 DEBUG:boto:Params: {} 2024-04-16T18:24:05.031 DEBUG:boto:Token: None 2024-04-16T18:24:05.031 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HvWU3e/vKo7dGLL72M3+JsZr+QQ= 2024-04-16T18:24:05.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HvWU3e/vKo7dGLL72M3+JsZr+QQ=', 'Content-Length': '0'} 2024-04-16T18:24:05.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5c20df0573ce0a5-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.033 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.034 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.034 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.034 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.034 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.034 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.034 DEBUG:boto:Data: 2024-04-16T18:24:05.034 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.034 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.034 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.034 DEBUG:boto:Params: {} 2024-04-16T18:24:05.034 DEBUG:boto:Token: None 2024-04-16T18:24:05.035 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HvWU3e/vKo7dGLL72M3+JsZr+QQ= 2024-04-16T18:24:05.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HvWU3e/vKo7dGLL72M3+JsZr+QQ=', 'Content-Length': '0'} 2024-04-16T18:24:05.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000369d58714dbe60a0-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.037 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:24:05.037 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.037 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.037 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.037 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.037 DEBUG:boto:Method: GET 2024-04-16T18:24:05.037 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.038 DEBUG:boto:Data: 2024-04-16T18:24:05.038 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.038 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.038 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.038 DEBUG:boto:Params: {} 2024-04-16T18:24:05.038 DEBUG:boto:Token: None 2024-04-16T18:24:05.038 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.038 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPutxgtqqaRwKD9FXmCsUb4t1wY= 2024-04-16T18:24:05.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPutxgtqqaRwKD9FXmCsUb4t1wY=', 'Content-Length': '0'} 2024-04-16T18:24:05.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055f51cfa46afeead-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.082 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.082 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.083 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.083 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.083 DEBUG:boto:Method: GET 2024-04-16T18:24:05.083 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.083 DEBUG:boto:Data: 2024-04-16T18:24:05.083 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.083 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.083 DEBUG:boto:Params: {} 2024-04-16T18:24:05.083 DEBUG:boto:Token: None 2024-04-16T18:24:05.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:24:05.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KPutxgtqqaRwKD9FXmCsUb4t1wY= 2024-04-16T18:24:05.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KPutxgtqqaRwKD9FXmCsUb4t1wY=', 'Content-Length': '0'} 2024-04-16T18:24:05.086 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069047cf2273da7ea-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.086 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.086 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.086 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.086 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.087 DEBUG:boto:Method: GET 2024-04-16T18:24:05.087 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.087 DEBUG:boto:Data: 2024-04-16T18:24:05.087 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.087 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.087 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.087 DEBUG:boto:Params: {} 2024-04-16T18:24:05.087 DEBUG:boto:Token: None 2024-04-16T18:24:05.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.090 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c5257b4f2b0b0ac-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.130 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.130 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.131 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.131 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.131 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.131 DEBUG:boto:Method: GET 2024-04-16T18:24:05.131 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.131 DEBUG:boto:Data: 2024-04-16T18:24:05.131 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.131 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.131 DEBUG:boto:Params: {} 2024-04-16T18:24:05.132 DEBUG:boto:Token: None 2024-04-16T18:24:05.132 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000abed45ef1d6241a0-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.135 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.135 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.135 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.135 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.135 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:24:05.135 DEBUG:boto:Data: 2024-04-16T18:24:05.136 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.136 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.136 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.136 DEBUG:boto:Params: {} 2024-04-16T18:24:05.136 DEBUG:boto:Token: None 2024-04-16T18:24:05.136 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17 2024-04-16T18:24:05.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fs1klNRS0U+1pNX0Quz4mwNEHEY= 2024-04-16T18:24:05.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fs1klNRS0U+1pNX0Quz4mwNEHEY=', 'Content-Length': '0'} 2024-04-16T18:24:05.139 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb22ade657070bdd-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.139 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.139 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.139 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.139 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:24:05.139 DEBUG:boto:Data: 2024-04-16T18:24:05.139 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.140 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.140 DEBUG:boto:Params: {} 2024-04-16T18:24:05.140 DEBUG:boto:Token: None 2024-04-16T18:24:05.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17 2024-04-16T18:24:05.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fs1klNRS0U+1pNX0Quz4mwNEHEY= 2024-04-16T18:24:05.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fs1klNRS0U+1pNX0Quz4mwNEHEY=', 'Content-Length': '0'} 2024-04-16T18:24:05.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d39a6890ae2794ce-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.142 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:24:05.143 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.143 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.143 DEBUG:boto:Method: GET 2024-04-16T18:24:05.143 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:24:05.143 DEBUG:boto:Data: 2024-04-16T18:24:05.143 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.143 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.143 DEBUG:boto:Params: {} 2024-04-16T18:24:05.144 DEBUG:boto:Token: None 2024-04-16T18:24:05.145 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17 2024-04-16T18:24:05.145 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a6HLKNGtDYmUxQQ4rWoG+ZvvNnY= 2024-04-16T18:24:05.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a6HLKNGtDYmUxQQ4rWoG+ZvvNnY=', 'Content-Length': '0'} 2024-04-16T18:24:05.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9b24fa0cc4de7bd-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.190 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:24:05.190 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:24:05.191 DEBUG:boto:Method: GET 2024-04-16T18:24:05.191 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:24:05.191 DEBUG:boto:Data: 2024-04-16T18:24:05.191 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.191 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.191 DEBUG:boto:Params: {} 2024-04-16T18:24:05.191 DEBUG:boto:Token: None 2024-04-16T18:24:05.191 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj17 2024-04-16T18:24:05.191 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a6HLKNGtDYmUxQQ4rWoG+ZvvNnY= 2024-04-16T18:24:05.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a6HLKNGtDYmUxQQ4rWoG+ZvvNnY=', 'Content-Length': '0'} 2024-04-16T18:24:05.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e07a36cb6d617011-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.194 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.194 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.194 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.194 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.194 DEBUG:boto:Method: GET 2024-04-16T18:24:05.194 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.195 DEBUG:boto:Data: 2024-04-16T18:24:05.195 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.195 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.195 DEBUG:boto:Params: {} 2024-04-16T18:24:05.195 DEBUG:boto:Token: None 2024-04-16T18:24:05.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d208d73e3cb69b7f-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.238 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.239 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.239 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.239 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.239 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.239 DEBUG:boto:Method: GET 2024-04-16T18:24:05.239 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:24:05.239 DEBUG:boto:Data: 2024-04-16T18:24:05.239 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.240 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.240 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.240 DEBUG:boto:Params: {} 2024-04-16T18:24:05.240 DEBUG:boto:Token: None 2024-04-16T18:24:05.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063ebe41397e796df-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.243 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:24:05.243 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.244 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.244 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.244 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.244 DEBUG:boto:Method: GET 2024-04-16T18:24:05.244 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.244 DEBUG:boto:Data: 2024-04-16T18:24:05.244 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.244 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.244 DEBUG:boto:Params: {} 2024-04-16T18:24:05.245 DEBUG:boto:Token: None 2024-04-16T18:24:05.245 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.245 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko= 2024-04-16T18:24:05.245 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko=', 'Content-Length': '0'} 2024-04-16T18:24:05.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000641c56ad708d8595-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.290 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.290 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.291 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.291 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.291 DEBUG:boto:Method: GET 2024-04-16T18:24:05.291 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.291 DEBUG:boto:Data: 2024-04-16T18:24:05.291 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.291 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.291 DEBUG:boto:Params: {} 2024-04-16T18:24:05.291 DEBUG:boto:Token: None 2024-04-16T18:24:05.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko= 2024-04-16T18:24:05.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko=', 'Content-Length': '0'} 2024-04-16T18:24:05.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1ad9ee1347fd37a-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.294 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.294 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.294 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.294 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.294 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.294 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.294 DEBUG:boto:Data: 2024-04-16T18:24:05.294 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.295 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.295 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.295 DEBUG:boto:Params: {} 2024-04-16T18:24:05.295 DEBUG:boto:Token: None 2024-04-16T18:24:05.295 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5HdyNVfYovFRllli6laEckPU18= 2024-04-16T18:24:05.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5HdyNVfYovFRllli6laEckPU18=', 'Content-Length': '0'} 2024-04-16T18:24:05.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7c8b7d036174b6a-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.297 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.298 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.298 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.298 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.298 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.298 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.298 DEBUG:boto:Data: 2024-04-16T18:24:05.298 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.298 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.298 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.298 DEBUG:boto:Params: {} 2024-04-16T18:24:05.299 DEBUG:boto:Token: None 2024-04-16T18:24:05.299 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5HdyNVfYovFRllli6laEckPU18= 2024-04-16T18:24:05.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5HdyNVfYovFRllli6laEckPU18=', 'Content-Length': '0'} 2024-04-16T18:24:05.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009dc53b9c08867c77-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.301 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:24:05.301 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.301 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.301 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.301 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.301 DEBUG:boto:Method: GET 2024-04-16T18:24:05.301 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.302 DEBUG:boto:Data: 2024-04-16T18:24:05.302 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.302 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.302 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.302 DEBUG:boto:Params: {} 2024-04-16T18:24:05.302 DEBUG:boto:Token: None 2024-04-16T18:24:05.302 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.302 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko= 2024-04-16T18:24:05.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko=', 'Content-Length': '0'} 2024-04-16T18:24:05.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053520ce312513ead-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.346 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.346 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.347 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.347 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.347 DEBUG:boto:Method: GET 2024-04-16T18:24:05.347 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.347 DEBUG:boto:Data: 2024-04-16T18:24:05.347 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.347 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.347 DEBUG:boto:Params: {} 2024-04-16T18:24:05.347 DEBUG:boto:Token: None 2024-04-16T18:24:05.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:24:05.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko= 2024-04-16T18:24:05.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h/osTEOio2xKQ6wuujvwRw1M/Ko=', 'Content-Length': '0'} 2024-04-16T18:24:05.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000227604ae5a830af0-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.350 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.350 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.350 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.350 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.350 DEBUG:boto:Method: GET 2024-04-16T18:24:05.350 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.350 DEBUG:boto:Data: 2024-04-16T18:24:05.350 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.350 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.350 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.350 DEBUG:boto:Params: {} 2024-04-16T18:24:05.351 DEBUG:boto:Token: None 2024-04-16T18:24:05.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004203e551137a06b9-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.394 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.395 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.395 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.395 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.395 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.395 DEBUG:boto:Method: GET 2024-04-16T18:24:05.395 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.395 DEBUG:boto:Data: 2024-04-16T18:24:05.395 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.395 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.395 DEBUG:boto:Params: {} 2024-04-16T18:24:05.396 DEBUG:boto:Token: None 2024-04-16T18:24:05.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c865a6d071c247d0-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.398 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.399 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.399 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.399 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.399 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:24:05.399 DEBUG:boto:Data: 2024-04-16T18:24:05.399 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.399 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.399 DEBUG:boto:Params: {} 2024-04-16T18:24:05.400 DEBUG:boto:Token: None 2024-04-16T18:24:05.400 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19 2024-04-16T18:24:05.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7gG05TOV4mOBjQFAsfmaxgHm2ZA= 2024-04-16T18:24:05.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7gG05TOV4mOBjQFAsfmaxgHm2ZA=', 'Content-Length': '0'} 2024-04-16T18:24:05.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000953afc9b5252fc10-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.402 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.402 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.402 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.402 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:24:05.402 DEBUG:boto:Data: 2024-04-16T18:24:05.402 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.402 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.402 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.403 DEBUG:boto:Params: {} 2024-04-16T18:24:05.403 DEBUG:boto:Token: None 2024-04-16T18:24:05.403 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19 2024-04-16T18:24:05.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7gG05TOV4mOBjQFAsfmaxgHm2ZA= 2024-04-16T18:24:05.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7gG05TOV4mOBjQFAsfmaxgHm2ZA=', 'Content-Length': '0'} 2024-04-16T18:24:05.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bfde2d5e2786867-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.405 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:24:05.405 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.405 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.405 DEBUG:boto:Method: GET 2024-04-16T18:24:05.405 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:24:05.405 DEBUG:boto:Data: 2024-04-16T18:24:05.405 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.405 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.405 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.406 DEBUG:boto:Params: {} 2024-04-16T18:24:05.406 DEBUG:boto:Token: None 2024-04-16T18:24:05.406 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19 2024-04-16T18:24:05.406 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j3H5Q4PWA2BRoDktGNZC4Lhvxqs= 2024-04-16T18:24:05.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j3H5Q4PWA2BRoDktGNZC4Lhvxqs=', 'Content-Length': '0'} 2024-04-16T18:24:05.408 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a219a56ffb1e112-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.450 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:24:05.450 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:24:05.450 DEBUG:boto:Method: GET 2024-04-16T18:24:05.450 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:24:05.451 DEBUG:boto:Data: 2024-04-16T18:24:05.451 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.451 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.451 DEBUG:boto:Params: {} 2024-04-16T18:24:05.451 DEBUG:boto:Token: None 2024-04-16T18:24:05.451 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj19 2024-04-16T18:24:05.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j3H5Q4PWA2BRoDktGNZC4Lhvxqs= 2024-04-16T18:24:05.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j3H5Q4PWA2BRoDktGNZC4Lhvxqs=', 'Content-Length': '0'} 2024-04-16T18:24:05.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cc067dc24c3e852-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.453 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.453 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.453 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.453 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.453 DEBUG:boto:Method: GET 2024-04-16T18:24:05.453 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.454 DEBUG:boto:Data: 2024-04-16T18:24:05.454 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.454 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.454 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.454 DEBUG:boto:Params: {} 2024-04-16T18:24:05.454 DEBUG:boto:Token: None 2024-04-16T18:24:05.454 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.454 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.454 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.456 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1693b9421ebbe8a-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.457 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.457 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.457 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.457 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.457 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.457 DEBUG:boto:Method: GET 2024-04-16T18:24:05.457 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:24:05.457 DEBUG:boto:Data: 2024-04-16T18:24:05.458 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.458 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.458 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.458 DEBUG:boto:Params: {} 2024-04-16T18:24:05.458 DEBUG:boto:Token: None 2024-04-16T18:24:05.458 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.458 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.458 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001de6fe8959065091-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.461 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.462 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:24:05.462 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.462 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.462 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.462 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.462 DEBUG:boto:Method: GET 2024-04-16T18:24:05.462 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.462 DEBUG:boto:Data: 2024-04-16T18:24:05.462 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.463 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.463 DEBUG:boto:Params: {} 2024-04-16T18:24:05.463 DEBUG:boto:Token: None 2024-04-16T18:24:05.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8= 2024-04-16T18:24:05.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8=', 'Content-Length': '0'} 2024-04-16T18:24:05.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fa0928c0f6a0d45-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.506 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.506 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.507 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.507 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.507 DEBUG:boto:Method: GET 2024-04-16T18:24:05.507 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.507 DEBUG:boto:Data: 2024-04-16T18:24:05.507 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.507 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.507 DEBUG:boto:Params: {} 2024-04-16T18:24:05.507 DEBUG:boto:Token: None 2024-04-16T18:24:05.507 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8= 2024-04-16T18:24:05.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8=', 'Content-Length': '0'} 2024-04-16T18:24:05.509 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df886022e6a128e4-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.509 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.509 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.510 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.510 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.510 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.510 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.510 DEBUG:boto:Data: 2024-04-16T18:24:05.510 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.510 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.510 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.510 DEBUG:boto:Params: {} 2024-04-16T18:24:05.510 DEBUG:boto:Token: None 2024-04-16T18:24:05.510 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+MRWsX9GW55lZPuUk0+HgbpSvrw= 2024-04-16T18:24:05.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+MRWsX9GW55lZPuUk0+HgbpSvrw=', 'Content-Length': '0'} 2024-04-16T18:24:05.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082bb6fee3477766f-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.513 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.513 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.513 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.513 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.513 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.513 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.513 DEBUG:boto:Data: 2024-04-16T18:24:05.513 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.513 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.513 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.513 DEBUG:boto:Params: {} 2024-04-16T18:24:05.514 DEBUG:boto:Token: None 2024-04-16T18:24:05.514 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.514 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+MRWsX9GW55lZPuUk0+HgbpSvrw= 2024-04-16T18:24:05.514 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+MRWsX9GW55lZPuUk0+HgbpSvrw=', 'Content-Length': '0'} 2024-04-16T18:24:05.516 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ebe9819eaeead4b-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.516 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:24:05.516 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.516 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.516 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.516 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.516 DEBUG:boto:Method: GET 2024-04-16T18:24:05.516 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.516 DEBUG:boto:Data: 2024-04-16T18:24:05.517 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.517 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.517 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.517 DEBUG:boto:Params: {} 2024-04-16T18:24:05.517 DEBUG:boto:Token: None 2024-04-16T18:24:05.517 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.517 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8= 2024-04-16T18:24:05.517 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8=', 'Content-Length': '0'} 2024-04-16T18:24:05.519 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4e392a19dd3bd81-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.562 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.562 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.562 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.563 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.563 DEBUG:boto:Method: GET 2024-04-16T18:24:05.563 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.563 DEBUG:boto:Data: 2024-04-16T18:24:05.563 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.563 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.563 DEBUG:boto:Params: {} 2024-04-16T18:24:05.563 DEBUG:boto:Token: None 2024-04-16T18:24:05.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:24:05.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8= 2024-04-16T18:24:05.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CUDqIP7zDNP8qFU/eiDzPu8OwF8=', 'Content-Length': '0'} 2024-04-16T18:24:05.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000666f3d70889a0555-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.565 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.566 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.566 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.566 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.566 DEBUG:boto:Method: GET 2024-04-16T18:24:05.566 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.566 DEBUG:boto:Data: 2024-04-16T18:24:05.566 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.566 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.566 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.566 DEBUG:boto:Params: {} 2024-04-16T18:24:05.566 DEBUG:boto:Token: None 2024-04-16T18:24:05.567 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7379f9b2cc422b2-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.569 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.569 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.570 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.570 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.570 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.570 DEBUG:boto:Method: GET 2024-04-16T18:24:05.570 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.570 DEBUG:boto:Data: 2024-04-16T18:24:05.570 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.570 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.570 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.570 DEBUG:boto:Params: {} 2024-04-16T18:24:05.570 DEBUG:boto:Token: None 2024-04-16T18:24:05.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.571 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.574 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000510037c7069c4e34-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.574 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.574 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.574 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.574 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.574 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:24:05.575 DEBUG:boto:Data: 2024-04-16T18:24:05.575 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.575 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.575 DEBUG:boto:Params: {} 2024-04-16T18:24:05.575 DEBUG:boto:Token: None 2024-04-16T18:24:05.575 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22 2024-04-16T18:24:05.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AXgU30GQ4XgCiugFBf+dQMmiTks= 2024-04-16T18:24:05.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AXgU30GQ4XgCiugFBf+dQMmiTks=', 'Content-Length': '0'} 2024-04-16T18:24:05.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c5fd0879b68f29a-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.577 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.577 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.577 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.577 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:24:05.578 DEBUG:boto:Data: 2024-04-16T18:24:05.578 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.578 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.578 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.578 DEBUG:boto:Params: {} 2024-04-16T18:24:05.578 DEBUG:boto:Token: None 2024-04-16T18:24:05.578 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22 2024-04-16T18:24:05.578 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AXgU30GQ4XgCiugFBf+dQMmiTks= 2024-04-16T18:24:05.578 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AXgU30GQ4XgCiugFBf+dQMmiTks=', 'Content-Length': '0'} 2024-04-16T18:24:05.580 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa245eea6b194200-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.580 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:24:05.580 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.580 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.581 DEBUG:boto:Method: GET 2024-04-16T18:24:05.581 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:24:05.581 DEBUG:boto:Data: 2024-04-16T18:24:05.581 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.581 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.581 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.581 DEBUG:boto:Params: {} 2024-04-16T18:24:05.581 DEBUG:boto:Token: None 2024-04-16T18:24:05.581 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22 2024-04-16T18:24:05.581 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BMzYFmRnQgfAHGMHU9dldv+JxgU= 2024-04-16T18:24:05.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BMzYFmRnQgfAHGMHU9dldv+JxgU=', 'Content-Length': '0'} 2024-04-16T18:24:05.583 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd89c2bc487c9630-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.626 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:24:05.627 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:24:05.627 DEBUG:boto:Method: GET 2024-04-16T18:24:05.627 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:24:05.627 DEBUG:boto:Data: 2024-04-16T18:24:05.627 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.627 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.627 DEBUG:boto:Params: {} 2024-04-16T18:24:05.627 DEBUG:boto:Token: None 2024-04-16T18:24:05.627 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj22 2024-04-16T18:24:05.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BMzYFmRnQgfAHGMHU9dldv+JxgU= 2024-04-16T18:24:05.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BMzYFmRnQgfAHGMHU9dldv+JxgU=', 'Content-Length': '0'} 2024-04-16T18:24:05.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acd7121d0472d1dc-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.630 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.630 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.630 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.630 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.630 DEBUG:boto:Method: GET 2024-04-16T18:24:05.630 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.630 DEBUG:boto:Data: 2024-04-16T18:24:05.631 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.631 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.631 DEBUG:boto:Params: {} 2024-04-16T18:24:05.631 DEBUG:boto:Token: None 2024-04-16T18:24:05.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.634 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004463c785d3f249d5-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.634 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.634 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.634 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.634 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.635 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.635 DEBUG:boto:Method: GET 2024-04-16T18:24:05.635 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:24:05.635 DEBUG:boto:Data: 2024-04-16T18:24:05.635 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.635 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.635 DEBUG:boto:Params: {} 2024-04-16T18:24:05.635 DEBUG:boto:Token: None 2024-04-16T18:24:05.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.638 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088132c52253b1cd2-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.639 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.639 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:24:05.639 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.639 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.639 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.639 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.639 DEBUG:boto:Method: GET 2024-04-16T18:24:05.639 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.640 DEBUG:boto:Data: 2024-04-16T18:24:05.640 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.640 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.640 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.640 DEBUG:boto:Params: {} 2024-04-16T18:24:05.640 DEBUG:boto:Token: None 2024-04-16T18:24:05.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk= 2024-04-16T18:24:05.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk=', 'Content-Length': '0'} 2024-04-16T18:24:05.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025a616665f795565-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.687 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.687 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.687 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.687 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.687 DEBUG:boto:Method: GET 2024-04-16T18:24:05.687 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.687 DEBUG:boto:Data: 2024-04-16T18:24:05.687 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.688 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.688 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.688 DEBUG:boto:Params: {} 2024-04-16T18:24:05.688 DEBUG:boto:Token: None 2024-04-16T18:24:05.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk= 2024-04-16T18:24:05.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk=', 'Content-Length': '0'} 2024-04-16T18:24:05.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069be8de193b11c64-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.691 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.691 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.691 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.691 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.691 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.691 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.691 DEBUG:boto:Data: 2024-04-16T18:24:05.691 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.692 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.692 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.692 DEBUG:boto:Params: {} 2024-04-16T18:24:05.692 DEBUG:boto:Token: None 2024-04-16T18:24:05.692 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qXr5mptEhxNnozyGGddghJ7sFaY= 2024-04-16T18:24:05.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qXr5mptEhxNnozyGGddghJ7sFaY=', 'Content-Length': '0'} 2024-04-16T18:24:05.694 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063761d10310544e3-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.695 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.695 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.695 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.695 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.695 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.695 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.695 DEBUG:boto:Data: 2024-04-16T18:24:05.695 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.695 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.695 DEBUG:boto:Params: {} 2024-04-16T18:24:05.696 DEBUG:boto:Token: None 2024-04-16T18:24:05.696 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qXr5mptEhxNnozyGGddghJ7sFaY= 2024-04-16T18:24:05.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qXr5mptEhxNnozyGGddghJ7sFaY=', 'Content-Length': '0'} 2024-04-16T18:24:05.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5e7bfaf2c18059a-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.698 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:24:05.698 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.698 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.698 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.698 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.698 DEBUG:boto:Method: GET 2024-04-16T18:24:05.698 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.699 DEBUG:boto:Data: 2024-04-16T18:24:05.699 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.699 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.699 DEBUG:boto:Params: {} 2024-04-16T18:24:05.699 DEBUG:boto:Token: None 2024-04-16T18:24:05.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk= 2024-04-16T18:24:05.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk=', 'Content-Length': '0'} 2024-04-16T18:24:05.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd2979dba75c40f0-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.742 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.742 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.742 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.742 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.743 DEBUG:boto:Method: GET 2024-04-16T18:24:05.743 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.743 DEBUG:boto:Data: 2024-04-16T18:24:05.743 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.743 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.743 DEBUG:boto:Params: {} 2024-04-16T18:24:05.743 DEBUG:boto:Token: None 2024-04-16T18:24:05.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:24:05.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk= 2024-04-16T18:24:05.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wfvtNP5sLT0w4ZIPX+FLYoJZYAk=', 'Content-Length': '0'} 2024-04-16T18:24:05.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0d973b3c512fe90-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.745 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.745 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.745 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.746 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.746 DEBUG:boto:Method: GET 2024-04-16T18:24:05.746 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.746 DEBUG:boto:Data: 2024-04-16T18:24:05.746 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.746 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.746 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.746 DEBUG:boto:Params: {} 2024-04-16T18:24:05.746 DEBUG:boto:Token: None 2024-04-16T18:24:05.746 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.746 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.749 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f709599ab1920756-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.749 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.749 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.749 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.749 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.750 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.750 DEBUG:boto:Method: GET 2024-04-16T18:24:05.750 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.750 DEBUG:boto:Data: 2024-04-16T18:24:05.750 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.750 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.750 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.750 DEBUG:boto:Params: {} 2024-04-16T18:24:05.750 DEBUG:boto:Token: None 2024-04-16T18:24:05.751 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.751 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000055aecc61371e572b-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.753 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.754 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.754 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.754 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.754 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:24:05.754 DEBUG:boto:Data: 2024-04-16T18:24:05.754 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.754 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.754 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.755 DEBUG:boto:Params: {} 2024-04-16T18:24:05.755 DEBUG:boto:Token: None 2024-04-16T18:24:05.755 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23 2024-04-16T18:24:05.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sARcTXbrk7ijZ/7wa6t/lchpXFU= 2024-04-16T18:24:05.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sARcTXbrk7ijZ/7wa6t/lchpXFU=', 'Content-Length': '0'} 2024-04-16T18:24:05.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061330958368a6761-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.757 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.757 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.757 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.757 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:24:05.758 DEBUG:boto:Data: 2024-04-16T18:24:05.758 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.758 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.758 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.758 DEBUG:boto:Params: {} 2024-04-16T18:24:05.758 DEBUG:boto:Token: None 2024-04-16T18:24:05.758 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23 2024-04-16T18:24:05.758 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sARcTXbrk7ijZ/7wa6t/lchpXFU= 2024-04-16T18:24:05.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sARcTXbrk7ijZ/7wa6t/lchpXFU=', 'Content-Length': '0'} 2024-04-16T18:24:05.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063d0a72e1fde8bec-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:24:05.760 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.760 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.760 DEBUG:boto:Method: GET 2024-04-16T18:24:05.761 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:24:05.761 DEBUG:boto:Data: 2024-04-16T18:24:05.761 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.761 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.761 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.761 DEBUG:boto:Params: {} 2024-04-16T18:24:05.761 DEBUG:boto:Token: None 2024-04-16T18:24:05.761 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23 2024-04-16T18:24:05.761 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xa1bKrd+YFEeRkH7seOahGL3v+E= 2024-04-16T18:24:05.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xa1bKrd+YFEeRkH7seOahGL3v+E=', 'Content-Length': '0'} 2024-04-16T18:24:05.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df4d8edf3c8b20a5-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.806 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:24:05.806 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:24:05.807 DEBUG:boto:Method: GET 2024-04-16T18:24:05.807 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:24:05.807 DEBUG:boto:Data: 2024-04-16T18:24:05.807 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.807 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.807 DEBUG:boto:Params: {} 2024-04-16T18:24:05.807 DEBUG:boto:Token: None 2024-04-16T18:24:05.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj23 2024-04-16T18:24:05.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xa1bKrd+YFEeRkH7seOahGL3v+E= 2024-04-16T18:24:05.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xa1bKrd+YFEeRkH7seOahGL3v+E=', 'Content-Length': '0'} 2024-04-16T18:24:05.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036001407264619b5-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.810 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.810 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.810 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.810 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.810 DEBUG:boto:Method: GET 2024-04-16T18:24:05.810 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.810 DEBUG:boto:Data: 2024-04-16T18:24:05.810 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.811 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.811 DEBUG:boto:Params: {} 2024-04-16T18:24:05.811 DEBUG:boto:Token: None 2024-04-16T18:24:05.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.813 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000460130cd585250a8-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.813 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.814 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.814 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.814 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.814 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.814 DEBUG:boto:Method: GET 2024-04-16T18:24:05.814 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:24:05.814 DEBUG:boto:Data: 2024-04-16T18:24:05.814 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.815 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.815 DEBUG:boto:Params: {} 2024-04-16T18:24:05.815 DEBUG:boto:Token: None 2024-04-16T18:24:05.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.818 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008aa5aee1dc648d16-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.818 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:24:05.819 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.819 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.819 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.819 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.819 DEBUG:boto:Method: GET 2024-04-16T18:24:05.819 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.819 DEBUG:boto:Data: 2024-04-16T18:24:05.820 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.820 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.820 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.820 DEBUG:boto:Params: {} 2024-04-16T18:24:05.820 DEBUG:boto:Token: None 2024-04-16T18:24:05.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k= 2024-04-16T18:24:05.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k=', 'Content-Length': '0'} 2024-04-16T18:24:05.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d92d5b4afcd733ef-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.866 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.866 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.866 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.867 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.867 DEBUG:boto:Method: GET 2024-04-16T18:24:05.867 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.867 DEBUG:boto:Data: 2024-04-16T18:24:05.867 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.867 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.867 DEBUG:boto:Params: {} 2024-04-16T18:24:05.867 DEBUG:boto:Token: None 2024-04-16T18:24:05.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k= 2024-04-16T18:24:05.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k=', 'Content-Length': '0'} 2024-04-16T18:24:05.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005135a34a6c11acee-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.872 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.872 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.872 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.872 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.872 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.872 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.872 DEBUG:boto:Data: 2024-04-16T18:24:05.872 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.872 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.872 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.873 DEBUG:boto:Params: {} 2024-04-16T18:24:05.873 DEBUG:boto:Token: None 2024-04-16T18:24:05.873 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.873 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yzHfE/2Ca52JFX1f+x26nVpLkA0= 2024-04-16T18:24:05.873 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yzHfE/2Ca52JFX1f+x26nVpLkA0=', 'Content-Length': '0'} 2024-04-16T18:24:05.875 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f92daf1e67dd40c-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.876 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.876 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.876 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.876 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.876 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.876 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.876 DEBUG:boto:Data: 2024-04-16T18:24:05.876 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.876 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.876 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.876 DEBUG:boto:Params: {} 2024-04-16T18:24:05.876 DEBUG:boto:Token: None 2024-04-16T18:24:05.877 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.877 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yzHfE/2Ca52JFX1f+x26nVpLkA0= 2024-04-16T18:24:05.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yzHfE/2Ca52JFX1f+x26nVpLkA0=', 'Content-Length': '0'} 2024-04-16T18:24:05.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005aed6bf046dea8e2-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.879 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:24:05.879 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.879 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.879 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.879 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.879 DEBUG:boto:Method: GET 2024-04-16T18:24:05.879 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.879 DEBUG:boto:Data: 2024-04-16T18:24:05.879 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.880 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.880 DEBUG:boto:Params: {} 2024-04-16T18:24:05.880 DEBUG:boto:Token: None 2024-04-16T18:24:05.880 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k= 2024-04-16T18:24:05.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k=', 'Content-Length': '0'} 2024-04-16T18:24:05.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000da9fb8f6edd75a5-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.922 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.922 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.922 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.923 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.923 DEBUG:boto:Method: GET 2024-04-16T18:24:05.923 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.923 DEBUG:boto:Data: 2024-04-16T18:24:05.923 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.923 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.923 DEBUG:boto:Params: {} 2024-04-16T18:24:05.923 DEBUG:boto:Token: None 2024-04-16T18:24:05.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:24:05.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k= 2024-04-16T18:24:05.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LO0/KZaZhHPiGXe5rw3AFsS686k=', 'Content-Length': '0'} 2024-04-16T18:24:05.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000515f96406f85ca35-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.926 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.926 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.926 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.926 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.926 DEBUG:boto:Method: GET 2024-04-16T18:24:05.926 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.926 DEBUG:boto:Data: 2024-04-16T18:24:05.926 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.926 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.927 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.927 DEBUG:boto:Params: {} 2024-04-16T18:24:05.927 DEBUG:boto:Token: None 2024-04-16T18:24:05.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003dead0010e5479e-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.930 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.930 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.930 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.930 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.931 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.931 DEBUG:boto:Method: GET 2024-04-16T18:24:05.931 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.931 DEBUG:boto:Data: 2024-04-16T18:24:05.931 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.931 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.931 DEBUG:boto:Params: {} 2024-04-16T18:24:05.931 DEBUG:boto:Token: None 2024-04-16T18:24:05.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.935 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002578f789bba393fa-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.935 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.935 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.935 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.936 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.936 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:24:05.936 DEBUG:boto:Data: 2024-04-16T18:24:05.936 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.936 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.936 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.936 DEBUG:boto:Params: {} 2024-04-16T18:24:05.936 DEBUG:boto:Token: None 2024-04-16T18:24:05.936 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33 2024-04-16T18:24:05.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RC1KyRvj290M5NR/Npv1VKnSApQ= 2024-04-16T18:24:05.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RC1KyRvj290M5NR/Npv1VKnSApQ=', 'Content-Length': '0'} 2024-04-16T18:24:05.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed8a4104693fde97-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.938 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.938 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.939 DEBUG:boto:Method: HEAD 2024-04-16T18:24:05.939 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:24:05.939 DEBUG:boto:Data: 2024-04-16T18:24:05.939 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.939 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.939 DEBUG:boto:Params: {} 2024-04-16T18:24:05.939 DEBUG:boto:Token: None 2024-04-16T18:24:05.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33 2024-04-16T18:24:05.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RC1KyRvj290M5NR/Npv1VKnSApQ= 2024-04-16T18:24:05.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RC1KyRvj290M5NR/Npv1VKnSApQ=', 'Content-Length': '0'} 2024-04-16T18:24:05.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e36117ac6930d22-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.942 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:24:05.942 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.942 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.942 DEBUG:boto:Method: GET 2024-04-16T18:24:05.942 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:24:05.942 DEBUG:boto:Data: 2024-04-16T18:24:05.942 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.942 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.942 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.942 DEBUG:boto:Params: {} 2024-04-16T18:24:05.942 DEBUG:boto:Token: None 2024-04-16T18:24:05.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33 2024-04-16T18:24:05.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AmjrdSKz3Rrbq7JRAU4Sp7bItz8= 2024-04-16T18:24:05.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AmjrdSKz3Rrbq7JRAU4Sp7bItz8=', 'Content-Length': '0'} 2024-04-16T18:24:05.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004aecb60bc995d545-00661ec245-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.986 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:24:05.986 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:24:05.987 DEBUG:boto:Method: GET 2024-04-16T18:24:05.987 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:24:05.987 DEBUG:boto:Data: 2024-04-16T18:24:05.987 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.987 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.987 DEBUG:boto:Params: {} 2024-04-16T18:24:05.987 DEBUG:boto:Token: None 2024-04-16T18:24:05.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/obj33 2024-04-16T18:24:05.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AmjrdSKz3Rrbq7JRAU4Sp7bItz8= 2024-04-16T18:24:05.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AmjrdSKz3Rrbq7JRAU4Sp7bItz8=', 'Content-Length': '0'} 2024-04-16T18:24:05.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000332cc8d0b5b5b734-00661ec245-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.990 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.990 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.990 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.990 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.990 DEBUG:boto:Method: GET 2024-04-16T18:24:05.990 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.991 DEBUG:boto:Data: 2024-04-16T18:24:05.991 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:05.991 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.991 DEBUG:boto:Params: {} 2024-04-16T18:24:05.991 DEBUG:boto:Token: None 2024-04-16T18:24:05.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.994 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf296a04733bc412-00661ec245-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:05 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.994 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.995 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:05.995 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:05.995 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.995 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.995 DEBUG:boto:Method: GET 2024-04-16T18:24:05.995 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:24:05.995 DEBUG:boto:Data: 2024-04-16T18:24:05.995 DEBUG:boto:Headers: {} 2024-04-16T18:24:05.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:05.995 DEBUG:boto:Port: 8000 2024-04-16T18:24:05.995 DEBUG:boto:Params: {} 2024-04-16T18:24:05.996 DEBUG:boto:Token: None 2024-04-16T18:24:05.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:05 GMT /cjqttm-52/ 2024-04-16T18:24:05.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U= 2024-04-16T18:24:05.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:05 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5oLwXBzFHUzdEAm5+dfQG86T+U=', 'Content-Length': '0'} 2024-04-16T18:24:05.999 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009795c0adf2e52353-00661ec245-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:05.999 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:05.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:24:06.000 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.000 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.000 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.000 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.000 DEBUG:boto:Method: GET 2024-04-16T18:24:06.000 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.000 DEBUG:boto:Data: 2024-04-16T18:24:06.000 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.000 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.000 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.001 DEBUG:boto:Params: {} 2024-04-16T18:24:06.001 DEBUG:boto:Token: None 2024-04-16T18:24:06.001 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0= 2024-04-16T18:24:06.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0=', 'Content-Length': '0'} 2024-04-16T18:24:06.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c03ca0109784c44-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.046 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.046 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.046 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.047 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.047 DEBUG:boto:Method: GET 2024-04-16T18:24:06.047 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.047 DEBUG:boto:Data: 2024-04-16T18:24:06.047 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.047 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.047 DEBUG:boto:Params: {} 2024-04-16T18:24:06.047 DEBUG:boto:Token: None 2024-04-16T18:24:06.048 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0= 2024-04-16T18:24:06.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0=', 'Content-Length': '0'} 2024-04-16T18:24:06.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044d286c71fd417b6-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.050 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.050 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.050 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.050 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.050 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.050 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.051 DEBUG:boto:Data: 2024-04-16T18:24:06.051 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.051 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.051 DEBUG:boto:Params: {} 2024-04-16T18:24:06.051 DEBUG:boto:Token: None 2024-04-16T18:24:06.051 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rSQQ2cUT7MPIIKF1ra2EeuH+SCY= 2024-04-16T18:24:06.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rSQQ2cUT7MPIIKF1ra2EeuH+SCY=', 'Content-Length': '0'} 2024-04-16T18:24:06.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008de84bdee3fb6890-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.054 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.054 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.054 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.054 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.054 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.054 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.054 DEBUG:boto:Data: 2024-04-16T18:24:06.054 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.054 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.055 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.055 DEBUG:boto:Params: {} 2024-04-16T18:24:06.055 DEBUG:boto:Token: None 2024-04-16T18:24:06.055 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rSQQ2cUT7MPIIKF1ra2EeuH+SCY= 2024-04-16T18:24:06.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rSQQ2cUT7MPIIKF1ra2EeuH+SCY=', 'Content-Length': '0'} 2024-04-16T18:24:06.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009117d7b02445c93e-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:24:06.057 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.057 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.057 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.058 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.058 DEBUG:boto:Method: GET 2024-04-16T18:24:06.058 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.058 DEBUG:boto:Data: 2024-04-16T18:24:06.058 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.058 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.058 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.058 DEBUG:boto:Params: {} 2024-04-16T18:24:06.058 DEBUG:boto:Token: None 2024-04-16T18:24:06.058 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0= 2024-04-16T18:24:06.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0=', 'Content-Length': '0'} 2024-04-16T18:24:06.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d4c5f4e0cda1e7d-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.102 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.102 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.102 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.103 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.103 DEBUG:boto:Method: GET 2024-04-16T18:24:06.103 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.103 DEBUG:boto:Data: 2024-04-16T18:24:06.103 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.103 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.103 DEBUG:boto:Params: {} 2024-04-16T18:24:06.103 DEBUG:boto:Token: None 2024-04-16T18:24:06.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:24:06.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0= 2024-04-16T18:24:06.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/A2RjkigkSLYTpdjykZQ5Tydhb0=', 'Content-Length': '0'} 2024-04-16T18:24:06.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016dc82407265013e-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.106 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.106 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.106 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.106 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.106 DEBUG:boto:Method: GET 2024-04-16T18:24:06.106 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.106 DEBUG:boto:Data: 2024-04-16T18:24:06.107 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.107 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.107 DEBUG:boto:Params: {} 2024-04-16T18:24:06.107 DEBUG:boto:Token: None 2024-04-16T18:24:06.107 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6cf59e412f30452-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.110 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.110 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.110 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.110 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.110 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.111 DEBUG:boto:Method: GET 2024-04-16T18:24:06.111 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.111 DEBUG:boto:Data: 2024-04-16T18:24:06.111 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.111 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.111 DEBUG:boto:Params: {} 2024-04-16T18:24:06.111 DEBUG:boto:Token: None 2024-04-16T18:24:06.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.114 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000792775d536b614bb-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.115 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.115 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.115 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.115 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.115 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:24:06.115 DEBUG:boto:Data: 2024-04-16T18:24:06.115 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.115 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.116 DEBUG:boto:Params: {} 2024-04-16T18:24:06.116 DEBUG:boto:Token: None 2024-04-16T18:24:06.116 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34 2024-04-16T18:24:06.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rTokZWNXUJy+dpzmIMmr0/lNVuE= 2024-04-16T18:24:06.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rTokZWNXUJy+dpzmIMmr0/lNVuE=', 'Content-Length': '0'} 2024-04-16T18:24:06.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e829be6e788757b7-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.118 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.118 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.118 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.118 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:24:06.119 DEBUG:boto:Data: 2024-04-16T18:24:06.119 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.119 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.119 DEBUG:boto:Params: {} 2024-04-16T18:24:06.119 DEBUG:boto:Token: None 2024-04-16T18:24:06.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34 2024-04-16T18:24:06.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rTokZWNXUJy+dpzmIMmr0/lNVuE= 2024-04-16T18:24:06.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rTokZWNXUJy+dpzmIMmr0/lNVuE=', 'Content-Length': '0'} 2024-04-16T18:24:06.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000aa44a2f2573cb26-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:24:06.122 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.122 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.122 DEBUG:boto:Method: GET 2024-04-16T18:24:06.122 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:24:06.122 DEBUG:boto:Data: 2024-04-16T18:24:06.122 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.122 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.122 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.122 DEBUG:boto:Params: {} 2024-04-16T18:24:06.122 DEBUG:boto:Token: None 2024-04-16T18:24:06.123 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34 2024-04-16T18:24:06.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f44LHPyWV+Lz5moaG3byKX1BLDI= 2024-04-16T18:24:06.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f44LHPyWV+Lz5moaG3byKX1BLDI=', 'Content-Length': '0'} 2024-04-16T18:24:06.124 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f195bbc474619e3d-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.166 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:24:06.166 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:24:06.166 DEBUG:boto:Method: GET 2024-04-16T18:24:06.167 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:24:06.167 DEBUG:boto:Data: 2024-04-16T18:24:06.167 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.167 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.167 DEBUG:boto:Params: {} 2024-04-16T18:24:06.167 DEBUG:boto:Token: None 2024-04-16T18:24:06.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj34 2024-04-16T18:24:06.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f44LHPyWV+Lz5moaG3byKX1BLDI= 2024-04-16T18:24:06.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f44LHPyWV+Lz5moaG3byKX1BLDI=', 'Content-Length': '0'} 2024-04-16T18:24:06.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d0dda4d7cb828f2-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.169 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.170 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.170 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.170 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.170 DEBUG:boto:Method: GET 2024-04-16T18:24:06.170 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.170 DEBUG:boto:Data: 2024-04-16T18:24:06.170 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.170 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.170 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.170 DEBUG:boto:Params: {} 2024-04-16T18:24:06.171 DEBUG:boto:Token: None 2024-04-16T18:24:06.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000de46c1b6759a259-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.214 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.215 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.215 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.215 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.215 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.215 DEBUG:boto:Method: GET 2024-04-16T18:24:06.215 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:24:06.215 DEBUG:boto:Data: 2024-04-16T18:24:06.215 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.215 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.215 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.215 DEBUG:boto:Params: {} 2024-04-16T18:24:06.215 DEBUG:boto:Token: None 2024-04-16T18:24:06.216 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.219 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b9785e2e3523758-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.219 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.219 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:24:06.219 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.220 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.220 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.220 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.220 DEBUG:boto:Method: GET 2024-04-16T18:24:06.220 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.220 DEBUG:boto:Data: 2024-04-16T18:24:06.220 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.220 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.220 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.220 DEBUG:boto:Params: {} 2024-04-16T18:24:06.220 DEBUG:boto:Token: None 2024-04-16T18:24:06.221 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.221 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g= 2024-04-16T18:24:06.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g=', 'Content-Length': '0'} 2024-04-16T18:24:06.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebb0b2390c4a735e-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.266 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.266 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.266 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.267 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.267 DEBUG:boto:Method: GET 2024-04-16T18:24:06.267 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.267 DEBUG:boto:Data: 2024-04-16T18:24:06.267 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.267 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.267 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.267 DEBUG:boto:Params: {} 2024-04-16T18:24:06.267 DEBUG:boto:Token: None 2024-04-16T18:24:06.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g= 2024-04-16T18:24:06.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g=', 'Content-Length': '0'} 2024-04-16T18:24:06.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002341ec20ece38a5a-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.270 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.270 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.270 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.270 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.270 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.270 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.270 DEBUG:boto:Data: 2024-04-16T18:24:06.270 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.271 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.271 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.271 DEBUG:boto:Params: {} 2024-04-16T18:24:06.271 DEBUG:boto:Token: None 2024-04-16T18:24:06.271 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2pdiXHk9KqMQJOfs4g4Dpy6xAmI= 2024-04-16T18:24:06.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2pdiXHk9KqMQJOfs4g4Dpy6xAmI=', 'Content-Length': '0'} 2024-04-16T18:24:06.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf3a01b715a888f2-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.273 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.273 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.273 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.273 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.274 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.274 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.274 DEBUG:boto:Data: 2024-04-16T18:24:06.274 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.274 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.274 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.274 DEBUG:boto:Params: {} 2024-04-16T18:24:06.274 DEBUG:boto:Token: None 2024-04-16T18:24:06.274 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.274 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2pdiXHk9KqMQJOfs4g4Dpy6xAmI= 2024-04-16T18:24:06.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2pdiXHk9KqMQJOfs4g4Dpy6xAmI=', 'Content-Length': '0'} 2024-04-16T18:24:06.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000077319cd0d79a58c-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.276 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:24:06.277 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.277 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.277 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.277 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.277 DEBUG:boto:Method: GET 2024-04-16T18:24:06.277 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.277 DEBUG:boto:Data: 2024-04-16T18:24:06.277 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.277 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.277 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.277 DEBUG:boto:Params: {} 2024-04-16T18:24:06.278 DEBUG:boto:Token: None 2024-04-16T18:24:06.278 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.278 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g= 2024-04-16T18:24:06.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g=', 'Content-Length': '0'} 2024-04-16T18:24:06.280 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000efbf65643e387e0-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.322 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.322 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.323 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.323 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.323 DEBUG:boto:Method: GET 2024-04-16T18:24:06.323 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.323 DEBUG:boto:Data: 2024-04-16T18:24:06.323 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.323 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.323 DEBUG:boto:Params: {} 2024-04-16T18:24:06.323 DEBUG:boto:Token: None 2024-04-16T18:24:06.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:24:06.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g= 2024-04-16T18:24:06.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GOF5w9yJYsTWE2i/E3490M/Xv2g=', 'Content-Length': '0'} 2024-04-16T18:24:06.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f56686fe66bb0eeb-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.326 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.326 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.326 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.326 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.326 DEBUG:boto:Method: GET 2024-04-16T18:24:06.326 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.326 DEBUG:boto:Data: 2024-04-16T18:24:06.326 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.326 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.326 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.327 DEBUG:boto:Params: {} 2024-04-16T18:24:06.327 DEBUG:boto:Token: None 2024-04-16T18:24:06.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.329 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095a036573c20e0d0-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.370 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.371 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.371 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.371 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.371 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.371 DEBUG:boto:Method: GET 2024-04-16T18:24:06.371 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.371 DEBUG:boto:Data: 2024-04-16T18:24:06.371 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.371 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.371 DEBUG:boto:Params: {} 2024-04-16T18:24:06.372 DEBUG:boto:Token: None 2024-04-16T18:24:06.372 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.375 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009eee48c660210b71-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.375 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.375 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.376 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.376 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.376 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:24:06.376 DEBUG:boto:Data: 2024-04-16T18:24:06.376 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.376 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.376 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.376 DEBUG:boto:Params: {} 2024-04-16T18:24:06.376 DEBUG:boto:Token: None 2024-04-16T18:24:06.376 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38 2024-04-16T18:24:06.377 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aUylWNy35Dn1xrmdSi+GidUUNLI= 2024-04-16T18:24:06.377 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aUylWNy35Dn1xrmdSi+GidUUNLI=', 'Content-Length': '0'} 2024-04-16T18:24:06.378 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e22c1f2174b29caa-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.379 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.379 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.379 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.379 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:24:06.379 DEBUG:boto:Data: 2024-04-16T18:24:06.379 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.379 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.379 DEBUG:boto:Params: {} 2024-04-16T18:24:06.380 DEBUG:boto:Token: None 2024-04-16T18:24:06.380 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38 2024-04-16T18:24:06.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aUylWNy35Dn1xrmdSi+GidUUNLI= 2024-04-16T18:24:06.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aUylWNy35Dn1xrmdSi+GidUUNLI=', 'Content-Length': '0'} 2024-04-16T18:24:06.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9dd9abc40404de4-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.382 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:24:06.382 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.382 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.382 DEBUG:boto:Method: GET 2024-04-16T18:24:06.382 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:24:06.382 DEBUG:boto:Data: 2024-04-16T18:24:06.382 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.383 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.383 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.383 DEBUG:boto:Params: {} 2024-04-16T18:24:06.383 DEBUG:boto:Token: None 2024-04-16T18:24:06.383 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38 2024-04-16T18:24:06.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RXsWKzQNaD1huylvRfuLshvxYTM= 2024-04-16T18:24:06.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RXsWKzQNaD1huylvRfuLshvxYTM=', 'Content-Length': '0'} 2024-04-16T18:24:06.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019ee89790f4d0439-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.426 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:24:06.426 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:24:06.427 DEBUG:boto:Method: GET 2024-04-16T18:24:06.427 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:24:06.427 DEBUG:boto:Data: 2024-04-16T18:24:06.427 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.427 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.427 DEBUG:boto:Params: {} 2024-04-16T18:24:06.427 DEBUG:boto:Token: None 2024-04-16T18:24:06.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj38 2024-04-16T18:24:06.427 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RXsWKzQNaD1huylvRfuLshvxYTM= 2024-04-16T18:24:06.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RXsWKzQNaD1huylvRfuLshvxYTM=', 'Content-Length': '0'} 2024-04-16T18:24:06.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a863e5a7cb67d2d4-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.430 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.430 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.430 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.430 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.430 DEBUG:boto:Method: GET 2024-04-16T18:24:06.430 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.430 DEBUG:boto:Data: 2024-04-16T18:24:06.430 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.430 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.430 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.431 DEBUG:boto:Params: {} 2024-04-16T18:24:06.431 DEBUG:boto:Token: None 2024-04-16T18:24:06.431 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.431 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.433 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2b67c14ea410f83-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.474 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.474 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.475 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.475 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.475 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.475 DEBUG:boto:Method: GET 2024-04-16T18:24:06.475 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:24:06.475 DEBUG:boto:Data: 2024-04-16T18:24:06.475 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.475 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.475 DEBUG:boto:Params: {} 2024-04-16T18:24:06.475 DEBUG:boto:Token: None 2024-04-16T18:24:06.476 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.479 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e64aae1348adc8d8-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.479 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:24:06.479 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.479 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.480 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.480 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.480 DEBUG:boto:Method: GET 2024-04-16T18:24:06.480 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.480 DEBUG:boto:Data: 2024-04-16T18:24:06.480 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.480 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.480 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.480 DEBUG:boto:Params: {} 2024-04-16T18:24:06.480 DEBUG:boto:Token: None 2024-04-16T18:24:06.481 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.481 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8= 2024-04-16T18:24:06.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8=', 'Content-Length': '0'} 2024-04-16T18:24:06.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7f87f7c37140753-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.526 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.526 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.526 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.527 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.527 DEBUG:boto:Method: GET 2024-04-16T18:24:06.527 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.527 DEBUG:boto:Data: 2024-04-16T18:24:06.527 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.527 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.527 DEBUG:boto:Params: {} 2024-04-16T18:24:06.527 DEBUG:boto:Token: None 2024-04-16T18:24:06.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8= 2024-04-16T18:24:06.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8=', 'Content-Length': '0'} 2024-04-16T18:24:06.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f8fb208e7a5dcb0-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.530 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.530 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.530 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.530 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.530 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.530 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.530 DEBUG:boto:Data: 2024-04-16T18:24:06.531 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.531 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.531 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.531 DEBUG:boto:Params: {} 2024-04-16T18:24:06.531 DEBUG:boto:Token: None 2024-04-16T18:24:06.531 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:siOeQ4JdZJyjqsQqdWkXF9icios= 2024-04-16T18:24:06.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:siOeQ4JdZJyjqsQqdWkXF9icios=', 'Content-Length': '0'} 2024-04-16T18:24:06.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074412e11756c050c-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.533 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.534 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.534 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.534 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.534 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.534 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.534 DEBUG:boto:Data: 2024-04-16T18:24:06.534 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.534 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.534 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.534 DEBUG:boto:Params: {} 2024-04-16T18:24:06.534 DEBUG:boto:Token: None 2024-04-16T18:24:06.535 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:siOeQ4JdZJyjqsQqdWkXF9icios= 2024-04-16T18:24:06.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:siOeQ4JdZJyjqsQqdWkXF9icios=', 'Content-Length': '0'} 2024-04-16T18:24:06.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031f228b35ad454ea-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:24:06.537 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.537 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.537 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.537 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.537 DEBUG:boto:Method: GET 2024-04-16T18:24:06.537 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.537 DEBUG:boto:Data: 2024-04-16T18:24:06.537 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.537 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.537 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.537 DEBUG:boto:Params: {} 2024-04-16T18:24:06.538 DEBUG:boto:Token: None 2024-04-16T18:24:06.538 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.538 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8= 2024-04-16T18:24:06.538 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8=', 'Content-Length': '0'} 2024-04-16T18:24:06.540 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a1a471d1dfd13dd-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.582 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.582 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.582 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.583 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.583 DEBUG:boto:Method: GET 2024-04-16T18:24:06.583 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.583 DEBUG:boto:Data: 2024-04-16T18:24:06.583 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.583 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.583 DEBUG:boto:Params: {} 2024-04-16T18:24:06.583 DEBUG:boto:Token: None 2024-04-16T18:24:06.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:24:06.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8= 2024-04-16T18:24:06.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BF37Y211VNPUsJvv2/Ai3aKGGf8=', 'Content-Length': '0'} 2024-04-16T18:24:06.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092d912790735a425-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.586 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.586 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.586 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.586 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.586 DEBUG:boto:Method: GET 2024-04-16T18:24:06.586 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.586 DEBUG:boto:Data: 2024-04-16T18:24:06.586 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.586 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.586 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.586 DEBUG:boto:Params: {} 2024-04-16T18:24:06.587 DEBUG:boto:Token: None 2024-04-16T18:24:06.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.589 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7dee39474e63457-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.630 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.631 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.631 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.631 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.631 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.631 DEBUG:boto:Method: GET 2024-04-16T18:24:06.631 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.631 DEBUG:boto:Data: 2024-04-16T18:24:06.631 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.631 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.632 DEBUG:boto:Params: {} 2024-04-16T18:24:06.632 DEBUG:boto:Token: None 2024-04-16T18:24:06.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.635 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1ab5efe4d29189f-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.635 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.636 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.636 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.636 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.636 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:24:06.636 DEBUG:boto:Data: 2024-04-16T18:24:06.636 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.636 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.636 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.636 DEBUG:boto:Params: {} 2024-04-16T18:24:06.637 DEBUG:boto:Token: None 2024-04-16T18:24:06.637 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44 2024-04-16T18:24:06.637 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Baktel6ADopmRg4BDQMyiUoxqpE= 2024-04-16T18:24:06.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Baktel6ADopmRg4BDQMyiUoxqpE=', 'Content-Length': '0'} 2024-04-16T18:24:06.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0fe877088e50e78-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.639 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.639 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.639 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.639 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:24:06.639 DEBUG:boto:Data: 2024-04-16T18:24:06.639 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.640 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.640 DEBUG:boto:Params: {} 2024-04-16T18:24:06.640 DEBUG:boto:Token: None 2024-04-16T18:24:06.640 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44 2024-04-16T18:24:06.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Baktel6ADopmRg4BDQMyiUoxqpE= 2024-04-16T18:24:06.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Baktel6ADopmRg4BDQMyiUoxqpE=', 'Content-Length': '0'} 2024-04-16T18:24:06.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002800c0017278f143-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.642 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:24:06.642 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.643 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.643 DEBUG:boto:Method: GET 2024-04-16T18:24:06.643 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:24:06.643 DEBUG:boto:Data: 2024-04-16T18:24:06.643 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.643 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.643 DEBUG:boto:Params: {} 2024-04-16T18:24:06.643 DEBUG:boto:Token: None 2024-04-16T18:24:06.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44 2024-04-16T18:24:06.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Iy/3mfLPXnBSdeqI+I4IjrEsQso= 2024-04-16T18:24:06.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Iy/3mfLPXnBSdeqI+I4IjrEsQso=', 'Content-Length': '0'} 2024-04-16T18:24:06.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047b6c5f042205787-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.686 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:24:06.686 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:24:06.687 DEBUG:boto:Method: GET 2024-04-16T18:24:06.687 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:24:06.687 DEBUG:boto:Data: 2024-04-16T18:24:06.687 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.687 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.687 DEBUG:boto:Params: {} 2024-04-16T18:24:06.687 DEBUG:boto:Token: None 2024-04-16T18:24:06.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj44 2024-04-16T18:24:06.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Iy/3mfLPXnBSdeqI+I4IjrEsQso= 2024-04-16T18:24:06.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Iy/3mfLPXnBSdeqI+I4IjrEsQso=', 'Content-Length': '0'} 2024-04-16T18:24:06.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000766a187885327e09-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.689 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.689 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.690 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.690 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.690 DEBUG:boto:Method: GET 2024-04-16T18:24:06.690 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.690 DEBUG:boto:Data: 2024-04-16T18:24:06.690 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.690 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.690 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.690 DEBUG:boto:Params: {} 2024-04-16T18:24:06.690 DEBUG:boto:Token: None 2024-04-16T18:24:06.690 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.693 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce73e5f9fc32cc85-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.734 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.735 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.735 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.735 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.735 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.735 DEBUG:boto:Method: GET 2024-04-16T18:24:06.735 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:24:06.735 DEBUG:boto:Data: 2024-04-16T18:24:06.735 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.735 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.736 DEBUG:boto:Params: {} 2024-04-16T18:24:06.736 DEBUG:boto:Token: None 2024-04-16T18:24:06.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.739 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5bca6c7b1e3a77b-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.739 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.739 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:24:06.739 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.740 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.740 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.740 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.740 DEBUG:boto:Method: GET 2024-04-16T18:24:06.740 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.740 DEBUG:boto:Data: 2024-04-16T18:24:06.740 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.740 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.740 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.740 DEBUG:boto:Params: {} 2024-04-16T18:24:06.740 DEBUG:boto:Token: None 2024-04-16T18:24:06.741 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.741 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA= 2024-04-16T18:24:06.741 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA=', 'Content-Length': '0'} 2024-04-16T18:24:06.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d95f37528ee94ff-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.786 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.786 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.786 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.787 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.787 DEBUG:boto:Method: GET 2024-04-16T18:24:06.787 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.787 DEBUG:boto:Data: 2024-04-16T18:24:06.787 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.787 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.787 DEBUG:boto:Params: {} 2024-04-16T18:24:06.787 DEBUG:boto:Token: None 2024-04-16T18:24:06.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA= 2024-04-16T18:24:06.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA=', 'Content-Length': '0'} 2024-04-16T18:24:06.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d10f6191cd635122-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.790 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.790 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.790 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.790 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.791 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.791 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.791 DEBUG:boto:Data: 2024-04-16T18:24:06.791 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.791 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.791 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.791 DEBUG:boto:Params: {} 2024-04-16T18:24:06.791 DEBUG:boto:Token: None 2024-04-16T18:24:06.791 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MfRV6tTvLTV2DOFti3t483Kp3rE= 2024-04-16T18:24:06.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MfRV6tTvLTV2DOFti3t483Kp3rE=', 'Content-Length': '0'} 2024-04-16T18:24:06.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c30203ca6689523-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.794 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.794 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.794 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.794 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.795 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.795 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.795 DEBUG:boto:Data: 2024-04-16T18:24:06.795 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.795 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.795 DEBUG:boto:Params: {} 2024-04-16T18:24:06.795 DEBUG:boto:Token: None 2024-04-16T18:24:06.795 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MfRV6tTvLTV2DOFti3t483Kp3rE= 2024-04-16T18:24:06.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MfRV6tTvLTV2DOFti3t483Kp3rE=', 'Content-Length': '0'} 2024-04-16T18:24:06.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001942e071062f0f39-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:24:06.798 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.798 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.798 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.798 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.798 DEBUG:boto:Method: GET 2024-04-16T18:24:06.798 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.799 DEBUG:boto:Data: 2024-04-16T18:24:06.799 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.799 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.799 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.799 DEBUG:boto:Params: {} 2024-04-16T18:24:06.799 DEBUG:boto:Token: None 2024-04-16T18:24:06.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA= 2024-04-16T18:24:06.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA=', 'Content-Length': '0'} 2024-04-16T18:24:06.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006abd30892a87d854-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.842 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.842 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.842 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.843 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.843 DEBUG:boto:Method: GET 2024-04-16T18:24:06.843 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.843 DEBUG:boto:Data: 2024-04-16T18:24:06.843 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.843 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.843 DEBUG:boto:Params: {} 2024-04-16T18:24:06.843 DEBUG:boto:Token: None 2024-04-16T18:24:06.843 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:24:06.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA= 2024-04-16T18:24:06.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b1w+V4Mi1PcuywE88zfW2cHMyLA=', 'Content-Length': '0'} 2024-04-16T18:24:06.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000428c3a1ffe48781b-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.846 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.846 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.846 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.846 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.846 DEBUG:boto:Method: GET 2024-04-16T18:24:06.846 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.847 DEBUG:boto:Data: 2024-04-16T18:24:06.847 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.847 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.847 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.847 DEBUG:boto:Params: {} 2024-04-16T18:24:06.847 DEBUG:boto:Token: None 2024-04-16T18:24:06.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b227243806dbe41d-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.890 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.891 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.891 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.891 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.891 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.891 DEBUG:boto:Method: GET 2024-04-16T18:24:06.891 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.891 DEBUG:boto:Data: 2024-04-16T18:24:06.891 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.892 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.892 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.892 DEBUG:boto:Params: {} 2024-04-16T18:24:06.892 DEBUG:boto:Token: None 2024-04-16T18:24:06.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8fde1fd040b28c9-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.895 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.895 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.895 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.896 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.896 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:24:06.896 DEBUG:boto:Data: 2024-04-16T18:24:06.896 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.896 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.896 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.896 DEBUG:boto:Params: {} 2024-04-16T18:24:06.896 DEBUG:boto:Token: None 2024-04-16T18:24:06.896 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46 2024-04-16T18:24:06.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zlvlu+es7nz43h4GCwqvTwXPJKw= 2024-04-16T18:24:06.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zlvlu+es7nz43h4GCwqvTwXPJKw=', 'Content-Length': '0'} 2024-04-16T18:24:06.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b395ae0c015738dd-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.899 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.899 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.899 DEBUG:boto:Method: HEAD 2024-04-16T18:24:06.899 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:24:06.899 DEBUG:boto:Data: 2024-04-16T18:24:06.899 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.900 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.900 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.900 DEBUG:boto:Params: {} 2024-04-16T18:24:06.900 DEBUG:boto:Token: None 2024-04-16T18:24:06.900 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46 2024-04-16T18:24:06.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zlvlu+es7nz43h4GCwqvTwXPJKw= 2024-04-16T18:24:06.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zlvlu+es7nz43h4GCwqvTwXPJKw=', 'Content-Length': '0'} 2024-04-16T18:24:06.902 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad1bd310c70f3305-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.902 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:24:06.902 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.903 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.903 DEBUG:boto:Method: GET 2024-04-16T18:24:06.903 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:24:06.903 DEBUG:boto:Data: 2024-04-16T18:24:06.903 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.903 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.903 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.903 DEBUG:boto:Params: {} 2024-04-16T18:24:06.903 DEBUG:boto:Token: None 2024-04-16T18:24:06.904 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46 2024-04-16T18:24:06.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7rLMwa8EvjnRFsuYRdM0aY20q0g= 2024-04-16T18:24:06.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7rLMwa8EvjnRFsuYRdM0aY20q0g=', 'Content-Length': '0'} 2024-04-16T18:24:06.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008571692b1b9bbbd9-00661ec246-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.946 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:24:06.946 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:24:06.946 DEBUG:boto:Method: GET 2024-04-16T18:24:06.947 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:24:06.947 DEBUG:boto:Data: 2024-04-16T18:24:06.947 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.947 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.947 DEBUG:boto:Params: {} 2024-04-16T18:24:06.947 DEBUG:boto:Token: None 2024-04-16T18:24:06.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/obj46 2024-04-16T18:24:06.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7rLMwa8EvjnRFsuYRdM0aY20q0g= 2024-04-16T18:24:06.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7rLMwa8EvjnRFsuYRdM0aY20q0g=', 'Content-Length': '0'} 2024-04-16T18:24:06.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9e1692c13fcb692-00661ec246-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.950 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.950 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.950 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.950 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.950 DEBUG:boto:Method: GET 2024-04-16T18:24:06.950 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.950 DEBUG:boto:Data: 2024-04-16T18:24:06.950 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.951 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:06.951 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.951 DEBUG:boto:Params: {} 2024-04-16T18:24:06.951 DEBUG:boto:Token: None 2024-04-16T18:24:06.951 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.953 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000037476f9108be2ee9-00661ec246-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.994 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.995 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:06.995 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:06.995 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.995 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.995 DEBUG:boto:Method: GET 2024-04-16T18:24:06.995 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:24:06.995 DEBUG:boto:Data: 2024-04-16T18:24:06.995 DEBUG:boto:Headers: {} 2024-04-16T18:24:06.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:06.995 DEBUG:boto:Port: 8000 2024-04-16T18:24:06.995 DEBUG:boto:Params: {} 2024-04-16T18:24:06.996 DEBUG:boto:Token: None 2024-04-16T18:24:06.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:06 GMT /cjqttm-52/ 2024-04-16T18:24:06.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc= 2024-04-16T18:24:06.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qrv2LVcvB6DKonTzWE+UMRmffzc=', 'Content-Length': '0'} 2024-04-16T18:24:06.999 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5eec5dfe649ec9e-00661ec246-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:06.999 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:06.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:24:06.999 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:06.999 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.000 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.000 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.000 DEBUG:boto:Method: GET 2024-04-16T18:24:07.000 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.000 DEBUG:boto:Data: 2024-04-16T18:24:07.000 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.000 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.000 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.000 DEBUG:boto:Params: {} 2024-04-16T18:24:07.000 DEBUG:boto:Token: None 2024-04-16T18:24:07.000 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw= 2024-04-16T18:24:07.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw=', 'Content-Length': '0'} 2024-04-16T18:24:07.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f91c11095ed91e3-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.046 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.046 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.046 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.047 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.047 DEBUG:boto:Method: GET 2024-04-16T18:24:07.047 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.047 DEBUG:boto:Data: 2024-04-16T18:24:07.047 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.047 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.047 DEBUG:boto:Params: {} 2024-04-16T18:24:07.047 DEBUG:boto:Token: None 2024-04-16T18:24:07.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw= 2024-04-16T18:24:07.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw=', 'Content-Length': '0'} 2024-04-16T18:24:07.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1fa2add564334cf-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.050 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.050 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.050 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.050 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.051 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.051 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.051 DEBUG:boto:Data: 2024-04-16T18:24:07.051 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.051 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.051 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.051 DEBUG:boto:Params: {} 2024-04-16T18:24:07.051 DEBUG:boto:Token: None 2024-04-16T18:24:07.051 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zTd140rvVaD2D6gmrpFpA5ai3kQ= 2024-04-16T18:24:07.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zTd140rvVaD2D6gmrpFpA5ai3kQ=', 'Content-Length': '0'} 2024-04-16T18:24:07.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000579b63dad7054ec3-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.054 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.054 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.054 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.054 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.054 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.054 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.054 DEBUG:boto:Data: 2024-04-16T18:24:07.055 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.055 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.055 DEBUG:boto:Params: {} 2024-04-16T18:24:07.055 DEBUG:boto:Token: None 2024-04-16T18:24:07.055 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zTd140rvVaD2D6gmrpFpA5ai3kQ= 2024-04-16T18:24:07.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zTd140rvVaD2D6gmrpFpA5ai3kQ=', 'Content-Length': '0'} 2024-04-16T18:24:07.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6c017185f5ba359-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:24:07.058 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.058 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.058 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.058 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.058 DEBUG:boto:Method: GET 2024-04-16T18:24:07.058 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.058 DEBUG:boto:Data: 2024-04-16T18:24:07.058 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.058 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.058 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.059 DEBUG:boto:Params: {} 2024-04-16T18:24:07.059 DEBUG:boto:Token: None 2024-04-16T18:24:07.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw= 2024-04-16T18:24:07.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw=', 'Content-Length': '0'} 2024-04-16T18:24:07.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f96b5107838014a4-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.102 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.102 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.103 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.103 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.103 DEBUG:boto:Method: GET 2024-04-16T18:24:07.103 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.103 DEBUG:boto:Data: 2024-04-16T18:24:07.103 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.103 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.103 DEBUG:boto:Params: {} 2024-04-16T18:24:07.103 DEBUG:boto:Token: None 2024-04-16T18:24:07.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:24:07.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw= 2024-04-16T18:24:07.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SfVZ065iIwo/eMDnM8EqfgwMiSw=', 'Content-Length': '0'} 2024-04-16T18:24:07.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ee8bc4a87a13009-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.106 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.106 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.106 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.106 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.106 DEBUG:boto:Method: GET 2024-04-16T18:24:07.106 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.107 DEBUG:boto:Data: 2024-04-16T18:24:07.107 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.107 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.107 DEBUG:boto:Params: {} 2024-04-16T18:24:07.107 DEBUG:boto:Token: None 2024-04-16T18:24:07.107 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000028ca6cf4e0458af5-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.150 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.151 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.151 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.151 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.151 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.151 DEBUG:boto:Method: GET 2024-04-16T18:24:07.151 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.151 DEBUG:boto:Data: 2024-04-16T18:24:07.151 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.151 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.152 DEBUG:boto:Params: {} 2024-04-16T18:24:07.152 DEBUG:boto:Token: None 2024-04-16T18:24:07.152 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.155 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b74891b91d8e93aa-00661ec247-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.155 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.155 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.156 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.156 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.156 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:24:07.156 DEBUG:boto:Data: 2024-04-16T18:24:07.156 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.156 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.156 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.156 DEBUG:boto:Params: {} 2024-04-16T18:24:07.156 DEBUG:boto:Token: None 2024-04-16T18:24:07.157 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51 2024-04-16T18:24:07.157 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D8VvbkSQoicR9Th3ZV5qGMHwhhY= 2024-04-16T18:24:07.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D8VvbkSQoicR9Th3ZV5qGMHwhhY=', 'Content-Length': '0'} 2024-04-16T18:24:07.159 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b3378f8fbc88f4a5-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.159 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.159 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.160 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.160 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:24:07.160 DEBUG:boto:Data: 2024-04-16T18:24:07.160 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.160 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.160 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.160 DEBUG:boto:Params: {} 2024-04-16T18:24:07.160 DEBUG:boto:Token: None 2024-04-16T18:24:07.160 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51 2024-04-16T18:24:07.161 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D8VvbkSQoicR9Th3ZV5qGMHwhhY= 2024-04-16T18:24:07.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D8VvbkSQoicR9Th3ZV5qGMHwhhY=', 'Content-Length': '0'} 2024-04-16T18:24:07.163 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c45d49707f9695b-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.163 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:24:07.163 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.163 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.164 DEBUG:boto:Method: GET 2024-04-16T18:24:07.164 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:24:07.164 DEBUG:boto:Data: 2024-04-16T18:24:07.164 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.164 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.164 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.164 DEBUG:boto:Params: {} 2024-04-16T18:24:07.164 DEBUG:boto:Token: None 2024-04-16T18:24:07.164 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51 2024-04-16T18:24:07.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VQnpWUdX8LWAx/f+dqKBTU8DVvg= 2024-04-16T18:24:07.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VQnpWUdX8LWAx/f+dqKBTU8DVvg=', 'Content-Length': '0'} 2024-04-16T18:24:07.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eef97955bd379a79-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.210 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:24:07.210 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:24:07.211 DEBUG:boto:Method: GET 2024-04-16T18:24:07.211 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:24:07.211 DEBUG:boto:Data: 2024-04-16T18:24:07.211 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.211 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.211 DEBUG:boto:Params: {} 2024-04-16T18:24:07.211 DEBUG:boto:Token: None 2024-04-16T18:24:07.211 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj51 2024-04-16T18:24:07.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VQnpWUdX8LWAx/f+dqKBTU8DVvg= 2024-04-16T18:24:07.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VQnpWUdX8LWAx/f+dqKBTU8DVvg=', 'Content-Length': '0'} 2024-04-16T18:24:07.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0d5b94b5b9ba2d7-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.214 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.214 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.214 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.214 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.214 DEBUG:boto:Method: GET 2024-04-16T18:24:07.215 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.215 DEBUG:boto:Data: 2024-04-16T18:24:07.215 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.215 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.215 DEBUG:boto:Params: {} 2024-04-16T18:24:07.215 DEBUG:boto:Token: None 2024-04-16T18:24:07.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.215 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.218 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae5e98a7cf78d89c-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.258 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.259 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.259 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.259 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.259 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.259 DEBUG:boto:Method: GET 2024-04-16T18:24:07.259 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:24:07.259 DEBUG:boto:Data: 2024-04-16T18:24:07.259 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.259 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.260 DEBUG:boto:Params: {} 2024-04-16T18:24:07.260 DEBUG:boto:Token: None 2024-04-16T18:24:07.260 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.263 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb3bd0483ae3224b-00661ec247-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.263 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.263 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:24:07.264 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.264 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.264 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.264 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.264 DEBUG:boto:Method: GET 2024-04-16T18:24:07.264 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.264 DEBUG:boto:Data: 2024-04-16T18:24:07.264 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.264 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.264 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.265 DEBUG:boto:Params: {} 2024-04-16T18:24:07.265 DEBUG:boto:Token: None 2024-04-16T18:24:07.265 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.265 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo= 2024-04-16T18:24:07.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo=', 'Content-Length': '0'} 2024-04-16T18:24:07.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be6b6f77051aede8-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.310 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.310 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.311 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.311 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.311 DEBUG:boto:Method: GET 2024-04-16T18:24:07.311 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.311 DEBUG:boto:Data: 2024-04-16T18:24:07.311 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.311 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.311 DEBUG:boto:Params: {} 2024-04-16T18:24:07.311 DEBUG:boto:Token: None 2024-04-16T18:24:07.312 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo= 2024-04-16T18:24:07.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo=', 'Content-Length': '0'} 2024-04-16T18:24:07.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b5872bbaa49c93b-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.314 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.314 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.314 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.314 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.315 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.315 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.315 DEBUG:boto:Data: 2024-04-16T18:24:07.315 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.315 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.315 DEBUG:boto:Params: {} 2024-04-16T18:24:07.315 DEBUG:boto:Token: None 2024-04-16T18:24:07.315 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GfTCcauR9c+hEGGNfMYH5VVMa0U= 2024-04-16T18:24:07.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GfTCcauR9c+hEGGNfMYH5VVMa0U=', 'Content-Length': '0'} 2024-04-16T18:24:07.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c59656990be0460-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.318 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.318 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.318 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.318 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.318 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.318 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.318 DEBUG:boto:Data: 2024-04-16T18:24:07.318 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.319 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.319 DEBUG:boto:Params: {} 2024-04-16T18:24:07.319 DEBUG:boto:Token: None 2024-04-16T18:24:07.319 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GfTCcauR9c+hEGGNfMYH5VVMa0U= 2024-04-16T18:24:07.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GfTCcauR9c+hEGGNfMYH5VVMa0U=', 'Content-Length': '0'} 2024-04-16T18:24:07.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003245ca283ea3358-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.322 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:24:07.322 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.322 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.322 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.322 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.322 DEBUG:boto:Method: GET 2024-04-16T18:24:07.322 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.322 DEBUG:boto:Data: 2024-04-16T18:24:07.322 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.323 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.323 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.323 DEBUG:boto:Params: {} 2024-04-16T18:24:07.323 DEBUG:boto:Token: None 2024-04-16T18:24:07.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo= 2024-04-16T18:24:07.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo=', 'Content-Length': '0'} 2024-04-16T18:24:07.325 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006904ba1d469c5758-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.366 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.366 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.366 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.367 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.367 DEBUG:boto:Method: GET 2024-04-16T18:24:07.367 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.367 DEBUG:boto:Data: 2024-04-16T18:24:07.367 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.367 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.367 DEBUG:boto:Params: {} 2024-04-16T18:24:07.367 DEBUG:boto:Token: None 2024-04-16T18:24:07.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:24:07.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo= 2024-04-16T18:24:07.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W9eVwusg4HfbJV3VpeveQYLFmjo=', 'Content-Length': '0'} 2024-04-16T18:24:07.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028903af487dcd514-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.370 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.370 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.370 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.370 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.370 DEBUG:boto:Method: GET 2024-04-16T18:24:07.370 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.370 DEBUG:boto:Data: 2024-04-16T18:24:07.371 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.371 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.371 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.371 DEBUG:boto:Params: {} 2024-04-16T18:24:07.371 DEBUG:boto:Token: None 2024-04-16T18:24:07.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.374 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6cc2795af48b096-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.414 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.415 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.415 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.415 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.415 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.415 DEBUG:boto:Method: GET 2024-04-16T18:24:07.415 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.415 DEBUG:boto:Data: 2024-04-16T18:24:07.415 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.415 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.415 DEBUG:boto:Params: {} 2024-04-16T18:24:07.416 DEBUG:boto:Token: None 2024-04-16T18:24:07.416 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.419 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d39d4d0aa9ee774-00661ec247-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.419 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.420 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.420 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.420 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.420 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:24:07.420 DEBUG:boto:Data: 2024-04-16T18:24:07.420 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.420 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.420 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.420 DEBUG:boto:Params: {} 2024-04-16T18:24:07.421 DEBUG:boto:Token: None 2024-04-16T18:24:07.421 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55 2024-04-16T18:24:07.421 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q8J4X7Igoj+lSae1Lcu19Qf9igA= 2024-04-16T18:24:07.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q8J4X7Igoj+lSae1Lcu19Qf9igA=', 'Content-Length': '0'} 2024-04-16T18:24:07.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ec1efee21d8d4d4-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.423 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.423 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.423 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.424 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:24:07.424 DEBUG:boto:Data: 2024-04-16T18:24:07.424 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.424 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.424 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.424 DEBUG:boto:Params: {} 2024-04-16T18:24:07.424 DEBUG:boto:Token: None 2024-04-16T18:24:07.424 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55 2024-04-16T18:24:07.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q8J4X7Igoj+lSae1Lcu19Qf9igA= 2024-04-16T18:24:07.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q8J4X7Igoj+lSae1Lcu19Qf9igA=', 'Content-Length': '0'} 2024-04-16T18:24:07.426 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c93d66d69762dc69-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.427 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:24:07.427 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.427 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.427 DEBUG:boto:Method: GET 2024-04-16T18:24:07.427 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:24:07.427 DEBUG:boto:Data: 2024-04-16T18:24:07.427 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.427 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.427 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.427 DEBUG:boto:Params: {} 2024-04-16T18:24:07.427 DEBUG:boto:Token: None 2024-04-16T18:24:07.428 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55 2024-04-16T18:24:07.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:alHQQ4YQ1W2t/71Wu4hMAlwLpws= 2024-04-16T18:24:07.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:alHQQ4YQ1W2t/71Wu4hMAlwLpws=', 'Content-Length': '0'} 2024-04-16T18:24:07.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009886130f3284d8f9-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.470 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:24:07.470 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:24:07.471 DEBUG:boto:Method: GET 2024-04-16T18:24:07.471 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:24:07.471 DEBUG:boto:Data: 2024-04-16T18:24:07.471 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.471 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.471 DEBUG:boto:Params: {} 2024-04-16T18:24:07.471 DEBUG:boto:Token: None 2024-04-16T18:24:07.471 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj55 2024-04-16T18:24:07.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:alHQQ4YQ1W2t/71Wu4hMAlwLpws= 2024-04-16T18:24:07.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:alHQQ4YQ1W2t/71Wu4hMAlwLpws=', 'Content-Length': '0'} 2024-04-16T18:24:07.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cac57be9ab99047-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.474 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.474 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.474 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.474 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.474 DEBUG:boto:Method: GET 2024-04-16T18:24:07.474 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.474 DEBUG:boto:Data: 2024-04-16T18:24:07.474 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.475 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.475 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.475 DEBUG:boto:Params: {} 2024-04-16T18:24:07.475 DEBUG:boto:Token: None 2024-04-16T18:24:07.475 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.478 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000dc0ff963c93f31d-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.518 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.519 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.519 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.519 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.519 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.519 DEBUG:boto:Method: GET 2024-04-16T18:24:07.519 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:24:07.519 DEBUG:boto:Data: 2024-04-16T18:24:07.519 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.519 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.519 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.519 DEBUG:boto:Params: {} 2024-04-16T18:24:07.520 DEBUG:boto:Token: None 2024-04-16T18:24:07.520 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.523 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aa1b041d7eed04b3-00661ec247-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.523 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.523 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:24:07.523 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.523 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.523 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.524 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.524 DEBUG:boto:Method: GET 2024-04-16T18:24:07.524 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.524 DEBUG:boto:Data: 2024-04-16T18:24:07.524 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.524 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.524 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.524 DEBUG:boto:Params: {} 2024-04-16T18:24:07.524 DEBUG:boto:Token: None 2024-04-16T18:24:07.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M= 2024-04-16T18:24:07.525 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M=', 'Content-Length': '0'} 2024-04-16T18:24:07.527 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4105ff2cdd78912-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.570 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.570 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.570 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.571 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.571 DEBUG:boto:Method: GET 2024-04-16T18:24:07.571 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.571 DEBUG:boto:Data: 2024-04-16T18:24:07.571 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.571 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.571 DEBUG:boto:Params: {} 2024-04-16T18:24:07.571 DEBUG:boto:Token: None 2024-04-16T18:24:07.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M= 2024-04-16T18:24:07.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M=', 'Content-Length': '0'} 2024-04-16T18:24:07.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa6988e5c391bed3-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.574 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.574 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.574 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.575 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.575 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.575 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.575 DEBUG:boto:Data: 2024-04-16T18:24:07.575 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.575 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.575 DEBUG:boto:Params: {} 2024-04-16T18:24:07.575 DEBUG:boto:Token: None 2024-04-16T18:24:07.575 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RtwRdYncPGK4Nc05/DYkVbldVmQ= 2024-04-16T18:24:07.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RtwRdYncPGK4Nc05/DYkVbldVmQ=', 'Content-Length': '0'} 2024-04-16T18:24:07.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2b0ed44b09167c7-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.578 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.578 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.578 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.578 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.578 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.578 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.578 DEBUG:boto:Data: 2024-04-16T18:24:07.578 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.578 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.578 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.579 DEBUG:boto:Params: {} 2024-04-16T18:24:07.579 DEBUG:boto:Token: None 2024-04-16T18:24:07.579 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RtwRdYncPGK4Nc05/DYkVbldVmQ= 2024-04-16T18:24:07.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RtwRdYncPGK4Nc05/DYkVbldVmQ=', 'Content-Length': '0'} 2024-04-16T18:24:07.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036b2f362e246bf05-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.581 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:24:07.582 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.582 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.582 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.582 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.582 DEBUG:boto:Method: GET 2024-04-16T18:24:07.582 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.582 DEBUG:boto:Data: 2024-04-16T18:24:07.582 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.582 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.582 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.582 DEBUG:boto:Params: {} 2024-04-16T18:24:07.583 DEBUG:boto:Token: None 2024-04-16T18:24:07.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M= 2024-04-16T18:24:07.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M=', 'Content-Length': '0'} 2024-04-16T18:24:07.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043014f710a0914fd-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.626 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.626 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.627 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.627 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.627 DEBUG:boto:Method: GET 2024-04-16T18:24:07.627 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.627 DEBUG:boto:Data: 2024-04-16T18:24:07.627 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.627 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.627 DEBUG:boto:Params: {} 2024-04-16T18:24:07.627 DEBUG:boto:Token: None 2024-04-16T18:24:07.627 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:24:07.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M= 2024-04-16T18:24:07.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v3DTsw15TPNyizspaOFZKSH946M=', 'Content-Length': '0'} 2024-04-16T18:24:07.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000711506eff2a28d9c-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.630 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.630 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.630 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.630 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.630 DEBUG:boto:Method: GET 2024-04-16T18:24:07.630 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.630 DEBUG:boto:Data: 2024-04-16T18:24:07.631 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.631 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.631 DEBUG:boto:Params: {} 2024-04-16T18:24:07.631 DEBUG:boto:Token: None 2024-04-16T18:24:07.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.634 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069b6d3091cd85047-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.674 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.675 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.675 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.675 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.675 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.675 DEBUG:boto:Method: GET 2024-04-16T18:24:07.675 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.675 DEBUG:boto:Data: 2024-04-16T18:24:07.675 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.675 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.675 DEBUG:boto:Params: {} 2024-04-16T18:24:07.676 DEBUG:boto:Token: None 2024-04-16T18:24:07.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.679 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c93acf3f4329225-00661ec247-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.679 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.679 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.679 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.679 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.679 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:24:07.680 DEBUG:boto:Data: 2024-04-16T18:24:07.680 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.680 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.680 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.680 DEBUG:boto:Params: {} 2024-04-16T18:24:07.680 DEBUG:boto:Token: None 2024-04-16T18:24:07.680 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57 2024-04-16T18:24:07.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rwhmFUo3O/Wvymtm2WrFhERszyw= 2024-04-16T18:24:07.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rwhmFUo3O/Wvymtm2WrFhERszyw=', 'Content-Length': '0'} 2024-04-16T18:24:07.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab8cd1f22626431b-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.683 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.683 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.683 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.683 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:24:07.683 DEBUG:boto:Data: 2024-04-16T18:24:07.683 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.683 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.683 DEBUG:boto:Params: {} 2024-04-16T18:24:07.684 DEBUG:boto:Token: None 2024-04-16T18:24:07.684 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57 2024-04-16T18:24:07.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rwhmFUo3O/Wvymtm2WrFhERszyw= 2024-04-16T18:24:07.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rwhmFUo3O/Wvymtm2WrFhERszyw=', 'Content-Length': '0'} 2024-04-16T18:24:07.686 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f20624a51a94d15-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.686 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:24:07.686 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.686 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.686 DEBUG:boto:Method: GET 2024-04-16T18:24:07.686 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:24:07.686 DEBUG:boto:Data: 2024-04-16T18:24:07.686 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.686 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.686 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.687 DEBUG:boto:Params: {} 2024-04-16T18:24:07.687 DEBUG:boto:Token: None 2024-04-16T18:24:07.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57 2024-04-16T18:24:07.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/zgqABlGeZ3jmAh5Dwh3YcQ+Sbg= 2024-04-16T18:24:07.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/zgqABlGeZ3jmAh5Dwh3YcQ+Sbg=', 'Content-Length': '0'} 2024-04-16T18:24:07.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000053c7659b40a34dfb-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.730 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:24:07.730 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:24:07.730 DEBUG:boto:Method: GET 2024-04-16T18:24:07.730 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:24:07.731 DEBUG:boto:Data: 2024-04-16T18:24:07.731 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.731 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.731 DEBUG:boto:Params: {} 2024-04-16T18:24:07.731 DEBUG:boto:Token: None 2024-04-16T18:24:07.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj57 2024-04-16T18:24:07.731 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/zgqABlGeZ3jmAh5Dwh3YcQ+Sbg= 2024-04-16T18:24:07.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/zgqABlGeZ3jmAh5Dwh3YcQ+Sbg=', 'Content-Length': '0'} 2024-04-16T18:24:07.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005517d3ac4a35d33e-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.734 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.734 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.734 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.734 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.734 DEBUG:boto:Method: GET 2024-04-16T18:24:07.734 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.734 DEBUG:boto:Data: 2024-04-16T18:24:07.735 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.735 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.735 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.735 DEBUG:boto:Params: {} 2024-04-16T18:24:07.735 DEBUG:boto:Token: None 2024-04-16T18:24:07.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.738 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000263c506f6a98f93f-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.778 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.779 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.779 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.779 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.779 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.779 DEBUG:boto:Method: GET 2024-04-16T18:24:07.779 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:24:07.779 DEBUG:boto:Data: 2024-04-16T18:24:07.779 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.779 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.779 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.779 DEBUG:boto:Params: {} 2024-04-16T18:24:07.780 DEBUG:boto:Token: None 2024-04-16T18:24:07.780 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.783 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df7b5ca43a146ac6-00661ec247-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.783 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.783 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:24:07.783 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.784 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.784 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.784 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.784 DEBUG:boto:Method: GET 2024-04-16T18:24:07.784 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.784 DEBUG:boto:Data: 2024-04-16T18:24:07.784 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.784 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.784 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.784 DEBUG:boto:Params: {} 2024-04-16T18:24:07.784 DEBUG:boto:Token: None 2024-04-16T18:24:07.785 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.785 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA= 2024-04-16T18:24:07.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA=', 'Content-Length': '0'} 2024-04-16T18:24:07.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000611e82b6afb6d81d-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.830 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.830 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.830 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.831 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.831 DEBUG:boto:Method: GET 2024-04-16T18:24:07.831 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.831 DEBUG:boto:Data: 2024-04-16T18:24:07.831 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.831 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.831 DEBUG:boto:Params: {} 2024-04-16T18:24:07.831 DEBUG:boto:Token: None 2024-04-16T18:24:07.831 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA= 2024-04-16T18:24:07.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA=', 'Content-Length': '0'} 2024-04-16T18:24:07.834 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000448e520e25222ef6-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.834 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.834 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.834 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.834 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.834 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.835 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.835 DEBUG:boto:Data: 2024-04-16T18:24:07.835 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.835 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.835 DEBUG:boto:Params: {} 2024-04-16T18:24:07.835 DEBUG:boto:Token: None 2024-04-16T18:24:07.835 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AY1naOhW4umzYckEHjvfEpAWD7Q= 2024-04-16T18:24:07.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AY1naOhW4umzYckEHjvfEpAWD7Q=', 'Content-Length': '0'} 2024-04-16T18:24:07.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035b1e6478e43e18a-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.838 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.838 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.838 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.838 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.838 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.838 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.838 DEBUG:boto:Data: 2024-04-16T18:24:07.838 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.838 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.838 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.838 DEBUG:boto:Params: {} 2024-04-16T18:24:07.839 DEBUG:boto:Token: None 2024-04-16T18:24:07.839 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AY1naOhW4umzYckEHjvfEpAWD7Q= 2024-04-16T18:24:07.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AY1naOhW4umzYckEHjvfEpAWD7Q=', 'Content-Length': '0'} 2024-04-16T18:24:07.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d42b4d8b7d3c1cd-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:24:07.841 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.841 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.841 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.841 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.841 DEBUG:boto:Method: GET 2024-04-16T18:24:07.841 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.842 DEBUG:boto:Data: 2024-04-16T18:24:07.842 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.842 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.842 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.842 DEBUG:boto:Params: {} 2024-04-16T18:24:07.842 DEBUG:boto:Token: None 2024-04-16T18:24:07.842 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.842 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA= 2024-04-16T18:24:07.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA=', 'Content-Length': '0'} 2024-04-16T18:24:07.844 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b90a782bd893543-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.886 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.886 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.886 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.887 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.887 DEBUG:boto:Method: GET 2024-04-16T18:24:07.887 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.887 DEBUG:boto:Data: 2024-04-16T18:24:07.887 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.887 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.887 DEBUG:boto:Params: {} 2024-04-16T18:24:07.887 DEBUG:boto:Token: None 2024-04-16T18:24:07.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:24:07.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA= 2024-04-16T18:24:07.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:McHHjPrFFlBQXtCZcOHNIfOexGA=', 'Content-Length': '0'} 2024-04-16T18:24:07.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004e6e08f8fa69ea8-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.890 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.890 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.890 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.890 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.890 DEBUG:boto:Method: GET 2024-04-16T18:24:07.890 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.890 DEBUG:boto:Data: 2024-04-16T18:24:07.890 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.891 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.891 DEBUG:boto:Params: {} 2024-04-16T18:24:07.891 DEBUG:boto:Token: None 2024-04-16T18:24:07.891 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.893 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da9f63dcc230659f-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.934 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.935 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.935 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.935 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.935 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.935 DEBUG:boto:Method: GET 2024-04-16T18:24:07.935 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.935 DEBUG:boto:Data: 2024-04-16T18:24:07.935 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.936 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.936 DEBUG:boto:Params: {} 2024-04-16T18:24:07.936 DEBUG:boto:Token: None 2024-04-16T18:24:07.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.939 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0013ca7c268e669-00661ec247-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.939 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:07.940 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.940 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.940 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.940 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:24:07.940 DEBUG:boto:Data: 2024-04-16T18:24:07.940 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.940 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.940 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.940 DEBUG:boto:Params: {} 2024-04-16T18:24:07.940 DEBUG:boto:Token: None 2024-04-16T18:24:07.941 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68 2024-04-16T18:24:07.941 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vRbchv5rGvL1OUr41GNTR4UZ6u4= 2024-04-16T18:24:07.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vRbchv5rGvL1OUr41GNTR4UZ6u4=', 'Content-Length': '0'} 2024-04-16T18:24:07.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aed1365f974f569c-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.943 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.943 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.943 DEBUG:boto:Method: HEAD 2024-04-16T18:24:07.943 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:24:07.943 DEBUG:boto:Data: 2024-04-16T18:24:07.943 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.943 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.944 DEBUG:boto:Params: {} 2024-04-16T18:24:07.944 DEBUG:boto:Token: None 2024-04-16T18:24:07.944 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68 2024-04-16T18:24:07.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vRbchv5rGvL1OUr41GNTR4UZ6u4= 2024-04-16T18:24:07.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vRbchv5rGvL1OUr41GNTR4UZ6u4=', 'Content-Length': '0'} 2024-04-16T18:24:07.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed319b6672e02490-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:24:07.946 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.946 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.946 DEBUG:boto:Method: GET 2024-04-16T18:24:07.947 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:24:07.947 DEBUG:boto:Data: 2024-04-16T18:24:07.947 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.947 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.947 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.947 DEBUG:boto:Params: {} 2024-04-16T18:24:07.947 DEBUG:boto:Token: None 2024-04-16T18:24:07.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68 2024-04-16T18:24:07.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JjTrkVqPBfmRWzAAQl0MGrHy4eA= 2024-04-16T18:24:07.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JjTrkVqPBfmRWzAAQl0MGrHy4eA=', 'Content-Length': '0'} 2024-04-16T18:24:07.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000980e4481c130bb17-00661ec247-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.990 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:24:07.990 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:24:07.991 DEBUG:boto:Method: GET 2024-04-16T18:24:07.991 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:24:07.991 DEBUG:boto:Data: 2024-04-16T18:24:07.991 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:07.991 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.991 DEBUG:boto:Params: {} 2024-04-16T18:24:07.991 DEBUG:boto:Token: None 2024-04-16T18:24:07.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/obj68 2024-04-16T18:24:07.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JjTrkVqPBfmRWzAAQl0MGrHy4eA= 2024-04-16T18:24:07.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JjTrkVqPBfmRWzAAQl0MGrHy4eA=', 'Content-Length': '0'} 2024-04-16T18:24:07.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e3c03e733595a8d-00661ec247-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:07.994 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:07.994 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:07.994 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.994 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.994 DEBUG:boto:Method: GET 2024-04-16T18:24:07.994 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:24:07.994 DEBUG:boto:Data: 2024-04-16T18:24:07.994 DEBUG:boto:Headers: {} 2024-04-16T18:24:07.994 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:07.994 DEBUG:boto:Port: 8000 2024-04-16T18:24:07.995 DEBUG:boto:Params: {} 2024-04-16T18:24:07.995 DEBUG:boto:Token: None 2024-04-16T18:24:07.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:07 GMT /cjqttm-52/ 2024-04-16T18:24:07.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk= 2024-04-16T18:24:07.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:enfRxwan0O5RQLbXNoCggeR+Atk=', 'Content-Length': '0'} 2024-04-16T18:24:07.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064431a0951b9d0af-00661ec247-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.038 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.039 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.039 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.039 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:08.039 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:24:08.039 DEBUG:boto:Method: GET 2024-04-16T18:24:08.039 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:24:08.039 DEBUG:boto:Data: 2024-04-16T18:24:08.039 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.039 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.039 DEBUG:boto:Params: {} 2024-04-16T18:24:08.040 DEBUG:boto:Token: None 2024-04-16T18:24:08.040 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.043 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f51c38374af07419-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.043 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.043 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:24:08.044 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.044 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.044 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.044 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.044 DEBUG:boto:Method: GET 2024-04-16T18:24:08.044 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.044 DEBUG:boto:Data: 2024-04-16T18:24:08.044 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.044 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.044 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.044 DEBUG:boto:Params: {} 2024-04-16T18:24:08.044 DEBUG:boto:Token: None 2024-04-16T18:24:08.045 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.045 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA= 2024-04-16T18:24:08.045 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA=', 'Content-Length': '0'} 2024-04-16T18:24:08.047 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de8bf838747e1e98-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.090 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.090 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.091 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.091 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.091 DEBUG:boto:Method: GET 2024-04-16T18:24:08.091 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.091 DEBUG:boto:Data: 2024-04-16T18:24:08.091 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.091 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.091 DEBUG:boto:Params: {} 2024-04-16T18:24:08.091 DEBUG:boto:Token: None 2024-04-16T18:24:08.092 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA= 2024-04-16T18:24:08.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA=', 'Content-Length': '0'} 2024-04-16T18:24:08.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bd14fe006620b1d-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.094 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.094 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.094 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.095 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.095 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.095 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.095 DEBUG:boto:Data: 2024-04-16T18:24:08.095 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.095 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.095 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.095 DEBUG:boto:Params: {} 2024-04-16T18:24:08.095 DEBUG:boto:Token: None 2024-04-16T18:24:08.095 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TrmYa2zm+PNc8/Bm8vhvrsgFMSk= 2024-04-16T18:24:08.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TrmYa2zm+PNc8/Bm8vhvrsgFMSk=', 'Content-Length': '0'} 2024-04-16T18:24:08.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b03fb2ff0b04fcaf-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.098 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.098 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.098 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.098 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.098 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.099 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.099 DEBUG:boto:Data: 2024-04-16T18:24:08.099 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.099 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.099 DEBUG:boto:Params: {} 2024-04-16T18:24:08.099 DEBUG:boto:Token: None 2024-04-16T18:24:08.099 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TrmYa2zm+PNc8/Bm8vhvrsgFMSk= 2024-04-16T18:24:08.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TrmYa2zm+PNc8/Bm8vhvrsgFMSk=', 'Content-Length': '0'} 2024-04-16T18:24:08.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4864af5472fbfc4-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.102 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:24:08.102 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.102 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.102 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.102 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.102 DEBUG:boto:Method: GET 2024-04-16T18:24:08.102 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.102 DEBUG:boto:Data: 2024-04-16T18:24:08.102 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.103 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.103 DEBUG:boto:Params: {} 2024-04-16T18:24:08.103 DEBUG:boto:Token: None 2024-04-16T18:24:08.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA= 2024-04-16T18:24:08.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA=', 'Content-Length': '0'} 2024-04-16T18:24:08.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef0f153ad23d1b67-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.146 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.146 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.147 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.147 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.147 DEBUG:boto:Method: GET 2024-04-16T18:24:08.147 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.147 DEBUG:boto:Data: 2024-04-16T18:24:08.147 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.147 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.147 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.147 DEBUG:boto:Params: {} 2024-04-16T18:24:08.147 DEBUG:boto:Token: None 2024-04-16T18:24:08.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:24:08.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA= 2024-04-16T18:24:08.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0q3yeMyhxFafI5hVAmeoTQ2bTxA=', 'Content-Length': '0'} 2024-04-16T18:24:08.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007dff90fdb313ace8-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.150 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.150 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.150 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.150 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.150 DEBUG:boto:Method: GET 2024-04-16T18:24:08.150 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.150 DEBUG:boto:Data: 2024-04-16T18:24:08.151 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.151 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.151 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.151 DEBUG:boto:Params: {} 2024-04-16T18:24:08.151 DEBUG:boto:Token: None 2024-04-16T18:24:08.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.154 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065c56a2df067ebee-00661ec248-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.194 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.195 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.195 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.195 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.195 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.195 DEBUG:boto:Method: GET 2024-04-16T18:24:08.195 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.195 DEBUG:boto:Data: 2024-04-16T18:24:08.195 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.196 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.196 DEBUG:boto:Params: {} 2024-04-16T18:24:08.196 DEBUG:boto:Token: None 2024-04-16T18:24:08.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.199 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0ddc907ddfe9b0b-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.199 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.200 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.200 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.200 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.200 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:24:08.200 DEBUG:boto:Data: 2024-04-16T18:24:08.200 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.200 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.200 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.200 DEBUG:boto:Params: {} 2024-04-16T18:24:08.201 DEBUG:boto:Token: None 2024-04-16T18:24:08.201 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69 2024-04-16T18:24:08.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pf6dfqD5/fHbKw6FxgPDpyo1Tms= 2024-04-16T18:24:08.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pf6dfqD5/fHbKw6FxgPDpyo1Tms=', 'Content-Length': '0'} 2024-04-16T18:24:08.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028601f9edbf7ec06-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.203 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.203 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.203 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.203 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:24:08.203 DEBUG:boto:Data: 2024-04-16T18:24:08.204 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.204 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.204 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.204 DEBUG:boto:Params: {} 2024-04-16T18:24:08.204 DEBUG:boto:Token: None 2024-04-16T18:24:08.204 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69 2024-04-16T18:24:08.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pf6dfqD5/fHbKw6FxgPDpyo1Tms= 2024-04-16T18:24:08.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pf6dfqD5/fHbKw6FxgPDpyo1Tms=', 'Content-Length': '0'} 2024-04-16T18:24:08.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039a7e73695da77b0-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.206 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:24:08.207 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.207 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.207 DEBUG:boto:Method: GET 2024-04-16T18:24:08.207 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:24:08.207 DEBUG:boto:Data: 2024-04-16T18:24:08.207 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.207 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.207 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.207 DEBUG:boto:Params: {} 2024-04-16T18:24:08.207 DEBUG:boto:Token: None 2024-04-16T18:24:08.207 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69 2024-04-16T18:24:08.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+3iwtBjumQPzWMKVyr57VZDPEKo= 2024-04-16T18:24:08.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+3iwtBjumQPzWMKVyr57VZDPEKo=', 'Content-Length': '0'} 2024-04-16T18:24:08.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d7ec95c67b1f0bc-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.250 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:24:08.250 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:24:08.250 DEBUG:boto:Method: GET 2024-04-16T18:24:08.251 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:24:08.251 DEBUG:boto:Data: 2024-04-16T18:24:08.251 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.251 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.251 DEBUG:boto:Params: {} 2024-04-16T18:24:08.251 DEBUG:boto:Token: None 2024-04-16T18:24:08.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj69 2024-04-16T18:24:08.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+3iwtBjumQPzWMKVyr57VZDPEKo= 2024-04-16T18:24:08.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+3iwtBjumQPzWMKVyr57VZDPEKo=', 'Content-Length': '0'} 2024-04-16T18:24:08.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a96adfe0a990b68-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.254 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.254 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.254 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.254 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.254 DEBUG:boto:Method: GET 2024-04-16T18:24:08.255 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.255 DEBUG:boto:Data: 2024-04-16T18:24:08.255 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.255 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.255 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.255 DEBUG:boto:Params: {} 2024-04-16T18:24:08.255 DEBUG:boto:Token: None 2024-04-16T18:24:08.255 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.258 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c243fea372f85bde-00661ec248-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.298 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.299 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.299 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.299 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.299 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.299 DEBUG:boto:Method: GET 2024-04-16T18:24:08.299 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:24:08.299 DEBUG:boto:Data: 2024-04-16T18:24:08.299 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.299 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.300 DEBUG:boto:Params: {} 2024-04-16T18:24:08.300 DEBUG:boto:Token: None 2024-04-16T18:24:08.300 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.303 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b39edd28371d3ec-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.303 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.303 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:24:08.304 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.304 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.304 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.304 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.304 DEBUG:boto:Method: GET 2024-04-16T18:24:08.304 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.304 DEBUG:boto:Data: 2024-04-16T18:24:08.304 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.304 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.304 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.305 DEBUG:boto:Params: {} 2024-04-16T18:24:08.305 DEBUG:boto:Token: None 2024-04-16T18:24:08.305 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.305 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4= 2024-04-16T18:24:08.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4=', 'Content-Length': '0'} 2024-04-16T18:24:08.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbab6e709914df6b-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.350 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.351 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.351 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.351 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.351 DEBUG:boto:Method: GET 2024-04-16T18:24:08.351 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.351 DEBUG:boto:Data: 2024-04-16T18:24:08.351 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.351 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.351 DEBUG:boto:Params: {} 2024-04-16T18:24:08.352 DEBUG:boto:Token: None 2024-04-16T18:24:08.352 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4= 2024-04-16T18:24:08.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4=', 'Content-Length': '0'} 2024-04-16T18:24:08.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf9a5040d9af4783-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.354 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.354 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.354 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.354 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.354 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.354 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.355 DEBUG:boto:Data: 2024-04-16T18:24:08.355 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.355 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.355 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.355 DEBUG:boto:Params: {} 2024-04-16T18:24:08.355 DEBUG:boto:Token: None 2024-04-16T18:24:08.355 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CVov83clvj5xapEtXaSrYW6Kqv8= 2024-04-16T18:24:08.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CVov83clvj5xapEtXaSrYW6Kqv8=', 'Content-Length': '0'} 2024-04-16T18:24:08.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff0fd350d3b9602d-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.357 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.358 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.358 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.358 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.358 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.358 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.358 DEBUG:boto:Data: 2024-04-16T18:24:08.358 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.358 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.358 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.358 DEBUG:boto:Params: {} 2024-04-16T18:24:08.358 DEBUG:boto:Token: None 2024-04-16T18:24:08.359 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CVov83clvj5xapEtXaSrYW6Kqv8= 2024-04-16T18:24:08.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CVov83clvj5xapEtXaSrYW6Kqv8=', 'Content-Length': '0'} 2024-04-16T18:24:08.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bf13fbc475ba95d-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:24:08.361 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.361 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.361 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.361 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.361 DEBUG:boto:Method: GET 2024-04-16T18:24:08.361 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.362 DEBUG:boto:Data: 2024-04-16T18:24:08.362 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.362 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.362 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.362 DEBUG:boto:Params: {} 2024-04-16T18:24:08.362 DEBUG:boto:Token: None 2024-04-16T18:24:08.362 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.362 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4= 2024-04-16T18:24:08.362 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4=', 'Content-Length': '0'} 2024-04-16T18:24:08.364 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e4d990dd7c1bef6-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.406 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.406 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.406 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.407 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.407 DEBUG:boto:Method: GET 2024-04-16T18:24:08.407 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.407 DEBUG:boto:Data: 2024-04-16T18:24:08.407 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.407 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.407 DEBUG:boto:Params: {} 2024-04-16T18:24:08.407 DEBUG:boto:Token: None 2024-04-16T18:24:08.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:24:08.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4= 2024-04-16T18:24:08.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HhP3c9O0lBts5aKuGMj8IMsVaU4=', 'Content-Length': '0'} 2024-04-16T18:24:08.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca70819516d81435-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.410 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.410 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.410 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.410 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.410 DEBUG:boto:Method: GET 2024-04-16T18:24:08.410 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.410 DEBUG:boto:Data: 2024-04-16T18:24:08.410 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.410 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.410 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.411 DEBUG:boto:Params: {} 2024-04-16T18:24:08.411 DEBUG:boto:Token: None 2024-04-16T18:24:08.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.413 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f80816bad5fc139b-00661ec248-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.454 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.455 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.455 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.455 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.455 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.455 DEBUG:boto:Method: GET 2024-04-16T18:24:08.455 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.455 DEBUG:boto:Data: 2024-04-16T18:24:08.455 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.455 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.455 DEBUG:boto:Params: {} 2024-04-16T18:24:08.456 DEBUG:boto:Token: None 2024-04-16T18:24:08.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.459 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f73fe23da940efac-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.459 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.459 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.459 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.460 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.460 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:24:08.460 DEBUG:boto:Data: 2024-04-16T18:24:08.460 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.460 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.460 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.460 DEBUG:boto:Params: {} 2024-04-16T18:24:08.460 DEBUG:boto:Token: None 2024-04-16T18:24:08.460 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76 2024-04-16T18:24:08.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:87Zb1wTylN+CCYgSs4k9CGIufn4= 2024-04-16T18:24:08.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:87Zb1wTylN+CCYgSs4k9CGIufn4=', 'Content-Length': '0'} 2024-04-16T18:24:08.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e67a6e61c5e38b3a-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.463 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.463 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.463 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.463 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:24:08.463 DEBUG:boto:Data: 2024-04-16T18:24:08.463 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.463 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.463 DEBUG:boto:Params: {} 2024-04-16T18:24:08.463 DEBUG:boto:Token: None 2024-04-16T18:24:08.464 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76 2024-04-16T18:24:08.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:87Zb1wTylN+CCYgSs4k9CGIufn4= 2024-04-16T18:24:08.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:87Zb1wTylN+CCYgSs4k9CGIufn4=', 'Content-Length': '0'} 2024-04-16T18:24:08.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c29325760ab78e2e-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.466 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:24:08.466 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.466 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.466 DEBUG:boto:Method: GET 2024-04-16T18:24:08.466 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:24:08.466 DEBUG:boto:Data: 2024-04-16T18:24:08.467 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.467 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.467 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.467 DEBUG:boto:Params: {} 2024-04-16T18:24:08.467 DEBUG:boto:Token: None 2024-04-16T18:24:08.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76 2024-04-16T18:24:08.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ghTgY4+n6qABexZWB+XTBoJxinM= 2024-04-16T18:24:08.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ghTgY4+n6qABexZWB+XTBoJxinM=', 'Content-Length': '0'} 2024-04-16T18:24:08.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016ba529b6a21cc69-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.510 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:24:08.510 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:24:08.511 DEBUG:boto:Method: GET 2024-04-16T18:24:08.511 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:24:08.511 DEBUG:boto:Data: 2024-04-16T18:24:08.511 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.511 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.511 DEBUG:boto:Params: {} 2024-04-16T18:24:08.511 DEBUG:boto:Token: None 2024-04-16T18:24:08.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj76 2024-04-16T18:24:08.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ghTgY4+n6qABexZWB+XTBoJxinM= 2024-04-16T18:24:08.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ghTgY4+n6qABexZWB+XTBoJxinM=', 'Content-Length': '0'} 2024-04-16T18:24:08.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5d70ac65ab01cb6-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.514 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.514 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.514 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.514 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.514 DEBUG:boto:Method: GET 2024-04-16T18:24:08.514 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.514 DEBUG:boto:Data: 2024-04-16T18:24:08.514 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.514 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.515 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.515 DEBUG:boto:Params: {} 2024-04-16T18:24:08.515 DEBUG:boto:Token: None 2024-04-16T18:24:08.515 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.517 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007fc710a7cd15660-00661ec248-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.558 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.559 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.559 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.559 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.559 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.559 DEBUG:boto:Method: GET 2024-04-16T18:24:08.559 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:24:08.559 DEBUG:boto:Data: 2024-04-16T18:24:08.559 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.560 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.560 DEBUG:boto:Params: {} 2024-04-16T18:24:08.560 DEBUG:boto:Token: None 2024-04-16T18:24:08.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.563 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042a71d4c484da6ee-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.563 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:24:08.563 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.564 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.564 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.564 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.564 DEBUG:boto:Method: GET 2024-04-16T18:24:08.564 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.564 DEBUG:boto:Data: 2024-04-16T18:24:08.564 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.564 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.564 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.564 DEBUG:boto:Params: {} 2024-04-16T18:24:08.564 DEBUG:boto:Token: None 2024-04-16T18:24:08.564 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.565 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM= 2024-04-16T18:24:08.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM=', 'Content-Length': '0'} 2024-04-16T18:24:08.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7b19430f82cb2c6-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.610 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.611 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.611 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.611 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.611 DEBUG:boto:Method: GET 2024-04-16T18:24:08.611 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.611 DEBUG:boto:Data: 2024-04-16T18:24:08.611 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.611 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.611 DEBUG:boto:Params: {} 2024-04-16T18:24:08.611 DEBUG:boto:Token: None 2024-04-16T18:24:08.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM= 2024-04-16T18:24:08.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM=', 'Content-Length': '0'} 2024-04-16T18:24:08.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039b4bc45aa96fcb9-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.614 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.614 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.614 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.614 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.614 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.615 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.615 DEBUG:boto:Data: 2024-04-16T18:24:08.615 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.615 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.615 DEBUG:boto:Params: {} 2024-04-16T18:24:08.615 DEBUG:boto:Token: None 2024-04-16T18:24:08.615 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X9VGW59k4daVb4egwkMDa/pL3Dc= 2024-04-16T18:24:08.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X9VGW59k4daVb4egwkMDa/pL3Dc=', 'Content-Length': '0'} 2024-04-16T18:24:08.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008753e0cd8a4a7a41-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.617 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.617 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.617 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.618 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.618 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.618 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.618 DEBUG:boto:Data: 2024-04-16T18:24:08.618 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.618 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.618 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.618 DEBUG:boto:Params: {} 2024-04-16T18:24:08.618 DEBUG:boto:Token: None 2024-04-16T18:24:08.618 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.618 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X9VGW59k4daVb4egwkMDa/pL3Dc= 2024-04-16T18:24:08.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X9VGW59k4daVb4egwkMDa/pL3Dc=', 'Content-Length': '0'} 2024-04-16T18:24:08.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e41b4e95691eb22e-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:24:08.621 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.621 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.621 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.621 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.621 DEBUG:boto:Method: GET 2024-04-16T18:24:08.621 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.621 DEBUG:boto:Data: 2024-04-16T18:24:08.621 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.622 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.622 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.622 DEBUG:boto:Params: {} 2024-04-16T18:24:08.622 DEBUG:boto:Token: None 2024-04-16T18:24:08.622 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.622 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM= 2024-04-16T18:24:08.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM=', 'Content-Length': '0'} 2024-04-16T18:24:08.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c7046e5acbc8f4e-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.666 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.666 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.666 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.667 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.667 DEBUG:boto:Method: GET 2024-04-16T18:24:08.667 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.667 DEBUG:boto:Data: 2024-04-16T18:24:08.667 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.667 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.667 DEBUG:boto:Params: {} 2024-04-16T18:24:08.667 DEBUG:boto:Token: None 2024-04-16T18:24:08.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:24:08.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM= 2024-04-16T18:24:08.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AuMo9RvuUcH1Fh2Sm2KxnP/UcoM=', 'Content-Length': '0'} 2024-04-16T18:24:08.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f1ce850a93eb71b-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.670 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.670 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.670 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.670 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.670 DEBUG:boto:Method: GET 2024-04-16T18:24:08.670 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.670 DEBUG:boto:Data: 2024-04-16T18:24:08.670 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.670 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.670 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.670 DEBUG:boto:Params: {} 2024-04-16T18:24:08.671 DEBUG:boto:Token: None 2024-04-16T18:24:08.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4aecbda0cdb37b8-00661ec248-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.714 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.715 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.715 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.715 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.715 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.715 DEBUG:boto:Method: GET 2024-04-16T18:24:08.715 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.715 DEBUG:boto:Data: 2024-04-16T18:24:08.715 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.715 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.715 DEBUG:boto:Params: {} 2024-04-16T18:24:08.716 DEBUG:boto:Token: None 2024-04-16T18:24:08.716 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.719 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003eab3db03e11ea19-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.719 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.719 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.720 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.720 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.720 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:24:08.720 DEBUG:boto:Data: 2024-04-16T18:24:08.720 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.720 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.720 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.720 DEBUG:boto:Params: {} 2024-04-16T18:24:08.720 DEBUG:boto:Token: None 2024-04-16T18:24:08.720 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85 2024-04-16T18:24:08.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4EUmlPn6d6G4lam/7BxeQBDdB9E= 2024-04-16T18:24:08.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4EUmlPn6d6G4lam/7BxeQBDdB9E=', 'Content-Length': '0'} 2024-04-16T18:24:08.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000386e39d0b7767a6-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.722 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.723 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.723 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.723 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:24:08.723 DEBUG:boto:Data: 2024-04-16T18:24:08.723 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.723 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.723 DEBUG:boto:Params: {} 2024-04-16T18:24:08.723 DEBUG:boto:Token: None 2024-04-16T18:24:08.724 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85 2024-04-16T18:24:08.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4EUmlPn6d6G4lam/7BxeQBDdB9E= 2024-04-16T18:24:08.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4EUmlPn6d6G4lam/7BxeQBDdB9E=', 'Content-Length': '0'} 2024-04-16T18:24:08.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000610750c14a71c68e-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.725 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:24:08.726 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.726 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.726 DEBUG:boto:Method: GET 2024-04-16T18:24:08.726 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:24:08.726 DEBUG:boto:Data: 2024-04-16T18:24:08.726 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.726 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.726 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.726 DEBUG:boto:Params: {} 2024-04-16T18:24:08.727 DEBUG:boto:Token: None 2024-04-16T18:24:08.727 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85 2024-04-16T18:24:08.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZAiuIrxdkUXWVIAHtuMrHMDQNJk= 2024-04-16T18:24:08.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZAiuIrxdkUXWVIAHtuMrHMDQNJk=', 'Content-Length': '0'} 2024-04-16T18:24:08.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016ec1efe741d8a3a-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.770 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:24:08.770 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:24:08.771 DEBUG:boto:Method: GET 2024-04-16T18:24:08.771 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:24:08.771 DEBUG:boto:Data: 2024-04-16T18:24:08.771 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.771 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.771 DEBUG:boto:Params: {} 2024-04-16T18:24:08.771 DEBUG:boto:Token: None 2024-04-16T18:24:08.771 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj85 2024-04-16T18:24:08.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZAiuIrxdkUXWVIAHtuMrHMDQNJk= 2024-04-16T18:24:08.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZAiuIrxdkUXWVIAHtuMrHMDQNJk=', 'Content-Length': '0'} 2024-04-16T18:24:08.773 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000868976bf3b8537e-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.774 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.774 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.774 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.774 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.774 DEBUG:boto:Method: GET 2024-04-16T18:24:08.774 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.774 DEBUG:boto:Data: 2024-04-16T18:24:08.774 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.774 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.774 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.774 DEBUG:boto:Params: {} 2024-04-16T18:24:08.775 DEBUG:boto:Token: None 2024-04-16T18:24:08.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000530fd94a1ec7092f-00661ec248-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.818 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.819 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.819 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.819 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.819 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.819 DEBUG:boto:Method: GET 2024-04-16T18:24:08.819 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:24:08.819 DEBUG:boto:Data: 2024-04-16T18:24:08.819 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.819 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.819 DEBUG:boto:Params: {} 2024-04-16T18:24:08.820 DEBUG:boto:Token: None 2024-04-16T18:24:08.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.823 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ee3a7174c50aacf-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.823 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.823 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:24:08.823 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.823 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.824 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.824 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.824 DEBUG:boto:Method: GET 2024-04-16T18:24:08.824 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.824 DEBUG:boto:Data: 2024-04-16T18:24:08.824 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.824 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.824 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.824 DEBUG:boto:Params: {} 2024-04-16T18:24:08.824 DEBUG:boto:Token: None 2024-04-16T18:24:08.824 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU= 2024-04-16T18:24:08.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU=', 'Content-Length': '0'} 2024-04-16T18:24:08.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e85e152e500c69c7-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.870 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.870 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.870 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.871 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.871 DEBUG:boto:Method: GET 2024-04-16T18:24:08.871 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.871 DEBUG:boto:Data: 2024-04-16T18:24:08.871 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.871 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.871 DEBUG:boto:Params: {} 2024-04-16T18:24:08.871 DEBUG:boto:Token: None 2024-04-16T18:24:08.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU= 2024-04-16T18:24:08.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU=', 'Content-Length': '0'} 2024-04-16T18:24:08.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a010199681d5560-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.874 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.874 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.874 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.874 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.874 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.874 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.875 DEBUG:boto:Data: 2024-04-16T18:24:08.875 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.875 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.875 DEBUG:boto:Params: {} 2024-04-16T18:24:08.875 DEBUG:boto:Token: None 2024-04-16T18:24:08.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GiJovfM9BWv99vtkxKELsFbTysU= 2024-04-16T18:24:08.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GiJovfM9BWv99vtkxKELsFbTysU=', 'Content-Length': '0'} 2024-04-16T18:24:08.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4d96d3d69c38781-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.878 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.878 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.878 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.878 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.878 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.878 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.878 DEBUG:boto:Data: 2024-04-16T18:24:08.878 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.878 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.878 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.878 DEBUG:boto:Params: {} 2024-04-16T18:24:08.879 DEBUG:boto:Token: None 2024-04-16T18:24:08.879 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GiJovfM9BWv99vtkxKELsFbTysU= 2024-04-16T18:24:08.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GiJovfM9BWv99vtkxKELsFbTysU=', 'Content-Length': '0'} 2024-04-16T18:24:08.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000230e5e60fc73924b-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:24:08.881 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.881 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.881 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.881 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.881 DEBUG:boto:Method: GET 2024-04-16T18:24:08.881 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.882 DEBUG:boto:Data: 2024-04-16T18:24:08.882 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.882 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.882 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.882 DEBUG:boto:Params: {} 2024-04-16T18:24:08.882 DEBUG:boto:Token: None 2024-04-16T18:24:08.882 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.882 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU= 2024-04-16T18:24:08.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU=', 'Content-Length': '0'} 2024-04-16T18:24:08.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000874bb8e0db80a8b6-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.926 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.926 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.927 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.927 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.927 DEBUG:boto:Method: GET 2024-04-16T18:24:08.927 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.927 DEBUG:boto:Data: 2024-04-16T18:24:08.927 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.927 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.927 DEBUG:boto:Params: {} 2024-04-16T18:24:08.927 DEBUG:boto:Token: None 2024-04-16T18:24:08.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:24:08.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU= 2024-04-16T18:24:08.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wq1kKcFWvzltWIaQ/WXi+q3DScU=', 'Content-Length': '0'} 2024-04-16T18:24:08.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ddce04be8a07cb8-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.930 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.930 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.930 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:08.930 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:08.930 DEBUG:boto:Method: GET 2024-04-16T18:24:08.930 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:24:08.930 DEBUG:boto:Data: 2024-04-16T18:24:08.930 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.930 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.930 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.931 DEBUG:boto:Params: {} 2024-04-16T18:24:08.931 DEBUG:boto:Token: None 2024-04-16T18:24:08.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.934 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000975ab307a9d73f1b-00661ec248-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.974 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.975 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:08.975 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:08.975 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:08.975 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:08.975 DEBUG:boto:Method: GET 2024-04-16T18:24:08.975 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:24:08.975 DEBUG:boto:Data: 2024-04-16T18:24:08.975 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.975 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.975 DEBUG:boto:Params: {} 2024-04-16T18:24:08.976 DEBUG:boto:Token: None 2024-04-16T18:24:08.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/ 2024-04-16T18:24:08.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys= 2024-04-16T18:24:08.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IUygO6m3mmdeQ+fb/XquxiWf1Ys=', 'Content-Length': '0'} 2024-04-16T18:24:08.979 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000005ec303492f11466-00661ec248-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.979 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:08.979 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.979 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.979 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.979 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:24:08.980 DEBUG:boto:Data: 2024-04-16T18:24:08.980 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.980 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.980 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.980 DEBUG:boto:Params: {} 2024-04-16T18:24:08.980 DEBUG:boto:Token: None 2024-04-16T18:24:08.980 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92 2024-04-16T18:24:08.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4JC8yY17ps9mQb+4w1DMLO9mivw= 2024-04-16T18:24:08.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4JC8yY17ps9mQb+4w1DMLO9mivw=', 'Content-Length': '0'} 2024-04-16T18:24:08.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef32db402ae8e7fd-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.982 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.982 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.983 DEBUG:boto:Method: HEAD 2024-04-16T18:24:08.983 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:24:08.983 DEBUG:boto:Data: 2024-04-16T18:24:08.983 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:08.983 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.983 DEBUG:boto:Params: {} 2024-04-16T18:24:08.983 DEBUG:boto:Token: None 2024-04-16T18:24:08.983 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92 2024-04-16T18:24:08.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4JC8yY17ps9mQb+4w1DMLO9mivw= 2024-04-16T18:24:08.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4JC8yY17ps9mQb+4w1DMLO9mivw=', 'Content-Length': '0'} 2024-04-16T18:24:08.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082ec48f941a6d4cf-00661ec248-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:08.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:24:08.986 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:08.986 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:08.986 DEBUG:boto:Method: GET 2024-04-16T18:24:08.986 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:24:08.986 DEBUG:boto:Data: 2024-04-16T18:24:08.986 DEBUG:boto:Headers: {} 2024-04-16T18:24:08.986 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:08.986 DEBUG:boto:Port: 8000 2024-04-16T18:24:08.986 DEBUG:boto:Params: {} 2024-04-16T18:24:08.986 DEBUG:boto:Token: None 2024-04-16T18:24:08.986 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:08 GMT /cjqttm-52/obj92 2024-04-16T18:24:08.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tM2pYMU1KmwqbOdIl67HmR51Hqw= 2024-04-16T18:24:08.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tM2pYMU1KmwqbOdIl67HmR51Hqw=', 'Content-Length': '0'} 2024-04-16T18:24:08.988 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000756ff0ddba9efae0-00661ec248-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.030 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:24:09.030 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:24:09.030 DEBUG:boto:Method: GET 2024-04-16T18:24:09.031 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:24:09.031 DEBUG:boto:Data: 2024-04-16T18:24:09.031 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.031 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.031 DEBUG:boto:Params: {} 2024-04-16T18:24:09.031 DEBUG:boto:Token: None 2024-04-16T18:24:09.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj92 2024-04-16T18:24:09.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5HRorON8CsLv8KuO3RQsrVmjqwU= 2024-04-16T18:24:09.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5HRorON8CsLv8KuO3RQsrVmjqwU=', 'Content-Length': '0'} 2024-04-16T18:24:09.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002253b904c3e16f4e-00661ec249-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.033 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.034 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.034 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:09.034 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:09.034 DEBUG:boto:Method: GET 2024-04-16T18:24:09.034 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:24:09.034 DEBUG:boto:Data: 2024-04-16T18:24:09.034 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.034 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.034 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.034 DEBUG:boto:Params: {} 2024-04-16T18:24:09.034 DEBUG:boto:Token: None 2024-04-16T18:24:09.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI= 2024-04-16T18:24:09.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI=', 'Content-Length': '0'} 2024-04-16T18:24:09.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ff5c3f0e05155df-00661ec249-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.037 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:09.038 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.038 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.038 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:09.038 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:24:09.038 DEBUG:boto:Method: GET 2024-04-16T18:24:09.038 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:24:09.038 DEBUG:boto:Data: 2024-04-16T18:24:09.038 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.038 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.039 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.039 DEBUG:boto:Params: {} 2024-04-16T18:24:09.039 DEBUG:boto:Token: None 2024-04-16T18:24:09.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI= 2024-04-16T18:24:09.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI=', 'Content-Length': '0'} 2024-04-16T18:24:09.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020b2ea18018297c6-00661ec249-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.042 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:09.042 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:24:09.043 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.043 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.043 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.043 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.043 DEBUG:boto:Method: GET 2024-04-16T18:24:09.043 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.043 DEBUG:boto:Data: 2024-04-16T18:24:09.043 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.043 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.043 DEBUG:boto:Params: {} 2024-04-16T18:24:09.044 DEBUG:boto:Token: None 2024-04-16T18:24:09.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY= 2024-04-16T18:24:09.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY=', 'Content-Length': '0'} 2024-04-16T18:24:09.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000dcf064cee12d15-00661ec249-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.090 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.090 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.091 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.091 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.091 DEBUG:boto:Method: GET 2024-04-16T18:24:09.091 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.091 DEBUG:boto:Data: 2024-04-16T18:24:09.091 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.091 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.091 DEBUG:boto:Params: {} 2024-04-16T18:24:09.091 DEBUG:boto:Token: None 2024-04-16T18:24:09.092 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY= 2024-04-16T18:24:09.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY=', 'Content-Length': '0'} 2024-04-16T18:24:09.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a6bf80b6325ffc3-00661ec249-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.094 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.094 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.094 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.094 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.095 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.095 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.095 DEBUG:boto:Data: 2024-04-16T18:24:09.095 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.095 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.095 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.095 DEBUG:boto:Params: {} 2024-04-16T18:24:09.095 DEBUG:boto:Token: None 2024-04-16T18:24:09.095 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.095 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3H70fNf9sHPkcWVlhgYt/wU4Bws= 2024-04-16T18:24:09.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3H70fNf9sHPkcWVlhgYt/wU4Bws=', 'Content-Length': '0'} 2024-04-16T18:24:09.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6a762c5b3f14be7-00661ec249-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.097 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.098 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.098 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.098 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.098 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.098 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.098 DEBUG:boto:Data: 2024-04-16T18:24:09.098 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.098 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.098 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.098 DEBUG:boto:Params: {} 2024-04-16T18:24:09.098 DEBUG:boto:Token: None 2024-04-16T18:24:09.099 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3H70fNf9sHPkcWVlhgYt/wU4Bws= 2024-04-16T18:24:09.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3H70fNf9sHPkcWVlhgYt/wU4Bws=', 'Content-Length': '0'} 2024-04-16T18:24:09.100 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087622fed60ea77ea-00661ec249-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.101 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:24:09.101 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.101 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.101 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.101 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.101 DEBUG:boto:Method: GET 2024-04-16T18:24:09.101 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.101 DEBUG:boto:Data: 2024-04-16T18:24:09.102 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.102 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.102 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.102 DEBUG:boto:Params: {} 2024-04-16T18:24:09.102 DEBUG:boto:Token: None 2024-04-16T18:24:09.102 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.102 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY= 2024-04-16T18:24:09.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY=', 'Content-Length': '0'} 2024-04-16T18:24:09.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000276184e1493037ba-00661ec249-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.146 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.146 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.147 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.147 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.147 DEBUG:boto:Method: GET 2024-04-16T18:24:09.147 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.147 DEBUG:boto:Data: 2024-04-16T18:24:09.147 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.147 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.147 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.147 DEBUG:boto:Params: {} 2024-04-16T18:24:09.147 DEBUG:boto:Token: None 2024-04-16T18:24:09.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:24:09.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY= 2024-04-16T18:24:09.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GFpx2XDcCVi9pF2qZg5lr1i4PiY=', 'Content-Length': '0'} 2024-04-16T18:24:09.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000028442426826037-00661ec249-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.150 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.150 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.150 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.150 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.150 DEBUG:boto:Method: GET 2024-04-16T18:24:09.151 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.151 DEBUG:boto:Data: 2024-04-16T18:24:09.151 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.151 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.151 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.151 DEBUG:boto:Params: {} 2024-04-16T18:24:09.151 DEBUG:boto:Token: None 2024-04-16T18:24:09.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI= 2024-04-16T18:24:09.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI=', 'Content-Length': '0'} 2024-04-16T18:24:09.154 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f5749e23a0aa4c5-00661ec249-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.155 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:09.155 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.155 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.155 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.155 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.155 DEBUG:boto:Method: GET 2024-04-16T18:24:09.155 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.155 DEBUG:boto:Data: 2024-04-16T18:24:09.156 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.156 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.156 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.156 DEBUG:boto:Params: {} 2024-04-16T18:24:09.156 DEBUG:boto:Token: None 2024-04-16T18:24:09.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI= 2024-04-16T18:24:09.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI=', 'Content-Length': '0'} 2024-04-16T18:24:09.159 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd59a9895dafd1c8-00661ec249-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.159 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:09.159 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.159 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.160 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.160 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:24:09.160 DEBUG:boto:Data: 2024-04-16T18:24:09.160 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.160 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.160 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.160 DEBUG:boto:Params: {} 2024-04-16T18:24:09.160 DEBUG:boto:Token: None 2024-04-16T18:24:09.160 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95 2024-04-16T18:24:09.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/JRIG7ZQ91kd5o3fYnZhUnzWQA8= 2024-04-16T18:24:09.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/JRIG7ZQ91kd5o3fYnZhUnzWQA8=', 'Content-Length': '0'} 2024-04-16T18:24:09.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7b7fcb1c180eb17-00661ec249-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.163 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.163 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.163 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.163 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:24:09.163 DEBUG:boto:Data: 2024-04-16T18:24:09.163 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.163 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.163 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.163 DEBUG:boto:Params: {} 2024-04-16T18:24:09.163 DEBUG:boto:Token: None 2024-04-16T18:24:09.164 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95 2024-04-16T18:24:09.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/JRIG7ZQ91kd5o3fYnZhUnzWQA8= 2024-04-16T18:24:09.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/JRIG7ZQ91kd5o3fYnZhUnzWQA8=', 'Content-Length': '0'} 2024-04-16T18:24:09.166 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c82018074595e4c9-00661ec249-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.166 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:24:09.166 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.167 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.167 DEBUG:boto:Method: GET 2024-04-16T18:24:09.167 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:24:09.167 DEBUG:boto:Data: 2024-04-16T18:24:09.167 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.167 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.167 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.167 DEBUG:boto:Params: {} 2024-04-16T18:24:09.167 DEBUG:boto:Token: None 2024-04-16T18:24:09.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95 2024-04-16T18:24:09.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mTZLRUCwuCoiRAU+H9C6Vr2iiMs= 2024-04-16T18:24:09.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mTZLRUCwuCoiRAU+H9C6Vr2iiMs=', 'Content-Length': '0'} 2024-04-16T18:24:09.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b2cc83d456abe65-00661ec249-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.210 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:24:09.210 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:24:09.211 DEBUG:boto:Method: GET 2024-04-16T18:24:09.211 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:24:09.211 DEBUG:boto:Data: 2024-04-16T18:24:09.211 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.211 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.211 DEBUG:boto:Params: {} 2024-04-16T18:24:09.211 DEBUG:boto:Token: None 2024-04-16T18:24:09.211 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj95 2024-04-16T18:24:09.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mTZLRUCwuCoiRAU+H9C6Vr2iiMs= 2024-04-16T18:24:09.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mTZLRUCwuCoiRAU+H9C6Vr2iiMs=', 'Content-Length': '0'} 2024-04-16T18:24:09.213 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2a6d1ea81a77851-00661ec249-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.214 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.214 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.214 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.214 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.214 DEBUG:boto:Method: GET 2024-04-16T18:24:09.214 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.214 DEBUG:boto:Data: 2024-04-16T18:24:09.214 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.214 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:24:09.214 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.215 DEBUG:boto:Params: {} 2024-04-16T18:24:09.215 DEBUG:boto:Token: None 2024-04-16T18:24:09.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.215 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI= 2024-04-16T18:24:09.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI=', 'Content-Length': '0'} 2024-04-16T18:24:09.217 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4f728d7c95b1d40-00661ec249-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.217 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:09.218 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.218 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.218 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.218 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.218 DEBUG:boto:Method: GET 2024-04-16T18:24:09.218 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:24:09.218 DEBUG:boto:Data: 2024-04-16T18:24:09.218 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.218 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.219 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.219 DEBUG:boto:Params: {} 2024-04-16T18:24:09.219 DEBUG:boto:Token: None 2024-04-16T18:24:09.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI= 2024-04-16T18:24:09.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zva1XWvgQ7D1a/ZeMarFosfMLqI=', 'Content-Length': '0'} 2024-04-16T18:24:09.222 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d5fdce4ebbf37bd3-00661ec249-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.222 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:24:09.223 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:24:09.223 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:24:09.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:24:09.223 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:24:09.282 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:24:09.282 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:24:09.357 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:24:09.357 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-52 2024-04-16T18:24:09.367 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 20 2024-04-16T18:24:09.436 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.436 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.436 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.436 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:24:09.436 DEBUG:boto:Data: 2024-04-16T18:24:09.436 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.437 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.437 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.437 DEBUG:boto:Params: {} 2024-04-16T18:24:09.437 DEBUG:boto:Token: None 2024-04-16T18:24:09.437 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.437 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA= 2024-04-16T18:24:09.437 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA=', 'Content-Length': '0'} 2024-04-16T18:24:09.440 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009ad7af2da0ff97ab-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.441 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:24:09.441 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:24:09.441 DEBUG:boto:Method: PUT 2024-04-16T18:24:09.441 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:24:09.441 DEBUG:boto:Data: 2024-04-16T18:24:09.441 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:24:09.441 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.442 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.442 DEBUG:boto:Params: {} 2024-04-16T18:24:09.442 DEBUG:boto:Token: None 2024-04-16T18:24:09.442 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj29 2024-04-16T18:24:09.442 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t68EcTDwI98ucMIvsB/B1nN2B3E= 2024-04-16T18:24:09.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t68EcTDwI98ucMIvsB/B1nN2B3E='} 2024-04-16T18:24:09.486 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000df2beb64fc2a2f99-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.487 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.487 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.487 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.487 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:24:09.487 DEBUG:boto:Data: 2024-04-16T18:24:09.487 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.487 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.487 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.487 DEBUG:boto:Params: {} 2024-04-16T18:24:09.487 DEBUG:boto:Token: None 2024-04-16T18:24:09.488 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA= 2024-04-16T18:24:09.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA=', 'Content-Length': '0'} 2024-04-16T18:24:09.490 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a618017b4bb5161c-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.491 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:24:09.491 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:24:09.491 DEBUG:boto:Method: PUT 2024-04-16T18:24:09.491 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:24:09.491 DEBUG:boto:Data: 2024-04-16T18:24:09.491 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:24:09.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.492 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.492 DEBUG:boto:Params: {} 2024-04-16T18:24:09.492 DEBUG:boto:Token: None 2024-04-16T18:24:09.492 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj58 2024-04-16T18:24:09.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qC9KeqSDoPrdurdofuuW47AkjLk= 2024-04-16T18:24:09.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qC9KeqSDoPrdurdofuuW47AkjLk='} 2024-04-16T18:24:09.497 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f4bdc5165ab9492e-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.497 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.498 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.498 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.498 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:24:09.498 DEBUG:boto:Data: 2024-04-16T18:24:09.498 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.498 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.498 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.498 DEBUG:boto:Params: {} 2024-04-16T18:24:09.498 DEBUG:boto:Token: None 2024-04-16T18:24:09.498 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA= 2024-04-16T18:24:09.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA=', 'Content-Length': '0'} 2024-04-16T18:24:09.501 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003db956d92f0529fb-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.501 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:24:09.501 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:24:09.502 DEBUG:boto:Method: PUT 2024-04-16T18:24:09.502 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:24:09.502 DEBUG:boto:Data: 2024-04-16T18:24:09.502 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:24:09.502 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.502 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.502 DEBUG:boto:Params: {} 2024-04-16T18:24:09.502 DEBUG:boto:Token: None 2024-04-16T18:24:09.503 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj87 2024-04-16T18:24:09.503 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eayme0r0gHMgzUVPDzK5dfMgyj8= 2024-04-16T18:24:09.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eayme0r0gHMgzUVPDzK5dfMgyj8='} 2024-04-16T18:24:09.546 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000037a1c8a75e727347-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.547 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.547 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.547 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.547 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:24:09.547 DEBUG:boto:Data: 2024-04-16T18:24:09.547 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.547 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.547 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.547 DEBUG:boto:Params: {} 2024-04-16T18:24:09.547 DEBUG:boto:Token: None 2024-04-16T18:24:09.547 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA= 2024-04-16T18:24:09.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA=', 'Content-Length': '0'} 2024-04-16T18:24:09.550 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f34b613e6690e342-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.551 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:24:09.551 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:24:09.551 DEBUG:boto:Method: PUT 2024-04-16T18:24:09.551 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:24:09.551 DEBUG:boto:Data: 2024-04-16T18:24:09.551 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:24:09.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.551 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.551 DEBUG:boto:Params: {} 2024-04-16T18:24:09.551 DEBUG:boto:Token: None 2024-04-16T18:24:09.552 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj116 2024-04-16T18:24:09.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tKubN4Y+XlyxQT5z348Yhg7B/98= 2024-04-16T18:24:09.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tKubN4Y+XlyxQT5z348Yhg7B/98='} 2024-04-16T18:24:09.557 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f663fafbe2594fb6-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.557 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:24:09.557 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:24:09.558 DEBUG:boto:Method: HEAD 2024-04-16T18:24:09.558 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:24:09.558 DEBUG:boto:Data: 2024-04-16T18:24:09.558 DEBUG:boto:Headers: {} 2024-04-16T18:24:09.558 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.558 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.558 DEBUG:boto:Params: {} 2024-04-16T18:24:09.558 DEBUG:boto:Token: None 2024-04-16T18:24:09.558 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/ 2024-04-16T18:24:09.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA= 2024-04-16T18:24:09.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ClXPG+9ufR0dRhhzrcqeYY77shA=', 'Content-Length': '0'} 2024-04-16T18:24:09.573 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000308db3d80bfe3989-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.573 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:24:09.573 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:24:09.573 DEBUG:boto:Method: PUT 2024-04-16T18:24:09.573 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:24:09.574 DEBUG:boto:Data: 2024-04-16T18:24:09.574 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:24:09.574 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:24:09.574 DEBUG:boto:Port: 8000 2024-04-16T18:24:09.574 DEBUG:boto:Params: {} 2024-04-16T18:24:09.574 DEBUG:boto:Token: None 2024-04-16T18:24:09.574 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:24:09 GMT /cjqttm-52/obj145 2024-04-16T18:24:09.574 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Re44yelZrDr4xsqrUYMvTzuoxW4= 2024-04-16T18:24:09.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:24:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Re44yelZrDr4xsqrUYMvTzuoxW4='} 2024-04-16T18:24:09.618 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd51d53c59c90c7e-00661ec249-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:24:09.619 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:24:09.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:24:09.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:24:09.619 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:24:09.682 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:24:09.682 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:24:09.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:09.744+0000 7f4c09c33800 1 waiting to reach latest gen 4, on 3.. 2024-04-16T18:24:14.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:14.746+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:14.746 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:14.747 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:19.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:19.748+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:19.748 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:19.748 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:24.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:24.750+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:24.750 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:24.750 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:29.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:29.753+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:29.754 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:29.754 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:34.754 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:34.755+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:34.754 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:34.754 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:39.758 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:39.757+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:39.758 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:39.758 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:44.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:44.758+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:44.758 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:44.758 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:49.759 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:49.759+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:49.759 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:49.759 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:54.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:54.761+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:54.761 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:54.761 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:24:59.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:24:59.763+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:24:59.768 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:24:59.768 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:04.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:04.765+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:04.765 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:25:04.765 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:09.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:09.767+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:09.767 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , , , , , , , , , , , , 00000000002.78.6, , , , , , , , , , , ] 2024-04-16T18:25:09.767 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:14.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:14.770+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:14.769 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , , , , , , , , , , , , 00000000002.78.6, , , , , , , , , , , ] 2024-04-16T18:25:14.769 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:19.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:19.772+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:19.772 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:19.772 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:24.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:24.774+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:24.773 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:24.773 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:29.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:29.775+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:29.775 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:29.775 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:34.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:34.777+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:34.776 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:34.777 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:39.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:39.778+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:39.778 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:39.778 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:44.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:44.780+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:44.780 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:44.780 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:49.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:49.782+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:49.782 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:49.782 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:54.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:54.784+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:54.784 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:54.784 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:59.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:25:59.786+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:25:59.786 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:25:59.786 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:04.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:04.789+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:04.788 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:04.788 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:09.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:09.791+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:09.790 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:14.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:14.792+0000 7f4c09c33800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:14.792 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:14.792 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:19.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:19.793+0000 7f4c09c33800 1 bucket sync caught up with source: 2024-04-16T18:26:19.793 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:19.793 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [00000000002.71.6, 00000000001.59.6, , , , , 00000000001.61.6, , , , , , , , , , , 00000000002.78.6, 00000000001.55.6, , , , , , , , , , ] 2024-04-16T18:26:19.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:19.793+0000 7f4c09c33800 0 bucket checkpoint complete 2024-04-16T18:26:19.820 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:26:19.820 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:26:19.820 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:26:19.821 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:26:19.883 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:26:19.883 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:26:19.946 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:26:19.947+0000 7f6cf432d800 1 bucket sync caught up with source: 2024-04-16T18:26:19.946 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.544.6, 00000000002.673.6, 00000000001.1301.6, 00000000003.433.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000002.877.6, 00000000005.166.6, 00000000004.767.6] 2024-04-16T18:26:19.946 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000002.544.6, 00000000002.673.6, 00000000001.1301.6, 00000000003.433.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000002.877.6, 00000000005.166.6, 00000000004.767.6] 2024-04-16T18:26:19.947 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:26:19.947+0000 7f6cf432d800 0 bucket checkpoint complete 2024-04-16T18:26:19.969 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:26:19.969 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:19.969 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:19.969 DEBUG:boto:Method: HEAD 2024-04-16T18:26:19.969 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:26:19.970 DEBUG:boto:Data: 2024-04-16T18:26:19.970 DEBUG:boto:Headers: {} 2024-04-16T18:26:19.970 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:19.970 DEBUG:boto:Port: 8000 2024-04-16T18:26:19.970 DEBUG:boto:Params: {} 2024-04-16T18:26:19.971 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:26:19.971 DEBUG:boto:Token: None 2024-04-16T18:26:19.971 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:19 GMT /cjqttm-52/ 2024-04-16T18:26:19.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rJ1Sr4xF3lWt/sflxDo2JPIMpOA= 2024-04-16T18:26:19.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rJ1Sr4xF3lWt/sflxDo2JPIMpOA=', 'Content-Length': '0'} 2024-04-16T18:26:19.977 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001b94dcd526097428-00661ec2cb-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:26:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:19.977 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:19.977 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:19.977 DEBUG:boto:Method: HEAD 2024-04-16T18:26:19.977 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:26:19.978 DEBUG:boto:Data: 2024-04-16T18:26:19.978 DEBUG:boto:Headers: {} 2024-04-16T18:26:19.978 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:19.978 DEBUG:boto:Port: 8000 2024-04-16T18:26:19.978 DEBUG:boto:Params: {} 2024-04-16T18:26:19.978 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:26:19.978 DEBUG:boto:Token: None 2024-04-16T18:26:19.978 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:19 GMT /cjqttm-52/ 2024-04-16T18:26:19.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rJ1Sr4xF3lWt/sflxDo2JPIMpOA= 2024-04-16T18:26:19.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rJ1Sr4xF3lWt/sflxDo2JPIMpOA=', 'Content-Length': '0'} 2024-04-16T18:26:19.983 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ae35cd72e3b1fc20-00661ec2cb-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:26:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:19.983 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:26:19.984 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:19.984 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:19.984 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:19.984 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:19.984 DEBUG:boto:Method: GET 2024-04-16T18:26:19.984 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:19.984 DEBUG:boto:Data: 2024-04-16T18:26:19.984 DEBUG:boto:Headers: {} 2024-04-16T18:26:19.984 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:19.985 DEBUG:boto:Port: 8000 2024-04-16T18:26:19.985 DEBUG:boto:Params: {} 2024-04-16T18:26:19.985 DEBUG:boto:Token: None 2024-04-16T18:26:19.985 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:19 GMT /cjqttm-52/?versions 2024-04-16T18:26:19.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:emRGXZ28xT3Dd03st4ZnSxIt8oU= 2024-04-16T18:26:19.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:emRGXZ28xT3Dd03st4ZnSxIt8oU=', 'Content-Length': '0'} 2024-04-16T18:26:19.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f87552f2db60243b-00661ec2cb-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:19.988 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:19.989 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:26:19.989 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:26:19.990 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:26:19.991 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:26:19.992 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:26:19.992 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:26:19.992 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:26:19.992 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:26:19.992 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:19.992 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:19.992 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:19.992 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:19.992 DEBUG:boto:Method: GET 2024-04-16T18:26:19.992 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:19.993 DEBUG:boto:Data: 2024-04-16T18:26:19.993 DEBUG:boto:Headers: {} 2024-04-16T18:26:19.993 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:19.993 DEBUG:boto:Port: 8000 2024-04-16T18:26:19.993 DEBUG:boto:Params: {} 2024-04-16T18:26:19.993 DEBUG:boto:Token: None 2024-04-16T18:26:19.993 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:19 GMT /cjqttm-52/?versions 2024-04-16T18:26:19.993 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:emRGXZ28xT3Dd03st4ZnSxIt8oU= 2024-04-16T18:26:19.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:emRGXZ28xT3Dd03st4ZnSxIt8oU=', 'Content-Length': '0'} 2024-04-16T18:26:19.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007739b6a87f28c8be-00661ec2cb-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:19.997 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:19.998 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:26:19.998 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:26:19.998 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:26:19.998 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:26:19.999 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:26:20.000 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:26:20.001 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.001 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.001 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:20.001 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:20.001 DEBUG:boto:Method: GET 2024-04-16T18:26:20.001 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:20.001 DEBUG:boto:Data: 2024-04-16T18:26:20.001 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.001 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.001 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.002 DEBUG:boto:Params: {} 2024-04-16T18:26:20.002 DEBUG:boto:Token: None 2024-04-16T18:26:20.002 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/?versions 2024-04-16T18:26:20.002 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ipj7B5GjiRolWd621M90Io4x+pY= 2024-04-16T18:26:20.002 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ipj7B5GjiRolWd621M90Io4x+pY=', 'Content-Length': '0'} 2024-04-16T18:26:20.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033de0bb61e2e3d1b-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.005 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.006 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.006 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.006 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:20.006 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:20.006 DEBUG:boto:Method: GET 2024-04-16T18:26:20.007 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:26:20.007 DEBUG:boto:Data: 2024-04-16T18:26:20.007 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.007 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.007 DEBUG:boto:Params: {} 2024-04-16T18:26:20.007 DEBUG:boto:Token: None 2024-04-16T18:26:20.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/?versions 2024-04-16T18:26:20.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ipj7B5GjiRolWd621M90Io4x+pY= 2024-04-16T18:26:20.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ipj7B5GjiRolWd621M90Io4x+pY=', 'Content-Length': '0'} 2024-04-16T18:26:20.011 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f67697a1ede389c5-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.011 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.012 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:26:20.012 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.012 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.012 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.013 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.013 DEBUG:boto:Method: GET 2024-04-16T18:26:20.013 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.013 DEBUG:boto:Data: 2024-04-16T18:26:20.013 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.013 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.013 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.013 DEBUG:boto:Params: {} 2024-04-16T18:26:20.013 DEBUG:boto:Token: None 2024-04-16T18:26:20.013 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.014 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg= 2024-04-16T18:26:20.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg=', 'Content-Length': '0'} 2024-04-16T18:26:20.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dec6edb73129128b-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.016 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.016 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.016 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.016 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.016 DEBUG:boto:Method: GET 2024-04-16T18:26:20.017 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.017 DEBUG:boto:Data: 2024-04-16T18:26:20.017 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.017 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.017 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.017 DEBUG:boto:Params: {} 2024-04-16T18:26:20.017 DEBUG:boto:Token: None 2024-04-16T18:26:20.017 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.017 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg= 2024-04-16T18:26:20.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg=', 'Content-Length': '0'} 2024-04-16T18:26:20.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000470dadf389f9325d-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.062 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.063 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.063 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.063 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.063 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.063 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.063 DEBUG:boto:Data: 2024-04-16T18:26:20.063 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.063 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.063 DEBUG:boto:Params: {} 2024-04-16T18:26:20.063 DEBUG:boto:Token: None 2024-04-16T18:26:20.064 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gJaBlL+E4VS2oshi3+TRxsst8Do= 2024-04-16T18:26:20.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gJaBlL+E4VS2oshi3+TRxsst8Do=', 'Content-Length': '0'} 2024-04-16T18:26:20.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007315dae2f3552ce8-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.066 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.066 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.066 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.066 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.067 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.067 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.067 DEBUG:boto:Data: 2024-04-16T18:26:20.067 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.067 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.067 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.067 DEBUG:boto:Params: {} 2024-04-16T18:26:20.067 DEBUG:boto:Token: None 2024-04-16T18:26:20.067 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gJaBlL+E4VS2oshi3+TRxsst8Do= 2024-04-16T18:26:20.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gJaBlL+E4VS2oshi3+TRxsst8Do=', 'Content-Length': '0'} 2024-04-16T18:26:20.069 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed39ade116aa2b81-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.069 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:26:20.070 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.070 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.070 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.070 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.070 DEBUG:boto:Method: GET 2024-04-16T18:26:20.070 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.070 DEBUG:boto:Data: 2024-04-16T18:26:20.070 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.071 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.071 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.071 DEBUG:boto:Params: {} 2024-04-16T18:26:20.071 DEBUG:boto:Token: None 2024-04-16T18:26:20.071 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.071 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg= 2024-04-16T18:26:20.071 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg=', 'Content-Length': '0'} 2024-04-16T18:26:20.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003757c31be8367628-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.074 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.074 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.074 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.074 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.074 DEBUG:boto:Method: GET 2024-04-16T18:26:20.074 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.075 DEBUG:boto:Data: 2024-04-16T18:26:20.075 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.075 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.075 DEBUG:boto:Params: {} 2024-04-16T18:26:20.075 DEBUG:boto:Token: None 2024-04-16T18:26:20.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:26:20.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg= 2024-04-16T18:26:20.075 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rS8vDf85+5eWwvy3KTkQ4lSHmg=', 'Content-Length': '0'} 2024-04-16T18:26:20.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7b5a5946e3f93a4-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.077 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.078 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.078 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.078 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.078 DEBUG:boto:Method: GET 2024-04-16T18:26:20.078 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.078 DEBUG:boto:Data: 2024-04-16T18:26:20.078 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.078 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.078 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.078 DEBUG:boto:Params: {} 2024-04-16T18:26:20.078 DEBUG:boto:Token: None 2024-04-16T18:26:20.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.081 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098c63bb399dc84a2-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.082 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.082 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.082 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.082 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.082 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.082 DEBUG:boto:Method: GET 2024-04-16T18:26:20.082 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.083 DEBUG:boto:Data: 2024-04-16T18:26:20.083 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.083 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.083 DEBUG:boto:Params: {} 2024-04-16T18:26:20.083 DEBUG:boto:Token: None 2024-04-16T18:26:20.083 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.083 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000061e55b532a098ba6-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.087 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.087 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.087 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.087 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.088 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:26:20.088 DEBUG:boto:Data: 2024-04-16T18:26:20.088 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.088 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.088 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.088 DEBUG:boto:Params: {} 2024-04-16T18:26:20.088 DEBUG:boto:Token: None 2024-04-16T18:26:20.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11 2024-04-16T18:26:20.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LMmm5XPigfateQkXM9sTzWWBbes= 2024-04-16T18:26:20.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LMmm5XPigfateQkXM9sTzWWBbes=', 'Content-Length': '0'} 2024-04-16T18:26:20.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b844ec4088d41658-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.091 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.091 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.091 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.091 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:26:20.091 DEBUG:boto:Data: 2024-04-16T18:26:20.091 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.092 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.092 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.092 DEBUG:boto:Params: {} 2024-04-16T18:26:20.092 DEBUG:boto:Token: None 2024-04-16T18:26:20.092 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11 2024-04-16T18:26:20.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LMmm5XPigfateQkXM9sTzWWBbes= 2024-04-16T18:26:20.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LMmm5XPigfateQkXM9sTzWWBbes=', 'Content-Length': '0'} 2024-04-16T18:26:20.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d1ef009bfc8ed99-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.094 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:26:20.095 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.095 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.095 DEBUG:boto:Method: GET 2024-04-16T18:26:20.095 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:26:20.095 DEBUG:boto:Data: 2024-04-16T18:26:20.095 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.095 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.095 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.095 DEBUG:boto:Params: {} 2024-04-16T18:26:20.096 DEBUG:boto:Token: None 2024-04-16T18:26:20.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11 2024-04-16T18:26:20.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RJQozaIJdVaFekEFTpiSKhUj44c= 2024-04-16T18:26:20.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RJQozaIJdVaFekEFTpiSKhUj44c=', 'Content-Length': '0'} 2024-04-16T18:26:20.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a81571958f69d4d-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.098 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:26:20.098 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:26:20.099 DEBUG:boto:Method: GET 2024-04-16T18:26:20.099 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:26:20.099 DEBUG:boto:Data: 2024-04-16T18:26:20.099 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.099 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.099 DEBUG:boto:Params: {} 2024-04-16T18:26:20.099 DEBUG:boto:Token: None 2024-04-16T18:26:20.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj11 2024-04-16T18:26:20.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RJQozaIJdVaFekEFTpiSKhUj44c= 2024-04-16T18:26:20.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RJQozaIJdVaFekEFTpiSKhUj44c=', 'Content-Length': '0'} 2024-04-16T18:26:20.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db9ac91bafaae7d7-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.102 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.102 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.102 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.102 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.102 DEBUG:boto:Method: GET 2024-04-16T18:26:20.102 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.103 DEBUG:boto:Data: 2024-04-16T18:26:20.103 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.103 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.103 DEBUG:boto:Params: {} 2024-04-16T18:26:20.103 DEBUG:boto:Token: None 2024-04-16T18:26:20.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f922b8e8c8c3d60-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.146 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.147 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.147 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.147 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.147 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.147 DEBUG:boto:Method: GET 2024-04-16T18:26:20.147 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:26:20.147 DEBUG:boto:Data: 2024-04-16T18:26:20.148 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.148 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.148 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.148 DEBUG:boto:Params: {} 2024-04-16T18:26:20.148 DEBUG:boto:Token: None 2024-04-16T18:26:20.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.151 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048217cabfc7b5e4d-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.152 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.152 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:26:20.152 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.152 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.152 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.153 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.153 DEBUG:boto:Method: GET 2024-04-16T18:26:20.153 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.153 DEBUG:boto:Data: 2024-04-16T18:26:20.153 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.153 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.153 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.153 DEBUG:boto:Params: {} 2024-04-16T18:26:20.153 DEBUG:boto:Token: None 2024-04-16T18:26:20.154 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.154 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w= 2024-04-16T18:26:20.154 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w=', 'Content-Length': '0'} 2024-04-16T18:26:20.156 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015ae16d35a012b86-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.202 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.203 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.203 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.203 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.203 DEBUG:boto:Method: GET 2024-04-16T18:26:20.203 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.203 DEBUG:boto:Data: 2024-04-16T18:26:20.203 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.203 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.203 DEBUG:boto:Params: {} 2024-04-16T18:26:20.204 DEBUG:boto:Token: None 2024-04-16T18:26:20.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w= 2024-04-16T18:26:20.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w=', 'Content-Length': '0'} 2024-04-16T18:26:20.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084ba7e7ccca4992c-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.206 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.207 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.207 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.207 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.207 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.207 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.207 DEBUG:boto:Data: 2024-04-16T18:26:20.207 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.207 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.207 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.207 DEBUG:boto:Params: {} 2024-04-16T18:26:20.208 DEBUG:boto:Token: None 2024-04-16T18:26:20.208 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LEcVaZYCcx0k89zZznQ22optJ84= 2024-04-16T18:26:20.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LEcVaZYCcx0k89zZznQ22optJ84=', 'Content-Length': '0'} 2024-04-16T18:26:20.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d21d5f99c47dc55-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.210 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.211 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.211 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.211 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.211 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.211 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.211 DEBUG:boto:Data: 2024-04-16T18:26:20.211 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.211 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.211 DEBUG:boto:Params: {} 2024-04-16T18:26:20.212 DEBUG:boto:Token: None 2024-04-16T18:26:20.212 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LEcVaZYCcx0k89zZznQ22optJ84= 2024-04-16T18:26:20.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LEcVaZYCcx0k89zZznQ22optJ84=', 'Content-Length': '0'} 2024-04-16T18:26:20.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ba612539962b6b4-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.214 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:26:20.214 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.214 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.215 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.215 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.215 DEBUG:boto:Method: GET 2024-04-16T18:26:20.215 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.215 DEBUG:boto:Data: 2024-04-16T18:26:20.215 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.215 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.215 DEBUG:boto:Params: {} 2024-04-16T18:26:20.215 DEBUG:boto:Token: None 2024-04-16T18:26:20.216 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w= 2024-04-16T18:26:20.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w=', 'Content-Length': '0'} 2024-04-16T18:26:20.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb337caf75b3ad08-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.258 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.259 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.259 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.259 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.259 DEBUG:boto:Method: GET 2024-04-16T18:26:20.259 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.259 DEBUG:boto:Data: 2024-04-16T18:26:20.259 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.259 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.260 DEBUG:boto:Params: {} 2024-04-16T18:26:20.260 DEBUG:boto:Token: None 2024-04-16T18:26:20.260 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:26:20.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w= 2024-04-16T18:26:20.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2kD8z1fLsH3W1T+p9ZtVs3+43w=', 'Content-Length': '0'} 2024-04-16T18:26:20.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec13783f342cc37f-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.262 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.263 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.263 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.263 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.263 DEBUG:boto:Method: GET 2024-04-16T18:26:20.263 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.263 DEBUG:boto:Data: 2024-04-16T18:26:20.263 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.263 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.263 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.264 DEBUG:boto:Params: {} 2024-04-16T18:26:20.264 DEBUG:boto:Token: None 2024-04-16T18:26:20.264 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009b504236f71a85e-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.266 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.267 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.267 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.267 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.267 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.267 DEBUG:boto:Method: GET 2024-04-16T18:26:20.267 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.268 DEBUG:boto:Data: 2024-04-16T18:26:20.268 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.268 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.268 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.268 DEBUG:boto:Params: {} 2024-04-16T18:26:20.268 DEBUG:boto:Token: None 2024-04-16T18:26:20.268 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.271 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb3f5919aaeb2ed6-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.272 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.272 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.272 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.272 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.272 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:26:20.272 DEBUG:boto:Data: 2024-04-16T18:26:20.273 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.273 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.273 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.273 DEBUG:boto:Params: {} 2024-04-16T18:26:20.273 DEBUG:boto:Token: None 2024-04-16T18:26:20.273 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115 2024-04-16T18:26:20.273 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LyWZHJjqZP53sCrf6H/iAPPEKdk= 2024-04-16T18:26:20.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LyWZHJjqZP53sCrf6H/iAPPEKdk=', 'Content-Length': '0'} 2024-04-16T18:26:20.276 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023b2b42443d72651-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.276 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.276 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.276 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.276 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:26:20.276 DEBUG:boto:Data: 2024-04-16T18:26:20.276 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.276 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.276 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.277 DEBUG:boto:Params: {} 2024-04-16T18:26:20.277 DEBUG:boto:Token: None 2024-04-16T18:26:20.277 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115 2024-04-16T18:26:20.277 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LyWZHJjqZP53sCrf6H/iAPPEKdk= 2024-04-16T18:26:20.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LyWZHJjqZP53sCrf6H/iAPPEKdk=', 'Content-Length': '0'} 2024-04-16T18:26:20.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ad2b471b33ff31f-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.279 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:26:20.279 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.279 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.279 DEBUG:boto:Method: GET 2024-04-16T18:26:20.280 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:26:20.280 DEBUG:boto:Data: 2024-04-16T18:26:20.280 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.280 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.280 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.280 DEBUG:boto:Params: {} 2024-04-16T18:26:20.280 DEBUG:boto:Token: None 2024-04-16T18:26:20.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115 2024-04-16T18:26:20.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tSDat6kDq5FrIjUYq7hUFUF5vOE= 2024-04-16T18:26:20.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tSDat6kDq5FrIjUYq7hUFUF5vOE=', 'Content-Length': '0'} 2024-04-16T18:26:20.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023c0ac7fedf7c352-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.326 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:26:20.327 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:26:20.327 DEBUG:boto:Method: GET 2024-04-16T18:26:20.327 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:26:20.327 DEBUG:boto:Data: 2024-04-16T18:26:20.327 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.327 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.327 DEBUG:boto:Params: {} 2024-04-16T18:26:20.327 DEBUG:boto:Token: None 2024-04-16T18:26:20.328 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj115 2024-04-16T18:26:20.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tSDat6kDq5FrIjUYq7hUFUF5vOE= 2024-04-16T18:26:20.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tSDat6kDq5FrIjUYq7hUFUF5vOE=', 'Content-Length': '0'} 2024-04-16T18:26:20.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d564a86ab14adb4e-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.331 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.331 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.331 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.331 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.331 DEBUG:boto:Method: GET 2024-04-16T18:26:20.331 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.331 DEBUG:boto:Data: 2024-04-16T18:26:20.331 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.331 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.332 DEBUG:boto:Params: {} 2024-04-16T18:26:20.332 DEBUG:boto:Token: None 2024-04-16T18:26:20.332 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.334 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002123f5737aff7187-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.335 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.335 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.335 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.335 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.335 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.336 DEBUG:boto:Method: GET 2024-04-16T18:26:20.336 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:26:20.336 DEBUG:boto:Data: 2024-04-16T18:26:20.336 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.336 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.336 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.336 DEBUG:boto:Params: {} 2024-04-16T18:26:20.336 DEBUG:boto:Token: None 2024-04-16T18:26:20.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.340 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac994d64d6edcc6d-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.382 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.383 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:26:20.383 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.383 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.383 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.383 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.383 DEBUG:boto:Method: GET 2024-04-16T18:26:20.383 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.383 DEBUG:boto:Data: 2024-04-16T18:26:20.383 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.384 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.384 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.384 DEBUG:boto:Params: {} 2024-04-16T18:26:20.384 DEBUG:boto:Token: None 2024-04-16T18:26:20.384 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0= 2024-04-16T18:26:20.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0=', 'Content-Length': '0'} 2024-04-16T18:26:20.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000524eca901c6f98a5-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.426 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.426 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.427 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.427 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.427 DEBUG:boto:Method: GET 2024-04-16T18:26:20.427 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.427 DEBUG:boto:Data: 2024-04-16T18:26:20.427 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.427 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.427 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.427 DEBUG:boto:Params: {} 2024-04-16T18:26:20.427 DEBUG:boto:Token: None 2024-04-16T18:26:20.428 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.428 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0= 2024-04-16T18:26:20.428 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0=', 'Content-Length': '0'} 2024-04-16T18:26:20.429 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eab5e80bee56fa5b-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.430 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.430 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.430 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.430 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.430 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.430 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.430 DEBUG:boto:Data: 2024-04-16T18:26:20.431 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.431 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.431 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.431 DEBUG:boto:Params: {} 2024-04-16T18:26:20.431 DEBUG:boto:Token: None 2024-04-16T18:26:20.431 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.431 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fRZIdy0mhyKNXxpqEqlYbOQnhvs= 2024-04-16T18:26:20.431 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fRZIdy0mhyKNXxpqEqlYbOQnhvs=', 'Content-Length': '0'} 2024-04-16T18:26:20.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a8f6513ae2ce116-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.433 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.433 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.434 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.434 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.434 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.434 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.434 DEBUG:boto:Data: 2024-04-16T18:26:20.434 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.434 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.434 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.434 DEBUG:boto:Params: {} 2024-04-16T18:26:20.435 DEBUG:boto:Token: None 2024-04-16T18:26:20.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fRZIdy0mhyKNXxpqEqlYbOQnhvs= 2024-04-16T18:26:20.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fRZIdy0mhyKNXxpqEqlYbOQnhvs=', 'Content-Length': '0'} 2024-04-16T18:26:20.436 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee543332fa8dac57-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.437 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:26:20.437 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.437 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.437 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.437 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.437 DEBUG:boto:Method: GET 2024-04-16T18:26:20.438 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.438 DEBUG:boto:Data: 2024-04-16T18:26:20.438 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.438 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.438 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.438 DEBUG:boto:Params: {} 2024-04-16T18:26:20.438 DEBUG:boto:Token: None 2024-04-16T18:26:20.438 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0= 2024-04-16T18:26:20.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0=', 'Content-Length': '0'} 2024-04-16T18:26:20.440 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bba00901a0e16e39-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.482 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.482 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.483 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.483 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.483 DEBUG:boto:Method: GET 2024-04-16T18:26:20.483 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.483 DEBUG:boto:Data: 2024-04-16T18:26:20.483 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.483 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.483 DEBUG:boto:Params: {} 2024-04-16T18:26:20.484 DEBUG:boto:Token: None 2024-04-16T18:26:20.484 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:26:20.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0= 2024-04-16T18:26:20.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N/Hh7cQPARJcLZko52jc72gWgz0=', 'Content-Length': '0'} 2024-04-16T18:26:20.486 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ce79d138055137e-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.486 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.486 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.486 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.486 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.486 DEBUG:boto:Method: GET 2024-04-16T18:26:20.486 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.487 DEBUG:boto:Data: 2024-04-16T18:26:20.487 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.487 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.487 DEBUG:boto:Params: {} 2024-04-16T18:26:20.487 DEBUG:boto:Token: None 2024-04-16T18:26:20.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000577e68dcfa34c739-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.530 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.531 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.531 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.531 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.531 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.531 DEBUG:boto:Method: GET 2024-04-16T18:26:20.531 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.531 DEBUG:boto:Data: 2024-04-16T18:26:20.531 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.532 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.532 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.532 DEBUG:boto:Params: {} 2024-04-16T18:26:20.532 DEBUG:boto:Token: None 2024-04-16T18:26:20.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003536e2c3f7e89289-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.535 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.536 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.536 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.536 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.536 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:26:20.536 DEBUG:boto:Data: 2024-04-16T18:26:20.536 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.536 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.536 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.536 DEBUG:boto:Params: {} 2024-04-16T18:26:20.536 DEBUG:boto:Token: None 2024-04-16T18:26:20.537 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116 2024-04-16T18:26:20.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rQeezcdFUeV1YHiO9T38bISz/0M= 2024-04-16T18:26:20.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rQeezcdFUeV1YHiO9T38bISz/0M=', 'Content-Length': '0'} 2024-04-16T18:26:20.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000589c21b70263c562-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.539 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.539 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.539 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.539 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:26:20.539 DEBUG:boto:Data: 2024-04-16T18:26:20.539 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.540 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.540 DEBUG:boto:Params: {} 2024-04-16T18:26:20.540 DEBUG:boto:Token: None 2024-04-16T18:26:20.540 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116 2024-04-16T18:26:20.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rQeezcdFUeV1YHiO9T38bISz/0M= 2024-04-16T18:26:20.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rQeezcdFUeV1YHiO9T38bISz/0M=', 'Content-Length': '0'} 2024-04-16T18:26:20.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000486ab338088ec710-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:26:20.542 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.542 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.542 DEBUG:boto:Method: GET 2024-04-16T18:26:20.542 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:26:20.543 DEBUG:boto:Data: 2024-04-16T18:26:20.543 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.543 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.543 DEBUG:boto:Params: {} 2024-04-16T18:26:20.543 DEBUG:boto:Token: None 2024-04-16T18:26:20.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116 2024-04-16T18:26:20.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0ZIKvzoGqEaInYzJWMqLtO39GSI= 2024-04-16T18:26:20.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0ZIKvzoGqEaInYzJWMqLtO39GSI=', 'Content-Length': '0'} 2024-04-16T18:26:20.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d44b5b096d61977e-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.586 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:26:20.587 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:26:20.587 DEBUG:boto:Method: GET 2024-04-16T18:26:20.587 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:26:20.587 DEBUG:boto:Data: 2024-04-16T18:26:20.587 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.587 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.587 DEBUG:boto:Params: {} 2024-04-16T18:26:20.587 DEBUG:boto:Token: None 2024-04-16T18:26:20.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj116 2024-04-16T18:26:20.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0ZIKvzoGqEaInYzJWMqLtO39GSI= 2024-04-16T18:26:20.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0ZIKvzoGqEaInYzJWMqLtO39GSI=', 'Content-Length': '0'} 2024-04-16T18:26:20.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072f46a04cce8f29a-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.590 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.590 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.590 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.590 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.590 DEBUG:boto:Method: GET 2024-04-16T18:26:20.591 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.591 DEBUG:boto:Data: 2024-04-16T18:26:20.591 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.591 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.591 DEBUG:boto:Params: {} 2024-04-16T18:26:20.591 DEBUG:boto:Token: None 2024-04-16T18:26:20.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.594 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b10dfdbad6e4cbdb-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.634 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.635 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.635 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.635 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.635 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.635 DEBUG:boto:Method: GET 2024-04-16T18:26:20.635 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:26:20.635 DEBUG:boto:Data: 2024-04-16T18:26:20.635 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.636 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.636 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.636 DEBUG:boto:Params: {} 2024-04-16T18:26:20.636 DEBUG:boto:Token: None 2024-04-16T18:26:20.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.640 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097b87724c04cc6dd-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.640 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.640 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:26:20.641 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.641 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.641 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.641 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.641 DEBUG:boto:Method: GET 2024-04-16T18:26:20.641 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.641 DEBUG:boto:Data: 2024-04-16T18:26:20.641 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.641 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.641 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.641 DEBUG:boto:Params: {} 2024-04-16T18:26:20.641 DEBUG:boto:Token: None 2024-04-16T18:26:20.642 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.642 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls= 2024-04-16T18:26:20.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls=', 'Content-Length': '0'} 2024-04-16T18:26:20.644 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1d3b7e1fe4f350b-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.686 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.686 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.687 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.687 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.687 DEBUG:boto:Method: GET 2024-04-16T18:26:20.687 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.687 DEBUG:boto:Data: 2024-04-16T18:26:20.687 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.687 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.687 DEBUG:boto:Params: {} 2024-04-16T18:26:20.687 DEBUG:boto:Token: None 2024-04-16T18:26:20.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls= 2024-04-16T18:26:20.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls=', 'Content-Length': '0'} 2024-04-16T18:26:20.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8d89abaa5cdea62-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.690 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.690 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.690 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.690 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.690 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.690 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.690 DEBUG:boto:Data: 2024-04-16T18:26:20.690 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.690 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.690 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.691 DEBUG:boto:Params: {} 2024-04-16T18:26:20.691 DEBUG:boto:Token: None 2024-04-16T18:26:20.691 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cmstRDVr2G3lTfDYy+9O8A/BwYM= 2024-04-16T18:26:20.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cmstRDVr2G3lTfDYy+9O8A/BwYM=', 'Content-Length': '0'} 2024-04-16T18:26:20.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000199785496f017fa5-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.693 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.693 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.693 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.693 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.693 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.693 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.693 DEBUG:boto:Data: 2024-04-16T18:26:20.694 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.694 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.694 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.694 DEBUG:boto:Params: {} 2024-04-16T18:26:20.694 DEBUG:boto:Token: None 2024-04-16T18:26:20.694 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.694 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cmstRDVr2G3lTfDYy+9O8A/BwYM= 2024-04-16T18:26:20.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cmstRDVr2G3lTfDYy+9O8A/BwYM=', 'Content-Length': '0'} 2024-04-16T18:26:20.696 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c544d22f3d8ec7a-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.697 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:26:20.697 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.697 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.697 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.697 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.697 DEBUG:boto:Method: GET 2024-04-16T18:26:20.697 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.697 DEBUG:boto:Data: 2024-04-16T18:26:20.697 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.698 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.698 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.698 DEBUG:boto:Params: {} 2024-04-16T18:26:20.698 DEBUG:boto:Token: None 2024-04-16T18:26:20.698 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.698 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls= 2024-04-16T18:26:20.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls=', 'Content-Length': '0'} 2024-04-16T18:26:20.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000139100485b0f842d-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.742 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.742 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.742 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.743 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.743 DEBUG:boto:Method: GET 2024-04-16T18:26:20.743 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.743 DEBUG:boto:Data: 2024-04-16T18:26:20.743 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.743 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.743 DEBUG:boto:Params: {} 2024-04-16T18:26:20.743 DEBUG:boto:Token: None 2024-04-16T18:26:20.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:26:20.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls= 2024-04-16T18:26:20.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q0zxLPVgIAnbiNq21F1wFmRDVls=', 'Content-Length': '0'} 2024-04-16T18:26:20.746 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b108174e5046aaf8-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.746 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.746 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.746 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.746 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.746 DEBUG:boto:Method: GET 2024-04-16T18:26:20.746 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.746 DEBUG:boto:Data: 2024-04-16T18:26:20.747 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.747 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.747 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.747 DEBUG:boto:Params: {} 2024-04-16T18:26:20.747 DEBUG:boto:Token: None 2024-04-16T18:26:20.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000009a902f44763e8-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.790 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.791 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.791 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.791 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.791 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.791 DEBUG:boto:Method: GET 2024-04-16T18:26:20.791 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.791 DEBUG:boto:Data: 2024-04-16T18:26:20.791 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.792 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.792 DEBUG:boto:Params: {} 2024-04-16T18:26:20.792 DEBUG:boto:Token: None 2024-04-16T18:26:20.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.795 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be280d6df675fc09-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.796 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.796 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.796 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.796 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.796 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:26:20.796 DEBUG:boto:Data: 2024-04-16T18:26:20.796 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.796 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.796 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.797 DEBUG:boto:Params: {} 2024-04-16T18:26:20.797 DEBUG:boto:Token: None 2024-04-16T18:26:20.797 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145 2024-04-16T18:26:20.797 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3S+rAR5PpknbyrKACLqZvYEKiGs= 2024-04-16T18:26:20.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3S+rAR5PpknbyrKACLqZvYEKiGs=', 'Content-Length': '0'} 2024-04-16T18:26:20.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aaad6dbe154caf2e-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.799 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.799 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.799 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.799 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:26:20.799 DEBUG:boto:Data: 2024-04-16T18:26:20.799 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.800 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.800 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.800 DEBUG:boto:Params: {} 2024-04-16T18:26:20.800 DEBUG:boto:Token: None 2024-04-16T18:26:20.800 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145 2024-04-16T18:26:20.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3S+rAR5PpknbyrKACLqZvYEKiGs= 2024-04-16T18:26:20.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3S+rAR5PpknbyrKACLqZvYEKiGs=', 'Content-Length': '0'} 2024-04-16T18:26:20.802 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007715ccfd14347a86-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.802 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:26:20.802 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.802 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.802 DEBUG:boto:Method: GET 2024-04-16T18:26:20.803 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:26:20.803 DEBUG:boto:Data: 2024-04-16T18:26:20.803 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.803 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.803 DEBUG:boto:Params: {} 2024-04-16T18:26:20.803 DEBUG:boto:Token: None 2024-04-16T18:26:20.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145 2024-04-16T18:26:20.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/4gI8ONd7LH/unCqjeT8BXNmaqM= 2024-04-16T18:26:20.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/4gI8ONd7LH/unCqjeT8BXNmaqM=', 'Content-Length': '0'} 2024-04-16T18:26:20.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a489e2f01f18c42-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.846 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:26:20.846 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:26:20.846 DEBUG:boto:Method: GET 2024-04-16T18:26:20.847 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:26:20.847 DEBUG:boto:Data: 2024-04-16T18:26:20.847 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.847 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.847 DEBUG:boto:Params: {} 2024-04-16T18:26:20.847 DEBUG:boto:Token: None 2024-04-16T18:26:20.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj145 2024-04-16T18:26:20.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/4gI8ONd7LH/unCqjeT8BXNmaqM= 2024-04-16T18:26:20.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/4gI8ONd7LH/unCqjeT8BXNmaqM=', 'Content-Length': '0'} 2024-04-16T18:26:20.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a526614a60e4ba9-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.850 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.850 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.850 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.850 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.850 DEBUG:boto:Method: GET 2024-04-16T18:26:20.850 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.850 DEBUG:boto:Data: 2024-04-16T18:26:20.850 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.851 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.851 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.851 DEBUG:boto:Params: {} 2024-04-16T18:26:20.851 DEBUG:boto:Token: None 2024-04-16T18:26:20.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.854 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af2f38e7cdc7ebf2-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.894 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.894 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:20.895 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:20.895 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.895 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.895 DEBUG:boto:Method: GET 2024-04-16T18:26:20.895 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:26:20.895 DEBUG:boto:Data: 2024-04-16T18:26:20.895 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.895 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.895 DEBUG:boto:Params: {} 2024-04-16T18:26:20.895 DEBUG:boto:Token: None 2024-04-16T18:26:20.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/ 2024-04-16T18:26:20.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4= 2024-04-16T18:26:20.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TKKt4RN6VKSkf5ajEzBESbCA1h4=', 'Content-Length': '0'} 2024-04-16T18:26:20.899 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000533cd54a30bbe15d-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.900 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:20.900 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:26:20.900 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:20.900 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:20.900 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.901 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.901 DEBUG:boto:Method: GET 2024-04-16T18:26:20.901 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.901 DEBUG:boto:Data: 2024-04-16T18:26:20.901 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.901 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.901 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.901 DEBUG:boto:Params: {} 2024-04-16T18:26:20.901 DEBUG:boto:Token: None 2024-04-16T18:26:20.901 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.902 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LZ1vnPw+YpCb+0H/o01gfUY/UB4= 2024-04-16T18:26:20.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LZ1vnPw+YpCb+0H/o01gfUY/UB4=', 'Content-Length': '0'} 2024-04-16T18:26:20.904 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004572dd23da5e6497-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.946 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:20.947 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:20.947 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.947 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.947 DEBUG:boto:Method: GET 2024-04-16T18:26:20.947 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.947 DEBUG:boto:Data: 2024-04-16T18:26:20.947 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.947 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.947 DEBUG:boto:Params: {} 2024-04-16T18:26:20.948 DEBUG:boto:Token: None 2024-04-16T18:26:20.948 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LZ1vnPw+YpCb+0H/o01gfUY/UB4= 2024-04-16T18:26:20.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LZ1vnPw+YpCb+0H/o01gfUY/UB4=', 'Content-Length': '0'} 2024-04-16T18:26:20.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceb744f4894670b3-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.950 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:20.950 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:20.950 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.950 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.951 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.951 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.951 DEBUG:boto:Data: 2024-04-16T18:26:20.951 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.951 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.951 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.951 DEBUG:boto:Params: {} 2024-04-16T18:26:20.951 DEBUG:boto:Token: None 2024-04-16T18:26:20.951 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.951 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S1Gwv2p08AU4u+XpvohFKjHPfD8= 2024-04-16T18:26:20.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S1Gwv2p08AU4u+XpvohFKjHPfD8=', 'Content-Length': '0'} 2024-04-16T18:26:20.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a56f14fda9dc80a8-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.954 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:20.954 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:20.954 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.954 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.954 DEBUG:boto:Method: HEAD 2024-04-16T18:26:20.954 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.955 DEBUG:boto:Data: 2024-04-16T18:26:20.955 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:20.955 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.955 DEBUG:boto:Params: {} 2024-04-16T18:26:20.955 DEBUG:boto:Token: None 2024-04-16T18:26:20.955 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.955 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S1Gwv2p08AU4u+XpvohFKjHPfD8= 2024-04-16T18:26:20.955 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S1Gwv2p08AU4u+XpvohFKjHPfD8=', 'Content-Length': '0'} 2024-04-16T18:26:20.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fd7100ee16305b4-00661ec2cc-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:20.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:26:20.958 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:20.958 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:20.958 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.958 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.958 DEBUG:boto:Method: GET 2024-04-16T18:26:20.958 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.958 DEBUG:boto:Data: 2024-04-16T18:26:20.958 DEBUG:boto:Headers: {} 2024-04-16T18:26:20.958 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:20.958 DEBUG:boto:Port: 8000 2024-04-16T18:26:20.958 DEBUG:boto:Params: {} 2024-04-16T18:26:20.959 DEBUG:boto:Token: None 2024-04-16T18:26:20.959 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:20 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:20.959 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LZ1vnPw+YpCb+0H/o01gfUY/UB4= 2024-04-16T18:26:20.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LZ1vnPw+YpCb+0H/o01gfUY/UB4=', 'Content-Length': '0'} 2024-04-16T18:26:20.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d8a20bc98af421e-00661ec2cc-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.003 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:21.003 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:21.003 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:21.003 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:26:21.004 DEBUG:boto:Method: GET 2024-04-16T18:26:21.004 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:21.004 DEBUG:boto:Data: 2024-04-16T18:26:21.004 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.004 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.004 DEBUG:boto:Params: {} 2024-04-16T18:26:21.004 DEBUG:boto:Token: None 2024-04-16T18:26:21.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:26:21.005 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WbqaOFuCBwRoOQLSFVaiM7I79Vs= 2024-04-16T18:26:21.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WbqaOFuCBwRoOQLSFVaiM7I79Vs=', 'Content-Length': '0'} 2024-04-16T18:26:21.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a224a2af9dec411-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.007 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.007 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.007 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.007 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.007 DEBUG:boto:Method: GET 2024-04-16T18:26:21.007 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.007 DEBUG:boto:Data: 2024-04-16T18:26:21.007 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.007 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.007 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.008 DEBUG:boto:Params: {} 2024-04-16T18:26:21.008 DEBUG:boto:Token: None 2024-04-16T18:26:21.008 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.010 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000921cfc44917a5ab7-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.054 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.055 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.055 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.055 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.055 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.055 DEBUG:boto:Method: GET 2024-04-16T18:26:21.055 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.055 DEBUG:boto:Data: 2024-04-16T18:26:21.055 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.055 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.055 DEBUG:boto:Params: {} 2024-04-16T18:26:21.055 DEBUG:boto:Token: None 2024-04-16T18:26:21.056 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.059 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000915aba1171731e32-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.059 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.059 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:21.060 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:21.060 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.060 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:26:21.060 DEBUG:boto:Data: 2024-04-16T18:26:21.060 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.060 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.060 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.060 DEBUG:boto:Params: {} 2024-04-16T18:26:21.060 DEBUG:boto:Token: None 2024-04-16T18:26:21.060 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj17 2024-04-16T18:26:21.061 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uCYQZTo4zAy7p94ezZf3RI/Jhs0= 2024-04-16T18:26:21.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uCYQZTo4zAy7p94ezZf3RI/Jhs0=', 'Content-Length': '0'} 2024-04-16T18:26:21.063 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000284f3cddb30d9d2b-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.063 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:21.063 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:21.063 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.063 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:26:21.063 DEBUG:boto:Data: 2024-04-16T18:26:21.064 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.064 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.064 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.064 DEBUG:boto:Params: {} 2024-04-16T18:26:21.064 DEBUG:boto:Token: None 2024-04-16T18:26:21.064 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj17 2024-04-16T18:26:21.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uCYQZTo4zAy7p94ezZf3RI/Jhs0= 2024-04-16T18:26:21.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uCYQZTo4zAy7p94ezZf3RI/Jhs0=', 'Content-Length': '0'} 2024-04-16T18:26:21.066 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e3b6984442cc577-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.066 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:26:21.067 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:21.067 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:21.067 DEBUG:boto:Method: GET 2024-04-16T18:26:21.067 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:26:21.067 DEBUG:boto:Data: 2024-04-16T18:26:21.067 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.067 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.067 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.067 DEBUG:boto:Params: {} 2024-04-16T18:26:21.067 DEBUG:boto:Token: None 2024-04-16T18:26:21.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj17 2024-04-16T18:26:21.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qoQjEVpeyaKinMQJv4OJ7oXX3AI= 2024-04-16T18:26:21.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qoQjEVpeyaKinMQJv4OJ7oXX3AI=', 'Content-Length': '0'} 2024-04-16T18:26:21.070 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b20a789ed2c2fec6-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.110 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:26:21.110 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:26:21.111 DEBUG:boto:Method: GET 2024-04-16T18:26:21.111 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:26:21.111 DEBUG:boto:Data: 2024-04-16T18:26:21.111 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.111 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.111 DEBUG:boto:Params: {} 2024-04-16T18:26:21.111 DEBUG:boto:Token: None 2024-04-16T18:26:21.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj17 2024-04-16T18:26:21.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qoQjEVpeyaKinMQJv4OJ7oXX3AI= 2024-04-16T18:26:21.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qoQjEVpeyaKinMQJv4OJ7oXX3AI=', 'Content-Length': '0'} 2024-04-16T18:26:21.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f63f7eec2c518496-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.114 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.114 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.114 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.114 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.114 DEBUG:boto:Method: GET 2024-04-16T18:26:21.114 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.115 DEBUG:boto:Data: 2024-04-16T18:26:21.115 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.115 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.115 DEBUG:boto:Params: {} 2024-04-16T18:26:21.115 DEBUG:boto:Token: None 2024-04-16T18:26:21.115 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005fdeaf7a2a2bd1d8-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.158 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.159 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.159 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.159 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.159 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.159 DEBUG:boto:Method: GET 2024-04-16T18:26:21.159 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:26:21.160 DEBUG:boto:Data: 2024-04-16T18:26:21.160 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.160 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.160 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.160 DEBUG:boto:Params: {} 2024-04-16T18:26:21.160 DEBUG:boto:Token: None 2024-04-16T18:26:21.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.161 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.164 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000446557b6212ec95c-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.164 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.165 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:26:21.165 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.165 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.165 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.165 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.165 DEBUG:boto:Method: GET 2024-04-16T18:26:21.165 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.165 DEBUG:boto:Data: 2024-04-16T18:26:21.165 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.166 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.166 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.166 DEBUG:boto:Params: {} 2024-04-16T18:26:21.166 DEBUG:boto:Token: None 2024-04-16T18:26:21.166 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg= 2024-04-16T18:26:21.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg=', 'Content-Length': '0'} 2024-04-16T18:26:21.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fc313ec61972046-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.210 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.210 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.211 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.211 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.211 DEBUG:boto:Method: GET 2024-04-16T18:26:21.211 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.211 DEBUG:boto:Data: 2024-04-16T18:26:21.211 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.211 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.211 DEBUG:boto:Params: {} 2024-04-16T18:26:21.211 DEBUG:boto:Token: None 2024-04-16T18:26:21.212 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg= 2024-04-16T18:26:21.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg=', 'Content-Length': '0'} 2024-04-16T18:26:21.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000725f641f5fd0cd2a-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.214 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.214 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.215 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.215 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.215 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.215 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.215 DEBUG:boto:Data: 2024-04-16T18:26:21.215 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.215 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.215 DEBUG:boto:Params: {} 2024-04-16T18:26:21.215 DEBUG:boto:Token: None 2024-04-16T18:26:21.216 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gYaontWLLSkAyz2DL1v1CzaoveE= 2024-04-16T18:26:21.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gYaontWLLSkAyz2DL1v1CzaoveE=', 'Content-Length': '0'} 2024-04-16T18:26:21.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4b93f4c88f43ec5-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.218 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.218 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.218 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.218 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.218 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.218 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.218 DEBUG:boto:Data: 2024-04-16T18:26:21.218 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.218 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.218 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.218 DEBUG:boto:Params: {} 2024-04-16T18:26:21.219 DEBUG:boto:Token: None 2024-04-16T18:26:21.219 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gYaontWLLSkAyz2DL1v1CzaoveE= 2024-04-16T18:26:21.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gYaontWLLSkAyz2DL1v1CzaoveE=', 'Content-Length': '0'} 2024-04-16T18:26:21.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e25c386a9f90b02-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.221 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:26:21.221 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.221 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.221 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.221 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.221 DEBUG:boto:Method: GET 2024-04-16T18:26:21.222 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.222 DEBUG:boto:Data: 2024-04-16T18:26:21.222 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.222 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.222 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.222 DEBUG:boto:Params: {} 2024-04-16T18:26:21.222 DEBUG:boto:Token: None 2024-04-16T18:26:21.222 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.222 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg= 2024-04-16T18:26:21.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg=', 'Content-Length': '0'} 2024-04-16T18:26:21.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3bee35b83884019-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.270 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.271 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.271 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.271 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.271 DEBUG:boto:Method: GET 2024-04-16T18:26:21.271 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.271 DEBUG:boto:Data: 2024-04-16T18:26:21.271 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.271 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.271 DEBUG:boto:Params: {} 2024-04-16T18:26:21.271 DEBUG:boto:Token: None 2024-04-16T18:26:21.272 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:26:21.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg= 2024-04-16T18:26:21.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TMU5NAymKYrhwxTrk9uDg034Glg=', 'Content-Length': '0'} 2024-04-16T18:26:21.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b1fe89c8b42a664-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.274 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.274 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.274 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.274 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.274 DEBUG:boto:Method: GET 2024-04-16T18:26:21.274 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.274 DEBUG:boto:Data: 2024-04-16T18:26:21.275 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.275 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.275 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.275 DEBUG:boto:Params: {} 2024-04-16T18:26:21.275 DEBUG:boto:Token: None 2024-04-16T18:26:21.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.277 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064815acd3edcd597-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.318 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.319 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.319 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.319 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.319 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.319 DEBUG:boto:Method: GET 2024-04-16T18:26:21.319 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.319 DEBUG:boto:Data: 2024-04-16T18:26:21.319 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.319 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.320 DEBUG:boto:Params: {} 2024-04-16T18:26:21.320 DEBUG:boto:Token: None 2024-04-16T18:26:21.320 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.323 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000687783865adb4a21-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.324 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.324 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.324 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.324 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.324 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:26:21.324 DEBUG:boto:Data: 2024-04-16T18:26:21.324 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.324 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.324 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.324 DEBUG:boto:Params: {} 2024-04-16T18:26:21.325 DEBUG:boto:Token: None 2024-04-16T18:26:21.325 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19 2024-04-16T18:26:21.325 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wBr69iUfQE9c8pL6dvjlPn/QlZ4= 2024-04-16T18:26:21.325 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wBr69iUfQE9c8pL6dvjlPn/QlZ4=', 'Content-Length': '0'} 2024-04-16T18:26:21.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007265818302a07eb-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.327 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.327 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.327 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.327 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:26:21.327 DEBUG:boto:Data: 2024-04-16T18:26:21.328 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.328 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.328 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.328 DEBUG:boto:Params: {} 2024-04-16T18:26:21.328 DEBUG:boto:Token: None 2024-04-16T18:26:21.328 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19 2024-04-16T18:26:21.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wBr69iUfQE9c8pL6dvjlPn/QlZ4= 2024-04-16T18:26:21.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wBr69iUfQE9c8pL6dvjlPn/QlZ4=', 'Content-Length': '0'} 2024-04-16T18:26:21.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ceabf9b5be94af1-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:26:21.330 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.331 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.331 DEBUG:boto:Method: GET 2024-04-16T18:26:21.331 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:26:21.331 DEBUG:boto:Data: 2024-04-16T18:26:21.331 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.331 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.331 DEBUG:boto:Params: {} 2024-04-16T18:26:21.331 DEBUG:boto:Token: None 2024-04-16T18:26:21.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19 2024-04-16T18:26:21.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lw8blP2V+TKhHyfWtnyFRhurvSk= 2024-04-16T18:26:21.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lw8blP2V+TKhHyfWtnyFRhurvSk=', 'Content-Length': '0'} 2024-04-16T18:26:21.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fb343d52589a772-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.374 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:26:21.375 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:26:21.375 DEBUG:boto:Method: GET 2024-04-16T18:26:21.375 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:26:21.375 DEBUG:boto:Data: 2024-04-16T18:26:21.375 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.375 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.375 DEBUG:boto:Params: {} 2024-04-16T18:26:21.375 DEBUG:boto:Token: None 2024-04-16T18:26:21.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj19 2024-04-16T18:26:21.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lw8blP2V+TKhHyfWtnyFRhurvSk= 2024-04-16T18:26:21.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lw8blP2V+TKhHyfWtnyFRhurvSk=', 'Content-Length': '0'} 2024-04-16T18:26:21.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a6614327dd9637a-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.378 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.378 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.378 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.378 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.378 DEBUG:boto:Method: GET 2024-04-16T18:26:21.378 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.378 DEBUG:boto:Data: 2024-04-16T18:26:21.378 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.379 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.379 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.379 DEBUG:boto:Params: {} 2024-04-16T18:26:21.379 DEBUG:boto:Token: None 2024-04-16T18:26:21.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.381 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c40d761d8f58969d-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.422 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.423 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.423 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.423 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.423 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.423 DEBUG:boto:Method: GET 2024-04-16T18:26:21.423 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:26:21.423 DEBUG:boto:Data: 2024-04-16T18:26:21.423 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.424 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.424 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.424 DEBUG:boto:Params: {} 2024-04-16T18:26:21.424 DEBUG:boto:Token: None 2024-04-16T18:26:21.424 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.427 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019f66f009c09f592-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.427 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.428 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:26:21.428 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.428 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.428 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.428 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.428 DEBUG:boto:Method: GET 2024-04-16T18:26:21.428 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.428 DEBUG:boto:Data: 2024-04-16T18:26:21.429 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.429 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.429 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.429 DEBUG:boto:Params: {} 2024-04-16T18:26:21.429 DEBUG:boto:Token: None 2024-04-16T18:26:21.429 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8= 2024-04-16T18:26:21.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8=', 'Content-Length': '0'} 2024-04-16T18:26:21.431 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6e3915a712cb028-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.474 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.474 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.475 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.475 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.475 DEBUG:boto:Method: GET 2024-04-16T18:26:21.475 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.475 DEBUG:boto:Data: 2024-04-16T18:26:21.475 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.475 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.475 DEBUG:boto:Params: {} 2024-04-16T18:26:21.475 DEBUG:boto:Token: None 2024-04-16T18:26:21.475 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8= 2024-04-16T18:26:21.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8=', 'Content-Length': '0'} 2024-04-16T18:26:21.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000738ff3b4115411c-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.478 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.478 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.478 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.478 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.479 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.479 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.479 DEBUG:boto:Data: 2024-04-16T18:26:21.479 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.479 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.479 DEBUG:boto:Params: {} 2024-04-16T18:26:21.479 DEBUG:boto:Token: None 2024-04-16T18:26:21.479 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jCsVbspxBjJ627v6PFAl2kkFsgU= 2024-04-16T18:26:21.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jCsVbspxBjJ627v6PFAl2kkFsgU=', 'Content-Length': '0'} 2024-04-16T18:26:21.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000916cee85c78de572-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.482 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.482 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.482 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.482 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.483 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.483 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.483 DEBUG:boto:Data: 2024-04-16T18:26:21.483 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.483 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.483 DEBUG:boto:Params: {} 2024-04-16T18:26:21.483 DEBUG:boto:Token: None 2024-04-16T18:26:21.483 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jCsVbspxBjJ627v6PFAl2kkFsgU= 2024-04-16T18:26:21.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jCsVbspxBjJ627v6PFAl2kkFsgU=', 'Content-Length': '0'} 2024-04-16T18:26:21.485 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040c95bd2c4328b65-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.486 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:26:21.486 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.486 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.486 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.486 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.486 DEBUG:boto:Method: GET 2024-04-16T18:26:21.486 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.487 DEBUG:boto:Data: 2024-04-16T18:26:21.487 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.487 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.487 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.487 DEBUG:boto:Params: {} 2024-04-16T18:26:21.487 DEBUG:boto:Token: None 2024-04-16T18:26:21.487 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.487 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8= 2024-04-16T18:26:21.487 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8=', 'Content-Length': '0'} 2024-04-16T18:26:21.489 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c61514790b9531a5-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.530 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.531 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.531 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.531 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.531 DEBUG:boto:Method: GET 2024-04-16T18:26:21.531 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.531 DEBUG:boto:Data: 2024-04-16T18:26:21.531 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.531 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.531 DEBUG:boto:Params: {} 2024-04-16T18:26:21.531 DEBUG:boto:Token: None 2024-04-16T18:26:21.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:26:21.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8= 2024-04-16T18:26:21.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8L5yM+bIDxyPsZGVKS+HzT8vad8=', 'Content-Length': '0'} 2024-04-16T18:26:21.533 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050c299c7ecf3253f-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.534 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.534 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.534 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.534 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.534 DEBUG:boto:Method: GET 2024-04-16T18:26:21.534 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.534 DEBUG:boto:Data: 2024-04-16T18:26:21.535 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.535 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.535 DEBUG:boto:Params: {} 2024-04-16T18:26:21.535 DEBUG:boto:Token: None 2024-04-16T18:26:21.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.538 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d413e3677b290f8-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.578 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.579 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.579 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.579 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.579 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.579 DEBUG:boto:Method: GET 2024-04-16T18:26:21.579 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.579 DEBUG:boto:Data: 2024-04-16T18:26:21.579 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.580 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.580 DEBUG:boto:Params: {} 2024-04-16T18:26:21.580 DEBUG:boto:Token: None 2024-04-16T18:26:21.580 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a47b1312865975b-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.584 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.584 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.584 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.584 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.584 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:26:21.585 DEBUG:boto:Data: 2024-04-16T18:26:21.585 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.585 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.585 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.585 DEBUG:boto:Params: {} 2024-04-16T18:26:21.585 DEBUG:boto:Token: None 2024-04-16T18:26:21.585 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22 2024-04-16T18:26:21.585 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z083Z3i15ftjeyk6h+hs3z/VRSg= 2024-04-16T18:26:21.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z083Z3i15ftjeyk6h+hs3z/VRSg=', 'Content-Length': '0'} 2024-04-16T18:26:21.587 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002251d4b44b803e87-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.588 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.588 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.588 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.588 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:26:21.588 DEBUG:boto:Data: 2024-04-16T18:26:21.588 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.588 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.588 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.588 DEBUG:boto:Params: {} 2024-04-16T18:26:21.588 DEBUG:boto:Token: None 2024-04-16T18:26:21.588 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22 2024-04-16T18:26:21.589 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z083Z3i15ftjeyk6h+hs3z/VRSg= 2024-04-16T18:26:21.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z083Z3i15ftjeyk6h+hs3z/VRSg=', 'Content-Length': '0'} 2024-04-16T18:26:21.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002500055634bd361b-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.591 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:26:21.591 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.591 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.591 DEBUG:boto:Method: GET 2024-04-16T18:26:21.591 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:26:21.591 DEBUG:boto:Data: 2024-04-16T18:26:21.591 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.591 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.591 DEBUG:boto:Params: {} 2024-04-16T18:26:21.592 DEBUG:boto:Token: None 2024-04-16T18:26:21.592 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22 2024-04-16T18:26:21.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b0rOuwbRu6HHN1uaPcZfcDQYlOk= 2024-04-16T18:26:21.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b0rOuwbRu6HHN1uaPcZfcDQYlOk=', 'Content-Length': '0'} 2024-04-16T18:26:21.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f2ebb994d842548-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.634 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:26:21.634 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:26:21.635 DEBUG:boto:Method: GET 2024-04-16T18:26:21.635 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:26:21.635 DEBUG:boto:Data: 2024-04-16T18:26:21.635 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.635 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.635 DEBUG:boto:Params: {} 2024-04-16T18:26:21.635 DEBUG:boto:Token: None 2024-04-16T18:26:21.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj22 2024-04-16T18:26:21.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b0rOuwbRu6HHN1uaPcZfcDQYlOk= 2024-04-16T18:26:21.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b0rOuwbRu6HHN1uaPcZfcDQYlOk=', 'Content-Length': '0'} 2024-04-16T18:26:21.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029932274cf2a411d-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.638 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.638 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.638 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.638 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.638 DEBUG:boto:Method: GET 2024-04-16T18:26:21.638 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.638 DEBUG:boto:Data: 2024-04-16T18:26:21.638 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.639 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.639 DEBUG:boto:Params: {} 2024-04-16T18:26:21.639 DEBUG:boto:Token: None 2024-04-16T18:26:21.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.641 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008cd7551ee6cfd3f8-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.682 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.683 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.683 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.683 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.683 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.683 DEBUG:boto:Method: GET 2024-04-16T18:26:21.683 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:26:21.683 DEBUG:boto:Data: 2024-04-16T18:26:21.683 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.684 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.684 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.684 DEBUG:boto:Params: {} 2024-04-16T18:26:21.684 DEBUG:boto:Token: None 2024-04-16T18:26:21.684 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000290b6961b43a0814-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.688 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.688 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:26:21.688 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.688 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.688 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.688 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.689 DEBUG:boto:Method: GET 2024-04-16T18:26:21.689 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.689 DEBUG:boto:Data: 2024-04-16T18:26:21.689 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.689 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.689 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.689 DEBUG:boto:Params: {} 2024-04-16T18:26:21.689 DEBUG:boto:Token: None 2024-04-16T18:26:21.689 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.689 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw= 2024-04-16T18:26:21.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw=', 'Content-Length': '0'} 2024-04-16T18:26:21.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000e9c8676520e55b-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.734 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.734 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.735 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.735 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.735 DEBUG:boto:Method: GET 2024-04-16T18:26:21.735 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.735 DEBUG:boto:Data: 2024-04-16T18:26:21.735 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.735 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.735 DEBUG:boto:Params: {} 2024-04-16T18:26:21.735 DEBUG:boto:Token: None 2024-04-16T18:26:21.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw= 2024-04-16T18:26:21.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw=', 'Content-Length': '0'} 2024-04-16T18:26:21.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5105388117973d0-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.738 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.738 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.738 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.738 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.738 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.738 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.738 DEBUG:boto:Data: 2024-04-16T18:26:21.738 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.739 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.739 DEBUG:boto:Params: {} 2024-04-16T18:26:21.739 DEBUG:boto:Token: None 2024-04-16T18:26:21.739 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vpWSOZbeFGbfelZS/0G8bm6kQLM= 2024-04-16T18:26:21.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vpWSOZbeFGbfelZS/0G8bm6kQLM=', 'Content-Length': '0'} 2024-04-16T18:26:21.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4f789a23aff5b69-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.741 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.741 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.742 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.742 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.742 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.742 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.742 DEBUG:boto:Data: 2024-04-16T18:26:21.742 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.742 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.742 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.742 DEBUG:boto:Params: {} 2024-04-16T18:26:21.742 DEBUG:boto:Token: None 2024-04-16T18:26:21.743 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vpWSOZbeFGbfelZS/0G8bm6kQLM= 2024-04-16T18:26:21.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vpWSOZbeFGbfelZS/0G8bm6kQLM=', 'Content-Length': '0'} 2024-04-16T18:26:21.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d104f643f58c69b-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:26:21.745 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.745 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.745 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.745 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.745 DEBUG:boto:Method: GET 2024-04-16T18:26:21.745 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.745 DEBUG:boto:Data: 2024-04-16T18:26:21.745 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.746 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.746 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.746 DEBUG:boto:Params: {} 2024-04-16T18:26:21.746 DEBUG:boto:Token: None 2024-04-16T18:26:21.746 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.746 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw= 2024-04-16T18:26:21.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw=', 'Content-Length': '0'} 2024-04-16T18:26:21.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5acdf4dfa403e16-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.790 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.790 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.791 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.791 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.791 DEBUG:boto:Method: GET 2024-04-16T18:26:21.791 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.791 DEBUG:boto:Data: 2024-04-16T18:26:21.791 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.791 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.791 DEBUG:boto:Params: {} 2024-04-16T18:26:21.791 DEBUG:boto:Token: None 2024-04-16T18:26:21.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:26:21.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw= 2024-04-16T18:26:21.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fVd9VJuq9hAOQJuomtYXPntPKjw=', 'Content-Length': '0'} 2024-04-16T18:26:21.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f0d620133062ef8-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.794 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.794 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.794 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.794 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.794 DEBUG:boto:Method: GET 2024-04-16T18:26:21.795 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.795 DEBUG:boto:Data: 2024-04-16T18:26:21.795 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.795 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.795 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.795 DEBUG:boto:Params: {} 2024-04-16T18:26:21.795 DEBUG:boto:Token: None 2024-04-16T18:26:21.795 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.797 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000037823027aa4ab6e-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.838 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.839 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.839 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.839 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.839 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.839 DEBUG:boto:Method: GET 2024-04-16T18:26:21.839 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.839 DEBUG:boto:Data: 2024-04-16T18:26:21.839 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.839 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.839 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.839 DEBUG:boto:Params: {} 2024-04-16T18:26:21.840 DEBUG:boto:Token: None 2024-04-16T18:26:21.840 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.843 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000359e9942a8460f04-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.843 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.844 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.844 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.844 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.844 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:26:21.844 DEBUG:boto:Data: 2024-04-16T18:26:21.844 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.844 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.844 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.844 DEBUG:boto:Params: {} 2024-04-16T18:26:21.844 DEBUG:boto:Token: None 2024-04-16T18:26:21.845 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23 2024-04-16T18:26:21.845 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c3nOpNpnZSpTS5TyVG8GAl4Gy4U= 2024-04-16T18:26:21.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c3nOpNpnZSpTS5TyVG8GAl4Gy4U=', 'Content-Length': '0'} 2024-04-16T18:26:21.847 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000285917f54103f880-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.847 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.847 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.847 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.847 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:26:21.847 DEBUG:boto:Data: 2024-04-16T18:26:21.847 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.848 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.848 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.848 DEBUG:boto:Params: {} 2024-04-16T18:26:21.848 DEBUG:boto:Token: None 2024-04-16T18:26:21.848 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23 2024-04-16T18:26:21.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c3nOpNpnZSpTS5TyVG8GAl4Gy4U= 2024-04-16T18:26:21.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c3nOpNpnZSpTS5TyVG8GAl4Gy4U=', 'Content-Length': '0'} 2024-04-16T18:26:21.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef574e1a5c37eacc-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.850 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:26:21.850 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.851 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.851 DEBUG:boto:Method: GET 2024-04-16T18:26:21.851 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:26:21.851 DEBUG:boto:Data: 2024-04-16T18:26:21.851 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.851 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.851 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.851 DEBUG:boto:Params: {} 2024-04-16T18:26:21.851 DEBUG:boto:Token: None 2024-04-16T18:26:21.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23 2024-04-16T18:26:21.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L9i1fRLdJMqI7SqENql8Mq7ty8A= 2024-04-16T18:26:21.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L9i1fRLdJMqI7SqENql8Mq7ty8A=', 'Content-Length': '0'} 2024-04-16T18:26:21.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce1460667f3bb500-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.894 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:26:21.894 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:26:21.895 DEBUG:boto:Method: GET 2024-04-16T18:26:21.895 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:26:21.895 DEBUG:boto:Data: 2024-04-16T18:26:21.895 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.895 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.895 DEBUG:boto:Params: {} 2024-04-16T18:26:21.895 DEBUG:boto:Token: None 2024-04-16T18:26:21.895 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj23 2024-04-16T18:26:21.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L9i1fRLdJMqI7SqENql8Mq7ty8A= 2024-04-16T18:26:21.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L9i1fRLdJMqI7SqENql8Mq7ty8A=', 'Content-Length': '0'} 2024-04-16T18:26:21.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ee2ed86ed271c21-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.898 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.898 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.898 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.898 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.898 DEBUG:boto:Method: GET 2024-04-16T18:26:21.898 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.898 DEBUG:boto:Data: 2024-04-16T18:26:21.898 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.898 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.899 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.899 DEBUG:boto:Params: {} 2024-04-16T18:26:21.899 DEBUG:boto:Token: None 2024-04-16T18:26:21.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.901 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb15cf633d71b0f2-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.942 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.943 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:21.943 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:21.943 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.943 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.943 DEBUG:boto:Method: GET 2024-04-16T18:26:21.943 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:26:21.943 DEBUG:boto:Data: 2024-04-16T18:26:21.943 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.943 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.944 DEBUG:boto:Params: {} 2024-04-16T18:26:21.944 DEBUG:boto:Token: None 2024-04-16T18:26:21.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/ 2024-04-16T18:26:21.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg= 2024-04-16T18:26:21.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:15d5ubXjtDnRympaHyjgYdTAIYg=', 'Content-Length': '0'} 2024-04-16T18:26:21.948 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1121877f1c33d81-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.948 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:21.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:26:21.948 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:21.948 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:21.949 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.949 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.949 DEBUG:boto:Method: GET 2024-04-16T18:26:21.949 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.949 DEBUG:boto:Data: 2024-04-16T18:26:21.949 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.949 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.949 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.949 DEBUG:boto:Params: {} 2024-04-16T18:26:21.949 DEBUG:boto:Token: None 2024-04-16T18:26:21.950 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nEegcSPXiTqhgU/LmjO22Ebrc18= 2024-04-16T18:26:21.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nEegcSPXiTqhgU/LmjO22Ebrc18=', 'Content-Length': '0'} 2024-04-16T18:26:21.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8409153ad0b7d00-00661ec2cd-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.994 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:21.994 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:21.995 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.995 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.995 DEBUG:boto:Method: GET 2024-04-16T18:26:21.995 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.995 DEBUG:boto:Data: 2024-04-16T18:26:21.995 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:21.995 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.995 DEBUG:boto:Params: {} 2024-04-16T18:26:21.995 DEBUG:boto:Token: None 2024-04-16T18:26:21.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nEegcSPXiTqhgU/LmjO22Ebrc18= 2024-04-16T18:26:21.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nEegcSPXiTqhgU/LmjO22Ebrc18=', 'Content-Length': '0'} 2024-04-16T18:26:21.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d942058015e98656-00661ec2cd-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:21 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:21.998 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:21.998 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:21.998 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.999 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.999 DEBUG:boto:Method: HEAD 2024-04-16T18:26:21.999 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:21.999 DEBUG:boto:Data: 2024-04-16T18:26:21.999 DEBUG:boto:Headers: {} 2024-04-16T18:26:21.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:21.999 DEBUG:boto:Port: 8000 2024-04-16T18:26:21.999 DEBUG:boto:Params: {} 2024-04-16T18:26:21.999 DEBUG:boto:Token: None 2024-04-16T18:26:21.999 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:21 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TUtSmnStZb/2kC5QXTj5EJNwCOo= 2024-04-16T18:26:22.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:21 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TUtSmnStZb/2kC5QXTj5EJNwCOo=', 'Content-Length': '0'} 2024-04-16T18:26:22.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000789a5f6f5b7768ae-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.002 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:22.002 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:22.002 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.002 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.002 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.002 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.002 DEBUG:boto:Data: 2024-04-16T18:26:22.002 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.003 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.003 DEBUG:boto:Params: {} 2024-04-16T18:26:22.003 DEBUG:boto:Token: None 2024-04-16T18:26:22.003 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WJ/0VCBzNDhULfr1QcaoS0+tWP8= 2024-04-16T18:26:22.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WJ/0VCBzNDhULfr1QcaoS0+tWP8=', 'Content-Length': '0'} 2024-04-16T18:26:22.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2eeedbe9cbc8d01-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.005 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:26:22.006 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:22.006 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:22.006 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.006 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.006 DEBUG:boto:Method: GET 2024-04-16T18:26:22.006 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.006 DEBUG:boto:Data: 2024-04-16T18:26:22.006 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.007 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.007 DEBUG:boto:Params: {} 2024-04-16T18:26:22.007 DEBUG:boto:Token: None 2024-04-16T18:26:22.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xHzZszjBqXoXyCZSzCehwYxYV94= 2024-04-16T18:26:22.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xHzZszjBqXoXyCZSzCehwYxYV94=', 'Content-Length': '0'} 2024-04-16T18:26:22.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4a27d313d0bffd1-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.050 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:22.050 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:22.051 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.051 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.051 DEBUG:boto:Method: GET 2024-04-16T18:26:22.051 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.051 DEBUG:boto:Data: 2024-04-16T18:26:22.051 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.051 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.051 DEBUG:boto:Params: {} 2024-04-16T18:26:22.051 DEBUG:boto:Token: None 2024-04-16T18:26:22.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:26:22.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xHzZszjBqXoXyCZSzCehwYxYV94= 2024-04-16T18:26:22.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xHzZszjBqXoXyCZSzCehwYxYV94=', 'Content-Length': '0'} 2024-04-16T18:26:22.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb1b7026c0557f73-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.054 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.054 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.054 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.054 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.054 DEBUG:boto:Method: GET 2024-04-16T18:26:22.055 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.055 DEBUG:boto:Data: 2024-04-16T18:26:22.055 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.055 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.055 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.055 DEBUG:boto:Params: {} 2024-04-16T18:26:22.055 DEBUG:boto:Token: None 2024-04-16T18:26:22.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.058 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f892ce2c79f42f78-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.098 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.099 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.099 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.099 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.099 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.099 DEBUG:boto:Method: GET 2024-04-16T18:26:22.099 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.099 DEBUG:boto:Data: 2024-04-16T18:26:22.099 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.099 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.100 DEBUG:boto:Params: {} 2024-04-16T18:26:22.100 DEBUG:boto:Token: None 2024-04-16T18:26:22.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.103 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098771dc586ad1385-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.104 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.104 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:22.104 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:22.104 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.104 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:26:22.104 DEBUG:boto:Data: 2024-04-16T18:26:22.104 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.104 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.104 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.105 DEBUG:boto:Params: {} 2024-04-16T18:26:22.105 DEBUG:boto:Token: None 2024-04-16T18:26:22.105 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj29 2024-04-16T18:26:22.105 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yybmpl29+HxtwyaGqTTwvd6X4G4= 2024-04-16T18:26:22.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yybmpl29+HxtwyaGqTTwvd6X4G4=', 'Content-Length': '0'} 2024-04-16T18:26:22.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1304ab48e334c53-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.107 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:22.107 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:22.107 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.107 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:26:22.108 DEBUG:boto:Data: 2024-04-16T18:26:22.108 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.108 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.108 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.108 DEBUG:boto:Params: {} 2024-04-16T18:26:22.108 DEBUG:boto:Token: None 2024-04-16T18:26:22.108 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj29 2024-04-16T18:26:22.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yybmpl29+HxtwyaGqTTwvd6X4G4= 2024-04-16T18:26:22.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yybmpl29+HxtwyaGqTTwvd6X4G4=', 'Content-Length': '0'} 2024-04-16T18:26:22.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a4cb7f9bc532d6d-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.110 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:26:22.111 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:22.111 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:22.111 DEBUG:boto:Method: GET 2024-04-16T18:26:22.111 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:26:22.111 DEBUG:boto:Data: 2024-04-16T18:26:22.111 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.111 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.111 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.111 DEBUG:boto:Params: {} 2024-04-16T18:26:22.111 DEBUG:boto:Token: None 2024-04-16T18:26:22.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj29 2024-04-16T18:26:22.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:REluxNxZT0+KTiBNlDbudTf3yZM= 2024-04-16T18:26:22.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:REluxNxZT0+KTiBNlDbudTf3yZM=', 'Content-Length': '0'} 2024-04-16T18:26:22.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f22214876e5f102b-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.154 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:26:22.154 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:26:22.155 DEBUG:boto:Method: GET 2024-04-16T18:26:22.155 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:26:22.155 DEBUG:boto:Data: 2024-04-16T18:26:22.155 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.155 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.155 DEBUG:boto:Params: {} 2024-04-16T18:26:22.155 DEBUG:boto:Token: None 2024-04-16T18:26:22.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj29 2024-04-16T18:26:22.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:REluxNxZT0+KTiBNlDbudTf3yZM= 2024-04-16T18:26:22.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:REluxNxZT0+KTiBNlDbudTf3yZM=', 'Content-Length': '0'} 2024-04-16T18:26:22.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009ea3eb6bbcdd012-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.158 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.158 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.158 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.158 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.158 DEBUG:boto:Method: GET 2024-04-16T18:26:22.158 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.158 DEBUG:boto:Data: 2024-04-16T18:26:22.159 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.159 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.159 DEBUG:boto:Params: {} 2024-04-16T18:26:22.159 DEBUG:boto:Token: None 2024-04-16T18:26:22.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.161 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007cd493fc5d2ec4c6-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.202 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.203 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.203 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.203 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.203 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.203 DEBUG:boto:Method: GET 2024-04-16T18:26:22.203 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:26:22.203 DEBUG:boto:Data: 2024-04-16T18:26:22.203 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.204 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.204 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.204 DEBUG:boto:Params: {} 2024-04-16T18:26:22.204 DEBUG:boto:Token: None 2024-04-16T18:26:22.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.208 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b2104591cc726fa-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.208 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:26:22.209 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.209 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.209 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.209 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.209 DEBUG:boto:Method: GET 2024-04-16T18:26:22.209 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.209 DEBUG:boto:Data: 2024-04-16T18:26:22.209 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.209 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.209 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.209 DEBUG:boto:Params: {} 2024-04-16T18:26:22.210 DEBUG:boto:Token: None 2024-04-16T18:26:22.210 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.210 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA= 2024-04-16T18:26:22.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA=', 'Content-Length': '0'} 2024-04-16T18:26:22.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007002802b2850c890-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.254 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.255 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.255 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.255 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.255 DEBUG:boto:Method: GET 2024-04-16T18:26:22.255 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.255 DEBUG:boto:Data: 2024-04-16T18:26:22.255 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.255 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.255 DEBUG:boto:Params: {} 2024-04-16T18:26:22.255 DEBUG:boto:Token: None 2024-04-16T18:26:22.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA= 2024-04-16T18:26:22.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA=', 'Content-Length': '0'} 2024-04-16T18:26:22.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e62560ce275b23c0-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.258 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.258 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.258 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.258 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.259 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.259 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.259 DEBUG:boto:Data: 2024-04-16T18:26:22.259 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.259 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.259 DEBUG:boto:Params: {} 2024-04-16T18:26:22.259 DEBUG:boto:Token: None 2024-04-16T18:26:22.259 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XcIWXKbgIuJv1ydzcCLrCqEROCI= 2024-04-16T18:26:22.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XcIWXKbgIuJv1ydzcCLrCqEROCI=', 'Content-Length': '0'} 2024-04-16T18:26:22.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000faf425e379fa31cf-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.262 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.262 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.262 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.262 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.262 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.262 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.263 DEBUG:boto:Data: 2024-04-16T18:26:22.263 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.263 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.263 DEBUG:boto:Params: {} 2024-04-16T18:26:22.263 DEBUG:boto:Token: None 2024-04-16T18:26:22.263 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XcIWXKbgIuJv1ydzcCLrCqEROCI= 2024-04-16T18:26:22.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XcIWXKbgIuJv1ydzcCLrCqEROCI=', 'Content-Length': '0'} 2024-04-16T18:26:22.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e809f6362bfc743-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.266 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:26:22.266 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.266 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.266 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.266 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.266 DEBUG:boto:Method: GET 2024-04-16T18:26:22.266 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.266 DEBUG:boto:Data: 2024-04-16T18:26:22.267 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.267 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.267 DEBUG:boto:Params: {} 2024-04-16T18:26:22.267 DEBUG:boto:Token: None 2024-04-16T18:26:22.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA= 2024-04-16T18:26:22.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA=', 'Content-Length': '0'} 2024-04-16T18:26:22.269 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aef5c71ed7f32c9d-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.310 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.310 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.310 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.311 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.311 DEBUG:boto:Method: GET 2024-04-16T18:26:22.311 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.311 DEBUG:boto:Data: 2024-04-16T18:26:22.311 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.311 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.311 DEBUG:boto:Params: {} 2024-04-16T18:26:22.311 DEBUG:boto:Token: None 2024-04-16T18:26:22.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:26:22.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA= 2024-04-16T18:26:22.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u75TmU9yttsumTtOSW6C35PjuFA=', 'Content-Length': '0'} 2024-04-16T18:26:22.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007366f4670ad51963-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.314 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.314 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.314 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.314 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.314 DEBUG:boto:Method: GET 2024-04-16T18:26:22.314 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.314 DEBUG:boto:Data: 2024-04-16T18:26:22.314 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.314 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.315 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.315 DEBUG:boto:Params: {} 2024-04-16T18:26:22.315 DEBUG:boto:Token: None 2024-04-16T18:26:22.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ebdeddb2b9e2312c-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.358 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.359 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.359 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.359 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.359 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.359 DEBUG:boto:Method: GET 2024-04-16T18:26:22.359 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.359 DEBUG:boto:Data: 2024-04-16T18:26:22.359 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.359 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.359 DEBUG:boto:Params: {} 2024-04-16T18:26:22.360 DEBUG:boto:Token: None 2024-04-16T18:26:22.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.363 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004135c2695c0736d5-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.363 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.364 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.364 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.364 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.364 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:26:22.364 DEBUG:boto:Data: 2024-04-16T18:26:22.364 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.364 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.364 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.364 DEBUG:boto:Params: {} 2024-04-16T18:26:22.365 DEBUG:boto:Token: None 2024-04-16T18:26:22.365 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33 2024-04-16T18:26:22.365 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zD8EYLyINXZU04p1FyRtD54VppM= 2024-04-16T18:26:22.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zD8EYLyINXZU04p1FyRtD54VppM=', 'Content-Length': '0'} 2024-04-16T18:26:22.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9655e2ad680b952-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.367 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.367 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.367 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.367 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:26:22.368 DEBUG:boto:Data: 2024-04-16T18:26:22.368 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.368 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.368 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.368 DEBUG:boto:Params: {} 2024-04-16T18:26:22.368 DEBUG:boto:Token: None 2024-04-16T18:26:22.368 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33 2024-04-16T18:26:22.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zD8EYLyINXZU04p1FyRtD54VppM= 2024-04-16T18:26:22.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zD8EYLyINXZU04p1FyRtD54VppM=', 'Content-Length': '0'} 2024-04-16T18:26:22.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7fa5019655b917c-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.371 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:26:22.371 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.371 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.371 DEBUG:boto:Method: GET 2024-04-16T18:26:22.371 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:26:22.371 DEBUG:boto:Data: 2024-04-16T18:26:22.371 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.371 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.372 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.372 DEBUG:boto:Params: {} 2024-04-16T18:26:22.372 DEBUG:boto:Token: None 2024-04-16T18:26:22.372 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33 2024-04-16T18:26:22.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UXgR8Q3wC931CtVupPvSWV4StFc= 2024-04-16T18:26:22.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UXgR8Q3wC931CtVupPvSWV4StFc=', 'Content-Length': '0'} 2024-04-16T18:26:22.374 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007cb2e9e51969d4fe-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.418 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:26:22.419 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:26:22.419 DEBUG:boto:Method: GET 2024-04-16T18:26:22.419 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:26:22.419 DEBUG:boto:Data: 2024-04-16T18:26:22.419 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.419 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.419 DEBUG:boto:Params: {} 2024-04-16T18:26:22.419 DEBUG:boto:Token: None 2024-04-16T18:26:22.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj33 2024-04-16T18:26:22.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UXgR8Q3wC931CtVupPvSWV4StFc= 2024-04-16T18:26:22.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UXgR8Q3wC931CtVupPvSWV4StFc=', 'Content-Length': '0'} 2024-04-16T18:26:22.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d61992f2f99a3f57-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.422 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.422 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.422 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.422 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.422 DEBUG:boto:Method: GET 2024-04-16T18:26:22.423 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.423 DEBUG:boto:Data: 2024-04-16T18:26:22.423 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.423 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.423 DEBUG:boto:Params: {} 2024-04-16T18:26:22.425 DEBUG:boto:Token: None 2024-04-16T18:26:22.425 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.426 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.428 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0b66cf18e7e6878-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.470 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.471 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.471 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.471 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.471 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.471 DEBUG:boto:Method: GET 2024-04-16T18:26:22.471 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:26:22.471 DEBUG:boto:Data: 2024-04-16T18:26:22.471 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.471 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.471 DEBUG:boto:Params: {} 2024-04-16T18:26:22.472 DEBUG:boto:Token: None 2024-04-16T18:26:22.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.475 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a667a4cba34c7d33-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.476 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.476 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:26:22.476 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.476 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.476 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.476 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.476 DEBUG:boto:Method: GET 2024-04-16T18:26:22.476 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.476 DEBUG:boto:Data: 2024-04-16T18:26:22.477 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.477 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.477 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.477 DEBUG:boto:Params: {} 2024-04-16T18:26:22.477 DEBUG:boto:Token: None 2024-04-16T18:26:22.477 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.477 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y= 2024-04-16T18:26:22.477 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y=', 'Content-Length': '0'} 2024-04-16T18:26:22.479 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081aacd03e24a5e0e-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.522 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.522 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.523 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.523 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.523 DEBUG:boto:Method: GET 2024-04-16T18:26:22.523 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.523 DEBUG:boto:Data: 2024-04-16T18:26:22.523 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.523 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.523 DEBUG:boto:Params: {} 2024-04-16T18:26:22.523 DEBUG:boto:Token: None 2024-04-16T18:26:22.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y= 2024-04-16T18:26:22.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y=', 'Content-Length': '0'} 2024-04-16T18:26:22.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0f07d19358ab6e8-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.526 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.526 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.526 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.526 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.526 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.526 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.526 DEBUG:boto:Data: 2024-04-16T18:26:22.526 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.527 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.527 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.527 DEBUG:boto:Params: {} 2024-04-16T18:26:22.527 DEBUG:boto:Token: None 2024-04-16T18:26:22.527 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YEv+fMJvJm2lhnPdAMmfyp2avAw= 2024-04-16T18:26:22.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YEv+fMJvJm2lhnPdAMmfyp2avAw=', 'Content-Length': '0'} 2024-04-16T18:26:22.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005498132845c4a093-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.529 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.529 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.529 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.530 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.530 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.530 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.530 DEBUG:boto:Data: 2024-04-16T18:26:22.530 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.530 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.530 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.530 DEBUG:boto:Params: {} 2024-04-16T18:26:22.530 DEBUG:boto:Token: None 2024-04-16T18:26:22.531 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YEv+fMJvJm2lhnPdAMmfyp2avAw= 2024-04-16T18:26:22.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YEv+fMJvJm2lhnPdAMmfyp2avAw=', 'Content-Length': '0'} 2024-04-16T18:26:22.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e92a8c792c324747-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.533 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:26:22.533 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.533 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.533 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.533 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.533 DEBUG:boto:Method: GET 2024-04-16T18:26:22.533 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.533 DEBUG:boto:Data: 2024-04-16T18:26:22.533 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.533 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.534 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.534 DEBUG:boto:Params: {} 2024-04-16T18:26:22.534 DEBUG:boto:Token: None 2024-04-16T18:26:22.534 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.534 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y= 2024-04-16T18:26:22.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y=', 'Content-Length': '0'} 2024-04-16T18:26:22.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd32ed2c4019239f-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.578 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.578 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.579 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.579 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.579 DEBUG:boto:Method: GET 2024-04-16T18:26:22.579 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.579 DEBUG:boto:Data: 2024-04-16T18:26:22.579 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.579 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.579 DEBUG:boto:Params: {} 2024-04-16T18:26:22.579 DEBUG:boto:Token: None 2024-04-16T18:26:22.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:26:22.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y= 2024-04-16T18:26:22.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EMy2deifdXnD349AjJNzird88Y=', 'Content-Length': '0'} 2024-04-16T18:26:22.582 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000995a65e69648d0f8-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.582 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.582 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.582 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.582 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.582 DEBUG:boto:Method: GET 2024-04-16T18:26:22.582 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.582 DEBUG:boto:Data: 2024-04-16T18:26:22.583 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.583 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.583 DEBUG:boto:Params: {} 2024-04-16T18:26:22.583 DEBUG:boto:Token: None 2024-04-16T18:26:22.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000058f928ea37f73525-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.626 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.627 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.627 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.627 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.627 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.627 DEBUG:boto:Method: GET 2024-04-16T18:26:22.627 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.627 DEBUG:boto:Data: 2024-04-16T18:26:22.627 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.627 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.627 DEBUG:boto:Params: {} 2024-04-16T18:26:22.628 DEBUG:boto:Token: None 2024-04-16T18:26:22.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.631 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9f3e04a2c481307-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.632 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.632 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.632 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.632 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.632 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:26:22.632 DEBUG:boto:Data: 2024-04-16T18:26:22.632 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.632 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.633 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.633 DEBUG:boto:Params: {} 2024-04-16T18:26:22.633 DEBUG:boto:Token: None 2024-04-16T18:26:22.633 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34 2024-04-16T18:26:22.633 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nPY1PFDuYzRFWqKeS6zQmmyqxdA= 2024-04-16T18:26:22.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nPY1PFDuYzRFWqKeS6zQmmyqxdA=', 'Content-Length': '0'} 2024-04-16T18:26:22.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a9a7124b88d0dd2-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.635 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.635 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.635 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.635 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:26:22.635 DEBUG:boto:Data: 2024-04-16T18:26:22.635 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.636 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.636 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.636 DEBUG:boto:Params: {} 2024-04-16T18:26:22.636 DEBUG:boto:Token: None 2024-04-16T18:26:22.636 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34 2024-04-16T18:26:22.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nPY1PFDuYzRFWqKeS6zQmmyqxdA= 2024-04-16T18:26:22.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nPY1PFDuYzRFWqKeS6zQmmyqxdA=', 'Content-Length': '0'} 2024-04-16T18:26:22.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b932f8349dc6472-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.638 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:26:22.639 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.639 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.639 DEBUG:boto:Method: GET 2024-04-16T18:26:22.639 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:26:22.639 DEBUG:boto:Data: 2024-04-16T18:26:22.639 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.639 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.639 DEBUG:boto:Params: {} 2024-04-16T18:26:22.639 DEBUG:boto:Token: None 2024-04-16T18:26:22.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34 2024-04-16T18:26:22.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8BhloAGIXiBHKN8Tv2aUFbMPRR0= 2024-04-16T18:26:22.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8BhloAGIXiBHKN8Tv2aUFbMPRR0=', 'Content-Length': '0'} 2024-04-16T18:26:22.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f993388b7a818cf5-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.682 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:26:22.682 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:26:22.683 DEBUG:boto:Method: GET 2024-04-16T18:26:22.683 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:26:22.683 DEBUG:boto:Data: 2024-04-16T18:26:22.683 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.683 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.683 DEBUG:boto:Params: {} 2024-04-16T18:26:22.683 DEBUG:boto:Token: None 2024-04-16T18:26:22.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj34 2024-04-16T18:26:22.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8BhloAGIXiBHKN8Tv2aUFbMPRR0= 2024-04-16T18:26:22.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8BhloAGIXiBHKN8Tv2aUFbMPRR0=', 'Content-Length': '0'} 2024-04-16T18:26:22.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045903a38697cca22-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.686 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.686 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.686 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.686 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.686 DEBUG:boto:Method: GET 2024-04-16T18:26:22.686 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.686 DEBUG:boto:Data: 2024-04-16T18:26:22.686 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.686 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.687 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.687 DEBUG:boto:Params: {} 2024-04-16T18:26:22.687 DEBUG:boto:Token: None 2024-04-16T18:26:22.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fbf990158ae27b4f-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.730 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.731 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.731 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.731 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.731 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.731 DEBUG:boto:Method: GET 2024-04-16T18:26:22.731 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:26:22.731 DEBUG:boto:Data: 2024-04-16T18:26:22.731 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.732 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.732 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.732 DEBUG:boto:Params: {} 2024-04-16T18:26:22.732 DEBUG:boto:Token: None 2024-04-16T18:26:22.732 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.736 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098048178bf90bf73-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.736 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.736 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:26:22.736 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.736 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.737 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.737 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.737 DEBUG:boto:Method: GET 2024-04-16T18:26:22.737 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.737 DEBUG:boto:Data: 2024-04-16T18:26:22.737 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.737 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.737 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.737 DEBUG:boto:Params: {} 2024-04-16T18:26:22.737 DEBUG:boto:Token: None 2024-04-16T18:26:22.737 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.738 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM= 2024-04-16T18:26:22.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM=', 'Content-Length': '0'} 2024-04-16T18:26:22.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000775404aefcb0aa3a-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.782 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.782 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.783 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.783 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.783 DEBUG:boto:Method: GET 2024-04-16T18:26:22.783 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.783 DEBUG:boto:Data: 2024-04-16T18:26:22.783 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.783 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.783 DEBUG:boto:Params: {} 2024-04-16T18:26:22.784 DEBUG:boto:Token: None 2024-04-16T18:26:22.784 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM= 2024-04-16T18:26:22.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM=', 'Content-Length': '0'} 2024-04-16T18:26:22.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039209425af3b02e1-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.786 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.786 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.786 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.786 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.786 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.787 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.787 DEBUG:boto:Data: 2024-04-16T18:26:22.787 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.787 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.787 DEBUG:boto:Params: {} 2024-04-16T18:26:22.787 DEBUG:boto:Token: None 2024-04-16T18:26:22.787 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YDpT7WEX8caPDRMEiJgosteaZhA= 2024-04-16T18:26:22.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YDpT7WEX8caPDRMEiJgosteaZhA=', 'Content-Length': '0'} 2024-04-16T18:26:22.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e533b89e386ff4e8-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.790 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.790 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.790 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.790 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.790 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.790 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.790 DEBUG:boto:Data: 2024-04-16T18:26:22.790 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.790 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.790 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.791 DEBUG:boto:Params: {} 2024-04-16T18:26:22.791 DEBUG:boto:Token: None 2024-04-16T18:26:22.791 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YDpT7WEX8caPDRMEiJgosteaZhA= 2024-04-16T18:26:22.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YDpT7WEX8caPDRMEiJgosteaZhA=', 'Content-Length': '0'} 2024-04-16T18:26:22.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009320c9284e6c41aa-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:26:22.793 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.793 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.793 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.793 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.794 DEBUG:boto:Method: GET 2024-04-16T18:26:22.794 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.794 DEBUG:boto:Data: 2024-04-16T18:26:22.794 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.794 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.794 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.794 DEBUG:boto:Params: {} 2024-04-16T18:26:22.794 DEBUG:boto:Token: None 2024-04-16T18:26:22.794 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.794 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM= 2024-04-16T18:26:22.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM=', 'Content-Length': '0'} 2024-04-16T18:26:22.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000419ba74e1d9c9070-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.838 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.838 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.839 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.839 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.839 DEBUG:boto:Method: GET 2024-04-16T18:26:22.839 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.839 DEBUG:boto:Data: 2024-04-16T18:26:22.839 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.839 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.839 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.839 DEBUG:boto:Params: {} 2024-04-16T18:26:22.839 DEBUG:boto:Token: None 2024-04-16T18:26:22.840 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:26:22.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM= 2024-04-16T18:26:22.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HB14BMKGJRanGw+Jrg9bBveZ4cM=', 'Content-Length': '0'} 2024-04-16T18:26:22.842 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a27ff03270e7b852-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.842 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.842 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.842 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.842 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.843 DEBUG:boto:Method: GET 2024-04-16T18:26:22.843 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.843 DEBUG:boto:Data: 2024-04-16T18:26:22.843 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.843 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.843 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.843 DEBUG:boto:Params: {} 2024-04-16T18:26:22.843 DEBUG:boto:Token: None 2024-04-16T18:26:22.843 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.846 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003d291bbe37154299-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.886 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.887 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.887 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.887 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.887 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.887 DEBUG:boto:Method: GET 2024-04-16T18:26:22.887 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.887 DEBUG:boto:Data: 2024-04-16T18:26:22.887 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.887 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.888 DEBUG:boto:Params: {} 2024-04-16T18:26:22.888 DEBUG:boto:Token: None 2024-04-16T18:26:22.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.892 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066e8810e394129d8-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.892 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.892 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.892 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.892 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.893 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:26:22.893 DEBUG:boto:Data: 2024-04-16T18:26:22.893 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.893 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.893 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.893 DEBUG:boto:Params: {} 2024-04-16T18:26:22.893 DEBUG:boto:Token: None 2024-04-16T18:26:22.893 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38 2024-04-16T18:26:22.893 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UNwIkGWpJyELdRf0Cuv11FHmdrM= 2024-04-16T18:26:22.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UNwIkGWpJyELdRf0Cuv11FHmdrM=', 'Content-Length': '0'} 2024-04-16T18:26:22.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a916200932cf28b-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.895 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.895 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.895 DEBUG:boto:Method: HEAD 2024-04-16T18:26:22.896 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:26:22.896 DEBUG:boto:Data: 2024-04-16T18:26:22.896 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.896 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.896 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.896 DEBUG:boto:Params: {} 2024-04-16T18:26:22.896 DEBUG:boto:Token: None 2024-04-16T18:26:22.896 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38 2024-04-16T18:26:22.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UNwIkGWpJyELdRf0Cuv11FHmdrM= 2024-04-16T18:26:22.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UNwIkGWpJyELdRf0Cuv11FHmdrM=', 'Content-Length': '0'} 2024-04-16T18:26:22.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006862f9b0d26331d5-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.898 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:26:22.899 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.899 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.899 DEBUG:boto:Method: GET 2024-04-16T18:26:22.899 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:26:22.899 DEBUG:boto:Data: 2024-04-16T18:26:22.899 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.899 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.899 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.899 DEBUG:boto:Params: {} 2024-04-16T18:26:22.899 DEBUG:boto:Token: None 2024-04-16T18:26:22.900 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38 2024-04-16T18:26:22.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C7+/ttk/IwzHgGs+YfwAoWtz+54= 2024-04-16T18:26:22.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C7+/ttk/IwzHgGs+YfwAoWtz+54=', 'Content-Length': '0'} 2024-04-16T18:26:22.902 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1d31adc6dc8636c-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.942 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:26:22.943 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:26:22.943 DEBUG:boto:Method: GET 2024-04-16T18:26:22.943 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:26:22.943 DEBUG:boto:Data: 2024-04-16T18:26:22.943 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.943 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.943 DEBUG:boto:Params: {} 2024-04-16T18:26:22.943 DEBUG:boto:Token: None 2024-04-16T18:26:22.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj38 2024-04-16T18:26:22.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C7+/ttk/IwzHgGs+YfwAoWtz+54= 2024-04-16T18:26:22.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C7+/ttk/IwzHgGs+YfwAoWtz+54=', 'Content-Length': '0'} 2024-04-16T18:26:22.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f5161e1929e07a3-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.946 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.946 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.946 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.946 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.946 DEBUG:boto:Method: GET 2024-04-16T18:26:22.946 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.946 DEBUG:boto:Data: 2024-04-16T18:26:22.947 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.947 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.947 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.947 DEBUG:boto:Params: {} 2024-04-16T18:26:22.947 DEBUG:boto:Token: None 2024-04-16T18:26:22.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.950 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095b518ae71fcd30b-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.990 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.991 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:22.991 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:22.991 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.991 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.991 DEBUG:boto:Method: GET 2024-04-16T18:26:22.991 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:26:22.991 DEBUG:boto:Data: 2024-04-16T18:26:22.991 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:22.992 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.992 DEBUG:boto:Params: {} 2024-04-16T18:26:22.992 DEBUG:boto:Token: None 2024-04-16T18:26:22.992 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/ 2024-04-16T18:26:22.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0= 2024-04-16T18:26:22.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:huoQyt1YVfPbbzs+kthseBey0V0=', 'Content-Length': '0'} 2024-04-16T18:26:22.996 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6c529c979639d88-00661ec2ce-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:22 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:22.996 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:22.996 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:26:22.996 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:22.996 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:22.996 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:22.997 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:22.997 DEBUG:boto:Method: GET 2024-04-16T18:26:22.997 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:22.997 DEBUG:boto:Data: 2024-04-16T18:26:22.997 DEBUG:boto:Headers: {} 2024-04-16T18:26:22.997 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:22.997 DEBUG:boto:Port: 8000 2024-04-16T18:26:22.997 DEBUG:boto:Params: {} 2024-04-16T18:26:22.997 DEBUG:boto:Token: None 2024-04-16T18:26:22.997 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:22 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:22.998 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cCkFK4/KokuP/zX3RS0gkpCk8mM= 2024-04-16T18:26:22.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:22 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cCkFK4/KokuP/zX3RS0gkpCk8mM=', 'Content-Length': '0'} 2024-04-16T18:26:23.000 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f77feaeb0033f8ef-00661ec2ce-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.042 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.043 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.043 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.043 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.043 DEBUG:boto:Method: GET 2024-04-16T18:26:23.043 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.043 DEBUG:boto:Data: 2024-04-16T18:26:23.043 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.043 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.044 DEBUG:boto:Params: {} 2024-04-16T18:26:23.044 DEBUG:boto:Token: None 2024-04-16T18:26:23.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XPyjy7YIzWCZBpYCaesXjnw6G/g= 2024-04-16T18:26:23.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XPyjy7YIzWCZBpYCaesXjnw6G/g=', 'Content-Length': '0'} 2024-04-16T18:26:23.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035dc21ea36fd87d4-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.046 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.046 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.047 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.047 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.047 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.047 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.047 DEBUG:boto:Data: 2024-04-16T18:26:23.047 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.047 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.047 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.047 DEBUG:boto:Params: {} 2024-04-16T18:26:23.047 DEBUG:boto:Token: None 2024-04-16T18:26:23.048 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+D18qiLpWXKlrOqb7TBgpwLAsD4= 2024-04-16T18:26:23.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+D18qiLpWXKlrOqb7TBgpwLAsD4=', 'Content-Length': '0'} 2024-04-16T18:26:23.050 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f671eca7090bac32-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.050 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.050 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.050 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.050 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.050 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.050 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.051 DEBUG:boto:Data: 2024-04-16T18:26:23.051 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.051 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.051 DEBUG:boto:Params: {} 2024-04-16T18:26:23.051 DEBUG:boto:Token: None 2024-04-16T18:26:23.051 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+D18qiLpWXKlrOqb7TBgpwLAsD4= 2024-04-16T18:26:23.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+D18qiLpWXKlrOqb7TBgpwLAsD4=', 'Content-Length': '0'} 2024-04-16T18:26:23.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047777d06cd85c747-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.053 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:26:23.053 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.054 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.054 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.054 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.054 DEBUG:boto:Method: GET 2024-04-16T18:26:23.054 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.054 DEBUG:boto:Data: 2024-04-16T18:26:23.054 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.054 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.054 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.054 DEBUG:boto:Params: {} 2024-04-16T18:26:23.054 DEBUG:boto:Token: None 2024-04-16T18:26:23.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XPyjy7YIzWCZBpYCaesXjnw6G/g= 2024-04-16T18:26:23.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XPyjy7YIzWCZBpYCaesXjnw6G/g=', 'Content-Length': '0'} 2024-04-16T18:26:23.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047e4c80f5a82d1ac-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.098 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.099 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.099 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.099 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.099 DEBUG:boto:Method: GET 2024-04-16T18:26:23.099 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.099 DEBUG:boto:Data: 2024-04-16T18:26:23.099 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.099 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.099 DEBUG:boto:Params: {} 2024-04-16T18:26:23.100 DEBUG:boto:Token: None 2024-04-16T18:26:23.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:26:23.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XPyjy7YIzWCZBpYCaesXjnw6G/g= 2024-04-16T18:26:23.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XPyjy7YIzWCZBpYCaesXjnw6G/g=', 'Content-Length': '0'} 2024-04-16T18:26:23.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060b3ead5052e8c01-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.102 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.102 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.102 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.103 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.103 DEBUG:boto:Method: GET 2024-04-16T18:26:23.103 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.103 DEBUG:boto:Data: 2024-04-16T18:26:23.103 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.103 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.103 DEBUG:boto:Params: {} 2024-04-16T18:26:23.103 DEBUG:boto:Token: None 2024-04-16T18:26:23.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.106 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f95843593dfe1645-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.146 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.147 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.147 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.147 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.147 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.147 DEBUG:boto:Method: GET 2024-04-16T18:26:23.147 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.147 DEBUG:boto:Data: 2024-04-16T18:26:23.147 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.147 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.147 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.148 DEBUG:boto:Params: {} 2024-04-16T18:26:23.148 DEBUG:boto:Token: None 2024-04-16T18:26:23.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.152 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e980318a18817da-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.152 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.152 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.152 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.152 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.152 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:26:23.153 DEBUG:boto:Data: 2024-04-16T18:26:23.153 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.153 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.153 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.153 DEBUG:boto:Params: {} 2024-04-16T18:26:23.153 DEBUG:boto:Token: None 2024-04-16T18:26:23.153 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44 2024-04-16T18:26:23.153 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ycCoKogGDBQFUR8G2TYdLlj9GAA= 2024-04-16T18:26:23.153 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ycCoKogGDBQFUR8G2TYdLlj9GAA=', 'Content-Length': '0'} 2024-04-16T18:26:23.155 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b255a5a560ac7ee-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.155 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.156 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.156 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.156 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:26:23.156 DEBUG:boto:Data: 2024-04-16T18:26:23.156 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.156 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.156 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.156 DEBUG:boto:Params: {} 2024-04-16T18:26:23.156 DEBUG:boto:Token: None 2024-04-16T18:26:23.156 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44 2024-04-16T18:26:23.157 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ycCoKogGDBQFUR8G2TYdLlj9GAA= 2024-04-16T18:26:23.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ycCoKogGDBQFUR8G2TYdLlj9GAA=', 'Content-Length': '0'} 2024-04-16T18:26:23.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a196f4a0f4f72ff-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:26:23.159 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.159 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.159 DEBUG:boto:Method: GET 2024-04-16T18:26:23.159 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:26:23.159 DEBUG:boto:Data: 2024-04-16T18:26:23.159 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.159 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.159 DEBUG:boto:Params: {} 2024-04-16T18:26:23.160 DEBUG:boto:Token: None 2024-04-16T18:26:23.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44 2024-04-16T18:26:23.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0y6ck47XKU4Xf84zBqdQ6OUA0eo= 2024-04-16T18:26:23.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0y6ck47XKU4Xf84zBqdQ6OUA0eo=', 'Content-Length': '0'} 2024-04-16T18:26:23.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1767ed48f2abddb-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.202 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:26:23.202 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:26:23.203 DEBUG:boto:Method: GET 2024-04-16T18:26:23.203 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:26:23.203 DEBUG:boto:Data: 2024-04-16T18:26:23.203 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.203 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.203 DEBUG:boto:Params: {} 2024-04-16T18:26:23.203 DEBUG:boto:Token: None 2024-04-16T18:26:23.203 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj44 2024-04-16T18:26:23.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0y6ck47XKU4Xf84zBqdQ6OUA0eo= 2024-04-16T18:26:23.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0y6ck47XKU4Xf84zBqdQ6OUA0eo=', 'Content-Length': '0'} 2024-04-16T18:26:23.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dc116bd88743d81-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.206 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.206 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.206 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.206 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.206 DEBUG:boto:Method: GET 2024-04-16T18:26:23.206 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.206 DEBUG:boto:Data: 2024-04-16T18:26:23.206 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.206 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.207 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.207 DEBUG:boto:Params: {} 2024-04-16T18:26:23.207 DEBUG:boto:Token: None 2024-04-16T18:26:23.207 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.209 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000968c21d339d3679a-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.250 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.251 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.251 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.251 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.251 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.251 DEBUG:boto:Method: GET 2024-04-16T18:26:23.251 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:26:23.251 DEBUG:boto:Data: 2024-04-16T18:26:23.251 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.252 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.252 DEBUG:boto:Params: {} 2024-04-16T18:26:23.252 DEBUG:boto:Token: None 2024-04-16T18:26:23.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.256 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008378a8c3bf3f2568-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.256 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.256 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:26:23.256 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.256 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.257 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.257 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.257 DEBUG:boto:Method: GET 2024-04-16T18:26:23.257 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.257 DEBUG:boto:Data: 2024-04-16T18:26:23.257 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.257 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.257 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.257 DEBUG:boto:Params: {} 2024-04-16T18:26:23.257 DEBUG:boto:Token: None 2024-04-16T18:26:23.257 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s= 2024-04-16T18:26:23.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s=', 'Content-Length': '0'} 2024-04-16T18:26:23.260 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2e5529b0f92fd16-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.302 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.303 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.303 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.303 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.303 DEBUG:boto:Method: GET 2024-04-16T18:26:23.303 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.303 DEBUG:boto:Data: 2024-04-16T18:26:23.303 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.303 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.303 DEBUG:boto:Params: {} 2024-04-16T18:26:23.304 DEBUG:boto:Token: None 2024-04-16T18:26:23.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s= 2024-04-16T18:26:23.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s=', 'Content-Length': '0'} 2024-04-16T18:26:23.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebd96eb070821493-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.307 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.307 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.307 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.307 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.307 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.307 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.307 DEBUG:boto:Data: 2024-04-16T18:26:23.307 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.307 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.307 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.308 DEBUG:boto:Params: {} 2024-04-16T18:26:23.308 DEBUG:boto:Token: None 2024-04-16T18:26:23.308 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oiG5uojQn74pe6639tLKvKMyvqk= 2024-04-16T18:26:23.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oiG5uojQn74pe6639tLKvKMyvqk=', 'Content-Length': '0'} 2024-04-16T18:26:23.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a74afb333a3a6e87-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.310 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.310 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.310 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.311 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.311 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.311 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.311 DEBUG:boto:Data: 2024-04-16T18:26:23.311 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.311 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.311 DEBUG:boto:Params: {} 2024-04-16T18:26:23.311 DEBUG:boto:Token: None 2024-04-16T18:26:23.311 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oiG5uojQn74pe6639tLKvKMyvqk= 2024-04-16T18:26:23.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oiG5uojQn74pe6639tLKvKMyvqk=', 'Content-Length': '0'} 2024-04-16T18:26:23.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a032c470c9350b87-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:26:23.314 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.314 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.314 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.314 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.314 DEBUG:boto:Method: GET 2024-04-16T18:26:23.314 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.314 DEBUG:boto:Data: 2024-04-16T18:26:23.315 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.315 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.315 DEBUG:boto:Params: {} 2024-04-16T18:26:23.315 DEBUG:boto:Token: None 2024-04-16T18:26:23.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s= 2024-04-16T18:26:23.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s=', 'Content-Length': '0'} 2024-04-16T18:26:23.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004db97562deaeedf0-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.358 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.358 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.359 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.359 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.359 DEBUG:boto:Method: GET 2024-04-16T18:26:23.359 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.359 DEBUG:boto:Data: 2024-04-16T18:26:23.359 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.359 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.359 DEBUG:boto:Params: {} 2024-04-16T18:26:23.359 DEBUG:boto:Token: None 2024-04-16T18:26:23.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:26:23.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s= 2024-04-16T18:26:23.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DdKnSf3bE0AgHV5BfhhOSbAcg3s=', 'Content-Length': '0'} 2024-04-16T18:26:23.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004751797bceb89ff2-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.362 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.362 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.362 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.362 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.362 DEBUG:boto:Method: GET 2024-04-16T18:26:23.363 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.363 DEBUG:boto:Data: 2024-04-16T18:26:23.363 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.363 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.363 DEBUG:boto:Params: {} 2024-04-16T18:26:23.363 DEBUG:boto:Token: None 2024-04-16T18:26:23.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.366 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef82b6601f1f9f8f-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.406 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.407 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.407 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.407 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.407 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.407 DEBUG:boto:Method: GET 2024-04-16T18:26:23.407 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.407 DEBUG:boto:Data: 2024-04-16T18:26:23.407 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.407 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.408 DEBUG:boto:Params: {} 2024-04-16T18:26:23.408 DEBUG:boto:Token: None 2024-04-16T18:26:23.408 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.411 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000668feee6ccdcb392-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.412 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.412 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.412 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.412 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.412 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:26:23.412 DEBUG:boto:Data: 2024-04-16T18:26:23.412 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.412 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.412 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.413 DEBUG:boto:Params: {} 2024-04-16T18:26:23.413 DEBUG:boto:Token: None 2024-04-16T18:26:23.413 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46 2024-04-16T18:26:23.413 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S3zX1sz/pMeaC+eWjgPNT2zyLrM= 2024-04-16T18:26:23.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S3zX1sz/pMeaC+eWjgPNT2zyLrM=', 'Content-Length': '0'} 2024-04-16T18:26:23.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000847cdef732332bd6-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.415 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.415 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.415 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.415 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:26:23.416 DEBUG:boto:Data: 2024-04-16T18:26:23.416 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.416 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.416 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.416 DEBUG:boto:Params: {} 2024-04-16T18:26:23.416 DEBUG:boto:Token: None 2024-04-16T18:26:23.416 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46 2024-04-16T18:26:23.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S3zX1sz/pMeaC+eWjgPNT2zyLrM= 2024-04-16T18:26:23.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S3zX1sz/pMeaC+eWjgPNT2zyLrM=', 'Content-Length': '0'} 2024-04-16T18:26:23.418 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e9b8f5073500d00-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.418 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:26:23.419 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.419 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.419 DEBUG:boto:Method: GET 2024-04-16T18:26:23.419 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:26:23.419 DEBUG:boto:Data: 2024-04-16T18:26:23.419 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.419 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.419 DEBUG:boto:Params: {} 2024-04-16T18:26:23.420 DEBUG:boto:Token: None 2024-04-16T18:26:23.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46 2024-04-16T18:26:23.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DN5PAzuH6rOl1FkeoRcxf9lmp5w= 2024-04-16T18:26:23.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DN5PAzuH6rOl1FkeoRcxf9lmp5w=', 'Content-Length': '0'} 2024-04-16T18:26:23.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000acacc3d6522ceff-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.462 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:26:23.463 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:26:23.463 DEBUG:boto:Method: GET 2024-04-16T18:26:23.463 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:26:23.463 DEBUG:boto:Data: 2024-04-16T18:26:23.463 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.463 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.463 DEBUG:boto:Params: {} 2024-04-16T18:26:23.463 DEBUG:boto:Token: None 2024-04-16T18:26:23.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj46 2024-04-16T18:26:23.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DN5PAzuH6rOl1FkeoRcxf9lmp5w= 2024-04-16T18:26:23.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DN5PAzuH6rOl1FkeoRcxf9lmp5w=', 'Content-Length': '0'} 2024-04-16T18:26:23.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc82f6e4823620b2-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.466 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.466 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.466 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.466 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.466 DEBUG:boto:Method: GET 2024-04-16T18:26:23.467 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.467 DEBUG:boto:Data: 2024-04-16T18:26:23.467 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.467 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.467 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.467 DEBUG:boto:Params: {} 2024-04-16T18:26:23.467 DEBUG:boto:Token: None 2024-04-16T18:26:23.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.488 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d8ac8fa2ef655cdb-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.530 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.531 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.531 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.531 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.531 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.531 DEBUG:boto:Method: GET 2024-04-16T18:26:23.531 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:26:23.531 DEBUG:boto:Data: 2024-04-16T18:26:23.531 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.531 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.532 DEBUG:boto:Params: {} 2024-04-16T18:26:23.532 DEBUG:boto:Token: None 2024-04-16T18:26:23.532 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.535 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000650ab5f2b0355f7b-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.536 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.536 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:26:23.536 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.536 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.536 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.536 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.536 DEBUG:boto:Method: GET 2024-04-16T18:26:23.536 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.537 DEBUG:boto:Data: 2024-04-16T18:26:23.537 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.537 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.537 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.537 DEBUG:boto:Params: {} 2024-04-16T18:26:23.537 DEBUG:boto:Token: None 2024-04-16T18:26:23.537 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg= 2024-04-16T18:26:23.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg=', 'Content-Length': '0'} 2024-04-16T18:26:23.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000557e655164635c59-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.582 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.582 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.583 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.583 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.583 DEBUG:boto:Method: GET 2024-04-16T18:26:23.583 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.583 DEBUG:boto:Data: 2024-04-16T18:26:23.583 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.583 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.583 DEBUG:boto:Params: {} 2024-04-16T18:26:23.583 DEBUG:boto:Token: None 2024-04-16T18:26:23.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg= 2024-04-16T18:26:23.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg=', 'Content-Length': '0'} 2024-04-16T18:26:23.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046c3af429740ffe7-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.586 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.586 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.586 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.587 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.587 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.587 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.587 DEBUG:boto:Data: 2024-04-16T18:26:23.587 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.587 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.587 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.587 DEBUG:boto:Params: {} 2024-04-16T18:26:23.587 DEBUG:boto:Token: None 2024-04-16T18:26:23.587 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SNfmiO+gwc5jw5qkW4QS+AkA//M= 2024-04-16T18:26:23.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SNfmiO+gwc5jw5qkW4QS+AkA//M=', 'Content-Length': '0'} 2024-04-16T18:26:23.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9dd760fed710c0d-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.589 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.590 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.590 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.590 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.590 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.590 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.590 DEBUG:boto:Data: 2024-04-16T18:26:23.590 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.590 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.590 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.590 DEBUG:boto:Params: {} 2024-04-16T18:26:23.591 DEBUG:boto:Token: None 2024-04-16T18:26:23.591 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SNfmiO+gwc5jw5qkW4QS+AkA//M= 2024-04-16T18:26:23.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SNfmiO+gwc5jw5qkW4QS+AkA//M=', 'Content-Length': '0'} 2024-04-16T18:26:23.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000876f80ac35158c2e-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.593 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:26:23.593 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.593 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.593 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.594 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.594 DEBUG:boto:Method: GET 2024-04-16T18:26:23.594 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.594 DEBUG:boto:Data: 2024-04-16T18:26:23.594 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.594 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.594 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.594 DEBUG:boto:Params: {} 2024-04-16T18:26:23.594 DEBUG:boto:Token: None 2024-04-16T18:26:23.594 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.594 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg= 2024-04-16T18:26:23.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg=', 'Content-Length': '0'} 2024-04-16T18:26:23.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aed2250411b8a73-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.638 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.639 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.639 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.639 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.639 DEBUG:boto:Method: GET 2024-04-16T18:26:23.639 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.639 DEBUG:boto:Data: 2024-04-16T18:26:23.639 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.639 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.639 DEBUG:boto:Params: {} 2024-04-16T18:26:23.639 DEBUG:boto:Token: None 2024-04-16T18:26:23.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:26:23.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg= 2024-04-16T18:26:23.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iSLr68Nm9zoP2Sc/wxL7X5MOwwg=', 'Content-Length': '0'} 2024-04-16T18:26:23.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aac52d2c431f4f12-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.642 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.643 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.643 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.643 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.643 DEBUG:boto:Method: GET 2024-04-16T18:26:23.643 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.643 DEBUG:boto:Data: 2024-04-16T18:26:23.643 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.643 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.643 DEBUG:boto:Params: {} 2024-04-16T18:26:23.643 DEBUG:boto:Token: None 2024-04-16T18:26:23.644 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.646 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c722aa0c4d124c7-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.686 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.687 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.687 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.687 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.687 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.687 DEBUG:boto:Method: GET 2024-04-16T18:26:23.687 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.687 DEBUG:boto:Data: 2024-04-16T18:26:23.687 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.687 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.687 DEBUG:boto:Params: {} 2024-04-16T18:26:23.688 DEBUG:boto:Token: None 2024-04-16T18:26:23.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.691 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000180ee253121e3f51-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.691 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.692 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.692 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.692 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.692 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:26:23.692 DEBUG:boto:Data: 2024-04-16T18:26:23.692 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.692 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.692 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.692 DEBUG:boto:Params: {} 2024-04-16T18:26:23.693 DEBUG:boto:Token: None 2024-04-16T18:26:23.693 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51 2024-04-16T18:26:23.693 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/mS4/b4o2DaOGH3T7dby05Tt0dM= 2024-04-16T18:26:23.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/mS4/b4o2DaOGH3T7dby05Tt0dM=', 'Content-Length': '0'} 2024-04-16T18:26:23.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000333c03ca054a2e3d-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.695 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.695 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.695 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.696 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:26:23.696 DEBUG:boto:Data: 2024-04-16T18:26:23.696 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.696 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.696 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.696 DEBUG:boto:Params: {} 2024-04-16T18:26:23.696 DEBUG:boto:Token: None 2024-04-16T18:26:23.696 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51 2024-04-16T18:26:23.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/mS4/b4o2DaOGH3T7dby05Tt0dM= 2024-04-16T18:26:23.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/mS4/b4o2DaOGH3T7dby05Tt0dM=', 'Content-Length': '0'} 2024-04-16T18:26:23.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005452831b98f25589-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.699 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:26:23.699 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.699 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.699 DEBUG:boto:Method: GET 2024-04-16T18:26:23.699 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:26:23.699 DEBUG:boto:Data: 2024-04-16T18:26:23.699 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.700 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.700 DEBUG:boto:Params: {} 2024-04-16T18:26:23.700 DEBUG:boto:Token: None 2024-04-16T18:26:23.700 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51 2024-04-16T18:26:23.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GUwkLzSutd9IkEz+uGkJFDpsgbk= 2024-04-16T18:26:23.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GUwkLzSutd9IkEz+uGkJFDpsgbk=', 'Content-Length': '0'} 2024-04-16T18:26:23.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004629151ecdb004e0-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.742 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:26:23.742 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:26:23.743 DEBUG:boto:Method: GET 2024-04-16T18:26:23.743 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:26:23.743 DEBUG:boto:Data: 2024-04-16T18:26:23.743 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.743 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.743 DEBUG:boto:Params: {} 2024-04-16T18:26:23.743 DEBUG:boto:Token: None 2024-04-16T18:26:23.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj51 2024-04-16T18:26:23.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GUwkLzSutd9IkEz+uGkJFDpsgbk= 2024-04-16T18:26:23.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GUwkLzSutd9IkEz+uGkJFDpsgbk=', 'Content-Length': '0'} 2024-04-16T18:26:23.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ede360a89e33f05a-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.746 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.746 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.746 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.746 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.746 DEBUG:boto:Method: GET 2024-04-16T18:26:23.746 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.746 DEBUG:boto:Data: 2024-04-16T18:26:23.747 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.747 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.747 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.747 DEBUG:boto:Params: {} 2024-04-16T18:26:23.747 DEBUG:boto:Token: None 2024-04-16T18:26:23.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dba4264afd0ee476-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.790 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.791 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.791 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.791 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.791 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.791 DEBUG:boto:Method: GET 2024-04-16T18:26:23.791 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:26:23.791 DEBUG:boto:Data: 2024-04-16T18:26:23.791 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.791 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.791 DEBUG:boto:Params: {} 2024-04-16T18:26:23.791 DEBUG:boto:Token: None 2024-04-16T18:26:23.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.796 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1c00c6a67e17dec-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.796 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.796 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:26:23.796 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.796 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.796 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.796 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.797 DEBUG:boto:Method: GET 2024-04-16T18:26:23.797 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.797 DEBUG:boto:Data: 2024-04-16T18:26:23.797 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.797 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.797 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.797 DEBUG:boto:Params: {} 2024-04-16T18:26:23.797 DEBUG:boto:Token: None 2024-04-16T18:26:23.797 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.797 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ= 2024-04-16T18:26:23.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ=', 'Content-Length': '0'} 2024-04-16T18:26:23.799 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000824121d0fb240a90-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.842 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.843 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.843 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.843 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.843 DEBUG:boto:Method: GET 2024-04-16T18:26:23.843 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.843 DEBUG:boto:Data: 2024-04-16T18:26:23.843 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.843 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.843 DEBUG:boto:Params: {} 2024-04-16T18:26:23.843 DEBUG:boto:Token: None 2024-04-16T18:26:23.844 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ= 2024-04-16T18:26:23.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ=', 'Content-Length': '0'} 2024-04-16T18:26:23.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070f4956acf2aae09-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.846 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.846 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.846 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.846 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.847 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.847 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.847 DEBUG:boto:Data: 2024-04-16T18:26:23.847 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.847 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.847 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.847 DEBUG:boto:Params: {} 2024-04-16T18:26:23.847 DEBUG:boto:Token: None 2024-04-16T18:26:23.847 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ifVkBjMQwASZ6Cqqz9DgLOUz9Hg= 2024-04-16T18:26:23.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ifVkBjMQwASZ6Cqqz9DgLOUz9Hg=', 'Content-Length': '0'} 2024-04-16T18:26:23.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088763db973c61ba3-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.850 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.850 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.850 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.850 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.850 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.850 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.850 DEBUG:boto:Data: 2024-04-16T18:26:23.850 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.853 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.853 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.854 DEBUG:boto:Params: {} 2024-04-16T18:26:23.854 DEBUG:boto:Token: None 2024-04-16T18:26:23.854 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.854 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ifVkBjMQwASZ6Cqqz9DgLOUz9Hg= 2024-04-16T18:26:23.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ifVkBjMQwASZ6Cqqz9DgLOUz9Hg=', 'Content-Length': '0'} 2024-04-16T18:26:23.856 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcf5eda977b73e82-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.856 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:26:23.856 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.856 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.856 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.856 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.857 DEBUG:boto:Method: GET 2024-04-16T18:26:23.857 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.857 DEBUG:boto:Data: 2024-04-16T18:26:23.857 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.857 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.857 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.857 DEBUG:boto:Params: {} 2024-04-16T18:26:23.857 DEBUG:boto:Token: None 2024-04-16T18:26:23.857 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.858 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ= 2024-04-16T18:26:23.858 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ=', 'Content-Length': '0'} 2024-04-16T18:26:23.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e9fd47ac3efd49f-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.902 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.902 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.902 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.903 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.903 DEBUG:boto:Method: GET 2024-04-16T18:26:23.903 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.903 DEBUG:boto:Data: 2024-04-16T18:26:23.903 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.903 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.903 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.903 DEBUG:boto:Params: {} 2024-04-16T18:26:23.903 DEBUG:boto:Token: None 2024-04-16T18:26:23.903 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:26:23.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ= 2024-04-16T18:26:23.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d7Y5CM7yNkA0dDMqi838GFKByzQ=', 'Content-Length': '0'} 2024-04-16T18:26:23.906 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec1a895453f5b43e-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.906 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.907 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.907 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:23.907 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:23.907 DEBUG:boto:Method: GET 2024-04-16T18:26:23.907 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:26:23.907 DEBUG:boto:Data: 2024-04-16T18:26:23.907 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.907 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.907 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.907 DEBUG:boto:Params: {} 2024-04-16T18:26:23.907 DEBUG:boto:Token: None 2024-04-16T18:26:23.908 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.910 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007b0df01db3e88923-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.950 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.951 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:23.951 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:23.951 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:23.951 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:23.951 DEBUG:boto:Method: GET 2024-04-16T18:26:23.951 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:26:23.951 DEBUG:boto:Data: 2024-04-16T18:26:23.951 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.951 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.951 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.951 DEBUG:boto:Params: {} 2024-04-16T18:26:23.952 DEBUG:boto:Token: None 2024-04-16T18:26:23.952 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/ 2024-04-16T18:26:23.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU= 2024-04-16T18:26:23.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C+ShXzFKUp7bYy7PcirSc79WAhU=', 'Content-Length': '0'} 2024-04-16T18:26:23.955 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4f975e5d77441d7-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.956 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:23.956 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.956 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.956 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.956 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:26:23.956 DEBUG:boto:Data: 2024-04-16T18:26:23.956 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.956 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.957 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.957 DEBUG:boto:Params: {} 2024-04-16T18:26:23.957 DEBUG:boto:Token: None 2024-04-16T18:26:23.957 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55 2024-04-16T18:26:23.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NbG4LIy4V586xhVv8YPkeZ+q8ho= 2024-04-16T18:26:23.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NbG4LIy4V586xhVv8YPkeZ+q8ho=', 'Content-Length': '0'} 2024-04-16T18:26:23.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ddd4a507eff5f1c-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.959 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.959 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.959 DEBUG:boto:Method: HEAD 2024-04-16T18:26:23.960 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:26:23.960 DEBUG:boto:Data: 2024-04-16T18:26:23.960 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.960 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:23.960 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.960 DEBUG:boto:Params: {} 2024-04-16T18:26:23.960 DEBUG:boto:Token: None 2024-04-16T18:26:23.960 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55 2024-04-16T18:26:23.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NbG4LIy4V586xhVv8YPkeZ+q8ho= 2024-04-16T18:26:23.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NbG4LIy4V586xhVv8YPkeZ+q8ho=', 'Content-Length': '0'} 2024-04-16T18:26:23.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe191cf34d16cfa9-00661ec2cf-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:23.963 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:26:23.963 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:23.963 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:23.963 DEBUG:boto:Method: GET 2024-04-16T18:26:23.963 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:26:23.963 DEBUG:boto:Data: 2024-04-16T18:26:23.963 DEBUG:boto:Headers: {} 2024-04-16T18:26:23.963 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:23.963 DEBUG:boto:Port: 8000 2024-04-16T18:26:23.963 DEBUG:boto:Params: {} 2024-04-16T18:26:23.964 DEBUG:boto:Token: None 2024-04-16T18:26:23.964 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:23 GMT /cjqttm-52/obj55 2024-04-16T18:26:23.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9mL+L3ayC6k0tpmFSIBhNqtt3a4= 2024-04-16T18:26:23.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:23 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9mL+L3ayC6k0tpmFSIBhNqtt3a4=', 'Content-Length': '0'} 2024-04-16T18:26:23.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000428c2c1d771923e2-00661ec2cf-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:23 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.006 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:26:24.006 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:26:24.007 DEBUG:boto:Method: GET 2024-04-16T18:26:24.007 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:26:24.007 DEBUG:boto:Data: 2024-04-16T18:26:24.007 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.007 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.007 DEBUG:boto:Params: {} 2024-04-16T18:26:24.007 DEBUG:boto:Token: None 2024-04-16T18:26:24.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj55 2024-04-16T18:26:24.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:so0Sv3ivmstKJr1TUJAsjnPeMOU= 2024-04-16T18:26:24.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:so0Sv3ivmstKJr1TUJAsjnPeMOU=', 'Content-Length': '0'} 2024-04-16T18:26:24.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d2476247501305e-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.010 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.010 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.010 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:24.010 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:24.010 DEBUG:boto:Method: GET 2024-04-16T18:26:24.010 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:26:24.010 DEBUG:boto:Data: 2024-04-16T18:26:24.011 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.011 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.011 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.011 DEBUG:boto:Params: {} 2024-04-16T18:26:24.011 DEBUG:boto:Token: None 2024-04-16T18:26:24.011 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.013 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031cff442501b591d-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.054 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.055 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.055 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.055 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:24.055 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:26:24.055 DEBUG:boto:Method: GET 2024-04-16T18:26:24.055 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:26:24.055 DEBUG:boto:Data: 2024-04-16T18:26:24.055 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.055 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.055 DEBUG:boto:Params: {} 2024-04-16T18:26:24.056 DEBUG:boto:Token: None 2024-04-16T18:26:24.056 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.059 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d678172b72b0d1e-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.060 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.060 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:26:24.060 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.060 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.060 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.060 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.060 DEBUG:boto:Method: GET 2024-04-16T18:26:24.061 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.061 DEBUG:boto:Data: 2024-04-16T18:26:24.061 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.061 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.061 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.061 DEBUG:boto:Params: {} 2024-04-16T18:26:24.061 DEBUG:boto:Token: None 2024-04-16T18:26:24.061 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.061 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE= 2024-04-16T18:26:24.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE=', 'Content-Length': '0'} 2024-04-16T18:26:24.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006497c8cebfa6fdb-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.106 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.107 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.107 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.107 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.107 DEBUG:boto:Method: GET 2024-04-16T18:26:24.107 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.107 DEBUG:boto:Data: 2024-04-16T18:26:24.107 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.107 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.107 DEBUG:boto:Params: {} 2024-04-16T18:26:24.108 DEBUG:boto:Token: None 2024-04-16T18:26:24.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE= 2024-04-16T18:26:24.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE=', 'Content-Length': '0'} 2024-04-16T18:26:24.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ef4f8b30e1588db-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.111 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.111 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.111 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.111 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.111 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.111 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.111 DEBUG:boto:Data: 2024-04-16T18:26:24.111 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.111 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.111 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.111 DEBUG:boto:Params: {} 2024-04-16T18:26:24.112 DEBUG:boto:Token: None 2024-04-16T18:26:24.112 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4pHrXqCbOP48JfYg5yjGZvwMt20= 2024-04-16T18:26:24.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4pHrXqCbOP48JfYg5yjGZvwMt20=', 'Content-Length': '0'} 2024-04-16T18:26:24.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b6e951e24472b1c-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.114 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.115 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.115 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.115 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.115 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.115 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.115 DEBUG:boto:Data: 2024-04-16T18:26:24.115 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.115 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.115 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.115 DEBUG:boto:Params: {} 2024-04-16T18:26:24.116 DEBUG:boto:Token: None 2024-04-16T18:26:24.116 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4pHrXqCbOP48JfYg5yjGZvwMt20= 2024-04-16T18:26:24.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4pHrXqCbOP48JfYg5yjGZvwMt20=', 'Content-Length': '0'} 2024-04-16T18:26:24.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dabc3b5d8ccd7261-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.118 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:26:24.118 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.119 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.119 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.119 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.119 DEBUG:boto:Method: GET 2024-04-16T18:26:24.119 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.119 DEBUG:boto:Data: 2024-04-16T18:26:24.119 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.119 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.119 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.119 DEBUG:boto:Params: {} 2024-04-16T18:26:24.119 DEBUG:boto:Token: None 2024-04-16T18:26:24.120 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE= 2024-04-16T18:26:24.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE=', 'Content-Length': '0'} 2024-04-16T18:26:24.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072d036ef3c4e2dbe-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.162 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.162 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.163 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.163 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.163 DEBUG:boto:Method: GET 2024-04-16T18:26:24.163 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.163 DEBUG:boto:Data: 2024-04-16T18:26:24.163 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.163 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.163 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.163 DEBUG:boto:Params: {} 2024-04-16T18:26:24.163 DEBUG:boto:Token: None 2024-04-16T18:26:24.163 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:26:24.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE= 2024-04-16T18:26:24.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cz/Sehwf0MwTqpyi8LpNJuKOYLE=', 'Content-Length': '0'} 2024-04-16T18:26:24.166 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008753d00281adbe93-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.166 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.166 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.166 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.166 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.167 DEBUG:boto:Method: GET 2024-04-16T18:26:24.167 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.167 DEBUG:boto:Data: 2024-04-16T18:26:24.167 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.167 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.167 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.167 DEBUG:boto:Params: {} 2024-04-16T18:26:24.167 DEBUG:boto:Token: None 2024-04-16T18:26:24.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.170 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000432879b91ffe25f5-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.210 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.211 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.211 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.211 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.211 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.211 DEBUG:boto:Method: GET 2024-04-16T18:26:24.211 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.211 DEBUG:boto:Data: 2024-04-16T18:26:24.212 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.212 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.212 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.212 DEBUG:boto:Params: {} 2024-04-16T18:26:24.212 DEBUG:boto:Token: None 2024-04-16T18:26:24.212 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.216 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef5d8e6090ea510e-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.216 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.217 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.217 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.217 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.217 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:26:24.217 DEBUG:boto:Data: 2024-04-16T18:26:24.217 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.217 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.217 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.217 DEBUG:boto:Params: {} 2024-04-16T18:26:24.218 DEBUG:boto:Token: None 2024-04-16T18:26:24.218 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57 2024-04-16T18:26:24.218 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:avUhv4t+jLfS01vOeFoWS2OEU6I= 2024-04-16T18:26:24.218 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:avUhv4t+jLfS01vOeFoWS2OEU6I=', 'Content-Length': '0'} 2024-04-16T18:26:24.220 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e5933af6b3c2002-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.220 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.221 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.221 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.221 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:26:24.221 DEBUG:boto:Data: 2024-04-16T18:26:24.221 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.221 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.221 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.221 DEBUG:boto:Params: {} 2024-04-16T18:26:24.221 DEBUG:boto:Token: None 2024-04-16T18:26:24.221 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57 2024-04-16T18:26:24.222 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:avUhv4t+jLfS01vOeFoWS2OEU6I= 2024-04-16T18:26:24.222 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:avUhv4t+jLfS01vOeFoWS2OEU6I=', 'Content-Length': '0'} 2024-04-16T18:26:24.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad2d78b753ed8a5e-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.224 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:26:24.224 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.224 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.224 DEBUG:boto:Method: GET 2024-04-16T18:26:24.224 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:26:24.225 DEBUG:boto:Data: 2024-04-16T18:26:24.225 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.225 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.225 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.225 DEBUG:boto:Params: {} 2024-04-16T18:26:24.225 DEBUG:boto:Token: None 2024-04-16T18:26:24.225 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57 2024-04-16T18:26:24.225 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YgTMXKSPQ+nzdvc2mTAUZrKodvU= 2024-04-16T18:26:24.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YgTMXKSPQ+nzdvc2mTAUZrKodvU=', 'Content-Length': '0'} 2024-04-16T18:26:24.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000185506ad0afecf9d-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.270 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:26:24.270 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:26:24.271 DEBUG:boto:Method: GET 2024-04-16T18:26:24.271 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:26:24.271 DEBUG:boto:Data: 2024-04-16T18:26:24.271 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.271 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.271 DEBUG:boto:Params: {} 2024-04-16T18:26:24.271 DEBUG:boto:Token: None 2024-04-16T18:26:24.271 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj57 2024-04-16T18:26:24.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YgTMXKSPQ+nzdvc2mTAUZrKodvU= 2024-04-16T18:26:24.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YgTMXKSPQ+nzdvc2mTAUZrKodvU=', 'Content-Length': '0'} 2024-04-16T18:26:24.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009067e7dde9b1ffd6-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.274 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.274 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.274 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.274 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.275 DEBUG:boto:Method: GET 2024-04-16T18:26:24.275 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.275 DEBUG:boto:Data: 2024-04-16T18:26:24.275 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.275 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.275 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.275 DEBUG:boto:Params: {} 2024-04-16T18:26:24.275 DEBUG:boto:Token: None 2024-04-16T18:26:24.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.278 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2b17df5dac6c420-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.278 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.278 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.278 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.279 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.279 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.279 DEBUG:boto:Method: GET 2024-04-16T18:26:24.279 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:26:24.279 DEBUG:boto:Data: 2024-04-16T18:26:24.279 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.279 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.279 DEBUG:boto:Params: {} 2024-04-16T18:26:24.279 DEBUG:boto:Token: None 2024-04-16T18:26:24.279 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.283 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062599bdf48abd895-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.283 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.284 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:26:24.284 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.284 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.284 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.284 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.284 DEBUG:boto:Method: GET 2024-04-16T18:26:24.284 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.284 DEBUG:boto:Data: 2024-04-16T18:26:24.284 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.285 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.285 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.285 DEBUG:boto:Params: {} 2024-04-16T18:26:24.285 DEBUG:boto:Token: None 2024-04-16T18:26:24.285 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg= 2024-04-16T18:26:24.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg=', 'Content-Length': '0'} 2024-04-16T18:26:24.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000250f0a06687aa10a-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.330 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.330 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.330 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.331 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.331 DEBUG:boto:Method: GET 2024-04-16T18:26:24.331 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.331 DEBUG:boto:Data: 2024-04-16T18:26:24.331 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.331 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.331 DEBUG:boto:Params: {} 2024-04-16T18:26:24.331 DEBUG:boto:Token: None 2024-04-16T18:26:24.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg= 2024-04-16T18:26:24.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg=', 'Content-Length': '0'} 2024-04-16T18:26:24.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b62bf69927e89cec-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.333 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.334 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.334 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.334 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.334 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.334 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.334 DEBUG:boto:Data: 2024-04-16T18:26:24.334 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.334 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.334 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.334 DEBUG:boto:Params: {} 2024-04-16T18:26:24.334 DEBUG:boto:Token: None 2024-04-16T18:26:24.335 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7teXIUmX7mwmJJSJXQrp9slm2sY= 2024-04-16T18:26:24.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7teXIUmX7mwmJJSJXQrp9slm2sY=', 'Content-Length': '0'} 2024-04-16T18:26:24.337 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007653aa84047297c5-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.337 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.337 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.337 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.337 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.337 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.337 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.337 DEBUG:boto:Data: 2024-04-16T18:26:24.338 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.338 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.338 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.338 DEBUG:boto:Params: {} 2024-04-16T18:26:24.338 DEBUG:boto:Token: None 2024-04-16T18:26:24.338 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.338 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7teXIUmX7mwmJJSJXQrp9slm2sY= 2024-04-16T18:26:24.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7teXIUmX7mwmJJSJXQrp9slm2sY=', 'Content-Length': '0'} 2024-04-16T18:26:24.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d76e8aa456e9ae84-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:26:24.340 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.341 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.341 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.341 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.341 DEBUG:boto:Method: GET 2024-04-16T18:26:24.341 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.341 DEBUG:boto:Data: 2024-04-16T18:26:24.341 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.341 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.341 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.341 DEBUG:boto:Params: {} 2024-04-16T18:26:24.341 DEBUG:boto:Token: None 2024-04-16T18:26:24.342 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.342 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg= 2024-04-16T18:26:24.342 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg=', 'Content-Length': '0'} 2024-04-16T18:26:24.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2f58c8101e3f8c1-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.390 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.391 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.391 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.391 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.391 DEBUG:boto:Method: GET 2024-04-16T18:26:24.391 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.391 DEBUG:boto:Data: 2024-04-16T18:26:24.391 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.391 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.391 DEBUG:boto:Params: {} 2024-04-16T18:26:24.392 DEBUG:boto:Token: None 2024-04-16T18:26:24.392 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:26:24.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg= 2024-04-16T18:26:24.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9rWSGVf08/y8ugaOtSAoDblxxNg=', 'Content-Length': '0'} 2024-04-16T18:26:24.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef60c076b4780d6d-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.394 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.394 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.394 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.395 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.395 DEBUG:boto:Method: GET 2024-04-16T18:26:24.395 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.395 DEBUG:boto:Data: 2024-04-16T18:26:24.395 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.395 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.395 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.395 DEBUG:boto:Params: {} 2024-04-16T18:26:24.395 DEBUG:boto:Token: None 2024-04-16T18:26:24.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b6c39844eb7cb94-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.398 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.398 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.399 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.399 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.399 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.399 DEBUG:boto:Method: GET 2024-04-16T18:26:24.399 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.399 DEBUG:boto:Data: 2024-04-16T18:26:24.399 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.399 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.399 DEBUG:boto:Params: {} 2024-04-16T18:26:24.399 DEBUG:boto:Token: None 2024-04-16T18:26:24.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.403 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e97ef27174c5eaf3-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.403 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.403 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.404 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.404 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.404 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:26:24.404 DEBUG:boto:Data: 2024-04-16T18:26:24.404 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.404 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.404 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.404 DEBUG:boto:Params: {} 2024-04-16T18:26:24.404 DEBUG:boto:Token: None 2024-04-16T18:26:24.404 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58 2024-04-16T18:26:24.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oOEWz2zJJ/OvDQA+ncMPJdFy3n4= 2024-04-16T18:26:24.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oOEWz2zJJ/OvDQA+ncMPJdFy3n4=', 'Content-Length': '0'} 2024-04-16T18:26:24.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d7a9ee624c3fd25-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.406 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.407 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.407 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.407 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:26:24.407 DEBUG:boto:Data: 2024-04-16T18:26:24.407 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.407 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.407 DEBUG:boto:Params: {} 2024-04-16T18:26:24.407 DEBUG:boto:Token: None 2024-04-16T18:26:24.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58 2024-04-16T18:26:24.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oOEWz2zJJ/OvDQA+ncMPJdFy3n4= 2024-04-16T18:26:24.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oOEWz2zJJ/OvDQA+ncMPJdFy3n4=', 'Content-Length': '0'} 2024-04-16T18:26:24.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008bc1e05c9bdc8b2-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:26:24.410 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.410 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.410 DEBUG:boto:Method: GET 2024-04-16T18:26:24.410 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:26:24.410 DEBUG:boto:Data: 2024-04-16T18:26:24.410 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.410 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.410 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.410 DEBUG:boto:Params: {} 2024-04-16T18:26:24.410 DEBUG:boto:Token: None 2024-04-16T18:26:24.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58 2024-04-16T18:26:24.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:33FFAPeI09p4jNE1ngjKQHS4DvA= 2024-04-16T18:26:24.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:33FFAPeI09p4jNE1ngjKQHS4DvA=', 'Content-Length': '0'} 2024-04-16T18:26:24.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d42f8bf5aa69794-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.454 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:26:24.454 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:26:24.455 DEBUG:boto:Method: GET 2024-04-16T18:26:24.455 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:26:24.455 DEBUG:boto:Data: 2024-04-16T18:26:24.455 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.455 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.455 DEBUG:boto:Params: {} 2024-04-16T18:26:24.455 DEBUG:boto:Token: None 2024-04-16T18:26:24.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj58 2024-04-16T18:26:24.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:33FFAPeI09p4jNE1ngjKQHS4DvA= 2024-04-16T18:26:24.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:33FFAPeI09p4jNE1ngjKQHS4DvA=', 'Content-Length': '0'} 2024-04-16T18:26:24.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008f00606e8779dd7-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.458 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.458 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.458 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.458 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.458 DEBUG:boto:Method: GET 2024-04-16T18:26:24.458 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.458 DEBUG:boto:Data: 2024-04-16T18:26:24.459 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.459 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.459 DEBUG:boto:Params: {} 2024-04-16T18:26:24.459 DEBUG:boto:Token: None 2024-04-16T18:26:24.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079541b0f9c2ac752-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.462 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.462 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.465 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.465 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.465 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.465 DEBUG:boto:Method: GET 2024-04-16T18:26:24.465 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:26:24.465 DEBUG:boto:Data: 2024-04-16T18:26:24.465 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.465 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.465 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.466 DEBUG:boto:Params: {} 2024-04-16T18:26:24.466 DEBUG:boto:Token: None 2024-04-16T18:26:24.466 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.466 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c66ddd7d941c9acd-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.470 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.470 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:26:24.470 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.470 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.470 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.470 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.470 DEBUG:boto:Method: GET 2024-04-16T18:26:24.470 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.471 DEBUG:boto:Data: 2024-04-16T18:26:24.471 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.471 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.471 DEBUG:boto:Params: {} 2024-04-16T18:26:24.471 DEBUG:boto:Token: None 2024-04-16T18:26:24.471 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c= 2024-04-16T18:26:24.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c=', 'Content-Length': '0'} 2024-04-16T18:26:24.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065facf56d29ae359-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.514 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.515 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.515 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.515 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.515 DEBUG:boto:Method: GET 2024-04-16T18:26:24.515 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.515 DEBUG:boto:Data: 2024-04-16T18:26:24.515 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.515 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.515 DEBUG:boto:Params: {} 2024-04-16T18:26:24.515 DEBUG:boto:Token: None 2024-04-16T18:26:24.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c= 2024-04-16T18:26:24.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c=', 'Content-Length': '0'} 2024-04-16T18:26:24.518 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e35e5d4a8307d264-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.518 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.518 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.518 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.518 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.518 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.519 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.519 DEBUG:boto:Data: 2024-04-16T18:26:24.519 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.519 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.519 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.519 DEBUG:boto:Params: {} 2024-04-16T18:26:24.519 DEBUG:boto:Token: None 2024-04-16T18:26:24.519 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.519 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zwg9DVWiHOJgjQyWgF+NJmaffAE= 2024-04-16T18:26:24.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zwg9DVWiHOJgjQyWgF+NJmaffAE=', 'Content-Length': '0'} 2024-04-16T18:26:24.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c19271e3e4aab42-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.521 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.521 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.521 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.522 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.522 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.522 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.522 DEBUG:boto:Data: 2024-04-16T18:26:24.522 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.522 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.522 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.522 DEBUG:boto:Params: {} 2024-04-16T18:26:24.522 DEBUG:boto:Token: None 2024-04-16T18:26:24.522 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Zwg9DVWiHOJgjQyWgF+NJmaffAE= 2024-04-16T18:26:24.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Zwg9DVWiHOJgjQyWgF+NJmaffAE=', 'Content-Length': '0'} 2024-04-16T18:26:24.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022d84e63c2a43a4c-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:26:24.525 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.525 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.525 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.525 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.525 DEBUG:boto:Method: GET 2024-04-16T18:26:24.525 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.525 DEBUG:boto:Data: 2024-04-16T18:26:24.526 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.526 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.526 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.526 DEBUG:boto:Params: {} 2024-04-16T18:26:24.526 DEBUG:boto:Token: None 2024-04-16T18:26:24.526 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.526 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c= 2024-04-16T18:26:24.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c=', 'Content-Length': '0'} 2024-04-16T18:26:24.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009df96613c9562b5d-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.570 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.570 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.571 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.571 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.571 DEBUG:boto:Method: GET 2024-04-16T18:26:24.571 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.571 DEBUG:boto:Data: 2024-04-16T18:26:24.571 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.571 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.571 DEBUG:boto:Params: {} 2024-04-16T18:26:24.571 DEBUG:boto:Token: None 2024-04-16T18:26:24.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:26:24.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c= 2024-04-16T18:26:24.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wVBnMhNkq+9uX43OcuBOu3Nid5c=', 'Content-Length': '0'} 2024-04-16T18:26:24.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1dcdfa5704d19f8-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.574 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.574 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.574 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.574 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.574 DEBUG:boto:Method: GET 2024-04-16T18:26:24.574 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.574 DEBUG:boto:Data: 2024-04-16T18:26:24.574 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.575 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.575 DEBUG:boto:Params: {} 2024-04-16T18:26:24.575 DEBUG:boto:Token: None 2024-04-16T18:26:24.575 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.577 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c989346af77f4724-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.578 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.578 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.578 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.578 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.578 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.578 DEBUG:boto:Method: GET 2024-04-16T18:26:24.579 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.579 DEBUG:boto:Data: 2024-04-16T18:26:24.579 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.579 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.579 DEBUG:boto:Params: {} 2024-04-16T18:26:24.579 DEBUG:boto:Token: None 2024-04-16T18:26:24.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000073bb385541f3c82b-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.583 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.583 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.583 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.584 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.584 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:26:24.584 DEBUG:boto:Data: 2024-04-16T18:26:24.584 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.584 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.584 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.584 DEBUG:boto:Params: {} 2024-04-16T18:26:24.584 DEBUG:boto:Token: None 2024-04-16T18:26:24.584 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68 2024-04-16T18:26:24.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YkOx7zcR/+l3hfZ2Ke2EeH2aiw4= 2024-04-16T18:26:24.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkOx7zcR/+l3hfZ2Ke2EeH2aiw4=', 'Content-Length': '0'} 2024-04-16T18:26:24.586 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9296d3e98e34a45-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.586 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.587 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.587 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.587 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:26:24.587 DEBUG:boto:Data: 2024-04-16T18:26:24.587 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.587 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.587 DEBUG:boto:Params: {} 2024-04-16T18:26:24.587 DEBUG:boto:Token: None 2024-04-16T18:26:24.587 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68 2024-04-16T18:26:24.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YkOx7zcR/+l3hfZ2Ke2EeH2aiw4= 2024-04-16T18:26:24.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkOx7zcR/+l3hfZ2Ke2EeH2aiw4=', 'Content-Length': '0'} 2024-04-16T18:26:24.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d3c66d79c180b24-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.590 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:26:24.590 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.590 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.590 DEBUG:boto:Method: GET 2024-04-16T18:26:24.590 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:26:24.590 DEBUG:boto:Data: 2024-04-16T18:26:24.590 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.590 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.590 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.590 DEBUG:boto:Params: {} 2024-04-16T18:26:24.591 DEBUG:boto:Token: None 2024-04-16T18:26:24.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68 2024-04-16T18:26:24.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:njEPS1LeJQRMyRCW3MrJuUxFAbI= 2024-04-16T18:26:24.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:njEPS1LeJQRMyRCW3MrJuUxFAbI=', 'Content-Length': '0'} 2024-04-16T18:26:24.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001e3bc67153d6e5c-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.634 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:26:24.634 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:26:24.635 DEBUG:boto:Method: GET 2024-04-16T18:26:24.635 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:26:24.635 DEBUG:boto:Data: 2024-04-16T18:26:24.635 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.635 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.635 DEBUG:boto:Params: {} 2024-04-16T18:26:24.635 DEBUG:boto:Token: None 2024-04-16T18:26:24.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj68 2024-04-16T18:26:24.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:njEPS1LeJQRMyRCW3MrJuUxFAbI= 2024-04-16T18:26:24.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:njEPS1LeJQRMyRCW3MrJuUxFAbI=', 'Content-Length': '0'} 2024-04-16T18:26:24.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005b21d2bca69f890-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.638 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.638 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.638 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.638 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.638 DEBUG:boto:Method: GET 2024-04-16T18:26:24.638 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.638 DEBUG:boto:Data: 2024-04-16T18:26:24.638 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.639 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.639 DEBUG:boto:Params: {} 2024-04-16T18:26:24.639 DEBUG:boto:Token: None 2024-04-16T18:26:24.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ade5e92aeac926fe-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.642 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.642 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.642 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.642 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.643 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.643 DEBUG:boto:Method: GET 2024-04-16T18:26:24.643 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:26:24.643 DEBUG:boto:Data: 2024-04-16T18:26:24.643 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.643 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.643 DEBUG:boto:Params: {} 2024-04-16T18:26:24.643 DEBUG:boto:Token: None 2024-04-16T18:26:24.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.647 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000574d946def6291f1-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.647 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:26:24.648 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.648 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.648 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.648 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.648 DEBUG:boto:Method: GET 2024-04-16T18:26:24.648 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.648 DEBUG:boto:Data: 2024-04-16T18:26:24.649 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.649 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.649 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.649 DEBUG:boto:Params: {} 2024-04-16T18:26:24.649 DEBUG:boto:Token: None 2024-04-16T18:26:24.649 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.649 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU= 2024-04-16T18:26:24.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU=', 'Content-Length': '0'} 2024-04-16T18:26:24.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bae72cf052ee3f1-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.694 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.695 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.695 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.695 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.695 DEBUG:boto:Method: GET 2024-04-16T18:26:24.695 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.695 DEBUG:boto:Data: 2024-04-16T18:26:24.695 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.695 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.695 DEBUG:boto:Params: {} 2024-04-16T18:26:24.695 DEBUG:boto:Token: None 2024-04-16T18:26:24.696 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU= 2024-04-16T18:26:24.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU=', 'Content-Length': '0'} 2024-04-16T18:26:24.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000013ca8c7e5e72315-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.698 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.698 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.698 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.698 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.699 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.699 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.699 DEBUG:boto:Data: 2024-04-16T18:26:24.699 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.699 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.699 DEBUG:boto:Params: {} 2024-04-16T18:26:24.699 DEBUG:boto:Token: None 2024-04-16T18:26:24.699 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KN13h2w6un1+mBQuXfoU6cPpK2M= 2024-04-16T18:26:24.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KN13h2w6un1+mBQuXfoU6cPpK2M=', 'Content-Length': '0'} 2024-04-16T18:26:24.702 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082b4ba0e437543a8-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.702 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.702 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.702 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.702 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.702 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.702 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.702 DEBUG:boto:Data: 2024-04-16T18:26:24.702 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.703 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.703 DEBUG:boto:Params: {} 2024-04-16T18:26:24.703 DEBUG:boto:Token: None 2024-04-16T18:26:24.703 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KN13h2w6un1+mBQuXfoU6cPpK2M= 2024-04-16T18:26:24.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KN13h2w6un1+mBQuXfoU6cPpK2M=', 'Content-Length': '0'} 2024-04-16T18:26:24.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000556f095383dfcadd-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.705 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:26:24.706 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.706 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.706 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.706 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.706 DEBUG:boto:Method: GET 2024-04-16T18:26:24.706 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.706 DEBUG:boto:Data: 2024-04-16T18:26:24.706 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.706 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.706 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.706 DEBUG:boto:Params: {} 2024-04-16T18:26:24.707 DEBUG:boto:Token: None 2024-04-16T18:26:24.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU= 2024-04-16T18:26:24.707 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU=', 'Content-Length': '0'} 2024-04-16T18:26:24.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c3499c4f1e596b5-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.750 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.750 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.751 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.751 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.751 DEBUG:boto:Method: GET 2024-04-16T18:26:24.751 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.751 DEBUG:boto:Data: 2024-04-16T18:26:24.751 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.751 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.751 DEBUG:boto:Params: {} 2024-04-16T18:26:24.751 DEBUG:boto:Token: None 2024-04-16T18:26:24.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:26:24.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU= 2024-04-16T18:26:24.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cqOqMMVqLj5xMtwCpu8W4yRx8YU=', 'Content-Length': '0'} 2024-04-16T18:26:24.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac22a7197d8917a0-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.754 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.755 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.755 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.755 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.755 DEBUG:boto:Method: GET 2024-04-16T18:26:24.755 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.755 DEBUG:boto:Data: 2024-04-16T18:26:24.755 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.755 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.755 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.755 DEBUG:boto:Params: {} 2024-04-16T18:26:24.755 DEBUG:boto:Token: None 2024-04-16T18:26:24.756 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069b7bb4193f05a1d-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.758 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.759 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.759 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.759 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.759 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.759 DEBUG:boto:Method: GET 2024-04-16T18:26:24.759 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.759 DEBUG:boto:Data: 2024-04-16T18:26:24.759 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.760 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.760 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.760 DEBUG:boto:Params: {} 2024-04-16T18:26:24.760 DEBUG:boto:Token: None 2024-04-16T18:26:24.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000071acad68b8a8568c-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.764 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.764 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.765 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.765 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.765 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:26:24.765 DEBUG:boto:Data: 2024-04-16T18:26:24.765 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.765 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.765 DEBUG:boto:Params: {} 2024-04-16T18:26:24.765 DEBUG:boto:Token: None 2024-04-16T18:26:24.765 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69 2024-04-16T18:26:24.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZkS68R/EY3X0reEMujIWg892eEk= 2024-04-16T18:26:24.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZkS68R/EY3X0reEMujIWg892eEk=', 'Content-Length': '0'} 2024-04-16T18:26:24.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acd694fd4447469b-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.768 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.768 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.768 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.768 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:26:24.768 DEBUG:boto:Data: 2024-04-16T18:26:24.769 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.769 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.769 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.769 DEBUG:boto:Params: {} 2024-04-16T18:26:24.769 DEBUG:boto:Token: None 2024-04-16T18:26:24.769 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69 2024-04-16T18:26:24.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZkS68R/EY3X0reEMujIWg892eEk= 2024-04-16T18:26:24.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZkS68R/EY3X0reEMujIWg892eEk=', 'Content-Length': '0'} 2024-04-16T18:26:24.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ade6e42a6b82735a-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:26:24.772 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.772 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.772 DEBUG:boto:Method: GET 2024-04-16T18:26:24.772 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:26:24.772 DEBUG:boto:Data: 2024-04-16T18:26:24.772 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.772 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.772 DEBUG:boto:Params: {} 2024-04-16T18:26:24.772 DEBUG:boto:Token: None 2024-04-16T18:26:24.773 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69 2024-04-16T18:26:24.773 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HrHrSrVK3gYJN3EE7TCJIr5C72U= 2024-04-16T18:26:24.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HrHrSrVK3gYJN3EE7TCJIr5C72U=', 'Content-Length': '0'} 2024-04-16T18:26:24.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099e60dda35993a10-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.818 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:26:24.819 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:26:24.819 DEBUG:boto:Method: GET 2024-04-16T18:26:24.819 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:26:24.819 DEBUG:boto:Data: 2024-04-16T18:26:24.819 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.819 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.819 DEBUG:boto:Params: {} 2024-04-16T18:26:24.819 DEBUG:boto:Token: None 2024-04-16T18:26:24.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj69 2024-04-16T18:26:24.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HrHrSrVK3gYJN3EE7TCJIr5C72U= 2024-04-16T18:26:24.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HrHrSrVK3gYJN3EE7TCJIr5C72U=', 'Content-Length': '0'} 2024-04-16T18:26:24.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e77f66979c56ede2-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.822 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.822 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.822 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.822 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.822 DEBUG:boto:Method: GET 2024-04-16T18:26:24.822 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.822 DEBUG:boto:Data: 2024-04-16T18:26:24.822 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.822 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.823 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.823 DEBUG:boto:Params: {} 2024-04-16T18:26:24.823 DEBUG:boto:Token: None 2024-04-16T18:26:24.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088c1986b18f727bf-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.826 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.826 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.826 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.826 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.826 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.826 DEBUG:boto:Method: GET 2024-04-16T18:26:24.826 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:26:24.826 DEBUG:boto:Data: 2024-04-16T18:26:24.827 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.827 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.827 DEBUG:boto:Params: {} 2024-04-16T18:26:24.827 DEBUG:boto:Token: None 2024-04-16T18:26:24.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.831 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbaae8f4d4a01738-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.831 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:26:24.831 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.832 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.832 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.832 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.832 DEBUG:boto:Method: GET 2024-04-16T18:26:24.832 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.832 DEBUG:boto:Data: 2024-04-16T18:26:24.832 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.832 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.832 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.832 DEBUG:boto:Params: {} 2024-04-16T18:26:24.832 DEBUG:boto:Token: None 2024-04-16T18:26:24.833 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ= 2024-04-16T18:26:24.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ=', 'Content-Length': '0'} 2024-04-16T18:26:24.834 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039e274981d207c41-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.878 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.878 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.879 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.879 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.879 DEBUG:boto:Method: GET 2024-04-16T18:26:24.879 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.879 DEBUG:boto:Data: 2024-04-16T18:26:24.879 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.879 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.879 DEBUG:boto:Params: {} 2024-04-16T18:26:24.879 DEBUG:boto:Token: None 2024-04-16T18:26:24.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ= 2024-04-16T18:26:24.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ=', 'Content-Length': '0'} 2024-04-16T18:26:24.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020cd63551533da83-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.882 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.882 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.882 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.882 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.883 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.883 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.883 DEBUG:boto:Data: 2024-04-16T18:26:24.883 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.883 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.883 DEBUG:boto:Params: {} 2024-04-16T18:26:24.883 DEBUG:boto:Token: None 2024-04-16T18:26:24.883 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QSBmoPiu5HCcTxaXbeuyFQfUwBQ= 2024-04-16T18:26:24.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QSBmoPiu5HCcTxaXbeuyFQfUwBQ=', 'Content-Length': '0'} 2024-04-16T18:26:24.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006381f7eb4570993d-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.885 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.886 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.886 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.886 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.886 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.886 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.886 DEBUG:boto:Data: 2024-04-16T18:26:24.886 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.886 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.886 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.886 DEBUG:boto:Params: {} 2024-04-16T18:26:24.886 DEBUG:boto:Token: None 2024-04-16T18:26:24.887 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QSBmoPiu5HCcTxaXbeuyFQfUwBQ= 2024-04-16T18:26:24.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QSBmoPiu5HCcTxaXbeuyFQfUwBQ=', 'Content-Length': '0'} 2024-04-16T18:26:24.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ac4b6d9e66ec61f-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:26:24.889 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.889 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.889 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.889 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.889 DEBUG:boto:Method: GET 2024-04-16T18:26:24.889 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.889 DEBUG:boto:Data: 2024-04-16T18:26:24.890 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.890 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.890 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.890 DEBUG:boto:Params: {} 2024-04-16T18:26:24.890 DEBUG:boto:Token: None 2024-04-16T18:26:24.890 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.890 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ= 2024-04-16T18:26:24.890 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ=', 'Content-Length': '0'} 2024-04-16T18:26:24.892 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e00899e12945427-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.934 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.934 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.935 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.935 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.935 DEBUG:boto:Method: GET 2024-04-16T18:26:24.935 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.935 DEBUG:boto:Data: 2024-04-16T18:26:24.935 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.935 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.935 DEBUG:boto:Params: {} 2024-04-16T18:26:24.935 DEBUG:boto:Token: None 2024-04-16T18:26:24.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:26:24.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ= 2024-04-16T18:26:24.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nh+MbwyYwcZ8+aBczF4h3ypaaAQ=', 'Content-Length': '0'} 2024-04-16T18:26:24.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b6d21f6a5ef4f4f-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.937 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.938 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.938 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:24.938 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:24.938 DEBUG:boto:Method: GET 2024-04-16T18:26:24.938 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:26:24.938 DEBUG:boto:Data: 2024-04-16T18:26:24.938 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.938 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.938 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.938 DEBUG:boto:Params: {} 2024-04-16T18:26:24.939 DEBUG:boto:Token: None 2024-04-16T18:26:24.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ac80118166037b4-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.982 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.983 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:24.983 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:24.983 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:24.983 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:24.983 DEBUG:boto:Method: GET 2024-04-16T18:26:24.983 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:26:24.983 DEBUG:boto:Data: 2024-04-16T18:26:24.983 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.983 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.983 DEBUG:boto:Params: {} 2024-04-16T18:26:24.984 DEBUG:boto:Token: None 2024-04-16T18:26:24.984 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/ 2024-04-16T18:26:24.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA= 2024-04-16T18:26:24.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQwgdtga/sTFM4FnEWJa/Y7/wFA=', 'Content-Length': '0'} 2024-04-16T18:26:24.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068833e28dec0a64c-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.987 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:24.988 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.988 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.988 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.988 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:26:24.988 DEBUG:boto:Data: 2024-04-16T18:26:24.988 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.988 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.988 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.988 DEBUG:boto:Params: {} 2024-04-16T18:26:24.988 DEBUG:boto:Token: None 2024-04-16T18:26:24.988 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76 2024-04-16T18:26:24.989 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XC3h7jK2Cb0j1UamsQQH6z5QaCk= 2024-04-16T18:26:24.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XC3h7jK2Cb0j1UamsQQH6z5QaCk=', 'Content-Length': '0'} 2024-04-16T18:26:24.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaf813865db73b88-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.991 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.991 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.991 DEBUG:boto:Method: HEAD 2024-04-16T18:26:24.991 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:26:24.991 DEBUG:boto:Data: 2024-04-16T18:26:24.991 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:24.991 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.992 DEBUG:boto:Params: {} 2024-04-16T18:26:24.992 DEBUG:boto:Token: None 2024-04-16T18:26:24.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76 2024-04-16T18:26:24.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XC3h7jK2Cb0j1UamsQQH6z5QaCk= 2024-04-16T18:26:24.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XC3h7jK2Cb0j1UamsQQH6z5QaCk=', 'Content-Length': '0'} 2024-04-16T18:26:24.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f8bd6b70d4d0e16-00661ec2d0-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:24.994 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:26:24.994 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:24.994 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:24.994 DEBUG:boto:Method: GET 2024-04-16T18:26:24.994 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:26:24.995 DEBUG:boto:Data: 2024-04-16T18:26:24.995 DEBUG:boto:Headers: {} 2024-04-16T18:26:24.995 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:24.995 DEBUG:boto:Port: 8000 2024-04-16T18:26:24.995 DEBUG:boto:Params: {} 2024-04-16T18:26:24.995 DEBUG:boto:Token: None 2024-04-16T18:26:24.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:24 GMT /cjqttm-52/obj76 2024-04-16T18:26:24.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fhG1YcdEbbQl6Z1lAbKFTU6DteE= 2024-04-16T18:26:24.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:24 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fhG1YcdEbbQl6Z1lAbKFTU6DteE=', 'Content-Length': '0'} 2024-04-16T18:26:24.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065665385ac532557-00661ec2d0-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:24 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.038 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:26:25.038 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:26:25.039 DEBUG:boto:Method: GET 2024-04-16T18:26:25.039 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:26:25.039 DEBUG:boto:Data: 2024-04-16T18:26:25.039 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.039 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.039 DEBUG:boto:Params: {} 2024-04-16T18:26:25.039 DEBUG:boto:Token: None 2024-04-16T18:26:25.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj76 2024-04-16T18:26:25.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1A0lyr6crQFZd/iB6A56OZOtWl4= 2024-04-16T18:26:25.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1A0lyr6crQFZd/iB6A56OZOtWl4=', 'Content-Length': '0'} 2024-04-16T18:26:25.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d08c2243fe0e1a0f-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.042 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.042 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.042 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:25.042 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:25.042 DEBUG:boto:Method: GET 2024-04-16T18:26:25.043 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:26:25.043 DEBUG:boto:Data: 2024-04-16T18:26:25.043 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.043 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.043 DEBUG:boto:Params: {} 2024-04-16T18:26:25.043 DEBUG:boto:Token: None 2024-04-16T18:26:25.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a0ce2dabfd01116-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.086 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.087 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.087 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.087 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:25.087 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:26:25.087 DEBUG:boto:Method: GET 2024-04-16T18:26:25.087 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:26:25.087 DEBUG:boto:Data: 2024-04-16T18:26:25.087 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.087 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.088 DEBUG:boto:Params: {} 2024-04-16T18:26:25.088 DEBUG:boto:Token: None 2024-04-16T18:26:25.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.091 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008964c4dfc7e19f93-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.092 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:26:25.092 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.092 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.092 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.092 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.092 DEBUG:boto:Method: GET 2024-04-16T18:26:25.092 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.093 DEBUG:boto:Data: 2024-04-16T18:26:25.093 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.093 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.093 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.093 DEBUG:boto:Params: {} 2024-04-16T18:26:25.093 DEBUG:boto:Token: None 2024-04-16T18:26:25.093 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.093 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI= 2024-04-16T18:26:25.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI=', 'Content-Length': '0'} 2024-04-16T18:26:25.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ef666340987d0ae-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.138 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.139 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.139 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.139 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.139 DEBUG:boto:Method: GET 2024-04-16T18:26:25.139 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.139 DEBUG:boto:Data: 2024-04-16T18:26:25.139 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.139 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.139 DEBUG:boto:Params: {} 2024-04-16T18:26:25.139 DEBUG:boto:Token: None 2024-04-16T18:26:25.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI= 2024-04-16T18:26:25.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI=', 'Content-Length': '0'} 2024-04-16T18:26:25.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f3a3f15351f52ee-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.142 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.142 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.142 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.142 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.142 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.142 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.142 DEBUG:boto:Data: 2024-04-16T18:26:25.142 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.143 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.143 DEBUG:boto:Params: {} 2024-04-16T18:26:25.143 DEBUG:boto:Token: None 2024-04-16T18:26:25.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w1bntEAgAhHMmVYBc/iWRw5Riq0= 2024-04-16T18:26:25.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w1bntEAgAhHMmVYBc/iWRw5Riq0=', 'Content-Length': '0'} 2024-04-16T18:26:25.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aff7980790608a5a-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.145 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.145 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.145 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.145 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.145 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.145 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.145 DEBUG:boto:Data: 2024-04-16T18:26:25.145 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.146 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.146 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.146 DEBUG:boto:Params: {} 2024-04-16T18:26:25.146 DEBUG:boto:Token: None 2024-04-16T18:26:25.146 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.146 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w1bntEAgAhHMmVYBc/iWRw5Riq0= 2024-04-16T18:26:25.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w1bntEAgAhHMmVYBc/iWRw5Riq0=', 'Content-Length': '0'} 2024-04-16T18:26:25.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fec51f6e04143742-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:26:25.148 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.148 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.149 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.149 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.149 DEBUG:boto:Method: GET 2024-04-16T18:26:25.149 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.149 DEBUG:boto:Data: 2024-04-16T18:26:25.149 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.149 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.149 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.149 DEBUG:boto:Params: {} 2024-04-16T18:26:25.149 DEBUG:boto:Token: None 2024-04-16T18:26:25.150 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.150 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI= 2024-04-16T18:26:25.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI=', 'Content-Length': '0'} 2024-04-16T18:26:25.151 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aeddef261d8a538a-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.194 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.194 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.195 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.195 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.195 DEBUG:boto:Method: GET 2024-04-16T18:26:25.195 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.195 DEBUG:boto:Data: 2024-04-16T18:26:25.195 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.195 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.195 DEBUG:boto:Params: {} 2024-04-16T18:26:25.196 DEBUG:boto:Token: None 2024-04-16T18:26:25.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:26:25.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI= 2024-04-16T18:26:25.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CW+Ib7WjvCPGtsDydhJ3v8Zi5QI=', 'Content-Length': '0'} 2024-04-16T18:26:25.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd2ce858e9e42815-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.198 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.198 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.198 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.199 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.199 DEBUG:boto:Method: GET 2024-04-16T18:26:25.199 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.199 DEBUG:boto:Data: 2024-04-16T18:26:25.199 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.199 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.199 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.199 DEBUG:boto:Params: {} 2024-04-16T18:26:25.199 DEBUG:boto:Token: None 2024-04-16T18:26:25.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fdd02d44e57fe72-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.242 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.243 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.243 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.243 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.243 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.243 DEBUG:boto:Method: GET 2024-04-16T18:26:25.243 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.243 DEBUG:boto:Data: 2024-04-16T18:26:25.243 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.244 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.244 DEBUG:boto:Params: {} 2024-04-16T18:26:25.244 DEBUG:boto:Token: None 2024-04-16T18:26:25.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.248 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007003f5aee7df4cba-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.248 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.248 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.248 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.249 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.249 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:26:25.249 DEBUG:boto:Data: 2024-04-16T18:26:25.249 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.249 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.249 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.249 DEBUG:boto:Params: {} 2024-04-16T18:26:25.249 DEBUG:boto:Token: None 2024-04-16T18:26:25.249 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85 2024-04-16T18:26:25.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lN46dkVa7lPb4/fHZIyrcddBUhk= 2024-04-16T18:26:25.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lN46dkVa7lPb4/fHZIyrcddBUhk=', 'Content-Length': '0'} 2024-04-16T18:26:25.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000103de688dedd10e9-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.252 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.252 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.252 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.252 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:26:25.252 DEBUG:boto:Data: 2024-04-16T18:26:25.252 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.252 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.253 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.253 DEBUG:boto:Params: {} 2024-04-16T18:26:25.253 DEBUG:boto:Token: None 2024-04-16T18:26:25.253 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85 2024-04-16T18:26:25.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lN46dkVa7lPb4/fHZIyrcddBUhk= 2024-04-16T18:26:25.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lN46dkVa7lPb4/fHZIyrcddBUhk=', 'Content-Length': '0'} 2024-04-16T18:26:25.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072a2a2435c0d2fd7-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.255 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:26:25.255 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.255 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.255 DEBUG:boto:Method: GET 2024-04-16T18:26:25.255 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:26:25.255 DEBUG:boto:Data: 2024-04-16T18:26:25.255 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.256 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.256 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.256 DEBUG:boto:Params: {} 2024-04-16T18:26:25.256 DEBUG:boto:Token: None 2024-04-16T18:26:25.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85 2024-04-16T18:26:25.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G6kcLD0dcwLdG/Ok3nadiHQ+hOw= 2024-04-16T18:26:25.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G6kcLD0dcwLdG/Ok3nadiHQ+hOw=', 'Content-Length': '0'} 2024-04-16T18:26:25.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b67102a191062f82-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.298 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:26:25.299 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:26:25.299 DEBUG:boto:Method: GET 2024-04-16T18:26:25.299 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:26:25.299 DEBUG:boto:Data: 2024-04-16T18:26:25.299 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.299 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.299 DEBUG:boto:Params: {} 2024-04-16T18:26:25.299 DEBUG:boto:Token: None 2024-04-16T18:26:25.300 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj85 2024-04-16T18:26:25.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G6kcLD0dcwLdG/Ok3nadiHQ+hOw= 2024-04-16T18:26:25.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G6kcLD0dcwLdG/Ok3nadiHQ+hOw=', 'Content-Length': '0'} 2024-04-16T18:26:25.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000042d05e4bf07e77b-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.302 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.302 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.302 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.302 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.302 DEBUG:boto:Method: GET 2024-04-16T18:26:25.303 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.303 DEBUG:boto:Data: 2024-04-16T18:26:25.303 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.303 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.303 DEBUG:boto:Params: {} 2024-04-16T18:26:25.303 DEBUG:boto:Token: None 2024-04-16T18:26:25.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac5000a9bf79ab6e-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.346 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.347 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.347 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.347 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.347 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.347 DEBUG:boto:Method: GET 2024-04-16T18:26:25.347 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:26:25.347 DEBUG:boto:Data: 2024-04-16T18:26:25.347 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.347 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.347 DEBUG:boto:Params: {} 2024-04-16T18:26:25.348 DEBUG:boto:Token: None 2024-04-16T18:26:25.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.351 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011f154bfae20d1e8-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.352 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.352 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:26:25.352 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.352 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.352 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.352 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.352 DEBUG:boto:Method: GET 2024-04-16T18:26:25.353 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.353 DEBUG:boto:Data: 2024-04-16T18:26:25.353 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.353 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.353 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.353 DEBUG:boto:Params: {} 2024-04-16T18:26:25.353 DEBUG:boto:Token: None 2024-04-16T18:26:25.353 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0= 2024-04-16T18:26:25.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0=', 'Content-Length': '0'} 2024-04-16T18:26:25.356 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e53d5711a74cdcd5-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.398 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.398 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.399 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.399 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.399 DEBUG:boto:Method: GET 2024-04-16T18:26:25.399 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.399 DEBUG:boto:Data: 2024-04-16T18:26:25.399 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.399 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.399 DEBUG:boto:Params: {} 2024-04-16T18:26:25.399 DEBUG:boto:Token: None 2024-04-16T18:26:25.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0= 2024-04-16T18:26:25.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0=', 'Content-Length': '0'} 2024-04-16T18:26:25.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070da1abababae568-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.402 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.402 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.402 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.402 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.402 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.402 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.402 DEBUG:boto:Data: 2024-04-16T18:26:25.402 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.402 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.402 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.403 DEBUG:boto:Params: {} 2024-04-16T18:26:25.403 DEBUG:boto:Token: None 2024-04-16T18:26:25.403 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z635g3vC2nQpPVGaWK/QeZv+il0= 2024-04-16T18:26:25.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z635g3vC2nQpPVGaWK/QeZv+il0=', 'Content-Length': '0'} 2024-04-16T18:26:25.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3f6c48ecbedcab7-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.405 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.405 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.405 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.406 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.406 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.406 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.406 DEBUG:boto:Data: 2024-04-16T18:26:25.406 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.406 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.406 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.406 DEBUG:boto:Params: {} 2024-04-16T18:26:25.406 DEBUG:boto:Token: None 2024-04-16T18:26:25.406 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z635g3vC2nQpPVGaWK/QeZv+il0= 2024-04-16T18:26:25.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z635g3vC2nQpPVGaWK/QeZv+il0=', 'Content-Length': '0'} 2024-04-16T18:26:25.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ec90276425fc82b-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:26:25.409 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.409 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.409 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.409 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.409 DEBUG:boto:Method: GET 2024-04-16T18:26:25.410 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.410 DEBUG:boto:Data: 2024-04-16T18:26:25.410 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.410 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.410 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.410 DEBUG:boto:Params: {} 2024-04-16T18:26:25.410 DEBUG:boto:Token: None 2024-04-16T18:26:25.410 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.410 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0= 2024-04-16T18:26:25.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0=', 'Content-Length': '0'} 2024-04-16T18:26:25.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f856d789b969bcc2-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.454 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.454 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.454 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.455 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.455 DEBUG:boto:Method: GET 2024-04-16T18:26:25.455 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.455 DEBUG:boto:Data: 2024-04-16T18:26:25.455 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.455 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.455 DEBUG:boto:Params: {} 2024-04-16T18:26:25.455 DEBUG:boto:Token: None 2024-04-16T18:26:25.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:26:25.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0= 2024-04-16T18:26:25.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K5Bqsn8vxGNV4pcHNpgoP92dhi0=', 'Content-Length': '0'} 2024-04-16T18:26:25.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fe1ec31332bab1a-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.458 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.458 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.458 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.458 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.458 DEBUG:boto:Method: GET 2024-04-16T18:26:25.458 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.458 DEBUG:boto:Data: 2024-04-16T18:26:25.458 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.458 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.458 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.459 DEBUG:boto:Params: {} 2024-04-16T18:26:25.459 DEBUG:boto:Token: None 2024-04-16T18:26:25.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009528150ca05ddfa6-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.502 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.503 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.503 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.503 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.503 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.503 DEBUG:boto:Method: GET 2024-04-16T18:26:25.503 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.503 DEBUG:boto:Data: 2024-04-16T18:26:25.503 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.503 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.504 DEBUG:boto:Params: {} 2024-04-16T18:26:25.504 DEBUG:boto:Token: None 2024-04-16T18:26:25.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.507 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005edf42bc2bb127e6-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.507 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.508 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.508 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.508 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.508 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:26:25.508 DEBUG:boto:Data: 2024-04-16T18:26:25.508 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.508 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.508 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.508 DEBUG:boto:Params: {} 2024-04-16T18:26:25.509 DEBUG:boto:Token: None 2024-04-16T18:26:25.509 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87 2024-04-16T18:26:25.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6cWD63ipuluuCq34s4qszkCKeFg= 2024-04-16T18:26:25.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6cWD63ipuluuCq34s4qszkCKeFg=', 'Content-Length': '0'} 2024-04-16T18:26:25.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000998266b49a42b853-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.511 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.511 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.511 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.511 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:26:25.511 DEBUG:boto:Data: 2024-04-16T18:26:25.511 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.511 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.512 DEBUG:boto:Params: {} 2024-04-16T18:26:25.512 DEBUG:boto:Token: None 2024-04-16T18:26:25.512 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87 2024-04-16T18:26:25.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6cWD63ipuluuCq34s4qszkCKeFg= 2024-04-16T18:26:25.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6cWD63ipuluuCq34s4qszkCKeFg=', 'Content-Length': '0'} 2024-04-16T18:26:25.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4dc62b80e3c7e7c-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:26:25.514 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.514 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.514 DEBUG:boto:Method: GET 2024-04-16T18:26:25.514 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:26:25.514 DEBUG:boto:Data: 2024-04-16T18:26:25.514 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.514 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.515 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.515 DEBUG:boto:Params: {} 2024-04-16T18:26:25.515 DEBUG:boto:Token: None 2024-04-16T18:26:25.515 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87 2024-04-16T18:26:25.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T91aTUPlfmj8Ep5/S/KtwBUG5EU= 2024-04-16T18:26:25.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T91aTUPlfmj8Ep5/S/KtwBUG5EU=', 'Content-Length': '0'} 2024-04-16T18:26:25.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae410857a613efb8-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.558 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:26:25.558 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:26:25.559 DEBUG:boto:Method: GET 2024-04-16T18:26:25.559 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:26:25.559 DEBUG:boto:Data: 2024-04-16T18:26:25.559 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.559 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.559 DEBUG:boto:Params: {} 2024-04-16T18:26:25.559 DEBUG:boto:Token: None 2024-04-16T18:26:25.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj87 2024-04-16T18:26:25.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T91aTUPlfmj8Ep5/S/KtwBUG5EU= 2024-04-16T18:26:25.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T91aTUPlfmj8Ep5/S/KtwBUG5EU=', 'Content-Length': '0'} 2024-04-16T18:26:25.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000798c6c56fe099b11-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.562 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.562 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.562 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.562 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.562 DEBUG:boto:Method: GET 2024-04-16T18:26:25.562 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.562 DEBUG:boto:Data: 2024-04-16T18:26:25.562 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.563 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.563 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.563 DEBUG:boto:Params: {} 2024-04-16T18:26:25.563 DEBUG:boto:Token: None 2024-04-16T18:26:25.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.565 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062f77f19c19677a0-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.606 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.607 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.607 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.607 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.607 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.607 DEBUG:boto:Method: GET 2024-04-16T18:26:25.607 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:26:25.607 DEBUG:boto:Data: 2024-04-16T18:26:25.607 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.607 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.608 DEBUG:boto:Params: {} 2024-04-16T18:26:25.608 DEBUG:boto:Token: None 2024-04-16T18:26:25.608 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.611 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b09ebcfbc89a5733-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.611 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:26:25.612 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.612 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.612 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.612 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.612 DEBUG:boto:Method: GET 2024-04-16T18:26:25.612 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.612 DEBUG:boto:Data: 2024-04-16T18:26:25.613 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.613 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.613 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.613 DEBUG:boto:Params: {} 2024-04-16T18:26:25.613 DEBUG:boto:Token: None 2024-04-16T18:26:25.613 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.613 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28= 2024-04-16T18:26:25.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28=', 'Content-Length': '0'} 2024-04-16T18:26:25.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7d3e3f410e88a47-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.658 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.658 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.659 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.659 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.659 DEBUG:boto:Method: GET 2024-04-16T18:26:25.659 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.659 DEBUG:boto:Data: 2024-04-16T18:26:25.659 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.659 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.659 DEBUG:boto:Params: {} 2024-04-16T18:26:25.659 DEBUG:boto:Token: None 2024-04-16T18:26:25.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28= 2024-04-16T18:26:25.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28=', 'Content-Length': '0'} 2024-04-16T18:26:25.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6975c65dc0c0207-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.662 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.662 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.662 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.663 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.663 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.663 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.663 DEBUG:boto:Data: 2024-04-16T18:26:25.663 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.663 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.663 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.663 DEBUG:boto:Params: {} 2024-04-16T18:26:25.663 DEBUG:boto:Token: None 2024-04-16T18:26:25.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iBi0BJ5r0myY2dgwY37sPuHl3FQ= 2024-04-16T18:26:25.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iBi0BJ5r0myY2dgwY37sPuHl3FQ=', 'Content-Length': '0'} 2024-04-16T18:26:25.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005edbd271e83c92d9-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.666 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.666 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.666 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.666 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.666 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.666 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.666 DEBUG:boto:Data: 2024-04-16T18:26:25.667 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.667 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.667 DEBUG:boto:Params: {} 2024-04-16T18:26:25.667 DEBUG:boto:Token: None 2024-04-16T18:26:25.667 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iBi0BJ5r0myY2dgwY37sPuHl3FQ= 2024-04-16T18:26:25.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iBi0BJ5r0myY2dgwY37sPuHl3FQ=', 'Content-Length': '0'} 2024-04-16T18:26:25.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a842d54cd67f66b-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.670 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:26:25.670 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.670 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.670 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.670 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.670 DEBUG:boto:Method: GET 2024-04-16T18:26:25.671 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.671 DEBUG:boto:Data: 2024-04-16T18:26:25.671 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.671 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.671 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.671 DEBUG:boto:Params: {} 2024-04-16T18:26:25.671 DEBUG:boto:Token: None 2024-04-16T18:26:25.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28= 2024-04-16T18:26:25.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28=', 'Content-Length': '0'} 2024-04-16T18:26:25.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b101d52c9aa0271d-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.714 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.714 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.714 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.715 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.715 DEBUG:boto:Method: GET 2024-04-16T18:26:25.715 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.715 DEBUG:boto:Data: 2024-04-16T18:26:25.715 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.715 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.715 DEBUG:boto:Params: {} 2024-04-16T18:26:25.715 DEBUG:boto:Token: None 2024-04-16T18:26:25.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:26:25.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28= 2024-04-16T18:26:25.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/m3irJDYNxKV0MTVh0xpW612j28=', 'Content-Length': '0'} 2024-04-16T18:26:25.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bae446d8d662af8-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.718 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.718 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.718 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.718 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.718 DEBUG:boto:Method: GET 2024-04-16T18:26:25.718 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.718 DEBUG:boto:Data: 2024-04-16T18:26:25.719 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.719 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.719 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.719 DEBUG:boto:Params: {} 2024-04-16T18:26:25.719 DEBUG:boto:Token: None 2024-04-16T18:26:25.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.722 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d76033127bf4a841-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.766 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.767 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.767 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.767 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.767 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.767 DEBUG:boto:Method: GET 2024-04-16T18:26:25.767 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.767 DEBUG:boto:Data: 2024-04-16T18:26:25.767 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.767 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.768 DEBUG:boto:Params: {} 2024-04-16T18:26:25.768 DEBUG:boto:Token: None 2024-04-16T18:26:25.768 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.771 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000081cd1521771c1ac-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.772 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.772 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.772 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.772 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.772 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:26:25.772 DEBUG:boto:Data: 2024-04-16T18:26:25.772 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.772 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.772 DEBUG:boto:Params: {} 2024-04-16T18:26:25.773 DEBUG:boto:Token: None 2024-04-16T18:26:25.773 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92 2024-04-16T18:26:25.773 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KGsKurrHY/QwGoNtb63SxxoWovk= 2024-04-16T18:26:25.773 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KGsKurrHY/QwGoNtb63SxxoWovk=', 'Content-Length': '0'} 2024-04-16T18:26:25.775 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a559b82f35320161-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.775 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.775 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.775 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.775 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:26:25.775 DEBUG:boto:Data: 2024-04-16T18:26:25.775 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.776 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.776 DEBUG:boto:Params: {} 2024-04-16T18:26:25.776 DEBUG:boto:Token: None 2024-04-16T18:26:25.776 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92 2024-04-16T18:26:25.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KGsKurrHY/QwGoNtb63SxxoWovk= 2024-04-16T18:26:25.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KGsKurrHY/QwGoNtb63SxxoWovk=', 'Content-Length': '0'} 2024-04-16T18:26:25.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048851a5692f5317c-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.778 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:26:25.778 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.778 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.778 DEBUG:boto:Method: GET 2024-04-16T18:26:25.778 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:26:25.778 DEBUG:boto:Data: 2024-04-16T18:26:25.778 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.779 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.779 DEBUG:boto:Params: {} 2024-04-16T18:26:25.779 DEBUG:boto:Token: None 2024-04-16T18:26:25.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92 2024-04-16T18:26:25.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O2d26+S9HBGtm3Ol7chfFsuCy7w= 2024-04-16T18:26:25.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O2d26+S9HBGtm3Ol7chfFsuCy7w=', 'Content-Length': '0'} 2024-04-16T18:26:25.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000d2700fec2c9578-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.822 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:26:25.822 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:26:25.823 DEBUG:boto:Method: GET 2024-04-16T18:26:25.823 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:26:25.823 DEBUG:boto:Data: 2024-04-16T18:26:25.823 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.823 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.823 DEBUG:boto:Params: {} 2024-04-16T18:26:25.823 DEBUG:boto:Token: None 2024-04-16T18:26:25.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj92 2024-04-16T18:26:25.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O2d26+S9HBGtm3Ol7chfFsuCy7w= 2024-04-16T18:26:25.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O2d26+S9HBGtm3Ol7chfFsuCy7w=', 'Content-Length': '0'} 2024-04-16T18:26:25.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d9f7e17eda28409-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.826 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.826 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.826 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.826 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.826 DEBUG:boto:Method: GET 2024-04-16T18:26:25.826 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.826 DEBUG:boto:Data: 2024-04-16T18:26:25.826 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.827 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.827 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.827 DEBUG:boto:Params: {} 2024-04-16T18:26:25.827 DEBUG:boto:Token: None 2024-04-16T18:26:25.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.829 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f7c7758bb0d26ec3-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.870 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.871 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.871 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.871 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.871 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.871 DEBUG:boto:Method: GET 2024-04-16T18:26:25.871 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:26:25.871 DEBUG:boto:Data: 2024-04-16T18:26:25.871 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.871 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.871 DEBUG:boto:Params: {} 2024-04-16T18:26:25.872 DEBUG:boto:Token: None 2024-04-16T18:26:25.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.875 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038ffc416db473169-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.876 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:25.876 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:26:25.876 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:25.876 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:25.876 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.876 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.876 DEBUG:boto:Method: GET 2024-04-16T18:26:25.876 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.876 DEBUG:boto:Data: 2024-04-16T18:26:25.877 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.877 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.877 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.877 DEBUG:boto:Params: {} 2024-04-16T18:26:25.877 DEBUG:boto:Token: None 2024-04-16T18:26:25.877 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.877 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A= 2024-04-16T18:26:25.877 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A=', 'Content-Length': '0'} 2024-04-16T18:26:25.879 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc697e7ab23af321-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.922 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:25.922 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:25.923 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.923 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.923 DEBUG:boto:Method: GET 2024-04-16T18:26:25.923 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.923 DEBUG:boto:Data: 2024-04-16T18:26:25.923 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.923 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.923 DEBUG:boto:Params: {} 2024-04-16T18:26:25.923 DEBUG:boto:Token: None 2024-04-16T18:26:25.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A= 2024-04-16T18:26:25.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A=', 'Content-Length': '0'} 2024-04-16T18:26:25.926 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000771f6ca403af15d6-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.926 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:25.926 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:25.926 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.926 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.926 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.926 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.927 DEBUG:boto:Data: 2024-04-16T18:26:25.927 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.927 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.927 DEBUG:boto:Params: {} 2024-04-16T18:26:25.927 DEBUG:boto:Token: None 2024-04-16T18:26:25.927 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zxvsJlbNDPrpDQcVdp5ifBAWisI= 2024-04-16T18:26:25.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zxvsJlbNDPrpDQcVdp5ifBAWisI=', 'Content-Length': '0'} 2024-04-16T18:26:25.930 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081d2c29d6084e916-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.930 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:25.930 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:25.930 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.930 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.930 DEBUG:boto:Method: HEAD 2024-04-16T18:26:25.930 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.931 DEBUG:boto:Data: 2024-04-16T18:26:25.931 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.931 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.931 DEBUG:boto:Params: {} 2024-04-16T18:26:25.931 DEBUG:boto:Token: None 2024-04-16T18:26:25.931 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zxvsJlbNDPrpDQcVdp5ifBAWisI= 2024-04-16T18:26:25.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zxvsJlbNDPrpDQcVdp5ifBAWisI=', 'Content-Length': '0'} 2024-04-16T18:26:25.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001abe2bef0b749ed-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.933 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:26:25.934 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:25.934 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:25.934 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.934 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.934 DEBUG:boto:Method: GET 2024-04-16T18:26:25.934 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.934 DEBUG:boto:Data: 2024-04-16T18:26:25.934 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.934 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.934 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.934 DEBUG:boto:Params: {} 2024-04-16T18:26:25.935 DEBUG:boto:Token: None 2024-04-16T18:26:25.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A= 2024-04-16T18:26:25.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A=', 'Content-Length': '0'} 2024-04-16T18:26:25.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb29905b5ee55a1e-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.978 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:25.978 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:25.978 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.979 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.979 DEBUG:boto:Method: GET 2024-04-16T18:26:25.979 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.979 DEBUG:boto:Data: 2024-04-16T18:26:25.979 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:25.979 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.979 DEBUG:boto:Params: {} 2024-04-16T18:26:25.979 DEBUG:boto:Token: None 2024-04-16T18:26:25.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:26:25.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A= 2024-04-16T18:26:25.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HLm1jzwPN9s0862wIQ2fVT7EC0A=', 'Content-Length': '0'} 2024-04-16T18:26:25.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb495bd0cd339cc6-00661ec2d1-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:25.982 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:25.982 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:25.982 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:25.982 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:25.982 DEBUG:boto:Method: GET 2024-04-16T18:26:25.982 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:26:25.982 DEBUG:boto:Data: 2024-04-16T18:26:25.983 DEBUG:boto:Headers: {} 2024-04-16T18:26:25.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:25.983 DEBUG:boto:Port: 8000 2024-04-16T18:26:25.983 DEBUG:boto:Params: {} 2024-04-16T18:26:25.983 DEBUG:boto:Token: None 2024-04-16T18:26:25.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:25 GMT /cjqttm-52/ 2024-04-16T18:26:25.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M= 2024-04-16T18:26:25.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ugX1l03tNQrX9wNRrVX1fBdB8+M=', 'Content-Length': '0'} 2024-04-16T18:26:25.985 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae65eef012bea173-00661ec2d1-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.026 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:26.027 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.027 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.027 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.027 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.027 DEBUG:boto:Method: GET 2024-04-16T18:26:26.027 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.027 DEBUG:boto:Data: 2024-04-16T18:26:26.027 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.028 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.028 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.028 DEBUG:boto:Params: {} 2024-04-16T18:26:26.028 DEBUG:boto:Token: None 2024-04-16T18:26:26.028 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.028 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VSRxdvOWzauk36owKg6NF+wYlTw= 2024-04-16T18:26:26.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VSRxdvOWzauk36owKg6NF+wYlTw=', 'Content-Length': '0'} 2024-04-16T18:26:26.032 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a30eda5ebc0c2f42-00661ec2d2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.032 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:26.032 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:26.033 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:26.033 DEBUG:boto:Method: HEAD 2024-04-16T18:26:26.033 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:26:26.033 DEBUG:boto:Data: 2024-04-16T18:26:26.033 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.033 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:26.033 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.033 DEBUG:boto:Params: {} 2024-04-16T18:26:26.033 DEBUG:boto:Token: None 2024-04-16T18:26:26.033 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj95 2024-04-16T18:26:26.034 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OijA3qcM+0+4wvbFG1cgCWQlDA8= 2024-04-16T18:26:26.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OijA3qcM+0+4wvbFG1cgCWQlDA8=', 'Content-Length': '0'} 2024-04-16T18:26:26.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a97003df4c628d8-00661ec2d2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.036 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:26.036 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:26.036 DEBUG:boto:Method: HEAD 2024-04-16T18:26:26.036 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:26:26.036 DEBUG:boto:Data: 2024-04-16T18:26:26.036 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.036 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.037 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.037 DEBUG:boto:Params: {} 2024-04-16T18:26:26.037 DEBUG:boto:Token: None 2024-04-16T18:26:26.037 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj95 2024-04-16T18:26:26.037 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OijA3qcM+0+4wvbFG1cgCWQlDA8= 2024-04-16T18:26:26.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OijA3qcM+0+4wvbFG1cgCWQlDA8=', 'Content-Length': '0'} 2024-04-16T18:26:26.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f78ffbbc3d8eb57-00661ec2d2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.039 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:26:26.039 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:26.039 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:26.039 DEBUG:boto:Method: GET 2024-04-16T18:26:26.039 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:26:26.040 DEBUG:boto:Data: 2024-04-16T18:26:26.040 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.040 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:26.040 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.040 DEBUG:boto:Params: {} 2024-04-16T18:26:26.040 DEBUG:boto:Token: None 2024-04-16T18:26:26.040 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj95 2024-04-16T18:26:26.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LwYcY3Y1V1P2xlSS9azVz08h7fg= 2024-04-16T18:26:26.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LwYcY3Y1V1P2xlSS9azVz08h7fg=', 'Content-Length': '0'} 2024-04-16T18:26:26.043 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d37af8a70eccbeaf-00661ec2d2-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.086 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:26:26.087 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:26:26.087 DEBUG:boto:Method: GET 2024-04-16T18:26:26.087 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:26:26.087 DEBUG:boto:Data: 2024-04-16T18:26:26.087 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.087 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.087 DEBUG:boto:Params: {} 2024-04-16T18:26:26.087 DEBUG:boto:Token: None 2024-04-16T18:26:26.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj95 2024-04-16T18:26:26.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LwYcY3Y1V1P2xlSS9azVz08h7fg= 2024-04-16T18:26:26.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LwYcY3Y1V1P2xlSS9azVz08h7fg=', 'Content-Length': '0'} 2024-04-16T18:26:26.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000244eb35b448811d7-00661ec2d2-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.090 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.090 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.090 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.090 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.090 DEBUG:boto:Method: GET 2024-04-16T18:26:26.091 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.091 DEBUG:boto:Data: 2024-04-16T18:26:26.091 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.091 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:26:26.091 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.091 DEBUG:boto:Params: {} 2024-04-16T18:26:26.091 DEBUG:boto:Token: None 2024-04-16T18:26:26.091 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VSRxdvOWzauk36owKg6NF+wYlTw= 2024-04-16T18:26:26.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VSRxdvOWzauk36owKg6NF+wYlTw=', 'Content-Length': '0'} 2024-04-16T18:26:26.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038f4cff3bd2eb640-00661ec2d2-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.094 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:26.094 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.094 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.095 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.095 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.095 DEBUG:boto:Method: GET 2024-04-16T18:26:26.095 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:26:26.095 DEBUG:boto:Data: 2024-04-16T18:26:26.095 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.095 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.095 DEBUG:boto:Params: {} 2024-04-16T18:26:26.095 DEBUG:boto:Token: None 2024-04-16T18:26:26.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VSRxdvOWzauk36owKg6NF+wYlTw= 2024-04-16T18:26:26.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VSRxdvOWzauk36owKg6NF+wYlTw=', 'Content-Length': '0'} 2024-04-16T18:26:26.099 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f59e936f256ed7b-00661ec2d2-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.099 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:26:26.100 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:26:26.100 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:26:26.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:26:26.100 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:26:26.159 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:26:26.159 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:26:26.231 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:26:26.231 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-52 2024-04-16T18:26:26.244 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 25 2024-04-16T18:26:26.316 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.316 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.316 DEBUG:boto:Method: HEAD 2024-04-16T18:26:26.317 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:26:26.317 DEBUG:boto:Data: 2024-04-16T18:26:26.317 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.317 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.317 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.317 DEBUG:boto:Params: {} 2024-04-16T18:26:26.317 DEBUG:boto:Token: None 2024-04-16T18:26:26.317 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.317 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k= 2024-04-16T18:26:26.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k=', 'Content-Length': '0'} 2024-04-16T18:26:26.320 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d6f3b2b2d6e6adb7-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.321 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:26:26.321 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:26:26.321 DEBUG:boto:Method: PUT 2024-04-16T18:26:26.321 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:26:26.321 DEBUG:boto:Data: 2024-04-16T18:26:26.321 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:26:26.321 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.321 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.321 DEBUG:boto:Params: {} 2024-04-16T18:26:26.322 DEBUG:boto:Token: None 2024-04-16T18:26:26.322 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj31 2024-04-16T18:26:26.322 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:22Fl5R7VbFThZwdns03dHN43ioA= 2024-04-16T18:26:26.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:22Fl5R7VbFThZwdns03dHN43ioA='} 2024-04-16T18:26:26.328 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000edd7cf51af7c6828-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.328 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.328 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.328 DEBUG:boto:Method: HEAD 2024-04-16T18:26:26.328 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:26:26.328 DEBUG:boto:Data: 2024-04-16T18:26:26.328 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.329 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.329 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.329 DEBUG:boto:Params: {} 2024-04-16T18:26:26.329 DEBUG:boto:Token: None 2024-04-16T18:26:26.329 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.329 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k= 2024-04-16T18:26:26.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k=', 'Content-Length': '0'} 2024-04-16T18:26:26.332 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000039cef9541f6b0e85-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.332 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:26:26.332 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:26:26.332 DEBUG:boto:Method: PUT 2024-04-16T18:26:26.332 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:26:26.332 DEBUG:boto:Data: 2024-04-16T18:26:26.333 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:26:26.333 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.333 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.333 DEBUG:boto:Params: {} 2024-04-16T18:26:26.333 DEBUG:boto:Token: None 2024-04-16T18:26:26.333 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj62 2024-04-16T18:26:26.333 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FsCmapsP9YIeIGDrFOP7Ij06P2k= 2024-04-16T18:26:26.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FsCmapsP9YIeIGDrFOP7Ij06P2k='} 2024-04-16T18:26:26.374 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001e03cd4b9f279c68-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.375 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.375 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.375 DEBUG:boto:Method: HEAD 2024-04-16T18:26:26.375 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:26:26.375 DEBUG:boto:Data: 2024-04-16T18:26:26.375 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.375 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.375 DEBUG:boto:Params: {} 2024-04-16T18:26:26.375 DEBUG:boto:Token: None 2024-04-16T18:26:26.376 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.376 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k= 2024-04-16T18:26:26.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k=', 'Content-Length': '0'} 2024-04-16T18:26:26.378 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001737a5bd2fe63abe-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.379 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:26:26.379 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:26:26.379 DEBUG:boto:Method: PUT 2024-04-16T18:26:26.379 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:26:26.379 DEBUG:boto:Data: 2024-04-16T18:26:26.379 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:26:26.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.379 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.379 DEBUG:boto:Params: {} 2024-04-16T18:26:26.379 DEBUG:boto:Token: None 2024-04-16T18:26:26.380 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj93 2024-04-16T18:26:26.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p66GVgDEUBMaPjJrIdxAfBZcLgA= 2024-04-16T18:26:26.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p66GVgDEUBMaPjJrIdxAfBZcLgA='} 2024-04-16T18:26:26.385 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000043eb80e8250b4753-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.385 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.385 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.385 DEBUG:boto:Method: HEAD 2024-04-16T18:26:26.385 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:26:26.385 DEBUG:boto:Data: 2024-04-16T18:26:26.385 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.385 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.385 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.386 DEBUG:boto:Params: {} 2024-04-16T18:26:26.386 DEBUG:boto:Token: None 2024-04-16T18:26:26.386 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k= 2024-04-16T18:26:26.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k=', 'Content-Length': '0'} 2024-04-16T18:26:26.388 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dae3c12c51b30d60-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.389 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:26:26.389 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:26:26.389 DEBUG:boto:Method: PUT 2024-04-16T18:26:26.389 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:26:26.389 DEBUG:boto:Data: 2024-04-16T18:26:26.389 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:26:26.389 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.389 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.389 DEBUG:boto:Params: {} 2024-04-16T18:26:26.390 DEBUG:boto:Token: None 2024-04-16T18:26:26.390 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj124 2024-04-16T18:26:26.390 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XcBucFxNZFRsowRapCkTVr4MXAE= 2024-04-16T18:26:26.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XcBucFxNZFRsowRapCkTVr4MXAE='} 2024-04-16T18:26:26.434 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ff3729cb00588bf-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.435 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:26:26.435 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:26:26.435 DEBUG:boto:Method: HEAD 2024-04-16T18:26:26.435 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:26:26.435 DEBUG:boto:Data: 2024-04-16T18:26:26.435 DEBUG:boto:Headers: {} 2024-04-16T18:26:26.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.435 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.435 DEBUG:boto:Params: {} 2024-04-16T18:26:26.435 DEBUG:boto:Token: None 2024-04-16T18:26:26.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/ 2024-04-16T18:26:26.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k= 2024-04-16T18:26:26.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuIEMk7yUXdm4eVz39ObP5xAQ8k=', 'Content-Length': '0'} 2024-04-16T18:26:26.438 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cd54a5c1ab4d5189-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.439 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:26:26.439 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:26:26.439 DEBUG:boto:Method: PUT 2024-04-16T18:26:26.439 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:26:26.439 DEBUG:boto:Data: 2024-04-16T18:26:26.439 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:26:26.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:26:26.439 DEBUG:boto:Port: 8000 2024-04-16T18:26:26.440 DEBUG:boto:Params: {} 2024-04-16T18:26:26.440 DEBUG:boto:Token: None 2024-04-16T18:26:26.440 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:26:26 GMT /cjqttm-52/obj155 2024-04-16T18:26:26.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EJj8Jqs7llKjDREKE/w9qgwEUx8= 2024-04-16T18:26:26.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:26:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EJj8Jqs7llKjDREKE/w9qgwEUx8='} 2024-04-16T18:26:26.445 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000069963ea2e77d38aa-00661ec2d2-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:26:26.445 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:26:26.446 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:26:26.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:26:26.446 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:26:26.514 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:26:26.514 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:26:26.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:26.574+0000 7fd102a16800 1 waiting to reach latest gen 5, on 4.. 2024-04-16T18:26:31.576 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:31.577+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:31.577 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:26:31.577 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:26:36.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:36.579+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:36.579 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:26:36.579 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:26:41.581 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:41.581+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:41.581 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:26:41.581 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:26:46.583 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:46.583+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:46.583 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:26:46.583 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:26:51.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:51.586+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:51.585 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:26:51.585 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:26:56.587 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:26:56.588+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:26:56.587 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:26:56.587 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:01.589 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:01.589+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:01.589 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:01.589 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:06.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:06.591+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:06.591 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:06.591 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:11.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:11.593+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:11.593 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:11.593 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:16.595 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:16.595+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:16.595 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:16.595 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:21.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:21.597+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:21.597 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:21.597 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:26.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:26.599+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:26.599 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:26.599 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:31.601 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:31.601+0000 7fd102a16800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:31.601 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:31.601 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:36.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:36.604+0000 7fd102a16800 1 bucket sync caught up with source: 2024-04-16T18:27:36.603 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:36.603 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , 00000000002.109.6, , 00000000001.76.6, , 00000000001.73.6, , , , , , , , , , 00000000001.62.6, , , , , , , , , , , , , , 00000000001.85.6] 2024-04-16T18:27:36.603 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:36.604+0000 7fd102a16800 0 bucket checkpoint complete 2024-04-16T18:27:36.630 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:27:36.630 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:27:36.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:27:36.631 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:27:36.694 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:27:36.694 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:27:36.756 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:27:36.757+0000 7f1bfa333800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:36.756 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000002.544.6, 00000000002.673.6, 00000000002.1312.6, 00000000003.433.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000002.877.6, 00000000005.166.6, 00000000004.767.6] 2024-04-16T18:27:36.756 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000003.555.6, 00000000002.673.6, 00000000002.1312.6, 00000000004.439.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000003.888.6, 00000000006.175.6, 00000000004.767.6] 2024-04-16T18:27:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:27:41.758+0000 7f1bfa333800 1 bucket sync caught up with source: 2024-04-16T18:27:41.758 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000003.555.6, 00000000002.673.6, 00000000002.1312.6, 00000000004.439.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000003.888.6, 00000000006.175.6, 00000000004.767.6] 2024-04-16T18:27:41.758 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000003.555.6, 00000000002.673.6, 00000000002.1312.6, 00000000004.439.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000003.888.6, 00000000006.175.6, 00000000004.767.6] 2024-04-16T18:27:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:27:41.758+0000 7f1bfa333800 0 bucket checkpoint complete 2024-04-16T18:27:41.785 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:27:41.785 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.785 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.785 DEBUG:boto:Method: HEAD 2024-04-16T18:27:41.785 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:27:41.785 DEBUG:boto:Data: 2024-04-16T18:27:41.785 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.786 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.786 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.786 DEBUG:boto:Params: {} 2024-04-16T18:27:41.786 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:27:41.786 DEBUG:boto:Token: None 2024-04-16T18:27:41.787 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/ 2024-04-16T18:27:41.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LOuO6IAg1DGR1k20naWeep0jXG8= 2024-04-16T18:27:41.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LOuO6IAg1DGR1k20naWeep0jXG8=', 'Content-Length': '0'} 2024-04-16T18:27:41.792 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fcada4c06583f676-00661ec31d-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.792 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.792 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.792 DEBUG:boto:Method: HEAD 2024-04-16T18:27:41.792 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:27:41.792 DEBUG:boto:Data: 2024-04-16T18:27:41.792 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.792 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.793 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.793 DEBUG:boto:Params: {} 2024-04-16T18:27:41.793 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:27:41.793 DEBUG:boto:Token: None 2024-04-16T18:27:41.793 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/ 2024-04-16T18:27:41.793 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LOuO6IAg1DGR1k20naWeep0jXG8= 2024-04-16T18:27:41.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LOuO6IAg1DGR1k20naWeep0jXG8=', 'Content-Length': '0'} 2024-04-16T18:27:41.798 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ce6138e1683939dd-00661ec31d-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.799 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:27:41.799 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.799 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.799 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.799 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.799 DEBUG:boto:Method: GET 2024-04-16T18:27:41.799 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.799 DEBUG:boto:Data: 2024-04-16T18:27:41.799 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.800 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.800 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.800 DEBUG:boto:Params: {} 2024-04-16T18:27:41.800 DEBUG:boto:Token: None 2024-04-16T18:27:41.800 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/?versions 2024-04-16T18:27:41.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY= 2024-04-16T18:27:41.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY=', 'Content-Length': '0'} 2024-04-16T18:27:41.803 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000942755ae74397373-00661ec31d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.803 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:27:41.805 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:27:41.806 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:27:41.807 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:27:41.807 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.807 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.808 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.808 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.808 DEBUG:boto:Method: GET 2024-04-16T18:27:41.808 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.808 DEBUG:boto:Data: 2024-04-16T18:27:41.808 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.808 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.808 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.808 DEBUG:boto:Params: {} 2024-04-16T18:27:41.808 DEBUG:boto:Token: None 2024-04-16T18:27:41.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/?versions 2024-04-16T18:27:41.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY= 2024-04-16T18:27:41.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY=', 'Content-Length': '0'} 2024-04-16T18:27:41.812 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3a53eb71cdf1f11-00661ec31d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.812 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:41.813 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:27:41.814 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:27:41.815 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:27:41.816 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:27:41.816 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:27:41.816 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.816 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.816 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.816 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.816 DEBUG:boto:Method: GET 2024-04-16T18:27:41.816 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.816 DEBUG:boto:Data: 2024-04-16T18:27:41.816 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.816 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.816 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.817 DEBUG:boto:Params: {} 2024-04-16T18:27:41.817 DEBUG:boto:Token: None 2024-04-16T18:27:41.817 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/?versions 2024-04-16T18:27:41.817 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY= 2024-04-16T18:27:41.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY=', 'Content-Length': '0'} 2024-04-16T18:27:41.820 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002343b00ed4a8f728-00661ec31d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.820 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:41.822 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.822 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.822 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.822 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.822 DEBUG:boto:Method: GET 2024-04-16T18:27:41.822 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:27:41.822 DEBUG:boto:Data: 2024-04-16T18:27:41.822 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.822 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.823 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.823 DEBUG:boto:Params: {} 2024-04-16T18:27:41.823 DEBUG:boto:Token: None 2024-04-16T18:27:41.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/?versions 2024-04-16T18:27:41.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY= 2024-04-16T18:27:41.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:70tjVOfwSPF3seLXkyyNG2o5NSY=', 'Content-Length': '0'} 2024-04-16T18:27:41.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c65ebfbbd383790-00661ec31d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.827 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:41.828 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:27:41.828 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.828 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.828 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.828 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.828 DEBUG:boto:Method: GET 2024-04-16T18:27:41.829 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.829 DEBUG:boto:Data: 2024-04-16T18:27:41.829 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.829 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.829 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.829 DEBUG:boto:Params: {} 2024-04-16T18:27:41.829 DEBUG:boto:Token: None 2024-04-16T18:27:41.829 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.829 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM= 2024-04-16T18:27:41.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM=', 'Content-Length': '0'} 2024-04-16T18:27:41.831 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015b3a50f3364fce4-00661ec31d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.879 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.879 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.880 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.880 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.880 DEBUG:boto:Method: GET 2024-04-16T18:27:41.880 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.880 DEBUG:boto:Data: 2024-04-16T18:27:41.880 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.880 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.880 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.880 DEBUG:boto:Params: {} 2024-04-16T18:27:41.880 DEBUG:boto:Token: None 2024-04-16T18:27:41.881 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.881 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM= 2024-04-16T18:27:41.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM=', 'Content-Length': '0'} 2024-04-16T18:27:41.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003351635f7b61500a-00661ec31d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.883 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.883 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.883 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.884 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.884 DEBUG:boto:Method: HEAD 2024-04-16T18:27:41.884 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.884 DEBUG:boto:Data: 2024-04-16T18:27:41.884 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.884 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.884 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.884 DEBUG:boto:Params: {} 2024-04-16T18:27:41.884 DEBUG:boto:Token: None 2024-04-16T18:27:41.884 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VBptVbkgCo6XUNIHcaakPLA/jcQ= 2024-04-16T18:27:41.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VBptVbkgCo6XUNIHcaakPLA/jcQ=', 'Content-Length': '0'} 2024-04-16T18:27:41.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011e048e8702460b1-00661ec31d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.887 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.887 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.887 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.887 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.888 DEBUG:boto:Method: HEAD 2024-04-16T18:27:41.888 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.888 DEBUG:boto:Data: 2024-04-16T18:27:41.888 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.888 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.888 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.888 DEBUG:boto:Params: {} 2024-04-16T18:27:41.888 DEBUG:boto:Token: None 2024-04-16T18:27:41.888 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VBptVbkgCo6XUNIHcaakPLA/jcQ= 2024-04-16T18:27:41.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VBptVbkgCo6XUNIHcaakPLA/jcQ=', 'Content-Length': '0'} 2024-04-16T18:27:41.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000201e919c6d598f55-00661ec31d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:27:41.891 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.891 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.891 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.891 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.892 DEBUG:boto:Method: GET 2024-04-16T18:27:41.892 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.892 DEBUG:boto:Data: 2024-04-16T18:27:41.892 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.892 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.892 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.892 DEBUG:boto:Params: {} 2024-04-16T18:27:41.892 DEBUG:boto:Token: None 2024-04-16T18:27:41.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM= 2024-04-16T18:27:41.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM=', 'Content-Length': '0'} 2024-04-16T18:27:41.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096fa1c0620a59223-00661ec31d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.938 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.938 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.939 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.939 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.939 DEBUG:boto:Method: GET 2024-04-16T18:27:41.939 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.939 DEBUG:boto:Data: 2024-04-16T18:27:41.939 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.939 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.939 DEBUG:boto:Params: {} 2024-04-16T18:27:41.939 DEBUG:boto:Token: None 2024-04-16T18:27:41.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:27:41.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM= 2024-04-16T18:27:41.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kuOXgat/1LKGlQHAn+kTLaIO/KM=', 'Content-Length': '0'} 2024-04-16T18:27:41.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077da8909f94d7e12-00661ec31d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.942 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.942 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.942 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:41.942 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:41.942 DEBUG:boto:Method: GET 2024-04-16T18:27:41.942 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:27:41.943 DEBUG:boto:Data: 2024-04-16T18:27:41.943 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.943 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.943 DEBUG:boto:Params: {} 2024-04-16T18:27:41.943 DEBUG:boto:Token: None 2024-04-16T18:27:41.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/ 2024-04-16T18:27:41.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A/zMiOHjoc/20LM25uW6kO2C5Fw= 2024-04-16T18:27:41.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A/zMiOHjoc/20LM25uW6kO2C5Fw=', 'Content-Length': '0'} 2024-04-16T18:27:41.945 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a5dca7b1dbb1d7d-00661ec31d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.986 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:41.987 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:41.987 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:41.987 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:41.987 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:41.987 DEBUG:boto:Method: GET 2024-04-16T18:27:41.987 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:27:41.987 DEBUG:boto:Data: 2024-04-16T18:27:41.987 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.987 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.987 DEBUG:boto:Params: {} 2024-04-16T18:27:41.988 DEBUG:boto:Token: None 2024-04-16T18:27:41.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/ 2024-04-16T18:27:41.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A/zMiOHjoc/20LM25uW6kO2C5Fw= 2024-04-16T18:27:41.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A/zMiOHjoc/20LM25uW6kO2C5Fw=', 'Content-Length': '0'} 2024-04-16T18:27:41.991 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008435c4763b157f43-00661ec31d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.991 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:41.991 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.992 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.992 DEBUG:boto:Method: HEAD 2024-04-16T18:27:41.992 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:27:41.992 DEBUG:boto:Data: 2024-04-16T18:27:41.992 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.992 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.992 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.992 DEBUG:boto:Params: {} 2024-04-16T18:27:41.992 DEBUG:boto:Token: None 2024-04-16T18:27:41.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11 2024-04-16T18:27:41.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bZ+KSse5kukAM2nWv9iXzHmjy/c= 2024-04-16T18:27:41.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bZ+KSse5kukAM2nWv9iXzHmjy/c=', 'Content-Length': '0'} 2024-04-16T18:27:41.995 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc76e2e4707be5c4-00661ec31d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.995 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.995 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.995 DEBUG:boto:Method: HEAD 2024-04-16T18:27:41.995 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:27:41.995 DEBUG:boto:Data: 2024-04-16T18:27:41.995 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:41.995 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.995 DEBUG:boto:Params: {} 2024-04-16T18:27:41.996 DEBUG:boto:Token: None 2024-04-16T18:27:41.996 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11 2024-04-16T18:27:41.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bZ+KSse5kukAM2nWv9iXzHmjy/c= 2024-04-16T18:27:41.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bZ+KSse5kukAM2nWv9iXzHmjy/c=', 'Content-Length': '0'} 2024-04-16T18:27:41.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020dd8f3c6057c059-00661ec31d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:41.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:27:41.998 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:41.998 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:41.998 DEBUG:boto:Method: GET 2024-04-16T18:27:41.999 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:27:41.999 DEBUG:boto:Data: 2024-04-16T18:27:41.999 DEBUG:boto:Headers: {} 2024-04-16T18:27:41.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:41.999 DEBUG:boto:Port: 8000 2024-04-16T18:27:41.999 DEBUG:boto:Params: {} 2024-04-16T18:27:41.999 DEBUG:boto:Token: None 2024-04-16T18:27:41.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:41 GMT /cjqttm-52/obj11 2024-04-16T18:27:41.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ro+SMEtu3TS51azKgGgarZlI7MY= 2024-04-16T18:27:41.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ro+SMEtu3TS51azKgGgarZlI7MY=', 'Content-Length': '0'} 2024-04-16T18:27:42.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccc321970a9b5d2b-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.002 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:27:42.002 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:27:42.002 DEBUG:boto:Method: GET 2024-04-16T18:27:42.003 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:27:42.003 DEBUG:boto:Data: 2024-04-16T18:27:42.003 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.003 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.003 DEBUG:boto:Params: {} 2024-04-16T18:27:42.003 DEBUG:boto:Token: None 2024-04-16T18:27:42.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj11 2024-04-16T18:27:42.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E7seUB9Xh4E4vkAIt8gd5F4U2Vg= 2024-04-16T18:27:42.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7seUB9Xh4E4vkAIt8gd5F4U2Vg=', 'Content-Length': '0'} 2024-04-16T18:27:42.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002630ca160184da2-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.006 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.006 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.006 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:42.006 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:42.006 DEBUG:boto:Method: GET 2024-04-16T18:27:42.006 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:27:42.006 DEBUG:boto:Data: 2024-04-16T18:27:42.006 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.006 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.007 DEBUG:boto:Params: {} 2024-04-16T18:27:42.007 DEBUG:boto:Token: None 2024-04-16T18:27:42.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0a7cc6f6e21efb7-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.009 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.010 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.010 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.010 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:42.010 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:27:42.010 DEBUG:boto:Method: GET 2024-04-16T18:27:42.010 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:27:42.010 DEBUG:boto:Data: 2024-04-16T18:27:42.010 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.010 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.010 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.010 DEBUG:boto:Params: {} 2024-04-16T18:27:42.011 DEBUG:boto:Token: None 2024-04-16T18:27:42.011 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.014 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e8a62ade4815a56-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.014 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.015 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:27:42.015 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.015 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.015 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.015 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.015 DEBUG:boto:Method: GET 2024-04-16T18:27:42.015 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.015 DEBUG:boto:Data: 2024-04-16T18:27:42.015 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.015 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.015 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.016 DEBUG:boto:Params: {} 2024-04-16T18:27:42.016 DEBUG:boto:Token: None 2024-04-16T18:27:42.016 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA= 2024-04-16T18:27:42.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA=', 'Content-Length': '0'} 2024-04-16T18:27:42.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000751c057db0ead0ca-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.018 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.019 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.019 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.019 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.019 DEBUG:boto:Method: GET 2024-04-16T18:27:42.019 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.019 DEBUG:boto:Data: 2024-04-16T18:27:42.019 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.019 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.019 DEBUG:boto:Params: {} 2024-04-16T18:27:42.019 DEBUG:boto:Token: None 2024-04-16T18:27:42.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA= 2024-04-16T18:27:42.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA=', 'Content-Length': '0'} 2024-04-16T18:27:42.022 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e26b03cc35eebae-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.022 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.022 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.022 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.022 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.023 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.023 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.023 DEBUG:boto:Data: 2024-04-16T18:27:42.023 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.023 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.023 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.023 DEBUG:boto:Params: {} 2024-04-16T18:27:42.023 DEBUG:boto:Token: None 2024-04-16T18:27:42.023 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r8/92hQoxhAqcCwo/5RQ6JAoPLU= 2024-04-16T18:27:42.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r8/92hQoxhAqcCwo/5RQ6JAoPLU=', 'Content-Length': '0'} 2024-04-16T18:27:42.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035825ae22c30e728-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.026 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.026 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.026 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.026 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.026 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.027 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.027 DEBUG:boto:Data: 2024-04-16T18:27:42.027 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.027 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.027 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.027 DEBUG:boto:Params: {} 2024-04-16T18:27:42.027 DEBUG:boto:Token: None 2024-04-16T18:27:42.027 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r8/92hQoxhAqcCwo/5RQ6JAoPLU= 2024-04-16T18:27:42.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r8/92hQoxhAqcCwo/5RQ6JAoPLU=', 'Content-Length': '0'} 2024-04-16T18:27:42.029 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c66ad1da04577fd-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.029 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:27:42.029 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.029 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.030 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.030 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.030 DEBUG:boto:Method: GET 2024-04-16T18:27:42.030 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.030 DEBUG:boto:Data: 2024-04-16T18:27:42.030 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.030 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.030 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.030 DEBUG:boto:Params: {} 2024-04-16T18:27:42.030 DEBUG:boto:Token: None 2024-04-16T18:27:42.030 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA= 2024-04-16T18:27:42.031 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA=', 'Content-Length': '0'} 2024-04-16T18:27:42.033 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4c643b175f6d08c-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.078 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.078 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.079 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.079 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.079 DEBUG:boto:Method: GET 2024-04-16T18:27:42.079 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.079 DEBUG:boto:Data: 2024-04-16T18:27:42.079 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.079 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.079 DEBUG:boto:Params: {} 2024-04-16T18:27:42.079 DEBUG:boto:Token: None 2024-04-16T18:27:42.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:27:42.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA= 2024-04-16T18:27:42.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLtyKNxa6olalwt1JC95Tz1f5PA=', 'Content-Length': '0'} 2024-04-16T18:27:42.082 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003aa41d06ee4bb878-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.082 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.082 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.082 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.083 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.083 DEBUG:boto:Method: GET 2024-04-16T18:27:42.083 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.083 DEBUG:boto:Data: 2024-04-16T18:27:42.083 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.083 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.083 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.083 DEBUG:boto:Params: {} 2024-04-16T18:27:42.083 DEBUG:boto:Token: None 2024-04-16T18:27:42.083 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.083 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f44e5214b2ccf18-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.086 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.086 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.086 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.086 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.087 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.087 DEBUG:boto:Method: GET 2024-04-16T18:27:42.087 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.087 DEBUG:boto:Data: 2024-04-16T18:27:42.087 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.087 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.087 DEBUG:boto:Params: {} 2024-04-16T18:27:42.087 DEBUG:boto:Token: None 2024-04-16T18:27:42.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.091 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000724bd4b3d7c55583-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.091 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.091 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.091 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.092 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.092 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:27:42.092 DEBUG:boto:Data: 2024-04-16T18:27:42.092 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.092 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.092 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.092 DEBUG:boto:Params: {} 2024-04-16T18:27:42.092 DEBUG:boto:Token: None 2024-04-16T18:27:42.092 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115 2024-04-16T18:27:42.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H9w2tLqS1QqAcApEglLUmOTd4PQ= 2024-04-16T18:27:42.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H9w2tLqS1QqAcApEglLUmOTd4PQ=', 'Content-Length': '0'} 2024-04-16T18:27:42.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e18d862c9eb92ea-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.095 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.095 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.095 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.095 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:27:42.095 DEBUG:boto:Data: 2024-04-16T18:27:42.095 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.095 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.095 DEBUG:boto:Params: {} 2024-04-16T18:27:42.095 DEBUG:boto:Token: None 2024-04-16T18:27:42.095 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115 2024-04-16T18:27:42.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:H9w2tLqS1QqAcApEglLUmOTd4PQ= 2024-04-16T18:27:42.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H9w2tLqS1QqAcApEglLUmOTd4PQ=', 'Content-Length': '0'} 2024-04-16T18:27:42.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002028797201d9153c-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.098 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:27:42.098 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.098 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.099 DEBUG:boto:Method: GET 2024-04-16T18:27:42.099 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:27:42.099 DEBUG:boto:Data: 2024-04-16T18:27:42.099 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.099 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.099 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.099 DEBUG:boto:Params: {} 2024-04-16T18:27:42.099 DEBUG:boto:Token: None 2024-04-16T18:27:42.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115 2024-04-16T18:27:42.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/rOl2AblXzgKaLObQ34pPH31PI= 2024-04-16T18:27:42.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/rOl2AblXzgKaLObQ34pPH31PI=', 'Content-Length': '0'} 2024-04-16T18:27:42.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad20d2c4d75a7ab8-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.102 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:27:42.102 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:27:42.102 DEBUG:boto:Method: GET 2024-04-16T18:27:42.102 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:27:42.102 DEBUG:boto:Data: 2024-04-16T18:27:42.103 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.103 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.103 DEBUG:boto:Params: {} 2024-04-16T18:27:42.103 DEBUG:boto:Token: None 2024-04-16T18:27:42.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj115 2024-04-16T18:27:42.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5/rOl2AblXzgKaLObQ34pPH31PI= 2024-04-16T18:27:42.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5/rOl2AblXzgKaLObQ34pPH31PI=', 'Content-Length': '0'} 2024-04-16T18:27:42.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069d2891fd3087664-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.146 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.146 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.147 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.147 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.147 DEBUG:boto:Method: GET 2024-04-16T18:27:42.147 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.147 DEBUG:boto:Data: 2024-04-16T18:27:42.147 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.147 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.147 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.147 DEBUG:boto:Params: {} 2024-04-16T18:27:42.148 DEBUG:boto:Token: None 2024-04-16T18:27:42.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.150 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000320b561ac4576b6f-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.150 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.151 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.151 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.151 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.151 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.151 DEBUG:boto:Method: GET 2024-04-16T18:27:42.151 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:27:42.151 DEBUG:boto:Data: 2024-04-16T18:27:42.151 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.151 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.152 DEBUG:boto:Params: {} 2024-04-16T18:27:42.152 DEBUG:boto:Token: None 2024-04-16T18:27:42.152 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.155 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009391962c27f04fa0-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.155 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.155 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:27:42.156 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.156 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.156 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.156 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.156 DEBUG:boto:Method: GET 2024-04-16T18:27:42.156 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.156 DEBUG:boto:Data: 2024-04-16T18:27:42.156 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.156 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.156 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.156 DEBUG:boto:Params: {} 2024-04-16T18:27:42.156 DEBUG:boto:Token: None 2024-04-16T18:27:42.157 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.157 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs= 2024-04-16T18:27:42.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs=', 'Content-Length': '0'} 2024-04-16T18:27:42.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0633e2e85852b2e-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.202 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.202 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.203 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.203 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.203 DEBUG:boto:Method: GET 2024-04-16T18:27:42.203 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.203 DEBUG:boto:Data: 2024-04-16T18:27:42.203 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.203 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.203 DEBUG:boto:Params: {} 2024-04-16T18:27:42.203 DEBUG:boto:Token: None 2024-04-16T18:27:42.203 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs= 2024-04-16T18:27:42.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs=', 'Content-Length': '0'} 2024-04-16T18:27:42.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e0d95cd2395d661-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.206 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.206 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.206 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.206 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.206 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.206 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.206 DEBUG:boto:Data: 2024-04-16T18:27:42.206 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.206 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.206 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.207 DEBUG:boto:Params: {} 2024-04-16T18:27:42.207 DEBUG:boto:Token: None 2024-04-16T18:27:42.207 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fk3hl3xdZ8QBUqi4z7VXf3ya9O0= 2024-04-16T18:27:42.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fk3hl3xdZ8QBUqi4z7VXf3ya9O0=', 'Content-Length': '0'} 2024-04-16T18:27:42.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2444dc87b8fe018-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.209 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.209 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.209 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.209 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.209 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.209 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.209 DEBUG:boto:Data: 2024-04-16T18:27:42.210 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.210 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.210 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.210 DEBUG:boto:Params: {} 2024-04-16T18:27:42.210 DEBUG:boto:Token: None 2024-04-16T18:27:42.210 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.210 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fk3hl3xdZ8QBUqi4z7VXf3ya9O0= 2024-04-16T18:27:42.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fk3hl3xdZ8QBUqi4z7VXf3ya9O0=', 'Content-Length': '0'} 2024-04-16T18:27:42.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd195fbde5575a33-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.212 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:27:42.212 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.212 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.212 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.213 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.213 DEBUG:boto:Method: GET 2024-04-16T18:27:42.213 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.213 DEBUG:boto:Data: 2024-04-16T18:27:42.213 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.213 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.213 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.213 DEBUG:boto:Params: {} 2024-04-16T18:27:42.213 DEBUG:boto:Token: None 2024-04-16T18:27:42.213 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.213 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs= 2024-04-16T18:27:42.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs=', 'Content-Length': '0'} 2024-04-16T18:27:42.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fb6f76e2b812190-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.216 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.216 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.216 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.216 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.216 DEBUG:boto:Method: GET 2024-04-16T18:27:42.216 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.216 DEBUG:boto:Data: 2024-04-16T18:27:42.216 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.216 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.216 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.216 DEBUG:boto:Params: {} 2024-04-16T18:27:42.217 DEBUG:boto:Token: None 2024-04-16T18:27:42.217 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:27:42.217 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs= 2024-04-16T18:27:42.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bqj3C9mLftpcF5hfpkHN8VoMVQs=', 'Content-Length': '0'} 2024-04-16T18:27:42.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006769a984f64bc1c3-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.219 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.219 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.219 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.220 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.220 DEBUG:boto:Method: GET 2024-04-16T18:27:42.220 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.220 DEBUG:boto:Data: 2024-04-16T18:27:42.220 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.220 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.220 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.220 DEBUG:boto:Params: {} 2024-04-16T18:27:42.220 DEBUG:boto:Token: None 2024-04-16T18:27:42.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.223 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000193eaca65e77772c-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.223 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.223 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.223 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.223 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.224 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.224 DEBUG:boto:Method: GET 2024-04-16T18:27:42.224 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.224 DEBUG:boto:Data: 2024-04-16T18:27:42.224 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.224 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.224 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.224 DEBUG:boto:Params: {} 2024-04-16T18:27:42.224 DEBUG:boto:Token: None 2024-04-16T18:27:42.224 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.228 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e0e363c95dd5586-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.228 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.228 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.229 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.229 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.229 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:27:42.229 DEBUG:boto:Data: 2024-04-16T18:27:42.229 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.229 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.229 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.229 DEBUG:boto:Params: {} 2024-04-16T18:27:42.229 DEBUG:boto:Token: None 2024-04-16T18:27:42.229 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116 2024-04-16T18:27:42.229 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VqHD3YuowfuJ1BTPQDr4ZH0gC2U= 2024-04-16T18:27:42.230 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VqHD3YuowfuJ1BTPQDr4ZH0gC2U=', 'Content-Length': '0'} 2024-04-16T18:27:42.231 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018e0cc9339aaf84e-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.231 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.232 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.232 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.232 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:27:42.232 DEBUG:boto:Data: 2024-04-16T18:27:42.232 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.232 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.232 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.232 DEBUG:boto:Params: {} 2024-04-16T18:27:42.232 DEBUG:boto:Token: None 2024-04-16T18:27:42.232 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116 2024-04-16T18:27:42.233 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VqHD3YuowfuJ1BTPQDr4ZH0gC2U= 2024-04-16T18:27:42.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VqHD3YuowfuJ1BTPQDr4ZH0gC2U=', 'Content-Length': '0'} 2024-04-16T18:27:42.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000588399106d5f11a8-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.234 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:27:42.235 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.235 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.235 DEBUG:boto:Method: GET 2024-04-16T18:27:42.235 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:27:42.235 DEBUG:boto:Data: 2024-04-16T18:27:42.235 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.235 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.235 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.235 DEBUG:boto:Params: {} 2024-04-16T18:27:42.235 DEBUG:boto:Token: None 2024-04-16T18:27:42.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116 2024-04-16T18:27:42.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3s+p+MKAPk8+em1O0XVJY4FIWi8= 2024-04-16T18:27:42.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3s+p+MKAPk8+em1O0XVJY4FIWi8=', 'Content-Length': '0'} 2024-04-16T18:27:42.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000742e3ab1bd67ccde-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.278 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:27:42.279 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:27:42.279 DEBUG:boto:Method: GET 2024-04-16T18:27:42.279 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:27:42.279 DEBUG:boto:Data: 2024-04-16T18:27:42.279 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.279 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.279 DEBUG:boto:Params: {} 2024-04-16T18:27:42.279 DEBUG:boto:Token: None 2024-04-16T18:27:42.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj116 2024-04-16T18:27:42.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3s+p+MKAPk8+em1O0XVJY4FIWi8= 2024-04-16T18:27:42.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3s+p+MKAPk8+em1O0XVJY4FIWi8=', 'Content-Length': '0'} 2024-04-16T18:27:42.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed957788a9632cca-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.282 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.282 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.282 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.282 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.282 DEBUG:boto:Method: GET 2024-04-16T18:27:42.282 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.282 DEBUG:boto:Data: 2024-04-16T18:27:42.283 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.283 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.283 DEBUG:boto:Params: {} 2024-04-16T18:27:42.283 DEBUG:boto:Token: None 2024-04-16T18:27:42.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9d576f6f3989acc-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.285 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.286 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.286 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.286 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.286 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.286 DEBUG:boto:Method: GET 2024-04-16T18:27:42.286 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:27:42.286 DEBUG:boto:Data: 2024-04-16T18:27:42.286 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.286 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.286 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.286 DEBUG:boto:Params: {} 2024-04-16T18:27:42.287 DEBUG:boto:Token: None 2024-04-16T18:27:42.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003730ef3dfe929dd4-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.290 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:27:42.290 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.290 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.291 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.291 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.291 DEBUG:boto:Method: GET 2024-04-16T18:27:42.291 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.291 DEBUG:boto:Data: 2024-04-16T18:27:42.291 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.291 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.291 DEBUG:boto:Params: {} 2024-04-16T18:27:42.291 DEBUG:boto:Token: None 2024-04-16T18:27:42.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ= 2024-04-16T18:27:42.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ=', 'Content-Length': '0'} 2024-04-16T18:27:42.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000804389dc2313bcb3-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.294 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.294 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.294 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.294 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.294 DEBUG:boto:Method: GET 2024-04-16T18:27:42.295 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.295 DEBUG:boto:Data: 2024-04-16T18:27:42.295 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.295 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.295 DEBUG:boto:Params: {} 2024-04-16T18:27:42.295 DEBUG:boto:Token: None 2024-04-16T18:27:42.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ= 2024-04-16T18:27:42.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ=', 'Content-Length': '0'} 2024-04-16T18:27:42.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaa808d2d11a072d-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.297 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.298 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.298 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.298 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.298 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.298 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.298 DEBUG:boto:Data: 2024-04-16T18:27:42.298 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.298 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.298 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.298 DEBUG:boto:Params: {} 2024-04-16T18:27:42.298 DEBUG:boto:Token: None 2024-04-16T18:27:42.299 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ihm1zvsHXFTK/wswGDEy96UhBGA= 2024-04-16T18:27:42.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ihm1zvsHXFTK/wswGDEy96UhBGA=', 'Content-Length': '0'} 2024-04-16T18:27:42.301 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000664b293d07d5d3cd-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.301 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.301 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.301 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.301 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.301 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.301 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.302 DEBUG:boto:Data: 2024-04-16T18:27:42.302 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.302 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.302 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.302 DEBUG:boto:Params: {} 2024-04-16T18:27:42.302 DEBUG:boto:Token: None 2024-04-16T18:27:42.302 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.302 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ihm1zvsHXFTK/wswGDEy96UhBGA= 2024-04-16T18:27:42.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ihm1zvsHXFTK/wswGDEy96UhBGA=', 'Content-Length': '0'} 2024-04-16T18:27:42.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054e11236356284ea-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:27:42.304 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.304 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.304 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.305 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.305 DEBUG:boto:Method: GET 2024-04-16T18:27:42.305 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.305 DEBUG:boto:Data: 2024-04-16T18:27:42.305 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.305 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.305 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.305 DEBUG:boto:Params: {} 2024-04-16T18:27:42.305 DEBUG:boto:Token: None 2024-04-16T18:27:42.305 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.305 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ= 2024-04-16T18:27:42.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ=', 'Content-Length': '0'} 2024-04-16T18:27:42.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d17de081f85ee0b-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.308 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.308 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.308 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.308 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.308 DEBUG:boto:Method: GET 2024-04-16T18:27:42.308 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.308 DEBUG:boto:Data: 2024-04-16T18:27:42.308 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.308 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.308 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.308 DEBUG:boto:Params: {} 2024-04-16T18:27:42.309 DEBUG:boto:Token: None 2024-04-16T18:27:42.309 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:27:42.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ= 2024-04-16T18:27:42.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HW75gLbNcEJMnz8jxQ12WWmQUkQ=', 'Content-Length': '0'} 2024-04-16T18:27:42.311 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f121e5548c2a5166-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.311 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.311 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.311 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.311 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.311 DEBUG:boto:Method: GET 2024-04-16T18:27:42.312 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.312 DEBUG:boto:Data: 2024-04-16T18:27:42.312 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.312 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.312 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.312 DEBUG:boto:Params: {} 2024-04-16T18:27:42.312 DEBUG:boto:Token: None 2024-04-16T18:27:42.312 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.315 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000203bb4175e6a7801-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.315 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.315 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.315 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.315 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.315 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.315 DEBUG:boto:Method: GET 2024-04-16T18:27:42.315 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.316 DEBUG:boto:Data: 2024-04-16T18:27:42.316 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.316 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.316 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.316 DEBUG:boto:Params: {} 2024-04-16T18:27:42.316 DEBUG:boto:Token: None 2024-04-16T18:27:42.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.319 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a8cb2aa0c19f634-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.320 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.320 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.320 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.320 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.320 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:27:42.320 DEBUG:boto:Data: 2024-04-16T18:27:42.320 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.320 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.320 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.321 DEBUG:boto:Params: {} 2024-04-16T18:27:42.321 DEBUG:boto:Token: None 2024-04-16T18:27:42.321 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124 2024-04-16T18:27:42.321 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1vclAVuENr6bS5SbdpuWEvu8WWU= 2024-04-16T18:27:42.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1vclAVuENr6bS5SbdpuWEvu8WWU=', 'Content-Length': '0'} 2024-04-16T18:27:42.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e345f4c67ea0f05-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.323 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.323 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.323 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.323 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:27:42.323 DEBUG:boto:Data: 2024-04-16T18:27:42.323 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.323 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.324 DEBUG:boto:Params: {} 2024-04-16T18:27:42.324 DEBUG:boto:Token: None 2024-04-16T18:27:42.324 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124 2024-04-16T18:27:42.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1vclAVuENr6bS5SbdpuWEvu8WWU= 2024-04-16T18:27:42.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1vclAVuENr6bS5SbdpuWEvu8WWU=', 'Content-Length': '0'} 2024-04-16T18:27:42.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acc18e52fbca5b62-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.326 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:27:42.326 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.326 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.326 DEBUG:boto:Method: GET 2024-04-16T18:27:42.326 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:27:42.326 DEBUG:boto:Data: 2024-04-16T18:27:42.326 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.326 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.327 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.327 DEBUG:boto:Params: {} 2024-04-16T18:27:42.327 DEBUG:boto:Token: None 2024-04-16T18:27:42.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124 2024-04-16T18:27:42.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qG+rDADsTtqD0COJmwf+NyHYAS0= 2024-04-16T18:27:42.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qG+rDADsTtqD0COJmwf+NyHYAS0=', 'Content-Length': '0'} 2024-04-16T18:27:42.329 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001450edc84912abf2-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.370 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:27:42.371 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:27:42.371 DEBUG:boto:Method: GET 2024-04-16T18:27:42.371 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:27:42.371 DEBUG:boto:Data: 2024-04-16T18:27:42.371 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.371 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.371 DEBUG:boto:Params: {} 2024-04-16T18:27:42.371 DEBUG:boto:Token: None 2024-04-16T18:27:42.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj124 2024-04-16T18:27:42.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qG+rDADsTtqD0COJmwf+NyHYAS0= 2024-04-16T18:27:42.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qG+rDADsTtqD0COJmwf+NyHYAS0=', 'Content-Length': '0'} 2024-04-16T18:27:42.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db7fea8d6803a70a-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.373 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.374 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.374 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.374 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.374 DEBUG:boto:Method: GET 2024-04-16T18:27:42.374 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.374 DEBUG:boto:Data: 2024-04-16T18:27:42.374 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.374 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.374 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.374 DEBUG:boto:Params: {} 2024-04-16T18:27:42.374 DEBUG:boto:Token: None 2024-04-16T18:27:42.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f9afc7291fc44b9-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.377 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.377 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.377 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.378 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.378 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.378 DEBUG:boto:Method: GET 2024-04-16T18:27:42.378 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:27:42.378 DEBUG:boto:Data: 2024-04-16T18:27:42.378 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.378 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.378 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.378 DEBUG:boto:Params: {} 2024-04-16T18:27:42.378 DEBUG:boto:Token: None 2024-04-16T18:27:42.378 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.382 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed45b4044147daab-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.382 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.382 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:27:42.383 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.383 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.383 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.383 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.383 DEBUG:boto:Method: GET 2024-04-16T18:27:42.383 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.383 DEBUG:boto:Data: 2024-04-16T18:27:42.383 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.383 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.383 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.383 DEBUG:boto:Params: {} 2024-04-16T18:27:42.383 DEBUG:boto:Token: None 2024-04-16T18:27:42.384 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU= 2024-04-16T18:27:42.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU=', 'Content-Length': '0'} 2024-04-16T18:27:42.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046740f80417c49dc-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.386 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.386 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.386 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.386 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.386 DEBUG:boto:Method: GET 2024-04-16T18:27:42.386 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.386 DEBUG:boto:Data: 2024-04-16T18:27:42.387 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.387 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.387 DEBUG:boto:Params: {} 2024-04-16T18:27:42.387 DEBUG:boto:Token: None 2024-04-16T18:27:42.387 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU= 2024-04-16T18:27:42.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU=', 'Content-Length': '0'} 2024-04-16T18:27:42.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b1d8ecff6a222c6-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.389 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.389 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.390 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.390 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.390 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.390 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.390 DEBUG:boto:Data: 2024-04-16T18:27:42.390 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.390 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.390 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.390 DEBUG:boto:Params: {} 2024-04-16T18:27:42.390 DEBUG:boto:Token: None 2024-04-16T18:27:42.390 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mY0f6I9vKYO/64E3FT0x3iF7kqY= 2024-04-16T18:27:42.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mY0f6I9vKYO/64E3FT0x3iF7kqY=', 'Content-Length': '0'} 2024-04-16T18:27:42.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d86291c8fd1b6d8b-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.393 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.393 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.393 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.393 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.393 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.393 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.393 DEBUG:boto:Data: 2024-04-16T18:27:42.393 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.393 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.394 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.394 DEBUG:boto:Params: {} 2024-04-16T18:27:42.394 DEBUG:boto:Token: None 2024-04-16T18:27:42.394 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.394 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mY0f6I9vKYO/64E3FT0x3iF7kqY= 2024-04-16T18:27:42.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mY0f6I9vKYO/64E3FT0x3iF7kqY=', 'Content-Length': '0'} 2024-04-16T18:27:42.396 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a5abf930e46035c-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:27:42.396 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.396 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.397 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.397 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.397 DEBUG:boto:Method: GET 2024-04-16T18:27:42.397 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.397 DEBUG:boto:Data: 2024-04-16T18:27:42.397 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.397 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.397 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.397 DEBUG:boto:Params: {} 2024-04-16T18:27:42.397 DEBUG:boto:Token: None 2024-04-16T18:27:42.397 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU= 2024-04-16T18:27:42.398 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU=', 'Content-Length': '0'} 2024-04-16T18:27:42.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe56e5da7cc117ae-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.399 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.400 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.400 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.400 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.400 DEBUG:boto:Method: GET 2024-04-16T18:27:42.400 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.400 DEBUG:boto:Data: 2024-04-16T18:27:42.400 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.400 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.400 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.400 DEBUG:boto:Params: {} 2024-04-16T18:27:42.400 DEBUG:boto:Token: None 2024-04-16T18:27:42.401 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:27:42.401 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU= 2024-04-16T18:27:42.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8IImbYSAr69FXxJXL+4viPjQpxU=', 'Content-Length': '0'} 2024-04-16T18:27:42.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000570451ae5d0d47cb-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.403 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.403 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.403 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.403 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.403 DEBUG:boto:Method: GET 2024-04-16T18:27:42.403 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.404 DEBUG:boto:Data: 2024-04-16T18:27:42.404 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.404 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.404 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.404 DEBUG:boto:Params: {} 2024-04-16T18:27:42.404 DEBUG:boto:Token: None 2024-04-16T18:27:42.404 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.406 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e870a9e15782fe98-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.407 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.407 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.407 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.407 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.407 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.407 DEBUG:boto:Method: GET 2024-04-16T18:27:42.407 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.407 DEBUG:boto:Data: 2024-04-16T18:27:42.407 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.408 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.408 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.408 DEBUG:boto:Params: {} 2024-04-16T18:27:42.408 DEBUG:boto:Token: None 2024-04-16T18:27:42.408 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.411 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5d634bdacec4739-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.454 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.455 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.455 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.455 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.455 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:27:42.455 DEBUG:boto:Data: 2024-04-16T18:27:42.455 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.455 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.455 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.455 DEBUG:boto:Params: {} 2024-04-16T18:27:42.455 DEBUG:boto:Token: None 2024-04-16T18:27:42.456 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145 2024-04-16T18:27:42.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ekmP15QZMf5MX3Qucuz1jY8j6ZM= 2024-04-16T18:27:42.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ekmP15QZMf5MX3Qucuz1jY8j6ZM=', 'Content-Length': '0'} 2024-04-16T18:27:42.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e06446fc2d733f3-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.458 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.458 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.458 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.458 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:27:42.458 DEBUG:boto:Data: 2024-04-16T18:27:42.458 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.458 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.459 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.459 DEBUG:boto:Params: {} 2024-04-16T18:27:42.459 DEBUG:boto:Token: None 2024-04-16T18:27:42.459 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145 2024-04-16T18:27:42.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ekmP15QZMf5MX3Qucuz1jY8j6ZM= 2024-04-16T18:27:42.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ekmP15QZMf5MX3Qucuz1jY8j6ZM=', 'Content-Length': '0'} 2024-04-16T18:27:42.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027a0aba3ac46f3b4-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.461 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:27:42.461 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.461 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.461 DEBUG:boto:Method: GET 2024-04-16T18:27:42.461 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:27:42.462 DEBUG:boto:Data: 2024-04-16T18:27:42.462 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.462 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.462 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.462 DEBUG:boto:Params: {} 2024-04-16T18:27:42.462 DEBUG:boto:Token: None 2024-04-16T18:27:42.462 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145 2024-04-16T18:27:42.462 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w66x82Saizn/OJgdnXlcaV8h5OI= 2024-04-16T18:27:42.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w66x82Saizn/OJgdnXlcaV8h5OI=', 'Content-Length': '0'} 2024-04-16T18:27:42.464 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036b26e261df20462-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.464 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:27:42.465 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:27:42.465 DEBUG:boto:Method: GET 2024-04-16T18:27:42.465 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:27:42.465 DEBUG:boto:Data: 2024-04-16T18:27:42.465 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.465 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.465 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.465 DEBUG:boto:Params: {} 2024-04-16T18:27:42.465 DEBUG:boto:Token: None 2024-04-16T18:27:42.465 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj145 2024-04-16T18:27:42.465 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w66x82Saizn/OJgdnXlcaV8h5OI= 2024-04-16T18:27:42.466 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w66x82Saizn/OJgdnXlcaV8h5OI=', 'Content-Length': '0'} 2024-04-16T18:27:42.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e482bb28f3a4ffd-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.468 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.468 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.468 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.468 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.468 DEBUG:boto:Method: GET 2024-04-16T18:27:42.468 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.468 DEBUG:boto:Data: 2024-04-16T18:27:42.468 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.468 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.468 DEBUG:boto:Params: {} 2024-04-16T18:27:42.469 DEBUG:boto:Token: None 2024-04-16T18:27:42.469 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.471 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000065121dcefc7f3ac0-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.471 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.472 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.472 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.472 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.472 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.472 DEBUG:boto:Method: GET 2024-04-16T18:27:42.472 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:27:42.472 DEBUG:boto:Data: 2024-04-16T18:27:42.472 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.472 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.473 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.473 DEBUG:boto:Params: {} 2024-04-16T18:27:42.473 DEBUG:boto:Token: None 2024-04-16T18:27:42.473 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.473 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.476 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000433a22342e4fca95-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.477 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:27:42.477 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.477 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.477 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.477 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.477 DEBUG:boto:Method: GET 2024-04-16T18:27:42.477 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.478 DEBUG:boto:Data: 2024-04-16T18:27:42.478 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.478 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.478 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.478 DEBUG:boto:Params: {} 2024-04-16T18:27:42.478 DEBUG:boto:Token: None 2024-04-16T18:27:42.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo= 2024-04-16T18:27:42.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo=', 'Content-Length': '0'} 2024-04-16T18:27:42.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6ea942269a048e1-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.522 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.522 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.522 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.523 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.523 DEBUG:boto:Method: GET 2024-04-16T18:27:42.523 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.523 DEBUG:boto:Data: 2024-04-16T18:27:42.523 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.523 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.523 DEBUG:boto:Params: {} 2024-04-16T18:27:42.523 DEBUG:boto:Token: None 2024-04-16T18:27:42.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo= 2024-04-16T18:27:42.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo=', 'Content-Length': '0'} 2024-04-16T18:27:42.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007941795d0e097080-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.526 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.526 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.526 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.526 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.526 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.526 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.526 DEBUG:boto:Data: 2024-04-16T18:27:42.526 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.526 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.527 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.527 DEBUG:boto:Params: {} 2024-04-16T18:27:42.527 DEBUG:boto:Token: None 2024-04-16T18:27:42.527 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S1kNFn9+r/8NzGFifeLNzahuIKU= 2024-04-16T18:27:42.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S1kNFn9+r/8NzGFifeLNzahuIKU=', 'Content-Length': '0'} 2024-04-16T18:27:42.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f319c15e738cf31-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.529 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.529 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.529 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.529 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.530 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.530 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.530 DEBUG:boto:Data: 2024-04-16T18:27:42.530 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.530 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.530 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.530 DEBUG:boto:Params: {} 2024-04-16T18:27:42.530 DEBUG:boto:Token: None 2024-04-16T18:27:42.530 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.530 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S1kNFn9+r/8NzGFifeLNzahuIKU= 2024-04-16T18:27:42.531 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S1kNFn9+r/8NzGFifeLNzahuIKU=', 'Content-Length': '0'} 2024-04-16T18:27:42.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008263008dd9e8e2af-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:27:42.533 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.533 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.533 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.533 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.533 DEBUG:boto:Method: GET 2024-04-16T18:27:42.533 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.533 DEBUG:boto:Data: 2024-04-16T18:27:42.533 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.533 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.533 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.533 DEBUG:boto:Params: {} 2024-04-16T18:27:42.533 DEBUG:boto:Token: None 2024-04-16T18:27:42.534 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.534 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo= 2024-04-16T18:27:42.534 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo=', 'Content-Length': '0'} 2024-04-16T18:27:42.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d8829cbf6c03b61-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.536 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.536 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.536 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.536 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.536 DEBUG:boto:Method: GET 2024-04-16T18:27:42.536 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.537 DEBUG:boto:Data: 2024-04-16T18:27:42.537 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.537 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.537 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.537 DEBUG:boto:Params: {} 2024-04-16T18:27:42.537 DEBUG:boto:Token: None 2024-04-16T18:27:42.537 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:27:42.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo= 2024-04-16T18:27:42.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c3z/e/Iupo3Wkq06Ci21dBR05Mo=', 'Content-Length': '0'} 2024-04-16T18:27:42.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000341a8fa6a730725e-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.539 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.540 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.540 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.540 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.540 DEBUG:boto:Method: GET 2024-04-16T18:27:42.540 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.540 DEBUG:boto:Data: 2024-04-16T18:27:42.540 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.540 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.540 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.540 DEBUG:boto:Params: {} 2024-04-16T18:27:42.540 DEBUG:boto:Token: None 2024-04-16T18:27:42.541 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.541 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.541 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e589cd0bddcb89a-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.543 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.544 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.544 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.544 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.544 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.544 DEBUG:boto:Method: GET 2024-04-16T18:27:42.544 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.544 DEBUG:boto:Data: 2024-04-16T18:27:42.544 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.544 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.544 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.544 DEBUG:boto:Params: {} 2024-04-16T18:27:42.544 DEBUG:boto:Token: None 2024-04-16T18:27:42.545 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.548 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca258cf926018ad0-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.590 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.591 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.591 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.591 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.591 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:27:42.591 DEBUG:boto:Data: 2024-04-16T18:27:42.591 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.591 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.591 DEBUG:boto:Params: {} 2024-04-16T18:27:42.591 DEBUG:boto:Token: None 2024-04-16T18:27:42.592 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155 2024-04-16T18:27:42.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QIZqohZmchaDr5c1EdanMr3G12c= 2024-04-16T18:27:42.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QIZqohZmchaDr5c1EdanMr3G12c=', 'Content-Length': '0'} 2024-04-16T18:27:42.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000420d50b86828c788-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.594 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.594 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.594 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.594 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:27:42.594 DEBUG:boto:Data: 2024-04-16T18:27:42.594 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.594 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.595 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.595 DEBUG:boto:Params: {} 2024-04-16T18:27:42.595 DEBUG:boto:Token: None 2024-04-16T18:27:42.595 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155 2024-04-16T18:27:42.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QIZqohZmchaDr5c1EdanMr3G12c= 2024-04-16T18:27:42.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QIZqohZmchaDr5c1EdanMr3G12c=', 'Content-Length': '0'} 2024-04-16T18:27:42.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d2884b2e99eb6c5-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.597 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:27:42.597 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.597 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.598 DEBUG:boto:Method: GET 2024-04-16T18:27:42.598 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:27:42.598 DEBUG:boto:Data: 2024-04-16T18:27:42.598 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.598 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.598 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.598 DEBUG:boto:Params: {} 2024-04-16T18:27:42.598 DEBUG:boto:Token: None 2024-04-16T18:27:42.598 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155 2024-04-16T18:27:42.598 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C8v5KypOLaz2GFYtnccu6GtWPHE= 2024-04-16T18:27:42.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C8v5KypOLaz2GFYtnccu6GtWPHE=', 'Content-Length': '0'} 2024-04-16T18:27:42.600 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ada1c34df7db0b3-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.601 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:27:42.601 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:27:42.601 DEBUG:boto:Method: GET 2024-04-16T18:27:42.601 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:27:42.601 DEBUG:boto:Data: 2024-04-16T18:27:42.601 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.601 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.601 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.601 DEBUG:boto:Params: {} 2024-04-16T18:27:42.602 DEBUG:boto:Token: None 2024-04-16T18:27:42.602 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj155 2024-04-16T18:27:42.602 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C8v5KypOLaz2GFYtnccu6GtWPHE= 2024-04-16T18:27:42.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C8v5KypOLaz2GFYtnccu6GtWPHE=', 'Content-Length': '0'} 2024-04-16T18:27:42.604 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f573257f5f7ce342-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.604 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.604 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.604 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.604 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.604 DEBUG:boto:Method: GET 2024-04-16T18:27:42.605 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.605 DEBUG:boto:Data: 2024-04-16T18:27:42.605 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.605 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.605 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.605 DEBUG:boto:Params: {} 2024-04-16T18:27:42.605 DEBUG:boto:Token: None 2024-04-16T18:27:42.605 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.605 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e7ee8a241bbcdff-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.608 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.608 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.608 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.608 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.608 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.608 DEBUG:boto:Method: GET 2024-04-16T18:27:42.608 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:27:42.608 DEBUG:boto:Data: 2024-04-16T18:27:42.609 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.609 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.609 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.609 DEBUG:boto:Params: {} 2024-04-16T18:27:42.609 DEBUG:boto:Token: None 2024-04-16T18:27:42.609 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.609 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fbd8db45c4e808b3-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.613 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.613 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:27:42.613 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.613 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.613 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.613 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.613 DEBUG:boto:Method: GET 2024-04-16T18:27:42.614 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.614 DEBUG:boto:Data: 2024-04-16T18:27:42.614 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.614 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.614 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.614 DEBUG:boto:Params: {} 2024-04-16T18:27:42.614 DEBUG:boto:Token: None 2024-04-16T18:27:42.614 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.614 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig= 2024-04-16T18:27:42.614 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig=', 'Content-Length': '0'} 2024-04-16T18:27:42.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7762cd2211bc7c9-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.617 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.617 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.617 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.617 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.617 DEBUG:boto:Method: GET 2024-04-16T18:27:42.617 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.617 DEBUG:boto:Data: 2024-04-16T18:27:42.617 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.618 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.618 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.618 DEBUG:boto:Params: {} 2024-04-16T18:27:42.618 DEBUG:boto:Token: None 2024-04-16T18:27:42.618 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.618 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig= 2024-04-16T18:27:42.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig=', 'Content-Length': '0'} 2024-04-16T18:27:42.620 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8b8c8d8f433e464-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.620 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.621 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.621 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.621 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.621 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.621 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.621 DEBUG:boto:Data: 2024-04-16T18:27:42.621 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.621 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.621 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.621 DEBUG:boto:Params: {} 2024-04-16T18:27:42.621 DEBUG:boto:Token: None 2024-04-16T18:27:42.622 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.622 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SBA/lfeX2tAnPdURGngj8F7Evng= 2024-04-16T18:27:42.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SBA/lfeX2tAnPdURGngj8F7Evng=', 'Content-Length': '0'} 2024-04-16T18:27:42.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e42b36f491a0bc5a-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.624 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.624 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.624 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.624 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.624 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.624 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.624 DEBUG:boto:Data: 2024-04-16T18:27:42.624 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.625 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.625 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.625 DEBUG:boto:Params: {} 2024-04-16T18:27:42.625 DEBUG:boto:Token: None 2024-04-16T18:27:42.625 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.625 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SBA/lfeX2tAnPdURGngj8F7Evng= 2024-04-16T18:27:42.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SBA/lfeX2tAnPdURGngj8F7Evng=', 'Content-Length': '0'} 2024-04-16T18:27:42.627 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f199855765a01bbf-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:27:42.628 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.628 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.628 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.628 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.628 DEBUG:boto:Method: GET 2024-04-16T18:27:42.628 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.628 DEBUG:boto:Data: 2024-04-16T18:27:42.628 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.628 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.628 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.628 DEBUG:boto:Params: {} 2024-04-16T18:27:42.628 DEBUG:boto:Token: None 2024-04-16T18:27:42.629 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.629 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig= 2024-04-16T18:27:42.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig=', 'Content-Length': '0'} 2024-04-16T18:27:42.631 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e852e53f134941a6-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.631 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.631 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.632 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.632 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.632 DEBUG:boto:Method: GET 2024-04-16T18:27:42.632 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.632 DEBUG:boto:Data: 2024-04-16T18:27:42.632 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.632 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.632 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.632 DEBUG:boto:Params: {} 2024-04-16T18:27:42.632 DEBUG:boto:Token: None 2024-04-16T18:27:42.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:27:42.633 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig= 2024-04-16T18:27:42.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZ8Ht3zhrGBePeaJXm7lVYQq1ig=', 'Content-Length': '0'} 2024-04-16T18:27:42.635 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa4f364043ab2a61-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.678 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.678 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.679 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.679 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.679 DEBUG:boto:Method: GET 2024-04-16T18:27:42.679 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.679 DEBUG:boto:Data: 2024-04-16T18:27:42.679 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.679 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.679 DEBUG:boto:Params: {} 2024-04-16T18:27:42.679 DEBUG:boto:Token: None 2024-04-16T18:27:42.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047eb7ad849ef5acd-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.682 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.682 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.682 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.682 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.682 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.682 DEBUG:boto:Method: GET 2024-04-16T18:27:42.683 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.683 DEBUG:boto:Data: 2024-04-16T18:27:42.683 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.683 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.683 DEBUG:boto:Params: {} 2024-04-16T18:27:42.683 DEBUG:boto:Token: None 2024-04-16T18:27:42.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000099bf308a471d50c8-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.687 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.687 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.688 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.688 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.688 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:27:42.688 DEBUG:boto:Data: 2024-04-16T18:27:42.688 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.688 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.688 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.688 DEBUG:boto:Params: {} 2024-04-16T18:27:42.688 DEBUG:boto:Token: None 2024-04-16T18:27:42.688 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17 2024-04-16T18:27:42.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bEt5OK7zYGRTjbaq67U6o/wSbrc= 2024-04-16T18:27:42.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bEt5OK7zYGRTjbaq67U6o/wSbrc=', 'Content-Length': '0'} 2024-04-16T18:27:42.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e6e9d294665faf3-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.691 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.691 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.691 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.691 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:27:42.691 DEBUG:boto:Data: 2024-04-16T18:27:42.691 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.691 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.691 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.691 DEBUG:boto:Params: {} 2024-04-16T18:27:42.692 DEBUG:boto:Token: None 2024-04-16T18:27:42.692 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17 2024-04-16T18:27:42.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bEt5OK7zYGRTjbaq67U6o/wSbrc= 2024-04-16T18:27:42.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bEt5OK7zYGRTjbaq67U6o/wSbrc=', 'Content-Length': '0'} 2024-04-16T18:27:42.694 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000591d01f21a62c7f4-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.694 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:27:42.695 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.695 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.695 DEBUG:boto:Method: GET 2024-04-16T18:27:42.695 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:27:42.695 DEBUG:boto:Data: 2024-04-16T18:27:42.695 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.695 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.695 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.695 DEBUG:boto:Params: {} 2024-04-16T18:27:42.695 DEBUG:boto:Token: None 2024-04-16T18:27:42.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17 2024-04-16T18:27:42.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v8WkO/K9GjcRPTrcB1l3MVnnZBA= 2024-04-16T18:27:42.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v8WkO/K9GjcRPTrcB1l3MVnnZBA=', 'Content-Length': '0'} 2024-04-16T18:27:42.698 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004fae05f6955c3514-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.738 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:27:42.738 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:27:42.739 DEBUG:boto:Method: GET 2024-04-16T18:27:42.739 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:27:42.739 DEBUG:boto:Data: 2024-04-16T18:27:42.739 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.739 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.739 DEBUG:boto:Params: {} 2024-04-16T18:27:42.739 DEBUG:boto:Token: None 2024-04-16T18:27:42.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj17 2024-04-16T18:27:42.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v8WkO/K9GjcRPTrcB1l3MVnnZBA= 2024-04-16T18:27:42.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v8WkO/K9GjcRPTrcB1l3MVnnZBA=', 'Content-Length': '0'} 2024-04-16T18:27:42.742 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c601fe28c1a58ccc-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.742 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.742 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.742 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.742 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.742 DEBUG:boto:Method: GET 2024-04-16T18:27:42.742 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.743 DEBUG:boto:Data: 2024-04-16T18:27:42.743 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.743 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.743 DEBUG:boto:Params: {} 2024-04-16T18:27:42.743 DEBUG:boto:Token: None 2024-04-16T18:27:42.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f915195e4c188272-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.746 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.746 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.746 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.747 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.747 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.747 DEBUG:boto:Method: GET 2024-04-16T18:27:42.747 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:27:42.747 DEBUG:boto:Data: 2024-04-16T18:27:42.747 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.747 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.747 DEBUG:boto:Params: {} 2024-04-16T18:27:42.747 DEBUG:boto:Token: None 2024-04-16T18:27:42.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.752 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007626b2f8f4c6e869-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.752 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.752 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:27:42.752 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.752 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.752 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.752 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.752 DEBUG:boto:Method: GET 2024-04-16T18:27:42.753 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.753 DEBUG:boto:Data: 2024-04-16T18:27:42.753 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.753 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.753 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.753 DEBUG:boto:Params: {} 2024-04-16T18:27:42.753 DEBUG:boto:Token: None 2024-04-16T18:27:42.753 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.753 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY= 2024-04-16T18:27:42.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY=', 'Content-Length': '0'} 2024-04-16T18:27:42.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0e3b0e8855aceed-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.755 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.756 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.756 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.756 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.756 DEBUG:boto:Method: GET 2024-04-16T18:27:42.756 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.756 DEBUG:boto:Data: 2024-04-16T18:27:42.756 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.756 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.756 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.756 DEBUG:boto:Params: {} 2024-04-16T18:27:42.756 DEBUG:boto:Token: None 2024-04-16T18:27:42.757 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.757 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY= 2024-04-16T18:27:42.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY=', 'Content-Length': '0'} 2024-04-16T18:27:42.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b9e619927bb37db-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.802 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.803 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.803 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.803 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.803 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.803 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.803 DEBUG:boto:Data: 2024-04-16T18:27:42.803 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.803 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.803 DEBUG:boto:Params: {} 2024-04-16T18:27:42.804 DEBUG:boto:Token: None 2024-04-16T18:27:42.804 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bGwZ0PlaWguu2gGpYvcvonXb9nI= 2024-04-16T18:27:42.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bGwZ0PlaWguu2gGpYvcvonXb9nI=', 'Content-Length': '0'} 2024-04-16T18:27:42.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049c98941f57fc55c-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.806 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.806 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.806 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.806 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.806 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.806 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.806 DEBUG:boto:Data: 2024-04-16T18:27:42.806 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.806 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.807 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.807 DEBUG:boto:Params: {} 2024-04-16T18:27:42.807 DEBUG:boto:Token: None 2024-04-16T18:27:42.807 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bGwZ0PlaWguu2gGpYvcvonXb9nI= 2024-04-16T18:27:42.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bGwZ0PlaWguu2gGpYvcvonXb9nI=', 'Content-Length': '0'} 2024-04-16T18:27:42.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d22b6dbcf9b8d7b3-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.809 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:27:42.810 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.810 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.810 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.810 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.810 DEBUG:boto:Method: GET 2024-04-16T18:27:42.810 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.810 DEBUG:boto:Data: 2024-04-16T18:27:42.810 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.810 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.810 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.810 DEBUG:boto:Params: {} 2024-04-16T18:27:42.811 DEBUG:boto:Token: None 2024-04-16T18:27:42.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY= 2024-04-16T18:27:42.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY=', 'Content-Length': '0'} 2024-04-16T18:27:42.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ea2a9d977efb608-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.813 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.813 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.813 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.813 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.813 DEBUG:boto:Method: GET 2024-04-16T18:27:42.813 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.814 DEBUG:boto:Data: 2024-04-16T18:27:42.814 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.814 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.814 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.814 DEBUG:boto:Params: {} 2024-04-16T18:27:42.814 DEBUG:boto:Token: None 2024-04-16T18:27:42.814 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:27:42.814 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY= 2024-04-16T18:27:42.814 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WOBk539rZlipvyG4LGLCacF5SZY=', 'Content-Length': '0'} 2024-04-16T18:27:42.816 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1dbdff78d2dbb61-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.816 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.817 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.817 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.817 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.817 DEBUG:boto:Method: GET 2024-04-16T18:27:42.817 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.817 DEBUG:boto:Data: 2024-04-16T18:27:42.817 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.817 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.817 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.817 DEBUG:boto:Params: {} 2024-04-16T18:27:42.817 DEBUG:boto:Token: None 2024-04-16T18:27:42.817 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.818 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.820 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002102744fcc3af2a2-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.820 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.821 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.821 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.821 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.821 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.821 DEBUG:boto:Method: GET 2024-04-16T18:27:42.821 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.821 DEBUG:boto:Data: 2024-04-16T18:27:42.821 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.821 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.821 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.822 DEBUG:boto:Params: {} 2024-04-16T18:27:42.822 DEBUG:boto:Token: None 2024-04-16T18:27:42.822 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.822 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bbfb4de1ef81f756-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.825 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.826 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.826 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.826 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.826 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:27:42.826 DEBUG:boto:Data: 2024-04-16T18:27:42.826 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.826 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.826 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.826 DEBUG:boto:Params: {} 2024-04-16T18:27:42.827 DEBUG:boto:Token: None 2024-04-16T18:27:42.827 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19 2024-04-16T18:27:42.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:50UoenDEcnJQ27heamdXcPLnkWc= 2024-04-16T18:27:42.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:50UoenDEcnJQ27heamdXcPLnkWc=', 'Content-Length': '0'} 2024-04-16T18:27:42.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1babf8ef0044fd4-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.829 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.829 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.829 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.829 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:27:42.829 DEBUG:boto:Data: 2024-04-16T18:27:42.829 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.829 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.829 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.830 DEBUG:boto:Params: {} 2024-04-16T18:27:42.830 DEBUG:boto:Token: None 2024-04-16T18:27:42.830 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19 2024-04-16T18:27:42.830 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:50UoenDEcnJQ27heamdXcPLnkWc= 2024-04-16T18:27:42.830 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:50UoenDEcnJQ27heamdXcPLnkWc=', 'Content-Length': '0'} 2024-04-16T18:27:42.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a044efa59aab8e6-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:27:42.832 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.832 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.833 DEBUG:boto:Method: GET 2024-04-16T18:27:42.833 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:27:42.833 DEBUG:boto:Data: 2024-04-16T18:27:42.833 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.833 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.833 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.833 DEBUG:boto:Params: {} 2024-04-16T18:27:42.833 DEBUG:boto:Token: None 2024-04-16T18:27:42.833 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19 2024-04-16T18:27:42.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ou4CPea1B/u+wDJYCZFQUsPK8Z4= 2024-04-16T18:27:42.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ou4CPea1B/u+wDJYCZFQUsPK8Z4=', 'Content-Length': '0'} 2024-04-16T18:27:42.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd4b1e12a81e4071-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.836 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:27:42.836 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:27:42.836 DEBUG:boto:Method: GET 2024-04-16T18:27:42.836 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:27:42.836 DEBUG:boto:Data: 2024-04-16T18:27:42.836 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.836 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.836 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.836 DEBUG:boto:Params: {} 2024-04-16T18:27:42.837 DEBUG:boto:Token: None 2024-04-16T18:27:42.837 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj19 2024-04-16T18:27:42.837 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ou4CPea1B/u+wDJYCZFQUsPK8Z4= 2024-04-16T18:27:42.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ou4CPea1B/u+wDJYCZFQUsPK8Z4=', 'Content-Length': '0'} 2024-04-16T18:27:42.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000855f768c67443cd0-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.839 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.839 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.839 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.839 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.839 DEBUG:boto:Method: GET 2024-04-16T18:27:42.839 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.839 DEBUG:boto:Data: 2024-04-16T18:27:42.839 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.839 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.839 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.840 DEBUG:boto:Params: {} 2024-04-16T18:27:42.840 DEBUG:boto:Token: None 2024-04-16T18:27:42.840 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f368789851ecb164-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.842 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.843 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.843 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.843 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.843 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.843 DEBUG:boto:Method: GET 2024-04-16T18:27:42.843 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:27:42.843 DEBUG:boto:Data: 2024-04-16T18:27:42.843 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.843 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.844 DEBUG:boto:Params: {} 2024-04-16T18:27:42.844 DEBUG:boto:Token: None 2024-04-16T18:27:42.844 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.847 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000255a568f86691d97-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.847 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.848 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:27:42.848 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.848 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.848 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.848 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.848 DEBUG:boto:Method: GET 2024-04-16T18:27:42.848 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.848 DEBUG:boto:Data: 2024-04-16T18:27:42.848 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.848 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.848 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.849 DEBUG:boto:Params: {} 2024-04-16T18:27:42.849 DEBUG:boto:Token: None 2024-04-16T18:27:42.849 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.849 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU= 2024-04-16T18:27:42.849 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU=', 'Content-Length': '0'} 2024-04-16T18:27:42.851 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e1606f217ed911d-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.894 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.895 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.895 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.895 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.895 DEBUG:boto:Method: GET 2024-04-16T18:27:42.895 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.895 DEBUG:boto:Data: 2024-04-16T18:27:42.895 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.895 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.895 DEBUG:boto:Params: {} 2024-04-16T18:27:42.896 DEBUG:boto:Token: None 2024-04-16T18:27:42.896 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU= 2024-04-16T18:27:42.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU=', 'Content-Length': '0'} 2024-04-16T18:27:42.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000060106714297f778-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.898 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.898 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.898 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.899 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.899 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.899 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.899 DEBUG:boto:Data: 2024-04-16T18:27:42.899 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.899 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.899 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.899 DEBUG:boto:Params: {} 2024-04-16T18:27:42.899 DEBUG:boto:Token: None 2024-04-16T18:27:42.899 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b8UqFGrUKzgem13lViGFWBC1Ozo= 2024-04-16T18:27:42.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b8UqFGrUKzgem13lViGFWBC1Ozo=', 'Content-Length': '0'} 2024-04-16T18:27:42.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000359e585986fc10aa-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.902 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.902 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.902 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.902 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.902 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.902 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.902 DEBUG:boto:Data: 2024-04-16T18:27:42.902 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.902 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.902 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.903 DEBUG:boto:Params: {} 2024-04-16T18:27:42.903 DEBUG:boto:Token: None 2024-04-16T18:27:42.903 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b8UqFGrUKzgem13lViGFWBC1Ozo= 2024-04-16T18:27:42.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b8UqFGrUKzgem13lViGFWBC1Ozo=', 'Content-Length': '0'} 2024-04-16T18:27:42.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a0c7f646ccea383-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.905 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:27:42.905 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.905 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.905 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.905 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.906 DEBUG:boto:Method: GET 2024-04-16T18:27:42.906 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.906 DEBUG:boto:Data: 2024-04-16T18:27:42.906 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.906 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.906 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.906 DEBUG:boto:Params: {} 2024-04-16T18:27:42.906 DEBUG:boto:Token: None 2024-04-16T18:27:42.906 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.906 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU= 2024-04-16T18:27:42.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU=', 'Content-Length': '0'} 2024-04-16T18:27:42.908 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae55a97eba817a13-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.909 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.909 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.909 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.909 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.909 DEBUG:boto:Method: GET 2024-04-16T18:27:42.909 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.909 DEBUG:boto:Data: 2024-04-16T18:27:42.909 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.909 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.909 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.909 DEBUG:boto:Params: {} 2024-04-16T18:27:42.910 DEBUG:boto:Token: None 2024-04-16T18:27:42.910 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:27:42.910 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU= 2024-04-16T18:27:42.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b/HmC/2Jpc6wwc9/mUXjipkqkDU=', 'Content-Length': '0'} 2024-04-16T18:27:42.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007db2354686cbda2-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.912 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.912 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.912 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.912 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.912 DEBUG:boto:Method: GET 2024-04-16T18:27:42.912 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.913 DEBUG:boto:Data: 2024-04-16T18:27:42.913 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.913 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.913 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.913 DEBUG:boto:Params: {} 2024-04-16T18:27:42.913 DEBUG:boto:Token: None 2024-04-16T18:27:42.913 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.913 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.915 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000035ad43beadc10c91-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.916 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.916 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.916 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.916 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.916 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.916 DEBUG:boto:Method: GET 2024-04-16T18:27:42.916 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.917 DEBUG:boto:Data: 2024-04-16T18:27:42.917 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.917 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.917 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.917 DEBUG:boto:Params: {} 2024-04-16T18:27:42.917 DEBUG:boto:Token: None 2024-04-16T18:27:42.917 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.917 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.917 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000196affc199ce4e27-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.921 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.921 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.921 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.921 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.921 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:27:42.922 DEBUG:boto:Data: 2024-04-16T18:27:42.922 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.922 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.922 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.922 DEBUG:boto:Params: {} 2024-04-16T18:27:42.922 DEBUG:boto:Token: None 2024-04-16T18:27:42.922 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22 2024-04-16T18:27:42.922 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FK0Hz3FwxyQ9nWlwSAPPIFBLSXs= 2024-04-16T18:27:42.922 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FK0Hz3FwxyQ9nWlwSAPPIFBLSXs=', 'Content-Length': '0'} 2024-04-16T18:27:42.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000827511c29deffb14-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.924 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.924 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.924 DEBUG:boto:Method: HEAD 2024-04-16T18:27:42.924 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:27:42.925 DEBUG:boto:Data: 2024-04-16T18:27:42.925 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.925 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.925 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.925 DEBUG:boto:Params: {} 2024-04-16T18:27:42.925 DEBUG:boto:Token: None 2024-04-16T18:27:42.925 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22 2024-04-16T18:27:42.925 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FK0Hz3FwxyQ9nWlwSAPPIFBLSXs= 2024-04-16T18:27:42.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FK0Hz3FwxyQ9nWlwSAPPIFBLSXs=', 'Content-Length': '0'} 2024-04-16T18:27:42.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000801e1c6ef1431265-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:27:42.927 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.928 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.928 DEBUG:boto:Method: GET 2024-04-16T18:27:42.928 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:27:42.928 DEBUG:boto:Data: 2024-04-16T18:27:42.928 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.928 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.928 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.928 DEBUG:boto:Params: {} 2024-04-16T18:27:42.928 DEBUG:boto:Token: None 2024-04-16T18:27:42.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22 2024-04-16T18:27:42.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M6Skg3JWMjVvh0y+as4DtEZHqt0= 2024-04-16T18:27:42.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M6Skg3JWMjVvh0y+as4DtEZHqt0=', 'Content-Length': '0'} 2024-04-16T18:27:42.931 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057aefcf0e405d133-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.931 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:27:42.931 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:27:42.931 DEBUG:boto:Method: GET 2024-04-16T18:27:42.931 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:27:42.931 DEBUG:boto:Data: 2024-04-16T18:27:42.931 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.932 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.932 DEBUG:boto:Params: {} 2024-04-16T18:27:42.932 DEBUG:boto:Token: None 2024-04-16T18:27:42.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj22 2024-04-16T18:27:42.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M6Skg3JWMjVvh0y+as4DtEZHqt0= 2024-04-16T18:27:42.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M6Skg3JWMjVvh0y+as4DtEZHqt0=', 'Content-Length': '0'} 2024-04-16T18:27:42.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ab96c381bfc9c15-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.974 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.975 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.975 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.975 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.975 DEBUG:boto:Method: GET 2024-04-16T18:27:42.975 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.975 DEBUG:boto:Data: 2024-04-16T18:27:42.975 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.975 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.975 DEBUG:boto:Params: {} 2024-04-16T18:27:42.975 DEBUG:boto:Token: None 2024-04-16T18:27:42.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b7d8f7dd2baaaec-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.978 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.979 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:42.979 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:42.979 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.979 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.979 DEBUG:boto:Method: GET 2024-04-16T18:27:42.979 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:27:42.979 DEBUG:boto:Data: 2024-04-16T18:27:42.979 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:42.979 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.979 DEBUG:boto:Params: {} 2024-04-16T18:27:42.980 DEBUG:boto:Token: None 2024-04-16T18:27:42.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/ 2024-04-16T18:27:42.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0= 2024-04-16T18:27:42.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:f5L/nbsLWOVwxKjAFOaz7GVxQY0=', 'Content-Length': '0'} 2024-04-16T18:27:42.983 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f63e099aecf22f5-00661ec31e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:42.983 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:42.983 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:27:42.984 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:42.984 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:42.984 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:42.984 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:42.984 DEBUG:boto:Method: GET 2024-04-16T18:27:42.984 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:42.984 DEBUG:boto:Data: 2024-04-16T18:27:42.984 DEBUG:boto:Headers: {} 2024-04-16T18:27:42.984 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:42.984 DEBUG:boto:Port: 8000 2024-04-16T18:27:42.985 DEBUG:boto:Params: {} 2024-04-16T18:27:42.985 DEBUG:boto:Token: None 2024-04-16T18:27:42.985 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:42 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:42.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W5Yn4IKS8wXemSIsGSs2x0DrL/o= 2024-04-16T18:27:42.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W5Yn4IKS8wXemSIsGSs2x0DrL/o=', 'Content-Length': '0'} 2024-04-16T18:27:42.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c8c5d905474beac-00661ec31e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.030 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.030 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.031 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.031 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.031 DEBUG:boto:Method: GET 2024-04-16T18:27:43.031 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.031 DEBUG:boto:Data: 2024-04-16T18:27:43.031 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.031 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.031 DEBUG:boto:Params: {} 2024-04-16T18:27:43.031 DEBUG:boto:Token: None 2024-04-16T18:27:43.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uo/uex9fVViVsvKmCrBw294Rx/4= 2024-04-16T18:27:43.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uo/uex9fVViVsvKmCrBw294Rx/4=', 'Content-Length': '0'} 2024-04-16T18:27:43.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b24b3056037abeee-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.034 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.034 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.034 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.034 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.034 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.035 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.035 DEBUG:boto:Data: 2024-04-16T18:27:43.035 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.035 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.035 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.035 DEBUG:boto:Params: {} 2024-04-16T18:27:43.035 DEBUG:boto:Token: None 2024-04-16T18:27:43.035 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mkCfgjTe+O2aeU0mtrerST46KJI= 2024-04-16T18:27:43.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mkCfgjTe+O2aeU0mtrerST46KJI=', 'Content-Length': '0'} 2024-04-16T18:27:43.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000389d74da70505407-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.037 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.037 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.037 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.038 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.038 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.038 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.038 DEBUG:boto:Data: 2024-04-16T18:27:43.038 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.038 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.038 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.038 DEBUG:boto:Params: {} 2024-04-16T18:27:43.038 DEBUG:boto:Token: None 2024-04-16T18:27:43.038 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mkCfgjTe+O2aeU0mtrerST46KJI= 2024-04-16T18:27:43.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mkCfgjTe+O2aeU0mtrerST46KJI=', 'Content-Length': '0'} 2024-04-16T18:27:43.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001466d11602b708ef-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:27:43.041 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.041 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.041 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.041 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.041 DEBUG:boto:Method: GET 2024-04-16T18:27:43.041 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.041 DEBUG:boto:Data: 2024-04-16T18:27:43.041 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.041 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.041 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.041 DEBUG:boto:Params: {} 2024-04-16T18:27:43.042 DEBUG:boto:Token: None 2024-04-16T18:27:43.042 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.042 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uo/uex9fVViVsvKmCrBw294Rx/4= 2024-04-16T18:27:43.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uo/uex9fVViVsvKmCrBw294Rx/4=', 'Content-Length': '0'} 2024-04-16T18:27:43.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb162ea06e4868fc-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.086 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.086 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.087 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.087 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.087 DEBUG:boto:Method: GET 2024-04-16T18:27:43.087 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.087 DEBUG:boto:Data: 2024-04-16T18:27:43.087 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.087 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.087 DEBUG:boto:Params: {} 2024-04-16T18:27:43.087 DEBUG:boto:Token: None 2024-04-16T18:27:43.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:27:43.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uo/uex9fVViVsvKmCrBw294Rx/4= 2024-04-16T18:27:43.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uo/uex9fVViVsvKmCrBw294Rx/4=', 'Content-Length': '0'} 2024-04-16T18:27:43.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cc69a0df2401e66-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.090 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.090 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.090 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.091 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.091 DEBUG:boto:Method: GET 2024-04-16T18:27:43.091 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.091 DEBUG:boto:Data: 2024-04-16T18:27:43.091 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.091 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.091 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.091 DEBUG:boto:Params: {} 2024-04-16T18:27:43.091 DEBUG:boto:Token: None 2024-04-16T18:27:43.091 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ec41d9bffd826c5-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.094 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.094 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.095 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.095 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.095 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.095 DEBUG:boto:Method: GET 2024-04-16T18:27:43.095 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.095 DEBUG:boto:Data: 2024-04-16T18:27:43.095 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.095 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.095 DEBUG:boto:Params: {} 2024-04-16T18:27:43.096 DEBUG:boto:Token: None 2024-04-16T18:27:43.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090da8b1b345d66ed-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.100 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.100 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.100 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.100 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.101 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:27:43.101 DEBUG:boto:Data: 2024-04-16T18:27:43.101 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.101 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.101 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.101 DEBUG:boto:Params: {} 2024-04-16T18:27:43.101 DEBUG:boto:Token: None 2024-04-16T18:27:43.101 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23 2024-04-16T18:27:43.101 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yIurU1lF5pnlrKwNUPZkc4bebUA= 2024-04-16T18:27:43.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yIurU1lF5pnlrKwNUPZkc4bebUA=', 'Content-Length': '0'} 2024-04-16T18:27:43.103 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000491fc4c2e4dffaf8-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.104 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.104 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.104 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.104 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:27:43.104 DEBUG:boto:Data: 2024-04-16T18:27:43.104 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.104 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.104 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.104 DEBUG:boto:Params: {} 2024-04-16T18:27:43.105 DEBUG:boto:Token: None 2024-04-16T18:27:43.105 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23 2024-04-16T18:27:43.105 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yIurU1lF5pnlrKwNUPZkc4bebUA= 2024-04-16T18:27:43.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yIurU1lF5pnlrKwNUPZkc4bebUA=', 'Content-Length': '0'} 2024-04-16T18:27:43.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039cf62ff559c1af3-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:27:43.107 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.107 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.107 DEBUG:boto:Method: GET 2024-04-16T18:27:43.107 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:27:43.107 DEBUG:boto:Data: 2024-04-16T18:27:43.107 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.108 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.108 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.108 DEBUG:boto:Params: {} 2024-04-16T18:27:43.108 DEBUG:boto:Token: None 2024-04-16T18:27:43.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23 2024-04-16T18:27:43.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y0KpaOIRjYJGJd5oeiq1O5Gi4iI= 2024-04-16T18:27:43.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y0KpaOIRjYJGJd5oeiq1O5Gi4iI=', 'Content-Length': '0'} 2024-04-16T18:27:43.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d55f3acf68a299d5-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.150 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:27:43.151 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:27:43.151 DEBUG:boto:Method: GET 2024-04-16T18:27:43.151 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:27:43.151 DEBUG:boto:Data: 2024-04-16T18:27:43.151 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.151 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.151 DEBUG:boto:Params: {} 2024-04-16T18:27:43.151 DEBUG:boto:Token: None 2024-04-16T18:27:43.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj23 2024-04-16T18:27:43.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:y0KpaOIRjYJGJd5oeiq1O5Gi4iI= 2024-04-16T18:27:43.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:y0KpaOIRjYJGJd5oeiq1O5Gi4iI=', 'Content-Length': '0'} 2024-04-16T18:27:43.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077d9b7f30e12486b-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.154 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.154 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.154 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.154 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.154 DEBUG:boto:Method: GET 2024-04-16T18:27:43.154 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.154 DEBUG:boto:Data: 2024-04-16T18:27:43.154 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.154 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.154 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.155 DEBUG:boto:Params: {} 2024-04-16T18:27:43.155 DEBUG:boto:Token: None 2024-04-16T18:27:43.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.158 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019f0102ed7ad16d7-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.158 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.158 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.158 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.158 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.158 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.159 DEBUG:boto:Method: GET 2024-04-16T18:27:43.159 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:27:43.159 DEBUG:boto:Data: 2024-04-16T18:27:43.159 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.159 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.159 DEBUG:boto:Params: {} 2024-04-16T18:27:43.159 DEBUG:boto:Token: None 2024-04-16T18:27:43.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.163 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000538303a62ebe5c3d-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.163 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.163 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:27:43.164 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.164 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.164 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.164 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.164 DEBUG:boto:Method: GET 2024-04-16T18:27:43.164 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.164 DEBUG:boto:Data: 2024-04-16T18:27:43.164 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.164 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.164 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.164 DEBUG:boto:Params: {} 2024-04-16T18:27:43.165 DEBUG:boto:Token: None 2024-04-16T18:27:43.165 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.165 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw= 2024-04-16T18:27:43.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw=', 'Content-Length': '0'} 2024-04-16T18:27:43.167 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aadf33c79c06caa0-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.210 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.211 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.211 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.211 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.211 DEBUG:boto:Method: GET 2024-04-16T18:27:43.211 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.211 DEBUG:boto:Data: 2024-04-16T18:27:43.211 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.211 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.211 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.212 DEBUG:boto:Params: {} 2024-04-16T18:27:43.212 DEBUG:boto:Token: None 2024-04-16T18:27:43.212 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw= 2024-04-16T18:27:43.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw=', 'Content-Length': '0'} 2024-04-16T18:27:43.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ceeb88da57272c9-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.215 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.215 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.215 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.215 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.216 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.216 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.216 DEBUG:boto:Data: 2024-04-16T18:27:43.216 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.216 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.216 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.216 DEBUG:boto:Params: {} 2024-04-16T18:27:43.216 DEBUG:boto:Token: None 2024-04-16T18:27:43.217 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.217 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VEc3rUHDSNhpgXB76KPNQ/X5J1o= 2024-04-16T18:27:43.217 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VEc3rUHDSNhpgXB76KPNQ/X5J1o=', 'Content-Length': '0'} 2024-04-16T18:27:43.219 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f6049bbd791ecc5-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.219 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.219 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.219 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.219 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.219 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.220 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.220 DEBUG:boto:Data: 2024-04-16T18:27:43.220 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.220 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.220 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.220 DEBUG:boto:Params: {} 2024-04-16T18:27:43.220 DEBUG:boto:Token: None 2024-04-16T18:27:43.220 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VEc3rUHDSNhpgXB76KPNQ/X5J1o= 2024-04-16T18:27:43.221 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VEc3rUHDSNhpgXB76KPNQ/X5J1o=', 'Content-Length': '0'} 2024-04-16T18:27:43.223 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000776f8f409cae76-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.223 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:27:43.223 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.223 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.223 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.224 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.224 DEBUG:boto:Method: GET 2024-04-16T18:27:43.224 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.224 DEBUG:boto:Data: 2024-04-16T18:27:43.224 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.224 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.224 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.224 DEBUG:boto:Params: {} 2024-04-16T18:27:43.224 DEBUG:boto:Token: None 2024-04-16T18:27:43.225 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.225 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw= 2024-04-16T18:27:43.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw=', 'Content-Length': '0'} 2024-04-16T18:27:43.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ab23b6debefdb6c-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.270 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.271 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.271 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.271 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.271 DEBUG:boto:Method: GET 2024-04-16T18:27:43.271 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.271 DEBUG:boto:Data: 2024-04-16T18:27:43.271 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.272 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.272 DEBUG:boto:Params: {} 2024-04-16T18:27:43.272 DEBUG:boto:Token: None 2024-04-16T18:27:43.272 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:27:43.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw= 2024-04-16T18:27:43.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IVaSbDerDIITsM80qfpIiqPQCLw=', 'Content-Length': '0'} 2024-04-16T18:27:43.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae7e32f1048eccd6-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.275 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.275 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.275 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.275 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.275 DEBUG:boto:Method: GET 2024-04-16T18:27:43.275 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.275 DEBUG:boto:Data: 2024-04-16T18:27:43.276 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.276 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.276 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.276 DEBUG:boto:Params: {} 2024-04-16T18:27:43.276 DEBUG:boto:Token: None 2024-04-16T18:27:43.276 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.279 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d0e6cc0a7d44d5f-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.279 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.279 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.279 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.279 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.280 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.280 DEBUG:boto:Method: GET 2024-04-16T18:27:43.280 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.280 DEBUG:boto:Data: 2024-04-16T18:27:43.280 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.280 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.280 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.280 DEBUG:boto:Params: {} 2024-04-16T18:27:43.280 DEBUG:boto:Token: None 2024-04-16T18:27:43.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.281 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.284 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009ea64f81f6c4efda-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.285 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.285 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.285 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.285 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.285 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:27:43.285 DEBUG:boto:Data: 2024-04-16T18:27:43.285 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.286 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.286 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.286 DEBUG:boto:Params: {} 2024-04-16T18:27:43.286 DEBUG:boto:Token: None 2024-04-16T18:27:43.286 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29 2024-04-16T18:27:43.286 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:78aZ7G8qNfy/3fG3gnAKLCsEPTY= 2024-04-16T18:27:43.286 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:78aZ7G8qNfy/3fG3gnAKLCsEPTY=', 'Content-Length': '0'} 2024-04-16T18:27:43.288 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e67037e60931bad-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.288 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.288 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.288 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.289 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:27:43.289 DEBUG:boto:Data: 2024-04-16T18:27:43.289 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.289 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.289 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.289 DEBUG:boto:Params: {} 2024-04-16T18:27:43.289 DEBUG:boto:Token: None 2024-04-16T18:27:43.289 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29 2024-04-16T18:27:43.289 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:78aZ7G8qNfy/3fG3gnAKLCsEPTY= 2024-04-16T18:27:43.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:78aZ7G8qNfy/3fG3gnAKLCsEPTY=', 'Content-Length': '0'} 2024-04-16T18:27:43.292 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1b847a64bf1ff2d-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.292 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:27:43.292 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.292 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.293 DEBUG:boto:Method: GET 2024-04-16T18:27:43.293 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:27:43.293 DEBUG:boto:Data: 2024-04-16T18:27:43.293 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.293 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.293 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.293 DEBUG:boto:Params: {} 2024-04-16T18:27:43.293 DEBUG:boto:Token: None 2024-04-16T18:27:43.293 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29 2024-04-16T18:27:43.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ao+SBZ6UU9hjfZo6sYfLTWfeDig= 2024-04-16T18:27:43.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ao+SBZ6UU9hjfZo6sYfLTWfeDig=', 'Content-Length': '0'} 2024-04-16T18:27:43.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029c61f607554218a-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.338 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:27:43.339 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:27:43.339 DEBUG:boto:Method: GET 2024-04-16T18:27:43.339 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:27:43.339 DEBUG:boto:Data: 2024-04-16T18:27:43.339 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.339 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.339 DEBUG:boto:Params: {} 2024-04-16T18:27:43.339 DEBUG:boto:Token: None 2024-04-16T18:27:43.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj29 2024-04-16T18:27:43.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ao+SBZ6UU9hjfZo6sYfLTWfeDig= 2024-04-16T18:27:43.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ao+SBZ6UU9hjfZo6sYfLTWfeDig=', 'Content-Length': '0'} 2024-04-16T18:27:43.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022962effd976fb20-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.342 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.342 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.342 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.343 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.343 DEBUG:boto:Method: GET 2024-04-16T18:27:43.343 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.343 DEBUG:boto:Data: 2024-04-16T18:27:43.343 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.343 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.343 DEBUG:boto:Params: {} 2024-04-16T18:27:43.343 DEBUG:boto:Token: None 2024-04-16T18:27:43.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.346 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000458527533b9e24e5-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.386 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.387 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.387 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.387 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.387 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.387 DEBUG:boto:Method: GET 2024-04-16T18:27:43.387 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:27:43.387 DEBUG:boto:Data: 2024-04-16T18:27:43.387 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.388 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.388 DEBUG:boto:Params: {} 2024-04-16T18:27:43.388 DEBUG:boto:Token: None 2024-04-16T18:27:43.388 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.392 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000689dc0c1f73eb1a1-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.392 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.392 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:27:43.392 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.392 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.393 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.393 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.393 DEBUG:boto:Method: GET 2024-04-16T18:27:43.393 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.393 DEBUG:boto:Data: 2024-04-16T18:27:43.393 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.393 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.393 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.393 DEBUG:boto:Params: {} 2024-04-16T18:27:43.393 DEBUG:boto:Token: None 2024-04-16T18:27:43.394 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.394 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI= 2024-04-16T18:27:43.394 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI=', 'Content-Length': '0'} 2024-04-16T18:27:43.396 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a00e46a9124b9937-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.438 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.439 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.439 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.439 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.439 DEBUG:boto:Method: GET 2024-04-16T18:27:43.439 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.439 DEBUG:boto:Data: 2024-04-16T18:27:43.439 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.439 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.439 DEBUG:boto:Params: {} 2024-04-16T18:27:43.439 DEBUG:boto:Token: None 2024-04-16T18:27:43.440 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI= 2024-04-16T18:27:43.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI=', 'Content-Length': '0'} 2024-04-16T18:27:43.442 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006dfa71fef2bc29c3-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.442 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.442 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.442 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.443 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.443 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.443 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.443 DEBUG:boto:Data: 2024-04-16T18:27:43.443 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.443 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.443 DEBUG:boto:Params: {} 2024-04-16T18:27:43.443 DEBUG:boto:Token: None 2024-04-16T18:27:43.444 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afnYqwItpmoKWRm0kOmgmfH2c2g= 2024-04-16T18:27:43.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afnYqwItpmoKWRm0kOmgmfH2c2g=', 'Content-Length': '0'} 2024-04-16T18:27:43.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002408a943d91f2044-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.446 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.446 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.446 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.446 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.447 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.447 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.447 DEBUG:boto:Data: 2024-04-16T18:27:43.447 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.447 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.447 DEBUG:boto:Params: {} 2024-04-16T18:27:43.447 DEBUG:boto:Token: None 2024-04-16T18:27:43.447 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.447 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:afnYqwItpmoKWRm0kOmgmfH2c2g= 2024-04-16T18:27:43.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:afnYqwItpmoKWRm0kOmgmfH2c2g=', 'Content-Length': '0'} 2024-04-16T18:27:43.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081d972094e37e255-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.450 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:27:43.450 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.450 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.450 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.450 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.450 DEBUG:boto:Method: GET 2024-04-16T18:27:43.451 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.451 DEBUG:boto:Data: 2024-04-16T18:27:43.451 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.451 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.451 DEBUG:boto:Params: {} 2024-04-16T18:27:43.451 DEBUG:boto:Token: None 2024-04-16T18:27:43.451 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI= 2024-04-16T18:27:43.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI=', 'Content-Length': '0'} 2024-04-16T18:27:43.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011f75368412ce9c9-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.498 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.499 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.499 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.499 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.499 DEBUG:boto:Method: GET 2024-04-16T18:27:43.499 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.499 DEBUG:boto:Data: 2024-04-16T18:27:43.499 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.499 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.499 DEBUG:boto:Params: {} 2024-04-16T18:27:43.500 DEBUG:boto:Token: None 2024-04-16T18:27:43.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:27:43.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI= 2024-04-16T18:27:43.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX6xY3ce8DtAGyKAb4uW0+euQTI=', 'Content-Length': '0'} 2024-04-16T18:27:43.502 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018b43e606005c462-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.502 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.503 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.503 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.503 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.503 DEBUG:boto:Method: GET 2024-04-16T18:27:43.503 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.503 DEBUG:boto:Data: 2024-04-16T18:27:43.503 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.503 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.503 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.503 DEBUG:boto:Params: {} 2024-04-16T18:27:43.504 DEBUG:boto:Token: None 2024-04-16T18:27:43.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.506 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051aad5b586bf0154-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.550 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.551 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.551 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.551 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.551 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.551 DEBUG:boto:Method: GET 2024-04-16T18:27:43.551 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.551 DEBUG:boto:Data: 2024-04-16T18:27:43.552 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.552 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.552 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.552 DEBUG:boto:Params: {} 2024-04-16T18:27:43.552 DEBUG:boto:Token: None 2024-04-16T18:27:43.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.556 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf6c1a9ac6e0670e-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.556 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.557 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.557 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.557 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.557 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:27:43.557 DEBUG:boto:Data: 2024-04-16T18:27:43.557 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.557 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.557 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.558 DEBUG:boto:Params: {} 2024-04-16T18:27:43.558 DEBUG:boto:Token: None 2024-04-16T18:27:43.558 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31 2024-04-16T18:27:43.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1iWrQLsKxTrs2o3g0IJj7TzKioU= 2024-04-16T18:27:43.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1iWrQLsKxTrs2o3g0IJj7TzKioU=', 'Content-Length': '0'} 2024-04-16T18:27:43.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e464858c75693c85-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.561 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.561 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.561 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.561 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:27:43.561 DEBUG:boto:Data: 2024-04-16T18:27:43.561 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.561 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.561 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.562 DEBUG:boto:Params: {} 2024-04-16T18:27:43.562 DEBUG:boto:Token: None 2024-04-16T18:27:43.562 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31 2024-04-16T18:27:43.562 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1iWrQLsKxTrs2o3g0IJj7TzKioU= 2024-04-16T18:27:43.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1iWrQLsKxTrs2o3g0IJj7TzKioU=', 'Content-Length': '0'} 2024-04-16T18:27:43.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056cdff44812d36ef-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.564 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:27:43.565 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.565 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.565 DEBUG:boto:Method: GET 2024-04-16T18:27:43.565 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:27:43.565 DEBUG:boto:Data: 2024-04-16T18:27:43.565 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.565 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.565 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.565 DEBUG:boto:Params: {} 2024-04-16T18:27:43.565 DEBUG:boto:Token: None 2024-04-16T18:27:43.566 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31 2024-04-16T18:27:43.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:edR/ZPmvuUQYp0qwBT7UcUTVkZA= 2024-04-16T18:27:43.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:edR/ZPmvuUQYp0qwBT7UcUTVkZA=', 'Content-Length': '0'} 2024-04-16T18:27:43.568 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011bb7e3511c7ee28-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.610 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:27:43.611 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:27:43.611 DEBUG:boto:Method: GET 2024-04-16T18:27:43.611 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:27:43.611 DEBUG:boto:Data: 2024-04-16T18:27:43.611 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.611 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.611 DEBUG:boto:Params: {} 2024-04-16T18:27:43.611 DEBUG:boto:Token: None 2024-04-16T18:27:43.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj31 2024-04-16T18:27:43.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:edR/ZPmvuUQYp0qwBT7UcUTVkZA= 2024-04-16T18:27:43.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:edR/ZPmvuUQYp0qwBT7UcUTVkZA=', 'Content-Length': '0'} 2024-04-16T18:27:43.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000010ca3a24563758d-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.614 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.614 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.614 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.615 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.615 DEBUG:boto:Method: GET 2024-04-16T18:27:43.615 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.615 DEBUG:boto:Data: 2024-04-16T18:27:43.615 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.615 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.615 DEBUG:boto:Params: {} 2024-04-16T18:27:43.615 DEBUG:boto:Token: None 2024-04-16T18:27:43.616 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffd37abdaaf48d78-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.619 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.619 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.619 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.619 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.619 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.619 DEBUG:boto:Method: GET 2024-04-16T18:27:43.620 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:27:43.620 DEBUG:boto:Data: 2024-04-16T18:27:43.620 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.620 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.620 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.620 DEBUG:boto:Params: {} 2024-04-16T18:27:43.620 DEBUG:boto:Token: None 2024-04-16T18:27:43.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.624 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012207fd2dece403c-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.624 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.625 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:27:43.625 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.625 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.625 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.625 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.625 DEBUG:boto:Method: GET 2024-04-16T18:27:43.625 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.625 DEBUG:boto:Data: 2024-04-16T18:27:43.625 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.625 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.626 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.626 DEBUG:boto:Params: {} 2024-04-16T18:27:43.626 DEBUG:boto:Token: None 2024-04-16T18:27:43.626 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.626 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA= 2024-04-16T18:27:43.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA=', 'Content-Length': '0'} 2024-04-16T18:27:43.628 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023cb25b04d029ce2-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.674 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.675 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.675 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.675 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.675 DEBUG:boto:Method: GET 2024-04-16T18:27:43.675 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.675 DEBUG:boto:Data: 2024-04-16T18:27:43.675 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.675 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.676 DEBUG:boto:Params: {} 2024-04-16T18:27:43.676 DEBUG:boto:Token: None 2024-04-16T18:27:43.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA= 2024-04-16T18:27:43.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA=', 'Content-Length': '0'} 2024-04-16T18:27:43.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000035c17b618c141b4-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.679 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.679 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.679 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.679 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.679 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.679 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.679 DEBUG:boto:Data: 2024-04-16T18:27:43.680 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.680 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.680 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.680 DEBUG:boto:Params: {} 2024-04-16T18:27:43.680 DEBUG:boto:Token: None 2024-04-16T18:27:43.680 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tFxee3cbv47XzcfUfSeYtna8lgY= 2024-04-16T18:27:43.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tFxee3cbv47XzcfUfSeYtna8lgY=', 'Content-Length': '0'} 2024-04-16T18:27:43.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d44e84418c6329b1-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.683 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.683 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.683 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.683 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.683 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.683 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.683 DEBUG:boto:Data: 2024-04-16T18:27:43.684 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.684 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.684 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.684 DEBUG:boto:Params: {} 2024-04-16T18:27:43.684 DEBUG:boto:Token: None 2024-04-16T18:27:43.684 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tFxee3cbv47XzcfUfSeYtna8lgY= 2024-04-16T18:27:43.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tFxee3cbv47XzcfUfSeYtna8lgY=', 'Content-Length': '0'} 2024-04-16T18:27:43.687 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027a49c62319c0649-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:27:43.687 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.687 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.687 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.687 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.687 DEBUG:boto:Method: GET 2024-04-16T18:27:43.688 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.688 DEBUG:boto:Data: 2024-04-16T18:27:43.688 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.688 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.688 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.688 DEBUG:boto:Params: {} 2024-04-16T18:27:43.688 DEBUG:boto:Token: None 2024-04-16T18:27:43.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA= 2024-04-16T18:27:43.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA=', 'Content-Length': '0'} 2024-04-16T18:27:43.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c5ecb64157d526e-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.734 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.735 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.735 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.735 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.735 DEBUG:boto:Method: GET 2024-04-16T18:27:43.735 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.735 DEBUG:boto:Data: 2024-04-16T18:27:43.735 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.735 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.736 DEBUG:boto:Params: {} 2024-04-16T18:27:43.736 DEBUG:boto:Token: None 2024-04-16T18:27:43.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:27:43.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA= 2024-04-16T18:27:43.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DzrftfYGRYNoh4siJkAyijo9ICA=', 'Content-Length': '0'} 2024-04-16T18:27:43.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efecaea777cdfb27-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.738 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.739 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.739 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.739 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.739 DEBUG:boto:Method: GET 2024-04-16T18:27:43.739 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.739 DEBUG:boto:Data: 2024-04-16T18:27:43.739 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.739 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.740 DEBUG:boto:Params: {} 2024-04-16T18:27:43.740 DEBUG:boto:Token: None 2024-04-16T18:27:43.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a14dc6f16d4b874e-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.786 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.787 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.787 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.787 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.787 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.787 DEBUG:boto:Method: GET 2024-04-16T18:27:43.787 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.787 DEBUG:boto:Data: 2024-04-16T18:27:43.788 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.788 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.788 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.788 DEBUG:boto:Params: {} 2024-04-16T18:27:43.788 DEBUG:boto:Token: None 2024-04-16T18:27:43.788 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.792 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000715d93bb27a72194-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.792 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.793 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.793 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.793 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.793 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:27:43.793 DEBUG:boto:Data: 2024-04-16T18:27:43.793 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.793 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.793 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.794 DEBUG:boto:Params: {} 2024-04-16T18:27:43.794 DEBUG:boto:Token: None 2024-04-16T18:27:43.794 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33 2024-04-16T18:27:43.794 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hJt6wqyj9RkXC7ez9A8cotzs26o= 2024-04-16T18:27:43.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hJt6wqyj9RkXC7ez9A8cotzs26o=', 'Content-Length': '0'} 2024-04-16T18:27:43.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f2a821fa2e00ccf-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.796 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.797 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.797 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.797 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:27:43.797 DEBUG:boto:Data: 2024-04-16T18:27:43.797 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.797 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.797 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.797 DEBUG:boto:Params: {} 2024-04-16T18:27:43.797 DEBUG:boto:Token: None 2024-04-16T18:27:43.798 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33 2024-04-16T18:27:43.798 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hJt6wqyj9RkXC7ez9A8cotzs26o= 2024-04-16T18:27:43.798 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hJt6wqyj9RkXC7ez9A8cotzs26o=', 'Content-Length': '0'} 2024-04-16T18:27:43.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d448fea037692622-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:27:43.800 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.801 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.801 DEBUG:boto:Method: GET 2024-04-16T18:27:43.801 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:27:43.801 DEBUG:boto:Data: 2024-04-16T18:27:43.801 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.801 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.801 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.801 DEBUG:boto:Params: {} 2024-04-16T18:27:43.801 DEBUG:boto:Token: None 2024-04-16T18:27:43.802 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33 2024-04-16T18:27:43.802 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ea8cXoc7MM91cDwGIfFBxPragOU= 2024-04-16T18:27:43.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ea8cXoc7MM91cDwGIfFBxPragOU=', 'Content-Length': '0'} 2024-04-16T18:27:43.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060d682dec2fb5b63-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.846 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:27:43.847 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:27:43.847 DEBUG:boto:Method: GET 2024-04-16T18:27:43.847 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:27:43.847 DEBUG:boto:Data: 2024-04-16T18:27:43.847 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.847 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.848 DEBUG:boto:Params: {} 2024-04-16T18:27:43.848 DEBUG:boto:Token: None 2024-04-16T18:27:43.848 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj33 2024-04-16T18:27:43.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ea8cXoc7MM91cDwGIfFBxPragOU= 2024-04-16T18:27:43.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ea8cXoc7MM91cDwGIfFBxPragOU=', 'Content-Length': '0'} 2024-04-16T18:27:43.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6defe1b588103c0-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.851 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.851 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.851 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.851 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.851 DEBUG:boto:Method: GET 2024-04-16T18:27:43.851 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.851 DEBUG:boto:Data: 2024-04-16T18:27:43.852 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.852 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.852 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.852 DEBUG:boto:Params: {} 2024-04-16T18:27:43.852 DEBUG:boto:Token: None 2024-04-16T18:27:43.852 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.855 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079b5a27720a5e221-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.855 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.855 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:43.856 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:43.856 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.856 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.856 DEBUG:boto:Method: GET 2024-04-16T18:27:43.856 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:27:43.856 DEBUG:boto:Data: 2024-04-16T18:27:43.856 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.856 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.856 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.857 DEBUG:boto:Params: {} 2024-04-16T18:27:43.857 DEBUG:boto:Token: None 2024-04-16T18:27:43.857 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/ 2024-04-16T18:27:43.857 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I= 2024-04-16T18:27:43.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EDPfQcUxmuRfG8yP005yin3fE7I=', 'Content-Length': '0'} 2024-04-16T18:27:43.860 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000673e300aaa90f4ad-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.902 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:43.903 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:27:43.903 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:43.903 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:43.903 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.903 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.903 DEBUG:boto:Method: GET 2024-04-16T18:27:43.904 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.904 DEBUG:boto:Data: 2024-04-16T18:27:43.904 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.904 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.904 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.904 DEBUG:boto:Params: {} 2024-04-16T18:27:43.904 DEBUG:boto:Token: None 2024-04-16T18:27:43.904 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.905 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9dLtgehnIZURz+2IVz1KhkY2h0w= 2024-04-16T18:27:43.905 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9dLtgehnIZURz+2IVz1KhkY2h0w=', 'Content-Length': '0'} 2024-04-16T18:27:43.907 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd1d75663d9b38e5-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.950 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:43.951 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:43.951 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.951 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.951 DEBUG:boto:Method: GET 2024-04-16T18:27:43.951 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.951 DEBUG:boto:Data: 2024-04-16T18:27:43.952 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.952 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.952 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.952 DEBUG:boto:Params: {} 2024-04-16T18:27:43.952 DEBUG:boto:Token: None 2024-04-16T18:27:43.952 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.953 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9dLtgehnIZURz+2IVz1KhkY2h0w= 2024-04-16T18:27:43.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9dLtgehnIZURz+2IVz1KhkY2h0w=', 'Content-Length': '0'} 2024-04-16T18:27:43.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7d95351fa78692f-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.955 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:43.955 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:43.955 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.955 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.956 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.956 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.956 DEBUG:boto:Data: 2024-04-16T18:27:43.956 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.956 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.956 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.956 DEBUG:boto:Params: {} 2024-04-16T18:27:43.957 DEBUG:boto:Token: None 2024-04-16T18:27:43.957 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w68v/ssU9Rnpe0/38+Eqk4Ldmp8= 2024-04-16T18:27:43.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w68v/ssU9Rnpe0/38+Eqk4Ldmp8=', 'Content-Length': '0'} 2024-04-16T18:27:43.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003882d22d475ec6ea-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.959 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:43.959 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:43.959 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.960 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.960 DEBUG:boto:Method: HEAD 2024-04-16T18:27:43.960 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.960 DEBUG:boto:Data: 2024-04-16T18:27:43.960 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.960 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:43.960 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.960 DEBUG:boto:Params: {} 2024-04-16T18:27:43.960 DEBUG:boto:Token: None 2024-04-16T18:27:43.961 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w68v/ssU9Rnpe0/38+Eqk4Ldmp8= 2024-04-16T18:27:43.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w68v/ssU9Rnpe0/38+Eqk4Ldmp8=', 'Content-Length': '0'} 2024-04-16T18:27:43.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aad71746f318cbf3-00661ec31f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:43.964 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:27:43.964 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:43.964 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:43.964 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.964 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.964 DEBUG:boto:Method: GET 2024-04-16T18:27:43.964 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.965 DEBUG:boto:Data: 2024-04-16T18:27:43.965 DEBUG:boto:Headers: {} 2024-04-16T18:27:43.965 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:43.965 DEBUG:boto:Port: 8000 2024-04-16T18:27:43.965 DEBUG:boto:Params: {} 2024-04-16T18:27:43.965 DEBUG:boto:Token: None 2024-04-16T18:27:43.965 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:43 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:43.965 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9dLtgehnIZURz+2IVz1KhkY2h0w= 2024-04-16T18:27:43.966 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9dLtgehnIZURz+2IVz1KhkY2h0w=', 'Content-Length': '0'} 2024-04-16T18:27:43.967 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1953dd1b3c8d666-00661ec31f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.010 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:44.010 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:44.011 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:44.011 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:27:44.011 DEBUG:boto:Method: GET 2024-04-16T18:27:44.011 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:44.011 DEBUG:boto:Data: 2024-04-16T18:27:44.011 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.011 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.011 DEBUG:boto:Params: {} 2024-04-16T18:27:44.012 DEBUG:boto:Token: None 2024-04-16T18:27:44.012 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:27:44.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:co4abJaHIi4yi73Ky3CE8zV3KOc= 2024-04-16T18:27:44.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:co4abJaHIi4yi73Ky3CE8zV3KOc=', 'Content-Length': '0'} 2024-04-16T18:27:44.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffbf69b7e0718fa7-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.014 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.014 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.014 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.015 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.015 DEBUG:boto:Method: GET 2024-04-16T18:27:44.015 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.015 DEBUG:boto:Data: 2024-04-16T18:27:44.015 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.015 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.015 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.015 DEBUG:boto:Params: {} 2024-04-16T18:27:44.015 DEBUG:boto:Token: None 2024-04-16T18:27:44.015 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.018 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e1ef6e46d4ca8df-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.018 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.019 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.019 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.019 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.019 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.019 DEBUG:boto:Method: GET 2024-04-16T18:27:44.019 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.019 DEBUG:boto:Data: 2024-04-16T18:27:44.019 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.019 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.020 DEBUG:boto:Params: {} 2024-04-16T18:27:44.020 DEBUG:boto:Token: None 2024-04-16T18:27:44.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.024 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004492e45c7d52a52c-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.024 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.024 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:44.025 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:44.025 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.025 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:27:44.025 DEBUG:boto:Data: 2024-04-16T18:27:44.025 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.025 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.025 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.025 DEBUG:boto:Params: {} 2024-04-16T18:27:44.025 DEBUG:boto:Token: None 2024-04-16T18:27:44.025 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj34 2024-04-16T18:27:44.026 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hVDVF5ZeUmnyxjxKKBEIzrf7Aww= 2024-04-16T18:27:44.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hVDVF5ZeUmnyxjxKKBEIzrf7Aww=', 'Content-Length': '0'} 2024-04-16T18:27:44.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd7a083bd7807899-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.028 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:44.028 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:44.028 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.028 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:27:44.028 DEBUG:boto:Data: 2024-04-16T18:27:44.028 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.028 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.028 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.029 DEBUG:boto:Params: {} 2024-04-16T18:27:44.029 DEBUG:boto:Token: None 2024-04-16T18:27:44.029 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj34 2024-04-16T18:27:44.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hVDVF5ZeUmnyxjxKKBEIzrf7Aww= 2024-04-16T18:27:44.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hVDVF5ZeUmnyxjxKKBEIzrf7Aww=', 'Content-Length': '0'} 2024-04-16T18:27:44.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000808ac8872cbd5b6a-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.031 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:27:44.031 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:44.032 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:44.032 DEBUG:boto:Method: GET 2024-04-16T18:27:44.032 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:27:44.032 DEBUG:boto:Data: 2024-04-16T18:27:44.032 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.032 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.032 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.032 DEBUG:boto:Params: {} 2024-04-16T18:27:44.032 DEBUG:boto:Token: None 2024-04-16T18:27:44.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj34 2024-04-16T18:27:44.033 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9XaaA3gbFmqJBjgdzaTz/04skTc= 2024-04-16T18:27:44.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9XaaA3gbFmqJBjgdzaTz/04skTc=', 'Content-Length': '0'} 2024-04-16T18:27:44.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd9cc756c95697f4-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.078 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:27:44.078 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:27:44.079 DEBUG:boto:Method: GET 2024-04-16T18:27:44.079 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:27:44.079 DEBUG:boto:Data: 2024-04-16T18:27:44.079 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.079 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.079 DEBUG:boto:Params: {} 2024-04-16T18:27:44.079 DEBUG:boto:Token: None 2024-04-16T18:27:44.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj34 2024-04-16T18:27:44.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9XaaA3gbFmqJBjgdzaTz/04skTc= 2024-04-16T18:27:44.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9XaaA3gbFmqJBjgdzaTz/04skTc=', 'Content-Length': '0'} 2024-04-16T18:27:44.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030c923ae87675147-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.081 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.082 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.082 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.082 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.082 DEBUG:boto:Method: GET 2024-04-16T18:27:44.082 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.082 DEBUG:boto:Data: 2024-04-16T18:27:44.082 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.082 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.082 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.082 DEBUG:boto:Params: {} 2024-04-16T18:27:44.082 DEBUG:boto:Token: None 2024-04-16T18:27:44.083 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.083 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.085 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000055a166d5584858a5-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.085 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.086 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.086 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.086 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.086 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.086 DEBUG:boto:Method: GET 2024-04-16T18:27:44.086 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:27:44.086 DEBUG:boto:Data: 2024-04-16T18:27:44.086 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.086 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.086 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.086 DEBUG:boto:Params: {} 2024-04-16T18:27:44.087 DEBUG:boto:Token: None 2024-04-16T18:27:44.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.092 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000158f4c180f5c9eb3-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.092 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:27:44.092 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.092 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.092 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.092 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.093 DEBUG:boto:Method: GET 2024-04-16T18:27:44.093 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.093 DEBUG:boto:Data: 2024-04-16T18:27:44.093 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.093 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.093 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.093 DEBUG:boto:Params: {} 2024-04-16T18:27:44.093 DEBUG:boto:Token: None 2024-04-16T18:27:44.093 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.093 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg= 2024-04-16T18:27:44.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg=', 'Content-Length': '0'} 2024-04-16T18:27:44.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088bd906e07b66199-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.138 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.138 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.138 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.139 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.139 DEBUG:boto:Method: GET 2024-04-16T18:27:44.139 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.139 DEBUG:boto:Data: 2024-04-16T18:27:44.139 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.139 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.139 DEBUG:boto:Params: {} 2024-04-16T18:27:44.139 DEBUG:boto:Token: None 2024-04-16T18:27:44.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg= 2024-04-16T18:27:44.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg=', 'Content-Length': '0'} 2024-04-16T18:27:44.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bc066a7fa280fdd-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.142 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.142 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.142 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.142 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.142 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.142 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.142 DEBUG:boto:Data: 2024-04-16T18:27:44.142 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.142 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.142 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.143 DEBUG:boto:Params: {} 2024-04-16T18:27:44.143 DEBUG:boto:Token: None 2024-04-16T18:27:44.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cSJX40u9m/9lt0gF+JldEuy3co= 2024-04-16T18:27:44.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cSJX40u9m/9lt0gF+JldEuy3co=', 'Content-Length': '0'} 2024-04-16T18:27:44.145 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000971dca50ed2654f6-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.145 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.145 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.145 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.145 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.145 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.145 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.145 DEBUG:boto:Data: 2024-04-16T18:27:44.145 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.146 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.146 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.146 DEBUG:boto:Params: {} 2024-04-16T18:27:44.146 DEBUG:boto:Token: None 2024-04-16T18:27:44.146 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.146 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cSJX40u9m/9lt0gF+JldEuy3co= 2024-04-16T18:27:44.146 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cSJX40u9m/9lt0gF+JldEuy3co=', 'Content-Length': '0'} 2024-04-16T18:27:44.148 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000462bf6d74806adb8-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.148 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:27:44.148 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.148 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.149 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.149 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.149 DEBUG:boto:Method: GET 2024-04-16T18:27:44.149 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.149 DEBUG:boto:Data: 2024-04-16T18:27:44.149 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.149 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.149 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.149 DEBUG:boto:Params: {} 2024-04-16T18:27:44.149 DEBUG:boto:Token: None 2024-04-16T18:27:44.149 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.150 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg= 2024-04-16T18:27:44.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg=', 'Content-Length': '0'} 2024-04-16T18:27:44.151 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d71609e673965f1-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.194 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.194 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.194 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.195 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.195 DEBUG:boto:Method: GET 2024-04-16T18:27:44.195 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.195 DEBUG:boto:Data: 2024-04-16T18:27:44.195 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.195 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.195 DEBUG:boto:Params: {} 2024-04-16T18:27:44.195 DEBUG:boto:Token: None 2024-04-16T18:27:44.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:27:44.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg= 2024-04-16T18:27:44.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5sTJtPdF++Mwf5xLFcH+GF8I7vg=', 'Content-Length': '0'} 2024-04-16T18:27:44.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3fc82d43df45b54-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.198 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.198 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.198 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.198 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.198 DEBUG:boto:Method: GET 2024-04-16T18:27:44.198 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.198 DEBUG:boto:Data: 2024-04-16T18:27:44.198 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.198 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.199 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.199 DEBUG:boto:Params: {} 2024-04-16T18:27:44.199 DEBUG:boto:Token: None 2024-04-16T18:27:44.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdb670bbd2702dd7-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.201 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.202 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.202 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.202 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.202 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.202 DEBUG:boto:Method: GET 2024-04-16T18:27:44.202 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.202 DEBUG:boto:Data: 2024-04-16T18:27:44.202 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.202 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.203 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.203 DEBUG:boto:Params: {} 2024-04-16T18:27:44.203 DEBUG:boto:Token: None 2024-04-16T18:27:44.203 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f408b51eff38cff-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.206 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.207 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.207 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.207 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.207 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:27:44.207 DEBUG:boto:Data: 2024-04-16T18:27:44.207 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.207 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.207 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.207 DEBUG:boto:Params: {} 2024-04-16T18:27:44.207 DEBUG:boto:Token: None 2024-04-16T18:27:44.207 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38 2024-04-16T18:27:44.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L+7+sCRKYrezQZCV/1wY7vRWT3c= 2024-04-16T18:27:44.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L+7+sCRKYrezQZCV/1wY7vRWT3c=', 'Content-Length': '0'} 2024-04-16T18:27:44.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000020c4039dc6840de-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.210 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.210 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.210 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.210 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:27:44.210 DEBUG:boto:Data: 2024-04-16T18:27:44.210 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.210 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.210 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.211 DEBUG:boto:Params: {} 2024-04-16T18:27:44.211 DEBUG:boto:Token: None 2024-04-16T18:27:44.211 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38 2024-04-16T18:27:44.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L+7+sCRKYrezQZCV/1wY7vRWT3c= 2024-04-16T18:27:44.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L+7+sCRKYrezQZCV/1wY7vRWT3c=', 'Content-Length': '0'} 2024-04-16T18:27:44.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051806525c2e1092e-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.213 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:27:44.213 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.213 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.213 DEBUG:boto:Method: GET 2024-04-16T18:27:44.213 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:27:44.213 DEBUG:boto:Data: 2024-04-16T18:27:44.213 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.213 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.213 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.213 DEBUG:boto:Params: {} 2024-04-16T18:27:44.214 DEBUG:boto:Token: None 2024-04-16T18:27:44.214 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38 2024-04-16T18:27:44.214 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lmDn3toYtg7ppm9GzuaNmRU/UNU= 2024-04-16T18:27:44.214 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lmDn3toYtg7ppm9GzuaNmRU/UNU=', 'Content-Length': '0'} 2024-04-16T18:27:44.216 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5100bab2c9f3b0d-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.258 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:27:44.258 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:27:44.258 DEBUG:boto:Method: GET 2024-04-16T18:27:44.259 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:27:44.259 DEBUG:boto:Data: 2024-04-16T18:27:44.259 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.259 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.259 DEBUG:boto:Params: {} 2024-04-16T18:27:44.259 DEBUG:boto:Token: None 2024-04-16T18:27:44.259 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj38 2024-04-16T18:27:44.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lmDn3toYtg7ppm9GzuaNmRU/UNU= 2024-04-16T18:27:44.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lmDn3toYtg7ppm9GzuaNmRU/UNU=', 'Content-Length': '0'} 2024-04-16T18:27:44.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7d735bfe4ba26f9-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.262 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.262 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.262 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.262 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.262 DEBUG:boto:Method: GET 2024-04-16T18:27:44.262 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.262 DEBUG:boto:Data: 2024-04-16T18:27:44.262 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.262 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.263 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.263 DEBUG:boto:Params: {} 2024-04-16T18:27:44.263 DEBUG:boto:Token: None 2024-04-16T18:27:44.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6a7449b0478820f-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.265 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.266 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.266 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.266 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.266 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.266 DEBUG:boto:Method: GET 2024-04-16T18:27:44.266 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:27:44.266 DEBUG:boto:Data: 2024-04-16T18:27:44.266 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.266 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.267 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.267 DEBUG:boto:Params: {} 2024-04-16T18:27:44.267 DEBUG:boto:Token: None 2024-04-16T18:27:44.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.270 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ce50adfeec613a0-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.271 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.271 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:27:44.271 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.271 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.271 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.271 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.271 DEBUG:boto:Method: GET 2024-04-16T18:27:44.272 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.272 DEBUG:boto:Data: 2024-04-16T18:27:44.272 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.272 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.272 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.272 DEBUG:boto:Params: {} 2024-04-16T18:27:44.272 DEBUG:boto:Token: None 2024-04-16T18:27:44.272 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g= 2024-04-16T18:27:44.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g=', 'Content-Length': '0'} 2024-04-16T18:27:44.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f08fb3b21281d057-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.314 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.315 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.315 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.315 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.315 DEBUG:boto:Method: GET 2024-04-16T18:27:44.315 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.315 DEBUG:boto:Data: 2024-04-16T18:27:44.315 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.315 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.315 DEBUG:boto:Params: {} 2024-04-16T18:27:44.315 DEBUG:boto:Token: None 2024-04-16T18:27:44.316 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.316 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g= 2024-04-16T18:27:44.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g=', 'Content-Length': '0'} 2024-04-16T18:27:44.318 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdce7c588755118e-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.318 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.318 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.318 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.318 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.318 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.318 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.319 DEBUG:boto:Data: 2024-04-16T18:27:44.319 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.319 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.319 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.319 DEBUG:boto:Params: {} 2024-04-16T18:27:44.319 DEBUG:boto:Token: None 2024-04-16T18:27:44.319 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ubB4O20cgC1nOy4CuCvGW1tPJw= 2024-04-16T18:27:44.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ubB4O20cgC1nOy4CuCvGW1tPJw=', 'Content-Length': '0'} 2024-04-16T18:27:44.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ef54f585a8490ab-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.321 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.321 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.321 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.321 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.322 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.322 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.322 DEBUG:boto:Data: 2024-04-16T18:27:44.322 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.322 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.322 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.322 DEBUG:boto:Params: {} 2024-04-16T18:27:44.322 DEBUG:boto:Token: None 2024-04-16T18:27:44.322 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.322 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ubB4O20cgC1nOy4CuCvGW1tPJw= 2024-04-16T18:27:44.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ubB4O20cgC1nOy4CuCvGW1tPJw=', 'Content-Length': '0'} 2024-04-16T18:27:44.324 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001515cd62c0675ee5-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.324 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:27:44.325 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.325 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.325 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.325 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.325 DEBUG:boto:Method: GET 2024-04-16T18:27:44.325 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.325 DEBUG:boto:Data: 2024-04-16T18:27:44.325 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.325 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.325 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.325 DEBUG:boto:Params: {} 2024-04-16T18:27:44.325 DEBUG:boto:Token: None 2024-04-16T18:27:44.326 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.326 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g= 2024-04-16T18:27:44.326 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g=', 'Content-Length': '0'} 2024-04-16T18:27:44.327 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ddc3e3a558459e0-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.370 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.370 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.370 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.371 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.371 DEBUG:boto:Method: GET 2024-04-16T18:27:44.371 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.371 DEBUG:boto:Data: 2024-04-16T18:27:44.371 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.371 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.371 DEBUG:boto:Params: {} 2024-04-16T18:27:44.371 DEBUG:boto:Token: None 2024-04-16T18:27:44.372 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:27:44.372 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g= 2024-04-16T18:27:44.372 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xd4lY0elcke/IdwSHkkI+GdBV+g=', 'Content-Length': '0'} 2024-04-16T18:27:44.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a7c6b7d52f8a798-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.374 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.374 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.374 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.374 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.374 DEBUG:boto:Method: GET 2024-04-16T18:27:44.374 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.374 DEBUG:boto:Data: 2024-04-16T18:27:44.374 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.374 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.375 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.375 DEBUG:boto:Params: {} 2024-04-16T18:27:44.375 DEBUG:boto:Token: None 2024-04-16T18:27:44.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.377 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbab5d3e904350f7-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.377 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.378 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.378 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.378 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.378 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.378 DEBUG:boto:Method: GET 2024-04-16T18:27:44.378 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.378 DEBUG:boto:Data: 2024-04-16T18:27:44.378 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.378 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.379 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.379 DEBUG:boto:Params: {} 2024-04-16T18:27:44.379 DEBUG:boto:Token: None 2024-04-16T18:27:44.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.382 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000438e97fdff003550-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.382 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.383 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.383 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.383 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.383 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:27:44.383 DEBUG:boto:Data: 2024-04-16T18:27:44.383 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.383 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.383 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.383 DEBUG:boto:Params: {} 2024-04-16T18:27:44.383 DEBUG:boto:Token: None 2024-04-16T18:27:44.383 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44 2024-04-16T18:27:44.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c78231U1ZuamQdJ/tQjXn8+o9Mc= 2024-04-16T18:27:44.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c78231U1ZuamQdJ/tQjXn8+o9Mc=', 'Content-Length': '0'} 2024-04-16T18:27:44.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d4216ee86d8752a-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.386 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.386 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.386 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.386 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:27:44.386 DEBUG:boto:Data: 2024-04-16T18:27:44.386 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.386 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.386 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.387 DEBUG:boto:Params: {} 2024-04-16T18:27:44.387 DEBUG:boto:Token: None 2024-04-16T18:27:44.387 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44 2024-04-16T18:27:44.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c78231U1ZuamQdJ/tQjXn8+o9Mc= 2024-04-16T18:27:44.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c78231U1ZuamQdJ/tQjXn8+o9Mc=', 'Content-Length': '0'} 2024-04-16T18:27:44.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cc7c41f0b1cfa51-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:27:44.389 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.389 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.389 DEBUG:boto:Method: GET 2024-04-16T18:27:44.389 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:27:44.389 DEBUG:boto:Data: 2024-04-16T18:27:44.389 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.389 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.389 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.389 DEBUG:boto:Params: {} 2024-04-16T18:27:44.390 DEBUG:boto:Token: None 2024-04-16T18:27:44.390 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44 2024-04-16T18:27:44.390 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mdFz0mzL4bPBTEbJazWyNDXpeQ0= 2024-04-16T18:27:44.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mdFz0mzL4bPBTEbJazWyNDXpeQ0=', 'Content-Length': '0'} 2024-04-16T18:27:44.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1c6f0fef0d78e60-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.434 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:27:44.434 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:27:44.435 DEBUG:boto:Method: GET 2024-04-16T18:27:44.435 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:27:44.435 DEBUG:boto:Data: 2024-04-16T18:27:44.435 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.435 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.435 DEBUG:boto:Params: {} 2024-04-16T18:27:44.435 DEBUG:boto:Token: None 2024-04-16T18:27:44.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj44 2024-04-16T18:27:44.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mdFz0mzL4bPBTEbJazWyNDXpeQ0= 2024-04-16T18:27:44.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mdFz0mzL4bPBTEbJazWyNDXpeQ0=', 'Content-Length': '0'} 2024-04-16T18:27:44.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab1f3f1ff4585bf7-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.438 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.438 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.438 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.438 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.438 DEBUG:boto:Method: GET 2024-04-16T18:27:44.438 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.438 DEBUG:boto:Data: 2024-04-16T18:27:44.438 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.438 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.439 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.439 DEBUG:boto:Params: {} 2024-04-16T18:27:44.439 DEBUG:boto:Token: None 2024-04-16T18:27:44.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e09fd8de3a3202b6-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.442 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.442 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.442 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.442 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.443 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.443 DEBUG:boto:Method: GET 2024-04-16T18:27:44.443 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:27:44.443 DEBUG:boto:Data: 2024-04-16T18:27:44.443 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.443 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.443 DEBUG:boto:Params: {} 2024-04-16T18:27:44.443 DEBUG:boto:Token: None 2024-04-16T18:27:44.443 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.447 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0441aa78d56d108-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.447 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.447 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:27:44.448 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.448 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.448 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.448 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.448 DEBUG:boto:Method: GET 2024-04-16T18:27:44.448 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.448 DEBUG:boto:Data: 2024-04-16T18:27:44.448 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.448 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.448 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.448 DEBUG:boto:Params: {} 2024-04-16T18:27:44.448 DEBUG:boto:Token: None 2024-04-16T18:27:44.449 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.449 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM= 2024-04-16T18:27:44.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM=', 'Content-Length': '0'} 2024-04-16T18:27:44.451 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079071b719f1b0957-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.494 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.494 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.495 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.495 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.495 DEBUG:boto:Method: GET 2024-04-16T18:27:44.495 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.495 DEBUG:boto:Data: 2024-04-16T18:27:44.495 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.495 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.495 DEBUG:boto:Params: {} 2024-04-16T18:27:44.495 DEBUG:boto:Token: None 2024-04-16T18:27:44.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM= 2024-04-16T18:27:44.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM=', 'Content-Length': '0'} 2024-04-16T18:27:44.498 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028dc9270aeb2933a-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.498 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.501 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.501 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.501 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.502 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.502 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.502 DEBUG:boto:Data: 2024-04-16T18:27:44.502 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.502 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.502 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.502 DEBUG:boto:Params: {} 2024-04-16T18:27:44.502 DEBUG:boto:Token: None 2024-04-16T18:27:44.502 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.502 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BrG3AB7zxbrXRdURTab8I/fNVEY= 2024-04-16T18:27:44.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BrG3AB7zxbrXRdURTab8I/fNVEY=', 'Content-Length': '0'} 2024-04-16T18:27:44.504 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed3066f3d4b063f6-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.505 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.505 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.505 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.505 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.505 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.505 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.505 DEBUG:boto:Data: 2024-04-16T18:27:44.505 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.505 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.505 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.506 DEBUG:boto:Params: {} 2024-04-16T18:27:44.506 DEBUG:boto:Token: None 2024-04-16T18:27:44.506 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.506 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BrG3AB7zxbrXRdURTab8I/fNVEY= 2024-04-16T18:27:44.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BrG3AB7zxbrXRdURTab8I/fNVEY=', 'Content-Length': '0'} 2024-04-16T18:27:44.508 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf87ff7d1510367e-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.509 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:27:44.509 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.509 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.509 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.509 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.509 DEBUG:boto:Method: GET 2024-04-16T18:27:44.509 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.509 DEBUG:boto:Data: 2024-04-16T18:27:44.509 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.510 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.510 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.510 DEBUG:boto:Params: {} 2024-04-16T18:27:44.510 DEBUG:boto:Token: None 2024-04-16T18:27:44.510 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM= 2024-04-16T18:27:44.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM=', 'Content-Length': '0'} 2024-04-16T18:27:44.512 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b75a17a49a26cc4f-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.554 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.554 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.554 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.555 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.555 DEBUG:boto:Method: GET 2024-04-16T18:27:44.555 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.555 DEBUG:boto:Data: 2024-04-16T18:27:44.555 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.555 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.555 DEBUG:boto:Params: {} 2024-04-16T18:27:44.555 DEBUG:boto:Token: None 2024-04-16T18:27:44.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:27:44.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM= 2024-04-16T18:27:44.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WejGaLGrM4kKSEFl+Vg7m5q+hTM=', 'Content-Length': '0'} 2024-04-16T18:27:44.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021a81e0941f7ef6b-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.558 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.558 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.558 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.558 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.559 DEBUG:boto:Method: GET 2024-04-16T18:27:44.559 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.559 DEBUG:boto:Data: 2024-04-16T18:27:44.559 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.559 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.559 DEBUG:boto:Params: {} 2024-04-16T18:27:44.559 DEBUG:boto:Token: None 2024-04-16T18:27:44.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066f3e814124503a0-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.562 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.562 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.563 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.563 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.563 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.563 DEBUG:boto:Method: GET 2024-04-16T18:27:44.563 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.563 DEBUG:boto:Data: 2024-04-16T18:27:44.563 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.563 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.563 DEBUG:boto:Params: {} 2024-04-16T18:27:44.563 DEBUG:boto:Token: None 2024-04-16T18:27:44.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.567 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7a1ca43ff48a0ea-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.567 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.568 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.568 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.568 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.568 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:27:44.568 DEBUG:boto:Data: 2024-04-16T18:27:44.568 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.568 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.568 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.568 DEBUG:boto:Params: {} 2024-04-16T18:27:44.568 DEBUG:boto:Token: None 2024-04-16T18:27:44.569 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46 2024-04-16T18:27:44.569 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rUWhOX1UYHCHEo45xuJ40ak4Lfw= 2024-04-16T18:27:44.569 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rUWhOX1UYHCHEo45xuJ40ak4Lfw=', 'Content-Length': '0'} 2024-04-16T18:27:44.571 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007215977a06c2f487-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.571 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.571 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.571 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.571 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:27:44.571 DEBUG:boto:Data: 2024-04-16T18:27:44.572 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.572 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.572 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.572 DEBUG:boto:Params: {} 2024-04-16T18:27:44.572 DEBUG:boto:Token: None 2024-04-16T18:27:44.572 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46 2024-04-16T18:27:44.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rUWhOX1UYHCHEo45xuJ40ak4Lfw= 2024-04-16T18:27:44.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rUWhOX1UYHCHEo45xuJ40ak4Lfw=', 'Content-Length': '0'} 2024-04-16T18:27:44.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060342a2e00ab6638-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.574 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:27:44.574 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.575 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.575 DEBUG:boto:Method: GET 2024-04-16T18:27:44.575 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:27:44.575 DEBUG:boto:Data: 2024-04-16T18:27:44.575 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.575 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.575 DEBUG:boto:Params: {} 2024-04-16T18:27:44.575 DEBUG:boto:Token: None 2024-04-16T18:27:44.575 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46 2024-04-16T18:27:44.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W92Puo8xiT5xFUz+O6pknQbYvM8= 2024-04-16T18:27:44.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W92Puo8xiT5xFUz+O6pknQbYvM8=', 'Content-Length': '0'} 2024-04-16T18:27:44.578 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8064764485b8871-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.618 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:27:44.618 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:27:44.618 DEBUG:boto:Method: GET 2024-04-16T18:27:44.619 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:27:44.619 DEBUG:boto:Data: 2024-04-16T18:27:44.619 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.619 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.619 DEBUG:boto:Params: {} 2024-04-16T18:27:44.619 DEBUG:boto:Token: None 2024-04-16T18:27:44.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj46 2024-04-16T18:27:44.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:W92Puo8xiT5xFUz+O6pknQbYvM8= 2024-04-16T18:27:44.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:W92Puo8xiT5xFUz+O6pknQbYvM8=', 'Content-Length': '0'} 2024-04-16T18:27:44.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a44419a6d4d2534f-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.622 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.622 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.622 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.622 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.622 DEBUG:boto:Method: GET 2024-04-16T18:27:44.622 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.622 DEBUG:boto:Data: 2024-04-16T18:27:44.622 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.623 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.623 DEBUG:boto:Params: {} 2024-04-16T18:27:44.623 DEBUG:boto:Token: None 2024-04-16T18:27:44.623 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.625 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000668d2f6de4166f95-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.666 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.667 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.667 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.667 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.667 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.667 DEBUG:boto:Method: GET 2024-04-16T18:27:44.667 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:27:44.667 DEBUG:boto:Data: 2024-04-16T18:27:44.667 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.668 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.668 DEBUG:boto:Params: {} 2024-04-16T18:27:44.668 DEBUG:boto:Token: None 2024-04-16T18:27:44.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9c9a6eae4b74cb0-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.672 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:27:44.672 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.672 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.672 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.672 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.672 DEBUG:boto:Method: GET 2024-04-16T18:27:44.672 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.673 DEBUG:boto:Data: 2024-04-16T18:27:44.673 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.673 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.673 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.673 DEBUG:boto:Params: {} 2024-04-16T18:27:44.673 DEBUG:boto:Token: None 2024-04-16T18:27:44.673 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c= 2024-04-16T18:27:44.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c=', 'Content-Length': '0'} 2024-04-16T18:27:44.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af417d06abeb3855-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.718 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.718 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.719 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.719 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.719 DEBUG:boto:Method: GET 2024-04-16T18:27:44.719 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.719 DEBUG:boto:Data: 2024-04-16T18:27:44.719 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.719 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.719 DEBUG:boto:Params: {} 2024-04-16T18:27:44.719 DEBUG:boto:Token: None 2024-04-16T18:27:44.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c= 2024-04-16T18:27:44.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c=', 'Content-Length': '0'} 2024-04-16T18:27:44.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c509f14b8b5cbcec-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.722 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.722 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.722 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.723 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.723 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.723 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.723 DEBUG:boto:Data: 2024-04-16T18:27:44.723 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.723 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.723 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.723 DEBUG:boto:Params: {} 2024-04-16T18:27:44.723 DEBUG:boto:Token: None 2024-04-16T18:27:44.723 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvDT5SJ0lHYHEdv/YXPRPg5v8Js= 2024-04-16T18:27:44.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvDT5SJ0lHYHEdv/YXPRPg5v8Js=', 'Content-Length': '0'} 2024-04-16T18:27:44.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007abd2577c4db02d4-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.726 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.726 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.726 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.726 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.726 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.727 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.727 DEBUG:boto:Data: 2024-04-16T18:27:44.727 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.727 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.727 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.727 DEBUG:boto:Params: {} 2024-04-16T18:27:44.727 DEBUG:boto:Token: None 2024-04-16T18:27:44.727 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KvDT5SJ0lHYHEdv/YXPRPg5v8Js= 2024-04-16T18:27:44.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KvDT5SJ0lHYHEdv/YXPRPg5v8Js=', 'Content-Length': '0'} 2024-04-16T18:27:44.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001e85eccf5ae5037-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:27:44.730 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.730 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.730 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.730 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.730 DEBUG:boto:Method: GET 2024-04-16T18:27:44.730 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.730 DEBUG:boto:Data: 2024-04-16T18:27:44.730 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.730 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.731 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.731 DEBUG:boto:Params: {} 2024-04-16T18:27:44.731 DEBUG:boto:Token: None 2024-04-16T18:27:44.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.731 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c= 2024-04-16T18:27:44.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c=', 'Content-Length': '0'} 2024-04-16T18:27:44.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000605ce9bb6677ec23-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.774 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.774 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.775 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.775 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.775 DEBUG:boto:Method: GET 2024-04-16T18:27:44.775 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.775 DEBUG:boto:Data: 2024-04-16T18:27:44.775 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.775 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.775 DEBUG:boto:Params: {} 2024-04-16T18:27:44.775 DEBUG:boto:Token: None 2024-04-16T18:27:44.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:27:44.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c= 2024-04-16T18:27:44.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0qdFUz4/YY0y+3saWQnQkF0c5c=', 'Content-Length': '0'} 2024-04-16T18:27:44.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064b2888b777c8a5b-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.778 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.778 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.778 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.778 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.778 DEBUG:boto:Method: GET 2024-04-16T18:27:44.779 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.779 DEBUG:boto:Data: 2024-04-16T18:27:44.779 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.779 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.779 DEBUG:boto:Params: {} 2024-04-16T18:27:44.779 DEBUG:boto:Token: None 2024-04-16T18:27:44.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4f632538aeeb191-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.823 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.824 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.824 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.824 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.824 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.825 DEBUG:boto:Method: GET 2024-04-16T18:27:44.825 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.825 DEBUG:boto:Data: 2024-04-16T18:27:44.825 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.825 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.825 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.825 DEBUG:boto:Params: {} 2024-04-16T18:27:44.826 DEBUG:boto:Token: None 2024-04-16T18:27:44.826 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.830 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a2377bb6c85ad9d5-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.830 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.831 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.831 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.831 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.831 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:27:44.832 DEBUG:boto:Data: 2024-04-16T18:27:44.832 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.832 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.832 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.832 DEBUG:boto:Params: {} 2024-04-16T18:27:44.833 DEBUG:boto:Token: None 2024-04-16T18:27:44.833 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51 2024-04-16T18:27:44.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZkqEoxNPo9Q35qYSEAdfV2nxxT8= 2024-04-16T18:27:44.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZkqEoxNPo9Q35qYSEAdfV2nxxT8=', 'Content-Length': '0'} 2024-04-16T18:27:44.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c537e3169b83ab3-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.836 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.836 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.836 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.836 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:27:44.836 DEBUG:boto:Data: 2024-04-16T18:27:44.836 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.837 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.837 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.837 DEBUG:boto:Params: {} 2024-04-16T18:27:44.837 DEBUG:boto:Token: None 2024-04-16T18:27:44.837 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51 2024-04-16T18:27:44.837 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZkqEoxNPo9Q35qYSEAdfV2nxxT8= 2024-04-16T18:27:44.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZkqEoxNPo9Q35qYSEAdfV2nxxT8=', 'Content-Length': '0'} 2024-04-16T18:27:44.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003984a2707f774450-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.839 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:27:44.840 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.840 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.840 DEBUG:boto:Method: GET 2024-04-16T18:27:44.840 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:27:44.840 DEBUG:boto:Data: 2024-04-16T18:27:44.840 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.840 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.840 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.840 DEBUG:boto:Params: {} 2024-04-16T18:27:44.841 DEBUG:boto:Token: None 2024-04-16T18:27:44.841 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51 2024-04-16T18:27:44.841 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GtWh8cMbg+rKyNewlpAgkVCjNIA= 2024-04-16T18:27:44.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GtWh8cMbg+rKyNewlpAgkVCjNIA=', 'Content-Length': '0'} 2024-04-16T18:27:44.843 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074be9b88c8b1d098-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.886 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:27:44.886 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:27:44.887 DEBUG:boto:Method: GET 2024-04-16T18:27:44.887 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:27:44.887 DEBUG:boto:Data: 2024-04-16T18:27:44.887 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.887 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.887 DEBUG:boto:Params: {} 2024-04-16T18:27:44.887 DEBUG:boto:Token: None 2024-04-16T18:27:44.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj51 2024-04-16T18:27:44.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GtWh8cMbg+rKyNewlpAgkVCjNIA= 2024-04-16T18:27:44.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GtWh8cMbg+rKyNewlpAgkVCjNIA=', 'Content-Length': '0'} 2024-04-16T18:27:44.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043c1031a5a627f9b-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.890 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.890 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.890 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.890 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.890 DEBUG:boto:Method: GET 2024-04-16T18:27:44.890 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.890 DEBUG:boto:Data: 2024-04-16T18:27:44.890 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.890 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.891 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.891 DEBUG:boto:Params: {} 2024-04-16T18:27:44.891 DEBUG:boto:Token: None 2024-04-16T18:27:44.891 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.893 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ceac3ce3e1006f9-00661ec320-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.934 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.935 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:44.935 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:44.935 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.935 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.935 DEBUG:boto:Method: GET 2024-04-16T18:27:44.935 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:27:44.935 DEBUG:boto:Data: 2024-04-16T18:27:44.935 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.935 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.935 DEBUG:boto:Params: {} 2024-04-16T18:27:44.936 DEBUG:boto:Token: None 2024-04-16T18:27:44.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/ 2024-04-16T18:27:44.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo= 2024-04-16T18:27:44.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UDlXsPk74owwjMeO/gKwQZCmGTo=', 'Content-Length': '0'} 2024-04-16T18:27:44.939 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ce9c5f6fbe2044c-00661ec320-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.939 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:44.940 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:27:44.940 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:44.940 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:44.940 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.940 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.940 DEBUG:boto:Method: GET 2024-04-16T18:27:44.940 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.940 DEBUG:boto:Data: 2024-04-16T18:27:44.940 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.940 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.940 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.941 DEBUG:boto:Params: {} 2024-04-16T18:27:44.941 DEBUG:boto:Token: None 2024-04-16T18:27:44.941 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.941 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:INU+Q8x1lQ9cfExIjxiNSElDZeI= 2024-04-16T18:27:44.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:INU+Q8x1lQ9cfExIjxiNSElDZeI=', 'Content-Length': '0'} 2024-04-16T18:27:44.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f8b4d85e6f05cbd-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.986 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:44.986 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:44.987 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.987 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.987 DEBUG:boto:Method: GET 2024-04-16T18:27:44.987 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.987 DEBUG:boto:Data: 2024-04-16T18:27:44.987 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.987 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.987 DEBUG:boto:Params: {} 2024-04-16T18:27:44.987 DEBUG:boto:Token: None 2024-04-16T18:27:44.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:INU+Q8x1lQ9cfExIjxiNSElDZeI= 2024-04-16T18:27:44.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:INU+Q8x1lQ9cfExIjxiNSElDZeI=', 'Content-Length': '0'} 2024-04-16T18:27:44.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0bddff740812686-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.990 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:44.990 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:44.990 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.991 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.991 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.991 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.991 DEBUG:boto:Data: 2024-04-16T18:27:44.991 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.991 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.991 DEBUG:boto:Params: {} 2024-04-16T18:27:44.991 DEBUG:boto:Token: None 2024-04-16T18:27:44.991 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1GwlnC5WapFSSufxo0GwZbs5f1E= 2024-04-16T18:27:44.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1GwlnC5WapFSSufxo0GwZbs5f1E=', 'Content-Length': '0'} 2024-04-16T18:27:44.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006428d44b58716da8-00661ec320-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.994 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:44.994 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:44.995 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.995 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.995 DEBUG:boto:Method: HEAD 2024-04-16T18:27:44.995 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.995 DEBUG:boto:Data: 2024-04-16T18:27:44.995 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:44.995 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.995 DEBUG:boto:Params: {} 2024-04-16T18:27:44.995 DEBUG:boto:Token: None 2024-04-16T18:27:44.996 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1GwlnC5WapFSSufxo0GwZbs5f1E= 2024-04-16T18:27:44.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1GwlnC5WapFSSufxo0GwZbs5f1E=', 'Content-Length': '0'} 2024-04-16T18:27:44.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2823de61f554a5d-00661ec320-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:44.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:27:44.998 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:44.998 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:44.998 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.998 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.999 DEBUG:boto:Method: GET 2024-04-16T18:27:44.999 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.999 DEBUG:boto:Data: 2024-04-16T18:27:44.999 DEBUG:boto:Headers: {} 2024-04-16T18:27:44.999 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:44.999 DEBUG:boto:Port: 8000 2024-04-16T18:27:44.999 DEBUG:boto:Params: {} 2024-04-16T18:27:44.999 DEBUG:boto:Token: None 2024-04-16T18:27:44.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:44 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:44.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:INU+Q8x1lQ9cfExIjxiNSElDZeI= 2024-04-16T18:27:45.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:INU+Q8x1lQ9cfExIjxiNSElDZeI=', 'Content-Length': '0'} 2024-04-16T18:27:45.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e0399b0a4b1779b-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.042 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:45.042 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:45.043 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:45.043 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:27:45.043 DEBUG:boto:Method: GET 2024-04-16T18:27:45.043 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:45.043 DEBUG:boto:Data: 2024-04-16T18:27:45.043 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.043 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.043 DEBUG:boto:Params: {} 2024-04-16T18:27:45.043 DEBUG:boto:Token: None 2024-04-16T18:27:45.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:27:45.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SJuvn2bPbcZNly4pfbRsLZBubP4= 2024-04-16T18:27:45.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SJuvn2bPbcZNly4pfbRsLZBubP4=', 'Content-Length': '0'} 2024-04-16T18:27:45.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec656231b6917b6c-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.046 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.046 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.046 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.046 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.047 DEBUG:boto:Method: GET 2024-04-16T18:27:45.047 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.047 DEBUG:boto:Data: 2024-04-16T18:27:45.047 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.047 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.047 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.047 DEBUG:boto:Params: {} 2024-04-16T18:27:45.047 DEBUG:boto:Token: None 2024-04-16T18:27:45.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce10fa57c10687a6-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.090 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.091 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.091 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.091 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.091 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.091 DEBUG:boto:Method: GET 2024-04-16T18:27:45.091 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.091 DEBUG:boto:Data: 2024-04-16T18:27:45.091 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.091 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.092 DEBUG:boto:Params: {} 2024-04-16T18:27:45.092 DEBUG:boto:Token: None 2024-04-16T18:27:45.092 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.095 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd01e3ffda3b5b2f-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.095 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.095 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:45.096 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:45.096 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.096 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:27:45.096 DEBUG:boto:Data: 2024-04-16T18:27:45.096 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.096 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.096 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.096 DEBUG:boto:Params: {} 2024-04-16T18:27:45.096 DEBUG:boto:Token: None 2024-04-16T18:27:45.096 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj55 2024-04-16T18:27:45.097 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0O1ELul3swHtP8nbN16YyPKAlHs= 2024-04-16T18:27:45.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0O1ELul3swHtP8nbN16YyPKAlHs=', 'Content-Length': '0'} 2024-04-16T18:27:45.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000169bac82b2473fb5-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.099 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:45.099 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:45.099 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.099 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:27:45.099 DEBUG:boto:Data: 2024-04-16T18:27:45.099 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.100 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.100 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.100 DEBUG:boto:Params: {} 2024-04-16T18:27:45.100 DEBUG:boto:Token: None 2024-04-16T18:27:45.100 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj55 2024-04-16T18:27:45.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0O1ELul3swHtP8nbN16YyPKAlHs= 2024-04-16T18:27:45.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0O1ELul3swHtP8nbN16YyPKAlHs=', 'Content-Length': '0'} 2024-04-16T18:27:45.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005800a2a5436b1534-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.103 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:27:45.103 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:45.103 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:45.103 DEBUG:boto:Method: GET 2024-04-16T18:27:45.103 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:27:45.103 DEBUG:boto:Data: 2024-04-16T18:27:45.104 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.104 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.104 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.104 DEBUG:boto:Params: {} 2024-04-16T18:27:45.104 DEBUG:boto:Token: None 2024-04-16T18:27:45.104 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj55 2024-04-16T18:27:45.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQAUFkpoma3qXwUn2UtvWm/89qo= 2024-04-16T18:27:45.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQAUFkpoma3qXwUn2UtvWm/89qo=', 'Content-Length': '0'} 2024-04-16T18:27:45.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073d0e21a5e16aa33-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.150 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:27:45.150 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:27:45.151 DEBUG:boto:Method: GET 2024-04-16T18:27:45.151 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:27:45.151 DEBUG:boto:Data: 2024-04-16T18:27:45.151 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.151 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.151 DEBUG:boto:Params: {} 2024-04-16T18:27:45.151 DEBUG:boto:Token: None 2024-04-16T18:27:45.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj55 2024-04-16T18:27:45.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQAUFkpoma3qXwUn2UtvWm/89qo= 2024-04-16T18:27:45.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQAUFkpoma3qXwUn2UtvWm/89qo=', 'Content-Length': '0'} 2024-04-16T18:27:45.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000534d41601cca61ca-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.154 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.154 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.154 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.154 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.154 DEBUG:boto:Method: GET 2024-04-16T18:27:45.155 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.155 DEBUG:boto:Data: 2024-04-16T18:27:45.155 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.155 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.155 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.155 DEBUG:boto:Params: {} 2024-04-16T18:27:45.155 DEBUG:boto:Token: None 2024-04-16T18:27:45.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.158 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009431d82dd80a6ad9-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.198 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.199 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.199 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.199 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.199 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.199 DEBUG:boto:Method: GET 2024-04-16T18:27:45.199 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:27:45.199 DEBUG:boto:Data: 2024-04-16T18:27:45.199 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.199 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.200 DEBUG:boto:Params: {} 2024-04-16T18:27:45.200 DEBUG:boto:Token: None 2024-04-16T18:27:45.200 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.203 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef31805778ffa747-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.204 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.204 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:27:45.204 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.204 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.204 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.204 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.204 DEBUG:boto:Method: GET 2024-04-16T18:27:45.205 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.205 DEBUG:boto:Data: 2024-04-16T18:27:45.205 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.205 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.205 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.205 DEBUG:boto:Params: {} 2024-04-16T18:27:45.205 DEBUG:boto:Token: None 2024-04-16T18:27:45.205 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.205 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs= 2024-04-16T18:27:45.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs=', 'Content-Length': '0'} 2024-04-16T18:27:45.207 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dc6f4548a8a902d-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.250 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.250 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.251 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.251 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.251 DEBUG:boto:Method: GET 2024-04-16T18:27:45.251 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.251 DEBUG:boto:Data: 2024-04-16T18:27:45.251 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.251 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.251 DEBUG:boto:Params: {} 2024-04-16T18:27:45.251 DEBUG:boto:Token: None 2024-04-16T18:27:45.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs= 2024-04-16T18:27:45.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs=', 'Content-Length': '0'} 2024-04-16T18:27:45.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c02673f5388bbd4-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.254 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.254 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.254 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.254 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.255 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.255 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.255 DEBUG:boto:Data: 2024-04-16T18:27:45.255 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.255 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.255 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.255 DEBUG:boto:Params: {} 2024-04-16T18:27:45.255 DEBUG:boto:Token: None 2024-04-16T18:27:45.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:giWma/SIMnhakEVEpprOAKo8rfY= 2024-04-16T18:27:45.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:giWma/SIMnhakEVEpprOAKo8rfY=', 'Content-Length': '0'} 2024-04-16T18:27:45.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2a2f55006a59d8c-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.258 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.258 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.258 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.258 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.258 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.258 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.258 DEBUG:boto:Data: 2024-04-16T18:27:45.258 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.258 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.258 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.259 DEBUG:boto:Params: {} 2024-04-16T18:27:45.259 DEBUG:boto:Token: None 2024-04-16T18:27:45.259 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:giWma/SIMnhakEVEpprOAKo8rfY= 2024-04-16T18:27:45.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:giWma/SIMnhakEVEpprOAKo8rfY=', 'Content-Length': '0'} 2024-04-16T18:27:45.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012a1e7d63c701c44-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.261 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:27:45.262 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.262 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.262 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.262 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.262 DEBUG:boto:Method: GET 2024-04-16T18:27:45.262 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.262 DEBUG:boto:Data: 2024-04-16T18:27:45.262 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.262 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.262 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.262 DEBUG:boto:Params: {} 2024-04-16T18:27:45.263 DEBUG:boto:Token: None 2024-04-16T18:27:45.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs= 2024-04-16T18:27:45.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs=', 'Content-Length': '0'} 2024-04-16T18:27:45.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000690ea1c8db08a1f-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.306 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.306 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.307 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.307 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.307 DEBUG:boto:Method: GET 2024-04-16T18:27:45.307 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.307 DEBUG:boto:Data: 2024-04-16T18:27:45.307 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.307 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.307 DEBUG:boto:Params: {} 2024-04-16T18:27:45.307 DEBUG:boto:Token: None 2024-04-16T18:27:45.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:27:45.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs= 2024-04-16T18:27:45.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dAxTuP1G6x8zHq3qmNbgk+ByQQs=', 'Content-Length': '0'} 2024-04-16T18:27:45.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036c4c0eb0398c067-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.310 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.310 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.311 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.311 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.311 DEBUG:boto:Method: GET 2024-04-16T18:27:45.311 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.311 DEBUG:boto:Data: 2024-04-16T18:27:45.311 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.311 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.311 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.311 DEBUG:boto:Params: {} 2024-04-16T18:27:45.311 DEBUG:boto:Token: None 2024-04-16T18:27:45.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.315 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000379d7ef02b7c7f5d-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.354 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.355 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.355 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.355 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.355 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.355 DEBUG:boto:Method: GET 2024-04-16T18:27:45.355 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.355 DEBUG:boto:Data: 2024-04-16T18:27:45.355 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.356 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.356 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.356 DEBUG:boto:Params: {} 2024-04-16T18:27:45.356 DEBUG:boto:Token: None 2024-04-16T18:27:45.356 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.359 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079f630f53c398ccf-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.360 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.360 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.360 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.360 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.360 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:27:45.360 DEBUG:boto:Data: 2024-04-16T18:27:45.360 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.360 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.361 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.361 DEBUG:boto:Params: {} 2024-04-16T18:27:45.361 DEBUG:boto:Token: None 2024-04-16T18:27:45.361 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57 2024-04-16T18:27:45.361 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+AFiSFIutYczQv1EcsfFxg2kfZo= 2024-04-16T18:27:45.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+AFiSFIutYczQv1EcsfFxg2kfZo=', 'Content-Length': '0'} 2024-04-16T18:27:45.363 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000447b1d31cb8811a5-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.363 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.364 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.364 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.364 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:27:45.364 DEBUG:boto:Data: 2024-04-16T18:27:45.364 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.364 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.364 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.364 DEBUG:boto:Params: {} 2024-04-16T18:27:45.364 DEBUG:boto:Token: None 2024-04-16T18:27:45.364 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57 2024-04-16T18:27:45.365 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+AFiSFIutYczQv1EcsfFxg2kfZo= 2024-04-16T18:27:45.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+AFiSFIutYczQv1EcsfFxg2kfZo=', 'Content-Length': '0'} 2024-04-16T18:27:45.367 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000781cfb610d05107c-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.367 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:27:45.367 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.367 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.367 DEBUG:boto:Method: GET 2024-04-16T18:27:45.367 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:27:45.367 DEBUG:boto:Data: 2024-04-16T18:27:45.367 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.368 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.368 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.368 DEBUG:boto:Params: {} 2024-04-16T18:27:45.368 DEBUG:boto:Token: None 2024-04-16T18:27:45.368 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57 2024-04-16T18:27:45.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:byRfehOdUJCLpTM70deTWLKQq4s= 2024-04-16T18:27:45.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:byRfehOdUJCLpTM70deTWLKQq4s=', 'Content-Length': '0'} 2024-04-16T18:27:45.370 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfb76387e2f4c2dd-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.414 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:27:45.414 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:27:45.415 DEBUG:boto:Method: GET 2024-04-16T18:27:45.415 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:27:45.415 DEBUG:boto:Data: 2024-04-16T18:27:45.415 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.415 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.415 DEBUG:boto:Params: {} 2024-04-16T18:27:45.415 DEBUG:boto:Token: None 2024-04-16T18:27:45.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj57 2024-04-16T18:27:45.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:byRfehOdUJCLpTM70deTWLKQq4s= 2024-04-16T18:27:45.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:byRfehOdUJCLpTM70deTWLKQq4s=', 'Content-Length': '0'} 2024-04-16T18:27:45.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b0bc40456b65ac9-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.418 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.418 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.418 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.418 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.418 DEBUG:boto:Method: GET 2024-04-16T18:27:45.418 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.418 DEBUG:boto:Data: 2024-04-16T18:27:45.418 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.418 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.419 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.419 DEBUG:boto:Params: {} 2024-04-16T18:27:45.419 DEBUG:boto:Token: None 2024-04-16T18:27:45.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013306a6e5275a4c6-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.462 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.463 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.463 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.463 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.463 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.463 DEBUG:boto:Method: GET 2024-04-16T18:27:45.463 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:27:45.463 DEBUG:boto:Data: 2024-04-16T18:27:45.463 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.463 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.464 DEBUG:boto:Params: {} 2024-04-16T18:27:45.464 DEBUG:boto:Token: None 2024-04-16T18:27:45.464 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.467 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f365dfcb7cfb9f1f-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.467 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:27:45.468 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.468 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.468 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.468 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.468 DEBUG:boto:Method: GET 2024-04-16T18:27:45.468 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.468 DEBUG:boto:Data: 2024-04-16T18:27:45.468 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.468 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.468 DEBUG:boto:Params: {} 2024-04-16T18:27:45.468 DEBUG:boto:Token: None 2024-04-16T18:27:45.469 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ= 2024-04-16T18:27:45.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dba96429ad3be3f2-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.514 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.514 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.515 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.515 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.515 DEBUG:boto:Method: GET 2024-04-16T18:27:45.515 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.515 DEBUG:boto:Data: 2024-04-16T18:27:45.515 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.515 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.515 DEBUG:boto:Params: {} 2024-04-16T18:27:45.515 DEBUG:boto:Token: None 2024-04-16T18:27:45.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ= 2024-04-16T18:27:45.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.518 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6050e8313e6f8f1-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.518 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.518 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.518 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.518 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.519 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.519 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.519 DEBUG:boto:Data: 2024-04-16T18:27:45.519 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.519 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.519 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.519 DEBUG:boto:Params: {} 2024-04-16T18:27:45.519 DEBUG:boto:Token: None 2024-04-16T18:27:45.519 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.519 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P9rFQPI8LS67hgmCNUBStjJpg28= 2024-04-16T18:27:45.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P9rFQPI8LS67hgmCNUBStjJpg28=', 'Content-Length': '0'} 2024-04-16T18:27:45.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a36532ae04367f7-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.522 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.522 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.522 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.522 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.522 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.522 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.522 DEBUG:boto:Data: 2024-04-16T18:27:45.522 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.522 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.522 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.523 DEBUG:boto:Params: {} 2024-04-16T18:27:45.523 DEBUG:boto:Token: None 2024-04-16T18:27:45.523 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P9rFQPI8LS67hgmCNUBStjJpg28= 2024-04-16T18:27:45.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P9rFQPI8LS67hgmCNUBStjJpg28=', 'Content-Length': '0'} 2024-04-16T18:27:45.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c4e90f3e2e2e7c63-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:27:45.525 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.526 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.526 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.526 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.526 DEBUG:boto:Method: GET 2024-04-16T18:27:45.526 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.526 DEBUG:boto:Data: 2024-04-16T18:27:45.526 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.526 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.526 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.526 DEBUG:boto:Params: {} 2024-04-16T18:27:45.526 DEBUG:boto:Token: None 2024-04-16T18:27:45.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ= 2024-04-16T18:27:45.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.529 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4c04f45882b375d-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.570 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.570 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.571 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.571 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.571 DEBUG:boto:Method: GET 2024-04-16T18:27:45.571 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.571 DEBUG:boto:Data: 2024-04-16T18:27:45.571 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.571 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.571 DEBUG:boto:Params: {} 2024-04-16T18:27:45.571 DEBUG:boto:Token: None 2024-04-16T18:27:45.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:27:45.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ= 2024-04-16T18:27:45.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fsg/vTEI26smXHT/khCU1PtlviQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.573 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac57bb4cb6370794-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.574 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.574 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.574 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.574 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.574 DEBUG:boto:Method: GET 2024-04-16T18:27:45.574 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.574 DEBUG:boto:Data: 2024-04-16T18:27:45.574 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.574 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.575 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.575 DEBUG:boto:Params: {} 2024-04-16T18:27:45.575 DEBUG:boto:Token: None 2024-04-16T18:27:45.575 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.577 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c44f719be61cc34c-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.618 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.619 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.619 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.619 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.619 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.619 DEBUG:boto:Method: GET 2024-04-16T18:27:45.619 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.619 DEBUG:boto:Data: 2024-04-16T18:27:45.619 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.620 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.620 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.620 DEBUG:boto:Params: {} 2024-04-16T18:27:45.620 DEBUG:boto:Token: None 2024-04-16T18:27:45.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.624 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000000c8db76825d5635-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.624 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.624 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.624 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.624 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.625 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:27:45.625 DEBUG:boto:Data: 2024-04-16T18:27:45.625 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.625 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.625 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.625 DEBUG:boto:Params: {} 2024-04-16T18:27:45.625 DEBUG:boto:Token: None 2024-04-16T18:27:45.625 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58 2024-04-16T18:27:45.625 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zPkZMbfrGTtLglb+E+QLO/qgrNo= 2024-04-16T18:27:45.625 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zPkZMbfrGTtLglb+E+QLO/qgrNo=', 'Content-Length': '0'} 2024-04-16T18:27:45.627 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050b5c0e1d63ec0b6-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.628 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.628 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.628 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.628 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:27:45.628 DEBUG:boto:Data: 2024-04-16T18:27:45.628 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.628 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.628 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.628 DEBUG:boto:Params: {} 2024-04-16T18:27:45.628 DEBUG:boto:Token: None 2024-04-16T18:27:45.629 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58 2024-04-16T18:27:45.629 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zPkZMbfrGTtLglb+E+QLO/qgrNo= 2024-04-16T18:27:45.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zPkZMbfrGTtLglb+E+QLO/qgrNo=', 'Content-Length': '0'} 2024-04-16T18:27:45.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6f5af819bd7cf62-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.630 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:27:45.631 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.631 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.631 DEBUG:boto:Method: GET 2024-04-16T18:27:45.631 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:27:45.631 DEBUG:boto:Data: 2024-04-16T18:27:45.631 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.631 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.631 DEBUG:boto:Params: {} 2024-04-16T18:27:45.631 DEBUG:boto:Token: None 2024-04-16T18:27:45.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58 2024-04-16T18:27:45.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09ObyqfhKwjXryQDkti+yq7PvSQ= 2024-04-16T18:27:45.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09ObyqfhKwjXryQDkti+yq7PvSQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.634 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a78d7d0ad5e53d96-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.674 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:27:45.674 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:27:45.674 DEBUG:boto:Method: GET 2024-04-16T18:27:45.675 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:27:45.675 DEBUG:boto:Data: 2024-04-16T18:27:45.675 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.675 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.675 DEBUG:boto:Params: {} 2024-04-16T18:27:45.675 DEBUG:boto:Token: None 2024-04-16T18:27:45.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj58 2024-04-16T18:27:45.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09ObyqfhKwjXryQDkti+yq7PvSQ= 2024-04-16T18:27:45.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09ObyqfhKwjXryQDkti+yq7PvSQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.677 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a5aadb5251b8aa7-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.678 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.678 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.678 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.678 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.678 DEBUG:boto:Method: GET 2024-04-16T18:27:45.678 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.678 DEBUG:boto:Data: 2024-04-16T18:27:45.678 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.678 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.678 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.679 DEBUG:boto:Params: {} 2024-04-16T18:27:45.679 DEBUG:boto:Token: None 2024-04-16T18:27:45.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8ce44c398d34979-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.722 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.723 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.723 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.723 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.723 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.723 DEBUG:boto:Method: GET 2024-04-16T18:27:45.723 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:27:45.723 DEBUG:boto:Data: 2024-04-16T18:27:45.723 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.723 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.723 DEBUG:boto:Params: {} 2024-04-16T18:27:45.724 DEBUG:boto:Token: None 2024-04-16T18:27:45.724 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.729 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002375dd21903ab7da-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.729 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.730 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:27:45.730 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.730 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.730 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.730 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.731 DEBUG:boto:Method: GET 2024-04-16T18:27:45.731 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.731 DEBUG:boto:Data: 2024-04-16T18:27:45.731 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.731 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.731 DEBUG:boto:Params: {} 2024-04-16T18:27:45.731 DEBUG:boto:Token: None 2024-04-16T18:27:45.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.731 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM= 2024-04-16T18:27:45.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM=', 'Content-Length': '0'} 2024-04-16T18:27:45.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003278114b078f17be-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.774 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.774 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.775 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.775 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.775 DEBUG:boto:Method: GET 2024-04-16T18:27:45.775 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.775 DEBUG:boto:Data: 2024-04-16T18:27:45.775 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.775 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.775 DEBUG:boto:Params: {} 2024-04-16T18:27:45.775 DEBUG:boto:Token: None 2024-04-16T18:27:45.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM= 2024-04-16T18:27:45.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM=', 'Content-Length': '0'} 2024-04-16T18:27:45.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3a9dffd5cbd43d9-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.778 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.778 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.779 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.779 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.779 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.779 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.779 DEBUG:boto:Data: 2024-04-16T18:27:45.779 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.779 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.779 DEBUG:boto:Params: {} 2024-04-16T18:27:45.779 DEBUG:boto:Token: None 2024-04-16T18:27:45.780 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJtXVe8uU6NVnVJQnPcCx6b3JxQ= 2024-04-16T18:27:45.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJtXVe8uU6NVnVJQnPcCx6b3JxQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.782 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c83b92685d38db5-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.782 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.782 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.783 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.783 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.783 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.783 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.783 DEBUG:boto:Data: 2024-04-16T18:27:45.783 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.783 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.783 DEBUG:boto:Params: {} 2024-04-16T18:27:45.783 DEBUG:boto:Token: None 2024-04-16T18:27:45.783 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qJtXVe8uU6NVnVJQnPcCx6b3JxQ= 2024-04-16T18:27:45.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qJtXVe8uU6NVnVJQnPcCx6b3JxQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c4dc45f19f81133-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:27:45.786 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.786 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.786 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.786 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.786 DEBUG:boto:Method: GET 2024-04-16T18:27:45.786 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.787 DEBUG:boto:Data: 2024-04-16T18:27:45.787 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.787 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.787 DEBUG:boto:Params: {} 2024-04-16T18:27:45.787 DEBUG:boto:Token: None 2024-04-16T18:27:45.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM= 2024-04-16T18:27:45.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM=', 'Content-Length': '0'} 2024-04-16T18:27:45.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000063e44642aff38f5-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.830 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.830 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.831 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.831 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.831 DEBUG:boto:Method: GET 2024-04-16T18:27:45.831 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.831 DEBUG:boto:Data: 2024-04-16T18:27:45.831 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.831 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.831 DEBUG:boto:Params: {} 2024-04-16T18:27:45.831 DEBUG:boto:Token: None 2024-04-16T18:27:45.832 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:27:45.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM= 2024-04-16T18:27:45.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BS/Efvoqqa7CWE5wdnGyYItOhgM=', 'Content-Length': '0'} 2024-04-16T18:27:45.834 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6c5180cb04a636c-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.834 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.834 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.834 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.834 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.834 DEBUG:boto:Method: GET 2024-04-16T18:27:45.835 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.835 DEBUG:boto:Data: 2024-04-16T18:27:45.835 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.835 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.835 DEBUG:boto:Params: {} 2024-04-16T18:27:45.835 DEBUG:boto:Token: None 2024-04-16T18:27:45.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d4f6b279ccad147-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.878 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.879 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.879 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.879 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.879 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.879 DEBUG:boto:Method: GET 2024-04-16T18:27:45.879 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.879 DEBUG:boto:Data: 2024-04-16T18:27:45.879 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.879 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.879 DEBUG:boto:Params: {} 2024-04-16T18:27:45.880 DEBUG:boto:Token: None 2024-04-16T18:27:45.880 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.883 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d0abb1682d74980-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.884 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.884 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.884 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.884 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.884 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:27:45.884 DEBUG:boto:Data: 2024-04-16T18:27:45.884 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.884 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.885 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.885 DEBUG:boto:Params: {} 2024-04-16T18:27:45.885 DEBUG:boto:Token: None 2024-04-16T18:27:45.885 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62 2024-04-16T18:27:45.885 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Itf9iDwupeAdmJinQZq5HAZDlO0= 2024-04-16T18:27:45.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Itf9iDwupeAdmJinQZq5HAZDlO0=', 'Content-Length': '0'} 2024-04-16T18:27:45.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c10b02f26fca143-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.887 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.887 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.888 DEBUG:boto:Method: HEAD 2024-04-16T18:27:45.888 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:27:45.888 DEBUG:boto:Data: 2024-04-16T18:27:45.888 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.888 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.888 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.888 DEBUG:boto:Params: {} 2024-04-16T18:27:45.888 DEBUG:boto:Token: None 2024-04-16T18:27:45.888 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62 2024-04-16T18:27:45.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Itf9iDwupeAdmJinQZq5HAZDlO0= 2024-04-16T18:27:45.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Itf9iDwupeAdmJinQZq5HAZDlO0=', 'Content-Length': '0'} 2024-04-16T18:27:45.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc325ad0ab0a01a5-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:27:45.891 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.891 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.891 DEBUG:boto:Method: GET 2024-04-16T18:27:45.891 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:27:45.891 DEBUG:boto:Data: 2024-04-16T18:27:45.891 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.891 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.892 DEBUG:boto:Params: {} 2024-04-16T18:27:45.892 DEBUG:boto:Token: None 2024-04-16T18:27:45.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62 2024-04-16T18:27:45.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rWZnYPK2PzXKF1dvJvAzJjk+xVc= 2024-04-16T18:27:45.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rWZnYPK2PzXKF1dvJvAzJjk+xVc=', 'Content-Length': '0'} 2024-04-16T18:27:45.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070cda52b56f8bd06-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.934 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:27:45.935 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:27:45.935 DEBUG:boto:Method: GET 2024-04-16T18:27:45.935 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:27:45.935 DEBUG:boto:Data: 2024-04-16T18:27:45.935 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.935 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.935 DEBUG:boto:Params: {} 2024-04-16T18:27:45.935 DEBUG:boto:Token: None 2024-04-16T18:27:45.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj62 2024-04-16T18:27:45.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rWZnYPK2PzXKF1dvJvAzJjk+xVc= 2024-04-16T18:27:45.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rWZnYPK2PzXKF1dvJvAzJjk+xVc=', 'Content-Length': '0'} 2024-04-16T18:27:45.938 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bc660b10ad2e44d-00661ec321-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.938 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.938 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.938 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.938 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.938 DEBUG:boto:Method: GET 2024-04-16T18:27:45.938 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.939 DEBUG:boto:Data: 2024-04-16T18:27:45.939 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.939 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.939 DEBUG:boto:Params: {} 2024-04-16T18:27:45.939 DEBUG:boto:Token: None 2024-04-16T18:27:45.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b2cabd69ed8ac339-00661ec321-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.982 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.983 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:45.983 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:45.983 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.983 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.983 DEBUG:boto:Method: GET 2024-04-16T18:27:45.983 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:27:45.983 DEBUG:boto:Data: 2024-04-16T18:27:45.983 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:45.983 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.984 DEBUG:boto:Params: {} 2024-04-16T18:27:45.984 DEBUG:boto:Token: None 2024-04-16T18:27:45.984 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/ 2024-04-16T18:27:45.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ= 2024-04-16T18:27:45.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5hKZcRUB/ybzUClUOH8E6y4g7IQ=', 'Content-Length': '0'} 2024-04-16T18:27:45.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002739483e26874773-00661ec321-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:45.988 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:45.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:27:45.988 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:45.988 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:45.988 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:45.988 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:45.988 DEBUG:boto:Method: GET 2024-04-16T18:27:45.988 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:45.988 DEBUG:boto:Data: 2024-04-16T18:27:45.989 DEBUG:boto:Headers: {} 2024-04-16T18:27:45.989 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:45.989 DEBUG:boto:Port: 8000 2024-04-16T18:27:45.989 DEBUG:boto:Params: {} 2024-04-16T18:27:45.989 DEBUG:boto:Token: None 2024-04-16T18:27:45.989 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:45 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:45.989 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AR6+hi11BkaA7sup+em7P5zPh3M= 2024-04-16T18:27:45.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AR6+hi11BkaA7sup+em7P5zPh3M=', 'Content-Length': '0'} 2024-04-16T18:27:45.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b5b198f666a1f47-00661ec321-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.034 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.034 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.034 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.035 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.035 DEBUG:boto:Method: GET 2024-04-16T18:27:46.035 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.035 DEBUG:boto:Data: 2024-04-16T18:27:46.035 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.035 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.035 DEBUG:boto:Params: {} 2024-04-16T18:27:46.035 DEBUG:boto:Token: None 2024-04-16T18:27:46.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kwT5+CcxIA3zSnzzrxeBX7mPojU= 2024-04-16T18:27:46.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kwT5+CcxIA3zSnzzrxeBX7mPojU=', 'Content-Length': '0'} 2024-04-16T18:27:46.037 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1dda44935258b52-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.038 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.038 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.038 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.038 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.038 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.038 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.038 DEBUG:boto:Data: 2024-04-16T18:27:46.039 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.039 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.039 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.039 DEBUG:boto:Params: {} 2024-04-16T18:27:46.039 DEBUG:boto:Token: None 2024-04-16T18:27:46.039 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8UXFoXCtVIijNKl3nj52b6E13xc= 2024-04-16T18:27:46.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8UXFoXCtVIijNKl3nj52b6E13xc=', 'Content-Length': '0'} 2024-04-16T18:27:46.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7995cf98cec5cba-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.041 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.042 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.042 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.042 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.042 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.042 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.042 DEBUG:boto:Data: 2024-04-16T18:27:46.042 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.042 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.042 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.042 DEBUG:boto:Params: {} 2024-04-16T18:27:46.043 DEBUG:boto:Token: None 2024-04-16T18:27:46.043 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8UXFoXCtVIijNKl3nj52b6E13xc= 2024-04-16T18:27:46.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8UXFoXCtVIijNKl3nj52b6E13xc=', 'Content-Length': '0'} 2024-04-16T18:27:46.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016e8201ae78771f3-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:27:46.045 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.045 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.045 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.045 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.045 DEBUG:boto:Method: GET 2024-04-16T18:27:46.045 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.045 DEBUG:boto:Data: 2024-04-16T18:27:46.046 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.046 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.046 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.046 DEBUG:boto:Params: {} 2024-04-16T18:27:46.046 DEBUG:boto:Token: None 2024-04-16T18:27:46.046 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.046 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kwT5+CcxIA3zSnzzrxeBX7mPojU= 2024-04-16T18:27:46.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kwT5+CcxIA3zSnzzrxeBX7mPojU=', 'Content-Length': '0'} 2024-04-16T18:27:46.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078ec7dcef8bf0f1d-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.090 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.090 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.091 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.091 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.091 DEBUG:boto:Method: GET 2024-04-16T18:27:46.091 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.091 DEBUG:boto:Data: 2024-04-16T18:27:46.091 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.091 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.091 DEBUG:boto:Params: {} 2024-04-16T18:27:46.091 DEBUG:boto:Token: None 2024-04-16T18:27:46.091 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:27:46.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kwT5+CcxIA3zSnzzrxeBX7mPojU= 2024-04-16T18:27:46.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kwT5+CcxIA3zSnzzrxeBX7mPojU=', 'Content-Length': '0'} 2024-04-16T18:27:46.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d8b5fdc9c57d292b-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.094 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.094 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.094 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.094 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.094 DEBUG:boto:Method: GET 2024-04-16T18:27:46.094 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.095 DEBUG:boto:Data: 2024-04-16T18:27:46.095 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.095 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.095 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.095 DEBUG:boto:Params: {} 2024-04-16T18:27:46.095 DEBUG:boto:Token: None 2024-04-16T18:27:46.095 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.095 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.098 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b438554d6bf216f3-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.138 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.139 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.139 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.139 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.139 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.139 DEBUG:boto:Method: GET 2024-04-16T18:27:46.139 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.139 DEBUG:boto:Data: 2024-04-16T18:27:46.139 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.139 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.140 DEBUG:boto:Params: {} 2024-04-16T18:27:46.140 DEBUG:boto:Token: None 2024-04-16T18:27:46.140 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.143 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca8710702877709a-00661ec322-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.144 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.144 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.144 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.144 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.144 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:27:46.144 DEBUG:boto:Data: 2024-04-16T18:27:46.144 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.145 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.145 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.145 DEBUG:boto:Params: {} 2024-04-16T18:27:46.145 DEBUG:boto:Token: None 2024-04-16T18:27:46.145 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68 2024-04-16T18:27:46.145 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n/1wQP/Oi+lBsRXB9MkDx8nI1/M= 2024-04-16T18:27:46.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n/1wQP/Oi+lBsRXB9MkDx8nI1/M=', 'Content-Length': '0'} 2024-04-16T18:27:46.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5a592ed9c0eb840-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.147 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.148 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.148 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.148 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:27:46.148 DEBUG:boto:Data: 2024-04-16T18:27:46.148 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.148 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.148 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.148 DEBUG:boto:Params: {} 2024-04-16T18:27:46.148 DEBUG:boto:Token: None 2024-04-16T18:27:46.148 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68 2024-04-16T18:27:46.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n/1wQP/Oi+lBsRXB9MkDx8nI1/M= 2024-04-16T18:27:46.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n/1wQP/Oi+lBsRXB9MkDx8nI1/M=', 'Content-Length': '0'} 2024-04-16T18:27:46.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005021b7a0eab7d054-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:27:46.151 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.151 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.151 DEBUG:boto:Method: GET 2024-04-16T18:27:46.151 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:27:46.151 DEBUG:boto:Data: 2024-04-16T18:27:46.151 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.151 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.151 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.151 DEBUG:boto:Params: {} 2024-04-16T18:27:46.151 DEBUG:boto:Token: None 2024-04-16T18:27:46.152 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68 2024-04-16T18:27:46.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KyTvFoud1VlcKdPlKE2A3n9P71A= 2024-04-16T18:27:46.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KyTvFoud1VlcKdPlKE2A3n9P71A=', 'Content-Length': '0'} 2024-04-16T18:27:46.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c1b786d8e912638-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.194 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:27:46.195 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:27:46.195 DEBUG:boto:Method: GET 2024-04-16T18:27:46.195 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:27:46.195 DEBUG:boto:Data: 2024-04-16T18:27:46.195 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.195 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.195 DEBUG:boto:Params: {} 2024-04-16T18:27:46.195 DEBUG:boto:Token: None 2024-04-16T18:27:46.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj68 2024-04-16T18:27:46.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KyTvFoud1VlcKdPlKE2A3n9P71A= 2024-04-16T18:27:46.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KyTvFoud1VlcKdPlKE2A3n9P71A=', 'Content-Length': '0'} 2024-04-16T18:27:46.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fdd56c859660e91-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.198 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.198 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.198 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.198 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.198 DEBUG:boto:Method: GET 2024-04-16T18:27:46.198 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.198 DEBUG:boto:Data: 2024-04-16T18:27:46.198 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.198 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.199 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.199 DEBUG:boto:Params: {} 2024-04-16T18:27:46.199 DEBUG:boto:Token: None 2024-04-16T18:27:46.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b91b153e5dd98fc-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.242 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.243 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.243 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.243 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.243 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.243 DEBUG:boto:Method: GET 2024-04-16T18:27:46.243 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:27:46.243 DEBUG:boto:Data: 2024-04-16T18:27:46.243 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.243 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.244 DEBUG:boto:Params: {} 2024-04-16T18:27:46.244 DEBUG:boto:Token: None 2024-04-16T18:27:46.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.247 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000239d817164c4e57d-00661ec322-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.248 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.248 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:27:46.248 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.248 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.248 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.248 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.248 DEBUG:boto:Method: GET 2024-04-16T18:27:46.248 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.248 DEBUG:boto:Data: 2024-04-16T18:27:46.249 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.249 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.249 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.249 DEBUG:boto:Params: {} 2024-04-16T18:27:46.249 DEBUG:boto:Token: None 2024-04-16T18:27:46.249 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4= 2024-04-16T18:27:46.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4=', 'Content-Length': '0'} 2024-04-16T18:27:46.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000943fd359839c47fa-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.294 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.294 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.294 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.295 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.295 DEBUG:boto:Method: GET 2024-04-16T18:27:46.295 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.295 DEBUG:boto:Data: 2024-04-16T18:27:46.295 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.295 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.295 DEBUG:boto:Params: {} 2024-04-16T18:27:46.295 DEBUG:boto:Token: None 2024-04-16T18:27:46.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4= 2024-04-16T18:27:46.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4=', 'Content-Length': '0'} 2024-04-16T18:27:46.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003aefb9e4b56caaf2-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.298 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.298 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.298 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.298 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.298 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.299 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.299 DEBUG:boto:Data: 2024-04-16T18:27:46.299 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.299 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.299 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.299 DEBUG:boto:Params: {} 2024-04-16T18:27:46.299 DEBUG:boto:Token: None 2024-04-16T18:27:46.299 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MyngKUu5wJfbRqyTL7L2MW6UluE= 2024-04-16T18:27:46.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MyngKUu5wJfbRqyTL7L2MW6UluE=', 'Content-Length': '0'} 2024-04-16T18:27:46.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d60256fb0f488c0-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.302 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.302 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.302 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.302 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.302 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.302 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.302 DEBUG:boto:Data: 2024-04-16T18:27:46.303 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.303 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.303 DEBUG:boto:Params: {} 2024-04-16T18:27:46.303 DEBUG:boto:Token: None 2024-04-16T18:27:46.303 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MyngKUu5wJfbRqyTL7L2MW6UluE= 2024-04-16T18:27:46.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MyngKUu5wJfbRqyTL7L2MW6UluE=', 'Content-Length': '0'} 2024-04-16T18:27:46.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adec7d534a80b43a-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.306 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:27:46.306 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.306 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.306 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.306 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.306 DEBUG:boto:Method: GET 2024-04-16T18:27:46.306 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.307 DEBUG:boto:Data: 2024-04-16T18:27:46.307 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.307 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.307 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.307 DEBUG:boto:Params: {} 2024-04-16T18:27:46.307 DEBUG:boto:Token: None 2024-04-16T18:27:46.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4= 2024-04-16T18:27:46.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4=', 'Content-Length': '0'} 2024-04-16T18:27:46.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ef5a4ddc65ff5a3-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.350 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.350 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.350 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.351 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.351 DEBUG:boto:Method: GET 2024-04-16T18:27:46.351 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.351 DEBUG:boto:Data: 2024-04-16T18:27:46.351 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.351 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.351 DEBUG:boto:Params: {} 2024-04-16T18:27:46.351 DEBUG:boto:Token: None 2024-04-16T18:27:46.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:27:46.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4= 2024-04-16T18:27:46.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7qircAaKcWw+muDdT4XTkn14RW4=', 'Content-Length': '0'} 2024-04-16T18:27:46.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3d5105aa2f86305-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.354 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.354 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.354 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.354 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.355 DEBUG:boto:Method: GET 2024-04-16T18:27:46.355 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.355 DEBUG:boto:Data: 2024-04-16T18:27:46.355 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.355 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.355 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.355 DEBUG:boto:Params: {} 2024-04-16T18:27:46.355 DEBUG:boto:Token: None 2024-04-16T18:27:46.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.358 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e84335078793eb0b-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.398 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.399 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.399 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.399 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.399 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.399 DEBUG:boto:Method: GET 2024-04-16T18:27:46.399 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.399 DEBUG:boto:Data: 2024-04-16T18:27:46.399 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.400 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.400 DEBUG:boto:Params: {} 2024-04-16T18:27:46.400 DEBUG:boto:Token: None 2024-04-16T18:27:46.400 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.404 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c795713d2a4d3d3-00661ec322-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.404 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.404 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.404 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.404 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.404 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:27:46.404 DEBUG:boto:Data: 2024-04-16T18:27:46.405 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.405 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.405 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.405 DEBUG:boto:Params: {} 2024-04-16T18:27:46.405 DEBUG:boto:Token: None 2024-04-16T18:27:46.405 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69 2024-04-16T18:27:46.405 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ww09GNJazFkPwx7YU0Y+XTtEyDQ= 2024-04-16T18:27:46.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ww09GNJazFkPwx7YU0Y+XTtEyDQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.407 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002de7866f3eb85b77-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.407 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.407 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.407 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.408 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:27:46.408 DEBUG:boto:Data: 2024-04-16T18:27:46.408 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.408 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.408 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.408 DEBUG:boto:Params: {} 2024-04-16T18:27:46.408 DEBUG:boto:Token: None 2024-04-16T18:27:46.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69 2024-04-16T18:27:46.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ww09GNJazFkPwx7YU0Y+XTtEyDQ= 2024-04-16T18:27:46.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ww09GNJazFkPwx7YU0Y+XTtEyDQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db57fff26f6c8513-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:27:46.411 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.411 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.411 DEBUG:boto:Method: GET 2024-04-16T18:27:46.411 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:27:46.411 DEBUG:boto:Data: 2024-04-16T18:27:46.411 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.411 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.412 DEBUG:boto:Params: {} 2024-04-16T18:27:46.412 DEBUG:boto:Token: None 2024-04-16T18:27:46.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69 2024-04-16T18:27:46.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:khGDdrvMfGOY5qVIt8S6JbB+Yyc= 2024-04-16T18:27:46.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:khGDdrvMfGOY5qVIt8S6JbB+Yyc=', 'Content-Length': '0'} 2024-04-16T18:27:46.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae590437f2e6a036-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.454 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:27:46.454 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:27:46.454 DEBUG:boto:Method: GET 2024-04-16T18:27:46.455 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:27:46.455 DEBUG:boto:Data: 2024-04-16T18:27:46.455 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.455 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.455 DEBUG:boto:Params: {} 2024-04-16T18:27:46.455 DEBUG:boto:Token: None 2024-04-16T18:27:46.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj69 2024-04-16T18:27:46.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:khGDdrvMfGOY5qVIt8S6JbB+Yyc= 2024-04-16T18:27:46.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:khGDdrvMfGOY5qVIt8S6JbB+Yyc=', 'Content-Length': '0'} 2024-04-16T18:27:46.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000737f9254aac348a3-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.458 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.458 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.458 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.458 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.458 DEBUG:boto:Method: GET 2024-04-16T18:27:46.458 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.458 DEBUG:boto:Data: 2024-04-16T18:27:46.459 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.459 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.459 DEBUG:boto:Params: {} 2024-04-16T18:27:46.459 DEBUG:boto:Token: None 2024-04-16T18:27:46.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.461 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f3d2bfad532966f-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.502 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.503 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.503 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.503 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.503 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.503 DEBUG:boto:Method: GET 2024-04-16T18:27:46.503 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:27:46.503 DEBUG:boto:Data: 2024-04-16T18:27:46.504 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.504 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.504 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.504 DEBUG:boto:Params: {} 2024-04-16T18:27:46.504 DEBUG:boto:Token: None 2024-04-16T18:27:46.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ccbbb5273c1b94f-00661ec322-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.509 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.509 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:27:46.510 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.510 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.510 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.510 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.510 DEBUG:boto:Method: GET 2024-04-16T18:27:46.510 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.510 DEBUG:boto:Data: 2024-04-16T18:27:46.510 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.510 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.510 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.511 DEBUG:boto:Params: {} 2024-04-16T18:27:46.511 DEBUG:boto:Token: None 2024-04-16T18:27:46.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q= 2024-04-16T18:27:46.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q=', 'Content-Length': '0'} 2024-04-16T18:27:46.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2dbb05c9ec41b7b-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.554 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.554 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.555 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.555 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.555 DEBUG:boto:Method: GET 2024-04-16T18:27:46.555 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.555 DEBUG:boto:Data: 2024-04-16T18:27:46.555 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.555 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.555 DEBUG:boto:Params: {} 2024-04-16T18:27:46.555 DEBUG:boto:Token: None 2024-04-16T18:27:46.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q= 2024-04-16T18:27:46.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q=', 'Content-Length': '0'} 2024-04-16T18:27:46.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfceadf774c76619-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.558 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.558 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.558 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.559 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.559 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.559 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.559 DEBUG:boto:Data: 2024-04-16T18:27:46.559 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.559 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.559 DEBUG:boto:Params: {} 2024-04-16T18:27:46.559 DEBUG:boto:Token: None 2024-04-16T18:27:46.559 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fTbpH1DX6OYPTB4FC+3rAuuSu/A= 2024-04-16T18:27:46.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fTbpH1DX6OYPTB4FC+3rAuuSu/A=', 'Content-Length': '0'} 2024-04-16T18:27:46.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007ab97b3663ac4761-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.562 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.562 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.562 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.562 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.562 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.562 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.562 DEBUG:boto:Data: 2024-04-16T18:27:46.562 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.562 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.562 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.563 DEBUG:boto:Params: {} 2024-04-16T18:27:46.563 DEBUG:boto:Token: None 2024-04-16T18:27:46.563 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fTbpH1DX6OYPTB4FC+3rAuuSu/A= 2024-04-16T18:27:46.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fTbpH1DX6OYPTB4FC+3rAuuSu/A=', 'Content-Length': '0'} 2024-04-16T18:27:46.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c216cffb4708e720-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.565 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:27:46.565 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.565 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.566 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.566 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.566 DEBUG:boto:Method: GET 2024-04-16T18:27:46.566 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.566 DEBUG:boto:Data: 2024-04-16T18:27:46.566 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.566 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.566 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.566 DEBUG:boto:Params: {} 2024-04-16T18:27:46.566 DEBUG:boto:Token: None 2024-04-16T18:27:46.567 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q= 2024-04-16T18:27:46.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q=', 'Content-Length': '0'} 2024-04-16T18:27:46.568 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000216b48e40f50637b-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.610 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.610 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.611 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.611 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.611 DEBUG:boto:Method: GET 2024-04-16T18:27:46.611 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.611 DEBUG:boto:Data: 2024-04-16T18:27:46.611 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.611 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.611 DEBUG:boto:Params: {} 2024-04-16T18:27:46.611 DEBUG:boto:Token: None 2024-04-16T18:27:46.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:27:46.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q= 2024-04-16T18:27:46.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkcoN7Nucquzvy6oeOhfznsgE2Q=', 'Content-Length': '0'} 2024-04-16T18:27:46.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065c5f0beb56ac333-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.614 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.614 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.614 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.614 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.614 DEBUG:boto:Method: GET 2024-04-16T18:27:46.614 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.615 DEBUG:boto:Data: 2024-04-16T18:27:46.615 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.615 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.615 DEBUG:boto:Params: {} 2024-04-16T18:27:46.615 DEBUG:boto:Token: None 2024-04-16T18:27:46.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d22e77d508c40aa6-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.658 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.659 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.659 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.659 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.659 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.659 DEBUG:boto:Method: GET 2024-04-16T18:27:46.659 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.659 DEBUG:boto:Data: 2024-04-16T18:27:46.659 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.659 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.660 DEBUG:boto:Params: {} 2024-04-16T18:27:46.660 DEBUG:boto:Token: None 2024-04-16T18:27:46.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7dd766e99a224f0-00661ec322-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.664 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.664 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.664 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.664 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.664 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:27:46.665 DEBUG:boto:Data: 2024-04-16T18:27:46.665 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.665 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.665 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.665 DEBUG:boto:Params: {} 2024-04-16T18:27:46.665 DEBUG:boto:Token: None 2024-04-16T18:27:46.665 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76 2024-04-16T18:27:46.665 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bOxNImsRoUJRbo+QEWrhEnvMRP4= 2024-04-16T18:27:46.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bOxNImsRoUJRbo+QEWrhEnvMRP4=', 'Content-Length': '0'} 2024-04-16T18:27:46.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000dca39f2781c2764-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.668 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.668 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.668 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.668 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:27:46.668 DEBUG:boto:Data: 2024-04-16T18:27:46.668 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.668 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.668 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.668 DEBUG:boto:Params: {} 2024-04-16T18:27:46.668 DEBUG:boto:Token: None 2024-04-16T18:27:46.669 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76 2024-04-16T18:27:46.669 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bOxNImsRoUJRbo+QEWrhEnvMRP4= 2024-04-16T18:27:46.669 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bOxNImsRoUJRbo+QEWrhEnvMRP4=', 'Content-Length': '0'} 2024-04-16T18:27:46.671 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003232e2750c980b9b-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:27:46.671 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.671 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.671 DEBUG:boto:Method: GET 2024-04-16T18:27:46.671 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:27:46.671 DEBUG:boto:Data: 2024-04-16T18:27:46.671 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.672 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.672 DEBUG:boto:Params: {} 2024-04-16T18:27:46.672 DEBUG:boto:Token: None 2024-04-16T18:27:46.672 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76 2024-04-16T18:27:46.672 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o6EPfpQaqbSzAi4gnEtovFaoR3g= 2024-04-16T18:27:46.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o6EPfpQaqbSzAi4gnEtovFaoR3g=', 'Content-Length': '0'} 2024-04-16T18:27:46.674 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000998136307e16e484-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.714 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:27:46.714 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:27:46.715 DEBUG:boto:Method: GET 2024-04-16T18:27:46.715 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:27:46.715 DEBUG:boto:Data: 2024-04-16T18:27:46.715 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.715 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.715 DEBUG:boto:Params: {} 2024-04-16T18:27:46.715 DEBUG:boto:Token: None 2024-04-16T18:27:46.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj76 2024-04-16T18:27:46.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o6EPfpQaqbSzAi4gnEtovFaoR3g= 2024-04-16T18:27:46.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o6EPfpQaqbSzAi4gnEtovFaoR3g=', 'Content-Length': '0'} 2024-04-16T18:27:46.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbaa6d4ff5375d67-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.717 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.718 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.718 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.718 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.718 DEBUG:boto:Method: GET 2024-04-16T18:27:46.718 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.718 DEBUG:boto:Data: 2024-04-16T18:27:46.718 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.718 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.718 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.718 DEBUG:boto:Params: {} 2024-04-16T18:27:46.719 DEBUG:boto:Token: None 2024-04-16T18:27:46.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.721 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000daf681d3efb4745e-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.762 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.763 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.763 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.763 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.763 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.763 DEBUG:boto:Method: GET 2024-04-16T18:27:46.763 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:27:46.763 DEBUG:boto:Data: 2024-04-16T18:27:46.763 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.764 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.764 DEBUG:boto:Params: {} 2024-04-16T18:27:46.764 DEBUG:boto:Token: None 2024-04-16T18:27:46.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.767 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007568ddd219d45560-00661ec322-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.768 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.768 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:27:46.768 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.768 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.768 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.769 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.769 DEBUG:boto:Method: GET 2024-04-16T18:27:46.769 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.769 DEBUG:boto:Data: 2024-04-16T18:27:46.769 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.769 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.769 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.769 DEBUG:boto:Params: {} 2024-04-16T18:27:46.769 DEBUG:boto:Token: None 2024-04-16T18:27:46.769 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.770 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg= 2024-04-16T18:27:46.770 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg=', 'Content-Length': '0'} 2024-04-16T18:27:46.772 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000facb71f11a2157b2-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.814 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.814 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.815 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.815 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.815 DEBUG:boto:Method: GET 2024-04-16T18:27:46.815 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.815 DEBUG:boto:Data: 2024-04-16T18:27:46.815 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.815 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.815 DEBUG:boto:Params: {} 2024-04-16T18:27:46.815 DEBUG:boto:Token: None 2024-04-16T18:27:46.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg= 2024-04-16T18:27:46.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg=', 'Content-Length': '0'} 2024-04-16T18:27:46.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c147a125864885d-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.818 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.818 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.818 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.818 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.818 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.818 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.819 DEBUG:boto:Data: 2024-04-16T18:27:46.819 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.819 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.819 DEBUG:boto:Params: {} 2024-04-16T18:27:46.819 DEBUG:boto:Token: None 2024-04-16T18:27:46.819 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MVLeJDYytLqAnDZTN6quAllePY8= 2024-04-16T18:27:46.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MVLeJDYytLqAnDZTN6quAllePY8=', 'Content-Length': '0'} 2024-04-16T18:27:46.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005aa17b0854a44d84-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.821 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.821 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.822 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.822 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.822 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.822 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.822 DEBUG:boto:Data: 2024-04-16T18:27:46.822 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.822 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.822 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.822 DEBUG:boto:Params: {} 2024-04-16T18:27:46.822 DEBUG:boto:Token: None 2024-04-16T18:27:46.823 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MVLeJDYytLqAnDZTN6quAllePY8= 2024-04-16T18:27:46.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MVLeJDYytLqAnDZTN6quAllePY8=', 'Content-Length': '0'} 2024-04-16T18:27:46.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b807d9bf36b4b9d0-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.825 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:27:46.825 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.825 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.825 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.825 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.825 DEBUG:boto:Method: GET 2024-04-16T18:27:46.826 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.826 DEBUG:boto:Data: 2024-04-16T18:27:46.826 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.826 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.826 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.826 DEBUG:boto:Params: {} 2024-04-16T18:27:46.826 DEBUG:boto:Token: None 2024-04-16T18:27:46.826 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.826 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg= 2024-04-16T18:27:46.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg=', 'Content-Length': '0'} 2024-04-16T18:27:46.828 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099efdde03de26dd6-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.870 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.870 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.871 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.871 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.871 DEBUG:boto:Method: GET 2024-04-16T18:27:46.871 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.871 DEBUG:boto:Data: 2024-04-16T18:27:46.871 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.871 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.871 DEBUG:boto:Params: {} 2024-04-16T18:27:46.871 DEBUG:boto:Token: None 2024-04-16T18:27:46.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:27:46.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg= 2024-04-16T18:27:46.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D0DPkWFDbNS3qLpp1/DHmLaMffg=', 'Content-Length': '0'} 2024-04-16T18:27:46.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007565b0b078d1252e-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.874 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.874 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.874 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.874 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.874 DEBUG:boto:Method: GET 2024-04-16T18:27:46.875 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.875 DEBUG:boto:Data: 2024-04-16T18:27:46.875 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.875 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.875 DEBUG:boto:Params: {} 2024-04-16T18:27:46.875 DEBUG:boto:Token: None 2024-04-16T18:27:46.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.878 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002d2fc37780d558b0-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.918 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.919 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.919 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.919 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.919 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.919 DEBUG:boto:Method: GET 2024-04-16T18:27:46.919 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.919 DEBUG:boto:Data: 2024-04-16T18:27:46.919 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.920 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.920 DEBUG:boto:Params: {} 2024-04-16T18:27:46.920 DEBUG:boto:Token: None 2024-04-16T18:27:46.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9dd5a3d3f2cfe3d-00661ec322-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.923 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:46.924 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.924 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.924 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.924 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:27:46.924 DEBUG:boto:Data: 2024-04-16T18:27:46.924 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.924 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.924 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.925 DEBUG:boto:Params: {} 2024-04-16T18:27:46.925 DEBUG:boto:Token: None 2024-04-16T18:27:46.925 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85 2024-04-16T18:27:46.925 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HTpKnLkwiPzjSU7lOPCQ6K3ujwk= 2024-04-16T18:27:46.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HTpKnLkwiPzjSU7lOPCQ6K3ujwk=', 'Content-Length': '0'} 2024-04-16T18:27:46.927 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000886bcb5e183c3aa5-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.927 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.927 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.927 DEBUG:boto:Method: HEAD 2024-04-16T18:27:46.927 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:27:46.927 DEBUG:boto:Data: 2024-04-16T18:27:46.927 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.928 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.928 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.928 DEBUG:boto:Params: {} 2024-04-16T18:27:46.928 DEBUG:boto:Token: None 2024-04-16T18:27:46.928 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85 2024-04-16T18:27:46.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HTpKnLkwiPzjSU7lOPCQ6K3ujwk= 2024-04-16T18:27:46.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HTpKnLkwiPzjSU7lOPCQ6K3ujwk=', 'Content-Length': '0'} 2024-04-16T18:27:46.930 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe2981763542e698-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.930 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:27:46.930 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.930 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.930 DEBUG:boto:Method: GET 2024-04-16T18:27:46.931 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:27:46.931 DEBUG:boto:Data: 2024-04-16T18:27:46.931 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.931 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.931 DEBUG:boto:Params: {} 2024-04-16T18:27:46.931 DEBUG:boto:Token: None 2024-04-16T18:27:46.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85 2024-04-16T18:27:46.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PdFTit5Sfm3WwgSUAeNdsm2oXmo= 2024-04-16T18:27:46.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PdFTit5Sfm3WwgSUAeNdsm2oXmo=', 'Content-Length': '0'} 2024-04-16T18:27:46.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e1249ba6d061cae-00661ec322-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.974 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:27:46.974 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:27:46.975 DEBUG:boto:Method: GET 2024-04-16T18:27:46.975 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:27:46.975 DEBUG:boto:Data: 2024-04-16T18:27:46.975 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:46.975 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.975 DEBUG:boto:Params: {} 2024-04-16T18:27:46.975 DEBUG:boto:Token: None 2024-04-16T18:27:46.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/obj85 2024-04-16T18:27:46.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PdFTit5Sfm3WwgSUAeNdsm2oXmo= 2024-04-16T18:27:46.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PdFTit5Sfm3WwgSUAeNdsm2oXmo=', 'Content-Length': '0'} 2024-04-16T18:27:46.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000094151011955386e-00661ec322-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:46.978 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:46.978 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:46.978 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.978 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.978 DEBUG:boto:Method: GET 2024-04-16T18:27:46.978 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:27:46.978 DEBUG:boto:Data: 2024-04-16T18:27:46.978 DEBUG:boto:Headers: {} 2024-04-16T18:27:46.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:46.979 DEBUG:boto:Port: 8000 2024-04-16T18:27:46.979 DEBUG:boto:Params: {} 2024-04-16T18:27:46.979 DEBUG:boto:Token: None 2024-04-16T18:27:46.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:46 GMT /cjqttm-52/ 2024-04-16T18:27:46.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ= 2024-04-16T18:27:46.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BXqFS2d1eEs11/0q8jJDGBFFqAQ=', 'Content-Length': '0'} 2024-04-16T18:27:46.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000768b09d66a3b5d57-00661ec322-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.022 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.023 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.023 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.023 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:47.023 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:27:47.023 DEBUG:boto:Method: GET 2024-04-16T18:27:47.023 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:27:47.023 DEBUG:boto:Data: 2024-04-16T18:27:47.023 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.023 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.023 DEBUG:boto:Params: {} 2024-04-16T18:27:47.024 DEBUG:boto:Token: None 2024-04-16T18:27:47.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.027 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000685a89817e8ab737-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.027 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.028 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:27:47.028 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.028 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.028 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.028 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.028 DEBUG:boto:Method: GET 2024-04-16T18:27:47.028 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.028 DEBUG:boto:Data: 2024-04-16T18:27:47.028 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.029 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.029 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.029 DEBUG:boto:Params: {} 2024-04-16T18:27:47.029 DEBUG:boto:Token: None 2024-04-16T18:27:47.029 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU= 2024-04-16T18:27:47.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU=', 'Content-Length': '0'} 2024-04-16T18:27:47.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083f17378b1e45d36-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.074 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.074 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.074 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.075 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.075 DEBUG:boto:Method: GET 2024-04-16T18:27:47.075 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.075 DEBUG:boto:Data: 2024-04-16T18:27:47.075 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.075 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.075 DEBUG:boto:Params: {} 2024-04-16T18:27:47.075 DEBUG:boto:Token: None 2024-04-16T18:27:47.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU= 2024-04-16T18:27:47.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU=', 'Content-Length': '0'} 2024-04-16T18:27:47.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b26e1697e96e4f7-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.078 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.078 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.078 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.078 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.078 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.078 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.078 DEBUG:boto:Data: 2024-04-16T18:27:47.078 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.078 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.079 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.079 DEBUG:boto:Params: {} 2024-04-16T18:27:47.079 DEBUG:boto:Token: None 2024-04-16T18:27:47.079 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3nklg0RuhHiNqEER2olGf6EdU40= 2024-04-16T18:27:47.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3nklg0RuhHiNqEER2olGf6EdU40=', 'Content-Length': '0'} 2024-04-16T18:27:47.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fcc46c6b944acca-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.081 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.081 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.081 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.081 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.081 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.082 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.082 DEBUG:boto:Data: 2024-04-16T18:27:47.082 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.082 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.082 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.082 DEBUG:boto:Params: {} 2024-04-16T18:27:47.082 DEBUG:boto:Token: None 2024-04-16T18:27:47.082 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.082 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3nklg0RuhHiNqEER2olGf6EdU40= 2024-04-16T18:27:47.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3nklg0RuhHiNqEER2olGf6EdU40=', 'Content-Length': '0'} 2024-04-16T18:27:47.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9d8865e855bfea2-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:27:47.084 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.085 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.085 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.085 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.085 DEBUG:boto:Method: GET 2024-04-16T18:27:47.085 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.085 DEBUG:boto:Data: 2024-04-16T18:27:47.085 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.085 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.085 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.085 DEBUG:boto:Params: {} 2024-04-16T18:27:47.085 DEBUG:boto:Token: None 2024-04-16T18:27:47.086 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.086 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU= 2024-04-16T18:27:47.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU=', 'Content-Length': '0'} 2024-04-16T18:27:47.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002efd63b03f42945e-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.130 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.130 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.131 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.131 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.131 DEBUG:boto:Method: GET 2024-04-16T18:27:47.131 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.131 DEBUG:boto:Data: 2024-04-16T18:27:47.131 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.131 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.131 DEBUG:boto:Params: {} 2024-04-16T18:27:47.131 DEBUG:boto:Token: None 2024-04-16T18:27:47.131 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:27:47.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU= 2024-04-16T18:27:47.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MAL6TnrZinWjwoiB8n8cjtskKMU=', 'Content-Length': '0'} 2024-04-16T18:27:47.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000619c45432e9efabb-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.134 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.134 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.134 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.134 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.134 DEBUG:boto:Method: GET 2024-04-16T18:27:47.134 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.134 DEBUG:boto:Data: 2024-04-16T18:27:47.135 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.135 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.135 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.135 DEBUG:boto:Params: {} 2024-04-16T18:27:47.135 DEBUG:boto:Token: None 2024-04-16T18:27:47.135 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.137 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8db08ef04e5ace3-00661ec323-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.182 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.183 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.183 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.183 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.183 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.183 DEBUG:boto:Method: GET 2024-04-16T18:27:47.183 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.183 DEBUG:boto:Data: 2024-04-16T18:27:47.183 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.184 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.184 DEBUG:boto:Params: {} 2024-04-16T18:27:47.184 DEBUG:boto:Token: None 2024-04-16T18:27:47.184 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.187 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000caef2200078934a5-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.187 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.188 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.188 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.188 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.188 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:27:47.188 DEBUG:boto:Data: 2024-04-16T18:27:47.188 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.188 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.189 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.189 DEBUG:boto:Params: {} 2024-04-16T18:27:47.189 DEBUG:boto:Token: None 2024-04-16T18:27:47.189 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87 2024-04-16T18:27:47.189 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w0C6lOjR5uNEYJyvOZwGSMw07gY= 2024-04-16T18:27:47.189 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w0C6lOjR5uNEYJyvOZwGSMw07gY=', 'Content-Length': '0'} 2024-04-16T18:27:47.191 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017bf15e325701845-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.191 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.191 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.191 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.191 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:27:47.191 DEBUG:boto:Data: 2024-04-16T18:27:47.191 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.192 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.192 DEBUG:boto:Params: {} 2024-04-16T18:27:47.192 DEBUG:boto:Token: None 2024-04-16T18:27:47.192 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87 2024-04-16T18:27:47.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w0C6lOjR5uNEYJyvOZwGSMw07gY= 2024-04-16T18:27:47.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w0C6lOjR5uNEYJyvOZwGSMw07gY=', 'Content-Length': '0'} 2024-04-16T18:27:47.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038f606525c5ac912-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:27:47.194 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.195 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.195 DEBUG:boto:Method: GET 2024-04-16T18:27:47.195 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:27:47.195 DEBUG:boto:Data: 2024-04-16T18:27:47.195 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.195 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.195 DEBUG:boto:Params: {} 2024-04-16T18:27:47.195 DEBUG:boto:Token: None 2024-04-16T18:27:47.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87 2024-04-16T18:27:47.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q7zAzTR570FCjOlR0NhrUCBrJAg= 2024-04-16T18:27:47.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q7zAzTR570FCjOlR0NhrUCBrJAg=', 'Content-Length': '0'} 2024-04-16T18:27:47.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9b1c28da3f4b94e-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.238 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:27:47.238 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:27:47.239 DEBUG:boto:Method: GET 2024-04-16T18:27:47.239 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:27:47.239 DEBUG:boto:Data: 2024-04-16T18:27:47.239 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.239 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.239 DEBUG:boto:Params: {} 2024-04-16T18:27:47.239 DEBUG:boto:Token: None 2024-04-16T18:27:47.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj87 2024-04-16T18:27:47.239 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q7zAzTR570FCjOlR0NhrUCBrJAg= 2024-04-16T18:27:47.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q7zAzTR570FCjOlR0NhrUCBrJAg=', 'Content-Length': '0'} 2024-04-16T18:27:47.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a894150a81a13c1-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.242 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.242 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.242 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.242 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.242 DEBUG:boto:Method: GET 2024-04-16T18:27:47.242 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.242 DEBUG:boto:Data: 2024-04-16T18:27:47.242 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.242 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.243 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.243 DEBUG:boto:Params: {} 2024-04-16T18:27:47.243 DEBUG:boto:Token: None 2024-04-16T18:27:47.243 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.245 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c03266bcd9277d9e-00661ec323-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.286 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.287 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.287 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.287 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.287 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.287 DEBUG:boto:Method: GET 2024-04-16T18:27:47.287 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:27:47.287 DEBUG:boto:Data: 2024-04-16T18:27:47.287 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.287 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.288 DEBUG:boto:Params: {} 2024-04-16T18:27:47.288 DEBUG:boto:Token: None 2024-04-16T18:27:47.288 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.291 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038e64715c8f18c05-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.292 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.292 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:27:47.292 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.292 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.292 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.292 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.292 DEBUG:boto:Method: GET 2024-04-16T18:27:47.293 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.293 DEBUG:boto:Data: 2024-04-16T18:27:47.293 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.293 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.293 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.293 DEBUG:boto:Params: {} 2024-04-16T18:27:47.293 DEBUG:boto:Token: None 2024-04-16T18:27:47.293 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc= 2024-04-16T18:27:47.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc=', 'Content-Length': '0'} 2024-04-16T18:27:47.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000964a6382026eaf47-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.338 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.338 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.338 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.339 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.339 DEBUG:boto:Method: GET 2024-04-16T18:27:47.339 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.339 DEBUG:boto:Data: 2024-04-16T18:27:47.339 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.339 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.339 DEBUG:boto:Params: {} 2024-04-16T18:27:47.339 DEBUG:boto:Token: None 2024-04-16T18:27:47.339 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc= 2024-04-16T18:27:47.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc=', 'Content-Length': '0'} 2024-04-16T18:27:47.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd90e0566eafec23-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.342 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.342 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.342 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.342 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.342 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.343 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.343 DEBUG:boto:Data: 2024-04-16T18:27:47.343 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.343 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.343 DEBUG:boto:Params: {} 2024-04-16T18:27:47.343 DEBUG:boto:Token: None 2024-04-16T18:27:47.343 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SlFiIMz1dM0/RwaxOJXiGGe0V3k= 2024-04-16T18:27:47.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SlFiIMz1dM0/RwaxOJXiGGe0V3k=', 'Content-Length': '0'} 2024-04-16T18:27:47.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001db33fb3cf69e625-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.346 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.346 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.346 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.346 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.346 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.346 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.346 DEBUG:boto:Data: 2024-04-16T18:27:47.346 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.346 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.346 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.346 DEBUG:boto:Params: {} 2024-04-16T18:27:47.347 DEBUG:boto:Token: None 2024-04-16T18:27:47.347 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SlFiIMz1dM0/RwaxOJXiGGe0V3k= 2024-04-16T18:27:47.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SlFiIMz1dM0/RwaxOJXiGGe0V3k=', 'Content-Length': '0'} 2024-04-16T18:27:47.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1bfafe858704ac1-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:27:47.349 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.349 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.349 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.349 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.349 DEBUG:boto:Method: GET 2024-04-16T18:27:47.350 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.350 DEBUG:boto:Data: 2024-04-16T18:27:47.350 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.350 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.350 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.350 DEBUG:boto:Params: {} 2024-04-16T18:27:47.350 DEBUG:boto:Token: None 2024-04-16T18:27:47.350 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc= 2024-04-16T18:27:47.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc=', 'Content-Length': '0'} 2024-04-16T18:27:47.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a40de358875cb68c-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.394 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.395 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.395 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.395 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.395 DEBUG:boto:Method: GET 2024-04-16T18:27:47.395 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.395 DEBUG:boto:Data: 2024-04-16T18:27:47.395 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.395 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.395 DEBUG:boto:Params: {} 2024-04-16T18:27:47.396 DEBUG:boto:Token: None 2024-04-16T18:27:47.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:27:47.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc= 2024-04-16T18:27:47.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ds38xbTH4KkpHnX1oKOQRg/sPgc=', 'Content-Length': '0'} 2024-04-16T18:27:47.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd420a2080485e36-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.398 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.398 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.398 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.399 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.399 DEBUG:boto:Method: GET 2024-04-16T18:27:47.399 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.399 DEBUG:boto:Data: 2024-04-16T18:27:47.399 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.399 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.399 DEBUG:boto:Params: {} 2024-04-16T18:27:47.399 DEBUG:boto:Token: None 2024-04-16T18:27:47.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079fe0eb8c4fab1da-00661ec323-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.442 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.443 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.443 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.443 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.443 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.443 DEBUG:boto:Method: GET 2024-04-16T18:27:47.443 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.443 DEBUG:boto:Data: 2024-04-16T18:27:47.443 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.443 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.444 DEBUG:boto:Params: {} 2024-04-16T18:27:47.444 DEBUG:boto:Token: None 2024-04-16T18:27:47.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.447 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000935ceb532549e1b0-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.447 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.448 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.448 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.448 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.448 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:27:47.448 DEBUG:boto:Data: 2024-04-16T18:27:47.448 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.448 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.448 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.448 DEBUG:boto:Params: {} 2024-04-16T18:27:47.449 DEBUG:boto:Token: None 2024-04-16T18:27:47.449 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92 2024-04-16T18:27:47.449 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h0WlaGRBeoBxdeGhwhfuhMw9ULE= 2024-04-16T18:27:47.449 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h0WlaGRBeoBxdeGhwhfuhMw9ULE=', 'Content-Length': '0'} 2024-04-16T18:27:47.451 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9bc8c376c445e5f-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.451 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.451 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.451 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.451 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:27:47.451 DEBUG:boto:Data: 2024-04-16T18:27:47.451 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.452 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.452 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.452 DEBUG:boto:Params: {} 2024-04-16T18:27:47.452 DEBUG:boto:Token: None 2024-04-16T18:27:47.452 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92 2024-04-16T18:27:47.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h0WlaGRBeoBxdeGhwhfuhMw9ULE= 2024-04-16T18:27:47.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h0WlaGRBeoBxdeGhwhfuhMw9ULE=', 'Content-Length': '0'} 2024-04-16T18:27:47.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c44df788a437c0cd-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.454 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:27:47.454 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.454 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.455 DEBUG:boto:Method: GET 2024-04-16T18:27:47.455 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:27:47.455 DEBUG:boto:Data: 2024-04-16T18:27:47.455 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.455 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.455 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.455 DEBUG:boto:Params: {} 2024-04-16T18:27:47.455 DEBUG:boto:Token: None 2024-04-16T18:27:47.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92 2024-04-16T18:27:47.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SKz+XAprbgMeFMs9u016/mo3gk= 2024-04-16T18:27:47.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SKz+XAprbgMeFMs9u016/mo3gk=', 'Content-Length': '0'} 2024-04-16T18:27:47.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080981e10835d71b7-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.498 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:27:47.498 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:27:47.498 DEBUG:boto:Method: GET 2024-04-16T18:27:47.499 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:27:47.499 DEBUG:boto:Data: 2024-04-16T18:27:47.499 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.499 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.499 DEBUG:boto:Params: {} 2024-04-16T18:27:47.499 DEBUG:boto:Token: None 2024-04-16T18:27:47.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj92 2024-04-16T18:27:47.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SKz+XAprbgMeFMs9u016/mo3gk= 2024-04-16T18:27:47.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SKz+XAprbgMeFMs9u016/mo3gk=', 'Content-Length': '0'} 2024-04-16T18:27:47.501 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d90c412c02fdd79-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.502 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.502 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.502 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.502 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.502 DEBUG:boto:Method: GET 2024-04-16T18:27:47.502 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.502 DEBUG:boto:Data: 2024-04-16T18:27:47.502 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.502 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.503 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.503 DEBUG:boto:Params: {} 2024-04-16T18:27:47.503 DEBUG:boto:Token: None 2024-04-16T18:27:47.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.503 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.505 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ac5461967e56f6f5-00661ec323-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.546 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.547 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.547 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.547 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.547 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.547 DEBUG:boto:Method: GET 2024-04-16T18:27:47.547 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:27:47.547 DEBUG:boto:Data: 2024-04-16T18:27:47.547 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.547 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.547 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.547 DEBUG:boto:Params: {} 2024-04-16T18:27:47.548 DEBUG:boto:Token: None 2024-04-16T18:27:47.548 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.552 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000775e0f1722eb25fa-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.552 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:27:47.553 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.553 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.553 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.553 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.553 DEBUG:boto:Method: GET 2024-04-16T18:27:47.553 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.553 DEBUG:boto:Data: 2024-04-16T18:27:47.554 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.554 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.554 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.554 DEBUG:boto:Params: {} 2024-04-16T18:27:47.554 DEBUG:boto:Token: None 2024-04-16T18:27:47.554 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.554 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI= 2024-04-16T18:27:47.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI=', 'Content-Length': '0'} 2024-04-16T18:27:47.556 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e3a6ed69b9c158a4-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.598 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.598 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.598 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.599 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.599 DEBUG:boto:Method: GET 2024-04-16T18:27:47.599 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.599 DEBUG:boto:Data: 2024-04-16T18:27:47.599 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.599 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.599 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.599 DEBUG:boto:Params: {} 2024-04-16T18:27:47.599 DEBUG:boto:Token: None 2024-04-16T18:27:47.599 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI= 2024-04-16T18:27:47.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI=', 'Content-Length': '0'} 2024-04-16T18:27:47.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000051ba23585fe5db82-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.602 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.602 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.602 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.602 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.602 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.603 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.603 DEBUG:boto:Data: 2024-04-16T18:27:47.603 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.603 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.603 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.603 DEBUG:boto:Params: {} 2024-04-16T18:27:47.603 DEBUG:boto:Token: None 2024-04-16T18:27:47.603 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICHaxfbVWhJVlv+6ZJNGuRTRwVM= 2024-04-16T18:27:47.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICHaxfbVWhJVlv+6ZJNGuRTRwVM=', 'Content-Length': '0'} 2024-04-16T18:27:47.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009789c6f84ea71450-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.605 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.606 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.606 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.606 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.606 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.606 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.606 DEBUG:boto:Data: 2024-04-16T18:27:47.606 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.606 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.606 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.606 DEBUG:boto:Params: {} 2024-04-16T18:27:47.607 DEBUG:boto:Token: None 2024-04-16T18:27:47.607 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICHaxfbVWhJVlv+6ZJNGuRTRwVM= 2024-04-16T18:27:47.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICHaxfbVWhJVlv+6ZJNGuRTRwVM=', 'Content-Length': '0'} 2024-04-16T18:27:47.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cb0b9821a03743e-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:27:47.609 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.609 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.609 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.609 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.609 DEBUG:boto:Method: GET 2024-04-16T18:27:47.610 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.610 DEBUG:boto:Data: 2024-04-16T18:27:47.610 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.610 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.610 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.610 DEBUG:boto:Params: {} 2024-04-16T18:27:47.610 DEBUG:boto:Token: None 2024-04-16T18:27:47.610 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI= 2024-04-16T18:27:47.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI=', 'Content-Length': '0'} 2024-04-16T18:27:47.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002594ba317845d0a7-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.654 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.655 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.655 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.655 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.655 DEBUG:boto:Method: GET 2024-04-16T18:27:47.655 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.655 DEBUG:boto:Data: 2024-04-16T18:27:47.655 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.655 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.655 DEBUG:boto:Params: {} 2024-04-16T18:27:47.655 DEBUG:boto:Token: None 2024-04-16T18:27:47.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:27:47.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI= 2024-04-16T18:27:47.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gdlnnc1dB372upMwTHQ8aCsgtTI=', 'Content-Length': '0'} 2024-04-16T18:27:47.657 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000415bb10cd01bdcbf-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.658 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.658 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.658 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.658 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.658 DEBUG:boto:Method: GET 2024-04-16T18:27:47.658 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.659 DEBUG:boto:Data: 2024-04-16T18:27:47.659 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.659 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.659 DEBUG:boto:Params: {} 2024-04-16T18:27:47.659 DEBUG:boto:Token: None 2024-04-16T18:27:47.659 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.662 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007284e9b81e0674e5-00661ec323-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.702 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.703 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.703 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.703 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.703 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.703 DEBUG:boto:Method: GET 2024-04-16T18:27:47.703 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.703 DEBUG:boto:Data: 2024-04-16T18:27:47.703 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.703 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.704 DEBUG:boto:Params: {} 2024-04-16T18:27:47.704 DEBUG:boto:Token: None 2024-04-16T18:27:47.704 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.707 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000072ffffe7bdf56f44-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.708 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.708 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.708 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.708 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.708 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:27:47.708 DEBUG:boto:Data: 2024-04-16T18:27:47.708 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.708 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.708 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.709 DEBUG:boto:Params: {} 2024-04-16T18:27:47.709 DEBUG:boto:Token: None 2024-04-16T18:27:47.709 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93 2024-04-16T18:27:47.709 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RtEjCGR7DP5DRwe3qF5+IRV20mM= 2024-04-16T18:27:47.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RtEjCGR7DP5DRwe3qF5+IRV20mM=', 'Content-Length': '0'} 2024-04-16T18:27:47.711 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bb0d4591dc8a36e-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.711 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.711 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.711 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.711 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:27:47.711 DEBUG:boto:Data: 2024-04-16T18:27:47.712 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.712 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.712 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.712 DEBUG:boto:Params: {} 2024-04-16T18:27:47.712 DEBUG:boto:Token: None 2024-04-16T18:27:47.712 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93 2024-04-16T18:27:47.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RtEjCGR7DP5DRwe3qF5+IRV20mM= 2024-04-16T18:27:47.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RtEjCGR7DP5DRwe3qF5+IRV20mM=', 'Content-Length': '0'} 2024-04-16T18:27:47.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a20f839ac8e2db0-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:27:47.715 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.715 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.715 DEBUG:boto:Method: GET 2024-04-16T18:27:47.715 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:27:47.715 DEBUG:boto:Data: 2024-04-16T18:27:47.715 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.715 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.715 DEBUG:boto:Params: {} 2024-04-16T18:27:47.715 DEBUG:boto:Token: None 2024-04-16T18:27:47.716 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93 2024-04-16T18:27:47.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:spPz/xSwn1YLFXpC8pfNGsmTjtg= 2024-04-16T18:27:47.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:spPz/xSwn1YLFXpC8pfNGsmTjtg=', 'Content-Length': '0'} 2024-04-16T18:27:47.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b4ae5fcb7595cf7-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.758 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:27:47.758 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:27:47.758 DEBUG:boto:Method: GET 2024-04-16T18:27:47.759 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:27:47.759 DEBUG:boto:Data: 2024-04-16T18:27:47.759 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.759 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.759 DEBUG:boto:Params: {} 2024-04-16T18:27:47.759 DEBUG:boto:Token: None 2024-04-16T18:27:47.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj93 2024-04-16T18:27:47.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:spPz/xSwn1YLFXpC8pfNGsmTjtg= 2024-04-16T18:27:47.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:spPz/xSwn1YLFXpC8pfNGsmTjtg=', 'Content-Length': '0'} 2024-04-16T18:27:47.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036a0a94d8114543b-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.761 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.762 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.762 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.762 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.762 DEBUG:boto:Method: GET 2024-04-16T18:27:47.762 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.762 DEBUG:boto:Data: 2024-04-16T18:27:47.762 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.762 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.762 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.762 DEBUG:boto:Params: {} 2024-04-16T18:27:47.763 DEBUG:boto:Token: None 2024-04-16T18:27:47.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.765 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000badfd2568d5aaf8-00661ec323-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.806 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.807 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.807 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.807 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.807 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.807 DEBUG:boto:Method: GET 2024-04-16T18:27:47.807 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:27:47.807 DEBUG:boto:Data: 2024-04-16T18:27:47.807 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.808 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.808 DEBUG:boto:Params: {} 2024-04-16T18:27:47.808 DEBUG:boto:Token: None 2024-04-16T18:27:47.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.811 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf3dd1f16a5015a9-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.812 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.812 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:27:47.812 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.812 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.812 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.812 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.812 DEBUG:boto:Method: GET 2024-04-16T18:27:47.812 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.812 DEBUG:boto:Data: 2024-04-16T18:27:47.813 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.813 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.813 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.813 DEBUG:boto:Params: {} 2024-04-16T18:27:47.813 DEBUG:boto:Token: None 2024-04-16T18:27:47.813 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.813 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc= 2024-04-16T18:27:47.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc=', 'Content-Length': '0'} 2024-04-16T18:27:47.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000739c3fc95fd04b93-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.858 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.858 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.859 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.859 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.859 DEBUG:boto:Method: GET 2024-04-16T18:27:47.859 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.859 DEBUG:boto:Data: 2024-04-16T18:27:47.859 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.859 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.859 DEBUG:boto:Params: {} 2024-04-16T18:27:47.859 DEBUG:boto:Token: None 2024-04-16T18:27:47.859 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc= 2024-04-16T18:27:47.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc=', 'Content-Length': '0'} 2024-04-16T18:27:47.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b0720adf5c9e043-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.862 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.863 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.863 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.863 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.863 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.863 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.863 DEBUG:boto:Data: 2024-04-16T18:27:47.863 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.863 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.863 DEBUG:boto:Params: {} 2024-04-16T18:27:47.863 DEBUG:boto:Token: None 2024-04-16T18:27:47.864 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3X1JsKkKz3Ia52P4ryDAgjI7F8E= 2024-04-16T18:27:47.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3X1JsKkKz3Ia52P4ryDAgjI7F8E=', 'Content-Length': '0'} 2024-04-16T18:27:47.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000247298962d35860a-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.866 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.866 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.866 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.867 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.867 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.867 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.867 DEBUG:boto:Data: 2024-04-16T18:27:47.867 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.867 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.867 DEBUG:boto:Params: {} 2024-04-16T18:27:47.867 DEBUG:boto:Token: None 2024-04-16T18:27:47.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3X1JsKkKz3Ia52P4ryDAgjI7F8E= 2024-04-16T18:27:47.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3X1JsKkKz3Ia52P4ryDAgjI7F8E=', 'Content-Length': '0'} 2024-04-16T18:27:47.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081fc7772c41c6f78-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.870 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:27:47.870 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.870 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.870 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.870 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.870 DEBUG:boto:Method: GET 2024-04-16T18:27:47.871 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.871 DEBUG:boto:Data: 2024-04-16T18:27:47.871 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.871 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.871 DEBUG:boto:Params: {} 2024-04-16T18:27:47.871 DEBUG:boto:Token: None 2024-04-16T18:27:47.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc= 2024-04-16T18:27:47.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc=', 'Content-Length': '0'} 2024-04-16T18:27:47.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054abec24f38a8f24-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.914 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.914 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.915 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.915 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.915 DEBUG:boto:Method: GET 2024-04-16T18:27:47.915 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.915 DEBUG:boto:Data: 2024-04-16T18:27:47.915 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.915 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.915 DEBUG:boto:Params: {} 2024-04-16T18:27:47.915 DEBUG:boto:Token: None 2024-04-16T18:27:47.915 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:27:47.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc= 2024-04-16T18:27:47.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iKK+X8xFDDiJCfjen22PnsuNYAc=', 'Content-Length': '0'} 2024-04-16T18:27:47.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb5e8e1aec10a85e-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.918 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.918 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.918 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:47.918 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:47.919 DEBUG:boto:Method: GET 2024-04-16T18:27:47.919 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:27:47.919 DEBUG:boto:Data: 2024-04-16T18:27:47.919 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.919 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.919 DEBUG:boto:Params: {} 2024-04-16T18:27:47.919 DEBUG:boto:Token: None 2024-04-16T18:27:47.919 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.922 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a248cbf629862f9-00661ec323-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.962 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.963 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:47.963 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:47.963 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:47.963 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:47.963 DEBUG:boto:Method: GET 2024-04-16T18:27:47.963 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:27:47.963 DEBUG:boto:Data: 2024-04-16T18:27:47.963 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.963 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.963 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.963 DEBUG:boto:Params: {} 2024-04-16T18:27:47.964 DEBUG:boto:Token: None 2024-04-16T18:27:47.964 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/ 2024-04-16T18:27:47.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y= 2024-04-16T18:27:47.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O14cYfLTo+rnauVe7D8hwIp1K6Y=', 'Content-Length': '0'} 2024-04-16T18:27:47.967 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ce614a70713a7a33-00661ec323-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.967 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:47.968 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.968 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.968 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.968 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:27:47.968 DEBUG:boto:Data: 2024-04-16T18:27:47.968 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.968 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.968 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.969 DEBUG:boto:Params: {} 2024-04-16T18:27:47.969 DEBUG:boto:Token: None 2024-04-16T18:27:47.969 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95 2024-04-16T18:27:47.969 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KbFlr501BqEdm3tuNoBrNMAU28c= 2024-04-16T18:27:47.969 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KbFlr501BqEdm3tuNoBrNMAU28c=', 'Content-Length': '0'} 2024-04-16T18:27:47.971 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba474d7e5546ee54-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.971 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.972 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.972 DEBUG:boto:Method: HEAD 2024-04-16T18:27:47.972 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:27:47.972 DEBUG:boto:Data: 2024-04-16T18:27:47.972 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.972 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:47.972 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.972 DEBUG:boto:Params: {} 2024-04-16T18:27:47.972 DEBUG:boto:Token: None 2024-04-16T18:27:47.972 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95 2024-04-16T18:27:47.973 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KbFlr501BqEdm3tuNoBrNMAU28c= 2024-04-16T18:27:47.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KbFlr501BqEdm3tuNoBrNMAU28c=', 'Content-Length': '0'} 2024-04-16T18:27:47.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fae3f162aa6d431a-00661ec323-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:47.975 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:27:47.975 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:47.975 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:47.975 DEBUG:boto:Method: GET 2024-04-16T18:27:47.975 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:27:47.975 DEBUG:boto:Data: 2024-04-16T18:27:47.975 DEBUG:boto:Headers: {} 2024-04-16T18:27:47.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:47.975 DEBUG:boto:Port: 8000 2024-04-16T18:27:47.976 DEBUG:boto:Params: {} 2024-04-16T18:27:47.976 DEBUG:boto:Token: None 2024-04-16T18:27:47.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:47 GMT /cjqttm-52/obj95 2024-04-16T18:27:47.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Bi/k2focVATE3J3RrB9+UKeqBfQ= 2024-04-16T18:27:47.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Bi/k2focVATE3J3RrB9+UKeqBfQ=', 'Content-Length': '0'} 2024-04-16T18:27:47.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036c39be86d53c62d-00661ec323-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.018 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:27:48.018 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:27:48.019 DEBUG:boto:Method: GET 2024-04-16T18:27:48.019 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:27:48.019 DEBUG:boto:Data: 2024-04-16T18:27:48.019 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.019 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.019 DEBUG:boto:Params: {} 2024-04-16T18:27:48.019 DEBUG:boto:Token: None 2024-04-16T18:27:48.019 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/obj95 2024-04-16T18:27:48.019 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Bjy/JdAE7TWZuYExyQqJxMbXZXo= 2024-04-16T18:27:48.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Bjy/JdAE7TWZuYExyQqJxMbXZXo=', 'Content-Length': '0'} 2024-04-16T18:27:48.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb712f0719cc42b8-00661ec324-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.022 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:48.022 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:48.022 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:48.022 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:48.022 DEBUG:boto:Method: GET 2024-04-16T18:27:48.022 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:27:48.022 DEBUG:boto:Data: 2024-04-16T18:27:48.022 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.023 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:27:48.023 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.023 DEBUG:boto:Params: {} 2024-04-16T18:27:48.023 DEBUG:boto:Token: None 2024-04-16T18:27:48.023 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/ 2024-04-16T18:27:48.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G8PRJLkZKEjJqqA2maDJW1VZQKc= 2024-04-16T18:27:48.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G8PRJLkZKEjJqqA2maDJW1VZQKc=', 'Content-Length': '0'} 2024-04-16T18:27:48.025 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d9e7e4afa7119ae1-00661ec324-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.066 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:48.066 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:48.067 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:48.067 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:48.067 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:27:48.067 DEBUG:boto:Method: GET 2024-04-16T18:27:48.067 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:27:48.067 DEBUG:boto:Data: 2024-04-16T18:27:48.067 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.067 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.067 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.067 DEBUG:boto:Params: {} 2024-04-16T18:27:48.067 DEBUG:boto:Token: None 2024-04-16T18:27:48.068 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/ 2024-04-16T18:27:48.068 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G8PRJLkZKEjJqqA2maDJW1VZQKc= 2024-04-16T18:27:48.068 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G8PRJLkZKEjJqqA2maDJW1VZQKc=', 'Content-Length': '0'} 2024-04-16T18:27:48.071 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000377d6e9339d82d5a-00661ec324-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.071 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:27:48.071 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:27:48.072 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:27:48.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:27:48.072 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:27:48.130 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:27:48.130 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:27:48.212 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:27:48.212 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-52 2024-04-16T18:27:48.226 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 30 2024-04-16T18:27:48.306 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:48.306 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:48.306 DEBUG:boto:Method: HEAD 2024-04-16T18:27:48.306 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:27:48.307 DEBUG:boto:Data: 2024-04-16T18:27:48.307 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.307 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.307 DEBUG:boto:Params: {} 2024-04-16T18:27:48.307 DEBUG:boto:Token: None 2024-04-16T18:27:48.307 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/ 2024-04-16T18:27:48.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow= 2024-04-16T18:27:48.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow=', 'Content-Length': '0'} 2024-04-16T18:27:48.311 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008bb2cb385faf02ab-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.311 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:27:48.311 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:27:48.311 DEBUG:boto:Method: PUT 2024-04-16T18:27:48.311 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:27:48.311 DEBUG:boto:Data: 2024-04-16T18:27:48.311 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:27:48.312 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.312 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.312 DEBUG:boto:Params: {} 2024-04-16T18:27:48.312 DEBUG:boto:Token: None 2024-04-16T18:27:48.312 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/obj37 2024-04-16T18:27:48.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2dvOJa4aGVGeWW0lvNt04mN42yA= 2024-04-16T18:27:48.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2dvOJa4aGVGeWW0lvNt04mN42yA='} 2024-04-16T18:27:48.318 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000079b4e94bc1af190d-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.318 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:48.318 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:48.318 DEBUG:boto:Method: HEAD 2024-04-16T18:27:48.318 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:27:48.318 DEBUG:boto:Data: 2024-04-16T18:27:48.319 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.319 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.319 DEBUG:boto:Params: {} 2024-04-16T18:27:48.319 DEBUG:boto:Token: None 2024-04-16T18:27:48.319 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/ 2024-04-16T18:27:48.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow= 2024-04-16T18:27:48.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow=', 'Content-Length': '0'} 2024-04-16T18:27:48.322 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000069b27704e07fecc-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.322 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:27:48.322 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:27:48.322 DEBUG:boto:Method: PUT 2024-04-16T18:27:48.322 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:27:48.323 DEBUG:boto:Data: 2024-04-16T18:27:48.323 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:27:48.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.323 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.323 DEBUG:boto:Params: {} 2024-04-16T18:27:48.323 DEBUG:boto:Token: None 2024-04-16T18:27:48.323 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/obj74 2024-04-16T18:27:48.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uSCbnRsYT1ClE3CuLTwfk2t4WsQ= 2024-04-16T18:27:48.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uSCbnRsYT1ClE3CuLTwfk2t4WsQ='} 2024-04-16T18:27:48.328 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000225f3266264f6a09-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.329 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:48.329 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:48.329 DEBUG:boto:Method: HEAD 2024-04-16T18:27:48.329 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:27:48.329 DEBUG:boto:Data: 2024-04-16T18:27:48.329 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.329 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.329 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.329 DEBUG:boto:Params: {} 2024-04-16T18:27:48.330 DEBUG:boto:Token: None 2024-04-16T18:27:48.330 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/ 2024-04-16T18:27:48.330 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow= 2024-04-16T18:27:48.330 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow=', 'Content-Length': '0'} 2024-04-16T18:27:48.332 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b6fa5e7e02bc934c-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.333 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:27:48.333 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:27:48.333 DEBUG:boto:Method: PUT 2024-04-16T18:27:48.333 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:27:48.333 DEBUG:boto:Data: 2024-04-16T18:27:48.333 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:27:48.333 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.333 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.333 DEBUG:boto:Params: {} 2024-04-16T18:27:48.334 DEBUG:boto:Token: None 2024-04-16T18:27:48.334 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/obj111 2024-04-16T18:27:48.334 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:irceT6tP7lB9y+GcDQVKAt7wBXI= 2024-04-16T18:27:48.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:irceT6tP7lB9y+GcDQVKAt7wBXI='} 2024-04-16T18:27:48.378 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ca990d7be227ba25-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.379 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:48.379 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:48.379 DEBUG:boto:Method: HEAD 2024-04-16T18:27:48.379 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:27:48.379 DEBUG:boto:Data: 2024-04-16T18:27:48.379 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.379 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.379 DEBUG:boto:Params: {} 2024-04-16T18:27:48.381 DEBUG:boto:Token: None 2024-04-16T18:27:48.381 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/ 2024-04-16T18:27:48.381 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow= 2024-04-16T18:27:48.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow=', 'Content-Length': '0'} 2024-04-16T18:27:48.403 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000016053fbd0d227bde-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.403 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:27:48.403 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:27:48.404 DEBUG:boto:Method: PUT 2024-04-16T18:27:48.404 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:27:48.404 DEBUG:boto:Data: 2024-04-16T18:27:48.404 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:27:48.404 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.404 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.404 DEBUG:boto:Params: {} 2024-04-16T18:27:48.404 DEBUG:boto:Token: None 2024-04-16T18:27:48.404 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/obj148 2024-04-16T18:27:48.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pEnZiFk3PIslFY3DOCVkC20uMGc= 2024-04-16T18:27:48.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pEnZiFk3PIslFY3DOCVkC20uMGc='} 2024-04-16T18:27:48.410 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ce6940fd86b1e5fd-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.410 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:27:48.410 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:27:48.410 DEBUG:boto:Method: HEAD 2024-04-16T18:27:48.411 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:27:48.411 DEBUG:boto:Data: 2024-04-16T18:27:48.411 DEBUG:boto:Headers: {} 2024-04-16T18:27:48.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.411 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.411 DEBUG:boto:Params: {} 2024-04-16T18:27:48.411 DEBUG:boto:Token: None 2024-04-16T18:27:48.411 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/ 2024-04-16T18:27:48.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow= 2024-04-16T18:27:48.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bo6VKZz7HCftHBZGctTHrjsc8Ow=', 'Content-Length': '0'} 2024-04-16T18:27:48.414 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005fe9735faf86e2ba-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.415 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:27:48.415 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:27:48.415 DEBUG:boto:Method: PUT 2024-04-16T18:27:48.415 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:27:48.415 DEBUG:boto:Data: 2024-04-16T18:27:48.415 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:27:48.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:27:48.415 DEBUG:boto:Port: 8000 2024-04-16T18:27:48.415 DEBUG:boto:Params: {} 2024-04-16T18:27:48.416 DEBUG:boto:Token: None 2024-04-16T18:27:48.416 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:27:48 GMT /cjqttm-52/obj185 2024-04-16T18:27:48.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:stZrV5S2h5uB8l5hiwYg2X9pP/0= 2024-04-16T18:27:48.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:27:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:stZrV5S2h5uB8l5hiwYg2X9pP/0='} 2024-04-16T18:27:48.458 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005fa43f90b202fb9d-00661ec324-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:27:48.459 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:27:48.459 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:27:48.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:27:48.459 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:27:48.521 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:27:48.522 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:27:48.582 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:48.583+0000 7fc42c71f800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:27:53.585 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:53.585+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:53.585 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:27:53.585 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:27:58.588 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:27:58.588+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:27:58.588 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:27:58.588 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:03.590 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:03.590+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:03.590 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:03.590 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:08.592 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:08.592+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:08.592 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:08.592 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:13.594 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:13.595+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:13.594 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:13.595 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:18.597 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:18.597+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:18.597 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:18.597 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:23.599 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:23.600+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:23.600 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:23.600 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:28.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:28.603+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:28.602 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:28.602 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:33.604 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:33.605+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:33.604 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:33.604 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:38.606 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:38.606+0000 7fc42c71f800 1 waiting for incremental sync to catch up: 2024-04-16T18:28:38.607 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , , , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:38.607 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:43.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:43.609+0000 7fc42c71f800 1 bucket sync caught up with source: 2024-04-16T18:28:43.609 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:43.609 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:28:43.609 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:28:43.609+0000 7fc42c71f800 0 bucket checkpoint complete 2024-04-16T18:28:43.635 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:28:43.635 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:28:43.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:28:43.636 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:28:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:43.698 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:43.760 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:28:43.761+0000 7f66f7c0f800 1 bucket sync caught up with source: 2024-04-16T18:28:43.761 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000003.555.6, 00000000002.673.6, 00000000002.1312.6, 00000000005.443.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000004.892.6, 00000000007.179.6, 00000000006.780.6] 2024-04-16T18:28:43.761 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000003.555.6, 00000000002.673.6, 00000000002.1312.6, 00000000005.443.6, 00000000004.278.6, 00000000001.395.6, 00000000001.554.6, 00000000004.892.6, 00000000007.179.6, 00000000006.780.6] 2024-04-16T18:28:43.761 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:28:43.761+0000 7f66f7c0f800 0 bucket checkpoint complete 2024-04-16T18:28:43.783 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:28:43.783 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.784 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.784 DEBUG:boto:Method: HEAD 2024-04-16T18:28:43.784 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:28:43.784 DEBUG:boto:Data: 2024-04-16T18:28:43.784 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.784 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.784 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.784 DEBUG:boto:Params: {} 2024-04-16T18:28:43.785 DEBUG:boto:Token: None 2024-04-16T18:28:43.785 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/ 2024-04-16T18:28:43.785 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X5JUVcvKVKnvu+rPXpsRjbpCZjk= 2024-04-16T18:28:43.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X5JUVcvKVKnvu+rPXpsRjbpCZjk=', 'Content-Length': '0'} 2024-04-16T18:28:43.787 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000edfc5c846e4e520c-00661ec35b-5610-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.788 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.788 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.788 DEBUG:boto:Method: HEAD 2024-04-16T18:28:43.788 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:28:43.788 DEBUG:boto:Data: 2024-04-16T18:28:43.788 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.788 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.788 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.788 DEBUG:boto:Params: {} 2024-04-16T18:28:43.789 DEBUG:boto:Token: None 2024-04-16T18:28:43.789 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/ 2024-04-16T18:28:43.789 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X5JUVcvKVKnvu+rPXpsRjbpCZjk= 2024-04-16T18:28:43.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X5JUVcvKVKnvu+rPXpsRjbpCZjk=', 'Content-Length': '0'} 2024-04-16T18:28:43.792 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000727a210f963a3aa5-00661ec35b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.792 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:28:43.792 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.792 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.792 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.792 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.792 DEBUG:boto:Method: GET 2024-04-16T18:28:43.792 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.793 DEBUG:boto:Data: 2024-04-16T18:28:43.793 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.793 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.793 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.793 DEBUG:boto:Params: {} 2024-04-16T18:28:43.793 DEBUG:boto:Token: None 2024-04-16T18:28:43.793 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/?versions 2024-04-16T18:28:43.793 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0= 2024-04-16T18:28:43.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0=', 'Content-Length': '0'} 2024-04-16T18:28:43.796 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb3067dc0126fa80-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.796 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:43.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:28:43.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:28:43.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:28:43.798 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:28:43.799 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:28:43.800 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:28:43.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:28:43.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:28:43.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:28:43.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:28:43.801 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:28:43.801 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:28:43.801 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.801 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.801 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.802 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.802 DEBUG:boto:Method: GET 2024-04-16T18:28:43.802 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.802 DEBUG:boto:Data: 2024-04-16T18:28:43.802 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.802 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.802 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.802 DEBUG:boto:Params: {} 2024-04-16T18:28:43.802 DEBUG:boto:Token: None 2024-04-16T18:28:43.802 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/?versions 2024-04-16T18:28:43.802 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0= 2024-04-16T18:28:43.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0=', 'Content-Length': '0'} 2024-04-16T18:28:43.806 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000012bd86f0e6d6a989-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.806 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:43.807 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:28:43.808 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:28:43.809 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:28:43.810 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:28:43.810 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.810 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.810 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.811 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.811 DEBUG:boto:Method: GET 2024-04-16T18:28:43.811 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.811 DEBUG:boto:Data: 2024-04-16T18:28:43.811 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.811 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.811 DEBUG:boto:Params: {} 2024-04-16T18:28:43.811 DEBUG:boto:Token: None 2024-04-16T18:28:43.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/?versions 2024-04-16T18:28:43.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0= 2024-04-16T18:28:43.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0=', 'Content-Length': '0'} 2024-04-16T18:28:43.814 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000906f53b2b804e8ca-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.815 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:43.816 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.816 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.816 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.816 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.816 DEBUG:boto:Method: GET 2024-04-16T18:28:43.817 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:28:43.817 DEBUG:boto:Data: 2024-04-16T18:28:43.817 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.817 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.817 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.817 DEBUG:boto:Params: {} 2024-04-16T18:28:43.817 DEBUG:boto:Token: None 2024-04-16T18:28:43.817 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/?versions 2024-04-16T18:28:43.817 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0= 2024-04-16T18:28:43.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FY5TRikRbJ0oyWTzzM4bpg5pmq0=', 'Content-Length': '0'} 2024-04-16T18:28:43.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000833580f04e746780-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.821 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:43.822 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:28:43.823 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.823 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.823 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.823 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.823 DEBUG:boto:Method: GET 2024-04-16T18:28:43.823 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.823 DEBUG:boto:Data: 2024-04-16T18:28:43.823 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.823 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.823 DEBUG:boto:Params: {} 2024-04-16T18:28:43.824 DEBUG:boto:Token: None 2024-04-16T18:28:43.824 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ= 2024-04-16T18:28:43.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ=', 'Content-Length': '0'} 2024-04-16T18:28:43.826 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef246dcfc4bcf58f-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.870 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.870 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.871 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.871 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.871 DEBUG:boto:Method: GET 2024-04-16T18:28:43.871 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.871 DEBUG:boto:Data: 2024-04-16T18:28:43.871 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.871 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.871 DEBUG:boto:Params: {} 2024-04-16T18:28:43.871 DEBUG:boto:Token: None 2024-04-16T18:28:43.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ= 2024-04-16T18:28:43.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ=', 'Content-Length': '0'} 2024-04-16T18:28:43.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6f9de5ea10861df-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.874 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.874 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.874 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.874 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.874 DEBUG:boto:Method: HEAD 2024-04-16T18:28:43.874 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.874 DEBUG:boto:Data: 2024-04-16T18:28:43.874 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.875 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.875 DEBUG:boto:Params: {} 2024-04-16T18:28:43.875 DEBUG:boto:Token: None 2024-04-16T18:28:43.875 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b3EtVE2VHsJ9CiJ5q5YqZVC+v7w= 2024-04-16T18:28:43.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b3EtVE2VHsJ9CiJ5q5YqZVC+v7w=', 'Content-Length': '0'} 2024-04-16T18:28:43.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006eb1c042f4c59627-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.877 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.878 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.878 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.878 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.878 DEBUG:boto:Method: HEAD 2024-04-16T18:28:43.878 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.878 DEBUG:boto:Data: 2024-04-16T18:28:43.878 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.878 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.878 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.878 DEBUG:boto:Params: {} 2024-04-16T18:28:43.878 DEBUG:boto:Token: None 2024-04-16T18:28:43.879 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b3EtVE2VHsJ9CiJ5q5YqZVC+v7w= 2024-04-16T18:28:43.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b3EtVE2VHsJ9CiJ5q5YqZVC+v7w=', 'Content-Length': '0'} 2024-04-16T18:28:43.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc4c21cbe350fde5-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:28:43.881 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.881 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.881 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.881 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.881 DEBUG:boto:Method: GET 2024-04-16T18:28:43.881 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.881 DEBUG:boto:Data: 2024-04-16T18:28:43.882 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.882 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.882 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.882 DEBUG:boto:Params: {} 2024-04-16T18:28:43.882 DEBUG:boto:Token: None 2024-04-16T18:28:43.882 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.882 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ= 2024-04-16T18:28:43.882 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ=', 'Content-Length': '0'} 2024-04-16T18:28:43.884 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f3cbfff5dd1091c-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.926 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.926 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.927 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.927 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.927 DEBUG:boto:Method: GET 2024-04-16T18:28:43.927 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.927 DEBUG:boto:Data: 2024-04-16T18:28:43.927 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.927 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.927 DEBUG:boto:Params: {} 2024-04-16T18:28:43.927 DEBUG:boto:Token: None 2024-04-16T18:28:43.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:28:43.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ= 2024-04-16T18:28:43.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2fRdCoRMbJnGGC6NdVNqGxX7pOQ=', 'Content-Length': '0'} 2024-04-16T18:28:43.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e21daa110a9d95fc-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.930 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.930 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.930 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.930 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.930 DEBUG:boto:Method: GET 2024-04-16T18:28:43.930 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.930 DEBUG:boto:Data: 2024-04-16T18:28:43.931 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.931 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.931 DEBUG:boto:Params: {} 2024-04-16T18:28:43.931 DEBUG:boto:Token: None 2024-04-16T18:28:43.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/ 2024-04-16T18:28:43.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0= 2024-04-16T18:28:43.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0=', 'Content-Length': '0'} 2024-04-16T18:28:43.933 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d09256482c772f3d-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.934 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:43.934 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.934 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.934 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.934 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.934 DEBUG:boto:Method: GET 2024-04-16T18:28:43.935 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.935 DEBUG:boto:Data: 2024-04-16T18:28:43.935 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.935 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.935 DEBUG:boto:Params: {} 2024-04-16T18:28:43.935 DEBUG:boto:Token: None 2024-04-16T18:28:43.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/ 2024-04-16T18:28:43.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0= 2024-04-16T18:28:43.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0=', 'Content-Length': '0'} 2024-04-16T18:28:43.938 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c68fa4e0e6e82833-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.939 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:43.939 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.939 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.939 DEBUG:boto:Method: HEAD 2024-04-16T18:28:43.939 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:28:43.939 DEBUG:boto:Data: 2024-04-16T18:28:43.940 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.940 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.940 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.940 DEBUG:boto:Params: {} 2024-04-16T18:28:43.940 DEBUG:boto:Token: None 2024-04-16T18:28:43.940 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11 2024-04-16T18:28:43.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d4rvKZOAsQFfSS1IGePH26TnPEc= 2024-04-16T18:28:43.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d4rvKZOAsQFfSS1IGePH26TnPEc=', 'Content-Length': '0'} 2024-04-16T18:28:43.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000752a39ddf9d31498-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.943 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.943 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.943 DEBUG:boto:Method: HEAD 2024-04-16T18:28:43.943 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:28:43.943 DEBUG:boto:Data: 2024-04-16T18:28:43.943 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.944 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.944 DEBUG:boto:Params: {} 2024-04-16T18:28:43.944 DEBUG:boto:Token: None 2024-04-16T18:28:43.944 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11 2024-04-16T18:28:43.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d4rvKZOAsQFfSS1IGePH26TnPEc= 2024-04-16T18:28:43.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d4rvKZOAsQFfSS1IGePH26TnPEc=', 'Content-Length': '0'} 2024-04-16T18:28:43.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff1634e1197e8579-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.946 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:28:43.946 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.946 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.946 DEBUG:boto:Method: GET 2024-04-16T18:28:43.946 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:28:43.946 DEBUG:boto:Data: 2024-04-16T18:28:43.946 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.947 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.947 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.947 DEBUG:boto:Params: {} 2024-04-16T18:28:43.947 DEBUG:boto:Token: None 2024-04-16T18:28:43.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11 2024-04-16T18:28:43.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eiUadu3Ftn37642UljvomBkzIo0= 2024-04-16T18:28:43.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eiUadu3Ftn37642UljvomBkzIo0=', 'Content-Length': '0'} 2024-04-16T18:28:43.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b1c1964171ed68b-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.990 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:28:43.990 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:28:43.991 DEBUG:boto:Method: GET 2024-04-16T18:28:43.991 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:28:43.991 DEBUG:boto:Data: 2024-04-16T18:28:43.991 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.991 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.991 DEBUG:boto:Params: {} 2024-04-16T18:28:43.991 DEBUG:boto:Token: None 2024-04-16T18:28:43.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/obj11 2024-04-16T18:28:43.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eiUadu3Ftn37642UljvomBkzIo0= 2024-04-16T18:28:43.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eiUadu3Ftn37642UljvomBkzIo0=', 'Content-Length': '0'} 2024-04-16T18:28:43.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b8d0d5ce49d3443-00661ec35b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.994 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.994 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.994 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.994 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.994 DEBUG:boto:Method: GET 2024-04-16T18:28:43.994 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.994 DEBUG:boto:Data: 2024-04-16T18:28:43.994 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.995 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:43.995 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.995 DEBUG:boto:Params: {} 2024-04-16T18:28:43.995 DEBUG:boto:Token: None 2024-04-16T18:28:43.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/ 2024-04-16T18:28:43.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0= 2024-04-16T18:28:43.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0=', 'Content-Length': '0'} 2024-04-16T18:28:43.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a2d26faac00120e-00661ec35b-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:43.997 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:43.998 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:43.998 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:43.998 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.998 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.998 DEBUG:boto:Method: GET 2024-04-16T18:28:43.998 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:28:43.999 DEBUG:boto:Data: 2024-04-16T18:28:43.999 DEBUG:boto:Headers: {} 2024-04-16T18:28:43.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:43.999 DEBUG:boto:Port: 8000 2024-04-16T18:28:43.999 DEBUG:boto:Params: {} 2024-04-16T18:28:43.999 DEBUG:boto:Token: None 2024-04-16T18:28:43.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:43 GMT /cjqttm-52/ 2024-04-16T18:28:43.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0= 2024-04-16T18:28:43.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hAAgNgA5aa2FRx6qM4NnvCycbG0=', 'Content-Length': '0'} 2024-04-16T18:28:44.002 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d237941934e329e-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.002 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.003 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:28:44.003 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.003 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.003 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.003 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.003 DEBUG:boto:Method: GET 2024-04-16T18:28:44.003 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.003 DEBUG:boto:Data: 2024-04-16T18:28:44.004 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.004 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.004 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.004 DEBUG:boto:Params: {} 2024-04-16T18:28:44.004 DEBUG:boto:Token: None 2024-04-16T18:28:44.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks= 2024-04-16T18:28:44.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks=', 'Content-Length': '0'} 2024-04-16T18:28:44.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e89a247d1d3e43db-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.006 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.007 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.007 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.007 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.007 DEBUG:boto:Method: GET 2024-04-16T18:28:44.007 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.007 DEBUG:boto:Data: 2024-04-16T18:28:44.007 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.007 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.007 DEBUG:boto:Params: {} 2024-04-16T18:28:44.007 DEBUG:boto:Token: None 2024-04-16T18:28:44.008 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks= 2024-04-16T18:28:44.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks=', 'Content-Length': '0'} 2024-04-16T18:28:44.009 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c246b781585b660d-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.010 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.010 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.010 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.010 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.010 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.010 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.010 DEBUG:boto:Data: 2024-04-16T18:28:44.010 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.010 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.010 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.010 DEBUG:boto:Params: {} 2024-04-16T18:28:44.011 DEBUG:boto:Token: None 2024-04-16T18:28:44.011 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TrLO9UqY2nBIpkasQnL4wjrTXT8= 2024-04-16T18:28:44.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TrLO9UqY2nBIpkasQnL4wjrTXT8=', 'Content-Length': '0'} 2024-04-16T18:28:44.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a526314348423cf4-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.013 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.013 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.013 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.013 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.013 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.014 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.014 DEBUG:boto:Data: 2024-04-16T18:28:44.014 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.014 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.014 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.014 DEBUG:boto:Params: {} 2024-04-16T18:28:44.014 DEBUG:boto:Token: None 2024-04-16T18:28:44.014 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.014 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TrLO9UqY2nBIpkasQnL4wjrTXT8= 2024-04-16T18:28:44.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TrLO9UqY2nBIpkasQnL4wjrTXT8=', 'Content-Length': '0'} 2024-04-16T18:28:44.016 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003659868705b8b311-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.016 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:28:44.016 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.016 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.016 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.017 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.017 DEBUG:boto:Method: GET 2024-04-16T18:28:44.017 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.017 DEBUG:boto:Data: 2024-04-16T18:28:44.017 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.017 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.017 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.017 DEBUG:boto:Params: {} 2024-04-16T18:28:44.017 DEBUG:boto:Token: None 2024-04-16T18:28:44.017 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.017 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks= 2024-04-16T18:28:44.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks=', 'Content-Length': '0'} 2024-04-16T18:28:44.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d14680c7124a75ac-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.062 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.062 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.062 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.063 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.063 DEBUG:boto:Method: GET 2024-04-16T18:28:44.063 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.063 DEBUG:boto:Data: 2024-04-16T18:28:44.063 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.063 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.063 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.063 DEBUG:boto:Params: {} 2024-04-16T18:28:44.063 DEBUG:boto:Token: None 2024-04-16T18:28:44.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:28:44.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks= 2024-04-16T18:28:44.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GtV536rFw5DjoEYHYrY5/wCiJks=', 'Content-Length': '0'} 2024-04-16T18:28:44.065 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000157b714960a7b36e-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.065 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.066 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.066 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.066 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.066 DEBUG:boto:Method: GET 2024-04-16T18:28:44.066 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.066 DEBUG:boto:Data: 2024-04-16T18:28:44.066 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.066 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.066 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.066 DEBUG:boto:Params: {} 2024-04-16T18:28:44.067 DEBUG:boto:Token: None 2024-04-16T18:28:44.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.069 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c0a412ada513c6f-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.110 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.111 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.111 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.111 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.111 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.111 DEBUG:boto:Method: GET 2024-04-16T18:28:44.111 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.111 DEBUG:boto:Data: 2024-04-16T18:28:44.111 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.111 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.112 DEBUG:boto:Params: {} 2024-04-16T18:28:44.112 DEBUG:boto:Token: None 2024-04-16T18:28:44.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.115 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000038144f5a9a7d4b5-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.115 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.115 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.115 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.115 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.115 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:28:44.116 DEBUG:boto:Data: 2024-04-16T18:28:44.116 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.116 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.116 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.116 DEBUG:boto:Params: {} 2024-04-16T18:28:44.116 DEBUG:boto:Token: None 2024-04-16T18:28:44.116 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111 2024-04-16T18:28:44.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R9HaFItqu2Alloa4w8wg/CvG3KI= 2024-04-16T18:28:44.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R9HaFItqu2Alloa4w8wg/CvG3KI=', 'Content-Length': '0'} 2024-04-16T18:28:44.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1a492ba90aa9cd0-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.118 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.118 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.119 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.119 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:28:44.119 DEBUG:boto:Data: 2024-04-16T18:28:44.119 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.119 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.119 DEBUG:boto:Params: {} 2024-04-16T18:28:44.119 DEBUG:boto:Token: None 2024-04-16T18:28:44.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111 2024-04-16T18:28:44.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R9HaFItqu2Alloa4w8wg/CvG3KI= 2024-04-16T18:28:44.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R9HaFItqu2Alloa4w8wg/CvG3KI=', 'Content-Length': '0'} 2024-04-16T18:28:44.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002621965cb5a776a5-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:28:44.122 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.122 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.122 DEBUG:boto:Method: GET 2024-04-16T18:28:44.122 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:28:44.122 DEBUG:boto:Data: 2024-04-16T18:28:44.122 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.122 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.122 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.122 DEBUG:boto:Params: {} 2024-04-16T18:28:44.122 DEBUG:boto:Token: None 2024-04-16T18:28:44.122 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111 2024-04-16T18:28:44.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fDaiC61ZHn5IsT3yMBH0rsZRuOU= 2024-04-16T18:28:44.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fDaiC61ZHn5IsT3yMBH0rsZRuOU=', 'Content-Length': '0'} 2024-04-16T18:28:44.124 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022125b6ebe189faf-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.166 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:28:44.166 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:28:44.167 DEBUG:boto:Method: GET 2024-04-16T18:28:44.167 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:28:44.167 DEBUG:boto:Data: 2024-04-16T18:28:44.167 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.167 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.167 DEBUG:boto:Params: {} 2024-04-16T18:28:44.167 DEBUG:boto:Token: None 2024-04-16T18:28:44.167 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj111 2024-04-16T18:28:44.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fDaiC61ZHn5IsT3yMBH0rsZRuOU= 2024-04-16T18:28:44.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fDaiC61ZHn5IsT3yMBH0rsZRuOU=', 'Content-Length': '0'} 2024-04-16T18:28:44.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096c811a6f6dff57a-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.169 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.170 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.170 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.170 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.170 DEBUG:boto:Method: GET 2024-04-16T18:28:44.170 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.170 DEBUG:boto:Data: 2024-04-16T18:28:44.170 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.170 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.170 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.170 DEBUG:boto:Params: {} 2024-04-16T18:28:44.170 DEBUG:boto:Token: None 2024-04-16T18:28:44.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.173 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000448b0820f55a8971-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.173 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.174 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.174 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.174 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.174 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.174 DEBUG:boto:Method: GET 2024-04-16T18:28:44.174 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:28:44.174 DEBUG:boto:Data: 2024-04-16T18:28:44.174 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.174 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.174 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.175 DEBUG:boto:Params: {} 2024-04-16T18:28:44.175 DEBUG:boto:Token: None 2024-04-16T18:28:44.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079cdbb1dfc3a35da-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.178 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:28:44.179 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.179 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.179 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.179 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.179 DEBUG:boto:Method: GET 2024-04-16T18:28:44.179 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.179 DEBUG:boto:Data: 2024-04-16T18:28:44.179 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.179 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.180 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.180 DEBUG:boto:Params: {} 2024-04-16T18:28:44.180 DEBUG:boto:Token: None 2024-04-16T18:28:44.180 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.180 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0= 2024-04-16T18:28:44.180 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0=', 'Content-Length': '0'} 2024-04-16T18:28:44.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5914985f4a22de0-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.226 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.226 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.227 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.227 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.227 DEBUG:boto:Method: GET 2024-04-16T18:28:44.227 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.227 DEBUG:boto:Data: 2024-04-16T18:28:44.227 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.227 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.227 DEBUG:boto:Params: {} 2024-04-16T18:28:44.227 DEBUG:boto:Token: None 2024-04-16T18:28:44.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0= 2024-04-16T18:28:44.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0=', 'Content-Length': '0'} 2024-04-16T18:28:44.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a78a306a24c744c-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.230 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.230 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.230 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.231 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.231 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.231 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.231 DEBUG:boto:Data: 2024-04-16T18:28:44.231 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.231 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.231 DEBUG:boto:Params: {} 2024-04-16T18:28:44.231 DEBUG:boto:Token: None 2024-04-16T18:28:44.231 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/a/jLaYg7zm5DiphMbEigzG5Fws= 2024-04-16T18:28:44.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/a/jLaYg7zm5DiphMbEigzG5Fws=', 'Content-Length': '0'} 2024-04-16T18:28:44.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023e659a7c0774909-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.234 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.234 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.234 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.234 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.234 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.234 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.234 DEBUG:boto:Data: 2024-04-16T18:28:44.234 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.235 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.235 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.235 DEBUG:boto:Params: {} 2024-04-16T18:28:44.235 DEBUG:boto:Token: None 2024-04-16T18:28:44.235 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/a/jLaYg7zm5DiphMbEigzG5Fws= 2024-04-16T18:28:44.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/a/jLaYg7zm5DiphMbEigzG5Fws=', 'Content-Length': '0'} 2024-04-16T18:28:44.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8367a15003bc965-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.237 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:28:44.238 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.238 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.238 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.238 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.238 DEBUG:boto:Method: GET 2024-04-16T18:28:44.238 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.238 DEBUG:boto:Data: 2024-04-16T18:28:44.238 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.238 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.238 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.238 DEBUG:boto:Params: {} 2024-04-16T18:28:44.239 DEBUG:boto:Token: None 2024-04-16T18:28:44.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.239 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0= 2024-04-16T18:28:44.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0=', 'Content-Length': '0'} 2024-04-16T18:28:44.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da17b3e32beada75-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.282 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.282 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.283 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.283 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.283 DEBUG:boto:Method: GET 2024-04-16T18:28:44.283 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.283 DEBUG:boto:Data: 2024-04-16T18:28:44.283 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.283 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.283 DEBUG:boto:Params: {} 2024-04-16T18:28:44.283 DEBUG:boto:Token: None 2024-04-16T18:28:44.284 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:28:44.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0= 2024-04-16T18:28:44.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PEyq6VxytHVTXl6L1IdSb33OVH0=', 'Content-Length': '0'} 2024-04-16T18:28:44.285 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000884a3f3063ce6cdc-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.286 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.286 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.286 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.286 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.286 DEBUG:boto:Method: GET 2024-04-16T18:28:44.286 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.286 DEBUG:boto:Data: 2024-04-16T18:28:44.286 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.287 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.287 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.287 DEBUG:boto:Params: {} 2024-04-16T18:28:44.287 DEBUG:boto:Token: None 2024-04-16T18:28:44.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f45aab2107cbec4-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.290 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.290 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.290 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.290 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.290 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.291 DEBUG:boto:Method: GET 2024-04-16T18:28:44.291 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.291 DEBUG:boto:Data: 2024-04-16T18:28:44.291 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.291 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.291 DEBUG:boto:Params: {} 2024-04-16T18:28:44.291 DEBUG:boto:Token: None 2024-04-16T18:28:44.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.295 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c415f008e82f1593-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.295 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.295 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.296 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.296 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.296 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:28:44.296 DEBUG:boto:Data: 2024-04-16T18:28:44.296 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.296 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.296 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.296 DEBUG:boto:Params: {} 2024-04-16T18:28:44.296 DEBUG:boto:Token: None 2024-04-16T18:28:44.296 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115 2024-04-16T18:28:44.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NudHDmaSSMR18QGtEMwGQAKJpAY= 2024-04-16T18:28:44.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NudHDmaSSMR18QGtEMwGQAKJpAY=', 'Content-Length': '0'} 2024-04-16T18:28:44.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f8666ad0365efa5-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.299 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.299 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.299 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.299 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:28:44.299 DEBUG:boto:Data: 2024-04-16T18:28:44.299 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.300 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.300 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.300 DEBUG:boto:Params: {} 2024-04-16T18:28:44.300 DEBUG:boto:Token: None 2024-04-16T18:28:44.300 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115 2024-04-16T18:28:44.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NudHDmaSSMR18QGtEMwGQAKJpAY= 2024-04-16T18:28:44.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NudHDmaSSMR18QGtEMwGQAKJpAY=', 'Content-Length': '0'} 2024-04-16T18:28:44.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054b3ae0c6e021297-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:28:44.303 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.303 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.303 DEBUG:boto:Method: GET 2024-04-16T18:28:44.303 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:28:44.303 DEBUG:boto:Data: 2024-04-16T18:28:44.303 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.303 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.303 DEBUG:boto:Params: {} 2024-04-16T18:28:44.303 DEBUG:boto:Token: None 2024-04-16T18:28:44.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115 2024-04-16T18:28:44.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUc0lOv7AbGLK5wulgu72VfNoS4= 2024-04-16T18:28:44.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUc0lOv7AbGLK5wulgu72VfNoS4=', 'Content-Length': '0'} 2024-04-16T18:28:44.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:24:00 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecd14cc48ecc8359-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.346 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:28:44.346 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:28:44.347 DEBUG:boto:Method: GET 2024-04-16T18:28:44.347 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:28:44.347 DEBUG:boto:Data: 2024-04-16T18:28:44.347 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.347 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.347 DEBUG:boto:Params: {} 2024-04-16T18:28:44.347 DEBUG:boto:Token: None 2024-04-16T18:28:44.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj115 2024-04-16T18:28:44.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUc0lOv7AbGLK5wulgu72VfNoS4= 2024-04-16T18:28:44.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUc0lOv7AbGLK5wulgu72VfNoS4=', 'Content-Length': '0'} 2024-04-16T18:28:44.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d44ff3e848f85b5-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.350 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.350 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.350 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.350 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.350 DEBUG:boto:Method: GET 2024-04-16T18:28:44.350 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.351 DEBUG:boto:Data: 2024-04-16T18:28:44.351 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.351 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.351 DEBUG:boto:Params: {} 2024-04-16T18:28:44.351 DEBUG:boto:Token: None 2024-04-16T18:28:44.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.354 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d0aec35fc094fa4-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.394 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.395 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.395 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.395 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.395 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.395 DEBUG:boto:Method: GET 2024-04-16T18:28:44.395 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:28:44.395 DEBUG:boto:Data: 2024-04-16T18:28:44.395 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.396 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.396 DEBUG:boto:Params: {} 2024-04-16T18:28:44.396 DEBUG:boto:Token: None 2024-04-16T18:28:44.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.399 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bed85a4660befcd3-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.399 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:28:44.400 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.400 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.400 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.400 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.400 DEBUG:boto:Method: GET 2024-04-16T18:28:44.400 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.400 DEBUG:boto:Data: 2024-04-16T18:28:44.401 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.401 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.401 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.401 DEBUG:boto:Params: {} 2024-04-16T18:28:44.401 DEBUG:boto:Token: None 2024-04-16T18:28:44.401 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.401 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o= 2024-04-16T18:28:44.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o=', 'Content-Length': '0'} 2024-04-16T18:28:44.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b707dba0edaba878-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.446 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.446 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.447 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.447 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.447 DEBUG:boto:Method: GET 2024-04-16T18:28:44.447 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.447 DEBUG:boto:Data: 2024-04-16T18:28:44.447 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.447 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.447 DEBUG:boto:Params: {} 2024-04-16T18:28:44.447 DEBUG:boto:Token: None 2024-04-16T18:28:44.447 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o= 2024-04-16T18:28:44.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o=', 'Content-Length': '0'} 2024-04-16T18:28:44.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d256798d0d505d6-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.450 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.450 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.450 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.450 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.450 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.450 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.451 DEBUG:boto:Data: 2024-04-16T18:28:44.451 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.451 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.451 DEBUG:boto:Params: {} 2024-04-16T18:28:44.451 DEBUG:boto:Token: None 2024-04-16T18:28:44.451 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X+KhrYKuoYKpJMGE0e9Z0+qNPS4= 2024-04-16T18:28:44.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X+KhrYKuoYKpJMGE0e9Z0+qNPS4=', 'Content-Length': '0'} 2024-04-16T18:28:44.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7416ff2b5372287-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.453 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.453 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.454 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.454 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.454 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.454 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.454 DEBUG:boto:Data: 2024-04-16T18:28:44.454 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.454 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.454 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.454 DEBUG:boto:Params: {} 2024-04-16T18:28:44.454 DEBUG:boto:Token: None 2024-04-16T18:28:44.455 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X+KhrYKuoYKpJMGE0e9Z0+qNPS4= 2024-04-16T18:28:44.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X+KhrYKuoYKpJMGE0e9Z0+qNPS4=', 'Content-Length': '0'} 2024-04-16T18:28:44.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a21c22ab4203903-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.457 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:28:44.457 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.457 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.457 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.457 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.457 DEBUG:boto:Method: GET 2024-04-16T18:28:44.458 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.458 DEBUG:boto:Data: 2024-04-16T18:28:44.458 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.458 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.458 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.458 DEBUG:boto:Params: {} 2024-04-16T18:28:44.458 DEBUG:boto:Token: None 2024-04-16T18:28:44.458 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.458 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o= 2024-04-16T18:28:44.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o=', 'Content-Length': '0'} 2024-04-16T18:28:44.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c70ac16e0a2e910-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.502 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.502 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.503 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.503 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.503 DEBUG:boto:Method: GET 2024-04-16T18:28:44.503 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.503 DEBUG:boto:Data: 2024-04-16T18:28:44.503 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.503 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.503 DEBUG:boto:Params: {} 2024-04-16T18:28:44.503 DEBUG:boto:Token: None 2024-04-16T18:28:44.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:28:44.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o= 2024-04-16T18:28:44.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9PfZ+cQj/TCBWmlQNkggoJY0B6o=', 'Content-Length': '0'} 2024-04-16T18:28:44.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e5fc43b0919eefa-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.506 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.506 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.506 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.506 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.506 DEBUG:boto:Method: GET 2024-04-16T18:28:44.506 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.507 DEBUG:boto:Data: 2024-04-16T18:28:44.507 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.509 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.509 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.509 DEBUG:boto:Params: {} 2024-04-16T18:28:44.509 DEBUG:boto:Token: None 2024-04-16T18:28:44.509 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.512 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006cff1cce8d7db73c-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.554 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.555 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.555 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.555 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.555 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.555 DEBUG:boto:Method: GET 2024-04-16T18:28:44.555 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.555 DEBUG:boto:Data: 2024-04-16T18:28:44.555 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.555 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.556 DEBUG:boto:Params: {} 2024-04-16T18:28:44.556 DEBUG:boto:Token: None 2024-04-16T18:28:44.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.559 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a3f5d5bc318d63b-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.559 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.560 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.560 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.560 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.560 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:28:44.560 DEBUG:boto:Data: 2024-04-16T18:28:44.560 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.560 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.560 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.560 DEBUG:boto:Params: {} 2024-04-16T18:28:44.561 DEBUG:boto:Token: None 2024-04-16T18:28:44.561 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116 2024-04-16T18:28:44.561 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IiZSXCK24BQ2/mC2efitKZWRqBM= 2024-04-16T18:28:44.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IiZSXCK24BQ2/mC2efitKZWRqBM=', 'Content-Length': '0'} 2024-04-16T18:28:44.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb3cb38a2f6e92c8-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.563 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.563 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.563 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.563 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:28:44.563 DEBUG:boto:Data: 2024-04-16T18:28:44.563 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.564 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.564 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.564 DEBUG:boto:Params: {} 2024-04-16T18:28:44.564 DEBUG:boto:Token: None 2024-04-16T18:28:44.564 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116 2024-04-16T18:28:44.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IiZSXCK24BQ2/mC2efitKZWRqBM= 2024-04-16T18:28:44.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IiZSXCK24BQ2/mC2efitKZWRqBM=', 'Content-Length': '0'} 2024-04-16T18:28:44.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cc55b93ceeba121-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.566 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:28:44.566 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.566 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.566 DEBUG:boto:Method: GET 2024-04-16T18:28:44.566 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:28:44.567 DEBUG:boto:Data: 2024-04-16T18:28:44.567 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.567 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.567 DEBUG:boto:Params: {} 2024-04-16T18:28:44.567 DEBUG:boto:Token: None 2024-04-16T18:28:44.567 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116 2024-04-16T18:28:44.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0Xy2Ehs8eyv7eVMixSEJgg1OJZo= 2024-04-16T18:28:44.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0Xy2Ehs8eyv7eVMixSEJgg1OJZo=', 'Content-Length': '0'} 2024-04-16T18:28:44.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:26:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000047c83dd03787b22-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.610 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:28:44.610 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:28:44.611 DEBUG:boto:Method: GET 2024-04-16T18:28:44.611 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:28:44.611 DEBUG:boto:Data: 2024-04-16T18:28:44.611 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.611 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.611 DEBUG:boto:Params: {} 2024-04-16T18:28:44.611 DEBUG:boto:Token: None 2024-04-16T18:28:44.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj116 2024-04-16T18:28:44.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0Xy2Ehs8eyv7eVMixSEJgg1OJZo= 2024-04-16T18:28:44.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0Xy2Ehs8eyv7eVMixSEJgg1OJZo=', 'Content-Length': '0'} 2024-04-16T18:28:44.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000924ddb0c219ad714-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.614 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.614 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.614 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.614 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.614 DEBUG:boto:Method: GET 2024-04-16T18:28:44.614 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.614 DEBUG:boto:Data: 2024-04-16T18:28:44.615 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.615 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.615 DEBUG:boto:Params: {} 2024-04-16T18:28:44.615 DEBUG:boto:Token: None 2024-04-16T18:28:44.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004b7cfb66c6c7318-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.658 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.659 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.659 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.659 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.659 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.659 DEBUG:boto:Method: GET 2024-04-16T18:28:44.659 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:28:44.659 DEBUG:boto:Data: 2024-04-16T18:28:44.659 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.660 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.660 DEBUG:boto:Params: {} 2024-04-16T18:28:44.660 DEBUG:boto:Token: None 2024-04-16T18:28:44.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.663 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009bbdeeb1360e3f1a-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.664 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:28:44.664 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.664 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.664 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.664 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.664 DEBUG:boto:Method: GET 2024-04-16T18:28:44.664 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.665 DEBUG:boto:Data: 2024-04-16T18:28:44.665 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.665 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.665 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.665 DEBUG:boto:Params: {} 2024-04-16T18:28:44.665 DEBUG:boto:Token: None 2024-04-16T18:28:44.665 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.665 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA= 2024-04-16T18:28:44.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA=', 'Content-Length': '0'} 2024-04-16T18:28:44.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea2381e859c14902-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.710 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.710 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.710 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.711 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.711 DEBUG:boto:Method: GET 2024-04-16T18:28:44.711 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.711 DEBUG:boto:Data: 2024-04-16T18:28:44.711 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.711 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.711 DEBUG:boto:Params: {} 2024-04-16T18:28:44.712 DEBUG:boto:Token: None 2024-04-16T18:28:44.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA= 2024-04-16T18:28:44.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA=', 'Content-Length': '0'} 2024-04-16T18:28:44.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c7230a547e8362c-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.714 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.714 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.714 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.714 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.714 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.714 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.715 DEBUG:boto:Data: 2024-04-16T18:28:44.715 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.715 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.715 DEBUG:boto:Params: {} 2024-04-16T18:28:44.715 DEBUG:boto:Token: None 2024-04-16T18:28:44.715 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0+psL7S5QH57M7n1rMh3pfNIhis= 2024-04-16T18:28:44.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0+psL7S5QH57M7n1rMh3pfNIhis=', 'Content-Length': '0'} 2024-04-16T18:28:44.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7e333446aeba91c-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.718 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.718 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.718 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.718 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.718 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.718 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.718 DEBUG:boto:Data: 2024-04-16T18:28:44.718 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.718 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.718 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.719 DEBUG:boto:Params: {} 2024-04-16T18:28:44.719 DEBUG:boto:Token: None 2024-04-16T18:28:44.719 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0+psL7S5QH57M7n1rMh3pfNIhis= 2024-04-16T18:28:44.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0+psL7S5QH57M7n1rMh3pfNIhis=', 'Content-Length': '0'} 2024-04-16T18:28:44.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6ffb02f1d14b9aa-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.721 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:28:44.721 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.721 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.721 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.721 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.721 DEBUG:boto:Method: GET 2024-04-16T18:28:44.721 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.721 DEBUG:boto:Data: 2024-04-16T18:28:44.722 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.722 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.722 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.722 DEBUG:boto:Params: {} 2024-04-16T18:28:44.722 DEBUG:boto:Token: None 2024-04-16T18:28:44.722 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.722 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA= 2024-04-16T18:28:44.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA=', 'Content-Length': '0'} 2024-04-16T18:28:44.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050e3c90ef1bc24e7-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.766 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.766 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.767 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.767 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.767 DEBUG:boto:Method: GET 2024-04-16T18:28:44.767 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.767 DEBUG:boto:Data: 2024-04-16T18:28:44.767 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.767 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.767 DEBUG:boto:Params: {} 2024-04-16T18:28:44.767 DEBUG:boto:Token: None 2024-04-16T18:28:44.767 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:28:44.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA= 2024-04-16T18:28:44.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HkT30nLcGUUylYjnUi4H8kpdYZA=', 'Content-Length': '0'} 2024-04-16T18:28:44.770 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e90a89a3417df34a-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.770 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.770 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.770 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.770 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.770 DEBUG:boto:Method: GET 2024-04-16T18:28:44.770 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.771 DEBUG:boto:Data: 2024-04-16T18:28:44.771 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.771 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.771 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.771 DEBUG:boto:Params: {} 2024-04-16T18:28:44.771 DEBUG:boto:Token: None 2024-04-16T18:28:44.771 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.771 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.773 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001cbd1c11140770b0-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.814 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.815 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.815 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.815 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.815 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.815 DEBUG:boto:Method: GET 2024-04-16T18:28:44.815 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.815 DEBUG:boto:Data: 2024-04-16T18:28:44.815 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.815 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.816 DEBUG:boto:Params: {} 2024-04-16T18:28:44.816 DEBUG:boto:Token: None 2024-04-16T18:28:44.816 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.816 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.819 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000568d6ff6e52f21c6-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.820 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.820 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.820 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.820 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.820 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:28:44.820 DEBUG:boto:Data: 2024-04-16T18:28:44.820 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.821 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.821 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.821 DEBUG:boto:Params: {} 2024-04-16T18:28:44.821 DEBUG:boto:Token: None 2024-04-16T18:28:44.821 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124 2024-04-16T18:28:44.821 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N4DkJxx0/tOPFM7LC2PmtTvAxro= 2024-04-16T18:28:44.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N4DkJxx0/tOPFM7LC2PmtTvAxro=', 'Content-Length': '0'} 2024-04-16T18:28:44.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004515bf0b990d6948-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.823 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.823 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.823 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.823 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:28:44.823 DEBUG:boto:Data: 2024-04-16T18:28:44.823 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.824 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.824 DEBUG:boto:Params: {} 2024-04-16T18:28:44.824 DEBUG:boto:Token: None 2024-04-16T18:28:44.824 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124 2024-04-16T18:28:44.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:N4DkJxx0/tOPFM7LC2PmtTvAxro= 2024-04-16T18:28:44.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:N4DkJxx0/tOPFM7LC2PmtTvAxro=', 'Content-Length': '0'} 2024-04-16T18:28:44.826 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f50aed436ca5d3b-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.826 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:28:44.826 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.826 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.826 DEBUG:boto:Method: GET 2024-04-16T18:28:44.826 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:28:44.826 DEBUG:boto:Data: 2024-04-16T18:28:44.827 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.827 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.827 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.827 DEBUG:boto:Params: {} 2024-04-16T18:28:44.827 DEBUG:boto:Token: None 2024-04-16T18:28:44.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124 2024-04-16T18:28:44.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5NOgTzC1q7p1jqA5sxcymapyRAE= 2024-04-16T18:28:44.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NOgTzC1q7p1jqA5sxcymapyRAE=', 'Content-Length': '0'} 2024-04-16T18:28:44.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022e000f6b53f11d2-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.870 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:28:44.870 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:28:44.870 DEBUG:boto:Method: GET 2024-04-16T18:28:44.871 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:28:44.871 DEBUG:boto:Data: 2024-04-16T18:28:44.871 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.871 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.871 DEBUG:boto:Params: {} 2024-04-16T18:28:44.871 DEBUG:boto:Token: None 2024-04-16T18:28:44.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj124 2024-04-16T18:28:44.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5NOgTzC1q7p1jqA5sxcymapyRAE= 2024-04-16T18:28:44.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NOgTzC1q7p1jqA5sxcymapyRAE=', 'Content-Length': '0'} 2024-04-16T18:28:44.873 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc3df8abc02d060f-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.874 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.874 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.874 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.874 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.874 DEBUG:boto:Method: GET 2024-04-16T18:28:44.874 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.874 DEBUG:boto:Data: 2024-04-16T18:28:44.874 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.874 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.874 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.875 DEBUG:boto:Params: {} 2024-04-16T18:28:44.875 DEBUG:boto:Token: None 2024-04-16T18:28:44.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.877 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044499d63e8d2b5e6-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.918 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.919 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:44.919 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:44.919 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.919 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.919 DEBUG:boto:Method: GET 2024-04-16T18:28:44.919 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:28:44.919 DEBUG:boto:Data: 2024-04-16T18:28:44.919 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.919 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.919 DEBUG:boto:Params: {} 2024-04-16T18:28:44.920 DEBUG:boto:Token: None 2024-04-16T18:28:44.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/ 2024-04-16T18:28:44.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60= 2024-04-16T18:28:44.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e0+Mp7d0ZVRfdLA+V06q86qCa60=', 'Content-Length': '0'} 2024-04-16T18:28:44.923 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e9af4cfec1163ee6-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.923 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:44.923 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:28:44.924 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:44.924 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:44.924 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.924 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.924 DEBUG:boto:Method: GET 2024-04-16T18:28:44.924 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.924 DEBUG:boto:Data: 2024-04-16T18:28:44.924 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.924 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.924 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.924 DEBUG:boto:Params: {} 2024-04-16T18:28:44.925 DEBUG:boto:Token: None 2024-04-16T18:28:44.925 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.925 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RztCGvOvtJMSsEy079TAoDcripQ= 2024-04-16T18:28:44.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RztCGvOvtJMSsEy079TAoDcripQ=', 'Content-Length': '0'} 2024-04-16T18:28:44.926 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000054414bfdc4c44e7-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.974 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:44.974 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:44.975 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.975 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.975 DEBUG:boto:Method: GET 2024-04-16T18:28:44.975 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.975 DEBUG:boto:Data: 2024-04-16T18:28:44.975 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.975 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.975 DEBUG:boto:Params: {} 2024-04-16T18:28:44.975 DEBUG:boto:Token: None 2024-04-16T18:28:44.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RztCGvOvtJMSsEy079TAoDcripQ= 2024-04-16T18:28:44.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RztCGvOvtJMSsEy079TAoDcripQ=', 'Content-Length': '0'} 2024-04-16T18:28:44.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ad3c0515ca00bb2-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.978 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:44.978 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:44.978 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.978 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.978 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.978 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.978 DEBUG:boto:Data: 2024-04-16T18:28:44.979 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.979 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.979 DEBUG:boto:Params: {} 2024-04-16T18:28:44.979 DEBUG:boto:Token: None 2024-04-16T18:28:44.979 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xj/ANukI6wNL6eejseVpb61Jp+o= 2024-04-16T18:28:44.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xj/ANukI6wNL6eejseVpb61Jp+o=', 'Content-Length': '0'} 2024-04-16T18:28:44.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dde114a850ae1ca-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.981 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:44.981 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:44.981 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.981 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.982 DEBUG:boto:Method: HEAD 2024-04-16T18:28:44.982 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.982 DEBUG:boto:Data: 2024-04-16T18:28:44.982 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.982 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:44.982 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.982 DEBUG:boto:Params: {} 2024-04-16T18:28:44.982 DEBUG:boto:Token: None 2024-04-16T18:28:44.982 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.982 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xj/ANukI6wNL6eejseVpb61Jp+o= 2024-04-16T18:28:44.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xj/ANukI6wNL6eejseVpb61Jp+o=', 'Content-Length': '0'} 2024-04-16T18:28:44.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001637573a3da27ed9-00661ec35c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:44.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:28:44.984 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:44.985 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:44.985 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.985 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.985 DEBUG:boto:Method: GET 2024-04-16T18:28:44.985 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.985 DEBUG:boto:Data: 2024-04-16T18:28:44.985 DEBUG:boto:Headers: {} 2024-04-16T18:28:44.985 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:44.985 DEBUG:boto:Port: 8000 2024-04-16T18:28:44.985 DEBUG:boto:Params: {} 2024-04-16T18:28:44.985 DEBUG:boto:Token: None 2024-04-16T18:28:44.986 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:44 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:44.986 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RztCGvOvtJMSsEy079TAoDcripQ= 2024-04-16T18:28:44.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RztCGvOvtJMSsEy079TAoDcripQ=', 'Content-Length': '0'} 2024-04-16T18:28:44.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023d16941036557d3-00661ec35c-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.030 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:45.030 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:45.030 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:45.031 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:28:45.031 DEBUG:boto:Method: GET 2024-04-16T18:28:45.031 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:45.031 DEBUG:boto:Data: 2024-04-16T18:28:45.031 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.031 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.031 DEBUG:boto:Params: {} 2024-04-16T18:28:45.031 DEBUG:boto:Token: None 2024-04-16T18:28:45.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:28:45.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Ec4HU8Z/yUvIVNNVnVu8FkN/wo= 2024-04-16T18:28:45.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Ec4HU8Z/yUvIVNNVnVu8FkN/wo=', 'Content-Length': '0'} 2024-04-16T18:28:45.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023dde9c76cc7109b-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.034 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.034 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.034 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.034 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.034 DEBUG:boto:Method: GET 2024-04-16T18:28:45.034 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.034 DEBUG:boto:Data: 2024-04-16T18:28:45.035 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.035 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.035 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.035 DEBUG:boto:Params: {} 2024-04-16T18:28:45.035 DEBUG:boto:Token: None 2024-04-16T18:28:45.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008101be522ee74992-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.078 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.079 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.079 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.079 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.079 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.079 DEBUG:boto:Method: GET 2024-04-16T18:28:45.079 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.079 DEBUG:boto:Data: 2024-04-16T18:28:45.079 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.080 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.080 DEBUG:boto:Params: {} 2024-04-16T18:28:45.080 DEBUG:boto:Token: None 2024-04-16T18:28:45.080 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.083 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a0bd05a1308a461-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.083 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.084 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:45.084 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:45.084 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.084 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:28:45.084 DEBUG:boto:Data: 2024-04-16T18:28:45.084 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.084 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.084 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.084 DEBUG:boto:Params: {} 2024-04-16T18:28:45.085 DEBUG:boto:Token: None 2024-04-16T18:28:45.085 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj145 2024-04-16T18:28:45.085 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RpTZj1vyiXPQXqqppz9hRHVDol4= 2024-04-16T18:28:45.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RpTZj1vyiXPQXqqppz9hRHVDol4=', 'Content-Length': '0'} 2024-04-16T18:28:45.087 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efedeb389a27b012-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.087 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:45.087 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:45.087 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.087 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:28:45.087 DEBUG:boto:Data: 2024-04-16T18:28:45.087 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.087 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.088 DEBUG:boto:Params: {} 2024-04-16T18:28:45.088 DEBUG:boto:Token: None 2024-04-16T18:28:45.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj145 2024-04-16T18:28:45.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RpTZj1vyiXPQXqqppz9hRHVDol4= 2024-04-16T18:28:45.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RpTZj1vyiXPQXqqppz9hRHVDol4=', 'Content-Length': '0'} 2024-04-16T18:28:45.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000121bfe410f331603-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.090 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:28:45.090 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:45.090 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:45.090 DEBUG:boto:Method: GET 2024-04-16T18:28:45.090 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:28:45.091 DEBUG:boto:Data: 2024-04-16T18:28:45.091 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.091 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.091 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.091 DEBUG:boto:Params: {} 2024-04-16T18:28:45.091 DEBUG:boto:Token: None 2024-04-16T18:28:45.091 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj145 2024-04-16T18:28:45.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sGpdmkgiObDeD6Mil4yf1zcKqYo= 2024-04-16T18:28:45.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sGpdmkgiObDeD6Mil4yf1zcKqYo=', 'Content-Length': '0'} 2024-04-16T18:28:45.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035f803b40396e8af-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.138 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:28:45.139 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:28:45.139 DEBUG:boto:Method: GET 2024-04-16T18:28:45.139 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:28:45.139 DEBUG:boto:Data: 2024-04-16T18:28:45.139 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.139 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.139 DEBUG:boto:Params: {} 2024-04-16T18:28:45.139 DEBUG:boto:Token: None 2024-04-16T18:28:45.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj145 2024-04-16T18:28:45.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sGpdmkgiObDeD6Mil4yf1zcKqYo= 2024-04-16T18:28:45.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sGpdmkgiObDeD6Mil4yf1zcKqYo=', 'Content-Length': '0'} 2024-04-16T18:28:45.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032f0039a8b39d1b4-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.142 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.142 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.142 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.142 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.142 DEBUG:boto:Method: GET 2024-04-16T18:28:45.142 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.142 DEBUG:boto:Data: 2024-04-16T18:28:45.142 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.142 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.143 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.143 DEBUG:boto:Params: {} 2024-04-16T18:28:45.143 DEBUG:boto:Token: None 2024-04-16T18:28:45.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.145 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b30bf5495ffc4897-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.186 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.187 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.187 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.187 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.187 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.187 DEBUG:boto:Method: GET 2024-04-16T18:28:45.187 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:28:45.187 DEBUG:boto:Data: 2024-04-16T18:28:45.187 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.187 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.187 DEBUG:boto:Params: {} 2024-04-16T18:28:45.188 DEBUG:boto:Token: None 2024-04-16T18:28:45.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.191 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b7f89149605780e-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.191 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:28:45.192 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.192 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.192 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.192 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.192 DEBUG:boto:Method: GET 2024-04-16T18:28:45.192 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.192 DEBUG:boto:Data: 2024-04-16T18:28:45.193 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.193 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.193 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.193 DEBUG:boto:Params: {} 2024-04-16T18:28:45.193 DEBUG:boto:Token: None 2024-04-16T18:28:45.193 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.193 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8= 2024-04-16T18:28:45.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8=', 'Content-Length': '0'} 2024-04-16T18:28:45.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009761da5cd5091cb4-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.238 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.238 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.239 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.239 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.239 DEBUG:boto:Method: GET 2024-04-16T18:28:45.239 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.239 DEBUG:boto:Data: 2024-04-16T18:28:45.239 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.239 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.239 DEBUG:boto:Params: {} 2024-04-16T18:28:45.239 DEBUG:boto:Token: None 2024-04-16T18:28:45.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8= 2024-04-16T18:28:45.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8=', 'Content-Length': '0'} 2024-04-16T18:28:45.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095863829e78c1f0e-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.242 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.242 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.242 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.242 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.242 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.242 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.242 DEBUG:boto:Data: 2024-04-16T18:28:45.243 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.243 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.243 DEBUG:boto:Params: {} 2024-04-16T18:28:45.243 DEBUG:boto:Token: None 2024-04-16T18:28:45.243 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VTgAYgvWDaAfvI0tvVZUolhyNYM= 2024-04-16T18:28:45.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VTgAYgvWDaAfvI0tvVZUolhyNYM=', 'Content-Length': '0'} 2024-04-16T18:28:45.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8075d1e16caa256-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.246 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.246 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.246 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.246 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.246 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.246 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.246 DEBUG:boto:Data: 2024-04-16T18:28:45.246 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.247 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.247 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.247 DEBUG:boto:Params: {} 2024-04-16T18:28:45.247 DEBUG:boto:Token: None 2024-04-16T18:28:45.247 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VTgAYgvWDaAfvI0tvVZUolhyNYM= 2024-04-16T18:28:45.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VTgAYgvWDaAfvI0tvVZUolhyNYM=', 'Content-Length': '0'} 2024-04-16T18:28:45.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000392707977e2f4ef-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.250 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:28:45.250 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.250 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.250 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.250 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.250 DEBUG:boto:Method: GET 2024-04-16T18:28:45.250 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.250 DEBUG:boto:Data: 2024-04-16T18:28:45.251 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.251 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.251 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.251 DEBUG:boto:Params: {} 2024-04-16T18:28:45.251 DEBUG:boto:Token: None 2024-04-16T18:28:45.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8= 2024-04-16T18:28:45.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8=', 'Content-Length': '0'} 2024-04-16T18:28:45.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000288b302ef1e4a778-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.294 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.294 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.295 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.295 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.295 DEBUG:boto:Method: GET 2024-04-16T18:28:45.295 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.295 DEBUG:boto:Data: 2024-04-16T18:28:45.295 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.295 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.295 DEBUG:boto:Params: {} 2024-04-16T18:28:45.295 DEBUG:boto:Token: None 2024-04-16T18:28:45.296 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:28:45.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8= 2024-04-16T18:28:45.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lwsFyZjKD8Axz8K4LuKLnnQSFo8=', 'Content-Length': '0'} 2024-04-16T18:28:45.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b078d220d677eca-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.298 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.298 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.298 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.298 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.298 DEBUG:boto:Method: GET 2024-04-16T18:28:45.299 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.299 DEBUG:boto:Data: 2024-04-16T18:28:45.299 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.299 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.299 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.299 DEBUG:boto:Params: {} 2024-04-16T18:28:45.299 DEBUG:boto:Token: None 2024-04-16T18:28:45.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c86e8a4d80bd00fb-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.342 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.343 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.343 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.343 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.343 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.343 DEBUG:boto:Method: GET 2024-04-16T18:28:45.343 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.343 DEBUG:boto:Data: 2024-04-16T18:28:45.343 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.343 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.344 DEBUG:boto:Params: {} 2024-04-16T18:28:45.344 DEBUG:boto:Token: None 2024-04-16T18:28:45.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.348 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008b8418876cbec851-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.348 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.348 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.348 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.348 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.349 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:28:45.349 DEBUG:boto:Data: 2024-04-16T18:28:45.349 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.349 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.349 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.349 DEBUG:boto:Params: {} 2024-04-16T18:28:45.349 DEBUG:boto:Token: None 2024-04-16T18:28:45.349 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148 2024-04-16T18:28:45.349 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8iW5htCHEvNphGDyYiiKhqcJ3wI= 2024-04-16T18:28:45.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8iW5htCHEvNphGDyYiiKhqcJ3wI=', 'Content-Length': '0'} 2024-04-16T18:28:45.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4081c1890bc649e-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.352 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.352 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.352 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.352 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:28:45.352 DEBUG:boto:Data: 2024-04-16T18:28:45.352 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.352 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.352 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.352 DEBUG:boto:Params: {} 2024-04-16T18:28:45.353 DEBUG:boto:Token: None 2024-04-16T18:28:45.353 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148 2024-04-16T18:28:45.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8iW5htCHEvNphGDyYiiKhqcJ3wI= 2024-04-16T18:28:45.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8iW5htCHEvNphGDyYiiKhqcJ3wI=', 'Content-Length': '0'} 2024-04-16T18:28:45.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cff18203b15ac54b-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.355 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:28:45.355 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.355 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.355 DEBUG:boto:Method: GET 2024-04-16T18:28:45.355 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:28:45.356 DEBUG:boto:Data: 2024-04-16T18:28:45.356 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.356 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.356 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.356 DEBUG:boto:Params: {} 2024-04-16T18:28:45.356 DEBUG:boto:Token: None 2024-04-16T18:28:45.356 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148 2024-04-16T18:28:45.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sEDiJZPlIheK9hAUf6iVKkeSPA4= 2024-04-16T18:28:45.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sEDiJZPlIheK9hAUf6iVKkeSPA4=', 'Content-Length': '0'} 2024-04-16T18:28:45.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e67189e6b6689bd-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.402 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:28:45.402 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:28:45.403 DEBUG:boto:Method: GET 2024-04-16T18:28:45.403 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:28:45.403 DEBUG:boto:Data: 2024-04-16T18:28:45.403 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.403 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.403 DEBUG:boto:Params: {} 2024-04-16T18:28:45.403 DEBUG:boto:Token: None 2024-04-16T18:28:45.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj148 2024-04-16T18:28:45.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sEDiJZPlIheK9hAUf6iVKkeSPA4= 2024-04-16T18:28:45.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sEDiJZPlIheK9hAUf6iVKkeSPA4=', 'Content-Length': '0'} 2024-04-16T18:28:45.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007548e16e326e75fd-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.406 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.406 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.406 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.406 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.406 DEBUG:boto:Method: GET 2024-04-16T18:28:45.406 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.407 DEBUG:boto:Data: 2024-04-16T18:28:45.407 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.407 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.407 DEBUG:boto:Params: {} 2024-04-16T18:28:45.407 DEBUG:boto:Token: None 2024-04-16T18:28:45.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.410 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000386340471695a6a8-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.450 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.451 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.451 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.451 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.451 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.451 DEBUG:boto:Method: GET 2024-04-16T18:28:45.451 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:28:45.451 DEBUG:boto:Data: 2024-04-16T18:28:45.451 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.452 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.452 DEBUG:boto:Params: {} 2024-04-16T18:28:45.452 DEBUG:boto:Token: None 2024-04-16T18:28:45.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a33a62c60f82112-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.455 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.456 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:28:45.456 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.456 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.456 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.456 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.456 DEBUG:boto:Method: GET 2024-04-16T18:28:45.456 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.456 DEBUG:boto:Data: 2024-04-16T18:28:45.456 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.456 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.457 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.457 DEBUG:boto:Params: {} 2024-04-16T18:28:45.457 DEBUG:boto:Token: None 2024-04-16T18:28:45.457 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.457 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg= 2024-04-16T18:28:45.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg=', 'Content-Length': '0'} 2024-04-16T18:28:45.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000557d3ac4cb472a3b-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.502 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.502 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.503 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.503 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.503 DEBUG:boto:Method: GET 2024-04-16T18:28:45.503 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.503 DEBUG:boto:Data: 2024-04-16T18:28:45.503 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.504 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.504 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.504 DEBUG:boto:Params: {} 2024-04-16T18:28:45.504 DEBUG:boto:Token: None 2024-04-16T18:28:45.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg= 2024-04-16T18:28:45.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg=', 'Content-Length': '0'} 2024-04-16T18:28:45.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f61cd2c86435560a-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.507 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.507 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.507 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.507 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.507 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.507 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.507 DEBUG:boto:Data: 2024-04-16T18:28:45.507 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.507 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.508 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.508 DEBUG:boto:Params: {} 2024-04-16T18:28:45.508 DEBUG:boto:Token: None 2024-04-16T18:28:45.508 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BjJaGFJJjf+Ez1hs81F3hevi/7Q= 2024-04-16T18:28:45.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BjJaGFJJjf+Ez1hs81F3hevi/7Q=', 'Content-Length': '0'} 2024-04-16T18:28:45.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cda4f578db4f4367-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.510 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.510 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.510 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.510 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.510 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.511 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.511 DEBUG:boto:Data: 2024-04-16T18:28:45.511 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.511 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.511 DEBUG:boto:Params: {} 2024-04-16T18:28:45.511 DEBUG:boto:Token: None 2024-04-16T18:28:45.511 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BjJaGFJJjf+Ez1hs81F3hevi/7Q= 2024-04-16T18:28:45.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BjJaGFJJjf+Ez1hs81F3hevi/7Q=', 'Content-Length': '0'} 2024-04-16T18:28:45.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006972a24b2430ff15-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.513 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:28:45.514 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.514 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.514 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.514 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.514 DEBUG:boto:Method: GET 2024-04-16T18:28:45.514 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.514 DEBUG:boto:Data: 2024-04-16T18:28:45.514 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.514 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.514 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.515 DEBUG:boto:Params: {} 2024-04-16T18:28:45.515 DEBUG:boto:Token: None 2024-04-16T18:28:45.515 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg= 2024-04-16T18:28:45.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg=', 'Content-Length': '0'} 2024-04-16T18:28:45.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000933ea1559cabc5ca-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.558 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.558 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.559 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.559 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.559 DEBUG:boto:Method: GET 2024-04-16T18:28:45.559 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.559 DEBUG:boto:Data: 2024-04-16T18:28:45.559 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.559 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.559 DEBUG:boto:Params: {} 2024-04-16T18:28:45.559 DEBUG:boto:Token: None 2024-04-16T18:28:45.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:28:45.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg= 2024-04-16T18:28:45.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xfg60G6jO7y7S70r83Uyeyg9XRg=', 'Content-Length': '0'} 2024-04-16T18:28:45.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0300cef0484cbff-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.562 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.562 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.562 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.562 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.562 DEBUG:boto:Method: GET 2024-04-16T18:28:45.562 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.563 DEBUG:boto:Data: 2024-04-16T18:28:45.563 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.563 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.563 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.563 DEBUG:boto:Params: {} 2024-04-16T18:28:45.563 DEBUG:boto:Token: None 2024-04-16T18:28:45.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.566 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034f9d699a9094e81-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.606 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.607 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.607 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.607 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.607 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.607 DEBUG:boto:Method: GET 2024-04-16T18:28:45.607 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.607 DEBUG:boto:Data: 2024-04-16T18:28:45.607 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.607 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.608 DEBUG:boto:Params: {} 2024-04-16T18:28:45.608 DEBUG:boto:Token: None 2024-04-16T18:28:45.608 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.611 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc2ee8338664db50-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.612 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.612 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.612 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.612 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.612 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:28:45.612 DEBUG:boto:Data: 2024-04-16T18:28:45.612 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.613 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.613 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.613 DEBUG:boto:Params: {} 2024-04-16T18:28:45.613 DEBUG:boto:Token: None 2024-04-16T18:28:45.613 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155 2024-04-16T18:28:45.613 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E0OO/VwbYRNuJzMi58pGDbhIqmE= 2024-04-16T18:28:45.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E0OO/VwbYRNuJzMi58pGDbhIqmE=', 'Content-Length': '0'} 2024-04-16T18:28:45.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1a05cbec7d40422-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.615 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.615 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.615 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.615 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:28:45.616 DEBUG:boto:Data: 2024-04-16T18:28:45.616 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.616 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.616 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.616 DEBUG:boto:Params: {} 2024-04-16T18:28:45.616 DEBUG:boto:Token: None 2024-04-16T18:28:45.616 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155 2024-04-16T18:28:45.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E0OO/VwbYRNuJzMi58pGDbhIqmE= 2024-04-16T18:28:45.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E0OO/VwbYRNuJzMi58pGDbhIqmE=', 'Content-Length': '0'} 2024-04-16T18:28:45.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f3f02bac69de359-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.619 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:28:45.619 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.619 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.619 DEBUG:boto:Method: GET 2024-04-16T18:28:45.619 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:28:45.619 DEBUG:boto:Data: 2024-04-16T18:28:45.619 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.619 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.620 DEBUG:boto:Params: {} 2024-04-16T18:28:45.620 DEBUG:boto:Token: None 2024-04-16T18:28:45.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155 2024-04-16T18:28:45.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fM8nsbBkvLILymXltIjFl415Juo= 2024-04-16T18:28:45.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fM8nsbBkvLILymXltIjFl415Juo=', 'Content-Length': '0'} 2024-04-16T18:28:45.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000944a19b04893222b-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.662 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:28:45.662 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:28:45.663 DEBUG:boto:Method: GET 2024-04-16T18:28:45.663 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:28:45.663 DEBUG:boto:Data: 2024-04-16T18:28:45.663 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.663 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.663 DEBUG:boto:Params: {} 2024-04-16T18:28:45.663 DEBUG:boto:Token: None 2024-04-16T18:28:45.663 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj155 2024-04-16T18:28:45.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fM8nsbBkvLILymXltIjFl415Juo= 2024-04-16T18:28:45.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fM8nsbBkvLILymXltIjFl415Juo=', 'Content-Length': '0'} 2024-04-16T18:28:45.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005fcf00d79f462f4f-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.666 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.666 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.666 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.666 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.666 DEBUG:boto:Method: GET 2024-04-16T18:28:45.666 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.666 DEBUG:boto:Data: 2024-04-16T18:28:45.666 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.666 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.667 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.667 DEBUG:boto:Params: {} 2024-04-16T18:28:45.667 DEBUG:boto:Token: None 2024-04-16T18:28:45.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.669 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c01d5d958f63e343-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.710 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.711 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.711 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.711 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.711 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.711 DEBUG:boto:Method: GET 2024-04-16T18:28:45.711 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:28:45.711 DEBUG:boto:Data: 2024-04-16T18:28:45.711 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.712 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.712 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.712 DEBUG:boto:Params: {} 2024-04-16T18:28:45.712 DEBUG:boto:Token: None 2024-04-16T18:28:45.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.715 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bae4485bd706cb7c-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.716 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.716 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:28:45.716 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.716 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.716 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.716 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.717 DEBUG:boto:Method: GET 2024-04-16T18:28:45.717 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.717 DEBUG:boto:Data: 2024-04-16T18:28:45.717 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.717 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.717 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.717 DEBUG:boto:Params: {} 2024-04-16T18:28:45.717 DEBUG:boto:Token: None 2024-04-16T18:28:45.717 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.717 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA= 2024-04-16T18:28:45.718 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA=', 'Content-Length': '0'} 2024-04-16T18:28:45.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000687d82676e045bd7-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.766 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.766 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.767 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.767 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.767 DEBUG:boto:Method: GET 2024-04-16T18:28:45.767 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.767 DEBUG:boto:Data: 2024-04-16T18:28:45.767 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.767 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.767 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.767 DEBUG:boto:Params: {} 2024-04-16T18:28:45.767 DEBUG:boto:Token: None 2024-04-16T18:28:45.768 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.768 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA= 2024-04-16T18:28:45.768 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA=', 'Content-Length': '0'} 2024-04-16T18:28:45.770 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d900a4960e6bc46f-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.770 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.770 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.770 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.770 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.770 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.771 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.771 DEBUG:boto:Data: 2024-04-16T18:28:45.771 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.771 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.771 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.771 DEBUG:boto:Params: {} 2024-04-16T18:28:45.771 DEBUG:boto:Token: None 2024-04-16T18:28:45.771 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XUCVP6ANVJJ5Piu6oxZMnUcp0ok= 2024-04-16T18:28:45.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XUCVP6ANVJJ5Piu6oxZMnUcp0ok=', 'Content-Length': '0'} 2024-04-16T18:28:45.773 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bb3aeb4d4597a29-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.774 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.774 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.774 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.774 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.774 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.774 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.774 DEBUG:boto:Data: 2024-04-16T18:28:45.775 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.775 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.775 DEBUG:boto:Params: {} 2024-04-16T18:28:45.775 DEBUG:boto:Token: None 2024-04-16T18:28:45.775 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XUCVP6ANVJJ5Piu6oxZMnUcp0ok= 2024-04-16T18:28:45.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XUCVP6ANVJJ5Piu6oxZMnUcp0ok=', 'Content-Length': '0'} 2024-04-16T18:28:45.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000189ee1806b524b8c-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.777 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:28:45.778 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.778 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.778 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.778 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.778 DEBUG:boto:Method: GET 2024-04-16T18:28:45.778 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.778 DEBUG:boto:Data: 2024-04-16T18:28:45.778 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.778 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.778 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.779 DEBUG:boto:Params: {} 2024-04-16T18:28:45.779 DEBUG:boto:Token: None 2024-04-16T18:28:45.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA= 2024-04-16T18:28:45.779 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA=', 'Content-Length': '0'} 2024-04-16T18:28:45.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c4c197d9f0c3db1-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.822 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.822 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.823 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.823 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.823 DEBUG:boto:Method: GET 2024-04-16T18:28:45.823 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.823 DEBUG:boto:Data: 2024-04-16T18:28:45.823 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.823 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.823 DEBUG:boto:Params: {} 2024-04-16T18:28:45.823 DEBUG:boto:Token: None 2024-04-16T18:28:45.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:28:45.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA= 2024-04-16T18:28:45.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XSnJATaQsnTbaYp46aX2UxGzqEA=', 'Content-Length': '0'} 2024-04-16T18:28:45.826 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b231b444719fed45-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.826 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.826 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.826 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.826 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.826 DEBUG:boto:Method: GET 2024-04-16T18:28:45.826 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.827 DEBUG:boto:Data: 2024-04-16T18:28:45.827 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.827 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.827 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.827 DEBUG:boto:Params: {} 2024-04-16T18:28:45.827 DEBUG:boto:Token: None 2024-04-16T18:28:45.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.830 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e768ff159ee80cb-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.870 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.871 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.871 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.871 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.871 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.871 DEBUG:boto:Method: GET 2024-04-16T18:28:45.871 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.871 DEBUG:boto:Data: 2024-04-16T18:28:45.871 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.872 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.872 DEBUG:boto:Params: {} 2024-04-16T18:28:45.872 DEBUG:boto:Token: None 2024-04-16T18:28:45.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.876 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000787f4909f72cfebb-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.876 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.876 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.876 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.877 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.877 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:28:45.877 DEBUG:boto:Data: 2024-04-16T18:28:45.877 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.877 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.877 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.877 DEBUG:boto:Params: {} 2024-04-16T18:28:45.877 DEBUG:boto:Token: None 2024-04-16T18:28:45.877 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17 2024-04-16T18:28:45.877 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2r0VWOB6vgETOyjlnngZBsKMi4= 2024-04-16T18:28:45.878 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2r0VWOB6vgETOyjlnngZBsKMi4=', 'Content-Length': '0'} 2024-04-16T18:28:45.880 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052d0e00b5308015e-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.880 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.880 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.880 DEBUG:boto:Method: HEAD 2024-04-16T18:28:45.880 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:28:45.880 DEBUG:boto:Data: 2024-04-16T18:28:45.880 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.880 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.881 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.881 DEBUG:boto:Params: {} 2024-04-16T18:28:45.881 DEBUG:boto:Token: None 2024-04-16T18:28:45.881 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17 2024-04-16T18:28:45.881 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R2r0VWOB6vgETOyjlnngZBsKMi4= 2024-04-16T18:28:45.881 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R2r0VWOB6vgETOyjlnngZBsKMi4=', 'Content-Length': '0'} 2024-04-16T18:28:45.883 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8fd567e9c80c8a7-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.883 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:28:45.884 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.884 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.884 DEBUG:boto:Method: GET 2024-04-16T18:28:45.884 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:28:45.884 DEBUG:boto:Data: 2024-04-16T18:28:45.884 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.884 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.884 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.884 DEBUG:boto:Params: {} 2024-04-16T18:28:45.884 DEBUG:boto:Token: None 2024-04-16T18:28:45.885 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17 2024-04-16T18:28:45.885 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K4A27cC3O//tHoNGTWSh/AqnGmI= 2024-04-16T18:28:45.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K4A27cC3O//tHoNGTWSh/AqnGmI=', 'Content-Length': '0'} 2024-04-16T18:28:45.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ca0c321ea542306-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.930 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:28:45.930 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:28:45.931 DEBUG:boto:Method: GET 2024-04-16T18:28:45.931 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:28:45.931 DEBUG:boto:Data: 2024-04-16T18:28:45.931 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.931 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.931 DEBUG:boto:Params: {} 2024-04-16T18:28:45.931 DEBUG:boto:Token: None 2024-04-16T18:28:45.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj17 2024-04-16T18:28:45.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K4A27cC3O//tHoNGTWSh/AqnGmI= 2024-04-16T18:28:45.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K4A27cC3O//tHoNGTWSh/AqnGmI=', 'Content-Length': '0'} 2024-04-16T18:28:45.933 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa3d195619a46952-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.934 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.934 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.934 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.934 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.934 DEBUG:boto:Method: GET 2024-04-16T18:28:45.934 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.934 DEBUG:boto:Data: 2024-04-16T18:28:45.934 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.934 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.935 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.935 DEBUG:boto:Params: {} 2024-04-16T18:28:45.935 DEBUG:boto:Token: None 2024-04-16T18:28:45.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.935 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.935 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002070724ceafed42e-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.978 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.979 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:45.979 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:45.979 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.979 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.979 DEBUG:boto:Method: GET 2024-04-16T18:28:45.979 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:28:45.979 DEBUG:boto:Data: 2024-04-16T18:28:45.979 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:45.979 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.980 DEBUG:boto:Params: {} 2024-04-16T18:28:45.980 DEBUG:boto:Token: None 2024-04-16T18:28:45.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/ 2024-04-16T18:28:45.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU= 2024-04-16T18:28:45.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nTgzTd3AuSxCUzoPy/msbDrS8IU=', 'Content-Length': '0'} 2024-04-16T18:28:45.983 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f3d9ea9b0014d3f-00661ec35d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:45.983 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:45.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:28:45.984 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:45.984 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:45.984 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:45.984 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:45.984 DEBUG:boto:Method: GET 2024-04-16T18:28:45.984 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:45.984 DEBUG:boto:Data: 2024-04-16T18:28:45.984 DEBUG:boto:Headers: {} 2024-04-16T18:28:45.985 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:45.985 DEBUG:boto:Port: 8000 2024-04-16T18:28:45.985 DEBUG:boto:Params: {} 2024-04-16T18:28:45.985 DEBUG:boto:Token: None 2024-04-16T18:28:45.985 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:45 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:45.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z12TIW7ILlBCPJGqCBwNhjsVAxY= 2024-04-16T18:28:45.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z12TIW7ILlBCPJGqCBwNhjsVAxY=', 'Content-Length': '0'} 2024-04-16T18:28:45.988 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000034589bd7f95d4d6d-00661ec35d-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.030 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.030 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.031 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.031 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.031 DEBUG:boto:Method: GET 2024-04-16T18:28:46.031 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.031 DEBUG:boto:Data: 2024-04-16T18:28:46.031 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.032 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.032 DEBUG:boto:Params: {} 2024-04-16T18:28:46.032 DEBUG:boto:Token: None 2024-04-16T18:28:46.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JCxL2tdwH2WmxfQXMBMeHwIlIn0= 2024-04-16T18:28:46.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JCxL2tdwH2WmxfQXMBMeHwIlIn0=', 'Content-Length': '0'} 2024-04-16T18:28:46.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000684fd159ff354541-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.034 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.035 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.035 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.035 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.035 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.035 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.035 DEBUG:boto:Data: 2024-04-16T18:28:46.035 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.035 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.035 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.035 DEBUG:boto:Params: {} 2024-04-16T18:28:46.036 DEBUG:boto:Token: None 2024-04-16T18:28:46.036 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FQ451/iDmlj14/atqn9w9RjUMi8= 2024-04-16T18:28:46.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FQ451/iDmlj14/atqn9w9RjUMi8=', 'Content-Length': '0'} 2024-04-16T18:28:46.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016614cdd4275e922-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.038 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.038 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.038 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.039 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.039 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.039 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.039 DEBUG:boto:Data: 2024-04-16T18:28:46.039 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.039 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.039 DEBUG:boto:Params: {} 2024-04-16T18:28:46.039 DEBUG:boto:Token: None 2024-04-16T18:28:46.039 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FQ451/iDmlj14/atqn9w9RjUMi8= 2024-04-16T18:28:46.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FQ451/iDmlj14/atqn9w9RjUMi8=', 'Content-Length': '0'} 2024-04-16T18:28:46.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007494235500e87564-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.042 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:28:46.042 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.042 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.042 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.042 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.042 DEBUG:boto:Method: GET 2024-04-16T18:28:46.042 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.042 DEBUG:boto:Data: 2024-04-16T18:28:46.042 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.043 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.043 DEBUG:boto:Params: {} 2024-04-16T18:28:46.043 DEBUG:boto:Token: None 2024-04-16T18:28:46.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JCxL2tdwH2WmxfQXMBMeHwIlIn0= 2024-04-16T18:28:46.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JCxL2tdwH2WmxfQXMBMeHwIlIn0=', 'Content-Length': '0'} 2024-04-16T18:28:46.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000361fc474e6b763a2-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.086 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.086 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.087 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.087 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.087 DEBUG:boto:Method: GET 2024-04-16T18:28:46.087 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.087 DEBUG:boto:Data: 2024-04-16T18:28:46.087 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.087 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.087 DEBUG:boto:Params: {} 2024-04-16T18:28:46.087 DEBUG:boto:Token: None 2024-04-16T18:28:46.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:28:46.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JCxL2tdwH2WmxfQXMBMeHwIlIn0= 2024-04-16T18:28:46.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JCxL2tdwH2WmxfQXMBMeHwIlIn0=', 'Content-Length': '0'} 2024-04-16T18:28:46.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0f1e2c4ccf9d32b-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.090 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.090 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.090 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.090 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.090 DEBUG:boto:Method: GET 2024-04-16T18:28:46.090 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.091 DEBUG:boto:Data: 2024-04-16T18:28:46.091 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.091 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.091 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.091 DEBUG:boto:Params: {} 2024-04-16T18:28:46.091 DEBUG:boto:Token: None 2024-04-16T18:28:46.091 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051dda73116a1c1bb-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.134 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.135 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.135 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.135 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.135 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.135 DEBUG:boto:Method: GET 2024-04-16T18:28:46.135 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.135 DEBUG:boto:Data: 2024-04-16T18:28:46.135 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.135 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.135 DEBUG:boto:Params: {} 2024-04-16T18:28:46.136 DEBUG:boto:Token: None 2024-04-16T18:28:46.136 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.139 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000031515715e114243e-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.139 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.140 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.140 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.140 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.140 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:28:46.140 DEBUG:boto:Data: 2024-04-16T18:28:46.140 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.140 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.140 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.141 DEBUG:boto:Params: {} 2024-04-16T18:28:46.141 DEBUG:boto:Token: None 2024-04-16T18:28:46.141 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185 2024-04-16T18:28:46.141 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vJ+Gj1ntHcBZ7FcOCBzb6S+5Fa4= 2024-04-16T18:28:46.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vJ+Gj1ntHcBZ7FcOCBzb6S+5Fa4=', 'Content-Length': '0'} 2024-04-16T18:28:46.143 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066caa1936742e0d1-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.143 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.143 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.143 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.143 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:28:46.144 DEBUG:boto:Data: 2024-04-16T18:28:46.144 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.144 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.144 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.144 DEBUG:boto:Params: {} 2024-04-16T18:28:46.144 DEBUG:boto:Token: None 2024-04-16T18:28:46.144 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185 2024-04-16T18:28:46.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vJ+Gj1ntHcBZ7FcOCBzb6S+5Fa4= 2024-04-16T18:28:46.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vJ+Gj1ntHcBZ7FcOCBzb6S+5Fa4=', 'Content-Length': '0'} 2024-04-16T18:28:46.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab4f867c36d110c0-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.147 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:28:46.147 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.147 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.147 DEBUG:boto:Method: GET 2024-04-16T18:28:46.147 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:28:46.147 DEBUG:boto:Data: 2024-04-16T18:28:46.147 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.147 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.147 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.148 DEBUG:boto:Params: {} 2024-04-16T18:28:46.148 DEBUG:boto:Token: None 2024-04-16T18:28:46.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185 2024-04-16T18:28:46.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:snbB0bGQLlWTKuGPMRdrgy36bHU= 2024-04-16T18:28:46.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:snbB0bGQLlWTKuGPMRdrgy36bHU=', 'Content-Length': '0'} 2024-04-16T18:28:46.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b9f9156a380ecba-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.190 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:28:46.190 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:28:46.191 DEBUG:boto:Method: GET 2024-04-16T18:28:46.191 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:28:46.191 DEBUG:boto:Data: 2024-04-16T18:28:46.191 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.191 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.191 DEBUG:boto:Params: {} 2024-04-16T18:28:46.191 DEBUG:boto:Token: None 2024-04-16T18:28:46.191 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj185 2024-04-16T18:28:46.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:snbB0bGQLlWTKuGPMRdrgy36bHU= 2024-04-16T18:28:46.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:snbB0bGQLlWTKuGPMRdrgy36bHU=', 'Content-Length': '0'} 2024-04-16T18:28:46.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8aef8d44beb237e-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.194 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.194 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.194 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.194 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.194 DEBUG:boto:Method: GET 2024-04-16T18:28:46.194 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.195 DEBUG:boto:Data: 2024-04-16T18:28:46.195 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.195 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.195 DEBUG:boto:Params: {} 2024-04-16T18:28:46.195 DEBUG:boto:Token: None 2024-04-16T18:28:46.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b8cb5d257b89a70-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.238 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.239 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.239 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.239 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.239 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.239 DEBUG:boto:Method: GET 2024-04-16T18:28:46.239 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:28:46.239 DEBUG:boto:Data: 2024-04-16T18:28:46.239 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.239 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.240 DEBUG:boto:Params: {} 2024-04-16T18:28:46.240 DEBUG:boto:Token: None 2024-04-16T18:28:46.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.243 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cd28c235292ca53f-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.244 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.244 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:28:46.244 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.244 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.244 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.244 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.244 DEBUG:boto:Method: GET 2024-04-16T18:28:46.245 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.245 DEBUG:boto:Data: 2024-04-16T18:28:46.245 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.245 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.245 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.245 DEBUG:boto:Params: {} 2024-04-16T18:28:46.245 DEBUG:boto:Token: None 2024-04-16T18:28:46.245 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.245 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI= 2024-04-16T18:28:46.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI=', 'Content-Length': '0'} 2024-04-16T18:28:46.247 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db0a37330b367ee8-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.290 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.290 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.291 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.291 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.291 DEBUG:boto:Method: GET 2024-04-16T18:28:46.291 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.291 DEBUG:boto:Data: 2024-04-16T18:28:46.291 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.291 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.291 DEBUG:boto:Params: {} 2024-04-16T18:28:46.291 DEBUG:boto:Token: None 2024-04-16T18:28:46.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI= 2024-04-16T18:28:46.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI=', 'Content-Length': '0'} 2024-04-16T18:28:46.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfe05a1604f70422-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.294 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.294 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.294 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.294 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.294 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.294 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.295 DEBUG:boto:Data: 2024-04-16T18:28:46.295 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.295 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.295 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.295 DEBUG:boto:Params: {} 2024-04-16T18:28:46.295 DEBUG:boto:Token: None 2024-04-16T18:28:46.295 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NEI1SODYVwm1F4pOwMMulV8mruA= 2024-04-16T18:28:46.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NEI1SODYVwm1F4pOwMMulV8mruA=', 'Content-Length': '0'} 2024-04-16T18:28:46.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000173b1149f0ef090-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.298 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.298 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.298 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.298 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.298 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.298 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.298 DEBUG:boto:Data: 2024-04-16T18:28:46.298 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.298 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.298 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.298 DEBUG:boto:Params: {} 2024-04-16T18:28:46.299 DEBUG:boto:Token: None 2024-04-16T18:28:46.299 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NEI1SODYVwm1F4pOwMMulV8mruA= 2024-04-16T18:28:46.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NEI1SODYVwm1F4pOwMMulV8mruA=', 'Content-Length': '0'} 2024-04-16T18:28:46.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059651c5894bcdd5f-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.301 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:28:46.301 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.301 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.301 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.301 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.301 DEBUG:boto:Method: GET 2024-04-16T18:28:46.301 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.301 DEBUG:boto:Data: 2024-04-16T18:28:46.302 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.302 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.302 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.302 DEBUG:boto:Params: {} 2024-04-16T18:28:46.302 DEBUG:boto:Token: None 2024-04-16T18:28:46.302 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.302 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI= 2024-04-16T18:28:46.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI=', 'Content-Length': '0'} 2024-04-16T18:28:46.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006571a71efb60dc42-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.346 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.346 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.347 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.347 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.347 DEBUG:boto:Method: GET 2024-04-16T18:28:46.347 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.347 DEBUG:boto:Data: 2024-04-16T18:28:46.347 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.347 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.347 DEBUG:boto:Params: {} 2024-04-16T18:28:46.347 DEBUG:boto:Token: None 2024-04-16T18:28:46.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:28:46.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI= 2024-04-16T18:28:46.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SO4ibFHIkhUplwq+m/ZZdQjusHI=', 'Content-Length': '0'} 2024-04-16T18:28:46.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf1ba77ae4b52bc5-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.350 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.350 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.350 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.350 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.350 DEBUG:boto:Method: GET 2024-04-16T18:28:46.350 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.351 DEBUG:boto:Data: 2024-04-16T18:28:46.351 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.351 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.351 DEBUG:boto:Params: {} 2024-04-16T18:28:46.351 DEBUG:boto:Token: None 2024-04-16T18:28:46.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.354 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd83a9f7a80cdfdd-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.394 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.395 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.395 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.395 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.395 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.395 DEBUG:boto:Method: GET 2024-04-16T18:28:46.395 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.395 DEBUG:boto:Data: 2024-04-16T18:28:46.395 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.395 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.396 DEBUG:boto:Params: {} 2024-04-16T18:28:46.396 DEBUG:boto:Token: None 2024-04-16T18:28:46.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e5a537586d1806c6-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.400 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.400 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.400 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.400 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.401 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:28:46.401 DEBUG:boto:Data: 2024-04-16T18:28:46.401 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.401 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.401 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.401 DEBUG:boto:Params: {} 2024-04-16T18:28:46.401 DEBUG:boto:Token: None 2024-04-16T18:28:46.401 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19 2024-04-16T18:28:46.401 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+jh82Up2SFCFVnTX1K1j1x+rKns= 2024-04-16T18:28:46.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+jh82Up2SFCFVnTX1K1j1x+rKns=', 'Content-Length': '0'} 2024-04-16T18:28:46.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083ed07deed8d74ad-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.403 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.403 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.404 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.404 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:28:46.404 DEBUG:boto:Data: 2024-04-16T18:28:46.404 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.404 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.404 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.404 DEBUG:boto:Params: {} 2024-04-16T18:28:46.404 DEBUG:boto:Token: None 2024-04-16T18:28:46.404 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19 2024-04-16T18:28:46.405 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+jh82Up2SFCFVnTX1K1j1x+rKns= 2024-04-16T18:28:46.405 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+jh82Up2SFCFVnTX1K1j1x+rKns=', 'Content-Length': '0'} 2024-04-16T18:28:46.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007906ac05e5f6901e-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:28:46.407 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.407 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.407 DEBUG:boto:Method: GET 2024-04-16T18:28:46.407 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:28:46.407 DEBUG:boto:Data: 2024-04-16T18:28:46.407 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.408 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.408 DEBUG:boto:Params: {} 2024-04-16T18:28:46.408 DEBUG:boto:Token: None 2024-04-16T18:28:46.408 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19 2024-04-16T18:28:46.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hzQm9h7LErVy8oXD99Jlas+XpCU= 2024-04-16T18:28:46.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hzQm9h7LErVy8oXD99Jlas+XpCU=', 'Content-Length': '0'} 2024-04-16T18:28:46.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045dbd5772fc8e7a6-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.450 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:28:46.450 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:28:46.450 DEBUG:boto:Method: GET 2024-04-16T18:28:46.451 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:28:46.451 DEBUG:boto:Data: 2024-04-16T18:28:46.451 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.451 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.451 DEBUG:boto:Params: {} 2024-04-16T18:28:46.451 DEBUG:boto:Token: None 2024-04-16T18:28:46.451 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj19 2024-04-16T18:28:46.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hzQm9h7LErVy8oXD99Jlas+XpCU= 2024-04-16T18:28:46.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hzQm9h7LErVy8oXD99Jlas+XpCU=', 'Content-Length': '0'} 2024-04-16T18:28:46.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bedcd68cada2fcb9-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.453 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.454 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.454 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.454 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.454 DEBUG:boto:Method: GET 2024-04-16T18:28:46.454 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.454 DEBUG:boto:Data: 2024-04-16T18:28:46.454 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.454 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.454 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.454 DEBUG:boto:Params: {} 2024-04-16T18:28:46.455 DEBUG:boto:Token: None 2024-04-16T18:28:46.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.457 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a1457eed2e0c26d-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.498 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.499 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.499 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.499 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.499 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.499 DEBUG:boto:Method: GET 2024-04-16T18:28:46.499 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:28:46.499 DEBUG:boto:Data: 2024-04-16T18:28:46.499 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.499 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.500 DEBUG:boto:Params: {} 2024-04-16T18:28:46.500 DEBUG:boto:Token: None 2024-04-16T18:28:46.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.503 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000869ecc6bac846f33-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.504 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.504 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:28:46.504 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.504 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.504 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.504 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.504 DEBUG:boto:Method: GET 2024-04-16T18:28:46.505 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.505 DEBUG:boto:Data: 2024-04-16T18:28:46.505 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.505 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.505 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.505 DEBUG:boto:Params: {} 2024-04-16T18:28:46.505 DEBUG:boto:Token: None 2024-04-16T18:28:46.505 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.505 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg= 2024-04-16T18:28:46.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg=', 'Content-Length': '0'} 2024-04-16T18:28:46.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007db4502a9b26f69d-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.550 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.550 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.551 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.551 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.551 DEBUG:boto:Method: GET 2024-04-16T18:28:46.551 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.551 DEBUG:boto:Data: 2024-04-16T18:28:46.551 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.551 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.551 DEBUG:boto:Params: {} 2024-04-16T18:28:46.551 DEBUG:boto:Token: None 2024-04-16T18:28:46.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg= 2024-04-16T18:28:46.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg=', 'Content-Length': '0'} 2024-04-16T18:28:46.554 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f84a320cbd12ef93-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.554 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.554 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.554 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.554 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.554 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.554 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.555 DEBUG:boto:Data: 2024-04-16T18:28:46.555 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.555 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.555 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.555 DEBUG:boto:Params: {} 2024-04-16T18:28:46.555 DEBUG:boto:Token: None 2024-04-16T18:28:46.555 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MMcxz7KkGZkSScdSUO2HKXP61YM= 2024-04-16T18:28:46.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MMcxz7KkGZkSScdSUO2HKXP61YM=', 'Content-Length': '0'} 2024-04-16T18:28:46.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbbe4982a4a216a2-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.557 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.557 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.557 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.557 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.557 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.558 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.558 DEBUG:boto:Data: 2024-04-16T18:28:46.558 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.558 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.558 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.558 DEBUG:boto:Params: {} 2024-04-16T18:28:46.558 DEBUG:boto:Token: None 2024-04-16T18:28:46.558 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MMcxz7KkGZkSScdSUO2HKXP61YM= 2024-04-16T18:28:46.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MMcxz7KkGZkSScdSUO2HKXP61YM=', 'Content-Length': '0'} 2024-04-16T18:28:46.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d465396b31c3764-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.560 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:28:46.560 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.561 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.561 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.561 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.561 DEBUG:boto:Method: GET 2024-04-16T18:28:46.561 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.561 DEBUG:boto:Data: 2024-04-16T18:28:46.561 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.561 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.561 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.561 DEBUG:boto:Params: {} 2024-04-16T18:28:46.562 DEBUG:boto:Token: None 2024-04-16T18:28:46.562 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.562 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg= 2024-04-16T18:28:46.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg=', 'Content-Length': '0'} 2024-04-16T18:28:46.564 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc44b30ed37fe1c3-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.606 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.606 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.606 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.607 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.607 DEBUG:boto:Method: GET 2024-04-16T18:28:46.607 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.607 DEBUG:boto:Data: 2024-04-16T18:28:46.607 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.607 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.607 DEBUG:boto:Params: {} 2024-04-16T18:28:46.607 DEBUG:boto:Token: None 2024-04-16T18:28:46.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:28:46.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg= 2024-04-16T18:28:46.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mczk7t9FvK/5XIzBs0fXNADYcrg=', 'Content-Length': '0'} 2024-04-16T18:28:46.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c62b518d735dba5-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.610 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.610 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.610 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.610 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.610 DEBUG:boto:Method: GET 2024-04-16T18:28:46.610 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.610 DEBUG:boto:Data: 2024-04-16T18:28:46.610 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.610 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.610 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.610 DEBUG:boto:Params: {} 2024-04-16T18:28:46.611 DEBUG:boto:Token: None 2024-04-16T18:28:46.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.613 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000fcfa391d2b95012-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.654 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.655 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.655 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.655 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.655 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.655 DEBUG:boto:Method: GET 2024-04-16T18:28:46.655 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.655 DEBUG:boto:Data: 2024-04-16T18:28:46.655 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.655 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.655 DEBUG:boto:Params: {} 2024-04-16T18:28:46.655 DEBUG:boto:Token: None 2024-04-16T18:28:46.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.659 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038602708ffc5a0b9-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.659 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.659 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.659 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.660 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.660 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:28:46.660 DEBUG:boto:Data: 2024-04-16T18:28:46.660 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.660 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.660 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.660 DEBUG:boto:Params: {} 2024-04-16T18:28:46.660 DEBUG:boto:Token: None 2024-04-16T18:28:46.660 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22 2024-04-16T18:28:46.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P1Fx7JT9Yx9iUpMAsglNkI/CRho= 2024-04-16T18:28:46.661 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P1Fx7JT9Yx9iUpMAsglNkI/CRho=', 'Content-Length': '0'} 2024-04-16T18:28:46.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000186e4cb88124f18a-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.663 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.663 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.663 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.663 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:28:46.663 DEBUG:boto:Data: 2024-04-16T18:28:46.663 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.663 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.663 DEBUG:boto:Params: {} 2024-04-16T18:28:46.663 DEBUG:boto:Token: None 2024-04-16T18:28:46.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22 2024-04-16T18:28:46.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P1Fx7JT9Yx9iUpMAsglNkI/CRho= 2024-04-16T18:28:46.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P1Fx7JT9Yx9iUpMAsglNkI/CRho=', 'Content-Length': '0'} 2024-04-16T18:28:46.666 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099a089bf8ee738fa-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:28:46.666 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.666 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.666 DEBUG:boto:Method: GET 2024-04-16T18:28:46.666 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:28:46.666 DEBUG:boto:Data: 2024-04-16T18:28:46.666 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.667 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.667 DEBUG:boto:Params: {} 2024-04-16T18:28:46.667 DEBUG:boto:Token: None 2024-04-16T18:28:46.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22 2024-04-16T18:28:46.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B8LZInw0NTqfPrI3g1hzZuXBzfQ= 2024-04-16T18:28:46.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B8LZInw0NTqfPrI3g1hzZuXBzfQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fcb90413ba947a3-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.710 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:28:46.710 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:28:46.710 DEBUG:boto:Method: GET 2024-04-16T18:28:46.711 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:28:46.711 DEBUG:boto:Data: 2024-04-16T18:28:46.711 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.711 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.711 DEBUG:boto:Params: {} 2024-04-16T18:28:46.711 DEBUG:boto:Token: None 2024-04-16T18:28:46.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj22 2024-04-16T18:28:46.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B8LZInw0NTqfPrI3g1hzZuXBzfQ= 2024-04-16T18:28:46.711 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B8LZInw0NTqfPrI3g1hzZuXBzfQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000897bebf2a791a429-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.714 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.714 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.714 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.714 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.714 DEBUG:boto:Method: GET 2024-04-16T18:28:46.714 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.714 DEBUG:boto:Data: 2024-04-16T18:28:46.714 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.715 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.715 DEBUG:boto:Params: {} 2024-04-16T18:28:46.715 DEBUG:boto:Token: None 2024-04-16T18:28:46.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000052545087f1963a5b-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.758 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.759 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.759 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.759 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.759 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.759 DEBUG:boto:Method: GET 2024-04-16T18:28:46.759 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:28:46.759 DEBUG:boto:Data: 2024-04-16T18:28:46.759 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.759 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.759 DEBUG:boto:Params: {} 2024-04-16T18:28:46.760 DEBUG:boto:Token: None 2024-04-16T18:28:46.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a582954baa278148-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.764 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.764 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:28:46.764 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.765 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.765 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.765 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.765 DEBUG:boto:Method: GET 2024-04-16T18:28:46.765 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.765 DEBUG:boto:Data: 2024-04-16T18:28:46.765 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.765 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.765 DEBUG:boto:Params: {} 2024-04-16T18:28:46.765 DEBUG:boto:Token: None 2024-04-16T18:28:46.766 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.766 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM= 2024-04-16T18:28:46.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM=', 'Content-Length': '0'} 2024-04-16T18:28:46.768 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff70fb1f272d8dc2-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.810 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.810 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.811 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.811 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.811 DEBUG:boto:Method: GET 2024-04-16T18:28:46.811 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.811 DEBUG:boto:Data: 2024-04-16T18:28:46.811 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.811 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.811 DEBUG:boto:Params: {} 2024-04-16T18:28:46.811 DEBUG:boto:Token: None 2024-04-16T18:28:46.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM= 2024-04-16T18:28:46.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM=', 'Content-Length': '0'} 2024-04-16T18:28:46.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adc365e7b7a3aad7-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.814 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.814 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.814 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.814 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.814 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.814 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.814 DEBUG:boto:Data: 2024-04-16T18:28:46.814 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.815 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.815 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.815 DEBUG:boto:Params: {} 2024-04-16T18:28:46.815 DEBUG:boto:Token: None 2024-04-16T18:28:46.815 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:It+XCW1tlWz9LXelq+HzDlujSo8= 2024-04-16T18:28:46.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:It+XCW1tlWz9LXelq+HzDlujSo8=', 'Content-Length': '0'} 2024-04-16T18:28:46.817 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e090fe5b1c25f7a-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.817 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.817 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.817 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.817 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.817 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.817 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.818 DEBUG:boto:Data: 2024-04-16T18:28:46.818 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.818 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.818 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.818 DEBUG:boto:Params: {} 2024-04-16T18:28:46.818 DEBUG:boto:Token: None 2024-04-16T18:28:46.818 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.818 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:It+XCW1tlWz9LXelq+HzDlujSo8= 2024-04-16T18:28:46.818 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:It+XCW1tlWz9LXelq+HzDlujSo8=', 'Content-Length': '0'} 2024-04-16T18:28:46.820 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a5c8264d5776ad3-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.820 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:28:46.820 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.820 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.821 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.821 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.821 DEBUG:boto:Method: GET 2024-04-16T18:28:46.821 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.821 DEBUG:boto:Data: 2024-04-16T18:28:46.821 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.821 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.821 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.821 DEBUG:boto:Params: {} 2024-04-16T18:28:46.821 DEBUG:boto:Token: None 2024-04-16T18:28:46.821 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.822 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM= 2024-04-16T18:28:46.822 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM=', 'Content-Length': '0'} 2024-04-16T18:28:46.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7fd8756eb8e74a8-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.866 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.866 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.867 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.867 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.867 DEBUG:boto:Method: GET 2024-04-16T18:28:46.867 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.867 DEBUG:boto:Data: 2024-04-16T18:28:46.867 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.867 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.867 DEBUG:boto:Params: {} 2024-04-16T18:28:46.867 DEBUG:boto:Token: None 2024-04-16T18:28:46.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:28:46.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM= 2024-04-16T18:28:46.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+B71u6EN0Pn2lu3x8QSsLLkllUM=', 'Content-Length': '0'} 2024-04-16T18:28:46.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000333420b1f9cd4145-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.870 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.870 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.870 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.870 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.870 DEBUG:boto:Method: GET 2024-04-16T18:28:46.870 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.870 DEBUG:boto:Data: 2024-04-16T18:28:46.870 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.870 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.870 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.871 DEBUG:boto:Params: {} 2024-04-16T18:28:46.871 DEBUG:boto:Token: None 2024-04-16T18:28:46.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f61baf6dcec9ce60-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.914 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.915 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.915 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.915 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.915 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.915 DEBUG:boto:Method: GET 2024-04-16T18:28:46.915 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.915 DEBUG:boto:Data: 2024-04-16T18:28:46.915 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.915 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.915 DEBUG:boto:Params: {} 2024-04-16T18:28:46.916 DEBUG:boto:Token: None 2024-04-16T18:28:46.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.919 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ea67c4bcdbb9587-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.919 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:46.920 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.920 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.920 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.920 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:28:46.920 DEBUG:boto:Data: 2024-04-16T18:28:46.920 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.920 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.920 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.920 DEBUG:boto:Params: {} 2024-04-16T18:28:46.921 DEBUG:boto:Token: None 2024-04-16T18:28:46.921 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23 2024-04-16T18:28:46.921 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rnKKE3u0haMOBUOXq8hntSFBIWA= 2024-04-16T18:28:46.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rnKKE3u0haMOBUOXq8hntSFBIWA=', 'Content-Length': '0'} 2024-04-16T18:28:46.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d646a0aa94a51d10-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.923 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.923 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.923 DEBUG:boto:Method: HEAD 2024-04-16T18:28:46.923 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:28:46.923 DEBUG:boto:Data: 2024-04-16T18:28:46.923 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.924 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.924 DEBUG:boto:Params: {} 2024-04-16T18:28:46.924 DEBUG:boto:Token: None 2024-04-16T18:28:46.924 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23 2024-04-16T18:28:46.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rnKKE3u0haMOBUOXq8hntSFBIWA= 2024-04-16T18:28:46.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rnKKE3u0haMOBUOXq8hntSFBIWA=', 'Content-Length': '0'} 2024-04-16T18:28:46.926 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073106925a88e539b-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.926 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:28:46.926 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.926 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.926 DEBUG:boto:Method: GET 2024-04-16T18:28:46.926 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:28:46.926 DEBUG:boto:Data: 2024-04-16T18:28:46.926 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.927 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.927 DEBUG:boto:Params: {} 2024-04-16T18:28:46.927 DEBUG:boto:Token: None 2024-04-16T18:28:46.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23 2024-04-16T18:28:46.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aa/3/JByH2AxdmroTf7Fu3+RXek= 2024-04-16T18:28:46.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aa/3/JByH2AxdmroTf7Fu3+RXek=', 'Content-Length': '0'} 2024-04-16T18:28:46.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000802391f03df84e5a-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.970 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:28:46.970 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:28:46.971 DEBUG:boto:Method: GET 2024-04-16T18:28:46.971 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:28:46.971 DEBUG:boto:Data: 2024-04-16T18:28:46.971 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:46.971 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.971 DEBUG:boto:Params: {} 2024-04-16T18:28:46.971 DEBUG:boto:Token: None 2024-04-16T18:28:46.971 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/obj23 2024-04-16T18:28:46.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aa/3/JByH2AxdmroTf7Fu3+RXek= 2024-04-16T18:28:46.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aa/3/JByH2AxdmroTf7Fu3+RXek=', 'Content-Length': '0'} 2024-04-16T18:28:46.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070af807ee17ddd8a-00661ec35e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:46.974 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:46.974 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:46.974 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.974 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.974 DEBUG:boto:Method: GET 2024-04-16T18:28:46.974 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:28:46.974 DEBUG:boto:Data: 2024-04-16T18:28:46.974 DEBUG:boto:Headers: {} 2024-04-16T18:28:46.974 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:46.975 DEBUG:boto:Port: 8000 2024-04-16T18:28:46.975 DEBUG:boto:Params: {} 2024-04-16T18:28:46.975 DEBUG:boto:Token: None 2024-04-16T18:28:46.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:46 GMT /cjqttm-52/ 2024-04-16T18:28:46.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ= 2024-04-16T18:28:46.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:46 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dWjyU4KnGrKCtjIwLy470o84bzQ=', 'Content-Length': '0'} 2024-04-16T18:28:46.977 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003909410e38f7f77e-00661ec35e-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:46 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.018 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.019 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.019 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.019 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:47.019 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:28:47.019 DEBUG:boto:Method: GET 2024-04-16T18:28:47.019 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:28:47.019 DEBUG:boto:Data: 2024-04-16T18:28:47.019 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.019 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.019 DEBUG:boto:Params: {} 2024-04-16T18:28:47.019 DEBUG:boto:Token: None 2024-04-16T18:28:47.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.023 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ccbdd211d16151b4-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.023 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.023 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:28:47.023 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.024 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.024 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.024 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.024 DEBUG:boto:Method: GET 2024-04-16T18:28:47.024 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.024 DEBUG:boto:Data: 2024-04-16T18:28:47.024 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.024 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.024 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.024 DEBUG:boto:Params: {} 2024-04-16T18:28:47.024 DEBUG:boto:Token: None 2024-04-16T18:28:47.025 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.025 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY= 2024-04-16T18:28:47.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY=', 'Content-Length': '0'} 2024-04-16T18:28:47.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a52da25919472f58-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.070 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.070 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.070 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.071 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.071 DEBUG:boto:Method: GET 2024-04-16T18:28:47.071 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.071 DEBUG:boto:Data: 2024-04-16T18:28:47.071 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.071 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.071 DEBUG:boto:Params: {} 2024-04-16T18:28:47.071 DEBUG:boto:Token: None 2024-04-16T18:28:47.071 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY= 2024-04-16T18:28:47.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY=', 'Content-Length': '0'} 2024-04-16T18:28:47.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e32e33964fccdce-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.074 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.074 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.075 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.075 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.075 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.075 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.075 DEBUG:boto:Data: 2024-04-16T18:28:47.075 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.075 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.075 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.075 DEBUG:boto:Params: {} 2024-04-16T18:28:47.075 DEBUG:boto:Token: None 2024-04-16T18:28:47.075 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:it8MiX/2amWTdeAkkxkJF3TbsFM= 2024-04-16T18:28:47.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:it8MiX/2amWTdeAkkxkJF3TbsFM=', 'Content-Length': '0'} 2024-04-16T18:28:47.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056f6e9b7fcfa16fc-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.077 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.078 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.078 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.078 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.078 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.078 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.078 DEBUG:boto:Data: 2024-04-16T18:28:47.078 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.078 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.078 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.078 DEBUG:boto:Params: {} 2024-04-16T18:28:47.078 DEBUG:boto:Token: None 2024-04-16T18:28:47.079 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:it8MiX/2amWTdeAkkxkJF3TbsFM= 2024-04-16T18:28:47.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:it8MiX/2amWTdeAkkxkJF3TbsFM=', 'Content-Length': '0'} 2024-04-16T18:28:47.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000561d5d046b178fba-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.081 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:28:47.081 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.081 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.081 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.081 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.081 DEBUG:boto:Method: GET 2024-04-16T18:28:47.082 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.082 DEBUG:boto:Data: 2024-04-16T18:28:47.082 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.082 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.082 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.082 DEBUG:boto:Params: {} 2024-04-16T18:28:47.082 DEBUG:boto:Token: None 2024-04-16T18:28:47.082 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.082 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY= 2024-04-16T18:28:47.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY=', 'Content-Length': '0'} 2024-04-16T18:28:47.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097cae5bfb43a10be-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.126 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.126 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.127 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.127 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.127 DEBUG:boto:Method: GET 2024-04-16T18:28:47.127 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.127 DEBUG:boto:Data: 2024-04-16T18:28:47.127 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.127 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.127 DEBUG:boto:Params: {} 2024-04-16T18:28:47.127 DEBUG:boto:Token: None 2024-04-16T18:28:47.128 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:28:47.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY= 2024-04-16T18:28:47.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IWV0CFA64nIKDP3rq2CiYA+r6pY=', 'Content-Length': '0'} 2024-04-16T18:28:47.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002def64b6c7bd32aa-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.130 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.130 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.130 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.131 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.131 DEBUG:boto:Method: GET 2024-04-16T18:28:47.131 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.131 DEBUG:boto:Data: 2024-04-16T18:28:47.131 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.131 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.131 DEBUG:boto:Params: {} 2024-04-16T18:28:47.131 DEBUG:boto:Token: None 2024-04-16T18:28:47.131 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d0619bf42f23857-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.174 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.175 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.175 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.175 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.175 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.175 DEBUG:boto:Method: GET 2024-04-16T18:28:47.175 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.175 DEBUG:boto:Data: 2024-04-16T18:28:47.175 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.175 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.176 DEBUG:boto:Params: {} 2024-04-16T18:28:47.176 DEBUG:boto:Token: None 2024-04-16T18:28:47.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.179 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf5c8c5fac98853a-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.179 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.180 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.180 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.180 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.180 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:28:47.180 DEBUG:boto:Data: 2024-04-16T18:28:47.180 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.180 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.180 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.180 DEBUG:boto:Params: {} 2024-04-16T18:28:47.181 DEBUG:boto:Token: None 2024-04-16T18:28:47.181 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29 2024-04-16T18:28:47.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1E76gDIk9ic2hGeJh6DuHu1pRWM= 2024-04-16T18:28:47.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1E76gDIk9ic2hGeJh6DuHu1pRWM=', 'Content-Length': '0'} 2024-04-16T18:28:47.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000492f603a65f11213-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.183 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.183 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.183 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.183 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:28:47.183 DEBUG:boto:Data: 2024-04-16T18:28:47.183 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.183 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.184 DEBUG:boto:Params: {} 2024-04-16T18:28:47.184 DEBUG:boto:Token: None 2024-04-16T18:28:47.184 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29 2024-04-16T18:28:47.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1E76gDIk9ic2hGeJh6DuHu1pRWM= 2024-04-16T18:28:47.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1E76gDIk9ic2hGeJh6DuHu1pRWM=', 'Content-Length': '0'} 2024-04-16T18:28:47.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8974569a441c71d-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:28:47.186 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.186 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.186 DEBUG:boto:Method: GET 2024-04-16T18:28:47.186 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:28:47.187 DEBUG:boto:Data: 2024-04-16T18:28:47.187 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.187 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.187 DEBUG:boto:Params: {} 2024-04-16T18:28:47.187 DEBUG:boto:Token: None 2024-04-16T18:28:47.187 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29 2024-04-16T18:28:47.187 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YiGHtfeE/ol6p1eWH4PcBQnZg0I= 2024-04-16T18:28:47.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YiGHtfeE/ol6p1eWH4PcBQnZg0I=', 'Content-Length': '0'} 2024-04-16T18:28:47.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b1e1d23df9f8e86-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.230 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:28:47.230 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:28:47.230 DEBUG:boto:Method: GET 2024-04-16T18:28:47.231 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:28:47.231 DEBUG:boto:Data: 2024-04-16T18:28:47.231 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.231 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.231 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.231 DEBUG:boto:Params: {} 2024-04-16T18:28:47.231 DEBUG:boto:Token: None 2024-04-16T18:28:47.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj29 2024-04-16T18:28:47.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YiGHtfeE/ol6p1eWH4PcBQnZg0I= 2024-04-16T18:28:47.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YiGHtfeE/ol6p1eWH4PcBQnZg0I=', 'Content-Length': '0'} 2024-04-16T18:28:47.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a57d0d1ad3dd1018-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.234 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.234 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.234 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.234 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.234 DEBUG:boto:Method: GET 2024-04-16T18:28:47.234 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.234 DEBUG:boto:Data: 2024-04-16T18:28:47.235 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.235 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.235 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.235 DEBUG:boto:Params: {} 2024-04-16T18:28:47.235 DEBUG:boto:Token: None 2024-04-16T18:28:47.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c38038b02015cbe5-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.278 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.279 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.279 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.279 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.279 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.279 DEBUG:boto:Method: GET 2024-04-16T18:28:47.279 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:28:47.279 DEBUG:boto:Data: 2024-04-16T18:28:47.279 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.279 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.279 DEBUG:boto:Params: {} 2024-04-16T18:28:47.279 DEBUG:boto:Token: None 2024-04-16T18:28:47.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.283 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019706974e075b690-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.284 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.284 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:28:47.284 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.284 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.284 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.284 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.285 DEBUG:boto:Method: GET 2024-04-16T18:28:47.285 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.285 DEBUG:boto:Data: 2024-04-16T18:28:47.285 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.285 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.285 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.285 DEBUG:boto:Params: {} 2024-04-16T18:28:47.285 DEBUG:boto:Token: None 2024-04-16T18:28:47.285 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA= 2024-04-16T18:28:47.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA=', 'Content-Length': '0'} 2024-04-16T18:28:47.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e49bda8ad5e5c829-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.330 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.330 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.330 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.331 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.331 DEBUG:boto:Method: GET 2024-04-16T18:28:47.331 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.331 DEBUG:boto:Data: 2024-04-16T18:28:47.331 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.331 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.331 DEBUG:boto:Params: {} 2024-04-16T18:28:47.331 DEBUG:boto:Token: None 2024-04-16T18:28:47.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA= 2024-04-16T18:28:47.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA=', 'Content-Length': '0'} 2024-04-16T18:28:47.334 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015f93e6764fb589b-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.334 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.334 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.335 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.335 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.335 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.335 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.335 DEBUG:boto:Data: 2024-04-16T18:28:47.335 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.335 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.335 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.335 DEBUG:boto:Params: {} 2024-04-16T18:28:47.335 DEBUG:boto:Token: None 2024-04-16T18:28:47.335 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8QPhCasph9tojWk4y1L6uLO6+to= 2024-04-16T18:28:47.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8QPhCasph9tojWk4y1L6uLO6+to=', 'Content-Length': '0'} 2024-04-16T18:28:47.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001218a8c5d97e6f72-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.338 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.338 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.338 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.338 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.338 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.338 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.339 DEBUG:boto:Data: 2024-04-16T18:28:47.339 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.339 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.339 DEBUG:boto:Params: {} 2024-04-16T18:28:47.339 DEBUG:boto:Token: None 2024-04-16T18:28:47.339 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.339 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8QPhCasph9tojWk4y1L6uLO6+to= 2024-04-16T18:28:47.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8QPhCasph9tojWk4y1L6uLO6+to=', 'Content-Length': '0'} 2024-04-16T18:28:47.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a765fa5f929bf700-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.342 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:28:47.342 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.342 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.342 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.342 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.342 DEBUG:boto:Method: GET 2024-04-16T18:28:47.342 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.343 DEBUG:boto:Data: 2024-04-16T18:28:47.343 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.343 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.343 DEBUG:boto:Params: {} 2024-04-16T18:28:47.343 DEBUG:boto:Token: None 2024-04-16T18:28:47.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA= 2024-04-16T18:28:47.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA=', 'Content-Length': '0'} 2024-04-16T18:28:47.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006795cb1198385a0d-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.386 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.386 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.387 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.387 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.387 DEBUG:boto:Method: GET 2024-04-16T18:28:47.387 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.387 DEBUG:boto:Data: 2024-04-16T18:28:47.387 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.387 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.387 DEBUG:boto:Params: {} 2024-04-16T18:28:47.387 DEBUG:boto:Token: None 2024-04-16T18:28:47.387 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:28:47.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA= 2024-04-16T18:28:47.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/X9lxal4hLbzam15MgQrNA2uIBA=', 'Content-Length': '0'} 2024-04-16T18:28:47.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a83c6004069886e9-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.390 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.390 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.390 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.390 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.390 DEBUG:boto:Method: GET 2024-04-16T18:28:47.390 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.390 DEBUG:boto:Data: 2024-04-16T18:28:47.390 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.390 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.391 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.391 DEBUG:boto:Params: {} 2024-04-16T18:28:47.391 DEBUG:boto:Token: None 2024-04-16T18:28:47.391 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.391 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.393 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008979bc45088a1380-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.434 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.435 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.435 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.435 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.435 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.435 DEBUG:boto:Method: GET 2024-04-16T18:28:47.435 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.435 DEBUG:boto:Data: 2024-04-16T18:28:47.435 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.435 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.435 DEBUG:boto:Params: {} 2024-04-16T18:28:47.436 DEBUG:boto:Token: None 2024-04-16T18:28:47.436 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.439 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cfa8c9e0661ba1e3-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.439 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.440 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.440 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.440 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.440 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:28:47.440 DEBUG:boto:Data: 2024-04-16T18:28:47.440 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.440 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.440 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.440 DEBUG:boto:Params: {} 2024-04-16T18:28:47.441 DEBUG:boto:Token: None 2024-04-16T18:28:47.441 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31 2024-04-16T18:28:47.441 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a3vCjz6/GVPoWhRMBCjNnaNm7FU= 2024-04-16T18:28:47.441 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a3vCjz6/GVPoWhRMBCjNnaNm7FU=', 'Content-Length': '0'} 2024-04-16T18:28:47.443 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc22491a2d552373-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.443 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.443 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.443 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.443 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:28:47.444 DEBUG:boto:Data: 2024-04-16T18:28:47.444 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.444 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.444 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.444 DEBUG:boto:Params: {} 2024-04-16T18:28:47.444 DEBUG:boto:Token: None 2024-04-16T18:28:47.444 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31 2024-04-16T18:28:47.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a3vCjz6/GVPoWhRMBCjNnaNm7FU= 2024-04-16T18:28:47.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a3vCjz6/GVPoWhRMBCjNnaNm7FU=', 'Content-Length': '0'} 2024-04-16T18:28:47.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000573cd9a25af6708d-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.447 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:28:47.447 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.447 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.447 DEBUG:boto:Method: GET 2024-04-16T18:28:47.447 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:28:47.447 DEBUG:boto:Data: 2024-04-16T18:28:47.447 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.447 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.447 DEBUG:boto:Params: {} 2024-04-16T18:28:47.447 DEBUG:boto:Token: None 2024-04-16T18:28:47.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31 2024-04-16T18:28:47.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wZcmGHAudoOtwcpt7mQTYhFjj9o= 2024-04-16T18:28:47.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wZcmGHAudoOtwcpt7mQTYhFjj9o=', 'Content-Length': '0'} 2024-04-16T18:28:47.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f00f029712adcd05-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.490 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:28:47.490 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:28:47.490 DEBUG:boto:Method: GET 2024-04-16T18:28:47.491 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:28:47.491 DEBUG:boto:Data: 2024-04-16T18:28:47.491 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.491 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.491 DEBUG:boto:Params: {} 2024-04-16T18:28:47.491 DEBUG:boto:Token: None 2024-04-16T18:28:47.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj31 2024-04-16T18:28:47.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wZcmGHAudoOtwcpt7mQTYhFjj9o= 2024-04-16T18:28:47.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wZcmGHAudoOtwcpt7mQTYhFjj9o=', 'Content-Length': '0'} 2024-04-16T18:28:47.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb5aa9bb0d128e6b-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.494 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.494 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.494 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.494 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.494 DEBUG:boto:Method: GET 2024-04-16T18:28:47.494 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.494 DEBUG:boto:Data: 2024-04-16T18:28:47.494 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.494 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.495 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.495 DEBUG:boto:Params: {} 2024-04-16T18:28:47.495 DEBUG:boto:Token: None 2024-04-16T18:28:47.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.497 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049330bee47dd8e79-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.538 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.539 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.539 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.539 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.539 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.539 DEBUG:boto:Method: GET 2024-04-16T18:28:47.539 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:28:47.539 DEBUG:boto:Data: 2024-04-16T18:28:47.539 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.539 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.539 DEBUG:boto:Params: {} 2024-04-16T18:28:47.540 DEBUG:boto:Token: None 2024-04-16T18:28:47.540 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c7ee9733e25aae99-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.543 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.544 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:28:47.544 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.544 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.544 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.544 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.544 DEBUG:boto:Method: GET 2024-04-16T18:28:47.544 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.544 DEBUG:boto:Data: 2024-04-16T18:28:47.544 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.544 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.544 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.545 DEBUG:boto:Params: {} 2024-04-16T18:28:47.545 DEBUG:boto:Token: None 2024-04-16T18:28:47.545 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk= 2024-04-16T18:28:47.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk=', 'Content-Length': '0'} 2024-04-16T18:28:47.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0d3aaee8daacab8-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.590 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.590 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.590 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.591 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.591 DEBUG:boto:Method: GET 2024-04-16T18:28:47.591 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.591 DEBUG:boto:Data: 2024-04-16T18:28:47.591 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.591 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.591 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.591 DEBUG:boto:Params: {} 2024-04-16T18:28:47.591 DEBUG:boto:Token: None 2024-04-16T18:28:47.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk= 2024-04-16T18:28:47.592 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk=', 'Content-Length': '0'} 2024-04-16T18:28:47.594 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090c372685c0cebbd-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.594 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.594 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.594 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.594 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.594 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.594 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.594 DEBUG:boto:Data: 2024-04-16T18:28:47.595 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.595 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.595 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.595 DEBUG:boto:Params: {} 2024-04-16T18:28:47.595 DEBUG:boto:Token: None 2024-04-16T18:28:47.595 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yxHJBYP5SUhXOnfGWS/elNz6uXo= 2024-04-16T18:28:47.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yxHJBYP5SUhXOnfGWS/elNz6uXo=', 'Content-Length': '0'} 2024-04-16T18:28:47.597 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d349e7f0e510c7e1-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.598 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.598 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.598 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.598 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.598 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.598 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.598 DEBUG:boto:Data: 2024-04-16T18:28:47.598 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.598 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.598 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.598 DEBUG:boto:Params: {} 2024-04-16T18:28:47.599 DEBUG:boto:Token: None 2024-04-16T18:28:47.599 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yxHJBYP5SUhXOnfGWS/elNz6uXo= 2024-04-16T18:28:47.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yxHJBYP5SUhXOnfGWS/elNz6uXo=', 'Content-Length': '0'} 2024-04-16T18:28:47.601 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff5a40f9ff5a8e53-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.601 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:28:47.601 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.601 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.601 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.601 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.601 DEBUG:boto:Method: GET 2024-04-16T18:28:47.602 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.602 DEBUG:boto:Data: 2024-04-16T18:28:47.602 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.602 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.602 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.602 DEBUG:boto:Params: {} 2024-04-16T18:28:47.602 DEBUG:boto:Token: None 2024-04-16T18:28:47.602 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.602 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk= 2024-04-16T18:28:47.602 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk=', 'Content-Length': '0'} 2024-04-16T18:28:47.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000058990e0e6e70dd2a-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.646 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.646 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.646 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.647 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.647 DEBUG:boto:Method: GET 2024-04-16T18:28:47.647 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.647 DEBUG:boto:Data: 2024-04-16T18:28:47.647 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.647 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.647 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.647 DEBUG:boto:Params: {} 2024-04-16T18:28:47.647 DEBUG:boto:Token: None 2024-04-16T18:28:47.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:28:47.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk= 2024-04-16T18:28:47.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YJKuX/+QxpiqtFr7eLe1NxbQUDk=', 'Content-Length': '0'} 2024-04-16T18:28:47.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9c728e19d804314-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.650 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.650 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.650 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.650 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.650 DEBUG:boto:Method: GET 2024-04-16T18:28:47.650 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.650 DEBUG:boto:Data: 2024-04-16T18:28:47.650 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.650 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.650 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.651 DEBUG:boto:Params: {} 2024-04-16T18:28:47.651 DEBUG:boto:Token: None 2024-04-16T18:28:47.651 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.653 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000644924d5eaff9552-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.694 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.695 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.695 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.695 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.695 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.695 DEBUG:boto:Method: GET 2024-04-16T18:28:47.695 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.695 DEBUG:boto:Data: 2024-04-16T18:28:47.695 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.695 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.695 DEBUG:boto:Params: {} 2024-04-16T18:28:47.696 DEBUG:boto:Token: None 2024-04-16T18:28:47.696 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.699 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aed650a6b53b4427-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.699 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.700 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.700 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.700 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.700 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:28:47.700 DEBUG:boto:Data: 2024-04-16T18:28:47.700 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.700 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.700 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.700 DEBUG:boto:Params: {} 2024-04-16T18:28:47.701 DEBUG:boto:Token: None 2024-04-16T18:28:47.701 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33 2024-04-16T18:28:47.701 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9RiOcq6QD3V4RMCe2uMgbwrp+zg= 2024-04-16T18:28:47.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9RiOcq6QD3V4RMCe2uMgbwrp+zg=', 'Content-Length': '0'} 2024-04-16T18:28:47.703 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cdeebbacb10e242-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.703 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.703 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.703 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.703 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:28:47.703 DEBUG:boto:Data: 2024-04-16T18:28:47.704 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.704 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.704 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.704 DEBUG:boto:Params: {} 2024-04-16T18:28:47.704 DEBUG:boto:Token: None 2024-04-16T18:28:47.704 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33 2024-04-16T18:28:47.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9RiOcq6QD3V4RMCe2uMgbwrp+zg= 2024-04-16T18:28:47.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9RiOcq6QD3V4RMCe2uMgbwrp+zg=', 'Content-Length': '0'} 2024-04-16T18:28:47.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dafa24ddcd2fb346-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.706 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:28:47.706 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.707 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.707 DEBUG:boto:Method: GET 2024-04-16T18:28:47.707 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:28:47.707 DEBUG:boto:Data: 2024-04-16T18:28:47.707 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.707 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.707 DEBUG:boto:Params: {} 2024-04-16T18:28:47.707 DEBUG:boto:Token: None 2024-04-16T18:28:47.707 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33 2024-04-16T18:28:47.707 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RCeR2ABlnc0NQEOuBa+APZ1tbN0= 2024-04-16T18:28:47.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RCeR2ABlnc0NQEOuBa+APZ1tbN0=', 'Content-Length': '0'} 2024-04-16T18:28:47.709 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d6265853864b6d2-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.750 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:28:47.751 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:28:47.751 DEBUG:boto:Method: GET 2024-04-16T18:28:47.751 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:28:47.751 DEBUG:boto:Data: 2024-04-16T18:28:47.751 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.751 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.751 DEBUG:boto:Params: {} 2024-04-16T18:28:47.751 DEBUG:boto:Token: None 2024-04-16T18:28:47.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj33 2024-04-16T18:28:47.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RCeR2ABlnc0NQEOuBa+APZ1tbN0= 2024-04-16T18:28:47.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RCeR2ABlnc0NQEOuBa+APZ1tbN0=', 'Content-Length': '0'} 2024-04-16T18:28:47.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029cdef4e76fd065e-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.754 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.754 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.754 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.754 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.755 DEBUG:boto:Method: GET 2024-04-16T18:28:47.755 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.755 DEBUG:boto:Data: 2024-04-16T18:28:47.755 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.755 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.755 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.755 DEBUG:boto:Params: {} 2024-04-16T18:28:47.755 DEBUG:boto:Token: None 2024-04-16T18:28:47.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.758 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000274c6845f572a1d7-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.798 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.799 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.799 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.799 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.799 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.799 DEBUG:boto:Method: GET 2024-04-16T18:28:47.799 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:28:47.799 DEBUG:boto:Data: 2024-04-16T18:28:47.799 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.799 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.799 DEBUG:boto:Params: {} 2024-04-16T18:28:47.800 DEBUG:boto:Token: None 2024-04-16T18:28:47.800 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.803 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d01bb6e1569ba7a3-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.803 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.803 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:28:47.803 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.804 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.804 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.804 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.804 DEBUG:boto:Method: GET 2024-04-16T18:28:47.804 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.804 DEBUG:boto:Data: 2024-04-16T18:28:47.804 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.804 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.804 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.804 DEBUG:boto:Params: {} 2024-04-16T18:28:47.804 DEBUG:boto:Token: None 2024-04-16T18:28:47.805 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.805 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM= 2024-04-16T18:28:47.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM=', 'Content-Length': '0'} 2024-04-16T18:28:47.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033240b7cba4d00e3-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.850 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.850 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.851 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.851 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.851 DEBUG:boto:Method: GET 2024-04-16T18:28:47.851 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.851 DEBUG:boto:Data: 2024-04-16T18:28:47.851 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.851 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.851 DEBUG:boto:Params: {} 2024-04-16T18:28:47.851 DEBUG:boto:Token: None 2024-04-16T18:28:47.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM= 2024-04-16T18:28:47.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM=', 'Content-Length': '0'} 2024-04-16T18:28:47.854 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9e4673cbcdd2c90-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.854 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.854 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.854 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.854 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.854 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.854 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.855 DEBUG:boto:Data: 2024-04-16T18:28:47.855 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.855 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.855 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.855 DEBUG:boto:Params: {} 2024-04-16T18:28:47.855 DEBUG:boto:Token: None 2024-04-16T18:28:47.855 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HfAesffNBibzqbF1iF9MmOO5Ge4= 2024-04-16T18:28:47.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HfAesffNBibzqbF1iF9MmOO5Ge4=', 'Content-Length': '0'} 2024-04-16T18:28:47.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001548435aa15b1f23-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.857 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.857 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.858 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.858 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.858 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.858 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.858 DEBUG:boto:Data: 2024-04-16T18:28:47.858 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.858 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.858 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.858 DEBUG:boto:Params: {} 2024-04-16T18:28:47.858 DEBUG:boto:Token: None 2024-04-16T18:28:47.859 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.859 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HfAesffNBibzqbF1iF9MmOO5Ge4= 2024-04-16T18:28:47.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HfAesffNBibzqbF1iF9MmOO5Ge4=', 'Content-Length': '0'} 2024-04-16T18:28:47.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001950b915200bdc55-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:28:47.861 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.861 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.861 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.861 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.861 DEBUG:boto:Method: GET 2024-04-16T18:28:47.861 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.861 DEBUG:boto:Data: 2024-04-16T18:28:47.861 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.862 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.862 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.862 DEBUG:boto:Params: {} 2024-04-16T18:28:47.862 DEBUG:boto:Token: None 2024-04-16T18:28:47.862 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.862 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM= 2024-04-16T18:28:47.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM=', 'Content-Length': '0'} 2024-04-16T18:28:47.864 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000610c0d0838288819-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.906 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.906 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.906 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.907 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.907 DEBUG:boto:Method: GET 2024-04-16T18:28:47.907 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.907 DEBUG:boto:Data: 2024-04-16T18:28:47.907 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.907 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.907 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.907 DEBUG:boto:Params: {} 2024-04-16T18:28:47.907 DEBUG:boto:Token: None 2024-04-16T18:28:47.907 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:28:47.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM= 2024-04-16T18:28:47.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqBYXnQVr8/OqTOp3U2QEuDA/lM=', 'Content-Length': '0'} 2024-04-16T18:28:47.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068dbb4a8bcf62601-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.910 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.910 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.910 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:47.910 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:47.910 DEBUG:boto:Method: GET 2024-04-16T18:28:47.910 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:28:47.910 DEBUG:boto:Data: 2024-04-16T18:28:47.910 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.910 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.910 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.910 DEBUG:boto:Params: {} 2024-04-16T18:28:47.911 DEBUG:boto:Token: None 2024-04-16T18:28:47.911 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.911 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.913 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a331458b62fd670-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.954 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.955 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:47.955 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:47.955 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:47.955 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:47.955 DEBUG:boto:Method: GET 2024-04-16T18:28:47.955 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:28:47.955 DEBUG:boto:Data: 2024-04-16T18:28:47.955 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.955 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.955 DEBUG:boto:Params: {} 2024-04-16T18:28:47.956 DEBUG:boto:Token: None 2024-04-16T18:28:47.956 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/ 2024-04-16T18:28:47.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g= 2024-04-16T18:28:47.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6xC0oSNzx6+TyO8jFLKnvTE/7g=', 'Content-Length': '0'} 2024-04-16T18:28:47.959 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf797ddd04898c1f-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.959 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:47.959 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.960 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.960 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.960 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:28:47.960 DEBUG:boto:Data: 2024-04-16T18:28:47.960 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.960 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.960 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.960 DEBUG:boto:Params: {} 2024-04-16T18:28:47.960 DEBUG:boto:Token: None 2024-04-16T18:28:47.960 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34 2024-04-16T18:28:47.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TFqvVAhbXV3lBscrzeWPNQJS934= 2024-04-16T18:28:47.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TFqvVAhbXV3lBscrzeWPNQJS934=', 'Content-Length': '0'} 2024-04-16T18:28:47.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9209e57347756e0-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.963 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.963 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.963 DEBUG:boto:Method: HEAD 2024-04-16T18:28:47.963 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:28:47.963 DEBUG:boto:Data: 2024-04-16T18:28:47.963 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.964 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:47.964 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.964 DEBUG:boto:Params: {} 2024-04-16T18:28:47.964 DEBUG:boto:Token: None 2024-04-16T18:28:47.964 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34 2024-04-16T18:28:47.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TFqvVAhbXV3lBscrzeWPNQJS934= 2024-04-16T18:28:47.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TFqvVAhbXV3lBscrzeWPNQJS934=', 'Content-Length': '0'} 2024-04-16T18:28:47.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8891ddf61eebb2b-00661ec35f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:47.966 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:28:47.966 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:47.967 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:47.967 DEBUG:boto:Method: GET 2024-04-16T18:28:47.967 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:28:47.967 DEBUG:boto:Data: 2024-04-16T18:28:47.967 DEBUG:boto:Headers: {} 2024-04-16T18:28:47.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:47.967 DEBUG:boto:Port: 8000 2024-04-16T18:28:47.967 DEBUG:boto:Params: {} 2024-04-16T18:28:47.967 DEBUG:boto:Token: None 2024-04-16T18:28:47.967 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:47 GMT /cjqttm-52/obj34 2024-04-16T18:28:47.967 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9UZaHIEuTupUJjlM9/E+nLvgs94= 2024-04-16T18:28:47.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:47 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9UZaHIEuTupUJjlM9/E+nLvgs94=', 'Content-Length': '0'} 2024-04-16T18:28:47.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe7171ec9a1b0ca3-00661ec35f-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:47 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.014 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:28:48.014 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:28:48.015 DEBUG:boto:Method: GET 2024-04-16T18:28:48.015 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:28:48.015 DEBUG:boto:Data: 2024-04-16T18:28:48.015 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.015 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.015 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.015 DEBUG:boto:Params: {} 2024-04-16T18:28:48.015 DEBUG:boto:Token: None 2024-04-16T18:28:48.015 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj34 2024-04-16T18:28:48.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZguJp1YwTTqS8A/z+Orh+CjqcyI= 2024-04-16T18:28:48.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZguJp1YwTTqS8A/z+Orh+CjqcyI=', 'Content-Length': '0'} 2024-04-16T18:28:48.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009895d7f9c8d7c452-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.018 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.018 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.018 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:48.018 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:48.019 DEBUG:boto:Method: GET 2024-04-16T18:28:48.019 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:28:48.019 DEBUG:boto:Data: 2024-04-16T18:28:48.019 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.019 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.019 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.019 DEBUG:boto:Params: {} 2024-04-16T18:28:48.019 DEBUG:boto:Token: None 2024-04-16T18:28:48.019 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.019 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.022 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004118981166edf147-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.062 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.063 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.063 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.063 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:48.063 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:28:48.063 DEBUG:boto:Method: GET 2024-04-16T18:28:48.063 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:28:48.063 DEBUG:boto:Data: 2024-04-16T18:28:48.063 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.063 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.063 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.063 DEBUG:boto:Params: {} 2024-04-16T18:28:48.064 DEBUG:boto:Token: None 2024-04-16T18:28:48.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000027c44efa7329afff-00661ec360-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.068 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.068 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:28:48.068 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.068 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.068 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.068 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.068 DEBUG:boto:Method: GET 2024-04-16T18:28:48.069 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.069 DEBUG:boto:Data: 2024-04-16T18:28:48.069 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.069 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.069 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.069 DEBUG:boto:Params: {} 2024-04-16T18:28:48.069 DEBUG:boto:Token: None 2024-04-16T18:28:48.069 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M= 2024-04-16T18:28:48.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M=', 'Content-Length': '0'} 2024-04-16T18:28:48.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:28:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d1a5ebbc81aaa61-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.114 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.115 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.115 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.115 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.115 DEBUG:boto:Method: GET 2024-04-16T18:28:48.115 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.115 DEBUG:boto:Data: 2024-04-16T18:28:48.115 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.115 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.115 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.115 DEBUG:boto:Params: {} 2024-04-16T18:28:48.115 DEBUG:boto:Token: None 2024-04-16T18:28:48.116 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M= 2024-04-16T18:28:48.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M=', 'Content-Length': '0'} 2024-04-16T18:28:48.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b852f0b539293f39-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.118 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.118 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.118 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.118 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.118 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.119 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.119 DEBUG:boto:Data: 2024-04-16T18:28:48.119 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.119 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.119 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.119 DEBUG:boto:Params: {} 2024-04-16T18:28:48.119 DEBUG:boto:Token: None 2024-04-16T18:28:48.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lU7zxOSn3MvYqL27K0pqBpgo2fs= 2024-04-16T18:28:48.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lU7zxOSn3MvYqL27K0pqBpgo2fs=', 'Content-Length': '0'} 2024-04-16T18:28:48.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:28:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c5b809765430dce-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.121 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.122 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.122 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.122 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.122 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.122 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.122 DEBUG:boto:Data: 2024-04-16T18:28:48.122 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.122 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.122 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.122 DEBUG:boto:Params: {} 2024-04-16T18:28:48.122 DEBUG:boto:Token: None 2024-04-16T18:28:48.123 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lU7zxOSn3MvYqL27K0pqBpgo2fs= 2024-04-16T18:28:48.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lU7zxOSn3MvYqL27K0pqBpgo2fs=', 'Content-Length': '0'} 2024-04-16T18:28:48.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000088f89e2ed0d4f0c-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.125 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:28:48.125 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.125 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.125 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.126 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.126 DEBUG:boto:Method: GET 2024-04-16T18:28:48.126 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.126 DEBUG:boto:Data: 2024-04-16T18:28:48.126 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.126 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.126 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.126 DEBUG:boto:Params: {} 2024-04-16T18:28:48.126 DEBUG:boto:Token: None 2024-04-16T18:28:48.126 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M= 2024-04-16T18:28:48.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M=', 'Content-Length': '0'} 2024-04-16T18:28:48.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:28:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4bedcc76a29b559-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.174 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.174 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.175 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.175 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.175 DEBUG:boto:Method: GET 2024-04-16T18:28:48.175 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.175 DEBUG:boto:Data: 2024-04-16T18:28:48.175 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.175 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.175 DEBUG:boto:Params: {} 2024-04-16T18:28:48.175 DEBUG:boto:Token: None 2024-04-16T18:28:48.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:28:48.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M= 2024-04-16T18:28:48.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gbMFZVjf+jM/Pf1eTWMdkb70L0M=', 'Content-Length': '0'} 2024-04-16T18:28:48.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c75e4e93637b8e20-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.178 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.178 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.178 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.178 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.178 DEBUG:boto:Method: GET 2024-04-16T18:28:48.178 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.178 DEBUG:boto:Data: 2024-04-16T18:28:48.178 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.179 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.179 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.179 DEBUG:boto:Params: {} 2024-04-16T18:28:48.179 DEBUG:boto:Token: None 2024-04-16T18:28:48.179 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.181 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081c6b6deb3070879-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.222 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.223 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.223 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.223 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.223 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.223 DEBUG:boto:Method: GET 2024-04-16T18:28:48.223 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.223 DEBUG:boto:Data: 2024-04-16T18:28:48.223 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.223 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.223 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.223 DEBUG:boto:Params: {} 2024-04-16T18:28:48.223 DEBUG:boto:Token: None 2024-04-16T18:28:48.224 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.224 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.227 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000833c2bc939ced541-00661ec360-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.227 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.228 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.228 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.228 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.228 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:28:48.228 DEBUG:boto:Data: 2024-04-16T18:28:48.228 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.228 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.228 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.228 DEBUG:boto:Params: {} 2024-04-16T18:28:48.228 DEBUG:boto:Token: None 2024-04-16T18:28:48.229 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37 2024-04-16T18:28:48.229 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hos9CppCIjEbG9xMShDtUkCgUQE= 2024-04-16T18:28:48.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hos9CppCIjEbG9xMShDtUkCgUQE=', 'Content-Length': '0'} 2024-04-16T18:28:48.231 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:28:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e33b200c708122ae-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.231 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.231 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.231 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.231 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:28:48.231 DEBUG:boto:Data: 2024-04-16T18:28:48.231 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.232 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.232 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.232 DEBUG:boto:Params: {} 2024-04-16T18:28:48.232 DEBUG:boto:Token: None 2024-04-16T18:28:48.232 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37 2024-04-16T18:28:48.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hos9CppCIjEbG9xMShDtUkCgUQE= 2024-04-16T18:28:48.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hos9CppCIjEbG9xMShDtUkCgUQE=', 'Content-Length': '0'} 2024-04-16T18:28:48.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033f8697823c79d4a-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.234 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:28:48.234 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.234 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.235 DEBUG:boto:Method: GET 2024-04-16T18:28:48.235 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:28:48.235 DEBUG:boto:Data: 2024-04-16T18:28:48.235 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.235 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.235 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.235 DEBUG:boto:Params: {} 2024-04-16T18:28:48.235 DEBUG:boto:Token: None 2024-04-16T18:28:48.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37 2024-04-16T18:28:48.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wIloEfb0tILdbbXNJdfzMzNTx6E= 2024-04-16T18:28:48.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wIloEfb0tILdbbXNJdfzMzNTx6E=', 'Content-Length': '0'} 2024-04-16T18:28:48.237 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:28:41 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcfecd4304b36d6a-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.278 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:28:48.278 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:28:48.279 DEBUG:boto:Method: GET 2024-04-16T18:28:48.279 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:28:48.279 DEBUG:boto:Data: 2024-04-16T18:28:48.279 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.279 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.279 DEBUG:boto:Params: {} 2024-04-16T18:28:48.279 DEBUG:boto:Token: None 2024-04-16T18:28:48.279 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj37 2024-04-16T18:28:48.279 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wIloEfb0tILdbbXNJdfzMzNTx6E= 2024-04-16T18:28:48.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wIloEfb0tILdbbXNJdfzMzNTx6E=', 'Content-Length': '0'} 2024-04-16T18:28:48.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d43343ab12757a94-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.282 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.282 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.282 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.282 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.282 DEBUG:boto:Method: GET 2024-04-16T18:28:48.282 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.282 DEBUG:boto:Data: 2024-04-16T18:28:48.282 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.283 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.283 DEBUG:boto:Params: {} 2024-04-16T18:28:48.283 DEBUG:boto:Token: None 2024-04-16T18:28:48.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bed8fe3db4d608df-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.326 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.327 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.327 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.327 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.327 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.327 DEBUG:boto:Method: GET 2024-04-16T18:28:48.327 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:28:48.327 DEBUG:boto:Data: 2024-04-16T18:28:48.327 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.327 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.327 DEBUG:boto:Params: {} 2024-04-16T18:28:48.328 DEBUG:boto:Token: None 2024-04-16T18:28:48.328 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.331 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004833c1e15b2d7eb1-00661ec360-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.332 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.332 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:28:48.332 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.332 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.332 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.332 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.332 DEBUG:boto:Method: GET 2024-04-16T18:28:48.332 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.333 DEBUG:boto:Data: 2024-04-16T18:28:48.333 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.333 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.333 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.333 DEBUG:boto:Params: {} 2024-04-16T18:28:48.333 DEBUG:boto:Token: None 2024-04-16T18:28:48.333 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.333 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28= 2024-04-16T18:28:48.333 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28=', 'Content-Length': '0'} 2024-04-16T18:28:48.335 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031185696a558c0a8-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.378 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.378 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.378 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.379 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.379 DEBUG:boto:Method: GET 2024-04-16T18:28:48.379 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.379 DEBUG:boto:Data: 2024-04-16T18:28:48.379 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.379 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.379 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.379 DEBUG:boto:Params: {} 2024-04-16T18:28:48.379 DEBUG:boto:Token: None 2024-04-16T18:28:48.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28= 2024-04-16T18:28:48.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28=', 'Content-Length': '0'} 2024-04-16T18:28:48.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002dac20b4487fcc1-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.382 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.382 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.382 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.382 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.382 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.382 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.382 DEBUG:boto:Data: 2024-04-16T18:28:48.383 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.383 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.383 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.383 DEBUG:boto:Params: {} 2024-04-16T18:28:48.383 DEBUG:boto:Token: None 2024-04-16T18:28:48.383 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q1jabk2dZM5Iogh/wJEyOpjFRzw= 2024-04-16T18:28:48.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q1jabk2dZM5Iogh/wJEyOpjFRzw=', 'Content-Length': '0'} 2024-04-16T18:28:48.385 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000972d54b4e57581ee-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.385 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.385 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.385 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.385 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.386 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.386 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.386 DEBUG:boto:Data: 2024-04-16T18:28:48.386 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.386 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.386 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.386 DEBUG:boto:Params: {} 2024-04-16T18:28:48.386 DEBUG:boto:Token: None 2024-04-16T18:28:48.386 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:q1jabk2dZM5Iogh/wJEyOpjFRzw= 2024-04-16T18:28:48.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:q1jabk2dZM5Iogh/wJEyOpjFRzw=', 'Content-Length': '0'} 2024-04-16T18:28:48.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093644961ec8cbf0e-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:28:48.389 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.389 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.389 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.389 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.389 DEBUG:boto:Method: GET 2024-04-16T18:28:48.389 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.389 DEBUG:boto:Data: 2024-04-16T18:28:48.389 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.390 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.390 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.390 DEBUG:boto:Params: {} 2024-04-16T18:28:48.390 DEBUG:boto:Token: None 2024-04-16T18:28:48.390 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.390 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28= 2024-04-16T18:28:48.390 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28=', 'Content-Length': '0'} 2024-04-16T18:28:48.392 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d6113c88b31ae04-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.434 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.434 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.434 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.435 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.435 DEBUG:boto:Method: GET 2024-04-16T18:28:48.435 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.435 DEBUG:boto:Data: 2024-04-16T18:28:48.435 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.435 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.435 DEBUG:boto:Params: {} 2024-04-16T18:28:48.435 DEBUG:boto:Token: None 2024-04-16T18:28:48.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:28:48.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28= 2024-04-16T18:28:48.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LvqW7DrCS2mtvl+bo0fQsSAUP28=', 'Content-Length': '0'} 2024-04-16T18:28:48.438 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7591e063a231cb3-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.438 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.438 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.438 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.438 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.438 DEBUG:boto:Method: GET 2024-04-16T18:28:48.438 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.439 DEBUG:boto:Data: 2024-04-16T18:28:48.439 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.439 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.439 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.439 DEBUG:boto:Params: {} 2024-04-16T18:28:48.439 DEBUG:boto:Token: None 2024-04-16T18:28:48.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.441 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000080a8c7d70f0f18a9-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.482 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.483 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.483 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.483 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.483 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.483 DEBUG:boto:Method: GET 2024-04-16T18:28:48.483 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.483 DEBUG:boto:Data: 2024-04-16T18:28:48.483 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.483 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.484 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.484 DEBUG:boto:Params: {} 2024-04-16T18:28:48.484 DEBUG:boto:Token: None 2024-04-16T18:28:48.484 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.487 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000576c40672a40f4b0-00661ec360-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.488 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.488 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.488 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.488 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.488 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:28:48.488 DEBUG:boto:Data: 2024-04-16T18:28:48.488 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.489 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.489 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.489 DEBUG:boto:Params: {} 2024-04-16T18:28:48.489 DEBUG:boto:Token: None 2024-04-16T18:28:48.489 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38 2024-04-16T18:28:48.489 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bVjzisv/EXGiG1MqejeI48xJo84= 2024-04-16T18:28:48.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bVjzisv/EXGiG1MqejeI48xJo84=', 'Content-Length': '0'} 2024-04-16T18:28:48.491 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a53111975c321147-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.491 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.491 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.492 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.492 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:28:48.492 DEBUG:boto:Data: 2024-04-16T18:28:48.492 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.492 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.492 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.492 DEBUG:boto:Params: {} 2024-04-16T18:28:48.492 DEBUG:boto:Token: None 2024-04-16T18:28:48.492 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38 2024-04-16T18:28:48.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bVjzisv/EXGiG1MqejeI48xJo84= 2024-04-16T18:28:48.493 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bVjzisv/EXGiG1MqejeI48xJo84=', 'Content-Length': '0'} 2024-04-16T18:28:48.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4d52193b5cce566-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.494 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:28:48.494 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.495 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.495 DEBUG:boto:Method: GET 2024-04-16T18:28:48.495 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:28:48.495 DEBUG:boto:Data: 2024-04-16T18:28:48.495 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.495 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.495 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.495 DEBUG:boto:Params: {} 2024-04-16T18:28:48.495 DEBUG:boto:Token: None 2024-04-16T18:28:48.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38 2024-04-16T18:28:48.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BgjMuLsC6iYCmoCF4aM6rfuHK9Q= 2024-04-16T18:28:48.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BgjMuLsC6iYCmoCF4aM6rfuHK9Q=', 'Content-Length': '0'} 2024-04-16T18:28:48.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7c57e7d0ed44701-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.538 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:28:48.538 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:28:48.539 DEBUG:boto:Method: GET 2024-04-16T18:28:48.539 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:28:48.539 DEBUG:boto:Data: 2024-04-16T18:28:48.539 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.539 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.539 DEBUG:boto:Params: {} 2024-04-16T18:28:48.539 DEBUG:boto:Token: None 2024-04-16T18:28:48.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj38 2024-04-16T18:28:48.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BgjMuLsC6iYCmoCF4aM6rfuHK9Q= 2024-04-16T18:28:48.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BgjMuLsC6iYCmoCF4aM6rfuHK9Q=', 'Content-Length': '0'} 2024-04-16T18:28:48.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f4eb11df161c14d1-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.542 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.542 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.542 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.542 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.542 DEBUG:boto:Method: GET 2024-04-16T18:28:48.542 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.542 DEBUG:boto:Data: 2024-04-16T18:28:48.542 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.543 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.543 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.543 DEBUG:boto:Params: {} 2024-04-16T18:28:48.543 DEBUG:boto:Token: None 2024-04-16T18:28:48.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.545 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c54df233eb9207a-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.586 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.587 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.587 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.587 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.587 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.587 DEBUG:boto:Method: GET 2024-04-16T18:28:48.587 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:28:48.587 DEBUG:boto:Data: 2024-04-16T18:28:48.587 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.587 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.587 DEBUG:boto:Params: {} 2024-04-16T18:28:48.588 DEBUG:boto:Token: None 2024-04-16T18:28:48.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.591 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b58326f914dd7659-00661ec360-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.591 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:28:48.592 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.592 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.592 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.592 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.592 DEBUG:boto:Method: GET 2024-04-16T18:28:48.592 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.592 DEBUG:boto:Data: 2024-04-16T18:28:48.592 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.592 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.593 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.593 DEBUG:boto:Params: {} 2024-04-16T18:28:48.593 DEBUG:boto:Token: None 2024-04-16T18:28:48.593 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.593 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y= 2024-04-16T18:28:48.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y=', 'Content-Length': '0'} 2024-04-16T18:28:48.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe398f6f710d5ba2-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.638 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.638 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.639 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.639 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.639 DEBUG:boto:Method: GET 2024-04-16T18:28:48.639 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.639 DEBUG:boto:Data: 2024-04-16T18:28:48.639 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.639 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.639 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.639 DEBUG:boto:Params: {} 2024-04-16T18:28:48.639 DEBUG:boto:Token: None 2024-04-16T18:28:48.640 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.640 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y= 2024-04-16T18:28:48.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y=', 'Content-Length': '0'} 2024-04-16T18:28:48.642 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6a0411d2ba7617c-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.642 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.642 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.642 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.642 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.642 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.642 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.642 DEBUG:boto:Data: 2024-04-16T18:28:48.643 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.643 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.643 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.643 DEBUG:boto:Params: {} 2024-04-16T18:28:48.643 DEBUG:boto:Token: None 2024-04-16T18:28:48.643 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gH1KpqIfK79WuHnNKKKKS8TABlM= 2024-04-16T18:28:48.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gH1KpqIfK79WuHnNKKKKS8TABlM=', 'Content-Length': '0'} 2024-04-16T18:28:48.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033416aea4a9f9f28-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.645 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.645 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.645 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.645 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.645 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.645 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.645 DEBUG:boto:Data: 2024-04-16T18:28:48.646 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.646 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.646 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.646 DEBUG:boto:Params: {} 2024-04-16T18:28:48.646 DEBUG:boto:Token: None 2024-04-16T18:28:48.646 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.646 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gH1KpqIfK79WuHnNKKKKS8TABlM= 2024-04-16T18:28:48.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gH1KpqIfK79WuHnNKKKKS8TABlM=', 'Content-Length': '0'} 2024-04-16T18:28:48.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c5115222d432f5b-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:28:48.648 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.649 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.649 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.649 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.649 DEBUG:boto:Method: GET 2024-04-16T18:28:48.649 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.649 DEBUG:boto:Data: 2024-04-16T18:28:48.649 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.649 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.649 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.649 DEBUG:boto:Params: {} 2024-04-16T18:28:48.649 DEBUG:boto:Token: None 2024-04-16T18:28:48.650 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.650 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y= 2024-04-16T18:28:48.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y=', 'Content-Length': '0'} 2024-04-16T18:28:48.651 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005f74444c1691111-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.694 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.694 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.695 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.695 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.695 DEBUG:boto:Method: GET 2024-04-16T18:28:48.695 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.695 DEBUG:boto:Data: 2024-04-16T18:28:48.695 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.695 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.695 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.695 DEBUG:boto:Params: {} 2024-04-16T18:28:48.695 DEBUG:boto:Token: None 2024-04-16T18:28:48.696 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:28:48.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y= 2024-04-16T18:28:48.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uSaGmzl8voLx57iWSYVDq1ioh8Y=', 'Content-Length': '0'} 2024-04-16T18:28:48.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f939e09228a9b3a0-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.698 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.698 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.698 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.698 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.698 DEBUG:boto:Method: GET 2024-04-16T18:28:48.698 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.698 DEBUG:boto:Data: 2024-04-16T18:28:48.698 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.699 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.699 DEBUG:boto:Params: {} 2024-04-16T18:28:48.699 DEBUG:boto:Token: None 2024-04-16T18:28:48.699 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.699 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.699 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.702 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ed299bce58c57a98-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.746 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.747 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.747 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.747 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.747 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.747 DEBUG:boto:Method: GET 2024-04-16T18:28:48.747 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.747 DEBUG:boto:Data: 2024-04-16T18:28:48.747 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.748 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.748 DEBUG:boto:Params: {} 2024-04-16T18:28:48.748 DEBUG:boto:Token: None 2024-04-16T18:28:48.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.752 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4b1f3760b092cc4-00661ec360-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.752 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.752 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.752 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.752 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.753 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:28:48.753 DEBUG:boto:Data: 2024-04-16T18:28:48.753 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.753 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.753 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.753 DEBUG:boto:Params: {} 2024-04-16T18:28:48.753 DEBUG:boto:Token: None 2024-04-16T18:28:48.753 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44 2024-04-16T18:28:48.753 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hEr73ReE+nntXu34DOVqI285zb4= 2024-04-16T18:28:48.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hEr73ReE+nntXu34DOVqI285zb4=', 'Content-Length': '0'} 2024-04-16T18:28:48.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001901853f81a05e27-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.755 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.755 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.756 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.756 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:28:48.756 DEBUG:boto:Data: 2024-04-16T18:28:48.756 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.756 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.756 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.756 DEBUG:boto:Params: {} 2024-04-16T18:28:48.756 DEBUG:boto:Token: None 2024-04-16T18:28:48.756 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44 2024-04-16T18:28:48.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hEr73ReE+nntXu34DOVqI285zb4= 2024-04-16T18:28:48.757 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hEr73ReE+nntXu34DOVqI285zb4=', 'Content-Length': '0'} 2024-04-16T18:28:48.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000962098161344f35-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:28:48.759 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.759 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.759 DEBUG:boto:Method: GET 2024-04-16T18:28:48.759 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:28:48.759 DEBUG:boto:Data: 2024-04-16T18:28:48.759 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.759 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.759 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.759 DEBUG:boto:Params: {} 2024-04-16T18:28:48.759 DEBUG:boto:Token: None 2024-04-16T18:28:48.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44 2024-04-16T18:28:48.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8atuWNm+8qY+c3Svr2rlREkDGTg= 2024-04-16T18:28:48.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8atuWNm+8qY+c3Svr2rlREkDGTg=', 'Content-Length': '0'} 2024-04-16T18:28:48.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dae5613fa7154d85-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.806 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:28:48.806 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:28:48.807 DEBUG:boto:Method: GET 2024-04-16T18:28:48.807 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:28:48.807 DEBUG:boto:Data: 2024-04-16T18:28:48.807 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.807 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.807 DEBUG:boto:Params: {} 2024-04-16T18:28:48.807 DEBUG:boto:Token: None 2024-04-16T18:28:48.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj44 2024-04-16T18:28:48.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8atuWNm+8qY+c3Svr2rlREkDGTg= 2024-04-16T18:28:48.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8atuWNm+8qY+c3Svr2rlREkDGTg=', 'Content-Length': '0'} 2024-04-16T18:28:48.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004014fdf54407937-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.810 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.810 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.810 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.810 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.810 DEBUG:boto:Method: GET 2024-04-16T18:28:48.810 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.810 DEBUG:boto:Data: 2024-04-16T18:28:48.811 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.811 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.811 DEBUG:boto:Params: {} 2024-04-16T18:28:48.811 DEBUG:boto:Token: None 2024-04-16T18:28:48.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.813 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ebcd6332432b6fa-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.854 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.855 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.855 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.855 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.855 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.855 DEBUG:boto:Method: GET 2024-04-16T18:28:48.855 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:28:48.855 DEBUG:boto:Data: 2024-04-16T18:28:48.855 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.855 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.855 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.856 DEBUG:boto:Params: {} 2024-04-16T18:28:48.856 DEBUG:boto:Token: None 2024-04-16T18:28:48.856 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.856 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.857 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.860 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c997f9ab0ad4deb-00661ec360-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.860 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:48.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:28:48.861 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:48.861 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:48.861 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.861 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.861 DEBUG:boto:Method: GET 2024-04-16T18:28:48.861 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.861 DEBUG:boto:Data: 2024-04-16T18:28:48.862 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.862 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.862 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.862 DEBUG:boto:Params: {} 2024-04-16T18:28:48.862 DEBUG:boto:Token: None 2024-04-16T18:28:48.863 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4= 2024-04-16T18:28:48.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4=', 'Content-Length': '0'} 2024-04-16T18:28:48.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000504e3f2bc0f31fb0-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.906 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:48.906 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:48.907 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.907 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.907 DEBUG:boto:Method: GET 2024-04-16T18:28:48.907 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.907 DEBUG:boto:Data: 2024-04-16T18:28:48.907 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.907 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.907 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.907 DEBUG:boto:Params: {} 2024-04-16T18:28:48.907 DEBUG:boto:Token: None 2024-04-16T18:28:48.908 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4= 2024-04-16T18:28:48.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4=', 'Content-Length': '0'} 2024-04-16T18:28:48.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e6693d7c74fabdd-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.910 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:48.911 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:48.911 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.911 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.911 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.911 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.911 DEBUG:boto:Data: 2024-04-16T18:28:48.911 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.911 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.911 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.911 DEBUG:boto:Params: {} 2024-04-16T18:28:48.911 DEBUG:boto:Token: None 2024-04-16T18:28:48.912 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fJXoJkGvhFYUGtwvn6sswOOmwis= 2024-04-16T18:28:48.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fJXoJkGvhFYUGtwvn6sswOOmwis=', 'Content-Length': '0'} 2024-04-16T18:28:48.914 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f52d3360805f0904-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.914 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:48.914 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:48.914 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.914 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.915 DEBUG:boto:Method: HEAD 2024-04-16T18:28:48.915 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.915 DEBUG:boto:Data: 2024-04-16T18:28:48.915 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.915 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.915 DEBUG:boto:Params: {} 2024-04-16T18:28:48.915 DEBUG:boto:Token: None 2024-04-16T18:28:48.915 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.915 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fJXoJkGvhFYUGtwvn6sswOOmwis= 2024-04-16T18:28:48.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fJXoJkGvhFYUGtwvn6sswOOmwis=', 'Content-Length': '0'} 2024-04-16T18:28:48.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000917739290eb8e19a-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.918 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:28:48.918 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:48.918 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:48.918 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.918 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.918 DEBUG:boto:Method: GET 2024-04-16T18:28:48.919 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.919 DEBUG:boto:Data: 2024-04-16T18:28:48.919 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.919 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.919 DEBUG:boto:Params: {} 2024-04-16T18:28:48.919 DEBUG:boto:Token: None 2024-04-16T18:28:48.919 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4= 2024-04-16T18:28:48.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4=', 'Content-Length': '0'} 2024-04-16T18:28:48.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038c7c5a023e0ff6f-00661ec360-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.962 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:48.962 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:48.963 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.963 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.963 DEBUG:boto:Method: GET 2024-04-16T18:28:48.963 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.963 DEBUG:boto:Data: 2024-04-16T18:28:48.963 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.963 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:48.963 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.963 DEBUG:boto:Params: {} 2024-04-16T18:28:48.963 DEBUG:boto:Token: None 2024-04-16T18:28:48.963 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:28:48.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4= 2024-04-16T18:28:48.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6E3AiRW7TefbU0YKbVNmaMZc4d4=', 'Content-Length': '0'} 2024-04-16T18:28:48.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b9c5ef45fcaddbc-00661ec360-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:48.966 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:48.966 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:48.966 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:48.966 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:48.966 DEBUG:boto:Method: GET 2024-04-16T18:28:48.966 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:28:48.966 DEBUG:boto:Data: 2024-04-16T18:28:48.967 DEBUG:boto:Headers: {} 2024-04-16T18:28:48.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:48.967 DEBUG:boto:Port: 8000 2024-04-16T18:28:48.967 DEBUG:boto:Params: {} 2024-04-16T18:28:48.967 DEBUG:boto:Token: None 2024-04-16T18:28:48.967 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:48 GMT /cjqttm-52/ 2024-04-16T18:28:48.967 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0= 2024-04-16T18:28:48.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YyhmjKo/kBGytOTFAqyRyIm9oX0=', 'Content-Length': '0'} 2024-04-16T18:28:48.969 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd8e3fb855bd4894-00661ec360-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.010 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.011 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.011 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.011 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.011 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.011 DEBUG:boto:Method: GET 2024-04-16T18:28:49.011 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.011 DEBUG:boto:Data: 2024-04-16T18:28:49.011 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.012 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.012 DEBUG:boto:Params: {} 2024-04-16T18:28:49.012 DEBUG:boto:Token: None 2024-04-16T18:28:49.012 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.015 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000713b8f22b577c3dc-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.016 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.016 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:49.016 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:49.016 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.016 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:28:49.016 DEBUG:boto:Data: 2024-04-16T18:28:49.016 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.016 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.016 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.017 DEBUG:boto:Params: {} 2024-04-16T18:28:49.017 DEBUG:boto:Token: None 2024-04-16T18:28:49.017 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj46 2024-04-16T18:28:49.017 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8iYRK6da2o3gkPJx6sLRneNpuJA= 2024-04-16T18:28:49.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8iYRK6da2o3gkPJx6sLRneNpuJA=', 'Content-Length': '0'} 2024-04-16T18:28:49.019 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008208772c6b7047a3-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.020 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:49.020 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:49.020 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.020 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:28:49.020 DEBUG:boto:Data: 2024-04-16T18:28:49.020 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.020 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.020 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.020 DEBUG:boto:Params: {} 2024-04-16T18:28:49.020 DEBUG:boto:Token: None 2024-04-16T18:28:49.021 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj46 2024-04-16T18:28:49.021 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8iYRK6da2o3gkPJx6sLRneNpuJA= 2024-04-16T18:28:49.021 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8iYRK6da2o3gkPJx6sLRneNpuJA=', 'Content-Length': '0'} 2024-04-16T18:28:49.023 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000070d8a151792d120d-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.023 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:28:49.023 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:49.023 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:49.024 DEBUG:boto:Method: GET 2024-04-16T18:28:49.024 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:28:49.024 DEBUG:boto:Data: 2024-04-16T18:28:49.024 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.024 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.024 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.024 DEBUG:boto:Params: {} 2024-04-16T18:28:49.024 DEBUG:boto:Token: None 2024-04-16T18:28:49.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj46 2024-04-16T18:28:49.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wGS5hN94FdE4BUKBhWEkfiu+Xxw= 2024-04-16T18:28:49.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wGS5hN94FdE4BUKBhWEkfiu+Xxw=', 'Content-Length': '0'} 2024-04-16T18:28:49.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074da531e7fa6626b-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.070 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:28:49.071 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:28:49.071 DEBUG:boto:Method: GET 2024-04-16T18:28:49.071 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:28:49.071 DEBUG:boto:Data: 2024-04-16T18:28:49.071 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.071 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.071 DEBUG:boto:Params: {} 2024-04-16T18:28:49.071 DEBUG:boto:Token: None 2024-04-16T18:28:49.071 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj46 2024-04-16T18:28:49.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wGS5hN94FdE4BUKBhWEkfiu+Xxw= 2024-04-16T18:28:49.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wGS5hN94FdE4BUKBhWEkfiu+Xxw=', 'Content-Length': '0'} 2024-04-16T18:28:49.074 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088e86e7d83bc80c0-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.074 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.074 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.074 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.075 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.075 DEBUG:boto:Method: GET 2024-04-16T18:28:49.075 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.075 DEBUG:boto:Data: 2024-04-16T18:28:49.075 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.075 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.075 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.075 DEBUG:boto:Params: {} 2024-04-16T18:28:49.075 DEBUG:boto:Token: None 2024-04-16T18:28:49.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.075 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.078 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1876c607d9e6edd-00661ec361-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.118 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.119 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.119 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.119 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.119 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.119 DEBUG:boto:Method: GET 2024-04-16T18:28:49.119 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:28:49.119 DEBUG:boto:Data: 2024-04-16T18:28:49.119 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.120 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.120 DEBUG:boto:Params: {} 2024-04-16T18:28:49.120 DEBUG:boto:Token: None 2024-04-16T18:28:49.120 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.124 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d7f117ffcafc5dfd-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.124 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:28:49.124 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.124 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.124 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.125 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.125 DEBUG:boto:Method: GET 2024-04-16T18:28:49.125 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.125 DEBUG:boto:Data: 2024-04-16T18:28:49.125 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.125 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.125 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.125 DEBUG:boto:Params: {} 2024-04-16T18:28:49.125 DEBUG:boto:Token: None 2024-04-16T18:28:49.125 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.126 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ= 2024-04-16T18:28:49.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ=', 'Content-Length': '0'} 2024-04-16T18:28:49.128 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b53be6c20a69c7c-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.170 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.171 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.171 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.171 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.171 DEBUG:boto:Method: GET 2024-04-16T18:28:49.171 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.171 DEBUG:boto:Data: 2024-04-16T18:28:49.171 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.171 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.171 DEBUG:boto:Params: {} 2024-04-16T18:28:49.171 DEBUG:boto:Token: None 2024-04-16T18:28:49.172 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ= 2024-04-16T18:28:49.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ=', 'Content-Length': '0'} 2024-04-16T18:28:49.174 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006286d72b7b172261-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.174 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.174 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.174 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.174 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.174 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.175 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.175 DEBUG:boto:Data: 2024-04-16T18:28:49.175 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.175 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.175 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.175 DEBUG:boto:Params: {} 2024-04-16T18:28:49.175 DEBUG:boto:Token: None 2024-04-16T18:28:49.175 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hhkMsUCfflKLWmf7F+OjQu1G7fc= 2024-04-16T18:28:49.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hhkMsUCfflKLWmf7F+OjQu1G7fc=', 'Content-Length': '0'} 2024-04-16T18:28:49.178 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008409dc49b6959cb9-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.178 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.178 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.178 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.178 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.178 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.178 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.178 DEBUG:boto:Data: 2024-04-16T18:28:49.179 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.179 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.179 DEBUG:boto:Params: {} 2024-04-16T18:28:49.179 DEBUG:boto:Token: None 2024-04-16T18:28:49.179 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hhkMsUCfflKLWmf7F+OjQu1G7fc= 2024-04-16T18:28:49.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hhkMsUCfflKLWmf7F+OjQu1G7fc=', 'Content-Length': '0'} 2024-04-16T18:28:49.182 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f167f70a7b7b924a-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.182 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:28:49.182 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.182 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.182 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.182 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.182 DEBUG:boto:Method: GET 2024-04-16T18:28:49.183 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.183 DEBUG:boto:Data: 2024-04-16T18:28:49.183 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.183 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.183 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.183 DEBUG:boto:Params: {} 2024-04-16T18:28:49.183 DEBUG:boto:Token: None 2024-04-16T18:28:49.183 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ= 2024-04-16T18:28:49.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ=', 'Content-Length': '0'} 2024-04-16T18:28:49.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000efed6ef7da6ec3ed-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.226 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.226 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.227 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.227 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.227 DEBUG:boto:Method: GET 2024-04-16T18:28:49.227 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.227 DEBUG:boto:Data: 2024-04-16T18:28:49.227 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.227 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.227 DEBUG:boto:Params: {} 2024-04-16T18:28:49.227 DEBUG:boto:Token: None 2024-04-16T18:28:49.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:28:49.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ= 2024-04-16T18:28:49.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YW+gJ/PbKWaSE9Pr9xnKiKPB/NQ=', 'Content-Length': '0'} 2024-04-16T18:28:49.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017ead5d6954eedaf-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.230 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.230 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.230 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.230 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.231 DEBUG:boto:Method: GET 2024-04-16T18:28:49.231 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.231 DEBUG:boto:Data: 2024-04-16T18:28:49.231 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.231 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.231 DEBUG:boto:Params: {} 2024-04-16T18:28:49.231 DEBUG:boto:Token: None 2024-04-16T18:28:49.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.234 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b34318b1271d753-00661ec361-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.274 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.275 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.275 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.275 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.275 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.275 DEBUG:boto:Method: GET 2024-04-16T18:28:49.275 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.275 DEBUG:boto:Data: 2024-04-16T18:28:49.275 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.275 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.275 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.276 DEBUG:boto:Params: {} 2024-04-16T18:28:49.276 DEBUG:boto:Token: None 2024-04-16T18:28:49.276 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.280 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d3f16e57cf445753-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.280 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.280 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.280 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.280 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.280 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:28:49.281 DEBUG:boto:Data: 2024-04-16T18:28:49.281 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.281 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.281 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.281 DEBUG:boto:Params: {} 2024-04-16T18:28:49.281 DEBUG:boto:Token: None 2024-04-16T18:28:49.281 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51 2024-04-16T18:28:49.281 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tQ9kh8tQTY9ym1jpGxG3yEc6PSI= 2024-04-16T18:28:49.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tQ9kh8tQTY9ym1jpGxG3yEc6PSI=', 'Content-Length': '0'} 2024-04-16T18:28:49.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0a828ea9d8f9c45-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.284 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.284 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.284 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.284 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:28:49.284 DEBUG:boto:Data: 2024-04-16T18:28:49.284 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.284 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.284 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.284 DEBUG:boto:Params: {} 2024-04-16T18:28:49.285 DEBUG:boto:Token: None 2024-04-16T18:28:49.285 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51 2024-04-16T18:28:49.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tQ9kh8tQTY9ym1jpGxG3yEc6PSI= 2024-04-16T18:28:49.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tQ9kh8tQTY9ym1jpGxG3yEc6PSI=', 'Content-Length': '0'} 2024-04-16T18:28:49.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001a9f17471ae6ae2-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.287 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:28:49.288 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.288 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.288 DEBUG:boto:Method: GET 2024-04-16T18:28:49.288 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:28:49.288 DEBUG:boto:Data: 2024-04-16T18:28:49.288 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.288 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.288 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.288 DEBUG:boto:Params: {} 2024-04-16T18:28:49.288 DEBUG:boto:Token: None 2024-04-16T18:28:49.289 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51 2024-04-16T18:28:49.289 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v16mYNfblWk4ZS9HKg3K3VLBisA= 2024-04-16T18:28:49.289 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v16mYNfblWk4ZS9HKg3K3VLBisA=', 'Content-Length': '0'} 2024-04-16T18:28:49.291 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003be14543159050bb-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.334 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:28:49.335 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:28:49.335 DEBUG:boto:Method: GET 2024-04-16T18:28:49.335 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:28:49.335 DEBUG:boto:Data: 2024-04-16T18:28:49.335 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.335 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.335 DEBUG:boto:Params: {} 2024-04-16T18:28:49.335 DEBUG:boto:Token: None 2024-04-16T18:28:49.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj51 2024-04-16T18:28:49.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v16mYNfblWk4ZS9HKg3K3VLBisA= 2024-04-16T18:28:49.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v16mYNfblWk4ZS9HKg3K3VLBisA=', 'Content-Length': '0'} 2024-04-16T18:28:49.338 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d326022d7c36b5e-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.338 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.338 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.338 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.338 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.339 DEBUG:boto:Method: GET 2024-04-16T18:28:49.339 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.339 DEBUG:boto:Data: 2024-04-16T18:28:49.339 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.339 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.339 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.339 DEBUG:boto:Params: {} 2024-04-16T18:28:49.339 DEBUG:boto:Token: None 2024-04-16T18:28:49.339 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.339 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.339 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.342 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff1ce90c09a09aee-00661ec361-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.382 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.383 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.383 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.383 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.383 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.383 DEBUG:boto:Method: GET 2024-04-16T18:28:49.383 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:28:49.383 DEBUG:boto:Data: 2024-04-16T18:28:49.383 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.383 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.383 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.384 DEBUG:boto:Params: {} 2024-04-16T18:28:49.384 DEBUG:boto:Token: None 2024-04-16T18:28:49.384 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.387 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a13274906a3e1428-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.387 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.387 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:28:49.388 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.388 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.388 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.388 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.388 DEBUG:boto:Method: GET 2024-04-16T18:28:49.388 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.388 DEBUG:boto:Data: 2024-04-16T18:28:49.388 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.388 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.388 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.388 DEBUG:boto:Params: {} 2024-04-16T18:28:49.389 DEBUG:boto:Token: None 2024-04-16T18:28:49.389 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.389 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto= 2024-04-16T18:28:49.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto=', 'Content-Length': '0'} 2024-04-16T18:28:49.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069d0f40d034ae78a-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.434 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.435 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.435 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.435 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.435 DEBUG:boto:Method: GET 2024-04-16T18:28:49.435 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.435 DEBUG:boto:Data: 2024-04-16T18:28:49.435 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.435 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.435 DEBUG:boto:Params: {} 2024-04-16T18:28:49.435 DEBUG:boto:Token: None 2024-04-16T18:28:49.436 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto= 2024-04-16T18:28:49.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto=', 'Content-Length': '0'} 2024-04-16T18:28:49.438 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ad0841e93e200706-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.438 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.438 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.438 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.438 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.438 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.439 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.439 DEBUG:boto:Data: 2024-04-16T18:28:49.439 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.439 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.439 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.439 DEBUG:boto:Params: {} 2024-04-16T18:28:49.439 DEBUG:boto:Token: None 2024-04-16T18:28:49.439 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6n5lKSmJgdG5UO/6U2R9CH/v7Q= 2024-04-16T18:28:49.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6n5lKSmJgdG5UO/6U2R9CH/v7Q=', 'Content-Length': '0'} 2024-04-16T18:28:49.442 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000306850965f6503f4-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.442 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.442 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.442 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.442 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.442 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.442 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.442 DEBUG:boto:Data: 2024-04-16T18:28:49.442 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.443 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.443 DEBUG:boto:Params: {} 2024-04-16T18:28:49.443 DEBUG:boto:Token: None 2024-04-16T18:28:49.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6n5lKSmJgdG5UO/6U2R9CH/v7Q= 2024-04-16T18:28:49.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6n5lKSmJgdG5UO/6U2R9CH/v7Q=', 'Content-Length': '0'} 2024-04-16T18:28:49.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa1dc43d6808edf6-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:28:49.445 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.446 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.446 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.446 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.446 DEBUG:boto:Method: GET 2024-04-16T18:28:49.446 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.446 DEBUG:boto:Data: 2024-04-16T18:28:49.446 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.446 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.446 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.446 DEBUG:boto:Params: {} 2024-04-16T18:28:49.446 DEBUG:boto:Token: None 2024-04-16T18:28:49.447 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.447 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto= 2024-04-16T18:28:49.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto=', 'Content-Length': '0'} 2024-04-16T18:28:49.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000583c335dcfb15446-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.490 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.490 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.491 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.491 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.491 DEBUG:boto:Method: GET 2024-04-16T18:28:49.491 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.491 DEBUG:boto:Data: 2024-04-16T18:28:49.491 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.491 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.491 DEBUG:boto:Params: {} 2024-04-16T18:28:49.491 DEBUG:boto:Token: None 2024-04-16T18:28:49.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:28:49.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto= 2024-04-16T18:28:49.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:10bn5QAur7jlyaG0KMNbU5b9Fto=', 'Content-Length': '0'} 2024-04-16T18:28:49.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dc1fb521dae9ffe-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.494 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.494 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.494 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.495 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.495 DEBUG:boto:Method: GET 2024-04-16T18:28:49.495 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.495 DEBUG:boto:Data: 2024-04-16T18:28:49.495 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.495 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.495 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.495 DEBUG:boto:Params: {} 2024-04-16T18:28:49.495 DEBUG:boto:Token: None 2024-04-16T18:28:49.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df412671df84e871-00661ec361-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.538 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.539 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.539 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.539 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.539 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.539 DEBUG:boto:Method: GET 2024-04-16T18:28:49.539 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.539 DEBUG:boto:Data: 2024-04-16T18:28:49.539 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.539 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.540 DEBUG:boto:Params: {} 2024-04-16T18:28:49.540 DEBUG:boto:Token: None 2024-04-16T18:28:49.540 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.543 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009bbcc0bb1b3213fd-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.544 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.544 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.544 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.544 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.544 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:28:49.544 DEBUG:boto:Data: 2024-04-16T18:28:49.544 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.545 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.545 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.545 DEBUG:boto:Params: {} 2024-04-16T18:28:49.545 DEBUG:boto:Token: None 2024-04-16T18:28:49.545 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55 2024-04-16T18:28:49.545 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X5uyQJ0b6G1ndY0rE6Gz9SALgRU= 2024-04-16T18:28:49.545 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X5uyQJ0b6G1ndY0rE6Gz9SALgRU=', 'Content-Length': '0'} 2024-04-16T18:28:49.547 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000084d4aa3738987ed-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.547 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.548 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.548 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.548 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:28:49.548 DEBUG:boto:Data: 2024-04-16T18:28:49.548 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.548 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.548 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.548 DEBUG:boto:Params: {} 2024-04-16T18:28:49.548 DEBUG:boto:Token: None 2024-04-16T18:28:49.548 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55 2024-04-16T18:28:49.549 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X5uyQJ0b6G1ndY0rE6Gz9SALgRU= 2024-04-16T18:28:49.549 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X5uyQJ0b6G1ndY0rE6Gz9SALgRU=', 'Content-Length': '0'} 2024-04-16T18:28:49.552 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e15e297754739ab3-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.552 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:28:49.552 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.552 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.552 DEBUG:boto:Method: GET 2024-04-16T18:28:49.553 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:28:49.553 DEBUG:boto:Data: 2024-04-16T18:28:49.553 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.553 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.553 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.553 DEBUG:boto:Params: {} 2024-04-16T18:28:49.553 DEBUG:boto:Token: None 2024-04-16T18:28:49.553 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55 2024-04-16T18:28:49.553 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G07KjddLUOIMp5UZehHMh0yHv5Y= 2024-04-16T18:28:49.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G07KjddLUOIMp5UZehHMh0yHv5Y=', 'Content-Length': '0'} 2024-04-16T18:28:49.555 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:19:59 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1b6e08333c35677-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.602 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:28:49.602 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:28:49.603 DEBUG:boto:Method: GET 2024-04-16T18:28:49.603 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:28:49.603 DEBUG:boto:Data: 2024-04-16T18:28:49.603 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.603 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.603 DEBUG:boto:Params: {} 2024-04-16T18:28:49.603 DEBUG:boto:Token: None 2024-04-16T18:28:49.603 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj55 2024-04-16T18:28:49.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G07KjddLUOIMp5UZehHMh0yHv5Y= 2024-04-16T18:28:49.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G07KjddLUOIMp5UZehHMh0yHv5Y=', 'Content-Length': '0'} 2024-04-16T18:28:49.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d8226622145ed14-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.606 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.606 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.606 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.606 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.606 DEBUG:boto:Method: GET 2024-04-16T18:28:49.606 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.607 DEBUG:boto:Data: 2024-04-16T18:28:49.607 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.607 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.607 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.607 DEBUG:boto:Params: {} 2024-04-16T18:28:49.607 DEBUG:boto:Token: None 2024-04-16T18:28:49.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.607 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.609 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000667002f0ede3ddfb-00661ec361-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.650 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.651 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.651 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.651 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.651 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.651 DEBUG:boto:Method: GET 2024-04-16T18:28:49.651 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:28:49.651 DEBUG:boto:Data: 2024-04-16T18:28:49.651 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.651 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.651 DEBUG:boto:Params: {} 2024-04-16T18:28:49.652 DEBUG:boto:Token: None 2024-04-16T18:28:49.652 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.652 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.652 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.656 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1ea4588cf50fee1-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.656 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.656 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:28:49.656 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.656 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.656 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.657 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.657 DEBUG:boto:Method: GET 2024-04-16T18:28:49.657 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.657 DEBUG:boto:Data: 2024-04-16T18:28:49.657 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.657 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.657 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.657 DEBUG:boto:Params: {} 2024-04-16T18:28:49.657 DEBUG:boto:Token: None 2024-04-16T18:28:49.657 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.658 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0= 2024-04-16T18:28:49.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0=', 'Content-Length': '0'} 2024-04-16T18:28:49.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083cab6ec5435f6f1-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.702 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.702 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.703 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.703 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.703 DEBUG:boto:Method: GET 2024-04-16T18:28:49.703 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.703 DEBUG:boto:Data: 2024-04-16T18:28:49.703 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.703 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.703 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.703 DEBUG:boto:Params: {} 2024-04-16T18:28:49.703 DEBUG:boto:Token: None 2024-04-16T18:28:49.703 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.704 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0= 2024-04-16T18:28:49.704 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0=', 'Content-Length': '0'} 2024-04-16T18:28:49.706 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a712f160fd141b9-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.706 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.706 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.707 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.707 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.707 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.707 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.707 DEBUG:boto:Data: 2024-04-16T18:28:49.707 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.707 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.707 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.707 DEBUG:boto:Params: {} 2024-04-16T18:28:49.707 DEBUG:boto:Token: None 2024-04-16T18:28:49.707 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.708 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p8u15BU0zNsC2qYZj8tyQRwPJ5A= 2024-04-16T18:28:49.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p8u15BU0zNsC2qYZj8tyQRwPJ5A=', 'Content-Length': '0'} 2024-04-16T18:28:49.710 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb37055ae5a87e3d-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.710 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.710 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.711 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.711 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.711 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.711 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.711 DEBUG:boto:Data: 2024-04-16T18:28:49.711 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.711 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.711 DEBUG:boto:Params: {} 2024-04-16T18:28:49.711 DEBUG:boto:Token: None 2024-04-16T18:28:49.711 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:p8u15BU0zNsC2qYZj8tyQRwPJ5A= 2024-04-16T18:28:49.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:p8u15BU0zNsC2qYZj8tyQRwPJ5A=', 'Content-Length': '0'} 2024-04-16T18:28:49.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c9772e9a3970fbf-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.714 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:28:49.714 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.714 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.714 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.714 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.714 DEBUG:boto:Method: GET 2024-04-16T18:28:49.714 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.714 DEBUG:boto:Data: 2024-04-16T18:28:49.715 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.715 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.715 DEBUG:boto:Params: {} 2024-04-16T18:28:49.715 DEBUG:boto:Token: None 2024-04-16T18:28:49.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0= 2024-04-16T18:28:49.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0=', 'Content-Length': '0'} 2024-04-16T18:28:49.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b311073f79b81aa-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.758 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.758 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.758 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.759 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.759 DEBUG:boto:Method: GET 2024-04-16T18:28:49.759 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.759 DEBUG:boto:Data: 2024-04-16T18:28:49.759 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.759 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.759 DEBUG:boto:Params: {} 2024-04-16T18:28:49.759 DEBUG:boto:Token: None 2024-04-16T18:28:49.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:28:49.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0= 2024-04-16T18:28:49.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/xZdr9X1UR0qS5cQWSGiQ10tTn0=', 'Content-Length': '0'} 2024-04-16T18:28:49.762 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ea33fe244e27495-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.762 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.762 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.762 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.762 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.763 DEBUG:boto:Method: GET 2024-04-16T18:28:49.763 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.763 DEBUG:boto:Data: 2024-04-16T18:28:49.763 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.763 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.763 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.763 DEBUG:boto:Params: {} 2024-04-16T18:28:49.763 DEBUG:boto:Token: None 2024-04-16T18:28:49.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.766 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ae9d8475147338d-00661ec361-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.806 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.807 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.807 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.807 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.807 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.807 DEBUG:boto:Method: GET 2024-04-16T18:28:49.807 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.807 DEBUG:boto:Data: 2024-04-16T18:28:49.807 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.807 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.808 DEBUG:boto:Params: {} 2024-04-16T18:28:49.808 DEBUG:boto:Token: None 2024-04-16T18:28:49.808 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.811 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007e5ff5a7a273c46f-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.812 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.812 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.812 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.812 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.812 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:28:49.812 DEBUG:boto:Data: 2024-04-16T18:28:49.813 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.813 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.813 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.813 DEBUG:boto:Params: {} 2024-04-16T18:28:49.813 DEBUG:boto:Token: None 2024-04-16T18:28:49.813 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57 2024-04-16T18:28:49.813 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dC0JG6tsxyzdzKKhCs77u4uQvYM= 2024-04-16T18:28:49.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dC0JG6tsxyzdzKKhCs77u4uQvYM=', 'Content-Length': '0'} 2024-04-16T18:28:49.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dff208611643c6e2-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.815 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.816 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.816 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.816 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:28:49.816 DEBUG:boto:Data: 2024-04-16T18:28:49.816 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.816 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.816 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.816 DEBUG:boto:Params: {} 2024-04-16T18:28:49.816 DEBUG:boto:Token: None 2024-04-16T18:28:49.816 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57 2024-04-16T18:28:49.816 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dC0JG6tsxyzdzKKhCs77u4uQvYM= 2024-04-16T18:28:49.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dC0JG6tsxyzdzKKhCs77u4uQvYM=', 'Content-Length': '0'} 2024-04-16T18:28:49.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083e6bb6cb29d05b3-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:28:49.819 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.819 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.819 DEBUG:boto:Method: GET 2024-04-16T18:28:49.819 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:28:49.819 DEBUG:boto:Data: 2024-04-16T18:28:49.819 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.819 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.819 DEBUG:boto:Params: {} 2024-04-16T18:28:49.821 DEBUG:boto:Token: None 2024-04-16T18:28:49.821 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57 2024-04-16T18:28:49.821 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EBC4bfip9wijniqnjV2GUfe0j3c= 2024-04-16T18:28:49.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EBC4bfip9wijniqnjV2GUfe0j3c=', 'Content-Length': '0'} 2024-04-16T18:28:49.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000859dd21be225230b-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.866 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:28:49.866 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:28:49.867 DEBUG:boto:Method: GET 2024-04-16T18:28:49.867 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:28:49.867 DEBUG:boto:Data: 2024-04-16T18:28:49.867 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.867 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.867 DEBUG:boto:Params: {} 2024-04-16T18:28:49.867 DEBUG:boto:Token: None 2024-04-16T18:28:49.867 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj57 2024-04-16T18:28:49.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EBC4bfip9wijniqnjV2GUfe0j3c= 2024-04-16T18:28:49.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EBC4bfip9wijniqnjV2GUfe0j3c=', 'Content-Length': '0'} 2024-04-16T18:28:49.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e0da3a88ab0d845-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.870 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.870 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.870 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.870 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.870 DEBUG:boto:Method: GET 2024-04-16T18:28:49.871 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.871 DEBUG:boto:Data: 2024-04-16T18:28:49.871 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.871 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.871 DEBUG:boto:Params: {} 2024-04-16T18:28:49.871 DEBUG:boto:Token: None 2024-04-16T18:28:49.871 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.873 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb6c13571b267d4b-00661ec361-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.914 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.915 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:49.915 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:49.915 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.915 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.915 DEBUG:boto:Method: GET 2024-04-16T18:28:49.915 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:28:49.915 DEBUG:boto:Data: 2024-04-16T18:28:49.915 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.915 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.915 DEBUG:boto:Params: {} 2024-04-16T18:28:49.916 DEBUG:boto:Token: None 2024-04-16T18:28:49.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/ 2024-04-16T18:28:49.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o= 2024-04-16T18:28:49.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5tl8ls1fCQrpo0ev9ladG2djn4o=', 'Content-Length': '0'} 2024-04-16T18:28:49.919 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b9e5f8d76ad300aa-00661ec361-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.920 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:49.920 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:28:49.920 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:49.920 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:49.920 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.920 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.920 DEBUG:boto:Method: GET 2024-04-16T18:28:49.920 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.921 DEBUG:boto:Data: 2024-04-16T18:28:49.921 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.921 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.921 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.921 DEBUG:boto:Params: {} 2024-04-16T18:28:49.921 DEBUG:boto:Token: None 2024-04-16T18:28:49.921 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.921 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y2X2QCOytWyO6lXfHL/SSUdygt0= 2024-04-16T18:28:49.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y2X2QCOytWyO6lXfHL/SSUdygt0=', 'Content-Length': '0'} 2024-04-16T18:28:49.923 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b68cd9aad833493-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.966 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:49.967 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:49.967 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.967 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.967 DEBUG:boto:Method: GET 2024-04-16T18:28:49.967 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.967 DEBUG:boto:Data: 2024-04-16T18:28:49.967 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.967 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.967 DEBUG:boto:Params: {} 2024-04-16T18:28:49.968 DEBUG:boto:Token: None 2024-04-16T18:28:49.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y2X2QCOytWyO6lXfHL/SSUdygt0= 2024-04-16T18:28:49.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y2X2QCOytWyO6lXfHL/SSUdygt0=', 'Content-Length': '0'} 2024-04-16T18:28:49.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012196e9d3ef4e63e-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.970 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:49.970 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:49.970 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.971 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.971 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.971 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.971 DEBUG:boto:Data: 2024-04-16T18:28:49.971 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.971 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.971 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.971 DEBUG:boto:Params: {} 2024-04-16T18:28:49.971 DEBUG:boto:Token: None 2024-04-16T18:28:49.971 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJuGKX6PHxesouZQ3T6lGIyubRE= 2024-04-16T18:28:49.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJuGKX6PHxesouZQ3T6lGIyubRE=', 'Content-Length': '0'} 2024-04-16T18:28:49.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb1ac3172794ecf0-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.974 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:49.974 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:49.974 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.974 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.974 DEBUG:boto:Method: HEAD 2024-04-16T18:28:49.974 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.974 DEBUG:boto:Data: 2024-04-16T18:28:49.974 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.974 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:49.975 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.975 DEBUG:boto:Params: {} 2024-04-16T18:28:49.975 DEBUG:boto:Token: None 2024-04-16T18:28:49.975 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJuGKX6PHxesouZQ3T6lGIyubRE= 2024-04-16T18:28:49.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJuGKX6PHxesouZQ3T6lGIyubRE=', 'Content-Length': '0'} 2024-04-16T18:28:49.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fb334777da70544-00661ec361-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:49.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:28:49.977 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:49.977 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:49.977 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.977 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.977 DEBUG:boto:Method: GET 2024-04-16T18:28:49.978 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.978 DEBUG:boto:Data: 2024-04-16T18:28:49.978 DEBUG:boto:Headers: {} 2024-04-16T18:28:49.978 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:49.978 DEBUG:boto:Port: 8000 2024-04-16T18:28:49.978 DEBUG:boto:Params: {} 2024-04-16T18:28:49.978 DEBUG:boto:Token: None 2024-04-16T18:28:49.978 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:49 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:49.978 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y2X2QCOytWyO6lXfHL/SSUdygt0= 2024-04-16T18:28:49.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:49 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y2X2QCOytWyO6lXfHL/SSUdygt0=', 'Content-Length': '0'} 2024-04-16T18:28:49.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012329986a73088b1-00661ec361-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:49 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.022 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:50.022 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:50.023 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:50.023 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:28:50.023 DEBUG:boto:Method: GET 2024-04-16T18:28:50.023 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:50.023 DEBUG:boto:Data: 2024-04-16T18:28:50.023 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.023 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.023 DEBUG:boto:Params: {} 2024-04-16T18:28:50.024 DEBUG:boto:Token: None 2024-04-16T18:28:50.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:28:50.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:If2LZn6YEvrp+uFpuRpCRw4AS2I= 2024-04-16T18:28:50.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:If2LZn6YEvrp+uFpuRpCRw4AS2I=', 'Content-Length': '0'} 2024-04-16T18:28:50.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095909393b751c9bd-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.026 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.027 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.027 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.027 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.027 DEBUG:boto:Method: GET 2024-04-16T18:28:50.027 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.027 DEBUG:boto:Data: 2024-04-16T18:28:50.027 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.027 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.027 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.028 DEBUG:boto:Params: {} 2024-04-16T18:28:50.028 DEBUG:boto:Token: None 2024-04-16T18:28:50.028 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.028 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c7734e39a8602b2-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.070 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.071 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.071 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.071 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.071 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.071 DEBUG:boto:Method: GET 2024-04-16T18:28:50.071 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.071 DEBUG:boto:Data: 2024-04-16T18:28:50.071 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.071 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.071 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.072 DEBUG:boto:Params: {} 2024-04-16T18:28:50.072 DEBUG:boto:Token: None 2024-04-16T18:28:50.072 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000442a35ad4dacdad-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.075 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.076 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:50.076 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:50.076 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.076 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:28:50.076 DEBUG:boto:Data: 2024-04-16T18:28:50.076 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.076 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.076 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.076 DEBUG:boto:Params: {} 2024-04-16T18:28:50.076 DEBUG:boto:Token: None 2024-04-16T18:28:50.077 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj58 2024-04-16T18:28:50.077 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u1Ng0sTSBtjEG8p5FSJpzCVK5OM= 2024-04-16T18:28:50.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u1Ng0sTSBtjEG8p5FSJpzCVK5OM=', 'Content-Length': '0'} 2024-04-16T18:28:50.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005acce58398ae47e4-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.079 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:50.079 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:50.079 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.079 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:28:50.080 DEBUG:boto:Data: 2024-04-16T18:28:50.080 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.080 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.080 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.080 DEBUG:boto:Params: {} 2024-04-16T18:28:50.080 DEBUG:boto:Token: None 2024-04-16T18:28:50.080 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj58 2024-04-16T18:28:50.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u1Ng0sTSBtjEG8p5FSJpzCVK5OM= 2024-04-16T18:28:50.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u1Ng0sTSBtjEG8p5FSJpzCVK5OM=', 'Content-Length': '0'} 2024-04-16T18:28:50.082 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045d9d255279999d0-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.083 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:28:50.083 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:50.083 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:50.083 DEBUG:boto:Method: GET 2024-04-16T18:28:50.083 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:28:50.083 DEBUG:boto:Data: 2024-04-16T18:28:50.083 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.083 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.084 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.084 DEBUG:boto:Params: {} 2024-04-16T18:28:50.084 DEBUG:boto:Token: None 2024-04-16T18:28:50.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj58 2024-04-16T18:28:50.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/GbDL0CCB4OI7tnUNEO62GiwESw= 2024-04-16T18:28:50.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/GbDL0CCB4OI7tnUNEO62GiwESw=', 'Content-Length': '0'} 2024-04-16T18:28:50.086 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b10ae8cbc24a71c2-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.126 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:28:50.127 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:28:50.127 DEBUG:boto:Method: GET 2024-04-16T18:28:50.127 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:28:50.127 DEBUG:boto:Data: 2024-04-16T18:28:50.127 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.127 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.127 DEBUG:boto:Params: {} 2024-04-16T18:28:50.127 DEBUG:boto:Token: None 2024-04-16T18:28:50.128 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj58 2024-04-16T18:28:50.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/GbDL0CCB4OI7tnUNEO62GiwESw= 2024-04-16T18:28:50.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/GbDL0CCB4OI7tnUNEO62GiwESw=', 'Content-Length': '0'} 2024-04-16T18:28:50.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b41f72a828e8c2b-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.130 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.130 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.130 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.130 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.130 DEBUG:boto:Method: GET 2024-04-16T18:28:50.130 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.131 DEBUG:boto:Data: 2024-04-16T18:28:50.131 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.131 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.131 DEBUG:boto:Params: {} 2024-04-16T18:28:50.131 DEBUG:boto:Token: None 2024-04-16T18:28:50.131 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.134 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c806f24c60028d47-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.174 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.174 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.175 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.175 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.175 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.175 DEBUG:boto:Method: GET 2024-04-16T18:28:50.175 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:28:50.175 DEBUG:boto:Data: 2024-04-16T18:28:50.175 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.175 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.175 DEBUG:boto:Params: {} 2024-04-16T18:28:50.176 DEBUG:boto:Token: None 2024-04-16T18:28:50.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.179 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068edb74cf9851721-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.179 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.180 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:28:50.180 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.180 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.180 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.180 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.180 DEBUG:boto:Method: GET 2024-04-16T18:28:50.180 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.180 DEBUG:boto:Data: 2024-04-16T18:28:50.180 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.180 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.180 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.181 DEBUG:boto:Params: {} 2024-04-16T18:28:50.181 DEBUG:boto:Token: None 2024-04-16T18:28:50.181 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY= 2024-04-16T18:28:50.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY=', 'Content-Length': '0'} 2024-04-16T18:28:50.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de83eb2dd37dfa07-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.226 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.226 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.226 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.227 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.227 DEBUG:boto:Method: GET 2024-04-16T18:28:50.227 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.227 DEBUG:boto:Data: 2024-04-16T18:28:50.227 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.227 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.227 DEBUG:boto:Params: {} 2024-04-16T18:28:50.227 DEBUG:boto:Token: None 2024-04-16T18:28:50.227 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY= 2024-04-16T18:28:50.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY=', 'Content-Length': '0'} 2024-04-16T18:28:50.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074414c0e04cce589-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.230 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.230 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.230 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.231 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.231 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.231 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.231 DEBUG:boto:Data: 2024-04-16T18:28:50.231 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.231 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.231 DEBUG:boto:Params: {} 2024-04-16T18:28:50.233 DEBUG:boto:Token: None 2024-04-16T18:28:50.233 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.233 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yoE0SZ7MrKiAZfZAwY/6Q4LFZ2M= 2024-04-16T18:28:50.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yoE0SZ7MrKiAZfZAwY/6Q4LFZ2M=', 'Content-Length': '0'} 2024-04-16T18:28:50.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087c7393731e005b6-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.235 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.235 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.235 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.236 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.236 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.236 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.236 DEBUG:boto:Data: 2024-04-16T18:28:50.236 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.236 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.236 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.236 DEBUG:boto:Params: {} 2024-04-16T18:28:50.236 DEBUG:boto:Token: None 2024-04-16T18:28:50.236 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yoE0SZ7MrKiAZfZAwY/6Q4LFZ2M= 2024-04-16T18:28:50.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yoE0SZ7MrKiAZfZAwY/6Q4LFZ2M=', 'Content-Length': '0'} 2024-04-16T18:28:50.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059a95ef1168c273a-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.239 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:28:50.239 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.239 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.240 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.240 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.240 DEBUG:boto:Method: GET 2024-04-16T18:28:50.240 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.240 DEBUG:boto:Data: 2024-04-16T18:28:50.240 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.240 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.240 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.240 DEBUG:boto:Params: {} 2024-04-16T18:28:50.240 DEBUG:boto:Token: None 2024-04-16T18:28:50.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.241 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY= 2024-04-16T18:28:50.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY=', 'Content-Length': '0'} 2024-04-16T18:28:50.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff458f7762897705-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.286 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.286 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.287 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.287 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.287 DEBUG:boto:Method: GET 2024-04-16T18:28:50.287 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.287 DEBUG:boto:Data: 2024-04-16T18:28:50.287 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.287 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.287 DEBUG:boto:Params: {} 2024-04-16T18:28:50.287 DEBUG:boto:Token: None 2024-04-16T18:28:50.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:28:50.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY= 2024-04-16T18:28:50.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+0RnkCyNzNLr/mMItD8fugZ1AxY=', 'Content-Length': '0'} 2024-04-16T18:28:50.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000347940f1b7495513-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.290 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.290 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.290 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.290 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.291 DEBUG:boto:Method: GET 2024-04-16T18:28:50.291 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.291 DEBUG:boto:Data: 2024-04-16T18:28:50.291 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.291 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.291 DEBUG:boto:Params: {} 2024-04-16T18:28:50.291 DEBUG:boto:Token: None 2024-04-16T18:28:50.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.294 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd719450e1be2884-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.294 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.295 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.295 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.295 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.295 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.295 DEBUG:boto:Method: GET 2024-04-16T18:28:50.295 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.295 DEBUG:boto:Data: 2024-04-16T18:28:50.295 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.295 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.295 DEBUG:boto:Params: {} 2024-04-16T18:28:50.295 DEBUG:boto:Token: None 2024-04-16T18:28:50.296 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.299 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfcc4f483da47a81-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.299 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.299 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.300 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.300 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.300 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:28:50.300 DEBUG:boto:Data: 2024-04-16T18:28:50.300 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.300 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.300 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.300 DEBUG:boto:Params: {} 2024-04-16T18:28:50.300 DEBUG:boto:Token: None 2024-04-16T18:28:50.300 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62 2024-04-16T18:28:50.301 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oQgrwBgB/Q7g2TsfgLccQXLLnO8= 2024-04-16T18:28:50.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oQgrwBgB/Q7g2TsfgLccQXLLnO8=', 'Content-Length': '0'} 2024-04-16T18:28:50.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb879f331baf3387-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.303 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.303 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.303 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.303 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:28:50.303 DEBUG:boto:Data: 2024-04-16T18:28:50.303 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.303 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.303 DEBUG:boto:Params: {} 2024-04-16T18:28:50.304 DEBUG:boto:Token: None 2024-04-16T18:28:50.304 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62 2024-04-16T18:28:50.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oQgrwBgB/Q7g2TsfgLccQXLLnO8= 2024-04-16T18:28:50.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oQgrwBgB/Q7g2TsfgLccQXLLnO8=', 'Content-Length': '0'} 2024-04-16T18:28:50.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000027ef711a1217abc6-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.306 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:28:50.306 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.306 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.306 DEBUG:boto:Method: GET 2024-04-16T18:28:50.306 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:28:50.306 DEBUG:boto:Data: 2024-04-16T18:28:50.306 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.307 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.307 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.307 DEBUG:boto:Params: {} 2024-04-16T18:28:50.307 DEBUG:boto:Token: None 2024-04-16T18:28:50.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62 2024-04-16T18:28:50.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OsAe68Y8zK6vrESgW9oLtDkA6rE= 2024-04-16T18:28:50.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OsAe68Y8zK6vrESgW9oLtDkA6rE=', 'Content-Length': '0'} 2024-04-16T18:28:50.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d54cb28ce78d2f09-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.354 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:28:50.354 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:28:50.355 DEBUG:boto:Method: GET 2024-04-16T18:28:50.355 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:28:50.355 DEBUG:boto:Data: 2024-04-16T18:28:50.355 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.355 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.355 DEBUG:boto:Params: {} 2024-04-16T18:28:50.355 DEBUG:boto:Token: None 2024-04-16T18:28:50.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj62 2024-04-16T18:28:50.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OsAe68Y8zK6vrESgW9oLtDkA6rE= 2024-04-16T18:28:50.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OsAe68Y8zK6vrESgW9oLtDkA6rE=', 'Content-Length': '0'} 2024-04-16T18:28:50.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000daf31771af48115-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.358 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.358 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.358 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.358 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.358 DEBUG:boto:Method: GET 2024-04-16T18:28:50.358 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.359 DEBUG:boto:Data: 2024-04-16T18:28:50.359 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.359 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.359 DEBUG:boto:Params: {} 2024-04-16T18:28:50.359 DEBUG:boto:Token: None 2024-04-16T18:28:50.359 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068a1f3819e6d5b80-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.362 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.363 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.363 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.363 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.363 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.363 DEBUG:boto:Method: GET 2024-04-16T18:28:50.363 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:28:50.363 DEBUG:boto:Data: 2024-04-16T18:28:50.363 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.363 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.363 DEBUG:boto:Params: {} 2024-04-16T18:28:50.364 DEBUG:boto:Token: None 2024-04-16T18:28:50.364 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.367 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b163d5175cf2df6-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.368 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:28:50.368 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.368 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.368 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.368 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.368 DEBUG:boto:Method: GET 2024-04-16T18:28:50.368 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.368 DEBUG:boto:Data: 2024-04-16T18:28:50.369 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.369 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.369 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.369 DEBUG:boto:Params: {} 2024-04-16T18:28:50.369 DEBUG:boto:Token: None 2024-04-16T18:28:50.369 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.369 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4= 2024-04-16T18:28:50.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4=', 'Content-Length': '0'} 2024-04-16T18:28:50.371 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090c9f7fc344a02e6-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.414 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.414 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.415 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.415 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.415 DEBUG:boto:Method: GET 2024-04-16T18:28:50.415 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.415 DEBUG:boto:Data: 2024-04-16T18:28:50.415 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.415 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.415 DEBUG:boto:Params: {} 2024-04-16T18:28:50.415 DEBUG:boto:Token: None 2024-04-16T18:28:50.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4= 2024-04-16T18:28:50.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4=', 'Content-Length': '0'} 2024-04-16T18:28:50.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1a6a1267ea50239-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.418 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.418 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.418 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.418 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.418 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.418 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.418 DEBUG:boto:Data: 2024-04-16T18:28:50.418 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.418 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.419 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.419 DEBUG:boto:Params: {} 2024-04-16T18:28:50.419 DEBUG:boto:Token: None 2024-04-16T18:28:50.419 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J71F69K5waCxxvogkDqib0DzQdM= 2024-04-16T18:28:50.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J71F69K5waCxxvogkDqib0DzQdM=', 'Content-Length': '0'} 2024-04-16T18:28:50.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bde64843bbaf52a-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.421 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.421 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.421 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.421 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.421 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.422 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.422 DEBUG:boto:Data: 2024-04-16T18:28:50.422 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.422 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.422 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.422 DEBUG:boto:Params: {} 2024-04-16T18:28:50.422 DEBUG:boto:Token: None 2024-04-16T18:28:50.422 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.422 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J71F69K5waCxxvogkDqib0DzQdM= 2024-04-16T18:28:50.422 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J71F69K5waCxxvogkDqib0DzQdM=', 'Content-Length': '0'} 2024-04-16T18:28:50.424 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003b943d96145ed31-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:28:50.425 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.425 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.425 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.425 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.425 DEBUG:boto:Method: GET 2024-04-16T18:28:50.425 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.425 DEBUG:boto:Data: 2024-04-16T18:28:50.425 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.425 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.425 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.425 DEBUG:boto:Params: {} 2024-04-16T18:28:50.425 DEBUG:boto:Token: None 2024-04-16T18:28:50.426 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.426 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4= 2024-04-16T18:28:50.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4=', 'Content-Length': '0'} 2024-04-16T18:28:50.427 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a644fca95d56568-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.470 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.471 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.471 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.471 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.471 DEBUG:boto:Method: GET 2024-04-16T18:28:50.471 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.471 DEBUG:boto:Data: 2024-04-16T18:28:50.471 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.471 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.472 DEBUG:boto:Params: {} 2024-04-16T18:28:50.472 DEBUG:boto:Token: None 2024-04-16T18:28:50.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:28:50.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4= 2024-04-16T18:28:50.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s607wbkvzGmjK/UY6UFfVP/SXj4=', 'Content-Length': '0'} 2024-04-16T18:28:50.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a01a2a05ab13a780-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.474 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.475 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.475 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.475 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.475 DEBUG:boto:Method: GET 2024-04-16T18:28:50.475 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.475 DEBUG:boto:Data: 2024-04-16T18:28:50.475 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.475 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.475 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.475 DEBUG:boto:Params: {} 2024-04-16T18:28:50.476 DEBUG:boto:Token: None 2024-04-16T18:28:50.476 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.478 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002904d1b6d2b5af9f-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.522 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.523 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.523 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.523 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.523 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.523 DEBUG:boto:Method: GET 2024-04-16T18:28:50.523 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.523 DEBUG:boto:Data: 2024-04-16T18:28:50.523 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.524 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.524 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.524 DEBUG:boto:Params: {} 2024-04-16T18:28:50.524 DEBUG:boto:Token: None 2024-04-16T18:28:50.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f5096ef62885c296-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.528 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.528 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.528 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.529 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.529 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:28:50.529 DEBUG:boto:Data: 2024-04-16T18:28:50.529 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.529 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.529 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.529 DEBUG:boto:Params: {} 2024-04-16T18:28:50.529 DEBUG:boto:Token: None 2024-04-16T18:28:50.529 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68 2024-04-16T18:28:50.529 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ehu2YbzwtCIhQ1IQGfVePbjBg+c= 2024-04-16T18:28:50.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ehu2YbzwtCIhQ1IQGfVePbjBg+c=', 'Content-Length': '0'} 2024-04-16T18:28:50.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003675d6008a92d8cd-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.532 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.532 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.532 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.532 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:28:50.532 DEBUG:boto:Data: 2024-04-16T18:28:50.532 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.532 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.532 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.532 DEBUG:boto:Params: {} 2024-04-16T18:28:50.533 DEBUG:boto:Token: None 2024-04-16T18:28:50.533 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68 2024-04-16T18:28:50.533 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ehu2YbzwtCIhQ1IQGfVePbjBg+c= 2024-04-16T18:28:50.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ehu2YbzwtCIhQ1IQGfVePbjBg+c=', 'Content-Length': '0'} 2024-04-16T18:28:50.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088ab59c3b07954bd-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.535 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:28:50.535 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.535 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.535 DEBUG:boto:Method: GET 2024-04-16T18:28:50.535 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:28:50.535 DEBUG:boto:Data: 2024-04-16T18:28:50.535 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.536 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.536 DEBUG:boto:Params: {} 2024-04-16T18:28:50.536 DEBUG:boto:Token: None 2024-04-16T18:28:50.536 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68 2024-04-16T18:28:50.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9w/FsQUJ75xn/ZWVJl1y/UbUr9w= 2024-04-16T18:28:50.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9w/FsQUJ75xn/ZWVJl1y/UbUr9w=', 'Content-Length': '0'} 2024-04-16T18:28:50.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080da79800b55eeb6-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.578 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:28:50.578 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:28:50.579 DEBUG:boto:Method: GET 2024-04-16T18:28:50.579 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:28:50.579 DEBUG:boto:Data: 2024-04-16T18:28:50.579 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.579 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.579 DEBUG:boto:Params: {} 2024-04-16T18:28:50.579 DEBUG:boto:Token: None 2024-04-16T18:28:50.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj68 2024-04-16T18:28:50.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9w/FsQUJ75xn/ZWVJl1y/UbUr9w= 2024-04-16T18:28:50.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9w/FsQUJ75xn/ZWVJl1y/UbUr9w=', 'Content-Length': '0'} 2024-04-16T18:28:50.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afa83914dbd90070-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.622 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.623 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.623 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.623 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.623 DEBUG:boto:Method: GET 2024-04-16T18:28:50.623 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.623 DEBUG:boto:Data: 2024-04-16T18:28:50.623 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.623 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.623 DEBUG:boto:Params: {} 2024-04-16T18:28:50.624 DEBUG:boto:Token: None 2024-04-16T18:28:50.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000271e41d44a6f2eb3-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.666 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.667 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.667 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.667 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.667 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.667 DEBUG:boto:Method: GET 2024-04-16T18:28:50.667 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:28:50.667 DEBUG:boto:Data: 2024-04-16T18:28:50.667 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.667 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.668 DEBUG:boto:Params: {} 2024-04-16T18:28:50.668 DEBUG:boto:Token: None 2024-04-16T18:28:50.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da239c95476f33f5-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.672 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:28:50.672 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.672 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.672 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.672 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.672 DEBUG:boto:Method: GET 2024-04-16T18:28:50.672 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.673 DEBUG:boto:Data: 2024-04-16T18:28:50.673 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.673 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.673 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.673 DEBUG:boto:Params: {} 2024-04-16T18:28:50.673 DEBUG:boto:Token: None 2024-04-16T18:28:50.673 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg= 2024-04-16T18:28:50.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg=', 'Content-Length': '0'} 2024-04-16T18:28:50.676 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000daa07f67539a3b29-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.718 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.718 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.718 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.719 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.719 DEBUG:boto:Method: GET 2024-04-16T18:28:50.719 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.719 DEBUG:boto:Data: 2024-04-16T18:28:50.719 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.719 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.719 DEBUG:boto:Params: {} 2024-04-16T18:28:50.719 DEBUG:boto:Token: None 2024-04-16T18:28:50.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg= 2024-04-16T18:28:50.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg=', 'Content-Length': '0'} 2024-04-16T18:28:50.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001808860c4f0f7f6a-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.722 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.722 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.722 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.722 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.722 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.723 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.723 DEBUG:boto:Data: 2024-04-16T18:28:50.723 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.723 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.723 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.723 DEBUG:boto:Params: {} 2024-04-16T18:28:50.723 DEBUG:boto:Token: None 2024-04-16T18:28:50.723 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K7KAcbGgBxTF4PPAbrRxt9n8tcQ= 2024-04-16T18:28:50.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K7KAcbGgBxTF4PPAbrRxt9n8tcQ=', 'Content-Length': '0'} 2024-04-16T18:28:50.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4a4ae355cc336fb-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.726 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.726 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.726 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.726 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.726 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.726 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.726 DEBUG:boto:Data: 2024-04-16T18:28:50.726 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.726 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.726 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.726 DEBUG:boto:Params: {} 2024-04-16T18:28:50.727 DEBUG:boto:Token: None 2024-04-16T18:28:50.727 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K7KAcbGgBxTF4PPAbrRxt9n8tcQ= 2024-04-16T18:28:50.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K7KAcbGgBxTF4PPAbrRxt9n8tcQ=', 'Content-Length': '0'} 2024-04-16T18:28:50.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005971e24d21ba753f-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:28:50.729 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.729 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.729 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.729 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.729 DEBUG:boto:Method: GET 2024-04-16T18:28:50.729 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.730 DEBUG:boto:Data: 2024-04-16T18:28:50.730 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.730 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.730 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.730 DEBUG:boto:Params: {} 2024-04-16T18:28:50.730 DEBUG:boto:Token: None 2024-04-16T18:28:50.730 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.730 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg= 2024-04-16T18:28:50.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg=', 'Content-Length': '0'} 2024-04-16T18:28:50.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000773e6a3fe86b390e-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.774 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.775 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.775 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.775 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.775 DEBUG:boto:Method: GET 2024-04-16T18:28:50.775 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.775 DEBUG:boto:Data: 2024-04-16T18:28:50.775 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.775 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.775 DEBUG:boto:Params: {} 2024-04-16T18:28:50.776 DEBUG:boto:Token: None 2024-04-16T18:28:50.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:28:50.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg= 2024-04-16T18:28:50.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YtQG1IMJnh0k30Sx2PWZScTlqlg=', 'Content-Length': '0'} 2024-04-16T18:28:50.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000138991230b0932ce-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.779 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.779 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.779 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.779 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.779 DEBUG:boto:Method: GET 2024-04-16T18:28:50.779 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.779 DEBUG:boto:Data: 2024-04-16T18:28:50.779 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.779 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.779 DEBUG:boto:Params: {} 2024-04-16T18:28:50.780 DEBUG:boto:Token: None 2024-04-16T18:28:50.780 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002e5425da73b4c25-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.826 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.827 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.827 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.827 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.827 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.827 DEBUG:boto:Method: GET 2024-04-16T18:28:50.827 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.827 DEBUG:boto:Data: 2024-04-16T18:28:50.827 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.828 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.828 DEBUG:boto:Params: {} 2024-04-16T18:28:50.828 DEBUG:boto:Token: None 2024-04-16T18:28:50.828 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.831 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000876d6be123d7a87e-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.831 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.832 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.832 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.832 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.832 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:28:50.832 DEBUG:boto:Data: 2024-04-16T18:28:50.832 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.832 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.832 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.832 DEBUG:boto:Params: {} 2024-04-16T18:28:50.833 DEBUG:boto:Token: None 2024-04-16T18:28:50.833 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69 2024-04-16T18:28:50.833 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O3c8mn5Le/zfZUp9gv169x9Jj8o= 2024-04-16T18:28:50.833 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O3c8mn5Le/zfZUp9gv169x9Jj8o=', 'Content-Length': '0'} 2024-04-16T18:28:50.835 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000976fa61168435c6f-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.835 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.835 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.836 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.836 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:28:50.836 DEBUG:boto:Data: 2024-04-16T18:28:50.836 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.836 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.836 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.836 DEBUG:boto:Params: {} 2024-04-16T18:28:50.836 DEBUG:boto:Token: None 2024-04-16T18:28:50.836 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69 2024-04-16T18:28:50.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O3c8mn5Le/zfZUp9gv169x9Jj8o= 2024-04-16T18:28:50.837 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O3c8mn5Le/zfZUp9gv169x9Jj8o=', 'Content-Length': '0'} 2024-04-16T18:28:50.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000edd91921d8a16fef-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.839 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:28:50.839 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.839 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.839 DEBUG:boto:Method: GET 2024-04-16T18:28:50.839 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:28:50.839 DEBUG:boto:Data: 2024-04-16T18:28:50.839 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.840 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.840 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.840 DEBUG:boto:Params: {} 2024-04-16T18:28:50.840 DEBUG:boto:Token: None 2024-04-16T18:28:50.840 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69 2024-04-16T18:28:50.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyjAwRzyv6n+ktAxzrA2gwT+Xw0= 2024-04-16T18:28:50.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyjAwRzyv6n+ktAxzrA2gwT+Xw0=', 'Content-Length': '0'} 2024-04-16T18:28:50.842 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000786e58adc7487012-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.886 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:28:50.886 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:28:50.887 DEBUG:boto:Method: GET 2024-04-16T18:28:50.887 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:28:50.887 DEBUG:boto:Data: 2024-04-16T18:28:50.887 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.887 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.887 DEBUG:boto:Params: {} 2024-04-16T18:28:50.887 DEBUG:boto:Token: None 2024-04-16T18:28:50.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj69 2024-04-16T18:28:50.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hyjAwRzyv6n+ktAxzrA2gwT+Xw0= 2024-04-16T18:28:50.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hyjAwRzyv6n+ktAxzrA2gwT+Xw0=', 'Content-Length': '0'} 2024-04-16T18:28:50.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010d408ccddcbc52b-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.890 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.890 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.890 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.890 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.890 DEBUG:boto:Method: GET 2024-04-16T18:28:50.891 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.891 DEBUG:boto:Data: 2024-04-16T18:28:50.891 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.891 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.891 DEBUG:boto:Params: {} 2024-04-16T18:28:50.891 DEBUG:boto:Token: None 2024-04-16T18:28:50.891 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.893 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a7510b7e5651853b-00661ec362-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.934 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.935 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:50.935 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:50.935 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.935 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.935 DEBUG:boto:Method: GET 2024-04-16T18:28:50.935 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:28:50.935 DEBUG:boto:Data: 2024-04-16T18:28:50.935 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.935 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.935 DEBUG:boto:Params: {} 2024-04-16T18:28:50.936 DEBUG:boto:Token: None 2024-04-16T18:28:50.936 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/ 2024-04-16T18:28:50.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o= 2024-04-16T18:28:50.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:imW3cdqbr8Z57OpRapSJkZdKn6o=', 'Content-Length': '0'} 2024-04-16T18:28:50.939 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e54d5da65f4cc152-00661ec362-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.939 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:50.940 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:28:50.940 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:50.940 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:50.940 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.940 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.940 DEBUG:boto:Method: GET 2024-04-16T18:28:50.940 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.940 DEBUG:boto:Data: 2024-04-16T18:28:50.940 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.940 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.941 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.941 DEBUG:boto:Params: {} 2024-04-16T18:28:50.941 DEBUG:boto:Token: None 2024-04-16T18:28:50.941 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.941 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cOIkccmoVFrSwEacsWN+McKpIo= 2024-04-16T18:28:50.941 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cOIkccmoVFrSwEacsWN+McKpIo=', 'Content-Length': '0'} 2024-04-16T18:28:50.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed2710f28afac2fd-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.986 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:50.987 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:50.987 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.987 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.987 DEBUG:boto:Method: GET 2024-04-16T18:28:50.987 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.987 DEBUG:boto:Data: 2024-04-16T18:28:50.987 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.987 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.987 DEBUG:boto:Params: {} 2024-04-16T18:28:50.987 DEBUG:boto:Token: None 2024-04-16T18:28:50.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cOIkccmoVFrSwEacsWN+McKpIo= 2024-04-16T18:28:50.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cOIkccmoVFrSwEacsWN+McKpIo=', 'Content-Length': '0'} 2024-04-16T18:28:50.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006263a775ef8135a0-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.990 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:50.990 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:50.990 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.990 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.990 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.990 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.991 DEBUG:boto:Data: 2024-04-16T18:28:50.991 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.991 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.991 DEBUG:boto:Params: {} 2024-04-16T18:28:50.991 DEBUG:boto:Token: None 2024-04-16T18:28:50.991 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09IUZAUTsqxw3n1kpp7t4On5IKk= 2024-04-16T18:28:50.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09IUZAUTsqxw3n1kpp7t4On5IKk=', 'Content-Length': '0'} 2024-04-16T18:28:50.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7ea9fb2198dff79-00661ec362-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.994 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:50.994 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:50.994 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.994 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.994 DEBUG:boto:Method: HEAD 2024-04-16T18:28:50.994 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.994 DEBUG:boto:Data: 2024-04-16T18:28:50.994 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.994 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:50.995 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.995 DEBUG:boto:Params: {} 2024-04-16T18:28:50.995 DEBUG:boto:Token: None 2024-04-16T18:28:50.995 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:09IUZAUTsqxw3n1kpp7t4On5IKk= 2024-04-16T18:28:50.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:09IUZAUTsqxw3n1kpp7t4On5IKk=', 'Content-Length': '0'} 2024-04-16T18:28:50.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001517482882a7ec7d-00661ec362-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:50.997 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:28:50.998 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:50.998 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:50.998 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.998 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.998 DEBUG:boto:Method: GET 2024-04-16T18:28:50.998 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.998 DEBUG:boto:Data: 2024-04-16T18:28:50.998 DEBUG:boto:Headers: {} 2024-04-16T18:28:50.998 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:50.998 DEBUG:boto:Port: 8000 2024-04-16T18:28:50.998 DEBUG:boto:Params: {} 2024-04-16T18:28:50.999 DEBUG:boto:Token: None 2024-04-16T18:28:50.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:50 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:50.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8cOIkccmoVFrSwEacsWN+McKpIo= 2024-04-16T18:28:50.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8cOIkccmoVFrSwEacsWN+McKpIo=', 'Content-Length': '0'} 2024-04-16T18:28:51.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eda3f8ad99aa708b-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.042 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:51.043 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:51.043 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:51.043 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:28:51.043 DEBUG:boto:Method: GET 2024-04-16T18:28:51.043 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:51.043 DEBUG:boto:Data: 2024-04-16T18:28:51.043 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.043 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.043 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.043 DEBUG:boto:Params: {} 2024-04-16T18:28:51.044 DEBUG:boto:Token: None 2024-04-16T18:28:51.044 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:28:51.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VbiF0fUdIbW2ySmU89NvdAOsP34= 2024-04-16T18:28:51.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VbiF0fUdIbW2ySmU89NvdAOsP34=', 'Content-Length': '0'} 2024-04-16T18:28:51.046 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb29b04a4f4696bd-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.046 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.046 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.046 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.046 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.047 DEBUG:boto:Method: GET 2024-04-16T18:28:51.047 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.047 DEBUG:boto:Data: 2024-04-16T18:28:51.047 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.047 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.047 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.047 DEBUG:boto:Params: {} 2024-04-16T18:28:51.047 DEBUG:boto:Token: None 2024-04-16T18:28:51.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e9671f173cd3dfc-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.094 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.095 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.095 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.095 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.095 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.095 DEBUG:boto:Method: GET 2024-04-16T18:28:51.095 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.095 DEBUG:boto:Data: 2024-04-16T18:28:51.095 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.095 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.095 DEBUG:boto:Params: {} 2024-04-16T18:28:51.096 DEBUG:boto:Token: None 2024-04-16T18:28:51.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.100 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a9812ed01a4eb32e-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.100 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.100 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:51.100 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:51.100 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.100 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:28:51.100 DEBUG:boto:Data: 2024-04-16T18:28:51.101 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.101 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.101 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.101 DEBUG:boto:Params: {} 2024-04-16T18:28:51.101 DEBUG:boto:Token: None 2024-04-16T18:28:51.101 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj74 2024-04-16T18:28:51.101 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:26ZJZNye72FG/hPWqkwuCt0uKuk= 2024-04-16T18:28:51.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:26ZJZNye72FG/hPWqkwuCt0uKuk=', 'Content-Length': '0'} 2024-04-16T18:28:51.103 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9b8a3e10b3f43e9-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.103 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:51.103 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:51.104 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.104 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:28:51.104 DEBUG:boto:Data: 2024-04-16T18:28:51.104 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.104 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.104 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.104 DEBUG:boto:Params: {} 2024-04-16T18:28:51.104 DEBUG:boto:Token: None 2024-04-16T18:28:51.104 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj74 2024-04-16T18:28:51.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:26ZJZNye72FG/hPWqkwuCt0uKuk= 2024-04-16T18:28:51.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:26ZJZNye72FG/hPWqkwuCt0uKuk=', 'Content-Length': '0'} 2024-04-16T18:28:51.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f79fa3b2c4edbae0-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.107 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:28:51.107 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:51.107 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:51.107 DEBUG:boto:Method: GET 2024-04-16T18:28:51.107 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:28:51.107 DEBUG:boto:Data: 2024-04-16T18:28:51.108 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.108 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.108 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.108 DEBUG:boto:Params: {} 2024-04-16T18:28:51.108 DEBUG:boto:Token: None 2024-04-16T18:28:51.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj74 2024-04-16T18:28:51.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eH6LekuAYcqqxqj9q9vI+il0yK0= 2024-04-16T18:28:51.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eH6LekuAYcqqxqj9q9vI+il0yK0=', 'Content-Length': '0'} 2024-04-16T18:28:51.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:53 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b16148f00e9788b-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.154 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:28:51.155 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:28:51.155 DEBUG:boto:Method: GET 2024-04-16T18:28:51.155 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:28:51.155 DEBUG:boto:Data: 2024-04-16T18:28:51.155 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.155 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.155 DEBUG:boto:Params: {} 2024-04-16T18:28:51.155 DEBUG:boto:Token: None 2024-04-16T18:28:51.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj74 2024-04-16T18:28:51.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eH6LekuAYcqqxqj9q9vI+il0yK0= 2024-04-16T18:28:51.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eH6LekuAYcqqxqj9q9vI+il0yK0=', 'Content-Length': '0'} 2024-04-16T18:28:51.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d778f49b2e4b674-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.158 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.158 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.158 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.158 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.158 DEBUG:boto:Method: GET 2024-04-16T18:28:51.158 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.159 DEBUG:boto:Data: 2024-04-16T18:28:51.159 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.159 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.159 DEBUG:boto:Params: {} 2024-04-16T18:28:51.159 DEBUG:boto:Token: None 2024-04-16T18:28:51.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001248bd888203f75c-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.202 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.203 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.203 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.203 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.203 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.203 DEBUG:boto:Method: GET 2024-04-16T18:28:51.203 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:28:51.203 DEBUG:boto:Data: 2024-04-16T18:28:51.203 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.203 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.204 DEBUG:boto:Params: {} 2024-04-16T18:28:51.204 DEBUG:boto:Token: None 2024-04-16T18:28:51.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.208 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008dc7786c0e4a7030-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.208 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:28:51.208 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.208 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.209 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.209 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.209 DEBUG:boto:Method: GET 2024-04-16T18:28:51.209 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.209 DEBUG:boto:Data: 2024-04-16T18:28:51.209 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.209 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.209 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.209 DEBUG:boto:Params: {} 2024-04-16T18:28:51.209 DEBUG:boto:Token: None 2024-04-16T18:28:51.209 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.210 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E= 2024-04-16T18:28:51.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E=', 'Content-Length': '0'} 2024-04-16T18:28:51.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000919724b26d7b5a9-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.254 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.254 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.255 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.255 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.255 DEBUG:boto:Method: GET 2024-04-16T18:28:51.255 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.255 DEBUG:boto:Data: 2024-04-16T18:28:51.255 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.255 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.255 DEBUG:boto:Params: {} 2024-04-16T18:28:51.255 DEBUG:boto:Token: None 2024-04-16T18:28:51.255 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E= 2024-04-16T18:28:51.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E=', 'Content-Length': '0'} 2024-04-16T18:28:51.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000406dfe47e8eb5fd9-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.258 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.258 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.258 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.258 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.258 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.259 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.259 DEBUG:boto:Data: 2024-04-16T18:28:51.259 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.259 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.261 DEBUG:boto:Params: {} 2024-04-16T18:28:51.261 DEBUG:boto:Token: None 2024-04-16T18:28:51.261 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.261 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ECUcZRn0ixTtbHAgpLjJgRG2BBs= 2024-04-16T18:28:51.261 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ECUcZRn0ixTtbHAgpLjJgRG2BBs=', 'Content-Length': '0'} 2024-04-16T18:28:51.263 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096ba8b7d074faf48-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.263 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.263 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.263 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.264 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.264 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.264 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.264 DEBUG:boto:Data: 2024-04-16T18:28:51.264 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.264 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.264 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.264 DEBUG:boto:Params: {} 2024-04-16T18:28:51.264 DEBUG:boto:Token: None 2024-04-16T18:28:51.264 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ECUcZRn0ixTtbHAgpLjJgRG2BBs= 2024-04-16T18:28:51.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ECUcZRn0ixTtbHAgpLjJgRG2BBs=', 'Content-Length': '0'} 2024-04-16T18:28:51.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a78bfaa30fd6ca7-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.267 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:28:51.267 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.267 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.267 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.267 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.267 DEBUG:boto:Method: GET 2024-04-16T18:28:51.267 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.267 DEBUG:boto:Data: 2024-04-16T18:28:51.267 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.268 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.268 DEBUG:boto:Params: {} 2024-04-16T18:28:51.268 DEBUG:boto:Token: None 2024-04-16T18:28:51.268 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E= 2024-04-16T18:28:51.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E=', 'Content-Length': '0'} 2024-04-16T18:28:51.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005279fb6fc2ee5992-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.310 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.310 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.310 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.311 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.311 DEBUG:boto:Method: GET 2024-04-16T18:28:51.311 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.311 DEBUG:boto:Data: 2024-04-16T18:28:51.311 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.311 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.311 DEBUG:boto:Params: {} 2024-04-16T18:28:51.311 DEBUG:boto:Token: None 2024-04-16T18:28:51.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:28:51.311 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E= 2024-04-16T18:28:51.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YzKPo9gT/7ZuBpamDKpGIt3k+4E=', 'Content-Length': '0'} 2024-04-16T18:28:51.314 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049a8e5c1b865c095-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.314 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.314 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.314 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.314 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.314 DEBUG:boto:Method: GET 2024-04-16T18:28:51.314 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.314 DEBUG:boto:Data: 2024-04-16T18:28:51.314 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.315 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.315 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.315 DEBUG:boto:Params: {} 2024-04-16T18:28:51.315 DEBUG:boto:Token: None 2024-04-16T18:28:51.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.317 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000acd0c9794b75e66d-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.318 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.318 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.318 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.318 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.318 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.318 DEBUG:boto:Method: GET 2024-04-16T18:28:51.318 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.319 DEBUG:boto:Data: 2024-04-16T18:28:51.319 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.319 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.319 DEBUG:boto:Params: {} 2024-04-16T18:28:51.319 DEBUG:boto:Token: None 2024-04-16T18:28:51.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.323 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ea70f7c993834b2-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.323 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.323 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.323 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.323 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.323 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:28:51.324 DEBUG:boto:Data: 2024-04-16T18:28:51.324 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.324 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.324 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.324 DEBUG:boto:Params: {} 2024-04-16T18:28:51.324 DEBUG:boto:Token: None 2024-04-16T18:28:51.324 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76 2024-04-16T18:28:51.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:31rFIUkjUDxVZ+Coa4C32A2BWS4= 2024-04-16T18:28:51.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:31rFIUkjUDxVZ+Coa4C32A2BWS4=', 'Content-Length': '0'} 2024-04-16T18:28:51.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077b5117ac24ac196-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.327 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.327 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.327 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.327 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:28:51.327 DEBUG:boto:Data: 2024-04-16T18:28:51.327 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.327 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.328 DEBUG:boto:Params: {} 2024-04-16T18:28:51.328 DEBUG:boto:Token: None 2024-04-16T18:28:51.328 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76 2024-04-16T18:28:51.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:31rFIUkjUDxVZ+Coa4C32A2BWS4= 2024-04-16T18:28:51.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:31rFIUkjUDxVZ+Coa4C32A2BWS4=', 'Content-Length': '0'} 2024-04-16T18:28:51.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f3dfb72bf98f720-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:28:51.330 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.330 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.331 DEBUG:boto:Method: GET 2024-04-16T18:28:51.331 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:28:51.331 DEBUG:boto:Data: 2024-04-16T18:28:51.331 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.331 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.331 DEBUG:boto:Params: {} 2024-04-16T18:28:51.331 DEBUG:boto:Token: None 2024-04-16T18:28:51.331 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76 2024-04-16T18:28:51.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HAfN71YXupt06HxQWmRve3rwBrg= 2024-04-16T18:28:51.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HAfN71YXupt06HxQWmRve3rwBrg=', 'Content-Length': '0'} 2024-04-16T18:28:51.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:39 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbc01d04546522b2-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.374 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:28:51.375 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:28:51.375 DEBUG:boto:Method: GET 2024-04-16T18:28:51.375 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:28:51.375 DEBUG:boto:Data: 2024-04-16T18:28:51.375 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.375 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.375 DEBUG:boto:Params: {} 2024-04-16T18:28:51.375 DEBUG:boto:Token: None 2024-04-16T18:28:51.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj76 2024-04-16T18:28:51.376 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HAfN71YXupt06HxQWmRve3rwBrg= 2024-04-16T18:28:51.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HAfN71YXupt06HxQWmRve3rwBrg=', 'Content-Length': '0'} 2024-04-16T18:28:51.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e512c4e1d2300ac9-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.378 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.378 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.378 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.378 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.378 DEBUG:boto:Method: GET 2024-04-16T18:28:51.378 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.378 DEBUG:boto:Data: 2024-04-16T18:28:51.378 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.379 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.379 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.379 DEBUG:boto:Params: {} 2024-04-16T18:28:51.379 DEBUG:boto:Token: None 2024-04-16T18:28:51.379 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.382 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bfb0525ea344a1c-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.382 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.382 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.382 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.382 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.382 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.382 DEBUG:boto:Method: GET 2024-04-16T18:28:51.383 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:28:51.383 DEBUG:boto:Data: 2024-04-16T18:28:51.383 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.383 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.383 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.383 DEBUG:boto:Params: {} 2024-04-16T18:28:51.383 DEBUG:boto:Token: None 2024-04-16T18:28:51.383 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.383 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.383 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.387 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007abcbac50e229215-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.387 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.387 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:28:51.388 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.388 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.388 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.388 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.388 DEBUG:boto:Method: GET 2024-04-16T18:28:51.388 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.388 DEBUG:boto:Data: 2024-04-16T18:28:51.388 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.388 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.388 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.388 DEBUG:boto:Params: {} 2024-04-16T18:28:51.388 DEBUG:boto:Token: None 2024-04-16T18:28:51.389 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.389 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU= 2024-04-16T18:28:51.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU=', 'Content-Length': '0'} 2024-04-16T18:28:51.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a744390642f3886-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.434 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.434 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.435 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.435 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.435 DEBUG:boto:Method: GET 2024-04-16T18:28:51.435 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.435 DEBUG:boto:Data: 2024-04-16T18:28:51.435 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.435 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.435 DEBUG:boto:Params: {} 2024-04-16T18:28:51.435 DEBUG:boto:Token: None 2024-04-16T18:28:51.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU= 2024-04-16T18:28:51.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU=', 'Content-Length': '0'} 2024-04-16T18:28:51.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec9f8e240bdf4741-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.438 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.438 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.438 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.438 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.438 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.438 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.438 DEBUG:boto:Data: 2024-04-16T18:28:51.438 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.438 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.438 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.439 DEBUG:boto:Params: {} 2024-04-16T18:28:51.439 DEBUG:boto:Token: None 2024-04-16T18:28:51.439 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MLfqU/ORYJXxINNx1P38wp/LRFY= 2024-04-16T18:28:51.439 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MLfqU/ORYJXxINNx1P38wp/LRFY=', 'Content-Length': '0'} 2024-04-16T18:28:51.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000867d315af0742acc-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.441 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.441 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.442 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.442 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.442 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.442 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.442 DEBUG:boto:Data: 2024-04-16T18:28:51.442 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.442 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.442 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.442 DEBUG:boto:Params: {} 2024-04-16T18:28:51.443 DEBUG:boto:Token: None 2024-04-16T18:28:51.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MLfqU/ORYJXxINNx1P38wp/LRFY= 2024-04-16T18:28:51.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MLfqU/ORYJXxINNx1P38wp/LRFY=', 'Content-Length': '0'} 2024-04-16T18:28:51.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff33b2e639818209-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:28:51.445 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.445 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.445 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.445 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.445 DEBUG:boto:Method: GET 2024-04-16T18:28:51.446 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.446 DEBUG:boto:Data: 2024-04-16T18:28:51.446 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.446 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.446 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.446 DEBUG:boto:Params: {} 2024-04-16T18:28:51.446 DEBUG:boto:Token: None 2024-04-16T18:28:51.446 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.446 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU= 2024-04-16T18:28:51.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU=', 'Content-Length': '0'} 2024-04-16T18:28:51.448 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093714c7218e0d1bb-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.490 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.490 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.491 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.491 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.491 DEBUG:boto:Method: GET 2024-04-16T18:28:51.491 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.491 DEBUG:boto:Data: 2024-04-16T18:28:51.491 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.491 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.491 DEBUG:boto:Params: {} 2024-04-16T18:28:51.492 DEBUG:boto:Token: None 2024-04-16T18:28:51.492 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:28:51.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU= 2024-04-16T18:28:51.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YZQ2Pi3h9EM2QjbUr7GQJdx2IjU=', 'Content-Length': '0'} 2024-04-16T18:28:51.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4247ebd7f6b055e-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.494 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.494 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.494 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.494 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.495 DEBUG:boto:Method: GET 2024-04-16T18:28:51.495 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.495 DEBUG:boto:Data: 2024-04-16T18:28:51.495 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.495 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.495 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.495 DEBUG:boto:Params: {} 2024-04-16T18:28:51.495 DEBUG:boto:Token: None 2024-04-16T18:28:51.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002034e381dfb5ac43-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.498 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.499 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.499 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.499 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.499 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.499 DEBUG:boto:Method: GET 2024-04-16T18:28:51.499 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.499 DEBUG:boto:Data: 2024-04-16T18:28:51.499 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.499 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.500 DEBUG:boto:Params: {} 2024-04-16T18:28:51.500 DEBUG:boto:Token: None 2024-04-16T18:28:51.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.504 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000986db660340c814a-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.504 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.504 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.505 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.505 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.505 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:28:51.505 DEBUG:boto:Data: 2024-04-16T18:28:51.505 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.505 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.505 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.505 DEBUG:boto:Params: {} 2024-04-16T18:28:51.505 DEBUG:boto:Token: None 2024-04-16T18:28:51.505 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85 2024-04-16T18:28:51.505 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8pBF1fW73FUdNA9pZfac5kJ9m3s= 2024-04-16T18:28:51.506 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8pBF1fW73FUdNA9pZfac5kJ9m3s=', 'Content-Length': '0'} 2024-04-16T18:28:51.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b42c1a7ca650237c-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.507 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.508 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.508 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.508 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:28:51.508 DEBUG:boto:Data: 2024-04-16T18:28:51.508 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.508 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.508 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.508 DEBUG:boto:Params: {} 2024-04-16T18:28:51.508 DEBUG:boto:Token: None 2024-04-16T18:28:51.509 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85 2024-04-16T18:28:51.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8pBF1fW73FUdNA9pZfac5kJ9m3s= 2024-04-16T18:28:51.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8pBF1fW73FUdNA9pZfac5kJ9m3s=', 'Content-Length': '0'} 2024-04-16T18:28:51.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe6b4da8f3c5c4f4-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:28:51.511 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.511 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.511 DEBUG:boto:Method: GET 2024-04-16T18:28:51.511 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:28:51.512 DEBUG:boto:Data: 2024-04-16T18:28:51.512 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.512 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.512 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.512 DEBUG:boto:Params: {} 2024-04-16T18:28:51.512 DEBUG:boto:Token: None 2024-04-16T18:28:51.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85 2024-04-16T18:28:51.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DRTkopSxtAuDkBTiyA8AfmD5kS0= 2024-04-16T18:28:51.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DRTkopSxtAuDkBTiyA8AfmD5kS0=', 'Content-Length': '0'} 2024-04-16T18:28:51.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:20:34 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4ebc960d4374dbf-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.554 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:28:51.555 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:28:51.555 DEBUG:boto:Method: GET 2024-04-16T18:28:51.555 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:28:51.555 DEBUG:boto:Data: 2024-04-16T18:28:51.555 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.555 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.555 DEBUG:boto:Params: {} 2024-04-16T18:28:51.555 DEBUG:boto:Token: None 2024-04-16T18:28:51.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj85 2024-04-16T18:28:51.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DRTkopSxtAuDkBTiyA8AfmD5kS0= 2024-04-16T18:28:51.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DRTkopSxtAuDkBTiyA8AfmD5kS0=', 'Content-Length': '0'} 2024-04-16T18:28:51.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf37940ed6d7de60-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.558 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.558 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.558 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.558 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.558 DEBUG:boto:Method: GET 2024-04-16T18:28:51.559 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.559 DEBUG:boto:Data: 2024-04-16T18:28:51.559 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.559 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.559 DEBUG:boto:Params: {} 2024-04-16T18:28:51.559 DEBUG:boto:Token: None 2024-04-16T18:28:51.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002bb349dee0a12795-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.602 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.603 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.603 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.603 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.603 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.603 DEBUG:boto:Method: GET 2024-04-16T18:28:51.603 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:28:51.603 DEBUG:boto:Data: 2024-04-16T18:28:51.603 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.603 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.604 DEBUG:boto:Params: {} 2024-04-16T18:28:51.604 DEBUG:boto:Token: None 2024-04-16T18:28:51.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.607 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f27800fa7f3442c1-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.608 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.608 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:28:51.608 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.608 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.608 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.608 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.608 DEBUG:boto:Method: GET 2024-04-16T18:28:51.608 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.609 DEBUG:boto:Data: 2024-04-16T18:28:51.609 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.609 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.609 DEBUG:boto:Params: {} 2024-04-16T18:28:51.609 DEBUG:boto:Token: None 2024-04-16T18:28:51.609 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.609 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU= 2024-04-16T18:28:51.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU=', 'Content-Length': '0'} 2024-04-16T18:28:51.611 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000014a927b58837b1ce-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.654 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.654 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.655 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.655 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.655 DEBUG:boto:Method: GET 2024-04-16T18:28:51.655 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.655 DEBUG:boto:Data: 2024-04-16T18:28:51.655 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.655 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.655 DEBUG:boto:Params: {} 2024-04-16T18:28:51.655 DEBUG:boto:Token: None 2024-04-16T18:28:51.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU= 2024-04-16T18:28:51.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU=', 'Content-Length': '0'} 2024-04-16T18:28:51.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc5ff211cc9ea1bd-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.658 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.658 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.658 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.658 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.658 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.658 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.659 DEBUG:boto:Data: 2024-04-16T18:28:51.659 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.659 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.659 DEBUG:boto:Params: {} 2024-04-16T18:28:51.659 DEBUG:boto:Token: None 2024-04-16T18:28:51.659 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZEMghCFGcAaog9Yy0n/HGQYhXBo= 2024-04-16T18:28:51.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZEMghCFGcAaog9Yy0n/HGQYhXBo=', 'Content-Length': '0'} 2024-04-16T18:28:51.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d891ad1aa5b44970-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.662 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.662 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.662 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.662 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.662 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.662 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.662 DEBUG:boto:Data: 2024-04-16T18:28:51.662 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.662 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.662 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.662 DEBUG:boto:Params: {} 2024-04-16T18:28:51.663 DEBUG:boto:Token: None 2024-04-16T18:28:51.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZEMghCFGcAaog9Yy0n/HGQYhXBo= 2024-04-16T18:28:51.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZEMghCFGcAaog9Yy0n/HGQYhXBo=', 'Content-Length': '0'} 2024-04-16T18:28:51.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003baa1e2bcc9dfd37-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.665 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:28:51.665 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.665 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.665 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.665 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.665 DEBUG:boto:Method: GET 2024-04-16T18:28:51.665 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.665 DEBUG:boto:Data: 2024-04-16T18:28:51.665 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.666 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.666 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.666 DEBUG:boto:Params: {} 2024-04-16T18:28:51.666 DEBUG:boto:Token: None 2024-04-16T18:28:51.666 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.666 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU= 2024-04-16T18:28:51.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU=', 'Content-Length': '0'} 2024-04-16T18:28:51.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000296fdfb639d17a68-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.710 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.710 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.711 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.711 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.711 DEBUG:boto:Method: GET 2024-04-16T18:28:51.711 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.711 DEBUG:boto:Data: 2024-04-16T18:28:51.711 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.711 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.711 DEBUG:boto:Params: {} 2024-04-16T18:28:51.711 DEBUG:boto:Token: None 2024-04-16T18:28:51.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:28:51.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU= 2024-04-16T18:28:51.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:chla+hghr6g0Doj3L6xR1la9tQU=', 'Content-Length': '0'} 2024-04-16T18:28:51.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018e1b7e2b258abca-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.714 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.714 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.714 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.714 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.714 DEBUG:boto:Method: GET 2024-04-16T18:28:51.714 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.714 DEBUG:boto:Data: 2024-04-16T18:28:51.714 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.714 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.715 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.715 DEBUG:boto:Params: {} 2024-04-16T18:28:51.715 DEBUG:boto:Token: None 2024-04-16T18:28:51.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.717 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bf117b762d3e24ee-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.762 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.763 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.763 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.763 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.763 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.763 DEBUG:boto:Method: GET 2024-04-16T18:28:51.763 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.763 DEBUG:boto:Data: 2024-04-16T18:28:51.763 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.764 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.764 DEBUG:boto:Params: {} 2024-04-16T18:28:51.764 DEBUG:boto:Token: None 2024-04-16T18:28:51.764 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.764 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.764 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.767 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a811b37d23f992b7-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.767 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.768 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.768 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.768 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.768 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:28:51.768 DEBUG:boto:Data: 2024-04-16T18:28:51.768 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.768 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.768 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.768 DEBUG:boto:Params: {} 2024-04-16T18:28:51.768 DEBUG:boto:Token: None 2024-04-16T18:28:51.769 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87 2024-04-16T18:28:51.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d7N4/zuU1AGNdO1MWFgPEBtFcgo= 2024-04-16T18:28:51.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d7N4/zuU1AGNdO1MWFgPEBtFcgo=', 'Content-Length': '0'} 2024-04-16T18:28:51.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ae45869bf4140e1-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.771 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.771 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.771 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.771 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:28:51.771 DEBUG:boto:Data: 2024-04-16T18:28:51.771 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.772 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.772 DEBUG:boto:Params: {} 2024-04-16T18:28:51.772 DEBUG:boto:Token: None 2024-04-16T18:28:51.772 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87 2024-04-16T18:28:51.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d7N4/zuU1AGNdO1MWFgPEBtFcgo= 2024-04-16T18:28:51.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d7N4/zuU1AGNdO1MWFgPEBtFcgo=', 'Content-Length': '0'} 2024-04-16T18:28:51.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078ad8dff31d68e62-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.774 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:28:51.774 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.774 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.775 DEBUG:boto:Method: GET 2024-04-16T18:28:51.775 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:28:51.775 DEBUG:boto:Data: 2024-04-16T18:28:51.775 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.775 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.775 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.775 DEBUG:boto:Params: {} 2024-04-16T18:28:51.775 DEBUG:boto:Token: None 2024-04-16T18:28:51.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87 2024-04-16T18:28:51.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dBD8ZIObMb8SnoLa1fDdW5Rsszg= 2024-04-16T18:28:51.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dBD8ZIObMb8SnoLa1fDdW5Rsszg=', 'Content-Length': '0'} 2024-04-16T18:28:51.777 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:25:16 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e47393032dcc76a-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.818 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:28:51.818 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:28:51.819 DEBUG:boto:Method: GET 2024-04-16T18:28:51.819 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:28:51.819 DEBUG:boto:Data: 2024-04-16T18:28:51.819 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.819 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.819 DEBUG:boto:Params: {} 2024-04-16T18:28:51.819 DEBUG:boto:Token: None 2024-04-16T18:28:51.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj87 2024-04-16T18:28:51.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dBD8ZIObMb8SnoLa1fDdW5Rsszg= 2024-04-16T18:28:51.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dBD8ZIObMb8SnoLa1fDdW5Rsszg=', 'Content-Length': '0'} 2024-04-16T18:28:51.821 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060e2aa1d7e93f0a6-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.822 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.822 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.822 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.822 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.822 DEBUG:boto:Method: GET 2024-04-16T18:28:51.822 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.822 DEBUG:boto:Data: 2024-04-16T18:28:51.822 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.822 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.823 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.823 DEBUG:boto:Params: {} 2024-04-16T18:28:51.823 DEBUG:boto:Token: None 2024-04-16T18:28:51.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd363276ad80eecb-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.866 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.867 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.867 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.867 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.867 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.867 DEBUG:boto:Method: GET 2024-04-16T18:28:51.867 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:28:51.867 DEBUG:boto:Data: 2024-04-16T18:28:51.868 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.868 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.868 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.868 DEBUG:boto:Params: {} 2024-04-16T18:28:51.868 DEBUG:boto:Token: None 2024-04-16T18:28:51.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.872 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e64029e764011015-00661ec363-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.872 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:51.873 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:28:51.873 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:51.873 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:51.873 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.873 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.873 DEBUG:boto:Method: GET 2024-04-16T18:28:51.873 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.874 DEBUG:boto:Data: 2024-04-16T18:28:51.874 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.874 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.874 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.874 DEBUG:boto:Params: {} 2024-04-16T18:28:51.874 DEBUG:boto:Token: None 2024-04-16T18:28:51.874 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.874 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU= 2024-04-16T18:28:51.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU=', 'Content-Length': '0'} 2024-04-16T18:28:51.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000343cb06127cd57ea-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.918 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:51.918 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:51.919 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.919 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.919 DEBUG:boto:Method: GET 2024-04-16T18:28:51.919 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.919 DEBUG:boto:Data: 2024-04-16T18:28:51.919 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.919 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.919 DEBUG:boto:Params: {} 2024-04-16T18:28:51.919 DEBUG:boto:Token: None 2024-04-16T18:28:51.919 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU= 2024-04-16T18:28:51.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU=', 'Content-Length': '0'} 2024-04-16T18:28:51.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003774940caf762ef0-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.922 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:51.922 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:51.922 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.922 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.922 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.922 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.922 DEBUG:boto:Data: 2024-04-16T18:28:51.922 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.923 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.923 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.923 DEBUG:boto:Params: {} 2024-04-16T18:28:51.923 DEBUG:boto:Token: None 2024-04-16T18:28:51.923 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y9WVUWfBg3LrHzJCzy/IyCxa/F0= 2024-04-16T18:28:51.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y9WVUWfBg3LrHzJCzy/IyCxa/F0=', 'Content-Length': '0'} 2024-04-16T18:28:51.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018d87419f1fb38a6-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.925 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:51.926 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:51.926 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.926 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.926 DEBUG:boto:Method: HEAD 2024-04-16T18:28:51.926 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.926 DEBUG:boto:Data: 2024-04-16T18:28:51.926 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.926 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.926 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.926 DEBUG:boto:Params: {} 2024-04-16T18:28:51.927 DEBUG:boto:Token: None 2024-04-16T18:28:51.927 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Y9WVUWfBg3LrHzJCzy/IyCxa/F0= 2024-04-16T18:28:51.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Y9WVUWfBg3LrHzJCzy/IyCxa/F0=', 'Content-Length': '0'} 2024-04-16T18:28:51.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000097a951cffbd17d3b-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.929 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:28:51.929 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:51.929 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:51.929 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.929 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.929 DEBUG:boto:Method: GET 2024-04-16T18:28:51.929 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.930 DEBUG:boto:Data: 2024-04-16T18:28:51.930 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.930 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.930 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.930 DEBUG:boto:Params: {} 2024-04-16T18:28:51.930 DEBUG:boto:Token: None 2024-04-16T18:28:51.930 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU= 2024-04-16T18:28:51.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU=', 'Content-Length': '0'} 2024-04-16T18:28:51.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dedacdd4629b0e0-00661ec363-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.974 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:51.974 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:51.974 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.975 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.975 DEBUG:boto:Method: GET 2024-04-16T18:28:51.975 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.975 DEBUG:boto:Data: 2024-04-16T18:28:51.975 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:51.975 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.975 DEBUG:boto:Params: {} 2024-04-16T18:28:51.975 DEBUG:boto:Token: None 2024-04-16T18:28:51.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:28:51.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU= 2024-04-16T18:28:51.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L1rv1hLq6i1Nu28ocYW5izqbvUU=', 'Content-Length': '0'} 2024-04-16T18:28:51.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036bbaa415a5f76df-00661ec363-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:51.978 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:51.978 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:51.978 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:51.978 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:51.978 DEBUG:boto:Method: GET 2024-04-16T18:28:51.978 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:28:51.978 DEBUG:boto:Data: 2024-04-16T18:28:51.979 DEBUG:boto:Headers: {} 2024-04-16T18:28:51.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:51.979 DEBUG:boto:Port: 8000 2024-04-16T18:28:51.979 DEBUG:boto:Params: {} 2024-04-16T18:28:51.979 DEBUG:boto:Token: None 2024-04-16T18:28:51.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:51 GMT /cjqttm-52/ 2024-04-16T18:28:51.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I= 2024-04-16T18:28:51.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ySkvOY+5tBs4T22DvF/2aUxUl0I=', 'Content-Length': '0'} 2024-04-16T18:28:51.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b5661adfaf59a2b-00661ec363-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.022 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.023 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.023 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.023 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.023 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.023 DEBUG:boto:Method: GET 2024-04-16T18:28:52.023 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.023 DEBUG:boto:Data: 2024-04-16T18:28:52.023 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.024 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.024 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.024 DEBUG:boto:Params: {} 2024-04-16T18:28:52.024 DEBUG:boto:Token: None 2024-04-16T18:28:52.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.027 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001855b7bfe5ceb81c-00661ec364-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.028 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.028 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:52.028 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:52.028 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.028 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:28:52.028 DEBUG:boto:Data: 2024-04-16T18:28:52.028 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.028 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.029 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.029 DEBUG:boto:Params: {} 2024-04-16T18:28:52.029 DEBUG:boto:Token: None 2024-04-16T18:28:52.029 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj92 2024-04-16T18:28:52.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cl0LkfM8oZR6VRZDSY9uSgUDYIc= 2024-04-16T18:28:52.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cl0LkfM8oZR6VRZDSY9uSgUDYIc=', 'Content-Length': '0'} 2024-04-16T18:28:52.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000061a44a854ba145d7-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.031 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:52.031 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:52.032 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.032 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:28:52.032 DEBUG:boto:Data: 2024-04-16T18:28:52.032 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.032 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.032 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.032 DEBUG:boto:Params: {} 2024-04-16T18:28:52.032 DEBUG:boto:Token: None 2024-04-16T18:28:52.032 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj92 2024-04-16T18:28:52.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cl0LkfM8oZR6VRZDSY9uSgUDYIc= 2024-04-16T18:28:52.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cl0LkfM8oZR6VRZDSY9uSgUDYIc=', 'Content-Length': '0'} 2024-04-16T18:28:52.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5b3b50b7b9b05fc-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.034 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:28:52.035 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:52.035 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:52.035 DEBUG:boto:Method: GET 2024-04-16T18:28:52.035 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:28:52.035 DEBUG:boto:Data: 2024-04-16T18:28:52.035 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.035 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.035 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.035 DEBUG:boto:Params: {} 2024-04-16T18:28:52.035 DEBUG:boto:Token: None 2024-04-16T18:28:52.036 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj92 2024-04-16T18:28:52.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nGS2e/jTITMSa+nkzYhtdSDLeLE= 2024-04-16T18:28:52.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nGS2e/jTITMSa+nkzYhtdSDLeLE=', 'Content-Length': '0'} 2024-04-16T18:28:52.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:22:50 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000631718cff6614a02-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.078 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:28:52.078 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:28:52.079 DEBUG:boto:Method: GET 2024-04-16T18:28:52.079 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:28:52.079 DEBUG:boto:Data: 2024-04-16T18:28:52.079 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.079 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.079 DEBUG:boto:Params: {} 2024-04-16T18:28:52.079 DEBUG:boto:Token: None 2024-04-16T18:28:52.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj92 2024-04-16T18:28:52.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nGS2e/jTITMSa+nkzYhtdSDLeLE= 2024-04-16T18:28:52.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nGS2e/jTITMSa+nkzYhtdSDLeLE=', 'Content-Length': '0'} 2024-04-16T18:28:52.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d448421e56cedae-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.082 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.082 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.082 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.082 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.082 DEBUG:boto:Method: GET 2024-04-16T18:28:52.082 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.082 DEBUG:boto:Data: 2024-04-16T18:28:52.082 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.082 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.082 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.082 DEBUG:boto:Params: {} 2024-04-16T18:28:52.083 DEBUG:boto:Token: None 2024-04-16T18:28:52.083 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.083 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.086 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3466e12fcb2e348-00661ec364-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.126 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.127 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.127 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.127 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.127 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.127 DEBUG:boto:Method: GET 2024-04-16T18:28:52.127 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:28:52.127 DEBUG:boto:Data: 2024-04-16T18:28:52.127 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.128 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.128 DEBUG:boto:Params: {} 2024-04-16T18:28:52.128 DEBUG:boto:Token: None 2024-04-16T18:28:52.128 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.132 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bb87a6649f6e7bf-00661ec364-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.132 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.132 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:28:52.132 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.133 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.133 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.133 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.133 DEBUG:boto:Method: GET 2024-04-16T18:28:52.133 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.133 DEBUG:boto:Data: 2024-04-16T18:28:52.133 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.133 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.133 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.133 DEBUG:boto:Params: {} 2024-04-16T18:28:52.134 DEBUG:boto:Token: None 2024-04-16T18:28:52.134 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.134 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A= 2024-04-16T18:28:52.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A=', 'Content-Length': '0'} 2024-04-16T18:28:52.136 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000648751364dad895-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.182 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.183 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.183 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.183 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.183 DEBUG:boto:Method: GET 2024-04-16T18:28:52.183 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.183 DEBUG:boto:Data: 2024-04-16T18:28:52.183 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.183 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.183 DEBUG:boto:Params: {} 2024-04-16T18:28:52.183 DEBUG:boto:Token: None 2024-04-16T18:28:52.184 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A= 2024-04-16T18:28:52.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A=', 'Content-Length': '0'} 2024-04-16T18:28:52.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008837be9f66ab0fdf-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.186 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.186 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.186 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.186 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.186 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.186 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.187 DEBUG:boto:Data: 2024-04-16T18:28:52.187 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.187 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.187 DEBUG:boto:Params: {} 2024-04-16T18:28:52.187 DEBUG:boto:Token: None 2024-04-16T18:28:52.187 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.187 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ulxmuIo0hQZL60XaTkibue4u/CI= 2024-04-16T18:28:52.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ulxmuIo0hQZL60XaTkibue4u/CI=', 'Content-Length': '0'} 2024-04-16T18:28:52.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003adad42cfdd51bac-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.189 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.189 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.190 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.190 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.190 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.190 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.190 DEBUG:boto:Data: 2024-04-16T18:28:52.190 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.190 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.190 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.190 DEBUG:boto:Params: {} 2024-04-16T18:28:52.190 DEBUG:boto:Token: None 2024-04-16T18:28:52.190 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.191 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ulxmuIo0hQZL60XaTkibue4u/CI= 2024-04-16T18:28:52.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ulxmuIo0hQZL60XaTkibue4u/CI=', 'Content-Length': '0'} 2024-04-16T18:28:52.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c4396fcc1cf87f6-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.193 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:28:52.193 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.193 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.193 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.193 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.193 DEBUG:boto:Method: GET 2024-04-16T18:28:52.193 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.194 DEBUG:boto:Data: 2024-04-16T18:28:52.194 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.194 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.194 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.194 DEBUG:boto:Params: {} 2024-04-16T18:28:52.194 DEBUG:boto:Token: None 2024-04-16T18:28:52.194 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.194 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A= 2024-04-16T18:28:52.194 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A=', 'Content-Length': '0'} 2024-04-16T18:28:52.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000291c634269006630-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.238 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.238 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.239 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.239 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.239 DEBUG:boto:Method: GET 2024-04-16T18:28:52.239 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.239 DEBUG:boto:Data: 2024-04-16T18:28:52.239 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.239 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.239 DEBUG:boto:Params: {} 2024-04-16T18:28:52.239 DEBUG:boto:Token: None 2024-04-16T18:28:52.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:28:52.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A= 2024-04-16T18:28:52.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8nHqtYo2AKIOkW1UYl22aOhie3A=', 'Content-Length': '0'} 2024-04-16T18:28:52.241 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000375e47073f9a1ac2-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.242 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.242 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.242 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.242 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.243 DEBUG:boto:Method: GET 2024-04-16T18:28:52.243 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.243 DEBUG:boto:Data: 2024-04-16T18:28:52.243 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.243 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.243 DEBUG:boto:Params: {} 2024-04-16T18:28:52.243 DEBUG:boto:Token: None 2024-04-16T18:28:52.243 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.247 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008130b73345d65dcc-00661ec364-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.290 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.291 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.291 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.291 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.291 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.291 DEBUG:boto:Method: GET 2024-04-16T18:28:52.291 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.291 DEBUG:boto:Data: 2024-04-16T18:28:52.291 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.291 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.291 DEBUG:boto:Params: {} 2024-04-16T18:28:52.292 DEBUG:boto:Token: None 2024-04-16T18:28:52.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.295 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000033c9bb45b325aca7-00661ec364-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.295 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.296 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.296 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.296 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.296 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:28:52.296 DEBUG:boto:Data: 2024-04-16T18:28:52.296 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.296 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.296 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.296 DEBUG:boto:Params: {} 2024-04-16T18:28:52.297 DEBUG:boto:Token: None 2024-04-16T18:28:52.297 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93 2024-04-16T18:28:52.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5eHlmmQ6aAA7E/Mkz9lzz2/P4I= 2024-04-16T18:28:52.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5eHlmmQ6aAA7E/Mkz9lzz2/P4I=', 'Content-Length': '0'} 2024-04-16T18:28:52.298 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076b3132d729595a6-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.299 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.299 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.299 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.299 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:28:52.299 DEBUG:boto:Data: 2024-04-16T18:28:52.299 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.299 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.299 DEBUG:boto:Params: {} 2024-04-16T18:28:52.299 DEBUG:boto:Token: None 2024-04-16T18:28:52.300 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93 2024-04-16T18:28:52.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5eHlmmQ6aAA7E/Mkz9lzz2/P4I= 2024-04-16T18:28:52.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5eHlmmQ6aAA7E/Mkz9lzz2/P4I=', 'Content-Length': '0'} 2024-04-16T18:28:52.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000541d7286621f4b41-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:28:52.302 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.302 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.302 DEBUG:boto:Method: GET 2024-04-16T18:28:52.302 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:28:52.302 DEBUG:boto:Data: 2024-04-16T18:28:52.302 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.303 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.303 DEBUG:boto:Params: {} 2024-04-16T18:28:52.303 DEBUG:boto:Token: None 2024-04-16T18:28:52.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93 2024-04-16T18:28:52.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i9ahptHJCug7li0cYQuXNLcGb6g= 2024-04-16T18:28:52.303 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i9ahptHJCug7li0cYQuXNLcGb6g=', 'Content-Length': '0'} 2024-04-16T18:28:52.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:27:32 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa4ad67f8567fb38-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.346 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:28:52.347 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:28:52.347 DEBUG:boto:Method: GET 2024-04-16T18:28:52.347 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:28:52.347 DEBUG:boto:Data: 2024-04-16T18:28:52.347 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.347 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.347 DEBUG:boto:Params: {} 2024-04-16T18:28:52.347 DEBUG:boto:Token: None 2024-04-16T18:28:52.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj93 2024-04-16T18:28:52.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i9ahptHJCug7li0cYQuXNLcGb6g= 2024-04-16T18:28:52.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i9ahptHJCug7li0cYQuXNLcGb6g=', 'Content-Length': '0'} 2024-04-16T18:28:52.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bac9a3f52d4797c-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.350 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.350 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.350 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.350 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.350 DEBUG:boto:Method: GET 2024-04-16T18:28:52.351 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.351 DEBUG:boto:Data: 2024-04-16T18:28:52.351 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.351 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.351 DEBUG:boto:Params: {} 2024-04-16T18:28:52.351 DEBUG:boto:Token: None 2024-04-16T18:28:52.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000092933c273659fbcf-00661ec364-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.394 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.395 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.395 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.395 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.395 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.395 DEBUG:boto:Method: GET 2024-04-16T18:28:52.395 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:28:52.395 DEBUG:boto:Data: 2024-04-16T18:28:52.395 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.396 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.396 DEBUG:boto:Params: {} 2024-04-16T18:28:52.396 DEBUG:boto:Token: None 2024-04-16T18:28:52.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.399 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c5f30e1c987d405-00661ec364-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.400 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:28:52.400 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.400 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.400 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.400 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.400 DEBUG:boto:Method: GET 2024-04-16T18:28:52.401 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.401 DEBUG:boto:Data: 2024-04-16T18:28:52.401 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.401 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.401 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.401 DEBUG:boto:Params: {} 2024-04-16T18:28:52.401 DEBUG:boto:Token: None 2024-04-16T18:28:52.401 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.401 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M= 2024-04-16T18:28:52.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M=', 'Content-Length': '0'} 2024-04-16T18:28:52.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003968d6bebe328e65-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.446 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.446 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.447 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.447 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.447 DEBUG:boto:Method: GET 2024-04-16T18:28:52.447 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.447 DEBUG:boto:Data: 2024-04-16T18:28:52.447 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.447 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.447 DEBUG:boto:Params: {} 2024-04-16T18:28:52.447 DEBUG:boto:Token: None 2024-04-16T18:28:52.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M= 2024-04-16T18:28:52.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M=', 'Content-Length': '0'} 2024-04-16T18:28:52.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000541bd9799057667d-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.450 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.450 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.450 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.450 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.451 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.451 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.451 DEBUG:boto:Data: 2024-04-16T18:28:52.451 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.451 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.451 DEBUG:boto:Params: {} 2024-04-16T18:28:52.451 DEBUG:boto:Token: None 2024-04-16T18:28:52.451 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IHEdgBcuU2iTCiUie6IxpH9UHiM= 2024-04-16T18:28:52.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IHEdgBcuU2iTCiUie6IxpH9UHiM=', 'Content-Length': '0'} 2024-04-16T18:28:52.453 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f028e0c456fe3c2-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.453 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.454 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.454 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.454 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.454 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.454 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.454 DEBUG:boto:Data: 2024-04-16T18:28:52.454 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.454 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.454 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.454 DEBUG:boto:Params: {} 2024-04-16T18:28:52.454 DEBUG:boto:Token: None 2024-04-16T18:28:52.455 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IHEdgBcuU2iTCiUie6IxpH9UHiM= 2024-04-16T18:28:52.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IHEdgBcuU2iTCiUie6IxpH9UHiM=', 'Content-Length': '0'} 2024-04-16T18:28:52.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a7670a3a1e08624-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.457 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:28:52.457 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.457 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.458 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.458 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.458 DEBUG:boto:Method: GET 2024-04-16T18:28:52.458 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.458 DEBUG:boto:Data: 2024-04-16T18:28:52.458 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.458 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.458 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.458 DEBUG:boto:Params: {} 2024-04-16T18:28:52.458 DEBUG:boto:Token: None 2024-04-16T18:28:52.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M= 2024-04-16T18:28:52.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M=', 'Content-Length': '0'} 2024-04-16T18:28:52.460 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7cfe7eee5cc1800-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.502 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.502 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.503 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.503 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.503 DEBUG:boto:Method: GET 2024-04-16T18:28:52.503 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.503 DEBUG:boto:Data: 2024-04-16T18:28:52.503 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.503 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.503 DEBUG:boto:Params: {} 2024-04-16T18:28:52.503 DEBUG:boto:Token: None 2024-04-16T18:28:52.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:28:52.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M= 2024-04-16T18:28:52.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DwbyVR1QtfcBD9qfnpMWOUJK86M=', 'Content-Length': '0'} 2024-04-16T18:28:52.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004080f2e52192adf4-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.506 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.507 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.507 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.507 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.507 DEBUG:boto:Method: GET 2024-04-16T18:28:52.507 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.507 DEBUG:boto:Data: 2024-04-16T18:28:52.507 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.507 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.507 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.507 DEBUG:boto:Params: {} 2024-04-16T18:28:52.507 DEBUG:boto:Token: None 2024-04-16T18:28:52.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.510 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b99d7cea3e74e6de-00661ec364-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.550 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.551 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.551 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.551 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.551 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.551 DEBUG:boto:Method: GET 2024-04-16T18:28:52.551 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.551 DEBUG:boto:Data: 2024-04-16T18:28:52.551 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.552 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.552 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.552 DEBUG:boto:Params: {} 2024-04-16T18:28:52.552 DEBUG:boto:Token: None 2024-04-16T18:28:52.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069ccbad8d8cc80d8-00661ec364-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.556 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.556 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.556 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.556 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.556 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:28:52.556 DEBUG:boto:Data: 2024-04-16T18:28:52.556 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.557 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.557 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.557 DEBUG:boto:Params: {} 2024-04-16T18:28:52.557 DEBUG:boto:Token: None 2024-04-16T18:28:52.557 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95 2024-04-16T18:28:52.557 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X3jGJWn62Cpyg7JElQGN5mmfGgo= 2024-04-16T18:28:52.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X3jGJWn62Cpyg7JElQGN5mmfGgo=', 'Content-Length': '0'} 2024-04-16T18:28:52.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba6f269ec4e75362-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.559 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.559 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.560 DEBUG:boto:Method: HEAD 2024-04-16T18:28:52.560 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:28:52.560 DEBUG:boto:Data: 2024-04-16T18:28:52.560 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.560 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.560 DEBUG:boto:Params: {} 2024-04-16T18:28:52.560 DEBUG:boto:Token: None 2024-04-16T18:28:52.560 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95 2024-04-16T18:28:52.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X3jGJWn62Cpyg7JElQGN5mmfGgo= 2024-04-16T18:28:52.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X3jGJWn62Cpyg7JElQGN5mmfGgo=', 'Content-Length': '0'} 2024-04-16T18:28:52.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a692c05f3ef2f11-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.563 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:28:52.563 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.563 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.563 DEBUG:boto:Method: GET 2024-04-16T18:28:52.563 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:28:52.563 DEBUG:boto:Data: 2024-04-16T18:28:52.563 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.563 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.563 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.563 DEBUG:boto:Params: {} 2024-04-16T18:28:52.564 DEBUG:boto:Token: None 2024-04-16T18:28:52.564 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95 2024-04-16T18:28:52.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sC4NN4JICGJOmU0aueObXpNTPNs= 2024-04-16T18:28:52.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sC4NN4JICGJOmU0aueObXpNTPNs=', 'Content-Length': '0'} 2024-04-16T18:28:52.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:21:24 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b1e52efbb36e1f8-00661ec364-5610-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.606 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:28:52.607 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:28:52.607 DEBUG:boto:Method: GET 2024-04-16T18:28:52.607 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:28:52.607 DEBUG:boto:Data: 2024-04-16T18:28:52.607 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.607 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.607 DEBUG:boto:Params: {} 2024-04-16T18:28:52.607 DEBUG:boto:Token: None 2024-04-16T18:28:52.607 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/obj95 2024-04-16T18:28:52.607 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sC4NN4JICGJOmU0aueObXpNTPNs= 2024-04-16T18:28:52.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sC4NN4JICGJOmU0aueObXpNTPNs=', 'Content-Length': '0'} 2024-04-16T18:28:52.610 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c77b5cf2ca3c52b3-00661ec364-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.610 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.610 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.610 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.610 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.610 DEBUG:boto:Method: GET 2024-04-16T18:28:52.611 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.611 DEBUG:boto:Data: 2024-04-16T18:28:52.611 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.611 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:28:52.611 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.611 DEBUG:boto:Params: {} 2024-04-16T18:28:52.611 DEBUG:boto:Token: None 2024-04-16T18:28:52.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.614 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000407ead6b775eb49-00661ec364-5610-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.654 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.655 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:28:52.655 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:28:52.655 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.655 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.655 DEBUG:boto:Method: GET 2024-04-16T18:28:52.655 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:28:52.655 DEBUG:boto:Data: 2024-04-16T18:28:52.655 DEBUG:boto:Headers: {} 2024-04-16T18:28:52.656 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:28:52.656 DEBUG:boto:Port: 8000 2024-04-16T18:28:52.656 DEBUG:boto:Params: {} 2024-04-16T18:28:52.656 DEBUG:boto:Token: None 2024-04-16T18:28:52.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:28:52 GMT /cjqttm-52/ 2024-04-16T18:28:52.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ= 2024-04-16T18:28:52.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:28:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1u67+pg+YEIIIkB99EBGWHaYCkQ=', 'Content-Length': '0'} 2024-04-16T18:28:52.660 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000082dc6f3ba0a5eb78-00661ec364-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:28:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:28:52.660 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:28:52.661 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:28:52.661 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:28:52.661 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:28:52.662 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:28:52.663+0000 7f80ec1f9640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 150352) UID: 0 2024-04-16T18:28:52.662 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:28:52.663+0000 7f80efa52880 -1 shutting down 2024-04-16T18:28:53.419 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:28:58.761 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:28:58.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:28:58.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:28:58.762 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:28:58.820 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:58.821 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:58.899 INFO:teuthology.orchestra.run.smithi139.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:19:55.888069Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_qHFWXis7jn00s3z05yQrqHrDY9oOdSD","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:27:48.337700Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_SNPQd-TVQbFdskwuuLIqlN0hQsk7HfZ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":13},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:49.363631Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"__rvHcPDTDyr380WK86yyg2YgHo6c8pd","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:24:09.555468Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ojKO5akCXDGm4cCbyLrTuZGuG5AJpdy","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:26:26.393396Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_rRATSjAzW447VQTflIMQ2kkvPrrU0wP","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:24:09.578210Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_7yLD3kWmu5Dun0_qtl0d1aer0M0yKRb","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:27:48.408275Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_X0fibykmr14Ool-32oKkGtpUnDCHXXD","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.443567Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_qtSWskWIaUo_K3QMAqFSa3-tWEjlaCu","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:20:07.434395Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_EMmRKqFmXNY4QgGpWT2c5YD32O_F5je","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:27:48.419829Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_vi4HBOp6yVurjHhjtrpBCnvGvbM1DE3","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:21:05.060964Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_8hdLiI2vjI5R0eZyMX_U0uJ5mZ2UuRv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:19:55.899996Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_onAPpl3g-RGv83B9qVq5KDegI2nY2Xj","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:49.242789Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_o6AC-0DKgN-m-eJz2PGPY4SjkHT8JJi","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":15},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:24:09.446766Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_OymZGgQsKPGsixtuM9rkHYolv_iqWab","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:26:26.325769Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_MoI3Up9E9iWAHOuI78jdS7STFFg5Hv0","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:19:55.909265Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_zwjYGuH1h2ZuNjD_BQuvSCly9Uv5kVt","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.444565Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_JWHOhcMu8buk4NzRf3GfOrUiay0thWx","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:27:48.316106Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_xsLqztUm7XwVzIvLQ7CkkmeFeK186_x","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:05.070730Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_MOLHuogB5vtM2ZIj3tGA1h0EZo1SmcH","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:19:55.959731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_c4Xkw8DvFUJRa0E3PPO4WVPkJ_YwdNv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:49.253253Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_d7L0BkzQ6062HJtyqIhb6mEzxfZ04O_","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:20:07.491221Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_oEsopprs6Qd6G9wEujdCbDoLz7FIeS7","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:19:55.976055Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_m5nbeWYZZxWvKs8LStU2LjuzGprkZub","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":3},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:05.079146Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_FsUgvH6QdMrX7NoKZVWlzIwaprtMDtA","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":17},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:24:09.495967Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_04n2mCS0VhBEh24cs9hJnuHu1p66ITb","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:26:26.336771Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_yyubJHNpHy3ZxPwD3dT4PGLdrrlJad-","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.502412Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_YIPX5q7XzGoIN9K8ypaCRmeSrfpJuA4","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:49.305190Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_XlygPFOKh53kUdB2SCHZUrby_wWwIwR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:27:48.327015Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_UZDnsDivNkLhBBcH9CgUTf4n_eiBYfx","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:05.127367Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_-iv7CIv5vAhZI3-_Xii03KHLwRPC5j2","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":15},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.513161Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_TUG4Jzb_bANau5cT95nx73-5H7Pek8I","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":39},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:24:09.506704Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_FCcNeC5ymbRaiUXCXapT7YWUXM6o6ro","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":4},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:49.315840Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Whhpk8CyMo5m6D_ddrc0ZlE-mfejZwg","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.383222Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_cdRa5yZwLBMXtDakLTRwjnS5Ne3FFsD","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:05.137388Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_QVZh8VjYUjAslMjSRqnwfBcnPGtvaL3","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-16T18:28:58.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:58.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:58.900 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj11 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:28:58.951 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:58.951 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:59.079 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj111', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj111', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.079 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj111 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:28:59.128 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:59.129 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:59.254 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj115', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj115', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.254 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj115 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:28:59.304 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:59.304 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:59.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:28:59.425 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj116', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj116', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.425 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj116 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:28:59.475 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:59.475 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:59.600 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj124', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj124', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.600 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj124 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:28:59.650 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:59.650 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:59.777 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj145', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj145', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.778 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj145 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:28:59.827 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:28:59.828 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:28:59.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj148', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.952 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj148', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:28:59.952 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj148 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:00.002 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:00.002 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:00.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj155', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj155', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.127 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj155 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:00.177 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:00.177 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:00.300 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.300 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj17 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:00.349 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:00.476 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj185', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj185', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.476 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj185 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:00.528 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:00.528 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:00.651 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.651 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj19 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:00.700 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:00.701 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:00.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj22', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj22', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:00.826 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj22 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:00.875 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:00.876 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:01.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj23', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj23', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.000 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj23 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:01.052 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:01.052 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:01.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj29', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj29', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.177 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj29 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:01.227 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:01.227 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:01.351 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj31', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj31', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.352 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj31 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:01.401 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:01.401 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:01.526 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj33', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj33', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.526 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj33 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:01.576 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:01.576 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:01.698 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj34', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj34', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.698 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj34 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:01.748 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:01.748 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:01.872 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj37', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:01.872 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj37 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:01.922 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:01.922 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:02.045 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj38', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj38', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.045 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj38 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:02.095 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:02.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.220 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj44 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:02.270 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:02.270 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:02.394 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.394 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj46 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:02.444 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:02.444 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:02.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj51', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.569 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj51 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:02.619 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:02.619 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:02.743 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj55', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj55', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.743 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj55 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:02.793 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:02.793 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:02.917 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj57', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj57', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:02.917 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj57 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:02.968 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:03.090 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj58', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj58', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.090 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj58 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:03.140 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:03.140 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:03.269 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.269 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj62 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:03.318 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:03.318 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:03.443 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.443 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj68 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:03.494 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:03.494 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:03.617 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.617 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.617 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj69 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:03.666 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:03.667 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:03.793 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj74', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj74', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.794 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj74 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:03.845 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:03.845 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:03.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj76', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj76', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:03.970 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj76 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:04.020 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:04.020 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:04.145 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.146 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj85 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:04.196 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:04.196 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:04.319 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj87', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj87', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.320 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj87 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:04.369 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:04.494 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj92', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj92', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.494 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj92 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:04.544 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:04.544 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:04.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj93', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj93', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.669 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj93 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:04.719 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:04.719 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:04.842 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj95', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'object', 'rm', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--object', 'obj95', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:04.843 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 object rm --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --object obj95 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:04.892 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:04.892 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:05.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'trim', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:05.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'trim', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:05.019 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog trim --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:05.066 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:05.066 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:05.144 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:05.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:05.145 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:05.195 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:05.195 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:05.268 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:05.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'run', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:29:05.268 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync run --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:29:05.319 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:05.319 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:05.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.421+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket: init. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.421 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.421+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: waiting on bucket lease 2024-04-16T18:29:05.426 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.427+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: status after acquiring the lock is: init 2024-04-16T18:29:05.435 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.436+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: listing bucket for full sync 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj11 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj11 op=0 op_state=1 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj11[0] 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj111 op=0 op_state=1 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: : injecting data sync error on key=obj111 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj115 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj115 op=0 op_state=1 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj115[0] 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj116 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj116 op=0 op_state=1 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj116[0] 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj124 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj124 op=0 op_state=1 2024-04-16T18:29:05.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj124[0] 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj145 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj145 op=0 op_state=1 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj145[0] 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj148 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj148 op=0 op_state=1 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj148[0] 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj155 op=0 op_state=1 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: : injecting data sync error on key=obj155 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.490 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj17 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj17 op=0 op_state=1 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj17[0] 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj185 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj185 op=0 op_state=1 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj185[0] 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj19 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj19 op=0 op_state=1 2024-04-16T18:29:05.491 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.482+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj19[0] 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj22 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj22 op=0 op_state=1 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: : injecting data sync error on key=obj22 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj22 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj23 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj23 op=0 op_state=1 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj23[0] 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj29 op=0 op_state=1 2024-04-16T18:29:05.492 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: : injecting data sync error on key=obj29 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj31 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj31 op=0 op_state=1 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj31[0] 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj33 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj33 op=0 op_state=1 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj33[0] 2024-04-16T18:29:05.493 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj34 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj34 op=0 op_state=1 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: : injecting data sync error on key=obj34 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj34 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj37 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj37 op=0 op_state=1 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj37[0] 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj38 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.483+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj38 op=0 op_state=1 2024-04-16T18:29:05.494 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj38[0] 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj44 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj44 op=0 op_state=1 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj44[0] 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj46 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj46 op=0 op_state=1 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj46[0] 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj51 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj51 op=0 op_state=1 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj51[0] 2024-04-16T18:29:05.495 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj55 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj55 op=0 op_state=1 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj55[0] 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj57 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj57 op=0 op_state=1 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj57[0] 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.484+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.485+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj58 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.485+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj58 op=0 op_state=1 2024-04-16T18:29:05.496 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.485+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj58[0] 2024-04-16T18:29:05.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.485+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.485+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj62 2024-04-16T18:29:05.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.485+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj62 op=0 op_state=1 2024-04-16T18:29:05.497 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.485+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj62[0] 2024-04-16T18:29:05.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: success 2024-04-16T18:29:05.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: success 2024-04-16T18:29:05.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj68 2024-04-16T18:29:05.507 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj68 op=0 op_state=1 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj68[0] 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: success 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj69 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj69 op=0 op_state=1 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj69[0] 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj74 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj74 op=0 op_state=1 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: success 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: success 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: success 2024-04-16T18:29:05.508 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.505+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj74[0] 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: success 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: success 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: success 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj76 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj76 op=0 op_state=1 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj76[0] 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj85 op=0 op_state=1 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj85[0] 2024-04-16T18:29:05.509 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: success 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj87 op=0 op_state=1 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj87[0] 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.506+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj92 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj92 op=0 op_state=1 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: success 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: success 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: success 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: success 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: success 2024-04-16T18:29:05.510 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: success 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: success 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj92[0] 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj93 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj93 op=0 op_state=1 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj93[0] 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj95 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj95 op=0 op_state=1 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj95[0] 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: success 2024-04-16T18:29:05.511 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: success 2024-04-16T18:29:05.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: success 2024-04-16T18:29:05.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: success 2024-04-16T18:29:05.512 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.507+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj11 2024-04-16T18:29:05.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.552+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: success 2024-04-16T18:29:05.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.553+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: success 2024-04-16T18:29:05.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.553+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: success 2024-04-16T18:29:05.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.554+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: success 2024-04-16T18:29:05.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.555+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: success 2024-04-16T18:29:05.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.555+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: success 2024-04-16T18:29:05.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.555+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: success 2024-04-16T18:29:05.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.555+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: success 2024-04-16T18:29:05.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.555+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: success 2024-04-16T18:29:05.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.555+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: backing out with sync_status=-5 2024-04-16T18:29:05.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.555+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: ERROR: full sync failed. error: -5 2024-04-16T18:29:05.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.557+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.557+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: waiting on bucket lease 2024-04-16T18:29:05.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.562+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: status after acquiring the lock is: full 2024-04-16T18:29:05.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.570+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: listing bucket for full sync 2024-04-16T18:29:05.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj11 2024-04-16T18:29:05.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj11 op=0 op_state=1 2024-04-16T18:29:05.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj11[0] 2024-04-16T18:29:05.619 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj111 op=0 op_state=1 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj111[0] 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj115 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj115 op=0 op_state=1 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj115[0] 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj116 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj116 op=0 op_state=1 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj116[0] 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj124 2024-04-16T18:29:05.620 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj124 op=0 op_state=1 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj124[0] 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj145 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj145 op=0 op_state=1 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj145[0] 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj148 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj148 op=0 op_state=1 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj148[0] 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.621 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj155 op=0 op_state=1 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj155[0] 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj17 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj17 op=0 op_state=1 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj17[0] 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj185 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj185 op=0 op_state=1 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj185[0] 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj19 2024-04-16T18:29:05.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj19 op=0 op_state=1 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj19[0] 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj22 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj22 op=0 op_state=1 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.616+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj22[0] 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj23 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj23 op=0 op_state=1 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj23[0] 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj29 op=0 op_state=1 2024-04-16T18:29:05.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj29[0] 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj31 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj31 op=0 op_state=1 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj31[0] 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj33 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj33 op=0 op_state=1 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj33[0] 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj34 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj34 op=0 op_state=1 2024-04-16T18:29:05.624 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj34[0] 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj37 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj37 op=0 op_state=1 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj37[0] 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj38 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj38 op=0 op_state=1 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj38[0] 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj44 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj44 op=0 op_state=1 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj44[0] 2024-04-16T18:29:05.625 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj46 2024-04-16T18:29:05.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj46 op=0 op_state=1 2024-04-16T18:29:05.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.617+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj46[0] 2024-04-16T18:29:05.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: success 2024-04-16T18:29:05.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj51 2024-04-16T18:29:05.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj51 op=0 op_state=1 2024-04-16T18:29:05.632 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj51[0] 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: success 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj55 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj55 op=0 op_state=1 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj55[0] 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: success 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj57 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.620+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj57 op=0 op_state=1 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj57[0] 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: success 2024-04-16T18:29:05.633 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj58 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj58 op=0 op_state=1 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj58[0] 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: success 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj62 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj62 op=0 op_state=1 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.621+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj62[0] 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: success 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj68 2024-04-16T18:29:05.634 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj68 op=0 op_state=1 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: : injecting data sync error on key=obj68 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj68 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: success 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj69 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj69 op=0 op_state=1 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj69[0] 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: success 2024-04-16T18:29:05.635 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj74 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj74 op=0 op_state=1 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj74[0] 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: success 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj76 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj76 op=0 op_state=1 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: : injecting data sync error on key=obj76 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj76 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: success 2024-04-16T18:29:05.636 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj85 op=0 op_state=1 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.622+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj85[0] 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: success 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: success 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj87 op=0 op_state=1 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: : injecting data sync error on key=obj87 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.637 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj92 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj92 op=0 op_state=1 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj92[0] 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj93 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj93 op=0 op_state=1 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj93[0] 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: success 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.623+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj124 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.638 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj95 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj95 op=0 op_state=1 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj95[0] 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: success 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: success 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.624+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: success 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.625+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: success 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.625+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: success 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.625+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: success 2024-04-16T18:29:05.639 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.625+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.625+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.625+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.625+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.626+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.626+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.626+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.626+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.626+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.627+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.627+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: success 2024-04-16T18:29:05.640 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.627+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj23 2024-04-16T18:29:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.627+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: success 2024-04-16T18:29:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.627+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: success 2024-04-16T18:29:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.628+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj62 2024-04-16T18:29:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.630+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: backing out with sync_status=-5 2024-04-16T18:29:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.630+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: ERROR: full sync failed. error: -5 2024-04-16T18:29:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.631+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.641 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.631+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: waiting on bucket lease 2024-04-16T18:29:05.676 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.677+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: status after acquiring the lock is: full 2024-04-16T18:29:05.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.685+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: listing bucket for full sync 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.690+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj11 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.690+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj11 op=0 op_state=1 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.690+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj11[0] 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.690+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.690+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj111 op=0 op_state=1 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.690+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj111[0] 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj115 2024-04-16T18:29:05.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj115 op=0 op_state=1 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj115[0] 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj116 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj116 op=0 op_state=1 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: : injecting data sync error on key=obj116 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj116 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj124 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj124 op=0 op_state=1 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj124[0] 2024-04-16T18:29:05.702 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj145 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj145 op=0 op_state=1 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj145[0] 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj148 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj148 op=0 op_state=1 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj148[0] 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj155 op=0 op_state=1 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: : injecting data sync error on key=obj155 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.703 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj17 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj17 op=0 op_state=1 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj17[0] 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj185 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj185 op=0 op_state=1 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj185[0] 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj19 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj19 op=0 op_state=1 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj19[0] 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj22 2024-04-16T18:29:05.704 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj22 op=0 op_state=1 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj22[0] 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj23 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj23 op=0 op_state=1 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj23[0] 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj29 op=0 op_state=1 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj29[0] 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj31 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj31 op=0 op_state=1 2024-04-16T18:29:05.705 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj31[0] 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj33 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj33 op=0 op_state=1 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj33[0] 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj34 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj34 op=0 op_state=1 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj34[0] 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj37 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj37 op=0 op_state=1 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj37[0] 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj38 2024-04-16T18:29:05.706 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj38 op=0 op_state=1 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj38[0] 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj44 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj44 op=0 op_state=1 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.691+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj44[0] 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj46 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj46 op=0 op_state=1 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj46[0] 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj51 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj51 op=0 op_state=1 2024-04-16T18:29:05.707 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj51[0] 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.692+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj55 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.693+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj55 op=0 op_state=1 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.693+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj55[0] 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: success 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj57 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj57 op=0 op_state=1 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj57[0] 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: success 2024-04-16T18:29:05.708 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj58 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj58 op=0 op_state=1 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.694+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj58[0] 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: success 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj62 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj62 op=0 op_state=1 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: : injecting data sync error on key=obj62 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj62 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: success 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj68 2024-04-16T18:29:05.709 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj68 op=0 op_state=1 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj68[0] 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: success 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj69 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj69 op=0 op_state=1 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.695+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj69[0] 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: success 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj74 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj74 op=0 op_state=1 2024-04-16T18:29:05.710 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj74[0] 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj76 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj76 op=0 op_state=1 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj76[0] 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: success 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: success 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: success 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj85 op=0 op_state=1 2024-04-16T18:29:05.711 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: : injecting data sync error on key=obj85 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj87 op=0 op_state=1 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: : injecting data sync error on key=obj87 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj92 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj92 op=0 op_state=1 2024-04-16T18:29:05.712 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj92[0] 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: success 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: success 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj93 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj93 op=0 op_state=1 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: success 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: : injecting data sync error on key=obj93 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj93 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj95 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj95 op=0 op_state=1 2024-04-16T18:29:05.713 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj95[0] 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.696+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.697+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.697+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.697+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.697+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.698+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.698+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: success 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.698+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.714 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.698+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.698+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.698+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.698+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.699+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.699+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.699+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.699+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.699+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.700+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: success 2024-04-16T18:29:05.715 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.700+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj115 2024-04-16T18:29:05.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.701+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: backing out with sync_status=-5 2024-04-16T18:29:05.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.701+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: ERROR: full sync failed. error: -5 2024-04-16T18:29:05.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.703+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.716 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.703+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: waiting on bucket lease 2024-04-16T18:29:05.748 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.749+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: status after acquiring the lock is: full 2024-04-16T18:29:05.756 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.757+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: listing bucket for full sync 2024-04-16T18:29:05.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj11 2024-04-16T18:29:05.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj11 op=0 op_state=1 2024-04-16T18:29:05.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj11[0] 2024-04-16T18:29:05.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj111 op=0 op_state=1 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: : injecting data sync error on key=obj111 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj115 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj115 op=0 op_state=1 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj115[0] 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj116 2024-04-16T18:29:05.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj116 op=0 op_state=1 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj116[0] 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj124 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj124 op=0 op_state=1 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: : injecting data sync error on key=obj124 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj124 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj145 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj145 op=0 op_state=1 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj145[0] 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj148 2024-04-16T18:29:05.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj148 op=0 op_state=1 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: : injecting data sync error on key=obj148 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj148 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj155 op=0 op_state=1 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj155[0] 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj17 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj17 op=0 op_state=1 2024-04-16T18:29:05.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: : injecting data sync error on key=obj17 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj17 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj185 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj185 op=0 op_state=1 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj185[0] 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj19 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj19 op=0 op_state=1 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj19[0] 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj22 2024-04-16T18:29:05.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj22 op=0 op_state=1 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj22[0] 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj23 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj23 op=0 op_state=1 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj23[0] 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj29 op=0 op_state=1 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj29[0] 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj31 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj31 op=0 op_state=1 2024-04-16T18:29:05.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj31[0] 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj33 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj33 op=0 op_state=1 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj33[0] 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj34 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj34 op=0 op_state=1 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj34[0] 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj37 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj37 op=0 op_state=1 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.763+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj37[0] 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj38 2024-04-16T18:29:05.777 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj38 op=0 op_state=1 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj38[0] 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj44 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj44 op=0 op_state=1 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj44[0] 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj46 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj46 op=0 op_state=1 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj46[0] 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj51 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj51 op=0 op_state=1 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj51[0] 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj55 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.764+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj55 op=0 op_state=1 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: : injecting data sync error on key=obj55 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj55 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj57 2024-04-16T18:29:05.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj57 op=0 op_state=1 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: : injecting data sync error on key=obj57 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj57 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj58 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj58 op=0 op_state=1 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.765+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj58[0] 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj62 2024-04-16T18:29:05.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj62 op=0 op_state=1 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj62[0] 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj68 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj68 op=0 op_state=1 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj68[0] 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: success 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj69 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj69 op=0 op_state=1 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.766+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj69[0] 2024-04-16T18:29:05.781 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: success 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj74 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj74 op=0 op_state=1 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj74[0] 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: success 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj76 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj76 op=0 op_state=1 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj76[0] 2024-04-16T18:29:05.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: success 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj85 op=0 op_state=1 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.767+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj85[0] 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: success 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj87 op=0 op_state=1 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj87[0] 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: success 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj92 2024-04-16T18:29:05.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj92 op=0 op_state=1 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj92[0] 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: success 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj93 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj93 op=0 op_state=1 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj93[0] 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: success 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: success 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj95 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj95 op=0 op_state=1 2024-04-16T18:29:05.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj95[0] 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.768+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.769+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.769+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.769+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.770+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.770+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.770+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.770+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.770+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: success 2024-04-16T18:29:05.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.770+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.770+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.771+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.771+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.771+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.771+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.771+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.771+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: success 2024-04-16T18:29:05.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.771+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: success 2024-04-16T18:29:05.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.772+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: success 2024-04-16T18:29:05.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.772+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: success 2024-04-16T18:29:05.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.772+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj11 2024-04-16T18:29:05.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.773+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: backing out with sync_status=-5 2024-04-16T18:29:05.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.773+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: ERROR: full sync failed. error: -5 2024-04-16T18:29:05.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.775+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.775+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: waiting on bucket lease 2024-04-16T18:29:05.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.821+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: status after acquiring the lock is: full 2024-04-16T18:29:05.828 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.829+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: listing bucket for full sync 2024-04-16T18:29:05.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj11 2024-04-16T18:29:05.837 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj11 op=0 op_state=1 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj11[0] 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj111 op=0 op_state=1 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj111[0] 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj115 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj115 op=0 op_state=1 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj115[0] 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj116 2024-04-16T18:29:05.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj116 op=0 op_state=1 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj116[0] 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj124 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj124 op=0 op_state=1 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj124[0] 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj145 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj145 op=0 op_state=1 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: : injecting data sync error on key=obj145 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj145 2024-04-16T18:29:05.839 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj148 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj148 op=0 op_state=1 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj148[0] 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj155 op=0 op_state=1 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj155[0] 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj17 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj17 op=0 op_state=1 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj17[0] 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj185 2024-04-16T18:29:05.840 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj185 op=0 op_state=1 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj185[0] 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj19 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj19 op=0 op_state=1 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj19[0] 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj22 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj22 op=0 op_state=1 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj22[0] 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj23 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj23 op=0 op_state=1 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.834+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj23[0] 2024-04-16T18:29:05.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj29 op=0 op_state=1 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: : injecting data sync error on key=obj29 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj31 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj31 op=0 op_state=1 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj31[0] 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj33 2024-04-16T18:29:05.842 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj33 op=0 op_state=1 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj33[0] 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj34 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj34 op=0 op_state=1 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj34[0] 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj37 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj37 op=0 op_state=1 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj37[0] 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj38 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj38 op=0 op_state=1 2024-04-16T18:29:05.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj38[0] 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj44 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj44 op=0 op_state=1 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj44[0] 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj46 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj46 op=0 op_state=1 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.835+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj46[0] 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj51 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj51 op=0 op_state=1 2024-04-16T18:29:05.844 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj51[0] 2024-04-16T18:29:05.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj55 2024-04-16T18:29:05.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj55 op=0 op_state=1 2024-04-16T18:29:05.845 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.836+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj55[0] 2024-04-16T18:29:05.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: success 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj57 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj57 op=0 op_state=1 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj57[0] 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: success 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj58 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj58 op=0 op_state=1 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj58[0] 2024-04-16T18:29:05.851 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.838+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: success 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: success 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj62 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj62 op=0 op_state=1 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj62[0] 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj68 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj68 op=0 op_state=1 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj68[0] 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: success 2024-04-16T18:29:05.852 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj69 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj69 op=0 op_state=1 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj69[0] 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: success 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj74 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj74 op=0 op_state=1 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj74[0] 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: success 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj76 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj76 op=0 op_state=1 2024-04-16T18:29:05.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj76[0] 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: success 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj85 op=0 op_state=1 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: : injecting data sync error on key=obj85 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: failed, retcode=-5 ((5) Input/output error) 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 0 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: ERROR: failed to sync object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: success 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj87 op=0 op_state=1 2024-04-16T18:29:05.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.839+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj87[0] 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: success 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj92 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj92 op=0 op_state=1 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj92[0] 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: success 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj93 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj93 op=0 op_state=1 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj93[0] 2024-04-16T18:29:05.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: success 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj95 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj95 op=0 op_state=1 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj95[0] 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: success 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: success 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: success 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.840+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: success 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.841+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: a sync operation returned error 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: success 2024-04-16T18:29:05.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj124 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: success 2024-04-16T18:29:05.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: success 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: success 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.843+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: success 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.844+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: success 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.844+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: success 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.844+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: backing out with sync_status=-5 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.844+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: ERROR: full sync failed. error: -5 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.845+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket: full. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.845+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: waiting on bucket lease 2024-04-16T18:29:05.891 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.892+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: status after acquiring the lock is: full 2024-04-16T18:29:05.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.900+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: listing bucket for full sync 2024-04-16T18:29:05.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj11 2024-04-16T18:29:05.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj11 op=0 op_state=1 2024-04-16T18:29:05.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj11[0] 2024-04-16T18:29:05.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj111 2024-04-16T18:29:05.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj111 op=0 op_state=1 2024-04-16T18:29:05.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj111[0] 2024-04-16T18:29:05.908 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj115 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj115 op=0 op_state=1 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj115[0] 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj116 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj116 op=0 op_state=1 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj116[0] 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj124 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj124 op=0 op_state=1 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj124[0] 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj145 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj145 op=0 op_state=1 2024-04-16T18:29:05.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj145[0] 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj148 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj148 op=0 op_state=1 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj148[0] 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj155 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj155 op=0 op_state=1 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj155[0] 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj17 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj17 op=0 op_state=1 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj17[0] 2024-04-16T18:29:05.910 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj185 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj185 op=0 op_state=1 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj185[0] 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj19 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj19 op=0 op_state=1 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj19[0] 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj22 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj22 op=0 op_state=1 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj22[0] 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj23 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj23 op=0 op_state=1 2024-04-16T18:29:05.911 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj23[0] 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj29 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj29 op=0 op_state=1 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj29[0] 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj31 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj31 op=0 op_state=1 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj31[0] 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj33 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj33 op=0 op_state=1 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.906+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj33[0] 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj34 2024-04-16T18:29:05.912 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj34 op=0 op_state=1 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj34[0] 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj37 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj37 op=0 op_state=1 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj37[0] 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj38 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj38 op=0 op_state=1 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj38[0] 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj44 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj44 op=0 op_state=1 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj44[0] 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj46 2024-04-16T18:29:05.913 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj46 op=0 op_state=1 2024-04-16T18:29:05.914 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.907+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj46[0] 2024-04-16T18:29:05.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.909+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj115]: success 2024-04-16T18:29:05.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.909+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj51 2024-04-16T18:29:05.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.909+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj51 op=0 op_state=1 2024-04-16T18:29:05.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.909+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj51[0] 2024-04-16T18:29:05.919 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.909+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj148]: success 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.909+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj55 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj55 op=0 op_state=1 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj55[0] 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj145]: success 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj57 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj57 op=0 op_state=1 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj57[0] 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj11]: success 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj58 2024-04-16T18:29:05.920 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj58 op=0 op_state=1 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj58[0] 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj17]: success 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj62 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj62 op=0 op_state=1 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj62[0] 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj116]: success 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj68 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj68 op=0 op_state=1 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj68[0] 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.910+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj111]: success 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj29]: success 2024-04-16T18:29:05.921 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj69 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj69 op=0 op_state=1 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj69[0] 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj74 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj74 op=0 op_state=1 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj74[0] 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj46]: success 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj76 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj76 op=0 op_state=1 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj76[0] 2024-04-16T18:29:05.922 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj185]: success 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj85 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj85 op=0 op_state=1 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj85[0] 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj34]: success 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj87 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj87 op=0 op_state=1 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj87[0] 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj37]: success 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj92 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj92 op=0 op_state=1 2024-04-16T18:29:05.923 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj92[0] 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj22]: success 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj33]: success 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj93 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj93 op=0 op_state=1 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj93[0] 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: [full sync] syncing object: cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0/obj95 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b=bucket sync single entry (source_zone=9ba59572-f51c-4bce-9578-e6350e822996) b= log_entry=obj95 op=0 op_state=1 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.911+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: bucket sync: sync obj: 9ba59572-f51c-4bce-9578-e6350e822996/:cjqttm-52[9ba59572-f51c-4bce-9578-e6350e822996.4816.21])/obj95[0] 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.912+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj31]: success 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.912+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj155]: success 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.912+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj19]: success 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.913+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj124]: success 2024-04-16T18:29:05.924 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.913+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj22 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.913+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj23]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.913+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj44]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.913+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj51]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.913+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj57]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.914+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj38]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.915+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj58]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.915+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj55]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.915+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj69]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.915+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj87]: success 2024-04-16T18:29:05.925 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.915+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj85]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.915+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj68]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj62]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj69 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj74]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj92]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj95]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj76]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:entry[obj93]: success 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.916+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: updating marker oid=bucket.full-sync-status.9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21 marker=obj95 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.918+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: set bucket state=incremental 2024-04-16T18:29:05.926 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.919+0000 7f4626e67800 5 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:full_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: bucket status objv={r=_Rc32QvVsRfNjgPcgcC6-NL6:153,w=:0} 2024-04-16T18:29:05.927 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.920+0000 7f4626e67800 10 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: WARNING: requested sync of past generation 0 < 6, returning success 2024-04-16T18:29:05.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.922+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.922+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:2]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.922+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:1]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.922+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:3]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:4]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:2]: sync status for source bucket shard: 2 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:2]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:2]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: sync status for source bucket shard: 2 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:0]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:5]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:3]: sync status for source bucket shard: 2 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:3]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:3]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:4]: sync status for source bucket shard: 2 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:4]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:4]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:7]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:1]: sync status for source bucket shard: 2 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:1]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:1]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.923+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:6]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:8]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:5]: sync status for source bucket shard: 2 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:5]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:5]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:9]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:7]: sync status for source bucket shard: 2 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:7]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:7]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:10]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:6]: sync status for source bucket shard: 2 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:6]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:6]: listing bilog for incremental sync; position=00000000002.92.6 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:8]: sync status for source bucket shard: 2 2024-04-16T18:29:05.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:8]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:8]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:9]: sync status for source bucket shard: 2 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:9]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:9]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:11]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.924+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:12]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:10]: sync status for source bucket shard: 2 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:10]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:10]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:13]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:14]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:11]: sync status for source bucket shard: 2 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:11]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:11]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:12]: sync status for source bucket shard: 2 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:12]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:12]: listing bilog for incremental sync; position=00000000002.83.6 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:15]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:14]: sync status for source bucket shard: 2 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:17]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:14]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:14]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:13]: sync status for source bucket shard: 2 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.925+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:13]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:13]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:16]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:15]: sync status for source bucket shard: 2 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:18]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:15]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:15]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:19]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:17]: sync status for source bucket shard: 2 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:17]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:17]: listing bilog for incremental sync; position=00000000002.54.6 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:20]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:16]: sync status for source bucket shard: 2 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:16]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:16]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:21]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.926+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:18]: sync status for source bucket shard: 2 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:19]: sync status for source bucket shard: 2 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:18]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:18]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:19]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:19]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:22]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:20]: sync status for source bucket shard: 2 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:20]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:20]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:21]: sync status for source bucket shard: 2 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:21]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:21]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:23]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:22]: sync status for source bucket shard: 2 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:22]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:22]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:24]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:25]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:23]: sync status for source bucket shard: 2 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.927+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:23]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:23]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:26]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:24]: sync status for source bucket shard: 2 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:24]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:24]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:27]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:25]: sync status for source bucket shard: 2 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:25]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:25]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:26]: sync status for source bucket shard: 2 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:28]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:26]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:26]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:29]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:27]: sync status for source bucket shard: 2 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.928+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:27]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:27]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:30]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:28]: sync status for source bucket shard: 2 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:28]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:28]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:31]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:29]: sync status for source bucket shard: 2 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:29]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:29]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:30]: sync status for source bucket shard: 2 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:30]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:30]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:33]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:32]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:31]: sync status for source bucket shard: 2 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:31]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:31]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.929+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:35]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:34]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:33]: sync status for source bucket shard: 2 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:33]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:33]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:32]: sync status for source bucket shard: 2 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:32]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:32]: listing bilog for incremental sync; position=00000000001.56.6 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:36]: sync status for source bucket: incremental. lease is: not taken. stop indications is: 0 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:35]: sync status for source bucket shard: 2 2024-04-16T18:29:05.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:35]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:35]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:34]: sync status for source bucket shard: 2 2024-04-16T18:29:05.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:34]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:34]: listing bilog for incremental sync; position= 2024-04-16T18:29:05.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:36]: sync status for source bucket shard: 2 2024-04-16T18:29:05.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:05.930+0000 7f4626e67800 20 RGW-SYNC:bucket[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21<-cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:36]:inc_sync[cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21:36]: listing bilog for incremental sync; position=00000000001.53.6 2024-04-16T18:29:06.002 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:06.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'list', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--max-entries', '10000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:06.002 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket list --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --max-entries 10000 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:06.058 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:06.059 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:06.140 INFO:teuthology.orchestra.run.smithi016.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:19:55.888069Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.2499448628699075834","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:27:48.337700Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.14598714492824566309","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:49.363631Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.5879205975389450116","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:24:09.555468Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17754310115765866422","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:26:26.393396Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1149388347203225791","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:24:09.578210Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.15947762210676739198","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:27:48.408275Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.14873490701998482941","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.443567Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.7608337489878399146","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.434395Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.14405759607852769484","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:27:48.419829Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.6891703220478081949","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:05.060964Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1594504079717010908","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:19:55.899996Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.5532113083596405052","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:49.242789Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.8647902515730934474","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:24:09.446766Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.16081205713416368025","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.325769Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17138394856725178408","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:19:55.909265Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1550388662960970649","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.444565Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.6761128262943720462","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:27:48.316106Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.8769890885978495245","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:05.070730Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.9612166387389636991","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:19:55.959731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1905165816037926736","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:21:49.253253Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.16438559338751980734","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:20:07.491221Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.217696158234805604","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:19:55.976055Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.1926188215521230165","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:05.079146Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.7039256434707428323","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:24:09.495967Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17635468415654775086","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:26:26.336771Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.2162797970744384616","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:20:07.502412Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.11926050562798828945","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:49.305190Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17420051191343345695","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:27:48.327015Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.2476753734387853833","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:05.127367Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.13137875733316491856","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:20:07.513161Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.990615892669087952","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:24:09.506704Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.4008705764506104647","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:49.315840Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.12071810891177361114","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.383222Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.4894147154610440019","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":0},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:05.137388Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"9ba59572-f51c-4bce-9578-e6350e822996.4816.17159709816637728998","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-16T18:29:06.140 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:06.140 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'list', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-52', '--max-entries', '10000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:06.140 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket list --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-52 --max-entries 10000 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:06.191 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:06.263 INFO:teuthology.orchestra.run.smithi139.stdout:[{"name":"obj11","instance":"","ver":{"pool":9,"epoch":16},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:19:55.888069Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_LCcRh1nlS4Lk9wQ3WQMtA42Lgvowekt","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj111","instance":"","ver":{"pool":9,"epoch":14},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:27:48.337700Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_gbRTJdNjBuFajJEJ9FsZWQNDXprOlRR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj115","instance":"","ver":{"pool":9,"epoch":17},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:49.363631Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_NhlEti7GVMczfHFhGBLCG10LY05n4XC","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj116","instance":"","ver":{"pool":9,"epoch":6},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:24:09.555468Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_rpon2q8F6i9uEgOk7U6IzJnF7yuGDdR","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj124","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.393396Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_HFV9JECX9Va3RhZCs2f5sxYWMMS1tsD","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj145","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:24:09.578210Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_AudUgjg-JcWWDBxil3qXGNtxA3wZ_Rg","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj148","instance":"","ver":{"pool":9,"epoch":12},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:27:48.408275Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_JsTFVM1BnWeb7X_mkIl-NkKCxLr0eJl","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj155","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.443567Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_lFCOIrZMEMEX-Zr-x48ubOw_H3DMTvX","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj17","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.434395Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_7-gtnmDun2HxQsGH-RSUkaLY8iXpIEk","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj185","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:27:48.419829Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_kb2Nf79egtLs-XjRMd_AzE_NzYiIvQv","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj19","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:05.060964Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_3b9v-4yJR6hxfzosHfkqPe8GghuW6gu","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj22","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:19:55.899996Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_SucrvQI5GCWn1Ls1yNT6x8CQRjVC3eE","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj23","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:49.242789Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ViavLa0D8jwgIqFIxOVN8F69-TgzjQj","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj29","instance":"","ver":{"pool":9,"epoch":17},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:24:09.446766Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_uJEdH4tu4DkdqrxsnD69bZnPdfsUV4l","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj31","instance":"","ver":{"pool":9,"epoch":13},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.325769Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_b7mWTIlhnv6DAflJu7ErS2Bzf5C__yD","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj33","instance":"","ver":{"pool":9,"epoch":9},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:19:55.909265Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_B4VJmFMxqNA5DgdY7W16jIUan5tUdmb","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj34","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.444565Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_d3U4SCnPhEaLgeQfU4nx0PwGqAVWDDx","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj37","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:27:48.316106Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Z9QOpNophZKuLGRxOoiN0t9EHTdHhJk","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj38","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:05.070730Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_ojQk264zFyQalZLuqllhSdIMP30Ro5q","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj44","instance":"","ver":{"pool":9,"epoch":7},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:19:55.959731Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_vE3OYxCSaU2Nf_MnFO2yOKb3j0DDJ7h","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj46","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:49.253253Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_wbkPID7Y1lIkuGs5PJ38ofXTsyjFwKe","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj51","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:20:07.491221Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_pcF24Qp3MlihK4iYUjKGGGDMFSNP6K7","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj55","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:19:55.976055Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"__FrXM1viA-4hOqOzxozkQiTOSujNa0O","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj57","instance":"","ver":{"pool":9,"epoch":5},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:05.079146Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_a-bAC4WZfP2rB6H7Zp_xYrXo63v5K2I","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj58","instance":"","ver":{"pool":9,"epoch":19},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:24:09.495967Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_Oku4xSFHgRoeb4DT8c2VjAGrV7UQq3h","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj62","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.336771Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_xfzQQvg-YhXTFQphlHlopFXDepgRqvc","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj68","instance":"","ver":{"pool":9,"epoch":10},"locator":"","exists":true,"meta":{"category":1,"size":6,"mtime":"2024-04-16T18:20:07.502412Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_M_Psac44Sp0sDiFwpsR5w2K9UuQqGOd","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj69","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:49.305190Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_a0vcYwYO4oC5d1ikKkuIidh2oWCYNhm","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj74","instance":"","ver":{"pool":9,"epoch":11},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:27:48.327015Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_-LlmAHta7K9kinIB6jy9Kw_nRwBfGq9","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj76","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":5,"mtime":"2024-04-16T18:21:05.127367Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_XHEDGY6FHhQj1_01P_AhGwWNRUysCCQ","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj85","instance":"","ver":{"pool":9,"epoch":17},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:20:07.513161Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_qsMxG7JiC9y5CSWjmhXJrYCXBbbD5QS","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj87","instance":"","ver":{"pool":9,"epoch":41},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:24:09.506704Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_kxbP4WYJsQeIO__i8S0kQ_0jD9nNhXF","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj92","instance":"","ver":{"pool":9,"epoch":8},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:21:49.315840Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_6-M34NIRM_l31CkdYXqkkjzHtaoLzPP","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj93","instance":"","ver":{"pool":9,"epoch":13},"locator":"","exists":true,"meta":{"category":1,"size":16,"mtime":"2024-04-16T18:26:26.383222Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_b5zYmQgBOaKxO4iYjdGwO8N_7SdCwZz","flags":0,"pending_map":[],"versioned_epoch":0},{"name":"obj95","instance":"","ver":{"pool":9,"epoch":14},"locator":"","exists":true,"meta":{"category":1,"size":3,"mtime":"2024-04-16T18:21:05.137388Z","etag":"acbd18db4cc2f85cedef654fccc4a4d8","storage_class":"","owner":"RGW11111111111111111","owner_display_name":"","content_type":"application/octet-stream","accounted_size":3,"user_data":"","appendable":false},"tag":"_1bw0Qd_O7wnze1gTeI0Ts15gpr-R36g","flags":0,"pending_map":[],"versioned_epoch":0}] 2024-04-16T18:29:06.263 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:29:06.264 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:29:06.266 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:29:06.266 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:06.285 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:29:06.286 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:29:06.286 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:29:06.286 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:29:06.286 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:29:06.457 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:29:06.459+0000 7f8be22e5880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:29:07.288 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:07.308 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:29:07.308 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:29:07.308 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:29:07.309 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:29:07.309 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-52 2024-04-16T18:29:07.309 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:29:07.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:29:07.310 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:29:07.405 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:07.405 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:07.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:07.464+0000 7f4c4c610800 1 bucket sync caught up with source: 2024-04-16T18:29:07.462 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:29:07.462 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.92.6, , , , , , 00000000002.83.6, , , , , 00000000002.54.6, , , , , , , , , , , , , , , 00000000001.56.6, , , , 00000000001.53.6] 2024-04-16T18:29:07.463 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:07.464+0000 7f4c4c610800 0 bucket checkpoint complete 2024-04-16T18:29:07.483 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-52 2024-04-16T18:29:07.483 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:29:07.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-52', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:29:07.484 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-52 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:29:07.546 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:07.546 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:07.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:29:07.609+0000 7f18d862d800 1 bucket sync caught up with source: 2024-04-16T18:29:07.610 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000009.571.6, 00000000006.692.6, 00000000006.1324.6, 00000000015.465.6, 00000000012.302.6, 00000000003.407.6, 00000000003.566.6, 00000000012.910.6, 00000000021.209.6, 00000000018.806.6] 2024-04-16T18:29:07.610 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000009.571.6, 00000000006.692.6, 00000000006.1324.6, 00000000015.465.6, 00000000012.302.6, 00000000003.407.6, 00000000003.566.6, 00000000012.910.6, 00000000021.209.6, 00000000018.806.6] 2024-04-16T18:29:07.610 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:29:07.609+0000 7f18d862d800 0 bucket checkpoint complete 2024-04-16T18:29:07.632 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:29:07.633 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:07.633 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:07.633 DEBUG:boto:Method: HEAD 2024-04-16T18:29:07.633 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:29:07.633 DEBUG:boto:Data: 2024-04-16T18:29:07.633 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.633 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:07.633 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.633 DEBUG:boto:Params: {} 2024-04-16T18:29:07.633 DEBUG:boto:Token: None 2024-04-16T18:29:07.634 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/ 2024-04-16T18:29:07.634 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:quajVXgJ+hGHhkZRzYI6wbLxmm4= 2024-04-16T18:29:07.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:quajVXgJ+hGHhkZRzYI6wbLxmm4=', 'Content-Length': '0'} 2024-04-16T18:29:07.634 DEBUG:boto:encountered RemoteDisconnected exception, reconnecting 2024-04-16T18:29:07.635 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:29:07.871 DEBUG:boto:Token: None 2024-04-16T18:29:07.871 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/ 2024-04-16T18:29:07.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:quajVXgJ+hGHhkZRzYI6wbLxmm4= 2024-04-16T18:29:07.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:quajVXgJ+hGHhkZRzYI6wbLxmm4=', 'Content-Length': '0'} 2024-04-16T18:29:07.878 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002e28168d5b21a00b-00661ec373-6094-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.878 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:07.878 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:07.878 DEBUG:boto:Method: HEAD 2024-04-16T18:29:07.878 DEBUG:boto:Path: /cjqttm-52/ 2024-04-16T18:29:07.879 DEBUG:boto:Data: 2024-04-16T18:29:07.879 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:07.879 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.879 DEBUG:boto:Params: {} 2024-04-16T18:29:07.879 DEBUG:boto:Token: None 2024-04-16T18:29:07.879 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/ 2024-04-16T18:29:07.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:quajVXgJ+hGHhkZRzYI6wbLxmm4= 2024-04-16T18:29:07.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:quajVXgJ+hGHhkZRzYI6wbLxmm4=', 'Content-Length': '0'} 2024-04-16T18:29:07.883 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069ef5de01c3c77a7-00661ec373-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.883 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:29:07.883 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:07.883 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:07.883 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.883 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.883 DEBUG:boto:Method: GET 2024-04-16T18:29:07.883 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.883 DEBUG:boto:Data: 2024-04-16T18:29:07.883 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.884 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:07.884 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.884 DEBUG:boto:Params: {} 2024-04-16T18:29:07.884 DEBUG:boto:Token: None 2024-04-16T18:29:07.884 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/?versions 2024-04-16T18:29:07.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98= 2024-04-16T18:29:07.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98=', 'Content-Length': '0'} 2024-04-16T18:29:07.887 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b69fa40bfb1a57fb-00661ec373-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.887 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:07.888 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:29:07.888 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:29:07.889 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:29:07.890 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:29:07.891 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:29:07.891 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:07.891 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:07.892 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.892 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.892 DEBUG:boto:Method: GET 2024-04-16T18:29:07.892 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.892 DEBUG:boto:Data: 2024-04-16T18:29:07.892 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.892 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:07.892 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.892 DEBUG:boto:Params: {} 2024-04-16T18:29:07.892 DEBUG:boto:Token: None 2024-04-16T18:29:07.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/?versions 2024-04-16T18:29:07.893 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98= 2024-04-16T18:29:07.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98=', 'Content-Length': '0'} 2024-04-16T18:29:07.897 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c8306a8fa48999cf-00661ec373-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.897 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:07.898 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:29:07.898 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:29:07.898 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:29:07.899 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:29:07.900 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:29:07.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:29:07.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:29:07.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:29:07.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:29:07.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:29:07.901 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:29:07.901 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:07.901 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:07.901 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.901 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.901 DEBUG:boto:Method: GET 2024-04-16T18:29:07.901 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.902 DEBUG:boto:Data: 2024-04-16T18:29:07.902 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.902 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:07.902 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.902 DEBUG:boto:Params: {} 2024-04-16T18:29:07.902 DEBUG:boto:Token: None 2024-04-16T18:29:07.902 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/?versions 2024-04-16T18:29:07.902 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98= 2024-04-16T18:29:07.902 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98=', 'Content-Length': '0'} 2024-04-16T18:29:07.905 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d4fe9fdf5d6d0012-00661ec373-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.905 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:07.906 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:07.906 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:07.907 DEBUG:boto:path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.907 DEBUG:boto:auth_path=/cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.907 DEBUG:boto:Method: GET 2024-04-16T18:29:07.907 DEBUG:boto:Path: /cjqttm-52/?versions&max-keys=999 2024-04-16T18:29:07.907 DEBUG:boto:Data: 2024-04-16T18:29:07.907 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.907 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:07.907 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.907 DEBUG:boto:Params: {} 2024-04-16T18:29:07.907 DEBUG:boto:Token: None 2024-04-16T18:29:07.907 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/?versions 2024-04-16T18:29:07.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98= 2024-04-16T18:29:07.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acG1+9T+qOjUDGls5lfcf/XuD98=', 'Content-Length': '0'} 2024-04-16T18:29:07.911 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004bca41eb6833e4e9-00661ec373-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.911 DEBUG:boto:b'cjqttm-52999falseobj11nulltrue2024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:07.912 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:29:07.913 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:07.913 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:07.913 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.913 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.913 DEBUG:boto:Method: GET 2024-04-16T18:29:07.913 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.913 DEBUG:boto:Data: 2024-04-16T18:29:07.913 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.913 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:07.913 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.913 DEBUG:boto:Params: {} 2024-04-16T18:29:07.913 DEBUG:boto:Token: None 2024-04-16T18:29:07.914 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.914 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uwIw6Wwn+L1pnJU7SnkBz8VM7UY= 2024-04-16T18:29:07.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uwIw6Wwn+L1pnJU7SnkBz8VM7UY=', 'Content-Length': '0'} 2024-04-16T18:29:07.916 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000204e91060aeca22b-00661ec373-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.916 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:07.917 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:07.917 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.917 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.917 DEBUG:boto:Method: GET 2024-04-16T18:29:07.917 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.917 DEBUG:boto:Data: 2024-04-16T18:29:07.917 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.917 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:07.917 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.917 DEBUG:boto:Params: {} 2024-04-16T18:29:07.917 DEBUG:boto:Token: None 2024-04-16T18:29:07.918 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.918 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uwIw6Wwn+L1pnJU7SnkBz8VM7UY= 2024-04-16T18:29:07.918 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uwIw6Wwn+L1pnJU7SnkBz8VM7UY=', 'Content-Length': '0'} 2024-04-16T18:29:07.920 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073155adab1abd0f2-00661ec373-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.966 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:07.966 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:07.967 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.967 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.967 DEBUG:boto:Method: HEAD 2024-04-16T18:29:07.967 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.967 DEBUG:boto:Data: 2024-04-16T18:29:07.967 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:07.967 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.967 DEBUG:boto:Params: {} 2024-04-16T18:29:07.967 DEBUG:boto:Token: None 2024-04-16T18:29:07.968 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5bAqP0vUBe1i1/RQUeMHXgnTms= 2024-04-16T18:29:07.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5bAqP0vUBe1i1/RQUeMHXgnTms=', 'Content-Length': '0'} 2024-04-16T18:29:07.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008238cac5b42ffeb4-00661ec373-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.970 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:07.970 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:07.970 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.971 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.971 DEBUG:boto:Method: HEAD 2024-04-16T18:29:07.971 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.971 DEBUG:boto:Data: 2024-04-16T18:29:07.971 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:07.971 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.971 DEBUG:boto:Params: {} 2024-04-16T18:29:07.971 DEBUG:boto:Token: None 2024-04-16T18:29:07.972 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r5bAqP0vUBe1i1/RQUeMHXgnTms= 2024-04-16T18:29:07.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r5bAqP0vUBe1i1/RQUeMHXgnTms=', 'Content-Length': '0'} 2024-04-16T18:29:07.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f07c3ff718a9ab35-00661ec373-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:07.974 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:29:07.974 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:07.974 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:07.974 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.974 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.974 DEBUG:boto:Method: GET 2024-04-16T18:29:07.974 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.975 DEBUG:boto:Data: 2024-04-16T18:29:07.975 DEBUG:boto:Headers: {} 2024-04-16T18:29:07.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:07.975 DEBUG:boto:Port: 8000 2024-04-16T18:29:07.975 DEBUG:boto:Params: {} 2024-04-16T18:29:07.975 DEBUG:boto:Token: None 2024-04-16T18:29:07.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:07 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:07.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uwIw6Wwn+L1pnJU7SnkBz8VM7UY= 2024-04-16T18:29:07.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uwIw6Wwn+L1pnJU7SnkBz8VM7UY=', 'Content-Length': '0'} 2024-04-16T18:29:07.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069aa0afe0ec8dc0c-00661ec373-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.018 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:08.028 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:08.028 DEBUG:boto:path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:08.028 DEBUG:boto:auth_path=/cjqttm-52/obj11?versionId=null 2024-04-16T18:29:08.028 DEBUG:boto:Method: GET 2024-04-16T18:29:08.028 DEBUG:boto:Path: /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:08.028 DEBUG:boto:Data: 2024-04-16T18:29:08.028 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.028 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.028 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.028 DEBUG:boto:Params: {} 2024-04-16T18:29:08.029 DEBUG:boto:Token: None 2024-04-16T18:29:08.029 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj11?versionId=null 2024-04-16T18:29:08.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yHxYLmRXFZgEkdzGprkyALJ/uT0= 2024-04-16T18:29:08.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yHxYLmRXFZgEkdzGprkyALJ/uT0=', 'Content-Length': '0'} 2024-04-16T18:29:08.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e744cfa31048bed-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.031 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.031 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.031 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.032 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.032 DEBUG:boto:Method: GET 2024-04-16T18:29:08.032 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.032 DEBUG:boto:Data: 2024-04-16T18:29:08.032 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.032 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.032 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.032 DEBUG:boto:Params: {} 2024-04-16T18:29:08.032 DEBUG:boto:Token: None 2024-04-16T18:29:08.033 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.033 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.035 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4db1796846a2f6a-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.035 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.036 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.036 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.036 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.036 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.036 DEBUG:boto:Method: GET 2024-04-16T18:29:08.036 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.036 DEBUG:boto:Data: 2024-04-16T18:29:08.036 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.036 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.036 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.037 DEBUG:boto:Params: {} 2024-04-16T18:29:08.037 DEBUG:boto:Token: None 2024-04-16T18:29:08.037 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.037 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.040 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c1258c2a0bae6d1-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.041 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.041 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:08.041 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:08.041 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.042 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:29:08.042 DEBUG:boto:Data: 2024-04-16T18:29:08.042 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.042 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.042 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.042 DEBUG:boto:Params: {} 2024-04-16T18:29:08.042 DEBUG:boto:Token: None 2024-04-16T18:29:08.042 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj11 2024-04-16T18:29:08.042 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rM6ab/d56GCJXDI0JpPBoF6Y8vs= 2024-04-16T18:29:08.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rM6ab/d56GCJXDI0JpPBoF6Y8vs=', 'Content-Length': '0'} 2024-04-16T18:29:08.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000614a571a2a11278d-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.045 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:08.045 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:08.045 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.045 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:29:08.045 DEBUG:boto:Data: 2024-04-16T18:29:08.045 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.045 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.045 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.045 DEBUG:boto:Params: {} 2024-04-16T18:29:08.046 DEBUG:boto:Token: None 2024-04-16T18:29:08.046 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj11 2024-04-16T18:29:08.046 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rM6ab/d56GCJXDI0JpPBoF6Y8vs= 2024-04-16T18:29:08.046 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rM6ab/d56GCJXDI0JpPBoF6Y8vs=', 'Content-Length': '0'} 2024-04-16T18:29:08.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc27552c83f83924-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.048 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:29:08.048 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:08.049 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:08.049 DEBUG:boto:Method: GET 2024-04-16T18:29:08.049 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:29:08.049 DEBUG:boto:Data: 2024-04-16T18:29:08.049 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.049 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.049 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.049 DEBUG:boto:Params: {} 2024-04-16T18:29:08.049 DEBUG:boto:Token: None 2024-04-16T18:29:08.049 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj11 2024-04-16T18:29:08.050 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:edS70U4UeOaGzkgR1JBSPwh8pWY= 2024-04-16T18:29:08.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:edS70U4UeOaGzkgR1JBSPwh8pWY=', 'Content-Length': '0'} 2024-04-16T18:29:08.052 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037646a396562dd3c-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.094 DEBUG:boto:path=/cjqttm-52/obj11 2024-04-16T18:29:08.094 DEBUG:boto:auth_path=/cjqttm-52/obj11 2024-04-16T18:29:08.095 DEBUG:boto:Method: GET 2024-04-16T18:29:08.095 DEBUG:boto:Path: /cjqttm-52/obj11 2024-04-16T18:29:08.095 DEBUG:boto:Data: 2024-04-16T18:29:08.095 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.095 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.095 DEBUG:boto:Params: {} 2024-04-16T18:29:08.095 DEBUG:boto:Token: None 2024-04-16T18:29:08.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj11 2024-04-16T18:29:08.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:edS70U4UeOaGzkgR1JBSPwh8pWY= 2024-04-16T18:29:08.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:edS70U4UeOaGzkgR1JBSPwh8pWY=', 'Content-Length': '0'} 2024-04-16T18:29:08.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a6fe9ae20edd23cf-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.098 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.098 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.098 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.098 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.099 DEBUG:boto:Method: GET 2024-04-16T18:29:08.099 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.099 DEBUG:boto:Data: 2024-04-16T18:29:08.099 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.099 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.099 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.099 DEBUG:boto:Params: {} 2024-04-16T18:29:08.099 DEBUG:boto:Token: None 2024-04-16T18:29:08.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b171944a69e0792-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.102 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.102 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.103 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.103 DEBUG:boto:path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.103 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.103 DEBUG:boto:Method: GET 2024-04-16T18:29:08.103 DEBUG:boto:Path: /cjqttm-52/?prefix=obj11 2024-04-16T18:29:08.103 DEBUG:boto:Data: 2024-04-16T18:29:08.103 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.103 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.103 DEBUG:boto:Params: {} 2024-04-16T18:29:08.104 DEBUG:boto:Token: None 2024-04-16T18:29:08.104 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.107 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013b55da8015a606d-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.108 DEBUG:boto:b'cjqttm-52obj111000falseobj112024-04-16T18:19:55.888Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:29:08.108 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.108 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.108 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.109 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.109 DEBUG:boto:Method: GET 2024-04-16T18:29:08.109 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.109 DEBUG:boto:Data: 2024-04-16T18:29:08.109 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.109 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.109 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.109 DEBUG:boto:Params: {} 2024-04-16T18:29:08.109 DEBUG:boto:Token: None 2024-04-16T18:29:08.110 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.110 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0= 2024-04-16T18:29:08.110 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0=', 'Content-Length': '0'} 2024-04-16T18:29:08.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000076c1aa78ee38f408-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.113 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.113 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.113 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.113 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.113 DEBUG:boto:Method: GET 2024-04-16T18:29:08.114 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.114 DEBUG:boto:Data: 2024-04-16T18:29:08.114 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.114 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.114 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.114 DEBUG:boto:Params: {} 2024-04-16T18:29:08.114 DEBUG:boto:Token: None 2024-04-16T18:29:08.114 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0= 2024-04-16T18:29:08.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0=', 'Content-Length': '0'} 2024-04-16T18:29:08.116 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000602abbe9aa86861-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.117 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.117 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.117 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.117 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.117 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.117 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.117 DEBUG:boto:Data: 2024-04-16T18:29:08.118 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.118 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.118 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.118 DEBUG:boto:Params: {} 2024-04-16T18:29:08.118 DEBUG:boto:Token: None 2024-04-16T18:29:08.118 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.118 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+QP9ZcaEtamNloJONehtPman40Q= 2024-04-16T18:29:08.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+QP9ZcaEtamNloJONehtPman40Q=', 'Content-Length': '0'} 2024-04-16T18:29:08.120 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a4bb4c917661dd7-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.120 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.120 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.121 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.121 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.121 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.121 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.121 DEBUG:boto:Data: 2024-04-16T18:29:08.121 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.121 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.121 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.121 DEBUG:boto:Params: {} 2024-04-16T18:29:08.122 DEBUG:boto:Token: None 2024-04-16T18:29:08.122 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.122 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+QP9ZcaEtamNloJONehtPman40Q= 2024-04-16T18:29:08.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+QP9ZcaEtamNloJONehtPman40Q=', 'Content-Length': '0'} 2024-04-16T18:29:08.124 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfbbc28320d2a86f-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.124 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:29:08.124 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.124 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.124 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.124 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.124 DEBUG:boto:Method: GET 2024-04-16T18:29:08.125 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.125 DEBUG:boto:Data: 2024-04-16T18:29:08.125 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.125 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.125 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.125 DEBUG:boto:Params: {} 2024-04-16T18:29:08.125 DEBUG:boto:Token: None 2024-04-16T18:29:08.125 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.125 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0= 2024-04-16T18:29:08.126 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0=', 'Content-Length': '0'} 2024-04-16T18:29:08.127 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000090bdddbcff5c2fa4-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.128 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.128 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.128 DEBUG:boto:path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.128 DEBUG:boto:auth_path=/cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.128 DEBUG:boto:Method: GET 2024-04-16T18:29:08.128 DEBUG:boto:Path: /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.128 DEBUG:boto:Data: 2024-04-16T18:29:08.128 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.129 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.129 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.129 DEBUG:boto:Params: {} 2024-04-16T18:29:08.129 DEBUG:boto:Token: None 2024-04-16T18:29:08.129 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111?versionId=null 2024-04-16T18:29:08.129 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0= 2024-04-16T18:29:08.129 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/f5jOMozF387HiW3bP4PggSMZO0=', 'Content-Length': '0'} 2024-04-16T18:29:08.131 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3d36f852d3317ae-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.131 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.131 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.131 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.131 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.132 DEBUG:boto:Method: GET 2024-04-16T18:29:08.132 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.132 DEBUG:boto:Data: 2024-04-16T18:29:08.132 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.132 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.132 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.132 DEBUG:boto:Params: {} 2024-04-16T18:29:08.132 DEBUG:boto:Token: None 2024-04-16T18:29:08.132 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.133 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.133 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.135 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009cb02d4ff21f7563-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.135 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.135 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.135 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.135 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.136 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.136 DEBUG:boto:Method: GET 2024-04-16T18:29:08.136 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.136 DEBUG:boto:Data: 2024-04-16T18:29:08.136 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.136 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.136 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.136 DEBUG:boto:Params: {} 2024-04-16T18:29:08.136 DEBUG:boto:Token: None 2024-04-16T18:29:08.136 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.137 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.140 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a8643aebf743592-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.140 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.140 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.141 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.141 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.141 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:29:08.141 DEBUG:boto:Data: 2024-04-16T18:29:08.141 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.141 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.141 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.141 DEBUG:boto:Params: {} 2024-04-16T18:29:08.141 DEBUG:boto:Token: None 2024-04-16T18:29:08.142 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111 2024-04-16T18:29:08.142 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vsfZnJoxGtXp8+gUHOdWkFXCtSI= 2024-04-16T18:29:08.142 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vsfZnJoxGtXp8+gUHOdWkFXCtSI=', 'Content-Length': '0'} 2024-04-16T18:29:08.143 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1b3bfa5d90b220b-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.144 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.144 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.144 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.144 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:29:08.144 DEBUG:boto:Data: 2024-04-16T18:29:08.144 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.144 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.145 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.145 DEBUG:boto:Params: {} 2024-04-16T18:29:08.145 DEBUG:boto:Token: None 2024-04-16T18:29:08.145 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111 2024-04-16T18:29:08.145 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vsfZnJoxGtXp8+gUHOdWkFXCtSI= 2024-04-16T18:29:08.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vsfZnJoxGtXp8+gUHOdWkFXCtSI=', 'Content-Length': '0'} 2024-04-16T18:29:08.147 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000069ef53c5970dfc7e-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.147 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:29:08.147 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.147 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.147 DEBUG:boto:Method: GET 2024-04-16T18:29:08.147 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:29:08.147 DEBUG:boto:Data: 2024-04-16T18:29:08.148 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.148 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.148 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.148 DEBUG:boto:Params: {} 2024-04-16T18:29:08.148 DEBUG:boto:Token: None 2024-04-16T18:29:08.148 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111 2024-04-16T18:29:08.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gA3baIUXS3Q6MQF3/2i/oavNnM4= 2024-04-16T18:29:08.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gA3baIUXS3Q6MQF3/2i/oavNnM4=', 'Content-Length': '0'} 2024-04-16T18:29:08.150 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000604f6b1a7ac4ee8b-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.194 DEBUG:boto:path=/cjqttm-52/obj111 2024-04-16T18:29:08.194 DEBUG:boto:auth_path=/cjqttm-52/obj111 2024-04-16T18:29:08.194 DEBUG:boto:Method: GET 2024-04-16T18:29:08.195 DEBUG:boto:Path: /cjqttm-52/obj111 2024-04-16T18:29:08.195 DEBUG:boto:Data: 2024-04-16T18:29:08.195 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.195 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.195 DEBUG:boto:Params: {} 2024-04-16T18:29:08.195 DEBUG:boto:Token: None 2024-04-16T18:29:08.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj111 2024-04-16T18:29:08.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gA3baIUXS3Q6MQF3/2i/oavNnM4= 2024-04-16T18:29:08.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gA3baIUXS3Q6MQF3/2i/oavNnM4=', 'Content-Length': '0'} 2024-04-16T18:29:08.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db518e4921662f33-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.198 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.198 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.198 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.198 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.198 DEBUG:boto:Method: GET 2024-04-16T18:29:08.198 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.198 DEBUG:boto:Data: 2024-04-16T18:29:08.198 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.198 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.199 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.199 DEBUG:boto:Params: {} 2024-04-16T18:29:08.199 DEBUG:boto:Token: None 2024-04-16T18:29:08.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.201 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000fc42f54f2ee7f64-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.202 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.202 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.202 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.202 DEBUG:boto:path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.202 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.202 DEBUG:boto:Method: GET 2024-04-16T18:29:08.202 DEBUG:boto:Path: /cjqttm-52/?prefix=obj111 2024-04-16T18:29:08.203 DEBUG:boto:Data: 2024-04-16T18:29:08.203 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.203 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.203 DEBUG:boto:Params: {} 2024-04-16T18:29:08.203 DEBUG:boto:Token: None 2024-04-16T18:29:08.203 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.206 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e150854b557fa1ed-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.207 DEBUG:boto:b'cjqttm-52obj1111000falseobj1112024-04-16T18:27:48.337Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.207 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:29:08.207 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.207 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.207 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.207 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.208 DEBUG:boto:Method: GET 2024-04-16T18:29:08.208 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.208 DEBUG:boto:Data: 2024-04-16T18:29:08.208 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.208 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.208 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.208 DEBUG:boto:Params: {} 2024-04-16T18:29:08.208 DEBUG:boto:Token: None 2024-04-16T18:29:08.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE= 2024-04-16T18:29:08.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee14ba016d304f47-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.211 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.211 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.211 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.211 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.211 DEBUG:boto:Method: GET 2024-04-16T18:29:08.211 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.212 DEBUG:boto:Data: 2024-04-16T18:29:08.212 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.212 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.212 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.212 DEBUG:boto:Params: {} 2024-04-16T18:29:08.212 DEBUG:boto:Token: None 2024-04-16T18:29:08.212 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE= 2024-04-16T18:29:08.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000146d0e2335c2975d-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.215 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.215 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.215 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.215 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.215 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.215 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.215 DEBUG:boto:Data: 2024-04-16T18:29:08.215 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.215 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.216 DEBUG:boto:Params: {} 2024-04-16T18:29:08.216 DEBUG:boto:Token: None 2024-04-16T18:29:08.216 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aPH2n0I5KJhAWwm1B29RoYxt/NI= 2024-04-16T18:29:08.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aPH2n0I5KJhAWwm1B29RoYxt/NI=', 'Content-Length': '0'} 2024-04-16T18:29:08.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004733b05d88322328-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.218 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.218 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.219 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.219 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.219 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.219 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.219 DEBUG:boto:Data: 2024-04-16T18:29:08.219 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.219 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.219 DEBUG:boto:Params: {} 2024-04-16T18:29:08.219 DEBUG:boto:Token: None 2024-04-16T18:29:08.220 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aPH2n0I5KJhAWwm1B29RoYxt/NI= 2024-04-16T18:29:08.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aPH2n0I5KJhAWwm1B29RoYxt/NI=', 'Content-Length': '0'} 2024-04-16T18:29:08.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcfdb64975a22362-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:29:08.222 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.222 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.222 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.222 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.222 DEBUG:boto:Method: GET 2024-04-16T18:29:08.223 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.223 DEBUG:boto:Data: 2024-04-16T18:29:08.223 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.223 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.223 DEBUG:boto:Params: {} 2024-04-16T18:29:08.223 DEBUG:boto:Token: None 2024-04-16T18:29:08.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE= 2024-04-16T18:29:08.224 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.225 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000877c6dafd61ad9be-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.226 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.226 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.226 DEBUG:boto:path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.226 DEBUG:boto:auth_path=/cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.226 DEBUG:boto:Method: GET 2024-04-16T18:29:08.226 DEBUG:boto:Path: /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.226 DEBUG:boto:Data: 2024-04-16T18:29:08.227 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.227 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.227 DEBUG:boto:Params: {} 2024-04-16T18:29:08.227 DEBUG:boto:Token: None 2024-04-16T18:29:08.227 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115?versionId=null 2024-04-16T18:29:08.227 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE= 2024-04-16T18:29:08.227 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a+O7FjskkAGUg1Fa7TtXQUBNRmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.229 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001e4edfce1f53bdee-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.230 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.230 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.230 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.230 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.230 DEBUG:boto:Method: GET 2024-04-16T18:29:08.230 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.230 DEBUG:boto:Data: 2024-04-16T18:29:08.230 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.230 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.231 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.231 DEBUG:boto:Params: {} 2024-04-16T18:29:08.231 DEBUG:boto:Token: None 2024-04-16T18:29:08.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.233 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8faa4121a6c6450-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.233 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.234 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.234 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.234 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.234 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.234 DEBUG:boto:Method: GET 2024-04-16T18:29:08.234 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.234 DEBUG:boto:Data: 2024-04-16T18:29:08.234 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.235 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.235 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.235 DEBUG:boto:Params: {} 2024-04-16T18:29:08.235 DEBUG:boto:Token: None 2024-04-16T18:29:08.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.238 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc8f8b8a95e997d9-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.239 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.239 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.239 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.239 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.239 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:29:08.240 DEBUG:boto:Data: 2024-04-16T18:29:08.240 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.240 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.240 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.240 DEBUG:boto:Params: {} 2024-04-16T18:29:08.240 DEBUG:boto:Token: None 2024-04-16T18:29:08.240 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115 2024-04-16T18:29:08.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CxsKNThv44a+bVHyEa2payKeMxI= 2024-04-16T18:29:08.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CxsKNThv44a+bVHyEa2payKeMxI=', 'Content-Length': '0'} 2024-04-16T18:29:08.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a715d380f78cdedd-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.242 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.243 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.243 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.243 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:29:08.243 DEBUG:boto:Data: 2024-04-16T18:29:08.243 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.243 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.243 DEBUG:boto:Params: {} 2024-04-16T18:29:08.243 DEBUG:boto:Token: None 2024-04-16T18:29:08.243 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115 2024-04-16T18:29:08.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CxsKNThv44a+bVHyEa2payKeMxI= 2024-04-16T18:29:08.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CxsKNThv44a+bVHyEa2payKeMxI=', 'Content-Length': '0'} 2024-04-16T18:29:08.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a08e412d347b8fe2-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:29:08.246 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.246 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.246 DEBUG:boto:Method: GET 2024-04-16T18:29:08.246 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:29:08.246 DEBUG:boto:Data: 2024-04-16T18:29:08.246 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.246 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.247 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.247 DEBUG:boto:Params: {} 2024-04-16T18:29:08.247 DEBUG:boto:Token: None 2024-04-16T18:29:08.247 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115 2024-04-16T18:29:08.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXTWZzKiElPAKc9LP9x2WjMyRBM= 2024-04-16T18:29:08.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXTWZzKiElPAKc9LP9x2WjMyRBM=', 'Content-Length': '0'} 2024-04-16T18:29:08.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d50d68adf274b752-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.249 DEBUG:boto:path=/cjqttm-52/obj115 2024-04-16T18:29:08.249 DEBUG:boto:auth_path=/cjqttm-52/obj115 2024-04-16T18:29:08.250 DEBUG:boto:Method: GET 2024-04-16T18:29:08.250 DEBUG:boto:Path: /cjqttm-52/obj115 2024-04-16T18:29:08.250 DEBUG:boto:Data: 2024-04-16T18:29:08.250 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.250 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.250 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.250 DEBUG:boto:Params: {} 2024-04-16T18:29:08.250 DEBUG:boto:Token: None 2024-04-16T18:29:08.250 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj115 2024-04-16T18:29:08.250 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vXTWZzKiElPAKc9LP9x2WjMyRBM= 2024-04-16T18:29:08.251 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vXTWZzKiElPAKc9LP9x2WjMyRBM=', 'Content-Length': '0'} 2024-04-16T18:29:08.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002eb2cc657e47b909-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.294 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.294 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.295 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.295 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.295 DEBUG:boto:Method: GET 2024-04-16T18:29:08.295 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.295 DEBUG:boto:Data: 2024-04-16T18:29:08.295 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.295 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.295 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.295 DEBUG:boto:Params: {} 2024-04-16T18:29:08.295 DEBUG:boto:Token: None 2024-04-16T18:29:08.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.298 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000046c0adb18c9558fa-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.298 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.298 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.298 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.298 DEBUG:boto:path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.299 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.299 DEBUG:boto:Method: GET 2024-04-16T18:29:08.299 DEBUG:boto:Path: /cjqttm-52/?prefix=obj115 2024-04-16T18:29:08.299 DEBUG:boto:Data: 2024-04-16T18:29:08.299 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.299 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.299 DEBUG:boto:Params: {} 2024-04-16T18:29:08.299 DEBUG:boto:Token: None 2024-04-16T18:29:08.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.303 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088441a4bbd2693a3-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.303 DEBUG:boto:b'cjqttm-52obj1151000falseobj1152024-04-16T18:21:49.363Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.303 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:29:08.303 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.304 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.304 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.304 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.304 DEBUG:boto:Method: GET 2024-04-16T18:29:08.304 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.304 DEBUG:boto:Data: 2024-04-16T18:29:08.304 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.304 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.304 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.304 DEBUG:boto:Params: {} 2024-04-16T18:29:08.304 DEBUG:boto:Token: None 2024-04-16T18:29:08.305 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.305 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8= 2024-04-16T18:29:08.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8=', 'Content-Length': '0'} 2024-04-16T18:29:08.307 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052c1fa162f0ce7d7-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.307 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.307 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.307 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.307 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.308 DEBUG:boto:Method: GET 2024-04-16T18:29:08.308 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.308 DEBUG:boto:Data: 2024-04-16T18:29:08.308 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.308 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.308 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.308 DEBUG:boto:Params: {} 2024-04-16T18:29:08.308 DEBUG:boto:Token: None 2024-04-16T18:29:08.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8= 2024-04-16T18:29:08.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8=', 'Content-Length': '0'} 2024-04-16T18:29:08.310 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e4490cf35ec191e-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.310 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.310 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.311 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.311 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.311 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.311 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.311 DEBUG:boto:Data: 2024-04-16T18:29:08.311 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.311 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.311 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.311 DEBUG:boto:Params: {} 2024-04-16T18:29:08.311 DEBUG:boto:Token: None 2024-04-16T18:29:08.311 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maiIXrmlFTOhaKqOOikY8MLD1Aw= 2024-04-16T18:29:08.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maiIXrmlFTOhaKqOOikY8MLD1Aw=', 'Content-Length': '0'} 2024-04-16T18:29:08.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcd3024a8f2ee026-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.314 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.314 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.314 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.314 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.314 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.314 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.314 DEBUG:boto:Data: 2024-04-16T18:29:08.314 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.314 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.314 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.314 DEBUG:boto:Params: {} 2024-04-16T18:29:08.315 DEBUG:boto:Token: None 2024-04-16T18:29:08.315 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:maiIXrmlFTOhaKqOOikY8MLD1Aw= 2024-04-16T18:29:08.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:maiIXrmlFTOhaKqOOikY8MLD1Aw=', 'Content-Length': '0'} 2024-04-16T18:29:08.317 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007031ef70fbf7c4fd-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.317 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:29:08.317 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.317 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.317 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.317 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.317 DEBUG:boto:Method: GET 2024-04-16T18:29:08.317 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.318 DEBUG:boto:Data: 2024-04-16T18:29:08.318 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.318 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.318 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.318 DEBUG:boto:Params: {} 2024-04-16T18:29:08.318 DEBUG:boto:Token: None 2024-04-16T18:29:08.318 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.318 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8= 2024-04-16T18:29:08.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8=', 'Content-Length': '0'} 2024-04-16T18:29:08.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005c13348af171b638-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.362 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.362 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.363 DEBUG:boto:path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.363 DEBUG:boto:auth_path=/cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.363 DEBUG:boto:Method: GET 2024-04-16T18:29:08.363 DEBUG:boto:Path: /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.363 DEBUG:boto:Data: 2024-04-16T18:29:08.363 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.363 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.363 DEBUG:boto:Params: {} 2024-04-16T18:29:08.363 DEBUG:boto:Token: None 2024-04-16T18:29:08.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116?versionId=null 2024-04-16T18:29:08.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8= 2024-04-16T18:29:08.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:j53CcrzEl6TH1VHCxHnWQbS9zN8=', 'Content-Length': '0'} 2024-04-16T18:29:08.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e560c7ecd4707aa-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.365 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.366 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.366 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.366 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.366 DEBUG:boto:Method: GET 2024-04-16T18:29:08.366 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.366 DEBUG:boto:Data: 2024-04-16T18:29:08.366 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.366 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.366 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.366 DEBUG:boto:Params: {} 2024-04-16T18:29:08.366 DEBUG:boto:Token: None 2024-04-16T18:29:08.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.369 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b898b79b021c2e57-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.369 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.369 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.369 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.370 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.370 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.370 DEBUG:boto:Method: GET 2024-04-16T18:29:08.370 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.370 DEBUG:boto:Data: 2024-04-16T18:29:08.370 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.370 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.370 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.370 DEBUG:boto:Params: {} 2024-04-16T18:29:08.370 DEBUG:boto:Token: None 2024-04-16T18:29:08.370 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.374 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a2bdddb2335e0db-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.374 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.374 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.374 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.374 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.375 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:29:08.375 DEBUG:boto:Data: 2024-04-16T18:29:08.375 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.375 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.375 DEBUG:boto:Params: {} 2024-04-16T18:29:08.375 DEBUG:boto:Token: None 2024-04-16T18:29:08.375 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116 2024-04-16T18:29:08.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OaB1+xOg5RZIWEufFsGOY6HDYwg= 2024-04-16T18:29:08.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OaB1+xOg5RZIWEufFsGOY6HDYwg=', 'Content-Length': '0'} 2024-04-16T18:29:08.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c12477e57deb419-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.377 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.377 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.378 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.378 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:29:08.378 DEBUG:boto:Data: 2024-04-16T18:29:08.378 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.378 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.378 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.378 DEBUG:boto:Params: {} 2024-04-16T18:29:08.378 DEBUG:boto:Token: None 2024-04-16T18:29:08.378 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116 2024-04-16T18:29:08.378 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OaB1+xOg5RZIWEufFsGOY6HDYwg= 2024-04-16T18:29:08.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OaB1+xOg5RZIWEufFsGOY6HDYwg=', 'Content-Length': '0'} 2024-04-16T18:29:08.380 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db51547283bc720c-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.380 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:29:08.380 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.380 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.380 DEBUG:boto:Method: GET 2024-04-16T18:29:08.380 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:29:08.381 DEBUG:boto:Data: 2024-04-16T18:29:08.381 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.381 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.381 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.381 DEBUG:boto:Params: {} 2024-04-16T18:29:08.381 DEBUG:boto:Token: None 2024-04-16T18:29:08.381 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116 2024-04-16T18:29:08.381 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uUf7TGcqrnLbhbJ0D4Z70J3KyHc= 2024-04-16T18:29:08.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uUf7TGcqrnLbhbJ0D4Z70J3KyHc=', 'Content-Length': '0'} 2024-04-16T18:29:08.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063a570b3f6805e7c-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.383 DEBUG:boto:path=/cjqttm-52/obj116 2024-04-16T18:29:08.383 DEBUG:boto:auth_path=/cjqttm-52/obj116 2024-04-16T18:29:08.384 DEBUG:boto:Method: GET 2024-04-16T18:29:08.384 DEBUG:boto:Path: /cjqttm-52/obj116 2024-04-16T18:29:08.384 DEBUG:boto:Data: 2024-04-16T18:29:08.384 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.384 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.384 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.384 DEBUG:boto:Params: {} 2024-04-16T18:29:08.384 DEBUG:boto:Token: None 2024-04-16T18:29:08.384 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj116 2024-04-16T18:29:08.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uUf7TGcqrnLbhbJ0D4Z70J3KyHc= 2024-04-16T18:29:08.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uUf7TGcqrnLbhbJ0D4Z70J3KyHc=', 'Content-Length': '0'} 2024-04-16T18:29:08.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c41d4846ac765187-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.386 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.387 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.387 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.387 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.387 DEBUG:boto:Method: GET 2024-04-16T18:29:08.387 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.387 DEBUG:boto:Data: 2024-04-16T18:29:08.387 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.387 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.387 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.387 DEBUG:boto:Params: {} 2024-04-16T18:29:08.387 DEBUG:boto:Token: None 2024-04-16T18:29:08.388 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009a20f45eea95aa19-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.390 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.390 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.391 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.391 DEBUG:boto:path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.391 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.391 DEBUG:boto:Method: GET 2024-04-16T18:29:08.391 DEBUG:boto:Path: /cjqttm-52/?prefix=obj116 2024-04-16T18:29:08.391 DEBUG:boto:Data: 2024-04-16T18:29:08.391 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.391 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.391 DEBUG:boto:Params: {} 2024-04-16T18:29:08.391 DEBUG:boto:Token: None 2024-04-16T18:29:08.392 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009da0fc4771a3f065-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.395 DEBUG:boto:b'cjqttm-52obj1161000falseobj1162024-04-16T18:24:09.555Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.395 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:29:08.395 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.395 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.396 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.396 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.396 DEBUG:boto:Method: GET 2024-04-16T18:29:08.396 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.396 DEBUG:boto:Data: 2024-04-16T18:29:08.396 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.396 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.396 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.396 DEBUG:boto:Params: {} 2024-04-16T18:29:08.397 DEBUG:boto:Token: None 2024-04-16T18:29:08.397 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo= 2024-04-16T18:29:08.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo=', 'Content-Length': '0'} 2024-04-16T18:29:08.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de066af7f69b47ea-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.399 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.399 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.400 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.400 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.400 DEBUG:boto:Method: GET 2024-04-16T18:29:08.400 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.400 DEBUG:boto:Data: 2024-04-16T18:29:08.400 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.400 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.400 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.400 DEBUG:boto:Params: {} 2024-04-16T18:29:08.400 DEBUG:boto:Token: None 2024-04-16T18:29:08.401 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.401 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo= 2024-04-16T18:29:08.401 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo=', 'Content-Length': '0'} 2024-04-16T18:29:08.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0897848204d0334-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.403 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.403 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.403 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.403 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.403 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.403 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.403 DEBUG:boto:Data: 2024-04-16T18:29:08.403 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.404 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.404 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.404 DEBUG:boto:Params: {} 2024-04-16T18:29:08.404 DEBUG:boto:Token: None 2024-04-16T18:29:08.404 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wo+w6fuMloehqjoM/BEwnVhlmvU= 2024-04-16T18:29:08.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wo+w6fuMloehqjoM/BEwnVhlmvU=', 'Content-Length': '0'} 2024-04-16T18:29:08.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004a4e26587837b1e5-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.406 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.406 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.406 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.406 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.406 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.406 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.407 DEBUG:boto:Data: 2024-04-16T18:29:08.407 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.407 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.407 DEBUG:boto:Params: {} 2024-04-16T18:29:08.407 DEBUG:boto:Token: None 2024-04-16T18:29:08.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Wo+w6fuMloehqjoM/BEwnVhlmvU= 2024-04-16T18:29:08.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Wo+w6fuMloehqjoM/BEwnVhlmvU=', 'Content-Length': '0'} 2024-04-16T18:29:08.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052499483f045d528-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.409 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:29:08.409 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.410 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.410 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.410 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.410 DEBUG:boto:Method: GET 2024-04-16T18:29:08.410 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.410 DEBUG:boto:Data: 2024-04-16T18:29:08.410 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.410 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.410 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.410 DEBUG:boto:Params: {} 2024-04-16T18:29:08.411 DEBUG:boto:Token: None 2024-04-16T18:29:08.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo= 2024-04-16T18:29:08.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo=', 'Content-Length': '0'} 2024-04-16T18:29:08.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000980fab80f94cfdce-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.454 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.454 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.455 DEBUG:boto:path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.455 DEBUG:boto:auth_path=/cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.455 DEBUG:boto:Method: GET 2024-04-16T18:29:08.455 DEBUG:boto:Path: /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.455 DEBUG:boto:Data: 2024-04-16T18:29:08.455 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.455 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.455 DEBUG:boto:Params: {} 2024-04-16T18:29:08.455 DEBUG:boto:Token: None 2024-04-16T18:29:08.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124?versionId=null 2024-04-16T18:29:08.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo= 2024-04-16T18:29:08.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2uC9uV88xozjVBrjzGdMMgCcsHo=', 'Content-Length': '0'} 2024-04-16T18:29:08.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000cee7fbac84daa52-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.458 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.458 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.458 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.458 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.458 DEBUG:boto:Method: GET 2024-04-16T18:29:08.458 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.459 DEBUG:boto:Data: 2024-04-16T18:29:08.459 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.459 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.459 DEBUG:boto:Params: {} 2024-04-16T18:29:08.459 DEBUG:boto:Token: None 2024-04-16T18:29:08.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.462 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c90754c45c826cfe-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.462 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.462 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.462 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.462 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.463 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.463 DEBUG:boto:Method: GET 2024-04-16T18:29:08.463 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.463 DEBUG:boto:Data: 2024-04-16T18:29:08.463 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.463 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.463 DEBUG:boto:Params: {} 2024-04-16T18:29:08.463 DEBUG:boto:Token: None 2024-04-16T18:29:08.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.467 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000463709e775fba209-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.467 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.467 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.468 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.468 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.468 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:29:08.468 DEBUG:boto:Data: 2024-04-16T18:29:08.468 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.468 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.468 DEBUG:boto:Params: {} 2024-04-16T18:29:08.468 DEBUG:boto:Token: None 2024-04-16T18:29:08.468 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124 2024-04-16T18:29:08.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IjYA6D8DsFsafWar5UMLcUqUBJ8= 2024-04-16T18:29:08.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IjYA6D8DsFsafWar5UMLcUqUBJ8=', 'Content-Length': '0'} 2024-04-16T18:29:08.470 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2c57bae9b62c017-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.471 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.471 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.471 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.471 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:29:08.471 DEBUG:boto:Data: 2024-04-16T18:29:08.471 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.471 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.471 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.471 DEBUG:boto:Params: {} 2024-04-16T18:29:08.471 DEBUG:boto:Token: None 2024-04-16T18:29:08.472 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124 2024-04-16T18:29:08.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IjYA6D8DsFsafWar5UMLcUqUBJ8= 2024-04-16T18:29:08.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IjYA6D8DsFsafWar5UMLcUqUBJ8=', 'Content-Length': '0'} 2024-04-16T18:29:08.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e2195b0454ea504-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.473 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:29:08.474 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.474 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.474 DEBUG:boto:Method: GET 2024-04-16T18:29:08.474 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:29:08.474 DEBUG:boto:Data: 2024-04-16T18:29:08.474 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.474 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.474 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.474 DEBUG:boto:Params: {} 2024-04-16T18:29:08.474 DEBUG:boto:Token: None 2024-04-16T18:29:08.474 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124 2024-04-16T18:29:08.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qgsjYlXD/MLnRYotaLwjamsSKYo= 2024-04-16T18:29:08.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qgsjYlXD/MLnRYotaLwjamsSKYo=', 'Content-Length': '0'} 2024-04-16T18:29:08.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6898ee547e5d954-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.477 DEBUG:boto:path=/cjqttm-52/obj124 2024-04-16T18:29:08.477 DEBUG:boto:auth_path=/cjqttm-52/obj124 2024-04-16T18:29:08.477 DEBUG:boto:Method: GET 2024-04-16T18:29:08.477 DEBUG:boto:Path: /cjqttm-52/obj124 2024-04-16T18:29:08.477 DEBUG:boto:Data: 2024-04-16T18:29:08.477 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.477 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.477 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.477 DEBUG:boto:Params: {} 2024-04-16T18:29:08.477 DEBUG:boto:Token: None 2024-04-16T18:29:08.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj124 2024-04-16T18:29:08.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qgsjYlXD/MLnRYotaLwjamsSKYo= 2024-04-16T18:29:08.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qgsjYlXD/MLnRYotaLwjamsSKYo=', 'Content-Length': '0'} 2024-04-16T18:29:08.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e62c95d559b7b88-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.481 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.481 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.481 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.481 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.481 DEBUG:boto:Method: GET 2024-04-16T18:29:08.481 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.481 DEBUG:boto:Data: 2024-04-16T18:29:08.481 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.481 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.481 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.481 DEBUG:boto:Params: {} 2024-04-16T18:29:08.482 DEBUG:boto:Token: None 2024-04-16T18:29:08.482 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.482 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.482 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.484 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089d91f9ff3f45d30-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.484 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.485 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.485 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.485 DEBUG:boto:path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.485 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.485 DEBUG:boto:Method: GET 2024-04-16T18:29:08.485 DEBUG:boto:Path: /cjqttm-52/?prefix=obj124 2024-04-16T18:29:08.485 DEBUG:boto:Data: 2024-04-16T18:29:08.485 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.485 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.486 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.486 DEBUG:boto:Params: {} 2024-04-16T18:29:08.486 DEBUG:boto:Token: None 2024-04-16T18:29:08.486 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.486 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.486 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.489 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b933d12f8d089163-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.489 DEBUG:boto:b'cjqttm-52obj1241000falseobj1242024-04-16T18:26:26.393Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.490 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:29:08.490 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.490 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.490 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.490 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.490 DEBUG:boto:Method: GET 2024-04-16T18:29:08.490 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.490 DEBUG:boto:Data: 2024-04-16T18:29:08.490 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.490 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.490 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.491 DEBUG:boto:Params: {} 2024-04-16T18:29:08.491 DEBUG:boto:Token: None 2024-04-16T18:29:08.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE= 2024-04-16T18:29:08.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE=', 'Content-Length': '0'} 2024-04-16T18:29:08.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009230d06f3cc7b03a-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.493 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.493 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.494 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.494 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.494 DEBUG:boto:Method: GET 2024-04-16T18:29:08.494 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.494 DEBUG:boto:Data: 2024-04-16T18:29:08.494 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.494 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.494 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.494 DEBUG:boto:Params: {} 2024-04-16T18:29:08.494 DEBUG:boto:Token: None 2024-04-16T18:29:08.494 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE= 2024-04-16T18:29:08.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE=', 'Content-Length': '0'} 2024-04-16T18:29:08.496 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001ad4ae3816a1a301-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.496 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.496 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.497 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.497 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.497 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.497 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.497 DEBUG:boto:Data: 2024-04-16T18:29:08.497 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.497 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.497 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.497 DEBUG:boto:Params: {} 2024-04-16T18:29:08.497 DEBUG:boto:Token: None 2024-04-16T18:29:08.497 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.498 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HKNw7TMIJ1jvYK3Dhpd0pB4KE/k= 2024-04-16T18:29:08.498 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HKNw7TMIJ1jvYK3Dhpd0pB4KE/k=', 'Content-Length': '0'} 2024-04-16T18:29:08.499 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005588d3e4bdfccd87-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.500 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.500 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.500 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.500 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.500 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.500 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.500 DEBUG:boto:Data: 2024-04-16T18:29:08.500 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.501 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.501 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.501 DEBUG:boto:Params: {} 2024-04-16T18:29:08.501 DEBUG:boto:Token: None 2024-04-16T18:29:08.501 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.501 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HKNw7TMIJ1jvYK3Dhpd0pB4KE/k= 2024-04-16T18:29:08.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HKNw7TMIJ1jvYK3Dhpd0pB4KE/k=', 'Content-Length': '0'} 2024-04-16T18:29:08.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019aa0e88709868ee-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:29:08.503 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.503 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.503 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.503 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.504 DEBUG:boto:Method: GET 2024-04-16T18:29:08.504 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.504 DEBUG:boto:Data: 2024-04-16T18:29:08.504 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.504 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.504 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.504 DEBUG:boto:Params: {} 2024-04-16T18:29:08.504 DEBUG:boto:Token: None 2024-04-16T18:29:08.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE= 2024-04-16T18:29:08.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE=', 'Content-Length': '0'} 2024-04-16T18:29:08.506 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f58c3945bbede69-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.507 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.507 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.507 DEBUG:boto:path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.507 DEBUG:boto:auth_path=/cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.507 DEBUG:boto:Method: GET 2024-04-16T18:29:08.507 DEBUG:boto:Path: /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.507 DEBUG:boto:Data: 2024-04-16T18:29:08.507 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.507 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.507 DEBUG:boto:Params: {} 2024-04-16T18:29:08.507 DEBUG:boto:Token: None 2024-04-16T18:29:08.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145?versionId=null 2024-04-16T18:29:08.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE= 2024-04-16T18:29:08.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J9aAHN707oNhHo5emRQqMxyk0tE=', 'Content-Length': '0'} 2024-04-16T18:29:08.509 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000046252e094d51c8a-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.510 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.510 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.510 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.510 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.510 DEBUG:boto:Method: GET 2024-04-16T18:29:08.510 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.510 DEBUG:boto:Data: 2024-04-16T18:29:08.510 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.510 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.511 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.511 DEBUG:boto:Params: {} 2024-04-16T18:29:08.511 DEBUG:boto:Token: None 2024-04-16T18:29:08.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.511 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.511 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.514 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011ef7befbba5f76c-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.514 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.514 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.514 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.514 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.514 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.515 DEBUG:boto:Method: GET 2024-04-16T18:29:08.515 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.515 DEBUG:boto:Data: 2024-04-16T18:29:08.515 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.515 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.515 DEBUG:boto:Params: {} 2024-04-16T18:29:08.515 DEBUG:boto:Token: None 2024-04-16T18:29:08.515 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.519 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a789b25964141369-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.519 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.519 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.519 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.519 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.519 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:29:08.520 DEBUG:boto:Data: 2024-04-16T18:29:08.520 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.520 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.520 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.520 DEBUG:boto:Params: {} 2024-04-16T18:29:08.520 DEBUG:boto:Token: None 2024-04-16T18:29:08.520 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145 2024-04-16T18:29:08.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9UkMDY/hzR3S8plqcFtNJS6Ques= 2024-04-16T18:29:08.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9UkMDY/hzR3S8plqcFtNJS6Ques=', 'Content-Length': '0'} 2024-04-16T18:29:08.522 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bfe94d2ddc062f3-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.523 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.523 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.523 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.523 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:29:08.523 DEBUG:boto:Data: 2024-04-16T18:29:08.523 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.523 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.523 DEBUG:boto:Params: {} 2024-04-16T18:29:08.523 DEBUG:boto:Token: None 2024-04-16T18:29:08.524 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145 2024-04-16T18:29:08.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9UkMDY/hzR3S8plqcFtNJS6Ques= 2024-04-16T18:29:08.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9UkMDY/hzR3S8plqcFtNJS6Ques=', 'Content-Length': '0'} 2024-04-16T18:29:08.525 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acd07604a0a92940-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:29:08.525 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.526 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.526 DEBUG:boto:Method: GET 2024-04-16T18:29:08.526 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:29:08.526 DEBUG:boto:Data: 2024-04-16T18:29:08.526 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.526 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.526 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.526 DEBUG:boto:Params: {} 2024-04-16T18:29:08.526 DEBUG:boto:Token: None 2024-04-16T18:29:08.526 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145 2024-04-16T18:29:08.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XjVWLfXDG2X+9Rj2Fh/2XPDMgFc= 2024-04-16T18:29:08.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XjVWLfXDG2X+9Rj2Fh/2XPDMgFc=', 'Content-Length': '0'} 2024-04-16T18:29:08.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b67586bae1ed6b66-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.529 DEBUG:boto:path=/cjqttm-52/obj145 2024-04-16T18:29:08.529 DEBUG:boto:auth_path=/cjqttm-52/obj145 2024-04-16T18:29:08.529 DEBUG:boto:Method: GET 2024-04-16T18:29:08.529 DEBUG:boto:Path: /cjqttm-52/obj145 2024-04-16T18:29:08.529 DEBUG:boto:Data: 2024-04-16T18:29:08.529 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.529 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.529 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.530 DEBUG:boto:Params: {} 2024-04-16T18:29:08.530 DEBUG:boto:Token: None 2024-04-16T18:29:08.530 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj145 2024-04-16T18:29:08.530 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XjVWLfXDG2X+9Rj2Fh/2XPDMgFc= 2024-04-16T18:29:08.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XjVWLfXDG2X+9Rj2Fh/2XPDMgFc=', 'Content-Length': '0'} 2024-04-16T18:29:08.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000752e8a66b0487737-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.574 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.574 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.575 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.575 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.575 DEBUG:boto:Method: GET 2024-04-16T18:29:08.575 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.575 DEBUG:boto:Data: 2024-04-16T18:29:08.575 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.575 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.575 DEBUG:boto:Params: {} 2024-04-16T18:29:08.575 DEBUG:boto:Token: None 2024-04-16T18:29:08.575 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.578 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023532d9cc662ec44-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.578 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.579 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.579 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.579 DEBUG:boto:path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.579 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.579 DEBUG:boto:Method: GET 2024-04-16T18:29:08.579 DEBUG:boto:Path: /cjqttm-52/?prefix=obj145 2024-04-16T18:29:08.579 DEBUG:boto:Data: 2024-04-16T18:29:08.579 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.580 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.580 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.580 DEBUG:boto:Params: {} 2024-04-16T18:29:08.580 DEBUG:boto:Token: None 2024-04-16T18:29:08.580 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001db26d54e38679ae-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.583 DEBUG:boto:b'cjqttm-52obj1451000falseobj1452024-04-16T18:24:09.578Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.584 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:29:08.584 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.584 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.584 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.584 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.584 DEBUG:boto:Method: GET 2024-04-16T18:29:08.584 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.584 DEBUG:boto:Data: 2024-04-16T18:29:08.584 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.585 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.585 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.585 DEBUG:boto:Params: {} 2024-04-16T18:29:08.585 DEBUG:boto:Token: None 2024-04-16T18:29:08.585 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.585 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4= 2024-04-16T18:29:08.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4=', 'Content-Length': '0'} 2024-04-16T18:29:08.587 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef86bc55af55f90a-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.588 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.588 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.588 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.588 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.588 DEBUG:boto:Method: GET 2024-04-16T18:29:08.588 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.588 DEBUG:boto:Data: 2024-04-16T18:29:08.588 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.589 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.589 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.589 DEBUG:boto:Params: {} 2024-04-16T18:29:08.589 DEBUG:boto:Token: None 2024-04-16T18:29:08.589 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.589 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4= 2024-04-16T18:29:08.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4=', 'Content-Length': '0'} 2024-04-16T18:29:08.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbefcca7090e71d4-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.591 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.591 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.591 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.592 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.592 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.592 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.592 DEBUG:boto:Data: 2024-04-16T18:29:08.592 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.592 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.592 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.592 DEBUG:boto:Params: {} 2024-04-16T18:29:08.592 DEBUG:boto:Token: None 2024-04-16T18:29:08.592 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.592 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PQ2mrB8bwWVlJA3Nxug6sQdxxRw= 2024-04-16T18:29:08.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PQ2mrB8bwWVlJA3Nxug6sQdxxRw=', 'Content-Length': '0'} 2024-04-16T18:29:08.595 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d08ec3eed78b5680-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.595 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.595 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.595 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.595 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.595 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.595 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.595 DEBUG:boto:Data: 2024-04-16T18:29:08.595 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.596 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.596 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.596 DEBUG:boto:Params: {} 2024-04-16T18:29:08.596 DEBUG:boto:Token: None 2024-04-16T18:29:08.596 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.596 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PQ2mrB8bwWVlJA3Nxug6sQdxxRw= 2024-04-16T18:29:08.596 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PQ2mrB8bwWVlJA3Nxug6sQdxxRw=', 'Content-Length': '0'} 2024-04-16T18:29:08.598 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000179e03022f378019-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.599 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:29:08.599 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.599 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.599 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.599 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.599 DEBUG:boto:Method: GET 2024-04-16T18:29:08.599 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.599 DEBUG:boto:Data: 2024-04-16T18:29:08.599 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.599 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.599 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.600 DEBUG:boto:Params: {} 2024-04-16T18:29:08.600 DEBUG:boto:Token: None 2024-04-16T18:29:08.600 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.600 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4= 2024-04-16T18:29:08.600 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4=', 'Content-Length': '0'} 2024-04-16T18:29:08.602 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000216720f1edabbfdd-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.642 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.642 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.642 DEBUG:boto:path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.643 DEBUG:boto:auth_path=/cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.643 DEBUG:boto:Method: GET 2024-04-16T18:29:08.643 DEBUG:boto:Path: /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.643 DEBUG:boto:Data: 2024-04-16T18:29:08.643 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.643 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.643 DEBUG:boto:Params: {} 2024-04-16T18:29:08.643 DEBUG:boto:Token: None 2024-04-16T18:29:08.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148?versionId=null 2024-04-16T18:29:08.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4= 2024-04-16T18:29:08.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hQKWUGtAFBQVmwSIrFL0fNfIre4=', 'Content-Length': '0'} 2024-04-16T18:29:08.646 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000086813a02020c2016-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.646 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.646 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.646 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.646 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.646 DEBUG:boto:Method: GET 2024-04-16T18:29:08.647 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.647 DEBUG:boto:Data: 2024-04-16T18:29:08.647 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.647 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.647 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.647 DEBUG:boto:Params: {} 2024-04-16T18:29:08.647 DEBUG:boto:Token: None 2024-04-16T18:29:08.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.649 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003fad9a593e2b2efc-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.650 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.650 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.650 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.650 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.650 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.650 DEBUG:boto:Method: GET 2024-04-16T18:29:08.650 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.651 DEBUG:boto:Data: 2024-04-16T18:29:08.651 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.651 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.651 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.651 DEBUG:boto:Params: {} 2024-04-16T18:29:08.651 DEBUG:boto:Token: None 2024-04-16T18:29:08.651 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.651 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001116a96a893ecb76-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.654 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.655 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.655 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.655 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.655 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:29:08.655 DEBUG:boto:Data: 2024-04-16T18:29:08.655 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.655 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.655 DEBUG:boto:Params: {} 2024-04-16T18:29:08.655 DEBUG:boto:Token: None 2024-04-16T18:29:08.656 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148 2024-04-16T18:29:08.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GZoczYPmEqOkjyugnoQUh4J4c2k= 2024-04-16T18:29:08.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GZoczYPmEqOkjyugnoQUh4J4c2k=', 'Content-Length': '0'} 2024-04-16T18:29:08.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf5a0781e1e0830b-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.658 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.658 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.658 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.658 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:29:08.659 DEBUG:boto:Data: 2024-04-16T18:29:08.659 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.659 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.659 DEBUG:boto:Params: {} 2024-04-16T18:29:08.659 DEBUG:boto:Token: None 2024-04-16T18:29:08.659 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148 2024-04-16T18:29:08.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GZoczYPmEqOkjyugnoQUh4J4c2k= 2024-04-16T18:29:08.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GZoczYPmEqOkjyugnoQUh4J4c2k=', 'Content-Length': '0'} 2024-04-16T18:29:08.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6de9a97c57740b4-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.662 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:29:08.662 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.662 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.662 DEBUG:boto:Method: GET 2024-04-16T18:29:08.662 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:29:08.662 DEBUG:boto:Data: 2024-04-16T18:29:08.663 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.663 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.663 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.663 DEBUG:boto:Params: {} 2024-04-16T18:29:08.663 DEBUG:boto:Token: None 2024-04-16T18:29:08.663 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148 2024-04-16T18:29:08.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MHRP5SE/MDBL+mf2ik4T+QSGrtU= 2024-04-16T18:29:08.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MHRP5SE/MDBL+mf2ik4T+QSGrtU=', 'Content-Length': '0'} 2024-04-16T18:29:08.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acdca797e18df870-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.666 DEBUG:boto:path=/cjqttm-52/obj148 2024-04-16T18:29:08.666 DEBUG:boto:auth_path=/cjqttm-52/obj148 2024-04-16T18:29:08.666 DEBUG:boto:Method: GET 2024-04-16T18:29:08.666 DEBUG:boto:Path: /cjqttm-52/obj148 2024-04-16T18:29:08.666 DEBUG:boto:Data: 2024-04-16T18:29:08.666 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.666 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.666 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.666 DEBUG:boto:Params: {} 2024-04-16T18:29:08.666 DEBUG:boto:Token: None 2024-04-16T18:29:08.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj148 2024-04-16T18:29:08.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MHRP5SE/MDBL+mf2ik4T+QSGrtU= 2024-04-16T18:29:08.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MHRP5SE/MDBL+mf2ik4T+QSGrtU=', 'Content-Length': '0'} 2024-04-16T18:29:08.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000073d6582a2b14b933-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.669 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.670 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.670 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.670 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.670 DEBUG:boto:Method: GET 2024-04-16T18:29:08.670 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.670 DEBUG:boto:Data: 2024-04-16T18:29:08.670 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.670 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.670 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.670 DEBUG:boto:Params: {} 2024-04-16T18:29:08.671 DEBUG:boto:Token: None 2024-04-16T18:29:08.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.673 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ea20a768632aef1-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.673 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.674 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.674 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.674 DEBUG:boto:path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.674 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.674 DEBUG:boto:Method: GET 2024-04-16T18:29:08.674 DEBUG:boto:Path: /cjqttm-52/?prefix=obj148 2024-04-16T18:29:08.674 DEBUG:boto:Data: 2024-04-16T18:29:08.674 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.674 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.675 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.675 DEBUG:boto:Params: {} 2024-04-16T18:29:08.675 DEBUG:boto:Token: None 2024-04-16T18:29:08.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.678 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f116354e0dc9dae-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.679 DEBUG:boto:b'cjqttm-52obj1481000falseobj1482024-04-16T18:27:48.408Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.679 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:29:08.679 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.679 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.679 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.679 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.679 DEBUG:boto:Method: GET 2024-04-16T18:29:08.680 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.680 DEBUG:boto:Data: 2024-04-16T18:29:08.680 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.680 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.680 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.680 DEBUG:boto:Params: {} 2024-04-16T18:29:08.680 DEBUG:boto:Token: None 2024-04-16T18:29:08.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY= 2024-04-16T18:29:08.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY=', 'Content-Length': '0'} 2024-04-16T18:29:08.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f6be623abf5023a-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.683 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.683 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.684 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.684 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.684 DEBUG:boto:Method: GET 2024-04-16T18:29:08.684 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.684 DEBUG:boto:Data: 2024-04-16T18:29:08.684 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.684 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.684 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.684 DEBUG:boto:Params: {} 2024-04-16T18:29:08.684 DEBUG:boto:Token: None 2024-04-16T18:29:08.684 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.685 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY= 2024-04-16T18:29:08.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY=', 'Content-Length': '0'} 2024-04-16T18:29:08.686 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7a310766693257d-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.687 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.687 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.687 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.687 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.687 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.687 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.687 DEBUG:boto:Data: 2024-04-16T18:29:08.687 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.687 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.687 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.687 DEBUG:boto:Params: {} 2024-04-16T18:29:08.688 DEBUG:boto:Token: None 2024-04-16T18:29:08.688 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:okopKJGGGlD7S0RsaGK8ADoyWS4= 2024-04-16T18:29:08.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:okopKJGGGlD7S0RsaGK8ADoyWS4=', 'Content-Length': '0'} 2024-04-16T18:29:08.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d992f26d169ec77-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.690 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.690 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.690 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.690 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.690 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.690 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.690 DEBUG:boto:Data: 2024-04-16T18:29:08.690 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.690 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.691 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.691 DEBUG:boto:Params: {} 2024-04-16T18:29:08.691 DEBUG:boto:Token: None 2024-04-16T18:29:08.691 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:okopKJGGGlD7S0RsaGK8ADoyWS4= 2024-04-16T18:29:08.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:okopKJGGGlD7S0RsaGK8ADoyWS4=', 'Content-Length': '0'} 2024-04-16T18:29:08.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a4c8a1de4cdf55b-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.693 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:29:08.693 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.693 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.693 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.693 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.694 DEBUG:boto:Method: GET 2024-04-16T18:29:08.694 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.694 DEBUG:boto:Data: 2024-04-16T18:29:08.694 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.694 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.694 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.694 DEBUG:boto:Params: {} 2024-04-16T18:29:08.694 DEBUG:boto:Token: None 2024-04-16T18:29:08.694 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.694 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY= 2024-04-16T18:29:08.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY=', 'Content-Length': '0'} 2024-04-16T18:29:08.696 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008bff97c1c28c3d93-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.697 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.697 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.697 DEBUG:boto:path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.697 DEBUG:boto:auth_path=/cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.697 DEBUG:boto:Method: GET 2024-04-16T18:29:08.697 DEBUG:boto:Path: /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.697 DEBUG:boto:Data: 2024-04-16T18:29:08.697 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.697 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.697 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.697 DEBUG:boto:Params: {} 2024-04-16T18:29:08.698 DEBUG:boto:Token: None 2024-04-16T18:29:08.698 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155?versionId=null 2024-04-16T18:29:08.698 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY= 2024-04-16T18:29:08.698 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l6B4Ax3jDVWXuEXcJ0l/0uBAdBY=', 'Content-Length': '0'} 2024-04-16T18:29:08.700 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057ce95e3986c1eec-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.742 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.742 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.743 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.743 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.743 DEBUG:boto:Method: GET 2024-04-16T18:29:08.743 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.743 DEBUG:boto:Data: 2024-04-16T18:29:08.743 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.743 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.743 DEBUG:boto:Params: {} 2024-04-16T18:29:08.743 DEBUG:boto:Token: None 2024-04-16T18:29:08.744 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000463efaca888b6caf-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.746 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.747 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.747 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.747 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.747 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.747 DEBUG:boto:Method: GET 2024-04-16T18:29:08.747 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.747 DEBUG:boto:Data: 2024-04-16T18:29:08.747 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.748 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.748 DEBUG:boto:Params: {} 2024-04-16T18:29:08.748 DEBUG:boto:Token: None 2024-04-16T18:29:08.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.751 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a85236f0b9fd100-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.752 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.752 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.752 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.752 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.752 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:29:08.752 DEBUG:boto:Data: 2024-04-16T18:29:08.752 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.752 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.753 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.753 DEBUG:boto:Params: {} 2024-04-16T18:29:08.753 DEBUG:boto:Token: None 2024-04-16T18:29:08.753 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155 2024-04-16T18:29:08.753 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9dz+0aOnaE9gcfReY156diGr55I= 2024-04-16T18:29:08.753 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9dz+0aOnaE9gcfReY156diGr55I=', 'Content-Length': '0'} 2024-04-16T18:29:08.755 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcdf7c9ff563bbc4-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.755 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.755 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.755 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.755 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:29:08.755 DEBUG:boto:Data: 2024-04-16T18:29:08.755 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.756 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.756 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.756 DEBUG:boto:Params: {} 2024-04-16T18:29:08.756 DEBUG:boto:Token: None 2024-04-16T18:29:08.756 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155 2024-04-16T18:29:08.756 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9dz+0aOnaE9gcfReY156diGr55I= 2024-04-16T18:29:08.756 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9dz+0aOnaE9gcfReY156diGr55I=', 'Content-Length': '0'} 2024-04-16T18:29:08.758 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee2edfdcd61e9355-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.758 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:29:08.758 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.758 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.759 DEBUG:boto:Method: GET 2024-04-16T18:29:08.759 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:29:08.759 DEBUG:boto:Data: 2024-04-16T18:29:08.759 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.759 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.759 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.759 DEBUG:boto:Params: {} 2024-04-16T18:29:08.759 DEBUG:boto:Token: None 2024-04-16T18:29:08.759 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155 2024-04-16T18:29:08.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rUKCX9Q0k9oskiu6UdFwff2DBWk= 2024-04-16T18:29:08.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rUKCX9Q0k9oskiu6UdFwff2DBWk=', 'Content-Length': '0'} 2024-04-16T18:29:08.761 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e1f5e2c6242b0f8-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.802 DEBUG:boto:path=/cjqttm-52/obj155 2024-04-16T18:29:08.802 DEBUG:boto:auth_path=/cjqttm-52/obj155 2024-04-16T18:29:08.802 DEBUG:boto:Method: GET 2024-04-16T18:29:08.803 DEBUG:boto:Path: /cjqttm-52/obj155 2024-04-16T18:29:08.803 DEBUG:boto:Data: 2024-04-16T18:29:08.803 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.803 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.803 DEBUG:boto:Params: {} 2024-04-16T18:29:08.803 DEBUG:boto:Token: None 2024-04-16T18:29:08.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj155 2024-04-16T18:29:08.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rUKCX9Q0k9oskiu6UdFwff2DBWk= 2024-04-16T18:29:08.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rUKCX9Q0k9oskiu6UdFwff2DBWk=', 'Content-Length': '0'} 2024-04-16T18:29:08.805 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055f0ab26ff27cd05-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.806 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.806 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.806 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.806 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.806 DEBUG:boto:Method: GET 2024-04-16T18:29:08.806 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.806 DEBUG:boto:Data: 2024-04-16T18:29:08.806 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.806 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.807 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.807 DEBUG:boto:Params: {} 2024-04-16T18:29:08.807 DEBUG:boto:Token: None 2024-04-16T18:29:08.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.809 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000611f3c690ef2dd37-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.810 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.810 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.810 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.810 DEBUG:boto:path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.810 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.810 DEBUG:boto:Method: GET 2024-04-16T18:29:08.810 DEBUG:boto:Path: /cjqttm-52/?prefix=obj155 2024-04-16T18:29:08.811 DEBUG:boto:Data: 2024-04-16T18:29:08.811 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.811 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.811 DEBUG:boto:Params: {} 2024-04-16T18:29:08.811 DEBUG:boto:Token: None 2024-04-16T18:29:08.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.815 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b197614dccb4bb4-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.815 DEBUG:boto:b'cjqttm-52obj1551000falseobj1552024-04-16T18:26:26.443Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.815 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:29:08.816 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.816 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.816 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.816 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.816 DEBUG:boto:Method: GET 2024-04-16T18:29:08.816 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.816 DEBUG:boto:Data: 2024-04-16T18:29:08.816 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.816 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.816 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.816 DEBUG:boto:Params: {} 2024-04-16T18:29:08.817 DEBUG:boto:Token: None 2024-04-16T18:29:08.817 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.817 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE= 2024-04-16T18:29:08.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.819 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c82ca1f3b3c9c8b3-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.820 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.820 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.820 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.820 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.820 DEBUG:boto:Method: GET 2024-04-16T18:29:08.820 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.820 DEBUG:boto:Data: 2024-04-16T18:29:08.820 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.820 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.820 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.820 DEBUG:boto:Params: {} 2024-04-16T18:29:08.821 DEBUG:boto:Token: None 2024-04-16T18:29:08.821 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.821 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE= 2024-04-16T18:29:08.821 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.823 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008fff82295f7ac5a-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.866 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.866 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.867 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.867 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.867 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.867 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.867 DEBUG:boto:Data: 2024-04-16T18:29:08.867 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.867 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.867 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.867 DEBUG:boto:Params: {} 2024-04-16T18:29:08.867 DEBUG:boto:Token: None 2024-04-16T18:29:08.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vip4+5sZqSNx2OVJTZDuFGo7+Ao= 2024-04-16T18:29:08.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vip4+5sZqSNx2OVJTZDuFGo7+Ao=', 'Content-Length': '0'} 2024-04-16T18:29:08.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000649d01896d2d3c0b-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.870 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.870 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.870 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.871 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.871 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.871 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.871 DEBUG:boto:Data: 2024-04-16T18:29:08.871 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.871 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.871 DEBUG:boto:Params: {} 2024-04-16T18:29:08.871 DEBUG:boto:Token: None 2024-04-16T18:29:08.871 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vip4+5sZqSNx2OVJTZDuFGo7+Ao= 2024-04-16T18:29:08.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vip4+5sZqSNx2OVJTZDuFGo7+Ao=', 'Content-Length': '0'} 2024-04-16T18:29:08.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca8638f9b9f784d8-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.874 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:29:08.874 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.874 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.874 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.874 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.874 DEBUG:boto:Method: GET 2024-04-16T18:29:08.874 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.875 DEBUG:boto:Data: 2024-04-16T18:29:08.875 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.875 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.875 DEBUG:boto:Params: {} 2024-04-16T18:29:08.875 DEBUG:boto:Token: None 2024-04-16T18:29:08.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.875 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE= 2024-04-16T18:29:08.875 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f84bf46d240c80fa-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.878 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.878 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.878 DEBUG:boto:path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.878 DEBUG:boto:auth_path=/cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.878 DEBUG:boto:Method: GET 2024-04-16T18:29:08.878 DEBUG:boto:Path: /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.878 DEBUG:boto:Data: 2024-04-16T18:29:08.878 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.879 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.879 DEBUG:boto:Params: {} 2024-04-16T18:29:08.879 DEBUG:boto:Token: None 2024-04-16T18:29:08.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17?versionId=null 2024-04-16T18:29:08.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE= 2024-04-16T18:29:08.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K0n/E3Bxh8VXh6YWeqS8v2C2LmE=', 'Content-Length': '0'} 2024-04-16T18:29:08.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0f2fbf37d2e382c-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.882 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.882 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.882 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.882 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.882 DEBUG:boto:Method: GET 2024-04-16T18:29:08.882 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.882 DEBUG:boto:Data: 2024-04-16T18:29:08.883 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.883 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.883 DEBUG:boto:Params: {} 2024-04-16T18:29:08.883 DEBUG:boto:Token: None 2024-04-16T18:29:08.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.885 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009fc4a4664efa688d-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.886 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.886 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.886 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.886 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.886 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.886 DEBUG:boto:Method: GET 2024-04-16T18:29:08.887 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.887 DEBUG:boto:Data: 2024-04-16T18:29:08.887 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.887 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.887 DEBUG:boto:Params: {} 2024-04-16T18:29:08.887 DEBUG:boto:Token: None 2024-04-16T18:29:08.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a8d9ae3333132e20-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.891 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.891 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.891 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.891 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.891 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:29:08.891 DEBUG:boto:Data: 2024-04-16T18:29:08.891 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.892 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.892 DEBUG:boto:Params: {} 2024-04-16T18:29:08.892 DEBUG:boto:Token: None 2024-04-16T18:29:08.892 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17 2024-04-16T18:29:08.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d5WgLd0IkgmY7HBWJZhcdiotjlU= 2024-04-16T18:29:08.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d5WgLd0IkgmY7HBWJZhcdiotjlU=', 'Content-Length': '0'} 2024-04-16T18:29:08.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4ab486ebf973821-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.894 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.895 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.895 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.895 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:29:08.895 DEBUG:boto:Data: 2024-04-16T18:29:08.895 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.895 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.895 DEBUG:boto:Params: {} 2024-04-16T18:29:08.895 DEBUG:boto:Token: None 2024-04-16T18:29:08.896 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17 2024-04-16T18:29:08.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:d5WgLd0IkgmY7HBWJZhcdiotjlU= 2024-04-16T18:29:08.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d5WgLd0IkgmY7HBWJZhcdiotjlU=', 'Content-Length': '0'} 2024-04-16T18:29:08.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015f08e90707d7f6c-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.898 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:29:08.898 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.898 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.898 DEBUG:boto:Method: GET 2024-04-16T18:29:08.899 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:29:08.899 DEBUG:boto:Data: 2024-04-16T18:29:08.899 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.899 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.899 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.899 DEBUG:boto:Params: {} 2024-04-16T18:29:08.899 DEBUG:boto:Token: None 2024-04-16T18:29:08.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17 2024-04-16T18:29:08.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SDcE+iRtgCxShIpC95daUBgE8A= 2024-04-16T18:29:08.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SDcE+iRtgCxShIpC95daUBgE8A=', 'Content-Length': '0'} 2024-04-16T18:29:08.902 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f145bddaee53bbec-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.902 DEBUG:boto:path=/cjqttm-52/obj17 2024-04-16T18:29:08.902 DEBUG:boto:auth_path=/cjqttm-52/obj17 2024-04-16T18:29:08.902 DEBUG:boto:Method: GET 2024-04-16T18:29:08.903 DEBUG:boto:Path: /cjqttm-52/obj17 2024-04-16T18:29:08.903 DEBUG:boto:Data: 2024-04-16T18:29:08.903 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.903 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.903 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.903 DEBUG:boto:Params: {} 2024-04-16T18:29:08.903 DEBUG:boto:Token: None 2024-04-16T18:29:08.903 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj17 2024-04-16T18:29:08.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/SDcE+iRtgCxShIpC95daUBgE8A= 2024-04-16T18:29:08.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/SDcE+iRtgCxShIpC95daUBgE8A=', 'Content-Length': '0'} 2024-04-16T18:29:08.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c676d5b3adb7fc72-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.906 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.906 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.906 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.906 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.906 DEBUG:boto:Method: GET 2024-04-16T18:29:08.906 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.906 DEBUG:boto:Data: 2024-04-16T18:29:08.906 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.907 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.907 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.907 DEBUG:boto:Params: {} 2024-04-16T18:29:08.907 DEBUG:boto:Token: None 2024-04-16T18:29:08.907 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.907 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.910 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070d988ffeffe55ff-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.910 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.910 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.910 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.910 DEBUG:boto:path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.910 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.911 DEBUG:boto:Method: GET 2024-04-16T18:29:08.911 DEBUG:boto:Path: /cjqttm-52/?prefix=obj17 2024-04-16T18:29:08.911 DEBUG:boto:Data: 2024-04-16T18:29:08.911 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.911 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.911 DEBUG:boto:Params: {} 2024-04-16T18:29:08.911 DEBUG:boto:Token: None 2024-04-16T18:29:08.911 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.911 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f56458c8c87452f2-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.915 DEBUG:boto:b'cjqttm-52obj171000falseobj172024-04-16T18:20:07.434Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:29:08.915 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.915 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.915 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.915 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.916 DEBUG:boto:Method: GET 2024-04-16T18:29:08.916 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.916 DEBUG:boto:Data: 2024-04-16T18:29:08.916 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.916 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.916 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.916 DEBUG:boto:Params: {} 2024-04-16T18:29:08.916 DEBUG:boto:Token: None 2024-04-16T18:29:08.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4= 2024-04-16T18:29:08.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4=', 'Content-Length': '0'} 2024-04-16T18:29:08.919 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000017b4c22859c7d2-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.919 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.919 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.919 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.920 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.920 DEBUG:boto:Method: GET 2024-04-16T18:29:08.920 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.920 DEBUG:boto:Data: 2024-04-16T18:29:08.920 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.920 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.920 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.920 DEBUG:boto:Params: {} 2024-04-16T18:29:08.920 DEBUG:boto:Token: None 2024-04-16T18:29:08.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.921 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4= 2024-04-16T18:29:08.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4=', 'Content-Length': '0'} 2024-04-16T18:29:08.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aa72f76e19e4c72-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.966 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.966 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.967 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.967 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.967 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.967 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.967 DEBUG:boto:Data: 2024-04-16T18:29:08.967 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.967 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.967 DEBUG:boto:Params: {} 2024-04-16T18:29:08.967 DEBUG:boto:Token: None 2024-04-16T18:29:08.968 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sxnwWTG49xsISKfvWDQGILFK34M= 2024-04-16T18:29:08.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sxnwWTG49xsISKfvWDQGILFK34M=', 'Content-Length': '0'} 2024-04-16T18:29:08.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a36c29679699c51-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.970 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.970 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.970 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.971 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.971 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.971 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.971 DEBUG:boto:Data: 2024-04-16T18:29:08.971 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.971 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.971 DEBUG:boto:Params: {} 2024-04-16T18:29:08.971 DEBUG:boto:Token: None 2024-04-16T18:29:08.971 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sxnwWTG49xsISKfvWDQGILFK34M= 2024-04-16T18:29:08.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sxnwWTG49xsISKfvWDQGILFK34M=', 'Content-Length': '0'} 2024-04-16T18:29:08.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000071a4a6f01b09a05-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.974 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:29:08.974 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.974 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.974 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.974 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.974 DEBUG:boto:Method: GET 2024-04-16T18:29:08.974 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.974 DEBUG:boto:Data: 2024-04-16T18:29:08.974 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.975 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.975 DEBUG:boto:Params: {} 2024-04-16T18:29:08.975 DEBUG:boto:Token: None 2024-04-16T18:29:08.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4= 2024-04-16T18:29:08.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4=', 'Content-Length': '0'} 2024-04-16T18:29:08.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f9039c2c53f9bbec-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.978 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.978 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.978 DEBUG:boto:path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.978 DEBUG:boto:auth_path=/cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.978 DEBUG:boto:Method: GET 2024-04-16T18:29:08.978 DEBUG:boto:Path: /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.978 DEBUG:boto:Data: 2024-04-16T18:29:08.978 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.978 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.978 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.979 DEBUG:boto:Params: {} 2024-04-16T18:29:08.979 DEBUG:boto:Token: None 2024-04-16T18:29:08.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185?versionId=null 2024-04-16T18:29:08.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4= 2024-04-16T18:29:08.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jP9HbNcFuuTUXEfvTkWcyJMp1N4=', 'Content-Length': '0'} 2024-04-16T18:29:08.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1b1e19c63e216ca-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.981 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.982 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.982 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:08.982 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:08.982 DEBUG:boto:Method: GET 2024-04-16T18:29:08.982 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:29:08.982 DEBUG:boto:Data: 2024-04-16T18:29:08.982 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.982 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.982 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.982 DEBUG:boto:Params: {} 2024-04-16T18:29:08.983 DEBUG:boto:Token: None 2024-04-16T18:29:08.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.985 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000069d0d00270cf1d01-00661ec374-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.985 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.986 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:08.986 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:08.986 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:08.986 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:08.986 DEBUG:boto:Method: GET 2024-04-16T18:29:08.986 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:29:08.986 DEBUG:boto:Data: 2024-04-16T18:29:08.986 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.987 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.987 DEBUG:boto:Params: {} 2024-04-16T18:29:08.987 DEBUG:boto:Token: None 2024-04-16T18:29:08.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/ 2024-04-16T18:29:08.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo= 2024-04-16T18:29:08.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOHyyGIAfZ3XL56Z04MMy1MUomo=', 'Content-Length': '0'} 2024-04-16T18:29:08.990 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041cec9cb570a7fc6-00661ec374-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.991 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:08.991 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.991 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.991 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.991 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:29:08.991 DEBUG:boto:Data: 2024-04-16T18:29:08.991 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.992 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.992 DEBUG:boto:Params: {} 2024-04-16T18:29:08.992 DEBUG:boto:Token: None 2024-04-16T18:29:08.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185 2024-04-16T18:29:08.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IKprPCNYBdMYo9PS+gzP6gohpww= 2024-04-16T18:29:08.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IKprPCNYBdMYo9PS+gzP6gohpww=', 'Content-Length': '0'} 2024-04-16T18:29:08.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000887137095fe7a6a-00661ec374-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.994 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.994 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.995 DEBUG:boto:Method: HEAD 2024-04-16T18:29:08.995 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:29:08.995 DEBUG:boto:Data: 2024-04-16T18:29:08.995 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:08.995 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.995 DEBUG:boto:Params: {} 2024-04-16T18:29:08.995 DEBUG:boto:Token: None 2024-04-16T18:29:08.995 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185 2024-04-16T18:29:08.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IKprPCNYBdMYo9PS+gzP6gohpww= 2024-04-16T18:29:08.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IKprPCNYBdMYo9PS+gzP6gohpww=', 'Content-Length': '0'} 2024-04-16T18:29:08.997 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e49d35ae88106cc-00661ec374-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:08.998 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:29:08.998 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:08.998 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:08.998 DEBUG:boto:Method: GET 2024-04-16T18:29:08.998 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:29:08.998 DEBUG:boto:Data: 2024-04-16T18:29:08.998 DEBUG:boto:Headers: {} 2024-04-16T18:29:08.998 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:08.999 DEBUG:boto:Port: 8000 2024-04-16T18:29:08.999 DEBUG:boto:Params: {} 2024-04-16T18:29:08.999 DEBUG:boto:Token: None 2024-04-16T18:29:08.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:08 GMT /cjqttm-52/obj185 2024-04-16T18:29:08.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i9GI6aH/RaTZPOBbkEPZ5UF/NEs= 2024-04-16T18:29:08.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i9GI6aH/RaTZPOBbkEPZ5UF/NEs=', 'Content-Length': '0'} 2024-04-16T18:29:09.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dbab200e10e1dfdb-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.001 DEBUG:boto:path=/cjqttm-52/obj185 2024-04-16T18:29:09.002 DEBUG:boto:auth_path=/cjqttm-52/obj185 2024-04-16T18:29:09.002 DEBUG:boto:Method: GET 2024-04-16T18:29:09.002 DEBUG:boto:Path: /cjqttm-52/obj185 2024-04-16T18:29:09.002 DEBUG:boto:Data: 2024-04-16T18:29:09.002 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.002 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.002 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.002 DEBUG:boto:Params: {} 2024-04-16T18:29:09.002 DEBUG:boto:Token: None 2024-04-16T18:29:09.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj185 2024-04-16T18:29:09.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ad1InOKWTTtrdZzg75q0BeHjOI4= 2024-04-16T18:29:09.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ad1InOKWTTtrdZzg75q0BeHjOI4=', 'Content-Length': '0'} 2024-04-16T18:29:09.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f4c81d63290ba72-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.005 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.005 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.005 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:09.005 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:09.005 DEBUG:boto:Method: GET 2024-04-16T18:29:09.005 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:29:09.006 DEBUG:boto:Data: 2024-04-16T18:29:09.006 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.006 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.006 DEBUG:boto:Params: {} 2024-04-16T18:29:09.006 DEBUG:boto:Token: None 2024-04-16T18:29:09.006 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.006 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.006 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020456744d7e88bb2-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.009 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.009 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.009 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.009 DEBUG:boto:path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:09.009 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj185 2024-04-16T18:29:09.010 DEBUG:boto:Method: GET 2024-04-16T18:29:09.010 DEBUG:boto:Path: /cjqttm-52/?prefix=obj185 2024-04-16T18:29:09.010 DEBUG:boto:Data: 2024-04-16T18:29:09.010 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.010 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.010 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.010 DEBUG:boto:Params: {} 2024-04-16T18:29:09.010 DEBUG:boto:Token: None 2024-04-16T18:29:09.010 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.010 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.014 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006665175c542e85dd-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.014 DEBUG:boto:b'cjqttm-52obj1851000falseobj1852024-04-16T18:27:48.419Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:29:09.014 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.014 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.015 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.015 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.015 DEBUG:boto:Method: GET 2024-04-16T18:29:09.015 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.015 DEBUG:boto:Data: 2024-04-16T18:29:09.015 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.015 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.015 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.015 DEBUG:boto:Params: {} 2024-04-16T18:29:09.015 DEBUG:boto:Token: None 2024-04-16T18:29:09.015 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.016 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg= 2024-04-16T18:29:09.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg=', 'Content-Length': '0'} 2024-04-16T18:29:09.018 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f179cc4a20c2b537-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.018 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.018 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.018 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.018 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.018 DEBUG:boto:Method: GET 2024-04-16T18:29:09.019 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.019 DEBUG:boto:Data: 2024-04-16T18:29:09.019 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.019 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.019 DEBUG:boto:Params: {} 2024-04-16T18:29:09.019 DEBUG:boto:Token: None 2024-04-16T18:29:09.019 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.019 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg= 2024-04-16T18:29:09.019 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg=', 'Content-Length': '0'} 2024-04-16T18:29:09.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000068614cbb7665d402-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.022 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.022 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.022 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.022 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.022 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.022 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.022 DEBUG:boto:Data: 2024-04-16T18:29:09.022 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.022 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.022 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.023 DEBUG:boto:Params: {} 2024-04-16T18:29:09.023 DEBUG:boto:Token: None 2024-04-16T18:29:09.023 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FHydkn25OqA0i7ij+I8bnFALgoU= 2024-04-16T18:29:09.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FHydkn25OqA0i7ij+I8bnFALgoU=', 'Content-Length': '0'} 2024-04-16T18:29:09.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c100cd85338ebb4-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.025 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.025 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.025 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.025 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.025 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.026 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.026 DEBUG:boto:Data: 2024-04-16T18:29:09.026 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.026 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.026 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.026 DEBUG:boto:Params: {} 2024-04-16T18:29:09.026 DEBUG:boto:Token: None 2024-04-16T18:29:09.026 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.026 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FHydkn25OqA0i7ij+I8bnFALgoU= 2024-04-16T18:29:09.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FHydkn25OqA0i7ij+I8bnFALgoU=', 'Content-Length': '0'} 2024-04-16T18:29:09.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df109e187bb7b1e0-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.028 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:29:09.029 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.029 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.029 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.029 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.029 DEBUG:boto:Method: GET 2024-04-16T18:29:09.029 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.029 DEBUG:boto:Data: 2024-04-16T18:29:09.029 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.029 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.029 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.029 DEBUG:boto:Params: {} 2024-04-16T18:29:09.030 DEBUG:boto:Token: None 2024-04-16T18:29:09.030 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.030 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg= 2024-04-16T18:29:09.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg=', 'Content-Length': '0'} 2024-04-16T18:29:09.032 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e487fec5a6c672b-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.032 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.032 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.032 DEBUG:boto:path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.032 DEBUG:boto:auth_path=/cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.032 DEBUG:boto:Method: GET 2024-04-16T18:29:09.033 DEBUG:boto:Path: /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.033 DEBUG:boto:Data: 2024-04-16T18:29:09.033 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.033 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.033 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.033 DEBUG:boto:Params: {} 2024-04-16T18:29:09.033 DEBUG:boto:Token: None 2024-04-16T18:29:09.033 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19?versionId=null 2024-04-16T18:29:09.033 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg= 2024-04-16T18:29:09.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dD0V2UySYbiLvPzQq1h2nu0BVXg=', 'Content-Length': '0'} 2024-04-16T18:29:09.035 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000554c8d03544aeb9a-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.035 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.036 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.036 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.036 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.036 DEBUG:boto:Method: GET 2024-04-16T18:29:09.036 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.036 DEBUG:boto:Data: 2024-04-16T18:29:09.036 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.036 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.036 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.036 DEBUG:boto:Params: {} 2024-04-16T18:29:09.036 DEBUG:boto:Token: None 2024-04-16T18:29:09.037 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.037 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.039 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eee9898e90e975e3-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.039 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.040 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.040 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.040 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.040 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.040 DEBUG:boto:Method: GET 2024-04-16T18:29:09.040 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.040 DEBUG:boto:Data: 2024-04-16T18:29:09.040 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.040 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.040 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.041 DEBUG:boto:Params: {} 2024-04-16T18:29:09.041 DEBUG:boto:Token: None 2024-04-16T18:29:09.041 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.041 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000800401348dc88587-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.086 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.087 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.087 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.087 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.087 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:29:09.087 DEBUG:boto:Data: 2024-04-16T18:29:09.087 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.087 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.087 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.087 DEBUG:boto:Params: {} 2024-04-16T18:29:09.087 DEBUG:boto:Token: None 2024-04-16T18:29:09.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19 2024-04-16T18:29:09.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eocNntPkt+eLGkw7PPFswZ+0xaQ= 2024-04-16T18:29:09.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eocNntPkt+eLGkw7PPFswZ+0xaQ=', 'Content-Length': '0'} 2024-04-16T18:29:09.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c30dfb9d09cf6af2-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.090 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.090 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.090 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.091 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:29:09.091 DEBUG:boto:Data: 2024-04-16T18:29:09.091 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.091 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.091 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.091 DEBUG:boto:Params: {} 2024-04-16T18:29:09.091 DEBUG:boto:Token: None 2024-04-16T18:29:09.091 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19 2024-04-16T18:29:09.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eocNntPkt+eLGkw7PPFswZ+0xaQ= 2024-04-16T18:29:09.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eocNntPkt+eLGkw7PPFswZ+0xaQ=', 'Content-Length': '0'} 2024-04-16T18:29:09.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a65bddfb19285362-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:29:09.093 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.094 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.094 DEBUG:boto:Method: GET 2024-04-16T18:29:09.094 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:29:09.094 DEBUG:boto:Data: 2024-04-16T18:29:09.094 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.094 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.094 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.094 DEBUG:boto:Params: {} 2024-04-16T18:29:09.094 DEBUG:boto:Token: None 2024-04-16T18:29:09.094 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19 2024-04-16T18:29:09.094 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nzFwHzYceu5yu0BcjNmAt1cki2g= 2024-04-16T18:29:09.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nzFwHzYceu5yu0BcjNmAt1cki2g=', 'Content-Length': '0'} 2024-04-16T18:29:09.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e404882c3b019cbd-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.097 DEBUG:boto:path=/cjqttm-52/obj19 2024-04-16T18:29:09.097 DEBUG:boto:auth_path=/cjqttm-52/obj19 2024-04-16T18:29:09.097 DEBUG:boto:Method: GET 2024-04-16T18:29:09.097 DEBUG:boto:Path: /cjqttm-52/obj19 2024-04-16T18:29:09.097 DEBUG:boto:Data: 2024-04-16T18:29:09.097 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.097 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.097 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.097 DEBUG:boto:Params: {} 2024-04-16T18:29:09.097 DEBUG:boto:Token: None 2024-04-16T18:29:09.098 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj19 2024-04-16T18:29:09.098 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nzFwHzYceu5yu0BcjNmAt1cki2g= 2024-04-16T18:29:09.098 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nzFwHzYceu5yu0BcjNmAt1cki2g=', 'Content-Length': '0'} 2024-04-16T18:29:09.099 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd7d5e822d9d8ce7-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.100 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.100 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.100 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.100 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.100 DEBUG:boto:Method: GET 2024-04-16T18:29:09.100 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.100 DEBUG:boto:Data: 2024-04-16T18:29:09.100 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.101 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.101 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.101 DEBUG:boto:Params: {} 2024-04-16T18:29:09.101 DEBUG:boto:Token: None 2024-04-16T18:29:09.101 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.101 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.103 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000481dfaacaff20bee-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.103 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.104 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.104 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.104 DEBUG:boto:path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.104 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.104 DEBUG:boto:Method: GET 2024-04-16T18:29:09.104 DEBUG:boto:Path: /cjqttm-52/?prefix=obj19 2024-04-16T18:29:09.104 DEBUG:boto:Data: 2024-04-16T18:29:09.104 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.104 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.105 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.105 DEBUG:boto:Params: {} 2024-04-16T18:29:09.105 DEBUG:boto:Token: None 2024-04-16T18:29:09.105 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.105 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.105 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ad1f4d0f0f97da3-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.109 DEBUG:boto:b'cjqttm-52obj191000falseobj192024-04-16T18:21:05.060Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:29:09.109 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.109 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.110 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.110 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.110 DEBUG:boto:Method: GET 2024-04-16T18:29:09.110 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.110 DEBUG:boto:Data: 2024-04-16T18:29:09.110 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.110 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.110 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.110 DEBUG:boto:Params: {} 2024-04-16T18:29:09.110 DEBUG:boto:Token: None 2024-04-16T18:29:09.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0= 2024-04-16T18:29:09.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0=', 'Content-Length': '0'} 2024-04-16T18:29:09.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bcb48e24f0fb99a-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.154 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.154 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.154 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.155 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.155 DEBUG:boto:Method: GET 2024-04-16T18:29:09.155 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.155 DEBUG:boto:Data: 2024-04-16T18:29:09.155 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.155 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.155 DEBUG:boto:Params: {} 2024-04-16T18:29:09.155 DEBUG:boto:Token: None 2024-04-16T18:29:09.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0= 2024-04-16T18:29:09.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0=', 'Content-Length': '0'} 2024-04-16T18:29:09.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd9f9a737c2f962c-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.158 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.158 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.158 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.158 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.158 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.158 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.158 DEBUG:boto:Data: 2024-04-16T18:29:09.158 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.158 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.159 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.159 DEBUG:boto:Params: {} 2024-04-16T18:29:09.159 DEBUG:boto:Token: None 2024-04-16T18:29:09.159 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6iukDhBM8LNhUpX+M9MpZTmupSk= 2024-04-16T18:29:09.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6iukDhBM8LNhUpX+M9MpZTmupSk=', 'Content-Length': '0'} 2024-04-16T18:29:09.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff2508a83426920e-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.161 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.161 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.162 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.162 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.162 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.162 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.162 DEBUG:boto:Data: 2024-04-16T18:29:09.162 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.162 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.162 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.162 DEBUG:boto:Params: {} 2024-04-16T18:29:09.162 DEBUG:boto:Token: None 2024-04-16T18:29:09.163 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6iukDhBM8LNhUpX+M9MpZTmupSk= 2024-04-16T18:29:09.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6iukDhBM8LNhUpX+M9MpZTmupSk=', 'Content-Length': '0'} 2024-04-16T18:29:09.164 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000215be45b2a6b38d1-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.165 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:29:09.165 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.165 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.165 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.165 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.165 DEBUG:boto:Method: GET 2024-04-16T18:29:09.165 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.165 DEBUG:boto:Data: 2024-04-16T18:29:09.165 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.165 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.165 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.165 DEBUG:boto:Params: {} 2024-04-16T18:29:09.166 DEBUG:boto:Token: None 2024-04-16T18:29:09.166 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0= 2024-04-16T18:29:09.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0=', 'Content-Length': '0'} 2024-04-16T18:29:09.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b33fee9b87975080-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.168 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.168 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.168 DEBUG:boto:path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.168 DEBUG:boto:auth_path=/cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.168 DEBUG:boto:Method: GET 2024-04-16T18:29:09.169 DEBUG:boto:Path: /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.169 DEBUG:boto:Data: 2024-04-16T18:29:09.169 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.169 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.169 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.169 DEBUG:boto:Params: {} 2024-04-16T18:29:09.169 DEBUG:boto:Token: None 2024-04-16T18:29:09.169 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22?versionId=null 2024-04-16T18:29:09.169 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0= 2024-04-16T18:29:09.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UUQv8FkkuGotol9sZh+vB2/IZt0=', 'Content-Length': '0'} 2024-04-16T18:29:09.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037fa75e9d8bd905b-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.171 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.171 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.172 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.172 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.172 DEBUG:boto:Method: GET 2024-04-16T18:29:09.172 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.172 DEBUG:boto:Data: 2024-04-16T18:29:09.172 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.172 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.172 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.172 DEBUG:boto:Params: {} 2024-04-16T18:29:09.172 DEBUG:boto:Token: None 2024-04-16T18:29:09.173 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.173 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.175 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045c1f6f7eb7399d6-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.175 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.175 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.176 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.176 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.176 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.176 DEBUG:boto:Method: GET 2024-04-16T18:29:09.176 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.176 DEBUG:boto:Data: 2024-04-16T18:29:09.176 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.176 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.176 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.176 DEBUG:boto:Params: {} 2024-04-16T18:29:09.176 DEBUG:boto:Token: None 2024-04-16T18:29:09.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.177 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.177 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.180 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000926ee6f414400046-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.180 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.180 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.180 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.180 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.181 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:29:09.181 DEBUG:boto:Data: 2024-04-16T18:29:09.181 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.181 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.181 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.181 DEBUG:boto:Params: {} 2024-04-16T18:29:09.181 DEBUG:boto:Token: None 2024-04-16T18:29:09.181 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22 2024-04-16T18:29:09.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vEz7FFW4LyYY6K/9Jcak1hS9dg0= 2024-04-16T18:29:09.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vEz7FFW4LyYY6K/9Jcak1hS9dg0=', 'Content-Length': '0'} 2024-04-16T18:29:09.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ed6098c70c30ffc-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.183 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.183 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.184 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.184 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:29:09.184 DEBUG:boto:Data: 2024-04-16T18:29:09.184 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.184 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.184 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.184 DEBUG:boto:Params: {} 2024-04-16T18:29:09.184 DEBUG:boto:Token: None 2024-04-16T18:29:09.184 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22 2024-04-16T18:29:09.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vEz7FFW4LyYY6K/9Jcak1hS9dg0= 2024-04-16T18:29:09.185 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vEz7FFW4LyYY6K/9Jcak1hS9dg0=', 'Content-Length': '0'} 2024-04-16T18:29:09.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d9061b2adbb9930-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:29:09.186 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.187 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.187 DEBUG:boto:Method: GET 2024-04-16T18:29:09.187 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:29:09.187 DEBUG:boto:Data: 2024-04-16T18:29:09.187 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.187 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.187 DEBUG:boto:Params: {} 2024-04-16T18:29:09.187 DEBUG:boto:Token: None 2024-04-16T18:29:09.187 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22 2024-04-16T18:29:09.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:No6eR4tNC9rKWQYyW/w03N59Igk= 2024-04-16T18:29:09.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:No6eR4tNC9rKWQYyW/w03N59Igk=', 'Content-Length': '0'} 2024-04-16T18:29:09.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9e1fbe2bf3a726a-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.230 DEBUG:boto:path=/cjqttm-52/obj22 2024-04-16T18:29:09.230 DEBUG:boto:auth_path=/cjqttm-52/obj22 2024-04-16T18:29:09.231 DEBUG:boto:Method: GET 2024-04-16T18:29:09.231 DEBUG:boto:Path: /cjqttm-52/obj22 2024-04-16T18:29:09.231 DEBUG:boto:Data: 2024-04-16T18:29:09.231 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.231 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.231 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.231 DEBUG:boto:Params: {} 2024-04-16T18:29:09.231 DEBUG:boto:Token: None 2024-04-16T18:29:09.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj22 2024-04-16T18:29:09.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:No6eR4tNC9rKWQYyW/w03N59Igk= 2024-04-16T18:29:09.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:No6eR4tNC9rKWQYyW/w03N59Igk=', 'Content-Length': '0'} 2024-04-16T18:29:09.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e7f0fcdddd123092-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.234 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.234 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.234 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.234 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.234 DEBUG:boto:Method: GET 2024-04-16T18:29:09.234 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.234 DEBUG:boto:Data: 2024-04-16T18:29:09.234 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.234 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.235 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.235 DEBUG:boto:Params: {} 2024-04-16T18:29:09.235 DEBUG:boto:Token: None 2024-04-16T18:29:09.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c5083b042aa75bf-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.237 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.238 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.238 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.238 DEBUG:boto:path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.238 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.238 DEBUG:boto:Method: GET 2024-04-16T18:29:09.238 DEBUG:boto:Path: /cjqttm-52/?prefix=obj22 2024-04-16T18:29:09.238 DEBUG:boto:Data: 2024-04-16T18:29:09.238 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.239 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.239 DEBUG:boto:Params: {} 2024-04-16T18:29:09.239 DEBUG:boto:Token: None 2024-04-16T18:29:09.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.239 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.242 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000029a47edeb67935d3-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.243 DEBUG:boto:b'cjqttm-52obj221000falseobj222024-04-16T18:19:55.899Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:29:09.243 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.243 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.243 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.243 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.243 DEBUG:boto:Method: GET 2024-04-16T18:29:09.243 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.244 DEBUG:boto:Data: 2024-04-16T18:29:09.244 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.244 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.244 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.244 DEBUG:boto:Params: {} 2024-04-16T18:29:09.244 DEBUG:boto:Token: None 2024-04-16T18:29:09.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8= 2024-04-16T18:29:09.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8=', 'Content-Length': '0'} 2024-04-16T18:29:09.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb85b58d2091b789-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.247 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.247 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.247 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.247 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.247 DEBUG:boto:Method: GET 2024-04-16T18:29:09.247 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.247 DEBUG:boto:Data: 2024-04-16T18:29:09.247 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.248 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.248 DEBUG:boto:Params: {} 2024-04-16T18:29:09.248 DEBUG:boto:Token: None 2024-04-16T18:29:09.248 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8= 2024-04-16T18:29:09.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8=', 'Content-Length': '0'} 2024-04-16T18:29:09.250 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007631354cd88190bc-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.250 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.250 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.251 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.251 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.251 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.251 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.251 DEBUG:boto:Data: 2024-04-16T18:29:09.251 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.251 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.251 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.251 DEBUG:boto:Params: {} 2024-04-16T18:29:09.251 DEBUG:boto:Token: None 2024-04-16T18:29:09.252 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4B9b0coYdRXuUaBwV5t/vVth5o= 2024-04-16T18:29:09.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4B9b0coYdRXuUaBwV5t/vVth5o=', 'Content-Length': '0'} 2024-04-16T18:29:09.253 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f409fe59a8252c9-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.254 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.254 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.254 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.254 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.254 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.254 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.254 DEBUG:boto:Data: 2024-04-16T18:29:09.254 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.255 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.255 DEBUG:boto:Params: {} 2024-04-16T18:29:09.255 DEBUG:boto:Token: None 2024-04-16T18:29:09.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z4B9b0coYdRXuUaBwV5t/vVth5o= 2024-04-16T18:29:09.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z4B9b0coYdRXuUaBwV5t/vVth5o=', 'Content-Length': '0'} 2024-04-16T18:29:09.257 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d096db427dd1cf2b-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:29:09.257 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.257 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.258 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.258 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.258 DEBUG:boto:Method: GET 2024-04-16T18:29:09.258 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.258 DEBUG:boto:Data: 2024-04-16T18:29:09.258 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.258 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.258 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.258 DEBUG:boto:Params: {} 2024-04-16T18:29:09.258 DEBUG:boto:Token: None 2024-04-16T18:29:09.259 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8= 2024-04-16T18:29:09.259 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8=', 'Content-Length': '0'} 2024-04-16T18:29:09.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005091365d98cce8c3-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.261 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.261 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.261 DEBUG:boto:path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.261 DEBUG:boto:auth_path=/cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.261 DEBUG:boto:Method: GET 2024-04-16T18:29:09.262 DEBUG:boto:Path: /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.262 DEBUG:boto:Data: 2024-04-16T18:29:09.262 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.262 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.262 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.262 DEBUG:boto:Params: {} 2024-04-16T18:29:09.262 DEBUG:boto:Token: None 2024-04-16T18:29:09.262 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23?versionId=null 2024-04-16T18:29:09.262 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8= 2024-04-16T18:29:09.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oZHx4L1U+75o7HbU8k8CSSfXHp8=', 'Content-Length': '0'} 2024-04-16T18:29:09.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ac0dd444cfc1b85-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.264 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.265 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.265 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.265 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.265 DEBUG:boto:Method: GET 2024-04-16T18:29:09.265 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.265 DEBUG:boto:Data: 2024-04-16T18:29:09.265 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.265 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.265 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.265 DEBUG:boto:Params: {} 2024-04-16T18:29:09.266 DEBUG:boto:Token: None 2024-04-16T18:29:09.266 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.268 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000524e6905ea69c8c-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.268 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.269 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.269 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.269 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.269 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.269 DEBUG:boto:Method: GET 2024-04-16T18:29:09.269 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.269 DEBUG:boto:Data: 2024-04-16T18:29:09.269 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.269 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.269 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.270 DEBUG:boto:Params: {} 2024-04-16T18:29:09.270 DEBUG:boto:Token: None 2024-04-16T18:29:09.270 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.270 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.273 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f5bfbdaa278401f-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.274 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.274 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.274 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.274 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.274 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:29:09.274 DEBUG:boto:Data: 2024-04-16T18:29:09.274 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.275 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.275 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.275 DEBUG:boto:Params: {} 2024-04-16T18:29:09.275 DEBUG:boto:Token: None 2024-04-16T18:29:09.275 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23 2024-04-16T18:29:09.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vdT9FHHhogUd4V9rahs/T1U58OE= 2024-04-16T18:29:09.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vdT9FHHhogUd4V9rahs/T1U58OE=', 'Content-Length': '0'} 2024-04-16T18:29:09.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038ffbd5657d0bc44-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.277 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.277 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.277 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.278 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:29:09.278 DEBUG:boto:Data: 2024-04-16T18:29:09.278 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.278 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.278 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.278 DEBUG:boto:Params: {} 2024-04-16T18:29:09.278 DEBUG:boto:Token: None 2024-04-16T18:29:09.278 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23 2024-04-16T18:29:09.278 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vdT9FHHhogUd4V9rahs/T1U58OE= 2024-04-16T18:29:09.278 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vdT9FHHhogUd4V9rahs/T1U58OE=', 'Content-Length': '0'} 2024-04-16T18:29:09.280 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e6df2cd6f08aef2-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.280 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:29:09.281 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.281 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.281 DEBUG:boto:Method: GET 2024-04-16T18:29:09.281 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:29:09.281 DEBUG:boto:Data: 2024-04-16T18:29:09.281 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.281 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.281 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.281 DEBUG:boto:Params: {} 2024-04-16T18:29:09.281 DEBUG:boto:Token: None 2024-04-16T18:29:09.281 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23 2024-04-16T18:29:09.282 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lLiPJQS/U6SGNI/qGGJegBb4SCA= 2024-04-16T18:29:09.282 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lLiPJQS/U6SGNI/qGGJegBb4SCA=', 'Content-Length': '0'} 2024-04-16T18:29:09.284 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf0bac9d52b7e2e4-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.284 DEBUG:boto:path=/cjqttm-52/obj23 2024-04-16T18:29:09.284 DEBUG:boto:auth_path=/cjqttm-52/obj23 2024-04-16T18:29:09.284 DEBUG:boto:Method: GET 2024-04-16T18:29:09.284 DEBUG:boto:Path: /cjqttm-52/obj23 2024-04-16T18:29:09.284 DEBUG:boto:Data: 2024-04-16T18:29:09.285 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.285 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.285 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.285 DEBUG:boto:Params: {} 2024-04-16T18:29:09.285 DEBUG:boto:Token: None 2024-04-16T18:29:09.285 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj23 2024-04-16T18:29:09.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lLiPJQS/U6SGNI/qGGJegBb4SCA= 2024-04-16T18:29:09.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lLiPJQS/U6SGNI/qGGJegBb4SCA=', 'Content-Length': '0'} 2024-04-16T18:29:09.287 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e14fb526eae4b0a-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.287 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.287 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.288 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.288 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.288 DEBUG:boto:Method: GET 2024-04-16T18:29:09.288 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.288 DEBUG:boto:Data: 2024-04-16T18:29:09.288 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.288 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.288 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.288 DEBUG:boto:Params: {} 2024-04-16T18:29:09.288 DEBUG:boto:Token: None 2024-04-16T18:29:09.288 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.289 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.289 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.291 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000864f889585e45106-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.291 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.291 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.292 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.292 DEBUG:boto:path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.292 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.292 DEBUG:boto:Method: GET 2024-04-16T18:29:09.292 DEBUG:boto:Path: /cjqttm-52/?prefix=obj23 2024-04-16T18:29:09.292 DEBUG:boto:Data: 2024-04-16T18:29:09.292 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.292 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.292 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.292 DEBUG:boto:Params: {} 2024-04-16T18:29:09.292 DEBUG:boto:Token: None 2024-04-16T18:29:09.293 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098b415bf4b31b008-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.338 DEBUG:boto:b'cjqttm-52obj231000falseobj232024-04-16T18:21:49.242Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.339 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:29:09.339 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.339 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.339 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.339 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.339 DEBUG:boto:Method: GET 2024-04-16T18:29:09.339 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.339 DEBUG:boto:Data: 2024-04-16T18:29:09.339 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.339 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.339 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.340 DEBUG:boto:Params: {} 2024-04-16T18:29:09.340 DEBUG:boto:Token: None 2024-04-16T18:29:09.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA= 2024-04-16T18:29:09.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA=', 'Content-Length': '0'} 2024-04-16T18:29:09.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000014b0242c1d6f1b2-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.342 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.343 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.343 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.343 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.343 DEBUG:boto:Method: GET 2024-04-16T18:29:09.343 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.343 DEBUG:boto:Data: 2024-04-16T18:29:09.343 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.343 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.343 DEBUG:boto:Params: {} 2024-04-16T18:29:09.343 DEBUG:boto:Token: None 2024-04-16T18:29:09.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA= 2024-04-16T18:29:09.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA=', 'Content-Length': '0'} 2024-04-16T18:29:09.346 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032b5c09f2a1bc245-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.346 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.346 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.347 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.347 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.347 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.347 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.347 DEBUG:boto:Data: 2024-04-16T18:29:09.347 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.347 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.347 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.347 DEBUG:boto:Params: {} 2024-04-16T18:29:09.347 DEBUG:boto:Token: None 2024-04-16T18:29:09.347 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ALVm5MPZl22CUs1+r2LpBVWSFQ= 2024-04-16T18:29:09.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ALVm5MPZl22CUs1+r2LpBVWSFQ=', 'Content-Length': '0'} 2024-04-16T18:29:09.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000765c1073530aa42-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.350 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.350 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.350 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.350 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.350 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.350 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.350 DEBUG:boto:Data: 2024-04-16T18:29:09.350 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.350 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.351 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.351 DEBUG:boto:Params: {} 2024-04-16T18:29:09.351 DEBUG:boto:Token: None 2024-04-16T18:29:09.351 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ALVm5MPZl22CUs1+r2LpBVWSFQ= 2024-04-16T18:29:09.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ALVm5MPZl22CUs1+r2LpBVWSFQ=', 'Content-Length': '0'} 2024-04-16T18:29:09.353 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004efa54986da7d530-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.353 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:29:09.354 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.354 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.354 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.354 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.354 DEBUG:boto:Method: GET 2024-04-16T18:29:09.354 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.354 DEBUG:boto:Data: 2024-04-16T18:29:09.354 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.354 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.354 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.355 DEBUG:boto:Params: {} 2024-04-16T18:29:09.355 DEBUG:boto:Token: None 2024-04-16T18:29:09.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA= 2024-04-16T18:29:09.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA=', 'Content-Length': '0'} 2024-04-16T18:29:09.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c8b2a4336db8369-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.398 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.398 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.399 DEBUG:boto:path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.399 DEBUG:boto:auth_path=/cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.399 DEBUG:boto:Method: GET 2024-04-16T18:29:09.399 DEBUG:boto:Path: /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.399 DEBUG:boto:Data: 2024-04-16T18:29:09.399 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.399 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.399 DEBUG:boto:Params: {} 2024-04-16T18:29:09.399 DEBUG:boto:Token: None 2024-04-16T18:29:09.400 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29?versionId=null 2024-04-16T18:29:09.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA= 2024-04-16T18:29:09.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8c6eJ27WRqNvUtUQr3gFIqK3brA=', 'Content-Length': '0'} 2024-04-16T18:29:09.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ff4670c6d6164681-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.402 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.402 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.402 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.403 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.403 DEBUG:boto:Method: GET 2024-04-16T18:29:09.403 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.403 DEBUG:boto:Data: 2024-04-16T18:29:09.403 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.403 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.403 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.403 DEBUG:boto:Params: {} 2024-04-16T18:29:09.403 DEBUG:boto:Token: None 2024-04-16T18:29:09.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.406 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002dba51778f8c653e-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.406 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.406 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.407 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.407 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.407 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.407 DEBUG:boto:Method: GET 2024-04-16T18:29:09.407 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.407 DEBUG:boto:Data: 2024-04-16T18:29:09.407 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.407 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.407 DEBUG:boto:Params: {} 2024-04-16T18:29:09.407 DEBUG:boto:Token: None 2024-04-16T18:29:09.408 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.412 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e1cd847af036b4a8-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.412 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.412 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.412 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.412 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.412 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:29:09.412 DEBUG:boto:Data: 2024-04-16T18:29:09.413 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.413 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.413 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.413 DEBUG:boto:Params: {} 2024-04-16T18:29:09.413 DEBUG:boto:Token: None 2024-04-16T18:29:09.413 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29 2024-04-16T18:29:09.413 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vUJhIzqX1VGPwjDgHNF3MG5PqmA= 2024-04-16T18:29:09.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vUJhIzqX1VGPwjDgHNF3MG5PqmA=', 'Content-Length': '0'} 2024-04-16T18:29:09.415 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfc95fb8bc34cc83-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.415 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.416 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.416 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.416 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:29:09.416 DEBUG:boto:Data: 2024-04-16T18:29:09.416 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.416 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.416 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.416 DEBUG:boto:Params: {} 2024-04-16T18:29:09.416 DEBUG:boto:Token: None 2024-04-16T18:29:09.416 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29 2024-04-16T18:29:09.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vUJhIzqX1VGPwjDgHNF3MG5PqmA= 2024-04-16T18:29:09.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vUJhIzqX1VGPwjDgHNF3MG5PqmA=', 'Content-Length': '0'} 2024-04-16T18:29:09.418 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044583bb768113498-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.419 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:29:09.419 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.419 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.419 DEBUG:boto:Method: GET 2024-04-16T18:29:09.419 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:29:09.419 DEBUG:boto:Data: 2024-04-16T18:29:09.419 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.419 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.419 DEBUG:boto:Params: {} 2024-04-16T18:29:09.419 DEBUG:boto:Token: None 2024-04-16T18:29:09.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29 2024-04-16T18:29:09.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+zFhMhU8MeuTUcajuEeU3IJ/0lM= 2024-04-16T18:29:09.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+zFhMhU8MeuTUcajuEeU3IJ/0lM=', 'Content-Length': '0'} 2024-04-16T18:29:09.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f71fc106af0b6c4-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.462 DEBUG:boto:path=/cjqttm-52/obj29 2024-04-16T18:29:09.462 DEBUG:boto:auth_path=/cjqttm-52/obj29 2024-04-16T18:29:09.463 DEBUG:boto:Method: GET 2024-04-16T18:29:09.463 DEBUG:boto:Path: /cjqttm-52/obj29 2024-04-16T18:29:09.463 DEBUG:boto:Data: 2024-04-16T18:29:09.463 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.463 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.463 DEBUG:boto:Params: {} 2024-04-16T18:29:09.463 DEBUG:boto:Token: None 2024-04-16T18:29:09.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj29 2024-04-16T18:29:09.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+zFhMhU8MeuTUcajuEeU3IJ/0lM= 2024-04-16T18:29:09.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+zFhMhU8MeuTUcajuEeU3IJ/0lM=', 'Content-Length': '0'} 2024-04-16T18:29:09.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7750df4adfdd550-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.466 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.466 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.466 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.466 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.466 DEBUG:boto:Method: GET 2024-04-16T18:29:09.466 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.467 DEBUG:boto:Data: 2024-04-16T18:29:09.467 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.467 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.467 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.467 DEBUG:boto:Params: {} 2024-04-16T18:29:09.467 DEBUG:boto:Token: None 2024-04-16T18:29:09.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013b0000ec0e8072e-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.510 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.511 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.511 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.511 DEBUG:boto:path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.511 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.511 DEBUG:boto:Method: GET 2024-04-16T18:29:09.511 DEBUG:boto:Path: /cjqttm-52/?prefix=obj29 2024-04-16T18:29:09.511 DEBUG:boto:Data: 2024-04-16T18:29:09.511 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.511 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.511 DEBUG:boto:Params: {} 2024-04-16T18:29:09.512 DEBUG:boto:Token: None 2024-04-16T18:29:09.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.516 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081d5928151b6ad01-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.516 DEBUG:boto:b'cjqttm-52obj291000falseobj292024-04-16T18:24:09.446Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.516 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:29:09.516 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.516 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.516 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.516 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.517 DEBUG:boto:Method: GET 2024-04-16T18:29:09.517 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.517 DEBUG:boto:Data: 2024-04-16T18:29:09.517 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.517 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.517 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.517 DEBUG:boto:Params: {} 2024-04-16T18:29:09.517 DEBUG:boto:Token: None 2024-04-16T18:29:09.517 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.517 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4= 2024-04-16T18:29:09.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4=', 'Content-Length': '0'} 2024-04-16T18:29:09.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a5587e9814674b7-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.562 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.562 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.563 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.563 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.563 DEBUG:boto:Method: GET 2024-04-16T18:29:09.563 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.563 DEBUG:boto:Data: 2024-04-16T18:29:09.563 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.563 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.563 DEBUG:boto:Params: {} 2024-04-16T18:29:09.563 DEBUG:boto:Token: None 2024-04-16T18:29:09.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4= 2024-04-16T18:29:09.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4=', 'Content-Length': '0'} 2024-04-16T18:29:09.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4a2b92adbccfbd8-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.566 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.566 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.567 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.567 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.567 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.567 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.567 DEBUG:boto:Data: 2024-04-16T18:29:09.567 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.567 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.567 DEBUG:boto:Params: {} 2024-04-16T18:29:09.567 DEBUG:boto:Token: None 2024-04-16T18:29:09.567 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NzZGPXm1wV0qfKbPEOSWpIYeERY= 2024-04-16T18:29:09.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NzZGPXm1wV0qfKbPEOSWpIYeERY=', 'Content-Length': '0'} 2024-04-16T18:29:09.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d61161d2c61dcd0-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.570 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.570 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.570 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.570 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.570 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.570 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.570 DEBUG:boto:Data: 2024-04-16T18:29:09.570 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.571 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.571 DEBUG:boto:Params: {} 2024-04-16T18:29:09.571 DEBUG:boto:Token: None 2024-04-16T18:29:09.571 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.571 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NzZGPXm1wV0qfKbPEOSWpIYeERY= 2024-04-16T18:29:09.571 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NzZGPXm1wV0qfKbPEOSWpIYeERY=', 'Content-Length': '0'} 2024-04-16T18:29:09.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e44523395d06dab-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.574 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:29:09.574 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.574 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.574 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.574 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.574 DEBUG:boto:Method: GET 2024-04-16T18:29:09.575 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.575 DEBUG:boto:Data: 2024-04-16T18:29:09.575 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.575 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.575 DEBUG:boto:Params: {} 2024-04-16T18:29:09.575 DEBUG:boto:Token: None 2024-04-16T18:29:09.575 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4= 2024-04-16T18:29:09.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4=', 'Content-Length': '0'} 2024-04-16T18:29:09.578 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8ff65f58b02d400-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.618 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.618 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.619 DEBUG:boto:path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.619 DEBUG:boto:auth_path=/cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.619 DEBUG:boto:Method: GET 2024-04-16T18:29:09.619 DEBUG:boto:Path: /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.619 DEBUG:boto:Data: 2024-04-16T18:29:09.619 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.619 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.619 DEBUG:boto:Params: {} 2024-04-16T18:29:09.619 DEBUG:boto:Token: None 2024-04-16T18:29:09.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31?versionId=null 2024-04-16T18:29:09.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4= 2024-04-16T18:29:09.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J+34jrVNtr4BFnySWmTue3sMPs4=', 'Content-Length': '0'} 2024-04-16T18:29:09.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006382bdde2af52a7c-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.622 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.622 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.622 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.622 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.622 DEBUG:boto:Method: GET 2024-04-16T18:29:09.622 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.622 DEBUG:boto:Data: 2024-04-16T18:29:09.623 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.623 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.623 DEBUG:boto:Params: {} 2024-04-16T18:29:09.623 DEBUG:boto:Token: None 2024-04-16T18:29:09.623 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000104ac61cf8fe6dbe-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.666 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.667 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.667 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.667 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.667 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.667 DEBUG:boto:Method: GET 2024-04-16T18:29:09.667 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.667 DEBUG:boto:Data: 2024-04-16T18:29:09.667 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.667 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.667 DEBUG:boto:Params: {} 2024-04-16T18:29:09.667 DEBUG:boto:Token: None 2024-04-16T18:29:09.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014317194a36a28c9-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.671 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.672 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.672 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.672 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.672 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:29:09.672 DEBUG:boto:Data: 2024-04-16T18:29:09.672 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.672 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.672 DEBUG:boto:Params: {} 2024-04-16T18:29:09.673 DEBUG:boto:Token: None 2024-04-16T18:29:09.673 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31 2024-04-16T18:29:09.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OMJpXcNkqFkGed2RDDWR/Ls2uwU= 2024-04-16T18:29:09.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OMJpXcNkqFkGed2RDDWR/Ls2uwU=', 'Content-Length': '0'} 2024-04-16T18:29:09.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077c03e077d5187be-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.675 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.675 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.675 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.676 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:29:09.676 DEBUG:boto:Data: 2024-04-16T18:29:09.676 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.676 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.676 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.676 DEBUG:boto:Params: {} 2024-04-16T18:29:09.676 DEBUG:boto:Token: None 2024-04-16T18:29:09.676 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31 2024-04-16T18:29:09.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OMJpXcNkqFkGed2RDDWR/Ls2uwU= 2024-04-16T18:29:09.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OMJpXcNkqFkGed2RDDWR/Ls2uwU=', 'Content-Length': '0'} 2024-04-16T18:29:09.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a9aa59c537351ad-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:29:09.679 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.679 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.679 DEBUG:boto:Method: GET 2024-04-16T18:29:09.679 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:29:09.679 DEBUG:boto:Data: 2024-04-16T18:29:09.679 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.679 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.679 DEBUG:boto:Params: {} 2024-04-16T18:29:09.679 DEBUG:boto:Token: None 2024-04-16T18:29:09.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31 2024-04-16T18:29:09.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J80nkBF+ihdAGMXQnZoy4QnWSio= 2024-04-16T18:29:09.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J80nkBF+ihdAGMXQnZoy4QnWSio=', 'Content-Length': '0'} 2024-04-16T18:29:09.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6099ebe0b05e4d5-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.722 DEBUG:boto:path=/cjqttm-52/obj31 2024-04-16T18:29:09.722 DEBUG:boto:auth_path=/cjqttm-52/obj31 2024-04-16T18:29:09.722 DEBUG:boto:Method: GET 2024-04-16T18:29:09.723 DEBUG:boto:Path: /cjqttm-52/obj31 2024-04-16T18:29:09.723 DEBUG:boto:Data: 2024-04-16T18:29:09.723 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.723 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.723 DEBUG:boto:Params: {} 2024-04-16T18:29:09.723 DEBUG:boto:Token: None 2024-04-16T18:29:09.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj31 2024-04-16T18:29:09.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J80nkBF+ihdAGMXQnZoy4QnWSio= 2024-04-16T18:29:09.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J80nkBF+ihdAGMXQnZoy4QnWSio=', 'Content-Length': '0'} 2024-04-16T18:29:09.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005df18fa74457a3e0-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.726 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.726 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.726 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.726 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.726 DEBUG:boto:Method: GET 2024-04-16T18:29:09.726 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.726 DEBUG:boto:Data: 2024-04-16T18:29:09.726 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.726 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.726 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.727 DEBUG:boto:Params: {} 2024-04-16T18:29:09.727 DEBUG:boto:Token: None 2024-04-16T18:29:09.727 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.730 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd4d0cad65c5e623-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.774 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.775 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.775 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.775 DEBUG:boto:path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.775 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.775 DEBUG:boto:Method: GET 2024-04-16T18:29:09.775 DEBUG:boto:Path: /cjqttm-52/?prefix=obj31 2024-04-16T18:29:09.775 DEBUG:boto:Data: 2024-04-16T18:29:09.775 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.775 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.775 DEBUG:boto:Params: {} 2024-04-16T18:29:09.775 DEBUG:boto:Token: None 2024-04-16T18:29:09.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.779 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003cee1d1775b83116-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.779 DEBUG:boto:b'cjqttm-52obj311000falseobj312024-04-16T18:26:26.325Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.780 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:29:09.780 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.780 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.780 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.780 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.780 DEBUG:boto:Method: GET 2024-04-16T18:29:09.780 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.780 DEBUG:boto:Data: 2024-04-16T18:29:09.780 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.780 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.781 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.781 DEBUG:boto:Params: {} 2024-04-16T18:29:09.781 DEBUG:boto:Token: None 2024-04-16T18:29:09.781 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.781 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU= 2024-04-16T18:29:09.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU=', 'Content-Length': '0'} 2024-04-16T18:29:09.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5b3a0f2114bb73b-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.826 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.826 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.827 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.827 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.827 DEBUG:boto:Method: GET 2024-04-16T18:29:09.827 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.827 DEBUG:boto:Data: 2024-04-16T18:29:09.827 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.827 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.827 DEBUG:boto:Params: {} 2024-04-16T18:29:09.827 DEBUG:boto:Token: None 2024-04-16T18:29:09.827 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU= 2024-04-16T18:29:09.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU=', 'Content-Length': '0'} 2024-04-16T18:29:09.830 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f2c8994cd4765b2-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.830 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.830 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.830 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.830 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.830 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.831 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.831 DEBUG:boto:Data: 2024-04-16T18:29:09.831 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.831 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.831 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.831 DEBUG:boto:Params: {} 2024-04-16T18:29:09.831 DEBUG:boto:Token: None 2024-04-16T18:29:09.831 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1rIhLK2hc7stII4Pxh7yBkH5D8Y= 2024-04-16T18:29:09.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1rIhLK2hc7stII4Pxh7yBkH5D8Y=', 'Content-Length': '0'} 2024-04-16T18:29:09.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052f442c7f8c9017f-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.834 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.834 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.834 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.834 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.834 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.834 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.834 DEBUG:boto:Data: 2024-04-16T18:29:09.834 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.835 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.835 DEBUG:boto:Params: {} 2024-04-16T18:29:09.835 DEBUG:boto:Token: None 2024-04-16T18:29:09.835 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1rIhLK2hc7stII4Pxh7yBkH5D8Y= 2024-04-16T18:29:09.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1rIhLK2hc7stII4Pxh7yBkH5D8Y=', 'Content-Length': '0'} 2024-04-16T18:29:09.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e95cc9f3f048eb1-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.837 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:29:09.838 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.838 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.838 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.838 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.838 DEBUG:boto:Method: GET 2024-04-16T18:29:09.838 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.838 DEBUG:boto:Data: 2024-04-16T18:29:09.838 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.838 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.838 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.839 DEBUG:boto:Params: {} 2024-04-16T18:29:09.839 DEBUG:boto:Token: None 2024-04-16T18:29:09.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU= 2024-04-16T18:29:09.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU=', 'Content-Length': '0'} 2024-04-16T18:29:09.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4341bd281502c80-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.882 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.882 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.882 DEBUG:boto:path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.883 DEBUG:boto:auth_path=/cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.883 DEBUG:boto:Method: GET 2024-04-16T18:29:09.883 DEBUG:boto:Path: /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.883 DEBUG:boto:Data: 2024-04-16T18:29:09.883 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.883 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.883 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.883 DEBUG:boto:Params: {} 2024-04-16T18:29:09.883 DEBUG:boto:Token: None 2024-04-16T18:29:09.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33?versionId=null 2024-04-16T18:29:09.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU= 2024-04-16T18:29:09.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u8EtD8TPN82TpnmVy42I1RcL9wU=', 'Content-Length': '0'} 2024-04-16T18:29:09.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f8023cb4d5d35f0-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.886 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.886 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.886 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.886 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.886 DEBUG:boto:Method: GET 2024-04-16T18:29:09.887 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.887 DEBUG:boto:Data: 2024-04-16T18:29:09.887 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.887 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.887 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.887 DEBUG:boto:Params: {} 2024-04-16T18:29:09.887 DEBUG:boto:Token: None 2024-04-16T18:29:09.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002731525f116917f5-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.930 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.931 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.931 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.931 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.931 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.931 DEBUG:boto:Method: GET 2024-04-16T18:29:09.931 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.931 DEBUG:boto:Data: 2024-04-16T18:29:09.931 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.931 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.932 DEBUG:boto:Params: {} 2024-04-16T18:29:09.932 DEBUG:boto:Token: None 2024-04-16T18:29:09.932 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.935 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000083e69d73233daf14-00661ec375-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.935 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:09.936 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.936 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.936 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.936 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:29:09.936 DEBUG:boto:Data: 2024-04-16T18:29:09.936 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.936 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.937 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.937 DEBUG:boto:Params: {} 2024-04-16T18:29:09.937 DEBUG:boto:Token: None 2024-04-16T18:29:09.937 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33 2024-04-16T18:29:09.937 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xTHK5tIC/4np9c2hVAA2eQn6U50= 2024-04-16T18:29:09.937 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xTHK5tIC/4np9c2hVAA2eQn6U50=', 'Content-Length': '0'} 2024-04-16T18:29:09.939 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b7afd36712039a60-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.939 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.939 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.939 DEBUG:boto:Method: HEAD 2024-04-16T18:29:09.940 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:29:09.940 DEBUG:boto:Data: 2024-04-16T18:29:09.940 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.940 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.940 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.940 DEBUG:boto:Params: {} 2024-04-16T18:29:09.940 DEBUG:boto:Token: None 2024-04-16T18:29:09.940 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33 2024-04-16T18:29:09.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xTHK5tIC/4np9c2hVAA2eQn6U50= 2024-04-16T18:29:09.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xTHK5tIC/4np9c2hVAA2eQn6U50=', 'Content-Length': '0'} 2024-04-16T18:29:09.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a19e16149d019264-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.943 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:29:09.943 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.943 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.943 DEBUG:boto:Method: GET 2024-04-16T18:29:09.943 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:29:09.943 DEBUG:boto:Data: 2024-04-16T18:29:09.943 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.944 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.944 DEBUG:boto:Params: {} 2024-04-16T18:29:09.944 DEBUG:boto:Token: None 2024-04-16T18:29:09.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33 2024-04-16T18:29:09.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G9Eezx+VlCJNok1OWR4VFk2JKgU= 2024-04-16T18:29:09.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G9Eezx+VlCJNok1OWR4VFk2JKgU=', 'Content-Length': '0'} 2024-04-16T18:29:09.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060006a5af68cb85f-00661ec375-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.986 DEBUG:boto:path=/cjqttm-52/obj33 2024-04-16T18:29:09.986 DEBUG:boto:auth_path=/cjqttm-52/obj33 2024-04-16T18:29:09.987 DEBUG:boto:Method: GET 2024-04-16T18:29:09.987 DEBUG:boto:Path: /cjqttm-52/obj33 2024-04-16T18:29:09.987 DEBUG:boto:Data: 2024-04-16T18:29:09.987 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:09.987 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.987 DEBUG:boto:Params: {} 2024-04-16T18:29:09.987 DEBUG:boto:Token: None 2024-04-16T18:29:09.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/obj33 2024-04-16T18:29:09.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G9Eezx+VlCJNok1OWR4VFk2JKgU= 2024-04-16T18:29:09.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G9Eezx+VlCJNok1OWR4VFk2JKgU=', 'Content-Length': '0'} 2024-04-16T18:29:09.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059f971fea771d399-00661ec375-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:09.989 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:09.990 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:09.990 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.990 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.990 DEBUG:boto:Method: GET 2024-04-16T18:29:09.990 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:29:09.990 DEBUG:boto:Data: 2024-04-16T18:29:09.990 DEBUG:boto:Headers: {} 2024-04-16T18:29:09.990 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:09.990 DEBUG:boto:Port: 8000 2024-04-16T18:29:09.990 DEBUG:boto:Params: {} 2024-04-16T18:29:09.991 DEBUG:boto:Token: None 2024-04-16T18:29:09.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:09 GMT /cjqttm-52/ 2024-04-16T18:29:09.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g= 2024-04-16T18:29:09.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xry437rkeLnH0PEXofK97K8iq4g=', 'Content-Length': '0'} 2024-04-16T18:29:09.993 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004fd833d43705cfc6-00661ec375-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.034 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.035 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.035 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.035 DEBUG:boto:path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:10.035 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj33 2024-04-16T18:29:10.035 DEBUG:boto:Method: GET 2024-04-16T18:29:10.035 DEBUG:boto:Path: /cjqttm-52/?prefix=obj33 2024-04-16T18:29:10.036 DEBUG:boto:Data: 2024-04-16T18:29:10.036 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.036 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.036 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.036 DEBUG:boto:Params: {} 2024-04-16T18:29:10.036 DEBUG:boto:Token: None 2024-04-16T18:29:10.036 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.040 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011812b2fa8701dd5-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.040 DEBUG:boto:b'cjqttm-52obj331000falseobj332024-04-16T18:19:55.909Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:29:10.041 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.041 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.041 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.041 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.041 DEBUG:boto:Method: GET 2024-04-16T18:29:10.041 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.041 DEBUG:boto:Data: 2024-04-16T18:29:10.041 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.041 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.041 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.041 DEBUG:boto:Params: {} 2024-04-16T18:29:10.042 DEBUG:boto:Token: None 2024-04-16T18:29:10.042 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.042 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc= 2024-04-16T18:29:10.042 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc=', 'Content-Length': '0'} 2024-04-16T18:29:10.044 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074e342d514e610b5-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.086 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.086 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.087 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.087 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.087 DEBUG:boto:Method: GET 2024-04-16T18:29:10.087 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.087 DEBUG:boto:Data: 2024-04-16T18:29:10.087 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.087 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.087 DEBUG:boto:Params: {} 2024-04-16T18:29:10.087 DEBUG:boto:Token: None 2024-04-16T18:29:10.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc= 2024-04-16T18:29:10.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc=', 'Content-Length': '0'} 2024-04-16T18:29:10.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002beaf6566dfa28d9-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.090 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.090 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.090 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.090 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.090 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.090 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.090 DEBUG:boto:Data: 2024-04-16T18:29:10.090 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.091 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.091 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.091 DEBUG:boto:Params: {} 2024-04-16T18:29:10.091 DEBUG:boto:Token: None 2024-04-16T18:29:10.091 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wLTWJ/UtQ5BQzDQnUz9FRa62dEo= 2024-04-16T18:29:10.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wLTWJ/UtQ5BQzDQnUz9FRa62dEo=', 'Content-Length': '0'} 2024-04-16T18:29:10.093 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfe6a6a1fff3e2db-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.093 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.094 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.094 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.094 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.094 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.094 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.094 DEBUG:boto:Data: 2024-04-16T18:29:10.094 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.094 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.094 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.094 DEBUG:boto:Params: {} 2024-04-16T18:29:10.095 DEBUG:boto:Token: None 2024-04-16T18:29:10.095 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.095 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wLTWJ/UtQ5BQzDQnUz9FRa62dEo= 2024-04-16T18:29:10.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wLTWJ/UtQ5BQzDQnUz9FRa62dEo=', 'Content-Length': '0'} 2024-04-16T18:29:10.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffee5936f290c78d-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.097 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:29:10.097 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.097 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.097 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.097 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.098 DEBUG:boto:Method: GET 2024-04-16T18:29:10.098 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.098 DEBUG:boto:Data: 2024-04-16T18:29:10.098 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.098 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.098 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.098 DEBUG:boto:Params: {} 2024-04-16T18:29:10.098 DEBUG:boto:Token: None 2024-04-16T18:29:10.098 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc= 2024-04-16T18:29:10.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc=', 'Content-Length': '0'} 2024-04-16T18:29:10.100 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c14f497a73880209-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.142 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.142 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.143 DEBUG:boto:path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.143 DEBUG:boto:auth_path=/cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.143 DEBUG:boto:Method: GET 2024-04-16T18:29:10.143 DEBUG:boto:Path: /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.143 DEBUG:boto:Data: 2024-04-16T18:29:10.143 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.143 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.143 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.143 DEBUG:boto:Params: {} 2024-04-16T18:29:10.143 DEBUG:boto:Token: None 2024-04-16T18:29:10.144 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34?versionId=null 2024-04-16T18:29:10.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc= 2024-04-16T18:29:10.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n/iXW2Odyt/12e4t3QgBILVYfvc=', 'Content-Length': '0'} 2024-04-16T18:29:10.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000640c9e5ae0afc486-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.146 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.146 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.146 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.146 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.146 DEBUG:boto:Method: GET 2024-04-16T18:29:10.146 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.147 DEBUG:boto:Data: 2024-04-16T18:29:10.147 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.147 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.147 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.147 DEBUG:boto:Params: {} 2024-04-16T18:29:10.147 DEBUG:boto:Token: None 2024-04-16T18:29:10.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fe3147d232035138-00661ec376-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.190 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.191 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.191 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.191 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.191 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.191 DEBUG:boto:Method: GET 2024-04-16T18:29:10.191 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.191 DEBUG:boto:Data: 2024-04-16T18:29:10.191 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.192 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.192 DEBUG:boto:Params: {} 2024-04-16T18:29:10.192 DEBUG:boto:Token: None 2024-04-16T18:29:10.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.196 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016b2fb4e26562920-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.196 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.196 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.196 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.197 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.197 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:29:10.197 DEBUG:boto:Data: 2024-04-16T18:29:10.197 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.197 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.197 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.197 DEBUG:boto:Params: {} 2024-04-16T18:29:10.197 DEBUG:boto:Token: None 2024-04-16T18:29:10.197 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34 2024-04-16T18:29:10.197 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2FR5y5MiAgusM2M5ZuiOGePrLSs= 2024-04-16T18:29:10.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2FR5y5MiAgusM2M5ZuiOGePrLSs=', 'Content-Length': '0'} 2024-04-16T18:29:10.199 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008508c3237065e6c3-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.200 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.200 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.200 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.200 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:29:10.200 DEBUG:boto:Data: 2024-04-16T18:29:10.200 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.200 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.200 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.201 DEBUG:boto:Params: {} 2024-04-16T18:29:10.201 DEBUG:boto:Token: None 2024-04-16T18:29:10.201 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34 2024-04-16T18:29:10.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2FR5y5MiAgusM2M5ZuiOGePrLSs= 2024-04-16T18:29:10.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2FR5y5MiAgusM2M5ZuiOGePrLSs=', 'Content-Length': '0'} 2024-04-16T18:29:10.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010b051528c950c1d-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.203 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:29:10.203 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.203 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.203 DEBUG:boto:Method: GET 2024-04-16T18:29:10.204 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:29:10.204 DEBUG:boto:Data: 2024-04-16T18:29:10.204 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.204 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.204 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.204 DEBUG:boto:Params: {} 2024-04-16T18:29:10.204 DEBUG:boto:Token: None 2024-04-16T18:29:10.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34 2024-04-16T18:29:10.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VE4WzVgS++DLNgu0vgQLJf+LIbQ= 2024-04-16T18:29:10.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VE4WzVgS++DLNgu0vgQLJf+LIbQ=', 'Content-Length': '0'} 2024-04-16T18:29:10.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007aeca71821eb9cea-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.250 DEBUG:boto:path=/cjqttm-52/obj34 2024-04-16T18:29:10.250 DEBUG:boto:auth_path=/cjqttm-52/obj34 2024-04-16T18:29:10.251 DEBUG:boto:Method: GET 2024-04-16T18:29:10.251 DEBUG:boto:Path: /cjqttm-52/obj34 2024-04-16T18:29:10.251 DEBUG:boto:Data: 2024-04-16T18:29:10.251 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.251 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.251 DEBUG:boto:Params: {} 2024-04-16T18:29:10.251 DEBUG:boto:Token: None 2024-04-16T18:29:10.251 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj34 2024-04-16T18:29:10.251 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VE4WzVgS++DLNgu0vgQLJf+LIbQ= 2024-04-16T18:29:10.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VE4WzVgS++DLNgu0vgQLJf+LIbQ=', 'Content-Length': '0'} 2024-04-16T18:29:10.254 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee51b37532768568-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.254 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.254 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.254 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.254 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.254 DEBUG:boto:Method: GET 2024-04-16T18:29:10.254 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.255 DEBUG:boto:Data: 2024-04-16T18:29:10.255 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.255 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.255 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.255 DEBUG:boto:Params: {} 2024-04-16T18:29:10.255 DEBUG:boto:Token: None 2024-04-16T18:29:10.255 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.258 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c23c2423ebe3f47b-00661ec376-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.298 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.299 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.299 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.299 DEBUG:boto:path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.299 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.299 DEBUG:boto:Method: GET 2024-04-16T18:29:10.299 DEBUG:boto:Path: /cjqttm-52/?prefix=obj34 2024-04-16T18:29:10.299 DEBUG:boto:Data: 2024-04-16T18:29:10.299 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.299 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.300 DEBUG:boto:Params: {} 2024-04-16T18:29:10.300 DEBUG:boto:Token: None 2024-04-16T18:29:10.300 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.303 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000063e62108236e5306-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.304 DEBUG:boto:b'cjqttm-52obj341000falseobj342024-04-16T18:20:07.444Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.304 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:29:10.304 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.304 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.304 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.305 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.305 DEBUG:boto:Method: GET 2024-04-16T18:29:10.305 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.305 DEBUG:boto:Data: 2024-04-16T18:29:10.305 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.305 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.305 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.305 DEBUG:boto:Params: {} 2024-04-16T18:29:10.305 DEBUG:boto:Token: None 2024-04-16T18:29:10.305 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.306 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4= 2024-04-16T18:29:10.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4=', 'Content-Length': '0'} 2024-04-16T18:29:10.308 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdd2b7f8b3116f78-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.350 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.350 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.350 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.351 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.351 DEBUG:boto:Method: GET 2024-04-16T18:29:10.351 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.351 DEBUG:boto:Data: 2024-04-16T18:29:10.351 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.351 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.351 DEBUG:boto:Params: {} 2024-04-16T18:29:10.351 DEBUG:boto:Token: None 2024-04-16T18:29:10.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4= 2024-04-16T18:29:10.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4=', 'Content-Length': '0'} 2024-04-16T18:29:10.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046e36ff7e00b5359-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.354 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.354 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.354 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.354 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.354 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.354 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.355 DEBUG:boto:Data: 2024-04-16T18:29:10.355 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.355 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.355 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.355 DEBUG:boto:Params: {} 2024-04-16T18:29:10.355 DEBUG:boto:Token: None 2024-04-16T18:29:10.355 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8YGUeIZx0i/Vl2SJqBDTaSomB6g= 2024-04-16T18:29:10.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8YGUeIZx0i/Vl2SJqBDTaSomB6g=', 'Content-Length': '0'} 2024-04-16T18:29:10.357 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039059530d6f5f0f3-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.358 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.358 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.358 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.358 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.358 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.358 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.358 DEBUG:boto:Data: 2024-04-16T18:29:10.358 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.359 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.359 DEBUG:boto:Params: {} 2024-04-16T18:29:10.359 DEBUG:boto:Token: None 2024-04-16T18:29:10.359 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.359 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8YGUeIZx0i/Vl2SJqBDTaSomB6g= 2024-04-16T18:29:10.359 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8YGUeIZx0i/Vl2SJqBDTaSomB6g=', 'Content-Length': '0'} 2024-04-16T18:29:10.361 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b92a77514157fd2e-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:29:10.362 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.362 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.362 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.362 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.362 DEBUG:boto:Method: GET 2024-04-16T18:29:10.362 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.362 DEBUG:boto:Data: 2024-04-16T18:29:10.362 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.362 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.362 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.363 DEBUG:boto:Params: {} 2024-04-16T18:29:10.363 DEBUG:boto:Token: None 2024-04-16T18:29:10.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4= 2024-04-16T18:29:10.363 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4=', 'Content-Length': '0'} 2024-04-16T18:29:10.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eac27e6fe2ef9f50-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.406 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.406 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.407 DEBUG:boto:path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.407 DEBUG:boto:auth_path=/cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.407 DEBUG:boto:Method: GET 2024-04-16T18:29:10.407 DEBUG:boto:Path: /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.407 DEBUG:boto:Data: 2024-04-16T18:29:10.407 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.407 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.407 DEBUG:boto:Params: {} 2024-04-16T18:29:10.407 DEBUG:boto:Token: None 2024-04-16T18:29:10.408 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37?versionId=null 2024-04-16T18:29:10.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4= 2024-04-16T18:29:10.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ICjCrNTPb2IKzG5PU7sA5CZQJL4=', 'Content-Length': '0'} 2024-04-16T18:29:10.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b7032e7587c91ce-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.410 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.410 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.411 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.411 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.411 DEBUG:boto:Method: GET 2024-04-16T18:29:10.411 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.411 DEBUG:boto:Data: 2024-04-16T18:29:10.411 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.411 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.411 DEBUG:boto:Params: {} 2024-04-16T18:29:10.411 DEBUG:boto:Token: None 2024-04-16T18:29:10.412 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000079a24c3335ea2665-00661ec376-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.458 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.459 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.459 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.459 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.459 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.459 DEBUG:boto:Method: GET 2024-04-16T18:29:10.459 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.459 DEBUG:boto:Data: 2024-04-16T18:29:10.459 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.460 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.460 DEBUG:boto:Params: {} 2024-04-16T18:29:10.460 DEBUG:boto:Token: None 2024-04-16T18:29:10.460 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.463 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a4eedc4de7ddcc3-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.464 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.464 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.464 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.464 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.464 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:29:10.464 DEBUG:boto:Data: 2024-04-16T18:29:10.464 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.464 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.465 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.465 DEBUG:boto:Params: {} 2024-04-16T18:29:10.465 DEBUG:boto:Token: None 2024-04-16T18:29:10.465 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37 2024-04-16T18:29:10.465 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xCWeHiRi5ZdN05wtzBWZfWSFgnk= 2024-04-16T18:29:10.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xCWeHiRi5ZdN05wtzBWZfWSFgnk=', 'Content-Length': '0'} 2024-04-16T18:29:10.467 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b607b4cc8fc1b084-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.468 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.468 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.468 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.468 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:29:10.468 DEBUG:boto:Data: 2024-04-16T18:29:10.468 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.468 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.468 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.469 DEBUG:boto:Params: {} 2024-04-16T18:29:10.469 DEBUG:boto:Token: None 2024-04-16T18:29:10.469 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37 2024-04-16T18:29:10.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xCWeHiRi5ZdN05wtzBWZfWSFgnk= 2024-04-16T18:29:10.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xCWeHiRi5ZdN05wtzBWZfWSFgnk=', 'Content-Length': '0'} 2024-04-16T18:29:10.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9c8f8fb2b83c905-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.471 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:29:10.471 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.472 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.472 DEBUG:boto:Method: GET 2024-04-16T18:29:10.472 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:29:10.472 DEBUG:boto:Data: 2024-04-16T18:29:10.472 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.472 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.472 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.472 DEBUG:boto:Params: {} 2024-04-16T18:29:10.472 DEBUG:boto:Token: None 2024-04-16T18:29:10.472 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37 2024-04-16T18:29:10.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Tl5aUIQ16FZOQbc8RJLR8Ojc77w= 2024-04-16T18:29:10.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Tl5aUIQ16FZOQbc8RJLR8Ojc77w=', 'Content-Length': '0'} 2024-04-16T18:29:10.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d65297bc379d83d-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.518 DEBUG:boto:path=/cjqttm-52/obj37 2024-04-16T18:29:10.518 DEBUG:boto:auth_path=/cjqttm-52/obj37 2024-04-16T18:29:10.519 DEBUG:boto:Method: GET 2024-04-16T18:29:10.519 DEBUG:boto:Path: /cjqttm-52/obj37 2024-04-16T18:29:10.519 DEBUG:boto:Data: 2024-04-16T18:29:10.519 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.519 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.519 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.519 DEBUG:boto:Params: {} 2024-04-16T18:29:10.519 DEBUG:boto:Token: None 2024-04-16T18:29:10.519 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj37 2024-04-16T18:29:10.519 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Tl5aUIQ16FZOQbc8RJLR8Ojc77w= 2024-04-16T18:29:10.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Tl5aUIQ16FZOQbc8RJLR8Ojc77w=', 'Content-Length': '0'} 2024-04-16T18:29:10.522 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5e89d531dc1bac5-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.522 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.522 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.522 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.522 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.522 DEBUG:boto:Method: GET 2024-04-16T18:29:10.522 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.523 DEBUG:boto:Data: 2024-04-16T18:29:10.523 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.523 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.523 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.523 DEBUG:boto:Params: {} 2024-04-16T18:29:10.523 DEBUG:boto:Token: None 2024-04-16T18:29:10.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.526 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000010fa19a06368dcf5-00661ec376-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.566 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.567 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.567 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.567 DEBUG:boto:path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.567 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.567 DEBUG:boto:Method: GET 2024-04-16T18:29:10.567 DEBUG:boto:Path: /cjqttm-52/?prefix=obj37 2024-04-16T18:29:10.567 DEBUG:boto:Data: 2024-04-16T18:29:10.567 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.568 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.568 DEBUG:boto:Params: {} 2024-04-16T18:29:10.568 DEBUG:boto:Token: None 2024-04-16T18:29:10.568 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.571 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cf8f092fb10f5b9e-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.571 DEBUG:boto:b'cjqttm-52obj371000falseobj372024-04-16T18:27:48.316Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:29:10.572 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.572 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.572 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.572 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.572 DEBUG:boto:Method: GET 2024-04-16T18:29:10.572 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.572 DEBUG:boto:Data: 2024-04-16T18:29:10.572 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.573 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.573 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.573 DEBUG:boto:Params: {} 2024-04-16T18:29:10.573 DEBUG:boto:Token: None 2024-04-16T18:29:10.573 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.573 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI= 2024-04-16T18:29:10.573 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI=', 'Content-Length': '0'} 2024-04-16T18:29:10.575 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b5b7d8cb9b1794e8-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.618 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.618 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.619 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.619 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.619 DEBUG:boto:Method: GET 2024-04-16T18:29:10.619 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.619 DEBUG:boto:Data: 2024-04-16T18:29:10.619 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.619 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.619 DEBUG:boto:Params: {} 2024-04-16T18:29:10.619 DEBUG:boto:Token: None 2024-04-16T18:29:10.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI= 2024-04-16T18:29:10.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI=', 'Content-Length': '0'} 2024-04-16T18:29:10.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000117f24041e2ec8c0-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.622 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.622 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.622 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.622 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.622 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.622 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.623 DEBUG:boto:Data: 2024-04-16T18:29:10.623 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.623 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.623 DEBUG:boto:Params: {} 2024-04-16T18:29:10.623 DEBUG:boto:Token: None 2024-04-16T18:29:10.623 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Gg5Y7tqU0o9U87xu7xUrp9SqU0= 2024-04-16T18:29:10.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Gg5Y7tqU0o9U87xu7xUrp9SqU0=', 'Content-Length': '0'} 2024-04-16T18:29:10.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002230d750604cd37d-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.625 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.626 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.626 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.626 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.626 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.626 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.626 DEBUG:boto:Data: 2024-04-16T18:29:10.626 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.626 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.626 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.626 DEBUG:boto:Params: {} 2024-04-16T18:29:10.627 DEBUG:boto:Token: None 2024-04-16T18:29:10.627 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.627 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Gg5Y7tqU0o9U87xu7xUrp9SqU0= 2024-04-16T18:29:10.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Gg5Y7tqU0o9U87xu7xUrp9SqU0=', 'Content-Length': '0'} 2024-04-16T18:29:10.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000215a4c62d933705-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:29:10.629 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.629 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.629 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.629 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.629 DEBUG:boto:Method: GET 2024-04-16T18:29:10.630 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.630 DEBUG:boto:Data: 2024-04-16T18:29:10.630 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.630 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.630 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.630 DEBUG:boto:Params: {} 2024-04-16T18:29:10.630 DEBUG:boto:Token: None 2024-04-16T18:29:10.630 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.630 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI= 2024-04-16T18:29:10.630 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI=', 'Content-Length': '0'} 2024-04-16T18:29:10.632 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000981aae579eef935a-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.674 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.674 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.675 DEBUG:boto:path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.675 DEBUG:boto:auth_path=/cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.675 DEBUG:boto:Method: GET 2024-04-16T18:29:10.675 DEBUG:boto:Path: /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.675 DEBUG:boto:Data: 2024-04-16T18:29:10.675 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.675 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.675 DEBUG:boto:Params: {} 2024-04-16T18:29:10.675 DEBUG:boto:Token: None 2024-04-16T18:29:10.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38?versionId=null 2024-04-16T18:29:10.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI= 2024-04-16T18:29:10.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvC/wLWJUbCyORK1S9GiNiGMAQI=', 'Content-Length': '0'} 2024-04-16T18:29:10.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001da5ce86ea9d2815-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.678 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.678 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.678 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.678 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.678 DEBUG:boto:Method: GET 2024-04-16T18:29:10.678 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.679 DEBUG:boto:Data: 2024-04-16T18:29:10.679 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.679 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.679 DEBUG:boto:Params: {} 2024-04-16T18:29:10.679 DEBUG:boto:Token: None 2024-04-16T18:29:10.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ff86dcbadff3574b-00661ec376-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.722 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.723 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.723 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.723 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.723 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.723 DEBUG:boto:Method: GET 2024-04-16T18:29:10.723 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.723 DEBUG:boto:Data: 2024-04-16T18:29:10.723 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.724 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.724 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.724 DEBUG:boto:Params: {} 2024-04-16T18:29:10.724 DEBUG:boto:Token: None 2024-04-16T18:29:10.724 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.727 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0113156b13b4ee2-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.728 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.728 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.728 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.728 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.728 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:29:10.728 DEBUG:boto:Data: 2024-04-16T18:29:10.728 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.729 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.729 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.729 DEBUG:boto:Params: {} 2024-04-16T18:29:10.729 DEBUG:boto:Token: None 2024-04-16T18:29:10.729 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38 2024-04-16T18:29:10.729 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a9GHmCPbQFD8KFrqhvC4mTtRuw8= 2024-04-16T18:29:10.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a9GHmCPbQFD8KFrqhvC4mTtRuw8=', 'Content-Length': '0'} 2024-04-16T18:29:10.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a466ac1e8fc41223-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.731 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.731 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.731 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.731 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:29:10.731 DEBUG:boto:Data: 2024-04-16T18:29:10.732 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.732 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.732 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.732 DEBUG:boto:Params: {} 2024-04-16T18:29:10.732 DEBUG:boto:Token: None 2024-04-16T18:29:10.732 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38 2024-04-16T18:29:10.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a9GHmCPbQFD8KFrqhvC4mTtRuw8= 2024-04-16T18:29:10.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a9GHmCPbQFD8KFrqhvC4mTtRuw8=', 'Content-Length': '0'} 2024-04-16T18:29:10.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001302d25e70777ff7-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.734 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:29:10.734 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.735 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.735 DEBUG:boto:Method: GET 2024-04-16T18:29:10.735 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:29:10.735 DEBUG:boto:Data: 2024-04-16T18:29:10.735 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.735 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.735 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.735 DEBUG:boto:Params: {} 2024-04-16T18:29:10.735 DEBUG:boto:Token: None 2024-04-16T18:29:10.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38 2024-04-16T18:29:10.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pkvQZ3N8FdWtWZ7BcmTP4Nbc+54= 2024-04-16T18:29:10.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pkvQZ3N8FdWtWZ7BcmTP4Nbc+54=', 'Content-Length': '0'} 2024-04-16T18:29:10.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000261ba61a29fdfbe6-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.778 DEBUG:boto:path=/cjqttm-52/obj38 2024-04-16T18:29:10.778 DEBUG:boto:auth_path=/cjqttm-52/obj38 2024-04-16T18:29:10.779 DEBUG:boto:Method: GET 2024-04-16T18:29:10.779 DEBUG:boto:Path: /cjqttm-52/obj38 2024-04-16T18:29:10.779 DEBUG:boto:Data: 2024-04-16T18:29:10.779 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.779 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.779 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.779 DEBUG:boto:Params: {} 2024-04-16T18:29:10.779 DEBUG:boto:Token: None 2024-04-16T18:29:10.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj38 2024-04-16T18:29:10.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pkvQZ3N8FdWtWZ7BcmTP4Nbc+54= 2024-04-16T18:29:10.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pkvQZ3N8FdWtWZ7BcmTP4Nbc+54=', 'Content-Length': '0'} 2024-04-16T18:29:10.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062928e11fd11f48e-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.782 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.782 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.782 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.782 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.782 DEBUG:boto:Method: GET 2024-04-16T18:29:10.782 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.782 DEBUG:boto:Data: 2024-04-16T18:29:10.782 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.783 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.783 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.783 DEBUG:boto:Params: {} 2024-04-16T18:29:10.783 DEBUG:boto:Token: None 2024-04-16T18:29:10.783 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.783 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.786 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043f47adbbf8b223f-00661ec376-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.826 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.827 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.827 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.827 DEBUG:boto:path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.827 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.827 DEBUG:boto:Method: GET 2024-04-16T18:29:10.827 DEBUG:boto:Path: /cjqttm-52/?prefix=obj38 2024-04-16T18:29:10.827 DEBUG:boto:Data: 2024-04-16T18:29:10.827 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.828 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.828 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.828 DEBUG:boto:Params: {} 2024-04-16T18:29:10.828 DEBUG:boto:Token: None 2024-04-16T18:29:10.828 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.832 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e70043b5e8c6f0a-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.832 DEBUG:boto:b'cjqttm-52obj381000falseobj382024-04-16T18:21:05.070Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.832 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:29:10.832 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.832 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.833 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.833 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.833 DEBUG:boto:Method: GET 2024-04-16T18:29:10.833 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.833 DEBUG:boto:Data: 2024-04-16T18:29:10.833 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.833 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.833 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.833 DEBUG:boto:Params: {} 2024-04-16T18:29:10.833 DEBUG:boto:Token: None 2024-04-16T18:29:10.834 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.834 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ= 2024-04-16T18:29:10.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ=', 'Content-Length': '0'} 2024-04-16T18:29:10.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092010cd23ddfcda7-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.878 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.879 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.879 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.879 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.879 DEBUG:boto:Method: GET 2024-04-16T18:29:10.879 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.879 DEBUG:boto:Data: 2024-04-16T18:29:10.879 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.879 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.879 DEBUG:boto:Params: {} 2024-04-16T18:29:10.879 DEBUG:boto:Token: None 2024-04-16T18:29:10.880 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ= 2024-04-16T18:29:10.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ=', 'Content-Length': '0'} 2024-04-16T18:29:10.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044359a7ba58d26c2-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.882 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.882 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.882 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.882 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.882 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.883 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.883 DEBUG:boto:Data: 2024-04-16T18:29:10.883 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.883 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.883 DEBUG:boto:Params: {} 2024-04-16T18:29:10.883 DEBUG:boto:Token: None 2024-04-16T18:29:10.883 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8VjIYbGM3plg3tMLZMYwlRB9cR8= 2024-04-16T18:29:10.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8VjIYbGM3plg3tMLZMYwlRB9cR8=', 'Content-Length': '0'} 2024-04-16T18:29:10.885 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000732cbce2af983f5a-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.886 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.886 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.886 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.886 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.886 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.886 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.886 DEBUG:boto:Data: 2024-04-16T18:29:10.886 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.886 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.887 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.887 DEBUG:boto:Params: {} 2024-04-16T18:29:10.887 DEBUG:boto:Token: None 2024-04-16T18:29:10.887 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8VjIYbGM3plg3tMLZMYwlRB9cR8= 2024-04-16T18:29:10.887 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8VjIYbGM3plg3tMLZMYwlRB9cR8=', 'Content-Length': '0'} 2024-04-16T18:29:10.889 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006da43e243d481b1c-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.889 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:29:10.890 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.890 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.890 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.890 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.890 DEBUG:boto:Method: GET 2024-04-16T18:29:10.890 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.890 DEBUG:boto:Data: 2024-04-16T18:29:10.890 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.890 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.891 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.891 DEBUG:boto:Params: {} 2024-04-16T18:29:10.891 DEBUG:boto:Token: None 2024-04-16T18:29:10.891 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ= 2024-04-16T18:29:10.891 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ=', 'Content-Length': '0'} 2024-04-16T18:29:10.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003124a2cf73e7f42f-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.934 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.934 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.935 DEBUG:boto:path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.935 DEBUG:boto:auth_path=/cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.935 DEBUG:boto:Method: GET 2024-04-16T18:29:10.935 DEBUG:boto:Path: /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.935 DEBUG:boto:Data: 2024-04-16T18:29:10.935 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.935 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.935 DEBUG:boto:Params: {} 2024-04-16T18:29:10.935 DEBUG:boto:Token: None 2024-04-16T18:29:10.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44?versionId=null 2024-04-16T18:29:10.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ= 2024-04-16T18:29:10.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ModvSfp4vwrAfe5kjqFfOoJleJQ=', 'Content-Length': '0'} 2024-04-16T18:29:10.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dff6f9609f042f42-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.938 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.938 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.938 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:10.938 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:10.938 DEBUG:boto:Method: GET 2024-04-16T18:29:10.938 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:29:10.938 DEBUG:boto:Data: 2024-04-16T18:29:10.939 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.939 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.939 DEBUG:boto:Params: {} 2024-04-16T18:29:10.939 DEBUG:boto:Token: None 2024-04-16T18:29:10.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.941 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000340cf7372e415395-00661ec376-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.982 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.983 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:10.983 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:10.983 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:10.983 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:10.983 DEBUG:boto:Method: GET 2024-04-16T18:29:10.983 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:29:10.983 DEBUG:boto:Data: 2024-04-16T18:29:10.983 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.983 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.984 DEBUG:boto:Params: {} 2024-04-16T18:29:10.984 DEBUG:boto:Token: None 2024-04-16T18:29:10.984 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/ 2024-04-16T18:29:10.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U= 2024-04-16T18:29:10.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YMVzNHGMVwbwJ7ZFZpdJmHPSn/U=', 'Content-Length': '0'} 2024-04-16T18:29:10.987 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004ba24d91ea9f839-00661ec376-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.987 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:10.988 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.988 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.988 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.988 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:29:10.988 DEBUG:boto:Data: 2024-04-16T18:29:10.988 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.988 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.988 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.988 DEBUG:boto:Params: {} 2024-04-16T18:29:10.989 DEBUG:boto:Token: None 2024-04-16T18:29:10.989 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44 2024-04-16T18:29:10.989 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JTKWAm8Lh6Rx1DFzZWzPEQb/X0g= 2024-04-16T18:29:10.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JTKWAm8Lh6Rx1DFzZWzPEQb/X0g=', 'Content-Length': '0'} 2024-04-16T18:29:10.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018e6bf15c67bd98d-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.991 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.991 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.991 DEBUG:boto:Method: HEAD 2024-04-16T18:29:10.992 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:29:10.992 DEBUG:boto:Data: 2024-04-16T18:29:10.992 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.992 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:10.992 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.992 DEBUG:boto:Params: {} 2024-04-16T18:29:10.992 DEBUG:boto:Token: None 2024-04-16T18:29:10.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44 2024-04-16T18:29:10.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JTKWAm8Lh6Rx1DFzZWzPEQb/X0g= 2024-04-16T18:29:10.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JTKWAm8Lh6Rx1DFzZWzPEQb/X0g=', 'Content-Length': '0'} 2024-04-16T18:29:10.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000085d58d75f7209aee-00661ec376-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:10.994 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:29:10.995 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:10.995 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:10.995 DEBUG:boto:Method: GET 2024-04-16T18:29:10.995 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:29:10.995 DEBUG:boto:Data: 2024-04-16T18:29:10.995 DEBUG:boto:Headers: {} 2024-04-16T18:29:10.995 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:10.995 DEBUG:boto:Port: 8000 2024-04-16T18:29:10.995 DEBUG:boto:Params: {} 2024-04-16T18:29:10.995 DEBUG:boto:Token: None 2024-04-16T18:29:10.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:10 GMT /cjqttm-52/obj44 2024-04-16T18:29:10.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FQqahhAWI36wcZnypJuf3TrORAU= 2024-04-16T18:29:10.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:10 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FQqahhAWI36wcZnypJuf3TrORAU=', 'Content-Length': '0'} 2024-04-16T18:29:10.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b41985981ec02bdc-00661ec376-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.038 DEBUG:boto:path=/cjqttm-52/obj44 2024-04-16T18:29:11.038 DEBUG:boto:auth_path=/cjqttm-52/obj44 2024-04-16T18:29:11.038 DEBUG:boto:Method: GET 2024-04-16T18:29:11.039 DEBUG:boto:Path: /cjqttm-52/obj44 2024-04-16T18:29:11.039 DEBUG:boto:Data: 2024-04-16T18:29:11.039 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.039 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.039 DEBUG:boto:Params: {} 2024-04-16T18:29:11.039 DEBUG:boto:Token: None 2024-04-16T18:29:11.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj44 2024-04-16T18:29:11.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E5+q6U7PWF7Kx3wQ9T1XbawWk/4= 2024-04-16T18:29:11.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E5+q6U7PWF7Kx3wQ9T1XbawWk/4=', 'Content-Length': '0'} 2024-04-16T18:29:11.041 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa2a22953fe2f9cd-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.042 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.042 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.042 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:11.042 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:11.042 DEBUG:boto:Method: GET 2024-04-16T18:29:11.042 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:29:11.042 DEBUG:boto:Data: 2024-04-16T18:29:11.042 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.042 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.043 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.043 DEBUG:boto:Params: {} 2024-04-16T18:29:11.043 DEBUG:boto:Token: None 2024-04-16T18:29:11.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009495786e6fd7bf64-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.086 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.087 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.087 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.087 DEBUG:boto:path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:11.087 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj44 2024-04-16T18:29:11.087 DEBUG:boto:Method: GET 2024-04-16T18:29:11.087 DEBUG:boto:Path: /cjqttm-52/?prefix=obj44 2024-04-16T18:29:11.087 DEBUG:boto:Data: 2024-04-16T18:29:11.087 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.087 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.087 DEBUG:boto:Params: {} 2024-04-16T18:29:11.088 DEBUG:boto:Token: None 2024-04-16T18:29:11.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.091 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000011617795e65ea6d6-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.092 DEBUG:boto:b'cjqttm-52obj441000falseobj442024-04-16T18:19:55.959Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.092 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:29:11.092 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.092 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.092 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.092 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.092 DEBUG:boto:Method: GET 2024-04-16T18:29:11.093 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.093 DEBUG:boto:Data: 2024-04-16T18:29:11.093 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.093 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.093 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.093 DEBUG:boto:Params: {} 2024-04-16T18:29:11.093 DEBUG:boto:Token: None 2024-04-16T18:29:11.093 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.093 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM= 2024-04-16T18:29:11.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM=', 'Content-Length': '0'} 2024-04-16T18:29:11.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000009857a6d8e3bb791-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.138 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.138 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.139 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.139 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.139 DEBUG:boto:Method: GET 2024-04-16T18:29:11.139 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.139 DEBUG:boto:Data: 2024-04-16T18:29:11.139 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.139 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.139 DEBUG:boto:Params: {} 2024-04-16T18:29:11.139 DEBUG:boto:Token: None 2024-04-16T18:29:11.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM= 2024-04-16T18:29:11.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM=', 'Content-Length': '0'} 2024-04-16T18:29:11.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000281fc7b25c607be7-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.142 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.142 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.142 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.142 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.143 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.143 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.143 DEBUG:boto:Data: 2024-04-16T18:29:11.143 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.143 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.143 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.143 DEBUG:boto:Params: {} 2024-04-16T18:29:11.143 DEBUG:boto:Token: None 2024-04-16T18:29:11.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ux4Ol9h0YUlV0FhpqZ36csU07Jo= 2024-04-16T18:29:11.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ux4Ol9h0YUlV0FhpqZ36csU07Jo=', 'Content-Length': '0'} 2024-04-16T18:29:11.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002fe8d3287d5b77a5-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.146 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.146 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.146 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.146 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.147 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.147 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.147 DEBUG:boto:Data: 2024-04-16T18:29:11.147 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.147 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.147 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.147 DEBUG:boto:Params: {} 2024-04-16T18:29:11.147 DEBUG:boto:Token: None 2024-04-16T18:29:11.147 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ux4Ol9h0YUlV0FhpqZ36csU07Jo= 2024-04-16T18:29:11.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ux4Ol9h0YUlV0FhpqZ36csU07Jo=', 'Content-Length': '0'} 2024-04-16T18:29:11.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c393c00323fa62f7-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:29:11.150 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.150 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.150 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.150 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.150 DEBUG:boto:Method: GET 2024-04-16T18:29:11.150 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.150 DEBUG:boto:Data: 2024-04-16T18:29:11.151 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.151 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.151 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.151 DEBUG:boto:Params: {} 2024-04-16T18:29:11.151 DEBUG:boto:Token: None 2024-04-16T18:29:11.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM= 2024-04-16T18:29:11.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM=', 'Content-Length': '0'} 2024-04-16T18:29:11.153 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063da9f3e3cb07096-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.194 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.194 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.195 DEBUG:boto:path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.195 DEBUG:boto:auth_path=/cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.195 DEBUG:boto:Method: GET 2024-04-16T18:29:11.195 DEBUG:boto:Path: /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.195 DEBUG:boto:Data: 2024-04-16T18:29:11.195 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.195 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.195 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.195 DEBUG:boto:Params: {} 2024-04-16T18:29:11.195 DEBUG:boto:Token: None 2024-04-16T18:29:11.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46?versionId=null 2024-04-16T18:29:11.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM= 2024-04-16T18:29:11.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KjWBlBzlJorproIsO3Q+pmJyObM=', 'Content-Length': '0'} 2024-04-16T18:29:11.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aefe003f8f8f518a-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.198 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.198 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.198 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.198 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.199 DEBUG:boto:Method: GET 2024-04-16T18:29:11.199 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.199 DEBUG:boto:Data: 2024-04-16T18:29:11.199 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.199 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.199 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.199 DEBUG:boto:Params: {} 2024-04-16T18:29:11.199 DEBUG:boto:Token: None 2024-04-16T18:29:11.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.202 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007746d5b739d87022-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.242 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.243 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.243 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.243 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.243 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.243 DEBUG:boto:Method: GET 2024-04-16T18:29:11.243 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.243 DEBUG:boto:Data: 2024-04-16T18:29:11.243 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.243 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.244 DEBUG:boto:Params: {} 2024-04-16T18:29:11.244 DEBUG:boto:Token: None 2024-04-16T18:29:11.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.247 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fd9e4c9350f5736b-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.248 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.248 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.248 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.248 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.248 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:29:11.248 DEBUG:boto:Data: 2024-04-16T18:29:11.248 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.248 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.249 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.249 DEBUG:boto:Params: {} 2024-04-16T18:29:11.249 DEBUG:boto:Token: None 2024-04-16T18:29:11.249 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46 2024-04-16T18:29:11.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8sNuyAFkEbUXa1mTvNhWI+uVwsI= 2024-04-16T18:29:11.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8sNuyAFkEbUXa1mTvNhWI+uVwsI=', 'Content-Length': '0'} 2024-04-16T18:29:11.251 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe1afceec33f40de-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.252 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.252 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.252 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.252 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:29:11.252 DEBUG:boto:Data: 2024-04-16T18:29:11.252 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.252 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.252 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.252 DEBUG:boto:Params: {} 2024-04-16T18:29:11.252 DEBUG:boto:Token: None 2024-04-16T18:29:11.252 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46 2024-04-16T18:29:11.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8sNuyAFkEbUXa1mTvNhWI+uVwsI= 2024-04-16T18:29:11.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8sNuyAFkEbUXa1mTvNhWI+uVwsI=', 'Content-Length': '0'} 2024-04-16T18:29:11.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089d817e46cb32e7c-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.255 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:29:11.255 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.255 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.255 DEBUG:boto:Method: GET 2024-04-16T18:29:11.255 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:29:11.255 DEBUG:boto:Data: 2024-04-16T18:29:11.255 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.256 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.256 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.256 DEBUG:boto:Params: {} 2024-04-16T18:29:11.256 DEBUG:boto:Token: None 2024-04-16T18:29:11.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46 2024-04-16T18:29:11.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kxnZtoCBhd7aF8R/+0Td82kpeZw= 2024-04-16T18:29:11.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kxnZtoCBhd7aF8R/+0Td82kpeZw=', 'Content-Length': '0'} 2024-04-16T18:29:11.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013521f5c9bc9bbb4-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.302 DEBUG:boto:path=/cjqttm-52/obj46 2024-04-16T18:29:11.302 DEBUG:boto:auth_path=/cjqttm-52/obj46 2024-04-16T18:29:11.303 DEBUG:boto:Method: GET 2024-04-16T18:29:11.303 DEBUG:boto:Path: /cjqttm-52/obj46 2024-04-16T18:29:11.303 DEBUG:boto:Data: 2024-04-16T18:29:11.303 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.303 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.303 DEBUG:boto:Params: {} 2024-04-16T18:29:11.303 DEBUG:boto:Token: None 2024-04-16T18:29:11.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj46 2024-04-16T18:29:11.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kxnZtoCBhd7aF8R/+0Td82kpeZw= 2024-04-16T18:29:11.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kxnZtoCBhd7aF8R/+0Td82kpeZw=', 'Content-Length': '0'} 2024-04-16T18:29:11.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009bfc19ba180c4af4-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.306 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.306 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.306 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.306 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.306 DEBUG:boto:Method: GET 2024-04-16T18:29:11.306 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.307 DEBUG:boto:Data: 2024-04-16T18:29:11.307 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.307 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.307 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.307 DEBUG:boto:Params: {} 2024-04-16T18:29:11.307 DEBUG:boto:Token: None 2024-04-16T18:29:11.307 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.309 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008e0da04e88fadf71-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.350 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.351 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.351 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.351 DEBUG:boto:path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.351 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.351 DEBUG:boto:Method: GET 2024-04-16T18:29:11.351 DEBUG:boto:Path: /cjqttm-52/?prefix=obj46 2024-04-16T18:29:11.351 DEBUG:boto:Data: 2024-04-16T18:29:11.351 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.352 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.352 DEBUG:boto:Params: {} 2024-04-16T18:29:11.352 DEBUG:boto:Token: None 2024-04-16T18:29:11.352 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.356 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000082cd3b7ed4c73fc6-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.356 DEBUG:boto:b'cjqttm-52obj461000falseobj462024-04-16T18:21:49.253Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.356 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:29:11.356 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.356 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.356 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.356 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.357 DEBUG:boto:Method: GET 2024-04-16T18:29:11.357 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.357 DEBUG:boto:Data: 2024-04-16T18:29:11.357 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.357 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.357 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.357 DEBUG:boto:Params: {} 2024-04-16T18:29:11.357 DEBUG:boto:Token: None 2024-04-16T18:29:11.357 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.357 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c= 2024-04-16T18:29:11.358 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c=', 'Content-Length': '0'} 2024-04-16T18:29:11.360 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052a15da2f590d578-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.402 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.402 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.403 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.403 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.403 DEBUG:boto:Method: GET 2024-04-16T18:29:11.403 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.403 DEBUG:boto:Data: 2024-04-16T18:29:11.403 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.403 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.403 DEBUG:boto:Params: {} 2024-04-16T18:29:11.403 DEBUG:boto:Token: None 2024-04-16T18:29:11.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c= 2024-04-16T18:29:11.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c=', 'Content-Length': '0'} 2024-04-16T18:29:11.406 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce7ff7ab2cbd7cbb-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.406 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.406 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.406 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.406 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.406 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.407 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.407 DEBUG:boto:Data: 2024-04-16T18:29:11.407 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.407 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.407 DEBUG:boto:Params: {} 2024-04-16T18:29:11.407 DEBUG:boto:Token: None 2024-04-16T18:29:11.407 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IMDJwhC5S7Fe+HqwhBXJG/Cp5Us= 2024-04-16T18:29:11.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IMDJwhC5S7Fe+HqwhBXJG/Cp5Us=', 'Content-Length': '0'} 2024-04-16T18:29:11.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f45538d03ccf7b9-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.410 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.410 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.410 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.410 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.410 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.410 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.411 DEBUG:boto:Data: 2024-04-16T18:29:11.411 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.411 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.411 DEBUG:boto:Params: {} 2024-04-16T18:29:11.411 DEBUG:boto:Token: None 2024-04-16T18:29:11.411 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.411 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IMDJwhC5S7Fe+HqwhBXJG/Cp5Us= 2024-04-16T18:29:11.411 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IMDJwhC5S7Fe+HqwhBXJG/Cp5Us=', 'Content-Length': '0'} 2024-04-16T18:29:11.413 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007f0870d60a33c32-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:29:11.414 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.414 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.414 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.414 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.414 DEBUG:boto:Method: GET 2024-04-16T18:29:11.414 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.415 DEBUG:boto:Data: 2024-04-16T18:29:11.415 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.415 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.415 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.415 DEBUG:boto:Params: {} 2024-04-16T18:29:11.415 DEBUG:boto:Token: None 2024-04-16T18:29:11.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c= 2024-04-16T18:29:11.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c=', 'Content-Length': '0'} 2024-04-16T18:29:11.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d82f9b84da65b39-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.458 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.458 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.461 DEBUG:boto:path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.461 DEBUG:boto:auth_path=/cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.461 DEBUG:boto:Method: GET 2024-04-16T18:29:11.462 DEBUG:boto:Path: /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.462 DEBUG:boto:Data: 2024-04-16T18:29:11.462 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.462 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.462 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.462 DEBUG:boto:Params: {} 2024-04-16T18:29:11.462 DEBUG:boto:Token: None 2024-04-16T18:29:11.462 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51?versionId=null 2024-04-16T18:29:11.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c= 2024-04-16T18:29:11.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:feQOkine2W/JnX3JKOKFfaecA4c=', 'Content-Length': '0'} 2024-04-16T18:29:11.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c34c10726070140-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.465 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.465 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.465 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.465 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.466 DEBUG:boto:Method: GET 2024-04-16T18:29:11.466 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.466 DEBUG:boto:Data: 2024-04-16T18:29:11.466 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.466 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.466 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.466 DEBUG:boto:Params: {} 2024-04-16T18:29:11.466 DEBUG:boto:Token: None 2024-04-16T18:29:11.466 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.467 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.469 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000beaf795069d0138d-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.510 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.511 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.511 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.511 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.511 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.511 DEBUG:boto:Method: GET 2024-04-16T18:29:11.511 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.511 DEBUG:boto:Data: 2024-04-16T18:29:11.511 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.512 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.512 DEBUG:boto:Params: {} 2024-04-16T18:29:11.512 DEBUG:boto:Token: None 2024-04-16T18:29:11.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.516 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006d81a3097de8b5d0-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.516 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.517 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.517 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.517 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.517 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:29:11.517 DEBUG:boto:Data: 2024-04-16T18:29:11.517 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.517 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.517 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.517 DEBUG:boto:Params: {} 2024-04-16T18:29:11.518 DEBUG:boto:Token: None 2024-04-16T18:29:11.518 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51 2024-04-16T18:29:11.518 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eTodHEgjyOUWZ8BBwQCyJcpuiSg= 2024-04-16T18:29:11.518 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eTodHEgjyOUWZ8BBwQCyJcpuiSg=', 'Content-Length': '0'} 2024-04-16T18:29:11.520 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f06e76448677060e-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.520 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.521 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.521 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.521 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:29:11.521 DEBUG:boto:Data: 2024-04-16T18:29:11.521 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.521 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.521 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.521 DEBUG:boto:Params: {} 2024-04-16T18:29:11.521 DEBUG:boto:Token: None 2024-04-16T18:29:11.522 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51 2024-04-16T18:29:11.522 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eTodHEgjyOUWZ8BBwQCyJcpuiSg= 2024-04-16T18:29:11.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eTodHEgjyOUWZ8BBwQCyJcpuiSg=', 'Content-Length': '0'} 2024-04-16T18:29:11.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009845cacfbaf777dc-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:29:11.524 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.524 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.524 DEBUG:boto:Method: GET 2024-04-16T18:29:11.525 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:29:11.525 DEBUG:boto:Data: 2024-04-16T18:29:11.525 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.525 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.525 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.525 DEBUG:boto:Params: {} 2024-04-16T18:29:11.525 DEBUG:boto:Token: None 2024-04-16T18:29:11.525 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51 2024-04-16T18:29:11.525 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XHOqtSVV2WabNHM+e383APZ99BA= 2024-04-16T18:29:11.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XHOqtSVV2WabNHM+e383APZ99BA=', 'Content-Length': '0'} 2024-04-16T18:29:11.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e9f6a31cd7071d-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.570 DEBUG:boto:path=/cjqttm-52/obj51 2024-04-16T18:29:11.570 DEBUG:boto:auth_path=/cjqttm-52/obj51 2024-04-16T18:29:11.571 DEBUG:boto:Method: GET 2024-04-16T18:29:11.571 DEBUG:boto:Path: /cjqttm-52/obj51 2024-04-16T18:29:11.571 DEBUG:boto:Data: 2024-04-16T18:29:11.571 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.571 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.571 DEBUG:boto:Params: {} 2024-04-16T18:29:11.571 DEBUG:boto:Token: None 2024-04-16T18:29:11.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj51 2024-04-16T18:29:11.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XHOqtSVV2WabNHM+e383APZ99BA= 2024-04-16T18:29:11.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XHOqtSVV2WabNHM+e383APZ99BA=', 'Content-Length': '0'} 2024-04-16T18:29:11.575 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009abfcfaee2baffdc-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.575 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.575 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.575 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.575 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.575 DEBUG:boto:Method: GET 2024-04-16T18:29:11.575 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.575 DEBUG:boto:Data: 2024-04-16T18:29:11.576 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.576 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.576 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.576 DEBUG:boto:Params: {} 2024-04-16T18:29:11.576 DEBUG:boto:Token: None 2024-04-16T18:29:11.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.579 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af8badebb86289d3-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.579 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.579 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.580 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.580 DEBUG:boto:path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.580 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.580 DEBUG:boto:Method: GET 2024-04-16T18:29:11.580 DEBUG:boto:Path: /cjqttm-52/?prefix=obj51 2024-04-16T18:29:11.580 DEBUG:boto:Data: 2024-04-16T18:29:11.580 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.580 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.580 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.580 DEBUG:boto:Params: {} 2024-04-16T18:29:11.581 DEBUG:boto:Token: None 2024-04-16T18:29:11.581 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.581 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.584 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f7c846db1c2a1af-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.626 DEBUG:boto:b'cjqttm-52obj511000falseobj512024-04-16T18:20:07.491Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:29:11.627 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.627 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.627 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.627 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.627 DEBUG:boto:Method: GET 2024-04-16T18:29:11.627 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.627 DEBUG:boto:Data: 2024-04-16T18:29:11.627 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.627 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.627 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.628 DEBUG:boto:Params: {} 2024-04-16T18:29:11.628 DEBUG:boto:Token: None 2024-04-16T18:29:11.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE= 2024-04-16T18:29:11.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE=', 'Content-Length': '0'} 2024-04-16T18:29:11.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7d10fe45d93f369-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.674 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.674 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.675 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.675 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.675 DEBUG:boto:Method: GET 2024-04-16T18:29:11.675 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.675 DEBUG:boto:Data: 2024-04-16T18:29:11.675 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.675 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.675 DEBUG:boto:Params: {} 2024-04-16T18:29:11.675 DEBUG:boto:Token: None 2024-04-16T18:29:11.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE= 2024-04-16T18:29:11.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE=', 'Content-Length': '0'} 2024-04-16T18:29:11.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7a885fbb349265c-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.678 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.678 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.678 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.678 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.678 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.679 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.679 DEBUG:boto:Data: 2024-04-16T18:29:11.679 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.679 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.679 DEBUG:boto:Params: {} 2024-04-16T18:29:11.679 DEBUG:boto:Token: None 2024-04-16T18:29:11.679 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fwL/zSgiadz8A9EE1Nd/TDHQq7U= 2024-04-16T18:29:11.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fwL/zSgiadz8A9EE1Nd/TDHQq7U=', 'Content-Length': '0'} 2024-04-16T18:29:11.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011e2fc67d2c6820f-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.682 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.682 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.682 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.682 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.682 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.682 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.682 DEBUG:boto:Data: 2024-04-16T18:29:11.682 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.682 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.683 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.683 DEBUG:boto:Params: {} 2024-04-16T18:29:11.683 DEBUG:boto:Token: None 2024-04-16T18:29:11.683 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fwL/zSgiadz8A9EE1Nd/TDHQq7U= 2024-04-16T18:29:11.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fwL/zSgiadz8A9EE1Nd/TDHQq7U=', 'Content-Length': '0'} 2024-04-16T18:29:11.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f8f06b48fc753d0-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.685 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:29:11.685 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.686 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.686 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.686 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.686 DEBUG:boto:Method: GET 2024-04-16T18:29:11.686 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.686 DEBUG:boto:Data: 2024-04-16T18:29:11.686 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.686 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.686 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.686 DEBUG:boto:Params: {} 2024-04-16T18:29:11.686 DEBUG:boto:Token: None 2024-04-16T18:29:11.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE= 2024-04-16T18:29:11.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE=', 'Content-Length': '0'} 2024-04-16T18:29:11.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0590765c888bbaf-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.730 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.730 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.731 DEBUG:boto:path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.731 DEBUG:boto:auth_path=/cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.731 DEBUG:boto:Method: GET 2024-04-16T18:29:11.731 DEBUG:boto:Path: /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.731 DEBUG:boto:Data: 2024-04-16T18:29:11.731 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.731 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.731 DEBUG:boto:Params: {} 2024-04-16T18:29:11.731 DEBUG:boto:Token: None 2024-04-16T18:29:11.732 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55?versionId=null 2024-04-16T18:29:11.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE= 2024-04-16T18:29:11.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dHk0DPSCq085bcerAurgZdqTKJE=', 'Content-Length': '0'} 2024-04-16T18:29:11.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb09790fe9b40242-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.734 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.735 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.735 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.735 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.735 DEBUG:boto:Method: GET 2024-04-16T18:29:11.735 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.735 DEBUG:boto:Data: 2024-04-16T18:29:11.735 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.735 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.735 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.735 DEBUG:boto:Params: {} 2024-04-16T18:29:11.735 DEBUG:boto:Token: None 2024-04-16T18:29:11.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.738 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e12b836ddad8bf40-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.738 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.739 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.739 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.739 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.739 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.739 DEBUG:boto:Method: GET 2024-04-16T18:29:11.739 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.739 DEBUG:boto:Data: 2024-04-16T18:29:11.739 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.739 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.739 DEBUG:boto:Params: {} 2024-04-16T18:29:11.740 DEBUG:boto:Token: None 2024-04-16T18:29:11.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.743 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d79c2379b94d1cea-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.744 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.744 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.744 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.744 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.744 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:29:11.744 DEBUG:boto:Data: 2024-04-16T18:29:11.744 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.744 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.745 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.745 DEBUG:boto:Params: {} 2024-04-16T18:29:11.745 DEBUG:boto:Token: None 2024-04-16T18:29:11.745 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55 2024-04-16T18:29:11.745 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pKjQZRi7fkD1M8To2VHMNB8bydI= 2024-04-16T18:29:11.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pKjQZRi7fkD1M8To2VHMNB8bydI=', 'Content-Length': '0'} 2024-04-16T18:29:11.747 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2f6e715b3a2252f-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.747 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.748 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.748 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.748 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:29:11.748 DEBUG:boto:Data: 2024-04-16T18:29:11.748 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.748 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.748 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.748 DEBUG:boto:Params: {} 2024-04-16T18:29:11.748 DEBUG:boto:Token: None 2024-04-16T18:29:11.748 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55 2024-04-16T18:29:11.749 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pKjQZRi7fkD1M8To2VHMNB8bydI= 2024-04-16T18:29:11.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pKjQZRi7fkD1M8To2VHMNB8bydI=', 'Content-Length': '0'} 2024-04-16T18:29:11.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a287cf7a7a91f4c-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:29:11.751 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.751 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.751 DEBUG:boto:Method: GET 2024-04-16T18:29:11.751 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:29:11.751 DEBUG:boto:Data: 2024-04-16T18:29:11.751 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.752 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.752 DEBUG:boto:Params: {} 2024-04-16T18:29:11.752 DEBUG:boto:Token: None 2024-04-16T18:29:11.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55 2024-04-16T18:29:11.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EjRL6tY1lnIv9KqIH6zcARyiFnU= 2024-04-16T18:29:11.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EjRL6tY1lnIv9KqIH6zcARyiFnU=', 'Content-Length': '0'} 2024-04-16T18:29:11.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acf21893e091955e-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.798 DEBUG:boto:path=/cjqttm-52/obj55 2024-04-16T18:29:11.798 DEBUG:boto:auth_path=/cjqttm-52/obj55 2024-04-16T18:29:11.799 DEBUG:boto:Method: GET 2024-04-16T18:29:11.799 DEBUG:boto:Path: /cjqttm-52/obj55 2024-04-16T18:29:11.799 DEBUG:boto:Data: 2024-04-16T18:29:11.799 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.799 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.799 DEBUG:boto:Params: {} 2024-04-16T18:29:11.799 DEBUG:boto:Token: None 2024-04-16T18:29:11.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj55 2024-04-16T18:29:11.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EjRL6tY1lnIv9KqIH6zcARyiFnU= 2024-04-16T18:29:11.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EjRL6tY1lnIv9KqIH6zcARyiFnU=', 'Content-Length': '0'} 2024-04-16T18:29:11.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:19:55 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045e382d29fb6d6a1-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.802 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.802 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.802 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.802 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.802 DEBUG:boto:Method: GET 2024-04-16T18:29:11.802 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.802 DEBUG:boto:Data: 2024-04-16T18:29:11.802 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.803 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.803 DEBUG:boto:Params: {} 2024-04-16T18:29:11.803 DEBUG:boto:Token: None 2024-04-16T18:29:11.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.805 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4217dc0150b55a3-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.805 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.806 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.806 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.806 DEBUG:boto:path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.806 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.806 DEBUG:boto:Method: GET 2024-04-16T18:29:11.806 DEBUG:boto:Path: /cjqttm-52/?prefix=obj55 2024-04-16T18:29:11.806 DEBUG:boto:Data: 2024-04-16T18:29:11.806 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.807 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.807 DEBUG:boto:Params: {} 2024-04-16T18:29:11.807 DEBUG:boto:Token: None 2024-04-16T18:29:11.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.811 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b15f9e0e33879d2c-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.811 DEBUG:boto:b'cjqttm-52obj551000falseobj552024-04-16T18:19:55.976Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.812 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:29:11.812 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.812 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.812 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.812 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.812 DEBUG:boto:Method: GET 2024-04-16T18:29:11.812 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.812 DEBUG:boto:Data: 2024-04-16T18:29:11.812 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.812 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.813 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.813 DEBUG:boto:Params: {} 2024-04-16T18:29:11.813 DEBUG:boto:Token: None 2024-04-16T18:29:11.813 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.813 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk= 2024-04-16T18:29:11.813 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk=', 'Content-Length': '0'} 2024-04-16T18:29:11.815 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098592943a9e62178-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.858 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.858 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.859 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.859 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.859 DEBUG:boto:Method: GET 2024-04-16T18:29:11.859 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.859 DEBUG:boto:Data: 2024-04-16T18:29:11.859 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.859 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.859 DEBUG:boto:Params: {} 2024-04-16T18:29:11.859 DEBUG:boto:Token: None 2024-04-16T18:29:11.859 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk= 2024-04-16T18:29:11.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk=', 'Content-Length': '0'} 2024-04-16T18:29:11.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d87c320d2186cef3-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.862 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.862 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.862 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.862 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.862 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.862 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.863 DEBUG:boto:Data: 2024-04-16T18:29:11.863 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.863 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.863 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.863 DEBUG:boto:Params: {} 2024-04-16T18:29:11.863 DEBUG:boto:Token: None 2024-04-16T18:29:11.863 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a5prBwuUrK3iti5I4yPstYYtqXQ= 2024-04-16T18:29:11.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a5prBwuUrK3iti5I4yPstYYtqXQ=', 'Content-Length': '0'} 2024-04-16T18:29:11.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ae4542abd13c9ab-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.866 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.866 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.866 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.866 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.866 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.866 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.866 DEBUG:boto:Data: 2024-04-16T18:29:11.867 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.867 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.867 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.867 DEBUG:boto:Params: {} 2024-04-16T18:29:11.867 DEBUG:boto:Token: None 2024-04-16T18:29:11.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a5prBwuUrK3iti5I4yPstYYtqXQ= 2024-04-16T18:29:11.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a5prBwuUrK3iti5I4yPstYYtqXQ=', 'Content-Length': '0'} 2024-04-16T18:29:11.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d5bf8cd6ce76341-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.870 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:29:11.870 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.870 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.870 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.870 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.870 DEBUG:boto:Method: GET 2024-04-16T18:29:11.870 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.870 DEBUG:boto:Data: 2024-04-16T18:29:11.870 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.871 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.871 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.873 DEBUG:boto:Params: {} 2024-04-16T18:29:11.873 DEBUG:boto:Token: None 2024-04-16T18:29:11.873 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.873 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk= 2024-04-16T18:29:11.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk=', 'Content-Length': '0'} 2024-04-16T18:29:11.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec8adc8eef04b31a-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.918 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.919 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.919 DEBUG:boto:path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.919 DEBUG:boto:auth_path=/cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.919 DEBUG:boto:Method: GET 2024-04-16T18:29:11.919 DEBUG:boto:Path: /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.919 DEBUG:boto:Data: 2024-04-16T18:29:11.919 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.919 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.919 DEBUG:boto:Params: {} 2024-04-16T18:29:11.919 DEBUG:boto:Token: None 2024-04-16T18:29:11.920 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57?versionId=null 2024-04-16T18:29:11.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk= 2024-04-16T18:29:11.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:idBPXuC0acHMUnIqQDGCTJ5mGPk=', 'Content-Length': '0'} 2024-04-16T18:29:11.922 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000738a5a5d323db649-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.922 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.922 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.922 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:11.922 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:11.922 DEBUG:boto:Method: GET 2024-04-16T18:29:11.922 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:29:11.923 DEBUG:boto:Data: 2024-04-16T18:29:11.923 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.923 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.923 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.923 DEBUG:boto:Params: {} 2024-04-16T18:29:11.923 DEBUG:boto:Token: None 2024-04-16T18:29:11.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.926 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000021bc4c549b7df3d3-00661ec377-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.966 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.967 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:11.967 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:11.967 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:11.967 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:11.967 DEBUG:boto:Method: GET 2024-04-16T18:29:11.967 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:29:11.967 DEBUG:boto:Data: 2024-04-16T18:29:11.967 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.967 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.968 DEBUG:boto:Params: {} 2024-04-16T18:29:11.968 DEBUG:boto:Token: None 2024-04-16T18:29:11.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/ 2024-04-16T18:29:11.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI= 2024-04-16T18:29:11.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:EClhB0lqGdkuf0gm2fhnqfn/AgI=', 'Content-Length': '0'} 2024-04-16T18:29:11.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c32206ead163999-00661ec377-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.972 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:11.972 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.972 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.972 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.972 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:29:11.972 DEBUG:boto:Data: 2024-04-16T18:29:11.972 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.973 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.973 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.973 DEBUG:boto:Params: {} 2024-04-16T18:29:11.973 DEBUG:boto:Token: None 2024-04-16T18:29:11.973 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57 2024-04-16T18:29:11.973 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HljxSqeIbHBkKsFu5PVasCEkRqg= 2024-04-16T18:29:11.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HljxSqeIbHBkKsFu5PVasCEkRqg=', 'Content-Length': '0'} 2024-04-16T18:29:11.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f11f41cdb1b8f75d-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.976 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.976 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.976 DEBUG:boto:Method: HEAD 2024-04-16T18:29:11.976 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:29:11.976 DEBUG:boto:Data: 2024-04-16T18:29:11.976 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.976 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:11.976 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.976 DEBUG:boto:Params: {} 2024-04-16T18:29:11.976 DEBUG:boto:Token: None 2024-04-16T18:29:11.977 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57 2024-04-16T18:29:11.977 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HljxSqeIbHBkKsFu5PVasCEkRqg= 2024-04-16T18:29:11.977 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HljxSqeIbHBkKsFu5PVasCEkRqg=', 'Content-Length': '0'} 2024-04-16T18:29:11.979 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000372874b1a56c1dd-00661ec377-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:11.979 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:29:11.979 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:11.979 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:11.979 DEBUG:boto:Method: GET 2024-04-16T18:29:11.979 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:29:11.979 DEBUG:boto:Data: 2024-04-16T18:29:11.979 DEBUG:boto:Headers: {} 2024-04-16T18:29:11.980 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:11.980 DEBUG:boto:Port: 8000 2024-04-16T18:29:11.980 DEBUG:boto:Params: {} 2024-04-16T18:29:11.980 DEBUG:boto:Token: None 2024-04-16T18:29:11.980 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:11 GMT /cjqttm-52/obj57 2024-04-16T18:29:11.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OiDCBvwoS+lqixC0DRbftospj7M= 2024-04-16T18:29:11.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OiDCBvwoS+lqixC0DRbftospj7M=', 'Content-Length': '0'} 2024-04-16T18:29:11.982 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052539b24948fe117-00661ec377-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.026 DEBUG:boto:path=/cjqttm-52/obj57 2024-04-16T18:29:12.026 DEBUG:boto:auth_path=/cjqttm-52/obj57 2024-04-16T18:29:12.027 DEBUG:boto:Method: GET 2024-04-16T18:29:12.027 DEBUG:boto:Path: /cjqttm-52/obj57 2024-04-16T18:29:12.027 DEBUG:boto:Data: 2024-04-16T18:29:12.027 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.027 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.027 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.027 DEBUG:boto:Params: {} 2024-04-16T18:29:12.027 DEBUG:boto:Token: None 2024-04-16T18:29:12.027 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj57 2024-04-16T18:29:12.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vlTEQswYKqjo3B/+cM6QwvQ1QfA= 2024-04-16T18:29:12.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vlTEQswYKqjo3B/+cM6QwvQ1QfA=', 'Content-Length': '0'} 2024-04-16T18:29:12.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da3dbcc9ad7760bd-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.030 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.030 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.030 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:12.030 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:12.030 DEBUG:boto:Method: GET 2024-04-16T18:29:12.031 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:29:12.031 DEBUG:boto:Data: 2024-04-16T18:29:12.031 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.031 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.031 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.031 DEBUG:boto:Params: {} 2024-04-16T18:29:12.031 DEBUG:boto:Token: None 2024-04-16T18:29:12.031 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.031 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.034 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000786d0cbd1d0c2966-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.074 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.075 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.075 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.075 DEBUG:boto:path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:12.075 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj57 2024-04-16T18:29:12.075 DEBUG:boto:Method: GET 2024-04-16T18:29:12.075 DEBUG:boto:Path: /cjqttm-52/?prefix=obj57 2024-04-16T18:29:12.075 DEBUG:boto:Data: 2024-04-16T18:29:12.075 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.075 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.076 DEBUG:boto:Params: {} 2024-04-16T18:29:12.076 DEBUG:boto:Token: None 2024-04-16T18:29:12.076 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c26d3cf519c855bd-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.080 DEBUG:boto:b'cjqttm-52obj571000falseobj572024-04-16T18:21:05.079Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:29:12.080 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.080 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.081 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.081 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.081 DEBUG:boto:Method: GET 2024-04-16T18:29:12.081 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.081 DEBUG:boto:Data: 2024-04-16T18:29:12.081 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.081 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.081 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.081 DEBUG:boto:Params: {} 2024-04-16T18:29:12.081 DEBUG:boto:Token: None 2024-04-16T18:29:12.082 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.082 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg= 2024-04-16T18:29:12.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg=', 'Content-Length': '0'} 2024-04-16T18:29:12.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b49ad727f0de7001-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.126 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.126 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.126 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.127 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.127 DEBUG:boto:Method: GET 2024-04-16T18:29:12.127 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.127 DEBUG:boto:Data: 2024-04-16T18:29:12.127 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.127 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.127 DEBUG:boto:Params: {} 2024-04-16T18:29:12.127 DEBUG:boto:Token: None 2024-04-16T18:29:12.127 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg= 2024-04-16T18:29:12.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg=', 'Content-Length': '0'} 2024-04-16T18:29:12.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dab571ce91b30204-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.130 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.130 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.130 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.130 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.130 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.130 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.130 DEBUG:boto:Data: 2024-04-16T18:29:12.131 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.131 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.131 DEBUG:boto:Params: {} 2024-04-16T18:29:12.131 DEBUG:boto:Token: None 2024-04-16T18:29:12.131 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.131 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KNKo7LqtvFsn1/jw3cDVQvIdDrM= 2024-04-16T18:29:12.131 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KNKo7LqtvFsn1/jw3cDVQvIdDrM=', 'Content-Length': '0'} 2024-04-16T18:29:12.133 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1dacb42bf447bee-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.133 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.134 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.134 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.134 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.134 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.134 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.134 DEBUG:boto:Data: 2024-04-16T18:29:12.134 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.134 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.134 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.134 DEBUG:boto:Params: {} 2024-04-16T18:29:12.135 DEBUG:boto:Token: None 2024-04-16T18:29:12.135 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KNKo7LqtvFsn1/jw3cDVQvIdDrM= 2024-04-16T18:29:12.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KNKo7LqtvFsn1/jw3cDVQvIdDrM=', 'Content-Length': '0'} 2024-04-16T18:29:12.137 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000027d5381d9f5ac22-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:29:12.137 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.137 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.137 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.137 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.137 DEBUG:boto:Method: GET 2024-04-16T18:29:12.137 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.137 DEBUG:boto:Data: 2024-04-16T18:29:12.138 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.138 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.138 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.138 DEBUG:boto:Params: {} 2024-04-16T18:29:12.138 DEBUG:boto:Token: None 2024-04-16T18:29:12.138 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.138 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg= 2024-04-16T18:29:12.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg=', 'Content-Length': '0'} 2024-04-16T18:29:12.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e5854a918dba6af-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.182 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.182 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.183 DEBUG:boto:path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.183 DEBUG:boto:auth_path=/cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.183 DEBUG:boto:Method: GET 2024-04-16T18:29:12.183 DEBUG:boto:Path: /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.183 DEBUG:boto:Data: 2024-04-16T18:29:12.183 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.183 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.183 DEBUG:boto:Params: {} 2024-04-16T18:29:12.183 DEBUG:boto:Token: None 2024-04-16T18:29:12.184 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58?versionId=null 2024-04-16T18:29:12.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg= 2024-04-16T18:29:12.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6NB8DH8YYB7uO3A/HWpr3KrMnxg=', 'Content-Length': '0'} 2024-04-16T18:29:12.185 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c430ea77be45ebe-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.186 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.186 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.186 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.186 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.186 DEBUG:boto:Method: GET 2024-04-16T18:29:12.186 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.186 DEBUG:boto:Data: 2024-04-16T18:29:12.187 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.187 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.187 DEBUG:boto:Params: {} 2024-04-16T18:29:12.187 DEBUG:boto:Token: None 2024-04-16T18:29:12.187 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.187 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.189 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000563f97a078fa54f5-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.230 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.231 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.231 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.231 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.231 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.231 DEBUG:boto:Method: GET 2024-04-16T18:29:12.231 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.231 DEBUG:boto:Data: 2024-04-16T18:29:12.231 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.231 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.231 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.232 DEBUG:boto:Params: {} 2024-04-16T18:29:12.232 DEBUG:boto:Token: None 2024-04-16T18:29:12.232 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.235 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000614334a6816017a3-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.236 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.236 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.236 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.236 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.236 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:29:12.236 DEBUG:boto:Data: 2024-04-16T18:29:12.236 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.236 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.237 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.237 DEBUG:boto:Params: {} 2024-04-16T18:29:12.237 DEBUG:boto:Token: None 2024-04-16T18:29:12.237 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58 2024-04-16T18:29:12.237 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u5eGUkwi306C8j8Elano7YHHDUg= 2024-04-16T18:29:12.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u5eGUkwi306C8j8Elano7YHHDUg=', 'Content-Length': '0'} 2024-04-16T18:29:12.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9c44061ffb0843f-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.239 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.239 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.240 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.240 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:29:12.240 DEBUG:boto:Data: 2024-04-16T18:29:12.240 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.240 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.240 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.240 DEBUG:boto:Params: {} 2024-04-16T18:29:12.240 DEBUG:boto:Token: None 2024-04-16T18:29:12.240 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58 2024-04-16T18:29:12.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u5eGUkwi306C8j8Elano7YHHDUg= 2024-04-16T18:29:12.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u5eGUkwi306C8j8Elano7YHHDUg=', 'Content-Length': '0'} 2024-04-16T18:29:12.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccc867403ec6fb0a-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.243 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:29:12.243 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.243 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.243 DEBUG:boto:Method: GET 2024-04-16T18:29:12.243 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:29:12.243 DEBUG:boto:Data: 2024-04-16T18:29:12.243 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.243 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.244 DEBUG:boto:Params: {} 2024-04-16T18:29:12.244 DEBUG:boto:Token: None 2024-04-16T18:29:12.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58 2024-04-16T18:29:12.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QyxeyBa0GNk21e3bUTGsrug0p78= 2024-04-16T18:29:12.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QyxeyBa0GNk21e3bUTGsrug0p78=', 'Content-Length': '0'} 2024-04-16T18:29:12.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb672057115f3f46-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.286 DEBUG:boto:path=/cjqttm-52/obj58 2024-04-16T18:29:12.286 DEBUG:boto:auth_path=/cjqttm-52/obj58 2024-04-16T18:29:12.286 DEBUG:boto:Method: GET 2024-04-16T18:29:12.287 DEBUG:boto:Path: /cjqttm-52/obj58 2024-04-16T18:29:12.287 DEBUG:boto:Data: 2024-04-16T18:29:12.287 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.287 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.287 DEBUG:boto:Params: {} 2024-04-16T18:29:12.287 DEBUG:boto:Token: None 2024-04-16T18:29:12.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj58 2024-04-16T18:29:12.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QyxeyBa0GNk21e3bUTGsrug0p78= 2024-04-16T18:29:12.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QyxeyBa0GNk21e3bUTGsrug0p78=', 'Content-Length': '0'} 2024-04-16T18:29:12.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002875b0df6b882be7-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.290 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.290 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.290 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.290 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.290 DEBUG:boto:Method: GET 2024-04-16T18:29:12.290 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.290 DEBUG:boto:Data: 2024-04-16T18:29:12.290 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.290 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.290 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.291 DEBUG:boto:Params: {} 2024-04-16T18:29:12.291 DEBUG:boto:Token: None 2024-04-16T18:29:12.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.293 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ea9efcf72d83a3c-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.334 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.335 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.335 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.335 DEBUG:boto:path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.335 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.335 DEBUG:boto:Method: GET 2024-04-16T18:29:12.335 DEBUG:boto:Path: /cjqttm-52/?prefix=obj58 2024-04-16T18:29:12.335 DEBUG:boto:Data: 2024-04-16T18:29:12.335 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.335 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.335 DEBUG:boto:Params: {} 2024-04-16T18:29:12.336 DEBUG:boto:Token: None 2024-04-16T18:29:12.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.339 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000044f710c95d03026f-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.339 DEBUG:boto:b'cjqttm-52obj581000falseobj582024-04-16T18:24:09.495Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:29:12.340 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.340 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.340 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.340 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.340 DEBUG:boto:Method: GET 2024-04-16T18:29:12.340 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.340 DEBUG:boto:Data: 2024-04-16T18:29:12.340 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.340 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.341 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.341 DEBUG:boto:Params: {} 2024-04-16T18:29:12.341 DEBUG:boto:Token: None 2024-04-16T18:29:12.341 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.341 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo= 2024-04-16T18:29:12.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo=', 'Content-Length': '0'} 2024-04-16T18:29:12.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005a6f0f53f8f3cda3-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.386 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.387 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.387 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.387 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.387 DEBUG:boto:Method: GET 2024-04-16T18:29:12.387 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.387 DEBUG:boto:Data: 2024-04-16T18:29:12.387 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.387 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.387 DEBUG:boto:Params: {} 2024-04-16T18:29:12.387 DEBUG:boto:Token: None 2024-04-16T18:29:12.388 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo= 2024-04-16T18:29:12.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo=', 'Content-Length': '0'} 2024-04-16T18:29:12.390 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b84e80baf293b14b-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.390 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.390 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.391 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.391 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.391 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.391 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.391 DEBUG:boto:Data: 2024-04-16T18:29:12.391 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.391 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.391 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.391 DEBUG:boto:Params: {} 2024-04-16T18:29:12.391 DEBUG:boto:Token: None 2024-04-16T18:29:12.392 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cLTy9d9a/37QEVaQuL77dwdI1mo= 2024-04-16T18:29:12.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cLTy9d9a/37QEVaQuL77dwdI1mo=', 'Content-Length': '0'} 2024-04-16T18:29:12.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e613cf2ea4e54d4-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.395 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.395 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.395 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.395 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.395 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.395 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.395 DEBUG:boto:Data: 2024-04-16T18:29:12.395 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.395 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.396 DEBUG:boto:Params: {} 2024-04-16T18:29:12.396 DEBUG:boto:Token: None 2024-04-16T18:29:12.396 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cLTy9d9a/37QEVaQuL77dwdI1mo= 2024-04-16T18:29:12.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cLTy9d9a/37QEVaQuL77dwdI1mo=', 'Content-Length': '0'} 2024-04-16T18:29:12.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fda2404b57d08b5-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.398 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:29:12.398 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.398 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.399 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.399 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.399 DEBUG:boto:Method: GET 2024-04-16T18:29:12.399 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.399 DEBUG:boto:Data: 2024-04-16T18:29:12.399 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.399 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.399 DEBUG:boto:Params: {} 2024-04-16T18:29:12.399 DEBUG:boto:Token: None 2024-04-16T18:29:12.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo= 2024-04-16T18:29:12.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo=', 'Content-Length': '0'} 2024-04-16T18:29:12.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007da8f3dd47a29faa-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.442 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.442 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.443 DEBUG:boto:path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.443 DEBUG:boto:auth_path=/cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.443 DEBUG:boto:Method: GET 2024-04-16T18:29:12.443 DEBUG:boto:Path: /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.443 DEBUG:boto:Data: 2024-04-16T18:29:12.443 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.443 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.443 DEBUG:boto:Params: {} 2024-04-16T18:29:12.443 DEBUG:boto:Token: None 2024-04-16T18:29:12.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62?versionId=null 2024-04-16T18:29:12.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo= 2024-04-16T18:29:12.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JD/FltUTwuFEAst+Y3IrlQWfdBo=', 'Content-Length': '0'} 2024-04-16T18:29:12.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005527bc0bf2b7dd69-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.446 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.446 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.446 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.446 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.446 DEBUG:boto:Method: GET 2024-04-16T18:29:12.447 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.447 DEBUG:boto:Data: 2024-04-16T18:29:12.447 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.447 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.447 DEBUG:boto:Params: {} 2024-04-16T18:29:12.447 DEBUG:boto:Token: None 2024-04-16T18:29:12.447 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.447 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.450 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001f9b6d762bf1a9d3-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.450 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.450 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.450 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.450 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.451 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.451 DEBUG:boto:Method: GET 2024-04-16T18:29:12.451 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.451 DEBUG:boto:Data: 2024-04-16T18:29:12.451 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.451 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.451 DEBUG:boto:Params: {} 2024-04-16T18:29:12.451 DEBUG:boto:Token: None 2024-04-16T18:29:12.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000724cce7657dfa65-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.455 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.455 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.456 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.456 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.456 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:29:12.456 DEBUG:boto:Data: 2024-04-16T18:29:12.456 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.456 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.456 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.456 DEBUG:boto:Params: {} 2024-04-16T18:29:12.456 DEBUG:boto:Token: None 2024-04-16T18:29:12.456 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62 2024-04-16T18:29:12.457 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMHIFs8PHMJBdQ/XbQGKu4P+ytw= 2024-04-16T18:29:12.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMHIFs8PHMJBdQ/XbQGKu4P+ytw=', 'Content-Length': '0'} 2024-04-16T18:29:12.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab792aa991ddce92-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.460 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.460 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.460 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.460 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:29:12.460 DEBUG:boto:Data: 2024-04-16T18:29:12.460 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.460 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.460 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.460 DEBUG:boto:Params: {} 2024-04-16T18:29:12.460 DEBUG:boto:Token: None 2024-04-16T18:29:12.461 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62 2024-04-16T18:29:12.461 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMHIFs8PHMJBdQ/XbQGKu4P+ytw= 2024-04-16T18:29:12.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMHIFs8PHMJBdQ/XbQGKu4P+ytw=', 'Content-Length': '0'} 2024-04-16T18:29:12.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003a3fe9518adee51a-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:29:12.463 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.463 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.463 DEBUG:boto:Method: GET 2024-04-16T18:29:12.463 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:29:12.463 DEBUG:boto:Data: 2024-04-16T18:29:12.463 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.463 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.464 DEBUG:boto:Params: {} 2024-04-16T18:29:12.464 DEBUG:boto:Token: None 2024-04-16T18:29:12.464 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62 2024-04-16T18:29:12.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rMo6l7oAAvFXdo8gz8q5wgyA+V4= 2024-04-16T18:29:12.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rMo6l7oAAvFXdo8gz8q5wgyA+V4=', 'Content-Length': '0'} 2024-04-16T18:29:12.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000167ac99454a59b22-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.506 DEBUG:boto:path=/cjqttm-52/obj62 2024-04-16T18:29:12.506 DEBUG:boto:auth_path=/cjqttm-52/obj62 2024-04-16T18:29:12.507 DEBUG:boto:Method: GET 2024-04-16T18:29:12.507 DEBUG:boto:Path: /cjqttm-52/obj62 2024-04-16T18:29:12.507 DEBUG:boto:Data: 2024-04-16T18:29:12.507 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.507 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.507 DEBUG:boto:Params: {} 2024-04-16T18:29:12.507 DEBUG:boto:Token: None 2024-04-16T18:29:12.507 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj62 2024-04-16T18:29:12.507 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rMo6l7oAAvFXdo8gz8q5wgyA+V4= 2024-04-16T18:29:12.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rMo6l7oAAvFXdo8gz8q5wgyA+V4=', 'Content-Length': '0'} 2024-04-16T18:29:12.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f43ab1dba1fe8899-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.510 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.510 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.510 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.510 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.511 DEBUG:boto:Method: GET 2024-04-16T18:29:12.511 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.511 DEBUG:boto:Data: 2024-04-16T18:29:12.511 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.511 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.511 DEBUG:boto:Params: {} 2024-04-16T18:29:12.511 DEBUG:boto:Token: None 2024-04-16T18:29:12.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.514 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000051fddd1d9b895db9-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.558 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.559 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.559 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.559 DEBUG:boto:path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.559 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.559 DEBUG:boto:Method: GET 2024-04-16T18:29:12.559 DEBUG:boto:Path: /cjqttm-52/?prefix=obj62 2024-04-16T18:29:12.559 DEBUG:boto:Data: 2024-04-16T18:29:12.559 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.559 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.560 DEBUG:boto:Params: {} 2024-04-16T18:29:12.560 DEBUG:boto:Token: None 2024-04-16T18:29:12.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043cd0268017f3634-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.564 DEBUG:boto:b'cjqttm-52obj621000falseobj622024-04-16T18:26:26.336Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.564 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:29:12.564 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.564 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.565 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.565 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.565 DEBUG:boto:Method: GET 2024-04-16T18:29:12.565 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.565 DEBUG:boto:Data: 2024-04-16T18:29:12.565 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.565 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.565 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.565 DEBUG:boto:Params: {} 2024-04-16T18:29:12.565 DEBUG:boto:Token: None 2024-04-16T18:29:12.566 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM= 2024-04-16T18:29:12.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM=', 'Content-Length': '0'} 2024-04-16T18:29:12.568 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000640cb4a9ec20a45c-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.610 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.610 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.610 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.611 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.611 DEBUG:boto:Method: GET 2024-04-16T18:29:12.611 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.611 DEBUG:boto:Data: 2024-04-16T18:29:12.611 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.611 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.611 DEBUG:boto:Params: {} 2024-04-16T18:29:12.611 DEBUG:boto:Token: None 2024-04-16T18:29:12.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM= 2024-04-16T18:29:12.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM=', 'Content-Length': '0'} 2024-04-16T18:29:12.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbce2b06499f9135-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.614 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.614 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.614 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.614 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.614 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.614 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.615 DEBUG:boto:Data: 2024-04-16T18:29:12.615 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.615 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.615 DEBUG:boto:Params: {} 2024-04-16T18:29:12.615 DEBUG:boto:Token: None 2024-04-16T18:29:12.615 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LeJ7w6h6VWWxWCTdaUMpVAA4brI= 2024-04-16T18:29:12.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LeJ7w6h6VWWxWCTdaUMpVAA4brI=', 'Content-Length': '0'} 2024-04-16T18:29:12.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000042fec353bb9ac43-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.618 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.618 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.618 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.618 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.618 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.618 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.618 DEBUG:boto:Data: 2024-04-16T18:29:12.618 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.618 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.618 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.619 DEBUG:boto:Params: {} 2024-04-16T18:29:12.619 DEBUG:boto:Token: None 2024-04-16T18:29:12.619 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LeJ7w6h6VWWxWCTdaUMpVAA4brI= 2024-04-16T18:29:12.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LeJ7w6h6VWWxWCTdaUMpVAA4brI=', 'Content-Length': '0'} 2024-04-16T18:29:12.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000130a658fd2fa60ce-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.621 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:29:12.622 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.622 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.622 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.622 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.622 DEBUG:boto:Method: GET 2024-04-16T18:29:12.622 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.622 DEBUG:boto:Data: 2024-04-16T18:29:12.622 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.622 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.622 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.623 DEBUG:boto:Params: {} 2024-04-16T18:29:12.623 DEBUG:boto:Token: None 2024-04-16T18:29:12.623 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM= 2024-04-16T18:29:12.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM=', 'Content-Length': '0'} 2024-04-16T18:29:12.625 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012702928b97c356a-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.666 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.666 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.667 DEBUG:boto:path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.667 DEBUG:boto:auth_path=/cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.667 DEBUG:boto:Method: GET 2024-04-16T18:29:12.667 DEBUG:boto:Path: /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.667 DEBUG:boto:Data: 2024-04-16T18:29:12.667 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.667 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.667 DEBUG:boto:Params: {} 2024-04-16T18:29:12.667 DEBUG:boto:Token: None 2024-04-16T18:29:12.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68?versionId=null 2024-04-16T18:29:12.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM= 2024-04-16T18:29:12.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hD7wqd7S8okv1oAq1SMZ0aZSyCM=', 'Content-Length': '0'} 2024-04-16T18:29:12.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e1f87d4b7a057a7-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.670 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.670 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.670 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.670 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.670 DEBUG:boto:Method: GET 2024-04-16T18:29:12.670 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.671 DEBUG:boto:Data: 2024-04-16T18:29:12.671 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.671 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.671 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.671 DEBUG:boto:Params: {} 2024-04-16T18:29:12.671 DEBUG:boto:Token: None 2024-04-16T18:29:12.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.671 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.671 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.674 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000043d0ff6a0d1e5ecc-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.714 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.715 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.715 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.715 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.715 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.715 DEBUG:boto:Method: GET 2024-04-16T18:29:12.715 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.715 DEBUG:boto:Data: 2024-04-16T18:29:12.715 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.715 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.716 DEBUG:boto:Params: {} 2024-04-16T18:29:12.716 DEBUG:boto:Token: None 2024-04-16T18:29:12.716 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.719 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000083fa07f7185ed77-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.720 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.720 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.720 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.720 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.720 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:29:12.720 DEBUG:boto:Data: 2024-04-16T18:29:12.720 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.721 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.721 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.721 DEBUG:boto:Params: {} 2024-04-16T18:29:12.721 DEBUG:boto:Token: None 2024-04-16T18:29:12.721 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68 2024-04-16T18:29:12.721 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/uJkQvIT+XKc9/p1pCB727D+IHw= 2024-04-16T18:29:12.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/uJkQvIT+XKc9/p1pCB727D+IHw=', 'Content-Length': '0'} 2024-04-16T18:29:12.723 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060723c30d5d3e2b0-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.723 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.723 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.723 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.724 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:29:12.724 DEBUG:boto:Data: 2024-04-16T18:29:12.724 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.724 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.724 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.724 DEBUG:boto:Params: {} 2024-04-16T18:29:12.724 DEBUG:boto:Token: None 2024-04-16T18:29:12.724 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68 2024-04-16T18:29:12.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/uJkQvIT+XKc9/p1pCB727D+IHw= 2024-04-16T18:29:12.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/uJkQvIT+XKc9/p1pCB727D+IHw=', 'Content-Length': '0'} 2024-04-16T18:29:12.726 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041f5aedb497fe68e-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:29:12.727 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.727 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.727 DEBUG:boto:Method: GET 2024-04-16T18:29:12.727 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:29:12.727 DEBUG:boto:Data: 2024-04-16T18:29:12.727 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.727 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.727 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.727 DEBUG:boto:Params: {} 2024-04-16T18:29:12.728 DEBUG:boto:Token: None 2024-04-16T18:29:12.728 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68 2024-04-16T18:29:12.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HcRic5IhxiuIj5BwavDS1ZSpYok= 2024-04-16T18:29:12.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HcRic5IhxiuIj5BwavDS1ZSpYok=', 'Content-Length': '0'} 2024-04-16T18:29:12.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e52d210c56f86ead-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.770 DEBUG:boto:path=/cjqttm-52/obj68 2024-04-16T18:29:12.770 DEBUG:boto:auth_path=/cjqttm-52/obj68 2024-04-16T18:29:12.771 DEBUG:boto:Method: GET 2024-04-16T18:29:12.771 DEBUG:boto:Path: /cjqttm-52/obj68 2024-04-16T18:29:12.771 DEBUG:boto:Data: 2024-04-16T18:29:12.771 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.771 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.771 DEBUG:boto:Params: {} 2024-04-16T18:29:12.771 DEBUG:boto:Token: None 2024-04-16T18:29:12.771 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj68 2024-04-16T18:29:12.771 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HcRic5IhxiuIj5BwavDS1ZSpYok= 2024-04-16T18:29:12.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HcRic5IhxiuIj5BwavDS1ZSpYok=', 'Content-Length': '0'} 2024-04-16T18:29:12.773 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000015bb46c79d5ae41b-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.774 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.774 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.774 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.774 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.774 DEBUG:boto:Method: GET 2024-04-16T18:29:12.774 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.774 DEBUG:boto:Data: 2024-04-16T18:29:12.774 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.775 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.775 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.775 DEBUG:boto:Params: {} 2024-04-16T18:29:12.775 DEBUG:boto:Token: None 2024-04-16T18:29:12.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.778 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020502f765f77be8c-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.818 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.819 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.819 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.819 DEBUG:boto:path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.819 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.819 DEBUG:boto:Method: GET 2024-04-16T18:29:12.819 DEBUG:boto:Path: /cjqttm-52/?prefix=obj68 2024-04-16T18:29:12.819 DEBUG:boto:Data: 2024-04-16T18:29:12.819 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.819 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.820 DEBUG:boto:Params: {} 2024-04-16T18:29:12.820 DEBUG:boto:Token: None 2024-04-16T18:29:12.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.823 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002a7c1b9749feed85-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.824 DEBUG:boto:b'cjqttm-52obj681000falseobj682024-04-16T18:20:07.502Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.824 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:29:12.824 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.824 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.824 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.824 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.824 DEBUG:boto:Method: GET 2024-04-16T18:29:12.824 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.825 DEBUG:boto:Data: 2024-04-16T18:29:12.825 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.825 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.825 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.825 DEBUG:boto:Params: {} 2024-04-16T18:29:12.825 DEBUG:boto:Token: None 2024-04-16T18:29:12.825 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.825 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0= 2024-04-16T18:29:12.825 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0=', 'Content-Length': '0'} 2024-04-16T18:29:12.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000096e35171f0668f8-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.870 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.871 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.871 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.871 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.871 DEBUG:boto:Method: GET 2024-04-16T18:29:12.871 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.871 DEBUG:boto:Data: 2024-04-16T18:29:12.871 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.871 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.871 DEBUG:boto:Params: {} 2024-04-16T18:29:12.872 DEBUG:boto:Token: None 2024-04-16T18:29:12.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0= 2024-04-16T18:29:12.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0=', 'Content-Length': '0'} 2024-04-16T18:29:12.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000088100b278a5d578-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.874 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.874 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.875 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.875 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.875 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.875 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.875 DEBUG:boto:Data: 2024-04-16T18:29:12.875 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.875 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.875 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.875 DEBUG:boto:Params: {} 2024-04-16T18:29:12.875 DEBUG:boto:Token: None 2024-04-16T18:29:12.876 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q2XXjkAHt+XxMwdFRy9Hm1dCmgM= 2024-04-16T18:29:12.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q2XXjkAHt+XxMwdFRy9Hm1dCmgM=', 'Content-Length': '0'} 2024-04-16T18:29:12.878 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eab4865d38f430c3-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.878 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.878 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.878 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.879 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.879 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.879 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.879 DEBUG:boto:Data: 2024-04-16T18:29:12.879 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.879 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.879 DEBUG:boto:Params: {} 2024-04-16T18:29:12.879 DEBUG:boto:Token: None 2024-04-16T18:29:12.879 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q2XXjkAHt+XxMwdFRy9Hm1dCmgM= 2024-04-16T18:29:12.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q2XXjkAHt+XxMwdFRy9Hm1dCmgM=', 'Content-Length': '0'} 2024-04-16T18:29:12.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001381ed469ff9ff89-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.882 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:29:12.882 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.882 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.883 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.883 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.883 DEBUG:boto:Method: GET 2024-04-16T18:29:12.883 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.883 DEBUG:boto:Data: 2024-04-16T18:29:12.883 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.883 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.883 DEBUG:boto:Params: {} 2024-04-16T18:29:12.883 DEBUG:boto:Token: None 2024-04-16T18:29:12.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.884 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0= 2024-04-16T18:29:12.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0=', 'Content-Length': '0'} 2024-04-16T18:29:12.886 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb5ccfdbc734c908-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.926 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.926 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.926 DEBUG:boto:path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.927 DEBUG:boto:auth_path=/cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.927 DEBUG:boto:Method: GET 2024-04-16T18:29:12.927 DEBUG:boto:Path: /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.927 DEBUG:boto:Data: 2024-04-16T18:29:12.927 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.927 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.927 DEBUG:boto:Params: {} 2024-04-16T18:29:12.927 DEBUG:boto:Token: None 2024-04-16T18:29:12.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69?versionId=null 2024-04-16T18:29:12.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0= 2024-04-16T18:29:12.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2B11HP9OApVYPMgLZcrxu8NOBR0=', 'Content-Length': '0'} 2024-04-16T18:29:12.930 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cbf0a44597a26e44-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.930 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.930 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.930 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:12.930 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:12.931 DEBUG:boto:Method: GET 2024-04-16T18:29:12.931 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:29:12.931 DEBUG:boto:Data: 2024-04-16T18:29:12.931 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.931 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.931 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.931 DEBUG:boto:Params: {} 2024-04-16T18:29:12.931 DEBUG:boto:Token: None 2024-04-16T18:29:12.931 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.931 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.934 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000417acf38458ad7f2-00661ec378-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.974 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.975 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:12.975 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:12.975 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:12.975 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:12.975 DEBUG:boto:Method: GET 2024-04-16T18:29:12.975 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:29:12.975 DEBUG:boto:Data: 2024-04-16T18:29:12.975 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.976 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.976 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.976 DEBUG:boto:Params: {} 2024-04-16T18:29:12.976 DEBUG:boto:Token: None 2024-04-16T18:29:12.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/ 2024-04-16T18:29:12.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI= 2024-04-16T18:29:12.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8ic5wdoevKN01+T7nSBOmwnEaUI=', 'Content-Length': '0'} 2024-04-16T18:29:12.980 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000682145d9205deec7-00661ec378-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.980 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:12.980 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.980 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.980 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.981 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:29:12.981 DEBUG:boto:Data: 2024-04-16T18:29:12.981 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.981 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.981 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.981 DEBUG:boto:Params: {} 2024-04-16T18:29:12.981 DEBUG:boto:Token: None 2024-04-16T18:29:12.981 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69 2024-04-16T18:29:12.981 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:duvcy1ZMLToYbsXakcLblLlR5H8= 2024-04-16T18:29:12.982 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:duvcy1ZMLToYbsXakcLblLlR5H8=', 'Content-Length': '0'} 2024-04-16T18:29:12.984 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a480ad6365ee7d8a-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.984 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.984 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.984 DEBUG:boto:Method: HEAD 2024-04-16T18:29:12.984 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:29:12.984 DEBUG:boto:Data: 2024-04-16T18:29:12.985 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.985 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:12.985 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.985 DEBUG:boto:Params: {} 2024-04-16T18:29:12.985 DEBUG:boto:Token: None 2024-04-16T18:29:12.985 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69 2024-04-16T18:29:12.985 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:duvcy1ZMLToYbsXakcLblLlR5H8= 2024-04-16T18:29:12.985 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:duvcy1ZMLToYbsXakcLblLlR5H8=', 'Content-Length': '0'} 2024-04-16T18:29:12.987 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6df67b0aea654ef-00661ec378-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:12.987 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:29:12.987 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:12.988 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:12.988 DEBUG:boto:Method: GET 2024-04-16T18:29:12.988 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:29:12.988 DEBUG:boto:Data: 2024-04-16T18:29:12.988 DEBUG:boto:Headers: {} 2024-04-16T18:29:12.988 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:12.988 DEBUG:boto:Port: 8000 2024-04-16T18:29:12.988 DEBUG:boto:Params: {} 2024-04-16T18:29:12.988 DEBUG:boto:Token: None 2024-04-16T18:29:12.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:12 GMT /cjqttm-52/obj69 2024-04-16T18:29:12.989 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2geZIudRfEsmmeAC2M69ZN6Tog4= 2024-04-16T18:29:12.989 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2geZIudRfEsmmeAC2M69ZN6Tog4=', 'Content-Length': '0'} 2024-04-16T18:29:12.991 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000847046003c488f63-00661ec378-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.034 DEBUG:boto:path=/cjqttm-52/obj69 2024-04-16T18:29:13.034 DEBUG:boto:auth_path=/cjqttm-52/obj69 2024-04-16T18:29:13.035 DEBUG:boto:Method: GET 2024-04-16T18:29:13.035 DEBUG:boto:Path: /cjqttm-52/obj69 2024-04-16T18:29:13.035 DEBUG:boto:Data: 2024-04-16T18:29:13.035 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.035 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.035 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.035 DEBUG:boto:Params: {} 2024-04-16T18:29:13.035 DEBUG:boto:Token: None 2024-04-16T18:29:13.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj69 2024-04-16T18:29:13.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QQGeDeOJIjsm3dA5lbz5TpnXphU= 2024-04-16T18:29:13.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QQGeDeOJIjsm3dA5lbz5TpnXphU=', 'Content-Length': '0'} 2024-04-16T18:29:13.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000857377b3a9a3c8d0-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.038 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.038 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.038 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:13.038 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:13.038 DEBUG:boto:Method: GET 2024-04-16T18:29:13.038 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:29:13.038 DEBUG:boto:Data: 2024-04-16T18:29:13.039 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.039 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.039 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.039 DEBUG:boto:Params: {} 2024-04-16T18:29:13.039 DEBUG:boto:Token: None 2024-04-16T18:29:13.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.042 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000771e2983ddf84e95-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.082 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.083 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.083 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.083 DEBUG:boto:path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:13.083 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj69 2024-04-16T18:29:13.083 DEBUG:boto:Method: GET 2024-04-16T18:29:13.083 DEBUG:boto:Path: /cjqttm-52/?prefix=obj69 2024-04-16T18:29:13.083 DEBUG:boto:Data: 2024-04-16T18:29:13.083 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.083 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.084 DEBUG:boto:Params: {} 2024-04-16T18:29:13.084 DEBUG:boto:Token: None 2024-04-16T18:29:13.084 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e4cf56373d10cdbb-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.088 DEBUG:boto:b'cjqttm-52obj691000falseobj692024-04-16T18:21:49.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:29:13.088 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.088 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.088 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.088 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.089 DEBUG:boto:Method: GET 2024-04-16T18:29:13.089 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.089 DEBUG:boto:Data: 2024-04-16T18:29:13.089 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.089 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.089 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.089 DEBUG:boto:Params: {} 2024-04-16T18:29:13.089 DEBUG:boto:Token: None 2024-04-16T18:29:13.089 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.089 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns= 2024-04-16T18:29:13.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns=', 'Content-Length': '0'} 2024-04-16T18:29:13.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa4479946205f545-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.134 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.134 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.135 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.135 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.135 DEBUG:boto:Method: GET 2024-04-16T18:29:13.135 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.135 DEBUG:boto:Data: 2024-04-16T18:29:13.135 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.135 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.135 DEBUG:boto:Params: {} 2024-04-16T18:29:13.135 DEBUG:boto:Token: None 2024-04-16T18:29:13.136 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns= 2024-04-16T18:29:13.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns=', 'Content-Length': '0'} 2024-04-16T18:29:13.138 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c0330571aaad94e-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.138 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.139 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.139 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.139 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.139 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.139 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.139 DEBUG:boto:Data: 2024-04-16T18:29:13.139 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.139 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.139 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.139 DEBUG:boto:Params: {} 2024-04-16T18:29:13.139 DEBUG:boto:Token: None 2024-04-16T18:29:13.140 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.140 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z9IfulCeUJQ6S+zt798wlnuwfuE= 2024-04-16T18:29:13.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z9IfulCeUJQ6S+zt798wlnuwfuE=', 'Content-Length': '0'} 2024-04-16T18:29:13.142 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaff9908b9355923-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.142 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.142 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.143 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.143 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.143 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.143 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.143 DEBUG:boto:Data: 2024-04-16T18:29:13.143 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.143 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.143 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.143 DEBUG:boto:Params: {} 2024-04-16T18:29:13.143 DEBUG:boto:Token: None 2024-04-16T18:29:13.143 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z9IfulCeUJQ6S+zt798wlnuwfuE= 2024-04-16T18:29:13.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z9IfulCeUJQ6S+zt798wlnuwfuE=', 'Content-Length': '0'} 2024-04-16T18:29:13.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ced6a0ab9e55c09-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.146 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:29:13.146 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.146 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.146 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.147 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.147 DEBUG:boto:Method: GET 2024-04-16T18:29:13.147 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.147 DEBUG:boto:Data: 2024-04-16T18:29:13.147 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.147 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.147 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.147 DEBUG:boto:Params: {} 2024-04-16T18:29:13.147 DEBUG:boto:Token: None 2024-04-16T18:29:13.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.148 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns= 2024-04-16T18:29:13.148 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns=', 'Content-Length': '0'} 2024-04-16T18:29:13.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000daee9d5fe3850ece-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.190 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.190 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.191 DEBUG:boto:path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.191 DEBUG:boto:auth_path=/cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.191 DEBUG:boto:Method: GET 2024-04-16T18:29:13.191 DEBUG:boto:Path: /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.191 DEBUG:boto:Data: 2024-04-16T18:29:13.191 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.191 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.191 DEBUG:boto:Params: {} 2024-04-16T18:29:13.192 DEBUG:boto:Token: None 2024-04-16T18:29:13.192 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74?versionId=null 2024-04-16T18:29:13.192 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns= 2024-04-16T18:29:13.192 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i2rAUlkeOgcp8KQgDXFGHxvH9ns=', 'Content-Length': '0'} 2024-04-16T18:29:13.194 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a87430ca2690325e-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.194 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.195 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.195 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.195 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.195 DEBUG:boto:Method: GET 2024-04-16T18:29:13.195 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.195 DEBUG:boto:Data: 2024-04-16T18:29:13.195 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.195 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.196 DEBUG:boto:Params: {} 2024-04-16T18:29:13.196 DEBUG:boto:Token: None 2024-04-16T18:29:13.196 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.198 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045e6073c6a335b48-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.238 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.239 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.239 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.239 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.239 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.239 DEBUG:boto:Method: GET 2024-04-16T18:29:13.239 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.239 DEBUG:boto:Data: 2024-04-16T18:29:13.239 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.240 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.240 DEBUG:boto:Params: {} 2024-04-16T18:29:13.240 DEBUG:boto:Token: None 2024-04-16T18:29:13.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.244 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053fa003b3463e06f-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.244 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.244 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.244 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.245 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.245 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:29:13.245 DEBUG:boto:Data: 2024-04-16T18:29:13.245 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.245 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.245 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.245 DEBUG:boto:Params: {} 2024-04-16T18:29:13.245 DEBUG:boto:Token: None 2024-04-16T18:29:13.245 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74 2024-04-16T18:29:13.246 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cChLQovDKkC45waliAdLQnr1nk0= 2024-04-16T18:29:13.246 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cChLQovDKkC45waliAdLQnr1nk0=', 'Content-Length': '0'} 2024-04-16T18:29:13.248 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f19b356343332339-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.248 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.248 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.248 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.248 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:29:13.249 DEBUG:boto:Data: 2024-04-16T18:29:13.249 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.249 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.249 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.249 DEBUG:boto:Params: {} 2024-04-16T18:29:13.249 DEBUG:boto:Token: None 2024-04-16T18:29:13.249 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74 2024-04-16T18:29:13.249 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cChLQovDKkC45waliAdLQnr1nk0= 2024-04-16T18:29:13.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cChLQovDKkC45waliAdLQnr1nk0=', 'Content-Length': '0'} 2024-04-16T18:29:13.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ffe78210f07e248a-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:29:13.252 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.252 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.252 DEBUG:boto:Method: GET 2024-04-16T18:29:13.252 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:29:13.252 DEBUG:boto:Data: 2024-04-16T18:29:13.253 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.253 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.253 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.253 DEBUG:boto:Params: {} 2024-04-16T18:29:13.253 DEBUG:boto:Token: None 2024-04-16T18:29:13.253 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74 2024-04-16T18:29:13.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KUMg3m6gH395cfsXZwPS8wgLirY= 2024-04-16T18:29:13.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KUMg3m6gH395cfsXZwPS8wgLirY=', 'Content-Length': '0'} 2024-04-16T18:29:13.256 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ddd2250927b60544-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.298 DEBUG:boto:path=/cjqttm-52/obj74 2024-04-16T18:29:13.298 DEBUG:boto:auth_path=/cjqttm-52/obj74 2024-04-16T18:29:13.299 DEBUG:boto:Method: GET 2024-04-16T18:29:13.299 DEBUG:boto:Path: /cjqttm-52/obj74 2024-04-16T18:29:13.299 DEBUG:boto:Data: 2024-04-16T18:29:13.299 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.299 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.299 DEBUG:boto:Params: {} 2024-04-16T18:29:13.299 DEBUG:boto:Token: None 2024-04-16T18:29:13.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj74 2024-04-16T18:29:13.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KUMg3m6gH395cfsXZwPS8wgLirY= 2024-04-16T18:29:13.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KUMg3m6gH395cfsXZwPS8wgLirY=', 'Content-Length': '0'} 2024-04-16T18:29:13.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:27:48 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004de6e9a72e5155c6-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.302 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.302 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.302 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.302 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.303 DEBUG:boto:Method: GET 2024-04-16T18:29:13.303 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.303 DEBUG:boto:Data: 2024-04-16T18:29:13.303 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.303 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.303 DEBUG:boto:Params: {} 2024-04-16T18:29:13.303 DEBUG:boto:Token: None 2024-04-16T18:29:13.303 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.303 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.306 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a57fc4c538a266e4-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.306 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.307 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.307 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.307 DEBUG:boto:path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.307 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.307 DEBUG:boto:Method: GET 2024-04-16T18:29:13.307 DEBUG:boto:Path: /cjqttm-52/?prefix=obj74 2024-04-16T18:29:13.307 DEBUG:boto:Data: 2024-04-16T18:29:13.307 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.308 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.308 DEBUG:boto:Params: {} 2024-04-16T18:29:13.308 DEBUG:boto:Token: None 2024-04-16T18:29:13.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ac6ba1c6eafc572-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.312 DEBUG:boto:b'cjqttm-52obj741000falseobj742024-04-16T18:27:48.327Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.312 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:29:13.312 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.312 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.312 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.313 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.313 DEBUG:boto:Method: GET 2024-04-16T18:29:13.313 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.313 DEBUG:boto:Data: 2024-04-16T18:29:13.313 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.313 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.313 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.313 DEBUG:boto:Params: {} 2024-04-16T18:29:13.313 DEBUG:boto:Token: None 2024-04-16T18:29:13.313 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.314 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8= 2024-04-16T18:29:13.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8=', 'Content-Length': '0'} 2024-04-16T18:29:13.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030effd2373e90c41-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.358 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.358 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.359 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.359 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.359 DEBUG:boto:Method: GET 2024-04-16T18:29:13.359 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.359 DEBUG:boto:Data: 2024-04-16T18:29:13.359 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.359 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.359 DEBUG:boto:Params: {} 2024-04-16T18:29:13.359 DEBUG:boto:Token: None 2024-04-16T18:29:13.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8= 2024-04-16T18:29:13.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8=', 'Content-Length': '0'} 2024-04-16T18:29:13.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b09e2f37fffeaec-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.362 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.362 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.362 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.363 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.363 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.363 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.363 DEBUG:boto:Data: 2024-04-16T18:29:13.363 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.363 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.363 DEBUG:boto:Params: {} 2024-04-16T18:29:13.363 DEBUG:boto:Token: None 2024-04-16T18:29:13.363 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+6rnjscLfLVCx5GQE5Yf+bi3CDo= 2024-04-16T18:29:13.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+6rnjscLfLVCx5GQE5Yf+bi3CDo=', 'Content-Length': '0'} 2024-04-16T18:29:13.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b01b866a7dc01c1d-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.366 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.366 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.366 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.366 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.366 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.366 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.366 DEBUG:boto:Data: 2024-04-16T18:29:13.366 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.366 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.366 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.367 DEBUG:boto:Params: {} 2024-04-16T18:29:13.367 DEBUG:boto:Token: None 2024-04-16T18:29:13.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+6rnjscLfLVCx5GQE5Yf+bi3CDo= 2024-04-16T18:29:13.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+6rnjscLfLVCx5GQE5Yf+bi3CDo=', 'Content-Length': '0'} 2024-04-16T18:29:13.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d0d8a4293ac08e2-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:29:13.369 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.369 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.369 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.369 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.370 DEBUG:boto:Method: GET 2024-04-16T18:29:13.370 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.370 DEBUG:boto:Data: 2024-04-16T18:29:13.370 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.370 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.370 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.370 DEBUG:boto:Params: {} 2024-04-16T18:29:13.370 DEBUG:boto:Token: None 2024-04-16T18:29:13.370 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8= 2024-04-16T18:29:13.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8=', 'Content-Length': '0'} 2024-04-16T18:29:13.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007edaf6b0b789ac87-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.414 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.414 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.415 DEBUG:boto:path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.415 DEBUG:boto:auth_path=/cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.415 DEBUG:boto:Method: GET 2024-04-16T18:29:13.415 DEBUG:boto:Path: /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.415 DEBUG:boto:Data: 2024-04-16T18:29:13.415 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.415 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.415 DEBUG:boto:Params: {} 2024-04-16T18:29:13.415 DEBUG:boto:Token: None 2024-04-16T18:29:13.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76?versionId=null 2024-04-16T18:29:13.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8= 2024-04-16T18:29:13.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LevO3G9BGjUG+q2UqyusdCjiEp8=', 'Content-Length': '0'} 2024-04-16T18:29:13.418 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026428297980df0d5-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.418 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.418 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.418 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.418 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.418 DEBUG:boto:Method: GET 2024-04-16T18:29:13.418 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.419 DEBUG:boto:Data: 2024-04-16T18:29:13.419 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.419 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.419 DEBUG:boto:Params: {} 2024-04-16T18:29:13.419 DEBUG:boto:Token: None 2024-04-16T18:29:13.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bec9012601ce434-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.422 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.422 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.422 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.423 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.423 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.423 DEBUG:boto:Method: GET 2024-04-16T18:29:13.423 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.423 DEBUG:boto:Data: 2024-04-16T18:29:13.423 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.423 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.423 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.423 DEBUG:boto:Params: {} 2024-04-16T18:29:13.423 DEBUG:boto:Token: None 2024-04-16T18:29:13.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.424 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.427 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af10135c5490aeff-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.427 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.427 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.427 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.428 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.428 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:29:13.428 DEBUG:boto:Data: 2024-04-16T18:29:13.428 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.428 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.428 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.428 DEBUG:boto:Params: {} 2024-04-16T18:29:13.428 DEBUG:boto:Token: None 2024-04-16T18:29:13.428 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76 2024-04-16T18:29:13.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ol4j2Jb0WwIQ5S1ypVQQWBJeReE= 2024-04-16T18:29:13.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ol4j2Jb0WwIQ5S1ypVQQWBJeReE=', 'Content-Length': '0'} 2024-04-16T18:29:13.430 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f008a478cead3e53-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.431 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.431 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.431 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.431 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:29:13.431 DEBUG:boto:Data: 2024-04-16T18:29:13.431 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.431 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.431 DEBUG:boto:Params: {} 2024-04-16T18:29:13.432 DEBUG:boto:Token: None 2024-04-16T18:29:13.432 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76 2024-04-16T18:29:13.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ol4j2Jb0WwIQ5S1ypVQQWBJeReE= 2024-04-16T18:29:13.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ol4j2Jb0WwIQ5S1ypVQQWBJeReE=', 'Content-Length': '0'} 2024-04-16T18:29:13.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dec13d31462f79c9-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.434 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:29:13.434 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.434 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.434 DEBUG:boto:Method: GET 2024-04-16T18:29:13.434 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:29:13.435 DEBUG:boto:Data: 2024-04-16T18:29:13.435 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.435 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.435 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.435 DEBUG:boto:Params: {} 2024-04-16T18:29:13.435 DEBUG:boto:Token: None 2024-04-16T18:29:13.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76 2024-04-16T18:29:13.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KFsLw5ZSlt7gZmhkT9iUIzUt1+8= 2024-04-16T18:29:13.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KFsLw5ZSlt7gZmhkT9iUIzUt1+8=', 'Content-Length': '0'} 2024-04-16T18:29:13.437 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035e96c4d07e56fda-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.478 DEBUG:boto:path=/cjqttm-52/obj76 2024-04-16T18:29:13.479 DEBUG:boto:auth_path=/cjqttm-52/obj76 2024-04-16T18:29:13.479 DEBUG:boto:Method: GET 2024-04-16T18:29:13.479 DEBUG:boto:Path: /cjqttm-52/obj76 2024-04-16T18:29:13.479 DEBUG:boto:Data: 2024-04-16T18:29:13.479 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.479 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.479 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.479 DEBUG:boto:Params: {} 2024-04-16T18:29:13.479 DEBUG:boto:Token: None 2024-04-16T18:29:13.480 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj76 2024-04-16T18:29:13.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KFsLw5ZSlt7gZmhkT9iUIzUt1+8= 2024-04-16T18:29:13.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KFsLw5ZSlt7gZmhkT9iUIzUt1+8=', 'Content-Length': '0'} 2024-04-16T18:29:13.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000776f35b86ea7441-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.482 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.482 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.482 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.482 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.482 DEBUG:boto:Method: GET 2024-04-16T18:29:13.483 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.483 DEBUG:boto:Data: 2024-04-16T18:29:13.483 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.483 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.483 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.483 DEBUG:boto:Params: {} 2024-04-16T18:29:13.483 DEBUG:boto:Token: None 2024-04-16T18:29:13.483 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.483 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.483 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.485 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098e828a1ffe90d36-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.526 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.527 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.527 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.527 DEBUG:boto:path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.527 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.527 DEBUG:boto:Method: GET 2024-04-16T18:29:13.527 DEBUG:boto:Path: /cjqttm-52/?prefix=obj76 2024-04-16T18:29:13.527 DEBUG:boto:Data: 2024-04-16T18:29:13.527 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.527 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.527 DEBUG:boto:Params: {} 2024-04-16T18:29:13.528 DEBUG:boto:Token: None 2024-04-16T18:29:13.528 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.531 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004dc434bc61b50a5a-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.532 DEBUG:boto:b'cjqttm-52obj761000falseobj762024-04-16T18:21:05.127Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.532 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:29:13.532 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.532 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.532 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.532 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.533 DEBUG:boto:Method: GET 2024-04-16T18:29:13.533 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.533 DEBUG:boto:Data: 2024-04-16T18:29:13.533 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.533 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.533 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.533 DEBUG:boto:Params: {} 2024-04-16T18:29:13.533 DEBUG:boto:Token: None 2024-04-16T18:29:13.533 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.533 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc= 2024-04-16T18:29:13.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc=', 'Content-Length': '0'} 2024-04-16T18:29:13.536 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002355c9d71d1604b-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.578 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.579 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.579 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.579 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.579 DEBUG:boto:Method: GET 2024-04-16T18:29:13.579 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.579 DEBUG:boto:Data: 2024-04-16T18:29:13.579 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.579 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.579 DEBUG:boto:Params: {} 2024-04-16T18:29:13.579 DEBUG:boto:Token: None 2024-04-16T18:29:13.580 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc= 2024-04-16T18:29:13.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc=', 'Content-Length': '0'} 2024-04-16T18:29:13.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000561015321b801553-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.582 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.582 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.582 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.582 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.582 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.582 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.582 DEBUG:boto:Data: 2024-04-16T18:29:13.582 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.582 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.583 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.583 DEBUG:boto:Params: {} 2024-04-16T18:29:13.583 DEBUG:boto:Token: None 2024-04-16T18:29:13.583 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJFaNfljgBmwSWE1NhDEIg6hLIg= 2024-04-16T18:29:13.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJFaNfljgBmwSWE1NhDEIg6hLIg=', 'Content-Length': '0'} 2024-04-16T18:29:13.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6702cb9a353a909-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.585 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.585 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.585 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.585 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.585 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.586 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.586 DEBUG:boto:Data: 2024-04-16T18:29:13.586 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.586 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.586 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.586 DEBUG:boto:Params: {} 2024-04-16T18:29:13.586 DEBUG:boto:Token: None 2024-04-16T18:29:13.586 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.586 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJFaNfljgBmwSWE1NhDEIg6hLIg= 2024-04-16T18:29:13.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJFaNfljgBmwSWE1NhDEIg6hLIg=', 'Content-Length': '0'} 2024-04-16T18:29:13.588 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007bee62114f1914ec-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.589 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:29:13.589 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.589 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.589 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.589 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.589 DEBUG:boto:Method: GET 2024-04-16T18:29:13.589 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.589 DEBUG:boto:Data: 2024-04-16T18:29:13.589 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.589 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.589 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.590 DEBUG:boto:Params: {} 2024-04-16T18:29:13.590 DEBUG:boto:Token: None 2024-04-16T18:29:13.590 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.590 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc= 2024-04-16T18:29:13.590 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc=', 'Content-Length': '0'} 2024-04-16T18:29:13.592 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e57a34765e2f49a0-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.634 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.634 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.635 DEBUG:boto:path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.635 DEBUG:boto:auth_path=/cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.635 DEBUG:boto:Method: GET 2024-04-16T18:29:13.635 DEBUG:boto:Path: /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.635 DEBUG:boto:Data: 2024-04-16T18:29:13.635 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.635 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.635 DEBUG:boto:Params: {} 2024-04-16T18:29:13.635 DEBUG:boto:Token: None 2024-04-16T18:29:13.635 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85?versionId=null 2024-04-16T18:29:13.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc= 2024-04-16T18:29:13.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BLw5KGTSyz0/RtUc/7NWiFy8fSc=', 'Content-Length': '0'} 2024-04-16T18:29:13.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1d101e53a6674f5-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.638 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.638 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.638 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.638 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.639 DEBUG:boto:Method: GET 2024-04-16T18:29:13.639 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.639 DEBUG:boto:Data: 2024-04-16T18:29:13.639 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.639 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.639 DEBUG:boto:Params: {} 2024-04-16T18:29:13.639 DEBUG:boto:Token: None 2024-04-16T18:29:13.639 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.642 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a1d2ed7db6a6ba6-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.682 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.683 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.683 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.683 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.683 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.683 DEBUG:boto:Method: GET 2024-04-16T18:29:13.683 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.683 DEBUG:boto:Data: 2024-04-16T18:29:13.683 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.683 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.683 DEBUG:boto:Params: {} 2024-04-16T18:29:13.684 DEBUG:boto:Token: None 2024-04-16T18:29:13.684 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.687 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003111d8dcd1227c83-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.687 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.687 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.688 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.688 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.688 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:29:13.688 DEBUG:boto:Data: 2024-04-16T18:29:13.688 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.688 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.688 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.688 DEBUG:boto:Params: {} 2024-04-16T18:29:13.688 DEBUG:boto:Token: None 2024-04-16T18:29:13.688 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85 2024-04-16T18:29:13.689 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RYTcsTz0ZOS+DIj7iWZUdboqU9g= 2024-04-16T18:29:13.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RYTcsTz0ZOS+DIj7iWZUdboqU9g=', 'Content-Length': '0'} 2024-04-16T18:29:13.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007451c698f84572c8-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.691 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.691 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.691 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.691 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:29:13.691 DEBUG:boto:Data: 2024-04-16T18:29:13.691 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.691 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.691 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.691 DEBUG:boto:Params: {} 2024-04-16T18:29:13.692 DEBUG:boto:Token: None 2024-04-16T18:29:13.692 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85 2024-04-16T18:29:13.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RYTcsTz0ZOS+DIj7iWZUdboqU9g= 2024-04-16T18:29:13.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RYTcsTz0ZOS+DIj7iWZUdboqU9g=', 'Content-Length': '0'} 2024-04-16T18:29:13.694 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c09062748c21692f-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.694 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:29:13.694 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.694 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.694 DEBUG:boto:Method: GET 2024-04-16T18:29:13.694 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:29:13.694 DEBUG:boto:Data: 2024-04-16T18:29:13.695 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.695 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.695 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.695 DEBUG:boto:Params: {} 2024-04-16T18:29:13.695 DEBUG:boto:Token: None 2024-04-16T18:29:13.695 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85 2024-04-16T18:29:13.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vlekzB/Vwg+8X5Vo67CSCn0vFK0= 2024-04-16T18:29:13.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vlekzB/Vwg+8X5Vo67CSCn0vFK0=', 'Content-Length': '0'} 2024-04-16T18:29:13.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf91811d7524d06d-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.738 DEBUG:boto:path=/cjqttm-52/obj85 2024-04-16T18:29:13.739 DEBUG:boto:auth_path=/cjqttm-52/obj85 2024-04-16T18:29:13.739 DEBUG:boto:Method: GET 2024-04-16T18:29:13.739 DEBUG:boto:Path: /cjqttm-52/obj85 2024-04-16T18:29:13.739 DEBUG:boto:Data: 2024-04-16T18:29:13.739 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.739 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.739 DEBUG:boto:Params: {} 2024-04-16T18:29:13.739 DEBUG:boto:Token: None 2024-04-16T18:29:13.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj85 2024-04-16T18:29:13.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vlekzB/Vwg+8X5Vo67CSCn0vFK0= 2024-04-16T18:29:13.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vlekzB/Vwg+8X5Vo67CSCn0vFK0=', 'Content-Length': '0'} 2024-04-16T18:29:13.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:20:07 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004556dd11fe3d6aec-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.742 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.742 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.742 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.742 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.742 DEBUG:boto:Method: GET 2024-04-16T18:29:13.742 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.742 DEBUG:boto:Data: 2024-04-16T18:29:13.742 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.742 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.743 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.743 DEBUG:boto:Params: {} 2024-04-16T18:29:13.743 DEBUG:boto:Token: None 2024-04-16T18:29:13.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc4063b7fda75d2f-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.786 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.787 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.787 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.787 DEBUG:boto:path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.787 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.787 DEBUG:boto:Method: GET 2024-04-16T18:29:13.787 DEBUG:boto:Path: /cjqttm-52/?prefix=obj85 2024-04-16T18:29:13.787 DEBUG:boto:Data: 2024-04-16T18:29:13.787 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.787 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.788 DEBUG:boto:Params: {} 2024-04-16T18:29:13.788 DEBUG:boto:Token: None 2024-04-16T18:29:13.788 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.792 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f7af78b663948f2-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.792 DEBUG:boto:b'cjqttm-52obj851000falseobj852024-04-16T18:20:07.513Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.792 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:29:13.792 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.792 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.793 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.793 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.793 DEBUG:boto:Method: GET 2024-04-16T18:29:13.793 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.793 DEBUG:boto:Data: 2024-04-16T18:29:13.793 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.793 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.793 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.793 DEBUG:boto:Params: {} 2024-04-16T18:29:13.793 DEBUG:boto:Token: None 2024-04-16T18:29:13.794 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.794 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI= 2024-04-16T18:29:13.794 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI=', 'Content-Length': '0'} 2024-04-16T18:29:13.796 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000709e85fbac6428f5-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.838 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.838 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.838 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.838 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.839 DEBUG:boto:Method: GET 2024-04-16T18:29:13.839 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.839 DEBUG:boto:Data: 2024-04-16T18:29:13.839 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.839 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.839 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.839 DEBUG:boto:Params: {} 2024-04-16T18:29:13.839 DEBUG:boto:Token: None 2024-04-16T18:29:13.839 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.840 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI= 2024-04-16T18:29:13.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI=', 'Content-Length': '0'} 2024-04-16T18:29:13.842 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062e6893d8edfd1f7-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.842 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.842 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.842 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.842 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.842 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.842 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.843 DEBUG:boto:Data: 2024-04-16T18:29:13.843 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.843 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.843 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.843 DEBUG:boto:Params: {} 2024-04-16T18:29:13.843 DEBUG:boto:Token: None 2024-04-16T18:29:13.843 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pjz9rE2Xgy0fkNuKbINRtDtLYmk= 2024-04-16T18:29:13.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pjz9rE2Xgy0fkNuKbINRtDtLYmk=', 'Content-Length': '0'} 2024-04-16T18:29:13.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b910cdec183e153c-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.845 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.846 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.846 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.846 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.846 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.846 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.846 DEBUG:boto:Data: 2024-04-16T18:29:13.846 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.846 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.846 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.847 DEBUG:boto:Params: {} 2024-04-16T18:29:13.847 DEBUG:boto:Token: None 2024-04-16T18:29:13.847 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pjz9rE2Xgy0fkNuKbINRtDtLYmk= 2024-04-16T18:29:13.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pjz9rE2Xgy0fkNuKbINRtDtLYmk=', 'Content-Length': '0'} 2024-04-16T18:29:13.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba9367d95cc31df0-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.849 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:29:13.849 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.849 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.849 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.850 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.850 DEBUG:boto:Method: GET 2024-04-16T18:29:13.850 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.850 DEBUG:boto:Data: 2024-04-16T18:29:13.850 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.850 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.850 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.850 DEBUG:boto:Params: {} 2024-04-16T18:29:13.850 DEBUG:boto:Token: None 2024-04-16T18:29:13.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI= 2024-04-16T18:29:13.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI=', 'Content-Length': '0'} 2024-04-16T18:29:13.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000005636c7b6f42e29-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.894 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.894 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.895 DEBUG:boto:path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.895 DEBUG:boto:auth_path=/cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.895 DEBUG:boto:Method: GET 2024-04-16T18:29:13.895 DEBUG:boto:Path: /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.895 DEBUG:boto:Data: 2024-04-16T18:29:13.895 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.895 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.895 DEBUG:boto:Params: {} 2024-04-16T18:29:13.895 DEBUG:boto:Token: None 2024-04-16T18:29:13.895 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87?versionId=null 2024-04-16T18:29:13.896 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI= 2024-04-16T18:29:13.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5oYjku5pOrvAwPr2c+uZwZxINmI=', 'Content-Length': '0'} 2024-04-16T18:29:13.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3451eb2d0b38fe1-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.898 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.898 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.898 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:13.899 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:13.899 DEBUG:boto:Method: GET 2024-04-16T18:29:13.899 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:29:13.899 DEBUG:boto:Data: 2024-04-16T18:29:13.899 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.899 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.899 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.899 DEBUG:boto:Params: {} 2024-04-16T18:29:13.899 DEBUG:boto:Token: None 2024-04-16T18:29:13.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.902 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e73f858ed9b84606-00661ec379-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.942 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.943 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:13.943 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:13.943 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:13.943 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:13.943 DEBUG:boto:Method: GET 2024-04-16T18:29:13.943 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:29:13.943 DEBUG:boto:Data: 2024-04-16T18:29:13.943 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.943 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.943 DEBUG:boto:Params: {} 2024-04-16T18:29:13.944 DEBUG:boto:Token: None 2024-04-16T18:29:13.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/ 2024-04-16T18:29:13.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE= 2024-04-16T18:29:13.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6HDgtTpDDKr4ata2wPOR+v0THGE=', 'Content-Length': '0'} 2024-04-16T18:29:13.947 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000070a17c3bb1421778-00661ec379-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.948 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:13.948 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.948 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.948 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.948 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:29:13.948 DEBUG:boto:Data: 2024-04-16T18:29:13.948 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.948 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.948 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.948 DEBUG:boto:Params: {} 2024-04-16T18:29:13.949 DEBUG:boto:Token: None 2024-04-16T18:29:13.949 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87 2024-04-16T18:29:13.949 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:guKYyS4sUVRS8DNLc8SO/8BXA2E= 2024-04-16T18:29:13.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:guKYyS4sUVRS8DNLc8SO/8BXA2E=', 'Content-Length': '0'} 2024-04-16T18:29:13.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db73901692269b97-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.951 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.951 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.951 DEBUG:boto:Method: HEAD 2024-04-16T18:29:13.951 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:29:13.951 DEBUG:boto:Data: 2024-04-16T18:29:13.952 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.952 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.952 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.952 DEBUG:boto:Params: {} 2024-04-16T18:29:13.952 DEBUG:boto:Token: None 2024-04-16T18:29:13.952 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87 2024-04-16T18:29:13.952 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:guKYyS4sUVRS8DNLc8SO/8BXA2E= 2024-04-16T18:29:13.952 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:guKYyS4sUVRS8DNLc8SO/8BXA2E=', 'Content-Length': '0'} 2024-04-16T18:29:13.954 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f57fc7f0da43ec9e-00661ec379-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.954 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:29:13.954 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.955 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.955 DEBUG:boto:Method: GET 2024-04-16T18:29:13.955 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:29:13.955 DEBUG:boto:Data: 2024-04-16T18:29:13.955 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.955 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:13.955 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.955 DEBUG:boto:Params: {} 2024-04-16T18:29:13.955 DEBUG:boto:Token: None 2024-04-16T18:29:13.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87 2024-04-16T18:29:13.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S0vgu2JdHRSaQRkS+d8MS/qYe88= 2024-04-16T18:29:13.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S0vgu2JdHRSaQRkS+d8MS/qYe88=', 'Content-Length': '0'} 2024-04-16T18:29:13.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4e51793054bd03b-00661ec379-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:13.998 DEBUG:boto:path=/cjqttm-52/obj87 2024-04-16T18:29:13.999 DEBUG:boto:auth_path=/cjqttm-52/obj87 2024-04-16T18:29:13.999 DEBUG:boto:Method: GET 2024-04-16T18:29:13.999 DEBUG:boto:Path: /cjqttm-52/obj87 2024-04-16T18:29:13.999 DEBUG:boto:Data: 2024-04-16T18:29:13.999 DEBUG:boto:Headers: {} 2024-04-16T18:29:13.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:13.999 DEBUG:boto:Port: 8000 2024-04-16T18:29:13.999 DEBUG:boto:Params: {} 2024-04-16T18:29:13.999 DEBUG:boto:Token: None 2024-04-16T18:29:13.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:13 GMT /cjqttm-52/obj87 2024-04-16T18:29:14.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S0vgu2JdHRSaQRkS+d8MS/qYe88= 2024-04-16T18:29:14.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S0vgu2JdHRSaQRkS+d8MS/qYe88=', 'Content-Length': '0'} 2024-04-16T18:29:14.002 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:24:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081c0030dc3131b08-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.002 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.002 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.002 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:14.002 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:14.002 DEBUG:boto:Method: GET 2024-04-16T18:29:14.002 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:29:14.002 DEBUG:boto:Data: 2024-04-16T18:29:14.003 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.003 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.003 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.003 DEBUG:boto:Params: {} 2024-04-16T18:29:14.003 DEBUG:boto:Token: None 2024-04-16T18:29:14.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.006 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d9a2b7ad2d2df58-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.046 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.047 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.047 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.047 DEBUG:boto:path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:14.047 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj87 2024-04-16T18:29:14.047 DEBUG:boto:Method: GET 2024-04-16T18:29:14.047 DEBUG:boto:Path: /cjqttm-52/?prefix=obj87 2024-04-16T18:29:14.047 DEBUG:boto:Data: 2024-04-16T18:29:14.047 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.047 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.048 DEBUG:boto:Params: {} 2024-04-16T18:29:14.048 DEBUG:boto:Token: None 2024-04-16T18:29:14.048 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.052 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081017e728e257477-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.052 DEBUG:boto:b'cjqttm-52obj871000falseobj872024-04-16T18:24:09.506Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.052 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:29:14.052 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.052 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.053 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.053 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.053 DEBUG:boto:Method: GET 2024-04-16T18:29:14.053 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.053 DEBUG:boto:Data: 2024-04-16T18:29:14.053 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.053 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.053 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.053 DEBUG:boto:Params: {} 2024-04-16T18:29:14.053 DEBUG:boto:Token: None 2024-04-16T18:29:14.053 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.054 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg= 2024-04-16T18:29:14.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg=', 'Content-Length': '0'} 2024-04-16T18:29:14.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f61e1a788c64f88-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.098 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.098 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.099 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.099 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.099 DEBUG:boto:Method: GET 2024-04-16T18:29:14.099 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.099 DEBUG:boto:Data: 2024-04-16T18:29:14.099 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.099 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.099 DEBUG:boto:Params: {} 2024-04-16T18:29:14.099 DEBUG:boto:Token: None 2024-04-16T18:29:14.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg= 2024-04-16T18:29:14.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg=', 'Content-Length': '0'} 2024-04-16T18:29:14.102 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002bb7c193ab2eead-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.102 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.102 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.102 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.102 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.102 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.103 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.103 DEBUG:boto:Data: 2024-04-16T18:29:14.103 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.103 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.103 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.103 DEBUG:boto:Params: {} 2024-04-16T18:29:14.103 DEBUG:boto:Token: None 2024-04-16T18:29:14.103 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m9A0R8jsrXPupJ5tr8qLRAgUePQ= 2024-04-16T18:29:14.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m9A0R8jsrXPupJ5tr8qLRAgUePQ=', 'Content-Length': '0'} 2024-04-16T18:29:14.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb5eb06f1dabe2b5-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.106 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.106 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.106 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.106 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.106 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.106 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.106 DEBUG:boto:Data: 2024-04-16T18:29:14.106 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.107 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.107 DEBUG:boto:Params: {} 2024-04-16T18:29:14.107 DEBUG:boto:Token: None 2024-04-16T18:29:14.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:m9A0R8jsrXPupJ5tr8qLRAgUePQ= 2024-04-16T18:29:14.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:m9A0R8jsrXPupJ5tr8qLRAgUePQ=', 'Content-Length': '0'} 2024-04-16T18:29:14.109 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae3473a7325aa326-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.109 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:29:14.109 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.110 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.110 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.110 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.110 DEBUG:boto:Method: GET 2024-04-16T18:29:14.110 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.110 DEBUG:boto:Data: 2024-04-16T18:29:14.110 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.110 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.110 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.110 DEBUG:boto:Params: {} 2024-04-16T18:29:14.111 DEBUG:boto:Token: None 2024-04-16T18:29:14.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg= 2024-04-16T18:29:14.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg=', 'Content-Length': '0'} 2024-04-16T18:29:14.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da2f375e3afecd1b-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.154 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.154 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.155 DEBUG:boto:path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.155 DEBUG:boto:auth_path=/cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.155 DEBUG:boto:Method: GET 2024-04-16T18:29:14.155 DEBUG:boto:Path: /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.155 DEBUG:boto:Data: 2024-04-16T18:29:14.155 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.155 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.155 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.155 DEBUG:boto:Params: {} 2024-04-16T18:29:14.155 DEBUG:boto:Token: None 2024-04-16T18:29:14.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92?versionId=null 2024-04-16T18:29:14.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg= 2024-04-16T18:29:14.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrF7beM75eFskHeBspOtbvZ9Grg=', 'Content-Length': '0'} 2024-04-16T18:29:14.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da3120e8b60e2ea6-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.158 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.158 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.158 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.158 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.158 DEBUG:boto:Method: GET 2024-04-16T18:29:14.159 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.159 DEBUG:boto:Data: 2024-04-16T18:29:14.159 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.159 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.159 DEBUG:boto:Params: {} 2024-04-16T18:29:14.159 DEBUG:boto:Token: None 2024-04-16T18:29:14.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bc203f8fe1dbddc8-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.202 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.203 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.203 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.203 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.203 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.203 DEBUG:boto:Method: GET 2024-04-16T18:29:14.203 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.203 DEBUG:boto:Data: 2024-04-16T18:29:14.203 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.203 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.203 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.204 DEBUG:boto:Params: {} 2024-04-16T18:29:14.204 DEBUG:boto:Token: None 2024-04-16T18:29:14.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.207 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f907b100ebd07edd-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.207 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.208 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.208 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.208 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.208 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:29:14.208 DEBUG:boto:Data: 2024-04-16T18:29:14.208 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.208 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.208 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.208 DEBUG:boto:Params: {} 2024-04-16T18:29:14.209 DEBUG:boto:Token: None 2024-04-16T18:29:14.209 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92 2024-04-16T18:29:14.209 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ci2oMoDlOSy+w5RJKyXa8DsoShs= 2024-04-16T18:29:14.209 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ci2oMoDlOSy+w5RJKyXa8DsoShs=', 'Content-Length': '0'} 2024-04-16T18:29:14.211 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008265a97d3720466d-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.211 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.211 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.212 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.212 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:29:14.212 DEBUG:boto:Data: 2024-04-16T18:29:14.212 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.212 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.212 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.212 DEBUG:boto:Params: {} 2024-04-16T18:29:14.212 DEBUG:boto:Token: None 2024-04-16T18:29:14.212 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92 2024-04-16T18:29:14.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ci2oMoDlOSy+w5RJKyXa8DsoShs= 2024-04-16T18:29:14.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ci2oMoDlOSy+w5RJKyXa8DsoShs=', 'Content-Length': '0'} 2024-04-16T18:29:14.214 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd50958a75d4ef81-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.215 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:29:14.215 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.215 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.215 DEBUG:boto:Method: GET 2024-04-16T18:29:14.215 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:29:14.215 DEBUG:boto:Data: 2024-04-16T18:29:14.215 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.215 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.216 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.216 DEBUG:boto:Params: {} 2024-04-16T18:29:14.216 DEBUG:boto:Token: None 2024-04-16T18:29:14.216 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92 2024-04-16T18:29:14.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:unp4lPboFyxajDF+rIQqa/FyL5Y= 2024-04-16T18:29:14.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:unp4lPboFyxajDF+rIQqa/FyL5Y=', 'Content-Length': '0'} 2024-04-16T18:29:14.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a4dbc3ee1cd03d7-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.258 DEBUG:boto:path=/cjqttm-52/obj92 2024-04-16T18:29:14.259 DEBUG:boto:auth_path=/cjqttm-52/obj92 2024-04-16T18:29:14.259 DEBUG:boto:Method: GET 2024-04-16T18:29:14.259 DEBUG:boto:Path: /cjqttm-52/obj92 2024-04-16T18:29:14.259 DEBUG:boto:Data: 2024-04-16T18:29:14.259 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.259 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.259 DEBUG:boto:Params: {} 2024-04-16T18:29:14.259 DEBUG:boto:Token: None 2024-04-16T18:29:14.259 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj92 2024-04-16T18:29:14.259 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:unp4lPboFyxajDF+rIQqa/FyL5Y= 2024-04-16T18:29:14.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:unp4lPboFyxajDF+rIQqa/FyL5Y=', 'Content-Length': '0'} 2024-04-16T18:29:14.261 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:49 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e5ea91097e53e5-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.262 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.262 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.262 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.262 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.262 DEBUG:boto:Method: GET 2024-04-16T18:29:14.262 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.262 DEBUG:boto:Data: 2024-04-16T18:29:14.262 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.262 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.263 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.263 DEBUG:boto:Params: {} 2024-04-16T18:29:14.263 DEBUG:boto:Token: None 2024-04-16T18:29:14.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.265 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000017380d0de4e24983-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.306 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.307 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.307 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.307 DEBUG:boto:path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.307 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.307 DEBUG:boto:Method: GET 2024-04-16T18:29:14.307 DEBUG:boto:Path: /cjqttm-52/?prefix=obj92 2024-04-16T18:29:14.307 DEBUG:boto:Data: 2024-04-16T18:29:14.307 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.307 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.308 DEBUG:boto:Params: {} 2024-04-16T18:29:14.308 DEBUG:boto:Token: None 2024-04-16T18:29:14.308 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.311 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008ee5c5c4e2a15810-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.312 DEBUG:boto:b'cjqttm-52obj921000falseobj922024-04-16T18:21:49.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.312 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:29:14.312 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.312 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.312 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.312 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.313 DEBUG:boto:Method: GET 2024-04-16T18:29:14.313 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.313 DEBUG:boto:Data: 2024-04-16T18:29:14.313 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.313 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.313 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.313 DEBUG:boto:Params: {} 2024-04-16T18:29:14.313 DEBUG:boto:Token: None 2024-04-16T18:29:14.313 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.313 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q= 2024-04-16T18:29:14.314 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q=', 'Content-Length': '0'} 2024-04-16T18:29:14.315 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d7d1d820c45b5b7-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.358 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.358 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.359 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.359 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.359 DEBUG:boto:Method: GET 2024-04-16T18:29:14.359 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.359 DEBUG:boto:Data: 2024-04-16T18:29:14.359 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.359 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.359 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.359 DEBUG:boto:Params: {} 2024-04-16T18:29:14.359 DEBUG:boto:Token: None 2024-04-16T18:29:14.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q= 2024-04-16T18:29:14.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q=', 'Content-Length': '0'} 2024-04-16T18:29:14.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018e303b55c854e24-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.362 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.362 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.362 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.362 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.362 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.362 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.363 DEBUG:boto:Data: 2024-04-16T18:29:14.363 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.363 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.363 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.363 DEBUG:boto:Params: {} 2024-04-16T18:29:14.363 DEBUG:boto:Token: None 2024-04-16T18:29:14.363 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2q5KB0QmTNwsXsFSETLAA7qIHLQ= 2024-04-16T18:29:14.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2q5KB0QmTNwsXsFSETLAA7qIHLQ=', 'Content-Length': '0'} 2024-04-16T18:29:14.365 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b2f18ea555f8d98-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.366 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.366 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.366 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.366 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.366 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.366 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.366 DEBUG:boto:Data: 2024-04-16T18:29:14.366 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.366 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.367 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.367 DEBUG:boto:Params: {} 2024-04-16T18:29:14.367 DEBUG:boto:Token: None 2024-04-16T18:29:14.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2q5KB0QmTNwsXsFSETLAA7qIHLQ= 2024-04-16T18:29:14.367 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2q5KB0QmTNwsXsFSETLAA7qIHLQ=', 'Content-Length': '0'} 2024-04-16T18:29:14.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004646d3040e7559d6-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.369 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:29:14.369 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.369 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.369 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.369 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.369 DEBUG:boto:Method: GET 2024-04-16T18:29:14.369 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.370 DEBUG:boto:Data: 2024-04-16T18:29:14.370 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.370 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.370 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.370 DEBUG:boto:Params: {} 2024-04-16T18:29:14.370 DEBUG:boto:Token: None 2024-04-16T18:29:14.370 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.370 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q= 2024-04-16T18:29:14.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q=', 'Content-Length': '0'} 2024-04-16T18:29:14.372 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d04d63aa506274f0-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.414 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.414 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.415 DEBUG:boto:path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.415 DEBUG:boto:auth_path=/cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.415 DEBUG:boto:Method: GET 2024-04-16T18:29:14.415 DEBUG:boto:Path: /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.415 DEBUG:boto:Data: 2024-04-16T18:29:14.415 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.415 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.415 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.415 DEBUG:boto:Params: {} 2024-04-16T18:29:14.415 DEBUG:boto:Token: None 2024-04-16T18:29:14.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93?versionId=null 2024-04-16T18:29:14.416 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q= 2024-04-16T18:29:14.416 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6tRSlH0SLHdqAdZUBZmhWOcA60Q=', 'Content-Length': '0'} 2024-04-16T18:29:14.418 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fba439e7c720982-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.418 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.418 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.418 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.418 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.418 DEBUG:boto:Method: GET 2024-04-16T18:29:14.419 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.419 DEBUG:boto:Data: 2024-04-16T18:29:14.419 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.419 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.419 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.419 DEBUG:boto:Params: {} 2024-04-16T18:29:14.419 DEBUG:boto:Token: None 2024-04-16T18:29:14.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.422 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000777f1ed017851af0-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.462 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.463 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.463 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.463 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.463 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.463 DEBUG:boto:Method: GET 2024-04-16T18:29:14.463 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.463 DEBUG:boto:Data: 2024-04-16T18:29:14.463 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.463 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.464 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.464 DEBUG:boto:Params: {} 2024-04-16T18:29:14.464 DEBUG:boto:Token: None 2024-04-16T18:29:14.464 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.464 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.467 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b2d2123f3036b1e-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.467 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.468 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.468 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.468 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.468 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:29:14.468 DEBUG:boto:Data: 2024-04-16T18:29:14.468 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.468 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.468 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.468 DEBUG:boto:Params: {} 2024-04-16T18:29:14.468 DEBUG:boto:Token: None 2024-04-16T18:29:14.469 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93 2024-04-16T18:29:14.469 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S0UaPymr+ioNqF/MF9f5H8ifETQ= 2024-04-16T18:29:14.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S0UaPymr+ioNqF/MF9f5H8ifETQ=', 'Content-Length': '0'} 2024-04-16T18:29:14.471 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000059d0eab7de8477b-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.471 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.471 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.471 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.471 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:29:14.471 DEBUG:boto:Data: 2024-04-16T18:29:14.472 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.472 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.472 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.472 DEBUG:boto:Params: {} 2024-04-16T18:29:14.472 DEBUG:boto:Token: None 2024-04-16T18:29:14.472 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93 2024-04-16T18:29:14.472 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:S0UaPymr+ioNqF/MF9f5H8ifETQ= 2024-04-16T18:29:14.472 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:S0UaPymr+ioNqF/MF9f5H8ifETQ=', 'Content-Length': '0'} 2024-04-16T18:29:14.474 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b818bbb7df383536-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.474 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:29:14.474 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.474 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.474 DEBUG:boto:Method: GET 2024-04-16T18:29:14.474 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:29:14.475 DEBUG:boto:Data: 2024-04-16T18:29:14.475 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.475 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.475 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.475 DEBUG:boto:Params: {} 2024-04-16T18:29:14.475 DEBUG:boto:Token: None 2024-04-16T18:29:14.475 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93 2024-04-16T18:29:14.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BoBmDhs2pu5Pox8o8X+ZzUGWpHg= 2024-04-16T18:29:14.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BoBmDhs2pu5Pox8o8X+ZzUGWpHg=', 'Content-Length': '0'} 2024-04-16T18:29:14.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000acdb67adbd7c7f25-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.518 DEBUG:boto:path=/cjqttm-52/obj93 2024-04-16T18:29:14.519 DEBUG:boto:auth_path=/cjqttm-52/obj93 2024-04-16T18:29:14.519 DEBUG:boto:Method: GET 2024-04-16T18:29:14.519 DEBUG:boto:Path: /cjqttm-52/obj93 2024-04-16T18:29:14.519 DEBUG:boto:Data: 2024-04-16T18:29:14.519 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.519 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.519 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.519 DEBUG:boto:Params: {} 2024-04-16T18:29:14.519 DEBUG:boto:Token: None 2024-04-16T18:29:14.519 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj93 2024-04-16T18:29:14.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BoBmDhs2pu5Pox8o8X+ZzUGWpHg= 2024-04-16T18:29:14.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BoBmDhs2pu5Pox8o8X+ZzUGWpHg=', 'Content-Length': '0'} 2024-04-16T18:29:14.522 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:26:26 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a99d7c891e42d5c5-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.522 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.522 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.522 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.522 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.522 DEBUG:boto:Method: GET 2024-04-16T18:29:14.522 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.522 DEBUG:boto:Data: 2024-04-16T18:29:14.523 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.523 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.523 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.523 DEBUG:boto:Params: {} 2024-04-16T18:29:14.523 DEBUG:boto:Token: None 2024-04-16T18:29:14.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.523 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.526 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c43db4944d512ec-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.566 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.567 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.567 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.567 DEBUG:boto:path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.567 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.567 DEBUG:boto:Method: GET 2024-04-16T18:29:14.567 DEBUG:boto:Path: /cjqttm-52/?prefix=obj93 2024-04-16T18:29:14.567 DEBUG:boto:Data: 2024-04-16T18:29:14.567 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.567 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.568 DEBUG:boto:Params: {} 2024-04-16T18:29:14.568 DEBUG:boto:Token: None 2024-04-16T18:29:14.568 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.572 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cbd1473781f35e18-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.572 DEBUG:boto:b'cjqttm-52obj931000falseobj932024-04-16T18:26:26.383Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:29:14.572 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.572 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.573 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.573 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.573 DEBUG:boto:Method: GET 2024-04-16T18:29:14.573 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.573 DEBUG:boto:Data: 2024-04-16T18:29:14.573 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.573 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.573 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.573 DEBUG:boto:Params: {} 2024-04-16T18:29:14.573 DEBUG:boto:Token: None 2024-04-16T18:29:14.574 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.574 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc= 2024-04-16T18:29:14.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc=', 'Content-Length': '0'} 2024-04-16T18:29:14.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcc2fac816b48a64-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.618 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.618 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.619 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.619 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.619 DEBUG:boto:Method: GET 2024-04-16T18:29:14.619 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.619 DEBUG:boto:Data: 2024-04-16T18:29:14.619 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.619 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.619 DEBUG:boto:Params: {} 2024-04-16T18:29:14.619 DEBUG:boto:Token: None 2024-04-16T18:29:14.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc= 2024-04-16T18:29:14.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc=', 'Content-Length': '0'} 2024-04-16T18:29:14.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006aa8b54fa98dcd20-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.622 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.622 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.622 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.623 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.623 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.623 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.623 DEBUG:boto:Data: 2024-04-16T18:29:14.623 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.623 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.623 DEBUG:boto:Params: {} 2024-04-16T18:29:14.623 DEBUG:boto:Token: None 2024-04-16T18:29:14.623 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fMKfAbQnlycfTpGZTd5qVnmW3RM= 2024-04-16T18:29:14.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fMKfAbQnlycfTpGZTd5qVnmW3RM=', 'Content-Length': '0'} 2024-04-16T18:29:14.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000911c83338963a7c6-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.626 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.626 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.626 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.627 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.627 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.627 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.627 DEBUG:boto:Data: 2024-04-16T18:29:14.627 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.627 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.627 DEBUG:boto:Params: {} 2024-04-16T18:29:14.627 DEBUG:boto:Token: None 2024-04-16T18:29:14.627 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.627 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fMKfAbQnlycfTpGZTd5qVnmW3RM= 2024-04-16T18:29:14.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fMKfAbQnlycfTpGZTd5qVnmW3RM=', 'Content-Length': '0'} 2024-04-16T18:29:14.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b7b2b9898ea537a-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.630 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:29:14.630 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.630 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.630 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.631 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.631 DEBUG:boto:Method: GET 2024-04-16T18:29:14.631 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.631 DEBUG:boto:Data: 2024-04-16T18:29:14.631 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.631 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.631 DEBUG:boto:Params: {} 2024-04-16T18:29:14.631 DEBUG:boto:Token: None 2024-04-16T18:29:14.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc= 2024-04-16T18:29:14.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc=', 'Content-Length': '0'} 2024-04-16T18:29:14.634 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ce3e64a98b96260-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.674 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.675 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.675 DEBUG:boto:path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.675 DEBUG:boto:auth_path=/cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.675 DEBUG:boto:Method: GET 2024-04-16T18:29:14.675 DEBUG:boto:Path: /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.675 DEBUG:boto:Data: 2024-04-16T18:29:14.675 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.675 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.675 DEBUG:boto:Params: {} 2024-04-16T18:29:14.676 DEBUG:boto:Token: None 2024-04-16T18:29:14.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95?versionId=null 2024-04-16T18:29:14.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc= 2024-04-16T18:29:14.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gSDA/kfdfOopg0/uzFVrlMHBKVc=', 'Content-Length': '0'} 2024-04-16T18:29:14.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063d51913676fa722-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.678 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.679 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.679 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.679 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.679 DEBUG:boto:Method: GET 2024-04-16T18:29:14.679 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.679 DEBUG:boto:Data: 2024-04-16T18:29:14.679 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.679 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.679 DEBUG:boto:Params: {} 2024-04-16T18:29:14.680 DEBUG:boto:Token: None 2024-04-16T18:29:14.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de2db8649e967095-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.722 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.723 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.723 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.723 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.723 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.723 DEBUG:boto:Method: GET 2024-04-16T18:29:14.723 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.723 DEBUG:boto:Data: 2024-04-16T18:29:14.723 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.723 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.724 DEBUG:boto:Params: {} 2024-04-16T18:29:14.724 DEBUG:boto:Token: None 2024-04-16T18:29:14.724 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.728 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9a77139f95ac819-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.728 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.728 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.728 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.728 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.728 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:29:14.728 DEBUG:boto:Data: 2024-04-16T18:29:14.729 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.729 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.729 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.729 DEBUG:boto:Params: {} 2024-04-16T18:29:14.729 DEBUG:boto:Token: None 2024-04-16T18:29:14.729 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95 2024-04-16T18:29:14.729 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L4Tjh2Fp/WEGP62oSz9gbnszhU8= 2024-04-16T18:29:14.729 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L4Tjh2Fp/WEGP62oSz9gbnszhU8=', 'Content-Length': '0'} 2024-04-16T18:29:14.731 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eac6e778a5f55549-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.732 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.732 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.732 DEBUG:boto:Method: HEAD 2024-04-16T18:29:14.732 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:29:14.732 DEBUG:boto:Data: 2024-04-16T18:29:14.732 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.732 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.732 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.732 DEBUG:boto:Params: {} 2024-04-16T18:29:14.732 DEBUG:boto:Token: None 2024-04-16T18:29:14.733 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95 2024-04-16T18:29:14.733 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L4Tjh2Fp/WEGP62oSz9gbnszhU8= 2024-04-16T18:29:14.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L4Tjh2Fp/WEGP62oSz9gbnszhU8=', 'Content-Length': '0'} 2024-04-16T18:29:14.734 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001533ea7631fcc127-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.735 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:29:14.735 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.735 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.735 DEBUG:boto:Method: GET 2024-04-16T18:29:14.735 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:29:14.735 DEBUG:boto:Data: 2024-04-16T18:29:14.735 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.735 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.735 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.735 DEBUG:boto:Params: {} 2024-04-16T18:29:14.736 DEBUG:boto:Token: None 2024-04-16T18:29:14.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95 2024-04-16T18:29:14.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o9gCJKJFIkLZYH9dEW+DMFudfbE= 2024-04-16T18:29:14.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o9gCJKJFIkLZYH9dEW+DMFudfbE=', 'Content-Length': '0'} 2024-04-16T18:29:14.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-52:9ba59572-f51c-4bce-9578-e6350e822996.4816.21'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:29:05 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb00c27e11c21323-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.782 DEBUG:boto:path=/cjqttm-52/obj95 2024-04-16T18:29:14.783 DEBUG:boto:auth_path=/cjqttm-52/obj95 2024-04-16T18:29:14.783 DEBUG:boto:Method: GET 2024-04-16T18:29:14.783 DEBUG:boto:Path: /cjqttm-52/obj95 2024-04-16T18:29:14.783 DEBUG:boto:Data: 2024-04-16T18:29:14.783 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.783 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.783 DEBUG:boto:Params: {} 2024-04-16T18:29:14.783 DEBUG:boto:Token: None 2024-04-16T18:29:14.784 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/obj95 2024-04-16T18:29:14.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o9gCJKJFIkLZYH9dEW+DMFudfbE= 2024-04-16T18:29:14.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o9gCJKJFIkLZYH9dEW+DMFudfbE=', 'Content-Length': '0'} 2024-04-16T18:29:14.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:21:05 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e33c29b578c8623-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.786 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.786 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.786 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.787 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.787 DEBUG:boto:Method: GET 2024-04-16T18:29:14.787 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.787 DEBUG:boto:Data: 2024-04-16T18:29:14.787 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:29:14.787 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.787 DEBUG:boto:Params: {} 2024-04-16T18:29:14.787 DEBUG:boto:Token: None 2024-04-16T18:29:14.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.790 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001a6631abecf5bc72-00661ec37a-6094-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.830 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.831 DEBUG:boto:path=/cjqttm-52/ 2024-04-16T18:29:14.831 DEBUG:boto:auth_path=/cjqttm-52/ 2024-04-16T18:29:14.831 DEBUG:boto:path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.831 DEBUG:boto:auth_path=/cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.831 DEBUG:boto:Method: GET 2024-04-16T18:29:14.831 DEBUG:boto:Path: /cjqttm-52/?prefix=obj95 2024-04-16T18:29:14.831 DEBUG:boto:Data: 2024-04-16T18:29:14.831 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.831 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.832 DEBUG:boto:Params: {} 2024-04-16T18:29:14.832 DEBUG:boto:Token: None 2024-04-16T18:29:14.832 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-52/ 2024-04-16T18:29:14.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU= 2024-04-16T18:29:14.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GCX27xhx43yz0ISaWyOPgcmRhtU=', 'Content-Length': '0'} 2024-04-16T18:29:14.835 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dc058c0870464621-00661ec37a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.835 DEBUG:boto:b'cjqttm-52obj951000falseobj952024-04-16T18:21:05.137Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:29:14.835 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-52 zones={test-zone2, test-zone1} 2024-04-16T18:29:14.836 INFO:tasks.rgw_multisite_tests:Create several generations of objects, trash them, then run bucket sync init ... ok 2024-04-16T18:29:14.841 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:29:14.841 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:29:14.842 DEBUG:boto:Method: PUT 2024-04-16T18:29:14.842 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:29:14.842 DEBUG:boto:Data: 2024-04-16T18:29:14.842 DEBUG:boto:Headers: {} 2024-04-16T18:29:14.842 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:29:14.842 DEBUG:boto:Port: 8000 2024-04-16T18:29:14.842 DEBUG:boto:Params: {} 2024-04-16T18:29:14.842 DEBUG:boto:Token: None 2024-04-16T18:29:14.842 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:29:14 GMT /cjqttm-53/ 2024-04-16T18:29:14.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qH/tDVbtpmxDIebMSBe/UqyPz/A= 2024-04-16T18:29:14.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:29:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qH/tDVbtpmxDIebMSBe/UqyPz/A=', 'Content-Length': '0'} 2024-04-16T18:29:14.863 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f9efeaae8474f472-00661ec37a-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:29:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:29:14.863 DEBUG:rgw_multi.tests:created bucket=cjqttm-53 2024-04-16T18:29:14.864 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:14.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:14.864 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:14.916 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:14.917 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:14.972 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:29:14.995 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713292154.862025_1377.1","last_update":"2024-04-16T18:29:14.862025Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:29:14.996 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:14.996 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:29:14.996 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:14.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:14.996 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:15.051 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:15.051 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:15.106 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:15.108+0000 7f9b6362f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:15.108 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:15.109+0000 7f9b6362f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:15.132 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:15Z"} 2024-04-16T18:29:15.132 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:15Z"} 2024-04-16T18:29:15.132 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:15.132 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:15.132 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:15.132 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:20.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:20.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:20.134 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:20.189 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:20.189 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:20.245 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:20.246+0000 7f9431f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:20.246 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:20.248+0000 7f9431f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:20.270 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:20Z"} 2024-04-16T18:29:20.270 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:20Z"} 2024-04-16T18:29:20.270 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:20.270 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:20.270 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:20.270 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:25.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:25.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:25.272 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:25.326 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:25.326 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:25.381 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:25.382+0000 7f242be9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:25.382 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:25.383+0000 7f242be9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:25.406 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:25Z"} 2024-04-16T18:29:25.406 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:25Z"} 2024-04-16T18:29:25.406 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:25.406 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:25.407 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:25.407 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:30.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:30.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:30.408 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:30.463 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:30.463 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:30.517 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:30.518+0000 7f49a5213800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:30.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:30.519+0000 7f49a5213800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:30.541 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:30Z"} 2024-04-16T18:29:30.541 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:30Z"} 2024-04-16T18:29:30.541 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:30.542 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:30.542 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:30.542 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:35.543 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:35.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:35.543 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:35.598 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:35.598 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:35.653 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:35.654+0000 7fd0c372d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:35.654 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:35.655+0000 7fd0c372d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:35.679 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:35Z"} 2024-04-16T18:29:35.679 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:35Z"} 2024-04-16T18:29:35.679 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:35.679 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:35.680 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:35.680 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:40.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:40.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:40.681 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:40.736 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:40.736 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:40.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:40.792+0000 7ff191b31800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:40.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:40.793+0000 7ff191b31800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:40.815 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:40Z"} 2024-04-16T18:29:40.815 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:40Z"} 2024-04-16T18:29:40.816 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:40.816 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:40.816 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:40.816 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:45.817 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:45.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:45.817 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:45.873 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:45.873 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:45.929 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:45.929+0000 7f84cc92d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:45.930 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:45.931+0000 7f84cc92d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:45.953 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:45Z"} 2024-04-16T18:29:45.953 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:45Z"} 2024-04-16T18:29:45.953 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:45.953 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:45.953 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:45.953 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:50.955 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:50.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:50.955 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:51.011 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:51.066 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:51.066+0000 7fbbf7d2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:51.067 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:51.068+0000 7fbbf7d2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:51.091 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:51Z"} 2024-04-16T18:29:51.091 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:51Z"} 2024-04-16T18:29:51.091 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:51.092 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:51.092 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:51.092 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:29:56.093 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:56.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:29:56.093 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:29:56.158 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:29:56.158 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:29:56.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:56.213+0000 7f9bd0a16800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:56.213 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:29:56.214+0000 7f9bd0a16800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:29:56.236 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:56Z"} 2024-04-16T18:29:56.236 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:29:56Z"} 2024-04-16T18:29:56.236 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:29:56.236 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:56.236 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:29:56.237 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:30:01.238 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:01.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:01.238 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:01.294 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:01.295 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:01.348 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:01.350+0000 7f71d3044800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:01.349 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:01.351+0000 7f71d3044800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:01.373 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:01Z"} 2024-04-16T18:30:01.373 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:01Z"} 2024-04-16T18:30:01.373 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:01.373 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:01.373 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:01.373 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:30:06.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:06.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:06.375 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:06.430 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:06.430 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:06.485 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:06.487+0000 7f6c41ae4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:06.487 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:06.488+0000 7f6c41ae4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:06.510 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:06Z"} 2024-04-16T18:30:06.510 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:06Z"} 2024-04-16T18:30:06.510 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:06.510 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:06.511 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:06.511 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:30:11.511 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:11.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:11.512 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:11.566 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:11.567 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:11.622 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:11.622+0000 7f4ba00e4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:11.623 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:11.624+0000 7f4ba00e4800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:11.647 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:11Z"} 2024-04-16T18:30:11.647 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:11Z"} 2024-04-16T18:30:11.647 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:11.647 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:11.648 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:11.648 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:30:16.648 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:16.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:16.649 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:16.704 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:16.704 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:16.761 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:16.761+0000 7f139069d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:16.762 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:16.763+0000 7f139069d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:16.786 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:16Z"} 2024-04-16T18:30:16.786 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:16Z"} 2024-04-16T18:30:16.787 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:16.787 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:16.787 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:16.787 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:30:21.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:21.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:21.789 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:21.844 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:21.844 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:21.899 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:21.900+0000 7f141132a800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:21.900 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:21.901+0000 7f141132a800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:21.923 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:21Z"} 2024-04-16T18:30:21.924 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:21Z"} 2024-04-16T18:30:21.924 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:21.924 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:21.924 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:21.924 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:30:26.925 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:26.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:26.926 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:26.983 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:26.984 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:27.040 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:27.040+0000 7fe60d1af800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:27.041 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:27.042+0000 7fe60d1af800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:27.064 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:27Z"} 2024-04-16T18:30:27.065 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292068.239541_1284.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:27:48.239541Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:27Z"} 2024-04-16T18:30:27.065 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292068.239541_1284.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.239541Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:27.065 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:27.065 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292068.239541_1284.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:27.065 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292068.239541_1284.1 2024-04-16T18:30:32.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:32.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:32.067 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:32.122 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:32.122 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:32.180 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:32.180+0000 7f9b7633b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:32.181 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:32.181+0000 7f9b7633b800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:32.205 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292154.851604_1374.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:29:14.851604Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:32Z"} 2024-04-16T18:30:32.205 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292154.851604_1374.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:29:14.851604Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:32Z"} 2024-04-16T18:30:32.206 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292154.851604_1374.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:29:14.851604Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:32.206 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:32.206 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.851604_1374.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:32.206 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292154.862025_1377.1 target=1_1713292154.851604_1374.1 2024-04-16T18:30:37.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:37.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:30:37.207 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:30:37.263 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:37.263 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:37.319 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:37.319+0000 7f578a327800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:37.320 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:37.321+0000 7f578a327800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:30:37.343 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292154.862025_1377.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:29:14.862025Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:37Z"} 2024-04-16T18:30:37.343 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292154.862025_1377.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:29:14.862025Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:30:37Z"} 2024-04-16T18:30:37.344 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292154.862025_1377.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:29:14.862025Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:30:37.344 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:37.344 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292154.862025_1377.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:30:37.344 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:30:37.344 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:30:37.344 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:30:37.345 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:30:37.346+0000 7f8bdea8c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 192273) UID: 0 2024-04-16T18:30:37.345 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:30:37.346+0000 7f8be22e5880 -1 shutting down 2024-04-16T18:30:41.270 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:30:43.446 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:30:43.446 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:30:43.447 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:30:43.447 DEBUG:boto:Method: HEAD 2024-04-16T18:30:43.447 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:30:43.447 DEBUG:boto:Data: 2024-04-16T18:30:43.447 DEBUG:boto:Headers: {} 2024-04-16T18:30:43.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.447 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.447 DEBUG:boto:Params: {} 2024-04-16T18:30:43.448 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:30:43.448 DEBUG:boto:Token: None 2024-04-16T18:30:43.448 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/ 2024-04-16T18:30:43.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4= 2024-04-16T18:30:43.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4=', 'Content-Length': '0'} 2024-04-16T18:30:43.453 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000064c4c34fd0d3d315-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.454 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:30:43.454 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:30:43.454 DEBUG:boto:Method: PUT 2024-04-16T18:30:43.454 DEBUG:boto:Path: /cjqttm-53/obj11 2024-04-16T18:30:43.454 DEBUG:boto:Data: 2024-04-16T18:30:43.454 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:30:43.454 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.454 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.454 DEBUG:boto:Params: {} 2024-04-16T18:30:43.455 DEBUG:boto:Token: None 2024-04-16T18:30:43.455 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/obj11 2024-04-16T18:30:43.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l+3euxel7bOK4ouRSFlHBNp+ZE4= 2024-04-16T18:30:43.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l+3euxel7bOK4ouRSFlHBNp+ZE4='} 2024-04-16T18:30:43.463 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000351d0211b27288fb-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.464 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:30:43.464 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:30:43.464 DEBUG:boto:Method: HEAD 2024-04-16T18:30:43.464 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:30:43.464 DEBUG:boto:Data: 2024-04-16T18:30:43.464 DEBUG:boto:Headers: {} 2024-04-16T18:30:43.464 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.464 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.464 DEBUG:boto:Params: {} 2024-04-16T18:30:43.465 DEBUG:boto:Token: None 2024-04-16T18:30:43.465 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/ 2024-04-16T18:30:43.465 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4= 2024-04-16T18:30:43.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4=', 'Content-Length': '0'} 2024-04-16T18:30:43.467 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009b2eee0b5f631c8b-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.467 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:30:43.467 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:30:43.468 DEBUG:boto:Method: PUT 2024-04-16T18:30:43.468 DEBUG:boto:Path: /cjqttm-53/obj22 2024-04-16T18:30:43.468 DEBUG:boto:Data: 2024-04-16T18:30:43.468 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:30:43.468 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.468 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.468 DEBUG:boto:Params: {} 2024-04-16T18:30:43.468 DEBUG:boto:Token: None 2024-04-16T18:30:43.468 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/obj22 2024-04-16T18:30:43.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tfVjTg/RIh/gOzB1ouXp9uAHDxc= 2024-04-16T18:30:43.469 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tfVjTg/RIh/gOzB1ouXp9uAHDxc='} 2024-04-16T18:30:43.473 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ec8a9fbc4fd366c1-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.473 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:30:43.473 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:30:43.473 DEBUG:boto:Method: HEAD 2024-04-16T18:30:43.473 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:30:43.474 DEBUG:boto:Data: 2024-04-16T18:30:43.474 DEBUG:boto:Headers: {} 2024-04-16T18:30:43.474 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.474 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.474 DEBUG:boto:Params: {} 2024-04-16T18:30:43.474 DEBUG:boto:Token: None 2024-04-16T18:30:43.474 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/ 2024-04-16T18:30:43.474 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4= 2024-04-16T18:30:43.474 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4=', 'Content-Length': '0'} 2024-04-16T18:30:43.477 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e31a6ffcacf64f92-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.477 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:30:43.477 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:30:43.477 DEBUG:boto:Method: PUT 2024-04-16T18:30:43.477 DEBUG:boto:Path: /cjqttm-53/obj33 2024-04-16T18:30:43.477 DEBUG:boto:Data: 2024-04-16T18:30:43.477 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:30:43.478 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.478 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.478 DEBUG:boto:Params: {} 2024-04-16T18:30:43.478 DEBUG:boto:Token: None 2024-04-16T18:30:43.478 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/obj33 2024-04-16T18:30:43.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D97g7NhHQJMIgcOcTcNIaIeiJ24= 2024-04-16T18:30:43.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D97g7NhHQJMIgcOcTcNIaIeiJ24='} 2024-04-16T18:30:43.523 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003ff43ec1f8b82ef9-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.523 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:30:43.523 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:30:43.523 DEBUG:boto:Method: HEAD 2024-04-16T18:30:43.523 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:30:43.523 DEBUG:boto:Data: 2024-04-16T18:30:43.523 DEBUG:boto:Headers: {} 2024-04-16T18:30:43.524 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.524 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.524 DEBUG:boto:Params: {} 2024-04-16T18:30:43.524 DEBUG:boto:Token: None 2024-04-16T18:30:43.524 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/ 2024-04-16T18:30:43.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4= 2024-04-16T18:30:43.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4=', 'Content-Length': '0'} 2024-04-16T18:30:43.526 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002b59ad17eb8000b3-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.527 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:30:43.527 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:30:43.527 DEBUG:boto:Method: PUT 2024-04-16T18:30:43.527 DEBUG:boto:Path: /cjqttm-53/obj44 2024-04-16T18:30:43.527 DEBUG:boto:Data: 2024-04-16T18:30:43.527 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:30:43.527 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.528 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.528 DEBUG:boto:Params: {} 2024-04-16T18:30:43.528 DEBUG:boto:Token: None 2024-04-16T18:30:43.528 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/obj44 2024-04-16T18:30:43.528 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KOyna2xXEeKoFXjD6EMEFaf5nIw= 2024-04-16T18:30:43.528 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KOyna2xXEeKoFXjD6EMEFaf5nIw='} 2024-04-16T18:30:43.535 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a2747ad41088b11b-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.535 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:30:43.535 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:30:43.535 DEBUG:boto:Method: HEAD 2024-04-16T18:30:43.535 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:30:43.536 DEBUG:boto:Data: 2024-04-16T18:30:43.536 DEBUG:boto:Headers: {} 2024-04-16T18:30:43.536 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.536 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.536 DEBUG:boto:Params: {} 2024-04-16T18:30:43.536 DEBUG:boto:Token: None 2024-04-16T18:30:43.536 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/ 2024-04-16T18:30:43.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4= 2024-04-16T18:30:43.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2n82wa6nVqBAfrg/IG8li6gFIx4=', 'Content-Length': '0'} 2024-04-16T18:30:43.538 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000072f8d4bf90cd3c07-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.539 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:30:43.539 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:30:43.539 DEBUG:boto:Method: PUT 2024-04-16T18:30:43.539 DEBUG:boto:Path: /cjqttm-53/obj55 2024-04-16T18:30:43.539 DEBUG:boto:Data: 2024-04-16T18:30:43.539 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:30:43.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:30:43.539 DEBUG:boto:Port: 8000 2024-04-16T18:30:43.540 DEBUG:boto:Params: {} 2024-04-16T18:30:43.540 DEBUG:boto:Token: None 2024-04-16T18:30:43.540 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:30:43 GMT /cjqttm-53/obj55 2024-04-16T18:30:43.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dbdZUZokObzXb5hm0QgMBrcYEYQ= 2024-04-16T18:30:43.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:30:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dbdZUZokObzXb5hm0QgMBrcYEYQ='} 2024-04-16T18:30:43.583 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000e987450bb972163-00661ec3d3-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:30:43.583 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:30:43.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:30:43.583 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:30:43.640 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:43.640 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:43.699 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:43.701+0000 7fc71753b800 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-16T18:30:43.701 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:43.703+0000 7fc71753b800 5 RGW-SYNC:data: acquired data sync status lease 2024-04-16T18:30:43.735 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:30:43.736 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:30:43.738 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:30:43.738 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:30:43.758 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:30:43.758 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:30:43.758 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:30:43.758 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:30:43.759 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:30:43.938 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:30:43.940+0000 7f664f80f880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:30:44.760 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:30:44.780 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:30:44.780 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:30:44.780 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:30:44.781 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:30:44.782 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-53 2024-04-16T18:30:44.782 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:30:44.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-53', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:30:44.782 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-53 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:30:44.877 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:30:44.877 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:30:44.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:44.934+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:30:47.278 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:30:49.933 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:49.935+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:30:53.198 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:30:53.199+0000 7f652f247640 -1 rgw async rados processor: ERROR: _send_request(): get_sync_policy_handler() returned -2 2024-04-16T18:30:54.934 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:54.934+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:30:59.935 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:30:59.935+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:04.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:04.936+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:09.936 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:09.937+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:14.937 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:14.938+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:19.938 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:19.938+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:24.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:24.939+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:29.939 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:29.941+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:34.940 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:34.941+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:39.941 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:39.941+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:44.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:44.942+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:49.942 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:49.942+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:54.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:54.943+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:31:59.943 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:31:59.944+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:04.944 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:04.944+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:09.945 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:09.946+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:14.946 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:14.947+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:19.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:19.948+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:24.947 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:24.948+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:29.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:29.948+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:34.948 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:34.949+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:39.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:39.949+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:44.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:44.950+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:49.950 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:49.951+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:54.951 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:54.952+0000 7fab96fa2800 1 waiting to reach incremental sync.. 2024-04-16T18:32:59.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:59.954+0000 7fab96fa2800 1 bucket sync caught up with source: 2024-04-16T18:32:59.953 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000001.93.6, 00000000002.92.6, 00000000002.100.6] 2024-04-16T18:32:59.953 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000001.93.6, 00000000002.92.6, 00000000002.100.6] 2024-04-16T18:32:59.953 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:32:59.954+0000 7fab96fa2800 0 bucket checkpoint complete 2024-04-16T18:32:59.982 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-53 2024-04-16T18:32:59.982 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:32:59.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-53', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:32:59.983 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-53 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:33:00.046 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:00.046 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:00.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:33:00.111+0000 7f3bfaf38800 1 bucket sync caught up with source: 2024-04-16T18:33:00.110 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000001.576.6, 00000000002.177.6, 00000000002.438.6] 2024-04-16T18:33:00.110 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000001.576.6, 00000000002.177.6, 00000000002.438.6] 2024-04-16T18:33:00.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:33:00.111+0000 7f3bfaf38800 0 bucket checkpoint complete 2024-04-16T18:33:00.133 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-53 zones={test-zone2, test-zone1} 2024-04-16T18:33:00.134 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.134 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.134 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.134 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:33:00.134 DEBUG:boto:Data: 2024-04-16T18:33:00.134 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.134 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.135 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.135 DEBUG:boto:Params: {} 2024-04-16T18:33:00.135 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:33:00.135 DEBUG:boto:Token: None 2024-04-16T18:33:00.135 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.136 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XK1U+pRby+DOVD8sUKE4kcEnf/0= 2024-04-16T18:33:00.136 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XK1U+pRby+DOVD8sUKE4kcEnf/0=', 'Content-Length': '0'} 2024-04-16T18:33:00.143 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000097aec216c5d846c7-00661ec45c-6236-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.143 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.143 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.143 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.144 DEBUG:boto:Path: /cjqttm-53/ 2024-04-16T18:33:00.144 DEBUG:boto:Data: 2024-04-16T18:33:00.144 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.144 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.144 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.144 DEBUG:boto:Params: {} 2024-04-16T18:33:00.144 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:33:00.144 DEBUG:boto:Token: None 2024-04-16T18:33:00.145 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.145 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XK1U+pRby+DOVD8sUKE4kcEnf/0= 2024-04-16T18:33:00.145 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XK1U+pRby+DOVD8sUKE4kcEnf/0=', 'Content-Length': '0'} 2024-04-16T18:33:00.149 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006217387e3ca07b47-00661ec45c-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.149 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:33:00.149 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.149 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.149 DEBUG:boto:path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.149 DEBUG:boto:auth_path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.149 DEBUG:boto:Method: GET 2024-04-16T18:33:00.150 DEBUG:boto:Path: /cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.150 DEBUG:boto:Data: 2024-04-16T18:33:00.150 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.150 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.150 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.150 DEBUG:boto:Params: {} 2024-04-16T18:33:00.150 DEBUG:boto:Token: None 2024-04-16T18:33:00.150 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/?versions 2024-04-16T18:33:00.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM= 2024-04-16T18:33:00.151 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM=', 'Content-Length': '0'} 2024-04-16T18:33:00.153 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004b19e10273a0a5da-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.153 DEBUG:boto:b'cjqttm-53999falseobj11nulltrue2024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.154 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:33:00.155 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:33:00.155 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:33:00.155 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:33:00.155 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:33:00.155 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:33:00.155 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.155 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.155 DEBUG:boto:path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.155 DEBUG:boto:auth_path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.155 DEBUG:boto:Method: GET 2024-04-16T18:33:00.156 DEBUG:boto:Path: /cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.156 DEBUG:boto:Data: 2024-04-16T18:33:00.156 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.156 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.156 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.156 DEBUG:boto:Params: {} 2024-04-16T18:33:00.156 DEBUG:boto:Token: None 2024-04-16T18:33:00.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/?versions 2024-04-16T18:33:00.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM= 2024-04-16T18:33:00.157 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM=', 'Content-Length': '0'} 2024-04-16T18:33:00.159 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ce97ef9b778af83-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.159 DEBUG:boto:b'cjqttm-53999falseobj11nulltrue2024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:33:00.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:33:00.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:33:00.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:33:00.160 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:33:00.160 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.160 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.160 DEBUG:boto:path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.160 DEBUG:boto:auth_path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.161 DEBUG:boto:Method: GET 2024-04-16T18:33:00.161 DEBUG:boto:Path: /cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.161 DEBUG:boto:Data: 2024-04-16T18:33:00.161 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.161 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.161 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.161 DEBUG:boto:Params: {} 2024-04-16T18:33:00.161 DEBUG:boto:Token: None 2024-04-16T18:33:00.161 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/?versions 2024-04-16T18:33:00.162 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM= 2024-04-16T18:33:00.162 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM=', 'Content-Length': '0'} 2024-04-16T18:33:00.164 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a2b71528b8dbee7-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.164 DEBUG:boto:b'cjqttm-53999falseobj11nulltrue2024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.165 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.165 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.165 DEBUG:boto:path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.165 DEBUG:boto:auth_path=/cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.165 DEBUG:boto:Method: GET 2024-04-16T18:33:00.165 DEBUG:boto:Path: /cjqttm-53/?versions&max-keys=999 2024-04-16T18:33:00.165 DEBUG:boto:Data: 2024-04-16T18:33:00.166 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.166 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.166 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.166 DEBUG:boto:Params: {} 2024-04-16T18:33:00.166 DEBUG:boto:Token: None 2024-04-16T18:33:00.166 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/?versions 2024-04-16T18:33:00.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM= 2024-04-16T18:33:00.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xwu5kwoobPX45+Nj5Gj3qYJTPjM=', 'Content-Length': '0'} 2024-04-16T18:33:00.169 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd70576d7f39c1c7-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.169 DEBUG:boto:b'cjqttm-53999falseobj11nulltrue2024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.169 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:33:00.169 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.170 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.170 DEBUG:boto:path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.170 DEBUG:boto:auth_path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.170 DEBUG:boto:Method: GET 2024-04-16T18:33:00.170 DEBUG:boto:Path: /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.170 DEBUG:boto:Data: 2024-04-16T18:33:00.170 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.170 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.170 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.171 DEBUG:boto:Params: {} 2024-04-16T18:33:00.171 DEBUG:boto:Token: None 2024-04-16T18:33:00.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U= 2024-04-16T18:33:00.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U=', 'Content-Length': '0'} 2024-04-16T18:33:00.174 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:31:51 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028a9e1c5afa40098-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.174 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.174 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.174 DEBUG:boto:path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.174 DEBUG:boto:auth_path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.174 DEBUG:boto:Method: GET 2024-04-16T18:33:00.175 DEBUG:boto:Path: /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.175 DEBUG:boto:Data: 2024-04-16T18:33:00.175 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.175 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.175 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.175 DEBUG:boto:Params: {} 2024-04-16T18:33:00.175 DEBUG:boto:Token: None 2024-04-16T18:33:00.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U= 2024-04-16T18:33:00.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U=', 'Content-Length': '0'} 2024-04-16T18:33:00.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d9b7d6be020abcbb-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.178 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.178 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.178 DEBUG:boto:path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.178 DEBUG:boto:auth_path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.178 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.178 DEBUG:boto:Path: /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.178 DEBUG:boto:Data: 2024-04-16T18:33:00.178 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.178 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.179 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.179 DEBUG:boto:Params: {} 2024-04-16T18:33:00.179 DEBUG:boto:Token: None 2024-04-16T18:33:00.179 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TTmWH/L4xTagMzFwK+XlhCcyXw0= 2024-04-16T18:33:00.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TTmWH/L4xTagMzFwK+XlhCcyXw0=', 'Content-Length': '0'} 2024-04-16T18:33:00.181 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:31:51 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c964bee2c4d5d6a-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.181 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.181 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.181 DEBUG:boto:path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.182 DEBUG:boto:auth_path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.182 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.182 DEBUG:boto:Path: /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.182 DEBUG:boto:Data: 2024-04-16T18:33:00.182 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.182 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.182 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.182 DEBUG:boto:Params: {} 2024-04-16T18:33:00.182 DEBUG:boto:Token: None 2024-04-16T18:33:00.182 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.183 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TTmWH/L4xTagMzFwK+XlhCcyXw0= 2024-04-16T18:33:00.183 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TTmWH/L4xTagMzFwK+XlhCcyXw0=', 'Content-Length': '0'} 2024-04-16T18:33:00.184 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bf681de59b81ccd-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.185 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:33:00.185 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.185 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.185 DEBUG:boto:path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.185 DEBUG:boto:auth_path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.185 DEBUG:boto:Method: GET 2024-04-16T18:33:00.185 DEBUG:boto:Path: /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.185 DEBUG:boto:Data: 2024-04-16T18:33:00.186 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.186 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.186 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.186 DEBUG:boto:Params: {} 2024-04-16T18:33:00.186 DEBUG:boto:Token: None 2024-04-16T18:33:00.186 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.186 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U= 2024-04-16T18:33:00.186 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U=', 'Content-Length': '0'} 2024-04-16T18:33:00.188 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:31:51 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000921c251e23237615-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.230 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.230 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.230 DEBUG:boto:path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.231 DEBUG:boto:auth_path=/cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.231 DEBUG:boto:Method: GET 2024-04-16T18:33:00.231 DEBUG:boto:Path: /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.231 DEBUG:boto:Data: 2024-04-16T18:33:00.231 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.231 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.231 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.231 DEBUG:boto:Params: {} 2024-04-16T18:33:00.231 DEBUG:boto:Token: None 2024-04-16T18:33:00.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11?versionId=null 2024-04-16T18:33:00.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U= 2024-04-16T18:33:00.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iBkNboQ7IMjvsnM/Ik91kE8bJ8U=', 'Content-Length': '0'} 2024-04-16T18:33:00.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a2f1cd6ad62c4d8-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.234 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.234 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.234 DEBUG:boto:path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.234 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.234 DEBUG:boto:Method: GET 2024-04-16T18:33:00.234 DEBUG:boto:Path: /cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.234 DEBUG:boto:Data: 2024-04-16T18:33:00.234 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.234 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.234 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.235 DEBUG:boto:Params: {} 2024-04-16T18:33:00.235 DEBUG:boto:Token: None 2024-04-16T18:33:00.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.235 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.237 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bda4ed9fb7485ff7-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.238 DEBUG:boto:b'cjqttm-53obj111000falseobj112024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.238 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.238 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.238 DEBUG:boto:path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.238 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.238 DEBUG:boto:Method: GET 2024-04-16T18:33:00.239 DEBUG:boto:Path: /cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.239 DEBUG:boto:Data: 2024-04-16T18:33:00.239 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.239 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.239 DEBUG:boto:Params: {} 2024-04-16T18:33:00.239 DEBUG:boto:Token: None 2024-04-16T18:33:00.239 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.239 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.239 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.241 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000643458d24096d1ba-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.242 DEBUG:boto:b'cjqttm-53obj111000falseobj112024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.242 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.242 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.242 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.242 DEBUG:boto:Path: /cjqttm-53/obj11 2024-04-16T18:33:00.242 DEBUG:boto:Data: 2024-04-16T18:33:00.243 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.243 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.243 DEBUG:boto:Params: {} 2024-04-16T18:33:00.243 DEBUG:boto:Token: None 2024-04-16T18:33:00.243 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11 2024-04-16T18:33:00.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GEMFAs9ypHjedBBxz29iyBWINuc= 2024-04-16T18:33:00.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GEMFAs9ypHjedBBxz29iyBWINuc=', 'Content-Length': '0'} 2024-04-16T18:33:00.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:31:51 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb1fe179479bdb49-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.246 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.246 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.246 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.246 DEBUG:boto:Path: /cjqttm-53/obj11 2024-04-16T18:33:00.246 DEBUG:boto:Data: 2024-04-16T18:33:00.246 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.246 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.246 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.246 DEBUG:boto:Params: {} 2024-04-16T18:33:00.247 DEBUG:boto:Token: None 2024-04-16T18:33:00.247 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11 2024-04-16T18:33:00.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GEMFAs9ypHjedBBxz29iyBWINuc= 2024-04-16T18:33:00.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GEMFAs9ypHjedBBxz29iyBWINuc=', 'Content-Length': '0'} 2024-04-16T18:33:00.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013d25a095ee1393a-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.249 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:33:00.249 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.249 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.249 DEBUG:boto:Method: GET 2024-04-16T18:33:00.249 DEBUG:boto:Path: /cjqttm-53/obj11 2024-04-16T18:33:00.249 DEBUG:boto:Data: 2024-04-16T18:33:00.249 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.250 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.250 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.250 DEBUG:boto:Params: {} 2024-04-16T18:33:00.250 DEBUG:boto:Token: None 2024-04-16T18:33:00.250 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11 2024-04-16T18:33:00.250 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cORySDRykrD6DoEB0BqdzDNPDLo= 2024-04-16T18:33:00.250 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cORySDRykrD6DoEB0BqdzDNPDLo=', 'Content-Length': '0'} 2024-04-16T18:33:00.252 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:31:51 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3dfeb3c341d0cbf-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.294 DEBUG:boto:path=/cjqttm-53/obj11 2024-04-16T18:33:00.295 DEBUG:boto:auth_path=/cjqttm-53/obj11 2024-04-16T18:33:00.295 DEBUG:boto:Method: GET 2024-04-16T18:33:00.295 DEBUG:boto:Path: /cjqttm-53/obj11 2024-04-16T18:33:00.295 DEBUG:boto:Data: 2024-04-16T18:33:00.295 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.295 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.295 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.295 DEBUG:boto:Params: {} 2024-04-16T18:33:00.295 DEBUG:boto:Token: None 2024-04-16T18:33:00.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj11 2024-04-16T18:33:00.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cORySDRykrD6DoEB0BqdzDNPDLo= 2024-04-16T18:33:00.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cORySDRykrD6DoEB0BqdzDNPDLo=', 'Content-Length': '0'} 2024-04-16T18:33:00.297 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d3e7dbeae6adeec-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.298 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.298 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.298 DEBUG:boto:path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.298 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.298 DEBUG:boto:Method: GET 2024-04-16T18:33:00.298 DEBUG:boto:Path: /cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.298 DEBUG:boto:Data: 2024-04-16T18:33:00.298 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.299 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.299 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.299 DEBUG:boto:Params: {} 2024-04-16T18:33:00.299 DEBUG:boto:Token: None 2024-04-16T18:33:00.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.299 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.299 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.301 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066dd8d5c1b62a259-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.342 DEBUG:boto:b'cjqttm-53obj111000falseobj112024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.343 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.343 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.343 DEBUG:boto:path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.343 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.343 DEBUG:boto:Method: GET 2024-04-16T18:33:00.343 DEBUG:boto:Path: /cjqttm-53/?prefix=obj11 2024-04-16T18:33:00.343 DEBUG:boto:Data: 2024-04-16T18:33:00.343 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.343 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.344 DEBUG:boto:Params: {} 2024-04-16T18:33:00.344 DEBUG:boto:Token: None 2024-04-16T18:33:00.344 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.346 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008967681b222c4149-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.346 DEBUG:boto:b'cjqttm-53obj111000falseobj112024-04-16T18:30:43.458Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:33:00.347 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.347 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.347 DEBUG:boto:path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.347 DEBUG:boto:auth_path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.347 DEBUG:boto:Method: GET 2024-04-16T18:33:00.347 DEBUG:boto:Path: /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.347 DEBUG:boto:Data: 2024-04-16T18:33:00.347 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.347 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.348 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.348 DEBUG:boto:Params: {} 2024-04-16T18:33:00.348 DEBUG:boto:Token: None 2024-04-16T18:33:00.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk= 2024-04-16T18:33:00.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk=', 'Content-Length': '0'} 2024-04-16T18:33:00.351 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3d308e0f88f8046-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.394 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.395 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.395 DEBUG:boto:path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.395 DEBUG:boto:auth_path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.395 DEBUG:boto:Method: GET 2024-04-16T18:33:00.395 DEBUG:boto:Path: /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.395 DEBUG:boto:Data: 2024-04-16T18:33:00.395 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.395 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.395 DEBUG:boto:Params: {} 2024-04-16T18:33:00.396 DEBUG:boto:Token: None 2024-04-16T18:33:00.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk= 2024-04-16T18:33:00.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk=', 'Content-Length': '0'} 2024-04-16T18:33:00.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050c4c5b90a102beb-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.398 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.398 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.399 DEBUG:boto:path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.399 DEBUG:boto:auth_path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.399 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.399 DEBUG:boto:Path: /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.399 DEBUG:boto:Data: 2024-04-16T18:33:00.399 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.399 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.399 DEBUG:boto:Params: {} 2024-04-16T18:33:00.399 DEBUG:boto:Token: None 2024-04-16T18:33:00.400 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MAmLtFBpQ2+O5iv0+nnOFmoYVJ4= 2024-04-16T18:33:00.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MAmLtFBpQ2+O5iv0+nnOFmoYVJ4=', 'Content-Length': '0'} 2024-04-16T18:33:00.402 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004421aed56e34d50c-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.402 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.402 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.402 DEBUG:boto:path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.402 DEBUG:boto:auth_path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.402 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.403 DEBUG:boto:Path: /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.403 DEBUG:boto:Data: 2024-04-16T18:33:00.403 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.403 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.403 DEBUG:boto:Params: {} 2024-04-16T18:33:00.403 DEBUG:boto:Token: None 2024-04-16T18:33:00.403 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MAmLtFBpQ2+O5iv0+nnOFmoYVJ4= 2024-04-16T18:33:00.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MAmLtFBpQ2+O5iv0+nnOFmoYVJ4=', 'Content-Length': '0'} 2024-04-16T18:33:00.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d25a46d9005df49-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.406 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:33:00.406 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.406 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.406 DEBUG:boto:path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.406 DEBUG:boto:auth_path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.406 DEBUG:boto:Method: GET 2024-04-16T18:33:00.406 DEBUG:boto:Path: /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.406 DEBUG:boto:Data: 2024-04-16T18:33:00.406 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.407 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.407 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.407 DEBUG:boto:Params: {} 2024-04-16T18:33:00.407 DEBUG:boto:Token: None 2024-04-16T18:33:00.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.407 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk= 2024-04-16T18:33:00.407 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk=', 'Content-Length': '0'} 2024-04-16T18:33:00.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a296181f4dbd89eb-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.450 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.450 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.450 DEBUG:boto:path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.451 DEBUG:boto:auth_path=/cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.451 DEBUG:boto:Method: GET 2024-04-16T18:33:00.451 DEBUG:boto:Path: /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.451 DEBUG:boto:Data: 2024-04-16T18:33:00.451 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.451 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.451 DEBUG:boto:Params: {} 2024-04-16T18:33:00.451 DEBUG:boto:Token: None 2024-04-16T18:33:00.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22?versionId=null 2024-04-16T18:33:00.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk= 2024-04-16T18:33:00.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9+Pc5xoAV4fsEzm9/OJDsmJU9Bk=', 'Content-Length': '0'} 2024-04-16T18:33:00.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045e142d9f8542f4a-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.454 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.454 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.454 DEBUG:boto:path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.455 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.455 DEBUG:boto:Method: GET 2024-04-16T18:33:00.455 DEBUG:boto:Path: /cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.455 DEBUG:boto:Data: 2024-04-16T18:33:00.455 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.455 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.455 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.455 DEBUG:boto:Params: {} 2024-04-16T18:33:00.455 DEBUG:boto:Token: None 2024-04-16T18:33:00.455 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.458 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000040125aef69d7de66-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.502 DEBUG:boto:b'cjqttm-53obj221000falseobj222024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.503 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.503 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.503 DEBUG:boto:path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.503 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.503 DEBUG:boto:Method: GET 2024-04-16T18:33:00.503 DEBUG:boto:Path: /cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.503 DEBUG:boto:Data: 2024-04-16T18:33:00.503 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.504 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.504 DEBUG:boto:Params: {} 2024-04-16T18:33:00.504 DEBUG:boto:Token: None 2024-04-16T18:33:00.504 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.506 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000673544de17a4f2a-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.506 DEBUG:boto:b'cjqttm-53obj221000falseobj222024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.507 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.507 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.507 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.507 DEBUG:boto:Path: /cjqttm-53/obj22 2024-04-16T18:33:00.507 DEBUG:boto:Data: 2024-04-16T18:33:00.507 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.507 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.507 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.507 DEBUG:boto:Params: {} 2024-04-16T18:33:00.508 DEBUG:boto:Token: None 2024-04-16T18:33:00.508 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22 2024-04-16T18:33:00.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tBQCsXUFRUr0y/cdlD9yZkPN9Q0= 2024-04-16T18:33:00.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tBQCsXUFRUr0y/cdlD9yZkPN9Q0=', 'Content-Length': '0'} 2024-04-16T18:33:00.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e85f0644cbb09dc9-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.510 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.511 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.511 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.511 DEBUG:boto:Path: /cjqttm-53/obj22 2024-04-16T18:33:00.511 DEBUG:boto:Data: 2024-04-16T18:33:00.511 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.511 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.511 DEBUG:boto:Params: {} 2024-04-16T18:33:00.511 DEBUG:boto:Token: None 2024-04-16T18:33:00.512 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22 2024-04-16T18:33:00.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tBQCsXUFRUr0y/cdlD9yZkPN9Q0= 2024-04-16T18:33:00.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tBQCsXUFRUr0y/cdlD9yZkPN9Q0=', 'Content-Length': '0'} 2024-04-16T18:33:00.513 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf9967f9028fde68-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.514 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:33:00.514 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.514 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.514 DEBUG:boto:Method: GET 2024-04-16T18:33:00.514 DEBUG:boto:Path: /cjqttm-53/obj22 2024-04-16T18:33:00.514 DEBUG:boto:Data: 2024-04-16T18:33:00.514 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.515 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.515 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.515 DEBUG:boto:Params: {} 2024-04-16T18:33:00.515 DEBUG:boto:Token: None 2024-04-16T18:33:00.515 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22 2024-04-16T18:33:00.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vly/EwvBUTm84GXsURJdv5Wzm/4= 2024-04-16T18:33:00.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vly/EwvBUTm84GXsURJdv5Wzm/4=', 'Content-Length': '0'} 2024-04-16T18:33:00.517 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063cbe9c6319393d7-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.558 DEBUG:boto:path=/cjqttm-53/obj22 2024-04-16T18:33:00.558 DEBUG:boto:auth_path=/cjqttm-53/obj22 2024-04-16T18:33:00.559 DEBUG:boto:Method: GET 2024-04-16T18:33:00.559 DEBUG:boto:Path: /cjqttm-53/obj22 2024-04-16T18:33:00.559 DEBUG:boto:Data: 2024-04-16T18:33:00.559 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.559 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.559 DEBUG:boto:Params: {} 2024-04-16T18:33:00.559 DEBUG:boto:Token: None 2024-04-16T18:33:00.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj22 2024-04-16T18:33:00.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vly/EwvBUTm84GXsURJdv5Wzm/4= 2024-04-16T18:33:00.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vly/EwvBUTm84GXsURJdv5Wzm/4=', 'Content-Length': '0'} 2024-04-16T18:33:00.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e86d51f3208cc9c9-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.562 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.562 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.562 DEBUG:boto:path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.562 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.562 DEBUG:boto:Method: GET 2024-04-16T18:33:00.563 DEBUG:boto:Path: /cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.563 DEBUG:boto:Data: 2024-04-16T18:33:00.563 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.563 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.563 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.563 DEBUG:boto:Params: {} 2024-04-16T18:33:00.563 DEBUG:boto:Token: None 2024-04-16T18:33:00.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.566 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b76a0d5ac98036a1-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.566 DEBUG:boto:b'cjqttm-53obj221000falseobj222024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.566 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.567 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.567 DEBUG:boto:path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.567 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.567 DEBUG:boto:Method: GET 2024-04-16T18:33:00.567 DEBUG:boto:Path: /cjqttm-53/?prefix=obj22 2024-04-16T18:33:00.567 DEBUG:boto:Data: 2024-04-16T18:33:00.567 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.567 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.567 DEBUG:boto:Params: {} 2024-04-16T18:33:00.567 DEBUG:boto:Token: None 2024-04-16T18:33:00.568 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000292e755ead7df65a-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.570 DEBUG:boto:b'cjqttm-53obj221000falseobj222024-04-16T18:30:43.472Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.571 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:33:00.571 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.571 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.571 DEBUG:boto:path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.571 DEBUG:boto:auth_path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.571 DEBUG:boto:Method: GET 2024-04-16T18:33:00.571 DEBUG:boto:Path: /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.571 DEBUG:boto:Data: 2024-04-16T18:33:00.571 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.571 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.572 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.572 DEBUG:boto:Params: {} 2024-04-16T18:33:00.572 DEBUG:boto:Token: None 2024-04-16T18:33:00.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4= 2024-04-16T18:33:00.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4=', 'Content-Length': '0'} 2024-04-16T18:33:00.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024f4dca47bb09e41-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.614 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.614 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.615 DEBUG:boto:path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.615 DEBUG:boto:auth_path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.615 DEBUG:boto:Method: GET 2024-04-16T18:33:00.615 DEBUG:boto:Path: /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.615 DEBUG:boto:Data: 2024-04-16T18:33:00.615 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.615 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.615 DEBUG:boto:Params: {} 2024-04-16T18:33:00.615 DEBUG:boto:Token: None 2024-04-16T18:33:00.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4= 2024-04-16T18:33:00.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4=', 'Content-Length': '0'} 2024-04-16T18:33:00.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005027445643535d51-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.618 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.618 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.618 DEBUG:boto:path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.618 DEBUG:boto:auth_path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.618 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.618 DEBUG:boto:Path: /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.618 DEBUG:boto:Data: 2024-04-16T18:33:00.618 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.618 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.618 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.618 DEBUG:boto:Params: {} 2024-04-16T18:33:00.619 DEBUG:boto:Token: None 2024-04-16T18:33:00.619 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KcWZwPX/h3r0tYajiZ7zlj3Ubco= 2024-04-16T18:33:00.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KcWZwPX/h3r0tYajiZ7zlj3Ubco=', 'Content-Length': '0'} 2024-04-16T18:33:00.621 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de4876acd5b04980-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.621 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.621 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.621 DEBUG:boto:path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.621 DEBUG:boto:auth_path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.621 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.621 DEBUG:boto:Path: /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.621 DEBUG:boto:Data: 2024-04-16T18:33:00.622 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.622 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.622 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.622 DEBUG:boto:Params: {} 2024-04-16T18:33:00.622 DEBUG:boto:Token: None 2024-04-16T18:33:00.622 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.622 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KcWZwPX/h3r0tYajiZ7zlj3Ubco= 2024-04-16T18:33:00.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KcWZwPX/h3r0tYajiZ7zlj3Ubco=', 'Content-Length': '0'} 2024-04-16T18:33:00.624 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a90c1c97902484e1-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.624 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:33:00.624 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.624 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.625 DEBUG:boto:path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.625 DEBUG:boto:auth_path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.625 DEBUG:boto:Method: GET 2024-04-16T18:33:00.625 DEBUG:boto:Path: /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.625 DEBUG:boto:Data: 2024-04-16T18:33:00.625 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.625 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.625 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.625 DEBUG:boto:Params: {} 2024-04-16T18:33:00.625 DEBUG:boto:Token: None 2024-04-16T18:33:00.625 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.626 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4= 2024-04-16T18:33:00.626 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4=', 'Content-Length': '0'} 2024-04-16T18:33:00.627 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f1e578dad930ca90-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.670 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.670 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.671 DEBUG:boto:path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.671 DEBUG:boto:auth_path=/cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.671 DEBUG:boto:Method: GET 2024-04-16T18:33:00.671 DEBUG:boto:Path: /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.671 DEBUG:boto:Data: 2024-04-16T18:33:00.671 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.671 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.671 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.671 DEBUG:boto:Params: {} 2024-04-16T18:33:00.671 DEBUG:boto:Token: None 2024-04-16T18:33:00.672 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33?versionId=null 2024-04-16T18:33:00.672 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4= 2024-04-16T18:33:00.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2GL58mW4Xv5XQqkk0wjrhZj7et4=', 'Content-Length': '0'} 2024-04-16T18:33:00.673 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cda700e7e7c05e7f-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.674 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.674 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.674 DEBUG:boto:path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.674 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.674 DEBUG:boto:Method: GET 2024-04-16T18:33:00.674 DEBUG:boto:Path: /cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.674 DEBUG:boto:Data: 2024-04-16T18:33:00.674 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.675 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.675 DEBUG:boto:Params: {} 2024-04-16T18:33:00.675 DEBUG:boto:Token: None 2024-04-16T18:33:00.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.678 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a9a18c06b35f5ab-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.678 DEBUG:boto:b'cjqttm-53obj331000falseobj332024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.678 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.679 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.679 DEBUG:boto:path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.679 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.679 DEBUG:boto:Method: GET 2024-04-16T18:33:00.679 DEBUG:boto:Path: /cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.679 DEBUG:boto:Data: 2024-04-16T18:33:00.679 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.679 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.679 DEBUG:boto:Params: {} 2024-04-16T18:33:00.679 DEBUG:boto:Token: None 2024-04-16T18:33:00.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000014e5db5d29b256f7-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.682 DEBUG:boto:b'cjqttm-53obj331000falseobj332024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.682 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.683 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.683 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.683 DEBUG:boto:Path: /cjqttm-53/obj33 2024-04-16T18:33:00.683 DEBUG:boto:Data: 2024-04-16T18:33:00.683 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.683 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.683 DEBUG:boto:Params: {} 2024-04-16T18:33:00.683 DEBUG:boto:Token: None 2024-04-16T18:33:00.683 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33 2024-04-16T18:33:00.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CGKBKq9M/TeSgJ1Iy0jKlBtHu3c= 2024-04-16T18:33:00.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CGKBKq9M/TeSgJ1Iy0jKlBtHu3c=', 'Content-Length': '0'} 2024-04-16T18:33:00.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8984b452a8dd1a9-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.686 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.686 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.686 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.686 DEBUG:boto:Path: /cjqttm-53/obj33 2024-04-16T18:33:00.686 DEBUG:boto:Data: 2024-04-16T18:33:00.686 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.686 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.686 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.686 DEBUG:boto:Params: {} 2024-04-16T18:33:00.687 DEBUG:boto:Token: None 2024-04-16T18:33:00.687 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33 2024-04-16T18:33:00.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CGKBKq9M/TeSgJ1Iy0jKlBtHu3c= 2024-04-16T18:33:00.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CGKBKq9M/TeSgJ1Iy0jKlBtHu3c=', 'Content-Length': '0'} 2024-04-16T18:33:00.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013a6f8f01fa71b2e-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.689 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:33:00.689 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.689 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.689 DEBUG:boto:Method: GET 2024-04-16T18:33:00.689 DEBUG:boto:Path: /cjqttm-53/obj33 2024-04-16T18:33:00.689 DEBUG:boto:Data: 2024-04-16T18:33:00.689 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.690 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.690 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.690 DEBUG:boto:Params: {} 2024-04-16T18:33:00.690 DEBUG:boto:Token: None 2024-04-16T18:33:00.690 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33 2024-04-16T18:33:00.690 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vVkRkrBOyc3AoshW5zsc5lNWIco= 2024-04-16T18:33:00.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vVkRkrBOyc3AoshW5zsc5lNWIco=', 'Content-Length': '0'} 2024-04-16T18:33:00.692 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ce08c0ba093b346-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.734 DEBUG:boto:path=/cjqttm-53/obj33 2024-04-16T18:33:00.734 DEBUG:boto:auth_path=/cjqttm-53/obj33 2024-04-16T18:33:00.735 DEBUG:boto:Method: GET 2024-04-16T18:33:00.735 DEBUG:boto:Path: /cjqttm-53/obj33 2024-04-16T18:33:00.735 DEBUG:boto:Data: 2024-04-16T18:33:00.735 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.735 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.735 DEBUG:boto:Params: {} 2024-04-16T18:33:00.735 DEBUG:boto:Token: None 2024-04-16T18:33:00.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj33 2024-04-16T18:33:00.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vVkRkrBOyc3AoshW5zsc5lNWIco= 2024-04-16T18:33:00.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vVkRkrBOyc3AoshW5zsc5lNWIco=', 'Content-Length': '0'} 2024-04-16T18:33:00.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3df5077a4bd1e52-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.738 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.738 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.738 DEBUG:boto:path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.738 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.738 DEBUG:boto:Method: GET 2024-04-16T18:33:00.739 DEBUG:boto:Path: /cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.739 DEBUG:boto:Data: 2024-04-16T18:33:00.739 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.739 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.739 DEBUG:boto:Params: {} 2024-04-16T18:33:00.739 DEBUG:boto:Token: None 2024-04-16T18:33:00.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f84e92b2fbcbd193-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.742 DEBUG:boto:b'cjqttm-53obj331000falseobj332024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.742 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.742 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.743 DEBUG:boto:path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.743 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.743 DEBUG:boto:Method: GET 2024-04-16T18:33:00.743 DEBUG:boto:Path: /cjqttm-53/?prefix=obj33 2024-04-16T18:33:00.743 DEBUG:boto:Data: 2024-04-16T18:33:00.743 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.743 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.743 DEBUG:boto:Params: {} 2024-04-16T18:33:00.743 DEBUG:boto:Token: None 2024-04-16T18:33:00.744 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.746 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000177428e438811942-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.746 DEBUG:boto:b'cjqttm-53obj331000falseobj332024-04-16T18:30:43.482Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.747 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:33:00.747 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.747 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.747 DEBUG:boto:path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.747 DEBUG:boto:auth_path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.747 DEBUG:boto:Method: GET 2024-04-16T18:33:00.747 DEBUG:boto:Path: /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.747 DEBUG:boto:Data: 2024-04-16T18:33:00.747 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.748 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.748 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.748 DEBUG:boto:Params: {} 2024-04-16T18:33:00.748 DEBUG:boto:Token: None 2024-04-16T18:33:00.748 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4= 2024-04-16T18:33:00.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4=', 'Content-Length': '0'} 2024-04-16T18:33:00.750 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000017e0dde9788efc23-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.790 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.790 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.791 DEBUG:boto:path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.791 DEBUG:boto:auth_path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.791 DEBUG:boto:Method: GET 2024-04-16T18:33:00.791 DEBUG:boto:Path: /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.791 DEBUG:boto:Data: 2024-04-16T18:33:00.791 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.791 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.791 DEBUG:boto:Params: {} 2024-04-16T18:33:00.792 DEBUG:boto:Token: None 2024-04-16T18:33:00.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4= 2024-04-16T18:33:00.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4=', 'Content-Length': '0'} 2024-04-16T18:33:00.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dbff1d6d23d4d50-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.794 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.794 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.794 DEBUG:boto:path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.794 DEBUG:boto:auth_path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.795 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.795 DEBUG:boto:Path: /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.795 DEBUG:boto:Data: 2024-04-16T18:33:00.795 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.795 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.795 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.795 DEBUG:boto:Params: {} 2024-04-16T18:33:00.795 DEBUG:boto:Token: None 2024-04-16T18:33:00.795 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SQFp0tifDetRxPaPYYOHG/7SRSw= 2024-04-16T18:33:00.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SQFp0tifDetRxPaPYYOHG/7SRSw=', 'Content-Length': '0'} 2024-04-16T18:33:00.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064ae7706e1586ae4-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.797 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.797 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.798 DEBUG:boto:path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.798 DEBUG:boto:auth_path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.798 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.798 DEBUG:boto:Path: /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.798 DEBUG:boto:Data: 2024-04-16T18:33:00.798 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.798 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.798 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.798 DEBUG:boto:Params: {} 2024-04-16T18:33:00.798 DEBUG:boto:Token: None 2024-04-16T18:33:00.799 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SQFp0tifDetRxPaPYYOHG/7SRSw= 2024-04-16T18:33:00.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SQFp0tifDetRxPaPYYOHG/7SRSw=', 'Content-Length': '0'} 2024-04-16T18:33:00.800 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003b920f6176181715-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.801 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:33:00.801 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.801 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.801 DEBUG:boto:path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.801 DEBUG:boto:auth_path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.801 DEBUG:boto:Method: GET 2024-04-16T18:33:00.801 DEBUG:boto:Path: /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.801 DEBUG:boto:Data: 2024-04-16T18:33:00.801 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.802 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.802 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.802 DEBUG:boto:Params: {} 2024-04-16T18:33:00.802 DEBUG:boto:Token: None 2024-04-16T18:33:00.802 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.802 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4= 2024-04-16T18:33:00.802 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4=', 'Content-Length': '0'} 2024-04-16T18:33:00.804 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f26b3dc2f3beff8-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.846 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.847 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.847 DEBUG:boto:path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.847 DEBUG:boto:auth_path=/cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.847 DEBUG:boto:Method: GET 2024-04-16T18:33:00.847 DEBUG:boto:Path: /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.847 DEBUG:boto:Data: 2024-04-16T18:33:00.847 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.847 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.847 DEBUG:boto:Params: {} 2024-04-16T18:33:00.847 DEBUG:boto:Token: None 2024-04-16T18:33:00.848 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44?versionId=null 2024-04-16T18:33:00.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4= 2024-04-16T18:33:00.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xD2vIIMXfwh9adweaqAaJN79G4=', 'Content-Length': '0'} 2024-04-16T18:33:00.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000beaf5244d5c9e7ba-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.850 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.850 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.850 DEBUG:boto:path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.850 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.850 DEBUG:boto:Method: GET 2024-04-16T18:33:00.850 DEBUG:boto:Path: /cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.850 DEBUG:boto:Data: 2024-04-16T18:33:00.851 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.851 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.851 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.851 DEBUG:boto:Params: {} 2024-04-16T18:33:00.851 DEBUG:boto:Token: None 2024-04-16T18:33:00.851 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.851 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.851 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.854 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000843b65e79e533e98-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.854 DEBUG:boto:b'cjqttm-53obj441000falseobj442024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.854 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.854 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.855 DEBUG:boto:path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.855 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.855 DEBUG:boto:Method: GET 2024-04-16T18:33:00.855 DEBUG:boto:Path: /cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.855 DEBUG:boto:Data: 2024-04-16T18:33:00.855 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.855 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.855 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.855 DEBUG:boto:Params: {} 2024-04-16T18:33:00.855 DEBUG:boto:Token: None 2024-04-16T18:33:00.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.856 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.858 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c8ea73940d12f40-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.858 DEBUG:boto:b'cjqttm-53obj441000falseobj442024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.858 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.858 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.859 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.859 DEBUG:boto:Path: /cjqttm-53/obj44 2024-04-16T18:33:00.859 DEBUG:boto:Data: 2024-04-16T18:33:00.859 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.859 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.859 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.859 DEBUG:boto:Params: {} 2024-04-16T18:33:00.859 DEBUG:boto:Token: None 2024-04-16T18:33:00.859 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44 2024-04-16T18:33:00.859 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uHPQWJsv38Vt/z5FyR9nqKAX1ms= 2024-04-16T18:33:00.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uHPQWJsv38Vt/z5FyR9nqKAX1ms=', 'Content-Length': '0'} 2024-04-16T18:33:00.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d74fc29c0dc7d22-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.862 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.862 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.862 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.862 DEBUG:boto:Path: /cjqttm-53/obj44 2024-04-16T18:33:00.862 DEBUG:boto:Data: 2024-04-16T18:33:00.862 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.863 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.863 DEBUG:boto:Params: {} 2024-04-16T18:33:00.863 DEBUG:boto:Token: None 2024-04-16T18:33:00.863 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44 2024-04-16T18:33:00.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uHPQWJsv38Vt/z5FyR9nqKAX1ms= 2024-04-16T18:33:00.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uHPQWJsv38Vt/z5FyR9nqKAX1ms=', 'Content-Length': '0'} 2024-04-16T18:33:00.865 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008f63de918dc6b31-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:33:00.865 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.865 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.865 DEBUG:boto:Method: GET 2024-04-16T18:33:00.866 DEBUG:boto:Path: /cjqttm-53/obj44 2024-04-16T18:33:00.866 DEBUG:boto:Data: 2024-04-16T18:33:00.866 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.866 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.866 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.866 DEBUG:boto:Params: {} 2024-04-16T18:33:00.866 DEBUG:boto:Token: None 2024-04-16T18:33:00.866 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44 2024-04-16T18:33:00.866 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OzvPFZ95kmvzDrQCH6WLkprZw5E= 2024-04-16T18:33:00.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OzvPFZ95kmvzDrQCH6WLkprZw5E=', 'Content-Length': '0'} 2024-04-16T18:33:00.868 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029cd0e020371c0c0-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.910 DEBUG:boto:path=/cjqttm-53/obj44 2024-04-16T18:33:00.910 DEBUG:boto:auth_path=/cjqttm-53/obj44 2024-04-16T18:33:00.911 DEBUG:boto:Method: GET 2024-04-16T18:33:00.911 DEBUG:boto:Path: /cjqttm-53/obj44 2024-04-16T18:33:00.911 DEBUG:boto:Data: 2024-04-16T18:33:00.911 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.911 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.911 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.911 DEBUG:boto:Params: {} 2024-04-16T18:33:00.911 DEBUG:boto:Token: None 2024-04-16T18:33:00.911 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj44 2024-04-16T18:33:00.912 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OzvPFZ95kmvzDrQCH6WLkprZw5E= 2024-04-16T18:33:00.912 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OzvPFZ95kmvzDrQCH6WLkprZw5E=', 'Content-Length': '0'} 2024-04-16T18:33:00.913 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000be190461c07c3a82-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.913 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.914 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.914 DEBUG:boto:path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.914 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.914 DEBUG:boto:Method: GET 2024-04-16T18:33:00.914 DEBUG:boto:Path: /cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.914 DEBUG:boto:Data: 2024-04-16T18:33:00.914 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.914 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.914 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.914 DEBUG:boto:Params: {} 2024-04-16T18:33:00.915 DEBUG:boto:Token: None 2024-04-16T18:33:00.915 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.915 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.917 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090796fc3e74dfa64-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.917 DEBUG:boto:b'cjqttm-53obj441000falseobj442024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.918 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:00.918 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:00.918 DEBUG:boto:path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.918 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.918 DEBUG:boto:Method: GET 2024-04-16T18:33:00.918 DEBUG:boto:Path: /cjqttm-53/?prefix=obj44 2024-04-16T18:33:00.918 DEBUG:boto:Data: 2024-04-16T18:33:00.918 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.919 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.919 DEBUG:boto:Params: {} 2024-04-16T18:33:00.919 DEBUG:boto:Token: None 2024-04-16T18:33:00.919 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/ 2024-04-16T18:33:00.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY= 2024-04-16T18:33:00.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZxzdQeQACCOm7T/ekzZaQwp4IUY=', 'Content-Length': '0'} 2024-04-16T18:33:00.921 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e954199b7b82c21-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.921 DEBUG:boto:b'cjqttm-53obj441000falseobj442024-04-16T18:30:43.531Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:00.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:33:00.922 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:00.922 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:00.922 DEBUG:boto:path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.922 DEBUG:boto:auth_path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.922 DEBUG:boto:Method: GET 2024-04-16T18:33:00.922 DEBUG:boto:Path: /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.923 DEBUG:boto:Data: 2024-04-16T18:33:00.923 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.923 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.923 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.923 DEBUG:boto:Params: {} 2024-04-16T18:33:00.923 DEBUG:boto:Token: None 2024-04-16T18:33:00.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5CoyUV/0tuqJmo/CBBlvy6cMrTU= 2024-04-16T18:33:00.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5CoyUV/0tuqJmo/CBBlvy6cMrTU=', 'Content-Length': '0'} 2024-04-16T18:33:00.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d4b7654355d83ab1-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.966 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:00.966 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:00.967 DEBUG:boto:path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.967 DEBUG:boto:auth_path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.967 DEBUG:boto:Method: GET 2024-04-16T18:33:00.967 DEBUG:boto:Path: /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.967 DEBUG:boto:Data: 2024-04-16T18:33:00.967 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.967 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.967 DEBUG:boto:Params: {} 2024-04-16T18:33:00.967 DEBUG:boto:Token: None 2024-04-16T18:33:00.967 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5CoyUV/0tuqJmo/CBBlvy6cMrTU= 2024-04-16T18:33:00.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5CoyUV/0tuqJmo/CBBlvy6cMrTU=', 'Content-Length': '0'} 2024-04-16T18:33:00.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d1a1d05c667dbd4-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.970 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:00.970 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:00.970 DEBUG:boto:path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.970 DEBUG:boto:auth_path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.970 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.970 DEBUG:boto:Path: /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.970 DEBUG:boto:Data: 2024-04-16T18:33:00.971 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.971 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.971 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.971 DEBUG:boto:Params: {} 2024-04-16T18:33:00.971 DEBUG:boto:Token: None 2024-04-16T18:33:00.971 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:svvP8SLI1kSCabIuOHpcl9Qhe0A= 2024-04-16T18:33:00.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:svvP8SLI1kSCabIuOHpcl9Qhe0A=', 'Content-Length': '0'} 2024-04-16T18:33:00.973 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d43154e814b8ad34-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.973 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:00.973 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:00.974 DEBUG:boto:path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.974 DEBUG:boto:auth_path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.974 DEBUG:boto:Method: HEAD 2024-04-16T18:33:00.974 DEBUG:boto:Path: /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.974 DEBUG:boto:Data: 2024-04-16T18:33:00.974 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.974 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:00.974 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.974 DEBUG:boto:Params: {} 2024-04-16T18:33:00.974 DEBUG:boto:Token: None 2024-04-16T18:33:00.975 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:svvP8SLI1kSCabIuOHpcl9Qhe0A= 2024-04-16T18:33:00.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:svvP8SLI1kSCabIuOHpcl9Qhe0A=', 'Content-Length': '0'} 2024-04-16T18:33:00.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030910194bdba2789-00661ec45c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:00.977 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:33:00.977 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:00.977 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:00.977 DEBUG:boto:path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.977 DEBUG:boto:auth_path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.977 DEBUG:boto:Method: GET 2024-04-16T18:33:00.977 DEBUG:boto:Path: /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.977 DEBUG:boto:Data: 2024-04-16T18:33:00.977 DEBUG:boto:Headers: {} 2024-04-16T18:33:00.978 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:00.978 DEBUG:boto:Port: 8000 2024-04-16T18:33:00.978 DEBUG:boto:Params: {} 2024-04-16T18:33:00.978 DEBUG:boto:Token: None 2024-04-16T18:33:00.978 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:00 GMT /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:00.978 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5CoyUV/0tuqJmo/CBBlvy6cMrTU= 2024-04-16T18:33:00.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5CoyUV/0tuqJmo/CBBlvy6cMrTU=', 'Content-Length': '0'} 2024-04-16T18:33:00.980 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0119c09a7f35d28-00661ec45c-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.022 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:01.022 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:01.023 DEBUG:boto:path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:01.023 DEBUG:boto:auth_path=/cjqttm-53/obj55?versionId=null 2024-04-16T18:33:01.023 DEBUG:boto:Method: GET 2024-04-16T18:33:01.023 DEBUG:boto:Path: /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:01.023 DEBUG:boto:Data: 2024-04-16T18:33:01.023 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:01.023 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.023 DEBUG:boto:Params: {} 2024-04-16T18:33:01.023 DEBUG:boto:Token: None 2024-04-16T18:33:01.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/obj55?versionId=null 2024-04-16T18:33:01.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wQrmv9tZwLzIRbUWUJnvtEBPSq0= 2024-04-16T18:33:01.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wQrmv9tZwLzIRbUWUJnvtEBPSq0=', 'Content-Length': '0'} 2024-04-16T18:33:01.026 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067010f5a512b2fe9-00661ec45d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.026 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:01.026 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:01.026 DEBUG:boto:path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.026 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.026 DEBUG:boto:Method: GET 2024-04-16T18:33:01.027 DEBUG:boto:Path: /cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.027 DEBUG:boto:Data: 2024-04-16T18:33:01.027 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.027 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:01.027 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.027 DEBUG:boto:Params: {} 2024-04-16T18:33:01.027 DEBUG:boto:Token: None 2024-04-16T18:33:01.027 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/ 2024-04-16T18:33:01.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4= 2024-04-16T18:33:01.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4=', 'Content-Length': '0'} 2024-04-16T18:33:01.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006f35af4d9e3b0f37-00661ec45d-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.030 DEBUG:boto:b'cjqttm-53obj551000falseobj552024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:01.031 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:01.031 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:01.031 DEBUG:boto:path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.031 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.031 DEBUG:boto:Method: GET 2024-04-16T18:33:01.031 DEBUG:boto:Path: /cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.031 DEBUG:boto:Data: 2024-04-16T18:33:01.032 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.032 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:01.032 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.032 DEBUG:boto:Params: {} 2024-04-16T18:33:01.032 DEBUG:boto:Token: None 2024-04-16T18:33:01.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/ 2024-04-16T18:33:01.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4= 2024-04-16T18:33:01.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4=', 'Content-Length': '0'} 2024-04-16T18:33:01.035 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000de8b1b5803376432-00661ec45d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.035 DEBUG:boto:b'cjqttm-53obj551000falseobj552024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:01.035 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:01.035 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:01.035 DEBUG:boto:Method: HEAD 2024-04-16T18:33:01.035 DEBUG:boto:Path: /cjqttm-53/obj55 2024-04-16T18:33:01.036 DEBUG:boto:Data: 2024-04-16T18:33:01.036 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.036 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:01.036 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.036 DEBUG:boto:Params: {} 2024-04-16T18:33:01.036 DEBUG:boto:Token: None 2024-04-16T18:33:01.036 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/obj55 2024-04-16T18:33:01.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RV/cWHMjHh2+PoB2v82wzhlKnuI= 2024-04-16T18:33:01.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RV/cWHMjHh2+PoB2v82wzhlKnuI=', 'Content-Length': '0'} 2024-04-16T18:33:01.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd2d1102bebe431a-00661ec45d-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.039 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:01.039 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:01.039 DEBUG:boto:Method: HEAD 2024-04-16T18:33:01.039 DEBUG:boto:Path: /cjqttm-53/obj55 2024-04-16T18:33:01.039 DEBUG:boto:Data: 2024-04-16T18:33:01.039 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:01.039 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.039 DEBUG:boto:Params: {} 2024-04-16T18:33:01.039 DEBUG:boto:Token: None 2024-04-16T18:33:01.040 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/obj55 2024-04-16T18:33:01.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RV/cWHMjHh2+PoB2v82wzhlKnuI= 2024-04-16T18:33:01.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RV/cWHMjHh2+PoB2v82wzhlKnuI=', 'Content-Length': '0'} 2024-04-16T18:33:01.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071266fe4606001db-00661ec45d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.042 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:33:01.042 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:01.042 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:01.042 DEBUG:boto:Method: GET 2024-04-16T18:33:01.042 DEBUG:boto:Path: /cjqttm-53/obj55 2024-04-16T18:33:01.042 DEBUG:boto:Data: 2024-04-16T18:33:01.043 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:01.043 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.043 DEBUG:boto:Params: {} 2024-04-16T18:33:01.043 DEBUG:boto:Token: None 2024-04-16T18:33:01.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/obj55 2024-04-16T18:33:01.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w1G8T5qpQ0SE8DM382VEAFbUIHM= 2024-04-16T18:33:01.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w1G8T5qpQ0SE8DM382VEAFbUIHM=', 'Content-Length': '0'} 2024-04-16T18:33:01.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-53:9ba59572-f51c-4bce-9578-e6350e822996.4816.22'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:30:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000099c78b140fdbd90f-00661ec45d-6236-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.086 DEBUG:boto:path=/cjqttm-53/obj55 2024-04-16T18:33:01.086 DEBUG:boto:auth_path=/cjqttm-53/obj55 2024-04-16T18:33:01.087 DEBUG:boto:Method: GET 2024-04-16T18:33:01.087 DEBUG:boto:Path: /cjqttm-53/obj55 2024-04-16T18:33:01.087 DEBUG:boto:Data: 2024-04-16T18:33:01.087 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:01.087 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.087 DEBUG:boto:Params: {} 2024-04-16T18:33:01.087 DEBUG:boto:Token: None 2024-04-16T18:33:01.087 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/obj55 2024-04-16T18:33:01.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w1G8T5qpQ0SE8DM382VEAFbUIHM= 2024-04-16T18:33:01.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w1G8T5qpQ0SE8DM382VEAFbUIHM=', 'Content-Length': '0'} 2024-04-16T18:33:01.090 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:30:43 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002558e661c9972649-00661ec45d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.090 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:01.090 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:01.090 DEBUG:boto:path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.090 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.090 DEBUG:boto:Method: GET 2024-04-16T18:33:01.091 DEBUG:boto:Path: /cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.091 DEBUG:boto:Data: 2024-04-16T18:33:01.091 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.091 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:01.091 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.091 DEBUG:boto:Params: {} 2024-04-16T18:33:01.091 DEBUG:boto:Token: None 2024-04-16T18:33:01.091 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/ 2024-04-16T18:33:01.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4= 2024-04-16T18:33:01.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4=', 'Content-Length': '0'} 2024-04-16T18:33:01.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009d56b500d9b40dc-00661ec45d-6236-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.094 DEBUG:boto:b'cjqttm-53obj551000falseobj552024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:01.094 DEBUG:boto:path=/cjqttm-53/ 2024-04-16T18:33:01.094 DEBUG:boto:auth_path=/cjqttm-53/ 2024-04-16T18:33:01.095 DEBUG:boto:path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.095 DEBUG:boto:auth_path=/cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.095 DEBUG:boto:Method: GET 2024-04-16T18:33:01.095 DEBUG:boto:Path: /cjqttm-53/?prefix=obj55 2024-04-16T18:33:01.095 DEBUG:boto:Data: 2024-04-16T18:33:01.095 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:01.095 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.095 DEBUG:boto:Params: {} 2024-04-16T18:33:01.095 DEBUG:boto:Token: None 2024-04-16T18:33:01.095 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-53/ 2024-04-16T18:33:01.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4= 2024-04-16T18:33:01.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JBJ88fvz9OrPRi7OusR4Sq50bP4=', 'Content-Length': '0'} 2024-04-16T18:33:01.098 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000514486360e7dc790-00661ec45d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.098 DEBUG:boto:b'cjqttm-53obj551000falseobj552024-04-16T18:30:43.543Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:33:01.098 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-53 zones={test-zone2, test-zone1} 2024-04-16T18:33:01.099 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T18:33:01.099 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.099 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:33:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:01.153 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:01.241 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000021556","last_update":"2024-04-16T18:27:48.281364Z"},{"marker":"00000000000000000000:00000000000000033242","last_update":"2024-04-16T18:30:43.535882Z"},{"marker":"00000000000000000000:00000000000000029298","last_update":"2024-04-16T18:30:51.684097Z"},{"marker":"00000000000000000000:00000000000000028217","last_update":"2024-04-16T18:30:51.686358Z"}] 2024-04-16T18:33:01.241 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000021556', 1: '00000000000000000000:00000000000000033242', 2: '00000000000000000000:00000000000000029298', 3: '00000000000000000000:00000000000000028217'} 2024-04-16T18:33:01.241 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:33:01.241 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.242 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:33:01.299 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:01.299 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:01.381 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4842221663108949279},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000021556","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:27:48.281364Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033242","next_step_marker":"","total_entries":44,"pos":0,"timestamp":"2024-04-16T18:30:43.535882Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000029298","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:30:51.684097Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000028217","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:30:51.686358Z"}}]},"full_sync":{"total":53,"complete":53},"current_time":"2024-04-16T18:33:01Z"} 2024-04-16T18:33:01.381 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":4842221663108949279},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000021556","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:27:48.281364Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000033242","next_step_marker":"","total_entries":44,"pos":0,"timestamp":"2024-04-16T18:30:43.535882Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000029298","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:30:51.684097Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000028217","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:30:51.686358Z"}}]},"full_sync":{"total":53,"complete":53},"current_time":"2024-04-16T18:33:01Z"} 2024-04-16T18:33:01.381 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000021556', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:27:48.281364Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000033242', 'next_step_marker': '', 'total_entries': 44, 'pos': 0, 'timestamp': '2024-04-16T18:30:43.535882Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000029298', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:30:51.684097Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000028217', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:30:51.686358Z'}}] 2024-04-16T18:33:01.382 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000021556', 1: '00000000000000000000:00000000000000033242', 2: '00000000000000000000:00000000000000029298', 3: '00000000000000000000:00000000000000028217'} 2024-04-16T18:33:01.382 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000021556', 1: '00000000000000000000:00000000000000033242', 2: '00000000000000000000:00000000000000029298', 3: '00000000000000000000:00000000000000028217'} 2024-04-16T18:33:01.382 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:33:01.382 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T18:33:01.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.382 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:33:01.429 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:01.429 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:01.511 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000007125","last_update":"2024-04-16T18:29:05.975828Z"},{"marker":"00000000000000000000:00000000000000015992","last_update":"2024-04-16T18:30:56.302830Z"},{"marker":"00000000000000000000:00000000000000016005","last_update":"2024-04-16T18:31:05.874012Z"},{"marker":"00000000000000000000:00000000000000012656","last_update":"2024-04-16T18:31:51.253081Z"}] 2024-04-16T18:33:01.511 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000007125', 1: '00000000000000000000:00000000000000015992', 2: '00000000000000000000:00000000000000016005', 3: '00000000000000000000:00000000000000012656'} 2024-04-16T18:33:01.512 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:33:01.512 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.512 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.512 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:33:01.564 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:01.564 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:01.642 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007125","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:29:05.975828Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000015992","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:30:56.302830Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016005","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:31:05.874012Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012656","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:31:51.253081Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:33:01Z"} 2024-04-16T18:33:01.642 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007125","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:29:05.975828Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000015992","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:30:56.302830Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016005","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:31:05.874012Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000012656","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:31:51.253081Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:33:01Z"} 2024-04-16T18:33:01.642 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007125', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T18:29:05.975828Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000015992', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:30:56.302830Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000016005', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:31:05.874012Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000012656', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:31:51.253081Z'}}] 2024-04-16T18:33:01.642 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000007125', 1: '00000000000000000000:00000000000000015992', 2: '00000000000000000000:00000000000000016005', 3: '00000000000000000000:00000000000000012656'} 2024-04-16T18:33:01.642 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000007125', 1: '00000000000000000000:00000000000000015992', 2: '00000000000000000000:00000000000000016005', 3: '00000000000000000000:00000000000000012656'} 2024-04-16T18:33:01.642 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:33:01.643 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_full_sync_after_data_sync_init ... ok 2024-04-16T18:33:01.644 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:01.645 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:01.645 DEBUG:boto:Method: PUT 2024-04-16T18:33:01.645 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:01.645 DEBUG:boto:Data: 2024-04-16T18:33:01.645 DEBUG:boto:Headers: {} 2024-04-16T18:33:01.645 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:01.645 DEBUG:boto:Port: 8000 2024-04-16T18:33:01.645 DEBUG:boto:Params: {} 2024-04-16T18:33:01.645 DEBUG:boto:Token: None 2024-04-16T18:33:01.646 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:33:01 GMT /cjqttm-54/ 2024-04-16T18:33:01.646 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+DZ8+DcKkifCHAUcY31UFn6Kykk= 2024-04-16T18:33:01.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:01 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+DZ8+DcKkifCHAUcY31UFn6Kykk=', 'Content-Length': '0'} 2024-04-16T18:33:01.663 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000002b130c40b2c73b9f-00661ec45d-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:01 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:01.663 DEBUG:rgw_multi.tests:created bucket=cjqttm-54 2024-04-16T18:33:01.664 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.664 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:33:01.710 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:01.710 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:01.761 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:33:01.784 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713292381.662852_1399.1","last_update":"2024-04-16T18:33:01.662852Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:33:01.784 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292381.662852_1399.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:33:01.784 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:33:01.785 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.785 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:33:01.785 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:33:01.834 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:01.834 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:01.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:01.888+0000 7f6325e0f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:33:01.888 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:01.889+0000 7f6325e0f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:33:01.911 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292381.662852_1399.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:33:01.662852Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:33:01Z"} 2024-04-16T18:33:01.911 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292381.662852_1399.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:33:01.662852Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:33:01Z"} 2024-04-16T18:33:01.911 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292381.662852_1399.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:33:01.662852Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:33:01.911 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292381.662852_1399.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:33:01.911 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292381.662852_1399.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:33:01.912 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:33:01.912 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:33:01.912 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:33:01.913 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:33:01.914+0000 7f6649c7c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 204536) UID: 0 2024-04-16T18:33:01.913 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:33:01.914+0000 7f664f80f880 -1 shutting down 2024-04-16T18:33:05.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:33:08.014 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:33:08.014 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.014 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.014 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.014 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.015 DEBUG:boto:Data: 2024-04-16T18:33:08.015 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.015 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.015 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.015 DEBUG:boto:Params: {} 2024-04-16T18:33:08.015 DEBUG:boto:Token: None 2024-04-16T18:33:08.015 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.015 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.016 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.018 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001efa9dc4b32dcb5f-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.018 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:33:08.018 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:33:08.019 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.019 DEBUG:boto:Path: /cjqttm-54/obj11 2024-04-16T18:33:08.019 DEBUG:boto:Data: 2024-04-16T18:33:08.019 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.019 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.019 DEBUG:boto:Params: {} 2024-04-16T18:33:08.019 DEBUG:boto:Token: None 2024-04-16T18:33:08.019 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj11 2024-04-16T18:33:08.019 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2DGhj0elpk2DUMq5NJkkWtxKN9s= 2024-04-16T18:33:08.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2DGhj0elpk2DUMq5NJkkWtxKN9s='} 2024-04-16T18:33:08.028 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c4fcb91243c50fbf-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.028 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.029 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.029 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.029 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.029 DEBUG:boto:Data: 2024-04-16T18:33:08.029 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.029 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.029 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.029 DEBUG:boto:Params: {} 2024-04-16T18:33:08.029 DEBUG:boto:Token: None 2024-04-16T18:33:08.029 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.030 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.032 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000088b7f1cb25e91d75-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.032 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:33:08.032 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:33:08.032 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.032 DEBUG:boto:Path: /cjqttm-54/obj22 2024-04-16T18:33:08.032 DEBUG:boto:Data: 2024-04-16T18:33:08.033 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.033 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.033 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.033 DEBUG:boto:Params: {} 2024-04-16T18:33:08.033 DEBUG:boto:Token: None 2024-04-16T18:33:08.033 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj22 2024-04-16T18:33:08.033 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6cKwYSDBpuO71HEA3c/NR6XxU8M= 2024-04-16T18:33:08.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6cKwYSDBpuO71HEA3c/NR6XxU8M='} 2024-04-16T18:33:08.038 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000035fb96b258d7a1c4-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.038 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.038 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.038 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.038 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.038 DEBUG:boto:Data: 2024-04-16T18:33:08.038 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.038 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.039 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.039 DEBUG:boto:Params: {} 2024-04-16T18:33:08.039 DEBUG:boto:Token: None 2024-04-16T18:33:08.039 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.041 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005da851d7b48a971a-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.041 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:33:08.042 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:33:08.042 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.042 DEBUG:boto:Path: /cjqttm-54/obj33 2024-04-16T18:33:08.042 DEBUG:boto:Data: 2024-04-16T18:33:08.042 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.042 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.042 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.042 DEBUG:boto:Params: {} 2024-04-16T18:33:08.042 DEBUG:boto:Token: None 2024-04-16T18:33:08.043 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj33 2024-04-16T18:33:08.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eCTiYLFni9yzq0FngP4jaMT+Hl0= 2024-04-16T18:33:08.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eCTiYLFni9yzq0FngP4jaMT+Hl0='} 2024-04-16T18:33:08.086 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000727466792617479e-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.087 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.087 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.087 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.087 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.087 DEBUG:boto:Data: 2024-04-16T18:33:08.087 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.087 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.087 DEBUG:boto:Params: {} 2024-04-16T18:33:08.087 DEBUG:boto:Token: None 2024-04-16T18:33:08.088 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.090 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ce00b0cb66aea11e-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.090 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:33:08.090 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:33:08.090 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.090 DEBUG:boto:Path: /cjqttm-54/obj44 2024-04-16T18:33:08.090 DEBUG:boto:Data: 2024-04-16T18:33:08.090 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.090 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.091 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.091 DEBUG:boto:Params: {} 2024-04-16T18:33:08.091 DEBUG:boto:Token: None 2024-04-16T18:33:08.091 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj44 2024-04-16T18:33:08.091 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:x04NfU5PkJoWZjUqAqaY/la1xbM= 2024-04-16T18:33:08.091 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x04NfU5PkJoWZjUqAqaY/la1xbM='} 2024-04-16T18:33:08.097 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005fb07034f26cf711-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.097 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.098 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.098 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.098 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.098 DEBUG:boto:Data: 2024-04-16T18:33:08.098 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.098 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.098 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.098 DEBUG:boto:Params: {} 2024-04-16T18:33:08.098 DEBUG:boto:Token: None 2024-04-16T18:33:08.098 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.098 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.101 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f18f3d6a1fd8c88d-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.101 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:33:08.101 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:33:08.101 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.101 DEBUG:boto:Path: /cjqttm-54/obj55 2024-04-16T18:33:08.101 DEBUG:boto:Data: 2024-04-16T18:33:08.101 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.101 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.101 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.102 DEBUG:boto:Params: {} 2024-04-16T18:33:08.102 DEBUG:boto:Token: None 2024-04-16T18:33:08.102 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj55 2024-04-16T18:33:08.102 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3lE4BGd4+HSMMLwfakroXCZOeKc= 2024-04-16T18:33:08.102 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3lE4BGd4+HSMMLwfakroXCZOeKc='} 2024-04-16T18:33:08.106 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000037a74c02b2444b7-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.107 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:08.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:08.107 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-54 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:33:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:08.163 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:08.234 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:33:08.234 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-54 2024-04-16T18:33:08.239 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 5 2024-04-16T18:33:08.292 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.292 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.292 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.292 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.292 DEBUG:boto:Data: 2024-04-16T18:33:08.292 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.292 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.293 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.293 DEBUG:boto:Params: {} 2024-04-16T18:33:08.293 DEBUG:boto:Token: None 2024-04-16T18:33:08.293 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.296 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f7898e30f1960aa-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.296 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:33:08.296 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:33:08.296 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.296 DEBUG:boto:Path: /cjqttm-54/obj17 2024-04-16T18:33:08.296 DEBUG:boto:Data: 2024-04-16T18:33:08.297 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.297 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.297 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.297 DEBUG:boto:Params: {} 2024-04-16T18:33:08.297 DEBUG:boto:Token: None 2024-04-16T18:33:08.297 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj17 2024-04-16T18:33:08.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9BGyY8pEN6XclE3Glc9f7uBxf9I= 2024-04-16T18:33:08.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9BGyY8pEN6XclE3Glc9f7uBxf9I='} 2024-04-16T18:33:08.338 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001a2adc667f2c859e-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.339 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.339 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.339 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.339 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.339 DEBUG:boto:Data: 2024-04-16T18:33:08.339 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.339 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.339 DEBUG:boto:Params: {} 2024-04-16T18:33:08.339 DEBUG:boto:Token: None 2024-04-16T18:33:08.340 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.342 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d52fe8f62412a445-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.343 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:33:08.343 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:33:08.343 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.343 DEBUG:boto:Path: /cjqttm-54/obj34 2024-04-16T18:33:08.343 DEBUG:boto:Data: 2024-04-16T18:33:08.343 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.343 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.343 DEBUG:boto:Params: {} 2024-04-16T18:33:08.343 DEBUG:boto:Token: None 2024-04-16T18:33:08.344 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj34 2024-04-16T18:33:08.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:r6rq/xpWH7L6RTW+cXTKDPfjSCA= 2024-04-16T18:33:08.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:r6rq/xpWH7L6RTW+cXTKDPfjSCA='} 2024-04-16T18:33:08.349 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eaf6c5c6b28d8206-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.349 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.349 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.349 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.349 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.349 DEBUG:boto:Data: 2024-04-16T18:33:08.350 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.350 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.350 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.350 DEBUG:boto:Params: {} 2024-04-16T18:33:08.350 DEBUG:boto:Token: None 2024-04-16T18:33:08.350 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.352 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b2aa68c458e19ac1-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.353 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:33:08.353 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:33:08.353 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.353 DEBUG:boto:Path: /cjqttm-54/obj51 2024-04-16T18:33:08.353 DEBUG:boto:Data: 2024-04-16T18:33:08.353 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.353 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.353 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.353 DEBUG:boto:Params: {} 2024-04-16T18:33:08.354 DEBUG:boto:Token: None 2024-04-16T18:33:08.354 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj51 2024-04-16T18:33:08.354 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tXAdDYhXiVmapxFyExZ4PqjLlfg= 2024-04-16T18:33:08.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tXAdDYhXiVmapxFyExZ4PqjLlfg='} 2024-04-16T18:33:08.359 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000c8a2fabd6571a3b-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.359 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.359 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.359 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.360 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.360 DEBUG:boto:Data: 2024-04-16T18:33:08.360 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.360 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.360 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.360 DEBUG:boto:Params: {} 2024-04-16T18:33:08.360 DEBUG:boto:Token: None 2024-04-16T18:33:08.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.363 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f10a46c9ef359dc5-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.363 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:33:08.363 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:33:08.363 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.363 DEBUG:boto:Path: /cjqttm-54/obj68 2024-04-16T18:33:08.363 DEBUG:boto:Data: 2024-04-16T18:33:08.363 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.364 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.364 DEBUG:boto:Params: {} 2024-04-16T18:33:08.364 DEBUG:boto:Token: None 2024-04-16T18:33:08.364 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj68 2024-04-16T18:33:08.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:F+QLrzquy/UXQ1mkTryiU5GrIyI= 2024-04-16T18:33:08.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:F+QLrzquy/UXQ1mkTryiU5GrIyI='} 2024-04-16T18:33:08.406 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000041b6a325744861b1-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.407 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.407 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.407 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.407 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.407 DEBUG:boto:Data: 2024-04-16T18:33:08.407 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.407 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.407 DEBUG:boto:Params: {} 2024-04-16T18:33:08.407 DEBUG:boto:Token: None 2024-04-16T18:33:08.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.410 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000abc477902ffbfd00-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.410 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:33:08.410 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:33:08.411 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.411 DEBUG:boto:Path: /cjqttm-54/obj85 2024-04-16T18:33:08.411 DEBUG:boto:Data: 2024-04-16T18:33:08.411 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.411 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.411 DEBUG:boto:Params: {} 2024-04-16T18:33:08.411 DEBUG:boto:Token: None 2024-04-16T18:33:08.411 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj85 2024-04-16T18:33:08.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mcqZANVmOgeVid6gYdUFa+A9X5U= 2024-04-16T18:33:08.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mcqZANVmOgeVid6gYdUFa+A9X5U='} 2024-04-16T18:33:08.417 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000820c7a9e7a5cde41-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.417 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:08.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:08.417 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-54 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:33:08.469 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:08.469 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:33:08.539 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-54 2024-04-16T18:33:08.546 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 10 2024-04-16T18:33:08.603 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.604 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.604 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.604 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.604 DEBUG:boto:Data: 2024-04-16T18:33:08.604 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.604 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.604 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.604 DEBUG:boto:Params: {} 2024-04-16T18:33:08.604 DEBUG:boto:Token: None 2024-04-16T18:33:08.604 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.605 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.607 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000039a1c891f2676e9d-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.607 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:33:08.608 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:33:08.608 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.608 DEBUG:boto:Path: /cjqttm-54/obj19 2024-04-16T18:33:08.608 DEBUG:boto:Data: 2024-04-16T18:33:08.608 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.608 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.608 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.608 DEBUG:boto:Params: {} 2024-04-16T18:33:08.608 DEBUG:boto:Token: None 2024-04-16T18:33:08.608 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj19 2024-04-16T18:33:08.609 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O2xGBpw03/i8Bss2eBWiGxHicAY= 2024-04-16T18:33:08.609 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O2xGBpw03/i8Bss2eBWiGxHicAY='} 2024-04-16T18:33:08.614 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009767c6b75eb1be63-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.614 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.614 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.614 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.615 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.615 DEBUG:boto:Data: 2024-04-16T18:33:08.615 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.615 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.615 DEBUG:boto:Params: {} 2024-04-16T18:33:08.615 DEBUG:boto:Token: None 2024-04-16T18:33:08.615 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.617 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008cec692636273313-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.618 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:33:08.618 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:33:08.618 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.618 DEBUG:boto:Path: /cjqttm-54/obj38 2024-04-16T18:33:08.618 DEBUG:boto:Data: 2024-04-16T18:33:08.618 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.618 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.618 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.618 DEBUG:boto:Params: {} 2024-04-16T18:33:08.619 DEBUG:boto:Token: None 2024-04-16T18:33:08.619 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj38 2024-04-16T18:33:08.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DWtL9inb3FilbFV1JOb6b3k1M/g= 2024-04-16T18:33:08.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DWtL9inb3FilbFV1JOb6b3k1M/g='} 2024-04-16T18:33:08.662 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000091b0d7469b49aedc-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.663 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.663 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.663 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.663 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.663 DEBUG:boto:Data: 2024-04-16T18:33:08.663 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.663 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.663 DEBUG:boto:Params: {} 2024-04-16T18:33:08.664 DEBUG:boto:Token: None 2024-04-16T18:33:08.664 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.666 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b7f77d9052ce0729-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.666 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:33:08.666 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:33:08.667 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.667 DEBUG:boto:Path: /cjqttm-54/obj57 2024-04-16T18:33:08.667 DEBUG:boto:Data: 2024-04-16T18:33:08.667 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.667 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.667 DEBUG:boto:Params: {} 2024-04-16T18:33:08.667 DEBUG:boto:Token: None 2024-04-16T18:33:08.667 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj57 2024-04-16T18:33:08.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8mTaNFS/dyWGNHRF60LyEZYlFVA= 2024-04-16T18:33:08.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8mTaNFS/dyWGNHRF60LyEZYlFVA='} 2024-04-16T18:33:08.671 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c4f63de4f1025b1-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.672 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.672 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.672 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.672 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.672 DEBUG:boto:Data: 2024-04-16T18:33:08.672 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.672 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.672 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.672 DEBUG:boto:Params: {} 2024-04-16T18:33:08.672 DEBUG:boto:Token: None 2024-04-16T18:33:08.673 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.675 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000020cd08e4e6d2247d-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.675 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:33:08.675 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:33:08.675 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.675 DEBUG:boto:Path: /cjqttm-54/obj76 2024-04-16T18:33:08.676 DEBUG:boto:Data: 2024-04-16T18:33:08.676 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.676 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.676 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.676 DEBUG:boto:Params: {} 2024-04-16T18:33:08.676 DEBUG:boto:Token: None 2024-04-16T18:33:08.676 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj76 2024-04-16T18:33:08.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LJQalO0SotJA0DG9tie59EtymhY= 2024-04-16T18:33:08.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LJQalO0SotJA0DG9tie59EtymhY='} 2024-04-16T18:33:08.718 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000075016fa88e8f4077-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.719 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.719 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.719 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.719 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.719 DEBUG:boto:Data: 2024-04-16T18:33:08.719 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.719 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.719 DEBUG:boto:Params: {} 2024-04-16T18:33:08.719 DEBUG:boto:Token: None 2024-04-16T18:33:08.720 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.722 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b02f637aad9d32d1-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.722 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:33:08.722 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:33:08.722 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.723 DEBUG:boto:Path: /cjqttm-54/obj95 2024-04-16T18:33:08.723 DEBUG:boto:Data: 2024-04-16T18:33:08.723 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.723 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.723 DEBUG:boto:Params: {} 2024-04-16T18:33:08.723 DEBUG:boto:Token: None 2024-04-16T18:33:08.723 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj95 2024-04-16T18:33:08.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hItJgXhEYHsSD9yf1H9NQhSvDgA= 2024-04-16T18:33:08.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hItJgXhEYHsSD9yf1H9NQhSvDgA='} 2024-04-16T18:33:08.727 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000026b6ce3abc60376a-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.727 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:08.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:08.728 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-54 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:33:08.778 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:08.778 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:08.847 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:33:08.847 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-54 2024-04-16T18:33:08.855 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 15 2024-04-16T18:33:08.915 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.915 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.915 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.915 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.915 DEBUG:boto:Data: 2024-04-16T18:33:08.915 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.915 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.915 DEBUG:boto:Params: {} 2024-04-16T18:33:08.916 DEBUG:boto:Token: None 2024-04-16T18:33:08.916 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.918 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002f0c3f78de090b5-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.919 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:33:08.919 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:33:08.919 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.919 DEBUG:boto:Path: /cjqttm-54/obj23 2024-04-16T18:33:08.919 DEBUG:boto:Data: 2024-04-16T18:33:08.919 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.919 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.919 DEBUG:boto:Params: {} 2024-04-16T18:33:08.920 DEBUG:boto:Token: None 2024-04-16T18:33:08.920 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj23 2024-04-16T18:33:08.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zEtDZe8fXAPeqcgrSQCFUMGCCKw= 2024-04-16T18:33:08.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zEtDZe8fXAPeqcgrSQCFUMGCCKw='} 2024-04-16T18:33:08.925 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c0c10f6982b4c733-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.925 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.925 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.925 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.925 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.925 DEBUG:boto:Data: 2024-04-16T18:33:08.926 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.926 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.926 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.926 DEBUG:boto:Params: {} 2024-04-16T18:33:08.926 DEBUG:boto:Token: None 2024-04-16T18:33:08.926 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.928 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004bb0e45465fa9229-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.929 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:33:08.929 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:33:08.929 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.929 DEBUG:boto:Path: /cjqttm-54/obj46 2024-04-16T18:33:08.929 DEBUG:boto:Data: 2024-04-16T18:33:08.929 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.929 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.929 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.929 DEBUG:boto:Params: {} 2024-04-16T18:33:08.930 DEBUG:boto:Token: None 2024-04-16T18:33:08.930 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj46 2024-04-16T18:33:08.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:J8I4BzreO0WK4LL+40Duz5EmssM= 2024-04-16T18:33:08.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:J8I4BzreO0WK4LL+40Duz5EmssM='} 2024-04-16T18:33:08.974 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003359342e7d7d98e8-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.975 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.975 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.975 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.975 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.975 DEBUG:boto:Data: 2024-04-16T18:33:08.975 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.975 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.975 DEBUG:boto:Params: {} 2024-04-16T18:33:08.975 DEBUG:boto:Token: None 2024-04-16T18:33:08.976 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.978 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002e8bbbcdf57f6696-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.978 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:33:08.978 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:33:08.979 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.979 DEBUG:boto:Path: /cjqttm-54/obj69 2024-04-16T18:33:08.979 DEBUG:boto:Data: 2024-04-16T18:33:08.979 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.979 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.979 DEBUG:boto:Params: {} 2024-04-16T18:33:08.979 DEBUG:boto:Token: None 2024-04-16T18:33:08.979 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj69 2024-04-16T18:33:08.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lSUr90LgEga0BFcbpfkqeB92z5s= 2024-04-16T18:33:08.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lSUr90LgEga0BFcbpfkqeB92z5s='} 2024-04-16T18:33:08.985 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000474a6cfc3149c490-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.985 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.985 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.985 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.985 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.985 DEBUG:boto:Data: 2024-04-16T18:33:08.985 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.985 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.985 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.986 DEBUG:boto:Params: {} 2024-04-16T18:33:08.986 DEBUG:boto:Token: None 2024-04-16T18:33:08.986 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.986 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.986 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.989 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fbd12eaf555f21aa-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.989 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:33:08.989 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:33:08.989 DEBUG:boto:Method: PUT 2024-04-16T18:33:08.989 DEBUG:boto:Path: /cjqttm-54/obj92 2024-04-16T18:33:08.989 DEBUG:boto:Data: 2024-04-16T18:33:08.989 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:08.990 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.990 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.990 DEBUG:boto:Params: {} 2024-04-16T18:33:08.990 DEBUG:boto:Token: None 2024-04-16T18:33:08.990 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/obj92 2024-04-16T18:33:08.990 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5chpUG86l8pWcdTb3H2HaLj+pVc= 2024-04-16T18:33:08.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5chpUG86l8pWcdTb3H2HaLj+pVc='} 2024-04-16T18:33:08.995 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003064407ac9fa497d-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.996 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:08.996 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:08.996 DEBUG:boto:Method: HEAD 2024-04-16T18:33:08.996 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:08.996 DEBUG:boto:Data: 2024-04-16T18:33:08.996 DEBUG:boto:Headers: {} 2024-04-16T18:33:08.996 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:08.996 DEBUG:boto:Port: 8000 2024-04-16T18:33:08.996 DEBUG:boto:Params: {} 2024-04-16T18:33:08.996 DEBUG:boto:Token: None 2024-04-16T18:33:08.997 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:08 GMT /cjqttm-54/ 2024-04-16T18:33:08.997 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc= 2024-04-16T18:33:08.997 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AMkzzmi/1UkBJFGSR2EWXeZ8NEc=', 'Content-Length': '0'} 2024-04-16T18:33:08.999 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b4c582ead318df8b-00661ec464-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:08.999 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:33:09.000 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:33:09.000 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.000 DEBUG:boto:Path: /cjqttm-54/obj115 2024-04-16T18:33:09.000 DEBUG:boto:Data: 2024-04-16T18:33:09.000 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.000 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.000 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.000 DEBUG:boto:Params: {} 2024-04-16T18:33:09.000 DEBUG:boto:Token: None 2024-04-16T18:33:09.000 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj115 2024-04-16T18:33:09.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t8Pk6+81daB0SBQ0KBDMLfvLTNw= 2024-04-16T18:33:09.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t8Pk6+81daB0SBQ0KBDMLfvLTNw='} 2024-04-16T18:33:09.042 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d1cc091d0da7e111-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.043 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:09.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:09.043 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-54 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:33:09.095 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:09.095 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:09.158 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:33:09.158 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-54 2024-04-16T18:33:09.168 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 20 2024-04-16T18:33:09.235 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.235 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.235 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.235 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.235 DEBUG:boto:Data: 2024-04-16T18:33:09.235 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.235 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.235 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.236 DEBUG:boto:Params: {} 2024-04-16T18:33:09.236 DEBUG:boto:Token: None 2024-04-16T18:33:09.236 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.239 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000002656938962897f0-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.239 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:33:09.239 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:33:09.239 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.239 DEBUG:boto:Path: /cjqttm-54/obj29 2024-04-16T18:33:09.239 DEBUG:boto:Data: 2024-04-16T18:33:09.240 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.240 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.240 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.240 DEBUG:boto:Params: {} 2024-04-16T18:33:09.240 DEBUG:boto:Token: None 2024-04-16T18:33:09.240 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj29 2024-04-16T18:33:09.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0622owWc1/DAbkNaXoNiTLMtyXU= 2024-04-16T18:33:09.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0622owWc1/DAbkNaXoNiTLMtyXU='} 2024-04-16T18:33:09.246 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000630da0349aecda85-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.246 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.246 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.246 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.246 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.247 DEBUG:boto:Data: 2024-04-16T18:33:09.247 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.247 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.247 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.247 DEBUG:boto:Params: {} 2024-04-16T18:33:09.247 DEBUG:boto:Token: None 2024-04-16T18:33:09.247 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.250 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000202ccf2cbaf84ca9-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.250 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:33:09.250 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:33:09.251 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.251 DEBUG:boto:Path: /cjqttm-54/obj58 2024-04-16T18:33:09.251 DEBUG:boto:Data: 2024-04-16T18:33:09.251 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.251 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.251 DEBUG:boto:Params: {} 2024-04-16T18:33:09.251 DEBUG:boto:Token: None 2024-04-16T18:33:09.251 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj58 2024-04-16T18:33:09.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sPP3xXEGphJYlfsmjoqP9Ws4+yk= 2024-04-16T18:33:09.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sPP3xXEGphJYlfsmjoqP9Ws4+yk='} 2024-04-16T18:33:09.256 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000012eb6550ece41178-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.257 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.257 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.257 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.257 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.257 DEBUG:boto:Data: 2024-04-16T18:33:09.257 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.257 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.257 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.257 DEBUG:boto:Params: {} 2024-04-16T18:33:09.258 DEBUG:boto:Token: None 2024-04-16T18:33:09.258 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.258 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.258 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.260 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8aaaac896bdb83f-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.261 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:33:09.261 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:33:09.261 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.261 DEBUG:boto:Path: /cjqttm-54/obj87 2024-04-16T18:33:09.261 DEBUG:boto:Data: 2024-04-16T18:33:09.261 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.261 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.261 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.261 DEBUG:boto:Params: {} 2024-04-16T18:33:09.261 DEBUG:boto:Token: None 2024-04-16T18:33:09.262 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj87 2024-04-16T18:33:09.262 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DzKWfUreg4gye5saebGZWKY2LYc= 2024-04-16T18:33:09.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DzKWfUreg4gye5saebGZWKY2LYc='} 2024-04-16T18:33:09.306 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000011f1d955721fe745-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.306 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.307 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.307 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.307 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.307 DEBUG:boto:Data: 2024-04-16T18:33:09.307 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.307 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.307 DEBUG:boto:Params: {} 2024-04-16T18:33:09.307 DEBUG:boto:Token: None 2024-04-16T18:33:09.307 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.310 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000500611cd3cde64ef-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.310 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:33:09.311 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:33:09.311 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.311 DEBUG:boto:Path: /cjqttm-54/obj116 2024-04-16T18:33:09.311 DEBUG:boto:Data: 2024-04-16T18:33:09.311 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.311 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.311 DEBUG:boto:Params: {} 2024-04-16T18:33:09.311 DEBUG:boto:Token: None 2024-04-16T18:33:09.311 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj116 2024-04-16T18:33:09.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ygs8KxHwlb4crwbXE5Vqf3zzuRI= 2024-04-16T18:33:09.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ygs8KxHwlb4crwbXE5Vqf3zzuRI='} 2024-04-16T18:33:09.317 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd9ee6eee01e81e6-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.317 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.317 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.317 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.317 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.317 DEBUG:boto:Data: 2024-04-16T18:33:09.317 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.318 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.318 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.318 DEBUG:boto:Params: {} 2024-04-16T18:33:09.318 DEBUG:boto:Token: None 2024-04-16T18:33:09.318 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.318 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.321 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000061b440657b103a4d-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.321 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:33:09.321 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:33:09.322 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.322 DEBUG:boto:Path: /cjqttm-54/obj145 2024-04-16T18:33:09.322 DEBUG:boto:Data: 2024-04-16T18:33:09.322 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.322 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.322 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.322 DEBUG:boto:Params: {} 2024-04-16T18:33:09.322 DEBUG:boto:Token: None 2024-04-16T18:33:09.322 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj145 2024-04-16T18:33:09.322 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HTnTKwohltHUD5RZf6yEeSFN56M= 2024-04-16T18:33:09.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HTnTKwohltHUD5RZf6yEeSFN56M='} 2024-04-16T18:33:09.327 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f9cf27723714d0f9-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.328 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:09.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:09.328 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-54 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:33:09.378 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:09.378 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:09.449 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:33:09.449 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-54 2024-04-16T18:33:09.462 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 25 2024-04-16T18:33:09.531 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.532 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.532 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.532 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.532 DEBUG:boto:Data: 2024-04-16T18:33:09.532 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.532 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.532 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.532 DEBUG:boto:Params: {} 2024-04-16T18:33:09.532 DEBUG:boto:Token: None 2024-04-16T18:33:09.533 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.533 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.536 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002b6dd2b8c09402ac-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.536 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:33:09.536 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:33:09.536 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.536 DEBUG:boto:Path: /cjqttm-54/obj31 2024-04-16T18:33:09.537 DEBUG:boto:Data: 2024-04-16T18:33:09.537 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.537 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.537 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.537 DEBUG:boto:Params: {} 2024-04-16T18:33:09.537 DEBUG:boto:Token: None 2024-04-16T18:33:09.537 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj31 2024-04-16T18:33:09.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:CQhCD4zz7ex2jV7pInwds8XqYAk= 2024-04-16T18:33:09.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:CQhCD4zz7ex2jV7pInwds8XqYAk='} 2024-04-16T18:33:09.582 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b7eb387807e68487-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.583 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.583 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.583 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.583 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.583 DEBUG:boto:Data: 2024-04-16T18:33:09.583 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.583 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.583 DEBUG:boto:Params: {} 2024-04-16T18:33:09.583 DEBUG:boto:Token: None 2024-04-16T18:33:09.584 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.587 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004ae545b7f8f4a29b-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.587 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:33:09.587 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:33:09.587 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.587 DEBUG:boto:Path: /cjqttm-54/obj62 2024-04-16T18:33:09.587 DEBUG:boto:Data: 2024-04-16T18:33:09.588 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.588 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.588 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.588 DEBUG:boto:Params: {} 2024-04-16T18:33:09.588 DEBUG:boto:Token: None 2024-04-16T18:33:09.588 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj62 2024-04-16T18:33:09.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:t1WwIqmy+JWEzF6mTFtzlQ5dlcA= 2024-04-16T18:33:09.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:t1WwIqmy+JWEzF6mTFtzlQ5dlcA='} 2024-04-16T18:33:09.594 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004f55724ba831044b-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.594 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.594 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.594 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.594 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.594 DEBUG:boto:Data: 2024-04-16T18:33:09.594 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.595 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.595 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.595 DEBUG:boto:Params: {} 2024-04-16T18:33:09.595 DEBUG:boto:Token: None 2024-04-16T18:33:09.595 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.598 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000062d7f7fe965698b2-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.598 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:33:09.598 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:33:09.598 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.598 DEBUG:boto:Path: /cjqttm-54/obj93 2024-04-16T18:33:09.598 DEBUG:boto:Data: 2024-04-16T18:33:09.598 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.598 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.599 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.599 DEBUG:boto:Params: {} 2024-04-16T18:33:09.599 DEBUG:boto:Token: None 2024-04-16T18:33:09.599 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj93 2024-04-16T18:33:09.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wy0rLB200CSYB7ITjtixUGB1khQ= 2024-04-16T18:33:09.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wy0rLB200CSYB7ITjtixUGB1khQ='} 2024-04-16T18:33:09.642 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000019676c5bc458c24d-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.642 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.643 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.643 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.643 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.643 DEBUG:boto:Data: 2024-04-16T18:33:09.643 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.643 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.643 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.643 DEBUG:boto:Params: {} 2024-04-16T18:33:09.643 DEBUG:boto:Token: None 2024-04-16T18:33:09.644 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.644 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.644 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.647 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003e3d2cc1cb96f937-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.647 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:33:09.647 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:33:09.647 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.647 DEBUG:boto:Path: /cjqttm-54/obj124 2024-04-16T18:33:09.647 DEBUG:boto:Data: 2024-04-16T18:33:09.648 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.648 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.648 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.648 DEBUG:boto:Params: {} 2024-04-16T18:33:09.648 DEBUG:boto:Token: None 2024-04-16T18:33:09.648 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj124 2024-04-16T18:33:09.648 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bmF0Qx2o4SUKqeHgzTz0isZ/63M= 2024-04-16T18:33:09.648 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bmF0Qx2o4SUKqeHgzTz0isZ/63M='} 2024-04-16T18:33:09.654 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c4467c45cdfad667-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.654 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.654 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.654 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.654 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.654 DEBUG:boto:Data: 2024-04-16T18:33:09.654 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.654 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.654 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.655 DEBUG:boto:Params: {} 2024-04-16T18:33:09.655 DEBUG:boto:Token: None 2024-04-16T18:33:09.655 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.655 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.655 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.658 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000071d9a5e2c8ced9a4-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.658 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:33:09.658 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:33:09.658 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.658 DEBUG:boto:Path: /cjqttm-54/obj155 2024-04-16T18:33:09.658 DEBUG:boto:Data: 2024-04-16T18:33:09.659 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.659 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.659 DEBUG:boto:Params: {} 2024-04-16T18:33:09.659 DEBUG:boto:Token: None 2024-04-16T18:33:09.659 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj155 2024-04-16T18:33:09.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n/p8XSBHVsNrtzXXzePxI0obl5c= 2024-04-16T18:33:09.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n/p8XSBHVsNrtzXXzePxI0obl5c='} 2024-04-16T18:33:09.702 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000006159684ce4397b0-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.703 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:09.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-54', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:09.703 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-54 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:33:09.754 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:09.754 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:09.821 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:33:09.822 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-54 2024-04-16T18:33:09.835 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 30 2024-04-16T18:33:09.908 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.908 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.909 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.909 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.909 DEBUG:boto:Data: 2024-04-16T18:33:09.909 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.909 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.909 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.909 DEBUG:boto:Params: {} 2024-04-16T18:33:09.909 DEBUG:boto:Token: None 2024-04-16T18:33:09.910 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.910 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.913 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f851f4b237ebe3f2-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.913 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:33:09.913 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:33:09.913 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.913 DEBUG:boto:Path: /cjqttm-54/obj37 2024-04-16T18:33:09.914 DEBUG:boto:Data: 2024-04-16T18:33:09.914 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.914 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.914 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.914 DEBUG:boto:Params: {} 2024-04-16T18:33:09.914 DEBUG:boto:Token: None 2024-04-16T18:33:09.914 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj37 2024-04-16T18:33:09.914 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:z2quLleAM8baB+wXQyi3WW6VZS8= 2024-04-16T18:33:09.914 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z2quLleAM8baB+wXQyi3WW6VZS8='} 2024-04-16T18:33:09.920 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000070ec8c91305090fc-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.920 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.920 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.920 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.920 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.920 DEBUG:boto:Data: 2024-04-16T18:33:09.920 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.920 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.921 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.921 DEBUG:boto:Params: {} 2024-04-16T18:33:09.921 DEBUG:boto:Token: None 2024-04-16T18:33:09.921 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.921 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.921 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.924 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000077530852fb44a3a1-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.924 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:33:09.924 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:33:09.924 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.924 DEBUG:boto:Path: /cjqttm-54/obj74 2024-04-16T18:33:09.924 DEBUG:boto:Data: 2024-04-16T18:33:09.924 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.925 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.925 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.925 DEBUG:boto:Params: {} 2024-04-16T18:33:09.925 DEBUG:boto:Token: None 2024-04-16T18:33:09.925 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj74 2024-04-16T18:33:09.925 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KlkBk1k3pxoFzV63Bp5+Us8AWI8= 2024-04-16T18:33:09.925 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KlkBk1k3pxoFzV63Bp5+Us8AWI8='} 2024-04-16T18:33:09.930 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ff4026749c3cd4c7-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.931 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.931 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.931 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.931 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.931 DEBUG:boto:Data: 2024-04-16T18:33:09.931 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.931 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.931 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.931 DEBUG:boto:Params: {} 2024-04-16T18:33:09.931 DEBUG:boto:Token: None 2024-04-16T18:33:09.932 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.932 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.932 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.935 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000193a1b1186a62315-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.935 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:33:09.935 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:33:09.935 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.935 DEBUG:boto:Path: /cjqttm-54/obj111 2024-04-16T18:33:09.935 DEBUG:boto:Data: 2024-04-16T18:33:09.936 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.936 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.936 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.936 DEBUG:boto:Params: {} 2024-04-16T18:33:09.936 DEBUG:boto:Token: None 2024-04-16T18:33:09.936 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj111 2024-04-16T18:33:09.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:napdecmHin0An8UwJmECI71VWP0= 2024-04-16T18:33:09.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:napdecmHin0An8UwJmECI71VWP0='} 2024-04-16T18:33:09.978 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000063ab633b03538e88-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.979 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.979 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.979 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.979 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.979 DEBUG:boto:Data: 2024-04-16T18:33:09.979 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.979 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.979 DEBUG:boto:Params: {} 2024-04-16T18:33:09.979 DEBUG:boto:Token: None 2024-04-16T18:33:09.980 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.983 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f2d377106712ae1-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.983 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:33:09.983 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:33:09.983 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.983 DEBUG:boto:Path: /cjqttm-54/obj148 2024-04-16T18:33:09.983 DEBUG:boto:Data: 2024-04-16T18:33:09.983 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.983 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.984 DEBUG:boto:Params: {} 2024-04-16T18:33:09.984 DEBUG:boto:Token: None 2024-04-16T18:33:09.984 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj148 2024-04-16T18:33:09.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i8Jvmz0iy0/IXEXVsPxT6oIrD5Y= 2024-04-16T18:33:09.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i8Jvmz0iy0/IXEXVsPxT6oIrD5Y='} 2024-04-16T18:33:09.989 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e0f812f6f96d57a5-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.989 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:33:09.989 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:33:09.989 DEBUG:boto:Method: HEAD 2024-04-16T18:33:09.989 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:33:09.989 DEBUG:boto:Data: 2024-04-16T18:33:09.990 DEBUG:boto:Headers: {} 2024-04-16T18:33:09.990 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.990 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.990 DEBUG:boto:Params: {} 2024-04-16T18:33:09.990 DEBUG:boto:Token: None 2024-04-16T18:33:09.990 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/ 2024-04-16T18:33:09.990 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I= 2024-04-16T18:33:09.990 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sFCyNyWp0Z4+Ls3s8iEBQwfhW+I=', 'Content-Length': '0'} 2024-04-16T18:33:09.993 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001dbf872f1b8ac265-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:09.993 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:33:09.993 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:33:09.994 DEBUG:boto:Method: PUT 2024-04-16T18:33:09.994 DEBUG:boto:Path: /cjqttm-54/obj185 2024-04-16T18:33:09.994 DEBUG:boto:Data: 2024-04-16T18:33:09.994 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:33:09.994 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:33:09.994 DEBUG:boto:Port: 8000 2024-04-16T18:33:09.994 DEBUG:boto:Params: {} 2024-04-16T18:33:09.994 DEBUG:boto:Token: None 2024-04-16T18:33:09.994 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:33:09 GMT /cjqttm-54/obj185 2024-04-16T18:33:09.994 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xh8geE3Divh7QeVc2DZ6Av1mCic= 2024-04-16T18:33:09.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:33:09 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xh8geE3Divh7QeVc2DZ6Av1mCic='} 2024-04-16T18:33:10.038 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006124a088d2bdecd7-00661ec465-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:33:10 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:33:10.039 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:10.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:33:10.039 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:33:10.095 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:10.095 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:10.153 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:10.155+0000 7f030a89d800 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-16T18:33:10.155 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:10.157+0000 7f030a89d800 5 RGW-SYNC:data: acquired data sync status lease 2024-04-16T18:33:10.189 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:33:10.189 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:33:10.191 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:33:10.191 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:10.209 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:33:10.210 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:33:10.210 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:33:10.210 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:33:10.211 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:33:10.389 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:33:10.391+0000 7f93e8e2f880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:33:11.212 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:33:11.232 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:33:11.233 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:33:11.233 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:33:11.233 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:33:11.234 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-54 2024-04-16T18:33:11.234 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-54', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:33:11.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-54', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:33:11.234 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-54 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:33:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:33:11.330 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:33:11.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:33:11.387 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:11.389+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:16.388 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:16.389+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:21.389 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:21.390+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:26.390 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:26.391+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:31.391 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:31.392+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:36.392 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:36.392+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:41.393 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:41.393+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:46.394 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:46.395+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:51.395 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:51.396+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:33:56.396 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:33:56.397+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:01.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:01.397+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:06.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:06.398+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:11.398 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:11.399+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:16.399 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:16.400+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:21.400 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:21.401+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:26.401 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:26.402+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:31.402 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:31.403+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:36.403 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:36.404+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:41.404 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:41.405+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:46.405 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:46.405+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:51.406 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:51.406+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:34:56.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:34:56.407+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:01.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:01.407+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:06.407 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:06.408+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:11.408 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:11.408+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:16.409 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:16.410+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:21.410 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:21.412+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:26.411 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:26.413+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:31.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:31.414+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:36.413 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:36.414+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:41.414 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:41.415+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:46.415 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:46.416+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:51.416 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:51.416+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:35:56.417 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:35:56.417+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:36:01.418 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:36:01.418+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:36:06.419 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:36:06.420+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:36:11.420 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:36:11.421+0000 7f637c642800 1 waiting to reach incremental sync.. 2024-04-16T18:36:16.423 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:36:16.425+0000 7f637c642800 1 bucket sync caught up with source: 2024-04-16T18:36:16.424 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.82.6, , , , , , 00000000002.65.6, , , , , 00000000002.71.6, , , , , , , , , , , , , , , 00000000001.108.6, , , , 00000000001.97.6] 2024-04-16T18:36:16.424 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.82.6, , , , , , 00000000002.65.6, , , , , 00000000002.71.6, , , , , , , , , , , , , , , 00000000001.108.6, , , , 00000000001.97.6] 2024-04-16T18:36:16.424 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:36:16.425+0000 7f637c642800 0 bucket checkpoint complete 2024-04-16T18:36:16.452 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-54 2024-04-16T18:36:16.452 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-54', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:36:16.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-54', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:36:16.453 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-54 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:36:16.517 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:36:16.517 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:36:16.579 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:16.580+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:21.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:21.580+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:26.580 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:26.581+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:31.581 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:31.582+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:36.582 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:36.582+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:41.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:41.583+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:46.583 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:46.584+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:51.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:51.585+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:36:56.584 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:36:56.585+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:01.585 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:01.586+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:06.586 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:06.586+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:11.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:11.587+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:16.587 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:16.588+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:21.588 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:21.589+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:26.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:26.589+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:31.589 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:31.590+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:36.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:36.591+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:41.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:41.590+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:46.590 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:46.591+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:51.591 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:51.592+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:37:56.592 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:37:56.592+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:01.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:01.593+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:06.593 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:06.594+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:11.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:11.594+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:16.594 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:16.595+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:21.595 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:21.595+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:26.596 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:26.596+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:31.597 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:31.597+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:36.598 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:36.598+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:41.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:41.599+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:46.599 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:46.598+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:51.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:51.599+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:38:56.600 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:38:56.601+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:01.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:01.601+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:06.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:06.602+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:11.601 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:11.602+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:16.602 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:16.603+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:21.603 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:21.603+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:26.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:26.604+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:31.604 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:31.605+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:36.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:36.606+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:41.605 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:41.606+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:46.606 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:46.606+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:51.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:51.607+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:39:56.607 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:39:56.608+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:40:01.608 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:40:01.609+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:40:06.609 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:40:06.609+0000 7fb6d2414800 1 waiting to reach incremental sync.. 2024-04-16T18:40:11.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:40:11.611+0000 7fb6d2414800 1 bucket sync caught up with source: 2024-04-16T18:40:11.611 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000003.269.6, 00000000002.254.6, 00000000002.405.6, 00000000005.290.6, 00000000004.186.6, 00000000001.244.6, 00000000001.695.6, 00000000004.605.6, 00000000007.578.6, 00000000006.478.6] 2024-04-16T18:40:11.611 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000003.269.6, 00000000002.254.6, 00000000002.405.6, 00000000005.290.6, 00000000004.186.6, 00000000001.244.6, 00000000001.695.6, 00000000004.605.6, 00000000007.578.6, 00000000006.478.6] 2024-04-16T18:40:11.611 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:40:11.611+0000 7fb6d2414800 0 bucket checkpoint complete 2024-04-16T18:40:11.638 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-54 zones={test-zone2, test-zone1} 2024-04-16T18:40:11.639 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.639 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.639 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.639 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:40:11.639 DEBUG:boto:Data: 2024-04-16T18:40:11.639 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.639 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.639 DEBUG:boto:Params: {} 2024-04-16T18:40:11.640 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:40:11.640 DEBUG:boto:Token: None 2024-04-16T18:40:11.640 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.641 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tAnSkeUMFH1XsJ2sbzgt9VOt4BM= 2024-04-16T18:40:11.641 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tAnSkeUMFH1XsJ2sbzgt9VOt4BM=', 'Content-Length': '0'} 2024-04-16T18:40:11.647 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000341bbb94c10230d1-00661ec60b-6280-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.648 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.648 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.648 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.648 DEBUG:boto:Path: /cjqttm-54/ 2024-04-16T18:40:11.648 DEBUG:boto:Data: 2024-04-16T18:40:11.648 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.648 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.648 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.648 DEBUG:boto:Params: {} 2024-04-16T18:40:11.648 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:40:11.649 DEBUG:boto:Token: None 2024-04-16T18:40:11.649 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.649 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tAnSkeUMFH1XsJ2sbzgt9VOt4BM= 2024-04-16T18:40:11.649 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tAnSkeUMFH1XsJ2sbzgt9VOt4BM=', 'Content-Length': '0'} 2024-04-16T18:40:11.655 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5af38f30ece8cf9-00661ec60b-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.655 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:40:11.655 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.655 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.655 DEBUG:boto:path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.656 DEBUG:boto:auth_path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.656 DEBUG:boto:Method: GET 2024-04-16T18:40:11.656 DEBUG:boto:Path: /cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.656 DEBUG:boto:Data: 2024-04-16T18:40:11.656 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.656 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.656 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.656 DEBUG:boto:Params: {} 2024-04-16T18:40:11.656 DEBUG:boto:Token: None 2024-04-16T18:40:11.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/?versions 2024-04-16T18:40:11.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM= 2024-04-16T18:40:11.657 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM=', 'Content-Length': '0'} 2024-04-16T18:40:11.659 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000621b7addebd28966-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.659 DEBUG:boto:b'cjqttm-54999falseobj11nulltrue2024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.661 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:40:11.661 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:40:11.662 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:40:11.663 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:40:11.664 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:40:11.664 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.664 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.665 DEBUG:boto:path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.665 DEBUG:boto:auth_path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.665 DEBUG:boto:Method: GET 2024-04-16T18:40:11.665 DEBUG:boto:Path: /cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.665 DEBUG:boto:Data: 2024-04-16T18:40:11.665 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.665 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.665 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.665 DEBUG:boto:Params: {} 2024-04-16T18:40:11.665 DEBUG:boto:Token: None 2024-04-16T18:40:11.665 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/?versions 2024-04-16T18:40:11.666 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM= 2024-04-16T18:40:11.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM=', 'Content-Length': '0'} 2024-04-16T18:40:11.670 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e498866920e251f7-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.670 DEBUG:boto:b'cjqttm-54999falseobj11nulltrue2024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.671 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:40:11.672 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:40:11.673 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:40:11.674 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:40:11.674 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.674 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.674 DEBUG:boto:path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.675 DEBUG:boto:auth_path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.675 DEBUG:boto:Method: GET 2024-04-16T18:40:11.675 DEBUG:boto:Path: /cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.675 DEBUG:boto:Data: 2024-04-16T18:40:11.675 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.675 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.675 DEBUG:boto:Params: {} 2024-04-16T18:40:11.675 DEBUG:boto:Token: None 2024-04-16T18:40:11.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/?versions 2024-04-16T18:40:11.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM= 2024-04-16T18:40:11.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM=', 'Content-Length': '0'} 2024-04-16T18:40:11.679 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ffc71861510ac92e-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.679 DEBUG:boto:b'cjqttm-54999falseobj11nulltrue2024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.680 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.680 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.680 DEBUG:boto:path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.681 DEBUG:boto:auth_path=/cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.681 DEBUG:boto:Method: GET 2024-04-16T18:40:11.681 DEBUG:boto:Path: /cjqttm-54/?versions&max-keys=999 2024-04-16T18:40:11.681 DEBUG:boto:Data: 2024-04-16T18:40:11.681 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.681 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.681 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.681 DEBUG:boto:Params: {} 2024-04-16T18:40:11.681 DEBUG:boto:Token: None 2024-04-16T18:40:11.681 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/?versions 2024-04-16T18:40:11.681 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM= 2024-04-16T18:40:11.682 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BnPVI3XUMueHh+ef37LhFEVSyXM=', 'Content-Length': '0'} 2024-04-16T18:40:11.685 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e698caadd7e51d51-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.685 DEBUG:boto:b'cjqttm-54999falseobj11nulltrue2024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:40:11.687 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.687 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.687 DEBUG:boto:path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.687 DEBUG:boto:auth_path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.688 DEBUG:boto:Method: GET 2024-04-16T18:40:11.688 DEBUG:boto:Path: /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.688 DEBUG:boto:Data: 2024-04-16T18:40:11.688 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.688 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.688 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.688 DEBUG:boto:Params: {} 2024-04-16T18:40:11.688 DEBUG:boto:Token: None 2024-04-16T18:40:11.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk= 2024-04-16T18:40:11.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk=', 'Content-Length': '0'} 2024-04-16T18:40:11.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c5abf636a2b66a80-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.734 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.734 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.735 DEBUG:boto:path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.735 DEBUG:boto:auth_path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.735 DEBUG:boto:Method: GET 2024-04-16T18:40:11.735 DEBUG:boto:Path: /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.735 DEBUG:boto:Data: 2024-04-16T18:40:11.735 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.735 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.735 DEBUG:boto:Params: {} 2024-04-16T18:40:11.735 DEBUG:boto:Token: None 2024-04-16T18:40:11.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk= 2024-04-16T18:40:11.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk=', 'Content-Length': '0'} 2024-04-16T18:40:11.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000045a8e0028d735645-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.738 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.738 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.738 DEBUG:boto:path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.738 DEBUG:boto:auth_path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.738 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.739 DEBUG:boto:Path: /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.739 DEBUG:boto:Data: 2024-04-16T18:40:11.739 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.739 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.739 DEBUG:boto:Params: {} 2024-04-16T18:40:11.739 DEBUG:boto:Token: None 2024-04-16T18:40:11.739 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Mz+P/64CSol3Iixe+oCO1lPdIbc= 2024-04-16T18:40:11.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Mz+P/64CSol3Iixe+oCO1lPdIbc=', 'Content-Length': '0'} 2024-04-16T18:40:11.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f3c859de7deaa202-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.741 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.742 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.742 DEBUG:boto:path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.742 DEBUG:boto:auth_path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.742 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.742 DEBUG:boto:Path: /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.742 DEBUG:boto:Data: 2024-04-16T18:40:11.742 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.742 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.742 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.742 DEBUG:boto:Params: {} 2024-04-16T18:40:11.742 DEBUG:boto:Token: None 2024-04-16T18:40:11.743 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Mz+P/64CSol3Iixe+oCO1lPdIbc= 2024-04-16T18:40:11.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Mz+P/64CSol3Iixe+oCO1lPdIbc=', 'Content-Length': '0'} 2024-04-16T18:40:11.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000540fd98ce8e96694-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.745 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:40:11.745 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.745 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.745 DEBUG:boto:path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.745 DEBUG:boto:auth_path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.745 DEBUG:boto:Method: GET 2024-04-16T18:40:11.745 DEBUG:boto:Path: /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.746 DEBUG:boto:Data: 2024-04-16T18:40:11.746 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.746 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.746 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.746 DEBUG:boto:Params: {} 2024-04-16T18:40:11.746 DEBUG:boto:Token: None 2024-04-16T18:40:11.746 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.746 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk= 2024-04-16T18:40:11.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk=', 'Content-Length': '0'} 2024-04-16T18:40:11.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5b2b11f364dbd4b-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.790 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.790 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.790 DEBUG:boto:path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.791 DEBUG:boto:auth_path=/cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.791 DEBUG:boto:Method: GET 2024-04-16T18:40:11.791 DEBUG:boto:Path: /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.791 DEBUG:boto:Data: 2024-04-16T18:40:11.791 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.791 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.791 DEBUG:boto:Params: {} 2024-04-16T18:40:11.791 DEBUG:boto:Token: None 2024-04-16T18:40:11.791 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11?versionId=null 2024-04-16T18:40:11.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk= 2024-04-16T18:40:11.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ry73qk7sWCxzQmG20bb073WH6nk=', 'Content-Length': '0'} 2024-04-16T18:40:11.793 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000662b6d31416f5434-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.794 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.794 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.794 DEBUG:boto:path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.794 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.794 DEBUG:boto:Method: GET 2024-04-16T18:40:11.794 DEBUG:boto:Path: /cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.794 DEBUG:boto:Data: 2024-04-16T18:40:11.794 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.794 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.795 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.795 DEBUG:boto:Params: {} 2024-04-16T18:40:11.795 DEBUG:boto:Token: None 2024-04-16T18:40:11.795 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.798 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ef15ec8ad465488e-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.798 DEBUG:boto:b'cjqttm-54obj111000falseobj112024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.799 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.799 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.799 DEBUG:boto:path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.799 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.799 DEBUG:boto:Method: GET 2024-04-16T18:40:11.799 DEBUG:boto:Path: /cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.799 DEBUG:boto:Data: 2024-04-16T18:40:11.799 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.799 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.800 DEBUG:boto:Params: {} 2024-04-16T18:40:11.800 DEBUG:boto:Token: None 2024-04-16T18:40:11.800 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.804 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fc0bb810da97bc95-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.804 DEBUG:boto:b'cjqttm-54obj111000falseobj112024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.804 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.804 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.804 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.804 DEBUG:boto:Path: /cjqttm-54/obj11 2024-04-16T18:40:11.805 DEBUG:boto:Data: 2024-04-16T18:40:11.805 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.805 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.805 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.805 DEBUG:boto:Params: {} 2024-04-16T18:40:11.805 DEBUG:boto:Token: None 2024-04-16T18:40:11.805 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11 2024-04-16T18:40:11.805 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vQofeFhFYVs0oFz1b1u+5Pr47Sk= 2024-04-16T18:40:11.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vQofeFhFYVs0oFz1b1u+5Pr47Sk=', 'Content-Length': '0'} 2024-04-16T18:40:11.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4510fcc7a86ec59-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.807 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.808 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.808 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.808 DEBUG:boto:Path: /cjqttm-54/obj11 2024-04-16T18:40:11.808 DEBUG:boto:Data: 2024-04-16T18:40:11.808 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.808 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.808 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.808 DEBUG:boto:Params: {} 2024-04-16T18:40:11.808 DEBUG:boto:Token: None 2024-04-16T18:40:11.808 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11 2024-04-16T18:40:11.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vQofeFhFYVs0oFz1b1u+5Pr47Sk= 2024-04-16T18:40:11.809 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vQofeFhFYVs0oFz1b1u+5Pr47Sk=', 'Content-Length': '0'} 2024-04-16T18:40:11.810 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000691b56975f384259-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.810 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:40:11.810 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.811 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.811 DEBUG:boto:Method: GET 2024-04-16T18:40:11.811 DEBUG:boto:Path: /cjqttm-54/obj11 2024-04-16T18:40:11.811 DEBUG:boto:Data: 2024-04-16T18:40:11.811 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.811 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.811 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.811 DEBUG:boto:Params: {} 2024-04-16T18:40:11.811 DEBUG:boto:Token: None 2024-04-16T18:40:11.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11 2024-04-16T18:40:11.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Hd8+Js+ncjOXvJFU36z+d+zxS0= 2024-04-16T18:40:11.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Hd8+Js+ncjOXvJFU36z+d+zxS0=', 'Content-Length': '0'} 2024-04-16T18:40:11.814 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009582c451a244d8f5-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.854 DEBUG:boto:path=/cjqttm-54/obj11 2024-04-16T18:40:11.854 DEBUG:boto:auth_path=/cjqttm-54/obj11 2024-04-16T18:40:11.855 DEBUG:boto:Method: GET 2024-04-16T18:40:11.855 DEBUG:boto:Path: /cjqttm-54/obj11 2024-04-16T18:40:11.855 DEBUG:boto:Data: 2024-04-16T18:40:11.855 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.855 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.855 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.855 DEBUG:boto:Params: {} 2024-04-16T18:40:11.855 DEBUG:boto:Token: None 2024-04-16T18:40:11.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj11 2024-04-16T18:40:11.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7Hd8+Js+ncjOXvJFU36z+d+zxS0= 2024-04-16T18:40:11.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7Hd8+Js+ncjOXvJFU36z+d+zxS0=', 'Content-Length': '0'} 2024-04-16T18:40:11.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000316116597480f851-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.857 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.858 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.858 DEBUG:boto:path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.858 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.858 DEBUG:boto:Method: GET 2024-04-16T18:40:11.858 DEBUG:boto:Path: /cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.858 DEBUG:boto:Data: 2024-04-16T18:40:11.858 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.858 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.858 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.858 DEBUG:boto:Params: {} 2024-04-16T18:40:11.858 DEBUG:boto:Token: None 2024-04-16T18:40:11.859 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.859 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.861 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ab8e5a076f43103-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.861 DEBUG:boto:b'cjqttm-54obj111000falseobj112024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.862 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.862 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.862 DEBUG:boto:path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.862 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.862 DEBUG:boto:Method: GET 2024-04-16T18:40:11.862 DEBUG:boto:Path: /cjqttm-54/?prefix=obj11 2024-04-16T18:40:11.862 DEBUG:boto:Data: 2024-04-16T18:40:11.862 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.862 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.862 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.863 DEBUG:boto:Params: {} 2024-04-16T18:40:11.863 DEBUG:boto:Token: None 2024-04-16T18:40:11.863 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.863 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.863 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c79ac63fe64665b-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.867 DEBUG:boto:b'cjqttm-54obj111000falseobj112024-04-16T18:33:08.023Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:40:11.867 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.867 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.867 DEBUG:boto:path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.867 DEBUG:boto:auth_path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.868 DEBUG:boto:Method: GET 2024-04-16T18:40:11.868 DEBUG:boto:Path: /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.868 DEBUG:boto:Data: 2024-04-16T18:40:11.868 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.868 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.868 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.868 DEBUG:boto:Params: {} 2024-04-16T18:40:11.868 DEBUG:boto:Token: None 2024-04-16T18:40:11.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ= 2024-04-16T18:40:11.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ=', 'Content-Length': '0'} 2024-04-16T18:40:11.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000da7968dbc7c4542e-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.871 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.871 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.871 DEBUG:boto:path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.871 DEBUG:boto:auth_path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.871 DEBUG:boto:Method: GET 2024-04-16T18:40:11.871 DEBUG:boto:Path: /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.871 DEBUG:boto:Data: 2024-04-16T18:40:11.871 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.871 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.871 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.872 DEBUG:boto:Params: {} 2024-04-16T18:40:11.872 DEBUG:boto:Token: None 2024-04-16T18:40:11.872 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.872 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ= 2024-04-16T18:40:11.872 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ=', 'Content-Length': '0'} 2024-04-16T18:40:11.874 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000903a4a1784c8614-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.914 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.914 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.915 DEBUG:boto:path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.915 DEBUG:boto:auth_path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.915 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.915 DEBUG:boto:Path: /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.915 DEBUG:boto:Data: 2024-04-16T18:40:11.915 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.915 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.915 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.915 DEBUG:boto:Params: {} 2024-04-16T18:40:11.915 DEBUG:boto:Token: None 2024-04-16T18:40:11.915 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/JiC6evb2vl8TJM0M71wjVyoLS8= 2024-04-16T18:40:11.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/JiC6evb2vl8TJM0M71wjVyoLS8=', 'Content-Length': '0'} 2024-04-16T18:40:11.917 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d64fdec1d2171665-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.918 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.918 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.918 DEBUG:boto:path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.918 DEBUG:boto:auth_path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.918 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.918 DEBUG:boto:Path: /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.918 DEBUG:boto:Data: 2024-04-16T18:40:11.918 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.919 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.919 DEBUG:boto:Params: {} 2024-04-16T18:40:11.919 DEBUG:boto:Token: None 2024-04-16T18:40:11.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/JiC6evb2vl8TJM0M71wjVyoLS8= 2024-04-16T18:40:11.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/JiC6evb2vl8TJM0M71wjVyoLS8=', 'Content-Length': '0'} 2024-04-16T18:40:11.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033a22f0d6af63aa9-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.921 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:40:11.921 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.921 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.922 DEBUG:boto:path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.922 DEBUG:boto:auth_path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.922 DEBUG:boto:Method: GET 2024-04-16T18:40:11.922 DEBUG:boto:Path: /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.922 DEBUG:boto:Data: 2024-04-16T18:40:11.922 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.922 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.922 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.922 DEBUG:boto:Params: {} 2024-04-16T18:40:11.922 DEBUG:boto:Token: None 2024-04-16T18:40:11.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ= 2024-04-16T18:40:11.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ=', 'Content-Length': '0'} 2024-04-16T18:40:11.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007adb9045de4d4c7f-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.925 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.925 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.925 DEBUG:boto:path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.925 DEBUG:boto:auth_path=/cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.925 DEBUG:boto:Method: GET 2024-04-16T18:40:11.925 DEBUG:boto:Path: /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.925 DEBUG:boto:Data: 2024-04-16T18:40:11.925 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.925 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.925 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.926 DEBUG:boto:Params: {} 2024-04-16T18:40:11.926 DEBUG:boto:Token: None 2024-04-16T18:40:11.926 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111?versionId=null 2024-04-16T18:40:11.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ= 2024-04-16T18:40:11.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kvw1W5v2YyZWq4hNhF7okSlyRTQ=', 'Content-Length': '0'} 2024-04-16T18:40:11.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005b35736cb78588a9-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.928 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.928 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.928 DEBUG:boto:path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.928 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.928 DEBUG:boto:Method: GET 2024-04-16T18:40:11.928 DEBUG:boto:Path: /cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.928 DEBUG:boto:Data: 2024-04-16T18:40:11.928 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.929 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.929 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.929 DEBUG:boto:Params: {} 2024-04-16T18:40:11.929 DEBUG:boto:Token: None 2024-04-16T18:40:11.929 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.929 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.929 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.931 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d04228c60e008157-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.932 DEBUG:boto:b'cjqttm-54obj1111000falseobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.932 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.932 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.932 DEBUG:boto:path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.932 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.932 DEBUG:boto:Method: GET 2024-04-16T18:40:11.932 DEBUG:boto:Path: /cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.933 DEBUG:boto:Data: 2024-04-16T18:40:11.933 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.933 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.933 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.933 DEBUG:boto:Params: {} 2024-04-16T18:40:11.933 DEBUG:boto:Token: None 2024-04-16T18:40:11.933 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.933 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001cbeed7982b630c1-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.937 DEBUG:boto:b'cjqttm-54obj1111000falseobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.938 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.938 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.938 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.938 DEBUG:boto:Path: /cjqttm-54/obj111 2024-04-16T18:40:11.938 DEBUG:boto:Data: 2024-04-16T18:40:11.938 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.938 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.938 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.938 DEBUG:boto:Params: {} 2024-04-16T18:40:11.938 DEBUG:boto:Token: None 2024-04-16T18:40:11.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111 2024-04-16T18:40:11.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mVfjg25T97/ZfOqlrBKObrJsMko= 2024-04-16T18:40:11.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mVfjg25T97/ZfOqlrBKObrJsMko=', 'Content-Length': '0'} 2024-04-16T18:40:11.940 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dc72a864655e10b-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.940 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.941 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.941 DEBUG:boto:Method: HEAD 2024-04-16T18:40:11.941 DEBUG:boto:Path: /cjqttm-54/obj111 2024-04-16T18:40:11.941 DEBUG:boto:Data: 2024-04-16T18:40:11.941 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.941 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.941 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.941 DEBUG:boto:Params: {} 2024-04-16T18:40:11.941 DEBUG:boto:Token: None 2024-04-16T18:40:11.941 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111 2024-04-16T18:40:11.942 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mVfjg25T97/ZfOqlrBKObrJsMko= 2024-04-16T18:40:11.942 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mVfjg25T97/ZfOqlrBKObrJsMko=', 'Content-Length': '0'} 2024-04-16T18:40:11.943 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001142f273bf6bc4e3-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.943 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:40:11.944 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.944 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.944 DEBUG:boto:Method: GET 2024-04-16T18:40:11.944 DEBUG:boto:Path: /cjqttm-54/obj111 2024-04-16T18:40:11.944 DEBUG:boto:Data: 2024-04-16T18:40:11.944 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.944 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.944 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.944 DEBUG:boto:Params: {} 2024-04-16T18:40:11.944 DEBUG:boto:Token: None 2024-04-16T18:40:11.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111 2024-04-16T18:40:11.945 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5bZWl247PyiY4hntD5F4PzAUTA= 2024-04-16T18:40:11.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5bZWl247PyiY4hntD5F4PzAUTA=', 'Content-Length': '0'} 2024-04-16T18:40:11.946 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e629e223f6fcb7a-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.947 DEBUG:boto:path=/cjqttm-54/obj111 2024-04-16T18:40:11.947 DEBUG:boto:auth_path=/cjqttm-54/obj111 2024-04-16T18:40:11.947 DEBUG:boto:Method: GET 2024-04-16T18:40:11.947 DEBUG:boto:Path: /cjqttm-54/obj111 2024-04-16T18:40:11.947 DEBUG:boto:Data: 2024-04-16T18:40:11.947 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.947 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.947 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.947 DEBUG:boto:Params: {} 2024-04-16T18:40:11.947 DEBUG:boto:Token: None 2024-04-16T18:40:11.948 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/obj111 2024-04-16T18:40:11.948 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:R5bZWl247PyiY4hntD5F4PzAUTA= 2024-04-16T18:40:11.948 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:R5bZWl247PyiY4hntD5F4PzAUTA=', 'Content-Length': '0'} 2024-04-16T18:40:11.950 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001392e4e2d396a858-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.990 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.990 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.991 DEBUG:boto:path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.991 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.991 DEBUG:boto:Method: GET 2024-04-16T18:40:11.991 DEBUG:boto:Path: /cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.991 DEBUG:boto:Data: 2024-04-16T18:40:11.991 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:11.991 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.991 DEBUG:boto:Params: {} 2024-04-16T18:40:11.991 DEBUG:boto:Token: None 2024-04-16T18:40:11.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.994 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ad03fe130e2de926-00661ec60b-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:11 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:11.994 DEBUG:boto:b'cjqttm-54obj1111000falseobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:11.994 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:11.995 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:11.995 DEBUG:boto:path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.995 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.995 DEBUG:boto:Method: GET 2024-04-16T18:40:11.995 DEBUG:boto:Path: /cjqttm-54/?prefix=obj111 2024-04-16T18:40:11.995 DEBUG:boto:Data: 2024-04-16T18:40:11.995 DEBUG:boto:Headers: {} 2024-04-16T18:40:11.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:11.995 DEBUG:boto:Port: 8000 2024-04-16T18:40:11.995 DEBUG:boto:Params: {} 2024-04-16T18:40:11.995 DEBUG:boto:Token: None 2024-04-16T18:40:11.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:11 GMT /cjqttm-54/ 2024-04-16T18:40:11.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4= 2024-04-16T18:40:11.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:11 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1UcvGRxefCybi3huDAiveyeH4k4=', 'Content-Length': '0'} 2024-04-16T18:40:11.999 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000054019a579a72c08e-00661ec60b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.000 DEBUG:boto:b'cjqttm-54obj1111000falseobj1112024-04-16T18:33:09.939Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:40:12.000 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.000 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.000 DEBUG:boto:path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.000 DEBUG:boto:auth_path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.000 DEBUG:boto:Method: GET 2024-04-16T18:40:12.000 DEBUG:boto:Path: /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.001 DEBUG:boto:Data: 2024-04-16T18:40:12.001 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.001 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.001 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.001 DEBUG:boto:Params: {} 2024-04-16T18:40:12.001 DEBUG:boto:Token: None 2024-04-16T18:40:12.001 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc= 2024-04-16T18:40:12.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc=', 'Content-Length': '0'} 2024-04-16T18:40:12.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e993716b77ac8d4c-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.003 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.004 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.004 DEBUG:boto:path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.004 DEBUG:boto:auth_path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.004 DEBUG:boto:Method: GET 2024-04-16T18:40:12.004 DEBUG:boto:Path: /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.004 DEBUG:boto:Data: 2024-04-16T18:40:12.004 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.004 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.004 DEBUG:boto:Params: {} 2024-04-16T18:40:12.004 DEBUG:boto:Token: None 2024-04-16T18:40:12.005 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.005 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc= 2024-04-16T18:40:12.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc=', 'Content-Length': '0'} 2024-04-16T18:40:12.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038b042d8152897e1-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.007 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.007 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.007 DEBUG:boto:path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.007 DEBUG:boto:auth_path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.007 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.007 DEBUG:boto:Path: /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.007 DEBUG:boto:Data: 2024-04-16T18:40:12.008 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.008 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.008 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.008 DEBUG:boto:Params: {} 2024-04-16T18:40:12.008 DEBUG:boto:Token: None 2024-04-16T18:40:12.008 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C2hloqAPXK+S5rpyqN8V5rsToz8= 2024-04-16T18:40:12.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C2hloqAPXK+S5rpyqN8V5rsToz8=', 'Content-Length': '0'} 2024-04-16T18:40:12.010 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af2e265740f85b06-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.010 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.010 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.010 DEBUG:boto:path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.011 DEBUG:boto:auth_path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.011 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.011 DEBUG:boto:Path: /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.011 DEBUG:boto:Data: 2024-04-16T18:40:12.011 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.011 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.011 DEBUG:boto:Params: {} 2024-04-16T18:40:12.011 DEBUG:boto:Token: None 2024-04-16T18:40:12.011 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C2hloqAPXK+S5rpyqN8V5rsToz8= 2024-04-16T18:40:12.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C2hloqAPXK+S5rpyqN8V5rsToz8=', 'Content-Length': '0'} 2024-04-16T18:40:12.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f435cb679ea68f0c-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:40:12.014 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.014 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.014 DEBUG:boto:path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.014 DEBUG:boto:auth_path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.014 DEBUG:boto:Method: GET 2024-04-16T18:40:12.015 DEBUG:boto:Path: /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.015 DEBUG:boto:Data: 2024-04-16T18:40:12.015 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.015 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.015 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.015 DEBUG:boto:Params: {} 2024-04-16T18:40:12.015 DEBUG:boto:Token: None 2024-04-16T18:40:12.015 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.015 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc= 2024-04-16T18:40:12.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc=', 'Content-Length': '0'} 2024-04-16T18:40:12.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005f8be2feb3998350-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.058 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.058 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.059 DEBUG:boto:path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.059 DEBUG:boto:auth_path=/cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.059 DEBUG:boto:Method: GET 2024-04-16T18:40:12.059 DEBUG:boto:Path: /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.059 DEBUG:boto:Data: 2024-04-16T18:40:12.059 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.059 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.059 DEBUG:boto:Params: {} 2024-04-16T18:40:12.059 DEBUG:boto:Token: None 2024-04-16T18:40:12.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115?versionId=null 2024-04-16T18:40:12.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc= 2024-04-16T18:40:12.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Pb0eWr8wOnEBwaagemFkbB60XRc=', 'Content-Length': '0'} 2024-04-16T18:40:12.062 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5b95aa7a0fb56a1-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.062 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.062 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.062 DEBUG:boto:path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.062 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.062 DEBUG:boto:Method: GET 2024-04-16T18:40:12.062 DEBUG:boto:Path: /cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.063 DEBUG:boto:Data: 2024-04-16T18:40:12.063 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.063 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.063 DEBUG:boto:Params: {} 2024-04-16T18:40:12.063 DEBUG:boto:Token: None 2024-04-16T18:40:12.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000096168905eaa4133a-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.065 DEBUG:boto:b'cjqttm-54obj1151000falseobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.066 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.066 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.066 DEBUG:boto:path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.066 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.066 DEBUG:boto:Method: GET 2024-04-16T18:40:12.066 DEBUG:boto:Path: /cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.066 DEBUG:boto:Data: 2024-04-16T18:40:12.066 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.066 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.067 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.067 DEBUG:boto:Params: {} 2024-04-16T18:40:12.067 DEBUG:boto:Token: None 2024-04-16T18:40:12.067 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.067 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.067 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.071 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ea29cf87155e096-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.071 DEBUG:boto:b'cjqttm-54obj1151000falseobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.071 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.071 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.072 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.072 DEBUG:boto:Path: /cjqttm-54/obj115 2024-04-16T18:40:12.072 DEBUG:boto:Data: 2024-04-16T18:40:12.072 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.072 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.072 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.072 DEBUG:boto:Params: {} 2024-04-16T18:40:12.072 DEBUG:boto:Token: None 2024-04-16T18:40:12.072 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115 2024-04-16T18:40:12.072 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qZnYhk4B8nONP8iNyIq6BDCmNAg= 2024-04-16T18:40:12.072 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qZnYhk4B8nONP8iNyIq6BDCmNAg=', 'Content-Length': '0'} 2024-04-16T18:40:12.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ee2a0c0c5c6924d-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.075 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.075 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.075 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.075 DEBUG:boto:Path: /cjqttm-54/obj115 2024-04-16T18:40:12.075 DEBUG:boto:Data: 2024-04-16T18:40:12.075 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.075 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.075 DEBUG:boto:Params: {} 2024-04-16T18:40:12.076 DEBUG:boto:Token: None 2024-04-16T18:40:12.076 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115 2024-04-16T18:40:12.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qZnYhk4B8nONP8iNyIq6BDCmNAg= 2024-04-16T18:40:12.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qZnYhk4B8nONP8iNyIq6BDCmNAg=', 'Content-Length': '0'} 2024-04-16T18:40:12.078 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ae9241e24e00b33a-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.078 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:40:12.078 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.078 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.078 DEBUG:boto:Method: GET 2024-04-16T18:40:12.078 DEBUG:boto:Path: /cjqttm-54/obj115 2024-04-16T18:40:12.078 DEBUG:boto:Data: 2024-04-16T18:40:12.079 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.079 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.079 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.079 DEBUG:boto:Params: {} 2024-04-16T18:40:12.079 DEBUG:boto:Token: None 2024-04-16T18:40:12.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115 2024-04-16T18:40:12.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XUDFoXVn0+9BbCJ/GFzZtNJRtEk= 2024-04-16T18:40:12.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XUDFoXVn0+9BbCJ/GFzZtNJRtEk=', 'Content-Length': '0'} 2024-04-16T18:40:12.081 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003409408dc6b60bb8-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.081 DEBUG:boto:path=/cjqttm-54/obj115 2024-04-16T18:40:12.081 DEBUG:boto:auth_path=/cjqttm-54/obj115 2024-04-16T18:40:12.082 DEBUG:boto:Method: GET 2024-04-16T18:40:12.082 DEBUG:boto:Path: /cjqttm-54/obj115 2024-04-16T18:40:12.082 DEBUG:boto:Data: 2024-04-16T18:40:12.082 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.082 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.082 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.082 DEBUG:boto:Params: {} 2024-04-16T18:40:12.082 DEBUG:boto:Token: None 2024-04-16T18:40:12.082 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj115 2024-04-16T18:40:12.082 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XUDFoXVn0+9BbCJ/GFzZtNJRtEk= 2024-04-16T18:40:12.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XUDFoXVn0+9BbCJ/GFzZtNJRtEk=', 'Content-Length': '0'} 2024-04-16T18:40:12.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dac022600d24809e-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.085 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.085 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.085 DEBUG:boto:path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.085 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.085 DEBUG:boto:Method: GET 2024-04-16T18:40:12.085 DEBUG:boto:Path: /cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.085 DEBUG:boto:Data: 2024-04-16T18:40:12.085 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.086 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.086 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.086 DEBUG:boto:Params: {} 2024-04-16T18:40:12.086 DEBUG:boto:Token: None 2024-04-16T18:40:12.086 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.086 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.088 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4d6d5dbb58c2c47-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.088 DEBUG:boto:b'cjqttm-54obj1151000falseobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.089 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.089 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.089 DEBUG:boto:path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.089 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.089 DEBUG:boto:Method: GET 2024-04-16T18:40:12.089 DEBUG:boto:Path: /cjqttm-54/?prefix=obj115 2024-04-16T18:40:12.089 DEBUG:boto:Data: 2024-04-16T18:40:12.089 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.089 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.090 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.090 DEBUG:boto:Params: {} 2024-04-16T18:40:12.090 DEBUG:boto:Token: None 2024-04-16T18:40:12.090 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.090 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.094 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca3380404d873264-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.094 DEBUG:boto:b'cjqttm-54obj1151000falseobj1152024-04-16T18:33:09.004Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.094 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:40:12.094 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.095 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.095 DEBUG:boto:path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.095 DEBUG:boto:auth_path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.095 DEBUG:boto:Method: GET 2024-04-16T18:40:12.095 DEBUG:boto:Path: /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.095 DEBUG:boto:Data: 2024-04-16T18:40:12.095 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.095 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.095 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.095 DEBUG:boto:Params: {} 2024-04-16T18:40:12.095 DEBUG:boto:Token: None 2024-04-16T18:40:12.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E= 2024-04-16T18:40:12.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E=', 'Content-Length': '0'} 2024-04-16T18:40:12.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a9f144af95e664bc-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.098 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.098 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.098 DEBUG:boto:path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.098 DEBUG:boto:auth_path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.098 DEBUG:boto:Method: GET 2024-04-16T18:40:12.098 DEBUG:boto:Path: /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.098 DEBUG:boto:Data: 2024-04-16T18:40:12.098 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.098 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.099 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.099 DEBUG:boto:Params: {} 2024-04-16T18:40:12.099 DEBUG:boto:Token: None 2024-04-16T18:40:12.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E= 2024-04-16T18:40:12.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E=', 'Content-Length': '0'} 2024-04-16T18:40:12.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008037427956ff7108-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.101 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.101 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.101 DEBUG:boto:path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.102 DEBUG:boto:auth_path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.102 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.102 DEBUG:boto:Path: /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.102 DEBUG:boto:Data: 2024-04-16T18:40:12.102 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.102 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.102 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.102 DEBUG:boto:Params: {} 2024-04-16T18:40:12.102 DEBUG:boto:Token: None 2024-04-16T18:40:12.102 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+bUsj8W+HbAo+SHVH9ju+Hv2buw= 2024-04-16T18:40:12.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+bUsj8W+HbAo+SHVH9ju+Hv2buw=', 'Content-Length': '0'} 2024-04-16T18:40:12.104 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000519e61aa23c39374-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.104 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.105 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.105 DEBUG:boto:path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.105 DEBUG:boto:auth_path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.105 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.105 DEBUG:boto:Path: /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.105 DEBUG:boto:Data: 2024-04-16T18:40:12.105 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.105 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.105 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.105 DEBUG:boto:Params: {} 2024-04-16T18:40:12.105 DEBUG:boto:Token: None 2024-04-16T18:40:12.106 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.106 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+bUsj8W+HbAo+SHVH9ju+Hv2buw= 2024-04-16T18:40:12.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+bUsj8W+HbAo+SHVH9ju+Hv2buw=', 'Content-Length': '0'} 2024-04-16T18:40:12.107 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006006b77731d7ed9-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.108 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:40:12.108 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.108 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.108 DEBUG:boto:path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.108 DEBUG:boto:auth_path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.108 DEBUG:boto:Method: GET 2024-04-16T18:40:12.108 DEBUG:boto:Path: /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.108 DEBUG:boto:Data: 2024-04-16T18:40:12.108 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.108 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.109 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.109 DEBUG:boto:Params: {} 2024-04-16T18:40:12.109 DEBUG:boto:Token: None 2024-04-16T18:40:12.109 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.109 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E= 2024-04-16T18:40:12.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E=', 'Content-Length': '0'} 2024-04-16T18:40:12.111 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000e320149311d0a4f-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.111 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.111 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.111 DEBUG:boto:path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.111 DEBUG:boto:auth_path=/cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.111 DEBUG:boto:Method: GET 2024-04-16T18:40:12.111 DEBUG:boto:Path: /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.112 DEBUG:boto:Data: 2024-04-16T18:40:12.112 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.112 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.112 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.112 DEBUG:boto:Params: {} 2024-04-16T18:40:12.112 DEBUG:boto:Token: None 2024-04-16T18:40:12.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116?versionId=null 2024-04-16T18:40:12.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E= 2024-04-16T18:40:12.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QIt9z74p7BQR7chvs0rUQlCZ/8E=', 'Content-Length': '0'} 2024-04-16T18:40:12.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c12242a1dc033dc6-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.114 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.115 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.115 DEBUG:boto:path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.115 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.115 DEBUG:boto:Method: GET 2024-04-16T18:40:12.115 DEBUG:boto:Path: /cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.115 DEBUG:boto:Data: 2024-04-16T18:40:12.115 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.115 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.115 DEBUG:boto:Params: {} 2024-04-16T18:40:12.116 DEBUG:boto:Token: None 2024-04-16T18:40:12.116 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.118 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005c5419d9b98b6c51-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.158 DEBUG:boto:b'cjqttm-54obj1161000falseobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.159 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.159 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.159 DEBUG:boto:path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.159 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.159 DEBUG:boto:Method: GET 2024-04-16T18:40:12.159 DEBUG:boto:Path: /cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.159 DEBUG:boto:Data: 2024-04-16T18:40:12.159 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.159 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.159 DEBUG:boto:Params: {} 2024-04-16T18:40:12.160 DEBUG:boto:Token: None 2024-04-16T18:40:12.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.163 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000893abdd0ba1ee812-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.163 DEBUG:boto:b'cjqttm-54obj1161000falseobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.164 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.164 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.164 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.164 DEBUG:boto:Path: /cjqttm-54/obj116 2024-04-16T18:40:12.164 DEBUG:boto:Data: 2024-04-16T18:40:12.164 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.164 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.164 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.164 DEBUG:boto:Params: {} 2024-04-16T18:40:12.165 DEBUG:boto:Token: None 2024-04-16T18:40:12.165 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116 2024-04-16T18:40:12.165 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Eaj4o/L2fW4i9D4Gp1pzhin0ITw= 2024-04-16T18:40:12.165 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Eaj4o/L2fW4i9D4Gp1pzhin0ITw=', 'Content-Length': '0'} 2024-04-16T18:40:12.166 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000738845f9a134a55e-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.167 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.167 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.167 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.167 DEBUG:boto:Path: /cjqttm-54/obj116 2024-04-16T18:40:12.167 DEBUG:boto:Data: 2024-04-16T18:40:12.167 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.167 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.167 DEBUG:boto:Params: {} 2024-04-16T18:40:12.167 DEBUG:boto:Token: None 2024-04-16T18:40:12.167 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116 2024-04-16T18:40:12.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Eaj4o/L2fW4i9D4Gp1pzhin0ITw= 2024-04-16T18:40:12.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Eaj4o/L2fW4i9D4Gp1pzhin0ITw=', 'Content-Length': '0'} 2024-04-16T18:40:12.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2d81f92eaa47031-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.169 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:40:12.170 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.170 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.170 DEBUG:boto:Method: GET 2024-04-16T18:40:12.170 DEBUG:boto:Path: /cjqttm-54/obj116 2024-04-16T18:40:12.170 DEBUG:boto:Data: 2024-04-16T18:40:12.170 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.170 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.170 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.170 DEBUG:boto:Params: {} 2024-04-16T18:40:12.171 DEBUG:boto:Token: None 2024-04-16T18:40:12.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116 2024-04-16T18:40:12.171 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ml8hpbCuDTHh6wjzl2aZNDQzlfY= 2024-04-16T18:40:12.171 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ml8hpbCuDTHh6wjzl2aZNDQzlfY=', 'Content-Length': '0'} 2024-04-16T18:40:12.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008336c242733e80db-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.173 DEBUG:boto:path=/cjqttm-54/obj116 2024-04-16T18:40:12.173 DEBUG:boto:auth_path=/cjqttm-54/obj116 2024-04-16T18:40:12.173 DEBUG:boto:Method: GET 2024-04-16T18:40:12.174 DEBUG:boto:Path: /cjqttm-54/obj116 2024-04-16T18:40:12.174 DEBUG:boto:Data: 2024-04-16T18:40:12.174 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.174 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.174 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.174 DEBUG:boto:Params: {} 2024-04-16T18:40:12.174 DEBUG:boto:Token: None 2024-04-16T18:40:12.174 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj116 2024-04-16T18:40:12.174 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ml8hpbCuDTHh6wjzl2aZNDQzlfY= 2024-04-16T18:40:12.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ml8hpbCuDTHh6wjzl2aZNDQzlfY=', 'Content-Length': '0'} 2024-04-16T18:40:12.176 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004d71f417b2dd40c-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.176 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.177 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.177 DEBUG:boto:path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.177 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.177 DEBUG:boto:Method: GET 2024-04-16T18:40:12.177 DEBUG:boto:Path: /cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.177 DEBUG:boto:Data: 2024-04-16T18:40:12.177 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.177 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.177 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.177 DEBUG:boto:Params: {} 2024-04-16T18:40:12.177 DEBUG:boto:Token: None 2024-04-16T18:40:12.178 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.178 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.180 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000046b511eb188547f-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.180 DEBUG:boto:b'cjqttm-54obj1161000falseobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.180 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.181 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.181 DEBUG:boto:path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.181 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.181 DEBUG:boto:Method: GET 2024-04-16T18:40:12.181 DEBUG:boto:Path: /cjqttm-54/?prefix=obj116 2024-04-16T18:40:12.181 DEBUG:boto:Data: 2024-04-16T18:40:12.181 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.181 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.181 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.181 DEBUG:boto:Params: {} 2024-04-16T18:40:12.181 DEBUG:boto:Token: None 2024-04-16T18:40:12.182 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.182 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.185 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008a155c6258757527-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.186 DEBUG:boto:b'cjqttm-54obj1161000falseobj1162024-04-16T18:33:09.315Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.186 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:40:12.186 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.186 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.186 DEBUG:boto:path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.186 DEBUG:boto:auth_path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.187 DEBUG:boto:Method: GET 2024-04-16T18:40:12.187 DEBUG:boto:Path: /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.187 DEBUG:boto:Data: 2024-04-16T18:40:12.187 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.187 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.187 DEBUG:boto:Params: {} 2024-04-16T18:40:12.187 DEBUG:boto:Token: None 2024-04-16T18:40:12.187 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.187 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk= 2024-04-16T18:40:12.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk=', 'Content-Length': '0'} 2024-04-16T18:40:12.189 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b40ee047a9167fe-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.190 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.190 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.190 DEBUG:boto:path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.190 DEBUG:boto:auth_path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.190 DEBUG:boto:Method: GET 2024-04-16T18:40:12.190 DEBUG:boto:Path: /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.190 DEBUG:boto:Data: 2024-04-16T18:40:12.190 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.190 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.190 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.191 DEBUG:boto:Params: {} 2024-04-16T18:40:12.191 DEBUG:boto:Token: None 2024-04-16T18:40:12.191 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.191 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk= 2024-04-16T18:40:12.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk=', 'Content-Length': '0'} 2024-04-16T18:40:12.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b47e4210c86285a-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.193 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.193 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.194 DEBUG:boto:path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.194 DEBUG:boto:auth_path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.194 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.194 DEBUG:boto:Path: /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.194 DEBUG:boto:Data: 2024-04-16T18:40:12.194 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.194 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.194 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.194 DEBUG:boto:Params: {} 2024-04-16T18:40:12.194 DEBUG:boto:Token: None 2024-04-16T18:40:12.194 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c8RRgmdJCK3QQpx8DuSpQy/zzgo= 2024-04-16T18:40:12.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c8RRgmdJCK3QQpx8DuSpQy/zzgo=', 'Content-Length': '0'} 2024-04-16T18:40:12.196 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000638af1835fc18736-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.197 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.197 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.197 DEBUG:boto:path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.197 DEBUG:boto:auth_path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.197 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.197 DEBUG:boto:Path: /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.197 DEBUG:boto:Data: 2024-04-16T18:40:12.197 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.197 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.197 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.197 DEBUG:boto:Params: {} 2024-04-16T18:40:12.198 DEBUG:boto:Token: None 2024-04-16T18:40:12.198 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.198 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:c8RRgmdJCK3QQpx8DuSpQy/zzgo= 2024-04-16T18:40:12.198 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c8RRgmdJCK3QQpx8DuSpQy/zzgo=', 'Content-Length': '0'} 2024-04-16T18:40:12.200 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000180791f1d1df6040-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:40:12.200 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.200 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.200 DEBUG:boto:path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.200 DEBUG:boto:auth_path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.201 DEBUG:boto:Method: GET 2024-04-16T18:40:12.201 DEBUG:boto:Path: /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.201 DEBUG:boto:Data: 2024-04-16T18:40:12.201 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.201 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.201 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.201 DEBUG:boto:Params: {} 2024-04-16T18:40:12.201 DEBUG:boto:Token: None 2024-04-16T18:40:12.201 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.201 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk= 2024-04-16T18:40:12.201 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk=', 'Content-Length': '0'} 2024-04-16T18:40:12.203 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052de6232c089d757-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.203 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.203 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.204 DEBUG:boto:path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.204 DEBUG:boto:auth_path=/cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.204 DEBUG:boto:Method: GET 2024-04-16T18:40:12.204 DEBUG:boto:Path: /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.204 DEBUG:boto:Data: 2024-04-16T18:40:12.204 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.204 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.204 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.204 DEBUG:boto:Params: {} 2024-04-16T18:40:12.204 DEBUG:boto:Token: None 2024-04-16T18:40:12.204 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124?versionId=null 2024-04-16T18:40:12.204 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk= 2024-04-16T18:40:12.205 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8zSJ1QepYXsaKhURWGyH1Pbk3lk=', 'Content-Length': '0'} 2024-04-16T18:40:12.206 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f2930d635e65387-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.207 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.207 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.207 DEBUG:boto:path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.207 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.207 DEBUG:boto:Method: GET 2024-04-16T18:40:12.207 DEBUG:boto:Path: /cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.207 DEBUG:boto:Data: 2024-04-16T18:40:12.207 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.207 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.207 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.208 DEBUG:boto:Params: {} 2024-04-16T18:40:12.208 DEBUG:boto:Token: None 2024-04-16T18:40:12.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.210 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b43a4248e8c54a28-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.250 DEBUG:boto:b'cjqttm-54obj1241000falseobj1242024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.251 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.251 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.251 DEBUG:boto:path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.251 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.251 DEBUG:boto:Method: GET 2024-04-16T18:40:12.251 DEBUG:boto:Path: /cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.251 DEBUG:boto:Data: 2024-04-16T18:40:12.251 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.251 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.251 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.251 DEBUG:boto:Params: {} 2024-04-16T18:40:12.252 DEBUG:boto:Token: None 2024-04-16T18:40:12.252 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.252 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.252 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.255 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ee63af8a6ba86432-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.256 DEBUG:boto:b'cjqttm-54obj1241000falseobj1242024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.256 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.256 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.256 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.256 DEBUG:boto:Path: /cjqttm-54/obj124 2024-04-16T18:40:12.256 DEBUG:boto:Data: 2024-04-16T18:40:12.256 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.256 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.257 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.257 DEBUG:boto:Params: {} 2024-04-16T18:40:12.257 DEBUG:boto:Token: None 2024-04-16T18:40:12.257 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124 2024-04-16T18:40:12.257 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nEYkxEYEktBNJL4WgI/WQ9DzM1Q= 2024-04-16T18:40:12.257 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nEYkxEYEktBNJL4WgI/WQ9DzM1Q=', 'Content-Length': '0'} 2024-04-16T18:40:12.259 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2e7bed3eda6bc0b-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.259 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.259 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.259 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.260 DEBUG:boto:Path: /cjqttm-54/obj124 2024-04-16T18:40:12.260 DEBUG:boto:Data: 2024-04-16T18:40:12.260 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.260 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.260 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.260 DEBUG:boto:Params: {} 2024-04-16T18:40:12.260 DEBUG:boto:Token: None 2024-04-16T18:40:12.260 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124 2024-04-16T18:40:12.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nEYkxEYEktBNJL4WgI/WQ9DzM1Q= 2024-04-16T18:40:12.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nEYkxEYEktBNJL4WgI/WQ9DzM1Q=', 'Content-Length': '0'} 2024-04-16T18:40:12.262 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000050dc7d4bb3db33dc-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.262 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:40:12.262 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.262 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.262 DEBUG:boto:Method: GET 2024-04-16T18:40:12.263 DEBUG:boto:Path: /cjqttm-54/obj124 2024-04-16T18:40:12.263 DEBUG:boto:Data: 2024-04-16T18:40:12.263 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.263 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.263 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.263 DEBUG:boto:Params: {} 2024-04-16T18:40:12.263 DEBUG:boto:Token: None 2024-04-16T18:40:12.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124 2024-04-16T18:40:12.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i9BmuLfV5ypUZ2eK3KYZk3S/LV8= 2024-04-16T18:40:12.263 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i9BmuLfV5ypUZ2eK3KYZk3S/LV8=', 'Content-Length': '0'} 2024-04-16T18:40:12.265 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092be655bd8e9c2a8-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.265 DEBUG:boto:path=/cjqttm-54/obj124 2024-04-16T18:40:12.265 DEBUG:boto:auth_path=/cjqttm-54/obj124 2024-04-16T18:40:12.265 DEBUG:boto:Method: GET 2024-04-16T18:40:12.265 DEBUG:boto:Path: /cjqttm-54/obj124 2024-04-16T18:40:12.266 DEBUG:boto:Data: 2024-04-16T18:40:12.266 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.266 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.266 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.266 DEBUG:boto:Params: {} 2024-04-16T18:40:12.266 DEBUG:boto:Token: None 2024-04-16T18:40:12.266 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj124 2024-04-16T18:40:12.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i9BmuLfV5ypUZ2eK3KYZk3S/LV8= 2024-04-16T18:40:12.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i9BmuLfV5ypUZ2eK3KYZk3S/LV8=', 'Content-Length': '0'} 2024-04-16T18:40:12.268 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d517ebecd6b11fe-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.310 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.310 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.310 DEBUG:boto:path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.311 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.311 DEBUG:boto:Method: GET 2024-04-16T18:40:12.311 DEBUG:boto:Path: /cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.311 DEBUG:boto:Data: 2024-04-16T18:40:12.311 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.311 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.311 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.311 DEBUG:boto:Params: {} 2024-04-16T18:40:12.311 DEBUG:boto:Token: None 2024-04-16T18:40:12.311 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.314 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d73258d8f80826f3-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.314 DEBUG:boto:b'cjqttm-54obj1241000falseobj1242024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.314 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.314 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.314 DEBUG:boto:path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.314 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.314 DEBUG:boto:Method: GET 2024-04-16T18:40:12.315 DEBUG:boto:Path: /cjqttm-54/?prefix=obj124 2024-04-16T18:40:12.315 DEBUG:boto:Data: 2024-04-16T18:40:12.315 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.315 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.315 DEBUG:boto:Params: {} 2024-04-16T18:40:12.315 DEBUG:boto:Token: None 2024-04-16T18:40:12.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.319 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009899102f6f89644c-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.319 DEBUG:boto:b'cjqttm-54obj1241000falseobj1242024-04-16T18:33:09.651Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:40:12.320 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.320 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.320 DEBUG:boto:path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.320 DEBUG:boto:auth_path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.320 DEBUG:boto:Method: GET 2024-04-16T18:40:12.320 DEBUG:boto:Path: /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.320 DEBUG:boto:Data: 2024-04-16T18:40:12.320 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.320 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.320 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.320 DEBUG:boto:Params: {} 2024-04-16T18:40:12.321 DEBUG:boto:Token: None 2024-04-16T18:40:12.321 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.321 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg= 2024-04-16T18:40:12.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg=', 'Content-Length': '0'} 2024-04-16T18:40:12.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000465d3d080d300b15-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.323 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.323 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.323 DEBUG:boto:path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.323 DEBUG:boto:auth_path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.323 DEBUG:boto:Method: GET 2024-04-16T18:40:12.324 DEBUG:boto:Path: /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.324 DEBUG:boto:Data: 2024-04-16T18:40:12.324 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.324 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.324 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.324 DEBUG:boto:Params: {} 2024-04-16T18:40:12.324 DEBUG:boto:Token: None 2024-04-16T18:40:12.324 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg= 2024-04-16T18:40:12.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg=', 'Content-Length': '0'} 2024-04-16T18:40:12.326 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049bac8e764cddba4-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.327 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.327 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.327 DEBUG:boto:path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.327 DEBUG:boto:auth_path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.327 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.327 DEBUG:boto:Path: /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.327 DEBUG:boto:Data: 2024-04-16T18:40:12.327 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.327 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.327 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.327 DEBUG:boto:Params: {} 2024-04-16T18:40:12.328 DEBUG:boto:Token: None 2024-04-16T18:40:12.328 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dQpLhbwf71hbi9tW9mpcjphmkFo= 2024-04-16T18:40:12.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dQpLhbwf71hbi9tW9mpcjphmkFo=', 'Content-Length': '0'} 2024-04-16T18:40:12.330 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001dbbef67c3d9a4f-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.330 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.330 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.330 DEBUG:boto:path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.330 DEBUG:boto:auth_path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.330 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.331 DEBUG:boto:Path: /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.331 DEBUG:boto:Data: 2024-04-16T18:40:12.331 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.331 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.331 DEBUG:boto:Params: {} 2024-04-16T18:40:12.331 DEBUG:boto:Token: None 2024-04-16T18:40:12.331 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.331 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dQpLhbwf71hbi9tW9mpcjphmkFo= 2024-04-16T18:40:12.331 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dQpLhbwf71hbi9tW9mpcjphmkFo=', 'Content-Length': '0'} 2024-04-16T18:40:12.333 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000340432fa2f4d62ea-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.334 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:40:12.334 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.334 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.334 DEBUG:boto:path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.334 DEBUG:boto:auth_path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.334 DEBUG:boto:Method: GET 2024-04-16T18:40:12.334 DEBUG:boto:Path: /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.334 DEBUG:boto:Data: 2024-04-16T18:40:12.334 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.334 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.334 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.335 DEBUG:boto:Params: {} 2024-04-16T18:40:12.335 DEBUG:boto:Token: None 2024-04-16T18:40:12.335 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.335 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg= 2024-04-16T18:40:12.335 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg=', 'Content-Length': '0'} 2024-04-16T18:40:12.337 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b6416a20a83a58ad-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.382 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.382 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.383 DEBUG:boto:path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.383 DEBUG:boto:auth_path=/cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.383 DEBUG:boto:Method: GET 2024-04-16T18:40:12.383 DEBUG:boto:Path: /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.383 DEBUG:boto:Data: 2024-04-16T18:40:12.383 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.383 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.383 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.383 DEBUG:boto:Params: {} 2024-04-16T18:40:12.383 DEBUG:boto:Token: None 2024-04-16T18:40:12.383 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145?versionId=null 2024-04-16T18:40:12.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg= 2024-04-16T18:40:12.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MJMh8osBio8S5sGyerSi8nwUyBg=', 'Content-Length': '0'} 2024-04-16T18:40:12.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000012e99bbb023a58f-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.386 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.386 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.386 DEBUG:boto:path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.386 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.387 DEBUG:boto:Method: GET 2024-04-16T18:40:12.387 DEBUG:boto:Path: /cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.387 DEBUG:boto:Data: 2024-04-16T18:40:12.387 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.387 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.387 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.387 DEBUG:boto:Params: {} 2024-04-16T18:40:12.387 DEBUG:boto:Token: None 2024-04-16T18:40:12.387 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.387 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.390 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008104aa7dae99d0a8-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.390 DEBUG:boto:b'cjqttm-54obj1451000falseobj1452024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.390 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.390 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.390 DEBUG:boto:path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.391 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.391 DEBUG:boto:Method: GET 2024-04-16T18:40:12.391 DEBUG:boto:Path: /cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.391 DEBUG:boto:Data: 2024-04-16T18:40:12.391 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.391 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.391 DEBUG:boto:Params: {} 2024-04-16T18:40:12.391 DEBUG:boto:Token: None 2024-04-16T18:40:12.391 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.395 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d876646ba79fb9be-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.395 DEBUG:boto:b'cjqttm-54obj1451000falseobj1452024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.396 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.396 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.396 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.396 DEBUG:boto:Path: /cjqttm-54/obj145 2024-04-16T18:40:12.396 DEBUG:boto:Data: 2024-04-16T18:40:12.396 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.396 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.396 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.396 DEBUG:boto:Params: {} 2024-04-16T18:40:12.397 DEBUG:boto:Token: None 2024-04-16T18:40:12.397 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145 2024-04-16T18:40:12.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fbyOf8VJ98xEvvbubZyv3yOcGDU= 2024-04-16T18:40:12.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fbyOf8VJ98xEvvbubZyv3yOcGDU=', 'Content-Length': '0'} 2024-04-16T18:40:12.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002013942e4a7d037e-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.399 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.399 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.399 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.399 DEBUG:boto:Path: /cjqttm-54/obj145 2024-04-16T18:40:12.400 DEBUG:boto:Data: 2024-04-16T18:40:12.400 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.400 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.400 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.400 DEBUG:boto:Params: {} 2024-04-16T18:40:12.400 DEBUG:boto:Token: None 2024-04-16T18:40:12.400 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145 2024-04-16T18:40:12.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fbyOf8VJ98xEvvbubZyv3yOcGDU= 2024-04-16T18:40:12.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fbyOf8VJ98xEvvbubZyv3yOcGDU=', 'Content-Length': '0'} 2024-04-16T18:40:12.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c08f373bf2acbfb3-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.405 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:40:12.405 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.405 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.406 DEBUG:boto:Method: GET 2024-04-16T18:40:12.406 DEBUG:boto:Path: /cjqttm-54/obj145 2024-04-16T18:40:12.406 DEBUG:boto:Data: 2024-04-16T18:40:12.406 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.406 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.406 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.406 DEBUG:boto:Params: {} 2024-04-16T18:40:12.406 DEBUG:boto:Token: None 2024-04-16T18:40:12.406 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145 2024-04-16T18:40:12.406 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RcF4E4em1r4lLBtA4nH4vcDKnjA= 2024-04-16T18:40:12.406 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RcF4E4em1r4lLBtA4nH4vcDKnjA=', 'Content-Length': '0'} 2024-04-16T18:40:12.409 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d245cd7e806b429-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.409 DEBUG:boto:path=/cjqttm-54/obj145 2024-04-16T18:40:12.409 DEBUG:boto:auth_path=/cjqttm-54/obj145 2024-04-16T18:40:12.409 DEBUG:boto:Method: GET 2024-04-16T18:40:12.409 DEBUG:boto:Path: /cjqttm-54/obj145 2024-04-16T18:40:12.409 DEBUG:boto:Data: 2024-04-16T18:40:12.409 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.409 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.410 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.410 DEBUG:boto:Params: {} 2024-04-16T18:40:12.410 DEBUG:boto:Token: None 2024-04-16T18:40:12.410 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj145 2024-04-16T18:40:12.410 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RcF4E4em1r4lLBtA4nH4vcDKnjA= 2024-04-16T18:40:12.410 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RcF4E4em1r4lLBtA4nH4vcDKnjA=', 'Content-Length': '0'} 2024-04-16T18:40:12.412 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb13038cee538e8c-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.412 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.413 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.413 DEBUG:boto:path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.413 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.413 DEBUG:boto:Method: GET 2024-04-16T18:40:12.413 DEBUG:boto:Path: /cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.413 DEBUG:boto:Data: 2024-04-16T18:40:12.413 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.413 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.413 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.413 DEBUG:boto:Params: {} 2024-04-16T18:40:12.413 DEBUG:boto:Token: None 2024-04-16T18:40:12.413 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.414 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.414 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.416 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a92a1e3e73a97446-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.416 DEBUG:boto:b'cjqttm-54obj1451000falseobj1452024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.416 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.416 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.416 DEBUG:boto:path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.416 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.416 DEBUG:boto:Method: GET 2024-04-16T18:40:12.417 DEBUG:boto:Path: /cjqttm-54/?prefix=obj145 2024-04-16T18:40:12.417 DEBUG:boto:Data: 2024-04-16T18:40:12.417 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.417 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.417 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.417 DEBUG:boto:Params: {} 2024-04-16T18:40:12.417 DEBUG:boto:Token: None 2024-04-16T18:40:12.417 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.417 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.421 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002efccf12f30b47fc-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.421 DEBUG:boto:b'cjqttm-54obj1451000falseobj1452024-04-16T18:33:09.326Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.421 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:40:12.421 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.422 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.422 DEBUG:boto:path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.422 DEBUG:boto:auth_path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.422 DEBUG:boto:Method: GET 2024-04-16T18:40:12.422 DEBUG:boto:Path: /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.422 DEBUG:boto:Data: 2024-04-16T18:40:12.422 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.422 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.422 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.422 DEBUG:boto:Params: {} 2024-04-16T18:40:12.422 DEBUG:boto:Token: None 2024-04-16T18:40:12.422 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs= 2024-04-16T18:40:12.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs=', 'Content-Length': '0'} 2024-04-16T18:40:12.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a872d9d1f6ac26ad-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.466 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.466 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.466 DEBUG:boto:path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.467 DEBUG:boto:auth_path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.467 DEBUG:boto:Method: GET 2024-04-16T18:40:12.467 DEBUG:boto:Path: /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.467 DEBUG:boto:Data: 2024-04-16T18:40:12.467 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.467 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.467 DEBUG:boto:Params: {} 2024-04-16T18:40:12.467 DEBUG:boto:Token: None 2024-04-16T18:40:12.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs= 2024-04-16T18:40:12.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs=', 'Content-Length': '0'} 2024-04-16T18:40:12.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe2453970d4a871d-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.470 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.470 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.470 DEBUG:boto:path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.470 DEBUG:boto:auth_path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.470 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.470 DEBUG:boto:Path: /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.470 DEBUG:boto:Data: 2024-04-16T18:40:12.470 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.470 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.470 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.471 DEBUG:boto:Params: {} 2024-04-16T18:40:12.471 DEBUG:boto:Token: None 2024-04-16T18:40:12.471 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fl180kdzz6GCcAEZn4QPBm/24ik= 2024-04-16T18:40:12.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fl180kdzz6GCcAEZn4QPBm/24ik=', 'Content-Length': '0'} 2024-04-16T18:40:12.473 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007be3b895d749e4ae-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.473 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.473 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.474 DEBUG:boto:path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.474 DEBUG:boto:auth_path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.474 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.474 DEBUG:boto:Path: /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.474 DEBUG:boto:Data: 2024-04-16T18:40:12.474 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.474 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.474 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.474 DEBUG:boto:Params: {} 2024-04-16T18:40:12.474 DEBUG:boto:Token: None 2024-04-16T18:40:12.474 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Fl180kdzz6GCcAEZn4QPBm/24ik= 2024-04-16T18:40:12.475 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Fl180kdzz6GCcAEZn4QPBm/24ik=', 'Content-Length': '0'} 2024-04-16T18:40:12.476 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9d1ea8421b26398-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.477 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:40:12.477 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.477 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.477 DEBUG:boto:path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.477 DEBUG:boto:auth_path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.477 DEBUG:boto:Method: GET 2024-04-16T18:40:12.477 DEBUG:boto:Path: /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.477 DEBUG:boto:Data: 2024-04-16T18:40:12.477 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.477 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.478 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.478 DEBUG:boto:Params: {} 2024-04-16T18:40:12.478 DEBUG:boto:Token: None 2024-04-16T18:40:12.478 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.478 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs= 2024-04-16T18:40:12.478 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs=', 'Content-Length': '0'} 2024-04-16T18:40:12.480 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008495480f3708d4df-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.480 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.480 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.480 DEBUG:boto:path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.480 DEBUG:boto:auth_path=/cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.480 DEBUG:boto:Method: GET 2024-04-16T18:40:12.481 DEBUG:boto:Path: /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.481 DEBUG:boto:Data: 2024-04-16T18:40:12.481 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.481 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.481 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.481 DEBUG:boto:Params: {} 2024-04-16T18:40:12.481 DEBUG:boto:Token: None 2024-04-16T18:40:12.481 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148?versionId=null 2024-04-16T18:40:12.481 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs= 2024-04-16T18:40:12.481 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hLpf+OqL63G0OKOsf9ftNObmoGs=', 'Content-Length': '0'} 2024-04-16T18:40:12.483 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f3b0078d84dc850-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.484 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.484 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.484 DEBUG:boto:path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.484 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.484 DEBUG:boto:Method: GET 2024-04-16T18:40:12.484 DEBUG:boto:Path: /cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.484 DEBUG:boto:Data: 2024-04-16T18:40:12.484 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.484 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.484 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.484 DEBUG:boto:Params: {} 2024-04-16T18:40:12.485 DEBUG:boto:Token: None 2024-04-16T18:40:12.485 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.485 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.487 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000aa9a57d64b95b5d-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.487 DEBUG:boto:b'cjqttm-54obj1481000falseobj1482024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.487 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.488 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.488 DEBUG:boto:path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.488 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.488 DEBUG:boto:Method: GET 2024-04-16T18:40:12.488 DEBUG:boto:Path: /cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.488 DEBUG:boto:Data: 2024-04-16T18:40:12.488 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.488 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.488 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.488 DEBUG:boto:Params: {} 2024-04-16T18:40:12.489 DEBUG:boto:Token: None 2024-04-16T18:40:12.489 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.489 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.492 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000edcb51efc7b703c7-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.534 DEBUG:boto:b'cjqttm-54obj1481000falseobj1482024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.535 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.535 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.535 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.535 DEBUG:boto:Path: /cjqttm-54/obj148 2024-04-16T18:40:12.535 DEBUG:boto:Data: 2024-04-16T18:40:12.535 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.535 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.535 DEBUG:boto:Params: {} 2024-04-16T18:40:12.536 DEBUG:boto:Token: None 2024-04-16T18:40:12.536 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148 2024-04-16T18:40:12.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1+TN+kPOoQicR2B1f7WhWMw8lO4= 2024-04-16T18:40:12.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1+TN+kPOoQicR2B1f7WhWMw8lO4=', 'Content-Length': '0'} 2024-04-16T18:40:12.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000089b65a601ef7988c-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.538 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.538 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.538 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.539 DEBUG:boto:Path: /cjqttm-54/obj148 2024-04-16T18:40:12.539 DEBUG:boto:Data: 2024-04-16T18:40:12.539 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.539 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.539 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.539 DEBUG:boto:Params: {} 2024-04-16T18:40:12.539 DEBUG:boto:Token: None 2024-04-16T18:40:12.539 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148 2024-04-16T18:40:12.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1+TN+kPOoQicR2B1f7WhWMw8lO4= 2024-04-16T18:40:12.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1+TN+kPOoQicR2B1f7WhWMw8lO4=', 'Content-Length': '0'} 2024-04-16T18:40:12.541 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098f705791f372a11-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.542 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:40:12.542 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.542 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.542 DEBUG:boto:Method: GET 2024-04-16T18:40:12.542 DEBUG:boto:Path: /cjqttm-54/obj148 2024-04-16T18:40:12.542 DEBUG:boto:Data: 2024-04-16T18:40:12.542 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.542 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.543 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.543 DEBUG:boto:Params: {} 2024-04-16T18:40:12.543 DEBUG:boto:Token: None 2024-04-16T18:40:12.543 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148 2024-04-16T18:40:12.543 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yn88SnntCXXYheAvJ48rJ1fHEYE= 2024-04-16T18:40:12.543 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yn88SnntCXXYheAvJ48rJ1fHEYE=', 'Content-Length': '0'} 2024-04-16T18:40:12.545 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bfee6c5e7c65530-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.545 DEBUG:boto:path=/cjqttm-54/obj148 2024-04-16T18:40:12.545 DEBUG:boto:auth_path=/cjqttm-54/obj148 2024-04-16T18:40:12.545 DEBUG:boto:Method: GET 2024-04-16T18:40:12.545 DEBUG:boto:Path: /cjqttm-54/obj148 2024-04-16T18:40:12.545 DEBUG:boto:Data: 2024-04-16T18:40:12.546 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.546 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.546 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.546 DEBUG:boto:Params: {} 2024-04-16T18:40:12.546 DEBUG:boto:Token: None 2024-04-16T18:40:12.546 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj148 2024-04-16T18:40:12.546 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yn88SnntCXXYheAvJ48rJ1fHEYE= 2024-04-16T18:40:12.546 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yn88SnntCXXYheAvJ48rJ1fHEYE=', 'Content-Length': '0'} 2024-04-16T18:40:12.548 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091fb7141dda5e45c-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.548 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.548 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.549 DEBUG:boto:path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.549 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.549 DEBUG:boto:Method: GET 2024-04-16T18:40:12.549 DEBUG:boto:Path: /cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.549 DEBUG:boto:Data: 2024-04-16T18:40:12.549 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.549 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.549 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.549 DEBUG:boto:Params: {} 2024-04-16T18:40:12.549 DEBUG:boto:Token: None 2024-04-16T18:40:12.550 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.550 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.550 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.552 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000041213df956539e60-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.552 DEBUG:boto:b'cjqttm-54obj1481000falseobj1482024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.552 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.552 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.553 DEBUG:boto:path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.553 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.553 DEBUG:boto:Method: GET 2024-04-16T18:40:12.553 DEBUG:boto:Path: /cjqttm-54/?prefix=obj148 2024-04-16T18:40:12.553 DEBUG:boto:Data: 2024-04-16T18:40:12.553 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.553 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.553 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.553 DEBUG:boto:Params: {} 2024-04-16T18:40:12.553 DEBUG:boto:Token: None 2024-04-16T18:40:12.553 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.554 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.554 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.557 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003ab7bae47dbfb313-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.557 DEBUG:boto:b'cjqttm-54obj1481000falseobj1482024-04-16T18:33:09.987Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.558 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:40:12.558 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.558 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.558 DEBUG:boto:path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.558 DEBUG:boto:auth_path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.558 DEBUG:boto:Method: GET 2024-04-16T18:40:12.558 DEBUG:boto:Path: /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.558 DEBUG:boto:Data: 2024-04-16T18:40:12.559 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.559 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.559 DEBUG:boto:Params: {} 2024-04-16T18:40:12.559 DEBUG:boto:Token: None 2024-04-16T18:40:12.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4= 2024-04-16T18:40:12.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4=', 'Content-Length': '0'} 2024-04-16T18:40:12.561 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009be1b1ec8d4bdf4c-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.561 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.562 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.562 DEBUG:boto:path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.562 DEBUG:boto:auth_path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.562 DEBUG:boto:Method: GET 2024-04-16T18:40:12.562 DEBUG:boto:Path: /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.562 DEBUG:boto:Data: 2024-04-16T18:40:12.562 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.562 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.562 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.562 DEBUG:boto:Params: {} 2024-04-16T18:40:12.563 DEBUG:boto:Token: None 2024-04-16T18:40:12.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4= 2024-04-16T18:40:12.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4=', 'Content-Length': '0'} 2024-04-16T18:40:12.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072ca3ce2ab9f3ef5-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.565 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.565 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.566 DEBUG:boto:path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.566 DEBUG:boto:auth_path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.566 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.566 DEBUG:boto:Path: /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.566 DEBUG:boto:Data: 2024-04-16T18:40:12.566 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.566 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.566 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.566 DEBUG:boto:Params: {} 2024-04-16T18:40:12.566 DEBUG:boto:Token: None 2024-04-16T18:40:12.567 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2/l2DhQl1whfkm+EE0jnQjad76Q= 2024-04-16T18:40:12.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2/l2DhQl1whfkm+EE0jnQjad76Q=', 'Content-Length': '0'} 2024-04-16T18:40:12.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c8e939916be43c1-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.569 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.569 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.569 DEBUG:boto:path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.569 DEBUG:boto:auth_path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.569 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.569 DEBUG:boto:Path: /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.569 DEBUG:boto:Data: 2024-04-16T18:40:12.570 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.570 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.570 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.570 DEBUG:boto:Params: {} 2024-04-16T18:40:12.570 DEBUG:boto:Token: None 2024-04-16T18:40:12.570 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.570 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2/l2DhQl1whfkm+EE0jnQjad76Q= 2024-04-16T18:40:12.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2/l2DhQl1whfkm+EE0jnQjad76Q=', 'Content-Length': '0'} 2024-04-16T18:40:12.572 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2ac35912534698e-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:40:12.572 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.572 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.573 DEBUG:boto:path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.573 DEBUG:boto:auth_path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.573 DEBUG:boto:Method: GET 2024-04-16T18:40:12.573 DEBUG:boto:Path: /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.573 DEBUG:boto:Data: 2024-04-16T18:40:12.573 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.573 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.573 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.573 DEBUG:boto:Params: {} 2024-04-16T18:40:12.573 DEBUG:boto:Token: None 2024-04-16T18:40:12.573 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.574 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4= 2024-04-16T18:40:12.574 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4=', 'Content-Length': '0'} 2024-04-16T18:40:12.576 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006ad1fa1b53afd29d-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.576 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.576 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.576 DEBUG:boto:path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.576 DEBUG:boto:auth_path=/cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.576 DEBUG:boto:Method: GET 2024-04-16T18:40:12.576 DEBUG:boto:Path: /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.576 DEBUG:boto:Data: 2024-04-16T18:40:12.577 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.577 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.577 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.577 DEBUG:boto:Params: {} 2024-04-16T18:40:12.577 DEBUG:boto:Token: None 2024-04-16T18:40:12.577 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155?versionId=null 2024-04-16T18:40:12.577 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4= 2024-04-16T18:40:12.577 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UIxidw5wVaSczc9o76RcaY470/4=', 'Content-Length': '0'} 2024-04-16T18:40:12.579 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009139eaf21dfa2075-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.580 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.580 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.580 DEBUG:boto:path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.580 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.580 DEBUG:boto:Method: GET 2024-04-16T18:40:12.580 DEBUG:boto:Path: /cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.580 DEBUG:boto:Data: 2024-04-16T18:40:12.580 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.580 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.580 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.580 DEBUG:boto:Params: {} 2024-04-16T18:40:12.581 DEBUG:boto:Token: None 2024-04-16T18:40:12.581 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.581 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.581 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.583 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be27eee1e6cb8391-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.583 DEBUG:boto:b'cjqttm-54obj1551000falseobj1552024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.583 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.584 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.584 DEBUG:boto:path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.584 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.584 DEBUG:boto:Method: GET 2024-04-16T18:40:12.584 DEBUG:boto:Path: /cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.584 DEBUG:boto:Data: 2024-04-16T18:40:12.584 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.584 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.584 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.584 DEBUG:boto:Params: {} 2024-04-16T18:40:12.584 DEBUG:boto:Token: None 2024-04-16T18:40:12.584 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.585 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.585 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.588 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009d2f6b9b33c81a39-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.630 DEBUG:boto:b'cjqttm-54obj1551000falseobj1552024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.631 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.631 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.631 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.631 DEBUG:boto:Path: /cjqttm-54/obj155 2024-04-16T18:40:12.631 DEBUG:boto:Data: 2024-04-16T18:40:12.631 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.631 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.631 DEBUG:boto:Params: {} 2024-04-16T18:40:12.632 DEBUG:boto:Token: None 2024-04-16T18:40:12.632 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155 2024-04-16T18:40:12.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cCN2HWyVGnJ6k0m+jq/RBh97JYU= 2024-04-16T18:40:12.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cCN2HWyVGnJ6k0m+jq/RBh97JYU=', 'Content-Length': '0'} 2024-04-16T18:40:12.634 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019eb856083554ba1-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.634 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.634 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.634 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.634 DEBUG:boto:Path: /cjqttm-54/obj155 2024-04-16T18:40:12.634 DEBUG:boto:Data: 2024-04-16T18:40:12.634 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.634 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.635 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.635 DEBUG:boto:Params: {} 2024-04-16T18:40:12.635 DEBUG:boto:Token: None 2024-04-16T18:40:12.635 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155 2024-04-16T18:40:12.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cCN2HWyVGnJ6k0m+jq/RBh97JYU= 2024-04-16T18:40:12.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cCN2HWyVGnJ6k0m+jq/RBh97JYU=', 'Content-Length': '0'} 2024-04-16T18:40:12.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000616669f38fd908-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:40:12.637 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.638 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.638 DEBUG:boto:Method: GET 2024-04-16T18:40:12.638 DEBUG:boto:Path: /cjqttm-54/obj155 2024-04-16T18:40:12.638 DEBUG:boto:Data: 2024-04-16T18:40:12.638 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.638 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.638 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.638 DEBUG:boto:Params: {} 2024-04-16T18:40:12.638 DEBUG:boto:Token: None 2024-04-16T18:40:12.638 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155 2024-04-16T18:40:12.638 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xR2MWzC3iNmzEa36Lyys221fKjE= 2024-04-16T18:40:12.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xR2MWzC3iNmzEa36Lyys221fKjE=', 'Content-Length': '0'} 2024-04-16T18:40:12.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003653caed1510aa87-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.642 DEBUG:boto:path=/cjqttm-54/obj155 2024-04-16T18:40:12.642 DEBUG:boto:auth_path=/cjqttm-54/obj155 2024-04-16T18:40:12.642 DEBUG:boto:Method: GET 2024-04-16T18:40:12.642 DEBUG:boto:Path: /cjqttm-54/obj155 2024-04-16T18:40:12.642 DEBUG:boto:Data: 2024-04-16T18:40:12.642 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.642 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.642 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.642 DEBUG:boto:Params: {} 2024-04-16T18:40:12.642 DEBUG:boto:Token: None 2024-04-16T18:40:12.643 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj155 2024-04-16T18:40:12.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xR2MWzC3iNmzEa36Lyys221fKjE= 2024-04-16T18:40:12.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xR2MWzC3iNmzEa36Lyys221fKjE=', 'Content-Length': '0'} 2024-04-16T18:40:12.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038bbcae87f1e5e32-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.645 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.645 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.646 DEBUG:boto:path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.646 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.646 DEBUG:boto:Method: GET 2024-04-16T18:40:12.646 DEBUG:boto:Path: /cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.646 DEBUG:boto:Data: 2024-04-16T18:40:12.646 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.646 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.646 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.646 DEBUG:boto:Params: {} 2024-04-16T18:40:12.646 DEBUG:boto:Token: None 2024-04-16T18:40:12.646 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.649 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db90d88616aedc16-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.649 DEBUG:boto:b'cjqttm-54obj1551000falseobj1552024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.649 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.649 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.649 DEBUG:boto:path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.649 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.650 DEBUG:boto:Method: GET 2024-04-16T18:40:12.650 DEBUG:boto:Path: /cjqttm-54/?prefix=obj155 2024-04-16T18:40:12.650 DEBUG:boto:Data: 2024-04-16T18:40:12.650 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.650 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.650 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.650 DEBUG:boto:Params: {} 2024-04-16T18:40:12.650 DEBUG:boto:Token: None 2024-04-16T18:40:12.650 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.650 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.651 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.654 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea4671e244a753c4-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.654 DEBUG:boto:b'cjqttm-54obj1551000falseobj1552024-04-16T18:33:09.662Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.654 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:40:12.654 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.654 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.655 DEBUG:boto:path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.655 DEBUG:boto:auth_path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.655 DEBUG:boto:Method: GET 2024-04-16T18:40:12.655 DEBUG:boto:Path: /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.655 DEBUG:boto:Data: 2024-04-16T18:40:12.655 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.655 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.655 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.655 DEBUG:boto:Params: {} 2024-04-16T18:40:12.655 DEBUG:boto:Token: None 2024-04-16T18:40:12.655 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs= 2024-04-16T18:40:12.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs=', 'Content-Length': '0'} 2024-04-16T18:40:12.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095490c2d085af0ad-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.658 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.658 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.658 DEBUG:boto:path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.658 DEBUG:boto:auth_path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.658 DEBUG:boto:Method: GET 2024-04-16T18:40:12.658 DEBUG:boto:Path: /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.659 DEBUG:boto:Data: 2024-04-16T18:40:12.659 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.659 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.659 DEBUG:boto:Params: {} 2024-04-16T18:40:12.659 DEBUG:boto:Token: None 2024-04-16T18:40:12.659 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.659 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs= 2024-04-16T18:40:12.659 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs=', 'Content-Length': '0'} 2024-04-16T18:40:12.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011841cd6aaf26d1e-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.661 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.662 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.662 DEBUG:boto:path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.662 DEBUG:boto:auth_path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.662 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.662 DEBUG:boto:Path: /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.662 DEBUG:boto:Data: 2024-04-16T18:40:12.662 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.662 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.662 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.662 DEBUG:boto:Params: {} 2024-04-16T18:40:12.662 DEBUG:boto:Token: None 2024-04-16T18:40:12.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u1vWJV6/pJGGDlYwc5pX41xJa9w= 2024-04-16T18:40:12.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u1vWJV6/pJGGDlYwc5pX41xJa9w=', 'Content-Length': '0'} 2024-04-16T18:40:12.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c0391c52ca0f472-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.665 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.665 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.665 DEBUG:boto:path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.666 DEBUG:boto:auth_path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.666 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.666 DEBUG:boto:Path: /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.666 DEBUG:boto:Data: 2024-04-16T18:40:12.666 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.666 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.666 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.666 DEBUG:boto:Params: {} 2024-04-16T18:40:12.666 DEBUG:boto:Token: None 2024-04-16T18:40:12.666 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:u1vWJV6/pJGGDlYwc5pX41xJa9w= 2024-04-16T18:40:12.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:u1vWJV6/pJGGDlYwc5pX41xJa9w=', 'Content-Length': '0'} 2024-04-16T18:40:12.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d9bca2f477f2040-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.669 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:40:12.669 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.669 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.669 DEBUG:boto:path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.669 DEBUG:boto:auth_path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.669 DEBUG:boto:Method: GET 2024-04-16T18:40:12.669 DEBUG:boto:Path: /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.669 DEBUG:boto:Data: 2024-04-16T18:40:12.669 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.669 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.669 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.670 DEBUG:boto:Params: {} 2024-04-16T18:40:12.670 DEBUG:boto:Token: None 2024-04-16T18:40:12.670 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.670 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs= 2024-04-16T18:40:12.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs=', 'Content-Length': '0'} 2024-04-16T18:40:12.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ba824980955c08c-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.672 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.672 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.672 DEBUG:boto:path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.672 DEBUG:boto:auth_path=/cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.672 DEBUG:boto:Method: GET 2024-04-16T18:40:12.672 DEBUG:boto:Path: /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.673 DEBUG:boto:Data: 2024-04-16T18:40:12.673 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.673 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.673 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.673 DEBUG:boto:Params: {} 2024-04-16T18:40:12.673 DEBUG:boto:Token: None 2024-04-16T18:40:12.673 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17?versionId=null 2024-04-16T18:40:12.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs= 2024-04-16T18:40:12.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MbGgeyhbSM5awRMYN8TBngk8WDs=', 'Content-Length': '0'} 2024-04-16T18:40:12.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c6783a29e487688f-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.675 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.676 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.676 DEBUG:boto:path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.676 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.676 DEBUG:boto:Method: GET 2024-04-16T18:40:12.676 DEBUG:boto:Path: /cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.676 DEBUG:boto:Data: 2024-04-16T18:40:12.676 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.676 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.676 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.676 DEBUG:boto:Params: {} 2024-04-16T18:40:12.676 DEBUG:boto:Token: None 2024-04-16T18:40:12.677 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.677 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.677 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.679 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aed71c639db7dfca-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.679 DEBUG:boto:b'cjqttm-54obj171000falseobj172024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.679 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.679 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.680 DEBUG:boto:path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.680 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.680 DEBUG:boto:Method: GET 2024-04-16T18:40:12.680 DEBUG:boto:Path: /cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.680 DEBUG:boto:Data: 2024-04-16T18:40:12.680 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.680 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.680 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.680 DEBUG:boto:Params: {} 2024-04-16T18:40:12.680 DEBUG:boto:Token: None 2024-04-16T18:40:12.681 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.681 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.685 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d675cc04c576f4ea-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.685 DEBUG:boto:b'cjqttm-54obj171000falseobj172024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.685 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.685 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.685 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.685 DEBUG:boto:Path: /cjqttm-54/obj17 2024-04-16T18:40:12.685 DEBUG:boto:Data: 2024-04-16T18:40:12.685 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.686 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.686 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.686 DEBUG:boto:Params: {} 2024-04-16T18:40:12.686 DEBUG:boto:Token: None 2024-04-16T18:40:12.686 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17 2024-04-16T18:40:12.686 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WHzmZTuzNpASO6SRqVgxVnTiMrs= 2024-04-16T18:40:12.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHzmZTuzNpASO6SRqVgxVnTiMrs=', 'Content-Length': '0'} 2024-04-16T18:40:12.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b912378c51b3bf23-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.688 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.688 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.688 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.689 DEBUG:boto:Path: /cjqttm-54/obj17 2024-04-16T18:40:12.689 DEBUG:boto:Data: 2024-04-16T18:40:12.689 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.689 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.689 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.689 DEBUG:boto:Params: {} 2024-04-16T18:40:12.689 DEBUG:boto:Token: None 2024-04-16T18:40:12.689 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17 2024-04-16T18:40:12.689 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WHzmZTuzNpASO6SRqVgxVnTiMrs= 2024-04-16T18:40:12.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHzmZTuzNpASO6SRqVgxVnTiMrs=', 'Content-Length': '0'} 2024-04-16T18:40:12.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f57708145d8ea158-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.691 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:40:12.692 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.692 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.692 DEBUG:boto:Method: GET 2024-04-16T18:40:12.692 DEBUG:boto:Path: /cjqttm-54/obj17 2024-04-16T18:40:12.692 DEBUG:boto:Data: 2024-04-16T18:40:12.692 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.692 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.692 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.692 DEBUG:boto:Params: {} 2024-04-16T18:40:12.692 DEBUG:boto:Token: None 2024-04-16T18:40:12.693 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17 2024-04-16T18:40:12.693 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KkqwA0WQDf8q4pc0XrIXmJ7S/jA= 2024-04-16T18:40:12.693 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KkqwA0WQDf8q4pc0XrIXmJ7S/jA=', 'Content-Length': '0'} 2024-04-16T18:40:12.695 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000231968a225e3cc20-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.738 DEBUG:boto:path=/cjqttm-54/obj17 2024-04-16T18:40:12.738 DEBUG:boto:auth_path=/cjqttm-54/obj17 2024-04-16T18:40:12.738 DEBUG:boto:Method: GET 2024-04-16T18:40:12.739 DEBUG:boto:Path: /cjqttm-54/obj17 2024-04-16T18:40:12.739 DEBUG:boto:Data: 2024-04-16T18:40:12.739 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.739 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.739 DEBUG:boto:Params: {} 2024-04-16T18:40:12.739 DEBUG:boto:Token: None 2024-04-16T18:40:12.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj17 2024-04-16T18:40:12.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KkqwA0WQDf8q4pc0XrIXmJ7S/jA= 2024-04-16T18:40:12.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KkqwA0WQDf8q4pc0XrIXmJ7S/jA=', 'Content-Length': '0'} 2024-04-16T18:40:12.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f2c3d864e45c0758-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.741 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.741 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.742 DEBUG:boto:path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.742 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.742 DEBUG:boto:Method: GET 2024-04-16T18:40:12.742 DEBUG:boto:Path: /cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.742 DEBUG:boto:Data: 2024-04-16T18:40:12.742 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.742 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.742 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.742 DEBUG:boto:Params: {} 2024-04-16T18:40:12.742 DEBUG:boto:Token: None 2024-04-16T18:40:12.742 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.744 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b06b249c52b76ce3-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.745 DEBUG:boto:b'cjqttm-54obj171000falseobj172024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.745 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.745 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.745 DEBUG:boto:path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.745 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.745 DEBUG:boto:Method: GET 2024-04-16T18:40:12.746 DEBUG:boto:Path: /cjqttm-54/?prefix=obj17 2024-04-16T18:40:12.746 DEBUG:boto:Data: 2024-04-16T18:40:12.746 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.746 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.746 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.746 DEBUG:boto:Params: {} 2024-04-16T18:40:12.746 DEBUG:boto:Token: None 2024-04-16T18:40:12.746 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.746 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.750 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd79829f32fad445-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.750 DEBUG:boto:b'cjqttm-54obj171000falseobj172024-04-16T18:33:08.300Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.750 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:40:12.751 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.751 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.751 DEBUG:boto:path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.751 DEBUG:boto:auth_path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.751 DEBUG:boto:Method: GET 2024-04-16T18:40:12.751 DEBUG:boto:Path: /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.751 DEBUG:boto:Data: 2024-04-16T18:40:12.751 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.751 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.751 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.751 DEBUG:boto:Params: {} 2024-04-16T18:40:12.752 DEBUG:boto:Token: None 2024-04-16T18:40:12.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8= 2024-04-16T18:40:12.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8=', 'Content-Length': '0'} 2024-04-16T18:40:12.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc9be13c4953dfa4-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.754 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.754 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.754 DEBUG:boto:path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.754 DEBUG:boto:auth_path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.754 DEBUG:boto:Method: GET 2024-04-16T18:40:12.754 DEBUG:boto:Path: /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.754 DEBUG:boto:Data: 2024-04-16T18:40:12.755 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.755 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.755 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.755 DEBUG:boto:Params: {} 2024-04-16T18:40:12.755 DEBUG:boto:Token: None 2024-04-16T18:40:12.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8= 2024-04-16T18:40:12.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8=', 'Content-Length': '0'} 2024-04-16T18:40:12.757 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016732313683b76d0-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.757 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.757 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.758 DEBUG:boto:path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.758 DEBUG:boto:auth_path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.758 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.758 DEBUG:boto:Path: /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.758 DEBUG:boto:Data: 2024-04-16T18:40:12.758 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.758 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.758 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.758 DEBUG:boto:Params: {} 2024-04-16T18:40:12.758 DEBUG:boto:Token: None 2024-04-16T18:40:12.758 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.759 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o2BCKBPYwh2Y6oq2GdJBixkEl2I= 2024-04-16T18:40:12.759 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o2BCKBPYwh2Y6oq2GdJBixkEl2I=', 'Content-Length': '0'} 2024-04-16T18:40:12.760 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d56478a018c8299f-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.761 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.761 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.761 DEBUG:boto:path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.761 DEBUG:boto:auth_path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.761 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.761 DEBUG:boto:Path: /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.761 DEBUG:boto:Data: 2024-04-16T18:40:12.761 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.761 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.762 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.762 DEBUG:boto:Params: {} 2024-04-16T18:40:12.762 DEBUG:boto:Token: None 2024-04-16T18:40:12.762 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.762 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o2BCKBPYwh2Y6oq2GdJBixkEl2I= 2024-04-16T18:40:12.762 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o2BCKBPYwh2Y6oq2GdJBixkEl2I=', 'Content-Length': '0'} 2024-04-16T18:40:12.764 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5a79946a5e418fc-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.764 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:40:12.764 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.764 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.764 DEBUG:boto:path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.764 DEBUG:boto:auth_path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.764 DEBUG:boto:Method: GET 2024-04-16T18:40:12.765 DEBUG:boto:Path: /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.765 DEBUG:boto:Data: 2024-04-16T18:40:12.765 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.765 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.765 DEBUG:boto:Params: {} 2024-04-16T18:40:12.765 DEBUG:boto:Token: None 2024-04-16T18:40:12.765 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.765 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8= 2024-04-16T18:40:12.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8=', 'Content-Length': '0'} 2024-04-16T18:40:12.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000106695bf3c4858ae-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.767 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.768 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.768 DEBUG:boto:path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.768 DEBUG:boto:auth_path=/cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.768 DEBUG:boto:Method: GET 2024-04-16T18:40:12.768 DEBUG:boto:Path: /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.768 DEBUG:boto:Data: 2024-04-16T18:40:12.768 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.768 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.768 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.768 DEBUG:boto:Params: {} 2024-04-16T18:40:12.768 DEBUG:boto:Token: None 2024-04-16T18:40:12.769 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185?versionId=null 2024-04-16T18:40:12.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8= 2024-04-16T18:40:12.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ENtTqF5HbbZtka3WOHEa7UMT7S8=', 'Content-Length': '0'} 2024-04-16T18:40:12.770 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077455165f2b27c11-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.771 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.771 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.771 DEBUG:boto:path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.771 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.771 DEBUG:boto:Method: GET 2024-04-16T18:40:12.771 DEBUG:boto:Path: /cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.771 DEBUG:boto:Data: 2024-04-16T18:40:12.771 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.772 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.772 DEBUG:boto:Params: {} 2024-04-16T18:40:12.772 DEBUG:boto:Token: None 2024-04-16T18:40:12.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.774 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003a659f1061c62b77-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.774 DEBUG:boto:b'cjqttm-54obj1851000falseobj1852024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.775 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.775 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.775 DEBUG:boto:path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.775 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.775 DEBUG:boto:Method: GET 2024-04-16T18:40:12.775 DEBUG:boto:Path: /cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.775 DEBUG:boto:Data: 2024-04-16T18:40:12.775 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.775 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.776 DEBUG:boto:Params: {} 2024-04-16T18:40:12.776 DEBUG:boto:Token: None 2024-04-16T18:40:12.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.780 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e23b81afd894056b-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.780 DEBUG:boto:b'cjqttm-54obj1851000falseobj1852024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.780 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.780 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.780 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.780 DEBUG:boto:Path: /cjqttm-54/obj185 2024-04-16T18:40:12.780 DEBUG:boto:Data: 2024-04-16T18:40:12.781 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.781 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.781 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.781 DEBUG:boto:Params: {} 2024-04-16T18:40:12.781 DEBUG:boto:Token: None 2024-04-16T18:40:12.781 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185 2024-04-16T18:40:12.781 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2760fsVLM7agachJ+5nimR95lTM= 2024-04-16T18:40:12.781 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2760fsVLM7agachJ+5nimR95lTM=', 'Content-Length': '0'} 2024-04-16T18:40:12.783 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006921052949312ced-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.783 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.784 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.784 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.784 DEBUG:boto:Path: /cjqttm-54/obj185 2024-04-16T18:40:12.784 DEBUG:boto:Data: 2024-04-16T18:40:12.784 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.784 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.784 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.784 DEBUG:boto:Params: {} 2024-04-16T18:40:12.784 DEBUG:boto:Token: None 2024-04-16T18:40:12.784 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185 2024-04-16T18:40:12.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2760fsVLM7agachJ+5nimR95lTM= 2024-04-16T18:40:12.785 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2760fsVLM7agachJ+5nimR95lTM=', 'Content-Length': '0'} 2024-04-16T18:40:12.786 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056c721f07bef40a0-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.786 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:40:12.787 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.787 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.787 DEBUG:boto:Method: GET 2024-04-16T18:40:12.787 DEBUG:boto:Path: /cjqttm-54/obj185 2024-04-16T18:40:12.787 DEBUG:boto:Data: 2024-04-16T18:40:12.787 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.787 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.787 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.787 DEBUG:boto:Params: {} 2024-04-16T18:40:12.787 DEBUG:boto:Token: None 2024-04-16T18:40:12.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185 2024-04-16T18:40:12.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2JZ9Y0k0mGi190s0zSpIn+tdJtg= 2024-04-16T18:40:12.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2JZ9Y0k0mGi190s0zSpIn+tdJtg=', 'Content-Length': '0'} 2024-04-16T18:40:12.790 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db6687f1e337937d-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.830 DEBUG:boto:path=/cjqttm-54/obj185 2024-04-16T18:40:12.830 DEBUG:boto:auth_path=/cjqttm-54/obj185 2024-04-16T18:40:12.830 DEBUG:boto:Method: GET 2024-04-16T18:40:12.831 DEBUG:boto:Path: /cjqttm-54/obj185 2024-04-16T18:40:12.831 DEBUG:boto:Data: 2024-04-16T18:40:12.831 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.831 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.831 DEBUG:boto:Params: {} 2024-04-16T18:40:12.831 DEBUG:boto:Token: None 2024-04-16T18:40:12.831 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj185 2024-04-16T18:40:12.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2JZ9Y0k0mGi190s0zSpIn+tdJtg= 2024-04-16T18:40:12.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2JZ9Y0k0mGi190s0zSpIn+tdJtg=', 'Content-Length': '0'} 2024-04-16T18:40:12.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042b2ba76bd15d4c3-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.833 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.833 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.834 DEBUG:boto:path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.834 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.834 DEBUG:boto:Method: GET 2024-04-16T18:40:12.834 DEBUG:boto:Path: /cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.834 DEBUG:boto:Data: 2024-04-16T18:40:12.834 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.834 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.834 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.834 DEBUG:boto:Params: {} 2024-04-16T18:40:12.834 DEBUG:boto:Token: None 2024-04-16T18:40:12.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.835 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.835 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.837 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006220c85523ff1477-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.837 DEBUG:boto:b'cjqttm-54obj1851000falseobj1852024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.837 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.837 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.838 DEBUG:boto:path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.838 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.838 DEBUG:boto:Method: GET 2024-04-16T18:40:12.838 DEBUG:boto:Path: /cjqttm-54/?prefix=obj185 2024-04-16T18:40:12.838 DEBUG:boto:Data: 2024-04-16T18:40:12.838 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.838 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.838 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.838 DEBUG:boto:Params: {} 2024-04-16T18:40:12.838 DEBUG:boto:Token: None 2024-04-16T18:40:12.838 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.839 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.842 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001922f29aa63fcd3d-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.843 DEBUG:boto:b'cjqttm-54obj1851000falseobj1852024-04-16T18:33:09.998Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.843 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:40:12.843 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.843 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.843 DEBUG:boto:path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.843 DEBUG:boto:auth_path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.843 DEBUG:boto:Method: GET 2024-04-16T18:40:12.843 DEBUG:boto:Path: /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.844 DEBUG:boto:Data: 2024-04-16T18:40:12.844 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.844 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.844 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.844 DEBUG:boto:Params: {} 2024-04-16T18:40:12.844 DEBUG:boto:Token: None 2024-04-16T18:40:12.844 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8= 2024-04-16T18:40:12.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8=', 'Content-Length': '0'} 2024-04-16T18:40:12.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008ceb2e7714c4af7c-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.846 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.847 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.847 DEBUG:boto:path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.847 DEBUG:boto:auth_path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.847 DEBUG:boto:Method: GET 2024-04-16T18:40:12.847 DEBUG:boto:Path: /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.847 DEBUG:boto:Data: 2024-04-16T18:40:12.847 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.847 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.847 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.847 DEBUG:boto:Params: {} 2024-04-16T18:40:12.847 DEBUG:boto:Token: None 2024-04-16T18:40:12.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8= 2024-04-16T18:40:12.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8=', 'Content-Length': '0'} 2024-04-16T18:40:12.850 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001422d365a43e6224-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.890 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.890 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.891 DEBUG:boto:path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.891 DEBUG:boto:auth_path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.891 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.891 DEBUG:boto:Path: /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.891 DEBUG:boto:Data: 2024-04-16T18:40:12.891 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.891 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.891 DEBUG:boto:Params: {} 2024-04-16T18:40:12.891 DEBUG:boto:Token: None 2024-04-16T18:40:12.891 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xybwAGxDWmAnOHX2zukm7/V42Hw= 2024-04-16T18:40:12.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xybwAGxDWmAnOHX2zukm7/V42Hw=', 'Content-Length': '0'} 2024-04-16T18:40:12.894 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f50f166f8efebbb-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.894 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.894 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.894 DEBUG:boto:path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.895 DEBUG:boto:auth_path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.895 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.895 DEBUG:boto:Path: /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.895 DEBUG:boto:Data: 2024-04-16T18:40:12.895 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.895 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.895 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.895 DEBUG:boto:Params: {} 2024-04-16T18:40:12.895 DEBUG:boto:Token: None 2024-04-16T18:40:12.895 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xybwAGxDWmAnOHX2zukm7/V42Hw= 2024-04-16T18:40:12.896 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xybwAGxDWmAnOHX2zukm7/V42Hw=', 'Content-Length': '0'} 2024-04-16T18:40:12.898 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078fdb86eceb9e16f-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.898 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:40:12.898 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.898 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.898 DEBUG:boto:path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.898 DEBUG:boto:auth_path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.898 DEBUG:boto:Method: GET 2024-04-16T18:40:12.899 DEBUG:boto:Path: /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.899 DEBUG:boto:Data: 2024-04-16T18:40:12.899 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.899 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.899 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.899 DEBUG:boto:Params: {} 2024-04-16T18:40:12.899 DEBUG:boto:Token: None 2024-04-16T18:40:12.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.899 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8= 2024-04-16T18:40:12.899 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8=', 'Content-Length': '0'} 2024-04-16T18:40:12.901 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003d34547b785e2bd-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.902 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.902 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.902 DEBUG:boto:path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.902 DEBUG:boto:auth_path=/cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.902 DEBUG:boto:Method: GET 2024-04-16T18:40:12.902 DEBUG:boto:Path: /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.902 DEBUG:boto:Data: 2024-04-16T18:40:12.902 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.902 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.902 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.903 DEBUG:boto:Params: {} 2024-04-16T18:40:12.903 DEBUG:boto:Token: None 2024-04-16T18:40:12.903 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19?versionId=null 2024-04-16T18:40:12.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8= 2024-04-16T18:40:12.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YigekksJEqe+Rja1k/tVIzsiqI8=', 'Content-Length': '0'} 2024-04-16T18:40:12.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096a6f2487a3f8887-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.905 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.905 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.906 DEBUG:boto:path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.906 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.906 DEBUG:boto:Method: GET 2024-04-16T18:40:12.906 DEBUG:boto:Path: /cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.906 DEBUG:boto:Data: 2024-04-16T18:40:12.906 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.906 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.906 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.906 DEBUG:boto:Params: {} 2024-04-16T18:40:12.906 DEBUG:boto:Token: None 2024-04-16T18:40:12.906 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.907 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.909 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a23ea425741d154d-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.909 DEBUG:boto:b'cjqttm-54obj191000falseobj192024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.909 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.909 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.909 DEBUG:boto:path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.909 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.909 DEBUG:boto:Method: GET 2024-04-16T18:40:12.910 DEBUG:boto:Path: /cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.910 DEBUG:boto:Data: 2024-04-16T18:40:12.910 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.910 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.910 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.910 DEBUG:boto:Params: {} 2024-04-16T18:40:12.910 DEBUG:boto:Token: None 2024-04-16T18:40:12.910 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.910 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000489bba3f2d536448-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.915 DEBUG:boto:b'cjqttm-54obj191000falseobj192024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.915 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.915 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.915 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.915 DEBUG:boto:Path: /cjqttm-54/obj19 2024-04-16T18:40:12.915 DEBUG:boto:Data: 2024-04-16T18:40:12.915 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.915 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.915 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.915 DEBUG:boto:Params: {} 2024-04-16T18:40:12.916 DEBUG:boto:Token: None 2024-04-16T18:40:12.916 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19 2024-04-16T18:40:12.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cqcLRPEJSiaV+uwDrn4ofYaD6cU= 2024-04-16T18:40:12.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cqcLRPEJSiaV+uwDrn4ofYaD6cU=', 'Content-Length': '0'} 2024-04-16T18:40:12.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009df1cb3562e38b84-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.918 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.918 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.918 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.919 DEBUG:boto:Path: /cjqttm-54/obj19 2024-04-16T18:40:12.919 DEBUG:boto:Data: 2024-04-16T18:40:12.919 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.919 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.919 DEBUG:boto:Params: {} 2024-04-16T18:40:12.919 DEBUG:boto:Token: None 2024-04-16T18:40:12.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19 2024-04-16T18:40:12.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cqcLRPEJSiaV+uwDrn4ofYaD6cU= 2024-04-16T18:40:12.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cqcLRPEJSiaV+uwDrn4ofYaD6cU=', 'Content-Length': '0'} 2024-04-16T18:40:12.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab8d74f879c1b67d-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:40:12.922 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.922 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.922 DEBUG:boto:Method: GET 2024-04-16T18:40:12.922 DEBUG:boto:Path: /cjqttm-54/obj19 2024-04-16T18:40:12.922 DEBUG:boto:Data: 2024-04-16T18:40:12.922 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.922 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.922 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.922 DEBUG:boto:Params: {} 2024-04-16T18:40:12.923 DEBUG:boto:Token: None 2024-04-16T18:40:12.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19 2024-04-16T18:40:12.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LMmYJpWWz8GT67S3DbT5HTAOgAU= 2024-04-16T18:40:12.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LMmYJpWWz8GT67S3DbT5HTAOgAU=', 'Content-Length': '0'} 2024-04-16T18:40:12.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc8f5438d98a5214-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.925 DEBUG:boto:path=/cjqttm-54/obj19 2024-04-16T18:40:12.925 DEBUG:boto:auth_path=/cjqttm-54/obj19 2024-04-16T18:40:12.925 DEBUG:boto:Method: GET 2024-04-16T18:40:12.926 DEBUG:boto:Path: /cjqttm-54/obj19 2024-04-16T18:40:12.926 DEBUG:boto:Data: 2024-04-16T18:40:12.926 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.926 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.926 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.926 DEBUG:boto:Params: {} 2024-04-16T18:40:12.926 DEBUG:boto:Token: None 2024-04-16T18:40:12.926 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj19 2024-04-16T18:40:12.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LMmYJpWWz8GT67S3DbT5HTAOgAU= 2024-04-16T18:40:12.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LMmYJpWWz8GT67S3DbT5HTAOgAU=', 'Content-Length': '0'} 2024-04-16T18:40:12.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa7412bcab269c04-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.929 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.929 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.929 DEBUG:boto:path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.929 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.929 DEBUG:boto:Method: GET 2024-04-16T18:40:12.929 DEBUG:boto:Path: /cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.929 DEBUG:boto:Data: 2024-04-16T18:40:12.929 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.930 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.930 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.930 DEBUG:boto:Params: {} 2024-04-16T18:40:12.930 DEBUG:boto:Token: None 2024-04-16T18:40:12.930 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.932 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ff1673e039e9f0c-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.932 DEBUG:boto:b'cjqttm-54obj191000falseobj192024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.933 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.933 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.933 DEBUG:boto:path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.933 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.933 DEBUG:boto:Method: GET 2024-04-16T18:40:12.933 DEBUG:boto:Path: /cjqttm-54/?prefix=obj19 2024-04-16T18:40:12.933 DEBUG:boto:Data: 2024-04-16T18:40:12.933 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.933 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.933 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.934 DEBUG:boto:Params: {} 2024-04-16T18:40:12.934 DEBUG:boto:Token: None 2024-04-16T18:40:12.934 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.934 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.937 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d67a0b3bf30a5fd4-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.938 DEBUG:boto:b'cjqttm-54obj191000falseobj192024-04-16T18:33:08.612Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.938 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:40:12.938 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:12.938 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:12.938 DEBUG:boto:path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.938 DEBUG:boto:auth_path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.938 DEBUG:boto:Method: GET 2024-04-16T18:40:12.939 DEBUG:boto:Path: /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.939 DEBUG:boto:Data: 2024-04-16T18:40:12.939 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.939 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.939 DEBUG:boto:Params: {} 2024-04-16T18:40:12.939 DEBUG:boto:Token: None 2024-04-16T18:40:12.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE= 2024-04-16T18:40:12.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE=', 'Content-Length': '0'} 2024-04-16T18:40:12.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000055854d50ef1a2abb-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.941 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:12.942 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:12.942 DEBUG:boto:path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.942 DEBUG:boto:auth_path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.942 DEBUG:boto:Method: GET 2024-04-16T18:40:12.942 DEBUG:boto:Path: /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.942 DEBUG:boto:Data: 2024-04-16T18:40:12.942 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.942 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.942 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.942 DEBUG:boto:Params: {} 2024-04-16T18:40:12.942 DEBUG:boto:Token: None 2024-04-16T18:40:12.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE= 2024-04-16T18:40:12.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE=', 'Content-Length': '0'} 2024-04-16T18:40:12.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080b2cf38b3bc1f62-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.945 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:12.945 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:12.945 DEBUG:boto:path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.945 DEBUG:boto:auth_path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.945 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.945 DEBUG:boto:Path: /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.946 DEBUG:boto:Data: 2024-04-16T18:40:12.946 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.946 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.946 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.946 DEBUG:boto:Params: {} 2024-04-16T18:40:12.946 DEBUG:boto:Token: None 2024-04-16T18:40:12.946 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.946 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O0FhufK/5vxJ6IyN3fL1Zhq7IHw= 2024-04-16T18:40:12.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O0FhufK/5vxJ6IyN3fL1Zhq7IHw=', 'Content-Length': '0'} 2024-04-16T18:40:12.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6ff700a5c2f2f8e-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.949 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:12.949 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:12.949 DEBUG:boto:path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.949 DEBUG:boto:auth_path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.949 DEBUG:boto:Method: HEAD 2024-04-16T18:40:12.949 DEBUG:boto:Path: /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.949 DEBUG:boto:Data: 2024-04-16T18:40:12.949 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.949 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.949 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.949 DEBUG:boto:Params: {} 2024-04-16T18:40:12.950 DEBUG:boto:Token: None 2024-04-16T18:40:12.950 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O0FhufK/5vxJ6IyN3fL1Zhq7IHw= 2024-04-16T18:40:12.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O0FhufK/5vxJ6IyN3fL1Zhq7IHw=', 'Content-Length': '0'} 2024-04-16T18:40:12.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cd54509f7fa44fb5-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:40:12.952 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:12.952 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:12.952 DEBUG:boto:path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.952 DEBUG:boto:auth_path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.952 DEBUG:boto:Method: GET 2024-04-16T18:40:12.953 DEBUG:boto:Path: /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.953 DEBUG:boto:Data: 2024-04-16T18:40:12.953 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.953 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.953 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.953 DEBUG:boto:Params: {} 2024-04-16T18:40:12.953 DEBUG:boto:Token: None 2024-04-16T18:40:12.953 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.953 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE= 2024-04-16T18:40:12.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE=', 'Content-Length': '0'} 2024-04-16T18:40:12.956 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000916c6269ffb31159-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.956 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:12.956 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:12.956 DEBUG:boto:path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.956 DEBUG:boto:auth_path=/cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.956 DEBUG:boto:Method: GET 2024-04-16T18:40:12.956 DEBUG:boto:Path: /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.956 DEBUG:boto:Data: 2024-04-16T18:40:12.956 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.957 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.957 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.957 DEBUG:boto:Params: {} 2024-04-16T18:40:12.957 DEBUG:boto:Token: None 2024-04-16T18:40:12.957 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/obj22?versionId=null 2024-04-16T18:40:12.957 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE= 2024-04-16T18:40:12.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HadgdAFEAnghnu0rV2KyTANaknE=', 'Content-Length': '0'} 2024-04-16T18:40:12.959 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccf56ec956a68578-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.959 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.960 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.960 DEBUG:boto:path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:12.960 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:12.960 DEBUG:boto:Method: GET 2024-04-16T18:40:12.960 DEBUG:boto:Path: /cjqttm-54/?prefix=obj22 2024-04-16T18:40:12.960 DEBUG:boto:Data: 2024-04-16T18:40:12.960 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.960 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:12.960 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.960 DEBUG:boto:Params: {} 2024-04-16T18:40:12.961 DEBUG:boto:Token: None 2024-04-16T18:40:12.961 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.963 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004be50661a2791120-00661ec60c-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:12.963 DEBUG:boto:b'cjqttm-54obj221000falseobj222024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:12.963 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:12.964 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:12.964 DEBUG:boto:path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:12.964 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:12.964 DEBUG:boto:Method: GET 2024-04-16T18:40:12.964 DEBUG:boto:Path: /cjqttm-54/?prefix=obj22 2024-04-16T18:40:12.964 DEBUG:boto:Data: 2024-04-16T18:40:12.964 DEBUG:boto:Headers: {} 2024-04-16T18:40:12.964 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:12.964 DEBUG:boto:Port: 8000 2024-04-16T18:40:12.964 DEBUG:boto:Params: {} 2024-04-16T18:40:12.965 DEBUG:boto:Token: None 2024-04-16T18:40:12.965 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:12 GMT /cjqttm-54/ 2024-04-16T18:40:12.965 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM= 2024-04-16T18:40:12.965 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:12 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kDmC12CpkpCdCt18uhUaCw1pThM=', 'Content-Length': '0'} 2024-04-16T18:40:12.968 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000228aa53d6ea2a15b-00661ec60c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:12 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.010 DEBUG:boto:b'cjqttm-54obj221000falseobj222024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.010 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:13.011 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:13.011 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.011 DEBUG:boto:Path: /cjqttm-54/obj22 2024-04-16T18:40:13.011 DEBUG:boto:Data: 2024-04-16T18:40:13.011 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.011 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.011 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.011 DEBUG:boto:Params: {} 2024-04-16T18:40:13.011 DEBUG:boto:Token: None 2024-04-16T18:40:13.011 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj22 2024-04-16T18:40:13.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:34x/SNKmdqRCvURYNk0qUFn64jY= 2024-04-16T18:40:13.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:34x/SNKmdqRCvURYNk0qUFn64jY=', 'Content-Length': '0'} 2024-04-16T18:40:13.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ecffedab789cb80-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.014 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:13.014 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:13.014 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.014 DEBUG:boto:Path: /cjqttm-54/obj22 2024-04-16T18:40:13.014 DEBUG:boto:Data: 2024-04-16T18:40:13.014 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.014 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.014 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.015 DEBUG:boto:Params: {} 2024-04-16T18:40:13.015 DEBUG:boto:Token: None 2024-04-16T18:40:13.015 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj22 2024-04-16T18:40:13.015 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:34x/SNKmdqRCvURYNk0qUFn64jY= 2024-04-16T18:40:13.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:34x/SNKmdqRCvURYNk0qUFn64jY=', 'Content-Length': '0'} 2024-04-16T18:40:13.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f8aa08c4e3b1296-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.017 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:40:13.017 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:13.017 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:13.017 DEBUG:boto:Method: GET 2024-04-16T18:40:13.017 DEBUG:boto:Path: /cjqttm-54/obj22 2024-04-16T18:40:13.017 DEBUG:boto:Data: 2024-04-16T18:40:13.018 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.018 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.018 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.018 DEBUG:boto:Params: {} 2024-04-16T18:40:13.018 DEBUG:boto:Token: None 2024-04-16T18:40:13.018 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj22 2024-04-16T18:40:13.018 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h3XTb2P7kxUwbp9MMl87sA8nsII= 2024-04-16T18:40:13.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h3XTb2P7kxUwbp9MMl87sA8nsII=', 'Content-Length': '0'} 2024-04-16T18:40:13.020 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b634cbb12f817de5-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.021 DEBUG:boto:path=/cjqttm-54/obj22 2024-04-16T18:40:13.021 DEBUG:boto:auth_path=/cjqttm-54/obj22 2024-04-16T18:40:13.021 DEBUG:boto:Method: GET 2024-04-16T18:40:13.021 DEBUG:boto:Path: /cjqttm-54/obj22 2024-04-16T18:40:13.021 DEBUG:boto:Data: 2024-04-16T18:40:13.021 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.021 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.021 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.021 DEBUG:boto:Params: {} 2024-04-16T18:40:13.021 DEBUG:boto:Token: None 2024-04-16T18:40:13.022 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj22 2024-04-16T18:40:13.022 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:h3XTb2P7kxUwbp9MMl87sA8nsII= 2024-04-16T18:40:13.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h3XTb2P7kxUwbp9MMl87sA8nsII=', 'Content-Length': '0'} 2024-04-16T18:40:13.024 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a465105ebc99cca1-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.024 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.024 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.024 DEBUG:boto:path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:13.025 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:13.025 DEBUG:boto:Method: GET 2024-04-16T18:40:13.025 DEBUG:boto:Path: /cjqttm-54/?prefix=obj22 2024-04-16T18:40:13.025 DEBUG:boto:Data: 2024-04-16T18:40:13.025 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.025 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.025 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.025 DEBUG:boto:Params: {} 2024-04-16T18:40:13.025 DEBUG:boto:Token: None 2024-04-16T18:40:13.025 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.025 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.027 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cedb39b0f9e7a4d5-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.028 DEBUG:boto:b'cjqttm-54obj221000falseobj222024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.028 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.028 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.028 DEBUG:boto:path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:13.028 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj22 2024-04-16T18:40:13.028 DEBUG:boto:Method: GET 2024-04-16T18:40:13.028 DEBUG:boto:Path: /cjqttm-54/?prefix=obj22 2024-04-16T18:40:13.029 DEBUG:boto:Data: 2024-04-16T18:40:13.029 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.029 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.029 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.029 DEBUG:boto:Params: {} 2024-04-16T18:40:13.029 DEBUG:boto:Token: None 2024-04-16T18:40:13.029 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.033 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000383bf95371ec899d-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.033 DEBUG:boto:b'cjqttm-54obj221000falseobj222024-04-16T18:33:08.036Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.033 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:40:13.033 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.033 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.033 DEBUG:boto:path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.033 DEBUG:boto:auth_path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.034 DEBUG:boto:Method: GET 2024-04-16T18:40:13.034 DEBUG:boto:Path: /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.034 DEBUG:boto:Data: 2024-04-16T18:40:13.034 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.034 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.034 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.034 DEBUG:boto:Params: {} 2024-04-16T18:40:13.034 DEBUG:boto:Token: None 2024-04-16T18:40:13.034 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.034 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE= 2024-04-16T18:40:13.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE=', 'Content-Length': '0'} 2024-04-16T18:40:13.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a221101248ca8eb1-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.078 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.078 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.078 DEBUG:boto:path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.079 DEBUG:boto:auth_path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.079 DEBUG:boto:Method: GET 2024-04-16T18:40:13.079 DEBUG:boto:Path: /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.079 DEBUG:boto:Data: 2024-04-16T18:40:13.079 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.079 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.079 DEBUG:boto:Params: {} 2024-04-16T18:40:13.079 DEBUG:boto:Token: None 2024-04-16T18:40:13.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE= 2024-04-16T18:40:13.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE=', 'Content-Length': '0'} 2024-04-16T18:40:13.082 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000299ed7d0505a801c-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.082 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.082 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.082 DEBUG:boto:path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.082 DEBUG:boto:auth_path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.082 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.082 DEBUG:boto:Path: /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.082 DEBUG:boto:Data: 2024-04-16T18:40:13.083 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.083 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.083 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.083 DEBUG:boto:Params: {} 2024-04-16T18:40:13.083 DEBUG:boto:Token: None 2024-04-16T18:40:13.083 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.083 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BDOKsi2qZ5prlM3t+7YAxzOZ4eU= 2024-04-16T18:40:13.083 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BDOKsi2qZ5prlM3t+7YAxzOZ4eU=', 'Content-Length': '0'} 2024-04-16T18:40:13.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000042fe362b73367ea-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.085 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.085 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.085 DEBUG:boto:path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.085 DEBUG:boto:auth_path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.085 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.085 DEBUG:boto:Path: /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.086 DEBUG:boto:Data: 2024-04-16T18:40:13.086 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.086 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.086 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.086 DEBUG:boto:Params: {} 2024-04-16T18:40:13.086 DEBUG:boto:Token: None 2024-04-16T18:40:13.086 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.086 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BDOKsi2qZ5prlM3t+7YAxzOZ4eU= 2024-04-16T18:40:13.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BDOKsi2qZ5prlM3t+7YAxzOZ4eU=', 'Content-Length': '0'} 2024-04-16T18:40:13.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004cd65d6e67c7e2da-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:40:13.089 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.089 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.089 DEBUG:boto:path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.089 DEBUG:boto:auth_path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.089 DEBUG:boto:Method: GET 2024-04-16T18:40:13.089 DEBUG:boto:Path: /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.089 DEBUG:boto:Data: 2024-04-16T18:40:13.089 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.089 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.089 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.089 DEBUG:boto:Params: {} 2024-04-16T18:40:13.089 DEBUG:boto:Token: None 2024-04-16T18:40:13.090 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.090 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE= 2024-04-16T18:40:13.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE=', 'Content-Length': '0'} 2024-04-16T18:40:13.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088687b5b6555d269-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.092 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.092 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.092 DEBUG:boto:path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.092 DEBUG:boto:auth_path=/cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.092 DEBUG:boto:Method: GET 2024-04-16T18:40:13.092 DEBUG:boto:Path: /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.093 DEBUG:boto:Data: 2024-04-16T18:40:13.093 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.093 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.093 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.093 DEBUG:boto:Params: {} 2024-04-16T18:40:13.093 DEBUG:boto:Token: None 2024-04-16T18:40:13.093 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23?versionId=null 2024-04-16T18:40:13.093 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE= 2024-04-16T18:40:13.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sjVkjitnE6t0SLEN8/ZzA1YQ8KE=', 'Content-Length': '0'} 2024-04-16T18:40:13.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c1a25268091cf1a-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.095 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.096 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.096 DEBUG:boto:path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.096 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.096 DEBUG:boto:Method: GET 2024-04-16T18:40:13.096 DEBUG:boto:Path: /cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.096 DEBUG:boto:Data: 2024-04-16T18:40:13.096 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.096 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.096 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.096 DEBUG:boto:Params: {} 2024-04-16T18:40:13.096 DEBUG:boto:Token: None 2024-04-16T18:40:13.097 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.097 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.097 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.099 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000fb69774ba48c33fd-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.099 DEBUG:boto:b'cjqttm-54obj231000falseobj232024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.099 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.099 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.100 DEBUG:boto:path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.100 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.100 DEBUG:boto:Method: GET 2024-04-16T18:40:13.100 DEBUG:boto:Path: /cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.100 DEBUG:boto:Data: 2024-04-16T18:40:13.100 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.100 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.100 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.100 DEBUG:boto:Params: {} 2024-04-16T18:40:13.100 DEBUG:boto:Token: None 2024-04-16T18:40:13.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.101 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.101 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000db811e4905d58dbe-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.105 DEBUG:boto:b'cjqttm-54obj231000falseobj232024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.105 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.105 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.105 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.105 DEBUG:boto:Path: /cjqttm-54/obj23 2024-04-16T18:40:13.105 DEBUG:boto:Data: 2024-04-16T18:40:13.105 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.105 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.105 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.105 DEBUG:boto:Params: {} 2024-04-16T18:40:13.106 DEBUG:boto:Token: None 2024-04-16T18:40:13.106 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23 2024-04-16T18:40:13.106 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hz3rvh+bRMRvpzECBti5gmkXnCQ= 2024-04-16T18:40:13.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hz3rvh+bRMRvpzECBti5gmkXnCQ=', 'Content-Length': '0'} 2024-04-16T18:40:13.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000054e3512e5c41a09c-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.108 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.108 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.108 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.108 DEBUG:boto:Path: /cjqttm-54/obj23 2024-04-16T18:40:13.108 DEBUG:boto:Data: 2024-04-16T18:40:13.108 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.108 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.108 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.109 DEBUG:boto:Params: {} 2024-04-16T18:40:13.109 DEBUG:boto:Token: None 2024-04-16T18:40:13.109 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23 2024-04-16T18:40:13.109 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hz3rvh+bRMRvpzECBti5gmkXnCQ= 2024-04-16T18:40:13.109 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hz3rvh+bRMRvpzECBti5gmkXnCQ=', 'Content-Length': '0'} 2024-04-16T18:40:13.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023d5aba9b29c038c-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.111 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:40:13.111 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.111 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.111 DEBUG:boto:Method: GET 2024-04-16T18:40:13.111 DEBUG:boto:Path: /cjqttm-54/obj23 2024-04-16T18:40:13.111 DEBUG:boto:Data: 2024-04-16T18:40:13.111 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.111 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.112 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.112 DEBUG:boto:Params: {} 2024-04-16T18:40:13.112 DEBUG:boto:Token: None 2024-04-16T18:40:13.112 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23 2024-04-16T18:40:13.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gcqD0oIOYlKVfksyCu8bK3d6hTc= 2024-04-16T18:40:13.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gcqD0oIOYlKVfksyCu8bK3d6hTc=', 'Content-Length': '0'} 2024-04-16T18:40:13.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d361df9bafba9ec2-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.114 DEBUG:boto:path=/cjqttm-54/obj23 2024-04-16T18:40:13.114 DEBUG:boto:auth_path=/cjqttm-54/obj23 2024-04-16T18:40:13.114 DEBUG:boto:Method: GET 2024-04-16T18:40:13.115 DEBUG:boto:Path: /cjqttm-54/obj23 2024-04-16T18:40:13.115 DEBUG:boto:Data: 2024-04-16T18:40:13.115 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.115 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.115 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.115 DEBUG:boto:Params: {} 2024-04-16T18:40:13.115 DEBUG:boto:Token: None 2024-04-16T18:40:13.115 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj23 2024-04-16T18:40:13.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gcqD0oIOYlKVfksyCu8bK3d6hTc= 2024-04-16T18:40:13.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gcqD0oIOYlKVfksyCu8bK3d6hTc=', 'Content-Length': '0'} 2024-04-16T18:40:13.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060911e1f2c5e3d41-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.158 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.158 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.158 DEBUG:boto:path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.159 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.159 DEBUG:boto:Method: GET 2024-04-16T18:40:13.159 DEBUG:boto:Path: /cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.159 DEBUG:boto:Data: 2024-04-16T18:40:13.159 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.159 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.159 DEBUG:boto:Params: {} 2024-04-16T18:40:13.159 DEBUG:boto:Token: None 2024-04-16T18:40:13.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.162 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009880b675f2958814-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.162 DEBUG:boto:b'cjqttm-54obj231000falseobj232024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.162 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.162 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.162 DEBUG:boto:path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.162 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.163 DEBUG:boto:Method: GET 2024-04-16T18:40:13.163 DEBUG:boto:Path: /cjqttm-54/?prefix=obj23 2024-04-16T18:40:13.163 DEBUG:boto:Data: 2024-04-16T18:40:13.163 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.163 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.163 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.163 DEBUG:boto:Params: {} 2024-04-16T18:40:13.163 DEBUG:boto:Token: None 2024-04-16T18:40:13.163 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.167 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000afc7c23a8824d5e7-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.167 DEBUG:boto:b'cjqttm-54obj231000falseobj232024-04-16T18:33:08.923Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.167 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:40:13.167 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.168 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.168 DEBUG:boto:path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.168 DEBUG:boto:auth_path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.168 DEBUG:boto:Method: GET 2024-04-16T18:40:13.168 DEBUG:boto:Path: /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.168 DEBUG:boto:Data: 2024-04-16T18:40:13.168 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.168 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.168 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.168 DEBUG:boto:Params: {} 2024-04-16T18:40:13.168 DEBUG:boto:Token: None 2024-04-16T18:40:13.169 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.169 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg= 2024-04-16T18:40:13.169 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg=', 'Content-Length': '0'} 2024-04-16T18:40:13.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d74f5d7a59ca2240-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.171 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.171 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.171 DEBUG:boto:path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.171 DEBUG:boto:auth_path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.171 DEBUG:boto:Method: GET 2024-04-16T18:40:13.171 DEBUG:boto:Path: /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.171 DEBUG:boto:Data: 2024-04-16T18:40:13.171 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.172 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.172 DEBUG:boto:Params: {} 2024-04-16T18:40:13.172 DEBUG:boto:Token: None 2024-04-16T18:40:13.172 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg= 2024-04-16T18:40:13.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg=', 'Content-Length': '0'} 2024-04-16T18:40:13.173 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb7f2d7267081bd2-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.174 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.174 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.174 DEBUG:boto:path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.174 DEBUG:boto:auth_path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.174 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.174 DEBUG:boto:Path: /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.174 DEBUG:boto:Data: 2024-04-16T18:40:13.174 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.175 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.175 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.175 DEBUG:boto:Params: {} 2024-04-16T18:40:13.175 DEBUG:boto:Token: None 2024-04-16T18:40:13.175 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZaSskAoa0tqiez+FJ+o+vugqgWU= 2024-04-16T18:40:13.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZaSskAoa0tqiez+FJ+o+vugqgWU=', 'Content-Length': '0'} 2024-04-16T18:40:13.177 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ed547366d17ca1e-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.177 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.177 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.177 DEBUG:boto:path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.177 DEBUG:boto:auth_path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.177 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.177 DEBUG:boto:Path: /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.177 DEBUG:boto:Data: 2024-04-16T18:40:13.177 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.178 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.178 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.178 DEBUG:boto:Params: {} 2024-04-16T18:40:13.178 DEBUG:boto:Token: None 2024-04-16T18:40:13.178 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.178 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZaSskAoa0tqiez+FJ+o+vugqgWU= 2024-04-16T18:40:13.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZaSskAoa0tqiez+FJ+o+vugqgWU=', 'Content-Length': '0'} 2024-04-16T18:40:13.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000731ffadb249e52a2-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.180 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:40:13.180 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.180 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.180 DEBUG:boto:path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.181 DEBUG:boto:auth_path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.181 DEBUG:boto:Method: GET 2024-04-16T18:40:13.181 DEBUG:boto:Path: /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.181 DEBUG:boto:Data: 2024-04-16T18:40:13.181 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.181 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.181 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.181 DEBUG:boto:Params: {} 2024-04-16T18:40:13.181 DEBUG:boto:Token: None 2024-04-16T18:40:13.181 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg= 2024-04-16T18:40:13.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg=', 'Content-Length': '0'} 2024-04-16T18:40:13.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000261aaca9aa114fe0-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.226 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.226 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.227 DEBUG:boto:path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.227 DEBUG:boto:auth_path=/cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.227 DEBUG:boto:Method: GET 2024-04-16T18:40:13.227 DEBUG:boto:Path: /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.227 DEBUG:boto:Data: 2024-04-16T18:40:13.227 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.227 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.227 DEBUG:boto:Params: {} 2024-04-16T18:40:13.227 DEBUG:boto:Token: None 2024-04-16T18:40:13.227 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29?versionId=null 2024-04-16T18:40:13.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg= 2024-04-16T18:40:13.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bR6sZeheG8IBEA5efHCNGFbbSdg=', 'Content-Length': '0'} 2024-04-16T18:40:13.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d51102a54b5c1b0-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.230 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.230 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.230 DEBUG:boto:path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.230 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.230 DEBUG:boto:Method: GET 2024-04-16T18:40:13.231 DEBUG:boto:Path: /cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.231 DEBUG:boto:Data: 2024-04-16T18:40:13.231 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.231 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.231 DEBUG:boto:Params: {} 2024-04-16T18:40:13.231 DEBUG:boto:Token: None 2024-04-16T18:40:13.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.234 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c6b5606d40c902d1-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.234 DEBUG:boto:b'cjqttm-54obj291000falseobj292024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.234 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.234 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.235 DEBUG:boto:path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.235 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.235 DEBUG:boto:Method: GET 2024-04-16T18:40:13.235 DEBUG:boto:Path: /cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.235 DEBUG:boto:Data: 2024-04-16T18:40:13.235 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.235 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.235 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.235 DEBUG:boto:Params: {} 2024-04-16T18:40:13.235 DEBUG:boto:Token: None 2024-04-16T18:40:13.235 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.239 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000066f3d03a0609909c-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.240 DEBUG:boto:b'cjqttm-54obj291000falseobj292024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.240 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.240 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.240 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.240 DEBUG:boto:Path: /cjqttm-54/obj29 2024-04-16T18:40:13.240 DEBUG:boto:Data: 2024-04-16T18:40:13.240 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.240 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.240 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.240 DEBUG:boto:Params: {} 2024-04-16T18:40:13.241 DEBUG:boto:Token: None 2024-04-16T18:40:13.241 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29 2024-04-16T18:40:13.241 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4ht6wvv1M31uc9q3WDPl1Yx5tRM= 2024-04-16T18:40:13.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4ht6wvv1M31uc9q3WDPl1Yx5tRM=', 'Content-Length': '0'} 2024-04-16T18:40:13.243 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b69d55c9cc63f2e5-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.243 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.243 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.243 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.243 DEBUG:boto:Path: /cjqttm-54/obj29 2024-04-16T18:40:13.243 DEBUG:boto:Data: 2024-04-16T18:40:13.243 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.244 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.244 DEBUG:boto:Params: {} 2024-04-16T18:40:13.244 DEBUG:boto:Token: None 2024-04-16T18:40:13.244 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29 2024-04-16T18:40:13.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4ht6wvv1M31uc9q3WDPl1Yx5tRM= 2024-04-16T18:40:13.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4ht6wvv1M31uc9q3WDPl1Yx5tRM=', 'Content-Length': '0'} 2024-04-16T18:40:13.246 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080f916523e6eb989-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:40:13.246 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.246 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.246 DEBUG:boto:Method: GET 2024-04-16T18:40:13.246 DEBUG:boto:Path: /cjqttm-54/obj29 2024-04-16T18:40:13.246 DEBUG:boto:Data: 2024-04-16T18:40:13.247 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.247 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.247 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.247 DEBUG:boto:Params: {} 2024-04-16T18:40:13.247 DEBUG:boto:Token: None 2024-04-16T18:40:13.247 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29 2024-04-16T18:40:13.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L4qVs0BOLr7kto7thQLZTSopJHk= 2024-04-16T18:40:13.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L4qVs0BOLr7kto7thQLZTSopJHk=', 'Content-Length': '0'} 2024-04-16T18:40:13.249 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc261d1603ea0c40-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.290 DEBUG:boto:path=/cjqttm-54/obj29 2024-04-16T18:40:13.290 DEBUG:boto:auth_path=/cjqttm-54/obj29 2024-04-16T18:40:13.291 DEBUG:boto:Method: GET 2024-04-16T18:40:13.291 DEBUG:boto:Path: /cjqttm-54/obj29 2024-04-16T18:40:13.291 DEBUG:boto:Data: 2024-04-16T18:40:13.291 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.291 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.291 DEBUG:boto:Params: {} 2024-04-16T18:40:13.291 DEBUG:boto:Token: None 2024-04-16T18:40:13.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj29 2024-04-16T18:40:13.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L4qVs0BOLr7kto7thQLZTSopJHk= 2024-04-16T18:40:13.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L4qVs0BOLr7kto7thQLZTSopJHk=', 'Content-Length': '0'} 2024-04-16T18:40:13.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000078947713d3db6bb5-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.294 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.294 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.294 DEBUG:boto:path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.294 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.294 DEBUG:boto:Method: GET 2024-04-16T18:40:13.294 DEBUG:boto:Path: /cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.294 DEBUG:boto:Data: 2024-04-16T18:40:13.294 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.294 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.294 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.294 DEBUG:boto:Params: {} 2024-04-16T18:40:13.295 DEBUG:boto:Token: None 2024-04-16T18:40:13.295 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.297 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ecc3dba22a0527d2-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.338 DEBUG:boto:b'cjqttm-54obj291000falseobj292024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.339 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.339 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.339 DEBUG:boto:path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.339 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.339 DEBUG:boto:Method: GET 2024-04-16T18:40:13.339 DEBUG:boto:Path: /cjqttm-54/?prefix=obj29 2024-04-16T18:40:13.339 DEBUG:boto:Data: 2024-04-16T18:40:13.339 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.340 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.340 DEBUG:boto:Params: {} 2024-04-16T18:40:13.340 DEBUG:boto:Token: None 2024-04-16T18:40:13.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.344 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005de9d40dcd1bdcf9-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.344 DEBUG:boto:b'cjqttm-54obj291000falseobj292024-04-16T18:33:09.244Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:40:13.344 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.344 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.345 DEBUG:boto:path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.345 DEBUG:boto:auth_path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.345 DEBUG:boto:Method: GET 2024-04-16T18:40:13.345 DEBUG:boto:Path: /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.345 DEBUG:boto:Data: 2024-04-16T18:40:13.345 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.345 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.345 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.345 DEBUG:boto:Params: {} 2024-04-16T18:40:13.345 DEBUG:boto:Token: None 2024-04-16T18:40:13.345 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.346 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo= 2024-04-16T18:40:13.346 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo=', 'Content-Length': '0'} 2024-04-16T18:40:13.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006cbc84b666697808-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.390 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.390 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.390 DEBUG:boto:path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.391 DEBUG:boto:auth_path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.391 DEBUG:boto:Method: GET 2024-04-16T18:40:13.391 DEBUG:boto:Path: /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.391 DEBUG:boto:Data: 2024-04-16T18:40:13.391 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.391 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.391 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.391 DEBUG:boto:Params: {} 2024-04-16T18:40:13.391 DEBUG:boto:Token: None 2024-04-16T18:40:13.392 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo= 2024-04-16T18:40:13.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo=', 'Content-Length': '0'} 2024-04-16T18:40:13.394 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b923f4d36aafcabb-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.394 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.394 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.394 DEBUG:boto:path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.394 DEBUG:boto:auth_path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.395 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.395 DEBUG:boto:Path: /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.395 DEBUG:boto:Data: 2024-04-16T18:40:13.395 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.395 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.395 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.395 DEBUG:boto:Params: {} 2024-04-16T18:40:13.395 DEBUG:boto:Token: None 2024-04-16T18:40:13.395 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nPA1cdNj7EQJuoPksEV48qN0+vM= 2024-04-16T18:40:13.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nPA1cdNj7EQJuoPksEV48qN0+vM=', 'Content-Length': '0'} 2024-04-16T18:40:13.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002c0feb696211b97d-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.398 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.398 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.398 DEBUG:boto:path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.398 DEBUG:boto:auth_path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.398 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.398 DEBUG:boto:Path: /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.398 DEBUG:boto:Data: 2024-04-16T18:40:13.399 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.399 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.399 DEBUG:boto:Params: {} 2024-04-16T18:40:13.399 DEBUG:boto:Token: None 2024-04-16T18:40:13.399 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nPA1cdNj7EQJuoPksEV48qN0+vM= 2024-04-16T18:40:13.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nPA1cdNj7EQJuoPksEV48qN0+vM=', 'Content-Length': '0'} 2024-04-16T18:40:13.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8d007c2001de28c-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.401 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:40:13.402 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.402 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.402 DEBUG:boto:path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.402 DEBUG:boto:auth_path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.402 DEBUG:boto:Method: GET 2024-04-16T18:40:13.402 DEBUG:boto:Path: /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.402 DEBUG:boto:Data: 2024-04-16T18:40:13.402 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.402 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.402 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.403 DEBUG:boto:Params: {} 2024-04-16T18:40:13.403 DEBUG:boto:Token: None 2024-04-16T18:40:13.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo= 2024-04-16T18:40:13.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo=', 'Content-Length': '0'} 2024-04-16T18:40:13.405 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000028011d1da2392f5b-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.446 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.446 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.447 DEBUG:boto:path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.447 DEBUG:boto:auth_path=/cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.447 DEBUG:boto:Method: GET 2024-04-16T18:40:13.447 DEBUG:boto:Path: /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.447 DEBUG:boto:Data: 2024-04-16T18:40:13.447 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.447 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.447 DEBUG:boto:Params: {} 2024-04-16T18:40:13.447 DEBUG:boto:Token: None 2024-04-16T18:40:13.447 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31?versionId=null 2024-04-16T18:40:13.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo= 2024-04-16T18:40:13.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nLMI/7DdjyRuEAbBI+MaR4i3alo=', 'Content-Length': '0'} 2024-04-16T18:40:13.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005bbc44f85bb87e06-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.450 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.450 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.450 DEBUG:boto:path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.450 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.451 DEBUG:boto:Method: GET 2024-04-16T18:40:13.451 DEBUG:boto:Path: /cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.451 DEBUG:boto:Data: 2024-04-16T18:40:13.451 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.451 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.451 DEBUG:boto:Params: {} 2024-04-16T18:40:13.451 DEBUG:boto:Token: None 2024-04-16T18:40:13.451 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.454 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007584abfddc5e7235-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.494 DEBUG:boto:b'cjqttm-54obj311000falseobj312024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.495 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.495 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.495 DEBUG:boto:path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.495 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.495 DEBUG:boto:Method: GET 2024-04-16T18:40:13.495 DEBUG:boto:Path: /cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.495 DEBUG:boto:Data: 2024-04-16T18:40:13.495 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.496 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.496 DEBUG:boto:Params: {} 2024-04-16T18:40:13.496 DEBUG:boto:Token: None 2024-04-16T18:40:13.496 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.500 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000095d6f5d14fefa84c-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.500 DEBUG:boto:b'cjqttm-54obj311000falseobj312024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.500 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.501 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.501 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.501 DEBUG:boto:Path: /cjqttm-54/obj31 2024-04-16T18:40:13.501 DEBUG:boto:Data: 2024-04-16T18:40:13.501 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.501 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.501 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.501 DEBUG:boto:Params: {} 2024-04-16T18:40:13.501 DEBUG:boto:Token: None 2024-04-16T18:40:13.501 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31 2024-04-16T18:40:13.502 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rwV8JFd7wjdodZYI/Wrw2nV4JD8= 2024-04-16T18:40:13.502 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rwV8JFd7wjdodZYI/Wrw2nV4JD8=', 'Content-Length': '0'} 2024-04-16T18:40:13.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cd2d1bb1645ad0b-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.504 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.504 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.504 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.504 DEBUG:boto:Path: /cjqttm-54/obj31 2024-04-16T18:40:13.504 DEBUG:boto:Data: 2024-04-16T18:40:13.504 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.504 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.504 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.504 DEBUG:boto:Params: {} 2024-04-16T18:40:13.505 DEBUG:boto:Token: None 2024-04-16T18:40:13.505 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31 2024-04-16T18:40:13.505 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rwV8JFd7wjdodZYI/Wrw2nV4JD8= 2024-04-16T18:40:13.505 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rwV8JFd7wjdodZYI/Wrw2nV4JD8=', 'Content-Length': '0'} 2024-04-16T18:40:13.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac22c3810c1a440b-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:40:13.507 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.507 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.507 DEBUG:boto:Method: GET 2024-04-16T18:40:13.507 DEBUG:boto:Path: /cjqttm-54/obj31 2024-04-16T18:40:13.508 DEBUG:boto:Data: 2024-04-16T18:40:13.508 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.508 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.508 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.508 DEBUG:boto:Params: {} 2024-04-16T18:40:13.508 DEBUG:boto:Token: None 2024-04-16T18:40:13.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31 2024-04-16T18:40:13.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jtQTRTak+LkS9DdZxawj1tDXRTY= 2024-04-16T18:40:13.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jtQTRTak+LkS9DdZxawj1tDXRTY=', 'Content-Length': '0'} 2024-04-16T18:40:13.511 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000c2692133fe88f7-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.554 DEBUG:boto:path=/cjqttm-54/obj31 2024-04-16T18:40:13.554 DEBUG:boto:auth_path=/cjqttm-54/obj31 2024-04-16T18:40:13.555 DEBUG:boto:Method: GET 2024-04-16T18:40:13.555 DEBUG:boto:Path: /cjqttm-54/obj31 2024-04-16T18:40:13.555 DEBUG:boto:Data: 2024-04-16T18:40:13.555 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.555 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.555 DEBUG:boto:Params: {} 2024-04-16T18:40:13.555 DEBUG:boto:Token: None 2024-04-16T18:40:13.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj31 2024-04-16T18:40:13.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jtQTRTak+LkS9DdZxawj1tDXRTY= 2024-04-16T18:40:13.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jtQTRTak+LkS9DdZxawj1tDXRTY=', 'Content-Length': '0'} 2024-04-16T18:40:13.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bcbaabea13f2450-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.558 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.558 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.559 DEBUG:boto:path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.559 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.559 DEBUG:boto:Method: GET 2024-04-16T18:40:13.559 DEBUG:boto:Path: /cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.559 DEBUG:boto:Data: 2024-04-16T18:40:13.559 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.559 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.559 DEBUG:boto:Params: {} 2024-04-16T18:40:13.559 DEBUG:boto:Token: None 2024-04-16T18:40:13.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000060fbed74f356ece5-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.602 DEBUG:boto:b'cjqttm-54obj311000falseobj312024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.603 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.603 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.603 DEBUG:boto:path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.603 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.603 DEBUG:boto:Method: GET 2024-04-16T18:40:13.603 DEBUG:boto:Path: /cjqttm-54/?prefix=obj31 2024-04-16T18:40:13.603 DEBUG:boto:Data: 2024-04-16T18:40:13.603 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.603 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.604 DEBUG:boto:Params: {} 2024-04-16T18:40:13.604 DEBUG:boto:Token: None 2024-04-16T18:40:13.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d23e91f8cae8bdb-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.608 DEBUG:boto:b'cjqttm-54obj311000falseobj312024-04-16T18:33:09.540Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:40:13.609 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.609 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.609 DEBUG:boto:path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.609 DEBUG:boto:auth_path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.609 DEBUG:boto:Method: GET 2024-04-16T18:40:13.609 DEBUG:boto:Path: /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.609 DEBUG:boto:Data: 2024-04-16T18:40:13.609 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.610 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.610 DEBUG:boto:Params: {} 2024-04-16T18:40:13.610 DEBUG:boto:Token: None 2024-04-16T18:40:13.610 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc= 2024-04-16T18:40:13.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc=', 'Content-Length': '0'} 2024-04-16T18:40:13.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006737f4337824a381-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.654 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.654 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.655 DEBUG:boto:path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.655 DEBUG:boto:auth_path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.655 DEBUG:boto:Method: GET 2024-04-16T18:40:13.655 DEBUG:boto:Path: /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.655 DEBUG:boto:Data: 2024-04-16T18:40:13.655 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.655 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.655 DEBUG:boto:Params: {} 2024-04-16T18:40:13.655 DEBUG:boto:Token: None 2024-04-16T18:40:13.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc= 2024-04-16T18:40:13.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc=', 'Content-Length': '0'} 2024-04-16T18:40:13.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000961f68e4f7c3e6b9-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.658 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.658 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.658 DEBUG:boto:path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.659 DEBUG:boto:auth_path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.659 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.659 DEBUG:boto:Path: /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.659 DEBUG:boto:Data: 2024-04-16T18:40:13.659 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.659 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.659 DEBUG:boto:Params: {} 2024-04-16T18:40:13.659 DEBUG:boto:Token: None 2024-04-16T18:40:13.659 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HbXqLYg7jenimW+fvxV2eeVoeMo= 2024-04-16T18:40:13.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HbXqLYg7jenimW+fvxV2eeVoeMo=', 'Content-Length': '0'} 2024-04-16T18:40:13.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f18542a701a7554-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.662 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.662 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.662 DEBUG:boto:path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.662 DEBUG:boto:auth_path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.662 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.663 DEBUG:boto:Path: /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.663 DEBUG:boto:Data: 2024-04-16T18:40:13.663 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.663 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.663 DEBUG:boto:Params: {} 2024-04-16T18:40:13.663 DEBUG:boto:Token: None 2024-04-16T18:40:13.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HbXqLYg7jenimW+fvxV2eeVoeMo= 2024-04-16T18:40:13.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HbXqLYg7jenimW+fvxV2eeVoeMo=', 'Content-Length': '0'} 2024-04-16T18:40:13.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000595261ca79dc4640-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:40:13.666 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.666 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.666 DEBUG:boto:path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.666 DEBUG:boto:auth_path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.666 DEBUG:boto:Method: GET 2024-04-16T18:40:13.666 DEBUG:boto:Path: /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.666 DEBUG:boto:Data: 2024-04-16T18:40:13.667 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.667 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.667 DEBUG:boto:Params: {} 2024-04-16T18:40:13.667 DEBUG:boto:Token: None 2024-04-16T18:40:13.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc= 2024-04-16T18:40:13.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc=', 'Content-Length': '0'} 2024-04-16T18:40:13.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e88042ad57358da0-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.710 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.710 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.710 DEBUG:boto:path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.711 DEBUG:boto:auth_path=/cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.711 DEBUG:boto:Method: GET 2024-04-16T18:40:13.711 DEBUG:boto:Path: /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.711 DEBUG:boto:Data: 2024-04-16T18:40:13.711 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.711 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.711 DEBUG:boto:Params: {} 2024-04-16T18:40:13.711 DEBUG:boto:Token: None 2024-04-16T18:40:13.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33?versionId=null 2024-04-16T18:40:13.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc= 2024-04-16T18:40:13.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uJX0oNyxuYSqWxdjv9RvdUKEiTc=', 'Content-Length': '0'} 2024-04-16T18:40:13.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ab6b433b7091d45-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.714 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.714 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.714 DEBUG:boto:path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.715 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.715 DEBUG:boto:Method: GET 2024-04-16T18:40:13.715 DEBUG:boto:Path: /cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.715 DEBUG:boto:Data: 2024-04-16T18:40:13.715 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.715 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.715 DEBUG:boto:Params: {} 2024-04-16T18:40:13.715 DEBUG:boto:Token: None 2024-04-16T18:40:13.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000014a21abcea8c10b-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.758 DEBUG:boto:b'cjqttm-54obj331000falseobj332024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.759 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.759 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.759 DEBUG:boto:path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.759 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.759 DEBUG:boto:Method: GET 2024-04-16T18:40:13.759 DEBUG:boto:Path: /cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.759 DEBUG:boto:Data: 2024-04-16T18:40:13.760 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.760 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.760 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.760 DEBUG:boto:Params: {} 2024-04-16T18:40:13.760 DEBUG:boto:Token: None 2024-04-16T18:40:13.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009562b1372f390551-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.764 DEBUG:boto:b'cjqttm-54obj331000falseobj332024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.764 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.764 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.764 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.765 DEBUG:boto:Path: /cjqttm-54/obj33 2024-04-16T18:40:13.765 DEBUG:boto:Data: 2024-04-16T18:40:13.765 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.765 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.765 DEBUG:boto:Params: {} 2024-04-16T18:40:13.765 DEBUG:boto:Token: None 2024-04-16T18:40:13.765 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33 2024-04-16T18:40:13.765 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SYJ10c8JA9RHdk+Lken/rnlAgGw= 2024-04-16T18:40:13.766 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SYJ10c8JA9RHdk+Lken/rnlAgGw=', 'Content-Length': '0'} 2024-04-16T18:40:13.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af0ec6a929f0a89a-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.768 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.768 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.768 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.768 DEBUG:boto:Path: /cjqttm-54/obj33 2024-04-16T18:40:13.768 DEBUG:boto:Data: 2024-04-16T18:40:13.768 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.768 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.768 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.768 DEBUG:boto:Params: {} 2024-04-16T18:40:13.769 DEBUG:boto:Token: None 2024-04-16T18:40:13.769 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33 2024-04-16T18:40:13.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SYJ10c8JA9RHdk+Lken/rnlAgGw= 2024-04-16T18:40:13.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SYJ10c8JA9RHdk+Lken/rnlAgGw=', 'Content-Length': '0'} 2024-04-16T18:40:13.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056fc4348bb5b2dec-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:40:13.771 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.771 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.771 DEBUG:boto:Method: GET 2024-04-16T18:40:13.771 DEBUG:boto:Path: /cjqttm-54/obj33 2024-04-16T18:40:13.772 DEBUG:boto:Data: 2024-04-16T18:40:13.772 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.772 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.772 DEBUG:boto:Params: {} 2024-04-16T18:40:13.772 DEBUG:boto:Token: None 2024-04-16T18:40:13.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33 2024-04-16T18:40:13.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oiCpG0PAEZSNqHSzcauoLun04/4= 2024-04-16T18:40:13.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oiCpG0PAEZSNqHSzcauoLun04/4=', 'Content-Length': '0'} 2024-04-16T18:40:13.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbd4fd66493f80fc-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.818 DEBUG:boto:path=/cjqttm-54/obj33 2024-04-16T18:40:13.818 DEBUG:boto:auth_path=/cjqttm-54/obj33 2024-04-16T18:40:13.818 DEBUG:boto:Method: GET 2024-04-16T18:40:13.819 DEBUG:boto:Path: /cjqttm-54/obj33 2024-04-16T18:40:13.819 DEBUG:boto:Data: 2024-04-16T18:40:13.819 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.819 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.819 DEBUG:boto:Params: {} 2024-04-16T18:40:13.819 DEBUG:boto:Token: None 2024-04-16T18:40:13.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj33 2024-04-16T18:40:13.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oiCpG0PAEZSNqHSzcauoLun04/4= 2024-04-16T18:40:13.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oiCpG0PAEZSNqHSzcauoLun04/4=', 'Content-Length': '0'} 2024-04-16T18:40:13.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008f50bb27bd203ef-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.822 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.822 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.822 DEBUG:boto:path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.822 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.822 DEBUG:boto:Method: GET 2024-04-16T18:40:13.823 DEBUG:boto:Path: /cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.823 DEBUG:boto:Data: 2024-04-16T18:40:13.823 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.823 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.823 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.823 DEBUG:boto:Params: {} 2024-04-16T18:40:13.823 DEBUG:boto:Token: None 2024-04-16T18:40:13.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.825 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c6d4c7505b84737-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.866 DEBUG:boto:b'cjqttm-54obj331000falseobj332024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.867 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.867 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.867 DEBUG:boto:path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.867 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.867 DEBUG:boto:Method: GET 2024-04-16T18:40:13.867 DEBUG:boto:Path: /cjqttm-54/?prefix=obj33 2024-04-16T18:40:13.867 DEBUG:boto:Data: 2024-04-16T18:40:13.867 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.868 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.868 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.868 DEBUG:boto:Params: {} 2024-04-16T18:40:13.868 DEBUG:boto:Token: None 2024-04-16T18:40:13.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.872 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003c719a3e1ac552dd-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.872 DEBUG:boto:b'cjqttm-54obj331000falseobj332024-04-16T18:33:08.046Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:13.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:40:13.872 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:13.873 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:13.873 DEBUG:boto:path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.873 DEBUG:boto:auth_path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.873 DEBUG:boto:Method: GET 2024-04-16T18:40:13.873 DEBUG:boto:Path: /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.873 DEBUG:boto:Data: 2024-04-16T18:40:13.873 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.873 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.873 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.873 DEBUG:boto:Params: {} 2024-04-16T18:40:13.873 DEBUG:boto:Token: None 2024-04-16T18:40:13.874 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.874 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM= 2024-04-16T18:40:13.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM=', 'Content-Length': '0'} 2024-04-16T18:40:13.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a193b16d487ec36e-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.918 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:13.918 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:13.918 DEBUG:boto:path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.919 DEBUG:boto:auth_path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.919 DEBUG:boto:Method: GET 2024-04-16T18:40:13.919 DEBUG:boto:Path: /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.919 DEBUG:boto:Data: 2024-04-16T18:40:13.919 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.919 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.919 DEBUG:boto:Params: {} 2024-04-16T18:40:13.919 DEBUG:boto:Token: None 2024-04-16T18:40:13.919 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM= 2024-04-16T18:40:13.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM=', 'Content-Length': '0'} 2024-04-16T18:40:13.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e16654e6851372c-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.922 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:13.922 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:13.922 DEBUG:boto:path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.922 DEBUG:boto:auth_path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.922 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.922 DEBUG:boto:Path: /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.922 DEBUG:boto:Data: 2024-04-16T18:40:13.923 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.923 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.923 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.923 DEBUG:boto:Params: {} 2024-04-16T18:40:13.923 DEBUG:boto:Token: None 2024-04-16T18:40:13.923 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rbOTrv3wROwBM9IhN9w661fJ1NU= 2024-04-16T18:40:13.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rbOTrv3wROwBM9IhN9w661fJ1NU=', 'Content-Length': '0'} 2024-04-16T18:40:13.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cddc5cb8c5289a7a-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.925 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:13.925 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:13.925 DEBUG:boto:path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.926 DEBUG:boto:auth_path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.926 DEBUG:boto:Method: HEAD 2024-04-16T18:40:13.926 DEBUG:boto:Path: /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.926 DEBUG:boto:Data: 2024-04-16T18:40:13.926 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.926 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.926 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.926 DEBUG:boto:Params: {} 2024-04-16T18:40:13.926 DEBUG:boto:Token: None 2024-04-16T18:40:13.926 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rbOTrv3wROwBM9IhN9w661fJ1NU= 2024-04-16T18:40:13.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rbOTrv3wROwBM9IhN9w661fJ1NU=', 'Content-Length': '0'} 2024-04-16T18:40:13.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9f7f89f85eb3ebb-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.929 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:40:13.929 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:13.929 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:13.929 DEBUG:boto:path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.929 DEBUG:boto:auth_path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.929 DEBUG:boto:Method: GET 2024-04-16T18:40:13.929 DEBUG:boto:Path: /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.929 DEBUG:boto:Data: 2024-04-16T18:40:13.930 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.930 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.930 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.930 DEBUG:boto:Params: {} 2024-04-16T18:40:13.930 DEBUG:boto:Token: None 2024-04-16T18:40:13.930 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM= 2024-04-16T18:40:13.931 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM=', 'Content-Length': '0'} 2024-04-16T18:40:13.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b14d8c41ef331422-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.974 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:13.974 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:13.974 DEBUG:boto:path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.975 DEBUG:boto:auth_path=/cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.975 DEBUG:boto:Method: GET 2024-04-16T18:40:13.975 DEBUG:boto:Path: /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.975 DEBUG:boto:Data: 2024-04-16T18:40:13.975 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:13.975 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.975 DEBUG:boto:Params: {} 2024-04-16T18:40:13.975 DEBUG:boto:Token: None 2024-04-16T18:40:13.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/obj34?versionId=null 2024-04-16T18:40:13.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM= 2024-04-16T18:40:13.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2PUDGVscuhXs8V/hwjGPJkVCEYM=', 'Content-Length': '0'} 2024-04-16T18:40:13.977 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000538ee1e7c4e8615e-00661ec60d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:13.978 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:13.978 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:13.978 DEBUG:boto:path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:13.978 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:13.978 DEBUG:boto:Method: GET 2024-04-16T18:40:13.978 DEBUG:boto:Path: /cjqttm-54/?prefix=obj34 2024-04-16T18:40:13.978 DEBUG:boto:Data: 2024-04-16T18:40:13.978 DEBUG:boto:Headers: {} 2024-04-16T18:40:13.978 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:13.978 DEBUG:boto:Port: 8000 2024-04-16T18:40:13.979 DEBUG:boto:Params: {} 2024-04-16T18:40:13.979 DEBUG:boto:Token: None 2024-04-16T18:40:13.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:13 GMT /cjqttm-54/ 2024-04-16T18:40:13.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E= 2024-04-16T18:40:13.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:13 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ij30UH+ezUDnd8VgT+2UG4LGr4E=', 'Content-Length': '0'} 2024-04-16T18:40:13.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ba30dd70d37b534-00661ec60d-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:13 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.022 DEBUG:boto:b'cjqttm-54obj341000falseobj342024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.023 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.023 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.023 DEBUG:boto:path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.023 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.023 DEBUG:boto:Method: GET 2024-04-16T18:40:14.023 DEBUG:boto:Path: /cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.023 DEBUG:boto:Data: 2024-04-16T18:40:14.023 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.024 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.024 DEBUG:boto:Params: {} 2024-04-16T18:40:14.024 DEBUG:boto:Token: None 2024-04-16T18:40:14.024 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.024 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.024 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.028 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cc463c3efd25093b-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.028 DEBUG:boto:b'cjqttm-54obj341000falseobj342024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.028 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:14.028 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:14.028 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.028 DEBUG:boto:Path: /cjqttm-54/obj34 2024-04-16T18:40:14.029 DEBUG:boto:Data: 2024-04-16T18:40:14.029 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.029 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.029 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.029 DEBUG:boto:Params: {} 2024-04-16T18:40:14.029 DEBUG:boto:Token: None 2024-04-16T18:40:14.029 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj34 2024-04-16T18:40:14.029 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/wJIvOg81SR4s0tpUCG2myB4vuE= 2024-04-16T18:40:14.029 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/wJIvOg81SR4s0tpUCG2myB4vuE=', 'Content-Length': '0'} 2024-04-16T18:40:14.031 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007afd8e694d2ced65-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.031 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:14.032 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:14.032 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.032 DEBUG:boto:Path: /cjqttm-54/obj34 2024-04-16T18:40:14.032 DEBUG:boto:Data: 2024-04-16T18:40:14.032 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.032 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.032 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.032 DEBUG:boto:Params: {} 2024-04-16T18:40:14.032 DEBUG:boto:Token: None 2024-04-16T18:40:14.032 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj34 2024-04-16T18:40:14.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/wJIvOg81SR4s0tpUCG2myB4vuE= 2024-04-16T18:40:14.033 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/wJIvOg81SR4s0tpUCG2myB4vuE=', 'Content-Length': '0'} 2024-04-16T18:40:14.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046c9ea82c95fe06d-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.035 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:40:14.035 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:14.035 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:14.035 DEBUG:boto:Method: GET 2024-04-16T18:40:14.035 DEBUG:boto:Path: /cjqttm-54/obj34 2024-04-16T18:40:14.035 DEBUG:boto:Data: 2024-04-16T18:40:14.035 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.035 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.035 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.035 DEBUG:boto:Params: {} 2024-04-16T18:40:14.036 DEBUG:boto:Token: None 2024-04-16T18:40:14.036 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj34 2024-04-16T18:40:14.036 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KbX/2wbZUpRHE0xEmrg2LOqi9hs= 2024-04-16T18:40:14.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KbX/2wbZUpRHE0xEmrg2LOqi9hs=', 'Content-Length': '0'} 2024-04-16T18:40:14.038 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:45 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064db744b73f3f005-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.078 DEBUG:boto:path=/cjqttm-54/obj34 2024-04-16T18:40:14.079 DEBUG:boto:auth_path=/cjqttm-54/obj34 2024-04-16T18:40:14.079 DEBUG:boto:Method: GET 2024-04-16T18:40:14.079 DEBUG:boto:Path: /cjqttm-54/obj34 2024-04-16T18:40:14.079 DEBUG:boto:Data: 2024-04-16T18:40:14.079 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.079 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.079 DEBUG:boto:Params: {} 2024-04-16T18:40:14.081 DEBUG:boto:Token: None 2024-04-16T18:40:14.081 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj34 2024-04-16T18:40:14.081 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KbX/2wbZUpRHE0xEmrg2LOqi9hs= 2024-04-16T18:40:14.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KbX/2wbZUpRHE0xEmrg2LOqi9hs=', 'Content-Length': '0'} 2024-04-16T18:40:14.083 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b066971dfcfecacd-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.083 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.084 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.084 DEBUG:boto:path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.084 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.084 DEBUG:boto:Method: GET 2024-04-16T18:40:14.084 DEBUG:boto:Path: /cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.084 DEBUG:boto:Data: 2024-04-16T18:40:14.084 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.084 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.084 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.084 DEBUG:boto:Params: {} 2024-04-16T18:40:14.084 DEBUG:boto:Token: None 2024-04-16T18:40:14.085 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.085 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.087 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000057476d2447809a2c-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.130 DEBUG:boto:b'cjqttm-54obj341000falseobj342024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.131 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.131 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.131 DEBUG:boto:path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.131 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.131 DEBUG:boto:Method: GET 2024-04-16T18:40:14.131 DEBUG:boto:Path: /cjqttm-54/?prefix=obj34 2024-04-16T18:40:14.131 DEBUG:boto:Data: 2024-04-16T18:40:14.131 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.131 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.131 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.131 DEBUG:boto:Params: {} 2024-04-16T18:40:14.132 DEBUG:boto:Token: None 2024-04-16T18:40:14.132 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.136 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000613b461cf00485b6-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.136 DEBUG:boto:b'cjqttm-54obj341000falseobj342024-04-16T18:33:08.347Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.136 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:40:14.136 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.137 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.137 DEBUG:boto:path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.137 DEBUG:boto:auth_path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.137 DEBUG:boto:Method: GET 2024-04-16T18:40:14.137 DEBUG:boto:Path: /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.137 DEBUG:boto:Data: 2024-04-16T18:40:14.137 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.137 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.137 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.137 DEBUG:boto:Params: {} 2024-04-16T18:40:14.137 DEBUG:boto:Token: None 2024-04-16T18:40:14.138 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.138 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s= 2024-04-16T18:40:14.138 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s=', 'Content-Length': '0'} 2024-04-16T18:40:14.140 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccb66147808317a3-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.182 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.182 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.183 DEBUG:boto:path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.183 DEBUG:boto:auth_path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.183 DEBUG:boto:Method: GET 2024-04-16T18:40:14.183 DEBUG:boto:Path: /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.183 DEBUG:boto:Data: 2024-04-16T18:40:14.183 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.183 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.183 DEBUG:boto:Params: {} 2024-04-16T18:40:14.183 DEBUG:boto:Token: None 2024-04-16T18:40:14.183 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s= 2024-04-16T18:40:14.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s=', 'Content-Length': '0'} 2024-04-16T18:40:14.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f1ee3b3cd755cca-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.186 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.186 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.187 DEBUG:boto:path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.187 DEBUG:boto:auth_path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.187 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.187 DEBUG:boto:Path: /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.187 DEBUG:boto:Data: 2024-04-16T18:40:14.187 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.187 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.187 DEBUG:boto:Params: {} 2024-04-16T18:40:14.187 DEBUG:boto:Token: None 2024-04-16T18:40:14.188 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PTi1YpQqhFuqmmWBy9YQv43F+KU= 2024-04-16T18:40:14.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PTi1YpQqhFuqmmWBy9YQv43F+KU=', 'Content-Length': '0'} 2024-04-16T18:40:14.190 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000020c0e3792c2950de-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.190 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.190 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.190 DEBUG:boto:path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.190 DEBUG:boto:auth_path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.190 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.191 DEBUG:boto:Path: /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.191 DEBUG:boto:Data: 2024-04-16T18:40:14.191 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.191 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.191 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.191 DEBUG:boto:Params: {} 2024-04-16T18:40:14.191 DEBUG:boto:Token: None 2024-04-16T18:40:14.191 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.191 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PTi1YpQqhFuqmmWBy9YQv43F+KU= 2024-04-16T18:40:14.191 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PTi1YpQqhFuqmmWBy9YQv43F+KU=', 'Content-Length': '0'} 2024-04-16T18:40:14.193 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e36441b6889f1da2-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.194 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:40:14.194 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.194 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.194 DEBUG:boto:path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.194 DEBUG:boto:auth_path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.194 DEBUG:boto:Method: GET 2024-04-16T18:40:14.194 DEBUG:boto:Path: /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.194 DEBUG:boto:Data: 2024-04-16T18:40:14.194 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.195 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.195 DEBUG:boto:Params: {} 2024-04-16T18:40:14.195 DEBUG:boto:Token: None 2024-04-16T18:40:14.195 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.195 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s= 2024-04-16T18:40:14.195 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s=', 'Content-Length': '0'} 2024-04-16T18:40:14.197 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b8b4d40becf02e1-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.238 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.239 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.239 DEBUG:boto:path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.239 DEBUG:boto:auth_path=/cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.239 DEBUG:boto:Method: GET 2024-04-16T18:40:14.239 DEBUG:boto:Path: /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.239 DEBUG:boto:Data: 2024-04-16T18:40:14.239 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.239 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.239 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.239 DEBUG:boto:Params: {} 2024-04-16T18:40:14.239 DEBUG:boto:Token: None 2024-04-16T18:40:14.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37?versionId=null 2024-04-16T18:40:14.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s= 2024-04-16T18:40:14.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:irBG1Q0lQlLFRqEXkGFzCUbfS9s=', 'Content-Length': '0'} 2024-04-16T18:40:14.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000546ea49d06394995-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.242 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.242 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.242 DEBUG:boto:path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.243 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.243 DEBUG:boto:Method: GET 2024-04-16T18:40:14.243 DEBUG:boto:Path: /cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.243 DEBUG:boto:Data: 2024-04-16T18:40:14.243 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.243 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.243 DEBUG:boto:Params: {} 2024-04-16T18:40:14.243 DEBUG:boto:Token: None 2024-04-16T18:40:14.243 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.246 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000049e685bcd3137062-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.286 DEBUG:boto:b'cjqttm-54obj371000falseobj372024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.287 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.287 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.287 DEBUG:boto:path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.287 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.287 DEBUG:boto:Method: GET 2024-04-16T18:40:14.287 DEBUG:boto:Path: /cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.287 DEBUG:boto:Data: 2024-04-16T18:40:14.287 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.287 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.287 DEBUG:boto:Params: {} 2024-04-16T18:40:14.288 DEBUG:boto:Token: None 2024-04-16T18:40:14.288 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.292 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000922d169ad39c3b49-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.292 DEBUG:boto:b'cjqttm-54obj371000falseobj372024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.292 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.292 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.293 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.293 DEBUG:boto:Path: /cjqttm-54/obj37 2024-04-16T18:40:14.293 DEBUG:boto:Data: 2024-04-16T18:40:14.293 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.293 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.293 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.293 DEBUG:boto:Params: {} 2024-04-16T18:40:14.293 DEBUG:boto:Token: None 2024-04-16T18:40:14.293 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37 2024-04-16T18:40:14.294 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzy5NYnMGIadEOUPSQef+2P8e28= 2024-04-16T18:40:14.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzy5NYnMGIadEOUPSQef+2P8e28=', 'Content-Length': '0'} 2024-04-16T18:40:14.295 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000896904337583e9e0-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.296 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.296 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.296 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.296 DEBUG:boto:Path: /cjqttm-54/obj37 2024-04-16T18:40:14.296 DEBUG:boto:Data: 2024-04-16T18:40:14.296 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.296 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.297 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.297 DEBUG:boto:Params: {} 2024-04-16T18:40:14.297 DEBUG:boto:Token: None 2024-04-16T18:40:14.297 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37 2024-04-16T18:40:14.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzy5NYnMGIadEOUPSQef+2P8e28= 2024-04-16T18:40:14.297 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzy5NYnMGIadEOUPSQef+2P8e28=', 'Content-Length': '0'} 2024-04-16T18:40:14.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab81fd80184e841c-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:40:14.299 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.299 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.299 DEBUG:boto:Method: GET 2024-04-16T18:40:14.300 DEBUG:boto:Path: /cjqttm-54/obj37 2024-04-16T18:40:14.300 DEBUG:boto:Data: 2024-04-16T18:40:14.300 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.300 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.300 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.300 DEBUG:boto:Params: {} 2024-04-16T18:40:14.300 DEBUG:boto:Token: None 2024-04-16T18:40:14.300 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37 2024-04-16T18:40:14.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zHZKOVWNV01QTwdiQaRSuiAN6Dc= 2024-04-16T18:40:14.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zHZKOVWNV01QTwdiQaRSuiAN6Dc=', 'Content-Length': '0'} 2024-04-16T18:40:14.303 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000642fd0c0eda68826-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.346 DEBUG:boto:path=/cjqttm-54/obj37 2024-04-16T18:40:14.346 DEBUG:boto:auth_path=/cjqttm-54/obj37 2024-04-16T18:40:14.347 DEBUG:boto:Method: GET 2024-04-16T18:40:14.347 DEBUG:boto:Path: /cjqttm-54/obj37 2024-04-16T18:40:14.347 DEBUG:boto:Data: 2024-04-16T18:40:14.347 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.347 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.347 DEBUG:boto:Params: {} 2024-04-16T18:40:14.347 DEBUG:boto:Token: None 2024-04-16T18:40:14.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj37 2024-04-16T18:40:14.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zHZKOVWNV01QTwdiQaRSuiAN6Dc= 2024-04-16T18:40:14.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zHZKOVWNV01QTwdiQaRSuiAN6Dc=', 'Content-Length': '0'} 2024-04-16T18:40:14.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000634e4442418f2f2e-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.350 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.350 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.350 DEBUG:boto:path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.350 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.350 DEBUG:boto:Method: GET 2024-04-16T18:40:14.350 DEBUG:boto:Path: /cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.350 DEBUG:boto:Data: 2024-04-16T18:40:14.351 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.351 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.351 DEBUG:boto:Params: {} 2024-04-16T18:40:14.351 DEBUG:boto:Token: None 2024-04-16T18:40:14.351 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.351 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.351 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.353 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000062436efae949f0f1-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.394 DEBUG:boto:b'cjqttm-54obj371000falseobj372024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.395 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.395 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.395 DEBUG:boto:path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.395 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.395 DEBUG:boto:Method: GET 2024-04-16T18:40:14.395 DEBUG:boto:Path: /cjqttm-54/?prefix=obj37 2024-04-16T18:40:14.395 DEBUG:boto:Data: 2024-04-16T18:40:14.395 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.396 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.396 DEBUG:boto:Params: {} 2024-04-16T18:40:14.396 DEBUG:boto:Token: None 2024-04-16T18:40:14.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.400 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9b26d771b9ae8c6-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.400 DEBUG:boto:b'cjqttm-54obj371000falseobj372024-04-16T18:33:09.918Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:40:14.401 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.401 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.401 DEBUG:boto:path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.401 DEBUG:boto:auth_path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.401 DEBUG:boto:Method: GET 2024-04-16T18:40:14.401 DEBUG:boto:Path: /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.401 DEBUG:boto:Data: 2024-04-16T18:40:14.401 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.401 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.401 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.401 DEBUG:boto:Params: {} 2024-04-16T18:40:14.402 DEBUG:boto:Token: None 2024-04-16T18:40:14.402 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.402 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM= 2024-04-16T18:40:14.402 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM=', 'Content-Length': '0'} 2024-04-16T18:40:14.404 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ceccff41ade3b20b-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.446 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.446 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.447 DEBUG:boto:path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.447 DEBUG:boto:auth_path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.447 DEBUG:boto:Method: GET 2024-04-16T18:40:14.447 DEBUG:boto:Path: /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.447 DEBUG:boto:Data: 2024-04-16T18:40:14.447 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.447 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.447 DEBUG:boto:Params: {} 2024-04-16T18:40:14.447 DEBUG:boto:Token: None 2024-04-16T18:40:14.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM= 2024-04-16T18:40:14.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM=', 'Content-Length': '0'} 2024-04-16T18:40:14.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f5541d37f547e7f7-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.450 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.451 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.451 DEBUG:boto:path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.451 DEBUG:boto:auth_path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.451 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.451 DEBUG:boto:Path: /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.451 DEBUG:boto:Data: 2024-04-16T18:40:14.451 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.451 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.451 DEBUG:boto:Params: {} 2024-04-16T18:40:14.451 DEBUG:boto:Token: None 2024-04-16T18:40:14.452 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XeqiJmIwSEmc35/5I9QXgLc0Ukw= 2024-04-16T18:40:14.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XeqiJmIwSEmc35/5I9QXgLc0Ukw=', 'Content-Length': '0'} 2024-04-16T18:40:14.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006620fd9b675150cd-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.454 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.454 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.454 DEBUG:boto:path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.454 DEBUG:boto:auth_path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.454 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.455 DEBUG:boto:Path: /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.455 DEBUG:boto:Data: 2024-04-16T18:40:14.455 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.455 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.455 DEBUG:boto:Params: {} 2024-04-16T18:40:14.455 DEBUG:boto:Token: None 2024-04-16T18:40:14.455 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XeqiJmIwSEmc35/5I9QXgLc0Ukw= 2024-04-16T18:40:14.455 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XeqiJmIwSEmc35/5I9QXgLc0Ukw=', 'Content-Length': '0'} 2024-04-16T18:40:14.457 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f07f189f0e5a43c8-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.458 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:40:14.458 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.458 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.458 DEBUG:boto:path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.458 DEBUG:boto:auth_path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.458 DEBUG:boto:Method: GET 2024-04-16T18:40:14.458 DEBUG:boto:Path: /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.459 DEBUG:boto:Data: 2024-04-16T18:40:14.459 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.459 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.459 DEBUG:boto:Params: {} 2024-04-16T18:40:14.459 DEBUG:boto:Token: None 2024-04-16T18:40:14.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM= 2024-04-16T18:40:14.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM=', 'Content-Length': '0'} 2024-04-16T18:40:14.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000378a04b8ae50c4be-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.502 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.502 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.502 DEBUG:boto:path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.503 DEBUG:boto:auth_path=/cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.503 DEBUG:boto:Method: GET 2024-04-16T18:40:14.503 DEBUG:boto:Path: /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.503 DEBUG:boto:Data: 2024-04-16T18:40:14.503 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.503 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.503 DEBUG:boto:Params: {} 2024-04-16T18:40:14.503 DEBUG:boto:Token: None 2024-04-16T18:40:14.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38?versionId=null 2024-04-16T18:40:14.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM= 2024-04-16T18:40:14.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qHBUhWpbL7FGVr3Hh1sluBdHfJM=', 'Content-Length': '0'} 2024-04-16T18:40:14.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001feebb73e4eeedef-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.507 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.507 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.507 DEBUG:boto:path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.508 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.508 DEBUG:boto:Method: GET 2024-04-16T18:40:14.508 DEBUG:boto:Path: /cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.508 DEBUG:boto:Data: 2024-04-16T18:40:14.508 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.508 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.508 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.508 DEBUG:boto:Params: {} 2024-04-16T18:40:14.508 DEBUG:boto:Token: None 2024-04-16T18:40:14.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.509 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.509 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.511 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ea6fa4e8e5aca8f5-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.554 DEBUG:boto:b'cjqttm-54obj381000falseobj382024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.555 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.555 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.555 DEBUG:boto:path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.555 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.555 DEBUG:boto:Method: GET 2024-04-16T18:40:14.555 DEBUG:boto:Path: /cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.555 DEBUG:boto:Data: 2024-04-16T18:40:14.555 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.555 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.555 DEBUG:boto:Params: {} 2024-04-16T18:40:14.556 DEBUG:boto:Token: None 2024-04-16T18:40:14.556 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.559 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007531d898e240a7ae-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.560 DEBUG:boto:b'cjqttm-54obj381000falseobj382024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.560 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.560 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.560 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.560 DEBUG:boto:Path: /cjqttm-54/obj38 2024-04-16T18:40:14.560 DEBUG:boto:Data: 2024-04-16T18:40:14.560 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.560 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.561 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.561 DEBUG:boto:Params: {} 2024-04-16T18:40:14.561 DEBUG:boto:Token: None 2024-04-16T18:40:14.561 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38 2024-04-16T18:40:14.561 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:90crDOOLPvPgdhLNyUESBkWflHA= 2024-04-16T18:40:14.561 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:90crDOOLPvPgdhLNyUESBkWflHA=', 'Content-Length': '0'} 2024-04-16T18:40:14.563 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce6c1777fb4494e9-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.564 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.564 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.564 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.564 DEBUG:boto:Path: /cjqttm-54/obj38 2024-04-16T18:40:14.564 DEBUG:boto:Data: 2024-04-16T18:40:14.564 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.564 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.564 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.564 DEBUG:boto:Params: {} 2024-04-16T18:40:14.564 DEBUG:boto:Token: None 2024-04-16T18:40:14.565 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38 2024-04-16T18:40:14.565 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:90crDOOLPvPgdhLNyUESBkWflHA= 2024-04-16T18:40:14.565 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:90crDOOLPvPgdhLNyUESBkWflHA=', 'Content-Length': '0'} 2024-04-16T18:40:14.567 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5e15782c2eed127-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.567 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:40:14.567 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.567 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.567 DEBUG:boto:Method: GET 2024-04-16T18:40:14.567 DEBUG:boto:Path: /cjqttm-54/obj38 2024-04-16T18:40:14.567 DEBUG:boto:Data: 2024-04-16T18:40:14.567 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.568 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.568 DEBUG:boto:Params: {} 2024-04-16T18:40:14.568 DEBUG:boto:Token: None 2024-04-16T18:40:14.568 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38 2024-04-16T18:40:14.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dACa8eww05zAz9mL5+C3KoBlXqU= 2024-04-16T18:40:14.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dACa8eww05zAz9mL5+C3KoBlXqU=', 'Content-Length': '0'} 2024-04-16T18:40:14.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e70b34b9053ba79a-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.610 DEBUG:boto:path=/cjqttm-54/obj38 2024-04-16T18:40:14.610 DEBUG:boto:auth_path=/cjqttm-54/obj38 2024-04-16T18:40:14.610 DEBUG:boto:Method: GET 2024-04-16T18:40:14.611 DEBUG:boto:Path: /cjqttm-54/obj38 2024-04-16T18:40:14.611 DEBUG:boto:Data: 2024-04-16T18:40:14.611 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.611 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.611 DEBUG:boto:Params: {} 2024-04-16T18:40:14.611 DEBUG:boto:Token: None 2024-04-16T18:40:14.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj38 2024-04-16T18:40:14.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dACa8eww05zAz9mL5+C3KoBlXqU= 2024-04-16T18:40:14.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dACa8eww05zAz9mL5+C3KoBlXqU=', 'Content-Length': '0'} 2024-04-16T18:40:14.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074790c8a1c69fd9a-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.614 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.614 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.614 DEBUG:boto:path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.614 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.614 DEBUG:boto:Method: GET 2024-04-16T18:40:14.614 DEBUG:boto:Path: /cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.614 DEBUG:boto:Data: 2024-04-16T18:40:14.614 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.614 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.615 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.615 DEBUG:boto:Params: {} 2024-04-16T18:40:14.615 DEBUG:boto:Token: None 2024-04-16T18:40:14.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.617 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009c6c2d8f129805f9-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.658 DEBUG:boto:b'cjqttm-54obj381000falseobj382024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.659 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.659 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.659 DEBUG:boto:path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.659 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.659 DEBUG:boto:Method: GET 2024-04-16T18:40:14.659 DEBUG:boto:Path: /cjqttm-54/?prefix=obj38 2024-04-16T18:40:14.659 DEBUG:boto:Data: 2024-04-16T18:40:14.659 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.660 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.660 DEBUG:boto:Params: {} 2024-04-16T18:40:14.660 DEBUG:boto:Token: None 2024-04-16T18:40:14.660 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.664 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005eb6051e053d7e10-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.664 DEBUG:boto:b'cjqttm-54obj381000falseobj382024-04-16T18:33:08.622Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:40:14.665 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.665 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.665 DEBUG:boto:path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.665 DEBUG:boto:auth_path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.665 DEBUG:boto:Method: GET 2024-04-16T18:40:14.665 DEBUG:boto:Path: /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.665 DEBUG:boto:Data: 2024-04-16T18:40:14.665 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.665 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.665 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.665 DEBUG:boto:Params: {} 2024-04-16T18:40:14.666 DEBUG:boto:Token: None 2024-04-16T18:40:14.666 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.666 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM= 2024-04-16T18:40:14.666 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM=', 'Content-Length': '0'} 2024-04-16T18:40:14.668 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000817d262378b33f7a-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.710 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.710 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.710 DEBUG:boto:path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.711 DEBUG:boto:auth_path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.711 DEBUG:boto:Method: GET 2024-04-16T18:40:14.711 DEBUG:boto:Path: /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.711 DEBUG:boto:Data: 2024-04-16T18:40:14.711 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.711 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.711 DEBUG:boto:Params: {} 2024-04-16T18:40:14.711 DEBUG:boto:Token: None 2024-04-16T18:40:14.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM= 2024-04-16T18:40:14.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM=', 'Content-Length': '0'} 2024-04-16T18:40:14.713 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000dbc2cad4341c0be-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.714 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.714 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.714 DEBUG:boto:path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.714 DEBUG:boto:auth_path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.714 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.714 DEBUG:boto:Path: /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.714 DEBUG:boto:Data: 2024-04-16T18:40:14.714 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.714 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.714 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.715 DEBUG:boto:Params: {} 2024-04-16T18:40:14.715 DEBUG:boto:Token: None 2024-04-16T18:40:14.715 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukeJrvr76qY0zz2+8O94lO/5hNo= 2024-04-16T18:40:14.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukeJrvr76qY0zz2+8O94lO/5hNo=', 'Content-Length': '0'} 2024-04-16T18:40:14.717 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ebcaa104d90f1a1-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.717 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.717 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.717 DEBUG:boto:path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.718 DEBUG:boto:auth_path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.718 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.718 DEBUG:boto:Path: /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.718 DEBUG:boto:Data: 2024-04-16T18:40:14.718 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.718 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.718 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.718 DEBUG:boto:Params: {} 2024-04-16T18:40:14.718 DEBUG:boto:Token: None 2024-04-16T18:40:14.718 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ukeJrvr76qY0zz2+8O94lO/5hNo= 2024-04-16T18:40:14.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ukeJrvr76qY0zz2+8O94lO/5hNo=', 'Content-Length': '0'} 2024-04-16T18:40:14.720 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000896f9e8d58685445-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.721 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:40:14.721 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.721 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.721 DEBUG:boto:path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.721 DEBUG:boto:auth_path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.721 DEBUG:boto:Method: GET 2024-04-16T18:40:14.721 DEBUG:boto:Path: /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.721 DEBUG:boto:Data: 2024-04-16T18:40:14.722 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.722 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.722 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.722 DEBUG:boto:Params: {} 2024-04-16T18:40:14.722 DEBUG:boto:Token: None 2024-04-16T18:40:14.722 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.722 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM= 2024-04-16T18:40:14.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM=', 'Content-Length': '0'} 2024-04-16T18:40:14.724 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b08693ebe4a1700-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.770 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.770 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.771 DEBUG:boto:path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.771 DEBUG:boto:auth_path=/cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.771 DEBUG:boto:Method: GET 2024-04-16T18:40:14.771 DEBUG:boto:Path: /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.771 DEBUG:boto:Data: 2024-04-16T18:40:14.771 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.771 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.771 DEBUG:boto:Params: {} 2024-04-16T18:40:14.771 DEBUG:boto:Token: None 2024-04-16T18:40:14.771 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44?versionId=null 2024-04-16T18:40:14.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM= 2024-04-16T18:40:14.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yz88UOiyy0GOsDZmJ5YZfS+fsIM=', 'Content-Length': '0'} 2024-04-16T18:40:14.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7aca1e12ec09d66-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.774 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.774 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.774 DEBUG:boto:path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.774 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.774 DEBUG:boto:Method: GET 2024-04-16T18:40:14.774 DEBUG:boto:Path: /cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.774 DEBUG:boto:Data: 2024-04-16T18:40:14.775 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.775 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.775 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.775 DEBUG:boto:Params: {} 2024-04-16T18:40:14.775 DEBUG:boto:Token: None 2024-04-16T18:40:14.775 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.775 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.775 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.777 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009591f957eecc8066-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.818 DEBUG:boto:b'cjqttm-54obj441000falseobj442024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.819 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.819 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.819 DEBUG:boto:path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.819 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.819 DEBUG:boto:Method: GET 2024-04-16T18:40:14.819 DEBUG:boto:Path: /cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.819 DEBUG:boto:Data: 2024-04-16T18:40:14.819 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.819 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.820 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.820 DEBUG:boto:Params: {} 2024-04-16T18:40:14.820 DEBUG:boto:Token: None 2024-04-16T18:40:14.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.824 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009806ed577d7959c-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.824 DEBUG:boto:b'cjqttm-54obj441000falseobj442024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.824 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.824 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.825 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.825 DEBUG:boto:Path: /cjqttm-54/obj44 2024-04-16T18:40:14.825 DEBUG:boto:Data: 2024-04-16T18:40:14.825 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.825 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.825 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.825 DEBUG:boto:Params: {} 2024-04-16T18:40:14.825 DEBUG:boto:Token: None 2024-04-16T18:40:14.825 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44 2024-04-16T18:40:14.825 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8pk8ByeGNFoVzEDZDmhwJfrmLDY= 2024-04-16T18:40:14.826 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8pk8ByeGNFoVzEDZDmhwJfrmLDY=', 'Content-Length': '0'} 2024-04-16T18:40:14.827 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049c7c9008f9cadeb-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.828 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.828 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.828 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.828 DEBUG:boto:Path: /cjqttm-54/obj44 2024-04-16T18:40:14.828 DEBUG:boto:Data: 2024-04-16T18:40:14.828 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.828 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.828 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.828 DEBUG:boto:Params: {} 2024-04-16T18:40:14.828 DEBUG:boto:Token: None 2024-04-16T18:40:14.829 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44 2024-04-16T18:40:14.829 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8pk8ByeGNFoVzEDZDmhwJfrmLDY= 2024-04-16T18:40:14.829 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8pk8ByeGNFoVzEDZDmhwJfrmLDY=', 'Content-Length': '0'} 2024-04-16T18:40:14.830 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033bbae1a7e589b85-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.831 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:40:14.831 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.831 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.831 DEBUG:boto:Method: GET 2024-04-16T18:40:14.831 DEBUG:boto:Path: /cjqttm-54/obj44 2024-04-16T18:40:14.831 DEBUG:boto:Data: 2024-04-16T18:40:14.831 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.831 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.831 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.832 DEBUG:boto:Params: {} 2024-04-16T18:40:14.832 DEBUG:boto:Token: None 2024-04-16T18:40:14.832 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44 2024-04-16T18:40:14.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yB1HlIupI/WUcesZiWExeMY1tXw= 2024-04-16T18:40:14.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yB1HlIupI/WUcesZiWExeMY1tXw=', 'Content-Length': '0'} 2024-04-16T18:40:14.834 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dae89679cc3f5e4c-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.874 DEBUG:boto:path=/cjqttm-54/obj44 2024-04-16T18:40:14.874 DEBUG:boto:auth_path=/cjqttm-54/obj44 2024-04-16T18:40:14.875 DEBUG:boto:Method: GET 2024-04-16T18:40:14.875 DEBUG:boto:Path: /cjqttm-54/obj44 2024-04-16T18:40:14.875 DEBUG:boto:Data: 2024-04-16T18:40:14.875 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.875 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.875 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.875 DEBUG:boto:Params: {} 2024-04-16T18:40:14.875 DEBUG:boto:Token: None 2024-04-16T18:40:14.875 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj44 2024-04-16T18:40:14.876 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yB1HlIupI/WUcesZiWExeMY1tXw= 2024-04-16T18:40:14.876 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yB1HlIupI/WUcesZiWExeMY1tXw=', 'Content-Length': '0'} 2024-04-16T18:40:14.877 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0af869f44a2f8f8-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.878 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.878 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.878 DEBUG:boto:path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.878 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.878 DEBUG:boto:Method: GET 2024-04-16T18:40:14.878 DEBUG:boto:Path: /cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.878 DEBUG:boto:Data: 2024-04-16T18:40:14.878 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.879 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.879 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.879 DEBUG:boto:Params: {} 2024-04-16T18:40:14.879 DEBUG:boto:Token: None 2024-04-16T18:40:14.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.879 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.879 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.881 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b763a076fe00114-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.922 DEBUG:boto:b'cjqttm-54obj441000falseobj442024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.923 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:14.923 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:14.923 DEBUG:boto:path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.923 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.923 DEBUG:boto:Method: GET 2024-04-16T18:40:14.923 DEBUG:boto:Path: /cjqttm-54/?prefix=obj44 2024-04-16T18:40:14.923 DEBUG:boto:Data: 2024-04-16T18:40:14.923 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.923 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.923 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.924 DEBUG:boto:Params: {} 2024-04-16T18:40:14.924 DEBUG:boto:Token: None 2024-04-16T18:40:14.924 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/ 2024-04-16T18:40:14.924 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0= 2024-04-16T18:40:14.924 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:w6ChKKM+8108Xq7prcOun7AG3d0=', 'Content-Length': '0'} 2024-04-16T18:40:14.928 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a84e5c453fe0b4c5-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.928 DEBUG:boto:b'cjqttm-54obj441000falseobj442024-04-16T18:33:08.094Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:14.928 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:40:14.928 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:14.928 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:14.929 DEBUG:boto:path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.929 DEBUG:boto:auth_path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.929 DEBUG:boto:Method: GET 2024-04-16T18:40:14.929 DEBUG:boto:Path: /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.929 DEBUG:boto:Data: 2024-04-16T18:40:14.929 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.929 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.929 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.929 DEBUG:boto:Params: {} 2024-04-16T18:40:14.929 DEBUG:boto:Token: None 2024-04-16T18:40:14.930 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.930 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nK6jSmdh2Q3Cm0wnTFmT/23/NYY= 2024-04-16T18:40:14.930 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nK6jSmdh2Q3Cm0wnTFmT/23/NYY=', 'Content-Length': '0'} 2024-04-16T18:40:14.932 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb9a0312ea1b604b-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.974 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:14.974 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:14.975 DEBUG:boto:path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.975 DEBUG:boto:auth_path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.975 DEBUG:boto:Method: GET 2024-04-16T18:40:14.975 DEBUG:boto:Path: /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.975 DEBUG:boto:Data: 2024-04-16T18:40:14.975 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.975 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.975 DEBUG:boto:Params: {} 2024-04-16T18:40:14.975 DEBUG:boto:Token: None 2024-04-16T18:40:14.976 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nK6jSmdh2Q3Cm0wnTFmT/23/NYY= 2024-04-16T18:40:14.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nK6jSmdh2Q3Cm0wnTFmT/23/NYY=', 'Content-Length': '0'} 2024-04-16T18:40:14.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000515be6638b76dd4f-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.978 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:14.978 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:14.978 DEBUG:boto:path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.979 DEBUG:boto:auth_path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.979 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.979 DEBUG:boto:Path: /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.979 DEBUG:boto:Data: 2024-04-16T18:40:14.979 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.979 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.979 DEBUG:boto:Params: {} 2024-04-16T18:40:14.979 DEBUG:boto:Token: None 2024-04-16T18:40:14.979 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dLVq04RYUdCsLNnlGOb4Yyhjm+A= 2024-04-16T18:40:14.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dLVq04RYUdCsLNnlGOb4Yyhjm+A=', 'Content-Length': '0'} 2024-04-16T18:40:14.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef74016214415414-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.982 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:14.982 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:14.982 DEBUG:boto:path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.982 DEBUG:boto:auth_path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.982 DEBUG:boto:Method: HEAD 2024-04-16T18:40:14.982 DEBUG:boto:Path: /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.982 DEBUG:boto:Data: 2024-04-16T18:40:14.982 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.982 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:14.982 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.983 DEBUG:boto:Params: {} 2024-04-16T18:40:14.983 DEBUG:boto:Token: None 2024-04-16T18:40:14.983 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dLVq04RYUdCsLNnlGOb4Yyhjm+A= 2024-04-16T18:40:14.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dLVq04RYUdCsLNnlGOb4Yyhjm+A=', 'Content-Length': '0'} 2024-04-16T18:40:14.985 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c63659911b8e72b7-00661ec60e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:14.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:40:14.985 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:14.986 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:14.986 DEBUG:boto:path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.986 DEBUG:boto:auth_path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.986 DEBUG:boto:Method: GET 2024-04-16T18:40:14.986 DEBUG:boto:Path: /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.986 DEBUG:boto:Data: 2024-04-16T18:40:14.986 DEBUG:boto:Headers: {} 2024-04-16T18:40:14.986 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:14.986 DEBUG:boto:Port: 8000 2024-04-16T18:40:14.986 DEBUG:boto:Params: {} 2024-04-16T18:40:14.987 DEBUG:boto:Token: None 2024-04-16T18:40:14.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:14 GMT /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:14.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nK6jSmdh2Q3Cm0wnTFmT/23/NYY= 2024-04-16T18:40:14.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:14 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nK6jSmdh2Q3Cm0wnTFmT/23/NYY=', 'Content-Length': '0'} 2024-04-16T18:40:14.989 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fe94d551c03276f9-00661ec60e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:14 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.030 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:15.030 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:15.031 DEBUG:boto:path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:15.031 DEBUG:boto:auth_path=/cjqttm-54/obj46?versionId=null 2024-04-16T18:40:15.031 DEBUG:boto:Method: GET 2024-04-16T18:40:15.031 DEBUG:boto:Path: /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:15.031 DEBUG:boto:Data: 2024-04-16T18:40:15.031 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.031 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.031 DEBUG:boto:Params: {} 2024-04-16T18:40:15.031 DEBUG:boto:Token: None 2024-04-16T18:40:15.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj46?versionId=null 2024-04-16T18:40:15.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9+QvHNNz0Nsd8lOEcvYo+D/n/j8= 2024-04-16T18:40:15.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9+QvHNNz0Nsd8lOEcvYo+D/n/j8=', 'Content-Length': '0'} 2024-04-16T18:40:15.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000622317d153568251-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.034 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.034 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.034 DEBUG:boto:path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.034 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.035 DEBUG:boto:Method: GET 2024-04-16T18:40:15.035 DEBUG:boto:Path: /cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.035 DEBUG:boto:Data: 2024-04-16T18:40:15.035 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.035 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.035 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.035 DEBUG:boto:Params: {} 2024-04-16T18:40:15.035 DEBUG:boto:Token: None 2024-04-16T18:40:15.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.036 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4832b89ed354c4d-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.078 DEBUG:boto:b'cjqttm-54obj461000falseobj462024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.079 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.079 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.079 DEBUG:boto:path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.079 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.079 DEBUG:boto:Method: GET 2024-04-16T18:40:15.079 DEBUG:boto:Path: /cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.079 DEBUG:boto:Data: 2024-04-16T18:40:15.079 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.079 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.079 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.080 DEBUG:boto:Params: {} 2024-04-16T18:40:15.080 DEBUG:boto:Token: None 2024-04-16T18:40:15.080 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.080 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.084 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000a72a82eb134b54e-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.084 DEBUG:boto:b'cjqttm-54obj461000falseobj462024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.084 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:15.084 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:15.085 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.085 DEBUG:boto:Path: /cjqttm-54/obj46 2024-04-16T18:40:15.085 DEBUG:boto:Data: 2024-04-16T18:40:15.085 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.085 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.085 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.085 DEBUG:boto:Params: {} 2024-04-16T18:40:15.085 DEBUG:boto:Token: None 2024-04-16T18:40:15.085 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj46 2024-04-16T18:40:15.085 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0U/ZDTS8Dp116vs/cd+DaGowND4= 2024-04-16T18:40:15.086 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0U/ZDTS8Dp116vs/cd+DaGowND4=', 'Content-Length': '0'} 2024-04-16T18:40:15.088 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033c64ca8f08d5c41-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.088 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:15.088 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:15.088 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.088 DEBUG:boto:Path: /cjqttm-54/obj46 2024-04-16T18:40:15.088 DEBUG:boto:Data: 2024-04-16T18:40:15.088 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.088 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.088 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.089 DEBUG:boto:Params: {} 2024-04-16T18:40:15.089 DEBUG:boto:Token: None 2024-04-16T18:40:15.089 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj46 2024-04-16T18:40:15.089 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0U/ZDTS8Dp116vs/cd+DaGowND4= 2024-04-16T18:40:15.089 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0U/ZDTS8Dp116vs/cd+DaGowND4=', 'Content-Length': '0'} 2024-04-16T18:40:15.091 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000383f4b21a5bedad2-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.091 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:40:15.091 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:15.091 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:15.091 DEBUG:boto:Method: GET 2024-04-16T18:40:15.092 DEBUG:boto:Path: /cjqttm-54/obj46 2024-04-16T18:40:15.092 DEBUG:boto:Data: 2024-04-16T18:40:15.092 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.092 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.092 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.092 DEBUG:boto:Params: {} 2024-04-16T18:40:15.092 DEBUG:boto:Token: None 2024-04-16T18:40:15.092 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj46 2024-04-16T18:40:15.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4wd3Ut0akThijl8+eyWND9iakE= 2024-04-16T18:40:15.093 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4wd3Ut0akThijl8+eyWND9iakE=', 'Content-Length': '0'} 2024-04-16T18:40:15.095 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000534edd4cf00bbb4e-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.138 DEBUG:boto:path=/cjqttm-54/obj46 2024-04-16T18:40:15.177 DEBUG:boto:auth_path=/cjqttm-54/obj46 2024-04-16T18:40:15.177 DEBUG:boto:Method: GET 2024-04-16T18:40:15.177 DEBUG:boto:Path: /cjqttm-54/obj46 2024-04-16T18:40:15.177 DEBUG:boto:Data: 2024-04-16T18:40:15.177 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.177 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.177 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.177 DEBUG:boto:Params: {} 2024-04-16T18:40:15.177 DEBUG:boto:Token: None 2024-04-16T18:40:15.178 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj46 2024-04-16T18:40:15.178 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O4wd3Ut0akThijl8+eyWND9iakE= 2024-04-16T18:40:15.178 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O4wd3Ut0akThijl8+eyWND9iakE=', 'Content-Length': '0'} 2024-04-16T18:40:15.180 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8fabe6447eb417b-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.180 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.180 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.180 DEBUG:boto:path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.180 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.180 DEBUG:boto:Method: GET 2024-04-16T18:40:15.181 DEBUG:boto:Path: /cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.181 DEBUG:boto:Data: 2024-04-16T18:40:15.181 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.181 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.181 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.181 DEBUG:boto:Params: {} 2024-04-16T18:40:15.181 DEBUG:boto:Token: None 2024-04-16T18:40:15.181 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.182 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.184 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b76e4ebe784a6b1-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.226 DEBUG:boto:b'cjqttm-54obj461000falseobj462024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.227 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.227 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.227 DEBUG:boto:path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.227 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.227 DEBUG:boto:Method: GET 2024-04-16T18:40:15.227 DEBUG:boto:Path: /cjqttm-54/?prefix=obj46 2024-04-16T18:40:15.227 DEBUG:boto:Data: 2024-04-16T18:40:15.227 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.227 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.227 DEBUG:boto:Params: {} 2024-04-16T18:40:15.227 DEBUG:boto:Token: None 2024-04-16T18:40:15.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.232 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d28f3a2f2830470d-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.232 DEBUG:boto:b'cjqttm-54obj461000falseobj462024-04-16T18:33:08.933Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.232 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:40:15.232 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.232 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.232 DEBUG:boto:path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.232 DEBUG:boto:auth_path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.233 DEBUG:boto:Method: GET 2024-04-16T18:40:15.233 DEBUG:boto:Path: /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.233 DEBUG:boto:Data: 2024-04-16T18:40:15.233 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.233 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.233 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.233 DEBUG:boto:Params: {} 2024-04-16T18:40:15.233 DEBUG:boto:Token: None 2024-04-16T18:40:15.233 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.233 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY= 2024-04-16T18:40:15.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY=', 'Content-Length': '0'} 2024-04-16T18:40:15.235 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f8e98f2577d1216-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.278 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.279 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.279 DEBUG:boto:path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.279 DEBUG:boto:auth_path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.279 DEBUG:boto:Method: GET 2024-04-16T18:40:15.279 DEBUG:boto:Path: /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.279 DEBUG:boto:Data: 2024-04-16T18:40:15.279 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.279 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.279 DEBUG:boto:Params: {} 2024-04-16T18:40:15.280 DEBUG:boto:Token: None 2024-04-16T18:40:15.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY= 2024-04-16T18:40:15.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY=', 'Content-Length': '0'} 2024-04-16T18:40:15.282 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bcd13f6427ef8f6b-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.283 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.283 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.283 DEBUG:boto:path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.283 DEBUG:boto:auth_path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.283 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.283 DEBUG:boto:Path: /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.283 DEBUG:boto:Data: 2024-04-16T18:40:15.283 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.283 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.284 DEBUG:boto:Params: {} 2024-04-16T18:40:15.284 DEBUG:boto:Token: None 2024-04-16T18:40:15.284 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ojPGxMIdO5W4K7CMjh+UvbKMu1s= 2024-04-16T18:40:15.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ojPGxMIdO5W4K7CMjh+UvbKMu1s=', 'Content-Length': '0'} 2024-04-16T18:40:15.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000052775d946b65659c-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.286 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.287 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.287 DEBUG:boto:path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.287 DEBUG:boto:auth_path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.287 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.287 DEBUG:boto:Path: /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.287 DEBUG:boto:Data: 2024-04-16T18:40:15.287 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.287 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.287 DEBUG:boto:Params: {} 2024-04-16T18:40:15.288 DEBUG:boto:Token: None 2024-04-16T18:40:15.288 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ojPGxMIdO5W4K7CMjh+UvbKMu1s= 2024-04-16T18:40:15.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ojPGxMIdO5W4K7CMjh+UvbKMu1s=', 'Content-Length': '0'} 2024-04-16T18:40:15.290 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd2cdbc7a371af0c-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.290 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:40:15.290 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.290 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.290 DEBUG:boto:path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.290 DEBUG:boto:auth_path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.290 DEBUG:boto:Method: GET 2024-04-16T18:40:15.291 DEBUG:boto:Path: /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.291 DEBUG:boto:Data: 2024-04-16T18:40:15.291 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.291 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.291 DEBUG:boto:Params: {} 2024-04-16T18:40:15.292 DEBUG:boto:Token: None 2024-04-16T18:40:15.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY= 2024-04-16T18:40:15.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY=', 'Content-Length': '0'} 2024-04-16T18:40:15.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000470e1447be73c2a5-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.338 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.338 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.339 DEBUG:boto:path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.339 DEBUG:boto:auth_path=/cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.339 DEBUG:boto:Method: GET 2024-04-16T18:40:15.339 DEBUG:boto:Path: /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.339 DEBUG:boto:Data: 2024-04-16T18:40:15.339 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.339 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.339 DEBUG:boto:Params: {} 2024-04-16T18:40:15.339 DEBUG:boto:Token: None 2024-04-16T18:40:15.340 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51?versionId=null 2024-04-16T18:40:15.340 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY= 2024-04-16T18:40:15.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rCctbHDT87cBGH0KEFtvOGn5zKY=', 'Content-Length': '0'} 2024-04-16T18:40:15.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2194019e71c9963-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.342 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.342 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.342 DEBUG:boto:path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.343 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.343 DEBUG:boto:Method: GET 2024-04-16T18:40:15.343 DEBUG:boto:Path: /cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.343 DEBUG:boto:Data: 2024-04-16T18:40:15.343 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.343 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.343 DEBUG:boto:Params: {} 2024-04-16T18:40:15.343 DEBUG:boto:Token: None 2024-04-16T18:40:15.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.344 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.344 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.346 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000039d051614fdd2948-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.346 DEBUG:boto:b'cjqttm-54obj511000falseobj512024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.346 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.347 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.347 DEBUG:boto:path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.347 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.347 DEBUG:boto:Method: GET 2024-04-16T18:40:15.347 DEBUG:boto:Path: /cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.347 DEBUG:boto:Data: 2024-04-16T18:40:15.347 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.347 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.347 DEBUG:boto:Params: {} 2024-04-16T18:40:15.348 DEBUG:boto:Token: None 2024-04-16T18:40:15.348 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.351 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000077e3625c03120ac-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.352 DEBUG:boto:b'cjqttm-54obj511000falseobj512024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.352 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.352 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.352 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.352 DEBUG:boto:Path: /cjqttm-54/obj51 2024-04-16T18:40:15.352 DEBUG:boto:Data: 2024-04-16T18:40:15.352 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.353 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.353 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.353 DEBUG:boto:Params: {} 2024-04-16T18:40:15.353 DEBUG:boto:Token: None 2024-04-16T18:40:15.353 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51 2024-04-16T18:40:15.353 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IeFLBmTC16oIUwz8c9NuJy9uOD0= 2024-04-16T18:40:15.353 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IeFLBmTC16oIUwz8c9NuJy9uOD0=', 'Content-Length': '0'} 2024-04-16T18:40:15.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b2732060fedbc345-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.355 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.355 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.356 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.356 DEBUG:boto:Path: /cjqttm-54/obj51 2024-04-16T18:40:15.356 DEBUG:boto:Data: 2024-04-16T18:40:15.356 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.356 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.356 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.356 DEBUG:boto:Params: {} 2024-04-16T18:40:15.356 DEBUG:boto:Token: None 2024-04-16T18:40:15.356 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51 2024-04-16T18:40:15.357 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:IeFLBmTC16oIUwz8c9NuJy9uOD0= 2024-04-16T18:40:15.357 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:IeFLBmTC16oIUwz8c9NuJy9uOD0=', 'Content-Length': '0'} 2024-04-16T18:40:15.359 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e08bc5166e5ed94-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.359 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:40:15.359 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.359 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.359 DEBUG:boto:Method: GET 2024-04-16T18:40:15.359 DEBUG:boto:Path: /cjqttm-54/obj51 2024-04-16T18:40:15.359 DEBUG:boto:Data: 2024-04-16T18:40:15.360 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.360 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.360 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.360 DEBUG:boto:Params: {} 2024-04-16T18:40:15.360 DEBUG:boto:Token: None 2024-04-16T18:40:15.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51 2024-04-16T18:40:15.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dJLBPT/Nuyz4vCGwgUhEoCuSIcU= 2024-04-16T18:40:15.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dJLBPT/Nuyz4vCGwgUhEoCuSIcU=', 'Content-Length': '0'} 2024-04-16T18:40:15.362 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009cfbf97dd18404fd-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.406 DEBUG:boto:path=/cjqttm-54/obj51 2024-04-16T18:40:15.406 DEBUG:boto:auth_path=/cjqttm-54/obj51 2024-04-16T18:40:15.407 DEBUG:boto:Method: GET 2024-04-16T18:40:15.407 DEBUG:boto:Path: /cjqttm-54/obj51 2024-04-16T18:40:15.407 DEBUG:boto:Data: 2024-04-16T18:40:15.407 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.407 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.407 DEBUG:boto:Params: {} 2024-04-16T18:40:15.407 DEBUG:boto:Token: None 2024-04-16T18:40:15.407 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj51 2024-04-16T18:40:15.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dJLBPT/Nuyz4vCGwgUhEoCuSIcU= 2024-04-16T18:40:15.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dJLBPT/Nuyz4vCGwgUhEoCuSIcU=', 'Content-Length': '0'} 2024-04-16T18:40:15.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007f302077e4889564-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.410 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.410 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.410 DEBUG:boto:path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.410 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.411 DEBUG:boto:Method: GET 2024-04-16T18:40:15.411 DEBUG:boto:Path: /cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.411 DEBUG:boto:Data: 2024-04-16T18:40:15.411 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.411 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.411 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.411 DEBUG:boto:Params: {} 2024-04-16T18:40:15.411 DEBUG:boto:Token: None 2024-04-16T18:40:15.411 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.414 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b74acadc418691d-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.454 DEBUG:boto:b'cjqttm-54obj511000falseobj512024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.455 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.455 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.455 DEBUG:boto:path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.455 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.455 DEBUG:boto:Method: GET 2024-04-16T18:40:15.455 DEBUG:boto:Path: /cjqttm-54/?prefix=obj51 2024-04-16T18:40:15.455 DEBUG:boto:Data: 2024-04-16T18:40:15.455 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.455 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.456 DEBUG:boto:Params: {} 2024-04-16T18:40:15.456 DEBUG:boto:Token: None 2024-04-16T18:40:15.456 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.460 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bfe2ed4417057551-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.460 DEBUG:boto:b'cjqttm-54obj511000falseobj512024-04-16T18:33:08.357Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.460 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:40:15.460 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.460 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.460 DEBUG:boto:path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.461 DEBUG:boto:auth_path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.461 DEBUG:boto:Method: GET 2024-04-16T18:40:15.461 DEBUG:boto:Path: /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.461 DEBUG:boto:Data: 2024-04-16T18:40:15.461 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.461 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.461 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.461 DEBUG:boto:Params: {} 2024-04-16T18:40:15.461 DEBUG:boto:Token: None 2024-04-16T18:40:15.461 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.462 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U= 2024-04-16T18:40:15.462 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U=', 'Content-Length': '0'} 2024-04-16T18:40:15.465 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac11551e1b93b25b-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.506 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.506 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.507 DEBUG:boto:path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.507 DEBUG:boto:auth_path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.507 DEBUG:boto:Method: GET 2024-04-16T18:40:15.507 DEBUG:boto:Path: /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.507 DEBUG:boto:Data: 2024-04-16T18:40:15.507 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.507 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.507 DEBUG:boto:Params: {} 2024-04-16T18:40:15.507 DEBUG:boto:Token: None 2024-04-16T18:40:15.507 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U= 2024-04-16T18:40:15.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U=', 'Content-Length': '0'} 2024-04-16T18:40:15.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b1b3a4004adc6d1c-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.510 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.511 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.511 DEBUG:boto:path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.511 DEBUG:boto:auth_path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.511 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.511 DEBUG:boto:Path: /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.511 DEBUG:boto:Data: 2024-04-16T18:40:15.511 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.511 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.511 DEBUG:boto:Params: {} 2024-04-16T18:40:15.512 DEBUG:boto:Token: None 2024-04-16T18:40:15.512 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eP4iv56b6et6bk/AG8buqjfWpn8= 2024-04-16T18:40:15.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eP4iv56b6et6bk/AG8buqjfWpn8=', 'Content-Length': '0'} 2024-04-16T18:40:15.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c3e9e14d4fe8e0b3-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.514 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.514 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.514 DEBUG:boto:path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.514 DEBUG:boto:auth_path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.514 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.515 DEBUG:boto:Path: /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.515 DEBUG:boto:Data: 2024-04-16T18:40:15.515 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.515 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.515 DEBUG:boto:Params: {} 2024-04-16T18:40:15.515 DEBUG:boto:Token: None 2024-04-16T18:40:15.515 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.515 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eP4iv56b6et6bk/AG8buqjfWpn8= 2024-04-16T18:40:15.515 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eP4iv56b6et6bk/AG8buqjfWpn8=', 'Content-Length': '0'} 2024-04-16T18:40:15.518 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f882e51bd1175f23-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.518 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:40:15.518 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.518 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.518 DEBUG:boto:path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.518 DEBUG:boto:auth_path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.518 DEBUG:boto:Method: GET 2024-04-16T18:40:15.519 DEBUG:boto:Path: /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.519 DEBUG:boto:Data: 2024-04-16T18:40:15.519 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.519 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.519 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.519 DEBUG:boto:Params: {} 2024-04-16T18:40:15.519 DEBUG:boto:Token: None 2024-04-16T18:40:15.519 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.519 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U= 2024-04-16T18:40:15.519 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U=', 'Content-Length': '0'} 2024-04-16T18:40:15.521 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000aa0cd39db804d51-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.562 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.562 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.562 DEBUG:boto:path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.563 DEBUG:boto:auth_path=/cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.563 DEBUG:boto:Method: GET 2024-04-16T18:40:15.563 DEBUG:boto:Path: /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.563 DEBUG:boto:Data: 2024-04-16T18:40:15.563 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.563 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.563 DEBUG:boto:Params: {} 2024-04-16T18:40:15.563 DEBUG:boto:Token: None 2024-04-16T18:40:15.563 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55?versionId=null 2024-04-16T18:40:15.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U= 2024-04-16T18:40:15.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:psWirRDYOt1ZLxYXtv1XVEb7J0U=', 'Content-Length': '0'} 2024-04-16T18:40:15.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d1ad30283bb9550-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.566 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.566 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.566 DEBUG:boto:path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.566 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.566 DEBUG:boto:Method: GET 2024-04-16T18:40:15.566 DEBUG:boto:Path: /cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.567 DEBUG:boto:Data: 2024-04-16T18:40:15.567 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.567 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.567 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.567 DEBUG:boto:Params: {} 2024-04-16T18:40:15.567 DEBUG:boto:Token: None 2024-04-16T18:40:15.567 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.570 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001488e977ff0c3b66-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.610 DEBUG:boto:b'cjqttm-54obj551000falseobj552024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.611 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.611 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.611 DEBUG:boto:path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.611 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.611 DEBUG:boto:Method: GET 2024-04-16T18:40:15.611 DEBUG:boto:Path: /cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.611 DEBUG:boto:Data: 2024-04-16T18:40:15.611 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.611 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.612 DEBUG:boto:Params: {} 2024-04-16T18:40:15.612 DEBUG:boto:Token: None 2024-04-16T18:40:15.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.615 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c14f60cf7f97ddd-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.616 DEBUG:boto:b'cjqttm-54obj551000falseobj552024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.616 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.616 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.616 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.616 DEBUG:boto:Path: /cjqttm-54/obj55 2024-04-16T18:40:15.616 DEBUG:boto:Data: 2024-04-16T18:40:15.617 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.617 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.617 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.617 DEBUG:boto:Params: {} 2024-04-16T18:40:15.617 DEBUG:boto:Token: None 2024-04-16T18:40:15.617 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55 2024-04-16T18:40:15.617 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hi/4ILFhhJZhGxbicc08eC0h7yE= 2024-04-16T18:40:15.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hi/4ILFhhJZhGxbicc08eC0h7yE=', 'Content-Length': '0'} 2024-04-16T18:40:15.619 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003aa667909b19e25f-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.619 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.619 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.620 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.620 DEBUG:boto:Path: /cjqttm-54/obj55 2024-04-16T18:40:15.620 DEBUG:boto:Data: 2024-04-16T18:40:15.620 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.620 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.620 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.620 DEBUG:boto:Params: {} 2024-04-16T18:40:15.620 DEBUG:boto:Token: None 2024-04-16T18:40:15.620 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55 2024-04-16T18:40:15.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Hi/4ILFhhJZhGxbicc08eC0h7yE= 2024-04-16T18:40:15.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Hi/4ILFhhJZhGxbicc08eC0h7yE=', 'Content-Length': '0'} 2024-04-16T18:40:15.622 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062f753e62b6ea03d-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.623 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:40:15.623 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.623 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.623 DEBUG:boto:Method: GET 2024-04-16T18:40:15.623 DEBUG:boto:Path: /cjqttm-54/obj55 2024-04-16T18:40:15.623 DEBUG:boto:Data: 2024-04-16T18:40:15.623 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.623 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.623 DEBUG:boto:Params: {} 2024-04-16T18:40:15.624 DEBUG:boto:Token: None 2024-04-16T18:40:15.624 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55 2024-04-16T18:40:15.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjkEab5Y8Xnwc/D92fA1aorbP1w= 2024-04-16T18:40:15.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjkEab5Y8Xnwc/D92fA1aorbP1w=', 'Content-Length': '0'} 2024-04-16T18:40:15.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009381bacf861a9153-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.666 DEBUG:boto:path=/cjqttm-54/obj55 2024-04-16T18:40:15.666 DEBUG:boto:auth_path=/cjqttm-54/obj55 2024-04-16T18:40:15.667 DEBUG:boto:Method: GET 2024-04-16T18:40:15.667 DEBUG:boto:Path: /cjqttm-54/obj55 2024-04-16T18:40:15.667 DEBUG:boto:Data: 2024-04-16T18:40:15.667 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.667 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.667 DEBUG:boto:Params: {} 2024-04-16T18:40:15.670 DEBUG:boto:Token: None 2024-04-16T18:40:15.670 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj55 2024-04-16T18:40:15.670 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NjkEab5Y8Xnwc/D92fA1aorbP1w= 2024-04-16T18:40:15.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NjkEab5Y8Xnwc/D92fA1aorbP1w=', 'Content-Length': '0'} 2024-04-16T18:40:15.672 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2995151b4f18e27-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.673 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.673 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.673 DEBUG:boto:path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.673 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.673 DEBUG:boto:Method: GET 2024-04-16T18:40:15.673 DEBUG:boto:Path: /cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.674 DEBUG:boto:Data: 2024-04-16T18:40:15.674 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.674 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.674 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.674 DEBUG:boto:Params: {} 2024-04-16T18:40:15.674 DEBUG:boto:Token: None 2024-04-16T18:40:15.674 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.674 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.676 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000135fda0626466d41-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.718 DEBUG:boto:b'cjqttm-54obj551000falseobj552024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.719 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.719 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.719 DEBUG:boto:path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.719 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.719 DEBUG:boto:Method: GET 2024-04-16T18:40:15.719 DEBUG:boto:Path: /cjqttm-54/?prefix=obj55 2024-04-16T18:40:15.719 DEBUG:boto:Data: 2024-04-16T18:40:15.719 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.719 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.720 DEBUG:boto:Params: {} 2024-04-16T18:40:15.720 DEBUG:boto:Token: None 2024-04-16T18:40:15.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.723 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f9b15189e9ff0225-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.723 DEBUG:boto:b'cjqttm-54obj551000falseobj552024-04-16T18:33:08.105Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:40:15.724 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.724 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.724 DEBUG:boto:path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.724 DEBUG:boto:auth_path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.724 DEBUG:boto:Method: GET 2024-04-16T18:40:15.724 DEBUG:boto:Path: /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.724 DEBUG:boto:Data: 2024-04-16T18:40:15.724 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.725 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.725 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.725 DEBUG:boto:Params: {} 2024-04-16T18:40:15.725 DEBUG:boto:Token: None 2024-04-16T18:40:15.725 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.725 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ= 2024-04-16T18:40:15.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ=', 'Content-Length': '0'} 2024-04-16T18:40:15.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037d697c7f3b3f462-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.770 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.771 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.771 DEBUG:boto:path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.771 DEBUG:boto:auth_path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.771 DEBUG:boto:Method: GET 2024-04-16T18:40:15.771 DEBUG:boto:Path: /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.771 DEBUG:boto:Data: 2024-04-16T18:40:15.771 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.771 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.771 DEBUG:boto:Params: {} 2024-04-16T18:40:15.772 DEBUG:boto:Token: None 2024-04-16T18:40:15.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ= 2024-04-16T18:40:15.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ=', 'Content-Length': '0'} 2024-04-16T18:40:15.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e2f959c935098a0d-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.774 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.774 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.775 DEBUG:boto:path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.775 DEBUG:boto:auth_path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.775 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.775 DEBUG:boto:Path: /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.775 DEBUG:boto:Data: 2024-04-16T18:40:15.775 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.775 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.775 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.775 DEBUG:boto:Params: {} 2024-04-16T18:40:15.775 DEBUG:boto:Token: None 2024-04-16T18:40:15.775 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1eB4Ja0FSKECbyHT5x3I1JR6RtM= 2024-04-16T18:40:15.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1eB4Ja0FSKECbyHT5x3I1JR6RtM=', 'Content-Length': '0'} 2024-04-16T18:40:15.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bbab13c54a949547-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.778 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.778 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.778 DEBUG:boto:path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.778 DEBUG:boto:auth_path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.778 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.779 DEBUG:boto:Path: /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.779 DEBUG:boto:Data: 2024-04-16T18:40:15.779 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.779 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.779 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.779 DEBUG:boto:Params: {} 2024-04-16T18:40:15.779 DEBUG:boto:Token: None 2024-04-16T18:40:15.779 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.779 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1eB4Ja0FSKECbyHT5x3I1JR6RtM= 2024-04-16T18:40:15.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1eB4Ja0FSKECbyHT5x3I1JR6RtM=', 'Content-Length': '0'} 2024-04-16T18:40:15.781 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b4609fad95c09d5-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.782 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:40:15.782 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.782 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.782 DEBUG:boto:path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.782 DEBUG:boto:auth_path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.782 DEBUG:boto:Method: GET 2024-04-16T18:40:15.782 DEBUG:boto:Path: /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.782 DEBUG:boto:Data: 2024-04-16T18:40:15.782 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.782 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.783 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.783 DEBUG:boto:Params: {} 2024-04-16T18:40:15.783 DEBUG:boto:Token: None 2024-04-16T18:40:15.783 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.783 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ= 2024-04-16T18:40:15.783 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ=', 'Content-Length': '0'} 2024-04-16T18:40:15.785 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c840690bd8629db7-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.826 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.827 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.827 DEBUG:boto:path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.827 DEBUG:boto:auth_path=/cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.827 DEBUG:boto:Method: GET 2024-04-16T18:40:15.827 DEBUG:boto:Path: /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.827 DEBUG:boto:Data: 2024-04-16T18:40:15.827 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.827 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.827 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.827 DEBUG:boto:Params: {} 2024-04-16T18:40:15.828 DEBUG:boto:Token: None 2024-04-16T18:40:15.828 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57?versionId=null 2024-04-16T18:40:15.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ= 2024-04-16T18:40:15.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8xSZS1JjvEJxjJ3TQVEfiAVRiZQ=', 'Content-Length': '0'} 2024-04-16T18:40:15.830 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1baad82a6c356d6-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.830 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.830 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.831 DEBUG:boto:path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.831 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.831 DEBUG:boto:Method: GET 2024-04-16T18:40:15.831 DEBUG:boto:Path: /cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.831 DEBUG:boto:Data: 2024-04-16T18:40:15.831 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.831 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.831 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.831 DEBUG:boto:Params: {} 2024-04-16T18:40:15.832 DEBUG:boto:Token: None 2024-04-16T18:40:15.832 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.834 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6486f2f81d8de84-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.878 DEBUG:boto:b'cjqttm-54obj571000falseobj572024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.879 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.879 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.879 DEBUG:boto:path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.879 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.879 DEBUG:boto:Method: GET 2024-04-16T18:40:15.879 DEBUG:boto:Path: /cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.880 DEBUG:boto:Data: 2024-04-16T18:40:15.880 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.880 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.880 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.880 DEBUG:boto:Params: {} 2024-04-16T18:40:15.880 DEBUG:boto:Token: None 2024-04-16T18:40:15.880 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.884 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008414e73a605fd7c9-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.884 DEBUG:boto:b'cjqttm-54obj571000falseobj572024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.884 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.884 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.885 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.885 DEBUG:boto:Path: /cjqttm-54/obj57 2024-04-16T18:40:15.885 DEBUG:boto:Data: 2024-04-16T18:40:15.885 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.885 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.885 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.885 DEBUG:boto:Params: {} 2024-04-16T18:40:15.885 DEBUG:boto:Token: None 2024-04-16T18:40:15.885 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57 2024-04-16T18:40:15.886 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7xDxjhgc4s9jDR7C3FdCEEzIRk4= 2024-04-16T18:40:15.886 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7xDxjhgc4s9jDR7C3FdCEEzIRk4=', 'Content-Length': '0'} 2024-04-16T18:40:15.887 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3fe77747eb28f1d-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.888 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.888 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.888 DEBUG:boto:Method: HEAD 2024-04-16T18:40:15.888 DEBUG:boto:Path: /cjqttm-54/obj57 2024-04-16T18:40:15.888 DEBUG:boto:Data: 2024-04-16T18:40:15.888 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.888 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.888 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.889 DEBUG:boto:Params: {} 2024-04-16T18:40:15.889 DEBUG:boto:Token: None 2024-04-16T18:40:15.889 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57 2024-04-16T18:40:15.889 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7xDxjhgc4s9jDR7C3FdCEEzIRk4= 2024-04-16T18:40:15.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7xDxjhgc4s9jDR7C3FdCEEzIRk4=', 'Content-Length': '0'} 2024-04-16T18:40:15.891 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000808616e044798c1f-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.891 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:40:15.892 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.892 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.892 DEBUG:boto:Method: GET 2024-04-16T18:40:15.892 DEBUG:boto:Path: /cjqttm-54/obj57 2024-04-16T18:40:15.892 DEBUG:boto:Data: 2024-04-16T18:40:15.892 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.892 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.892 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.892 DEBUG:boto:Params: {} 2024-04-16T18:40:15.893 DEBUG:boto:Token: None 2024-04-16T18:40:15.893 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57 2024-04-16T18:40:15.893 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qKOBnYrUilbaEtJjiydp1Jmqul8= 2024-04-16T18:40:15.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qKOBnYrUilbaEtJjiydp1Jmqul8=', 'Content-Length': '0'} 2024-04-16T18:40:15.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004066a79ba5724e1a-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.938 DEBUG:boto:path=/cjqttm-54/obj57 2024-04-16T18:40:15.939 DEBUG:boto:auth_path=/cjqttm-54/obj57 2024-04-16T18:40:15.939 DEBUG:boto:Method: GET 2024-04-16T18:40:15.939 DEBUG:boto:Path: /cjqttm-54/obj57 2024-04-16T18:40:15.939 DEBUG:boto:Data: 2024-04-16T18:40:15.939 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.939 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.939 DEBUG:boto:Params: {} 2024-04-16T18:40:15.940 DEBUG:boto:Token: None 2024-04-16T18:40:15.940 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj57 2024-04-16T18:40:15.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qKOBnYrUilbaEtJjiydp1Jmqul8= 2024-04-16T18:40:15.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qKOBnYrUilbaEtJjiydp1Jmqul8=', 'Content-Length': '0'} 2024-04-16T18:40:15.942 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000088c629a170980505-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.943 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.943 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.943 DEBUG:boto:path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.943 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.943 DEBUG:boto:Method: GET 2024-04-16T18:40:15.943 DEBUG:boto:Path: /cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.943 DEBUG:boto:Data: 2024-04-16T18:40:15.943 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.943 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.943 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.944 DEBUG:boto:Params: {} 2024-04-16T18:40:15.944 DEBUG:boto:Token: None 2024-04-16T18:40:15.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.946 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f18e281a91a0f111-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.986 DEBUG:boto:b'cjqttm-54obj571000falseobj572024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.987 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:15.987 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:15.987 DEBUG:boto:path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.987 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.987 DEBUG:boto:Method: GET 2024-04-16T18:40:15.987 DEBUG:boto:Path: /cjqttm-54/?prefix=obj57 2024-04-16T18:40:15.987 DEBUG:boto:Data: 2024-04-16T18:40:15.987 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.988 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:15.988 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.988 DEBUG:boto:Params: {} 2024-04-16T18:40:15.988 DEBUG:boto:Token: None 2024-04-16T18:40:15.988 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/ 2024-04-16T18:40:15.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4= 2024-04-16T18:40:15.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QAbJzfSJETzXu+snZUMQpARAeS4=', 'Content-Length': '0'} 2024-04-16T18:40:15.992 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ca83074f16a0ea0c-00661ec60f-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:15.992 DEBUG:boto:b'cjqttm-54obj571000falseobj572024-04-16T18:33:08.671Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:15.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:40:15.993 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:15.993 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:15.993 DEBUG:boto:path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:15.993 DEBUG:boto:auth_path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:15.993 DEBUG:boto:Method: GET 2024-04-16T18:40:15.993 DEBUG:boto:Path: /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:15.993 DEBUG:boto:Data: 2024-04-16T18:40:15.993 DEBUG:boto:Headers: {} 2024-04-16T18:40:15.993 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:15.993 DEBUG:boto:Port: 8000 2024-04-16T18:40:15.993 DEBUG:boto:Params: {} 2024-04-16T18:40:15.994 DEBUG:boto:Token: None 2024-04-16T18:40:15.994 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:15 GMT /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:15.994 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RQPrznlFm6b6SIpTwDP11TlGJqw= 2024-04-16T18:40:15.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:15 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RQPrznlFm6b6SIpTwDP11TlGJqw=', 'Content-Length': '0'} 2024-04-16T18:40:15.996 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046dcca1ff7421c88-00661ec60f-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:15 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.038 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.038 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.039 DEBUG:boto:path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.039 DEBUG:boto:auth_path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.039 DEBUG:boto:Method: GET 2024-04-16T18:40:16.039 DEBUG:boto:Path: /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.039 DEBUG:boto:Data: 2024-04-16T18:40:16.039 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.039 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.039 DEBUG:boto:Params: {} 2024-04-16T18:40:16.039 DEBUG:boto:Token: None 2024-04-16T18:40:16.040 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gbXGtdIfnUaTjzcZjg91pYTHyoA= 2024-04-16T18:40:16.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gbXGtdIfnUaTjzcZjg91pYTHyoA=', 'Content-Length': '0'} 2024-04-16T18:40:16.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf2250eecf588354-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.042 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.042 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.042 DEBUG:boto:path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.042 DEBUG:boto:auth_path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.042 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.042 DEBUG:boto:Path: /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.043 DEBUG:boto:Data: 2024-04-16T18:40:16.043 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.043 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.043 DEBUG:boto:Params: {} 2024-04-16T18:40:16.043 DEBUG:boto:Token: None 2024-04-16T18:40:16.043 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bYgP7aOWBbG0ZRG8GXJa5lWQuZU= 2024-04-16T18:40:16.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bYgP7aOWBbG0ZRG8GXJa5lWQuZU=', 'Content-Length': '0'} 2024-04-16T18:40:16.045 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000079fd4f5562d37496-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.045 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.045 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.045 DEBUG:boto:path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.046 DEBUG:boto:auth_path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.046 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.046 DEBUG:boto:Path: /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.046 DEBUG:boto:Data: 2024-04-16T18:40:16.046 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.046 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.046 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.046 DEBUG:boto:Params: {} 2024-04-16T18:40:16.046 DEBUG:boto:Token: None 2024-04-16T18:40:16.046 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bYgP7aOWBbG0ZRG8GXJa5lWQuZU= 2024-04-16T18:40:16.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bYgP7aOWBbG0ZRG8GXJa5lWQuZU=', 'Content-Length': '0'} 2024-04-16T18:40:16.048 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c174c1a8aaded9f-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.049 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:40:16.049 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.049 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.049 DEBUG:boto:path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.049 DEBUG:boto:auth_path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.049 DEBUG:boto:Method: GET 2024-04-16T18:40:16.049 DEBUG:boto:Path: /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.049 DEBUG:boto:Data: 2024-04-16T18:40:16.050 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.050 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.050 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.050 DEBUG:boto:Params: {} 2024-04-16T18:40:16.050 DEBUG:boto:Token: None 2024-04-16T18:40:16.050 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.050 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gbXGtdIfnUaTjzcZjg91pYTHyoA= 2024-04-16T18:40:16.050 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gbXGtdIfnUaTjzcZjg91pYTHyoA=', 'Content-Length': '0'} 2024-04-16T18:40:16.052 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a60cd8d392ad9f26-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.094 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.095 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.095 DEBUG:boto:path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.095 DEBUG:boto:auth_path=/cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.095 DEBUG:boto:Method: GET 2024-04-16T18:40:16.095 DEBUG:boto:Path: /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.095 DEBUG:boto:Data: 2024-04-16T18:40:16.095 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.095 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.095 DEBUG:boto:Params: {} 2024-04-16T18:40:16.095 DEBUG:boto:Token: None 2024-04-16T18:40:16.096 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58?versionId=null 2024-04-16T18:40:16.096 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gbXGtdIfnUaTjzcZjg91pYTHyoA= 2024-04-16T18:40:16.096 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gbXGtdIfnUaTjzcZjg91pYTHyoA=', 'Content-Length': '0'} 2024-04-16T18:40:16.098 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001418df76898a9204-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.098 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.098 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.098 DEBUG:boto:path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.098 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.099 DEBUG:boto:Method: GET 2024-04-16T18:40:16.099 DEBUG:boto:Path: /cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.099 DEBUG:boto:Data: 2024-04-16T18:40:16.099 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.099 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.099 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.099 DEBUG:boto:Params: {} 2024-04-16T18:40:16.099 DEBUG:boto:Token: None 2024-04-16T18:40:16.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.102 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000da1e78d624a821ba-00661ec610-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.142 DEBUG:boto:b'cjqttm-54obj581000falseobj582024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.143 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.143 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.143 DEBUG:boto:path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.143 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.143 DEBUG:boto:Method: GET 2024-04-16T18:40:16.143 DEBUG:boto:Path: /cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.143 DEBUG:boto:Data: 2024-04-16T18:40:16.143 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.143 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.143 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.144 DEBUG:boto:Params: {} 2024-04-16T18:40:16.144 DEBUG:boto:Token: None 2024-04-16T18:40:16.144 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.144 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.147 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c26203c8586a249-00661ec610-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.147 DEBUG:boto:b'cjqttm-54obj581000falseobj582024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.148 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.148 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.148 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.148 DEBUG:boto:Path: /cjqttm-54/obj58 2024-04-16T18:40:16.148 DEBUG:boto:Data: 2024-04-16T18:40:16.148 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.148 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.148 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.148 DEBUG:boto:Params: {} 2024-04-16T18:40:16.148 DEBUG:boto:Token: None 2024-04-16T18:40:16.149 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58 2024-04-16T18:40:16.149 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l+GXv3HclQ3Kr873SK1qo8lkffw= 2024-04-16T18:40:16.149 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l+GXv3HclQ3Kr873SK1qo8lkffw=', 'Content-Length': '0'} 2024-04-16T18:40:16.151 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008822419fe17e2f6e-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.151 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.151 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.151 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.151 DEBUG:boto:Path: /cjqttm-54/obj58 2024-04-16T18:40:16.151 DEBUG:boto:Data: 2024-04-16T18:40:16.151 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.151 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.152 DEBUG:boto:Params: {} 2024-04-16T18:40:16.152 DEBUG:boto:Token: None 2024-04-16T18:40:16.152 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58 2024-04-16T18:40:16.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l+GXv3HclQ3Kr873SK1qo8lkffw= 2024-04-16T18:40:16.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l+GXv3HclQ3Kr873SK1qo8lkffw=', 'Content-Length': '0'} 2024-04-16T18:40:16.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bfd816ac0813a556-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:40:16.154 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.154 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.154 DEBUG:boto:Method: GET 2024-04-16T18:40:16.155 DEBUG:boto:Path: /cjqttm-54/obj58 2024-04-16T18:40:16.155 DEBUG:boto:Data: 2024-04-16T18:40:16.155 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.155 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.155 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.155 DEBUG:boto:Params: {} 2024-04-16T18:40:16.155 DEBUG:boto:Token: None 2024-04-16T18:40:16.155 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58 2024-04-16T18:40:16.155 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9sGyjbash3zECuPizupKHj7HvNg= 2024-04-16T18:40:16.155 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9sGyjbash3zECuPizupKHj7HvNg=', 'Content-Length': '0'} 2024-04-16T18:40:16.157 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046ca794e929b8b66-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.198 DEBUG:boto:path=/cjqttm-54/obj58 2024-04-16T18:40:16.198 DEBUG:boto:auth_path=/cjqttm-54/obj58 2024-04-16T18:40:16.198 DEBUG:boto:Method: GET 2024-04-16T18:40:16.199 DEBUG:boto:Path: /cjqttm-54/obj58 2024-04-16T18:40:16.199 DEBUG:boto:Data: 2024-04-16T18:40:16.199 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.199 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.199 DEBUG:boto:Params: {} 2024-04-16T18:40:16.199 DEBUG:boto:Token: None 2024-04-16T18:40:16.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj58 2024-04-16T18:40:16.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9sGyjbash3zECuPizupKHj7HvNg= 2024-04-16T18:40:16.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9sGyjbash3zECuPizupKHj7HvNg=', 'Content-Length': '0'} 2024-04-16T18:40:16.201 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b92ba457dbb95490-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.202 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.202 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.202 DEBUG:boto:path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.202 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.202 DEBUG:boto:Method: GET 2024-04-16T18:40:16.202 DEBUG:boto:Path: /cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.202 DEBUG:boto:Data: 2024-04-16T18:40:16.203 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.203 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.203 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.203 DEBUG:boto:Params: {} 2024-04-16T18:40:16.203 DEBUG:boto:Token: None 2024-04-16T18:40:16.203 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.205 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d50da82b931471f-00661ec610-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.246 DEBUG:boto:b'cjqttm-54obj581000falseobj582024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.247 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.247 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.247 DEBUG:boto:path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.247 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.247 DEBUG:boto:Method: GET 2024-04-16T18:40:16.247 DEBUG:boto:Path: /cjqttm-54/?prefix=obj58 2024-04-16T18:40:16.247 DEBUG:boto:Data: 2024-04-16T18:40:16.247 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.247 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.247 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.247 DEBUG:boto:Params: {} 2024-04-16T18:40:16.248 DEBUG:boto:Token: None 2024-04-16T18:40:16.248 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.248 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.251 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000036a6507fe745805a-00661ec610-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.252 DEBUG:boto:b'cjqttm-54obj581000falseobj582024-04-16T18:33:09.255Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:40:16.252 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.252 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.252 DEBUG:boto:path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.252 DEBUG:boto:auth_path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.252 DEBUG:boto:Method: GET 2024-04-16T18:40:16.253 DEBUG:boto:Path: /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.253 DEBUG:boto:Data: 2024-04-16T18:40:16.253 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.253 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.253 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.253 DEBUG:boto:Params: {} 2024-04-16T18:40:16.253 DEBUG:boto:Token: None 2024-04-16T18:40:16.253 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.253 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU= 2024-04-16T18:40:16.253 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU=', 'Content-Length': '0'} 2024-04-16T18:40:16.255 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000defebc9750277f84-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.298 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.298 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.299 DEBUG:boto:path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.299 DEBUG:boto:auth_path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.299 DEBUG:boto:Method: GET 2024-04-16T18:40:16.299 DEBUG:boto:Path: /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.299 DEBUG:boto:Data: 2024-04-16T18:40:16.299 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.299 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.299 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.299 DEBUG:boto:Params: {} 2024-04-16T18:40:16.299 DEBUG:boto:Token: None 2024-04-16T18:40:16.299 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU= 2024-04-16T18:40:16.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU=', 'Content-Length': '0'} 2024-04-16T18:40:16.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ecc6dfe7b613f46c-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.302 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.302 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.302 DEBUG:boto:path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.302 DEBUG:boto:auth_path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.303 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.303 DEBUG:boto:Path: /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.303 DEBUG:boto:Data: 2024-04-16T18:40:16.303 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.303 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.303 DEBUG:boto:Params: {} 2024-04-16T18:40:16.303 DEBUG:boto:Token: None 2024-04-16T18:40:16.303 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bpvCf0xO80rWLnIaU+RIST9J2iI= 2024-04-16T18:40:16.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bpvCf0xO80rWLnIaU+RIST9J2iI=', 'Content-Length': '0'} 2024-04-16T18:40:16.305 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fcf0d1025899a8c-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.306 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.306 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.306 DEBUG:boto:path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.306 DEBUG:boto:auth_path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.306 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.306 DEBUG:boto:Path: /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.306 DEBUG:boto:Data: 2024-04-16T18:40:16.306 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.306 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.306 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.307 DEBUG:boto:Params: {} 2024-04-16T18:40:16.307 DEBUG:boto:Token: None 2024-04-16T18:40:16.307 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.307 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bpvCf0xO80rWLnIaU+RIST9J2iI= 2024-04-16T18:40:16.307 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bpvCf0xO80rWLnIaU+RIST9J2iI=', 'Content-Length': '0'} 2024-04-16T18:40:16.309 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0ddd90ea635ec4c-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.309 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:40:16.309 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.309 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.309 DEBUG:boto:path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.309 DEBUG:boto:auth_path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.309 DEBUG:boto:Method: GET 2024-04-16T18:40:16.310 DEBUG:boto:Path: /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.310 DEBUG:boto:Data: 2024-04-16T18:40:16.310 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.310 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.310 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.310 DEBUG:boto:Params: {} 2024-04-16T18:40:16.310 DEBUG:boto:Token: None 2024-04-16T18:40:16.310 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.310 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU= 2024-04-16T18:40:16.311 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU=', 'Content-Length': '0'} 2024-04-16T18:40:16.313 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004c4b0b1bf461def2-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.354 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.354 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.355 DEBUG:boto:path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.355 DEBUG:boto:auth_path=/cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.355 DEBUG:boto:Method: GET 2024-04-16T18:40:16.355 DEBUG:boto:Path: /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.355 DEBUG:boto:Data: 2024-04-16T18:40:16.355 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.355 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.355 DEBUG:boto:Params: {} 2024-04-16T18:40:16.355 DEBUG:boto:Token: None 2024-04-16T18:40:16.355 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62?versionId=null 2024-04-16T18:40:16.356 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU= 2024-04-16T18:40:16.356 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G6/rxAkqHrSt0RHKPwS1eBSYHwU=', 'Content-Length': '0'} 2024-04-16T18:40:16.358 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0252c941091f45c-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.359 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.359 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.359 DEBUG:boto:path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.359 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.359 DEBUG:boto:Method: GET 2024-04-16T18:40:16.359 DEBUG:boto:Path: /cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.359 DEBUG:boto:Data: 2024-04-16T18:40:16.359 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.359 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.359 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.359 DEBUG:boto:Params: {} 2024-04-16T18:40:16.360 DEBUG:boto:Token: None 2024-04-16T18:40:16.360 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.362 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004c75e831efe8097a-00661ec610-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.406 DEBUG:boto:b'cjqttm-54obj621000falseobj622024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.407 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.407 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.407 DEBUG:boto:path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.407 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.407 DEBUG:boto:Method: GET 2024-04-16T18:40:16.407 DEBUG:boto:Path: /cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.407 DEBUG:boto:Data: 2024-04-16T18:40:16.407 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.407 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.408 DEBUG:boto:Params: {} 2024-04-16T18:40:16.408 DEBUG:boto:Token: None 2024-04-16T18:40:16.408 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.411 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e3dfc3f0dff670e4-00661ec610-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.412 DEBUG:boto:b'cjqttm-54obj621000falseobj622024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.412 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.412 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.412 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.412 DEBUG:boto:Path: /cjqttm-54/obj62 2024-04-16T18:40:16.412 DEBUG:boto:Data: 2024-04-16T18:40:16.413 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.413 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.413 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.413 DEBUG:boto:Params: {} 2024-04-16T18:40:16.413 DEBUG:boto:Token: None 2024-04-16T18:40:16.413 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62 2024-04-16T18:40:16.413 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FVVfy8NNseeX1Oyd2fioofKjM9Q= 2024-04-16T18:40:16.413 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FVVfy8NNseeX1Oyd2fioofKjM9Q=', 'Content-Length': '0'} 2024-04-16T18:40:16.416 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000931060e4e4539396-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.416 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.416 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.416 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.416 DEBUG:boto:Path: /cjqttm-54/obj62 2024-04-16T18:40:16.417 DEBUG:boto:Data: 2024-04-16T18:40:16.417 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.417 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.417 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.417 DEBUG:boto:Params: {} 2024-04-16T18:40:16.417 DEBUG:boto:Token: None 2024-04-16T18:40:16.417 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62 2024-04-16T18:40:16.417 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FVVfy8NNseeX1Oyd2fioofKjM9Q= 2024-04-16T18:40:16.417 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FVVfy8NNseeX1Oyd2fioofKjM9Q=', 'Content-Length': '0'} 2024-04-16T18:40:16.420 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb831858a95e16ca-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.420 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:40:16.420 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.420 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.420 DEBUG:boto:Method: GET 2024-04-16T18:40:16.420 DEBUG:boto:Path: /cjqttm-54/obj62 2024-04-16T18:40:16.420 DEBUG:boto:Data: 2024-04-16T18:40:16.420 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.421 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.421 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.421 DEBUG:boto:Params: {} 2024-04-16T18:40:16.421 DEBUG:boto:Token: None 2024-04-16T18:40:16.421 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62 2024-04-16T18:40:16.421 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sh6jJl6bVVMWkue2Pqphv77VgpU= 2024-04-16T18:40:16.421 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sh6jJl6bVVMWkue2Pqphv77VgpU=', 'Content-Length': '0'} 2024-04-16T18:40:16.423 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000084eee6a3ad16a9a8-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.466 DEBUG:boto:path=/cjqttm-54/obj62 2024-04-16T18:40:16.466 DEBUG:boto:auth_path=/cjqttm-54/obj62 2024-04-16T18:40:16.467 DEBUG:boto:Method: GET 2024-04-16T18:40:16.467 DEBUG:boto:Path: /cjqttm-54/obj62 2024-04-16T18:40:16.467 DEBUG:boto:Data: 2024-04-16T18:40:16.467 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.467 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.467 DEBUG:boto:Params: {} 2024-04-16T18:40:16.467 DEBUG:boto:Token: None 2024-04-16T18:40:16.467 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj62 2024-04-16T18:40:16.467 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sh6jJl6bVVMWkue2Pqphv77VgpU= 2024-04-16T18:40:16.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sh6jJl6bVVMWkue2Pqphv77VgpU=', 'Content-Length': '0'} 2024-04-16T18:40:16.469 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fb26c881f1d44f54-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.470 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.470 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.470 DEBUG:boto:path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.470 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.470 DEBUG:boto:Method: GET 2024-04-16T18:40:16.470 DEBUG:boto:Path: /cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.471 DEBUG:boto:Data: 2024-04-16T18:40:16.471 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.471 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.471 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.471 DEBUG:boto:Params: {} 2024-04-16T18:40:16.471 DEBUG:boto:Token: None 2024-04-16T18:40:16.471 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.471 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.471 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.473 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000007ccefd59ff7dddd-00661ec610-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.514 DEBUG:boto:b'cjqttm-54obj621000falseobj622024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.515 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.515 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.515 DEBUG:boto:path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.515 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.515 DEBUG:boto:Method: GET 2024-04-16T18:40:16.515 DEBUG:boto:Path: /cjqttm-54/?prefix=obj62 2024-04-16T18:40:16.515 DEBUG:boto:Data: 2024-04-16T18:40:16.515 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.515 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.515 DEBUG:boto:Params: {} 2024-04-16T18:40:16.516 DEBUG:boto:Token: None 2024-04-16T18:40:16.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.520 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b4b9ea9360ca0fb4-00661ec610-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.520 DEBUG:boto:b'cjqttm-54obj621000falseobj622024-04-16T18:33:09.591Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.521 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:40:16.521 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.521 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.521 DEBUG:boto:path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.521 DEBUG:boto:auth_path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.521 DEBUG:boto:Method: GET 2024-04-16T18:40:16.521 DEBUG:boto:Path: /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.521 DEBUG:boto:Data: 2024-04-16T18:40:16.521 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.522 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.522 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.522 DEBUG:boto:Params: {} 2024-04-16T18:40:16.522 DEBUG:boto:Token: None 2024-04-16T18:40:16.522 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.522 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c= 2024-04-16T18:40:16.522 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c=', 'Content-Length': '0'} 2024-04-16T18:40:16.524 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004e079b5572b0fdd9-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.571 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.571 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.571 DEBUG:boto:path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.571 DEBUG:boto:auth_path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.571 DEBUG:boto:Method: GET 2024-04-16T18:40:16.571 DEBUG:boto:Path: /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.571 DEBUG:boto:Data: 2024-04-16T18:40:16.571 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.571 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.571 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.571 DEBUG:boto:Params: {} 2024-04-16T18:40:16.572 DEBUG:boto:Token: None 2024-04-16T18:40:16.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c= 2024-04-16T18:40:16.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c=', 'Content-Length': '0'} 2024-04-16T18:40:16.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a3670c5e7720a39d-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.574 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.574 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.574 DEBUG:boto:path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.575 DEBUG:boto:auth_path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.575 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.575 DEBUG:boto:Path: /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.575 DEBUG:boto:Data: 2024-04-16T18:40:16.575 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.575 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.575 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.575 DEBUG:boto:Params: {} 2024-04-16T18:40:16.575 DEBUG:boto:Token: None 2024-04-16T18:40:16.575 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MrNVzjHxwQnVq6Pb6dn7vVLbwA8= 2024-04-16T18:40:16.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MrNVzjHxwQnVq6Pb6dn7vVLbwA8=', 'Content-Length': '0'} 2024-04-16T18:40:16.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc21f47f41f1c01d-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.578 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.578 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.578 DEBUG:boto:path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.578 DEBUG:boto:auth_path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.578 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.578 DEBUG:boto:Path: /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.578 DEBUG:boto:Data: 2024-04-16T18:40:16.578 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.579 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.579 DEBUG:boto:Params: {} 2024-04-16T18:40:16.579 DEBUG:boto:Token: None 2024-04-16T18:40:16.579 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:MrNVzjHxwQnVq6Pb6dn7vVLbwA8= 2024-04-16T18:40:16.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MrNVzjHxwQnVq6Pb6dn7vVLbwA8=', 'Content-Length': '0'} 2024-04-16T18:40:16.582 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eed244a521ec0dcc-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.582 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:40:16.582 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.582 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.582 DEBUG:boto:path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.582 DEBUG:boto:auth_path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.582 DEBUG:boto:Method: GET 2024-04-16T18:40:16.582 DEBUG:boto:Path: /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.583 DEBUG:boto:Data: 2024-04-16T18:40:16.583 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.583 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.583 DEBUG:boto:Params: {} 2024-04-16T18:40:16.583 DEBUG:boto:Token: None 2024-04-16T18:40:16.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c= 2024-04-16T18:40:16.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c=', 'Content-Length': '0'} 2024-04-16T18:40:16.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049fbd10dbec5a8e2-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.626 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.626 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.627 DEBUG:boto:path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.627 DEBUG:boto:auth_path=/cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.627 DEBUG:boto:Method: GET 2024-04-16T18:40:16.627 DEBUG:boto:Path: /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.627 DEBUG:boto:Data: 2024-04-16T18:40:16.627 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.627 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.627 DEBUG:boto:Params: {} 2024-04-16T18:40:16.627 DEBUG:boto:Token: None 2024-04-16T18:40:16.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68?versionId=null 2024-04-16T18:40:16.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c= 2024-04-16T18:40:16.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gzgENPGnkdjAFu4gtuI0Espti4c=', 'Content-Length': '0'} 2024-04-16T18:40:16.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074a76373e048db6e-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.630 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.630 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.630 DEBUG:boto:path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.631 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.631 DEBUG:boto:Method: GET 2024-04-16T18:40:16.631 DEBUG:boto:Path: /cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.631 DEBUG:boto:Data: 2024-04-16T18:40:16.631 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.631 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.631 DEBUG:boto:Params: {} 2024-04-16T18:40:16.631 DEBUG:boto:Token: None 2024-04-16T18:40:16.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.634 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c75d4ffc61059e8-00661ec610-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.674 DEBUG:boto:b'cjqttm-54obj681000falseobj682024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.675 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.675 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.675 DEBUG:boto:path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.675 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.675 DEBUG:boto:Method: GET 2024-04-16T18:40:16.675 DEBUG:boto:Path: /cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.675 DEBUG:boto:Data: 2024-04-16T18:40:16.675 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.675 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.675 DEBUG:boto:Params: {} 2024-04-16T18:40:16.676 DEBUG:boto:Token: None 2024-04-16T18:40:16.676 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.679 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b6f797c596420de-00661ec610-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.680 DEBUG:boto:b'cjqttm-54obj681000falseobj682024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.680 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.680 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.680 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.680 DEBUG:boto:Path: /cjqttm-54/obj68 2024-04-16T18:40:16.680 DEBUG:boto:Data: 2024-04-16T18:40:16.680 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.681 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.681 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.681 DEBUG:boto:Params: {} 2024-04-16T18:40:16.681 DEBUG:boto:Token: None 2024-04-16T18:40:16.681 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68 2024-04-16T18:40:16.681 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NRIVtlorwYkWpMtq64o2tpBdY5M= 2024-04-16T18:40:16.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NRIVtlorwYkWpMtq64o2tpBdY5M=', 'Content-Length': '0'} 2024-04-16T18:40:16.683 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065a6f7a652ff387e-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.683 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.684 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.684 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.684 DEBUG:boto:Path: /cjqttm-54/obj68 2024-04-16T18:40:16.684 DEBUG:boto:Data: 2024-04-16T18:40:16.684 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.684 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.684 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.684 DEBUG:boto:Params: {} 2024-04-16T18:40:16.684 DEBUG:boto:Token: None 2024-04-16T18:40:16.684 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68 2024-04-16T18:40:16.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NRIVtlorwYkWpMtq64o2tpBdY5M= 2024-04-16T18:40:16.685 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NRIVtlorwYkWpMtq64o2tpBdY5M=', 'Content-Length': '0'} 2024-04-16T18:40:16.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001d4bf8d8584d17c8-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.689 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:40:16.689 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.690 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.690 DEBUG:boto:Method: GET 2024-04-16T18:40:16.690 DEBUG:boto:Path: /cjqttm-54/obj68 2024-04-16T18:40:16.690 DEBUG:boto:Data: 2024-04-16T18:40:16.690 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.690 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.690 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.690 DEBUG:boto:Params: {} 2024-04-16T18:40:16.690 DEBUG:boto:Token: None 2024-04-16T18:40:16.691 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68 2024-04-16T18:40:16.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bw51j1VcHGTIt3ovnQKUmvLyZt8= 2024-04-16T18:40:16.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bw51j1VcHGTIt3ovnQKUmvLyZt8=', 'Content-Length': '0'} 2024-04-16T18:40:16.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000756f889e0528185f-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.734 DEBUG:boto:path=/cjqttm-54/obj68 2024-04-16T18:40:16.734 DEBUG:boto:auth_path=/cjqttm-54/obj68 2024-04-16T18:40:16.734 DEBUG:boto:Method: GET 2024-04-16T18:40:16.735 DEBUG:boto:Path: /cjqttm-54/obj68 2024-04-16T18:40:16.735 DEBUG:boto:Data: 2024-04-16T18:40:16.735 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.735 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.735 DEBUG:boto:Params: {} 2024-04-16T18:40:16.735 DEBUG:boto:Token: None 2024-04-16T18:40:16.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj68 2024-04-16T18:40:16.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bw51j1VcHGTIt3ovnQKUmvLyZt8= 2024-04-16T18:40:16.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bw51j1VcHGTIt3ovnQKUmvLyZt8=', 'Content-Length': '0'} 2024-04-16T18:40:16.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d37c2151a709157-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.738 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.738 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.738 DEBUG:boto:path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.738 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.738 DEBUG:boto:Method: GET 2024-04-16T18:40:16.738 DEBUG:boto:Path: /cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.738 DEBUG:boto:Data: 2024-04-16T18:40:16.738 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.739 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.739 DEBUG:boto:Params: {} 2024-04-16T18:40:16.739 DEBUG:boto:Token: None 2024-04-16T18:40:16.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.741 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094350c047c7e2a5d-00661ec610-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.782 DEBUG:boto:b'cjqttm-54obj681000falseobj682024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.783 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.783 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.783 DEBUG:boto:path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.783 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.783 DEBUG:boto:Method: GET 2024-04-16T18:40:16.783 DEBUG:boto:Path: /cjqttm-54/?prefix=obj68 2024-04-16T18:40:16.783 DEBUG:boto:Data: 2024-04-16T18:40:16.783 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.783 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.784 DEBUG:boto:Params: {} 2024-04-16T18:40:16.784 DEBUG:boto:Token: None 2024-04-16T18:40:16.784 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.787 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c4a95392feb9bbb4-00661ec610-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.788 DEBUG:boto:b'cjqttm-54obj681000falseobj682024-04-16T18:33:08.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.788 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:40:16.788 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.788 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.788 DEBUG:boto:path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.788 DEBUG:boto:auth_path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.788 DEBUG:boto:Method: GET 2024-04-16T18:40:16.789 DEBUG:boto:Path: /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.789 DEBUG:boto:Data: 2024-04-16T18:40:16.789 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.789 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.789 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.789 DEBUG:boto:Params: {} 2024-04-16T18:40:16.789 DEBUG:boto:Token: None 2024-04-16T18:40:16.789 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.789 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk= 2024-04-16T18:40:16.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk=', 'Content-Length': '0'} 2024-04-16T18:40:16.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000056681a563f933fbb-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.834 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.834 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.834 DEBUG:boto:path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.835 DEBUG:boto:auth_path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.835 DEBUG:boto:Method: GET 2024-04-16T18:40:16.835 DEBUG:boto:Path: /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.835 DEBUG:boto:Data: 2024-04-16T18:40:16.835 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.835 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.835 DEBUG:boto:Params: {} 2024-04-16T18:40:16.835 DEBUG:boto:Token: None 2024-04-16T18:40:16.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk= 2024-04-16T18:40:16.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk=', 'Content-Length': '0'} 2024-04-16T18:40:16.838 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7643572ca551c23-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.838 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.838 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.838 DEBUG:boto:path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.838 DEBUG:boto:auth_path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.838 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.839 DEBUG:boto:Path: /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.839 DEBUG:boto:Data: 2024-04-16T18:40:16.839 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.839 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.839 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.839 DEBUG:boto:Params: {} 2024-04-16T18:40:16.839 DEBUG:boto:Token: None 2024-04-16T18:40:16.839 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.839 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JTrv7En0BwJd7LXGMpPfD9rwn24= 2024-04-16T18:40:16.840 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JTrv7En0BwJd7LXGMpPfD9rwn24=', 'Content-Length': '0'} 2024-04-16T18:40:16.841 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c8e0774aee0ced3-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.841 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.842 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.842 DEBUG:boto:path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.842 DEBUG:boto:auth_path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.842 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.842 DEBUG:boto:Path: /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.842 DEBUG:boto:Data: 2024-04-16T18:40:16.842 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.842 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.842 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.842 DEBUG:boto:Params: {} 2024-04-16T18:40:16.843 DEBUG:boto:Token: None 2024-04-16T18:40:16.843 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JTrv7En0BwJd7LXGMpPfD9rwn24= 2024-04-16T18:40:16.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JTrv7En0BwJd7LXGMpPfD9rwn24=', 'Content-Length': '0'} 2024-04-16T18:40:16.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ccb9205d69169602-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.845 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:40:16.845 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.845 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.846 DEBUG:boto:path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.846 DEBUG:boto:auth_path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.846 DEBUG:boto:Method: GET 2024-04-16T18:40:16.846 DEBUG:boto:Path: /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.846 DEBUG:boto:Data: 2024-04-16T18:40:16.846 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.846 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.846 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.846 DEBUG:boto:Params: {} 2024-04-16T18:40:16.846 DEBUG:boto:Token: None 2024-04-16T18:40:16.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk= 2024-04-16T18:40:16.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk=', 'Content-Length': '0'} 2024-04-16T18:40:16.849 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007388063d0084c361-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.890 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.890 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.890 DEBUG:boto:path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.891 DEBUG:boto:auth_path=/cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.891 DEBUG:boto:Method: GET 2024-04-16T18:40:16.891 DEBUG:boto:Path: /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.891 DEBUG:boto:Data: 2024-04-16T18:40:16.891 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.891 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.891 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.891 DEBUG:boto:Params: {} 2024-04-16T18:40:16.891 DEBUG:boto:Token: None 2024-04-16T18:40:16.893 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69?versionId=null 2024-04-16T18:40:16.893 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk= 2024-04-16T18:40:16.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gQuR6j9X0hMpsD0M/6dc2QZmOFk=', 'Content-Length': '0'} 2024-04-16T18:40:16.895 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004b7b583d6fd04e4c-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.896 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.896 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.896 DEBUG:boto:path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:16.896 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:16.896 DEBUG:boto:Method: GET 2024-04-16T18:40:16.896 DEBUG:boto:Path: /cjqttm-54/?prefix=obj69 2024-04-16T18:40:16.896 DEBUG:boto:Data: 2024-04-16T18:40:16.896 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.896 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.897 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.897 DEBUG:boto:Params: {} 2024-04-16T18:40:16.897 DEBUG:boto:Token: None 2024-04-16T18:40:16.897 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.897 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.899 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001eaea38dbc2d522b-00661ec610-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.942 DEBUG:boto:b'cjqttm-54obj691000falseobj692024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.943 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:16.943 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:16.943 DEBUG:boto:path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:16.943 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:16.943 DEBUG:boto:Method: GET 2024-04-16T18:40:16.943 DEBUG:boto:Path: /cjqttm-54/?prefix=obj69 2024-04-16T18:40:16.943 DEBUG:boto:Data: 2024-04-16T18:40:16.943 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.943 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.944 DEBUG:boto:Params: {} 2024-04-16T18:40:16.944 DEBUG:boto:Token: None 2024-04-16T18:40:16.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/ 2024-04-16T18:40:16.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA= 2024-04-16T18:40:16.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pexWsuLV5Y4islWEZWNGrPGAGvA=', 'Content-Length': '0'} 2024-04-16T18:40:16.948 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bca20664701e153a-00661ec610-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.948 DEBUG:boto:b'cjqttm-54obj691000falseobj692024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:16.948 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.948 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.948 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.948 DEBUG:boto:Path: /cjqttm-54/obj69 2024-04-16T18:40:16.949 DEBUG:boto:Data: 2024-04-16T18:40:16.949 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.949 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.949 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.949 DEBUG:boto:Params: {} 2024-04-16T18:40:16.949 DEBUG:boto:Token: None 2024-04-16T18:40:16.949 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69 2024-04-16T18:40:16.949 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YRA6rIAUPl1NXJUds1zvzm2MPL0= 2024-04-16T18:40:16.949 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YRA6rIAUPl1NXJUds1zvzm2MPL0=', 'Content-Length': '0'} 2024-04-16T18:40:16.951 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e208c8c3d549ccff-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.952 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.952 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.952 DEBUG:boto:Method: HEAD 2024-04-16T18:40:16.952 DEBUG:boto:Path: /cjqttm-54/obj69 2024-04-16T18:40:16.952 DEBUG:boto:Data: 2024-04-16T18:40:16.952 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.952 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:16.952 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.952 DEBUG:boto:Params: {} 2024-04-16T18:40:16.952 DEBUG:boto:Token: None 2024-04-16T18:40:16.953 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69 2024-04-16T18:40:16.953 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YRA6rIAUPl1NXJUds1zvzm2MPL0= 2024-04-16T18:40:16.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YRA6rIAUPl1NXJUds1zvzm2MPL0=', 'Content-Length': '0'} 2024-04-16T18:40:16.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e2f85cc0b35b9d2-00661ec610-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:16.955 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:40:16.955 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:16.955 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:16.956 DEBUG:boto:Method: GET 2024-04-16T18:40:16.956 DEBUG:boto:Path: /cjqttm-54/obj69 2024-04-16T18:40:16.956 DEBUG:boto:Data: 2024-04-16T18:40:16.956 DEBUG:boto:Headers: {} 2024-04-16T18:40:16.956 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:16.956 DEBUG:boto:Port: 8000 2024-04-16T18:40:16.956 DEBUG:boto:Params: {} 2024-04-16T18:40:16.956 DEBUG:boto:Token: None 2024-04-16T18:40:16.956 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:16 GMT /cjqttm-54/obj69 2024-04-16T18:40:16.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7MEzdJXqlSc284x44WUQqHKDGww= 2024-04-16T18:40:16.957 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:16 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7MEzdJXqlSc284x44WUQqHKDGww=', 'Content-Length': '0'} 2024-04-16T18:40:16.958 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b18ac7fed6781003-00661ec610-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:16 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.002 DEBUG:boto:path=/cjqttm-54/obj69 2024-04-16T18:40:17.002 DEBUG:boto:auth_path=/cjqttm-54/obj69 2024-04-16T18:40:17.003 DEBUG:boto:Method: GET 2024-04-16T18:40:17.003 DEBUG:boto:Path: /cjqttm-54/obj69 2024-04-16T18:40:17.003 DEBUG:boto:Data: 2024-04-16T18:40:17.003 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.003 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.003 DEBUG:boto:Params: {} 2024-04-16T18:40:17.003 DEBUG:boto:Token: None 2024-04-16T18:40:17.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj69 2024-04-16T18:40:17.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bF5Z9P0yLAXIjTmfopXYB/jLeTI= 2024-04-16T18:40:17.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bF5Z9P0yLAXIjTmfopXYB/jLeTI=', 'Content-Length': '0'} 2024-04-16T18:40:17.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5bcd27ae84d3448-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.006 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.006 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.006 DEBUG:boto:path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:17.006 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:17.006 DEBUG:boto:Method: GET 2024-04-16T18:40:17.006 DEBUG:boto:Path: /cjqttm-54/?prefix=obj69 2024-04-16T18:40:17.006 DEBUG:boto:Data: 2024-04-16T18:40:17.006 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.006 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.007 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.007 DEBUG:boto:Params: {} 2024-04-16T18:40:17.007 DEBUG:boto:Token: None 2024-04-16T18:40:17.007 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ab2caa44560d0212-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.050 DEBUG:boto:b'cjqttm-54obj691000falseobj692024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.051 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.051 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.051 DEBUG:boto:path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:17.051 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj69 2024-04-16T18:40:17.051 DEBUG:boto:Method: GET 2024-04-16T18:40:17.051 DEBUG:boto:Path: /cjqttm-54/?prefix=obj69 2024-04-16T18:40:17.051 DEBUG:boto:Data: 2024-04-16T18:40:17.051 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.051 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.051 DEBUG:boto:Params: {} 2024-04-16T18:40:17.052 DEBUG:boto:Token: None 2024-04-16T18:40:17.052 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.055 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006eb71d07b4ce084-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.055 DEBUG:boto:b'cjqttm-54obj691000falseobj692024-04-16T18:33:08.983Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.056 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:40:17.056 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.056 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.056 DEBUG:boto:path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.056 DEBUG:boto:auth_path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.056 DEBUG:boto:Method: GET 2024-04-16T18:40:17.056 DEBUG:boto:Path: /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.056 DEBUG:boto:Data: 2024-04-16T18:40:17.056 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.056 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.056 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.057 DEBUG:boto:Params: {} 2024-04-16T18:40:17.057 DEBUG:boto:Token: None 2024-04-16T18:40:17.057 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.057 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI= 2024-04-16T18:40:17.057 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI=', 'Content-Length': '0'} 2024-04-16T18:40:17.059 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9fe0b2fc32b97d8-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.102 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.102 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.103 DEBUG:boto:path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.103 DEBUG:boto:auth_path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.103 DEBUG:boto:Method: GET 2024-04-16T18:40:17.103 DEBUG:boto:Path: /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.103 DEBUG:boto:Data: 2024-04-16T18:40:17.103 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.103 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.103 DEBUG:boto:Params: {} 2024-04-16T18:40:17.103 DEBUG:boto:Token: None 2024-04-16T18:40:17.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.104 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI= 2024-04-16T18:40:17.104 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI=', 'Content-Length': '0'} 2024-04-16T18:40:17.106 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000477d6439d48c03e-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.106 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.106 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.106 DEBUG:boto:path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.106 DEBUG:boto:auth_path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.107 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.107 DEBUG:boto:Path: /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.107 DEBUG:boto:Data: 2024-04-16T18:40:17.107 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.107 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.107 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.107 DEBUG:boto:Params: {} 2024-04-16T18:40:17.107 DEBUG:boto:Token: None 2024-04-16T18:40:17.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NldaQfb3Uh28iM3l3mWGn29CzLc= 2024-04-16T18:40:17.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NldaQfb3Uh28iM3l3mWGn29CzLc=', 'Content-Length': '0'} 2024-04-16T18:40:17.110 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048c0f0f24312cd2c-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.110 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.110 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.110 DEBUG:boto:path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.110 DEBUG:boto:auth_path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.110 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.110 DEBUG:boto:Path: /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.111 DEBUG:boto:Data: 2024-04-16T18:40:17.111 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.111 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.111 DEBUG:boto:Params: {} 2024-04-16T18:40:17.111 DEBUG:boto:Token: None 2024-04-16T18:40:17.111 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NldaQfb3Uh28iM3l3mWGn29CzLc= 2024-04-16T18:40:17.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NldaQfb3Uh28iM3l3mWGn29CzLc=', 'Content-Length': '0'} 2024-04-16T18:40:17.113 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001082d8b2bab64dae-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.114 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:40:17.114 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.114 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.114 DEBUG:boto:path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.114 DEBUG:boto:auth_path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.114 DEBUG:boto:Method: GET 2024-04-16T18:40:17.114 DEBUG:boto:Path: /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.114 DEBUG:boto:Data: 2024-04-16T18:40:17.114 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.115 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.115 DEBUG:boto:Params: {} 2024-04-16T18:40:17.115 DEBUG:boto:Token: None 2024-04-16T18:40:17.115 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.115 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI= 2024-04-16T18:40:17.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI=', 'Content-Length': '0'} 2024-04-16T18:40:17.117 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000514b7e8421917823-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.158 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.159 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.159 DEBUG:boto:path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.159 DEBUG:boto:auth_path=/cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.159 DEBUG:boto:Method: GET 2024-04-16T18:40:17.159 DEBUG:boto:Path: /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.159 DEBUG:boto:Data: 2024-04-16T18:40:17.159 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.159 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.159 DEBUG:boto:Params: {} 2024-04-16T18:40:17.159 DEBUG:boto:Token: None 2024-04-16T18:40:17.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74?versionId=null 2024-04-16T18:40:17.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI= 2024-04-16T18:40:17.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+wz/7xdiitXBmyVcnPr+VJH/AvI=', 'Content-Length': '0'} 2024-04-16T18:40:17.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d56d3000912afcd-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.162 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.162 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.163 DEBUG:boto:path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.163 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.163 DEBUG:boto:Method: GET 2024-04-16T18:40:17.163 DEBUG:boto:Path: /cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.163 DEBUG:boto:Data: 2024-04-16T18:40:17.163 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.163 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.163 DEBUG:boto:Params: {} 2024-04-16T18:40:17.163 DEBUG:boto:Token: None 2024-04-16T18:40:17.163 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.166 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008babb775be868345-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.206 DEBUG:boto:b'cjqttm-54obj741000falseobj742024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.207 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.207 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.207 DEBUG:boto:path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.207 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.207 DEBUG:boto:Method: GET 2024-04-16T18:40:17.207 DEBUG:boto:Path: /cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.207 DEBUG:boto:Data: 2024-04-16T18:40:17.207 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.207 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.207 DEBUG:boto:Params: {} 2024-04-16T18:40:17.208 DEBUG:boto:Token: None 2024-04-16T18:40:17.208 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.211 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c638efb3ef21c1d8-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.211 DEBUG:boto:b'cjqttm-54obj741000falseobj742024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.212 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.212 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.212 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.212 DEBUG:boto:Path: /cjqttm-54/obj74 2024-04-16T18:40:17.212 DEBUG:boto:Data: 2024-04-16T18:40:17.212 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.212 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.212 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.212 DEBUG:boto:Params: {} 2024-04-16T18:40:17.212 DEBUG:boto:Token: None 2024-04-16T18:40:17.213 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74 2024-04-16T18:40:17.213 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7koqZaMSYmv98hh+gxWBRf+nt2U= 2024-04-16T18:40:17.213 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7koqZaMSYmv98hh+gxWBRf+nt2U=', 'Content-Length': '0'} 2024-04-16T18:40:17.215 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a92e9121bbbcd2e8-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.215 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.215 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.215 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.215 DEBUG:boto:Path: /cjqttm-54/obj74 2024-04-16T18:40:17.215 DEBUG:boto:Data: 2024-04-16T18:40:17.215 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.215 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.216 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.216 DEBUG:boto:Params: {} 2024-04-16T18:40:17.216 DEBUG:boto:Token: None 2024-04-16T18:40:17.216 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74 2024-04-16T18:40:17.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7koqZaMSYmv98hh+gxWBRf+nt2U= 2024-04-16T18:40:17.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7koqZaMSYmv98hh+gxWBRf+nt2U=', 'Content-Length': '0'} 2024-04-16T18:40:17.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000063e1f1497dca0a71-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.218 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:40:17.218 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.218 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.219 DEBUG:boto:Method: GET 2024-04-16T18:40:17.219 DEBUG:boto:Path: /cjqttm-54/obj74 2024-04-16T18:40:17.219 DEBUG:boto:Data: 2024-04-16T18:40:17.219 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.219 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.219 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.219 DEBUG:boto:Params: {} 2024-04-16T18:40:17.219 DEBUG:boto:Token: None 2024-04-16T18:40:17.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74 2024-04-16T18:40:17.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cpkmHMCR39R3SsoU1H0t87IQMP4= 2024-04-16T18:40:17.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cpkmHMCR39R3SsoU1H0t87IQMP4=', 'Content-Length': '0'} 2024-04-16T18:40:17.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f12977f1ee614b75-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.262 DEBUG:boto:path=/cjqttm-54/obj74 2024-04-16T18:40:17.262 DEBUG:boto:auth_path=/cjqttm-54/obj74 2024-04-16T18:40:17.263 DEBUG:boto:Method: GET 2024-04-16T18:40:17.263 DEBUG:boto:Path: /cjqttm-54/obj74 2024-04-16T18:40:17.263 DEBUG:boto:Data: 2024-04-16T18:40:17.263 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.263 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.263 DEBUG:boto:Params: {} 2024-04-16T18:40:17.263 DEBUG:boto:Token: None 2024-04-16T18:40:17.263 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj74 2024-04-16T18:40:17.263 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cpkmHMCR39R3SsoU1H0t87IQMP4= 2024-04-16T18:40:17.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cpkmHMCR39R3SsoU1H0t87IQMP4=', 'Content-Length': '0'} 2024-04-16T18:40:17.266 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b4c4f7c90bd65ca-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.266 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.266 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.266 DEBUG:boto:path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.266 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.266 DEBUG:boto:Method: GET 2024-04-16T18:40:17.266 DEBUG:boto:Path: /cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.267 DEBUG:boto:Data: 2024-04-16T18:40:17.267 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.267 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.267 DEBUG:boto:Params: {} 2024-04-16T18:40:17.267 DEBUG:boto:Token: None 2024-04-16T18:40:17.267 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.267 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.267 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.269 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdc1c765a30ff761-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.310 DEBUG:boto:b'cjqttm-54obj741000falseobj742024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.311 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.311 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.311 DEBUG:boto:path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.311 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.311 DEBUG:boto:Method: GET 2024-04-16T18:40:17.311 DEBUG:boto:Path: /cjqttm-54/?prefix=obj74 2024-04-16T18:40:17.311 DEBUG:boto:Data: 2024-04-16T18:40:17.311 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.311 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.311 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.311 DEBUG:boto:Params: {} 2024-04-16T18:40:17.312 DEBUG:boto:Token: None 2024-04-16T18:40:17.312 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.312 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.312 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.315 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005ab792de2939b377-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.316 DEBUG:boto:b'cjqttm-54obj741000falseobj742024-04-16T18:33:09.928Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:40:17.316 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.316 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.316 DEBUG:boto:path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.316 DEBUG:boto:auth_path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.316 DEBUG:boto:Method: GET 2024-04-16T18:40:17.316 DEBUG:boto:Path: /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.317 DEBUG:boto:Data: 2024-04-16T18:40:17.317 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.317 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.317 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.317 DEBUG:boto:Params: {} 2024-04-16T18:40:17.317 DEBUG:boto:Token: None 2024-04-16T18:40:17.317 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.317 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk= 2024-04-16T18:40:17.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk=', 'Content-Length': '0'} 2024-04-16T18:40:17.319 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008a092627952d970c-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.362 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.362 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.363 DEBUG:boto:path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.363 DEBUG:boto:auth_path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.363 DEBUG:boto:Method: GET 2024-04-16T18:40:17.363 DEBUG:boto:Path: /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.363 DEBUG:boto:Data: 2024-04-16T18:40:17.363 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.363 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.363 DEBUG:boto:Params: {} 2024-04-16T18:40:17.363 DEBUG:boto:Token: None 2024-04-16T18:40:17.363 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.364 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk= 2024-04-16T18:40:17.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk=', 'Content-Length': '0'} 2024-04-16T18:40:17.366 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007edf57bc76769c5e-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.366 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.366 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.366 DEBUG:boto:path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.367 DEBUG:boto:auth_path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.367 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.367 DEBUG:boto:Path: /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.367 DEBUG:boto:Data: 2024-04-16T18:40:17.367 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.367 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.367 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.367 DEBUG:boto:Params: {} 2024-04-16T18:40:17.367 DEBUG:boto:Token: None 2024-04-16T18:40:17.367 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sMfz/B+Aqf2SrZiu5wA2kgh4bLo= 2024-04-16T18:40:17.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sMfz/B+Aqf2SrZiu5wA2kgh4bLo=', 'Content-Length': '0'} 2024-04-16T18:40:17.370 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000035971093cb27410c-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.370 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.370 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.370 DEBUG:boto:path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.370 DEBUG:boto:auth_path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.370 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.370 DEBUG:boto:Path: /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.370 DEBUG:boto:Data: 2024-04-16T18:40:17.371 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.371 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.371 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.371 DEBUG:boto:Params: {} 2024-04-16T18:40:17.371 DEBUG:boto:Token: None 2024-04-16T18:40:17.371 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sMfz/B+Aqf2SrZiu5wA2kgh4bLo= 2024-04-16T18:40:17.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sMfz/B+Aqf2SrZiu5wA2kgh4bLo=', 'Content-Length': '0'} 2024-04-16T18:40:17.373 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000332065e45b82194a-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.374 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:40:17.374 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.374 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.374 DEBUG:boto:path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.374 DEBUG:boto:auth_path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.374 DEBUG:boto:Method: GET 2024-04-16T18:40:17.374 DEBUG:boto:Path: /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.374 DEBUG:boto:Data: 2024-04-16T18:40:17.375 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.375 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.375 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.375 DEBUG:boto:Params: {} 2024-04-16T18:40:17.375 DEBUG:boto:Token: None 2024-04-16T18:40:17.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk= 2024-04-16T18:40:17.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk=', 'Content-Length': '0'} 2024-04-16T18:40:17.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000083d6bd1efedbdabc-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.418 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.418 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.419 DEBUG:boto:path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.419 DEBUG:boto:auth_path=/cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.419 DEBUG:boto:Method: GET 2024-04-16T18:40:17.419 DEBUG:boto:Path: /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.419 DEBUG:boto:Data: 2024-04-16T18:40:17.419 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.419 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.419 DEBUG:boto:Params: {} 2024-04-16T18:40:17.419 DEBUG:boto:Token: None 2024-04-16T18:40:17.420 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76?versionId=null 2024-04-16T18:40:17.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk= 2024-04-16T18:40:17.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q/AMuysFowqk8dWEQ/SWV9BCXXk=', 'Content-Length': '0'} 2024-04-16T18:40:17.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001d90ace99450ebc-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.422 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.422 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.422 DEBUG:boto:path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.422 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.422 DEBUG:boto:Method: GET 2024-04-16T18:40:17.423 DEBUG:boto:Path: /cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.423 DEBUG:boto:Data: 2024-04-16T18:40:17.423 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.423 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.423 DEBUG:boto:Params: {} 2024-04-16T18:40:17.423 DEBUG:boto:Token: None 2024-04-16T18:40:17.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.426 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000034ac8729830a07d2-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.466 DEBUG:boto:b'cjqttm-54obj761000falseobj762024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.467 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.467 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.467 DEBUG:boto:path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.467 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.467 DEBUG:boto:Method: GET 2024-04-16T18:40:17.467 DEBUG:boto:Path: /cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.467 DEBUG:boto:Data: 2024-04-16T18:40:17.467 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.467 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.467 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.467 DEBUG:boto:Params: {} 2024-04-16T18:40:17.468 DEBUG:boto:Token: None 2024-04-16T18:40:17.468 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.468 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.468 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.471 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ec346beb1a745f3-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.471 DEBUG:boto:b'cjqttm-54obj761000falseobj762024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.472 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.472 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.472 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.472 DEBUG:boto:Path: /cjqttm-54/obj76 2024-04-16T18:40:17.472 DEBUG:boto:Data: 2024-04-16T18:40:17.472 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.472 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.472 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.472 DEBUG:boto:Params: {} 2024-04-16T18:40:17.473 DEBUG:boto:Token: None 2024-04-16T18:40:17.473 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76 2024-04-16T18:40:17.473 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vSLGt5kNuckM/JN3hY/PqirBobI= 2024-04-16T18:40:17.473 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vSLGt5kNuckM/JN3hY/PqirBobI=', 'Content-Length': '0'} 2024-04-16T18:40:17.475 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a1e1cdedd7a8c263-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.475 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.475 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.475 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.475 DEBUG:boto:Path: /cjqttm-54/obj76 2024-04-16T18:40:17.476 DEBUG:boto:Data: 2024-04-16T18:40:17.476 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.476 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.476 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.476 DEBUG:boto:Params: {} 2024-04-16T18:40:17.476 DEBUG:boto:Token: None 2024-04-16T18:40:17.476 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76 2024-04-16T18:40:17.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vSLGt5kNuckM/JN3hY/PqirBobI= 2024-04-16T18:40:17.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vSLGt5kNuckM/JN3hY/PqirBobI=', 'Content-Length': '0'} 2024-04-16T18:40:17.478 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000c404b4df11efcc3-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:40:17.479 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.479 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.479 DEBUG:boto:Method: GET 2024-04-16T18:40:17.479 DEBUG:boto:Path: /cjqttm-54/obj76 2024-04-16T18:40:17.479 DEBUG:boto:Data: 2024-04-16T18:40:17.479 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.479 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.479 DEBUG:boto:Params: {} 2024-04-16T18:40:17.480 DEBUG:boto:Token: None 2024-04-16T18:40:17.480 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76 2024-04-16T18:40:17.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WMEepSU6HWFKCsNE3GiRX8mMUi4= 2024-04-16T18:40:17.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WMEepSU6HWFKCsNE3GiRX8mMUi4=', 'Content-Length': '0'} 2024-04-16T18:40:17.482 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006bf083b846eef225-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.522 DEBUG:boto:path=/cjqttm-54/obj76 2024-04-16T18:40:17.522 DEBUG:boto:auth_path=/cjqttm-54/obj76 2024-04-16T18:40:17.523 DEBUG:boto:Method: GET 2024-04-16T18:40:17.523 DEBUG:boto:Path: /cjqttm-54/obj76 2024-04-16T18:40:17.523 DEBUG:boto:Data: 2024-04-16T18:40:17.523 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.523 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.523 DEBUG:boto:Params: {} 2024-04-16T18:40:17.523 DEBUG:boto:Token: None 2024-04-16T18:40:17.523 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj76 2024-04-16T18:40:17.523 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WMEepSU6HWFKCsNE3GiRX8mMUi4= 2024-04-16T18:40:17.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WMEepSU6HWFKCsNE3GiRX8mMUi4=', 'Content-Length': '0'} 2024-04-16T18:40:17.526 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ba5da6dbcb88057-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.526 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.526 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.526 DEBUG:boto:path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.526 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.526 DEBUG:boto:Method: GET 2024-04-16T18:40:17.526 DEBUG:boto:Path: /cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.527 DEBUG:boto:Data: 2024-04-16T18:40:17.527 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.527 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.527 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.527 DEBUG:boto:Params: {} 2024-04-16T18:40:17.527 DEBUG:boto:Token: None 2024-04-16T18:40:17.527 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.527 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.527 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.529 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d080fabd459ad9a3-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.574 DEBUG:boto:b'cjqttm-54obj761000falseobj762024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.575 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.575 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.575 DEBUG:boto:path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.575 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.575 DEBUG:boto:Method: GET 2024-04-16T18:40:17.575 DEBUG:boto:Path: /cjqttm-54/?prefix=obj76 2024-04-16T18:40:17.575 DEBUG:boto:Data: 2024-04-16T18:40:17.575 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.575 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.576 DEBUG:boto:Params: {} 2024-04-16T18:40:17.576 DEBUG:boto:Token: None 2024-04-16T18:40:17.576 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.576 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.576 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.581 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000fbca4c014d6314a-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.581 DEBUG:boto:b'cjqttm-54obj761000falseobj762024-04-16T18:33:08.680Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.581 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:40:17.582 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.582 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.582 DEBUG:boto:path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.582 DEBUG:boto:auth_path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.582 DEBUG:boto:Method: GET 2024-04-16T18:40:17.582 DEBUG:boto:Path: /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.582 DEBUG:boto:Data: 2024-04-16T18:40:17.582 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.582 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.582 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.583 DEBUG:boto:Params: {} 2024-04-16T18:40:17.583 DEBUG:boto:Token: None 2024-04-16T18:40:17.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk= 2024-04-16T18:40:17.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk=', 'Content-Length': '0'} 2024-04-16T18:40:17.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000171b0c578522b124-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.626 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.626 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.627 DEBUG:boto:path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.627 DEBUG:boto:auth_path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.627 DEBUG:boto:Method: GET 2024-04-16T18:40:17.627 DEBUG:boto:Path: /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.627 DEBUG:boto:Data: 2024-04-16T18:40:17.627 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.627 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.627 DEBUG:boto:Params: {} 2024-04-16T18:40:17.627 DEBUG:boto:Token: None 2024-04-16T18:40:17.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk= 2024-04-16T18:40:17.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk=', 'Content-Length': '0'} 2024-04-16T18:40:17.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e10366c5c8967e87-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.630 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.630 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.630 DEBUG:boto:path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.630 DEBUG:boto:auth_path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.630 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.631 DEBUG:boto:Path: /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.631 DEBUG:boto:Data: 2024-04-16T18:40:17.631 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.631 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.631 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.631 DEBUG:boto:Params: {} 2024-04-16T18:40:17.631 DEBUG:boto:Token: None 2024-04-16T18:40:17.631 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BgmLfO9oNbF1490PP+1677APPs4= 2024-04-16T18:40:17.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BgmLfO9oNbF1490PP+1677APPs4=', 'Content-Length': '0'} 2024-04-16T18:40:17.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f14dff32aa4c59b-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.633 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.634 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.634 DEBUG:boto:path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.634 DEBUG:boto:auth_path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.634 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.634 DEBUG:boto:Path: /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.634 DEBUG:boto:Data: 2024-04-16T18:40:17.634 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.634 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.634 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.634 DEBUG:boto:Params: {} 2024-04-16T18:40:17.635 DEBUG:boto:Token: None 2024-04-16T18:40:17.635 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BgmLfO9oNbF1490PP+1677APPs4= 2024-04-16T18:40:17.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BgmLfO9oNbF1490PP+1677APPs4=', 'Content-Length': '0'} 2024-04-16T18:40:17.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000716a3e22a6835a0c-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:40:17.637 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.637 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.637 DEBUG:boto:path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.637 DEBUG:boto:auth_path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.637 DEBUG:boto:Method: GET 2024-04-16T18:40:17.637 DEBUG:boto:Path: /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.638 DEBUG:boto:Data: 2024-04-16T18:40:17.638 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.638 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.638 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.638 DEBUG:boto:Params: {} 2024-04-16T18:40:17.638 DEBUG:boto:Token: None 2024-04-16T18:40:17.638 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.638 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk= 2024-04-16T18:40:17.638 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk=', 'Content-Length': '0'} 2024-04-16T18:40:17.640 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bd370f97def1548-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.682 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.682 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.682 DEBUG:boto:path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.683 DEBUG:boto:auth_path=/cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.683 DEBUG:boto:Method: GET 2024-04-16T18:40:17.683 DEBUG:boto:Path: /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.683 DEBUG:boto:Data: 2024-04-16T18:40:17.683 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.683 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.683 DEBUG:boto:Params: {} 2024-04-16T18:40:17.683 DEBUG:boto:Token: None 2024-04-16T18:40:17.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85?versionId=null 2024-04-16T18:40:17.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk= 2024-04-16T18:40:17.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PZ+/ubs2e+O4R+65onmBV+rHHPk=', 'Content-Length': '0'} 2024-04-16T18:40:17.685 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000002bd7286bc5e32d6-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.686 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.686 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.686 DEBUG:boto:path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.686 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.686 DEBUG:boto:Method: GET 2024-04-16T18:40:17.686 DEBUG:boto:Path: /cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.686 DEBUG:boto:Data: 2024-04-16T18:40:17.687 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.687 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.687 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.687 DEBUG:boto:Params: {} 2024-04-16T18:40:17.687 DEBUG:boto:Token: None 2024-04-16T18:40:17.687 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.689 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af28c68c7f660af8-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.730 DEBUG:boto:b'cjqttm-54obj851000falseobj852024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.731 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.731 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.731 DEBUG:boto:path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.731 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.731 DEBUG:boto:Method: GET 2024-04-16T18:40:17.731 DEBUG:boto:Path: /cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.731 DEBUG:boto:Data: 2024-04-16T18:40:17.731 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.731 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.731 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.731 DEBUG:boto:Params: {} 2024-04-16T18:40:17.732 DEBUG:boto:Token: None 2024-04-16T18:40:17.732 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.736 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ae9add3537f8d09b-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.736 DEBUG:boto:b'cjqttm-54obj851000falseobj852024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.736 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.736 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.736 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.736 DEBUG:boto:Path: /cjqttm-54/obj85 2024-04-16T18:40:17.737 DEBUG:boto:Data: 2024-04-16T18:40:17.737 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.737 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.737 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.737 DEBUG:boto:Params: {} 2024-04-16T18:40:17.737 DEBUG:boto:Token: None 2024-04-16T18:40:17.737 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85 2024-04-16T18:40:17.737 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6GqlZTz9/aBW2pTWQgrlX03IbsI= 2024-04-16T18:40:17.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6GqlZTz9/aBW2pTWQgrlX03IbsI=', 'Content-Length': '0'} 2024-04-16T18:40:17.739 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c3db2981c3bc354-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.739 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.739 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.739 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.739 DEBUG:boto:Path: /cjqttm-54/obj85 2024-04-16T18:40:17.740 DEBUG:boto:Data: 2024-04-16T18:40:17.740 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.740 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.740 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.740 DEBUG:boto:Params: {} 2024-04-16T18:40:17.740 DEBUG:boto:Token: None 2024-04-16T18:40:17.740 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85 2024-04-16T18:40:17.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6GqlZTz9/aBW2pTWQgrlX03IbsI= 2024-04-16T18:40:17.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6GqlZTz9/aBW2pTWQgrlX03IbsI=', 'Content-Length': '0'} 2024-04-16T18:40:17.742 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ef8f2f5384af16b-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.742 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:40:17.742 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.743 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.743 DEBUG:boto:Method: GET 2024-04-16T18:40:17.743 DEBUG:boto:Path: /cjqttm-54/obj85 2024-04-16T18:40:17.743 DEBUG:boto:Data: 2024-04-16T18:40:17.743 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.743 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.743 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.743 DEBUG:boto:Params: {} 2024-04-16T18:40:17.743 DEBUG:boto:Token: None 2024-04-16T18:40:17.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85 2024-04-16T18:40:17.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z1N1+UuTqrq4s3bK51Y1gLkQWik= 2024-04-16T18:40:17.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z1N1+UuTqrq4s3bK51Y1gLkQWik=', 'Content-Length': '0'} 2024-04-16T18:40:17.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ee0ac90654241c7-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.786 DEBUG:boto:path=/cjqttm-54/obj85 2024-04-16T18:40:17.786 DEBUG:boto:auth_path=/cjqttm-54/obj85 2024-04-16T18:40:17.786 DEBUG:boto:Method: GET 2024-04-16T18:40:17.787 DEBUG:boto:Path: /cjqttm-54/obj85 2024-04-16T18:40:17.787 DEBUG:boto:Data: 2024-04-16T18:40:17.787 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.787 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.787 DEBUG:boto:Params: {} 2024-04-16T18:40:17.787 DEBUG:boto:Token: None 2024-04-16T18:40:17.787 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj85 2024-04-16T18:40:17.787 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Z1N1+UuTqrq4s3bK51Y1gLkQWik= 2024-04-16T18:40:17.787 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Z1N1+UuTqrq4s3bK51Y1gLkQWik=', 'Content-Length': '0'} 2024-04-16T18:40:17.789 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f4aec9202b8d29a-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.789 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.790 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.790 DEBUG:boto:path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.790 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.790 DEBUG:boto:Method: GET 2024-04-16T18:40:17.790 DEBUG:boto:Path: /cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.790 DEBUG:boto:Data: 2024-04-16T18:40:17.790 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.790 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.790 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.790 DEBUG:boto:Params: {} 2024-04-16T18:40:17.791 DEBUG:boto:Token: None 2024-04-16T18:40:17.791 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.791 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.791 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.793 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008bd619067ab3ea5b-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.834 DEBUG:boto:b'cjqttm-54obj851000falseobj852024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.835 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.835 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.835 DEBUG:boto:path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.835 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.835 DEBUG:boto:Method: GET 2024-04-16T18:40:17.835 DEBUG:boto:Path: /cjqttm-54/?prefix=obj85 2024-04-16T18:40:17.835 DEBUG:boto:Data: 2024-04-16T18:40:17.835 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.835 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.835 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.835 DEBUG:boto:Params: {} 2024-04-16T18:40:17.836 DEBUG:boto:Token: None 2024-04-16T18:40:17.836 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.839 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d68d46aad0035afe-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.840 DEBUG:boto:b'cjqttm-54obj851000falseobj852024-04-16T18:33:08.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.840 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:40:17.840 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:17.840 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:17.840 DEBUG:boto:path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.840 DEBUG:boto:auth_path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.841 DEBUG:boto:Method: GET 2024-04-16T18:40:17.841 DEBUG:boto:Path: /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.841 DEBUG:boto:Data: 2024-04-16T18:40:17.841 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.841 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.841 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.841 DEBUG:boto:Params: {} 2024-04-16T18:40:17.841 DEBUG:boto:Token: None 2024-04-16T18:40:17.841 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.841 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q= 2024-04-16T18:40:17.842 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q=', 'Content-Length': '0'} 2024-04-16T18:40:17.843 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018152d584c53bf6f-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.886 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:17.886 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:17.887 DEBUG:boto:path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.887 DEBUG:boto:auth_path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.887 DEBUG:boto:Method: GET 2024-04-16T18:40:17.887 DEBUG:boto:Path: /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.887 DEBUG:boto:Data: 2024-04-16T18:40:17.887 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.887 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.887 DEBUG:boto:Params: {} 2024-04-16T18:40:17.887 DEBUG:boto:Token: None 2024-04-16T18:40:17.888 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.888 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q= 2024-04-16T18:40:17.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q=', 'Content-Length': '0'} 2024-04-16T18:40:17.890 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e85dbff0a4554d80-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.890 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:17.890 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:17.890 DEBUG:boto:path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.890 DEBUG:boto:auth_path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.890 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.891 DEBUG:boto:Path: /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.891 DEBUG:boto:Data: 2024-04-16T18:40:17.891 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.891 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.891 DEBUG:boto:Params: {} 2024-04-16T18:40:17.891 DEBUG:boto:Token: None 2024-04-16T18:40:17.891 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.891 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:muOFMxkzfEz6av0lC29aTBqLs3k= 2024-04-16T18:40:17.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:muOFMxkzfEz6av0lC29aTBqLs3k=', 'Content-Length': '0'} 2024-04-16T18:40:17.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f44402e869299d65-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.894 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:17.894 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:17.894 DEBUG:boto:path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.894 DEBUG:boto:auth_path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.894 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.894 DEBUG:boto:Path: /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.894 DEBUG:boto:Data: 2024-04-16T18:40:17.894 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.894 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.894 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.895 DEBUG:boto:Params: {} 2024-04-16T18:40:17.895 DEBUG:boto:Token: None 2024-04-16T18:40:17.895 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.895 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:muOFMxkzfEz6av0lC29aTBqLs3k= 2024-04-16T18:40:17.895 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:muOFMxkzfEz6av0lC29aTBqLs3k=', 'Content-Length': '0'} 2024-04-16T18:40:17.897 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb2ddd0f1363a22b-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.897 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:40:17.897 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:17.897 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:17.897 DEBUG:boto:path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.897 DEBUG:boto:auth_path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.897 DEBUG:boto:Method: GET 2024-04-16T18:40:17.897 DEBUG:boto:Path: /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.898 DEBUG:boto:Data: 2024-04-16T18:40:17.898 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.898 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.898 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.898 DEBUG:boto:Params: {} 2024-04-16T18:40:17.898 DEBUG:boto:Token: None 2024-04-16T18:40:17.898 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.898 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q= 2024-04-16T18:40:17.898 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q=', 'Content-Length': '0'} 2024-04-16T18:40:17.900 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f06b57dbed00c256-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.942 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:17.943 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:17.943 DEBUG:boto:path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.943 DEBUG:boto:auth_path=/cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.943 DEBUG:boto:Method: GET 2024-04-16T18:40:17.943 DEBUG:boto:Path: /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.943 DEBUG:boto:Data: 2024-04-16T18:40:17.943 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.943 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.943 DEBUG:boto:Params: {} 2024-04-16T18:40:17.943 DEBUG:boto:Token: None 2024-04-16T18:40:17.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj87?versionId=null 2024-04-16T18:40:17.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q= 2024-04-16T18:40:17.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:40cXS6g2tY9UbuWjFNawHB1uJ6Q=', 'Content-Length': '0'} 2024-04-16T18:40:17.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008950f5ca9f30046d-00661ec611-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.946 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.946 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.946 DEBUG:boto:path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:17.946 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:17.946 DEBUG:boto:Method: GET 2024-04-16T18:40:17.946 DEBUG:boto:Path: /cjqttm-54/?prefix=obj87 2024-04-16T18:40:17.946 DEBUG:boto:Data: 2024-04-16T18:40:17.947 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.947 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.947 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.947 DEBUG:boto:Params: {} 2024-04-16T18:40:17.947 DEBUG:boto:Token: None 2024-04-16T18:40:17.947 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.949 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000f512bc4f6dcc74e-00661ec611-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.990 DEBUG:boto:b'cjqttm-54obj871000falseobj872024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.991 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:17.991 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:17.991 DEBUG:boto:path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:17.991 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:17.991 DEBUG:boto:Method: GET 2024-04-16T18:40:17.991 DEBUG:boto:Path: /cjqttm-54/?prefix=obj87 2024-04-16T18:40:17.991 DEBUG:boto:Data: 2024-04-16T18:40:17.991 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:17.991 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.991 DEBUG:boto:Params: {} 2024-04-16T18:40:17.992 DEBUG:boto:Token: None 2024-04-16T18:40:17.992 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/ 2024-04-16T18:40:17.992 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4= 2024-04-16T18:40:17.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1tZ8tsVe8Pej+jTGwQ2dDst2yO4=', 'Content-Length': '0'} 2024-04-16T18:40:17.996 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000006b7a0f36871696d-00661ec611-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.996 DEBUG:boto:b'cjqttm-54obj871000falseobj872024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:17.996 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:17.997 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:17.997 DEBUG:boto:Method: HEAD 2024-04-16T18:40:17.997 DEBUG:boto:Path: /cjqttm-54/obj87 2024-04-16T18:40:17.997 DEBUG:boto:Data: 2024-04-16T18:40:17.997 DEBUG:boto:Headers: {} 2024-04-16T18:40:17.997 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:17.997 DEBUG:boto:Port: 8000 2024-04-16T18:40:17.997 DEBUG:boto:Params: {} 2024-04-16T18:40:17.997 DEBUG:boto:Token: None 2024-04-16T18:40:17.997 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:17 GMT /cjqttm-54/obj87 2024-04-16T18:40:17.998 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L9Y59rW9JINcYP8qaZBLZdcytkc= 2024-04-16T18:40:17.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L9Y59rW9JINcYP8qaZBLZdcytkc=', 'Content-Length': '0'} 2024-04-16T18:40:17.999 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb81347831365663-00661ec611-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:17.999 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:18.000 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:18.000 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.000 DEBUG:boto:Path: /cjqttm-54/obj87 2024-04-16T18:40:18.000 DEBUG:boto:Data: 2024-04-16T18:40:18.000 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.000 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.000 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.000 DEBUG:boto:Params: {} 2024-04-16T18:40:18.000 DEBUG:boto:Token: None 2024-04-16T18:40:18.000 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj87 2024-04-16T18:40:18.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qNkQa5Aq5oZlc/JCyKzKrQ3xV2g= 2024-04-16T18:40:18.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qNkQa5Aq5oZlc/JCyKzKrQ3xV2g=', 'Content-Length': '0'} 2024-04-16T18:40:18.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008fdc6d096185c05a-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.003 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:40:18.003 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:18.003 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:18.003 DEBUG:boto:Method: GET 2024-04-16T18:40:18.003 DEBUG:boto:Path: /cjqttm-54/obj87 2024-04-16T18:40:18.004 DEBUG:boto:Data: 2024-04-16T18:40:18.004 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.004 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.004 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.004 DEBUG:boto:Params: {} 2024-04-16T18:40:18.004 DEBUG:boto:Token: None 2024-04-16T18:40:18.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj87 2024-04-16T18:40:18.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vm3H0X99F4ZfoapKFQ1Jl4XKN8k= 2024-04-16T18:40:18.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vm3H0X99F4ZfoapKFQ1Jl4XKN8k=', 'Content-Length': '0'} 2024-04-16T18:40:18.006 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c789ea4840c3edf9-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.050 DEBUG:boto:path=/cjqttm-54/obj87 2024-04-16T18:40:18.050 DEBUG:boto:auth_path=/cjqttm-54/obj87 2024-04-16T18:40:18.050 DEBUG:boto:Method: GET 2024-04-16T18:40:18.051 DEBUG:boto:Path: /cjqttm-54/obj87 2024-04-16T18:40:18.051 DEBUG:boto:Data: 2024-04-16T18:40:18.051 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.051 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.051 DEBUG:boto:Params: {} 2024-04-16T18:40:18.051 DEBUG:boto:Token: None 2024-04-16T18:40:18.051 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj87 2024-04-16T18:40:18.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vm3H0X99F4ZfoapKFQ1Jl4XKN8k= 2024-04-16T18:40:18.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vm3H0X99F4ZfoapKFQ1Jl4XKN8k=', 'Content-Length': '0'} 2024-04-16T18:40:18.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1a9be1cf75d32ee-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.053 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.054 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.054 DEBUG:boto:path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:18.054 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:18.054 DEBUG:boto:Method: GET 2024-04-16T18:40:18.054 DEBUG:boto:Path: /cjqttm-54/?prefix=obj87 2024-04-16T18:40:18.054 DEBUG:boto:Data: 2024-04-16T18:40:18.054 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.054 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.054 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.054 DEBUG:boto:Params: {} 2024-04-16T18:40:18.054 DEBUG:boto:Token: None 2024-04-16T18:40:18.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.057 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005d6911bc4473fc66-00661ec612-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.098 DEBUG:boto:b'cjqttm-54obj871000falseobj872024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.099 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.099 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.099 DEBUG:boto:path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:18.099 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj87 2024-04-16T18:40:18.099 DEBUG:boto:Method: GET 2024-04-16T18:40:18.099 DEBUG:boto:Path: /cjqttm-54/?prefix=obj87 2024-04-16T18:40:18.099 DEBUG:boto:Data: 2024-04-16T18:40:18.099 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.099 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.099 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.100 DEBUG:boto:Params: {} 2024-04-16T18:40:18.100 DEBUG:boto:Token: None 2024-04-16T18:40:18.100 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.100 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.100 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.104 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000055c32102244cef24-00661ec612-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.104 DEBUG:boto:b'cjqttm-54obj871000falseobj872024-04-16T18:33:09.265Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.104 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:40:18.104 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.104 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.104 DEBUG:boto:path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.105 DEBUG:boto:auth_path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.105 DEBUG:boto:Method: GET 2024-04-16T18:40:18.105 DEBUG:boto:Path: /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.105 DEBUG:boto:Data: 2024-04-16T18:40:18.105 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.105 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.105 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.105 DEBUG:boto:Params: {} 2024-04-16T18:40:18.105 DEBUG:boto:Token: None 2024-04-16T18:40:18.105 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.105 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A= 2024-04-16T18:40:18.106 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A=', 'Content-Length': '0'} 2024-04-16T18:40:18.108 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000091c8869bc0db1e2c-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.151 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.151 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.151 DEBUG:boto:path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.151 DEBUG:boto:auth_path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.151 DEBUG:boto:Method: GET 2024-04-16T18:40:18.151 DEBUG:boto:Path: /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.151 DEBUG:boto:Data: 2024-04-16T18:40:18.151 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.151 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.151 DEBUG:boto:Params: {} 2024-04-16T18:40:18.152 DEBUG:boto:Token: None 2024-04-16T18:40:18.152 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A= 2024-04-16T18:40:18.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A=', 'Content-Length': '0'} 2024-04-16T18:40:18.154 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000093023e5ca491be9-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.155 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.155 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.155 DEBUG:boto:path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.155 DEBUG:boto:auth_path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.155 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.155 DEBUG:boto:Path: /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.155 DEBUG:boto:Data: 2024-04-16T18:40:18.155 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.155 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.155 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.155 DEBUG:boto:Params: {} 2024-04-16T18:40:18.156 DEBUG:boto:Token: None 2024-04-16T18:40:18.156 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vNQZ05Dc4ic28b06yHuH/i8e6X8= 2024-04-16T18:40:18.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vNQZ05Dc4ic28b06yHuH/i8e6X8=', 'Content-Length': '0'} 2024-04-16T18:40:18.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000013a41e2828df855b-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.158 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.159 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.159 DEBUG:boto:path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.159 DEBUG:boto:auth_path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.159 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.159 DEBUG:boto:Path: /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.159 DEBUG:boto:Data: 2024-04-16T18:40:18.159 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.159 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.159 DEBUG:boto:Params: {} 2024-04-16T18:40:18.159 DEBUG:boto:Token: None 2024-04-16T18:40:18.160 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vNQZ05Dc4ic28b06yHuH/i8e6X8= 2024-04-16T18:40:18.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vNQZ05Dc4ic28b06yHuH/i8e6X8=', 'Content-Length': '0'} 2024-04-16T18:40:18.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c1dc1cba2c56d31a-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.162 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:40:18.162 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.162 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.162 DEBUG:boto:path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.163 DEBUG:boto:auth_path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.163 DEBUG:boto:Method: GET 2024-04-16T18:40:18.163 DEBUG:boto:Path: /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.163 DEBUG:boto:Data: 2024-04-16T18:40:18.163 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.163 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.163 DEBUG:boto:Params: {} 2024-04-16T18:40:18.163 DEBUG:boto:Token: None 2024-04-16T18:40:18.163 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.164 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A= 2024-04-16T18:40:18.164 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A=', 'Content-Length': '0'} 2024-04-16T18:40:18.166 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4985a3d2a3a1310-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.206 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.206 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.207 DEBUG:boto:path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.207 DEBUG:boto:auth_path=/cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.207 DEBUG:boto:Method: GET 2024-04-16T18:40:18.207 DEBUG:boto:Path: /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.207 DEBUG:boto:Data: 2024-04-16T18:40:18.207 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.207 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.207 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.207 DEBUG:boto:Params: {} 2024-04-16T18:40:18.207 DEBUG:boto:Token: None 2024-04-16T18:40:18.207 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92?versionId=null 2024-04-16T18:40:18.208 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A= 2024-04-16T18:40:18.208 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oyFCmhxnBj325PLK7ELDYv07z2A=', 'Content-Length': '0'} 2024-04-16T18:40:18.210 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f76037b7be7a34e-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.210 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.210 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.211 DEBUG:boto:path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.211 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.211 DEBUG:boto:Method: GET 2024-04-16T18:40:18.211 DEBUG:boto:Path: /cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.211 DEBUG:boto:Data: 2024-04-16T18:40:18.211 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.211 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.211 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.211 DEBUG:boto:Params: {} 2024-04-16T18:40:18.211 DEBUG:boto:Token: None 2024-04-16T18:40:18.211 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.212 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.212 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.214 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000051d65bb858ea198-00661ec612-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.254 DEBUG:boto:b'cjqttm-54obj921000falseobj922024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.255 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.255 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.255 DEBUG:boto:path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.255 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.255 DEBUG:boto:Method: GET 2024-04-16T18:40:18.255 DEBUG:boto:Path: /cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.255 DEBUG:boto:Data: 2024-04-16T18:40:18.255 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.255 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.255 DEBUG:boto:Params: {} 2024-04-16T18:40:18.256 DEBUG:boto:Token: None 2024-04-16T18:40:18.256 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.256 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.260 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba26c47d25c3d0e9-00661ec612-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.260 DEBUG:boto:b'cjqttm-54obj921000falseobj922024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.260 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.260 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.260 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.261 DEBUG:boto:Path: /cjqttm-54/obj92 2024-04-16T18:40:18.261 DEBUG:boto:Data: 2024-04-16T18:40:18.261 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.261 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.261 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.261 DEBUG:boto:Params: {} 2024-04-16T18:40:18.261 DEBUG:boto:Token: None 2024-04-16T18:40:18.261 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92 2024-04-16T18:40:18.261 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o6FBacM02YKDWFQ/geZMeHSdddA= 2024-04-16T18:40:18.262 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o6FBacM02YKDWFQ/geZMeHSdddA=', 'Content-Length': '0'} 2024-04-16T18:40:18.264 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001414b919e8b625c3-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.264 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.264 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.264 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.264 DEBUG:boto:Path: /cjqttm-54/obj92 2024-04-16T18:40:18.265 DEBUG:boto:Data: 2024-04-16T18:40:18.265 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.265 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.265 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.265 DEBUG:boto:Params: {} 2024-04-16T18:40:18.265 DEBUG:boto:Token: None 2024-04-16T18:40:18.265 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92 2024-04-16T18:40:18.265 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:o6FBacM02YKDWFQ/geZMeHSdddA= 2024-04-16T18:40:18.265 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:o6FBacM02YKDWFQ/geZMeHSdddA=', 'Content-Length': '0'} 2024-04-16T18:40:18.267 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000184ea39bc47479ad-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.268 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:40:18.268 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.268 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.268 DEBUG:boto:Method: GET 2024-04-16T18:40:18.268 DEBUG:boto:Path: /cjqttm-54/obj92 2024-04-16T18:40:18.268 DEBUG:boto:Data: 2024-04-16T18:40:18.268 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.269 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.269 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.269 DEBUG:boto:Params: {} 2024-04-16T18:40:18.269 DEBUG:boto:Token: None 2024-04-16T18:40:18.269 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92 2024-04-16T18:40:18.269 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jIlDjQcZ7cZrrR8N+K+lSHsGwN8= 2024-04-16T18:40:18.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jIlDjQcZ7cZrrR8N+K+lSHsGwN8=', 'Content-Length': '0'} 2024-04-16T18:40:18.271 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f11190262bdae664-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.314 DEBUG:boto:path=/cjqttm-54/obj92 2024-04-16T18:40:18.314 DEBUG:boto:auth_path=/cjqttm-54/obj92 2024-04-16T18:40:18.315 DEBUG:boto:Method: GET 2024-04-16T18:40:18.315 DEBUG:boto:Path: /cjqttm-54/obj92 2024-04-16T18:40:18.315 DEBUG:boto:Data: 2024-04-16T18:40:18.315 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.315 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.315 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.315 DEBUG:boto:Params: {} 2024-04-16T18:40:18.315 DEBUG:boto:Token: None 2024-04-16T18:40:18.315 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj92 2024-04-16T18:40:18.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jIlDjQcZ7cZrrR8N+K+lSHsGwN8= 2024-04-16T18:40:18.316 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jIlDjQcZ7cZrrR8N+K+lSHsGwN8=', 'Content-Length': '0'} 2024-04-16T18:40:18.318 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024a8bdcbf1e6e9de-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.318 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.318 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.318 DEBUG:boto:path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.318 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.319 DEBUG:boto:Method: GET 2024-04-16T18:40:18.319 DEBUG:boto:Path: /cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.319 DEBUG:boto:Data: 2024-04-16T18:40:18.321 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.321 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.321 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.321 DEBUG:boto:Params: {} 2024-04-16T18:40:18.321 DEBUG:boto:Token: None 2024-04-16T18:40:18.321 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.321 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.323 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008d39eb3c76205164-00661ec612-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.366 DEBUG:boto:b'cjqttm-54obj921000falseobj922024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.367 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.367 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.367 DEBUG:boto:path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.367 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.367 DEBUG:boto:Method: GET 2024-04-16T18:40:18.367 DEBUG:boto:Path: /cjqttm-54/?prefix=obj92 2024-04-16T18:40:18.367 DEBUG:boto:Data: 2024-04-16T18:40:18.367 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.367 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.367 DEBUG:boto:Params: {} 2024-04-16T18:40:18.368 DEBUG:boto:Token: None 2024-04-16T18:40:18.368 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.372 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a846dac7e6724f9c-00661ec612-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.372 DEBUG:boto:b'cjqttm-54obj921000falseobj922024-04-16T18:33:08.994Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:40:18.372 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.372 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.372 DEBUG:boto:path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.372 DEBUG:boto:auth_path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.373 DEBUG:boto:Method: GET 2024-04-16T18:40:18.373 DEBUG:boto:Path: /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.373 DEBUG:boto:Data: 2024-04-16T18:40:18.373 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.373 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.373 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.373 DEBUG:boto:Params: {} 2024-04-16T18:40:18.373 DEBUG:boto:Token: None 2024-04-16T18:40:18.373 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.373 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4= 2024-04-16T18:40:18.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4=', 'Content-Length': '0'} 2024-04-16T18:40:18.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f85f2bd6fef5820c-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.418 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.418 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.418 DEBUG:boto:path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.419 DEBUG:boto:auth_path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.419 DEBUG:boto:Method: GET 2024-04-16T18:40:18.419 DEBUG:boto:Path: /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.419 DEBUG:boto:Data: 2024-04-16T18:40:18.419 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.419 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.419 DEBUG:boto:Params: {} 2024-04-16T18:40:18.419 DEBUG:boto:Token: None 2024-04-16T18:40:18.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4= 2024-04-16T18:40:18.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4=', 'Content-Length': '0'} 2024-04-16T18:40:18.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000502dfe4bb66d7d29-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.422 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.422 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.422 DEBUG:boto:path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.422 DEBUG:boto:auth_path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.422 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.422 DEBUG:boto:Path: /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.422 DEBUG:boto:Data: 2024-04-16T18:40:18.422 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.423 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.423 DEBUG:boto:Params: {} 2024-04-16T18:40:18.423 DEBUG:boto:Token: None 2024-04-16T18:40:18.423 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bfg9LrhAYYPBtFSKiDXgoFcG+i4= 2024-04-16T18:40:18.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bfg9LrhAYYPBtFSKiDXgoFcG+i4=', 'Content-Length': '0'} 2024-04-16T18:40:18.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c63bb77ddc4501c-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.425 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.425 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.425 DEBUG:boto:path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.425 DEBUG:boto:auth_path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.425 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.425 DEBUG:boto:Path: /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.426 DEBUG:boto:Data: 2024-04-16T18:40:18.426 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.426 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.426 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.426 DEBUG:boto:Params: {} 2024-04-16T18:40:18.426 DEBUG:boto:Token: None 2024-04-16T18:40:18.426 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.426 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bfg9LrhAYYPBtFSKiDXgoFcG+i4= 2024-04-16T18:40:18.426 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bfg9LrhAYYPBtFSKiDXgoFcG+i4=', 'Content-Length': '0'} 2024-04-16T18:40:18.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000719c7259e5bed8cb-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.428 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:40:18.429 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.429 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.429 DEBUG:boto:path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.429 DEBUG:boto:auth_path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.429 DEBUG:boto:Method: GET 2024-04-16T18:40:18.429 DEBUG:boto:Path: /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.429 DEBUG:boto:Data: 2024-04-16T18:40:18.429 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.429 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.429 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.429 DEBUG:boto:Params: {} 2024-04-16T18:40:18.430 DEBUG:boto:Token: None 2024-04-16T18:40:18.430 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.430 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4= 2024-04-16T18:40:18.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4=', 'Content-Length': '0'} 2024-04-16T18:40:18.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000081f67fc734a6155f-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.474 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.474 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.475 DEBUG:boto:path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.475 DEBUG:boto:auth_path=/cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.475 DEBUG:boto:Method: GET 2024-04-16T18:40:18.475 DEBUG:boto:Path: /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.475 DEBUG:boto:Data: 2024-04-16T18:40:18.475 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.475 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.475 DEBUG:boto:Params: {} 2024-04-16T18:40:18.475 DEBUG:boto:Token: None 2024-04-16T18:40:18.475 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93?versionId=null 2024-04-16T18:40:18.476 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4= 2024-04-16T18:40:18.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B94ceBloEsz1UtcCJhlu3ETCHt4=', 'Content-Length': '0'} 2024-04-16T18:40:18.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b47c9b2b6f6ee365-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.478 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.478 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.478 DEBUG:boto:path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.478 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.478 DEBUG:boto:Method: GET 2024-04-16T18:40:18.478 DEBUG:boto:Path: /cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.478 DEBUG:boto:Data: 2024-04-16T18:40:18.479 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.479 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.479 DEBUG:boto:Params: {} 2024-04-16T18:40:18.479 DEBUG:boto:Token: None 2024-04-16T18:40:18.479 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.481 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bac6153bda22a41d-00661ec612-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.522 DEBUG:boto:b'cjqttm-54obj931000falseobj932024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.523 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.523 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.523 DEBUG:boto:path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.523 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.523 DEBUG:boto:Method: GET 2024-04-16T18:40:18.523 DEBUG:boto:Path: /cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.523 DEBUG:boto:Data: 2024-04-16T18:40:18.523 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.523 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.523 DEBUG:boto:Params: {} 2024-04-16T18:40:18.524 DEBUG:boto:Token: None 2024-04-16T18:40:18.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.528 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001b7004c340d1c8ce-00661ec612-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.528 DEBUG:boto:b'cjqttm-54obj931000falseobj932024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.528 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.528 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.528 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.528 DEBUG:boto:Path: /cjqttm-54/obj93 2024-04-16T18:40:18.528 DEBUG:boto:Data: 2024-04-16T18:40:18.529 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.529 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.529 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.529 DEBUG:boto:Params: {} 2024-04-16T18:40:18.529 DEBUG:boto:Token: None 2024-04-16T18:40:18.529 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93 2024-04-16T18:40:18.529 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TWZHajo7gA5e4xVtOvluYMgPSTc= 2024-04-16T18:40:18.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TWZHajo7gA5e4xVtOvluYMgPSTc=', 'Content-Length': '0'} 2024-04-16T18:40:18.531 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000dc12cddd3cda6e-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.531 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.531 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.532 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.532 DEBUG:boto:Path: /cjqttm-54/obj93 2024-04-16T18:40:18.532 DEBUG:boto:Data: 2024-04-16T18:40:18.532 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.532 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.532 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.532 DEBUG:boto:Params: {} 2024-04-16T18:40:18.532 DEBUG:boto:Token: None 2024-04-16T18:40:18.532 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93 2024-04-16T18:40:18.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TWZHajo7gA5e4xVtOvluYMgPSTc= 2024-04-16T18:40:18.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TWZHajo7gA5e4xVtOvluYMgPSTc=', 'Content-Length': '0'} 2024-04-16T18:40:18.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003e98e3f7d4da9131-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:40:18.534 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.535 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.535 DEBUG:boto:Method: GET 2024-04-16T18:40:18.535 DEBUG:boto:Path: /cjqttm-54/obj93 2024-04-16T18:40:18.535 DEBUG:boto:Data: 2024-04-16T18:40:18.535 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.535 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.535 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.535 DEBUG:boto:Params: {} 2024-04-16T18:40:18.535 DEBUG:boto:Token: None 2024-04-16T18:40:18.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93 2024-04-16T18:40:18.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YhffB49idZAJDYC7IgRKhO+JuGY= 2024-04-16T18:40:18.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YhffB49idZAJDYC7IgRKhO+JuGY=', 'Content-Length': '0'} 2024-04-16T18:40:18.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001a49a06e4661480e-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.578 DEBUG:boto:path=/cjqttm-54/obj93 2024-04-16T18:40:18.579 DEBUG:boto:auth_path=/cjqttm-54/obj93 2024-04-16T18:40:18.579 DEBUG:boto:Method: GET 2024-04-16T18:40:18.579 DEBUG:boto:Path: /cjqttm-54/obj93 2024-04-16T18:40:18.579 DEBUG:boto:Data: 2024-04-16T18:40:18.579 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.579 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.579 DEBUG:boto:Params: {} 2024-04-16T18:40:18.579 DEBUG:boto:Token: None 2024-04-16T18:40:18.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj93 2024-04-16T18:40:18.580 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YhffB49idZAJDYC7IgRKhO+JuGY= 2024-04-16T18:40:18.580 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YhffB49idZAJDYC7IgRKhO+JuGY=', 'Content-Length': '0'} 2024-04-16T18:40:18.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:09 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006f6ccb69e18bc52d-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.582 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.582 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.582 DEBUG:boto:path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.582 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.582 DEBUG:boto:Method: GET 2024-04-16T18:40:18.582 DEBUG:boto:Path: /cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.582 DEBUG:boto:Data: 2024-04-16T18:40:18.582 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.583 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.583 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.583 DEBUG:boto:Params: {} 2024-04-16T18:40:18.583 DEBUG:boto:Token: None 2024-04-16T18:40:18.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000227d0c22755b8e7f-00661ec612-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.626 DEBUG:boto:b'cjqttm-54obj931000falseobj932024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.627 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.627 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.627 DEBUG:boto:path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.627 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.627 DEBUG:boto:Method: GET 2024-04-16T18:40:18.627 DEBUG:boto:Path: /cjqttm-54/?prefix=obj93 2024-04-16T18:40:18.627 DEBUG:boto:Data: 2024-04-16T18:40:18.627 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.628 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.628 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.628 DEBUG:boto:Params: {} 2024-04-16T18:40:18.628 DEBUG:boto:Token: None 2024-04-16T18:40:18.628 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.632 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003f465a7fcaa66d33-00661ec612-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.632 DEBUG:boto:b'cjqttm-54obj931000falseobj932024-04-16T18:33:09.602Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.632 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:40:18.632 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.632 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.633 DEBUG:boto:path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.633 DEBUG:boto:auth_path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.633 DEBUG:boto:Method: GET 2024-04-16T18:40:18.633 DEBUG:boto:Path: /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.633 DEBUG:boto:Data: 2024-04-16T18:40:18.633 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.633 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.633 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.633 DEBUG:boto:Params: {} 2024-04-16T18:40:18.633 DEBUG:boto:Token: None 2024-04-16T18:40:18.634 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.634 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI= 2024-04-16T18:40:18.634 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI=', 'Content-Length': '0'} 2024-04-16T18:40:18.636 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000499283b53dc10361-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.678 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.678 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.679 DEBUG:boto:path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.679 DEBUG:boto:auth_path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.679 DEBUG:boto:Method: GET 2024-04-16T18:40:18.679 DEBUG:boto:Path: /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.679 DEBUG:boto:Data: 2024-04-16T18:40:18.679 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.679 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.679 DEBUG:boto:Params: {} 2024-04-16T18:40:18.679 DEBUG:boto:Token: None 2024-04-16T18:40:18.680 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.680 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI= 2024-04-16T18:40:18.680 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI=', 'Content-Length': '0'} 2024-04-16T18:40:18.682 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc57a8fc4cd2dcde-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.682 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.682 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.682 DEBUG:boto:path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.682 DEBUG:boto:auth_path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.683 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.683 DEBUG:boto:Path: /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.683 DEBUG:boto:Data: 2024-04-16T18:40:18.683 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.683 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.683 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.683 DEBUG:boto:Params: {} 2024-04-16T18:40:18.683 DEBUG:boto:Token: None 2024-04-16T18:40:18.683 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xUygBa1X+fVzECmm+sYajk84z4M= 2024-04-16T18:40:18.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xUygBa1X+fVzECmm+sYajk84z4M=', 'Content-Length': '0'} 2024-04-16T18:40:18.686 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a693dbd3d03d7db0-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.686 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.686 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.686 DEBUG:boto:path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.686 DEBUG:boto:auth_path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.686 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.686 DEBUG:boto:Path: /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.687 DEBUG:boto:Data: 2024-04-16T18:40:18.687 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.687 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.687 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.687 DEBUG:boto:Params: {} 2024-04-16T18:40:18.687 DEBUG:boto:Token: None 2024-04-16T18:40:18.687 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xUygBa1X+fVzECmm+sYajk84z4M= 2024-04-16T18:40:18.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xUygBa1X+fVzECmm+sYajk84z4M=', 'Content-Length': '0'} 2024-04-16T18:40:18.690 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007818b07d59750035-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.690 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:40:18.690 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.690 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.690 DEBUG:boto:path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.690 DEBUG:boto:auth_path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.690 DEBUG:boto:Method: GET 2024-04-16T18:40:18.691 DEBUG:boto:Path: /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.691 DEBUG:boto:Data: 2024-04-16T18:40:18.691 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.691 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.691 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.691 DEBUG:boto:Params: {} 2024-04-16T18:40:18.691 DEBUG:boto:Token: None 2024-04-16T18:40:18.691 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI= 2024-04-16T18:40:18.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI=', 'Content-Length': '0'} 2024-04-16T18:40:18.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060214f4855346da8-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.734 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.734 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.735 DEBUG:boto:path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.735 DEBUG:boto:auth_path=/cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.735 DEBUG:boto:Method: GET 2024-04-16T18:40:18.735 DEBUG:boto:Path: /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.735 DEBUG:boto:Data: 2024-04-16T18:40:18.735 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.735 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.735 DEBUG:boto:Params: {} 2024-04-16T18:40:18.735 DEBUG:boto:Token: None 2024-04-16T18:40:18.736 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95?versionId=null 2024-04-16T18:40:18.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI= 2024-04-16T18:40:18.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ihzZcg2qAuC8saPGogJ04dt49iI=', 'Content-Length': '0'} 2024-04-16T18:40:18.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aa1acbe9e21a6b50-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.738 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.738 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.738 DEBUG:boto:path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.738 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.739 DEBUG:boto:Method: GET 2024-04-16T18:40:18.739 DEBUG:boto:Path: /cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.739 DEBUG:boto:Data: 2024-04-16T18:40:18.739 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.739 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.739 DEBUG:boto:Params: {} 2024-04-16T18:40:18.739 DEBUG:boto:Token: None 2024-04-16T18:40:18.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.739 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.742 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025a2d05cb1b03a23-00661ec612-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.782 DEBUG:boto:b'cjqttm-54obj951000falseobj952024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.783 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.783 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.783 DEBUG:boto:path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.783 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.783 DEBUG:boto:Method: GET 2024-04-16T18:40:18.783 DEBUG:boto:Path: /cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.783 DEBUG:boto:Data: 2024-04-16T18:40:18.783 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.783 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.783 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.784 DEBUG:boto:Params: {} 2024-04-16T18:40:18.784 DEBUG:boto:Token: None 2024-04-16T18:40:18.784 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.784 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.784 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.787 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000838e32e8cb2a0330-00661ec612-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.788 DEBUG:boto:b'cjqttm-54obj951000falseobj952024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.788 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.788 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.788 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.788 DEBUG:boto:Path: /cjqttm-54/obj95 2024-04-16T18:40:18.788 DEBUG:boto:Data: 2024-04-16T18:40:18.788 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.789 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.789 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.789 DEBUG:boto:Params: {} 2024-04-16T18:40:18.789 DEBUG:boto:Token: None 2024-04-16T18:40:18.789 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95 2024-04-16T18:40:18.789 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RMDzKZJCTeVU+zTHTvIzjx6hvrc= 2024-04-16T18:40:18.789 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RMDzKZJCTeVU+zTHTvIzjx6hvrc=', 'Content-Length': '0'} 2024-04-16T18:40:18.791 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a417af810daa73cb-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.792 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.792 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.792 DEBUG:boto:Method: HEAD 2024-04-16T18:40:18.792 DEBUG:boto:Path: /cjqttm-54/obj95 2024-04-16T18:40:18.792 DEBUG:boto:Data: 2024-04-16T18:40:18.792 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.792 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.792 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.792 DEBUG:boto:Params: {} 2024-04-16T18:40:18.792 DEBUG:boto:Token: None 2024-04-16T18:40:18.793 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95 2024-04-16T18:40:18.793 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RMDzKZJCTeVU+zTHTvIzjx6hvrc= 2024-04-16T18:40:18.793 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RMDzKZJCTeVU+zTHTvIzjx6hvrc=', 'Content-Length': '0'} 2024-04-16T18:40:18.795 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bfe1b837f89930e-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.795 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:40:18.795 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.795 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.795 DEBUG:boto:Method: GET 2024-04-16T18:40:18.795 DEBUG:boto:Path: /cjqttm-54/obj95 2024-04-16T18:40:18.795 DEBUG:boto:Data: 2024-04-16T18:40:18.796 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.796 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.796 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.796 DEBUG:boto:Params: {} 2024-04-16T18:40:18.796 DEBUG:boto:Token: None 2024-04-16T18:40:18.796 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95 2024-04-16T18:40:18.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gRZxiCqb/33lf+8kMVNi8hJ9uUE= 2024-04-16T18:40:18.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gRZxiCqb/33lf+8kMVNi8hJ9uUE=', 'Content-Length': '0'} 2024-04-16T18:40:18.798 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-54:9ba59572-f51c-4bce-9578-e6350e822996.4816.23'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:34:43 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0fbff503c811390-00661ec612-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.842 DEBUG:boto:path=/cjqttm-54/obj95 2024-04-16T18:40:18.842 DEBUG:boto:auth_path=/cjqttm-54/obj95 2024-04-16T18:40:18.843 DEBUG:boto:Method: GET 2024-04-16T18:40:18.843 DEBUG:boto:Path: /cjqttm-54/obj95 2024-04-16T18:40:18.843 DEBUG:boto:Data: 2024-04-16T18:40:18.843 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.843 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.843 DEBUG:boto:Params: {} 2024-04-16T18:40:18.843 DEBUG:boto:Token: None 2024-04-16T18:40:18.843 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/obj95 2024-04-16T18:40:18.844 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gRZxiCqb/33lf+8kMVNi8hJ9uUE= 2024-04-16T18:40:18.844 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gRZxiCqb/33lf+8kMVNi8hJ9uUE=', 'Content-Length': '0'} 2024-04-16T18:40:18.846 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:33:08 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d762438d8aff2ef-00661ec612-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.846 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.846 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.846 DEBUG:boto:path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.847 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.847 DEBUG:boto:Method: GET 2024-04-16T18:40:18.847 DEBUG:boto:Path: /cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.847 DEBUG:boto:Data: 2024-04-16T18:40:18.847 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.847 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:18.847 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.847 DEBUG:boto:Params: {} 2024-04-16T18:40:18.847 DEBUG:boto:Token: None 2024-04-16T18:40:18.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.850 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005beed84acbba4b93-00661ec612-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.890 DEBUG:boto:b'cjqttm-54obj951000falseobj952024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.891 DEBUG:boto:path=/cjqttm-54/ 2024-04-16T18:40:18.891 DEBUG:boto:auth_path=/cjqttm-54/ 2024-04-16T18:40:18.891 DEBUG:boto:path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.891 DEBUG:boto:auth_path=/cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.892 DEBUG:boto:Method: GET 2024-04-16T18:40:18.892 DEBUG:boto:Path: /cjqttm-54/?prefix=obj95 2024-04-16T18:40:18.892 DEBUG:boto:Data: 2024-04-16T18:40:18.892 DEBUG:boto:Headers: {} 2024-04-16T18:40:18.892 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:18.892 DEBUG:boto:Port: 8000 2024-04-16T18:40:18.892 DEBUG:boto:Params: {} 2024-04-16T18:40:18.892 DEBUG:boto:Token: None 2024-04-16T18:40:18.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:18 GMT /cjqttm-54/ 2024-04-16T18:40:18.893 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA= 2024-04-16T18:40:18.893 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WxBxQ0dq8RfROoK9hX0URq4/XRA=', 'Content-Length': '0'} 2024-04-16T18:40:18.896 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b5d9826c5ea00095-00661ec612-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:18.897 DEBUG:boto:b'cjqttm-54obj951000falseobj952024-04-16T18:33:08.726Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:18.897 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-54 zones={test-zone2, test-zone1} 2024-04-16T18:40:18.897 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T18:40:18.898 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:18.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:18.898 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:40:18.951 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:18.952 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:19.039 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000025945","last_update":"2024-04-16T18:33:25.689215Z"},{"marker":"00000000000000000000:00000000000000039891","last_update":"2024-04-16T18:33:10.000859Z"},{"marker":"00000000000000000000:00000000000000034956","last_update":"2024-04-16T18:33:25.691031Z"},{"marker":"00000000000000000000:00000000000000034589","last_update":"2024-04-16T18:33:25.693495Z"}] 2024-04-16T18:40:19.040 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000039891', 2: '00000000000000000000:00000000000000034956', 3: '00000000000000000000:00000000000000034589'} 2024-04-16T18:40:19.040 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:40:19.040 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.040 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:40:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:19.098 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:19.180 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10706311333416280840},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000025945","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000039891","next_step_marker":"","total_entries":45,"pos":24,"timestamp":"2024-04-16T18:33:10.000859Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034956","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:33:25.691031Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034589","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:33:25.693495Z"}}]},"full_sync":{"total":54,"complete":54},"current_time":"2024-04-16T18:40:19Z"} 2024-04-16T18:40:19.181 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":10706311333416280840},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000025945","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000039891","next_step_marker":"","total_entries":45,"pos":24,"timestamp":"2024-04-16T18:33:10.000859Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034956","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:33:25.691031Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034589","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:33:25.693495Z"}}]},"full_sync":{"total":54,"complete":54},"current_time":"2024-04-16T18:40:19Z"} 2024-04-16T18:40:19.181 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000025945', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.689215Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000039891', 'next_step_marker': '', 'total_entries': 45, 'pos': 24, 'timestamp': '2024-04-16T18:33:10.000859Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034956', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.691031Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034589', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.693495Z'}}] 2024-04-16T18:40:19.181 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000039891', 2: '00000000000000000000:00000000000000034956', 3: '00000000000000000000:00000000000000034589'} 2024-04-16T18:40:19.181 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000039891', 2: '00000000000000000000:00000000000000034956', 3: '00000000000000000000:00000000000000034589'} 2024-04-16T18:40:19.181 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:40:19.181 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T18:40:19.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.182 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:40:19.228 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:19.229 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:19.308 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000007548","last_update":"2024-04-16T18:35:00.327228Z"},{"marker":"00000000000000000000:00000000000000016556","last_update":"2024-04-16T18:35:00.329126Z"},{"marker":"00000000000000000000:00000000000000016851","last_update":"2024-04-16T18:35:00.331003Z"},{"marker":"00000000000000000000:00000000000000013363","last_update":"2024-04-16T18:35:00.332954Z"}] 2024-04-16T18:40:19.308 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000007548', 1: '00000000000000000000:00000000000000016556', 2: '00000000000000000000:00000000000000016851', 3: '00000000000000000000:00000000000000013363'} 2024-04-16T18:40:19.308 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:40:19.308 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.309 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.309 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:40:19.360 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:19.360 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:19.437 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007548","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:35:00.327228Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016556","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:35:00.329126Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016851","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:35:00.331003Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013363","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:35:00.332954Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:40:19Z"} 2024-04-16T18:40:19.437 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007548","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:35:00.327228Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016556","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:35:00.329126Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016851","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:35:00.331003Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013363","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:35:00.332954Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:40:19Z"} 2024-04-16T18:40:19.438 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007548', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T18:35:00.327228Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000016556', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:35:00.329126Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000016851', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:35:00.331003Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000013363', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:35:00.332954Z'}}] 2024-04-16T18:40:19.438 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000007548', 1: '00000000000000000000:00000000000000016556', 2: '00000000000000000000:00000000000000016851', 3: '00000000000000000000:00000000000000013363'} 2024-04-16T18:40:19.438 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000007548', 1: '00000000000000000000:00000000000000016556', 2: '00000000000000000000:00000000000000016851', 3: '00000000000000000000:00000000000000013363'} 2024-04-16T18:40:19.438 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:40:19.438 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_full_sync_after_data_sync_init ... ok 2024-04-16T18:40:19.440 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:19.441 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:19.441 DEBUG:boto:Method: PUT 2024-04-16T18:40:19.441 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:19.441 DEBUG:boto:Data: 2024-04-16T18:40:19.441 DEBUG:boto:Headers: {} 2024-04-16T18:40:19.441 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:19.441 DEBUG:boto:Port: 8000 2024-04-16T18:40:19.441 DEBUG:boto:Params: {} 2024-04-16T18:40:19.441 DEBUG:boto:Token: None 2024-04-16T18:40:19.441 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:40:19 GMT /cjqttm-55/ 2024-04-16T18:40:19.442 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/iXV/2aOleYaYbdjXEl84bp2hzI= 2024-04-16T18:40:19.442 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/iXV/2aOleYaYbdjXEl84bp2hzI=', 'Content-Length': '0'} 2024-04-16T18:40:19.458 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000f55111b665835005-00661ec613-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:19.459 DEBUG:rgw_multi.tests:created bucket=cjqttm-55 2024-04-16T18:40:19.459 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.459 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.459 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:40:19.505 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:19.505 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:19.556 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:40:19.580 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713292819.458171_1493.1","last_update":"2024-04-16T18:40:19.458171Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:40:19.580 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292819.458171_1493.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:40:19.581 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:40:19.581 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:40:19.581 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:40:19.629 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:19.629 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:19.683 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:19.683+0000 7f175d720800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:40:19.684 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:19.685+0000 7f175d720800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:40:19.707 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292819.458171_1493.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:19.458171Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:40:19Z"} 2024-04-16T18:40:19.707 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292819.458171_1493.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:19.458171Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:40:19Z"} 2024-04-16T18:40:19.707 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292819.458171_1493.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:19.458171Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:40:19.707 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292819.458171_1493.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:40:19.707 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292819.458171_1493.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:40:19.707 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:40:19.708 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:19.708 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:19.708 DEBUG:boto:Method: HEAD 2024-04-16T18:40:19.708 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:19.708 DEBUG:boto:Data: 2024-04-16T18:40:19.708 DEBUG:boto:Headers: {} 2024-04-16T18:40:19.708 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:19.708 DEBUG:boto:Port: 8000 2024-04-16T18:40:19.708 DEBUG:boto:Params: {} 2024-04-16T18:40:19.708 DEBUG:boto:Token: None 2024-04-16T18:40:19.709 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:19 GMT /cjqttm-55/ 2024-04-16T18:40:19.709 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:++rzbqLhEngqVPA5MyESV6RW46s= 2024-04-16T18:40:19.709 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:++rzbqLhEngqVPA5MyESV6RW46s=', 'Content-Length': '0'} 2024-04-16T18:40:19.711 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000ba9bd1abad586c5-00661ec613-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:19.711 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:19.711 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:19.711 DEBUG:boto:Method: PUT 2024-04-16T18:40:19.711 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:40:19.711 DEBUG:boto:Data: 2024-04-16T18:40:19.712 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:40:19.712 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:19.712 DEBUG:boto:Port: 8000 2024-04-16T18:40:19.712 DEBUG:boto:Params: {} 2024-04-16T18:40:19.712 DEBUG:boto:Token: None 2024-04-16T18:40:19.712 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:40:19 GMT /cjqttm-55/dummy 2024-04-16T18:40:19.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B6Hcg/qpodiWmpSEg6Ar1/bd47A= 2024-04-16T18:40:19.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:40:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B6Hcg/qpodiWmpSEg6Ar1/bd47A='} 2024-04-16T18:40:19.719 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000042178d0c27fd33db-00661ec613-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:19.720 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-55 2024-04-16T18:40:19.720 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:40:19.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:40:19.720 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-55 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:40:19.775 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:19.776 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:19.832 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:19.832+0000 7fa2c3644800 1 waiting to reach incremental sync.. 2024-04-16T18:40:24.834 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:24.835+0000 7fa2c3644800 1 bucket sync caught up with source: 2024-04-16T18:40:24.835 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:40:24.835 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:40:24.835 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:24.835+0000 7fa2c3644800 0 bucket checkpoint complete 2024-04-16T18:40:24.863 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-55 2024-04-16T18:40:24.863 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:40:24.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:40:24.863 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-55 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:40:24.926 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:24.927 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:24.989 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:40:24.990+0000 7fc79d036800 1 waiting to reach incremental sync.. 2024-04-16T18:40:29.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:40:29.993+0000 7fc79d036800 1 bucket sync caught up with source: 2024-04-16T18:40:29.992 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000001.756.6, , , , , ] 2024-04-16T18:40:29.992 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000001.756.6, , , , , ] 2024-04-16T18:40:29.992 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:40:29.993+0000 7fc79d036800 0 bucket checkpoint complete 2024-04-16T18:40:30.020 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-55 zones={test-zone2, test-zone1} 2024-04-16T18:40:30.020 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.020 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.021 DEBUG:boto:Method: HEAD 2024-04-16T18:40:30.021 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:30.021 DEBUG:boto:Data: 2024-04-16T18:40:30.021 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.021 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.021 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.021 DEBUG:boto:Params: {} 2024-04-16T18:40:30.021 DEBUG:boto:Token: None 2024-04-16T18:40:30.022 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/ 2024-04-16T18:40:30.022 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:taOE594qgHi0ggKSuj2pYm1tKOo= 2024-04-16T18:40:30.022 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:taOE594qgHi0ggKSuj2pYm1tKOo=', 'Content-Length': '0'} 2024-04-16T18:40:30.025 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000015b19210a313022b-00661ec61e-6280-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.025 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.025 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.025 DEBUG:boto:Method: HEAD 2024-04-16T18:40:30.025 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:30.025 DEBUG:boto:Data: 2024-04-16T18:40:30.025 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.026 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.026 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.026 DEBUG:boto:Params: {} 2024-04-16T18:40:30.026 DEBUG:boto:Token: None 2024-04-16T18:40:30.026 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/ 2024-04-16T18:40:30.026 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:taOE594qgHi0ggKSuj2pYm1tKOo= 2024-04-16T18:40:30.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:taOE594qgHi0ggKSuj2pYm1tKOo=', 'Content-Length': '0'} 2024-04-16T18:40:30.029 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008f8613e198f08271-00661ec61e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.029 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:40:30.029 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.029 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.029 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.029 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.029 DEBUG:boto:Method: GET 2024-04-16T18:40:30.029 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.029 DEBUG:boto:Data: 2024-04-16T18:40:30.030 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.030 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.030 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.030 DEBUG:boto:Params: {} 2024-04-16T18:40:30.030 DEBUG:boto:Token: None 2024-04-16T18:40:30.030 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/?versions 2024-04-16T18:40:30.030 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk= 2024-04-16T18:40:30.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk=', 'Content-Length': '0'} 2024-04-16T18:40:30.032 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b0e57c3890e99478-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.033 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.033 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T18:40:30.033 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:40:30.034 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.034 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.034 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.034 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.034 DEBUG:boto:Method: GET 2024-04-16T18:40:30.034 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.034 DEBUG:boto:Data: 2024-04-16T18:40:30.034 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.034 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.034 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.034 DEBUG:boto:Params: {} 2024-04-16T18:40:30.034 DEBUG:boto:Token: None 2024-04-16T18:40:30.035 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/?versions 2024-04-16T18:40:30.035 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk= 2024-04-16T18:40:30.035 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk=', 'Content-Length': '0'} 2024-04-16T18:40:30.037 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002c3d6f3239a96b20-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.037 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.038 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T18:40:30.038 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.038 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.038 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.038 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.038 DEBUG:boto:Method: GET 2024-04-16T18:40:30.038 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.038 DEBUG:boto:Data: 2024-04-16T18:40:30.038 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.038 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.038 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.039 DEBUG:boto:Params: {} 2024-04-16T18:40:30.039 DEBUG:boto:Token: None 2024-04-16T18:40:30.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/?versions 2024-04-16T18:40:30.039 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk= 2024-04-16T18:40:30.039 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk=', 'Content-Length': '0'} 2024-04-16T18:40:30.041 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d714d0cad2dfa8c9-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.041 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.042 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.042 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.042 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.042 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.042 DEBUG:boto:Method: GET 2024-04-16T18:40:30.042 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:40:30.042 DEBUG:boto:Data: 2024-04-16T18:40:30.042 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.042 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.042 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.043 DEBUG:boto:Params: {} 2024-04-16T18:40:30.043 DEBUG:boto:Token: None 2024-04-16T18:40:30.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/?versions 2024-04-16T18:40:30.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk= 2024-04-16T18:40:30.043 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Iu2GkXvczkicVPFlifHKuMbxDyk=', 'Content-Length': '0'} 2024-04-16T18:40:30.045 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f1c940bbe050b47d-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.045 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.045 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T18:40:30.046 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.046 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.046 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.046 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.046 DEBUG:boto:Method: GET 2024-04-16T18:40:30.046 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.046 DEBUG:boto:Data: 2024-04-16T18:40:30.046 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.046 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.046 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.046 DEBUG:boto:Params: {} 2024-04-16T18:40:30.047 DEBUG:boto:Token: None 2024-04-16T18:40:30.047 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8= 2024-04-16T18:40:30.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8=', 'Content-Length': '0'} 2024-04-16T18:40:30.049 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060b4ca85f7e68686-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.049 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.049 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.049 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.050 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.050 DEBUG:boto:Method: GET 2024-04-16T18:40:30.050 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.050 DEBUG:boto:Data: 2024-04-16T18:40:30.050 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.050 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.050 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.050 DEBUG:boto:Params: {} 2024-04-16T18:40:30.050 DEBUG:boto:Token: None 2024-04-16T18:40:30.050 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.050 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8= 2024-04-16T18:40:30.051 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8=', 'Content-Length': '0'} 2024-04-16T18:40:30.053 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd38677f8f4840e0-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.053 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.053 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.053 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.053 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.053 DEBUG:boto:Method: HEAD 2024-04-16T18:40:30.053 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.054 DEBUG:boto:Data: 2024-04-16T18:40:30.054 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.054 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.054 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.054 DEBUG:boto:Params: {} 2024-04-16T18:40:30.054 DEBUG:boto:Token: None 2024-04-16T18:40:30.054 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.054 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Z0v0J2SeFRuaTY4zSikUt5DvDg= 2024-04-16T18:40:30.054 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Z0v0J2SeFRuaTY4zSikUt5DvDg=', 'Content-Length': '0'} 2024-04-16T18:40:30.056 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e45a4820b5053742-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.056 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.057 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.057 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.057 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.057 DEBUG:boto:Method: HEAD 2024-04-16T18:40:30.057 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.057 DEBUG:boto:Data: 2024-04-16T18:40:30.057 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.057 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.057 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.057 DEBUG:boto:Params: {} 2024-04-16T18:40:30.057 DEBUG:boto:Token: None 2024-04-16T18:40:30.058 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.058 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Z0v0J2SeFRuaTY4zSikUt5DvDg= 2024-04-16T18:40:30.058 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Z0v0J2SeFRuaTY4zSikUt5DvDg=', 'Content-Length': '0'} 2024-04-16T18:40:30.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000afc0da2dfd675cc3-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.060 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T18:40:30.060 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.060 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.061 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.061 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.061 DEBUG:boto:Method: GET 2024-04-16T18:40:30.061 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.061 DEBUG:boto:Data: 2024-04-16T18:40:30.061 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.061 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.061 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.061 DEBUG:boto:Params: {} 2024-04-16T18:40:30.061 DEBUG:boto:Token: None 2024-04-16T18:40:30.061 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.061 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8= 2024-04-16T18:40:30.062 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8=', 'Content-Length': '0'} 2024-04-16T18:40:30.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002bbe6023903aa4ed-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.064 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.064 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.064 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.064 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.064 DEBUG:boto:Method: GET 2024-04-16T18:40:30.065 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.065 DEBUG:boto:Data: 2024-04-16T18:40:30.065 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.065 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.065 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.065 DEBUG:boto:Params: {} 2024-04-16T18:40:30.065 DEBUG:boto:Token: None 2024-04-16T18:40:30.065 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:40:30.065 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8= 2024-04-16T18:40:30.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrsEXOhqLJTE+XVR4hdrsj2wWK8=', 'Content-Length': '0'} 2024-04-16T18:40:30.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc9d4cce83c8add9-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.068 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.068 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.068 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.068 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.068 DEBUG:boto:Method: GET 2024-04-16T18:40:30.068 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.068 DEBUG:boto:Data: 2024-04-16T18:40:30.068 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.068 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.068 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.068 DEBUG:boto:Params: {} 2024-04-16T18:40:30.069 DEBUG:boto:Token: None 2024-04-16T18:40:30.069 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/ 2024-04-16T18:40:30.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk= 2024-04-16T18:40:30.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk=', 'Content-Length': '0'} 2024-04-16T18:40:30.071 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e6ae2fdbd0dae6b3-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.071 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.072 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.072 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.072 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.072 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.072 DEBUG:boto:Method: GET 2024-04-16T18:40:30.072 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.072 DEBUG:boto:Data: 2024-04-16T18:40:30.072 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.072 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.072 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.072 DEBUG:boto:Params: {} 2024-04-16T18:40:30.073 DEBUG:boto:Token: None 2024-04-16T18:40:30.073 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/ 2024-04-16T18:40:30.073 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk= 2024-04-16T18:40:30.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk=', 'Content-Length': '0'} 2024-04-16T18:40:30.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020490ce036b4fd29-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.118 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.119 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.119 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.119 DEBUG:boto:Method: HEAD 2024-04-16T18:40:30.119 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:40:30.119 DEBUG:boto:Data: 2024-04-16T18:40:30.119 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.119 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.119 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.119 DEBUG:boto:Params: {} 2024-04-16T18:40:30.119 DEBUG:boto:Token: None 2024-04-16T18:40:30.120 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy 2024-04-16T18:40:30.120 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pd20SF2Rrn4matXVsHe355uHv5M= 2024-04-16T18:40:30.120 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pd20SF2Rrn4matXVsHe355uHv5M=', 'Content-Length': '0'} 2024-04-16T18:40:30.122 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce1d9ab63abd3e84-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.122 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.122 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.122 DEBUG:boto:Method: HEAD 2024-04-16T18:40:30.122 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:40:30.122 DEBUG:boto:Data: 2024-04-16T18:40:30.123 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.123 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.123 DEBUG:boto:Params: {} 2024-04-16T18:40:30.123 DEBUG:boto:Token: None 2024-04-16T18:40:30.123 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy 2024-04-16T18:40:30.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pd20SF2Rrn4matXVsHe355uHv5M= 2024-04-16T18:40:30.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pd20SF2Rrn4matXVsHe355uHv5M=', 'Content-Length': '0'} 2024-04-16T18:40:30.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002977f33fde26be55-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.126 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T18:40:30.126 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.126 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.126 DEBUG:boto:Method: GET 2024-04-16T18:40:30.126 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:40:30.126 DEBUG:boto:Data: 2024-04-16T18:40:30.126 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.127 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.127 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.127 DEBUG:boto:Params: {} 2024-04-16T18:40:30.127 DEBUG:boto:Token: None 2024-04-16T18:40:30.127 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy 2024-04-16T18:40:30.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aqymv8gU96FSNdVlpix3J+fesd8= 2024-04-16T18:40:30.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aqymv8gU96FSNdVlpix3J+fesd8=', 'Content-Length': '0'} 2024-04-16T18:40:30.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f71a5e48ebe26bb3-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.170 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:40:30.171 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:40:30.171 DEBUG:boto:Method: GET 2024-04-16T18:40:30.171 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:40:30.171 DEBUG:boto:Data: 2024-04-16T18:40:30.171 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.171 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.171 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.171 DEBUG:boto:Params: {} 2024-04-16T18:40:30.171 DEBUG:boto:Token: None 2024-04-16T18:40:30.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/dummy 2024-04-16T18:40:30.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Aqymv8gU96FSNdVlpix3J+fesd8= 2024-04-16T18:40:30.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Aqymv8gU96FSNdVlpix3J+fesd8=', 'Content-Length': '0'} 2024-04-16T18:40:30.174 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000598619d3fffc55b4-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.174 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.174 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.174 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.174 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.174 DEBUG:boto:Method: GET 2024-04-16T18:40:30.174 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.175 DEBUG:boto:Data: 2024-04-16T18:40:30.175 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.175 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:30.175 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.175 DEBUG:boto:Params: {} 2024-04-16T18:40:30.175 DEBUG:boto:Token: None 2024-04-16T18:40:30.175 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/ 2024-04-16T18:40:30.175 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk= 2024-04-16T18:40:30.175 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk=', 'Content-Length': '0'} 2024-04-16T18:40:30.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000c37ad1d05ae2f90-00661ec61e-6280-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.178 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.178 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:30.178 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:30.178 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.178 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.178 DEBUG:boto:Method: GET 2024-04-16T18:40:30.179 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:40:30.179 DEBUG:boto:Data: 2024-04-16T18:40:30.179 DEBUG:boto:Headers: {} 2024-04-16T18:40:30.179 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:30.179 DEBUG:boto:Port: 8000 2024-04-16T18:40:30.179 DEBUG:boto:Params: {} 2024-04-16T18:40:30.179 DEBUG:boto:Token: None 2024-04-16T18:40:30.179 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:40:30 GMT /cjqttm-55/ 2024-04-16T18:40:30.179 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk= 2024-04-16T18:40:30.179 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:30 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mwFchqHK2v+fxf/La4HKnGVhvVk=', 'Content-Length': '0'} 2024-04-16T18:40:30.182 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f697de447ea71c60-00661ec61e-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:30 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:30.182 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:40:30.182 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-55 zones={test-zone2, test-zone1} 2024-04-16T18:40:30.183 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:40:30.183 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:40:30.184 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:40:30.184+0000 7f93e2e1d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 208282) UID: 0 2024-04-16T18:40:30.184 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:40:30.184+0000 7f93e8e2f880 -1 shutting down 2024-04-16T18:40:35.873 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:40:36.283 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:40:36.284 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:36.284 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:36.284 DEBUG:boto:Method: HEAD 2024-04-16T18:40:36.284 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:36.284 DEBUG:boto:Data: 2024-04-16T18:40:36.284 DEBUG:boto:Headers: {} 2024-04-16T18:40:36.284 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.284 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.284 DEBUG:boto:Params: {} 2024-04-16T18:40:36.285 DEBUG:boto:Token: None 2024-04-16T18:40:36.285 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/ 2024-04-16T18:40:36.285 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw= 2024-04-16T18:40:36.285 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw=', 'Content-Length': '0'} 2024-04-16T18:40:36.288 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a59a4ad7d2fc5ec-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.288 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:40:36.288 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:40:36.288 DEBUG:boto:Method: PUT 2024-04-16T18:40:36.289 DEBUG:boto:Path: /cjqttm-55/obj11 2024-04-16T18:40:36.289 DEBUG:boto:Data: 2024-04-16T18:40:36.289 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:40:36.289 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.289 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.289 DEBUG:boto:Params: {} 2024-04-16T18:40:36.289 DEBUG:boto:Token: None 2024-04-16T18:40:36.289 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/obj11 2024-04-16T18:40:36.289 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q7qgxtVlY7MSs50aQfFnDvkGyys= 2024-04-16T18:40:36.290 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q7qgxtVlY7MSs50aQfFnDvkGyys='} 2024-04-16T18:40:36.297 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000685166af4f14eed4-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.297 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:36.297 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:36.297 DEBUG:boto:Method: HEAD 2024-04-16T18:40:36.297 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:36.297 DEBUG:boto:Data: 2024-04-16T18:40:36.297 DEBUG:boto:Headers: {} 2024-04-16T18:40:36.297 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.298 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.298 DEBUG:boto:Params: {} 2024-04-16T18:40:36.298 DEBUG:boto:Token: None 2024-04-16T18:40:36.298 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/ 2024-04-16T18:40:36.298 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw= 2024-04-16T18:40:36.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw=', 'Content-Length': '0'} 2024-04-16T18:40:36.300 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069ce0b71056bd66f-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.301 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:40:36.301 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:40:36.301 DEBUG:boto:Method: PUT 2024-04-16T18:40:36.301 DEBUG:boto:Path: /cjqttm-55/obj22 2024-04-16T18:40:36.301 DEBUG:boto:Data: 2024-04-16T18:40:36.301 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:40:36.301 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.301 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.301 DEBUG:boto:Params: {} 2024-04-16T18:40:36.301 DEBUG:boto:Token: None 2024-04-16T18:40:36.302 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/obj22 2024-04-16T18:40:36.302 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HB5SIUnH+VNjx1doNam7wEVbpkE= 2024-04-16T18:40:36.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HB5SIUnH+VNjx1doNam7wEVbpkE='} 2024-04-16T18:40:36.346 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b2e5d4efd2692211-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.347 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:36.347 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:36.347 DEBUG:boto:Method: HEAD 2024-04-16T18:40:36.347 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:36.347 DEBUG:boto:Data: 2024-04-16T18:40:36.347 DEBUG:boto:Headers: {} 2024-04-16T18:40:36.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.347 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.348 DEBUG:boto:Params: {} 2024-04-16T18:40:36.348 DEBUG:boto:Token: None 2024-04-16T18:40:36.348 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/ 2024-04-16T18:40:36.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw= 2024-04-16T18:40:36.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw=', 'Content-Length': '0'} 2024-04-16T18:40:36.350 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005d59ca3a6e71cac2-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.351 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:40:36.351 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:40:36.351 DEBUG:boto:Method: PUT 2024-04-16T18:40:36.351 DEBUG:boto:Path: /cjqttm-55/obj33 2024-04-16T18:40:36.351 DEBUG:boto:Data: 2024-04-16T18:40:36.351 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:40:36.352 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.352 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.352 DEBUG:boto:Params: {} 2024-04-16T18:40:36.352 DEBUG:boto:Token: None 2024-04-16T18:40:36.352 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/obj33 2024-04-16T18:40:36.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GZu/Ax30+OCI2yan1Y8BMiSJsZk= 2024-04-16T18:40:36.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GZu/Ax30+OCI2yan1Y8BMiSJsZk='} 2024-04-16T18:40:36.359 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000062a9c4f9e4e04a10-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.359 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:36.359 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:36.359 DEBUG:boto:Method: HEAD 2024-04-16T18:40:36.360 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:36.360 DEBUG:boto:Data: 2024-04-16T18:40:36.360 DEBUG:boto:Headers: {} 2024-04-16T18:40:36.360 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.360 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.360 DEBUG:boto:Params: {} 2024-04-16T18:40:36.360 DEBUG:boto:Token: None 2024-04-16T18:40:36.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/ 2024-04-16T18:40:36.361 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw= 2024-04-16T18:40:36.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw=', 'Content-Length': '0'} 2024-04-16T18:40:36.363 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d053c8d317ff6c2b-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.363 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:40:36.363 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:40:36.364 DEBUG:boto:Method: PUT 2024-04-16T18:40:36.364 DEBUG:boto:Path: /cjqttm-55/obj44 2024-04-16T18:40:36.364 DEBUG:boto:Data: 2024-04-16T18:40:36.364 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:40:36.364 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.364 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.364 DEBUG:boto:Params: {} 2024-04-16T18:40:36.364 DEBUG:boto:Token: None 2024-04-16T18:40:36.365 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/obj44 2024-04-16T18:40:36.365 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0Xu7erfIt2txOr30jwUXNY1f3ho= 2024-04-16T18:40:36.365 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0Xu7erfIt2txOr30jwUXNY1f3ho='} 2024-04-16T18:40:36.406 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f5cb3f018e01c930-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.407 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:40:36.407 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:40:36.407 DEBUG:boto:Method: HEAD 2024-04-16T18:40:36.407 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:40:36.407 DEBUG:boto:Data: 2024-04-16T18:40:36.407 DEBUG:boto:Headers: {} 2024-04-16T18:40:36.407 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.407 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.408 DEBUG:boto:Params: {} 2024-04-16T18:40:36.408 DEBUG:boto:Token: None 2024-04-16T18:40:36.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/ 2024-04-16T18:40:36.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw= 2024-04-16T18:40:36.408 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jAgdaT6a/rKG5pY1GgRxutbamCw=', 'Content-Length': '0'} 2024-04-16T18:40:36.410 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003c814b2526d4aab3-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.411 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:40:36.411 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:40:36.411 DEBUG:boto:Method: PUT 2024-04-16T18:40:36.411 DEBUG:boto:Path: /cjqttm-55/obj55 2024-04-16T18:40:36.411 DEBUG:boto:Data: 2024-04-16T18:40:36.411 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:40:36.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:40:36.411 DEBUG:boto:Port: 8000 2024-04-16T18:40:36.411 DEBUG:boto:Params: {} 2024-04-16T18:40:36.412 DEBUG:boto:Token: None 2024-04-16T18:40:36.412 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:40:36 GMT /cjqttm-55/obj55 2024-04-16T18:40:36.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iNCSxlVC7k9+npYA8yWNWZYKSzQ= 2024-04-16T18:40:36.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:40:36 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iNCSxlVC7k9+npYA8yWNWZYKSzQ='} 2024-04-16T18:40:36.417 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b62f49c2dc6ce36e-00661ec624-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:40:36.417 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:40:36.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:40:36.417 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:40:36.474 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:36.474 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:36.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:36.532+0000 7fc015baf800 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-16T18:40:36.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:36.534+0000 7fc015baf800 5 RGW-SYNC:data: acquired data sync status lease 2024-04-16T18:40:36.568 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:40:36.568 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:40:36.571 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:40:36.571 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:36.590 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:40:36.590 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:40:36.590 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:40:36.591 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:40:36.591 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:40:36.776 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:40:36.777+0000 7f5d70ecc880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:40:37.593 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:40:37.614 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:40:37.614 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:40:37.615 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:40:37.616 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:40:37.616 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-55 2024-04-16T18:40:37.617 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:40:37.617 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:40:37.617 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-55 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:40:37.712 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:40:37.712 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:40:37.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:37.771+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:40:37.771 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:40:37.771 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:40:41.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:40:42.772 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:42.773+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:40:42.773 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:40:42.773 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:40:47.774 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:47.775+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:40:47.774 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:40:47.774 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:40:52.775 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:52.776+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:40:52.775 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:40:52.775 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:40:57.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:40:57.777+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:40:57.777 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:40:57.777 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:02.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:02.778+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:02.778 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:02.778 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:07.779 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:07.779+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:07.779 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:07.779 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:12.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:12.780+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:12.780 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:12.780 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:17.782 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:17.782+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:17.782 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:17.782 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:22.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:22.783+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:22.783 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:22.783 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:27.784 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:27.785+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:27.785 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:27.785 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:32.786 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:32.787+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:32.786 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:32.786 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:37.788 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:37.789+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:37.788 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:37.788 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:42.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:42.790+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:42.789 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:42.789 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:47.790 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:47.791+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:47.790 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:47.791 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:52.792 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:52.792+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:52.792 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:52.792 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:41:57.793 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:41:57.793+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:41:57.793 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:41:57.793 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:42:02.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:02.794+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:42:02.794 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:42:02.794 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:42:07.795 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:07.795+0000 7f5e28a36800 1 waiting for incremental sync to catch up: 2024-04-16T18:42:07.796 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , , , ] 2024-04-16T18:42:07.796 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:42:12.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:12.797+0000 7f5e28a36800 1 bucket sync caught up with source: 2024-04-16T18:42:12.796 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:42:12.797 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , 00000000001.90.6, , , 00000000001.74.6, 00000000002.104.6, 00000000002.110.6] 2024-04-16T18:42:12.797 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:12.797+0000 7f5e28a36800 0 bucket checkpoint complete 2024-04-16T18:42:12.825 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-55 2024-04-16T18:42:12.825 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:42:12.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-55', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:42:12.826 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-55 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:42:12.888 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:12.889 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:12.952 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:42:12.953+0000 7f8e2c214800 1 waiting for incremental sync to catch up: 2024-04-16T18:42:12.952 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000001.756.6, , , 00000000001.350.6, 00000000002.668.6, ] 2024-04-16T18:42:12.952 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000001.756.6, , , 00000000001.350.6, 00000000002.668.6, 00000000002.467.6] 2024-04-16T18:42:17.953 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:42:17.954+0000 7f8e2c214800 1 bucket sync caught up with source: 2024-04-16T18:42:17.954 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , 00000000001.756.6, , , 00000000001.350.6, 00000000002.668.6, 00000000002.467.6] 2024-04-16T18:42:17.954 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , 00000000001.756.6, , , 00000000001.350.6, 00000000002.668.6, 00000000002.467.6] 2024-04-16T18:42:17.954 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:42:17.954+0000 7f8e2c214800 0 bucket checkpoint complete 2024-04-16T18:42:17.981 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-55 zones={test-zone2, test-zone1} 2024-04-16T18:42:17.981 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:17.981 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:17.982 DEBUG:boto:Method: HEAD 2024-04-16T18:42:17.982 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:42:17.982 DEBUG:boto:Data: 2024-04-16T18:42:17.982 DEBUG:boto:Headers: {} 2024-04-16T18:42:17.982 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:17.982 DEBUG:boto:Port: 8000 2024-04-16T18:42:17.982 DEBUG:boto:Params: {} 2024-04-16T18:42:17.983 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:42:17.983 DEBUG:boto:Token: None 2024-04-16T18:42:17.983 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:17 GMT /cjqttm-55/ 2024-04-16T18:42:17.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eGEoqDelF33YHyQE3bSfgSqLld4= 2024-04-16T18:42:17.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eGEoqDelF33YHyQE3bSfgSqLld4=', 'Content-Length': '0'} 2024-04-16T18:42:17.991 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000634d65ba4f6f43dd-00661ec689-6331-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:17.991 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:17.991 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:17.991 DEBUG:boto:Method: HEAD 2024-04-16T18:42:17.992 DEBUG:boto:Path: /cjqttm-55/ 2024-04-16T18:42:17.992 DEBUG:boto:Data: 2024-04-16T18:42:17.992 DEBUG:boto:Headers: {} 2024-04-16T18:42:17.992 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:17.992 DEBUG:boto:Port: 8000 2024-04-16T18:42:17.992 DEBUG:boto:Params: {} 2024-04-16T18:42:17.992 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:42:17.992 DEBUG:boto:Token: None 2024-04-16T18:42:17.992 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:17 GMT /cjqttm-55/ 2024-04-16T18:42:17.993 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eGEoqDelF33YHyQE3bSfgSqLld4= 2024-04-16T18:42:17.993 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eGEoqDelF33YHyQE3bSfgSqLld4=', 'Content-Length': '0'} 2024-04-16T18:42:17.997 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005f8cebddbb7030c7-00661ec689-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:17 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:17.997 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:42:17.997 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:17.997 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:17.997 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:17.997 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:17.998 DEBUG:boto:Method: GET 2024-04-16T18:42:17.998 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:17.998 DEBUG:boto:Data: 2024-04-16T18:42:17.998 DEBUG:boto:Headers: {} 2024-04-16T18:42:17.998 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:17.998 DEBUG:boto:Port: 8000 2024-04-16T18:42:17.998 DEBUG:boto:Params: {} 2024-04-16T18:42:17.998 DEBUG:boto:Token: None 2024-04-16T18:42:17.998 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:17 GMT /cjqttm-55/?versions 2024-04-16T18:42:17.998 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XOBijGKnAraQzMLg2cKX55MtYNY= 2024-04-16T18:42:17.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:17 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XOBijGKnAraQzMLg2cKX55MtYNY=', 'Content-Length': '0'} 2024-04-16T18:42:18.001 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000984801e35dca5e01-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.001 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj11nulltrue2024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.002 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T18:42:18.002 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:42:18.002 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:42:18.003 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:42:18.003 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:42:18.003 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:42:18.003 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:42:18.003 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.003 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.003 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.003 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.003 DEBUG:boto:Method: GET 2024-04-16T18:42:18.003 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.003 DEBUG:boto:Data: 2024-04-16T18:42:18.003 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.004 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.004 DEBUG:boto:Params: {} 2024-04-16T18:42:18.004 DEBUG:boto:Token: None 2024-04-16T18:42:18.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/?versions 2024-04-16T18:42:18.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VVDOi9UkWSnb9/aXbqpdcz+aCTc= 2024-04-16T18:42:18.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVDOi9UkWSnb9/aXbqpdcz+aCTc=', 'Content-Length': '0'} 2024-04-16T18:42:18.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c3afeef618264e52-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.007 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj11nulltrue2024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.008 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2024-04-16T18:42:18.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:42:18.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:42:18.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:42:18.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:42:18.008 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:42:18.008 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.008 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.008 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.008 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.009 DEBUG:boto:Method: GET 2024-04-16T18:42:18.009 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.009 DEBUG:boto:Data: 2024-04-16T18:42:18.009 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.009 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.009 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.009 DEBUG:boto:Params: {} 2024-04-16T18:42:18.009 DEBUG:boto:Token: None 2024-04-16T18:42:18.009 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/?versions 2024-04-16T18:42:18.009 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VVDOi9UkWSnb9/aXbqpdcz+aCTc= 2024-04-16T18:42:18.010 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVDOi9UkWSnb9/aXbqpdcz+aCTc=', 'Content-Length': '0'} 2024-04-16T18:42:18.012 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cdef60e785cbdd24-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.012 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj11nulltrue2024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.012 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.013 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.013 DEBUG:boto:path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.013 DEBUG:boto:auth_path=/cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.013 DEBUG:boto:Method: GET 2024-04-16T18:42:18.013 DEBUG:boto:Path: /cjqttm-55/?versions&max-keys=999 2024-04-16T18:42:18.013 DEBUG:boto:Data: 2024-04-16T18:42:18.013 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.013 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.013 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.013 DEBUG:boto:Params: {} 2024-04-16T18:42:18.013 DEBUG:boto:Token: None 2024-04-16T18:42:18.014 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/?versions 2024-04-16T18:42:18.014 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VVDOi9UkWSnb9/aXbqpdcz+aCTc= 2024-04-16T18:42:18.014 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVDOi9UkWSnb9/aXbqpdcz+aCTc=', 'Content-Length': '0'} 2024-04-16T18:42:18.016 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000001291a55de5ba00d-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.016 DEBUG:boto:b'cjqttm-55999falsedummynulltrue2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj11nulltrue2024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.017 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T18:42:18.017 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.017 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.017 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.017 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.017 DEBUG:boto:Method: GET 2024-04-16T18:42:18.017 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.017 DEBUG:boto:Data: 2024-04-16T18:42:18.018 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.018 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.018 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.018 DEBUG:boto:Params: {} 2024-04-16T18:42:18.018 DEBUG:boto:Token: None 2024-04-16T18:42:18.018 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.018 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M= 2024-04-16T18:42:18.018 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M=', 'Content-Length': '0'} 2024-04-16T18:42:18.021 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4e6ade535ae301f-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.021 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.021 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.021 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.022 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.022 DEBUG:boto:Method: GET 2024-04-16T18:42:18.022 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.022 DEBUG:boto:Data: 2024-04-16T18:42:18.022 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.022 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.022 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.022 DEBUG:boto:Params: {} 2024-04-16T18:42:18.022 DEBUG:boto:Token: None 2024-04-16T18:42:18.022 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M= 2024-04-16T18:42:18.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M=', 'Content-Length': '0'} 2024-04-16T18:42:18.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a5ec7476f5f546c8-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.025 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.025 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.025 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.025 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.025 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.025 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.025 DEBUG:boto:Data: 2024-04-16T18:42:18.026 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.026 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.026 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.026 DEBUG:boto:Params: {} 2024-04-16T18:42:18.026 DEBUG:boto:Token: None 2024-04-16T18:42:18.026 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.026 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M6iT63/53pK6Nojej8pJ2UtZKNg= 2024-04-16T18:42:18.026 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M6iT63/53pK6Nojej8pJ2UtZKNg=', 'Content-Length': '0'} 2024-04-16T18:42:18.028 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062340caf058ae48f-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.028 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.029 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.029 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.029 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.029 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.029 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.029 DEBUG:boto:Data: 2024-04-16T18:42:18.029 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.029 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.029 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.029 DEBUG:boto:Params: {} 2024-04-16T18:42:18.030 DEBUG:boto:Token: None 2024-04-16T18:42:18.030 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.030 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M6iT63/53pK6Nojej8pJ2UtZKNg= 2024-04-16T18:42:18.030 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M6iT63/53pK6Nojej8pJ2UtZKNg=', 'Content-Length': '0'} 2024-04-16T18:42:18.032 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6067178c9f13469-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.032 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T18:42:18.032 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.032 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.032 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.033 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.033 DEBUG:boto:Method: GET 2024-04-16T18:42:18.033 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.033 DEBUG:boto:Data: 2024-04-16T18:42:18.033 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.033 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.033 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.033 DEBUG:boto:Params: {} 2024-04-16T18:42:18.033 DEBUG:boto:Token: None 2024-04-16T18:42:18.033 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.034 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M= 2024-04-16T18:42:18.034 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M=', 'Content-Length': '0'} 2024-04-16T18:42:18.036 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d60569b922ada67e-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.036 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.036 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.037 DEBUG:boto:path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.037 DEBUG:boto:auth_path=/cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.037 DEBUG:boto:Method: GET 2024-04-16T18:42:18.037 DEBUG:boto:Path: /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.037 DEBUG:boto:Data: 2024-04-16T18:42:18.037 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.037 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.037 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.037 DEBUG:boto:Params: {} 2024-04-16T18:42:18.037 DEBUG:boto:Token: None 2024-04-16T18:42:18.038 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy?versionId=null 2024-04-16T18:42:18.038 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M= 2024-04-16T18:42:18.038 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lZ0BeCcSapHQ7ysLfrA2ZWxCW4M=', 'Content-Length': '0'} 2024-04-16T18:42:18.040 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002161ed1a42a37d0d-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.040 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.040 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.040 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.040 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.041 DEBUG:boto:Method: GET 2024-04-16T18:42:18.041 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.041 DEBUG:boto:Data: 2024-04-16T18:42:18.041 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.041 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.041 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.041 DEBUG:boto:Params: {} 2024-04-16T18:42:18.041 DEBUG:boto:Token: None 2024-04-16T18:42:18.041 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.041 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.041 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.044 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003229668a2f70f8a3-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.086 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.087 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.087 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.087 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.087 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.087 DEBUG:boto:Method: GET 2024-04-16T18:42:18.087 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.087 DEBUG:boto:Data: 2024-04-16T18:42:18.087 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.087 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.088 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.088 DEBUG:boto:Params: {} 2024-04-16T18:42:18.088 DEBUG:boto:Token: None 2024-04-16T18:42:18.088 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.088 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.088 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.090 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000085cc71bfcb5034a3-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.090 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.091 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.091 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.091 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.091 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:42:18.091 DEBUG:boto:Data: 2024-04-16T18:42:18.091 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.091 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.092 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.092 DEBUG:boto:Params: {} 2024-04-16T18:42:18.092 DEBUG:boto:Token: None 2024-04-16T18:42:18.092 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy 2024-04-16T18:42:18.092 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gLsB1WZ7WmRZ6mgQcqOHHW9TAvE= 2024-04-16T18:42:18.092 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gLsB1WZ7WmRZ6mgQcqOHHW9TAvE=', 'Content-Length': '0'} 2024-04-16T18:42:18.094 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049fbc38f37da06d1-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.094 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.094 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.094 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.095 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:42:18.095 DEBUG:boto:Data: 2024-04-16T18:42:18.095 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.095 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.095 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.095 DEBUG:boto:Params: {} 2024-04-16T18:42:18.095 DEBUG:boto:Token: None 2024-04-16T18:42:18.095 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy 2024-04-16T18:42:18.095 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gLsB1WZ7WmRZ6mgQcqOHHW9TAvE= 2024-04-16T18:42:18.095 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gLsB1WZ7WmRZ6mgQcqOHHW9TAvE=', 'Content-Length': '0'} 2024-04-16T18:42:18.097 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b4b7e2b25632922-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.098 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2024-04-16T18:42:18.098 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.098 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.098 DEBUG:boto:Method: GET 2024-04-16T18:42:18.098 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:42:18.098 DEBUG:boto:Data: 2024-04-16T18:42:18.098 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.098 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.098 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.098 DEBUG:boto:Params: {} 2024-04-16T18:42:18.099 DEBUG:boto:Token: None 2024-04-16T18:42:18.099 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy 2024-04-16T18:42:18.099 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gmox9GXMO3fJxnSxMPZir1dvPH4= 2024-04-16T18:42:18.099 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gmox9GXMO3fJxnSxMPZir1dvPH4=', 'Content-Length': '0'} 2024-04-16T18:42:18.101 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:40:23 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000847ce9b137b3739a-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.142 DEBUG:boto:path=/cjqttm-55/dummy 2024-04-16T18:42:18.142 DEBUG:boto:auth_path=/cjqttm-55/dummy 2024-04-16T18:42:18.143 DEBUG:boto:Method: GET 2024-04-16T18:42:18.143 DEBUG:boto:Path: /cjqttm-55/dummy 2024-04-16T18:42:18.143 DEBUG:boto:Data: 2024-04-16T18:42:18.143 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.143 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.143 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.143 DEBUG:boto:Params: {} 2024-04-16T18:42:18.143 DEBUG:boto:Token: None 2024-04-16T18:42:18.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/dummy 2024-04-16T18:42:18.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gmox9GXMO3fJxnSxMPZir1dvPH4= 2024-04-16T18:42:18.144 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gmox9GXMO3fJxnSxMPZir1dvPH4=', 'Content-Length': '0'} 2024-04-16T18:42:18.146 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:19 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000067dc6ec0d26637eb-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.146 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.146 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.146 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.146 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.146 DEBUG:boto:Method: GET 2024-04-16T18:42:18.146 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.147 DEBUG:boto:Data: 2024-04-16T18:42:18.147 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.147 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.147 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.147 DEBUG:boto:Params: {} 2024-04-16T18:42:18.147 DEBUG:boto:Token: None 2024-04-16T18:42:18.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000206cde831555ff6c-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.150 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.150 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.150 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.150 DEBUG:boto:path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.150 DEBUG:boto:auth_path=/cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.151 DEBUG:boto:Method: GET 2024-04-16T18:42:18.151 DEBUG:boto:Path: /cjqttm-55/?prefix=dummy 2024-04-16T18:42:18.151 DEBUG:boto:Data: 2024-04-16T18:42:18.151 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.151 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.151 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.151 DEBUG:boto:Params: {} 2024-04-16T18:42:18.151 DEBUG:boto:Token: None 2024-04-16T18:42:18.151 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.151 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.154 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013556d954dc58332-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.154 DEBUG:boto:b'cjqttm-55dummy1000falsedummy2024-04-16T18:40:19.716Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.155 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:42:18.155 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.155 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.155 DEBUG:boto:path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.155 DEBUG:boto:auth_path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.155 DEBUG:boto:Method: GET 2024-04-16T18:42:18.155 DEBUG:boto:Path: /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.155 DEBUG:boto:Data: 2024-04-16T18:42:18.155 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.155 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.155 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.155 DEBUG:boto:Params: {} 2024-04-16T18:42:18.156 DEBUG:boto:Token: None 2024-04-16T18:42:18.156 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.156 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI= 2024-04-16T18:42:18.156 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI=', 'Content-Length': '0'} 2024-04-16T18:42:18.158 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a5c23a004def200-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.198 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.198 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.198 DEBUG:boto:path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.198 DEBUG:boto:auth_path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.199 DEBUG:boto:Method: GET 2024-04-16T18:42:18.199 DEBUG:boto:Path: /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.199 DEBUG:boto:Data: 2024-04-16T18:42:18.199 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.199 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.199 DEBUG:boto:Params: {} 2024-04-16T18:42:18.199 DEBUG:boto:Token: None 2024-04-16T18:42:18.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI= 2024-04-16T18:42:18.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI=', 'Content-Length': '0'} 2024-04-16T18:42:18.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc24ebe1476361dc-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.202 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.202 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.202 DEBUG:boto:path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.202 DEBUG:boto:auth_path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.202 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.202 DEBUG:boto:Path: /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.203 DEBUG:boto:Data: 2024-04-16T18:42:18.203 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.203 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.203 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.203 DEBUG:boto:Params: {} 2024-04-16T18:42:18.203 DEBUG:boto:Token: None 2024-04-16T18:42:18.203 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OgOGwpYgm6f5CBkG/4/CQsg+sLo= 2024-04-16T18:42:18.203 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OgOGwpYgm6f5CBkG/4/CQsg+sLo=', 'Content-Length': '0'} 2024-04-16T18:42:18.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed5698086ad8118a-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.206 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.206 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.206 DEBUG:boto:path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.206 DEBUG:boto:auth_path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.206 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.206 DEBUG:boto:Path: /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.206 DEBUG:boto:Data: 2024-04-16T18:42:18.206 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.206 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.206 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.206 DEBUG:boto:Params: {} 2024-04-16T18:42:18.207 DEBUG:boto:Token: None 2024-04-16T18:42:18.207 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:OgOGwpYgm6f5CBkG/4/CQsg+sLo= 2024-04-16T18:42:18.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OgOGwpYgm6f5CBkG/4/CQsg+sLo=', 'Content-Length': '0'} 2024-04-16T18:42:18.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007ddbc04bd4ef084-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.209 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:42:18.209 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.209 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.209 DEBUG:boto:path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.209 DEBUG:boto:auth_path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.209 DEBUG:boto:Method: GET 2024-04-16T18:42:18.209 DEBUG:boto:Path: /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.210 DEBUG:boto:Data: 2024-04-16T18:42:18.210 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.210 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.210 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.210 DEBUG:boto:Params: {} 2024-04-16T18:42:18.210 DEBUG:boto:Token: None 2024-04-16T18:42:18.210 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.210 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI= 2024-04-16T18:42:18.210 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI=', 'Content-Length': '0'} 2024-04-16T18:42:18.212 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba13322d9c3cd75a-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.254 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.254 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.254 DEBUG:boto:path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.255 DEBUG:boto:auth_path=/cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.255 DEBUG:boto:Method: GET 2024-04-16T18:42:18.255 DEBUG:boto:Path: /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.255 DEBUG:boto:Data: 2024-04-16T18:42:18.255 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.255 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.255 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.255 DEBUG:boto:Params: {} 2024-04-16T18:42:18.255 DEBUG:boto:Token: None 2024-04-16T18:42:18.255 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11?versionId=null 2024-04-16T18:42:18.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI= 2024-04-16T18:42:18.256 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aa4FWxwjH0n/LvO0LB/r/5t3TWI=', 'Content-Length': '0'} 2024-04-16T18:42:18.258 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d911fff4f531caf7-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.258 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.258 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.259 DEBUG:boto:path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.259 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.259 DEBUG:boto:Method: GET 2024-04-16T18:42:18.259 DEBUG:boto:Path: /cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.259 DEBUG:boto:Data: 2024-04-16T18:42:18.259 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.259 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.259 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.259 DEBUG:boto:Params: {} 2024-04-16T18:42:18.259 DEBUG:boto:Token: None 2024-04-16T18:42:18.260 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.262 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006161e77cbfc34b9e-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.262 DEBUG:boto:b'cjqttm-55obj111000falseobj112024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.262 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.263 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.263 DEBUG:boto:path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.263 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.263 DEBUG:boto:Method: GET 2024-04-16T18:42:18.263 DEBUG:boto:Path: /cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.263 DEBUG:boto:Data: 2024-04-16T18:42:18.263 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.263 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.263 DEBUG:boto:Params: {} 2024-04-16T18:42:18.263 DEBUG:boto:Token: None 2024-04-16T18:42:18.264 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.266 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d95fa27cc5d278f-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.266 DEBUG:boto:b'cjqttm-55obj111000falseobj112024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.267 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.267 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.267 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.267 DEBUG:boto:Path: /cjqttm-55/obj11 2024-04-16T18:42:18.267 DEBUG:boto:Data: 2024-04-16T18:42:18.267 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.267 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.267 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.267 DEBUG:boto:Params: {} 2024-04-16T18:42:18.267 DEBUG:boto:Token: None 2024-04-16T18:42:18.268 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11 2024-04-16T18:42:18.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ThdcAYVTr+RbwHgXHr+lkVF9eU0= 2024-04-16T18:42:18.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ThdcAYVTr+RbwHgXHr+lkVF9eU0=', 'Content-Length': '0'} 2024-04-16T18:42:18.270 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000372a23ba02773da5-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.270 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.270 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.270 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.270 DEBUG:boto:Path: /cjqttm-55/obj11 2024-04-16T18:42:18.270 DEBUG:boto:Data: 2024-04-16T18:42:18.271 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.271 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.271 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.271 DEBUG:boto:Params: {} 2024-04-16T18:42:18.271 DEBUG:boto:Token: None 2024-04-16T18:42:18.271 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11 2024-04-16T18:42:18.271 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ThdcAYVTr+RbwHgXHr+lkVF9eU0= 2024-04-16T18:42:18.271 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ThdcAYVTr+RbwHgXHr+lkVF9eU0=', 'Content-Length': '0'} 2024-04-16T18:42:18.273 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092eac37e19e85ea9-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:42:18.274 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.274 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.274 DEBUG:boto:Method: GET 2024-04-16T18:42:18.274 DEBUG:boto:Path: /cjqttm-55/obj11 2024-04-16T18:42:18.274 DEBUG:boto:Data: 2024-04-16T18:42:18.274 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.274 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.274 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.275 DEBUG:boto:Params: {} 2024-04-16T18:42:18.275 DEBUG:boto:Token: None 2024-04-16T18:42:18.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11 2024-04-16T18:42:18.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q7WM1pqaw7v8DPnAw5qJHbb6F1A= 2024-04-16T18:42:18.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q7WM1pqaw7v8DPnAw5qJHbb6F1A=', 'Content-Length': '0'} 2024-04-16T18:42:18.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001546f1eaf44d8667-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.318 DEBUG:boto:path=/cjqttm-55/obj11 2024-04-16T18:42:18.318 DEBUG:boto:auth_path=/cjqttm-55/obj11 2024-04-16T18:42:18.319 DEBUG:boto:Method: GET 2024-04-16T18:42:18.319 DEBUG:boto:Path: /cjqttm-55/obj11 2024-04-16T18:42:18.319 DEBUG:boto:Data: 2024-04-16T18:42:18.319 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.319 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.319 DEBUG:boto:Params: {} 2024-04-16T18:42:18.319 DEBUG:boto:Token: None 2024-04-16T18:42:18.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj11 2024-04-16T18:42:18.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q7WM1pqaw7v8DPnAw5qJHbb6F1A= 2024-04-16T18:42:18.319 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q7WM1pqaw7v8DPnAw5qJHbb6F1A=', 'Content-Length': '0'} 2024-04-16T18:42:18.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094ee8b7f9e58f5a9-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.322 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.322 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.322 DEBUG:boto:path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.322 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.322 DEBUG:boto:Method: GET 2024-04-16T18:42:18.322 DEBUG:boto:Path: /cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.322 DEBUG:boto:Data: 2024-04-16T18:42:18.322 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.322 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.323 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.323 DEBUG:boto:Params: {} 2024-04-16T18:42:18.323 DEBUG:boto:Token: None 2024-04-16T18:42:18.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b41ad9a44d24dcfb-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.326 DEBUG:boto:b'cjqttm-55obj111000falseobj112024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.326 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.326 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.326 DEBUG:boto:path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.326 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.326 DEBUG:boto:Method: GET 2024-04-16T18:42:18.326 DEBUG:boto:Path: /cjqttm-55/?prefix=obj11 2024-04-16T18:42:18.327 DEBUG:boto:Data: 2024-04-16T18:42:18.327 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.327 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.327 DEBUG:boto:Params: {} 2024-04-16T18:42:18.327 DEBUG:boto:Token: None 2024-04-16T18:42:18.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.327 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.330 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d39974c73121000e-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.330 DEBUG:boto:b'cjqttm-55obj111000falseobj112024-04-16T18:40:36.293Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.330 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:42:18.330 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.331 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.331 DEBUG:boto:path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.331 DEBUG:boto:auth_path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.331 DEBUG:boto:Method: GET 2024-04-16T18:42:18.331 DEBUG:boto:Path: /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.331 DEBUG:boto:Data: 2024-04-16T18:42:18.331 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.331 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.331 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.331 DEBUG:boto:Params: {} 2024-04-16T18:42:18.331 DEBUG:boto:Token: None 2024-04-16T18:42:18.332 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24= 2024-04-16T18:42:18.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24=', 'Content-Length': '0'} 2024-04-16T18:42:18.334 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098d68c3ff7cbb2d0-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.374 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.374 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.374 DEBUG:boto:path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.375 DEBUG:boto:auth_path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.375 DEBUG:boto:Method: GET 2024-04-16T18:42:18.375 DEBUG:boto:Path: /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.375 DEBUG:boto:Data: 2024-04-16T18:42:18.375 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.375 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.375 DEBUG:boto:Params: {} 2024-04-16T18:42:18.375 DEBUG:boto:Token: None 2024-04-16T18:42:18.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24= 2024-04-16T18:42:18.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24=', 'Content-Length': '0'} 2024-04-16T18:42:18.377 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c40a7c2808acd6a-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.378 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.378 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.378 DEBUG:boto:path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.378 DEBUG:boto:auth_path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.378 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.378 DEBUG:boto:Path: /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.378 DEBUG:boto:Data: 2024-04-16T18:42:18.378 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.378 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.378 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.378 DEBUG:boto:Params: {} 2024-04-16T18:42:18.379 DEBUG:boto:Token: None 2024-04-16T18:42:18.379 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.379 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6UQ/t4HI0L+9GFRPBceXGcXh/XU= 2024-04-16T18:42:18.379 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6UQ/t4HI0L+9GFRPBceXGcXh/XU=', 'Content-Length': '0'} 2024-04-16T18:42:18.381 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c322923418d237ad-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.381 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.381 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.381 DEBUG:boto:path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.381 DEBUG:boto:auth_path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.381 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.381 DEBUG:boto:Path: /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.381 DEBUG:boto:Data: 2024-04-16T18:42:18.382 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.382 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.382 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.382 DEBUG:boto:Params: {} 2024-04-16T18:42:18.382 DEBUG:boto:Token: None 2024-04-16T18:42:18.382 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.382 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6UQ/t4HI0L+9GFRPBceXGcXh/XU= 2024-04-16T18:42:18.382 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6UQ/t4HI0L+9GFRPBceXGcXh/XU=', 'Content-Length': '0'} 2024-04-16T18:42:18.384 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d49bd4c232ee724b-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.384 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:42:18.385 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.385 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.385 DEBUG:boto:path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.385 DEBUG:boto:auth_path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.385 DEBUG:boto:Method: GET 2024-04-16T18:42:18.385 DEBUG:boto:Path: /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.385 DEBUG:boto:Data: 2024-04-16T18:42:18.385 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.385 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.385 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.386 DEBUG:boto:Params: {} 2024-04-16T18:42:18.386 DEBUG:boto:Token: None 2024-04-16T18:42:18.386 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.386 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24= 2024-04-16T18:42:18.386 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24=', 'Content-Length': '0'} 2024-04-16T18:42:18.388 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077bcbd67317c797b-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.430 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.430 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.431 DEBUG:boto:path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.431 DEBUG:boto:auth_path=/cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.431 DEBUG:boto:Method: GET 2024-04-16T18:42:18.431 DEBUG:boto:Path: /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.431 DEBUG:boto:Data: 2024-04-16T18:42:18.431 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.431 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.431 DEBUG:boto:Params: {} 2024-04-16T18:42:18.431 DEBUG:boto:Token: None 2024-04-16T18:42:18.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22?versionId=null 2024-04-16T18:42:18.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24= 2024-04-16T18:42:18.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BJ7VY1opvPa7XOwjEqUAP2tXS24=', 'Content-Length': '0'} 2024-04-16T18:42:18.433 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000552ee6fd9fc3dbbf-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.434 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.434 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.434 DEBUG:boto:path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.434 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.434 DEBUG:boto:Method: GET 2024-04-16T18:42:18.434 DEBUG:boto:Path: /cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.434 DEBUG:boto:Data: 2024-04-16T18:42:18.435 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.435 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.435 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.435 DEBUG:boto:Params: {} 2024-04-16T18:42:18.435 DEBUG:boto:Token: None 2024-04-16T18:42:18.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.435 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000195f95e13f54135c-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.438 DEBUG:boto:b'cjqttm-55obj221000falseobj222024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.438 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.438 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.438 DEBUG:boto:path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.439 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.439 DEBUG:boto:Method: GET 2024-04-16T18:42:18.439 DEBUG:boto:Path: /cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.439 DEBUG:boto:Data: 2024-04-16T18:42:18.439 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.439 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.439 DEBUG:boto:Params: {} 2024-04-16T18:42:18.439 DEBUG:boto:Token: None 2024-04-16T18:42:18.439 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.442 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000622ce6825af0d485-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.442 DEBUG:boto:b'cjqttm-55obj221000falseobj222024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.442 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.442 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.443 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.443 DEBUG:boto:Path: /cjqttm-55/obj22 2024-04-16T18:42:18.443 DEBUG:boto:Data: 2024-04-16T18:42:18.443 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.443 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.443 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.443 DEBUG:boto:Params: {} 2024-04-16T18:42:18.443 DEBUG:boto:Token: None 2024-04-16T18:42:18.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22 2024-04-16T18:42:18.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sdZS5Adz4SImrAVv7ytamr2SIFs= 2024-04-16T18:42:18.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sdZS5Adz4SImrAVv7ytamr2SIFs=', 'Content-Length': '0'} 2024-04-16T18:42:18.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d21b6587c0e35951-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.445 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.445 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.445 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.446 DEBUG:boto:Path: /cjqttm-55/obj22 2024-04-16T18:42:18.446 DEBUG:boto:Data: 2024-04-16T18:42:18.446 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.446 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.446 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.446 DEBUG:boto:Params: {} 2024-04-16T18:42:18.446 DEBUG:boto:Token: None 2024-04-16T18:42:18.446 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22 2024-04-16T18:42:18.446 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sdZS5Adz4SImrAVv7ytamr2SIFs= 2024-04-16T18:42:18.446 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sdZS5Adz4SImrAVv7ytamr2SIFs=', 'Content-Length': '0'} 2024-04-16T18:42:18.448 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c7fac3ed20c2471f-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.448 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:42:18.449 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.449 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.449 DEBUG:boto:Method: GET 2024-04-16T18:42:18.449 DEBUG:boto:Path: /cjqttm-55/obj22 2024-04-16T18:42:18.449 DEBUG:boto:Data: 2024-04-16T18:42:18.449 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.449 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.449 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.449 DEBUG:boto:Params: {} 2024-04-16T18:42:18.449 DEBUG:boto:Token: None 2024-04-16T18:42:18.449 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22 2024-04-16T18:42:18.450 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LiqHBukyop3BJ/qNL8OUviX678o= 2024-04-16T18:42:18.450 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LiqHBukyop3BJ/qNL8OUviX678o=', 'Content-Length': '0'} 2024-04-16T18:42:18.451 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b90fbbe08bb4c6f-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.494 DEBUG:boto:path=/cjqttm-55/obj22 2024-04-16T18:42:18.494 DEBUG:boto:auth_path=/cjqttm-55/obj22 2024-04-16T18:42:18.494 DEBUG:boto:Method: GET 2024-04-16T18:42:18.495 DEBUG:boto:Path: /cjqttm-55/obj22 2024-04-16T18:42:18.495 DEBUG:boto:Data: 2024-04-16T18:42:18.495 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.495 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.495 DEBUG:boto:Params: {} 2024-04-16T18:42:18.495 DEBUG:boto:Token: None 2024-04-16T18:42:18.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj22 2024-04-16T18:42:18.495 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LiqHBukyop3BJ/qNL8OUviX678o= 2024-04-16T18:42:18.495 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LiqHBukyop3BJ/qNL8OUviX678o=', 'Content-Length': '0'} 2024-04-16T18:42:18.497 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005d119dd0eadaf779-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.498 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.498 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.498 DEBUG:boto:path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.498 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.498 DEBUG:boto:Method: GET 2024-04-16T18:42:18.498 DEBUG:boto:Path: /cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.498 DEBUG:boto:Data: 2024-04-16T18:42:18.498 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.499 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.499 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.499 DEBUG:boto:Params: {} 2024-04-16T18:42:18.499 DEBUG:boto:Token: None 2024-04-16T18:42:18.499 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.499 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.499 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.501 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e579eb75b8c8ac9-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.502 DEBUG:boto:b'cjqttm-55obj221000falseobj222024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.502 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.502 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.502 DEBUG:boto:path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.502 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.503 DEBUG:boto:Method: GET 2024-04-16T18:42:18.503 DEBUG:boto:Path: /cjqttm-55/?prefix=obj22 2024-04-16T18:42:18.503 DEBUG:boto:Data: 2024-04-16T18:42:18.503 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.503 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.503 DEBUG:boto:Params: {} 2024-04-16T18:42:18.503 DEBUG:boto:Token: None 2024-04-16T18:42:18.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.506 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003e0ff61e1b8f8346-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.506 DEBUG:boto:b'cjqttm-55obj221000falseobj222024-04-16T18:40:36.305Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:42:18.507 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.507 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.507 DEBUG:boto:path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.507 DEBUG:boto:auth_path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.507 DEBUG:boto:Method: GET 2024-04-16T18:42:18.507 DEBUG:boto:Path: /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.507 DEBUG:boto:Data: 2024-04-16T18:42:18.507 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.507 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.507 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.507 DEBUG:boto:Params: {} 2024-04-16T18:42:18.508 DEBUG:boto:Token: None 2024-04-16T18:42:18.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8= 2024-04-16T18:42:18.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8=', 'Content-Length': '0'} 2024-04-16T18:42:18.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002da9aea7876ce50d-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.554 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.554 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.555 DEBUG:boto:path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.555 DEBUG:boto:auth_path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.555 DEBUG:boto:Method: GET 2024-04-16T18:42:18.555 DEBUG:boto:Path: /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.555 DEBUG:boto:Data: 2024-04-16T18:42:18.555 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.555 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.555 DEBUG:boto:Params: {} 2024-04-16T18:42:18.555 DEBUG:boto:Token: None 2024-04-16T18:42:18.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.556 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8= 2024-04-16T18:42:18.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8=', 'Content-Length': '0'} 2024-04-16T18:42:18.558 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c68aac9bda6cd396-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.558 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.558 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.558 DEBUG:boto:path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.558 DEBUG:boto:auth_path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.558 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.559 DEBUG:boto:Path: /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.559 DEBUG:boto:Data: 2024-04-16T18:42:18.559 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.559 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.559 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.559 DEBUG:boto:Params: {} 2024-04-16T18:42:18.559 DEBUG:boto:Token: None 2024-04-16T18:42:18.559 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yj/kwNp7PHNdTpXQhw0YXqnbx9M= 2024-04-16T18:42:18.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yj/kwNp7PHNdTpXQhw0YXqnbx9M=', 'Content-Length': '0'} 2024-04-16T18:42:18.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d1bc9bdea44b5170-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.562 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.562 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.562 DEBUG:boto:path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.562 DEBUG:boto:auth_path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.562 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.562 DEBUG:boto:Path: /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.562 DEBUG:boto:Data: 2024-04-16T18:42:18.562 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.563 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.563 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.563 DEBUG:boto:Params: {} 2024-04-16T18:42:18.563 DEBUG:boto:Token: None 2024-04-16T18:42:18.563 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yj/kwNp7PHNdTpXQhw0YXqnbx9M= 2024-04-16T18:42:18.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yj/kwNp7PHNdTpXQhw0YXqnbx9M=', 'Content-Length': '0'} 2024-04-16T18:42:18.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007d1d6c1d38d6219b-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.566 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:42:18.566 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.566 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.566 DEBUG:boto:path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.566 DEBUG:boto:auth_path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.566 DEBUG:boto:Method: GET 2024-04-16T18:42:18.566 DEBUG:boto:Path: /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.566 DEBUG:boto:Data: 2024-04-16T18:42:18.566 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.566 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.567 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.567 DEBUG:boto:Params: {} 2024-04-16T18:42:18.567 DEBUG:boto:Token: None 2024-04-16T18:42:18.567 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8= 2024-04-16T18:42:18.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8=', 'Content-Length': '0'} 2024-04-16T18:42:18.569 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003f97966af3cb0074-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.610 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.610 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.611 DEBUG:boto:path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.611 DEBUG:boto:auth_path=/cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.611 DEBUG:boto:Method: GET 2024-04-16T18:42:18.611 DEBUG:boto:Path: /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.611 DEBUG:boto:Data: 2024-04-16T18:42:18.611 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.611 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.611 DEBUG:boto:Params: {} 2024-04-16T18:42:18.611 DEBUG:boto:Token: None 2024-04-16T18:42:18.612 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33?versionId=null 2024-04-16T18:42:18.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8= 2024-04-16T18:42:18.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rbQhG9Pc7yQDl0oG3+nn1JxHDR8=', 'Content-Length': '0'} 2024-04-16T18:42:18.614 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac6a626e47217bd6-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.614 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.614 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.614 DEBUG:boto:path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.614 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.615 DEBUG:boto:Method: GET 2024-04-16T18:42:18.615 DEBUG:boto:Path: /cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.615 DEBUG:boto:Data: 2024-04-16T18:42:18.615 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.615 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.615 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.615 DEBUG:boto:Params: {} 2024-04-16T18:42:18.615 DEBUG:boto:Token: None 2024-04-16T18:42:18.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.618 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003c8ae84c9508554-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.618 DEBUG:boto:b'cjqttm-55obj331000falseobj332024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.618 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.618 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.618 DEBUG:boto:path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.618 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.619 DEBUG:boto:Method: GET 2024-04-16T18:42:18.619 DEBUG:boto:Path: /cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.619 DEBUG:boto:Data: 2024-04-16T18:42:18.619 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.619 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.619 DEBUG:boto:Params: {} 2024-04-16T18:42:18.619 DEBUG:boto:Token: None 2024-04-16T18:42:18.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007a3f419234d8b17c-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.622 DEBUG:boto:b'cjqttm-55obj331000falseobj332024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.622 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.623 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.623 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.623 DEBUG:boto:Path: /cjqttm-55/obj33 2024-04-16T18:42:18.623 DEBUG:boto:Data: 2024-04-16T18:42:18.623 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.623 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.623 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.623 DEBUG:boto:Params: {} 2024-04-16T18:42:18.623 DEBUG:boto:Token: None 2024-04-16T18:42:18.623 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33 2024-04-16T18:42:18.624 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dd9bn7fDq4shtFAY87Wx5MeOPw0= 2024-04-16T18:42:18.624 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dd9bn7fDq4shtFAY87Wx5MeOPw0=', 'Content-Length': '0'} 2024-04-16T18:42:18.626 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cecc616c5cfc970-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.626 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.626 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.626 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.626 DEBUG:boto:Path: /cjqttm-55/obj33 2024-04-16T18:42:18.627 DEBUG:boto:Data: 2024-04-16T18:42:18.627 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.627 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.627 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.627 DEBUG:boto:Params: {} 2024-04-16T18:42:18.627 DEBUG:boto:Token: None 2024-04-16T18:42:18.627 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33 2024-04-16T18:42:18.627 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dd9bn7fDq4shtFAY87Wx5MeOPw0= 2024-04-16T18:42:18.627 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dd9bn7fDq4shtFAY87Wx5MeOPw0=', 'Content-Length': '0'} 2024-04-16T18:42:18.629 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002693114be85d8ed5-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.630 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:42:18.630 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.630 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.630 DEBUG:boto:Method: GET 2024-04-16T18:42:18.630 DEBUG:boto:Path: /cjqttm-55/obj33 2024-04-16T18:42:18.630 DEBUG:boto:Data: 2024-04-16T18:42:18.630 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.630 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.630 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.631 DEBUG:boto:Params: {} 2024-04-16T18:42:18.631 DEBUG:boto:Token: None 2024-04-16T18:42:18.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33 2024-04-16T18:42:18.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qIkCleWEiXosHqPOGC5c1KtumEY= 2024-04-16T18:42:18.631 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qIkCleWEiXosHqPOGC5c1KtumEY=', 'Content-Length': '0'} 2024-04-16T18:42:18.633 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000dcda89fbabcac69-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.674 DEBUG:boto:path=/cjqttm-55/obj33 2024-04-16T18:42:18.674 DEBUG:boto:auth_path=/cjqttm-55/obj33 2024-04-16T18:42:18.675 DEBUG:boto:Method: GET 2024-04-16T18:42:18.675 DEBUG:boto:Path: /cjqttm-55/obj33 2024-04-16T18:42:18.675 DEBUG:boto:Data: 2024-04-16T18:42:18.675 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.675 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.675 DEBUG:boto:Params: {} 2024-04-16T18:42:18.675 DEBUG:boto:Token: None 2024-04-16T18:42:18.675 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj33 2024-04-16T18:42:18.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qIkCleWEiXosHqPOGC5c1KtumEY= 2024-04-16T18:42:18.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qIkCleWEiXosHqPOGC5c1KtumEY=', 'Content-Length': '0'} 2024-04-16T18:42:18.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022760f7b600d1132-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.678 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.678 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.678 DEBUG:boto:path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.678 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.679 DEBUG:boto:Method: GET 2024-04-16T18:42:18.679 DEBUG:boto:Path: /cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.679 DEBUG:boto:Data: 2024-04-16T18:42:18.679 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.679 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.679 DEBUG:boto:Params: {} 2024-04-16T18:42:18.679 DEBUG:boto:Token: None 2024-04-16T18:42:18.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.682 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000358ba2c8eeaaa352-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.682 DEBUG:boto:b'cjqttm-55obj331000falseobj332024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.682 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.683 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.683 DEBUG:boto:path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.683 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.683 DEBUG:boto:Method: GET 2024-04-16T18:42:18.683 DEBUG:boto:Path: /cjqttm-55/?prefix=obj33 2024-04-16T18:42:18.683 DEBUG:boto:Data: 2024-04-16T18:42:18.683 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.683 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.683 DEBUG:boto:Params: {} 2024-04-16T18:42:18.684 DEBUG:boto:Token: None 2024-04-16T18:42:18.684 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.684 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.686 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000028ac9734134587f-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.687 DEBUG:boto:b'cjqttm-55obj331000falseobj332024-04-16T18:40:36.355Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.687 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:42:18.687 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.687 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.687 DEBUG:boto:path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.687 DEBUG:boto:auth_path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.688 DEBUG:boto:Method: GET 2024-04-16T18:42:18.688 DEBUG:boto:Path: /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.688 DEBUG:boto:Data: 2024-04-16T18:42:18.688 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.688 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.688 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.688 DEBUG:boto:Params: {} 2024-04-16T18:42:18.688 DEBUG:boto:Token: None 2024-04-16T18:42:18.688 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.688 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ= 2024-04-16T18:42:18.688 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ=', 'Content-Length': '0'} 2024-04-16T18:42:18.691 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008d9b93e90bab5925-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.734 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.734 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.735 DEBUG:boto:path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.735 DEBUG:boto:auth_path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.735 DEBUG:boto:Method: GET 2024-04-16T18:42:18.735 DEBUG:boto:Path: /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.735 DEBUG:boto:Data: 2024-04-16T18:42:18.735 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.735 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.735 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.735 DEBUG:boto:Params: {} 2024-04-16T18:42:18.735 DEBUG:boto:Token: None 2024-04-16T18:42:18.735 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.736 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ= 2024-04-16T18:42:18.736 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ=', 'Content-Length': '0'} 2024-04-16T18:42:18.738 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc28487880bd6a85-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.738 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.738 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.738 DEBUG:boto:path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.739 DEBUG:boto:auth_path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.739 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.739 DEBUG:boto:Path: /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.739 DEBUG:boto:Data: 2024-04-16T18:42:18.739 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.739 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.739 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.739 DEBUG:boto:Params: {} 2024-04-16T18:42:18.739 DEBUG:boto:Token: None 2024-04-16T18:42:18.739 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:08KNU5EXWpjNDdT5Fa1PkI4m80Q= 2024-04-16T18:42:18.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:08KNU5EXWpjNDdT5Fa1PkI4m80Q=', 'Content-Length': '0'} 2024-04-16T18:42:18.742 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002756559d8cc503ac-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.742 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.742 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.742 DEBUG:boto:path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.742 DEBUG:boto:auth_path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.743 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.743 DEBUG:boto:Path: /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.743 DEBUG:boto:Data: 2024-04-16T18:42:18.743 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.743 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.743 DEBUG:boto:Params: {} 2024-04-16T18:42:18.743 DEBUG:boto:Token: None 2024-04-16T18:42:18.743 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:08KNU5EXWpjNDdT5Fa1PkI4m80Q= 2024-04-16T18:42:18.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:08KNU5EXWpjNDdT5Fa1PkI4m80Q=', 'Content-Length': '0'} 2024-04-16T18:42:18.745 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6f4f6fe1d371e75-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.746 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:42:18.746 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.746 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.746 DEBUG:boto:path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.746 DEBUG:boto:auth_path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.746 DEBUG:boto:Method: GET 2024-04-16T18:42:18.746 DEBUG:boto:Path: /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.746 DEBUG:boto:Data: 2024-04-16T18:42:18.746 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.747 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.747 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.747 DEBUG:boto:Params: {} 2024-04-16T18:42:18.747 DEBUG:boto:Token: None 2024-04-16T18:42:18.747 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ= 2024-04-16T18:42:18.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ=', 'Content-Length': '0'} 2024-04-16T18:42:18.749 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000aec137576330d51-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.790 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.791 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.791 DEBUG:boto:path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.791 DEBUG:boto:auth_path=/cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.791 DEBUG:boto:Method: GET 2024-04-16T18:42:18.791 DEBUG:boto:Path: /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.791 DEBUG:boto:Data: 2024-04-16T18:42:18.791 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.791 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.791 DEBUG:boto:Params: {} 2024-04-16T18:42:18.792 DEBUG:boto:Token: None 2024-04-16T18:42:18.792 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44?versionId=null 2024-04-16T18:42:18.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ= 2024-04-16T18:42:18.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dkp12xsWcYOAoUZ6UQS6excwfbQ=', 'Content-Length': '0'} 2024-04-16T18:42:18.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000001665b9e487898c1-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.794 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.794 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.795 DEBUG:boto:path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.795 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.795 DEBUG:boto:Method: GET 2024-04-16T18:42:18.795 DEBUG:boto:Path: /cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.795 DEBUG:boto:Data: 2024-04-16T18:42:18.795 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.795 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.795 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.795 DEBUG:boto:Params: {} 2024-04-16T18:42:18.795 DEBUG:boto:Token: None 2024-04-16T18:42:18.795 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.798 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001d5bcaf5f564ecdf-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.798 DEBUG:boto:b'cjqttm-55obj441000falseobj442024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.799 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.799 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.799 DEBUG:boto:path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.799 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.799 DEBUG:boto:Method: GET 2024-04-16T18:42:18.799 DEBUG:boto:Path: /cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.799 DEBUG:boto:Data: 2024-04-16T18:42:18.799 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.799 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.799 DEBUG:boto:Params: {} 2024-04-16T18:42:18.800 DEBUG:boto:Token: None 2024-04-16T18:42:18.800 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.802 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018d95834e6f6f975-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.803 DEBUG:boto:b'cjqttm-55obj441000falseobj442024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.803 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.803 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.803 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.803 DEBUG:boto:Path: /cjqttm-55/obj44 2024-04-16T18:42:18.803 DEBUG:boto:Data: 2024-04-16T18:42:18.803 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.803 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.804 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.804 DEBUG:boto:Params: {} 2024-04-16T18:42:18.804 DEBUG:boto:Token: None 2024-04-16T18:42:18.804 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44 2024-04-16T18:42:18.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:odhQLrTK+pzMuc0PvLzsfooa3lk= 2024-04-16T18:42:18.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:odhQLrTK+pzMuc0PvLzsfooa3lk=', 'Content-Length': '0'} 2024-04-16T18:42:18.806 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005745f42f862e4458-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.806 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.806 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.807 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.807 DEBUG:boto:Path: /cjqttm-55/obj44 2024-04-16T18:42:18.807 DEBUG:boto:Data: 2024-04-16T18:42:18.807 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.807 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.807 DEBUG:boto:Params: {} 2024-04-16T18:42:18.807 DEBUG:boto:Token: None 2024-04-16T18:42:18.807 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44 2024-04-16T18:42:18.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:odhQLrTK+pzMuc0PvLzsfooa3lk= 2024-04-16T18:42:18.807 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:odhQLrTK+pzMuc0PvLzsfooa3lk=', 'Content-Length': '0'} 2024-04-16T18:42:18.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ea3d870db1e8b4ce-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.809 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:42:18.810 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.810 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.810 DEBUG:boto:Method: GET 2024-04-16T18:42:18.810 DEBUG:boto:Path: /cjqttm-55/obj44 2024-04-16T18:42:18.810 DEBUG:boto:Data: 2024-04-16T18:42:18.810 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.810 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.810 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.811 DEBUG:boto:Params: {} 2024-04-16T18:42:18.811 DEBUG:boto:Token: None 2024-04-16T18:42:18.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44 2024-04-16T18:42:18.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V1jL0TZKX4wnos8zPykzjaCxmek= 2024-04-16T18:42:18.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V1jL0TZKX4wnos8zPykzjaCxmek=', 'Content-Length': '0'} 2024-04-16T18:42:18.813 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd715ea54636dbd9-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.854 DEBUG:boto:path=/cjqttm-55/obj44 2024-04-16T18:42:18.854 DEBUG:boto:auth_path=/cjqttm-55/obj44 2024-04-16T18:42:18.855 DEBUG:boto:Method: GET 2024-04-16T18:42:18.855 DEBUG:boto:Path: /cjqttm-55/obj44 2024-04-16T18:42:18.855 DEBUG:boto:Data: 2024-04-16T18:42:18.855 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.855 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.855 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.855 DEBUG:boto:Params: {} 2024-04-16T18:42:18.855 DEBUG:boto:Token: None 2024-04-16T18:42:18.855 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj44 2024-04-16T18:42:18.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:V1jL0TZKX4wnos8zPykzjaCxmek= 2024-04-16T18:42:18.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V1jL0TZKX4wnos8zPykzjaCxmek=', 'Content-Length': '0'} 2024-04-16T18:42:18.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002d335a8c582ec3c6-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.858 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.858 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.858 DEBUG:boto:path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.858 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.858 DEBUG:boto:Method: GET 2024-04-16T18:42:18.859 DEBUG:boto:Path: /cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.859 DEBUG:boto:Data: 2024-04-16T18:42:18.859 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.859 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.859 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.859 DEBUG:boto:Params: {} 2024-04-16T18:42:18.859 DEBUG:boto:Token: None 2024-04-16T18:42:18.859 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.859 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.862 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a081adfbc186af06-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.862 DEBUG:boto:b'cjqttm-55obj441000falseobj442024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.862 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.863 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.863 DEBUG:boto:path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.863 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.863 DEBUG:boto:Method: GET 2024-04-16T18:42:18.863 DEBUG:boto:Path: /cjqttm-55/?prefix=obj44 2024-04-16T18:42:18.863 DEBUG:boto:Data: 2024-04-16T18:42:18.863 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.863 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.863 DEBUG:boto:Params: {} 2024-04-16T18:42:18.863 DEBUG:boto:Token: None 2024-04-16T18:42:18.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.866 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000d5b2d39847fce78-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.866 DEBUG:boto:b'cjqttm-55obj441000falseobj442024-04-16T18:40:36.368Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:42:18.867 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.867 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.867 DEBUG:boto:path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.867 DEBUG:boto:auth_path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.867 DEBUG:boto:Method: GET 2024-04-16T18:42:18.867 DEBUG:boto:Path: /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.868 DEBUG:boto:Data: 2024-04-16T18:42:18.868 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.868 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.868 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.868 DEBUG:boto:Params: {} 2024-04-16T18:42:18.868 DEBUG:boto:Token: None 2024-04-16T18:42:18.868 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.868 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc= 2024-04-16T18:42:18.868 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc=', 'Content-Length': '0'} 2024-04-16T18:42:18.870 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f6d99f84378cb924-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.914 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.914 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.915 DEBUG:boto:path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.915 DEBUG:boto:auth_path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.915 DEBUG:boto:Method: GET 2024-04-16T18:42:18.915 DEBUG:boto:Path: /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.915 DEBUG:boto:Data: 2024-04-16T18:42:18.915 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.915 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.915 DEBUG:boto:Params: {} 2024-04-16T18:42:18.916 DEBUG:boto:Token: None 2024-04-16T18:42:18.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc= 2024-04-16T18:42:18.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc=', 'Content-Length': '0'} 2024-04-16T18:42:18.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de76d9d41fd6299b-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.918 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.918 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.918 DEBUG:boto:path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.918 DEBUG:boto:auth_path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.919 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.919 DEBUG:boto:Path: /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.919 DEBUG:boto:Data: 2024-04-16T18:42:18.919 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.919 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.919 DEBUG:boto:Params: {} 2024-04-16T18:42:18.919 DEBUG:boto:Token: None 2024-04-16T18:42:18.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KdT16BYiJEjFgKy7/+EmrLHZO7U= 2024-04-16T18:42:18.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KdT16BYiJEjFgKy7/+EmrLHZO7U=', 'Content-Length': '0'} 2024-04-16T18:42:18.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000797ce1c305a1d039-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.922 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.922 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.922 DEBUG:boto:path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.922 DEBUG:boto:auth_path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.922 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.922 DEBUG:boto:Path: /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.922 DEBUG:boto:Data: 2024-04-16T18:42:18.922 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.922 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.922 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.923 DEBUG:boto:Params: {} 2024-04-16T18:42:18.923 DEBUG:boto:Token: None 2024-04-16T18:42:18.923 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KdT16BYiJEjFgKy7/+EmrLHZO7U= 2024-04-16T18:42:18.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KdT16BYiJEjFgKy7/+EmrLHZO7U=', 'Content-Length': '0'} 2024-04-16T18:42:18.925 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e879d85d0cf3e27a-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.925 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:42:18.926 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.926 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.926 DEBUG:boto:path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.926 DEBUG:boto:auth_path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.926 DEBUG:boto:Method: GET 2024-04-16T18:42:18.926 DEBUG:boto:Path: /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.926 DEBUG:boto:Data: 2024-04-16T18:42:18.926 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.926 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.926 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.926 DEBUG:boto:Params: {} 2024-04-16T18:42:18.927 DEBUG:boto:Token: None 2024-04-16T18:42:18.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.927 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc= 2024-04-16T18:42:18.927 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc=', 'Content-Length': '0'} 2024-04-16T18:42:18.929 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006d48967b3bfe28e4-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.970 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.970 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.971 DEBUG:boto:path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.971 DEBUG:boto:auth_path=/cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.971 DEBUG:boto:Method: GET 2024-04-16T18:42:18.971 DEBUG:boto:Path: /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.971 DEBUG:boto:Data: 2024-04-16T18:42:18.971 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.971 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.971 DEBUG:boto:Params: {} 2024-04-16T18:42:18.971 DEBUG:boto:Token: None 2024-04-16T18:42:18.971 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55?versionId=null 2024-04-16T18:42:18.971 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc= 2024-04-16T18:42:18.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WsUEPRICoLouTTX/jQkCoT/Ngwc=', 'Content-Length': '0'} 2024-04-16T18:42:18.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c1e4acf610b9609-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.974 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.974 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.974 DEBUG:boto:path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:18.974 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:18.974 DEBUG:boto:Method: GET 2024-04-16T18:42:18.975 DEBUG:boto:Path: /cjqttm-55/?prefix=obj55 2024-04-16T18:42:18.975 DEBUG:boto:Data: 2024-04-16T18:42:18.975 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.975 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.975 DEBUG:boto:Params: {} 2024-04-16T18:42:18.975 DEBUG:boto:Token: None 2024-04-16T18:42:18.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000018b94c12f77e1180-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.978 DEBUG:boto:b'cjqttm-55obj551000falseobj552024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.978 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:18.978 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:18.978 DEBUG:boto:path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:18.979 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:18.979 DEBUG:boto:Method: GET 2024-04-16T18:42:18.979 DEBUG:boto:Path: /cjqttm-55/?prefix=obj55 2024-04-16T18:42:18.979 DEBUG:boto:Data: 2024-04-16T18:42:18.979 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.979 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.979 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.979 DEBUG:boto:Params: {} 2024-04-16T18:42:18.979 DEBUG:boto:Token: None 2024-04-16T18:42:18.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/ 2024-04-16T18:42:18.980 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE= 2024-04-16T18:42:18.980 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:P0efoWlKBaqq/wy6rC4m4cbZglE=', 'Content-Length': '0'} 2024-04-16T18:42:18.982 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f0c8d6cf5ffe0f99-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.982 DEBUG:boto:b'cjqttm-55obj551000falseobj552024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:18.982 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.983 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.983 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.983 DEBUG:boto:Path: /cjqttm-55/obj55 2024-04-16T18:42:18.983 DEBUG:boto:Data: 2024-04-16T18:42:18.983 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.983 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.983 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.983 DEBUG:boto:Params: {} 2024-04-16T18:42:18.983 DEBUG:boto:Token: None 2024-04-16T18:42:18.983 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55 2024-04-16T18:42:18.984 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HqfZ4inETY83Lg6bY9JEZiF/s+A= 2024-04-16T18:42:18.984 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HqfZ4inETY83Lg6bY9JEZiF/s+A=', 'Content-Length': '0'} 2024-04-16T18:42:18.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eca0a3f79a5ad0e5-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.986 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.986 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.986 DEBUG:boto:Method: HEAD 2024-04-16T18:42:18.987 DEBUG:boto:Path: /cjqttm-55/obj55 2024-04-16T18:42:18.987 DEBUG:boto:Data: 2024-04-16T18:42:18.987 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.987 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:18.987 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.987 DEBUG:boto:Params: {} 2024-04-16T18:42:18.987 DEBUG:boto:Token: None 2024-04-16T18:42:18.987 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55 2024-04-16T18:42:18.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HqfZ4inETY83Lg6bY9JEZiF/s+A= 2024-04-16T18:42:18.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HqfZ4inETY83Lg6bY9JEZiF/s+A=', 'Content-Length': '0'} 2024-04-16T18:42:18.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000021c65840c27f2a15-00661ec68a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:18.990 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:42:18.990 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:18.990 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:18.990 DEBUG:boto:Method: GET 2024-04-16T18:42:18.990 DEBUG:boto:Path: /cjqttm-55/obj55 2024-04-16T18:42:18.991 DEBUG:boto:Data: 2024-04-16T18:42:18.991 DEBUG:boto:Headers: {} 2024-04-16T18:42:18.991 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:18.991 DEBUG:boto:Port: 8000 2024-04-16T18:42:18.991 DEBUG:boto:Params: {} 2024-04-16T18:42:18.991 DEBUG:boto:Token: None 2024-04-16T18:42:18.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:18 GMT /cjqttm-55/obj55 2024-04-16T18:42:18.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:yCCLQo1hjXgWY1HNuwekuhsw6O4= 2024-04-16T18:42:18.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:18 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yCCLQo1hjXgWY1HNuwekuhsw6O4=', 'Content-Length': '0'} 2024-04-16T18:42:18.994 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-55:9ba59572-f51c-4bce-9578-e6350e822996.4816.24'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057ea3fb94853b8e5-00661ec68a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:18 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:19.038 DEBUG:boto:path=/cjqttm-55/obj55 2024-04-16T18:42:19.039 DEBUG:boto:auth_path=/cjqttm-55/obj55 2024-04-16T18:42:19.039 DEBUG:boto:Method: GET 2024-04-16T18:42:19.039 DEBUG:boto:Path: /cjqttm-55/obj55 2024-04-16T18:42:19.039 DEBUG:boto:Data: 2024-04-16T18:42:19.039 DEBUG:boto:Headers: {} 2024-04-16T18:42:19.039 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:19.039 DEBUG:boto:Port: 8000 2024-04-16T18:42:19.039 DEBUG:boto:Params: {} 2024-04-16T18:42:19.039 DEBUG:boto:Token: None 2024-04-16T18:42:19.039 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:19 GMT /cjqttm-55/obj55 2024-04-16T18:42:19.040 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uC+fjE/+9g73sVvkX+lrCnwFJwg= 2024-04-16T18:42:19.040 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uC+fjE/+9g73sVvkX+lrCnwFJwg=', 'Content-Length': '0'} 2024-04-16T18:42:19.042 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:40:36 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef1e1667042cf62e-00661ec68b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:19.042 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:19.042 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:19.042 DEBUG:boto:path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:19.043 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:19.043 DEBUG:boto:Method: GET 2024-04-16T18:42:19.043 DEBUG:boto:Path: /cjqttm-55/?prefix=obj55 2024-04-16T18:42:19.043 DEBUG:boto:Data: 2024-04-16T18:42:19.043 DEBUG:boto:Headers: {} 2024-04-16T18:42:19.043 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:42:19.043 DEBUG:boto:Port: 8000 2024-04-16T18:42:19.043 DEBUG:boto:Params: {} 2024-04-16T18:42:19.043 DEBUG:boto:Token: None 2024-04-16T18:42:19.043 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:19 GMT /cjqttm-55/ 2024-04-16T18:42:19.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7u/0YQVBFU01utMmzXqyq5dgeFA= 2024-04-16T18:42:19.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7u/0YQVBFU01utMmzXqyq5dgeFA=', 'Content-Length': '0'} 2024-04-16T18:42:19.046 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c4f5bba2ae30d3a-00661ec68b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:19.046 DEBUG:boto:b'cjqttm-55obj551000falseobj552024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:19.046 DEBUG:boto:path=/cjqttm-55/ 2024-04-16T18:42:19.046 DEBUG:boto:auth_path=/cjqttm-55/ 2024-04-16T18:42:19.047 DEBUG:boto:path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:19.047 DEBUG:boto:auth_path=/cjqttm-55/?prefix=obj55 2024-04-16T18:42:19.047 DEBUG:boto:Method: GET 2024-04-16T18:42:19.047 DEBUG:boto:Path: /cjqttm-55/?prefix=obj55 2024-04-16T18:42:19.047 DEBUG:boto:Data: 2024-04-16T18:42:19.047 DEBUG:boto:Headers: {} 2024-04-16T18:42:19.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:19.047 DEBUG:boto:Port: 8000 2024-04-16T18:42:19.047 DEBUG:boto:Params: {} 2024-04-16T18:42:19.047 DEBUG:boto:Token: None 2024-04-16T18:42:19.048 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:42:19 GMT /cjqttm-55/ 2024-04-16T18:42:19.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:7u/0YQVBFU01utMmzXqyq5dgeFA= 2024-04-16T18:42:19.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:19 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7u/0YQVBFU01utMmzXqyq5dgeFA=', 'Content-Length': '0'} 2024-04-16T18:42:19.050 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000025aac04ec3c46c1f-00661ec68b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:19 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:19.050 DEBUG:boto:b'cjqttm-55obj551000falseobj552024-04-16T18:40:36.415Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:42:19.051 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-55 zones={test-zone2, test-zone1} 2024-04-16T18:42:19.051 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone1 target=test-zone2 2024-04-16T18:42:19.051 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:19.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:19.051 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:19.105 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:19.105 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:19.194 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"00000000000000000000:00000000000000025945","last_update":"2024-04-16T18:33:25.689215Z"},{"marker":"00000000000000000000:00000000000000040033","last_update":"2024-04-16T18:40:36.372375Z"},{"marker":"00000000000000000000:00000000000000035379","last_update":"2024-04-16T18:40:45.697830Z"},{"marker":"00000000000000000000:00000000000000034873","last_update":"2024-04-16T18:40:45.700566Z"}] 2024-04-16T18:42:19.194 DEBUG:rgw_multi.tests:data markers for zone=test-zone1 markers={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:19.194 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:42:19.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:19.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:19.195 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:19.250 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:19.250 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:19.331 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:19Z"} 2024-04-16T18:42:19.331 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:19Z"} 2024-04-16T18:42:19.331 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000025945', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.689215Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000040033', 'next_step_marker': '', 'total_entries': 46, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.372375Z'}}, {'key': 2, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000035238', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.359696Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034873', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:45.700566Z'}}] 2024-04-16T18:42:19.332 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:19.332 DEBUG:rgw_multi.tests:sync_status={0: '', 1: '00000000000000000000:00000000000000040033', 2: '', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:19.332 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000025945 target=, shard=2 master=00000000000000000000:00000000000000035379 target= 2024-04-16T18:42:24.333 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:24.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:24.333 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:24.390 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:24.390 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:24.471 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:24Z"} 2024-04-16T18:42:24.471 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:24Z"} 2024-04-16T18:42:24.472 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000025945', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.689215Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000040033', 'next_step_marker': '', 'total_entries': 46, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.372375Z'}}, {'key': 2, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000035238', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.359696Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034873', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:45.700566Z'}}] 2024-04-16T18:42:24.472 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:24.472 DEBUG:rgw_multi.tests:sync_status={0: '', 1: '00000000000000000000:00000000000000040033', 2: '', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:24.472 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000025945 target=, shard=2 master=00000000000000000000:00000000000000035379 target= 2024-04-16T18:42:29.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:29.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:29.474 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:29.534 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:29.534 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:29.617 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:29Z"} 2024-04-16T18:42:29.617 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:29Z"} 2024-04-16T18:42:29.617 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000025945', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.689215Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000040033', 'next_step_marker': '', 'total_entries': 46, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.372375Z'}}, {'key': 2, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000035238', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.359696Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034873', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:45.700566Z'}}] 2024-04-16T18:42:29.617 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:29.618 DEBUG:rgw_multi.tests:sync_status={0: '', 1: '00000000000000000000:00000000000000040033', 2: '', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:29.618 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000025945 target=, shard=2 master=00000000000000000000:00000000000000035379 target= 2024-04-16T18:42:34.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:34.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:34.620 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:34.678 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:34.678 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:34.760 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:34Z"} 2024-04-16T18:42:34.761 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000025945","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":46},"current_time":"2024-04-16T18:42:34Z"} 2024-04-16T18:42:34.761 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000025945', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.689215Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000040033', 'next_step_marker': '', 'total_entries': 46, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.372375Z'}}, {'key': 2, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000035238', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.359696Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034873', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:45.700566Z'}}] 2024-04-16T18:42:34.761 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:34.761 DEBUG:rgw_multi.tests:sync_status={0: '', 1: '00000000000000000000:00000000000000040033', 2: '', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:34.761 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=00000000000000000000:00000000000000025945 target=, shard=2 master=00000000000000000000:00000000000000035379 target= 2024-04-16T18:42:39.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:39.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:39.763 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:39.821 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:39.821 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:39.903 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000025945","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":55},"current_time":"2024-04-16T18:42:39Z"} 2024-04-16T18:42:39.903 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000025945","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"full-sync","marker":"","next_step_marker":"00000000000000000000:00000000000000035238","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:36.359696Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":55},"current_time":"2024-04-16T18:42:39Z"} 2024-04-16T18:42:39.904 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000025945', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.689215Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000040033', 'next_step_marker': '', 'total_entries': 46, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.372375Z'}}, {'key': 2, 'val': {'status': 'full-sync', 'marker': '', 'next_step_marker': '00000000000000000000:00000000000000035238', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.359696Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034873', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:45.700566Z'}}] 2024-04-16T18:42:39.904 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:39.904 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:39.904 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=00000000000000000000:00000000000000035379 target= 2024-04-16T18:42:44.905 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:44.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:44.906 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:44.963 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:44.963 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:45.044 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000025945","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000035379","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.697830Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":55},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T18:42:45.045 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":3590838497001870698},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000025945","next_step_marker":"","total_entries":9,"pos":0,"timestamp":"2024-04-16T18:33:25.689215Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000040033","next_step_marker":"","total_entries":46,"pos":0,"timestamp":"2024-04-16T18:40:36.372375Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000035379","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.697830Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000034873","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:40:45.700566Z"}}]},"full_sync":{"total":55,"complete":55},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T18:42:45.045 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000025945', 'next_step_marker': '', 'total_entries': 9, 'pos': 0, 'timestamp': '2024-04-16T18:33:25.689215Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000040033', 'next_step_marker': '', 'total_entries': 46, 'pos': 0, 'timestamp': '2024-04-16T18:40:36.372375Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000035379', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:45.697830Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000034873', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:40:45.700566Z'}}] 2024-04-16T18:42:45.045 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:45.045 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000025945', 1: '00000000000000000000:00000000000000040033', 2: '00000000000000000000:00000000000000035379', 3: '00000000000000000000:00000000000000034873'} 2024-04-16T18:42:45.045 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2024-04-16T18:42:45.045 DEBUG:rgw_multi.tests:data checkpoint: source=test-zone2 target=test-zone1 2024-04-16T18:42:45.045 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.046 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:45.093 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:45.093 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:45.175 INFO:teuthology.orchestra.run.smithi139.stdout:[{"marker":"00000000000000000000:00000000000000007548","last_update":"2024-04-16T18:35:00.327228Z"},{"marker":"00000000000000000000:00000000000000016697","last_update":"2024-04-16T18:42:10.595797Z"},{"marker":"00000000000000000000:00000000000000017274","last_update":"2024-04-16T18:42:26.707980Z"},{"marker":"00000000000000000000:00000000000000013647","last_update":"2024-04-16T18:42:26.710053Z"}] 2024-04-16T18:42:45.176 DEBUG:rgw_multi.tests:data markers for zone=test-zone2 markers={0: '00000000000000000000:00000000000000007548', 1: '00000000000000000000:00000000000000016697', 2: '00000000000000000000:00000000000000017274', 3: '00000000000000000000:00000000000000013647'} 2024-04-16T18:42:45.176 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:42:45.176 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.176 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:45.233 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:45.234 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:45.316 INFO:teuthology.orchestra.run.smithi016.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007548","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:35:00.327228Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016697","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:10.595797Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000017274","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:26.707980Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013647","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:26.710053Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T18:42:45.316 DEBUG:rgw_multi.tests:current data sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":13232108937970082950},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000007548","next_step_marker":"","total_entries":2,"pos":0,"timestamp":"2024-04-16T18:35:00.327228Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000016697","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:10.595797Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000017274","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:26.707980Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"00000000000000000000:00000000000000013647","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:26.710053Z"}}]},"full_sync":{"total":2,"complete":2},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T18:42:45.317 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000007548', 'next_step_marker': '', 'total_entries': 2, 'pos': 0, 'timestamp': '2024-04-16T18:35:00.327228Z'}}, {'key': 1, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000016697', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:42:10.595797Z'}}, {'key': 2, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000017274', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:42:26.707980Z'}}, {'key': 3, 'val': {'status': 'incremental-sync', 'marker': '00000000000000000000:00000000000000013647', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:42:26.710053Z'}}] 2024-04-16T18:42:45.317 DEBUG:rgw_multi.tests:log_status={0: '00000000000000000000:00000000000000007548', 1: '00000000000000000000:00000000000000016697', 2: '00000000000000000000:00000000000000017274', 3: '00000000000000000000:00000000000000013647'} 2024-04-16T18:42:45.317 DEBUG:rgw_multi.tests:sync_status={0: '00000000000000000000:00000000000000007548', 1: '00000000000000000000:00000000000000016697', 2: '00000000000000000000:00000000000000017274', 3: '00000000000000000000:00000000000000013647'} 2024-04-16T18:42:45.317 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2024-04-16T18:42:45.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_incremental_sync_after_data_sync_init ... ok 2024-04-16T18:42:45.319 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:45.319 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:45.319 DEBUG:boto:Method: PUT 2024-04-16T18:42:45.319 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:45.320 DEBUG:boto:Data: 2024-04-16T18:42:45.320 DEBUG:boto:Headers: {} 2024-04-16T18:42:45.320 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:45.320 DEBUG:boto:Port: 8000 2024-04-16T18:42:45.320 DEBUG:boto:Params: {} 2024-04-16T18:42:45.320 DEBUG:boto:Token: None 2024-04-16T18:42:45.320 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:42:45 GMT /cjqttm-56/ 2024-04-16T18:42:45.320 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iWCEbqwcqYfpIGfEDpz4TGOYeOI= 2024-04-16T18:42:45.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iWCEbqwcqYfpIGfEDpz4TGOYeOI=', 'Content-Length': '0'} 2024-04-16T18:42:45.337 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx000006677816fc5c92a13-00661ec6a5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:45.337 DEBUG:rgw_multi.tests:created bucket=cjqttm-56 2024-04-16T18:42:45.338 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.338 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:45.384 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:45.385 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:45.435 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:42:45.457 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713292965.337055_1519.1","last_update":"2024-04-16T18:42:45.337055Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:42:45.458 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:42:45.458 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:42:45.458 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:45.458 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:45.506 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:45.507 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:45.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:45.558+0000 7f7c4bc9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:42:45.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:45.559+0000 7f7c4bc9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:42:45.582 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.328527_1516.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.328527Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T18:42:45.582 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.328527_1516.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.328527Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T18:42:45.582 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292965.328527_1516.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:42:45.328527Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:42:45.582 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:42:45.582 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.328527_1516.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:42:45.582 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713292965.337055_1519.1 target=1_1713292965.328527_1516.1 2024-04-16T18:42:50.583 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:50.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:42:50.584 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:42:50.639 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:50.639 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:50.694 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:50.695+0000 7f0b7572d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:42:50.696 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:50.696+0000 7f0b7572d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:42:50.719 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.337055_1519.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.337055Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:50Z"} 2024-04-16T18:42:50.719 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.337055_1519.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.337055Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:50Z"} 2024-04-16T18:42:50.719 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292965.337055_1519.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:42:45.337055Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:42:50.719 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:42:50.719 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:42:50.720 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:42:50.720 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:50.720 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:50.720 DEBUG:boto:Method: HEAD 2024-04-16T18:42:50.720 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:50.720 DEBUG:boto:Data: 2024-04-16T18:42:50.720 DEBUG:boto:Headers: {} 2024-04-16T18:42:50.720 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.720 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.720 DEBUG:boto:Params: {} 2024-04-16T18:42:50.720 DEBUG:boto:Token: None 2024-04-16T18:42:50.721 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/ 2024-04-16T18:42:50.721 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T18:42:50.721 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T18:42:50.723 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8f761e1ee9cb26d-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.724 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:42:50.724 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:42:50.724 DEBUG:boto:Method: PUT 2024-04-16T18:42:50.724 DEBUG:boto:Path: /cjqttm-56/obj11 2024-04-16T18:42:50.724 DEBUG:boto:Data: 2024-04-16T18:42:50.724 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:50.724 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.724 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.724 DEBUG:boto:Params: {} 2024-04-16T18:42:50.724 DEBUG:boto:Token: None 2024-04-16T18:42:50.725 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/obj11 2024-04-16T18:42:50.725 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9n432fczakdTocgXO29t+0JDdAc= 2024-04-16T18:42:50.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9n432fczakdTocgXO29t+0JDdAc='} 2024-04-16T18:42:50.733 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e847ba94d939acd1-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.733 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:50.733 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:50.733 DEBUG:boto:Method: HEAD 2024-04-16T18:42:50.733 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:50.733 DEBUG:boto:Data: 2024-04-16T18:42:50.734 DEBUG:boto:Headers: {} 2024-04-16T18:42:50.734 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.734 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.734 DEBUG:boto:Params: {} 2024-04-16T18:42:50.734 DEBUG:boto:Token: None 2024-04-16T18:42:50.734 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/ 2024-04-16T18:42:50.734 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T18:42:50.734 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T18:42:50.737 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058940e18de043fae-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.737 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:42:50.737 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:42:50.737 DEBUG:boto:Method: PUT 2024-04-16T18:42:50.737 DEBUG:boto:Path: /cjqttm-56/obj22 2024-04-16T18:42:50.737 DEBUG:boto:Data: 2024-04-16T18:42:50.737 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:50.737 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.737 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.738 DEBUG:boto:Params: {} 2024-04-16T18:42:50.738 DEBUG:boto:Token: None 2024-04-16T18:42:50.738 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/obj22 2024-04-16T18:42:50.738 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ziBg22lpIw+gG41427G878dwRsk= 2024-04-16T18:42:50.738 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ziBg22lpIw+gG41427G878dwRsk='} 2024-04-16T18:42:50.743 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b0aecd9205bbe49f-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.743 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:50.743 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:50.743 DEBUG:boto:Method: HEAD 2024-04-16T18:42:50.743 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:50.743 DEBUG:boto:Data: 2024-04-16T18:42:50.743 DEBUG:boto:Headers: {} 2024-04-16T18:42:50.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.743 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.744 DEBUG:boto:Params: {} 2024-04-16T18:42:50.744 DEBUG:boto:Token: None 2024-04-16T18:42:50.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/ 2024-04-16T18:42:50.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T18:42:50.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T18:42:50.746 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008275fa7b1549a9ea-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.746 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:42:50.746 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:42:50.746 DEBUG:boto:Method: PUT 2024-04-16T18:42:50.746 DEBUG:boto:Path: /cjqttm-56/obj33 2024-04-16T18:42:50.747 DEBUG:boto:Data: 2024-04-16T18:42:50.747 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:50.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.747 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.747 DEBUG:boto:Params: {} 2024-04-16T18:42:50.747 DEBUG:boto:Token: None 2024-04-16T18:42:50.747 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/obj33 2024-04-16T18:42:50.747 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2hbLh494JlA+LawFSFor/xX8xNs= 2024-04-16T18:42:50.747 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2hbLh494JlA+LawFSFor/xX8xNs='} 2024-04-16T18:42:50.790 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000059eb6cc8f6b9afee-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.791 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:50.791 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:50.791 DEBUG:boto:Method: HEAD 2024-04-16T18:42:50.791 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:50.791 DEBUG:boto:Data: 2024-04-16T18:42:50.791 DEBUG:boto:Headers: {} 2024-04-16T18:42:50.791 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.791 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.791 DEBUG:boto:Params: {} 2024-04-16T18:42:50.791 DEBUG:boto:Token: None 2024-04-16T18:42:50.792 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/ 2024-04-16T18:42:50.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T18:42:50.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T18:42:50.794 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f76066edd6a0130-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.794 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:42:50.794 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:42:50.794 DEBUG:boto:Method: PUT 2024-04-16T18:42:50.794 DEBUG:boto:Path: /cjqttm-56/obj44 2024-04-16T18:42:50.794 DEBUG:boto:Data: 2024-04-16T18:42:50.795 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:50.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.795 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.795 DEBUG:boto:Params: {} 2024-04-16T18:42:50.795 DEBUG:boto:Token: None 2024-04-16T18:42:50.795 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/obj44 2024-04-16T18:42:50.795 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2kgNjs/gMgOQRKlLU0ZbSFnNG6k= 2024-04-16T18:42:50.795 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2kgNjs/gMgOQRKlLU0ZbSFnNG6k='} 2024-04-16T18:42:50.801 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ee70de23ae502779-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.802 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:50.802 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:50.802 DEBUG:boto:Method: HEAD 2024-04-16T18:42:50.802 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:50.802 DEBUG:boto:Data: 2024-04-16T18:42:50.802 DEBUG:boto:Headers: {} 2024-04-16T18:42:50.802 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.802 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.802 DEBUG:boto:Params: {} 2024-04-16T18:42:50.802 DEBUG:boto:Token: None 2024-04-16T18:42:50.803 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/ 2024-04-16T18:42:50.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T18:42:50.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T18:42:50.805 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fff602b8e0854d29-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.805 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:42:50.805 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:42:50.805 DEBUG:boto:Method: PUT 2024-04-16T18:42:50.805 DEBUG:boto:Path: /cjqttm-56/obj55 2024-04-16T18:42:50.806 DEBUG:boto:Data: 2024-04-16T18:42:50.806 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:50.806 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.806 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.806 DEBUG:boto:Params: {} 2024-04-16T18:42:50.806 DEBUG:boto:Token: None 2024-04-16T18:42:50.806 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/obj55 2024-04-16T18:42:50.806 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:g5MF38Yez2GwnSm04cbhZw7Y1Dk= 2024-04-16T18:42:50.806 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g5MF38Yez2GwnSm04cbhZw7Y1Dk='} 2024-04-16T18:42:50.811 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a5bebc8883c1aeb-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.811 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:50.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:50.812 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:42:50.867 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:50.867 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:50.936 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:42:50.936 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-56 2024-04-16T18:42:50.941 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 5 2024-04-16T18:42:50.993 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:50.993 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:50.993 DEBUG:boto:Method: HEAD 2024-04-16T18:42:50.993 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:50.993 DEBUG:boto:Data: 2024-04-16T18:42:50.993 DEBUG:boto:Headers: {} 2024-04-16T18:42:50.993 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.993 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.993 DEBUG:boto:Params: {} 2024-04-16T18:42:50.993 DEBUG:boto:Token: None 2024-04-16T18:42:50.994 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/ 2024-04-16T18:42:50.994 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T18:42:50.994 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T18:42:50.996 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001b0480eb1d4623f0-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:50.996 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:42:50.997 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:42:50.997 DEBUG:boto:Method: PUT 2024-04-16T18:42:50.997 DEBUG:boto:Path: /cjqttm-56/obj17 2024-04-16T18:42:50.997 DEBUG:boto:Data: 2024-04-16T18:42:50.997 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:50.997 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:50.997 DEBUG:boto:Port: 8000 2024-04-16T18:42:50.997 DEBUG:boto:Params: {} 2024-04-16T18:42:50.997 DEBUG:boto:Token: None 2024-04-16T18:42:50.998 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:50 GMT /cjqttm-56/obj17 2024-04-16T18:42:50.998 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1qqdvYnF3dSMRAEpF9H7rwTlODM= 2024-04-16T18:42:50.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1qqdvYnF3dSMRAEpF9H7rwTlODM='} 2024-04-16T18:42:51.003 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007201649e2ae5acda-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.003 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.004 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.004 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.004 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.004 DEBUG:boto:Data: 2024-04-16T18:42:51.004 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.004 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.004 DEBUG:boto:Params: {} 2024-04-16T18:42:51.004 DEBUG:boto:Token: None 2024-04-16T18:42:51.004 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.007 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001f51904fca6d08e6-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.007 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:42:51.007 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:42:51.007 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.007 DEBUG:boto:Path: /cjqttm-56/obj34 2024-04-16T18:42:51.007 DEBUG:boto:Data: 2024-04-16T18:42:51.007 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.007 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.007 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.008 DEBUG:boto:Params: {} 2024-04-16T18:42:51.008 DEBUG:boto:Token: None 2024-04-16T18:42:51.008 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj34 2024-04-16T18:42:51.008 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UjsECQNdrVXuChV/Cxb/5hxEDJA= 2024-04-16T18:42:51.008 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UjsECQNdrVXuChV/Cxb/5hxEDJA='} 2024-04-16T18:42:51.050 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b38d00d38e313cff-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.051 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.051 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.051 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.051 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.051 DEBUG:boto:Data: 2024-04-16T18:42:51.051 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.051 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.051 DEBUG:boto:Params: {} 2024-04-16T18:42:51.051 DEBUG:boto:Token: None 2024-04-16T18:42:51.052 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.054 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004ecea42105b9abf8-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.054 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:42:51.054 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:42:51.054 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.054 DEBUG:boto:Path: /cjqttm-56/obj51 2024-04-16T18:42:51.054 DEBUG:boto:Data: 2024-04-16T18:42:51.055 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.055 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.055 DEBUG:boto:Params: {} 2024-04-16T18:42:51.055 DEBUG:boto:Token: None 2024-04-16T18:42:51.055 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj51 2024-04-16T18:42:51.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FlfESczYpEMR4BodJuRGYNcjYaE= 2024-04-16T18:42:51.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FlfESczYpEMR4BodJuRGYNcjYaE='} 2024-04-16T18:42:51.060 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000683503253ff08ad3-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.060 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.060 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.061 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.061 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.061 DEBUG:boto:Data: 2024-04-16T18:42:51.061 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.061 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.061 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.061 DEBUG:boto:Params: {} 2024-04-16T18:42:51.061 DEBUG:boto:Token: None 2024-04-16T18:42:51.061 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.061 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.061 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.064 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006a1dae2edcb81bad-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.064 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:42:51.064 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:42:51.064 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.064 DEBUG:boto:Path: /cjqttm-56/obj68 2024-04-16T18:42:51.064 DEBUG:boto:Data: 2024-04-16T18:42:51.064 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.064 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.064 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.064 DEBUG:boto:Params: {} 2024-04-16T18:42:51.065 DEBUG:boto:Token: None 2024-04-16T18:42:51.065 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj68 2024-04-16T18:42:51.065 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ff4vuNE3YhepeqXT2gqYXSxKaks= 2024-04-16T18:42:51.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ff4vuNE3YhepeqXT2gqYXSxKaks='} 2024-04-16T18:42:51.106 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ab4c06106b16ef2a-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.107 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.107 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.107 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.107 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.107 DEBUG:boto:Data: 2024-04-16T18:42:51.107 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.107 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.107 DEBUG:boto:Params: {} 2024-04-16T18:42:51.107 DEBUG:boto:Token: None 2024-04-16T18:42:51.107 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.110 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002a11de3bcde35e25-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.110 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:42:51.110 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:42:51.110 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.110 DEBUG:boto:Path: /cjqttm-56/obj85 2024-04-16T18:42:51.110 DEBUG:boto:Data: 2024-04-16T18:42:51.110 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.110 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.111 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.111 DEBUG:boto:Params: {} 2024-04-16T18:42:51.111 DEBUG:boto:Token: None 2024-04-16T18:42:51.111 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj85 2024-04-16T18:42:51.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PPjRU+iCe7aMerPOiyp6RqYes8w= 2024-04-16T18:42:51.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PPjRU+iCe7aMerPOiyp6RqYes8w='} 2024-04-16T18:42:51.116 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a24c31e66791d225-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.117 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:51.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:51.117 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:42:51.167 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:51.168 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:51.230 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:42:51.231 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-56 2024-04-16T18:42:51.238 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 10 2024-04-16T18:42:51.293 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.293 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.293 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.293 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.293 DEBUG:boto:Data: 2024-04-16T18:42:51.293 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.293 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.294 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.294 DEBUG:boto:Params: {} 2024-04-16T18:42:51.294 DEBUG:boto:Token: None 2024-04-16T18:42:51.294 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.294 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.294 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.296 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c228094d1c586ee6-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.297 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:42:51.297 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:42:51.297 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.297 DEBUG:boto:Path: /cjqttm-56/obj19 2024-04-16T18:42:51.297 DEBUG:boto:Data: 2024-04-16T18:42:51.297 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.297 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.297 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.297 DEBUG:boto:Params: {} 2024-04-16T18:42:51.298 DEBUG:boto:Token: None 2024-04-16T18:42:51.298 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj19 2024-04-16T18:42:51.298 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:K/a7L/JVWYIkQk9YHf+MzY4oreY= 2024-04-16T18:42:51.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K/a7L/JVWYIkQk9YHf+MzY4oreY='} 2024-04-16T18:42:51.303 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d84f476598770234-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.303 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.303 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.303 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.303 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.303 DEBUG:boto:Data: 2024-04-16T18:42:51.303 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.303 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.304 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.304 DEBUG:boto:Params: {} 2024-04-16T18:42:51.304 DEBUG:boto:Token: None 2024-04-16T18:42:51.304 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.306 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0b4a92006c705b1-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.307 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:42:51.307 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:42:51.307 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.307 DEBUG:boto:Path: /cjqttm-56/obj38 2024-04-16T18:42:51.307 DEBUG:boto:Data: 2024-04-16T18:42:51.307 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.307 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.307 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.307 DEBUG:boto:Params: {} 2024-04-16T18:42:51.307 DEBUG:boto:Token: None 2024-04-16T18:42:51.307 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj38 2024-04-16T18:42:51.308 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l037I96dlBO/4ky1qJ6IrsQpFtE= 2024-04-16T18:42:51.308 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l037I96dlBO/4ky1qJ6IrsQpFtE='} 2024-04-16T18:42:51.350 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000004fcf1f960f0a3bd-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.351 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.351 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.351 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.351 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.351 DEBUG:boto:Data: 2024-04-16T18:42:51.351 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.351 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.351 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.351 DEBUG:boto:Params: {} 2024-04-16T18:42:51.351 DEBUG:boto:Token: None 2024-04-16T18:42:51.352 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.354 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000a4fea64600b7ac7-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.354 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:42:51.354 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:42:51.354 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.355 DEBUG:boto:Path: /cjqttm-56/obj57 2024-04-16T18:42:51.355 DEBUG:boto:Data: 2024-04-16T18:42:51.355 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.355 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.355 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.355 DEBUG:boto:Params: {} 2024-04-16T18:42:51.355 DEBUG:boto:Token: None 2024-04-16T18:42:51.355 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj57 2024-04-16T18:42:51.355 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ESXpOES9CI/e6w2OrNlggUnH4Iw= 2024-04-16T18:42:51.355 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ESXpOES9CI/e6w2OrNlggUnH4Iw='} 2024-04-16T18:42:51.359 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000203473c0266559d4-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.359 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.359 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.359 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.359 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.359 DEBUG:boto:Data: 2024-04-16T18:42:51.360 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.360 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.360 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.360 DEBUG:boto:Params: {} 2024-04-16T18:42:51.360 DEBUG:boto:Token: None 2024-04-16T18:42:51.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.360 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.362 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f383b877cb7c869b-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.362 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:42:51.362 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:42:51.363 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.363 DEBUG:boto:Path: /cjqttm-56/obj76 2024-04-16T18:42:51.363 DEBUG:boto:Data: 2024-04-16T18:42:51.363 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.363 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.363 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.363 DEBUG:boto:Params: {} 2024-04-16T18:42:51.363 DEBUG:boto:Token: None 2024-04-16T18:42:51.363 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj76 2024-04-16T18:42:51.363 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sjRqY3vaWqfshMC7HshfV5JsCRg= 2024-04-16T18:42:51.364 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sjRqY3vaWqfshMC7HshfV5JsCRg='} 2024-04-16T18:42:51.369 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007ef9b12279d3a5f5-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.369 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.369 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.369 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.369 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.370 DEBUG:boto:Data: 2024-04-16T18:42:51.370 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.370 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.370 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.370 DEBUG:boto:Params: {} 2024-04-16T18:42:51.370 DEBUG:boto:Token: None 2024-04-16T18:42:51.370 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.370 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.370 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.373 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008498eb47949becb8-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.373 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:42:51.373 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:42:51.373 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.373 DEBUG:boto:Path: /cjqttm-56/obj95 2024-04-16T18:42:51.373 DEBUG:boto:Data: 2024-04-16T18:42:51.373 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.373 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.374 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.374 DEBUG:boto:Params: {} 2024-04-16T18:42:51.374 DEBUG:boto:Token: None 2024-04-16T18:42:51.374 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj95 2024-04-16T18:42:51.374 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fLGlChFvg5s+V4H6wqRpj5NVt3A= 2024-04-16T18:42:51.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fLGlChFvg5s+V4H6wqRpj5NVt3A='} 2024-04-16T18:42:51.418 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b0194dc35a1e46d5-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.419 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:51.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:51.419 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:42:51.470 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:51.470 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:51.539 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:42:51.539 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-56 2024-04-16T18:42:51.546 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 15 2024-04-16T18:42:51.606 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.607 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.607 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.607 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.607 DEBUG:boto:Data: 2024-04-16T18:42:51.607 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.607 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.607 DEBUG:boto:Params: {} 2024-04-16T18:42:51.607 DEBUG:boto:Token: None 2024-04-16T18:42:51.607 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.611 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000025e821a9be5421ac-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.611 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:42:51.611 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:42:51.611 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.611 DEBUG:boto:Path: /cjqttm-56/obj23 2024-04-16T18:42:51.611 DEBUG:boto:Data: 2024-04-16T18:42:51.611 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.612 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.612 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.612 DEBUG:boto:Params: {} 2024-04-16T18:42:51.612 DEBUG:boto:Token: None 2024-04-16T18:42:51.612 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj23 2024-04-16T18:42:51.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:xOZYbS3qCgintPc6PAJvwc1/iCM= 2024-04-16T18:42:51.612 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xOZYbS3qCgintPc6PAJvwc1/iCM='} 2024-04-16T18:42:51.618 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bdf6676a0027f2ae-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.618 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.618 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.618 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.618 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.619 DEBUG:boto:Data: 2024-04-16T18:42:51.619 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.619 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.619 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.619 DEBUG:boto:Params: {} 2024-04-16T18:42:51.619 DEBUG:boto:Token: None 2024-04-16T18:42:51.619 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.619 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.622 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092413e44a9bb6edc-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.622 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:42:51.622 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:42:51.622 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.622 DEBUG:boto:Path: /cjqttm-56/obj46 2024-04-16T18:42:51.622 DEBUG:boto:Data: 2024-04-16T18:42:51.622 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.623 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.623 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.623 DEBUG:boto:Params: {} 2024-04-16T18:42:51.623 DEBUG:boto:Token: None 2024-04-16T18:42:51.623 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj46 2024-04-16T18:42:51.623 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:avEUhSLI9VDq+KVQcFdUhyF9XEY= 2024-04-16T18:42:51.623 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:avEUhSLI9VDq+KVQcFdUhyF9XEY='} 2024-04-16T18:42:51.628 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d20af17950be618f-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.628 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.628 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.628 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.629 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.629 DEBUG:boto:Data: 2024-04-16T18:42:51.629 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.629 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.629 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.629 DEBUG:boto:Params: {} 2024-04-16T18:42:51.629 DEBUG:boto:Token: None 2024-04-16T18:42:51.629 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.629 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.629 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.632 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000943016b7718b6b9-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.632 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:42:51.632 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:42:51.632 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.632 DEBUG:boto:Path: /cjqttm-56/obj69 2024-04-16T18:42:51.632 DEBUG:boto:Data: 2024-04-16T18:42:51.632 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.632 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.632 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.632 DEBUG:boto:Params: {} 2024-04-16T18:42:51.633 DEBUG:boto:Token: None 2024-04-16T18:42:51.633 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj69 2024-04-16T18:42:51.633 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2RBi9xCxreEuLdTqL8KNsI1991g= 2024-04-16T18:42:51.633 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2RBi9xCxreEuLdTqL8KNsI1991g='} 2024-04-16T18:42:51.674 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005e2b02e23aea2429-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.675 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.675 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.675 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.675 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.675 DEBUG:boto:Data: 2024-04-16T18:42:51.675 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.675 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.675 DEBUG:boto:Params: {} 2024-04-16T18:42:51.675 DEBUG:boto:Token: None 2024-04-16T18:42:51.676 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.678 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000efb49bc6b5ef62e3-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.678 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:42:51.678 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:42:51.679 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.679 DEBUG:boto:Path: /cjqttm-56/obj92 2024-04-16T18:42:51.679 DEBUG:boto:Data: 2024-04-16T18:42:51.679 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.679 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.679 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.679 DEBUG:boto:Params: {} 2024-04-16T18:42:51.679 DEBUG:boto:Token: None 2024-04-16T18:42:51.679 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj92 2024-04-16T18:42:51.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Qd9KY5Hzdk2o8n60SiMjWBG3mu8= 2024-04-16T18:42:51.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qd9KY5Hzdk2o8n60SiMjWBG3mu8='} 2024-04-16T18:42:51.684 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f7f606ac928c03d7-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.685 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.685 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.685 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.685 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.685 DEBUG:boto:Data: 2024-04-16T18:42:51.685 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.685 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.685 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.685 DEBUG:boto:Params: {} 2024-04-16T18:42:51.685 DEBUG:boto:Token: None 2024-04-16T18:42:51.685 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.686 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.688 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005eddac03db1b2d0f-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.688 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:42:51.688 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:42:51.688 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.688 DEBUG:boto:Path: /cjqttm-56/obj115 2024-04-16T18:42:51.688 DEBUG:boto:Data: 2024-04-16T18:42:51.688 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.689 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.689 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.689 DEBUG:boto:Params: {} 2024-04-16T18:42:51.689 DEBUG:boto:Token: None 2024-04-16T18:42:51.689 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj115 2024-04-16T18:42:51.689 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ecKcJJkI3K+1jOnpxIaeMe0lTvc= 2024-04-16T18:42:51.689 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ecKcJJkI3K+1jOnpxIaeMe0lTvc='} 2024-04-16T18:42:51.695 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001abd26b7057d32f9-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.695 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:51.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:51.695 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:42:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:51.746 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:51.811 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:42:51.811 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-56 2024-04-16T18:42:51.820 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 20 2024-04-16T18:42:51.884 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.884 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.884 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.884 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.884 DEBUG:boto:Data: 2024-04-16T18:42:51.884 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.884 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.884 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.885 DEBUG:boto:Params: {} 2024-04-16T18:42:51.885 DEBUG:boto:Token: None 2024-04-16T18:42:51.885 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.885 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.885 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.888 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005dda7359ea2dcce1-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.888 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:42:51.888 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:42:51.888 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.888 DEBUG:boto:Path: /cjqttm-56/obj29 2024-04-16T18:42:51.889 DEBUG:boto:Data: 2024-04-16T18:42:51.889 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.889 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.889 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.889 DEBUG:boto:Params: {} 2024-04-16T18:42:51.889 DEBUG:boto:Token: None 2024-04-16T18:42:51.889 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj29 2024-04-16T18:42:51.889 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pvDloHz2JZATcCvJWZOttoaL4JE= 2024-04-16T18:42:51.889 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pvDloHz2JZATcCvJWZOttoaL4JE='} 2024-04-16T18:42:51.934 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a277df49cdebdb95-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.935 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.935 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.935 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.935 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.935 DEBUG:boto:Data: 2024-04-16T18:42:51.935 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.935 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.935 DEBUG:boto:Params: {} 2024-04-16T18:42:51.935 DEBUG:boto:Token: None 2024-04-16T18:42:51.936 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.938 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000475a303646bee164-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.938 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:42:51.939 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:42:51.939 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.939 DEBUG:boto:Path: /cjqttm-56/obj58 2024-04-16T18:42:51.939 DEBUG:boto:Data: 2024-04-16T18:42:51.939 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.939 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.939 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.939 DEBUG:boto:Params: {} 2024-04-16T18:42:51.939 DEBUG:boto:Token: None 2024-04-16T18:42:51.940 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj58 2024-04-16T18:42:51.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ab/GA7BaT1lE8N4QnprEmAfkCzs= 2024-04-16T18:42:51.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ab/GA7BaT1lE8N4QnprEmAfkCzs='} 2024-04-16T18:42:51.945 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e9293394fb51e95e-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.945 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.945 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.945 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.945 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.945 DEBUG:boto:Data: 2024-04-16T18:42:51.945 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.945 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.946 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.946 DEBUG:boto:Params: {} 2024-04-16T18:42:51.946 DEBUG:boto:Token: None 2024-04-16T18:42:51.946 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.946 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.949 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9b928958f4d9b1e-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.949 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:42:51.949 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:42:51.949 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.950 DEBUG:boto:Path: /cjqttm-56/obj87 2024-04-16T18:42:51.950 DEBUG:boto:Data: 2024-04-16T18:42:51.950 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.950 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.950 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.950 DEBUG:boto:Params: {} 2024-04-16T18:42:51.950 DEBUG:boto:Token: None 2024-04-16T18:42:51.950 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/obj87 2024-04-16T18:42:51.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:42ynO98hN6PPb6dfR5LT0AGSRRQ= 2024-04-16T18:42:51.951 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:42ynO98hN6PPb6dfR5LT0AGSRRQ='} 2024-04-16T18:42:51.994 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000053a12b2825ad4df0-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.995 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:51.995 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:51.995 DEBUG:boto:Method: HEAD 2024-04-16T18:42:51.995 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:51.995 DEBUG:boto:Data: 2024-04-16T18:42:51.995 DEBUG:boto:Headers: {} 2024-04-16T18:42:51.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.995 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.995 DEBUG:boto:Params: {} 2024-04-16T18:42:51.996 DEBUG:boto:Token: None 2024-04-16T18:42:51.996 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:51 GMT /cjqttm-56/ 2024-04-16T18:42:51.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T18:42:51.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T18:42:51.998 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069956cf7fbf61c3b-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:51.999 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:42:51.999 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:42:51.999 DEBUG:boto:Method: PUT 2024-04-16T18:42:51.999 DEBUG:boto:Path: /cjqttm-56/obj116 2024-04-16T18:42:51.999 DEBUG:boto:Data: 2024-04-16T18:42:51.999 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:51.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:51.999 DEBUG:boto:Port: 8000 2024-04-16T18:42:51.999 DEBUG:boto:Params: {} 2024-04-16T18:42:52.000 DEBUG:boto:Token: None 2024-04-16T18:42:52.000 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj116 2024-04-16T18:42:52.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cve8Q2BQeszmDLWhUKzNd+shQjA= 2024-04-16T18:42:52.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cve8Q2BQeszmDLWhUKzNd+shQjA='} 2024-04-16T18:42:52.005 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c0bf820bb710825-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.005 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.006 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.006 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.006 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.006 DEBUG:boto:Data: 2024-04-16T18:42:52.006 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.006 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.006 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.006 DEBUG:boto:Params: {} 2024-04-16T18:42:52.006 DEBUG:boto:Token: None 2024-04-16T18:42:52.007 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.007 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.009 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000741a5c258cc792ac-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.009 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:42:52.009 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:42:52.010 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.010 DEBUG:boto:Path: /cjqttm-56/obj145 2024-04-16T18:42:52.010 DEBUG:boto:Data: 2024-04-16T18:42:52.010 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.010 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.010 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.010 DEBUG:boto:Params: {} 2024-04-16T18:42:52.010 DEBUG:boto:Token: None 2024-04-16T18:42:52.010 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj145 2024-04-16T18:42:52.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NDceUCFGHFqQBqLNhyE56izniUI= 2024-04-16T18:42:52.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NDceUCFGHFqQBqLNhyE56izniUI='} 2024-04-16T18:42:52.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009fae2a2747ecd540-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.055 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:52.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:52.055 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:42:52.109 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:52.110 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:52.175 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:42:52.176 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-56 2024-04-16T18:42:52.187 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 25 2024-04-16T18:42:52.254 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.254 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.254 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.254 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.254 DEBUG:boto:Data: 2024-04-16T18:42:52.254 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.254 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.254 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.255 DEBUG:boto:Params: {} 2024-04-16T18:42:52.255 DEBUG:boto:Token: None 2024-04-16T18:42:52.255 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.255 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.255 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.258 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bc4d5372801084ef-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.259 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:42:52.259 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:42:52.259 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.259 DEBUG:boto:Path: /cjqttm-56/obj31 2024-04-16T18:42:52.259 DEBUG:boto:Data: 2024-04-16T18:42:52.259 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.259 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.259 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.259 DEBUG:boto:Params: {} 2024-04-16T18:42:52.259 DEBUG:boto:Token: None 2024-04-16T18:42:52.260 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj31 2024-04-16T18:42:52.260 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+1cxUiVSJJYcv+I2tGqW/v9cxIU= 2024-04-16T18:42:52.260 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+1cxUiVSJJYcv+I2tGqW/v9cxIU='} 2024-04-16T18:42:52.264 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002bfddcee9f7098dc-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.265 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.265 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.265 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.265 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.265 DEBUG:boto:Data: 2024-04-16T18:42:52.265 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.265 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.265 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.265 DEBUG:boto:Params: {} 2024-04-16T18:42:52.265 DEBUG:boto:Token: None 2024-04-16T18:42:52.266 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.266 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.266 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.268 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007c942ea456b57114-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.269 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:42:52.269 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:42:52.269 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.269 DEBUG:boto:Path: /cjqttm-56/obj62 2024-04-16T18:42:52.269 DEBUG:boto:Data: 2024-04-16T18:42:52.269 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.269 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.269 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.270 DEBUG:boto:Params: {} 2024-04-16T18:42:52.270 DEBUG:boto:Token: None 2024-04-16T18:42:52.270 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj62 2024-04-16T18:42:52.270 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5EWUaTgXe9dukKIjmXaw1qrost0= 2024-04-16T18:42:52.270 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EWUaTgXe9dukKIjmXaw1qrost0='} 2024-04-16T18:42:52.275 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d368574e00d98fe2-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.275 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.275 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.275 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.276 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.276 DEBUG:boto:Data: 2024-04-16T18:42:52.276 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.276 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.276 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.276 DEBUG:boto:Params: {} 2024-04-16T18:42:52.276 DEBUG:boto:Token: None 2024-04-16T18:42:52.276 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.279 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009c990a39147acd4b-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.279 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:42:52.279 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:42:52.279 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.279 DEBUG:boto:Path: /cjqttm-56/obj93 2024-04-16T18:42:52.279 DEBUG:boto:Data: 2024-04-16T18:42:52.279 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.280 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.280 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.280 DEBUG:boto:Params: {} 2024-04-16T18:42:52.280 DEBUG:boto:Token: None 2024-04-16T18:42:52.280 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj93 2024-04-16T18:42:52.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:0W58CJwz0+9J8w+qqwMWRz2Grns= 2024-04-16T18:42:52.280 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0W58CJwz0+9J8w+qqwMWRz2Grns='} 2024-04-16T18:42:52.322 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006efa18f40f11cc9b-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.323 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.323 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.323 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.323 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.323 DEBUG:boto:Data: 2024-04-16T18:42:52.323 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.323 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.323 DEBUG:boto:Params: {} 2024-04-16T18:42:52.323 DEBUG:boto:Token: None 2024-04-16T18:42:52.324 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.327 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000228c453943f8d435-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.327 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:42:52.327 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:42:52.327 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.327 DEBUG:boto:Path: /cjqttm-56/obj124 2024-04-16T18:42:52.327 DEBUG:boto:Data: 2024-04-16T18:42:52.327 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.327 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.327 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.328 DEBUG:boto:Params: {} 2024-04-16T18:42:52.328 DEBUG:boto:Token: None 2024-04-16T18:42:52.328 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj124 2024-04-16T18:42:52.328 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3cftKEJa+xR0zhNh7QV0Nnp/Euk= 2024-04-16T18:42:52.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3cftKEJa+xR0zhNh7QV0Nnp/Euk='} 2024-04-16T18:42:52.333 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b2e55ea115cf7c3-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.333 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.333 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.333 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.333 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.334 DEBUG:boto:Data: 2024-04-16T18:42:52.334 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.334 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.334 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.334 DEBUG:boto:Params: {} 2024-04-16T18:42:52.334 DEBUG:boto:Token: None 2024-04-16T18:42:52.334 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.334 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.334 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.337 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000014e893090e7872b2-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.337 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:42:52.337 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:42:52.337 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.337 DEBUG:boto:Path: /cjqttm-56/obj155 2024-04-16T18:42:52.338 DEBUG:boto:Data: 2024-04-16T18:42:52.338 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.338 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.338 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.338 DEBUG:boto:Params: {} 2024-04-16T18:42:52.338 DEBUG:boto:Token: None 2024-04-16T18:42:52.338 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj155 2024-04-16T18:42:52.338 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kGhsC43RlVCBbTk2pPSaI1OBCE4= 2024-04-16T18:42:52.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kGhsC43RlVCBbTk2pPSaI1OBCE4='} 2024-04-16T18:42:52.386 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001e30eca7c33ec12e-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.387 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:52.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:42:52.387 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:42:52.443 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:52.443 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:52.514 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:42:52.514 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-56 2024-04-16T18:42:52.527 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 30 2024-04-16T18:42:52.599 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.599 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.600 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.600 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.600 DEBUG:boto:Data: 2024-04-16T18:42:52.600 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.600 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.600 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.600 DEBUG:boto:Params: {} 2024-04-16T18:42:52.600 DEBUG:boto:Token: None 2024-04-16T18:42:52.600 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.601 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.601 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.604 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000009ff425282b9af40-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.604 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:42:52.604 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:42:52.604 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.604 DEBUG:boto:Path: /cjqttm-56/obj37 2024-04-16T18:42:52.604 DEBUG:boto:Data: 2024-04-16T18:42:52.605 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.605 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.605 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.605 DEBUG:boto:Params: {} 2024-04-16T18:42:52.605 DEBUG:boto:Token: None 2024-04-16T18:42:52.605 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj37 2024-04-16T18:42:52.605 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vLJ/4/M5hOP/7P+1PyGJ8SlR5Ls= 2024-04-16T18:42:52.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLJ/4/M5hOP/7P+1PyGJ8SlR5Ls='} 2024-04-16T18:42:52.611 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000026c2365e95f6bdde-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.611 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.612 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.612 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.612 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.612 DEBUG:boto:Data: 2024-04-16T18:42:52.612 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.612 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.612 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.612 DEBUG:boto:Params: {} 2024-04-16T18:42:52.612 DEBUG:boto:Token: None 2024-04-16T18:42:52.612 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.612 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.616 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000af7f3286d1a2713a-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.616 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:42:52.616 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:42:52.616 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.616 DEBUG:boto:Path: /cjqttm-56/obj74 2024-04-16T18:42:52.616 DEBUG:boto:Data: 2024-04-16T18:42:52.616 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.616 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.616 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.617 DEBUG:boto:Params: {} 2024-04-16T18:42:52.617 DEBUG:boto:Token: None 2024-04-16T18:42:52.617 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj74 2024-04-16T18:42:52.617 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vKzru+0rkFXSPrju6mN75yA1yl8= 2024-04-16T18:42:52.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vKzru+0rkFXSPrju6mN75yA1yl8='} 2024-04-16T18:42:52.658 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ccfc50785e21975-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.659 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.659 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.659 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.659 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.659 DEBUG:boto:Data: 2024-04-16T18:42:52.659 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.659 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.659 DEBUG:boto:Params: {} 2024-04-16T18:42:52.659 DEBUG:boto:Token: None 2024-04-16T18:42:52.660 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.662 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000171580f0ad32f1fe-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.663 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:42:52.663 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:42:52.663 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.663 DEBUG:boto:Path: /cjqttm-56/obj111 2024-04-16T18:42:52.663 DEBUG:boto:Data: 2024-04-16T18:42:52.663 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.663 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.663 DEBUG:boto:Params: {} 2024-04-16T18:42:52.663 DEBUG:boto:Token: None 2024-04-16T18:42:52.664 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj111 2024-04-16T18:42:52.664 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hzh56HETtd5gFJ9eazBGpZDHnw8= 2024-04-16T18:42:52.664 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hzh56HETtd5gFJ9eazBGpZDHnw8='} 2024-04-16T18:42:52.669 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004f282ee3719d500d-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.669 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.669 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.669 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.669 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.669 DEBUG:boto:Data: 2024-04-16T18:42:52.669 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.670 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.670 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.670 DEBUG:boto:Params: {} 2024-04-16T18:42:52.670 DEBUG:boto:Token: None 2024-04-16T18:42:52.670 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.670 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.670 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.673 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006a4bcd6984081245-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.673 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:42:52.673 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:42:52.673 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.673 DEBUG:boto:Path: /cjqttm-56/obj148 2024-04-16T18:42:52.673 DEBUG:boto:Data: 2024-04-16T18:42:52.674 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.674 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.674 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.674 DEBUG:boto:Params: {} 2024-04-16T18:42:52.674 DEBUG:boto:Token: None 2024-04-16T18:42:52.674 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj148 2024-04-16T18:42:52.674 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZVzlLFG/OB0lWHL9LRf+Ma0Fy7s= 2024-04-16T18:42:52.674 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZVzlLFG/OB0lWHL9LRf+Ma0Fy7s='} 2024-04-16T18:42:52.718 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e20df072fa161440-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.718 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:42:52.719 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:42:52.719 DEBUG:boto:Method: HEAD 2024-04-16T18:42:52.719 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:42:52.719 DEBUG:boto:Data: 2024-04-16T18:42:52.719 DEBUG:boto:Headers: {} 2024-04-16T18:42:52.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.719 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.719 DEBUG:boto:Params: {} 2024-04-16T18:42:52.719 DEBUG:boto:Token: None 2024-04-16T18:42:52.720 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/ 2024-04-16T18:42:52.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T18:42:52.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T18:42:52.722 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d172993a2f8c6017-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.723 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:42:52.723 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:42:52.723 DEBUG:boto:Method: PUT 2024-04-16T18:42:52.723 DEBUG:boto:Path: /cjqttm-56/obj185 2024-04-16T18:42:52.723 DEBUG:boto:Data: 2024-04-16T18:42:52.723 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:42:52.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:42:52.723 DEBUG:boto:Port: 8000 2024-04-16T18:42:52.723 DEBUG:boto:Params: {} 2024-04-16T18:42:52.724 DEBUG:boto:Token: None 2024-04-16T18:42:52.724 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:42:52 GMT /cjqttm-56/obj185 2024-04-16T18:42:52.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s2yv3I//5HPkMcXBVZMRth4k0Bk= 2024-04-16T18:42:52.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s2yv3I//5HPkMcXBVZMRth4k0Bk='} 2024-04-16T18:42:52.729 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f6be7309c7ef2e1f-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:42:52.729 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-56 2024-04-16T18:42:52.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:42:52.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:42:52.729 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:42:52.791 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:42:52.791 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:42:52.854 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:52.855+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 4.. 2024-04-16T18:42:57.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:42:57.856+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:02.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:02.857+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:07.856 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:07.858+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:12.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:12.858+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:17.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:17.859+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:22.858 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:22.858+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:27.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:27.859+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:32.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:32.860+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:37.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:37.860+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:42.860 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:42.861+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:47.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:47.861+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:52.862 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:52.862+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T18:43:57.865 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:43:57.866+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:43:57.865 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:43:57.865 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:02.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:02.868+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:02.867 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:44:02.867 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:07.869 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:07.869+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:07.869 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , 00000000002.119.6, , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:44:07.869 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:12.872 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:12.872+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:12.872 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , 00000000002.119.6, , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:44:12.872 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:17.874 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:17.874+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:17.874 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , , , , , , 00000000002.119.6, , , , , , , , , , , , , , , , , , , ] 2024-04-16T18:44:17.874 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:22.876 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:22.876+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:22.876 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:22.877 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:27.878 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:27.879+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:27.879 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:27.879 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:32.881 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:32.881+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:32.881 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:32.881 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:37.885 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:37.885+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:37.885 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:37.885 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:42.886 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:42.888+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:42.887 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:42.887 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:47.889 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:47.890+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:47.889 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:47.889 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:52.892 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:52.893+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T18:44:52.892 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:52.892 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:57.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:57.894+0000 7f648a0e4800 1 bucket sync caught up with source: 2024-04-16T18:44:57.894 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:57.894 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:44:57.894 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:44:57.894+0000 7f648a0e4800 0 bucket checkpoint complete 2024-04-16T18:44:57.922 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-56 2024-04-16T18:44:57.923 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:44:57.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:44:57.923 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-56 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:44:57.992 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:44:57.992 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:44:58.054 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:44:58.055+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:03.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:03.055+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:08.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:08.055+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:13.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:13.057+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:18.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:18.057+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:23.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:23.058+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:28.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:28.059+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:33.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:33.059+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:38.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:38.060+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:43.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:43.060+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:48.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:48.061+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:53.061 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:53.062+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:45:58.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:45:58.062+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:03.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:03.063+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:08.063+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:13.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:13.064+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:18.064 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:18.065+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:23.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:23.066+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:28.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:28.067+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:33.067 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:33.067+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:38.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:38.068+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:43.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:43.068+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:48.068 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:48.069+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:53.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:53.070+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:46:58.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:46:58.070+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:03.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:03.071+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:08.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:08.072+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:13.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:13.071+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:18.072 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:18.072+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:23.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:23.073+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:28.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:28.074+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:33.075+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:38.075 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:38.075+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:43.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:43.076+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:48.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:48.077+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:53.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:53.077+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:47:58.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:47:58.078+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:03.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:03.079+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:08.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:08.080+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:13.079 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:13.079+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:18.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:18.080+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:23.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:23.081+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:28.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:28.082+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:33.082 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:33.082+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T18:48:38.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:38.084+0000 7f520c930800 1 bucket sync caught up with source: 2024-04-16T18:48:38.084 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, 00000000003.1441.6, 00000000002.450.6, 00000000002.538.6, 00000000005.799.6, 00000000004.526.6, 00000000001.339.6, 00000000001.307.6, 00000000004.318.6, 00000000007.584.6, 00000000006.517.6] 2024-04-16T18:48:38.084 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, 00000000003.1441.6, 00000000002.450.6, 00000000002.538.6, 00000000005.799.6, 00000000004.526.6, 00000000001.339.6, 00000000001.307.6, 00000000004.318.6, 00000000007.584.6, 00000000006.517.6] 2024-04-16T18:48:38.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:48:38.084+0000 7f520c930800 0 bucket checkpoint complete 2024-04-16T18:48:38.112 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-56 zones={test-zone2, test-zone1} 2024-04-16T18:48:38.112 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.113 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.113 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.113 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:48:38.113 DEBUG:boto:Data: 2024-04-16T18:48:38.113 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.113 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.113 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.113 DEBUG:boto:Params: {} 2024-04-16T18:48:38.114 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:48:38.114 DEBUG:boto:Token: None 2024-04-16T18:48:38.114 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.114 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M= 2024-04-16T18:48:38.115 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M=', 'Content-Length': '0'} 2024-04-16T18:48:38.120 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ebc25f469d0e06a-00661ec806-6331-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.120 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.120 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.120 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.120 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:48:38.121 DEBUG:boto:Data: 2024-04-16T18:48:38.121 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.121 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.121 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.121 DEBUG:boto:Params: {} 2024-04-16T18:48:38.121 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:48:38.121 DEBUG:boto:Token: None 2024-04-16T18:48:38.121 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.121 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M= 2024-04-16T18:48:38.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M=', 'Content-Length': '0'} 2024-04-16T18:48:38.126 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000054572a59fbdfa91f-00661ec806-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.126 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:48:38.126 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.127 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.127 DEBUG:boto:path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.127 DEBUG:boto:auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.127 DEBUG:boto:Method: GET 2024-04-16T18:48:38.127 DEBUG:boto:Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.127 DEBUG:boto:Data: 2024-04-16T18:48:38.127 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.127 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.127 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.127 DEBUG:boto:Params: {} 2024-04-16T18:48:38.127 DEBUG:boto:Token: None 2024-04-16T18:48:38.128 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/?versions 2024-04-16T18:48:38.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T18:48:38.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T18:48:38.130 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089b053e407e844ae-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.131 DEBUG:boto:b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:48:38.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:48:38.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:48:38.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:48:38.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:48:38.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:48:38.133 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:48:38.134 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:48:38.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:48:38.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:48:38.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:48:38.136 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:48:38.136 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.136 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.136 DEBUG:boto:path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.136 DEBUG:boto:auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.136 DEBUG:boto:Method: GET 2024-04-16T18:48:38.136 DEBUG:boto:Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.136 DEBUG:boto:Data: 2024-04-16T18:48:38.136 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.136 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.137 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.137 DEBUG:boto:Params: {} 2024-04-16T18:48:38.137 DEBUG:boto:Token: None 2024-04-16T18:48:38.137 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/?versions 2024-04-16T18:48:38.137 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T18:48:38.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T18:48:38.141 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f66e9973d4a7b57-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.141 DEBUG:boto:b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj111 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj115 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj116 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj124 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj145 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj148 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj155 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj17 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj185 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj19 2024-04-16T18:48:38.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj23 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj29 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj31 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj34 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj37 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj38 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj46 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj51 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj57 2024-04-16T18:48:38.144 DEBUG:tasks.rgw_multi.zone_rados:o=obj58 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj62 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj68 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj69 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj74 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj76 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj85 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj87 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj92 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj93 2024-04-16T18:48:38.145 DEBUG:tasks.rgw_multi.zone_rados:o=obj95 2024-04-16T18:48:38.145 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.145 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.145 DEBUG:boto:path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.146 DEBUG:boto:auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.146 DEBUG:boto:Method: GET 2024-04-16T18:48:38.146 DEBUG:boto:Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.146 DEBUG:boto:Data: 2024-04-16T18:48:38.146 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.146 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.146 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.146 DEBUG:boto:Params: {} 2024-04-16T18:48:38.146 DEBUG:boto:Token: None 2024-04-16T18:48:38.146 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/?versions 2024-04-16T18:48:38.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T18:48:38.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T18:48:38.149 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f84b6eaadf734f40-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.150 DEBUG:boto:b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.151 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.151 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.151 DEBUG:boto:path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.151 DEBUG:boto:auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.151 DEBUG:boto:Method: GET 2024-04-16T18:48:38.152 DEBUG:boto:Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T18:48:38.152 DEBUG:boto:Data: 2024-04-16T18:48:38.152 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.152 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.152 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.152 DEBUG:boto:Params: {} 2024-04-16T18:48:38.152 DEBUG:boto:Token: None 2024-04-16T18:48:38.152 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/?versions 2024-04-16T18:48:38.152 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T18:48:38.152 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T18:48:38.156 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020b26873bf05f0b8-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.156 DEBUG:boto:b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.158 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:48:38.158 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.158 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.158 DEBUG:boto:path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.158 DEBUG:boto:auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.158 DEBUG:boto:Method: GET 2024-04-16T18:48:38.158 DEBUG:boto:Path: /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.158 DEBUG:boto:Data: 2024-04-16T18:48:38.158 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.159 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.159 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.159 DEBUG:boto:Params: {} 2024-04-16T18:48:38.159 DEBUG:boto:Token: None 2024-04-16T18:48:38.159 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.159 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T18:48:38.159 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T18:48:38.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bba30accabaad3ea-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.161 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.162 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.162 DEBUG:boto:path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.162 DEBUG:boto:auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.162 DEBUG:boto:Method: GET 2024-04-16T18:48:38.162 DEBUG:boto:Path: /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.162 DEBUG:boto:Data: 2024-04-16T18:48:38.162 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.162 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.162 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.162 DEBUG:boto:Params: {} 2024-04-16T18:48:38.163 DEBUG:boto:Token: None 2024-04-16T18:48:38.163 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T18:48:38.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T18:48:38.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096aeb559754f9e79-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.165 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.165 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.165 DEBUG:boto:path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.165 DEBUG:boto:auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.165 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.165 DEBUG:boto:Path: /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.166 DEBUG:boto:Data: 2024-04-16T18:48:38.166 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.166 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.166 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.166 DEBUG:boto:Params: {} 2024-04-16T18:48:38.166 DEBUG:boto:Token: None 2024-04-16T18:48:38.166 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws= 2024-04-16T18:48:38.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws=', 'Content-Length': '0'} 2024-04-16T18:48:38.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000deea1ff4be0b10f6-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.168 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.168 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.169 DEBUG:boto:path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.169 DEBUG:boto:auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.169 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.169 DEBUG:boto:Path: /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.169 DEBUG:boto:Data: 2024-04-16T18:48:38.169 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.169 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.169 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.169 DEBUG:boto:Params: {} 2024-04-16T18:48:38.169 DEBUG:boto:Token: None 2024-04-16T18:48:38.169 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws= 2024-04-16T18:48:38.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws=', 'Content-Length': '0'} 2024-04-16T18:48:38.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003867618bb4cd939f-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.172 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:48:38.172 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.172 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.172 DEBUG:boto:path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.172 DEBUG:boto:auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.172 DEBUG:boto:Method: GET 2024-04-16T18:48:38.172 DEBUG:boto:Path: /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.172 DEBUG:boto:Data: 2024-04-16T18:48:38.172 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.172 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.172 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.172 DEBUG:boto:Params: {} 2024-04-16T18:48:38.173 DEBUG:boto:Token: None 2024-04-16T18:48:38.173 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.173 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T18:48:38.173 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T18:48:38.175 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000344b9316ca1e0296-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.218 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.219 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.219 DEBUG:boto:path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.219 DEBUG:boto:auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.219 DEBUG:boto:Method: GET 2024-04-16T18:48:38.219 DEBUG:boto:Path: /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.219 DEBUG:boto:Data: 2024-04-16T18:48:38.219 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.219 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.219 DEBUG:boto:Params: {} 2024-04-16T18:48:38.219 DEBUG:boto:Token: None 2024-04-16T18:48:38.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11?versionId=null 2024-04-16T18:48:38.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T18:48:38.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T18:48:38.222 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a53316c5656e1a95-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.222 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.222 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.222 DEBUG:boto:path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.222 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.222 DEBUG:boto:Method: GET 2024-04-16T18:48:38.222 DEBUG:boto:Path: /cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.222 DEBUG:boto:Data: 2024-04-16T18:48:38.223 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.223 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.223 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.223 DEBUG:boto:Params: {} 2024-04-16T18:48:38.223 DEBUG:boto:Token: None 2024-04-16T18:48:38.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.225 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0d9d4e6d6ed267d-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.266 DEBUG:boto:b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.267 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.267 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.267 DEBUG:boto:path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.267 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.267 DEBUG:boto:Method: GET 2024-04-16T18:48:38.267 DEBUG:boto:Path: /cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.267 DEBUG:boto:Data: 2024-04-16T18:48:38.267 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.267 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.267 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.268 DEBUG:boto:Params: {} 2024-04-16T18:48:38.268 DEBUG:boto:Token: None 2024-04-16T18:48:38.268 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.268 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.268 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.271 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1b3edebd0c4fba0-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.271 DEBUG:boto:b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.272 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.272 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.272 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.272 DEBUG:boto:Path: /cjqttm-56/obj11 2024-04-16T18:48:38.272 DEBUG:boto:Data: 2024-04-16T18:48:38.272 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.272 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.272 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.273 DEBUG:boto:Params: {} 2024-04-16T18:48:38.273 DEBUG:boto:Token: None 2024-04-16T18:48:38.273 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11 2024-04-16T18:48:38.273 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g= 2024-04-16T18:48:38.273 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g=', 'Content-Length': '0'} 2024-04-16T18:48:38.275 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac36759225ea7009-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.275 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.275 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.276 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.276 DEBUG:boto:Path: /cjqttm-56/obj11 2024-04-16T18:48:38.276 DEBUG:boto:Data: 2024-04-16T18:48:38.276 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.276 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.276 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.276 DEBUG:boto:Params: {} 2024-04-16T18:48:38.276 DEBUG:boto:Token: None 2024-04-16T18:48:38.276 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11 2024-04-16T18:48:38.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g= 2024-04-16T18:48:38.277 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g=', 'Content-Length': '0'} 2024-04-16T18:48:38.279 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b744963a92b62595-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.279 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:48:38.279 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.279 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.279 DEBUG:boto:Method: GET 2024-04-16T18:48:38.280 DEBUG:boto:Path: /cjqttm-56/obj11 2024-04-16T18:48:38.280 DEBUG:boto:Data: 2024-04-16T18:48:38.280 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.280 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.280 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.280 DEBUG:boto:Params: {} 2024-04-16T18:48:38.280 DEBUG:boto:Token: None 2024-04-16T18:48:38.280 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11 2024-04-16T18:48:38.280 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg= 2024-04-16T18:48:38.281 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg=', 'Content-Length': '0'} 2024-04-16T18:48:38.283 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040af00eac00f8c3a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.283 DEBUG:boto:path=/cjqttm-56/obj11 2024-04-16T18:48:38.283 DEBUG:boto:auth_path=/cjqttm-56/obj11 2024-04-16T18:48:38.283 DEBUG:boto:Method: GET 2024-04-16T18:48:38.283 DEBUG:boto:Path: /cjqttm-56/obj11 2024-04-16T18:48:38.283 DEBUG:boto:Data: 2024-04-16T18:48:38.283 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.283 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.283 DEBUG:boto:Params: {} 2024-04-16T18:48:38.284 DEBUG:boto:Token: None 2024-04-16T18:48:38.284 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj11 2024-04-16T18:48:38.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg= 2024-04-16T18:48:38.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg=', 'Content-Length': '0'} 2024-04-16T18:48:38.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d73ac06147821c6-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.326 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.326 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.326 DEBUG:boto:path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.327 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.327 DEBUG:boto:Method: GET 2024-04-16T18:48:38.327 DEBUG:boto:Path: /cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.327 DEBUG:boto:Data: 2024-04-16T18:48:38.327 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.327 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.327 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.327 DEBUG:boto:Params: {} 2024-04-16T18:48:38.327 DEBUG:boto:Token: None 2024-04-16T18:48:38.327 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.327 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.328 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.330 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009a4dec327a678e8-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.330 DEBUG:boto:b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.331 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.331 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.331 DEBUG:boto:path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.331 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.331 DEBUG:boto:Method: GET 2024-04-16T18:48:38.331 DEBUG:boto:Path: /cjqttm-56/?prefix=obj11 2024-04-16T18:48:38.331 DEBUG:boto:Data: 2024-04-16T18:48:38.331 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.331 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.331 DEBUG:boto:Params: {} 2024-04-16T18:48:38.332 DEBUG:boto:Token: None 2024-04-16T18:48:38.332 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.335 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003496f4b072dd1b3-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.336 DEBUG:boto:b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:48:38.336 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.336 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.336 DEBUG:boto:path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.337 DEBUG:boto:auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.337 DEBUG:boto:Method: GET 2024-04-16T18:48:38.337 DEBUG:boto:Path: /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.337 DEBUG:boto:Data: 2024-04-16T18:48:38.337 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.337 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.337 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.337 DEBUG:boto:Params: {} 2024-04-16T18:48:38.337 DEBUG:boto:Token: None 2024-04-16T18:48:38.337 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.338 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T18:48:38.338 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T18:48:38.340 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e27f4512993bb3c-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.340 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.340 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.340 DEBUG:boto:path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.340 DEBUG:boto:auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.340 DEBUG:boto:Method: GET 2024-04-16T18:48:38.340 DEBUG:boto:Path: /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.340 DEBUG:boto:Data: 2024-04-16T18:48:38.341 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.341 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.341 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.341 DEBUG:boto:Params: {} 2024-04-16T18:48:38.341 DEBUG:boto:Token: None 2024-04-16T18:48:38.341 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.341 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T18:48:38.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T18:48:38.343 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005be53c535e238f7e-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.344 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.344 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.344 DEBUG:boto:path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.344 DEBUG:boto:auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.344 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.344 DEBUG:boto:Path: /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.344 DEBUG:boto:Data: 2024-04-16T18:48:38.344 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.344 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.344 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.344 DEBUG:boto:Params: {} 2024-04-16T18:48:38.345 DEBUG:boto:Token: None 2024-04-16T18:48:38.345 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.345 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ= 2024-04-16T18:48:38.345 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.347 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af5dd340b43bd336-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.347 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.347 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.347 DEBUG:boto:path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.347 DEBUG:boto:auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.348 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.348 DEBUG:boto:Path: /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.348 DEBUG:boto:Data: 2024-04-16T18:48:38.348 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.348 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.348 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.348 DEBUG:boto:Params: {} 2024-04-16T18:48:38.348 DEBUG:boto:Token: None 2024-04-16T18:48:38.348 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ= 2024-04-16T18:48:38.349 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0b9123429d29114-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.351 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:48:38.351 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.351 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.351 DEBUG:boto:path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.351 DEBUG:boto:auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.351 DEBUG:boto:Method: GET 2024-04-16T18:48:38.351 DEBUG:boto:Path: /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.351 DEBUG:boto:Data: 2024-04-16T18:48:38.351 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.352 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.352 DEBUG:boto:Params: {} 2024-04-16T18:48:38.352 DEBUG:boto:Token: None 2024-04-16T18:48:38.352 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T18:48:38.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T18:48:38.354 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000764940d62d5c4314-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.394 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.394 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.395 DEBUG:boto:path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.395 DEBUG:boto:auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.395 DEBUG:boto:Method: GET 2024-04-16T18:48:38.395 DEBUG:boto:Path: /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.395 DEBUG:boto:Data: 2024-04-16T18:48:38.395 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.395 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.395 DEBUG:boto:Params: {} 2024-04-16T18:48:38.395 DEBUG:boto:Token: None 2024-04-16T18:48:38.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111?versionId=null 2024-04-16T18:48:38.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T18:48:38.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T18:48:38.398 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007522a9ff1904611a-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.398 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.398 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.398 DEBUG:boto:path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.399 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.399 DEBUG:boto:Method: GET 2024-04-16T18:48:38.399 DEBUG:boto:Path: /cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.399 DEBUG:boto:Data: 2024-04-16T18:48:38.399 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.399 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.399 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.399 DEBUG:boto:Params: {} 2024-04-16T18:48:38.399 DEBUG:boto:Token: None 2024-04-16T18:48:38.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003119fe3ffe9ef429-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.402 DEBUG:boto:b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.402 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.402 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.403 DEBUG:boto:path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.403 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.403 DEBUG:boto:Method: GET 2024-04-16T18:48:38.403 DEBUG:boto:Path: /cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.403 DEBUG:boto:Data: 2024-04-16T18:48:38.403 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.403 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.403 DEBUG:boto:Params: {} 2024-04-16T18:48:38.403 DEBUG:boto:Token: None 2024-04-16T18:48:38.404 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.404 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.404 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.407 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f87bf769438a5fc-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.407 DEBUG:boto:b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.407 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.407 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.408 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.408 DEBUG:boto:Path: /cjqttm-56/obj111 2024-04-16T18:48:38.408 DEBUG:boto:Data: 2024-04-16T18:48:38.408 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.408 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.408 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.408 DEBUG:boto:Params: {} 2024-04-16T18:48:38.408 DEBUG:boto:Token: None 2024-04-16T18:48:38.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111 2024-04-16T18:48:38.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE= 2024-04-16T18:48:38.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE=', 'Content-Length': '0'} 2024-04-16T18:48:38.411 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041c41c5c5d3490a5-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.411 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.411 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.411 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.411 DEBUG:boto:Path: /cjqttm-56/obj111 2024-04-16T18:48:38.411 DEBUG:boto:Data: 2024-04-16T18:48:38.411 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.411 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.412 DEBUG:boto:Params: {} 2024-04-16T18:48:38.412 DEBUG:boto:Token: None 2024-04-16T18:48:38.412 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111 2024-04-16T18:48:38.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE= 2024-04-16T18:48:38.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE=', 'Content-Length': '0'} 2024-04-16T18:48:38.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebb287d2fd1fffe4-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj111 2024-04-16T18:48:38.414 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.414 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.415 DEBUG:boto:Method: GET 2024-04-16T18:48:38.415 DEBUG:boto:Path: /cjqttm-56/obj111 2024-04-16T18:48:38.415 DEBUG:boto:Data: 2024-04-16T18:48:38.415 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.415 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.415 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.415 DEBUG:boto:Params: {} 2024-04-16T18:48:38.415 DEBUG:boto:Token: None 2024-04-16T18:48:38.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111 2024-04-16T18:48:38.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64= 2024-04-16T18:48:38.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64=', 'Content-Length': '0'} 2024-04-16T18:48:38.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004501008b7594207-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.418 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:38.418 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:38.418 DEBUG:boto:Method: GET 2024-04-16T18:48:38.418 DEBUG:boto:Path: /cjqttm-56/obj111 2024-04-16T18:48:38.418 DEBUG:boto:Data: 2024-04-16T18:48:38.418 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.418 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.418 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.419 DEBUG:boto:Params: {} 2024-04-16T18:48:38.419 DEBUG:boto:Token: None 2024-04-16T18:48:38.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj111 2024-04-16T18:48:38.419 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64= 2024-04-16T18:48:38.419 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64=', 'Content-Length': '0'} 2024-04-16T18:48:38.421 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7eafec84a50b73d-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.422 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.422 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.422 DEBUG:boto:path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.422 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.422 DEBUG:boto:Method: GET 2024-04-16T18:48:38.422 DEBUG:boto:Path: /cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.422 DEBUG:boto:Data: 2024-04-16T18:48:38.422 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.422 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.422 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.422 DEBUG:boto:Params: {} 2024-04-16T18:48:38.423 DEBUG:boto:Token: None 2024-04-16T18:48:38.423 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.425 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ffa1a0cd9a0e344-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.425 DEBUG:boto:b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.426 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.426 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.426 DEBUG:boto:path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.426 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.426 DEBUG:boto:Method: GET 2024-04-16T18:48:38.426 DEBUG:boto:Path: /cjqttm-56/?prefix=obj111 2024-04-16T18:48:38.426 DEBUG:boto:Data: 2024-04-16T18:48:38.426 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.426 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.426 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.426 DEBUG:boto:Params: {} 2024-04-16T18:48:38.427 DEBUG:boto:Token: None 2024-04-16T18:48:38.427 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.427 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.430 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d09c79ea5fbd976-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.431 DEBUG:boto:b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.431 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:48:38.431 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.431 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.431 DEBUG:boto:path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.431 DEBUG:boto:auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.431 DEBUG:boto:Method: GET 2024-04-16T18:48:38.431 DEBUG:boto:Path: /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.432 DEBUG:boto:Data: 2024-04-16T18:48:38.432 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.432 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.432 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.432 DEBUG:boto:Params: {} 2024-04-16T18:48:38.432 DEBUG:boto:Token: None 2024-04-16T18:48:38.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T18:48:38.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bae94cb569b835e-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.434 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.435 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.435 DEBUG:boto:path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.435 DEBUG:boto:auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.435 DEBUG:boto:Method: GET 2024-04-16T18:48:38.435 DEBUG:boto:Path: /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.435 DEBUG:boto:Data: 2024-04-16T18:48:38.435 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.435 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.435 DEBUG:boto:Params: {} 2024-04-16T18:48:38.435 DEBUG:boto:Token: None 2024-04-16T18:48:38.436 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T18:48:38.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.438 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023a8d68b3497cd0d-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.438 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.438 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.438 DEBUG:boto:path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.438 DEBUG:boto:auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.439 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.439 DEBUG:boto:Path: /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.439 DEBUG:boto:Data: 2024-04-16T18:48:38.439 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.439 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.439 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.439 DEBUG:boto:Params: {} 2024-04-16T18:48:38.439 DEBUG:boto:Token: None 2024-04-16T18:48:38.439 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.439 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s= 2024-04-16T18:48:38.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s=', 'Content-Length': '0'} 2024-04-16T18:48:38.441 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8d737080f61cb19-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.442 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.442 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.442 DEBUG:boto:path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.442 DEBUG:boto:auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.442 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.442 DEBUG:boto:Path: /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.442 DEBUG:boto:Data: 2024-04-16T18:48:38.442 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.442 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.442 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.442 DEBUG:boto:Params: {} 2024-04-16T18:48:38.443 DEBUG:boto:Token: None 2024-04-16T18:48:38.443 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.443 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s= 2024-04-16T18:48:38.443 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s=', 'Content-Length': '0'} 2024-04-16T18:48:38.445 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3855b76e25dbeda-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:48:38.445 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.446 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.446 DEBUG:boto:path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.446 DEBUG:boto:auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.446 DEBUG:boto:Method: GET 2024-04-16T18:48:38.446 DEBUG:boto:Path: /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.446 DEBUG:boto:Data: 2024-04-16T18:48:38.446 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.446 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.446 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.446 DEBUG:boto:Params: {} 2024-04-16T18:48:38.446 DEBUG:boto:Token: None 2024-04-16T18:48:38.447 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.447 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T18:48:38.447 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.449 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d97f47e680992bb6-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.490 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.491 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.491 DEBUG:boto:path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.491 DEBUG:boto:auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.491 DEBUG:boto:Method: GET 2024-04-16T18:48:38.491 DEBUG:boto:Path: /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.491 DEBUG:boto:Data: 2024-04-16T18:48:38.491 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.491 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.491 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.492 DEBUG:boto:Params: {} 2024-04-16T18:48:38.492 DEBUG:boto:Token: None 2024-04-16T18:48:38.492 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115?versionId=null 2024-04-16T18:48:38.492 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T18:48:38.492 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.494 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f353715209302e9-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.494 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.494 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.495 DEBUG:boto:path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.495 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.495 DEBUG:boto:Method: GET 2024-04-16T18:48:38.495 DEBUG:boto:Path: /cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.495 DEBUG:boto:Data: 2024-04-16T18:48:38.495 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.495 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.495 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.495 DEBUG:boto:Params: {} 2024-04-16T18:48:38.495 DEBUG:boto:Token: None 2024-04-16T18:48:38.495 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.498 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ec2718dc4508c30-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.499 DEBUG:boto:b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.499 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.499 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.499 DEBUG:boto:path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.499 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.499 DEBUG:boto:Method: GET 2024-04-16T18:48:38.499 DEBUG:boto:Path: /cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.499 DEBUG:boto:Data: 2024-04-16T18:48:38.499 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.499 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.500 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.500 DEBUG:boto:Params: {} 2024-04-16T18:48:38.500 DEBUG:boto:Token: None 2024-04-16T18:48:38.500 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.500 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.500 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.504 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fc95130d4bf4612-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.546 DEBUG:boto:b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.547 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.547 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.547 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.547 DEBUG:boto:Path: /cjqttm-56/obj115 2024-04-16T18:48:38.547 DEBUG:boto:Data: 2024-04-16T18:48:38.547 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.547 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.547 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.547 DEBUG:boto:Params: {} 2024-04-16T18:48:38.547 DEBUG:boto:Token: None 2024-04-16T18:48:38.548 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115 2024-04-16T18:48:38.548 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE= 2024-04-16T18:48:38.548 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE=', 'Content-Length': '0'} 2024-04-16T18:48:38.550 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbeba11be591baa2-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.550 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.550 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.551 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.551 DEBUG:boto:Path: /cjqttm-56/obj115 2024-04-16T18:48:38.551 DEBUG:boto:Data: 2024-04-16T18:48:38.551 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.551 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.551 DEBUG:boto:Params: {} 2024-04-16T18:48:38.551 DEBUG:boto:Token: None 2024-04-16T18:48:38.551 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115 2024-04-16T18:48:38.551 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE= 2024-04-16T18:48:38.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE=', 'Content-Length': '0'} 2024-04-16T18:48:38.553 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044e48c0eddbd34f3-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.553 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj115 2024-04-16T18:48:38.554 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.554 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.554 DEBUG:boto:Method: GET 2024-04-16T18:48:38.554 DEBUG:boto:Path: /cjqttm-56/obj115 2024-04-16T18:48:38.554 DEBUG:boto:Data: 2024-04-16T18:48:38.554 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.554 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.554 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.554 DEBUG:boto:Params: {} 2024-04-16T18:48:38.554 DEBUG:boto:Token: None 2024-04-16T18:48:38.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115 2024-04-16T18:48:38.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ= 2024-04-16T18:48:38.555 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8b7eb01626e6d2f-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.557 DEBUG:boto:path=/cjqttm-56/obj115 2024-04-16T18:48:38.557 DEBUG:boto:auth_path=/cjqttm-56/obj115 2024-04-16T18:48:38.557 DEBUG:boto:Method: GET 2024-04-16T18:48:38.557 DEBUG:boto:Path: /cjqttm-56/obj115 2024-04-16T18:48:38.557 DEBUG:boto:Data: 2024-04-16T18:48:38.557 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.558 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.558 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.558 DEBUG:boto:Params: {} 2024-04-16T18:48:38.558 DEBUG:boto:Token: None 2024-04-16T18:48:38.558 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj115 2024-04-16T18:48:38.558 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ= 2024-04-16T18:48:38.558 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.560 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e93855f1be472daa-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.560 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.561 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.561 DEBUG:boto:path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.561 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.561 DEBUG:boto:Method: GET 2024-04-16T18:48:38.561 DEBUG:boto:Path: /cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.561 DEBUG:boto:Data: 2024-04-16T18:48:38.561 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.561 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.561 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.561 DEBUG:boto:Params: {} 2024-04-16T18:48:38.561 DEBUG:boto:Token: None 2024-04-16T18:48:38.561 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.562 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.562 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.564 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8f03202df08c8c1-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.564 DEBUG:boto:b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.564 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.565 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.565 DEBUG:boto:path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.565 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.565 DEBUG:boto:Method: GET 2024-04-16T18:48:38.565 DEBUG:boto:Path: /cjqttm-56/?prefix=obj115 2024-04-16T18:48:38.565 DEBUG:boto:Data: 2024-04-16T18:48:38.565 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.565 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.565 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.565 DEBUG:boto:Params: {} 2024-04-16T18:48:38.565 DEBUG:boto:Token: None 2024-04-16T18:48:38.565 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.566 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.566 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.569 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b57739c9770b9812-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.570 DEBUG:boto:b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.570 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:48:38.570 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.570 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.570 DEBUG:boto:path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.570 DEBUG:boto:auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.571 DEBUG:boto:Method: GET 2024-04-16T18:48:38.571 DEBUG:boto:Path: /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.571 DEBUG:boto:Data: 2024-04-16T18:48:38.571 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.571 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.571 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.571 DEBUG:boto:Params: {} 2024-04-16T18:48:38.571 DEBUG:boto:Token: None 2024-04-16T18:48:38.571 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.571 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T18:48:38.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T18:48:38.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eed116a6070b4515-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.574 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.574 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.574 DEBUG:boto:path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.574 DEBUG:boto:auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.574 DEBUG:boto:Method: GET 2024-04-16T18:48:38.574 DEBUG:boto:Path: /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.575 DEBUG:boto:Data: 2024-04-16T18:48:38.575 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.575 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.575 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.575 DEBUG:boto:Params: {} 2024-04-16T18:48:38.575 DEBUG:boto:Token: None 2024-04-16T18:48:38.575 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.575 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T18:48:38.575 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T18:48:38.577 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dc4c2b38a8326b0-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.578 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.578 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.578 DEBUG:boto:path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.578 DEBUG:boto:auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.578 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.578 DEBUG:boto:Path: /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.578 DEBUG:boto:Data: 2024-04-16T18:48:38.579 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.579 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.579 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.579 DEBUG:boto:Params: {} 2024-04-16T18:48:38.579 DEBUG:boto:Token: None 2024-04-16T18:48:38.579 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk= 2024-04-16T18:48:38.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk=', 'Content-Length': '0'} 2024-04-16T18:48:38.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbb5048863a8fd47-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.582 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.582 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.582 DEBUG:boto:path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.582 DEBUG:boto:auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.582 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.582 DEBUG:boto:Path: /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.582 DEBUG:boto:Data: 2024-04-16T18:48:38.582 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.582 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.582 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.582 DEBUG:boto:Params: {} 2024-04-16T18:48:38.583 DEBUG:boto:Token: None 2024-04-16T18:48:38.583 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk= 2024-04-16T18:48:38.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk=', 'Content-Length': '0'} 2024-04-16T18:48:38.585 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059cab1db2d9c1ea6-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.586 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:48:38.586 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.586 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.586 DEBUG:boto:path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.586 DEBUG:boto:auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.586 DEBUG:boto:Method: GET 2024-04-16T18:48:38.586 DEBUG:boto:Path: /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.586 DEBUG:boto:Data: 2024-04-16T18:48:38.586 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.586 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.586 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.587 DEBUG:boto:Params: {} 2024-04-16T18:48:38.587 DEBUG:boto:Token: None 2024-04-16T18:48:38.587 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.587 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T18:48:38.587 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T18:48:38.589 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d07fcc30aa713ddf-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.590 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.590 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.590 DEBUG:boto:path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.590 DEBUG:boto:auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.590 DEBUG:boto:Method: GET 2024-04-16T18:48:38.590 DEBUG:boto:Path: /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.590 DEBUG:boto:Data: 2024-04-16T18:48:38.590 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.591 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.591 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.591 DEBUG:boto:Params: {} 2024-04-16T18:48:38.591 DEBUG:boto:Token: None 2024-04-16T18:48:38.591 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116?versionId=null 2024-04-16T18:48:38.591 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T18:48:38.591 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T18:48:38.593 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba7e27e0f6e27685-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.593 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.594 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.594 DEBUG:boto:path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.594 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.594 DEBUG:boto:Method: GET 2024-04-16T18:48:38.594 DEBUG:boto:Path: /cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.594 DEBUG:boto:Data: 2024-04-16T18:48:38.594 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.594 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.594 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.594 DEBUG:boto:Params: {} 2024-04-16T18:48:38.595 DEBUG:boto:Token: None 2024-04-16T18:48:38.595 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.595 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.595 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.597 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b4d1aeab9101486-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.597 DEBUG:boto:b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.598 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.598 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.598 DEBUG:boto:path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.598 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.598 DEBUG:boto:Method: GET 2024-04-16T18:48:38.598 DEBUG:boto:Path: /cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.598 DEBUG:boto:Data: 2024-04-16T18:48:38.598 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.598 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.599 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.599 DEBUG:boto:Params: {} 2024-04-16T18:48:38.599 DEBUG:boto:Token: None 2024-04-16T18:48:38.599 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.599 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.599 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.602 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f3f8dbe8de91e82-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.603 DEBUG:boto:b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.603 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.603 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.603 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.603 DEBUG:boto:Path: /cjqttm-56/obj116 2024-04-16T18:48:38.603 DEBUG:boto:Data: 2024-04-16T18:48:38.603 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.604 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.604 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.604 DEBUG:boto:Params: {} 2024-04-16T18:48:38.604 DEBUG:boto:Token: None 2024-04-16T18:48:38.604 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116 2024-04-16T18:48:38.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4= 2024-04-16T18:48:38.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4=', 'Content-Length': '0'} 2024-04-16T18:48:38.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000778a57a6d8d98e22-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.607 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.607 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.607 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.607 DEBUG:boto:Path: /cjqttm-56/obj116 2024-04-16T18:48:38.607 DEBUG:boto:Data: 2024-04-16T18:48:38.607 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.607 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.607 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.607 DEBUG:boto:Params: {} 2024-04-16T18:48:38.607 DEBUG:boto:Token: None 2024-04-16T18:48:38.608 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116 2024-04-16T18:48:38.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4= 2024-04-16T18:48:38.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4=', 'Content-Length': '0'} 2024-04-16T18:48:38.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000283bdf8644b0db4c-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj116 2024-04-16T18:48:38.610 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.610 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.610 DEBUG:boto:Method: GET 2024-04-16T18:48:38.610 DEBUG:boto:Path: /cjqttm-56/obj116 2024-04-16T18:48:38.610 DEBUG:boto:Data: 2024-04-16T18:48:38.610 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.610 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.610 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.611 DEBUG:boto:Params: {} 2024-04-16T18:48:38.611 DEBUG:boto:Token: None 2024-04-16T18:48:38.611 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116 2024-04-16T18:48:38.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A= 2024-04-16T18:48:38.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A=', 'Content-Length': '0'} 2024-04-16T18:48:38.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c41277eca0b80978-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.613 DEBUG:boto:path=/cjqttm-56/obj116 2024-04-16T18:48:38.613 DEBUG:boto:auth_path=/cjqttm-56/obj116 2024-04-16T18:48:38.614 DEBUG:boto:Method: GET 2024-04-16T18:48:38.614 DEBUG:boto:Path: /cjqttm-56/obj116 2024-04-16T18:48:38.614 DEBUG:boto:Data: 2024-04-16T18:48:38.614 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.614 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.614 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.614 DEBUG:boto:Params: {} 2024-04-16T18:48:38.614 DEBUG:boto:Token: None 2024-04-16T18:48:38.614 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj116 2024-04-16T18:48:38.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A= 2024-04-16T18:48:38.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A=', 'Content-Length': '0'} 2024-04-16T18:48:38.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8d7e37267cf27fb-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.617 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.617 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.617 DEBUG:boto:path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.617 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.617 DEBUG:boto:Method: GET 2024-04-16T18:48:38.618 DEBUG:boto:Path: /cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.618 DEBUG:boto:Data: 2024-04-16T18:48:38.618 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.618 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.618 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.618 DEBUG:boto:Params: {} 2024-04-16T18:48:38.618 DEBUG:boto:Token: None 2024-04-16T18:48:38.618 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.618 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.618 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.621 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a3be140999470e2-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.621 DEBUG:boto:b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.621 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.621 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.621 DEBUG:boto:path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.621 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.621 DEBUG:boto:Method: GET 2024-04-16T18:48:38.622 DEBUG:boto:Path: /cjqttm-56/?prefix=obj116 2024-04-16T18:48:38.622 DEBUG:boto:Data: 2024-04-16T18:48:38.622 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.622 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.622 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.622 DEBUG:boto:Params: {} 2024-04-16T18:48:38.622 DEBUG:boto:Token: None 2024-04-16T18:48:38.622 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.622 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.622 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.626 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b154804b802c478-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.626 DEBUG:boto:b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.626 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:48:38.626 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.626 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.627 DEBUG:boto:path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.627 DEBUG:boto:auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.627 DEBUG:boto:Method: GET 2024-04-16T18:48:38.627 DEBUG:boto:Path: /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.627 DEBUG:boto:Data: 2024-04-16T18:48:38.627 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.627 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.627 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.627 DEBUG:boto:Params: {} 2024-04-16T18:48:38.627 DEBUG:boto:Token: None 2024-04-16T18:48:38.627 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.628 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T18:48:38.628 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T18:48:38.630 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c702b9f16bf3b0ee-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.630 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.630 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.630 DEBUG:boto:path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.631 DEBUG:boto:auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.631 DEBUG:boto:Method: GET 2024-04-16T18:48:38.631 DEBUG:boto:Path: /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.631 DEBUG:boto:Data: 2024-04-16T18:48:38.631 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.631 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.631 DEBUG:boto:Params: {} 2024-04-16T18:48:38.631 DEBUG:boto:Token: None 2024-04-16T18:48:38.631 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.631 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T18:48:38.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T18:48:38.634 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9111c77e087016b-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.634 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.634 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.634 DEBUG:boto:path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.634 DEBUG:boto:auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.634 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.634 DEBUG:boto:Path: /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.635 DEBUG:boto:Data: 2024-04-16T18:48:38.635 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.635 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.635 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.635 DEBUG:boto:Params: {} 2024-04-16T18:48:38.635 DEBUG:boto:Token: None 2024-04-16T18:48:38.635 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.635 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM= 2024-04-16T18:48:38.635 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM=', 'Content-Length': '0'} 2024-04-16T18:48:38.637 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002cf56d4115da8933-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.638 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.638 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.638 DEBUG:boto:path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.638 DEBUG:boto:auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.638 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.638 DEBUG:boto:Path: /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.638 DEBUG:boto:Data: 2024-04-16T18:48:38.638 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.638 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.638 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.638 DEBUG:boto:Params: {} 2024-04-16T18:48:38.639 DEBUG:boto:Token: None 2024-04-16T18:48:38.639 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM= 2024-04-16T18:48:38.639 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM=', 'Content-Length': '0'} 2024-04-16T18:48:38.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038938200562a92f9-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.641 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:48:38.641 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.641 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.641 DEBUG:boto:path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.641 DEBUG:boto:auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.641 DEBUG:boto:Method: GET 2024-04-16T18:48:38.642 DEBUG:boto:Path: /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.642 DEBUG:boto:Data: 2024-04-16T18:48:38.642 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.642 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.642 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.642 DEBUG:boto:Params: {} 2024-04-16T18:48:38.642 DEBUG:boto:Token: None 2024-04-16T18:48:38.642 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.642 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T18:48:38.642 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T18:48:38.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000763638ac6aae68dc-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.645 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.645 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.645 DEBUG:boto:path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.645 DEBUG:boto:auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.645 DEBUG:boto:Method: GET 2024-04-16T18:48:38.645 DEBUG:boto:Path: /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.645 DEBUG:boto:Data: 2024-04-16T18:48:38.645 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.645 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.646 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.646 DEBUG:boto:Params: {} 2024-04-16T18:48:38.646 DEBUG:boto:Token: None 2024-04-16T18:48:38.646 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124?versionId=null 2024-04-16T18:48:38.646 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T18:48:38.646 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T18:48:38.648 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c47579fb67640d8e-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.648 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.648 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.648 DEBUG:boto:path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.648 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.649 DEBUG:boto:Method: GET 2024-04-16T18:48:38.649 DEBUG:boto:Path: /cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.649 DEBUG:boto:Data: 2024-04-16T18:48:38.649 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.649 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.649 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.649 DEBUG:boto:Params: {} 2024-04-16T18:48:38.649 DEBUG:boto:Token: None 2024-04-16T18:48:38.649 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.649 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.650 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.652 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001979074d4bb920ae-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.652 DEBUG:boto:b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.652 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.652 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.652 DEBUG:boto:path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.652 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.652 DEBUG:boto:Method: GET 2024-04-16T18:48:38.653 DEBUG:boto:Path: /cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.653 DEBUG:boto:Data: 2024-04-16T18:48:38.653 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.653 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.653 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.653 DEBUG:boto:Params: {} 2024-04-16T18:48:38.653 DEBUG:boto:Token: None 2024-04-16T18:48:38.653 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.653 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.654 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.657 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ebf768f1d057e3c-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.657 DEBUG:boto:b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.657 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.657 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.657 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.657 DEBUG:boto:Path: /cjqttm-56/obj124 2024-04-16T18:48:38.657 DEBUG:boto:Data: 2024-04-16T18:48:38.658 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.658 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.658 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.658 DEBUG:boto:Params: {} 2024-04-16T18:48:38.658 DEBUG:boto:Token: None 2024-04-16T18:48:38.658 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124 2024-04-16T18:48:38.658 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A= 2024-04-16T18:48:38.658 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A=', 'Content-Length': '0'} 2024-04-16T18:48:38.660 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d20ffda4e793160-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.660 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.660 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.661 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.661 DEBUG:boto:Path: /cjqttm-56/obj124 2024-04-16T18:48:38.661 DEBUG:boto:Data: 2024-04-16T18:48:38.661 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.661 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.661 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.661 DEBUG:boto:Params: {} 2024-04-16T18:48:38.661 DEBUG:boto:Token: None 2024-04-16T18:48:38.661 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124 2024-04-16T18:48:38.661 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A= 2024-04-16T18:48:38.662 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A=', 'Content-Length': '0'} 2024-04-16T18:48:38.663 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4da1fd245596594-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj124 2024-04-16T18:48:38.664 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.664 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.664 DEBUG:boto:Method: GET 2024-04-16T18:48:38.664 DEBUG:boto:Path: /cjqttm-56/obj124 2024-04-16T18:48:38.664 DEBUG:boto:Data: 2024-04-16T18:48:38.664 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.664 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.664 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.664 DEBUG:boto:Params: {} 2024-04-16T18:48:38.665 DEBUG:boto:Token: None 2024-04-16T18:48:38.665 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124 2024-04-16T18:48:38.665 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA= 2024-04-16T18:48:38.665 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA=', 'Content-Length': '0'} 2024-04-16T18:48:38.667 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c51a695b7d9aa87-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.710 DEBUG:boto:path=/cjqttm-56/obj124 2024-04-16T18:48:38.710 DEBUG:boto:auth_path=/cjqttm-56/obj124 2024-04-16T18:48:38.711 DEBUG:boto:Method: GET 2024-04-16T18:48:38.711 DEBUG:boto:Path: /cjqttm-56/obj124 2024-04-16T18:48:38.711 DEBUG:boto:Data: 2024-04-16T18:48:38.711 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.711 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.711 DEBUG:boto:Params: {} 2024-04-16T18:48:38.711 DEBUG:boto:Token: None 2024-04-16T18:48:38.711 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj124 2024-04-16T18:48:38.711 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA= 2024-04-16T18:48:38.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA=', 'Content-Length': '0'} 2024-04-16T18:48:38.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a14df4b784c55630-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.714 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.714 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.714 DEBUG:boto:path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.715 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.715 DEBUG:boto:Method: GET 2024-04-16T18:48:38.715 DEBUG:boto:Path: /cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.715 DEBUG:boto:Data: 2024-04-16T18:48:38.715 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.715 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.715 DEBUG:boto:Params: {} 2024-04-16T18:48:38.715 DEBUG:boto:Token: None 2024-04-16T18:48:38.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013e8f29bf57c4b2a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.718 DEBUG:boto:b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.718 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.719 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.719 DEBUG:boto:path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.719 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.719 DEBUG:boto:Method: GET 2024-04-16T18:48:38.719 DEBUG:boto:Path: /cjqttm-56/?prefix=obj124 2024-04-16T18:48:38.719 DEBUG:boto:Data: 2024-04-16T18:48:38.719 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.719 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.719 DEBUG:boto:Params: {} 2024-04-16T18:48:38.719 DEBUG:boto:Token: None 2024-04-16T18:48:38.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.723 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5eef6f3ff759a0c-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.723 DEBUG:boto:b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.724 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:48:38.724 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.724 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.724 DEBUG:boto:path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.724 DEBUG:boto:auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.724 DEBUG:boto:Method: GET 2024-04-16T18:48:38.724 DEBUG:boto:Path: /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.724 DEBUG:boto:Data: 2024-04-16T18:48:38.724 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.724 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.724 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.724 DEBUG:boto:Params: {} 2024-04-16T18:48:38.725 DEBUG:boto:Token: None 2024-04-16T18:48:38.725 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.725 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T18:48:38.725 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T18:48:38.727 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de3218dadd36b4b5-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.727 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.727 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.727 DEBUG:boto:path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.727 DEBUG:boto:auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.728 DEBUG:boto:Method: GET 2024-04-16T18:48:38.728 DEBUG:boto:Path: /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.728 DEBUG:boto:Data: 2024-04-16T18:48:38.728 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.728 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.728 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.728 DEBUG:boto:Params: {} 2024-04-16T18:48:38.728 DEBUG:boto:Token: None 2024-04-16T18:48:38.728 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.728 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T18:48:38.728 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T18:48:38.730 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009334eef4a39692b6-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.730 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.731 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.731 DEBUG:boto:path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.731 DEBUG:boto:auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.731 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.731 DEBUG:boto:Path: /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.731 DEBUG:boto:Data: 2024-04-16T18:48:38.731 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.731 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.731 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.731 DEBUG:boto:Params: {} 2024-04-16T18:48:38.731 DEBUG:boto:Token: None 2024-04-16T18:48:38.732 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ= 2024-04-16T18:48:38.732 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000550e5abcee964f79-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.734 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.734 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.734 DEBUG:boto:path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.734 DEBUG:boto:auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.734 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.734 DEBUG:boto:Path: /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.734 DEBUG:boto:Data: 2024-04-16T18:48:38.734 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.734 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.734 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.735 DEBUG:boto:Params: {} 2024-04-16T18:48:38.735 DEBUG:boto:Token: None 2024-04-16T18:48:38.735 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.735 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ= 2024-04-16T18:48:38.735 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.737 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df48ec4b5c0265d8-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.737 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:48:38.737 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.737 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.737 DEBUG:boto:path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.738 DEBUG:boto:auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.738 DEBUG:boto:Method: GET 2024-04-16T18:48:38.738 DEBUG:boto:Path: /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.738 DEBUG:boto:Data: 2024-04-16T18:48:38.738 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.738 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.738 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.738 DEBUG:boto:Params: {} 2024-04-16T18:48:38.738 DEBUG:boto:Token: None 2024-04-16T18:48:38.738 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.738 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T18:48:38.739 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T18:48:38.740 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066db4fda75439668-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.741 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.741 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.741 DEBUG:boto:path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.741 DEBUG:boto:auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.741 DEBUG:boto:Method: GET 2024-04-16T18:48:38.741 DEBUG:boto:Path: /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.741 DEBUG:boto:Data: 2024-04-16T18:48:38.741 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.741 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.741 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.741 DEBUG:boto:Params: {} 2024-04-16T18:48:38.742 DEBUG:boto:Token: None 2024-04-16T18:48:38.742 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145?versionId=null 2024-04-16T18:48:38.742 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T18:48:38.742 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T18:48:38.744 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7e14b19b0917171-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.744 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.744 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.744 DEBUG:boto:path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.744 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.744 DEBUG:boto:Method: GET 2024-04-16T18:48:38.745 DEBUG:boto:Path: /cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.745 DEBUG:boto:Data: 2024-04-16T18:48:38.745 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.745 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.745 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.745 DEBUG:boto:Params: {} 2024-04-16T18:48:38.745 DEBUG:boto:Token: None 2024-04-16T18:48:38.745 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.745 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.745 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.748 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003cd0018484e7ff79-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.748 DEBUG:boto:b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.748 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.748 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.748 DEBUG:boto:path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.749 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.749 DEBUG:boto:Method: GET 2024-04-16T18:48:38.749 DEBUG:boto:Path: /cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.749 DEBUG:boto:Data: 2024-04-16T18:48:38.749 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.749 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.749 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.749 DEBUG:boto:Params: {} 2024-04-16T18:48:38.749 DEBUG:boto:Token: None 2024-04-16T18:48:38.749 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.749 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.750 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.753 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcca8448b43e66f1-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.753 DEBUG:boto:b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.753 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.754 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.754 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.754 DEBUG:boto:Path: /cjqttm-56/obj145 2024-04-16T18:48:38.754 DEBUG:boto:Data: 2024-04-16T18:48:38.754 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.754 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.754 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.754 DEBUG:boto:Params: {} 2024-04-16T18:48:38.754 DEBUG:boto:Token: None 2024-04-16T18:48:38.755 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145 2024-04-16T18:48:38.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM= 2024-04-16T18:48:38.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM=', 'Content-Length': '0'} 2024-04-16T18:48:38.756 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006882ce9025851911-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.757 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.757 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.757 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.757 DEBUG:boto:Path: /cjqttm-56/obj145 2024-04-16T18:48:38.757 DEBUG:boto:Data: 2024-04-16T18:48:38.757 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.757 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.757 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.757 DEBUG:boto:Params: {} 2024-04-16T18:48:38.758 DEBUG:boto:Token: None 2024-04-16T18:48:38.758 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145 2024-04-16T18:48:38.758 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM= 2024-04-16T18:48:38.758 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM=', 'Content-Length': '0'} 2024-04-16T18:48:38.759 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a398e15105804969-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj145 2024-04-16T18:48:38.760 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.760 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.760 DEBUG:boto:Method: GET 2024-04-16T18:48:38.760 DEBUG:boto:Path: /cjqttm-56/obj145 2024-04-16T18:48:38.760 DEBUG:boto:Data: 2024-04-16T18:48:38.760 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.760 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.761 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.761 DEBUG:boto:Params: {} 2024-04-16T18:48:38.761 DEBUG:boto:Token: None 2024-04-16T18:48:38.761 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145 2024-04-16T18:48:38.761 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU= 2024-04-16T18:48:38.761 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU=', 'Content-Length': '0'} 2024-04-16T18:48:38.763 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047751d0415b4bf0c-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.806 DEBUG:boto:path=/cjqttm-56/obj145 2024-04-16T18:48:38.806 DEBUG:boto:auth_path=/cjqttm-56/obj145 2024-04-16T18:48:38.807 DEBUG:boto:Method: GET 2024-04-16T18:48:38.807 DEBUG:boto:Path: /cjqttm-56/obj145 2024-04-16T18:48:38.807 DEBUG:boto:Data: 2024-04-16T18:48:38.807 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.807 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.807 DEBUG:boto:Params: {} 2024-04-16T18:48:38.807 DEBUG:boto:Token: None 2024-04-16T18:48:38.807 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj145 2024-04-16T18:48:38.807 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU= 2024-04-16T18:48:38.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU=', 'Content-Length': '0'} 2024-04-16T18:48:38.809 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a3d8a4bd390a399-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.810 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.810 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.810 DEBUG:boto:path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.810 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.810 DEBUG:boto:Method: GET 2024-04-16T18:48:38.810 DEBUG:boto:Path: /cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.810 DEBUG:boto:Data: 2024-04-16T18:48:38.810 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.810 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.810 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.810 DEBUG:boto:Params: {} 2024-04-16T18:48:38.811 DEBUG:boto:Token: None 2024-04-16T18:48:38.811 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.811 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.811 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.813 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000362dce2719bc4724-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.813 DEBUG:boto:b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.814 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.814 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.814 DEBUG:boto:path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.814 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.814 DEBUG:boto:Method: GET 2024-04-16T18:48:38.814 DEBUG:boto:Path: /cjqttm-56/?prefix=obj145 2024-04-16T18:48:38.814 DEBUG:boto:Data: 2024-04-16T18:48:38.814 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.814 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.815 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.815 DEBUG:boto:Params: {} 2024-04-16T18:48:38.815 DEBUG:boto:Token: None 2024-04-16T18:48:38.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.818 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000540831647ba61157-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.818 DEBUG:boto:b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:48:38.819 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.819 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.819 DEBUG:boto:path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.819 DEBUG:boto:auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.819 DEBUG:boto:Method: GET 2024-04-16T18:48:38.819 DEBUG:boto:Path: /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.819 DEBUG:boto:Data: 2024-04-16T18:48:38.819 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.820 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.820 DEBUG:boto:Params: {} 2024-04-16T18:48:38.820 DEBUG:boto:Token: None 2024-04-16T18:48:38.820 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.820 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T18:48:38.820 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T18:48:38.822 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e2fbf8408d0458b-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.822 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.822 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.822 DEBUG:boto:path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.822 DEBUG:boto:auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.823 DEBUG:boto:Method: GET 2024-04-16T18:48:38.823 DEBUG:boto:Path: /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.823 DEBUG:boto:Data: 2024-04-16T18:48:38.823 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.823 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.823 DEBUG:boto:Params: {} 2024-04-16T18:48:38.823 DEBUG:boto:Token: None 2024-04-16T18:48:38.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.823 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T18:48:38.823 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T18:48:38.825 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b5ab58ff321db64-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.826 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.826 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.826 DEBUG:boto:path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.826 DEBUG:boto:auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.826 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.826 DEBUG:boto:Path: /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.826 DEBUG:boto:Data: 2024-04-16T18:48:38.826 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.826 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.826 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.827 DEBUG:boto:Params: {} 2024-04-16T18:48:38.827 DEBUG:boto:Token: None 2024-04-16T18:48:38.827 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.827 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA= 2024-04-16T18:48:38.827 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA=', 'Content-Length': '0'} 2024-04-16T18:48:38.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7c47539e6c9fe93-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.829 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.829 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.829 DEBUG:boto:path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.829 DEBUG:boto:auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.830 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.830 DEBUG:boto:Path: /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.830 DEBUG:boto:Data: 2024-04-16T18:48:38.830 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.830 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.830 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.830 DEBUG:boto:Params: {} 2024-04-16T18:48:38.830 DEBUG:boto:Token: None 2024-04-16T18:48:38.830 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA= 2024-04-16T18:48:38.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA=', 'Content-Length': '0'} 2024-04-16T18:48:38.832 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049650a4deb7c366d-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.833 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:48:38.833 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.833 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.833 DEBUG:boto:path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.833 DEBUG:boto:auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.833 DEBUG:boto:Method: GET 2024-04-16T18:48:38.833 DEBUG:boto:Path: /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.833 DEBUG:boto:Data: 2024-04-16T18:48:38.833 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.833 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.833 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.834 DEBUG:boto:Params: {} 2024-04-16T18:48:38.834 DEBUG:boto:Token: None 2024-04-16T18:48:38.834 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.834 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T18:48:38.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T18:48:38.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001deda49941ec8138-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.836 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.836 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.836 DEBUG:boto:path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.836 DEBUG:boto:auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.837 DEBUG:boto:Method: GET 2024-04-16T18:48:38.837 DEBUG:boto:Path: /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.837 DEBUG:boto:Data: 2024-04-16T18:48:38.837 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.837 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.837 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.837 DEBUG:boto:Params: {} 2024-04-16T18:48:38.837 DEBUG:boto:Token: None 2024-04-16T18:48:38.837 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148?versionId=null 2024-04-16T18:48:38.837 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T18:48:38.838 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T18:48:38.839 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009eb2ba29d4efbc77-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.839 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.840 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.840 DEBUG:boto:path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.840 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.840 DEBUG:boto:Method: GET 2024-04-16T18:48:38.840 DEBUG:boto:Path: /cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.840 DEBUG:boto:Data: 2024-04-16T18:48:38.840 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.840 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.840 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.840 DEBUG:boto:Params: {} 2024-04-16T18:48:38.840 DEBUG:boto:Token: None 2024-04-16T18:48:38.841 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.841 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.841 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.843 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042422ba083750874-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.843 DEBUG:boto:b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.844 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.844 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.844 DEBUG:boto:path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.844 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.844 DEBUG:boto:Method: GET 2024-04-16T18:48:38.844 DEBUG:boto:Path: /cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.844 DEBUG:boto:Data: 2024-04-16T18:48:38.844 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.844 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.844 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.844 DEBUG:boto:Params: {} 2024-04-16T18:48:38.845 DEBUG:boto:Token: None 2024-04-16T18:48:38.845 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.845 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.845 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.848 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c426cbbe8d7cba41-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.848 DEBUG:boto:b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.849 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.849 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.849 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.849 DEBUG:boto:Path: /cjqttm-56/obj148 2024-04-16T18:48:38.849 DEBUG:boto:Data: 2024-04-16T18:48:38.849 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.849 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.849 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.849 DEBUG:boto:Params: {} 2024-04-16T18:48:38.849 DEBUG:boto:Token: None 2024-04-16T18:48:38.850 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148 2024-04-16T18:48:38.850 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg= 2024-04-16T18:48:38.850 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg=', 'Content-Length': '0'} 2024-04-16T18:48:38.852 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8354a8ea491d68a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.852 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.852 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.852 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.852 DEBUG:boto:Path: /cjqttm-56/obj148 2024-04-16T18:48:38.852 DEBUG:boto:Data: 2024-04-16T18:48:38.852 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.852 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.852 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.852 DEBUG:boto:Params: {} 2024-04-16T18:48:38.853 DEBUG:boto:Token: None 2024-04-16T18:48:38.853 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148 2024-04-16T18:48:38.853 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg= 2024-04-16T18:48:38.853 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg=', 'Content-Length': '0'} 2024-04-16T18:48:38.855 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ccf030dc269786f-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.855 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj148 2024-04-16T18:48:38.855 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.855 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.855 DEBUG:boto:Method: GET 2024-04-16T18:48:38.855 DEBUG:boto:Path: /cjqttm-56/obj148 2024-04-16T18:48:38.855 DEBUG:boto:Data: 2024-04-16T18:48:38.856 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.856 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.856 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.856 DEBUG:boto:Params: {} 2024-04-16T18:48:38.856 DEBUG:boto:Token: None 2024-04-16T18:48:38.856 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148 2024-04-16T18:48:38.856 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4= 2024-04-16T18:48:38.856 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4=', 'Content-Length': '0'} 2024-04-16T18:48:38.858 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc481f18d4c69d23-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.859 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:38.859 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:38.859 DEBUG:boto:Method: GET 2024-04-16T18:48:38.859 DEBUG:boto:Path: /cjqttm-56/obj148 2024-04-16T18:48:38.859 DEBUG:boto:Data: 2024-04-16T18:48:38.859 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.859 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.859 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.859 DEBUG:boto:Params: {} 2024-04-16T18:48:38.859 DEBUG:boto:Token: None 2024-04-16T18:48:38.859 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj148 2024-04-16T18:48:38.860 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4= 2024-04-16T18:48:38.860 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4=', 'Content-Length': '0'} 2024-04-16T18:48:38.862 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5c5160ba543ad95-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.902 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.903 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.903 DEBUG:boto:path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.903 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.903 DEBUG:boto:Method: GET 2024-04-16T18:48:38.903 DEBUG:boto:Path: /cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.903 DEBUG:boto:Data: 2024-04-16T18:48:38.903 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.903 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.903 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.903 DEBUG:boto:Params: {} 2024-04-16T18:48:38.903 DEBUG:boto:Token: None 2024-04-16T18:48:38.904 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.904 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.904 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.906 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be85cc208a24b528-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.907 DEBUG:boto:b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.907 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.907 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.907 DEBUG:boto:path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.907 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.907 DEBUG:boto:Method: GET 2024-04-16T18:48:38.907 DEBUG:boto:Path: /cjqttm-56/?prefix=obj148 2024-04-16T18:48:38.907 DEBUG:boto:Data: 2024-04-16T18:48:38.907 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.908 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.908 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.908 DEBUG:boto:Params: {} 2024-04-16T18:48:38.908 DEBUG:boto:Token: None 2024-04-16T18:48:38.908 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.911 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064002f2f00345f67-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.912 DEBUG:boto:b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.912 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:48:38.912 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.912 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.912 DEBUG:boto:path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.912 DEBUG:boto:auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.912 DEBUG:boto:Method: GET 2024-04-16T18:48:38.913 DEBUG:boto:Path: /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.913 DEBUG:boto:Data: 2024-04-16T18:48:38.913 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.913 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.913 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.913 DEBUG:boto:Params: {} 2024-04-16T18:48:38.913 DEBUG:boto:Token: None 2024-04-16T18:48:38.913 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.913 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T18:48:38.913 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T18:48:38.915 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcefba4889a26591-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.958 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.959 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.959 DEBUG:boto:path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.959 DEBUG:boto:auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.959 DEBUG:boto:Method: GET 2024-04-16T18:48:38.959 DEBUG:boto:Path: /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.959 DEBUG:boto:Data: 2024-04-16T18:48:38.959 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.959 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.959 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.959 DEBUG:boto:Params: {} 2024-04-16T18:48:38.960 DEBUG:boto:Token: None 2024-04-16T18:48:38.960 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.960 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T18:48:38.960 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T18:48:38.962 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4763280a60520f0-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.962 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.962 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.962 DEBUG:boto:path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.962 DEBUG:boto:auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.963 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.963 DEBUG:boto:Path: /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.963 DEBUG:boto:Data: 2024-04-16T18:48:38.963 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.963 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.963 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.963 DEBUG:boto:Params: {} 2024-04-16T18:48:38.963 DEBUG:boto:Token: None 2024-04-16T18:48:38.963 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.963 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM= 2024-04-16T18:48:38.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM=', 'Content-Length': '0'} 2024-04-16T18:48:38.965 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026735328a0e46df1-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.965 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.965 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.966 DEBUG:boto:path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.966 DEBUG:boto:auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.966 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.966 DEBUG:boto:Path: /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.966 DEBUG:boto:Data: 2024-04-16T18:48:38.966 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.966 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.966 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.966 DEBUG:boto:Params: {} 2024-04-16T18:48:38.966 DEBUG:boto:Token: None 2024-04-16T18:48:38.967 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.967 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM= 2024-04-16T18:48:38.967 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM=', 'Content-Length': '0'} 2024-04-16T18:48:38.969 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e02f8c2d227d4419-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.969 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:48:38.969 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.969 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.969 DEBUG:boto:path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.969 DEBUG:boto:auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.969 DEBUG:boto:Method: GET 2024-04-16T18:48:38.970 DEBUG:boto:Path: /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.970 DEBUG:boto:Data: 2024-04-16T18:48:38.970 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.970 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.970 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.970 DEBUG:boto:Params: {} 2024-04-16T18:48:38.970 DEBUG:boto:Token: None 2024-04-16T18:48:38.970 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.970 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T18:48:38.971 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T18:48:38.972 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043ac4e76bbf69dc3-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.973 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.973 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.973 DEBUG:boto:path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.973 DEBUG:boto:auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.973 DEBUG:boto:Method: GET 2024-04-16T18:48:38.973 DEBUG:boto:Path: /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.973 DEBUG:boto:Data: 2024-04-16T18:48:38.973 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.973 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.973 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.974 DEBUG:boto:Params: {} 2024-04-16T18:48:38.974 DEBUG:boto:Token: None 2024-04-16T18:48:38.974 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155?versionId=null 2024-04-16T18:48:38.974 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T18:48:38.974 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T18:48:38.976 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c947a30bd72c421-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.976 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.976 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.976 DEBUG:boto:path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:38.976 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:38.977 DEBUG:boto:Method: GET 2024-04-16T18:48:38.977 DEBUG:boto:Path: /cjqttm-56/?prefix=obj155 2024-04-16T18:48:38.977 DEBUG:boto:Data: 2024-04-16T18:48:38.977 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.977 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.977 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.977 DEBUG:boto:Params: {} 2024-04-16T18:48:38.977 DEBUG:boto:Token: None 2024-04-16T18:48:38.977 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.977 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.978 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.981 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003835c8dbc556ea7-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.981 DEBUG:boto:b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.981 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:38.982 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:38.982 DEBUG:boto:path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:38.982 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:38.982 DEBUG:boto:Method: GET 2024-04-16T18:48:38.982 DEBUG:boto:Path: /cjqttm-56/?prefix=obj155 2024-04-16T18:48:38.982 DEBUG:boto:Data: 2024-04-16T18:48:38.982 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.982 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.982 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.982 DEBUG:boto:Params: {} 2024-04-16T18:48:38.983 DEBUG:boto:Token: None 2024-04-16T18:48:38.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/ 2024-04-16T18:48:38.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T18:48:38.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T18:48:38.986 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053f95790dde3dfa5-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.987 DEBUG:boto:b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:38.987 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.987 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.987 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.987 DEBUG:boto:Path: /cjqttm-56/obj155 2024-04-16T18:48:38.987 DEBUG:boto:Data: 2024-04-16T18:48:38.987 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.987 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.988 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.988 DEBUG:boto:Params: {} 2024-04-16T18:48:38.988 DEBUG:boto:Token: None 2024-04-16T18:48:38.988 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155 2024-04-16T18:48:38.988 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ= 2024-04-16T18:48:38.988 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.990 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016b045c2c2a74c4a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.990 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.990 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.990 DEBUG:boto:Method: HEAD 2024-04-16T18:48:38.990 DEBUG:boto:Path: /cjqttm-56/obj155 2024-04-16T18:48:38.990 DEBUG:boto:Data: 2024-04-16T18:48:38.991 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.991 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.991 DEBUG:boto:Params: {} 2024-04-16T18:48:38.991 DEBUG:boto:Token: None 2024-04-16T18:48:38.991 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155 2024-04-16T18:48:38.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ= 2024-04-16T18:48:38.991 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ=', 'Content-Length': '0'} 2024-04-16T18:48:38.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000842fb27f1e22e8d7-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.993 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj155 2024-04-16T18:48:38.993 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.993 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.994 DEBUG:boto:Method: GET 2024-04-16T18:48:38.994 DEBUG:boto:Path: /cjqttm-56/obj155 2024-04-16T18:48:38.994 DEBUG:boto:Data: 2024-04-16T18:48:38.994 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.994 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:38.994 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.994 DEBUG:boto:Params: {} 2024-04-16T18:48:38.994 DEBUG:boto:Token: None 2024-04-16T18:48:38.994 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155 2024-04-16T18:48:38.994 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI= 2024-04-16T18:48:38.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI=', 'Content-Length': '0'} 2024-04-16T18:48:38.996 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a5c6759679b163f-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:38.996 DEBUG:boto:path=/cjqttm-56/obj155 2024-04-16T18:48:38.997 DEBUG:boto:auth_path=/cjqttm-56/obj155 2024-04-16T18:48:38.997 DEBUG:boto:Method: GET 2024-04-16T18:48:38.997 DEBUG:boto:Path: /cjqttm-56/obj155 2024-04-16T18:48:38.997 DEBUG:boto:Data: 2024-04-16T18:48:38.997 DEBUG:boto:Headers: {} 2024-04-16T18:48:38.997 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:38.997 DEBUG:boto:Port: 8000 2024-04-16T18:48:38.997 DEBUG:boto:Params: {} 2024-04-16T18:48:38.997 DEBUG:boto:Token: None 2024-04-16T18:48:38.997 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:38 GMT /cjqttm-56/obj155 2024-04-16T18:48:38.998 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI= 2024-04-16T18:48:38.998 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI=', 'Content-Length': '0'} 2024-04-16T18:48:39.000 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098048dbec5dc1daf-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.000 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.000 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.000 DEBUG:boto:path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:39.000 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:39.000 DEBUG:boto:Method: GET 2024-04-16T18:48:39.000 DEBUG:boto:Path: /cjqttm-56/?prefix=obj155 2024-04-16T18:48:39.000 DEBUG:boto:Data: 2024-04-16T18:48:39.000 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.001 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.001 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.001 DEBUG:boto:Params: {} 2024-04-16T18:48:39.001 DEBUG:boto:Token: None 2024-04-16T18:48:39.001 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.001 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.004 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dccaf0f9ac193e8-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.004 DEBUG:boto:b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.004 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.004 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.004 DEBUG:boto:path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:39.004 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T18:48:39.004 DEBUG:boto:Method: GET 2024-04-16T18:48:39.004 DEBUG:boto:Path: /cjqttm-56/?prefix=obj155 2024-04-16T18:48:39.005 DEBUG:boto:Data: 2024-04-16T18:48:39.005 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.005 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.005 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.005 DEBUG:boto:Params: {} 2024-04-16T18:48:39.005 DEBUG:boto:Token: None 2024-04-16T18:48:39.005 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.005 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.009 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000519a9e9535d9705e-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.009 DEBUG:boto:b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.009 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:48:39.009 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.009 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.009 DEBUG:boto:path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.010 DEBUG:boto:auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.010 DEBUG:boto:Method: GET 2024-04-16T18:48:39.010 DEBUG:boto:Path: /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.010 DEBUG:boto:Data: 2024-04-16T18:48:39.010 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.010 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.010 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.010 DEBUG:boto:Params: {} 2024-04-16T18:48:39.010 DEBUG:boto:Token: None 2024-04-16T18:48:39.010 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T18:48:39.011 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T18:48:39.012 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e53f9f875309ef4e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.054 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.055 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.055 DEBUG:boto:path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.055 DEBUG:boto:auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.055 DEBUG:boto:Method: GET 2024-04-16T18:48:39.055 DEBUG:boto:Path: /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.055 DEBUG:boto:Data: 2024-04-16T18:48:39.055 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.055 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.055 DEBUG:boto:Params: {} 2024-04-16T18:48:39.055 DEBUG:boto:Token: None 2024-04-16T18:48:39.055 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T18:48:39.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T18:48:39.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebe846a80d5028ad-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.058 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.058 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.058 DEBUG:boto:path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.058 DEBUG:boto:auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.058 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.058 DEBUG:boto:Path: /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.058 DEBUG:boto:Data: 2024-04-16T18:48:39.058 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.058 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.059 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.059 DEBUG:boto:Params: {} 2024-04-16T18:48:39.059 DEBUG:boto:Token: None 2024-04-16T18:48:39.059 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM= 2024-04-16T18:48:39.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM=', 'Content-Length': '0'} 2024-04-16T18:48:39.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000655da89eba5d8988-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.061 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.061 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.061 DEBUG:boto:path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.062 DEBUG:boto:auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.062 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.062 DEBUG:boto:Path: /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.062 DEBUG:boto:Data: 2024-04-16T18:48:39.062 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.062 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.062 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.062 DEBUG:boto:Params: {} 2024-04-16T18:48:39.062 DEBUG:boto:Token: None 2024-04-16T18:48:39.062 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.062 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM= 2024-04-16T18:48:39.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM=', 'Content-Length': '0'} 2024-04-16T18:48:39.064 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047fc3ee6e31bb435-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:48:39.065 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.065 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.065 DEBUG:boto:path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.065 DEBUG:boto:auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.065 DEBUG:boto:Method: GET 2024-04-16T18:48:39.065 DEBUG:boto:Path: /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.065 DEBUG:boto:Data: 2024-04-16T18:48:39.065 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.065 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.065 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.065 DEBUG:boto:Params: {} 2024-04-16T18:48:39.066 DEBUG:boto:Token: None 2024-04-16T18:48:39.066 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.066 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T18:48:39.066 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T18:48:39.068 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab682430d6a2462c-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.068 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.068 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.068 DEBUG:boto:path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.068 DEBUG:boto:auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.068 DEBUG:boto:Method: GET 2024-04-16T18:48:39.068 DEBUG:boto:Path: /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.069 DEBUG:boto:Data: 2024-04-16T18:48:39.069 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.069 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.069 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.069 DEBUG:boto:Params: {} 2024-04-16T18:48:39.069 DEBUG:boto:Token: None 2024-04-16T18:48:39.069 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17?versionId=null 2024-04-16T18:48:39.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T18:48:39.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T18:48:39.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc132ef0ce9404d5-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.071 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.072 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.072 DEBUG:boto:path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.072 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.072 DEBUG:boto:Method: GET 2024-04-16T18:48:39.072 DEBUG:boto:Path: /cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.072 DEBUG:boto:Data: 2024-04-16T18:48:39.072 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.072 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.072 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.072 DEBUG:boto:Params: {} 2024-04-16T18:48:39.072 DEBUG:boto:Token: None 2024-04-16T18:48:39.072 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.073 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.075 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd9eea2e61c8f0c1-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.075 DEBUG:boto:b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.076 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.076 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.076 DEBUG:boto:path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.076 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.076 DEBUG:boto:Method: GET 2024-04-16T18:48:39.076 DEBUG:boto:Path: /cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.076 DEBUG:boto:Data: 2024-04-16T18:48:39.076 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.076 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.076 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.076 DEBUG:boto:Params: {} 2024-04-16T18:48:39.076 DEBUG:boto:Token: None 2024-04-16T18:48:39.077 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.077 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002dfbd0b52698ac6-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.122 DEBUG:boto:b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.123 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.123 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.123 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.123 DEBUG:boto:Path: /cjqttm-56/obj17 2024-04-16T18:48:39.123 DEBUG:boto:Data: 2024-04-16T18:48:39.123 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.123 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.123 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.123 DEBUG:boto:Params: {} 2024-04-16T18:48:39.123 DEBUG:boto:Token: None 2024-04-16T18:48:39.123 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17 2024-04-16T18:48:39.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U= 2024-04-16T18:48:39.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U=', 'Content-Length': '0'} 2024-04-16T18:48:39.125 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c5c989274d96d5d-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.126 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.126 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.126 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.126 DEBUG:boto:Path: /cjqttm-56/obj17 2024-04-16T18:48:39.126 DEBUG:boto:Data: 2024-04-16T18:48:39.126 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.126 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.126 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.126 DEBUG:boto:Params: {} 2024-04-16T18:48:39.126 DEBUG:boto:Token: None 2024-04-16T18:48:39.127 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17 2024-04-16T18:48:39.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U= 2024-04-16T18:48:39.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U=', 'Content-Length': '0'} 2024-04-16T18:48:39.129 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000661e3ba4fd445daf-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.129 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj17 2024-04-16T18:48:39.129 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.129 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.129 DEBUG:boto:Method: GET 2024-04-16T18:48:39.129 DEBUG:boto:Path: /cjqttm-56/obj17 2024-04-16T18:48:39.129 DEBUG:boto:Data: 2024-04-16T18:48:39.129 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.130 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.130 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.130 DEBUG:boto:Params: {} 2024-04-16T18:48:39.130 DEBUG:boto:Token: None 2024-04-16T18:48:39.130 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17 2024-04-16T18:48:39.130 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg= 2024-04-16T18:48:39.130 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg=', 'Content-Length': '0'} 2024-04-16T18:48:39.132 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0e2f918e716e0eb-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.132 DEBUG:boto:path=/cjqttm-56/obj17 2024-04-16T18:48:39.133 DEBUG:boto:auth_path=/cjqttm-56/obj17 2024-04-16T18:48:39.133 DEBUG:boto:Method: GET 2024-04-16T18:48:39.133 DEBUG:boto:Path: /cjqttm-56/obj17 2024-04-16T18:48:39.133 DEBUG:boto:Data: 2024-04-16T18:48:39.133 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.133 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.133 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.133 DEBUG:boto:Params: {} 2024-04-16T18:48:39.133 DEBUG:boto:Token: None 2024-04-16T18:48:39.133 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj17 2024-04-16T18:48:39.134 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg= 2024-04-16T18:48:39.134 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg=', 'Content-Length': '0'} 2024-04-16T18:48:39.135 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000460f4cac14a97c2d-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.136 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.136 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.136 DEBUG:boto:path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.136 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.136 DEBUG:boto:Method: GET 2024-04-16T18:48:39.136 DEBUG:boto:Path: /cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.136 DEBUG:boto:Data: 2024-04-16T18:48:39.136 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.136 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.137 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.137 DEBUG:boto:Params: {} 2024-04-16T18:48:39.137 DEBUG:boto:Token: None 2024-04-16T18:48:39.137 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.137 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.137 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.140 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2ac735624e1c171-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.140 DEBUG:boto:b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.140 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.140 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.140 DEBUG:boto:path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.140 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.140 DEBUG:boto:Method: GET 2024-04-16T18:48:39.141 DEBUG:boto:Path: /cjqttm-56/?prefix=obj17 2024-04-16T18:48:39.141 DEBUG:boto:Data: 2024-04-16T18:48:39.141 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.141 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.141 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.141 DEBUG:boto:Params: {} 2024-04-16T18:48:39.141 DEBUG:boto:Token: None 2024-04-16T18:48:39.141 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.141 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.141 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.145 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003274470a15f75df0-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.145 DEBUG:boto:b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:48:39.145 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.146 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.146 DEBUG:boto:path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.146 DEBUG:boto:auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.146 DEBUG:boto:Method: GET 2024-04-16T18:48:39.146 DEBUG:boto:Path: /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.146 DEBUG:boto:Data: 2024-04-16T18:48:39.146 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.146 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.146 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.146 DEBUG:boto:Params: {} 2024-04-16T18:48:39.146 DEBUG:boto:Token: None 2024-04-16T18:48:39.147 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.147 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T18:48:39.147 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T18:48:39.149 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000020fcfbd2fe00765-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.149 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.149 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.149 DEBUG:boto:path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.149 DEBUG:boto:auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.149 DEBUG:boto:Method: GET 2024-04-16T18:48:39.149 DEBUG:boto:Path: /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.149 DEBUG:boto:Data: 2024-04-16T18:48:39.150 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.150 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.150 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.150 DEBUG:boto:Params: {} 2024-04-16T18:48:39.150 DEBUG:boto:Token: None 2024-04-16T18:48:39.150 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.150 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T18:48:39.150 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T18:48:39.152 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e5dccdcc6f4bcde-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.194 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.195 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.195 DEBUG:boto:path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.195 DEBUG:boto:auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.195 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.195 DEBUG:boto:Path: /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.195 DEBUG:boto:Data: 2024-04-16T18:48:39.195 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.195 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.195 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.195 DEBUG:boto:Params: {} 2024-04-16T18:48:39.196 DEBUG:boto:Token: None 2024-04-16T18:48:39.196 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk= 2024-04-16T18:48:39.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk=', 'Content-Length': '0'} 2024-04-16T18:48:39.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095d9d7ce4a697271-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.199 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.199 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.199 DEBUG:boto:path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.199 DEBUG:boto:auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.199 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.199 DEBUG:boto:Path: /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.199 DEBUG:boto:Data: 2024-04-16T18:48:39.199 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.199 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.199 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.199 DEBUG:boto:Params: {} 2024-04-16T18:48:39.200 DEBUG:boto:Token: None 2024-04-16T18:48:39.200 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.200 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk= 2024-04-16T18:48:39.200 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk=', 'Content-Length': '0'} 2024-04-16T18:48:39.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065ffb32ad49a3aa6-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.202 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:48:39.202 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.202 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.202 DEBUG:boto:path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.202 DEBUG:boto:auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.202 DEBUG:boto:Method: GET 2024-04-16T18:48:39.203 DEBUG:boto:Path: /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.203 DEBUG:boto:Data: 2024-04-16T18:48:39.203 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.203 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.203 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.203 DEBUG:boto:Params: {} 2024-04-16T18:48:39.203 DEBUG:boto:Token: None 2024-04-16T18:48:39.203 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.203 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T18:48:39.204 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T18:48:39.205 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000052b8302c29e6d2c-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.206 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.206 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.206 DEBUG:boto:path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.206 DEBUG:boto:auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.206 DEBUG:boto:Method: GET 2024-04-16T18:48:39.206 DEBUG:boto:Path: /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.206 DEBUG:boto:Data: 2024-04-16T18:48:39.206 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.206 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.206 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.207 DEBUG:boto:Params: {} 2024-04-16T18:48:39.207 DEBUG:boto:Token: None 2024-04-16T18:48:39.207 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185?versionId=null 2024-04-16T18:48:39.207 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T18:48:39.207 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T18:48:39.209 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a34e725ad934125b-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.209 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.210 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.210 DEBUG:boto:path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.210 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.210 DEBUG:boto:Method: GET 2024-04-16T18:48:39.210 DEBUG:boto:Path: /cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.210 DEBUG:boto:Data: 2024-04-16T18:48:39.210 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.210 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.210 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.210 DEBUG:boto:Params: {} 2024-04-16T18:48:39.210 DEBUG:boto:Token: None 2024-04-16T18:48:39.211 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.211 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.211 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.213 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045969e8430a8ac21-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.213 DEBUG:boto:b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.214 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.214 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.214 DEBUG:boto:path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.214 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.214 DEBUG:boto:Method: GET 2024-04-16T18:48:39.214 DEBUG:boto:Path: /cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.214 DEBUG:boto:Data: 2024-04-16T18:48:39.214 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.214 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.214 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.215 DEBUG:boto:Params: {} 2024-04-16T18:48:39.215 DEBUG:boto:Token: None 2024-04-16T18:48:39.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.215 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.215 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.218 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2882b2229729853-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.218 DEBUG:boto:b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.219 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.219 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.219 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.219 DEBUG:boto:Path: /cjqttm-56/obj185 2024-04-16T18:48:39.219 DEBUG:boto:Data: 2024-04-16T18:48:39.219 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.219 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.219 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.219 DEBUG:boto:Params: {} 2024-04-16T18:48:39.219 DEBUG:boto:Token: None 2024-04-16T18:48:39.220 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185 2024-04-16T18:48:39.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q= 2024-04-16T18:48:39.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q=', 'Content-Length': '0'} 2024-04-16T18:48:39.221 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005a7f55a951a831c-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.222 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.222 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.222 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.222 DEBUG:boto:Path: /cjqttm-56/obj185 2024-04-16T18:48:39.222 DEBUG:boto:Data: 2024-04-16T18:48:39.222 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.222 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.222 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.222 DEBUG:boto:Params: {} 2024-04-16T18:48:39.222 DEBUG:boto:Token: None 2024-04-16T18:48:39.223 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185 2024-04-16T18:48:39.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q= 2024-04-16T18:48:39.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q=', 'Content-Length': '0'} 2024-04-16T18:48:39.224 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093f7b64187e096c0-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.225 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj185 2024-04-16T18:48:39.225 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.225 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.225 DEBUG:boto:Method: GET 2024-04-16T18:48:39.225 DEBUG:boto:Path: /cjqttm-56/obj185 2024-04-16T18:48:39.225 DEBUG:boto:Data: 2024-04-16T18:48:39.225 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.225 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.225 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.225 DEBUG:boto:Params: {} 2024-04-16T18:48:39.226 DEBUG:boto:Token: None 2024-04-16T18:48:39.226 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185 2024-04-16T18:48:39.226 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo= 2024-04-16T18:48:39.226 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo=', 'Content-Length': '0'} 2024-04-16T18:48:39.228 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8ce0300f719bfc0-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.228 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:39.228 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:39.228 DEBUG:boto:Method: GET 2024-04-16T18:48:39.228 DEBUG:boto:Path: /cjqttm-56/obj185 2024-04-16T18:48:39.228 DEBUG:boto:Data: 2024-04-16T18:48:39.229 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.229 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.229 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.229 DEBUG:boto:Params: {} 2024-04-16T18:48:39.229 DEBUG:boto:Token: None 2024-04-16T18:48:39.229 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj185 2024-04-16T18:48:39.229 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo= 2024-04-16T18:48:39.229 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo=', 'Content-Length': '0'} 2024-04-16T18:48:39.231 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e8c917bc315e96c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.231 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.232 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.232 DEBUG:boto:path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.232 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.232 DEBUG:boto:Method: GET 2024-04-16T18:48:39.232 DEBUG:boto:Path: /cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.232 DEBUG:boto:Data: 2024-04-16T18:48:39.232 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.232 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.232 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.232 DEBUG:boto:Params: {} 2024-04-16T18:48:39.233 DEBUG:boto:Token: None 2024-04-16T18:48:39.233 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.233 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.233 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.236 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f1cfcbd13b7d1e8-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.236 DEBUG:boto:b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.236 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.236 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.236 DEBUG:boto:path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.236 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.236 DEBUG:boto:Method: GET 2024-04-16T18:48:39.236 DEBUG:boto:Path: /cjqttm-56/?prefix=obj185 2024-04-16T18:48:39.237 DEBUG:boto:Data: 2024-04-16T18:48:39.237 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.237 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.237 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.237 DEBUG:boto:Params: {} 2024-04-16T18:48:39.237 DEBUG:boto:Token: None 2024-04-16T18:48:39.237 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.237 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.241 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d483e0d8ea317433-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.282 DEBUG:boto:b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.283 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:48:39.283 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.283 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.283 DEBUG:boto:path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.283 DEBUG:boto:auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.283 DEBUG:boto:Method: GET 2024-04-16T18:48:39.283 DEBUG:boto:Path: /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.283 DEBUG:boto:Data: 2024-04-16T18:48:39.283 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.284 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.284 DEBUG:boto:Params: {} 2024-04-16T18:48:39.284 DEBUG:boto:Token: None 2024-04-16T18:48:39.284 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T18:48:39.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T18:48:39.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031a3d2dd2e42c118-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.286 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.286 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.286 DEBUG:boto:path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.286 DEBUG:boto:auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.286 DEBUG:boto:Method: GET 2024-04-16T18:48:39.287 DEBUG:boto:Path: /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.287 DEBUG:boto:Data: 2024-04-16T18:48:39.287 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.287 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.287 DEBUG:boto:Params: {} 2024-04-16T18:48:39.287 DEBUG:boto:Token: None 2024-04-16T18:48:39.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T18:48:39.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T18:48:39.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfc7a3285836593c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.290 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.290 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.290 DEBUG:boto:path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.290 DEBUG:boto:auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.290 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.290 DEBUG:boto:Path: /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.290 DEBUG:boto:Data: 2024-04-16T18:48:39.290 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.291 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.291 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.291 DEBUG:boto:Params: {} 2024-04-16T18:48:39.291 DEBUG:boto:Token: None 2024-04-16T18:48:39.291 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io= 2024-04-16T18:48:39.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io=', 'Content-Length': '0'} 2024-04-16T18:48:39.293 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007af9aae14ea09d4-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.293 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.293 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.294 DEBUG:boto:path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.294 DEBUG:boto:auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.294 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.294 DEBUG:boto:Path: /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.294 DEBUG:boto:Data: 2024-04-16T18:48:39.294 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.294 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.294 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.294 DEBUG:boto:Params: {} 2024-04-16T18:48:39.294 DEBUG:boto:Token: None 2024-04-16T18:48:39.294 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.295 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io= 2024-04-16T18:48:39.295 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io=', 'Content-Length': '0'} 2024-04-16T18:48:39.296 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d60a7c49bca5376e-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.297 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:48:39.297 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.297 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.297 DEBUG:boto:path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.297 DEBUG:boto:auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.297 DEBUG:boto:Method: GET 2024-04-16T18:48:39.297 DEBUG:boto:Path: /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.297 DEBUG:boto:Data: 2024-04-16T18:48:39.298 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.298 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.298 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.298 DEBUG:boto:Params: {} 2024-04-16T18:48:39.298 DEBUG:boto:Token: None 2024-04-16T18:48:39.298 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.298 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T18:48:39.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T18:48:39.300 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd988a745cf5796f-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.300 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.300 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.300 DEBUG:boto:path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.301 DEBUG:boto:auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.301 DEBUG:boto:Method: GET 2024-04-16T18:48:39.301 DEBUG:boto:Path: /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.301 DEBUG:boto:Data: 2024-04-16T18:48:39.301 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.301 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.301 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.301 DEBUG:boto:Params: {} 2024-04-16T18:48:39.301 DEBUG:boto:Token: None 2024-04-16T18:48:39.301 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19?versionId=null 2024-04-16T18:48:39.302 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T18:48:39.302 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T18:48:39.304 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a41cf9f04448c4e6-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.304 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.304 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.304 DEBUG:boto:path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.304 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.304 DEBUG:boto:Method: GET 2024-04-16T18:48:39.304 DEBUG:boto:Path: /cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.304 DEBUG:boto:Data: 2024-04-16T18:48:39.304 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.305 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.305 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.305 DEBUG:boto:Params: {} 2024-04-16T18:48:39.305 DEBUG:boto:Token: None 2024-04-16T18:48:39.305 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.305 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.305 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.308 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e879a31b71c969b-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.308 DEBUG:boto:b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.308 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.308 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.308 DEBUG:boto:path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.308 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.309 DEBUG:boto:Method: GET 2024-04-16T18:48:39.309 DEBUG:boto:Path: /cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.309 DEBUG:boto:Data: 2024-04-16T18:48:39.309 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.309 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.309 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.309 DEBUG:boto:Params: {} 2024-04-16T18:48:39.309 DEBUG:boto:Token: None 2024-04-16T18:48:39.309 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.309 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.309 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.313 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048323b8512fb9418-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.313 DEBUG:boto:b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.314 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.314 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.314 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.314 DEBUG:boto:Path: /cjqttm-56/obj19 2024-04-16T18:48:39.314 DEBUG:boto:Data: 2024-04-16T18:48:39.314 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.314 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.314 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.314 DEBUG:boto:Params: {} 2024-04-16T18:48:39.315 DEBUG:boto:Token: None 2024-04-16T18:48:39.315 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19 2024-04-16T18:48:39.315 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg= 2024-04-16T18:48:39.315 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg=', 'Content-Length': '0'} 2024-04-16T18:48:39.316 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077dcf7243858e13e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.317 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.317 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.317 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.317 DEBUG:boto:Path: /cjqttm-56/obj19 2024-04-16T18:48:39.317 DEBUG:boto:Data: 2024-04-16T18:48:39.317 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.317 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.317 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.317 DEBUG:boto:Params: {} 2024-04-16T18:48:39.318 DEBUG:boto:Token: None 2024-04-16T18:48:39.318 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19 2024-04-16T18:48:39.318 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg= 2024-04-16T18:48:39.318 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg=', 'Content-Length': '0'} 2024-04-16T18:48:39.320 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000263e05404a9def05-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.320 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj19 2024-04-16T18:48:39.320 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.320 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.320 DEBUG:boto:Method: GET 2024-04-16T18:48:39.320 DEBUG:boto:Path: /cjqttm-56/obj19 2024-04-16T18:48:39.320 DEBUG:boto:Data: 2024-04-16T18:48:39.320 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.321 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.321 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.321 DEBUG:boto:Params: {} 2024-04-16T18:48:39.321 DEBUG:boto:Token: None 2024-04-16T18:48:39.321 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19 2024-04-16T18:48:39.321 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60= 2024-04-16T18:48:39.321 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60=', 'Content-Length': '0'} 2024-04-16T18:48:39.323 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c410f84f5bfea13-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.366 DEBUG:boto:path=/cjqttm-56/obj19 2024-04-16T18:48:39.367 DEBUG:boto:auth_path=/cjqttm-56/obj19 2024-04-16T18:48:39.367 DEBUG:boto:Method: GET 2024-04-16T18:48:39.367 DEBUG:boto:Path: /cjqttm-56/obj19 2024-04-16T18:48:39.367 DEBUG:boto:Data: 2024-04-16T18:48:39.367 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.367 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.367 DEBUG:boto:Params: {} 2024-04-16T18:48:39.367 DEBUG:boto:Token: None 2024-04-16T18:48:39.367 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj19 2024-04-16T18:48:39.367 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60= 2024-04-16T18:48:39.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60=', 'Content-Length': '0'} 2024-04-16T18:48:39.369 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039c57e2bc2a7bb46-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.370 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.370 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.370 DEBUG:boto:path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.370 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.370 DEBUG:boto:Method: GET 2024-04-16T18:48:39.370 DEBUG:boto:Path: /cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.370 DEBUG:boto:Data: 2024-04-16T18:48:39.370 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.370 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.371 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.371 DEBUG:boto:Params: {} 2024-04-16T18:48:39.371 DEBUG:boto:Token: None 2024-04-16T18:48:39.371 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.371 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.371 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.373 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000713b1c8c7ab3e280-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.374 DEBUG:boto:b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.374 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.374 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.374 DEBUG:boto:path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.374 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.374 DEBUG:boto:Method: GET 2024-04-16T18:48:39.374 DEBUG:boto:Path: /cjqttm-56/?prefix=obj19 2024-04-16T18:48:39.375 DEBUG:boto:Data: 2024-04-16T18:48:39.375 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.375 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.375 DEBUG:boto:Params: {} 2024-04-16T18:48:39.375 DEBUG:boto:Token: None 2024-04-16T18:48:39.375 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.375 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.375 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.379 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013e0dda2d06ad028-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.379 DEBUG:boto:b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.379 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:48:39.379 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.379 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.380 DEBUG:boto:path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.380 DEBUG:boto:auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.380 DEBUG:boto:Method: GET 2024-04-16T18:48:39.380 DEBUG:boto:Path: /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.380 DEBUG:boto:Data: 2024-04-16T18:48:39.380 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.380 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.380 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.380 DEBUG:boto:Params: {} 2024-04-16T18:48:39.380 DEBUG:boto:Token: None 2024-04-16T18:48:39.380 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.381 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T18:48:39.381 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T18:48:39.383 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0ce199b92b1c296-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.383 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.383 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.383 DEBUG:boto:path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.383 DEBUG:boto:auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.383 DEBUG:boto:Method: GET 2024-04-16T18:48:39.383 DEBUG:boto:Path: /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.383 DEBUG:boto:Data: 2024-04-16T18:48:39.383 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.384 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.384 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.384 DEBUG:boto:Params: {} 2024-04-16T18:48:39.384 DEBUG:boto:Token: None 2024-04-16T18:48:39.384 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T18:48:39.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T18:48:39.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d6d9d3859241e23-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.386 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.387 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.387 DEBUG:boto:path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.387 DEBUG:boto:auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.387 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.387 DEBUG:boto:Path: /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.387 DEBUG:boto:Data: 2024-04-16T18:48:39.387 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.389 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.389 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.389 DEBUG:boto:Params: {} 2024-04-16T18:48:39.389 DEBUG:boto:Token: None 2024-04-16T18:48:39.389 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.389 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk= 2024-04-16T18:48:39.389 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk=', 'Content-Length': '0'} 2024-04-16T18:48:39.391 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e63dd1c6303ab389-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.392 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.392 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.392 DEBUG:boto:path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.392 DEBUG:boto:auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.392 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.392 DEBUG:boto:Path: /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.392 DEBUG:boto:Data: 2024-04-16T18:48:39.392 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.392 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.392 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.392 DEBUG:boto:Params: {} 2024-04-16T18:48:39.393 DEBUG:boto:Token: None 2024-04-16T18:48:39.393 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.393 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk= 2024-04-16T18:48:39.393 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk=', 'Content-Length': '0'} 2024-04-16T18:48:39.395 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041dd2a73b6a8aa0a-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.395 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:48:39.395 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.396 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.396 DEBUG:boto:path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.396 DEBUG:boto:auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.396 DEBUG:boto:Method: GET 2024-04-16T18:48:39.396 DEBUG:boto:Path: /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.396 DEBUG:boto:Data: 2024-04-16T18:48:39.396 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.396 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.396 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.396 DEBUG:boto:Params: {} 2024-04-16T18:48:39.397 DEBUG:boto:Token: None 2024-04-16T18:48:39.397 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T18:48:39.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T18:48:39.399 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b99fafcd5f21c57e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.442 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.443 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.443 DEBUG:boto:path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.443 DEBUG:boto:auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.443 DEBUG:boto:Method: GET 2024-04-16T18:48:39.443 DEBUG:boto:Path: /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.443 DEBUG:boto:Data: 2024-04-16T18:48:39.443 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.443 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.443 DEBUG:boto:Params: {} 2024-04-16T18:48:39.443 DEBUG:boto:Token: None 2024-04-16T18:48:39.444 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22?versionId=null 2024-04-16T18:48:39.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T18:48:39.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T18:48:39.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f4731b09902624f-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.446 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.446 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.447 DEBUG:boto:path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.447 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.447 DEBUG:boto:Method: GET 2024-04-16T18:48:39.447 DEBUG:boto:Path: /cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.447 DEBUG:boto:Data: 2024-04-16T18:48:39.447 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.447 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.447 DEBUG:boto:Params: {} 2024-04-16T18:48:39.447 DEBUG:boto:Token: None 2024-04-16T18:48:39.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.450 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f285ae8102f43f30-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.450 DEBUG:boto:b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.451 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.451 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.451 DEBUG:boto:path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.451 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.451 DEBUG:boto:Method: GET 2024-04-16T18:48:39.451 DEBUG:boto:Path: /cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.451 DEBUG:boto:Data: 2024-04-16T18:48:39.451 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.451 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.452 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.452 DEBUG:boto:Params: {} 2024-04-16T18:48:39.452 DEBUG:boto:Token: None 2024-04-16T18:48:39.452 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.455 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9d8ff39e357d44c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.456 DEBUG:boto:b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.456 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.456 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.456 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.456 DEBUG:boto:Path: /cjqttm-56/obj22 2024-04-16T18:48:39.456 DEBUG:boto:Data: 2024-04-16T18:48:39.456 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.456 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.457 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.457 DEBUG:boto:Params: {} 2024-04-16T18:48:39.457 DEBUG:boto:Token: None 2024-04-16T18:48:39.457 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22 2024-04-16T18:48:39.457 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM= 2024-04-16T18:48:39.457 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM=', 'Content-Length': '0'} 2024-04-16T18:48:39.459 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002737caba62de7349-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.459 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.460 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.460 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.460 DEBUG:boto:Path: /cjqttm-56/obj22 2024-04-16T18:48:39.460 DEBUG:boto:Data: 2024-04-16T18:48:39.460 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.460 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.460 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.460 DEBUG:boto:Params: {} 2024-04-16T18:48:39.460 DEBUG:boto:Token: None 2024-04-16T18:48:39.461 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22 2024-04-16T18:48:39.461 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM= 2024-04-16T18:48:39.461 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM=', 'Content-Length': '0'} 2024-04-16T18:48:39.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036744af83ffb907c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:48:39.463 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.463 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.464 DEBUG:boto:Method: GET 2024-04-16T18:48:39.464 DEBUG:boto:Path: /cjqttm-56/obj22 2024-04-16T18:48:39.464 DEBUG:boto:Data: 2024-04-16T18:48:39.464 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.464 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.464 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.464 DEBUG:boto:Params: {} 2024-04-16T18:48:39.464 DEBUG:boto:Token: None 2024-04-16T18:48:39.464 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22 2024-04-16T18:48:39.464 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE= 2024-04-16T18:48:39.465 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE=', 'Content-Length': '0'} 2024-04-16T18:48:39.466 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e35d1b3a5ddc481d-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.510 DEBUG:boto:path=/cjqttm-56/obj22 2024-04-16T18:48:39.511 DEBUG:boto:auth_path=/cjqttm-56/obj22 2024-04-16T18:48:39.511 DEBUG:boto:Method: GET 2024-04-16T18:48:39.511 DEBUG:boto:Path: /cjqttm-56/obj22 2024-04-16T18:48:39.511 DEBUG:boto:Data: 2024-04-16T18:48:39.511 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.511 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.511 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.511 DEBUG:boto:Params: {} 2024-04-16T18:48:39.511 DEBUG:boto:Token: None 2024-04-16T18:48:39.511 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj22 2024-04-16T18:48:39.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE= 2024-04-16T18:48:39.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE=', 'Content-Length': '0'} 2024-04-16T18:48:39.514 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b3272580d186292-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.514 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.515 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.515 DEBUG:boto:path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.515 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.515 DEBUG:boto:Method: GET 2024-04-16T18:48:39.515 DEBUG:boto:Path: /cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.515 DEBUG:boto:Data: 2024-04-16T18:48:39.515 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.515 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.515 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.515 DEBUG:boto:Params: {} 2024-04-16T18:48:39.515 DEBUG:boto:Token: None 2024-04-16T18:48:39.516 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.518 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000732190ce74cf4587-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.518 DEBUG:boto:b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.519 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.519 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.519 DEBUG:boto:path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.519 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.519 DEBUG:boto:Method: GET 2024-04-16T18:48:39.519 DEBUG:boto:Path: /cjqttm-56/?prefix=obj22 2024-04-16T18:48:39.519 DEBUG:boto:Data: 2024-04-16T18:48:39.519 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.520 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.520 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.520 DEBUG:boto:Params: {} 2024-04-16T18:48:39.520 DEBUG:boto:Token: None 2024-04-16T18:48:39.520 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.520 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.520 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.524 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038949e8d6818fabc-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.524 DEBUG:boto:b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.524 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:48:39.524 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.524 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.524 DEBUG:boto:path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.525 DEBUG:boto:auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.525 DEBUG:boto:Method: GET 2024-04-16T18:48:39.525 DEBUG:boto:Path: /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.525 DEBUG:boto:Data: 2024-04-16T18:48:39.525 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.525 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.525 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.525 DEBUG:boto:Params: {} 2024-04-16T18:48:39.525 DEBUG:boto:Token: None 2024-04-16T18:48:39.525 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.526 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T18:48:39.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T18:48:39.528 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018f59502e23df71e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.528 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.528 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.528 DEBUG:boto:path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.528 DEBUG:boto:auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.528 DEBUG:boto:Method: GET 2024-04-16T18:48:39.529 DEBUG:boto:Path: /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.529 DEBUG:boto:Data: 2024-04-16T18:48:39.529 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.529 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.529 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.529 DEBUG:boto:Params: {} 2024-04-16T18:48:39.529 DEBUG:boto:Token: None 2024-04-16T18:48:39.529 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.529 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T18:48:39.530 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T18:48:39.532 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d35c8783f21b2172-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.532 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.532 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.532 DEBUG:boto:path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.532 DEBUG:boto:auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.532 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.532 DEBUG:boto:Path: /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.532 DEBUG:boto:Data: 2024-04-16T18:48:39.532 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.533 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.533 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.533 DEBUG:boto:Params: {} 2024-04-16T18:48:39.533 DEBUG:boto:Token: None 2024-04-16T18:48:39.533 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.533 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k= 2024-04-16T18:48:39.533 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k=', 'Content-Length': '0'} 2024-04-16T18:48:39.535 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009590ca35535638ec-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.535 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.535 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.536 DEBUG:boto:path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.536 DEBUG:boto:auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.536 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.536 DEBUG:boto:Path: /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.536 DEBUG:boto:Data: 2024-04-16T18:48:39.536 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.536 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.536 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.536 DEBUG:boto:Params: {} 2024-04-16T18:48:39.536 DEBUG:boto:Token: None 2024-04-16T18:48:39.536 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.537 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k= 2024-04-16T18:48:39.537 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k=', 'Content-Length': '0'} 2024-04-16T18:48:39.539 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000912ddba86eab18aa-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.539 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:48:39.539 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.539 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.539 DEBUG:boto:path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.539 DEBUG:boto:auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.539 DEBUG:boto:Method: GET 2024-04-16T18:48:39.539 DEBUG:boto:Path: /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.540 DEBUG:boto:Data: 2024-04-16T18:48:39.540 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.540 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.540 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.540 DEBUG:boto:Params: {} 2024-04-16T18:48:39.540 DEBUG:boto:Token: None 2024-04-16T18:48:39.540 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.540 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T18:48:39.540 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T18:48:39.542 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b98936fed8d12e36-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.586 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.587 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.587 DEBUG:boto:path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.587 DEBUG:boto:auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.587 DEBUG:boto:Method: GET 2024-04-16T18:48:39.587 DEBUG:boto:Path: /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.587 DEBUG:boto:Data: 2024-04-16T18:48:39.587 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.587 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.587 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.587 DEBUG:boto:Params: {} 2024-04-16T18:48:39.588 DEBUG:boto:Token: None 2024-04-16T18:48:39.588 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23?versionId=null 2024-04-16T18:48:39.588 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T18:48:39.588 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T18:48:39.590 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009344cf5cc802ea7c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.590 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.590 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.590 DEBUG:boto:path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.591 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.591 DEBUG:boto:Method: GET 2024-04-16T18:48:39.591 DEBUG:boto:Path: /cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.591 DEBUG:boto:Data: 2024-04-16T18:48:39.591 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.591 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.591 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.591 DEBUG:boto:Params: {} 2024-04-16T18:48:39.591 DEBUG:boto:Token: None 2024-04-16T18:48:39.593 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.593 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.593 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.596 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000147d13e3ed55c292-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.596 DEBUG:boto:b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.596 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.596 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.597 DEBUG:boto:path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.597 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.597 DEBUG:boto:Method: GET 2024-04-16T18:48:39.597 DEBUG:boto:Path: /cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.597 DEBUG:boto:Data: 2024-04-16T18:48:39.597 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.597 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.597 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.597 DEBUG:boto:Params: {} 2024-04-16T18:48:39.597 DEBUG:boto:Token: None 2024-04-16T18:48:39.597 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.598 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.598 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.601 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d66379e2e0343a8-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.601 DEBUG:boto:b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.602 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.602 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.602 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.602 DEBUG:boto:Path: /cjqttm-56/obj23 2024-04-16T18:48:39.602 DEBUG:boto:Data: 2024-04-16T18:48:39.602 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.602 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.602 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.602 DEBUG:boto:Params: {} 2024-04-16T18:48:39.603 DEBUG:boto:Token: None 2024-04-16T18:48:39.603 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23 2024-04-16T18:48:39.603 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4= 2024-04-16T18:48:39.603 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4=', 'Content-Length': '0'} 2024-04-16T18:48:39.605 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029a7147789c5bf10-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.605 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.605 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.605 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.605 DEBUG:boto:Path: /cjqttm-56/obj23 2024-04-16T18:48:39.606 DEBUG:boto:Data: 2024-04-16T18:48:39.606 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.606 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.606 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.606 DEBUG:boto:Params: {} 2024-04-16T18:48:39.606 DEBUG:boto:Token: None 2024-04-16T18:48:39.606 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23 2024-04-16T18:48:39.606 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4= 2024-04-16T18:48:39.606 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4=', 'Content-Length': '0'} 2024-04-16T18:48:39.608 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2c123de6131ac4d-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj23 2024-04-16T18:48:39.609 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.609 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.609 DEBUG:boto:Method: GET 2024-04-16T18:48:39.609 DEBUG:boto:Path: /cjqttm-56/obj23 2024-04-16T18:48:39.609 DEBUG:boto:Data: 2024-04-16T18:48:39.609 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.609 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.610 DEBUG:boto:Params: {} 2024-04-16T18:48:39.610 DEBUG:boto:Token: None 2024-04-16T18:48:39.610 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23 2024-04-16T18:48:39.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M= 2024-04-16T18:48:39.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M=', 'Content-Length': '0'} 2024-04-16T18:48:39.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d67b19087d680272-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.612 DEBUG:boto:path=/cjqttm-56/obj23 2024-04-16T18:48:39.612 DEBUG:boto:auth_path=/cjqttm-56/obj23 2024-04-16T18:48:39.612 DEBUG:boto:Method: GET 2024-04-16T18:48:39.613 DEBUG:boto:Path: /cjqttm-56/obj23 2024-04-16T18:48:39.613 DEBUG:boto:Data: 2024-04-16T18:48:39.613 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.613 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.613 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.613 DEBUG:boto:Params: {} 2024-04-16T18:48:39.613 DEBUG:boto:Token: None 2024-04-16T18:48:39.613 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj23 2024-04-16T18:48:39.613 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M= 2024-04-16T18:48:39.613 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M=', 'Content-Length': '0'} 2024-04-16T18:48:39.615 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcacf48a0b252334-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.615 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.615 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.616 DEBUG:boto:path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.616 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.616 DEBUG:boto:Method: GET 2024-04-16T18:48:39.616 DEBUG:boto:Path: /cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.616 DEBUG:boto:Data: 2024-04-16T18:48:39.616 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.616 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.616 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.616 DEBUG:boto:Params: {} 2024-04-16T18:48:39.617 DEBUG:boto:Token: None 2024-04-16T18:48:39.617 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.617 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.617 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.619 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000581438104e8a0736-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.620 DEBUG:boto:b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.620 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.620 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.620 DEBUG:boto:path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.620 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.620 DEBUG:boto:Method: GET 2024-04-16T18:48:39.620 DEBUG:boto:Path: /cjqttm-56/?prefix=obj23 2024-04-16T18:48:39.620 DEBUG:boto:Data: 2024-04-16T18:48:39.621 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.621 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.621 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.621 DEBUG:boto:Params: {} 2024-04-16T18:48:39.621 DEBUG:boto:Token: None 2024-04-16T18:48:39.621 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.621 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.621 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.624 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003de73b84384cc498-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.666 DEBUG:boto:b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.667 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:48:39.667 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.667 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.667 DEBUG:boto:path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.667 DEBUG:boto:auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.667 DEBUG:boto:Method: GET 2024-04-16T18:48:39.667 DEBUG:boto:Path: /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.667 DEBUG:boto:Data: 2024-04-16T18:48:39.667 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.668 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.668 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.668 DEBUG:boto:Params: {} 2024-04-16T18:48:39.668 DEBUG:boto:Token: None 2024-04-16T18:48:39.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T18:48:39.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T18:48:39.670 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dba09a8cab864587-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.670 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.670 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.671 DEBUG:boto:path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.671 DEBUG:boto:auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.671 DEBUG:boto:Method: GET 2024-04-16T18:48:39.671 DEBUG:boto:Path: /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.671 DEBUG:boto:Data: 2024-04-16T18:48:39.671 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.671 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.671 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.671 DEBUG:boto:Params: {} 2024-04-16T18:48:39.671 DEBUG:boto:Token: None 2024-04-16T18:48:39.671 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.672 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T18:48:39.672 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T18:48:39.674 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000804b35ce124846af-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.674 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.674 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.674 DEBUG:boto:path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.674 DEBUG:boto:auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.674 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.674 DEBUG:boto:Path: /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.675 DEBUG:boto:Data: 2024-04-16T18:48:39.675 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.675 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.675 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.675 DEBUG:boto:Params: {} 2024-04-16T18:48:39.675 DEBUG:boto:Token: None 2024-04-16T18:48:39.675 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.675 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8= 2024-04-16T18:48:39.675 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8=', 'Content-Length': '0'} 2024-04-16T18:48:39.677 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074c6fd5d152d93e8-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.678 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.678 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.678 DEBUG:boto:path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.678 DEBUG:boto:auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.678 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.678 DEBUG:boto:Path: /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.678 DEBUG:boto:Data: 2024-04-16T18:48:39.678 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.678 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.678 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.679 DEBUG:boto:Params: {} 2024-04-16T18:48:39.679 DEBUG:boto:Token: None 2024-04-16T18:48:39.679 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8= 2024-04-16T18:48:39.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8=', 'Content-Length': '0'} 2024-04-16T18:48:39.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bcf65a6eaf897eb-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.681 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:48:39.681 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.681 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.681 DEBUG:boto:path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.681 DEBUG:boto:auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.682 DEBUG:boto:Method: GET 2024-04-16T18:48:39.682 DEBUG:boto:Path: /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.682 DEBUG:boto:Data: 2024-04-16T18:48:39.682 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.682 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.682 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.682 DEBUG:boto:Params: {} 2024-04-16T18:48:39.682 DEBUG:boto:Token: None 2024-04-16T18:48:39.682 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.682 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T18:48:39.683 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T18:48:39.684 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c1559712af264c5-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.685 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.685 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.685 DEBUG:boto:path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.685 DEBUG:boto:auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.685 DEBUG:boto:Method: GET 2024-04-16T18:48:39.685 DEBUG:boto:Path: /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.685 DEBUG:boto:Data: 2024-04-16T18:48:39.685 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.686 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.686 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.686 DEBUG:boto:Params: {} 2024-04-16T18:48:39.686 DEBUG:boto:Token: None 2024-04-16T18:48:39.686 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29?versionId=null 2024-04-16T18:48:39.686 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T18:48:39.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T18:48:39.688 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b91cc3d93ab2f0a-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.688 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.689 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.689 DEBUG:boto:path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.689 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.689 DEBUG:boto:Method: GET 2024-04-16T18:48:39.689 DEBUG:boto:Path: /cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.689 DEBUG:boto:Data: 2024-04-16T18:48:39.689 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.689 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.689 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.689 DEBUG:boto:Params: {} 2024-04-16T18:48:39.689 DEBUG:boto:Token: None 2024-04-16T18:48:39.690 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.690 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.690 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.692 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af9e7a00dc40889e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.693 DEBUG:boto:b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.693 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.693 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.693 DEBUG:boto:path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.693 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.693 DEBUG:boto:Method: GET 2024-04-16T18:48:39.693 DEBUG:boto:Path: /cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.694 DEBUG:boto:Data: 2024-04-16T18:48:39.694 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.694 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.694 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.694 DEBUG:boto:Params: {} 2024-04-16T18:48:39.694 DEBUG:boto:Token: None 2024-04-16T18:48:39.694 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.694 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.694 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094cc7f12a8259704-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.698 DEBUG:boto:b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.698 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.699 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.699 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.699 DEBUG:boto:Path: /cjqttm-56/obj29 2024-04-16T18:48:39.699 DEBUG:boto:Data: 2024-04-16T18:48:39.699 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.699 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.699 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.699 DEBUG:boto:Params: {} 2024-04-16T18:48:39.699 DEBUG:boto:Token: None 2024-04-16T18:48:39.699 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29 2024-04-16T18:48:39.700 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E= 2024-04-16T18:48:39.700 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E=', 'Content-Length': '0'} 2024-04-16T18:48:39.701 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000706c782d00db7f91-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.702 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.702 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.702 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.702 DEBUG:boto:Path: /cjqttm-56/obj29 2024-04-16T18:48:39.702 DEBUG:boto:Data: 2024-04-16T18:48:39.702 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.702 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.702 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.702 DEBUG:boto:Params: {} 2024-04-16T18:48:39.703 DEBUG:boto:Token: None 2024-04-16T18:48:39.703 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29 2024-04-16T18:48:39.703 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E= 2024-04-16T18:48:39.703 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E=', 'Content-Length': '0'} 2024-04-16T18:48:39.705 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc76d179c78dd05d-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.705 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj29 2024-04-16T18:48:39.705 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.705 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.705 DEBUG:boto:Method: GET 2024-04-16T18:48:39.705 DEBUG:boto:Path: /cjqttm-56/obj29 2024-04-16T18:48:39.705 DEBUG:boto:Data: 2024-04-16T18:48:39.706 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.706 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.706 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.706 DEBUG:boto:Params: {} 2024-04-16T18:48:39.706 DEBUG:boto:Token: None 2024-04-16T18:48:39.706 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29 2024-04-16T18:48:39.706 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw= 2024-04-16T18:48:39.706 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw=', 'Content-Length': '0'} 2024-04-16T18:48:39.708 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bcef60cd1bd1b1d-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.750 DEBUG:boto:path=/cjqttm-56/obj29 2024-04-16T18:48:39.750 DEBUG:boto:auth_path=/cjqttm-56/obj29 2024-04-16T18:48:39.751 DEBUG:boto:Method: GET 2024-04-16T18:48:39.751 DEBUG:boto:Path: /cjqttm-56/obj29 2024-04-16T18:48:39.751 DEBUG:boto:Data: 2024-04-16T18:48:39.751 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.751 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.751 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.751 DEBUG:boto:Params: {} 2024-04-16T18:48:39.751 DEBUG:boto:Token: None 2024-04-16T18:48:39.751 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj29 2024-04-16T18:48:39.751 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw= 2024-04-16T18:48:39.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw=', 'Content-Length': '0'} 2024-04-16T18:48:39.753 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019733b20d291564b-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.754 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.754 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.754 DEBUG:boto:path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.754 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.754 DEBUG:boto:Method: GET 2024-04-16T18:48:39.754 DEBUG:boto:Path: /cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.754 DEBUG:boto:Data: 2024-04-16T18:48:39.754 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.754 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.754 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.755 DEBUG:boto:Params: {} 2024-04-16T18:48:39.755 DEBUG:boto:Token: None 2024-04-16T18:48:39.755 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.755 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.755 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.757 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068b26c521102f956-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.798 DEBUG:boto:b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.799 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.799 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.799 DEBUG:boto:path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.799 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.799 DEBUG:boto:Method: GET 2024-04-16T18:48:39.799 DEBUG:boto:Path: /cjqttm-56/?prefix=obj29 2024-04-16T18:48:39.799 DEBUG:boto:Data: 2024-04-16T18:48:39.799 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.799 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.799 DEBUG:boto:Params: {} 2024-04-16T18:48:39.800 DEBUG:boto:Token: None 2024-04-16T18:48:39.800 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.800 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.800 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.803 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba176ba3c6dcd57a-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.803 DEBUG:boto:b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.803 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:48:39.804 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.804 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.804 DEBUG:boto:path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.804 DEBUG:boto:auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.804 DEBUG:boto:Method: GET 2024-04-16T18:48:39.804 DEBUG:boto:Path: /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.804 DEBUG:boto:Data: 2024-04-16T18:48:39.804 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.804 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.804 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.804 DEBUG:boto:Params: {} 2024-04-16T18:48:39.805 DEBUG:boto:Token: None 2024-04-16T18:48:39.805 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.805 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T18:48:39.805 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T18:48:39.807 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dfd58c46fa8e8c5-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.850 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.850 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.851 DEBUG:boto:path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.851 DEBUG:boto:auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.851 DEBUG:boto:Method: GET 2024-04-16T18:48:39.851 DEBUG:boto:Path: /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.851 DEBUG:boto:Data: 2024-04-16T18:48:39.851 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.851 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.851 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.851 DEBUG:boto:Params: {} 2024-04-16T18:48:39.851 DEBUG:boto:Token: None 2024-04-16T18:48:39.852 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.852 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T18:48:39.852 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T18:48:39.853 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005279200d526b8798-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.854 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.854 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.854 DEBUG:boto:path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.854 DEBUG:boto:auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.854 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.854 DEBUG:boto:Path: /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.854 DEBUG:boto:Data: 2024-04-16T18:48:39.854 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.855 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.855 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.855 DEBUG:boto:Params: {} 2024-04-16T18:48:39.855 DEBUG:boto:Token: None 2024-04-16T18:48:39.855 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.855 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc= 2024-04-16T18:48:39.855 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc=', 'Content-Length': '0'} 2024-04-16T18:48:39.857 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033910ee2228cab84-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.857 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.857 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.857 DEBUG:boto:path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.858 DEBUG:boto:auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.858 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.858 DEBUG:boto:Path: /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.858 DEBUG:boto:Data: 2024-04-16T18:48:39.858 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.858 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.858 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.858 DEBUG:boto:Params: {} 2024-04-16T18:48:39.858 DEBUG:boto:Token: None 2024-04-16T18:48:39.858 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.859 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc= 2024-04-16T18:48:39.859 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc=', 'Content-Length': '0'} 2024-04-16T18:48:39.860 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8633bf3f460f109-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:48:39.861 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.861 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.861 DEBUG:boto:path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.861 DEBUG:boto:auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.861 DEBUG:boto:Method: GET 2024-04-16T18:48:39.861 DEBUG:boto:Path: /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.861 DEBUG:boto:Data: 2024-04-16T18:48:39.862 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.862 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.862 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.862 DEBUG:boto:Params: {} 2024-04-16T18:48:39.862 DEBUG:boto:Token: None 2024-04-16T18:48:39.862 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.862 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T18:48:39.862 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T18:48:39.864 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ab7be2c1f6ecff4-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.906 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.907 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.907 DEBUG:boto:path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.907 DEBUG:boto:auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.907 DEBUG:boto:Method: GET 2024-04-16T18:48:39.907 DEBUG:boto:Path: /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.907 DEBUG:boto:Data: 2024-04-16T18:48:39.907 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.907 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.907 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.907 DEBUG:boto:Params: {} 2024-04-16T18:48:39.907 DEBUG:boto:Token: None 2024-04-16T18:48:39.908 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31?versionId=null 2024-04-16T18:48:39.908 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T18:48:39.908 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T18:48:39.910 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cf1c796f70852c3-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.910 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.910 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.910 DEBUG:boto:path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:39.910 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:39.910 DEBUG:boto:Method: GET 2024-04-16T18:48:39.910 DEBUG:boto:Path: /cjqttm-56/?prefix=obj31 2024-04-16T18:48:39.910 DEBUG:boto:Data: 2024-04-16T18:48:39.911 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.911 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.911 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.911 DEBUG:boto:Params: {} 2024-04-16T18:48:39.911 DEBUG:boto:Token: None 2024-04-16T18:48:39.911 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.911 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.911 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.914 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c9770c6c27ccd80-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.954 DEBUG:boto:b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.955 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:39.955 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:39.955 DEBUG:boto:path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:39.955 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:39.955 DEBUG:boto:Method: GET 2024-04-16T18:48:39.955 DEBUG:boto:Path: /cjqttm-56/?prefix=obj31 2024-04-16T18:48:39.955 DEBUG:boto:Data: 2024-04-16T18:48:39.955 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.955 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.956 DEBUG:boto:Params: {} 2024-04-16T18:48:39.956 DEBUG:boto:Token: None 2024-04-16T18:48:39.956 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/ 2024-04-16T18:48:39.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T18:48:39.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T18:48:39.959 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ccc5478024b8a87-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.960 DEBUG:boto:b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:39.960 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.960 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.960 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.960 DEBUG:boto:Path: /cjqttm-56/obj31 2024-04-16T18:48:39.960 DEBUG:boto:Data: 2024-04-16T18:48:39.960 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.960 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.960 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.961 DEBUG:boto:Params: {} 2024-04-16T18:48:39.961 DEBUG:boto:Token: None 2024-04-16T18:48:39.961 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31 2024-04-16T18:48:39.961 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs= 2024-04-16T18:48:39.961 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs=', 'Content-Length': '0'} 2024-04-16T18:48:39.963 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ee6403c816e4acd-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.963 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.963 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.963 DEBUG:boto:Method: HEAD 2024-04-16T18:48:39.963 DEBUG:boto:Path: /cjqttm-56/obj31 2024-04-16T18:48:39.963 DEBUG:boto:Data: 2024-04-16T18:48:39.964 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.964 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:39.964 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.964 DEBUG:boto:Params: {} 2024-04-16T18:48:39.964 DEBUG:boto:Token: None 2024-04-16T18:48:39.964 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31 2024-04-16T18:48:39.964 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs= 2024-04-16T18:48:39.964 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs=', 'Content-Length': '0'} 2024-04-16T18:48:39.966 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e095a8258074e75-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:39.966 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj31 2024-04-16T18:48:39.967 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:39.967 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:39.967 DEBUG:boto:Method: GET 2024-04-16T18:48:39.967 DEBUG:boto:Path: /cjqttm-56/obj31 2024-04-16T18:48:39.967 DEBUG:boto:Data: 2024-04-16T18:48:39.967 DEBUG:boto:Headers: {} 2024-04-16T18:48:39.967 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:39.967 DEBUG:boto:Port: 8000 2024-04-16T18:48:39.967 DEBUG:boto:Params: {} 2024-04-16T18:48:39.967 DEBUG:boto:Token: None 2024-04-16T18:48:39.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:39 GMT /cjqttm-56/obj31 2024-04-16T18:48:39.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DZP2lUQEiFjgMMra0kL7PQtDISs= 2024-04-16T18:48:39.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DZP2lUQEiFjgMMra0kL7PQtDISs=', 'Content-Length': '0'} 2024-04-16T18:48:39.970 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022d901571e6a8f30-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.010 DEBUG:boto:path=/cjqttm-56/obj31 2024-04-16T18:48:40.010 DEBUG:boto:auth_path=/cjqttm-56/obj31 2024-04-16T18:48:40.011 DEBUG:boto:Method: GET 2024-04-16T18:48:40.011 DEBUG:boto:Path: /cjqttm-56/obj31 2024-04-16T18:48:40.011 DEBUG:boto:Data: 2024-04-16T18:48:40.011 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.011 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.011 DEBUG:boto:Params: {} 2024-04-16T18:48:40.011 DEBUG:boto:Token: None 2024-04-16T18:48:40.011 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj31 2024-04-16T18:48:40.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:O0Sc4yB8f+UvQv5VbRJel6CoOhw= 2024-04-16T18:48:40.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O0Sc4yB8f+UvQv5VbRJel6CoOhw=', 'Content-Length': '0'} 2024-04-16T18:48:40.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080c11055832cc8d3-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.014 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.014 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.014 DEBUG:boto:path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:40.014 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:40.014 DEBUG:boto:Method: GET 2024-04-16T18:48:40.014 DEBUG:boto:Path: /cjqttm-56/?prefix=obj31 2024-04-16T18:48:40.014 DEBUG:boto:Data: 2024-04-16T18:48:40.014 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.014 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.015 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.015 DEBUG:boto:Params: {} 2024-04-16T18:48:40.015 DEBUG:boto:Token: None 2024-04-16T18:48:40.015 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.015 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.017 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002cd53e041460aa70-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.058 DEBUG:boto:b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.059 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.059 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.059 DEBUG:boto:path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:40.059 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T18:48:40.059 DEBUG:boto:Method: GET 2024-04-16T18:48:40.059 DEBUG:boto:Path: /cjqttm-56/?prefix=obj31 2024-04-16T18:48:40.059 DEBUG:boto:Data: 2024-04-16T18:48:40.059 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.059 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.059 DEBUG:boto:Params: {} 2024-04-16T18:48:40.060 DEBUG:boto:Token: None 2024-04-16T18:48:40.060 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.063 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b92f560c40ba1041-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.064 DEBUG:boto:b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.064 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:48:40.064 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.064 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.064 DEBUG:boto:path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.064 DEBUG:boto:auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.064 DEBUG:boto:Method: GET 2024-04-16T18:48:40.065 DEBUG:boto:Path: /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.065 DEBUG:boto:Data: 2024-04-16T18:48:40.065 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.065 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.065 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.065 DEBUG:boto:Params: {} 2024-04-16T18:48:40.065 DEBUG:boto:Token: None 2024-04-16T18:48:40.065 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.065 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T18:48:40.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T18:48:40.067 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000849320a59c3df09-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.110 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.110 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.111 DEBUG:boto:path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.111 DEBUG:boto:auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.111 DEBUG:boto:Method: GET 2024-04-16T18:48:40.111 DEBUG:boto:Path: /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.111 DEBUG:boto:Data: 2024-04-16T18:48:40.111 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.111 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.111 DEBUG:boto:Params: {} 2024-04-16T18:48:40.111 DEBUG:boto:Token: None 2024-04-16T18:48:40.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T18:48:40.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T18:48:40.114 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bec29eae3b77facd-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.114 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.114 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.115 DEBUG:boto:path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.115 DEBUG:boto:auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.115 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.115 DEBUG:boto:Path: /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.115 DEBUG:boto:Data: 2024-04-16T18:48:40.115 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.115 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.115 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.115 DEBUG:boto:Params: {} 2024-04-16T18:48:40.115 DEBUG:boto:Token: None 2024-04-16T18:48:40.115 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU= 2024-04-16T18:48:40.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU=', 'Content-Length': '0'} 2024-04-16T18:48:40.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093f5a29477355fbc-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.118 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.118 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.118 DEBUG:boto:path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.118 DEBUG:boto:auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.118 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.118 DEBUG:boto:Path: /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.118 DEBUG:boto:Data: 2024-04-16T18:48:40.118 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.119 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.119 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.119 DEBUG:boto:Params: {} 2024-04-16T18:48:40.119 DEBUG:boto:Token: None 2024-04-16T18:48:40.119 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.119 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU= 2024-04-16T18:48:40.119 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU=', 'Content-Length': '0'} 2024-04-16T18:48:40.121 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd2a54aa17932c22-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.121 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:48:40.121 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.121 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.121 DEBUG:boto:path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.121 DEBUG:boto:auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.122 DEBUG:boto:Method: GET 2024-04-16T18:48:40.122 DEBUG:boto:Path: /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.122 DEBUG:boto:Data: 2024-04-16T18:48:40.122 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.122 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.122 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.122 DEBUG:boto:Params: {} 2024-04-16T18:48:40.122 DEBUG:boto:Token: None 2024-04-16T18:48:40.122 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.122 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T18:48:40.122 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T18:48:40.124 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf99451df0afba1a-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.166 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.167 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.167 DEBUG:boto:path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.167 DEBUG:boto:auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.167 DEBUG:boto:Method: GET 2024-04-16T18:48:40.167 DEBUG:boto:Path: /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.167 DEBUG:boto:Data: 2024-04-16T18:48:40.167 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.167 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.167 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.167 DEBUG:boto:Params: {} 2024-04-16T18:48:40.168 DEBUG:boto:Token: None 2024-04-16T18:48:40.168 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33?versionId=null 2024-04-16T18:48:40.168 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T18:48:40.168 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T18:48:40.170 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003a9856e4e482133-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.170 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.171 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.171 DEBUG:boto:path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.171 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.171 DEBUG:boto:Method: GET 2024-04-16T18:48:40.171 DEBUG:boto:Path: /cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.171 DEBUG:boto:Data: 2024-04-16T18:48:40.171 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.171 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.171 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.171 DEBUG:boto:Params: {} 2024-04-16T18:48:40.171 DEBUG:boto:Token: None 2024-04-16T18:48:40.171 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.172 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.172 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.174 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000815194c1a0b6549f-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.218 DEBUG:boto:b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.219 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.219 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.219 DEBUG:boto:path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.219 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.219 DEBUG:boto:Method: GET 2024-04-16T18:48:40.219 DEBUG:boto:Path: /cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.219 DEBUG:boto:Data: 2024-04-16T18:48:40.219 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.219 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.219 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.219 DEBUG:boto:Params: {} 2024-04-16T18:48:40.220 DEBUG:boto:Token: None 2024-04-16T18:48:40.220 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.220 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.220 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.223 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000445e40d37e6c445c-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.223 DEBUG:boto:b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.224 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.224 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.224 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.224 DEBUG:boto:Path: /cjqttm-56/obj33 2024-04-16T18:48:40.224 DEBUG:boto:Data: 2024-04-16T18:48:40.224 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.224 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.224 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.224 DEBUG:boto:Params: {} 2024-04-16T18:48:40.224 DEBUG:boto:Token: None 2024-04-16T18:48:40.225 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33 2024-04-16T18:48:40.225 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4= 2024-04-16T18:48:40.225 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4=', 'Content-Length': '0'} 2024-04-16T18:48:40.227 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4e978f824669608-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.227 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.227 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.227 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.228 DEBUG:boto:Path: /cjqttm-56/obj33 2024-04-16T18:48:40.228 DEBUG:boto:Data: 2024-04-16T18:48:40.228 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.228 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.228 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.228 DEBUG:boto:Params: {} 2024-04-16T18:48:40.228 DEBUG:boto:Token: None 2024-04-16T18:48:40.228 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33 2024-04-16T18:48:40.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4= 2024-04-16T18:48:40.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4=', 'Content-Length': '0'} 2024-04-16T18:48:40.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd368397171b5f91-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.230 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:48:40.231 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.231 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.231 DEBUG:boto:Method: GET 2024-04-16T18:48:40.231 DEBUG:boto:Path: /cjqttm-56/obj33 2024-04-16T18:48:40.231 DEBUG:boto:Data: 2024-04-16T18:48:40.231 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.231 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.231 DEBUG:boto:Params: {} 2024-04-16T18:48:40.231 DEBUG:boto:Token: None 2024-04-16T18:48:40.231 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33 2024-04-16T18:48:40.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY= 2024-04-16T18:48:40.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY=', 'Content-Length': '0'} 2024-04-16T18:48:40.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c2d52f5568dfa04-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.274 DEBUG:boto:path=/cjqttm-56/obj33 2024-04-16T18:48:40.275 DEBUG:boto:auth_path=/cjqttm-56/obj33 2024-04-16T18:48:40.275 DEBUG:boto:Method: GET 2024-04-16T18:48:40.275 DEBUG:boto:Path: /cjqttm-56/obj33 2024-04-16T18:48:40.275 DEBUG:boto:Data: 2024-04-16T18:48:40.275 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.275 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.275 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.275 DEBUG:boto:Params: {} 2024-04-16T18:48:40.275 DEBUG:boto:Token: None 2024-04-16T18:48:40.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj33 2024-04-16T18:48:40.276 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY= 2024-04-16T18:48:40.276 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY=', 'Content-Length': '0'} 2024-04-16T18:48:40.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dabf341212edb411-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.278 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.278 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.278 DEBUG:boto:path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.278 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.278 DEBUG:boto:Method: GET 2024-04-16T18:48:40.278 DEBUG:boto:Path: /cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.278 DEBUG:boto:Data: 2024-04-16T18:48:40.278 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.279 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.279 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.279 DEBUG:boto:Params: {} 2024-04-16T18:48:40.279 DEBUG:boto:Token: None 2024-04-16T18:48:40.279 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.279 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.282 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c8297bf5168a3d0-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.322 DEBUG:boto:b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.323 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.323 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.323 DEBUG:boto:path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.323 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.323 DEBUG:boto:Method: GET 2024-04-16T18:48:40.323 DEBUG:boto:Path: /cjqttm-56/?prefix=obj33 2024-04-16T18:48:40.323 DEBUG:boto:Data: 2024-04-16T18:48:40.323 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.323 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.323 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.323 DEBUG:boto:Params: {} 2024-04-16T18:48:40.324 DEBUG:boto:Token: None 2024-04-16T18:48:40.324 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.324 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.324 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.327 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016d2cf6e7915da80-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.327 DEBUG:boto:b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.327 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:48:40.328 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.328 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.328 DEBUG:boto:path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.328 DEBUG:boto:auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.328 DEBUG:boto:Method: GET 2024-04-16T18:48:40.328 DEBUG:boto:Path: /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.328 DEBUG:boto:Data: 2024-04-16T18:48:40.328 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.328 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.328 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.328 DEBUG:boto:Params: {} 2024-04-16T18:48:40.329 DEBUG:boto:Token: None 2024-04-16T18:48:40.329 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.329 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T18:48:40.329 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T18:48:40.331 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d67e24388d02ce55-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.374 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.374 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.375 DEBUG:boto:path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.375 DEBUG:boto:auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.375 DEBUG:boto:Method: GET 2024-04-16T18:48:40.375 DEBUG:boto:Path: /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.375 DEBUG:boto:Data: 2024-04-16T18:48:40.375 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.375 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.375 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.375 DEBUG:boto:Params: {} 2024-04-16T18:48:40.375 DEBUG:boto:Token: None 2024-04-16T18:48:40.376 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.376 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T18:48:40.376 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T18:48:40.378 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b964f5afc0eae03b-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.378 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.378 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.379 DEBUG:boto:path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.379 DEBUG:boto:auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.379 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.379 DEBUG:boto:Path: /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.379 DEBUG:boto:Data: 2024-04-16T18:48:40.379 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.379 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.379 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.379 DEBUG:boto:Params: {} 2024-04-16T18:48:40.379 DEBUG:boto:Token: None 2024-04-16T18:48:40.380 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8= 2024-04-16T18:48:40.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8=', 'Content-Length': '0'} 2024-04-16T18:48:40.382 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6bb8e248bf730cc-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.382 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.382 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.383 DEBUG:boto:path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.383 DEBUG:boto:auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.383 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.383 DEBUG:boto:Path: /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.383 DEBUG:boto:Data: 2024-04-16T18:48:40.383 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.383 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.383 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.383 DEBUG:boto:Params: {} 2024-04-16T18:48:40.383 DEBUG:boto:Token: None 2024-04-16T18:48:40.383 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.384 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8= 2024-04-16T18:48:40.384 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8=', 'Content-Length': '0'} 2024-04-16T18:48:40.386 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b8a7bc8d3600100-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.386 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:48:40.386 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.386 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.386 DEBUG:boto:path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.386 DEBUG:boto:auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.387 DEBUG:boto:Method: GET 2024-04-16T18:48:40.387 DEBUG:boto:Path: /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.387 DEBUG:boto:Data: 2024-04-16T18:48:40.387 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.387 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.387 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.387 DEBUG:boto:Params: {} 2024-04-16T18:48:40.387 DEBUG:boto:Token: None 2024-04-16T18:48:40.387 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.387 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T18:48:40.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T18:48:40.389 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006bc6f03df472a11-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.430 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.430 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.431 DEBUG:boto:path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.431 DEBUG:boto:auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.431 DEBUG:boto:Method: GET 2024-04-16T18:48:40.431 DEBUG:boto:Path: /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.431 DEBUG:boto:Data: 2024-04-16T18:48:40.431 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.431 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.431 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.431 DEBUG:boto:Params: {} 2024-04-16T18:48:40.431 DEBUG:boto:Token: None 2024-04-16T18:48:40.432 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34?versionId=null 2024-04-16T18:48:40.432 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T18:48:40.432 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T18:48:40.434 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000477fb57604c7260b-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.434 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.434 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.434 DEBUG:boto:path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.434 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.435 DEBUG:boto:Method: GET 2024-04-16T18:48:40.435 DEBUG:boto:Path: /cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.435 DEBUG:boto:Data: 2024-04-16T18:48:40.435 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.435 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.435 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.435 DEBUG:boto:Params: {} 2024-04-16T18:48:40.435 DEBUG:boto:Token: None 2024-04-16T18:48:40.435 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.435 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.438 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e52b425f618dbeb-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.478 DEBUG:boto:b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.479 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.479 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.479 DEBUG:boto:path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.479 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.479 DEBUG:boto:Method: GET 2024-04-16T18:48:40.479 DEBUG:boto:Path: /cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.479 DEBUG:boto:Data: 2024-04-16T18:48:40.479 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.479 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.479 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.479 DEBUG:boto:Params: {} 2024-04-16T18:48:40.480 DEBUG:boto:Token: None 2024-04-16T18:48:40.480 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.480 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.480 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.483 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075363831206f11a2-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.483 DEBUG:boto:b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.484 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.484 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.484 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.484 DEBUG:boto:Path: /cjqttm-56/obj34 2024-04-16T18:48:40.484 DEBUG:boto:Data: 2024-04-16T18:48:40.484 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.484 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.484 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.484 DEBUG:boto:Params: {} 2024-04-16T18:48:40.484 DEBUG:boto:Token: None 2024-04-16T18:48:40.485 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34 2024-04-16T18:48:40.485 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g= 2024-04-16T18:48:40.485 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g=', 'Content-Length': '0'} 2024-04-16T18:48:40.487 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8b2eef8740507f9-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.487 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.487 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.487 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.487 DEBUG:boto:Path: /cjqttm-56/obj34 2024-04-16T18:48:40.487 DEBUG:boto:Data: 2024-04-16T18:48:40.487 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.487 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.488 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.488 DEBUG:boto:Params: {} 2024-04-16T18:48:40.488 DEBUG:boto:Token: None 2024-04-16T18:48:40.488 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34 2024-04-16T18:48:40.488 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g= 2024-04-16T18:48:40.488 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g=', 'Content-Length': '0'} 2024-04-16T18:48:40.490 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bffe6ebab238852e-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.490 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj34 2024-04-16T18:48:40.490 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.490 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.490 DEBUG:boto:Method: GET 2024-04-16T18:48:40.491 DEBUG:boto:Path: /cjqttm-56/obj34 2024-04-16T18:48:40.491 DEBUG:boto:Data: 2024-04-16T18:48:40.491 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.491 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.491 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.491 DEBUG:boto:Params: {} 2024-04-16T18:48:40.491 DEBUG:boto:Token: None 2024-04-16T18:48:40.491 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34 2024-04-16T18:48:40.491 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4= 2024-04-16T18:48:40.491 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4=', 'Content-Length': '0'} 2024-04-16T18:48:40.493 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b92414cafb36051-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.534 DEBUG:boto:path=/cjqttm-56/obj34 2024-04-16T18:48:40.534 DEBUG:boto:auth_path=/cjqttm-56/obj34 2024-04-16T18:48:40.535 DEBUG:boto:Method: GET 2024-04-16T18:48:40.535 DEBUG:boto:Path: /cjqttm-56/obj34 2024-04-16T18:48:40.535 DEBUG:boto:Data: 2024-04-16T18:48:40.535 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.535 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.535 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.535 DEBUG:boto:Params: {} 2024-04-16T18:48:40.535 DEBUG:boto:Token: None 2024-04-16T18:48:40.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj34 2024-04-16T18:48:40.536 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4= 2024-04-16T18:48:40.536 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4=', 'Content-Length': '0'} 2024-04-16T18:48:40.538 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049013b57bbba3f45-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.538 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.538 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.538 DEBUG:boto:path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.538 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.538 DEBUG:boto:Method: GET 2024-04-16T18:48:40.539 DEBUG:boto:Path: /cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.539 DEBUG:boto:Data: 2024-04-16T18:48:40.539 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.539 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.539 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.539 DEBUG:boto:Params: {} 2024-04-16T18:48:40.539 DEBUG:boto:Token: None 2024-04-16T18:48:40.539 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.542 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024c3f016647f515d-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.582 DEBUG:boto:b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.583 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.583 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.583 DEBUG:boto:path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.583 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.583 DEBUG:boto:Method: GET 2024-04-16T18:48:40.583 DEBUG:boto:Path: /cjqttm-56/?prefix=obj34 2024-04-16T18:48:40.583 DEBUG:boto:Data: 2024-04-16T18:48:40.583 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.583 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.583 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.584 DEBUG:boto:Params: {} 2024-04-16T18:48:40.584 DEBUG:boto:Token: None 2024-04-16T18:48:40.584 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.584 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.584 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.587 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000834b320b6e5a6a64-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.588 DEBUG:boto:b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:48:40.588 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.588 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.588 DEBUG:boto:path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.588 DEBUG:boto:auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.588 DEBUG:boto:Method: GET 2024-04-16T18:48:40.589 DEBUG:boto:Path: /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.589 DEBUG:boto:Data: 2024-04-16T18:48:40.589 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.589 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.589 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.589 DEBUG:boto:Params: {} 2024-04-16T18:48:40.589 DEBUG:boto:Token: None 2024-04-16T18:48:40.589 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.589 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T18:48:40.589 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T18:48:40.591 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a14d443f2a5ed1f-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.634 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.635 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.635 DEBUG:boto:path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.635 DEBUG:boto:auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.635 DEBUG:boto:Method: GET 2024-04-16T18:48:40.635 DEBUG:boto:Path: /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.635 DEBUG:boto:Data: 2024-04-16T18:48:40.635 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.635 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.635 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.635 DEBUG:boto:Params: {} 2024-04-16T18:48:40.635 DEBUG:boto:Token: None 2024-04-16T18:48:40.636 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.636 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T18:48:40.636 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T18:48:40.638 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dc75d6f00722576-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.638 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.638 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.638 DEBUG:boto:path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.638 DEBUG:boto:auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.639 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.639 DEBUG:boto:Path: /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.639 DEBUG:boto:Data: 2024-04-16T18:48:40.639 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.639 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.639 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.639 DEBUG:boto:Params: {} 2024-04-16T18:48:40.639 DEBUG:boto:Token: None 2024-04-16T18:48:40.639 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.639 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk= 2024-04-16T18:48:40.640 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk=', 'Content-Length': '0'} 2024-04-16T18:48:40.641 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030f84b15b6326a3d-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.642 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.642 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.642 DEBUG:boto:path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.642 DEBUG:boto:auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.642 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.642 DEBUG:boto:Path: /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.642 DEBUG:boto:Data: 2024-04-16T18:48:40.642 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.642 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.642 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.642 DEBUG:boto:Params: {} 2024-04-16T18:48:40.643 DEBUG:boto:Token: None 2024-04-16T18:48:40.643 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.643 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk= 2024-04-16T18:48:40.643 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk=', 'Content-Length': '0'} 2024-04-16T18:48:40.645 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bc98940897dfbe2-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.646 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:48:40.646 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.646 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.646 DEBUG:boto:path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.646 DEBUG:boto:auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.646 DEBUG:boto:Method: GET 2024-04-16T18:48:40.646 DEBUG:boto:Path: /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.646 DEBUG:boto:Data: 2024-04-16T18:48:40.646 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.646 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.647 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.647 DEBUG:boto:Params: {} 2024-04-16T18:48:40.647 DEBUG:boto:Token: None 2024-04-16T18:48:40.647 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.647 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T18:48:40.647 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T18:48:40.649 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000800057e2ad149dcf-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.690 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.691 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.691 DEBUG:boto:path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.691 DEBUG:boto:auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.691 DEBUG:boto:Method: GET 2024-04-16T18:48:40.691 DEBUG:boto:Path: /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.691 DEBUG:boto:Data: 2024-04-16T18:48:40.691 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.691 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.691 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.691 DEBUG:boto:Params: {} 2024-04-16T18:48:40.692 DEBUG:boto:Token: None 2024-04-16T18:48:40.692 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37?versionId=null 2024-04-16T18:48:40.692 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T18:48:40.692 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T18:48:40.694 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf489791708e15f4-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.694 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.694 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.695 DEBUG:boto:path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.695 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.695 DEBUG:boto:Method: GET 2024-04-16T18:48:40.695 DEBUG:boto:Path: /cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.695 DEBUG:boto:Data: 2024-04-16T18:48:40.695 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.695 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.695 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.695 DEBUG:boto:Params: {} 2024-04-16T18:48:40.695 DEBUG:boto:Token: None 2024-04-16T18:48:40.696 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.696 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.696 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.698 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007654050432dc826b-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.738 DEBUG:boto:b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.739 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.739 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.739 DEBUG:boto:path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.739 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.739 DEBUG:boto:Method: GET 2024-04-16T18:48:40.740 DEBUG:boto:Path: /cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.740 DEBUG:boto:Data: 2024-04-16T18:48:40.740 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.740 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.740 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.740 DEBUG:boto:Params: {} 2024-04-16T18:48:40.740 DEBUG:boto:Token: None 2024-04-16T18:48:40.740 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.744 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f6ce1e62d13568c-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.744 DEBUG:boto:b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.744 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.745 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.745 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.745 DEBUG:boto:Path: /cjqttm-56/obj37 2024-04-16T18:48:40.745 DEBUG:boto:Data: 2024-04-16T18:48:40.745 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.745 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.745 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.745 DEBUG:boto:Params: {} 2024-04-16T18:48:40.745 DEBUG:boto:Token: None 2024-04-16T18:48:40.745 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37 2024-04-16T18:48:40.745 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo= 2024-04-16T18:48:40.746 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo=', 'Content-Length': '0'} 2024-04-16T18:48:40.748 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000df913867efdc85c-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.748 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.748 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.748 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.748 DEBUG:boto:Path: /cjqttm-56/obj37 2024-04-16T18:48:40.748 DEBUG:boto:Data: 2024-04-16T18:48:40.748 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.748 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.749 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.749 DEBUG:boto:Params: {} 2024-04-16T18:48:40.749 DEBUG:boto:Token: None 2024-04-16T18:48:40.749 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37 2024-04-16T18:48:40.749 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo= 2024-04-16T18:48:40.749 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo=', 'Content-Length': '0'} 2024-04-16T18:48:40.751 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f3fdc45162f596c-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.751 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj37 2024-04-16T18:48:40.751 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.751 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.751 DEBUG:boto:Method: GET 2024-04-16T18:48:40.752 DEBUG:boto:Path: /cjqttm-56/obj37 2024-04-16T18:48:40.752 DEBUG:boto:Data: 2024-04-16T18:48:40.752 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.752 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.752 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.752 DEBUG:boto:Params: {} 2024-04-16T18:48:40.752 DEBUG:boto:Token: None 2024-04-16T18:48:40.752 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37 2024-04-16T18:48:40.752 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI= 2024-04-16T18:48:40.752 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI=', 'Content-Length': '0'} 2024-04-16T18:48:40.754 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db7ab101ba0ea232-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.798 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:40.798 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:40.799 DEBUG:boto:Method: GET 2024-04-16T18:48:40.799 DEBUG:boto:Path: /cjqttm-56/obj37 2024-04-16T18:48:40.799 DEBUG:boto:Data: 2024-04-16T18:48:40.799 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.799 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.799 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.799 DEBUG:boto:Params: {} 2024-04-16T18:48:40.799 DEBUG:boto:Token: None 2024-04-16T18:48:40.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj37 2024-04-16T18:48:40.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI= 2024-04-16T18:48:40.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI=', 'Content-Length': '0'} 2024-04-16T18:48:40.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdc1ff319fae30e1-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.802 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.802 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.802 DEBUG:boto:path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.802 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.802 DEBUG:boto:Method: GET 2024-04-16T18:48:40.802 DEBUG:boto:Path: /cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.802 DEBUG:boto:Data: 2024-04-16T18:48:40.802 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.802 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.802 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.802 DEBUG:boto:Params: {} 2024-04-16T18:48:40.803 DEBUG:boto:Token: None 2024-04-16T18:48:40.803 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.803 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.803 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.805 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000598543cd1238e2ad-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.846 DEBUG:boto:b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.847 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.847 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.847 DEBUG:boto:path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.847 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.847 DEBUG:boto:Method: GET 2024-04-16T18:48:40.847 DEBUG:boto:Path: /cjqttm-56/?prefix=obj37 2024-04-16T18:48:40.847 DEBUG:boto:Data: 2024-04-16T18:48:40.848 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.848 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.848 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.848 DEBUG:boto:Params: {} 2024-04-16T18:48:40.848 DEBUG:boto:Token: None 2024-04-16T18:48:40.848 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.848 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.848 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.852 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2107a742770297d-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.852 DEBUG:boto:b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:40.853 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:48:40.853 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:40.853 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:40.853 DEBUG:boto:path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.853 DEBUG:boto:auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.853 DEBUG:boto:Method: GET 2024-04-16T18:48:40.853 DEBUG:boto:Path: /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.853 DEBUG:boto:Data: 2024-04-16T18:48:40.853 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.853 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.853 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.854 DEBUG:boto:Params: {} 2024-04-16T18:48:40.854 DEBUG:boto:Token: None 2024-04-16T18:48:40.854 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.854 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T18:48:40.854 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T18:48:40.856 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa521af35f8a37c9-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.898 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:40.898 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:40.899 DEBUG:boto:path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.899 DEBUG:boto:auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.899 DEBUG:boto:Method: GET 2024-04-16T18:48:40.899 DEBUG:boto:Path: /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.899 DEBUG:boto:Data: 2024-04-16T18:48:40.899 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.899 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.899 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.899 DEBUG:boto:Params: {} 2024-04-16T18:48:40.899 DEBUG:boto:Token: None 2024-04-16T18:48:40.899 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.900 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T18:48:40.900 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T18:48:40.902 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2c7ea869acff6a9-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.902 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:40.902 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:40.902 DEBUG:boto:path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.902 DEBUG:boto:auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.902 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.902 DEBUG:boto:Path: /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.902 DEBUG:boto:Data: 2024-04-16T18:48:40.903 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.903 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.903 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.903 DEBUG:boto:Params: {} 2024-04-16T18:48:40.903 DEBUG:boto:Token: None 2024-04-16T18:48:40.903 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.903 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg= 2024-04-16T18:48:40.903 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg=', 'Content-Length': '0'} 2024-04-16T18:48:40.905 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c9fe58958af7e52-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.906 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:40.906 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:40.906 DEBUG:boto:path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.906 DEBUG:boto:auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.906 DEBUG:boto:Method: HEAD 2024-04-16T18:48:40.906 DEBUG:boto:Path: /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.906 DEBUG:boto:Data: 2024-04-16T18:48:40.906 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.906 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.906 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.907 DEBUG:boto:Params: {} 2024-04-16T18:48:40.907 DEBUG:boto:Token: None 2024-04-16T18:48:40.907 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.907 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg= 2024-04-16T18:48:40.907 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg=', 'Content-Length': '0'} 2024-04-16T18:48:40.909 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a1b0c26c30982a4-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.909 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:48:40.909 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:40.909 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:40.909 DEBUG:boto:path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.909 DEBUG:boto:auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.909 DEBUG:boto:Method: GET 2024-04-16T18:48:40.909 DEBUG:boto:Path: /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.910 DEBUG:boto:Data: 2024-04-16T18:48:40.910 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.910 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.910 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.910 DEBUG:boto:Params: {} 2024-04-16T18:48:40.910 DEBUG:boto:Token: None 2024-04-16T18:48:40.910 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.910 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T18:48:40.910 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T18:48:40.912 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f5becf4bad4500c-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.954 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:40.954 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:40.955 DEBUG:boto:path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.955 DEBUG:boto:auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.955 DEBUG:boto:Method: GET 2024-04-16T18:48:40.955 DEBUG:boto:Path: /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.955 DEBUG:boto:Data: 2024-04-16T18:48:40.955 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.955 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:40.955 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.955 DEBUG:boto:Params: {} 2024-04-16T18:48:40.955 DEBUG:boto:Token: None 2024-04-16T18:48:40.955 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/obj38?versionId=null 2024-04-16T18:48:40.956 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T18:48:40.956 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T18:48:40.957 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ba4ee77a3b5172a-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:40.958 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:40.958 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:40.958 DEBUG:boto:path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:40.958 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:40.958 DEBUG:boto:Method: GET 2024-04-16T18:48:40.958 DEBUG:boto:Path: /cjqttm-56/?prefix=obj38 2024-04-16T18:48:40.958 DEBUG:boto:Data: 2024-04-16T18:48:40.959 DEBUG:boto:Headers: {} 2024-04-16T18:48:40.959 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:40.959 DEBUG:boto:Port: 8000 2024-04-16T18:48:40.959 DEBUG:boto:Params: {} 2024-04-16T18:48:40.959 DEBUG:boto:Token: None 2024-04-16T18:48:40.959 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:40 GMT /cjqttm-56/ 2024-04-16T18:48:40.959 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T18:48:40.959 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T18:48:40.962 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003e094800ae8b2a0-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.002 DEBUG:boto:b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.003 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.003 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.003 DEBUG:boto:path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.003 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.003 DEBUG:boto:Method: GET 2024-04-16T18:48:41.003 DEBUG:boto:Path: /cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.003 DEBUG:boto:Data: 2024-04-16T18:48:41.003 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.003 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.003 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.003 DEBUG:boto:Params: {} 2024-04-16T18:48:41.004 DEBUG:boto:Token: None 2024-04-16T18:48:41.004 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.004 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.004 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.007 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df5da3267b91523b-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.007 DEBUG:boto:b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.008 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:41.008 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:41.008 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.008 DEBUG:boto:Path: /cjqttm-56/obj38 2024-04-16T18:48:41.008 DEBUG:boto:Data: 2024-04-16T18:48:41.008 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.008 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.008 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.008 DEBUG:boto:Params: {} 2024-04-16T18:48:41.008 DEBUG:boto:Token: None 2024-04-16T18:48:41.009 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj38 2024-04-16T18:48:41.009 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg= 2024-04-16T18:48:41.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg=', 'Content-Length': '0'} 2024-04-16T18:48:41.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e13262c0e11cc645-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.011 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:41.011 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:41.011 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.011 DEBUG:boto:Path: /cjqttm-56/obj38 2024-04-16T18:48:41.011 DEBUG:boto:Data: 2024-04-16T18:48:41.011 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.011 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.012 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.012 DEBUG:boto:Params: {} 2024-04-16T18:48:41.012 DEBUG:boto:Token: None 2024-04-16T18:48:41.012 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj38 2024-04-16T18:48:41.012 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg= 2024-04-16T18:48:41.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg=', 'Content-Length': '0'} 2024-04-16T18:48:41.014 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024f98ddf63bcc8ae-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj38 2024-04-16T18:48:41.014 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:41.014 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:41.014 DEBUG:boto:Method: GET 2024-04-16T18:48:41.014 DEBUG:boto:Path: /cjqttm-56/obj38 2024-04-16T18:48:41.014 DEBUG:boto:Data: 2024-04-16T18:48:41.014 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.015 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.015 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.015 DEBUG:boto:Params: {} 2024-04-16T18:48:41.015 DEBUG:boto:Token: None 2024-04-16T18:48:41.015 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj38 2024-04-16T18:48:41.015 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44= 2024-04-16T18:48:41.015 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44=', 'Content-Length': '0'} 2024-04-16T18:48:41.017 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019bbf93d20e0e053-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.058 DEBUG:boto:path=/cjqttm-56/obj38 2024-04-16T18:48:41.059 DEBUG:boto:auth_path=/cjqttm-56/obj38 2024-04-16T18:48:41.059 DEBUG:boto:Method: GET 2024-04-16T18:48:41.059 DEBUG:boto:Path: /cjqttm-56/obj38 2024-04-16T18:48:41.059 DEBUG:boto:Data: 2024-04-16T18:48:41.059 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.059 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.059 DEBUG:boto:Params: {} 2024-04-16T18:48:41.059 DEBUG:boto:Token: None 2024-04-16T18:48:41.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj38 2024-04-16T18:48:41.060 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44= 2024-04-16T18:48:41.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44=', 'Content-Length': '0'} 2024-04-16T18:48:41.061 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098717e21245c0218-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.062 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.062 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.062 DEBUG:boto:path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.062 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.062 DEBUG:boto:Method: GET 2024-04-16T18:48:41.062 DEBUG:boto:Path: /cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.062 DEBUG:boto:Data: 2024-04-16T18:48:41.062 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.063 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.063 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.063 DEBUG:boto:Params: {} 2024-04-16T18:48:41.063 DEBUG:boto:Token: None 2024-04-16T18:48:41.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.065 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dde3e6d4c3032ca9-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.106 DEBUG:boto:b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.107 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.107 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.107 DEBUG:boto:path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.107 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.107 DEBUG:boto:Method: GET 2024-04-16T18:48:41.107 DEBUG:boto:Path: /cjqttm-56/?prefix=obj38 2024-04-16T18:48:41.107 DEBUG:boto:Data: 2024-04-16T18:48:41.107 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.107 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.107 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.107 DEBUG:boto:Params: {} 2024-04-16T18:48:41.108 DEBUG:boto:Token: None 2024-04-16T18:48:41.108 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.108 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.108 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.112 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000446c8388ceae2bbc-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.112 DEBUG:boto:b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.112 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:48:41.112 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.112 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.112 DEBUG:boto:path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.112 DEBUG:boto:auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.112 DEBUG:boto:Method: GET 2024-04-16T18:48:41.113 DEBUG:boto:Path: /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.113 DEBUG:boto:Data: 2024-04-16T18:48:41.113 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.113 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.113 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.113 DEBUG:boto:Params: {} 2024-04-16T18:48:41.113 DEBUG:boto:Token: None 2024-04-16T18:48:41.113 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.113 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T18:48:41.114 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T18:48:41.115 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000293a60f34a7d0cd3-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.158 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.158 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.159 DEBUG:boto:path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.159 DEBUG:boto:auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.159 DEBUG:boto:Method: GET 2024-04-16T18:48:41.159 DEBUG:boto:Path: /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.159 DEBUG:boto:Data: 2024-04-16T18:48:41.159 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.159 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.159 DEBUG:boto:Params: {} 2024-04-16T18:48:41.159 DEBUG:boto:Token: None 2024-04-16T18:48:41.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T18:48:41.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T18:48:41.162 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfde078f340fc20a-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.162 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.162 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.162 DEBUG:boto:path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.162 DEBUG:boto:auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.162 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.163 DEBUG:boto:Path: /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.163 DEBUG:boto:Data: 2024-04-16T18:48:41.163 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.163 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.163 DEBUG:boto:Params: {} 2024-04-16T18:48:41.163 DEBUG:boto:Token: None 2024-04-16T18:48:41.163 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc= 2024-04-16T18:48:41.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc=', 'Content-Length': '0'} 2024-04-16T18:48:41.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012b61e421a20d9eb-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.165 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.165 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.166 DEBUG:boto:path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.166 DEBUG:boto:auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.166 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.166 DEBUG:boto:Path: /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.166 DEBUG:boto:Data: 2024-04-16T18:48:41.166 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.166 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.166 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.166 DEBUG:boto:Params: {} 2024-04-16T18:48:41.166 DEBUG:boto:Token: None 2024-04-16T18:48:41.167 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.167 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc= 2024-04-16T18:48:41.167 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc=', 'Content-Length': '0'} 2024-04-16T18:48:41.169 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fedeea4fbe5cd18-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.169 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:48:41.169 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.169 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.169 DEBUG:boto:path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.169 DEBUG:boto:auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.169 DEBUG:boto:Method: GET 2024-04-16T18:48:41.169 DEBUG:boto:Path: /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.169 DEBUG:boto:Data: 2024-04-16T18:48:41.170 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.170 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.170 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.170 DEBUG:boto:Params: {} 2024-04-16T18:48:41.170 DEBUG:boto:Token: None 2024-04-16T18:48:41.170 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T18:48:41.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T18:48:41.172 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd0d50b2b6285ff9-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.214 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.214 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.215 DEBUG:boto:path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.215 DEBUG:boto:auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.215 DEBUG:boto:Method: GET 2024-04-16T18:48:41.215 DEBUG:boto:Path: /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.215 DEBUG:boto:Data: 2024-04-16T18:48:41.215 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.215 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.215 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.215 DEBUG:boto:Params: {} 2024-04-16T18:48:41.215 DEBUG:boto:Token: None 2024-04-16T18:48:41.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44?versionId=null 2024-04-16T18:48:41.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T18:48:41.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T18:48:41.217 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000149780c37aaf99c8-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.218 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.218 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.218 DEBUG:boto:path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.218 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.218 DEBUG:boto:Method: GET 2024-04-16T18:48:41.218 DEBUG:boto:Path: /cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.218 DEBUG:boto:Data: 2024-04-16T18:48:41.218 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.218 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.219 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.219 DEBUG:boto:Params: {} 2024-04-16T18:48:41.219 DEBUG:boto:Token: None 2024-04-16T18:48:41.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e3c3711ed967174-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.262 DEBUG:boto:b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.263 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.263 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.263 DEBUG:boto:path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.263 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.263 DEBUG:boto:Method: GET 2024-04-16T18:48:41.263 DEBUG:boto:Path: /cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.263 DEBUG:boto:Data: 2024-04-16T18:48:41.263 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.263 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.263 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.263 DEBUG:boto:Params: {} 2024-04-16T18:48:41.264 DEBUG:boto:Token: None 2024-04-16T18:48:41.264 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.264 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.264 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.267 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f21b098851b5656e-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.268 DEBUG:boto:b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.268 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.268 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.268 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.268 DEBUG:boto:Path: /cjqttm-56/obj44 2024-04-16T18:48:41.268 DEBUG:boto:Data: 2024-04-16T18:48:41.268 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.268 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.268 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.269 DEBUG:boto:Params: {} 2024-04-16T18:48:41.269 DEBUG:boto:Token: None 2024-04-16T18:48:41.269 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44 2024-04-16T18:48:41.269 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0= 2024-04-16T18:48:41.269 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0=', 'Content-Length': '0'} 2024-04-16T18:48:41.271 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc494762ecb919f0-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.271 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.271 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.271 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.271 DEBUG:boto:Path: /cjqttm-56/obj44 2024-04-16T18:48:41.271 DEBUG:boto:Data: 2024-04-16T18:48:41.271 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.272 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.272 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.272 DEBUG:boto:Params: {} 2024-04-16T18:48:41.272 DEBUG:boto:Token: None 2024-04-16T18:48:41.272 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44 2024-04-16T18:48:41.272 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0= 2024-04-16T18:48:41.272 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0=', 'Content-Length': '0'} 2024-04-16T18:48:41.274 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000666122fcccfd03be-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.274 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:48:41.274 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.274 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.275 DEBUG:boto:Method: GET 2024-04-16T18:48:41.275 DEBUG:boto:Path: /cjqttm-56/obj44 2024-04-16T18:48:41.275 DEBUG:boto:Data: 2024-04-16T18:48:41.275 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.275 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.275 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.275 DEBUG:boto:Params: {} 2024-04-16T18:48:41.275 DEBUG:boto:Token: None 2024-04-16T18:48:41.275 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44 2024-04-16T18:48:41.275 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4= 2024-04-16T18:48:41.275 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4=', 'Content-Length': '0'} 2024-04-16T18:48:41.277 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003097294665d1b704-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.318 DEBUG:boto:path=/cjqttm-56/obj44 2024-04-16T18:48:41.318 DEBUG:boto:auth_path=/cjqttm-56/obj44 2024-04-16T18:48:41.319 DEBUG:boto:Method: GET 2024-04-16T18:48:41.319 DEBUG:boto:Path: /cjqttm-56/obj44 2024-04-16T18:48:41.319 DEBUG:boto:Data: 2024-04-16T18:48:41.319 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.319 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.319 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.319 DEBUG:boto:Params: {} 2024-04-16T18:48:41.319 DEBUG:boto:Token: None 2024-04-16T18:48:41.319 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj44 2024-04-16T18:48:41.319 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4= 2024-04-16T18:48:41.320 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4=', 'Content-Length': '0'} 2024-04-16T18:48:41.321 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e156a0cc776c645-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.322 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.322 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.322 DEBUG:boto:path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.322 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.322 DEBUG:boto:Method: GET 2024-04-16T18:48:41.322 DEBUG:boto:Path: /cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.322 DEBUG:boto:Data: 2024-04-16T18:48:41.322 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.322 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.322 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.322 DEBUG:boto:Params: {} 2024-04-16T18:48:41.323 DEBUG:boto:Token: None 2024-04-16T18:48:41.323 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.323 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.323 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.325 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e066443132788179-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.366 DEBUG:boto:b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.367 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.367 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.367 DEBUG:boto:path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.367 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.367 DEBUG:boto:Method: GET 2024-04-16T18:48:41.367 DEBUG:boto:Path: /cjqttm-56/?prefix=obj44 2024-04-16T18:48:41.367 DEBUG:boto:Data: 2024-04-16T18:48:41.367 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.367 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.367 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.367 DEBUG:boto:Params: {} 2024-04-16T18:48:41.367 DEBUG:boto:Token: None 2024-04-16T18:48:41.368 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.368 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.368 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.371 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c28362f4f5a1102e-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.371 DEBUG:boto:b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.372 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:48:41.372 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.372 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.372 DEBUG:boto:path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.372 DEBUG:boto:auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.372 DEBUG:boto:Method: GET 2024-04-16T18:48:41.372 DEBUG:boto:Path: /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.372 DEBUG:boto:Data: 2024-04-16T18:48:41.372 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.372 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.372 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.373 DEBUG:boto:Params: {} 2024-04-16T18:48:41.373 DEBUG:boto:Token: None 2024-04-16T18:48:41.373 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.373 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T18:48:41.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T18:48:41.375 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f16837101c53333-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.418 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.418 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.419 DEBUG:boto:path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.419 DEBUG:boto:auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.419 DEBUG:boto:Method: GET 2024-04-16T18:48:41.419 DEBUG:boto:Path: /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.419 DEBUG:boto:Data: 2024-04-16T18:48:41.419 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.419 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.419 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.419 DEBUG:boto:Params: {} 2024-04-16T18:48:41.419 DEBUG:boto:Token: None 2024-04-16T18:48:41.419 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.420 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T18:48:41.420 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T18:48:41.422 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db33158c00ce4fcc-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.422 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.422 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.422 DEBUG:boto:path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.422 DEBUG:boto:auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.422 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.422 DEBUG:boto:Path: /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.423 DEBUG:boto:Data: 2024-04-16T18:48:41.423 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.423 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.423 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.423 DEBUG:boto:Params: {} 2024-04-16T18:48:41.423 DEBUG:boto:Token: None 2024-04-16T18:48:41.423 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.423 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw= 2024-04-16T18:48:41.423 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw=', 'Content-Length': '0'} 2024-04-16T18:48:41.425 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a23e2e6837bb55ab-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.425 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.425 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.425 DEBUG:boto:path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.425 DEBUG:boto:auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.426 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.426 DEBUG:boto:Path: /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.426 DEBUG:boto:Data: 2024-04-16T18:48:41.426 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.426 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.426 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.426 DEBUG:boto:Params: {} 2024-04-16T18:48:41.426 DEBUG:boto:Token: None 2024-04-16T18:48:41.426 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.427 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw= 2024-04-16T18:48:41.427 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw=', 'Content-Length': '0'} 2024-04-16T18:48:41.428 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032c6ffe3827819a4-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.429 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:48:41.429 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.429 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.429 DEBUG:boto:path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.429 DEBUG:boto:auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.429 DEBUG:boto:Method: GET 2024-04-16T18:48:41.429 DEBUG:boto:Path: /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.429 DEBUG:boto:Data: 2024-04-16T18:48:41.429 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.429 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.430 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.430 DEBUG:boto:Params: {} 2024-04-16T18:48:41.430 DEBUG:boto:Token: None 2024-04-16T18:48:41.430 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.430 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T18:48:41.430 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T18:48:41.432 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e798db64aa77983e-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.474 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.474 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.474 DEBUG:boto:path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.475 DEBUG:boto:auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.475 DEBUG:boto:Method: GET 2024-04-16T18:48:41.475 DEBUG:boto:Path: /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.475 DEBUG:boto:Data: 2024-04-16T18:48:41.475 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.475 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.475 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.475 DEBUG:boto:Params: {} 2024-04-16T18:48:41.475 DEBUG:boto:Token: None 2024-04-16T18:48:41.475 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46?versionId=null 2024-04-16T18:48:41.475 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T18:48:41.476 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T18:48:41.477 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaf966fd8bcf40ef-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.478 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.478 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.478 DEBUG:boto:path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.478 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.478 DEBUG:boto:Method: GET 2024-04-16T18:48:41.478 DEBUG:boto:Path: /cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.478 DEBUG:boto:Data: 2024-04-16T18:48:41.478 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.479 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.479 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.479 DEBUG:boto:Params: {} 2024-04-16T18:48:41.479 DEBUG:boto:Token: None 2024-04-16T18:48:41.479 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.479 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.479 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.481 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ae13e588803ac4d-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.522 DEBUG:boto:b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.523 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.523 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.523 DEBUG:boto:path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.523 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.523 DEBUG:boto:Method: GET 2024-04-16T18:48:41.523 DEBUG:boto:Path: /cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.523 DEBUG:boto:Data: 2024-04-16T18:48:41.523 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.523 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.523 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.523 DEBUG:boto:Params: {} 2024-04-16T18:48:41.524 DEBUG:boto:Token: None 2024-04-16T18:48:41.524 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.524 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.524 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.527 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a19ad0d3ef9f4a96-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.527 DEBUG:boto:b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.528 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.528 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.528 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.528 DEBUG:boto:Path: /cjqttm-56/obj46 2024-04-16T18:48:41.528 DEBUG:boto:Data: 2024-04-16T18:48:41.528 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.528 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.528 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.528 DEBUG:boto:Params: {} 2024-04-16T18:48:41.528 DEBUG:boto:Token: None 2024-04-16T18:48:41.528 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46 2024-04-16T18:48:41.529 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E= 2024-04-16T18:48:41.529 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E=', 'Content-Length': '0'} 2024-04-16T18:48:41.530 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018724143886cc2bc-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.531 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.531 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.531 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.531 DEBUG:boto:Path: /cjqttm-56/obj46 2024-04-16T18:48:41.531 DEBUG:boto:Data: 2024-04-16T18:48:41.531 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.531 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.531 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.531 DEBUG:boto:Params: {} 2024-04-16T18:48:41.531 DEBUG:boto:Token: None 2024-04-16T18:48:41.532 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46 2024-04-16T18:48:41.532 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E= 2024-04-16T18:48:41.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E=', 'Content-Length': '0'} 2024-04-16T18:48:41.534 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dacfc5e7926a516-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.534 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj46 2024-04-16T18:48:41.534 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.534 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.534 DEBUG:boto:Method: GET 2024-04-16T18:48:41.534 DEBUG:boto:Path: /cjqttm-56/obj46 2024-04-16T18:48:41.534 DEBUG:boto:Data: 2024-04-16T18:48:41.534 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.534 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.535 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.535 DEBUG:boto:Params: {} 2024-04-16T18:48:41.535 DEBUG:boto:Token: None 2024-04-16T18:48:41.535 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46 2024-04-16T18:48:41.535 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE= 2024-04-16T18:48:41.535 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE=', 'Content-Length': '0'} 2024-04-16T18:48:41.537 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5d893f3c4541cc8-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.578 DEBUG:boto:path=/cjqttm-56/obj46 2024-04-16T18:48:41.578 DEBUG:boto:auth_path=/cjqttm-56/obj46 2024-04-16T18:48:41.579 DEBUG:boto:Method: GET 2024-04-16T18:48:41.579 DEBUG:boto:Path: /cjqttm-56/obj46 2024-04-16T18:48:41.579 DEBUG:boto:Data: 2024-04-16T18:48:41.579 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.579 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.579 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.579 DEBUG:boto:Params: {} 2024-04-16T18:48:41.579 DEBUG:boto:Token: None 2024-04-16T18:48:41.579 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj46 2024-04-16T18:48:41.579 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE= 2024-04-16T18:48:41.579 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE=', 'Content-Length': '0'} 2024-04-16T18:48:41.581 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c33836823227a04f-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.582 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.582 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.582 DEBUG:boto:path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.582 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.582 DEBUG:boto:Method: GET 2024-04-16T18:48:41.582 DEBUG:boto:Path: /cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.582 DEBUG:boto:Data: 2024-04-16T18:48:41.582 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.582 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.583 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.583 DEBUG:boto:Params: {} 2024-04-16T18:48:41.583 DEBUG:boto:Token: None 2024-04-16T18:48:41.583 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.583 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.583 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.585 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009cee60535835827-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.630 DEBUG:boto:b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.631 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.631 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.631 DEBUG:boto:path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.631 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.631 DEBUG:boto:Method: GET 2024-04-16T18:48:41.631 DEBUG:boto:Path: /cjqttm-56/?prefix=obj46 2024-04-16T18:48:41.631 DEBUG:boto:Data: 2024-04-16T18:48:41.631 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.631 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.631 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.631 DEBUG:boto:Params: {} 2024-04-16T18:48:41.632 DEBUG:boto:Token: None 2024-04-16T18:48:41.632 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.632 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.632 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.635 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000caa84c7733ca5fc2-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.635 DEBUG:boto:b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.636 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:48:41.636 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.636 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.636 DEBUG:boto:path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.636 DEBUG:boto:auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.636 DEBUG:boto:Method: GET 2024-04-16T18:48:41.636 DEBUG:boto:Path: /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.636 DEBUG:boto:Data: 2024-04-16T18:48:41.636 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.636 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.637 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.637 DEBUG:boto:Params: {} 2024-04-16T18:48:41.637 DEBUG:boto:Token: None 2024-04-16T18:48:41.637 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.637 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T18:48:41.637 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T18:48:41.639 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d04eea7098cabc2d-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.682 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.682 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.682 DEBUG:boto:path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.682 DEBUG:boto:auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.683 DEBUG:boto:Method: GET 2024-04-16T18:48:41.683 DEBUG:boto:Path: /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.683 DEBUG:boto:Data: 2024-04-16T18:48:41.683 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.683 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.683 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.683 DEBUG:boto:Params: {} 2024-04-16T18:48:41.683 DEBUG:boto:Token: None 2024-04-16T18:48:41.683 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.683 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T18:48:41.684 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T18:48:41.686 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057cc04dc47779de4-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.686 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.686 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.686 DEBUG:boto:path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.686 DEBUG:boto:auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.686 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.686 DEBUG:boto:Path: /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.687 DEBUG:boto:Data: 2024-04-16T18:48:41.687 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.687 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.687 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.687 DEBUG:boto:Params: {} 2024-04-16T18:48:41.687 DEBUG:boto:Token: None 2024-04-16T18:48:41.687 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.687 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0= 2024-04-16T18:48:41.687 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0=', 'Content-Length': '0'} 2024-04-16T18:48:41.689 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030ffbad206862c42-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.690 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.690 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.690 DEBUG:boto:path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.690 DEBUG:boto:auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.690 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.690 DEBUG:boto:Path: /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.690 DEBUG:boto:Data: 2024-04-16T18:48:41.690 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.690 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.690 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.690 DEBUG:boto:Params: {} 2024-04-16T18:48:41.691 DEBUG:boto:Token: None 2024-04-16T18:48:41.691 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.691 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0= 2024-04-16T18:48:41.691 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0=', 'Content-Length': '0'} 2024-04-16T18:48:41.693 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5d7e2a0c9635160-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.693 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:48:41.693 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.693 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.693 DEBUG:boto:path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.694 DEBUG:boto:auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.694 DEBUG:boto:Method: GET 2024-04-16T18:48:41.694 DEBUG:boto:Path: /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.694 DEBUG:boto:Data: 2024-04-16T18:48:41.694 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.694 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.694 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.694 DEBUG:boto:Params: {} 2024-04-16T18:48:41.694 DEBUG:boto:Token: None 2024-04-16T18:48:41.694 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.695 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T18:48:41.695 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T18:48:41.697 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee50b97532404167-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.738 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.738 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.739 DEBUG:boto:path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.739 DEBUG:boto:auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.739 DEBUG:boto:Method: GET 2024-04-16T18:48:41.739 DEBUG:boto:Path: /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.739 DEBUG:boto:Data: 2024-04-16T18:48:41.739 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.739 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.739 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.739 DEBUG:boto:Params: {} 2024-04-16T18:48:41.739 DEBUG:boto:Token: None 2024-04-16T18:48:41.739 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51?versionId=null 2024-04-16T18:48:41.740 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T18:48:41.740 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T18:48:41.741 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046dd5eeec392cbb9-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.742 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.742 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.742 DEBUG:boto:path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.742 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.742 DEBUG:boto:Method: GET 2024-04-16T18:48:41.742 DEBUG:boto:Path: /cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.742 DEBUG:boto:Data: 2024-04-16T18:48:41.742 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.742 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.742 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.743 DEBUG:boto:Params: {} 2024-04-16T18:48:41.743 DEBUG:boto:Token: None 2024-04-16T18:48:41.743 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.743 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.743 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.745 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8f51ef6c5b6d7d7-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.786 DEBUG:boto:b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.787 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.787 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.787 DEBUG:boto:path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.787 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.787 DEBUG:boto:Method: GET 2024-04-16T18:48:41.787 DEBUG:boto:Path: /cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.787 DEBUG:boto:Data: 2024-04-16T18:48:41.787 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.787 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.787 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.787 DEBUG:boto:Params: {} 2024-04-16T18:48:41.788 DEBUG:boto:Token: None 2024-04-16T18:48:41.788 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.788 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.788 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.791 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b64638569f3cb7d-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.791 DEBUG:boto:b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.791 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.791 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.792 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.792 DEBUG:boto:Path: /cjqttm-56/obj51 2024-04-16T18:48:41.792 DEBUG:boto:Data: 2024-04-16T18:48:41.792 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.792 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.792 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.792 DEBUG:boto:Params: {} 2024-04-16T18:48:41.792 DEBUG:boto:Token: None 2024-04-16T18:48:41.792 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51 2024-04-16T18:48:41.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE= 2024-04-16T18:48:41.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE=', 'Content-Length': '0'} 2024-04-16T18:48:41.794 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000091dba91d910ad8e-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.795 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.795 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.795 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.795 DEBUG:boto:Path: /cjqttm-56/obj51 2024-04-16T18:48:41.795 DEBUG:boto:Data: 2024-04-16T18:48:41.795 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.795 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.795 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.795 DEBUG:boto:Params: {} 2024-04-16T18:48:41.795 DEBUG:boto:Token: None 2024-04-16T18:48:41.795 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51 2024-04-16T18:48:41.796 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE= 2024-04-16T18:48:41.796 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE=', 'Content-Length': '0'} 2024-04-16T18:48:41.797 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075a844dd9de30174-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.798 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj51 2024-04-16T18:48:41.798 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.798 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.798 DEBUG:boto:Method: GET 2024-04-16T18:48:41.798 DEBUG:boto:Path: /cjqttm-56/obj51 2024-04-16T18:48:41.798 DEBUG:boto:Data: 2024-04-16T18:48:41.798 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.798 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.798 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.798 DEBUG:boto:Params: {} 2024-04-16T18:48:41.799 DEBUG:boto:Token: None 2024-04-16T18:48:41.799 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51 2024-04-16T18:48:41.799 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ= 2024-04-16T18:48:41.799 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ=', 'Content-Length': '0'} 2024-04-16T18:48:41.801 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005245c0a3f9bef664-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.842 DEBUG:boto:path=/cjqttm-56/obj51 2024-04-16T18:48:41.842 DEBUG:boto:auth_path=/cjqttm-56/obj51 2024-04-16T18:48:41.843 DEBUG:boto:Method: GET 2024-04-16T18:48:41.843 DEBUG:boto:Path: /cjqttm-56/obj51 2024-04-16T18:48:41.843 DEBUG:boto:Data: 2024-04-16T18:48:41.843 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.843 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.843 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.843 DEBUG:boto:Params: {} 2024-04-16T18:48:41.843 DEBUG:boto:Token: None 2024-04-16T18:48:41.843 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj51 2024-04-16T18:48:41.843 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ= 2024-04-16T18:48:41.843 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ=', 'Content-Length': '0'} 2024-04-16T18:48:41.845 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de24a053f4a4c8a1-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.845 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.845 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.846 DEBUG:boto:path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.846 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.846 DEBUG:boto:Method: GET 2024-04-16T18:48:41.846 DEBUG:boto:Path: /cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.846 DEBUG:boto:Data: 2024-04-16T18:48:41.846 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.846 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.846 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.846 DEBUG:boto:Params: {} 2024-04-16T18:48:41.846 DEBUG:boto:Token: None 2024-04-16T18:48:41.847 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.847 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.847 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.849 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098d65b8c5ed1c46d-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.890 DEBUG:boto:b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.891 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:41.891 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:41.891 DEBUG:boto:path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.891 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.891 DEBUG:boto:Method: GET 2024-04-16T18:48:41.891 DEBUG:boto:Path: /cjqttm-56/?prefix=obj51 2024-04-16T18:48:41.891 DEBUG:boto:Data: 2024-04-16T18:48:41.891 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.891 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.891 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.892 DEBUG:boto:Params: {} 2024-04-16T18:48:41.892 DEBUG:boto:Token: None 2024-04-16T18:48:41.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/ 2024-04-16T18:48:41.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T18:48:41.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T18:48:41.895 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000856831ce619d23ed-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.895 DEBUG:boto:b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:41.896 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:48:41.896 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:41.896 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:41.896 DEBUG:boto:path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.896 DEBUG:boto:auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.896 DEBUG:boto:Method: GET 2024-04-16T18:48:41.896 DEBUG:boto:Path: /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.896 DEBUG:boto:Data: 2024-04-16T18:48:41.896 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.896 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.897 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.897 DEBUG:boto:Params: {} 2024-04-16T18:48:41.897 DEBUG:boto:Token: None 2024-04-16T18:48:41.897 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.897 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T18:48:41.897 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T18:48:41.899 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a91909dcb1514fc-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.942 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:41.942 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:41.943 DEBUG:boto:path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.943 DEBUG:boto:auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.943 DEBUG:boto:Method: GET 2024-04-16T18:48:41.943 DEBUG:boto:Path: /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.943 DEBUG:boto:Data: 2024-04-16T18:48:41.943 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.943 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.943 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.943 DEBUG:boto:Params: {} 2024-04-16T18:48:41.943 DEBUG:boto:Token: None 2024-04-16T18:48:41.943 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.944 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T18:48:41.944 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T18:48:41.945 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bed2eee5193b4fc4-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.946 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:41.946 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:41.946 DEBUG:boto:path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.946 DEBUG:boto:auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.946 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.946 DEBUG:boto:Path: /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.946 DEBUG:boto:Data: 2024-04-16T18:48:41.946 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.946 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.946 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.946 DEBUG:boto:Params: {} 2024-04-16T18:48:41.947 DEBUG:boto:Token: None 2024-04-16T18:48:41.947 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.947 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk= 2024-04-16T18:48:41.947 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk=', 'Content-Length': '0'} 2024-04-16T18:48:41.949 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0f1c9425fe3f769-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.949 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:41.949 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:41.949 DEBUG:boto:path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.949 DEBUG:boto:auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.949 DEBUG:boto:Method: HEAD 2024-04-16T18:48:41.949 DEBUG:boto:Path: /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.949 DEBUG:boto:Data: 2024-04-16T18:48:41.949 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.950 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.950 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.950 DEBUG:boto:Params: {} 2024-04-16T18:48:41.950 DEBUG:boto:Token: None 2024-04-16T18:48:41.950 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk= 2024-04-16T18:48:41.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk=', 'Content-Length': '0'} 2024-04-16T18:48:41.952 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004958c01b1df6aaa2-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.952 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:48:41.952 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:41.952 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:41.952 DEBUG:boto:path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.952 DEBUG:boto:auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.952 DEBUG:boto:Method: GET 2024-04-16T18:48:41.953 DEBUG:boto:Path: /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.953 DEBUG:boto:Data: 2024-04-16T18:48:41.953 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.953 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:41.953 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.953 DEBUG:boto:Params: {} 2024-04-16T18:48:41.953 DEBUG:boto:Token: None 2024-04-16T18:48:41.953 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.953 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T18:48:41.953 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T18:48:41.955 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000245deb9412b37d61-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:41.998 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:41.998 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:41.999 DEBUG:boto:path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.999 DEBUG:boto:auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.999 DEBUG:boto:Method: GET 2024-04-16T18:48:41.999 DEBUG:boto:Path: /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.999 DEBUG:boto:Data: 2024-04-16T18:48:41.999 DEBUG:boto:Headers: {} 2024-04-16T18:48:41.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:41.999 DEBUG:boto:Port: 8000 2024-04-16T18:48:41.999 DEBUG:boto:Params: {} 2024-04-16T18:48:41.999 DEBUG:boto:Token: None 2024-04-16T18:48:41.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:41 GMT /cjqttm-56/obj55?versionId=null 2024-04-16T18:48:41.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T18:48:42.000 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T18:48:42.001 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000dc662d9ffee70cb-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.002 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.002 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.002 DEBUG:boto:path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.002 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.002 DEBUG:boto:Method: GET 2024-04-16T18:48:42.002 DEBUG:boto:Path: /cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.002 DEBUG:boto:Data: 2024-04-16T18:48:42.002 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.002 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.003 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.003 DEBUG:boto:Params: {} 2024-04-16T18:48:42.003 DEBUG:boto:Token: None 2024-04-16T18:48:42.003 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.005 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019aacbc351a44cfd-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.046 DEBUG:boto:b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.047 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.047 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.047 DEBUG:boto:path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.047 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.047 DEBUG:boto:Method: GET 2024-04-16T18:48:42.047 DEBUG:boto:Path: /cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.047 DEBUG:boto:Data: 2024-04-16T18:48:42.047 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.047 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.047 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.047 DEBUG:boto:Params: {} 2024-04-16T18:48:42.047 DEBUG:boto:Token: None 2024-04-16T18:48:42.048 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.048 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.048 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.051 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075077d47a9478d73-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.051 DEBUG:boto:b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.051 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:42.051 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:42.051 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.052 DEBUG:boto:Path: /cjqttm-56/obj55 2024-04-16T18:48:42.052 DEBUG:boto:Data: 2024-04-16T18:48:42.052 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.052 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.052 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.052 DEBUG:boto:Params: {} 2024-04-16T18:48:42.052 DEBUG:boto:Token: None 2024-04-16T18:48:42.052 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj55 2024-04-16T18:48:42.052 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI= 2024-04-16T18:48:42.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI=', 'Content-Length': '0'} 2024-04-16T18:48:42.054 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000009558f397b09322-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.054 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:42.054 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:42.055 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.055 DEBUG:boto:Path: /cjqttm-56/obj55 2024-04-16T18:48:42.055 DEBUG:boto:Data: 2024-04-16T18:48:42.055 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.055 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.055 DEBUG:boto:Params: {} 2024-04-16T18:48:42.055 DEBUG:boto:Token: None 2024-04-16T18:48:42.055 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj55 2024-04-16T18:48:42.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI= 2024-04-16T18:48:42.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI=', 'Content-Length': '0'} 2024-04-16T18:48:42.057 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aee45235641d618-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.057 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:48:42.057 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:42.057 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:42.058 DEBUG:boto:Method: GET 2024-04-16T18:48:42.058 DEBUG:boto:Path: /cjqttm-56/obj55 2024-04-16T18:48:42.058 DEBUG:boto:Data: 2024-04-16T18:48:42.058 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.058 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.058 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.058 DEBUG:boto:Params: {} 2024-04-16T18:48:42.058 DEBUG:boto:Token: None 2024-04-16T18:48:42.058 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj55 2024-04-16T18:48:42.058 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk= 2024-04-16T18:48:42.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk=', 'Content-Length': '0'} 2024-04-16T18:48:42.060 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026f822e5bd96321b-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.102 DEBUG:boto:path=/cjqttm-56/obj55 2024-04-16T18:48:42.102 DEBUG:boto:auth_path=/cjqttm-56/obj55 2024-04-16T18:48:42.103 DEBUG:boto:Method: GET 2024-04-16T18:48:42.103 DEBUG:boto:Path: /cjqttm-56/obj55 2024-04-16T18:48:42.103 DEBUG:boto:Data: 2024-04-16T18:48:42.103 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.103 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.103 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.103 DEBUG:boto:Params: {} 2024-04-16T18:48:42.103 DEBUG:boto:Token: None 2024-04-16T18:48:42.103 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj55 2024-04-16T18:48:42.103 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk= 2024-04-16T18:48:42.103 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk=', 'Content-Length': '0'} 2024-04-16T18:48:42.105 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e133859e76880d-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.106 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.106 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.106 DEBUG:boto:path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.106 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.106 DEBUG:boto:Method: GET 2024-04-16T18:48:42.106 DEBUG:boto:Path: /cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.106 DEBUG:boto:Data: 2024-04-16T18:48:42.106 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.106 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.106 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.106 DEBUG:boto:Params: {} 2024-04-16T18:48:42.107 DEBUG:boto:Token: None 2024-04-16T18:48:42.107 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.107 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.107 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.109 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020a8751fa4a19e66-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.109 DEBUG:boto:b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.110 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.110 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.110 DEBUG:boto:path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.110 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.110 DEBUG:boto:Method: GET 2024-04-16T18:48:42.110 DEBUG:boto:Path: /cjqttm-56/?prefix=obj55 2024-04-16T18:48:42.110 DEBUG:boto:Data: 2024-04-16T18:48:42.110 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.110 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.110 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.111 DEBUG:boto:Params: {} 2024-04-16T18:48:42.111 DEBUG:boto:Token: None 2024-04-16T18:48:42.111 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.111 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.111 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.115 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c6c1513a608c997-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.115 DEBUG:boto:b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.115 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:48:42.115 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.115 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.115 DEBUG:boto:path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.115 DEBUG:boto:auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.115 DEBUG:boto:Method: GET 2024-04-16T18:48:42.116 DEBUG:boto:Path: /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.116 DEBUG:boto:Data: 2024-04-16T18:48:42.116 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.116 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.116 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.116 DEBUG:boto:Params: {} 2024-04-16T18:48:42.116 DEBUG:boto:Token: None 2024-04-16T18:48:42.116 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T18:48:42.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T18:48:42.118 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008daca9604e99c17-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.158 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.158 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.159 DEBUG:boto:path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.159 DEBUG:boto:auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.159 DEBUG:boto:Method: GET 2024-04-16T18:48:42.159 DEBUG:boto:Path: /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.159 DEBUG:boto:Data: 2024-04-16T18:48:42.159 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.159 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.159 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.159 DEBUG:boto:Params: {} 2024-04-16T18:48:42.159 DEBUG:boto:Token: None 2024-04-16T18:48:42.160 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.160 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T18:48:42.160 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T18:48:42.161 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c53e21cacf43bed7-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.162 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.162 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.162 DEBUG:boto:path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.162 DEBUG:boto:auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.162 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.162 DEBUG:boto:Path: /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.162 DEBUG:boto:Data: 2024-04-16T18:48:42.162 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.163 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.163 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.163 DEBUG:boto:Params: {} 2024-04-16T18:48:42.163 DEBUG:boto:Token: None 2024-04-16T18:48:42.163 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.163 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A= 2024-04-16T18:48:42.163 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A=', 'Content-Length': '0'} 2024-04-16T18:48:42.165 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbc8bd5d00f12848-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.165 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.165 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.165 DEBUG:boto:path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.165 DEBUG:boto:auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.165 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.165 DEBUG:boto:Path: /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.166 DEBUG:boto:Data: 2024-04-16T18:48:42.166 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.166 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.166 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.166 DEBUG:boto:Params: {} 2024-04-16T18:48:42.166 DEBUG:boto:Token: None 2024-04-16T18:48:42.166 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.166 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A= 2024-04-16T18:48:42.166 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A=', 'Content-Length': '0'} 2024-04-16T18:48:42.168 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000822414ed1525a48a-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.168 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:48:42.168 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.169 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.169 DEBUG:boto:path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.169 DEBUG:boto:auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.169 DEBUG:boto:Method: GET 2024-04-16T18:48:42.169 DEBUG:boto:Path: /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.169 DEBUG:boto:Data: 2024-04-16T18:48:42.169 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.169 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.169 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.169 DEBUG:boto:Params: {} 2024-04-16T18:48:42.169 DEBUG:boto:Token: None 2024-04-16T18:48:42.169 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.170 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T18:48:42.170 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T18:48:42.171 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a2f6b3f75972d6c-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.214 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.214 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.215 DEBUG:boto:path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.215 DEBUG:boto:auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.215 DEBUG:boto:Method: GET 2024-04-16T18:48:42.215 DEBUG:boto:Path: /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.215 DEBUG:boto:Data: 2024-04-16T18:48:42.215 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.215 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.215 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.215 DEBUG:boto:Params: {} 2024-04-16T18:48:42.215 DEBUG:boto:Token: None 2024-04-16T18:48:42.215 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57?versionId=null 2024-04-16T18:48:42.216 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T18:48:42.216 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T18:48:42.218 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a3facf42beb85f0-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.218 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.218 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.218 DEBUG:boto:path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.218 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.218 DEBUG:boto:Method: GET 2024-04-16T18:48:42.218 DEBUG:boto:Path: /cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.218 DEBUG:boto:Data: 2024-04-16T18:48:42.219 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.219 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.219 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.219 DEBUG:boto:Params: {} 2024-04-16T18:48:42.219 DEBUG:boto:Token: None 2024-04-16T18:48:42.219 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.219 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.219 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.221 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000510176982a1d699f-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.222 DEBUG:boto:b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.222 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.222 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.222 DEBUG:boto:path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.222 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.222 DEBUG:boto:Method: GET 2024-04-16T18:48:42.222 DEBUG:boto:Path: /cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.223 DEBUG:boto:Data: 2024-04-16T18:48:42.223 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.223 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.223 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.223 DEBUG:boto:Params: {} 2024-04-16T18:48:42.223 DEBUG:boto:Token: None 2024-04-16T18:48:42.223 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.223 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.223 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.227 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000652ddc86b71c4267-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.227 DEBUG:boto:b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.227 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.227 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.227 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.227 DEBUG:boto:Path: /cjqttm-56/obj57 2024-04-16T18:48:42.227 DEBUG:boto:Data: 2024-04-16T18:48:42.228 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.228 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.228 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.228 DEBUG:boto:Params: {} 2024-04-16T18:48:42.228 DEBUG:boto:Token: None 2024-04-16T18:48:42.228 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57 2024-04-16T18:48:42.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw= 2024-04-16T18:48:42.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw=', 'Content-Length': '0'} 2024-04-16T18:48:42.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f41add25cef22b82-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.230 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.230 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.230 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.231 DEBUG:boto:Path: /cjqttm-56/obj57 2024-04-16T18:48:42.231 DEBUG:boto:Data: 2024-04-16T18:48:42.231 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.231 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.231 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.231 DEBUG:boto:Params: {} 2024-04-16T18:48:42.231 DEBUG:boto:Token: None 2024-04-16T18:48:42.231 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57 2024-04-16T18:48:42.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw= 2024-04-16T18:48:42.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw=', 'Content-Length': '0'} 2024-04-16T18:48:42.233 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee71e4fe351df223-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.233 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj57 2024-04-16T18:48:42.233 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.233 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.234 DEBUG:boto:Method: GET 2024-04-16T18:48:42.234 DEBUG:boto:Path: /cjqttm-56/obj57 2024-04-16T18:48:42.234 DEBUG:boto:Data: 2024-04-16T18:48:42.234 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.234 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.234 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.234 DEBUG:boto:Params: {} 2024-04-16T18:48:42.234 DEBUG:boto:Token: None 2024-04-16T18:48:42.234 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57 2024-04-16T18:48:42.234 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8= 2024-04-16T18:48:42.235 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8=', 'Content-Length': '0'} 2024-04-16T18:48:42.236 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048f47c43324385cb-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.278 DEBUG:boto:path=/cjqttm-56/obj57 2024-04-16T18:48:42.278 DEBUG:boto:auth_path=/cjqttm-56/obj57 2024-04-16T18:48:42.279 DEBUG:boto:Method: GET 2024-04-16T18:48:42.279 DEBUG:boto:Path: /cjqttm-56/obj57 2024-04-16T18:48:42.279 DEBUG:boto:Data: 2024-04-16T18:48:42.279 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.279 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.279 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.279 DEBUG:boto:Params: {} 2024-04-16T18:48:42.279 DEBUG:boto:Token: None 2024-04-16T18:48:42.279 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj57 2024-04-16T18:48:42.279 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8= 2024-04-16T18:48:42.279 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8=', 'Content-Length': '0'} 2024-04-16T18:48:42.281 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059089a80238dcc91-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.282 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.282 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.282 DEBUG:boto:path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.282 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.282 DEBUG:boto:Method: GET 2024-04-16T18:48:42.282 DEBUG:boto:Path: /cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.282 DEBUG:boto:Data: 2024-04-16T18:48:42.282 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.283 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.283 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.283 DEBUG:boto:Params: {} 2024-04-16T18:48:42.283 DEBUG:boto:Token: None 2024-04-16T18:48:42.283 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.283 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.283 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.285 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090a5addb17ddb237-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.286 DEBUG:boto:b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.286 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.286 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.286 DEBUG:boto:path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.286 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.286 DEBUG:boto:Method: GET 2024-04-16T18:48:42.287 DEBUG:boto:Path: /cjqttm-56/?prefix=obj57 2024-04-16T18:48:42.287 DEBUG:boto:Data: 2024-04-16T18:48:42.287 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.287 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.287 DEBUG:boto:Params: {} 2024-04-16T18:48:42.287 DEBUG:boto:Token: None 2024-04-16T18:48:42.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.287 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.291 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020889063495d0a48-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.291 DEBUG:boto:b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.291 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:48:42.291 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.291 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.292 DEBUG:boto:path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.292 DEBUG:boto:auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.292 DEBUG:boto:Method: GET 2024-04-16T18:48:42.292 DEBUG:boto:Path: /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.292 DEBUG:boto:Data: 2024-04-16T18:48:42.292 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.292 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.292 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.292 DEBUG:boto:Params: {} 2024-04-16T18:48:42.292 DEBUG:boto:Token: None 2024-04-16T18:48:42.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.293 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T18:48:42.293 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T18:48:42.294 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1258f34cd26fbc0-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.338 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.338 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.338 DEBUG:boto:path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.339 DEBUG:boto:auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.339 DEBUG:boto:Method: GET 2024-04-16T18:48:42.339 DEBUG:boto:Path: /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.339 DEBUG:boto:Data: 2024-04-16T18:48:42.339 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.339 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.339 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.339 DEBUG:boto:Params: {} 2024-04-16T18:48:42.339 DEBUG:boto:Token: None 2024-04-16T18:48:42.339 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.339 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T18:48:42.340 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T18:48:42.342 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042b19bf82a2848b1-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.342 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.342 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.342 DEBUG:boto:path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.342 DEBUG:boto:auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.342 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.342 DEBUG:boto:Path: /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.342 DEBUG:boto:Data: 2024-04-16T18:48:42.343 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.343 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.343 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.343 DEBUG:boto:Params: {} 2024-04-16T18:48:42.343 DEBUG:boto:Token: None 2024-04-16T18:48:42.343 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM= 2024-04-16T18:48:42.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM=', 'Content-Length': '0'} 2024-04-16T18:48:42.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f7105974c8875c8-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.345 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.346 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.346 DEBUG:boto:path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.346 DEBUG:boto:auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.346 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.346 DEBUG:boto:Path: /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.346 DEBUG:boto:Data: 2024-04-16T18:48:42.346 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.346 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.346 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.346 DEBUG:boto:Params: {} 2024-04-16T18:48:42.346 DEBUG:boto:Token: None 2024-04-16T18:48:42.346 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM= 2024-04-16T18:48:42.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM=', 'Content-Length': '0'} 2024-04-16T18:48:42.348 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb517906b67f12e3-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:48:42.349 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.349 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.349 DEBUG:boto:path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.349 DEBUG:boto:auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.349 DEBUG:boto:Method: GET 2024-04-16T18:48:42.349 DEBUG:boto:Path: /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.349 DEBUG:boto:Data: 2024-04-16T18:48:42.349 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.350 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.350 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.350 DEBUG:boto:Params: {} 2024-04-16T18:48:42.350 DEBUG:boto:Token: None 2024-04-16T18:48:42.350 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T18:48:42.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T18:48:42.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e3171b9c77ed773-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.394 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.394 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.394 DEBUG:boto:path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.395 DEBUG:boto:auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.395 DEBUG:boto:Method: GET 2024-04-16T18:48:42.395 DEBUG:boto:Path: /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.395 DEBUG:boto:Data: 2024-04-16T18:48:42.395 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.395 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.395 DEBUG:boto:Params: {} 2024-04-16T18:48:42.395 DEBUG:boto:Token: None 2024-04-16T18:48:42.395 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58?versionId=null 2024-04-16T18:48:42.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T18:48:42.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T18:48:42.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000660b6752d52cc642-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.398 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.398 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.398 DEBUG:boto:path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.398 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.398 DEBUG:boto:Method: GET 2024-04-16T18:48:42.398 DEBUG:boto:Path: /cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.398 DEBUG:boto:Data: 2024-04-16T18:48:42.398 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.398 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.398 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.399 DEBUG:boto:Params: {} 2024-04-16T18:48:42.399 DEBUG:boto:Token: None 2024-04-16T18:48:42.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.402 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076672478817bf606-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.402 DEBUG:boto:b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.402 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.402 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.402 DEBUG:boto:path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.402 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.403 DEBUG:boto:Method: GET 2024-04-16T18:48:42.403 DEBUG:boto:Path: /cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.403 DEBUG:boto:Data: 2024-04-16T18:48:42.403 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.403 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.403 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.403 DEBUG:boto:Params: {} 2024-04-16T18:48:42.403 DEBUG:boto:Token: None 2024-04-16T18:48:42.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.407 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bad25775a3ac225-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.407 DEBUG:boto:b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.407 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.408 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.408 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.408 DEBUG:boto:Path: /cjqttm-56/obj58 2024-04-16T18:48:42.408 DEBUG:boto:Data: 2024-04-16T18:48:42.408 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.408 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.408 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.408 DEBUG:boto:Params: {} 2024-04-16T18:48:42.408 DEBUG:boto:Token: None 2024-04-16T18:48:42.408 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58 2024-04-16T18:48:42.408 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o= 2024-04-16T18:48:42.409 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o=', 'Content-Length': '0'} 2024-04-16T18:48:42.410 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000817b949aaac65484-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.411 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.411 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.411 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.411 DEBUG:boto:Path: /cjqttm-56/obj58 2024-04-16T18:48:42.411 DEBUG:boto:Data: 2024-04-16T18:48:42.411 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.411 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.411 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.411 DEBUG:boto:Params: {} 2024-04-16T18:48:42.411 DEBUG:boto:Token: None 2024-04-16T18:48:42.411 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58 2024-04-16T18:48:42.412 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o= 2024-04-16T18:48:42.412 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o=', 'Content-Length': '0'} 2024-04-16T18:48:42.414 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005927da772a51af17-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.414 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj58 2024-04-16T18:48:42.414 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.414 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.414 DEBUG:boto:Method: GET 2024-04-16T18:48:42.414 DEBUG:boto:Path: /cjqttm-56/obj58 2024-04-16T18:48:42.414 DEBUG:boto:Data: 2024-04-16T18:48:42.414 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.415 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.415 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.415 DEBUG:boto:Params: {} 2024-04-16T18:48:42.415 DEBUG:boto:Token: None 2024-04-16T18:48:42.415 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58 2024-04-16T18:48:42.415 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk= 2024-04-16T18:48:42.415 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk=', 'Content-Length': '0'} 2024-04-16T18:48:42.417 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5d14e6f89a77899-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.458 DEBUG:boto:path=/cjqttm-56/obj58 2024-04-16T18:48:42.458 DEBUG:boto:auth_path=/cjqttm-56/obj58 2024-04-16T18:48:42.459 DEBUG:boto:Method: GET 2024-04-16T18:48:42.459 DEBUG:boto:Path: /cjqttm-56/obj58 2024-04-16T18:48:42.459 DEBUG:boto:Data: 2024-04-16T18:48:42.459 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.459 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.459 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.459 DEBUG:boto:Params: {} 2024-04-16T18:48:42.459 DEBUG:boto:Token: None 2024-04-16T18:48:42.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj58 2024-04-16T18:48:42.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk= 2024-04-16T18:48:42.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk=', 'Content-Length': '0'} 2024-04-16T18:48:42.462 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000f69654f634f48f-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.462 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.462 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.462 DEBUG:boto:path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.462 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.462 DEBUG:boto:Method: GET 2024-04-16T18:48:42.462 DEBUG:boto:Path: /cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.463 DEBUG:boto:Data: 2024-04-16T18:48:42.463 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.463 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.463 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.463 DEBUG:boto:Params: {} 2024-04-16T18:48:42.463 DEBUG:boto:Token: None 2024-04-16T18:48:42.463 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.463 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.463 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.465 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f74e8f5d30161956-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.506 DEBUG:boto:b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.507 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.507 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.507 DEBUG:boto:path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.507 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.507 DEBUG:boto:Method: GET 2024-04-16T18:48:42.507 DEBUG:boto:Path: /cjqttm-56/?prefix=obj58 2024-04-16T18:48:42.507 DEBUG:boto:Data: 2024-04-16T18:48:42.507 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.507 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.507 DEBUG:boto:Params: {} 2024-04-16T18:48:42.507 DEBUG:boto:Token: None 2024-04-16T18:48:42.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.511 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048d4a85e5fa2581e-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.511 DEBUG:boto:b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.511 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:48:42.512 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.512 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.512 DEBUG:boto:path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.512 DEBUG:boto:auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.512 DEBUG:boto:Method: GET 2024-04-16T18:48:42.512 DEBUG:boto:Path: /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.512 DEBUG:boto:Data: 2024-04-16T18:48:42.512 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.512 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.512 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.512 DEBUG:boto:Params: {} 2024-04-16T18:48:42.512 DEBUG:boto:Token: None 2024-04-16T18:48:42.513 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.513 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T18:48:42.513 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T18:48:42.515 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c1ee23ceeb50850-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.558 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.558 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.559 DEBUG:boto:path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.559 DEBUG:boto:auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.559 DEBUG:boto:Method: GET 2024-04-16T18:48:42.559 DEBUG:boto:Path: /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.559 DEBUG:boto:Data: 2024-04-16T18:48:42.559 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.559 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.559 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.559 DEBUG:boto:Params: {} 2024-04-16T18:48:42.559 DEBUG:boto:Token: None 2024-04-16T18:48:42.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T18:48:42.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T18:48:42.562 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fb0d0eca4060daa-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.562 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.562 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.562 DEBUG:boto:path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.562 DEBUG:boto:auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.562 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.562 DEBUG:boto:Path: /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.563 DEBUG:boto:Data: 2024-04-16T18:48:42.563 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.563 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.563 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.563 DEBUG:boto:Params: {} 2024-04-16T18:48:42.563 DEBUG:boto:Token: None 2024-04-16T18:48:42.563 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.563 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg= 2024-04-16T18:48:42.563 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg=', 'Content-Length': '0'} 2024-04-16T18:48:42.565 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4eb39b12a8706ed-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.565 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.565 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.565 DEBUG:boto:path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.566 DEBUG:boto:auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.566 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.566 DEBUG:boto:Path: /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.566 DEBUG:boto:Data: 2024-04-16T18:48:42.566 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.566 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.566 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.566 DEBUG:boto:Params: {} 2024-04-16T18:48:42.566 DEBUG:boto:Token: None 2024-04-16T18:48:42.566 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.567 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg= 2024-04-16T18:48:42.567 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg=', 'Content-Length': '0'} 2024-04-16T18:48:42.568 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a69512d5efbdabeb-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.569 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:48:42.569 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.569 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.569 DEBUG:boto:path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.569 DEBUG:boto:auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.569 DEBUG:boto:Method: GET 2024-04-16T18:48:42.569 DEBUG:boto:Path: /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.569 DEBUG:boto:Data: 2024-04-16T18:48:42.569 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.570 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.570 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.570 DEBUG:boto:Params: {} 2024-04-16T18:48:42.570 DEBUG:boto:Token: None 2024-04-16T18:48:42.570 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.570 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T18:48:42.570 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T18:48:42.572 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000384fa3c907d903f-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.614 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.615 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.615 DEBUG:boto:path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.615 DEBUG:boto:auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.615 DEBUG:boto:Method: GET 2024-04-16T18:48:42.615 DEBUG:boto:Path: /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.615 DEBUG:boto:Data: 2024-04-16T18:48:42.615 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.615 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.615 DEBUG:boto:Params: {} 2024-04-16T18:48:42.616 DEBUG:boto:Token: None 2024-04-16T18:48:42.616 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62?versionId=null 2024-04-16T18:48:42.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T18:48:42.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T18:48:42.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008aa9764acc86aace-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.618 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.618 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.618 DEBUG:boto:path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.618 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.619 DEBUG:boto:Method: GET 2024-04-16T18:48:42.619 DEBUG:boto:Path: /cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.619 DEBUG:boto:Data: 2024-04-16T18:48:42.619 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.619 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.619 DEBUG:boto:Params: {} 2024-04-16T18:48:42.619 DEBUG:boto:Token: None 2024-04-16T18:48:42.619 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.619 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081dc9f866f69ff7a-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.666 DEBUG:boto:b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.667 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.667 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.667 DEBUG:boto:path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.667 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.667 DEBUG:boto:Method: GET 2024-04-16T18:48:42.667 DEBUG:boto:Path: /cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.667 DEBUG:boto:Data: 2024-04-16T18:48:42.667 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.667 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.667 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.668 DEBUG:boto:Params: {} 2024-04-16T18:48:42.668 DEBUG:boto:Token: None 2024-04-16T18:48:42.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.671 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6647e3b25a77654-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.672 DEBUG:boto:b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.672 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.672 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.672 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.672 DEBUG:boto:Path: /cjqttm-56/obj62 2024-04-16T18:48:42.672 DEBUG:boto:Data: 2024-04-16T18:48:42.672 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.672 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.672 DEBUG:boto:Params: {} 2024-04-16T18:48:42.673 DEBUG:boto:Token: None 2024-04-16T18:48:42.673 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62 2024-04-16T18:48:42.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00= 2024-04-16T18:48:42.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00=', 'Content-Length': '0'} 2024-04-16T18:48:42.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed1cb3543a1397a1-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.675 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.675 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.675 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.675 DEBUG:boto:Path: /cjqttm-56/obj62 2024-04-16T18:48:42.675 DEBUG:boto:Data: 2024-04-16T18:48:42.675 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.675 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.676 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.676 DEBUG:boto:Params: {} 2024-04-16T18:48:42.676 DEBUG:boto:Token: None 2024-04-16T18:48:42.676 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62 2024-04-16T18:48:42.676 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00= 2024-04-16T18:48:42.676 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00=', 'Content-Length': '0'} 2024-04-16T18:48:42.678 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007be3baea587bce9b-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj62 2024-04-16T18:48:42.678 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.678 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.679 DEBUG:boto:Method: GET 2024-04-16T18:48:42.679 DEBUG:boto:Path: /cjqttm-56/obj62 2024-04-16T18:48:42.679 DEBUG:boto:Data: 2024-04-16T18:48:42.679 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.679 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.679 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.679 DEBUG:boto:Params: {} 2024-04-16T18:48:42.679 DEBUG:boto:Token: None 2024-04-16T18:48:42.679 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62 2024-04-16T18:48:42.679 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM= 2024-04-16T18:48:42.679 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM=', 'Content-Length': '0'} 2024-04-16T18:48:42.681 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d55364f456c7b77b-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.722 DEBUG:boto:path=/cjqttm-56/obj62 2024-04-16T18:48:42.722 DEBUG:boto:auth_path=/cjqttm-56/obj62 2024-04-16T18:48:42.722 DEBUG:boto:Method: GET 2024-04-16T18:48:42.723 DEBUG:boto:Path: /cjqttm-56/obj62 2024-04-16T18:48:42.723 DEBUG:boto:Data: 2024-04-16T18:48:42.723 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.723 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.723 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.723 DEBUG:boto:Params: {} 2024-04-16T18:48:42.723 DEBUG:boto:Token: None 2024-04-16T18:48:42.723 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj62 2024-04-16T18:48:42.723 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM= 2024-04-16T18:48:42.723 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM=', 'Content-Length': '0'} 2024-04-16T18:48:42.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f84ce12f1d77f569-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.726 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.726 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.726 DEBUG:boto:path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.726 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.726 DEBUG:boto:Method: GET 2024-04-16T18:48:42.726 DEBUG:boto:Path: /cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.726 DEBUG:boto:Data: 2024-04-16T18:48:42.726 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.727 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.727 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.727 DEBUG:boto:Params: {} 2024-04-16T18:48:42.727 DEBUG:boto:Token: None 2024-04-16T18:48:42.727 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.729 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009664f201a1071ebd-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.770 DEBUG:boto:b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.771 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.771 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.771 DEBUG:boto:path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.771 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.771 DEBUG:boto:Method: GET 2024-04-16T18:48:42.771 DEBUG:boto:Path: /cjqttm-56/?prefix=obj62 2024-04-16T18:48:42.771 DEBUG:boto:Data: 2024-04-16T18:48:42.771 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.772 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.772 DEBUG:boto:Params: {} 2024-04-16T18:48:42.772 DEBUG:boto:Token: None 2024-04-16T18:48:42.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.775 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e2d5feb9133ef3c-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.776 DEBUG:boto:b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.776 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:48:42.776 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.776 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.776 DEBUG:boto:path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.776 DEBUG:boto:auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.776 DEBUG:boto:Method: GET 2024-04-16T18:48:42.776 DEBUG:boto:Path: /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.777 DEBUG:boto:Data: 2024-04-16T18:48:42.777 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.777 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.777 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.777 DEBUG:boto:Params: {} 2024-04-16T18:48:42.777 DEBUG:boto:Token: None 2024-04-16T18:48:42.777 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.777 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T18:48:42.777 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T18:48:42.779 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cc8d249d5a96909-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.822 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.822 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.823 DEBUG:boto:path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.823 DEBUG:boto:auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.823 DEBUG:boto:Method: GET 2024-04-16T18:48:42.823 DEBUG:boto:Path: /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.823 DEBUG:boto:Data: 2024-04-16T18:48:42.823 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.823 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.823 DEBUG:boto:Params: {} 2024-04-16T18:48:42.823 DEBUG:boto:Token: None 2024-04-16T18:48:42.823 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T18:48:42.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T18:48:42.826 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d76db62569ef44cd-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.826 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.826 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.827 DEBUG:boto:path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.827 DEBUG:boto:auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.827 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.827 DEBUG:boto:Path: /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.827 DEBUG:boto:Data: 2024-04-16T18:48:42.827 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.827 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.827 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.827 DEBUG:boto:Params: {} 2024-04-16T18:48:42.827 DEBUG:boto:Token: None 2024-04-16T18:48:42.827 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic= 2024-04-16T18:48:42.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic=', 'Content-Length': '0'} 2024-04-16T18:48:42.829 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f5babd7797161cb-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.830 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.830 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.830 DEBUG:boto:path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.830 DEBUG:boto:auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.830 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.830 DEBUG:boto:Path: /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.830 DEBUG:boto:Data: 2024-04-16T18:48:42.830 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.830 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.830 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.830 DEBUG:boto:Params: {} 2024-04-16T18:48:42.831 DEBUG:boto:Token: None 2024-04-16T18:48:42.831 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.831 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic= 2024-04-16T18:48:42.831 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic=', 'Content-Length': '0'} 2024-04-16T18:48:42.833 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb948959db3c2353-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.833 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:48:42.833 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.833 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.833 DEBUG:boto:path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.833 DEBUG:boto:auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.834 DEBUG:boto:Method: GET 2024-04-16T18:48:42.834 DEBUG:boto:Path: /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.834 DEBUG:boto:Data: 2024-04-16T18:48:42.834 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.834 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.834 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.834 DEBUG:boto:Params: {} 2024-04-16T18:48:42.834 DEBUG:boto:Token: None 2024-04-16T18:48:42.834 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.834 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T18:48:42.834 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T18:48:42.836 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007463fff8d0e6289b-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.878 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.878 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.879 DEBUG:boto:path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.879 DEBUG:boto:auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.879 DEBUG:boto:Method: GET 2024-04-16T18:48:42.879 DEBUG:boto:Path: /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.879 DEBUG:boto:Data: 2024-04-16T18:48:42.879 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.879 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.879 DEBUG:boto:Params: {} 2024-04-16T18:48:42.879 DEBUG:boto:Token: None 2024-04-16T18:48:42.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68?versionId=null 2024-04-16T18:48:42.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T18:48:42.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T18:48:42.882 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b80f664495cb6749-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.882 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.882 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.882 DEBUG:boto:path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.883 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.883 DEBUG:boto:Method: GET 2024-04-16T18:48:42.883 DEBUG:boto:Path: /cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.883 DEBUG:boto:Data: 2024-04-16T18:48:42.883 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.883 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.883 DEBUG:boto:Params: {} 2024-04-16T18:48:42.883 DEBUG:boto:Token: None 2024-04-16T18:48:42.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.884 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007796c9a7bac90579-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.926 DEBUG:boto:b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.927 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.927 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.927 DEBUG:boto:path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.927 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.927 DEBUG:boto:Method: GET 2024-04-16T18:48:42.927 DEBUG:boto:Path: /cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.927 DEBUG:boto:Data: 2024-04-16T18:48:42.927 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.927 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.927 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.927 DEBUG:boto:Params: {} 2024-04-16T18:48:42.928 DEBUG:boto:Token: None 2024-04-16T18:48:42.928 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.931 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e8f7c9022380235-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.931 DEBUG:boto:b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:42.932 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.932 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.932 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.932 DEBUG:boto:Path: /cjqttm-56/obj68 2024-04-16T18:48:42.932 DEBUG:boto:Data: 2024-04-16T18:48:42.932 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.932 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.932 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.932 DEBUG:boto:Params: {} 2024-04-16T18:48:42.932 DEBUG:boto:Token: None 2024-04-16T18:48:42.933 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68 2024-04-16T18:48:42.933 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE= 2024-04-16T18:48:42.933 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE=', 'Content-Length': '0'} 2024-04-16T18:48:42.934 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f657241bccae92e9-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.935 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.935 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.935 DEBUG:boto:Method: HEAD 2024-04-16T18:48:42.935 DEBUG:boto:Path: /cjqttm-56/obj68 2024-04-16T18:48:42.935 DEBUG:boto:Data: 2024-04-16T18:48:42.935 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.935 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.935 DEBUG:boto:Params: {} 2024-04-16T18:48:42.936 DEBUG:boto:Token: None 2024-04-16T18:48:42.936 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68 2024-04-16T18:48:42.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE= 2024-04-16T18:48:42.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE=', 'Content-Length': '0'} 2024-04-16T18:48:42.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005605444c8f7a4271-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.938 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj68 2024-04-16T18:48:42.938 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.938 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.938 DEBUG:boto:Method: GET 2024-04-16T18:48:42.938 DEBUG:boto:Path: /cjqttm-56/obj68 2024-04-16T18:48:42.938 DEBUG:boto:Data: 2024-04-16T18:48:42.938 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.938 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.938 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.939 DEBUG:boto:Params: {} 2024-04-16T18:48:42.939 DEBUG:boto:Token: None 2024-04-16T18:48:42.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68 2024-04-16T18:48:42.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo= 2024-04-16T18:48:42.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo=', 'Content-Length': '0'} 2024-04-16T18:48:42.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003abc4c265566762c-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.982 DEBUG:boto:path=/cjqttm-56/obj68 2024-04-16T18:48:42.982 DEBUG:boto:auth_path=/cjqttm-56/obj68 2024-04-16T18:48:42.982 DEBUG:boto:Method: GET 2024-04-16T18:48:42.983 DEBUG:boto:Path: /cjqttm-56/obj68 2024-04-16T18:48:42.983 DEBUG:boto:Data: 2024-04-16T18:48:42.983 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.983 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:42.983 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.983 DEBUG:boto:Params: {} 2024-04-16T18:48:42.983 DEBUG:boto:Token: None 2024-04-16T18:48:42.983 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/obj68 2024-04-16T18:48:42.983 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo= 2024-04-16T18:48:42.983 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo=', 'Content-Length': '0'} 2024-04-16T18:48:42.986 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000427436d3ada75e65-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:42.986 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:42.986 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:42.986 DEBUG:boto:path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.986 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.986 DEBUG:boto:Method: GET 2024-04-16T18:48:42.986 DEBUG:boto:Path: /cjqttm-56/?prefix=obj68 2024-04-16T18:48:42.987 DEBUG:boto:Data: 2024-04-16T18:48:42.987 DEBUG:boto:Headers: {} 2024-04-16T18:48:42.987 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:42.987 DEBUG:boto:Port: 8000 2024-04-16T18:48:42.987 DEBUG:boto:Params: {} 2024-04-16T18:48:42.987 DEBUG:boto:Token: None 2024-04-16T18:48:42.987 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:42 GMT /cjqttm-56/ 2024-04-16T18:48:42.987 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T18:48:42.987 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T18:48:42.989 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b33387ad2b60493-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.030 DEBUG:boto:b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.030 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.031 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.031 DEBUG:boto:path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:43.031 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T18:48:43.031 DEBUG:boto:Method: GET 2024-04-16T18:48:43.031 DEBUG:boto:Path: /cjqttm-56/?prefix=obj68 2024-04-16T18:48:43.031 DEBUG:boto:Data: 2024-04-16T18:48:43.031 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.031 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.031 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.031 DEBUG:boto:Params: {} 2024-04-16T18:48:43.031 DEBUG:boto:Token: None 2024-04-16T18:48:43.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.035 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b316dd4bf7dca0db-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.035 DEBUG:boto:b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.036 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:48:43.036 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.036 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.036 DEBUG:boto:path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.036 DEBUG:boto:auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.036 DEBUG:boto:Method: GET 2024-04-16T18:48:43.036 DEBUG:boto:Path: /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.036 DEBUG:boto:Data: 2024-04-16T18:48:43.036 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.036 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.037 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.037 DEBUG:boto:Params: {} 2024-04-16T18:48:43.037 DEBUG:boto:Token: None 2024-04-16T18:48:43.037 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.037 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T18:48:43.037 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T18:48:43.039 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0a2c3dbf9494607-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.082 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.082 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.083 DEBUG:boto:path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.083 DEBUG:boto:auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.083 DEBUG:boto:Method: GET 2024-04-16T18:48:43.083 DEBUG:boto:Path: /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.083 DEBUG:boto:Data: 2024-04-16T18:48:43.083 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.083 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.083 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.083 DEBUG:boto:Params: {} 2024-04-16T18:48:43.083 DEBUG:boto:Token: None 2024-04-16T18:48:43.083 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.084 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T18:48:43.084 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T18:48:43.085 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef76a41dee4a926f-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.086 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.086 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.086 DEBUG:boto:path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.086 DEBUG:boto:auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.086 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.086 DEBUG:boto:Path: /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.086 DEBUG:boto:Data: 2024-04-16T18:48:43.086 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.086 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.086 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.087 DEBUG:boto:Params: {} 2024-04-16T18:48:43.087 DEBUG:boto:Token: None 2024-04-16T18:48:43.087 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.087 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw= 2024-04-16T18:48:43.087 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw=', 'Content-Length': '0'} 2024-04-16T18:48:43.089 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cac3f85ee4c4dcb-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.089 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.089 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.089 DEBUG:boto:path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.089 DEBUG:boto:auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.089 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.089 DEBUG:boto:Path: /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.090 DEBUG:boto:Data: 2024-04-16T18:48:43.090 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.090 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.090 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.090 DEBUG:boto:Params: {} 2024-04-16T18:48:43.090 DEBUG:boto:Token: None 2024-04-16T18:48:43.090 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.090 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw= 2024-04-16T18:48:43.090 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw=', 'Content-Length': '0'} 2024-04-16T18:48:43.092 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064cce74e7d99b7d4-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.093 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:48:43.093 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.093 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.093 DEBUG:boto:path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.093 DEBUG:boto:auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.093 DEBUG:boto:Method: GET 2024-04-16T18:48:43.093 DEBUG:boto:Path: /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.093 DEBUG:boto:Data: 2024-04-16T18:48:43.093 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.093 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.093 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.094 DEBUG:boto:Params: {} 2024-04-16T18:48:43.094 DEBUG:boto:Token: None 2024-04-16T18:48:43.094 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.094 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T18:48:43.094 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T18:48:43.096 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec8b33e41bce70ac-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.138 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.138 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.139 DEBUG:boto:path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.139 DEBUG:boto:auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.139 DEBUG:boto:Method: GET 2024-04-16T18:48:43.139 DEBUG:boto:Path: /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.139 DEBUG:boto:Data: 2024-04-16T18:48:43.139 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.139 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.139 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.139 DEBUG:boto:Params: {} 2024-04-16T18:48:43.139 DEBUG:boto:Token: None 2024-04-16T18:48:43.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69?versionId=null 2024-04-16T18:48:43.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T18:48:43.140 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T18:48:43.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df6b158b60fe127b-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.142 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.142 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.142 DEBUG:boto:path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.142 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.142 DEBUG:boto:Method: GET 2024-04-16T18:48:43.142 DEBUG:boto:Path: /cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.142 DEBUG:boto:Data: 2024-04-16T18:48:43.142 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.142 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.142 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.142 DEBUG:boto:Params: {} 2024-04-16T18:48:43.143 DEBUG:boto:Token: None 2024-04-16T18:48:43.143 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.143 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.143 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.145 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bdbde76d06547c52-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.186 DEBUG:boto:b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.187 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.187 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.187 DEBUG:boto:path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.187 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.187 DEBUG:boto:Method: GET 2024-04-16T18:48:43.187 DEBUG:boto:Path: /cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.187 DEBUG:boto:Data: 2024-04-16T18:48:43.187 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.187 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.187 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.187 DEBUG:boto:Params: {} 2024-04-16T18:48:43.188 DEBUG:boto:Token: None 2024-04-16T18:48:43.188 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.188 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.188 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.191 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8177d2b9bdb3146-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.191 DEBUG:boto:b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.192 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.192 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.192 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.192 DEBUG:boto:Path: /cjqttm-56/obj69 2024-04-16T18:48:43.192 DEBUG:boto:Data: 2024-04-16T18:48:43.192 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.192 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.192 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.192 DEBUG:boto:Params: {} 2024-04-16T18:48:43.192 DEBUG:boto:Token: None 2024-04-16T18:48:43.193 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69 2024-04-16T18:48:43.193 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY= 2024-04-16T18:48:43.193 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY=', 'Content-Length': '0'} 2024-04-16T18:48:43.195 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049ee44f2cc295806-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.195 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.195 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.195 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.195 DEBUG:boto:Path: /cjqttm-56/obj69 2024-04-16T18:48:43.195 DEBUG:boto:Data: 2024-04-16T18:48:43.195 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.196 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.196 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.196 DEBUG:boto:Params: {} 2024-04-16T18:48:43.196 DEBUG:boto:Token: None 2024-04-16T18:48:43.196 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69 2024-04-16T18:48:43.196 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY= 2024-04-16T18:48:43.196 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY=', 'Content-Length': '0'} 2024-04-16T18:48:43.198 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005208de64c05f52f0-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.198 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj69 2024-04-16T18:48:43.198 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.198 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.198 DEBUG:boto:Method: GET 2024-04-16T18:48:43.198 DEBUG:boto:Path: /cjqttm-56/obj69 2024-04-16T18:48:43.199 DEBUG:boto:Data: 2024-04-16T18:48:43.199 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.199 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.199 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.199 DEBUG:boto:Params: {} 2024-04-16T18:48:43.199 DEBUG:boto:Token: None 2024-04-16T18:48:43.199 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69 2024-04-16T18:48:43.199 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE= 2024-04-16T18:48:43.199 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE=', 'Content-Length': '0'} 2024-04-16T18:48:43.202 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064f4382ca758b228-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.242 DEBUG:boto:path=/cjqttm-56/obj69 2024-04-16T18:48:43.242 DEBUG:boto:auth_path=/cjqttm-56/obj69 2024-04-16T18:48:43.242 DEBUG:boto:Method: GET 2024-04-16T18:48:43.243 DEBUG:boto:Path: /cjqttm-56/obj69 2024-04-16T18:48:43.243 DEBUG:boto:Data: 2024-04-16T18:48:43.243 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.243 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.243 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.243 DEBUG:boto:Params: {} 2024-04-16T18:48:43.243 DEBUG:boto:Token: None 2024-04-16T18:48:43.243 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj69 2024-04-16T18:48:43.243 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE= 2024-04-16T18:48:43.243 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE=', 'Content-Length': '0'} 2024-04-16T18:48:43.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c03b585bef6cb97-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.246 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.246 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.246 DEBUG:boto:path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.246 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.246 DEBUG:boto:Method: GET 2024-04-16T18:48:43.246 DEBUG:boto:Path: /cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.246 DEBUG:boto:Data: 2024-04-16T18:48:43.246 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.246 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.246 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.246 DEBUG:boto:Params: {} 2024-04-16T18:48:43.247 DEBUG:boto:Token: None 2024-04-16T18:48:43.247 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.247 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.247 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.249 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002fdb2e1cfdf4dfc4-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.290 DEBUG:boto:b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.291 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.291 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.291 DEBUG:boto:path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.291 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.291 DEBUG:boto:Method: GET 2024-04-16T18:48:43.291 DEBUG:boto:Path: /cjqttm-56/?prefix=obj69 2024-04-16T18:48:43.291 DEBUG:boto:Data: 2024-04-16T18:48:43.291 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.291 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.291 DEBUG:boto:Params: {} 2024-04-16T18:48:43.292 DEBUG:boto:Token: None 2024-04-16T18:48:43.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.296 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aee76e197c3fa077-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.296 DEBUG:boto:b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.296 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:48:43.296 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.296 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.297 DEBUG:boto:path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.297 DEBUG:boto:auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.297 DEBUG:boto:Method: GET 2024-04-16T18:48:43.297 DEBUG:boto:Path: /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.297 DEBUG:boto:Data: 2024-04-16T18:48:43.297 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.297 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.297 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.297 DEBUG:boto:Params: {} 2024-04-16T18:48:43.297 DEBUG:boto:Token: None 2024-04-16T18:48:43.297 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.297 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T18:48:43.298 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T18:48:43.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ae0795202f85482-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.342 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.342 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.342 DEBUG:boto:path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.342 DEBUG:boto:auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.343 DEBUG:boto:Method: GET 2024-04-16T18:48:43.343 DEBUG:boto:Path: /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.343 DEBUG:boto:Data: 2024-04-16T18:48:43.343 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.343 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.343 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.343 DEBUG:boto:Params: {} 2024-04-16T18:48:43.343 DEBUG:boto:Token: None 2024-04-16T18:48:43.343 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.343 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T18:48:43.343 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T18:48:43.345 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dfd7892dff873e7-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.346 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.346 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.346 DEBUG:boto:path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.346 DEBUG:boto:auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.346 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.346 DEBUG:boto:Path: /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.346 DEBUG:boto:Data: 2024-04-16T18:48:43.346 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.346 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.346 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.346 DEBUG:boto:Params: {} 2024-04-16T18:48:43.347 DEBUG:boto:Token: None 2024-04-16T18:48:43.347 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.347 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg= 2024-04-16T18:48:43.347 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg=', 'Content-Length': '0'} 2024-04-16T18:48:43.349 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009389771ffdb43220-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.349 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.349 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.349 DEBUG:boto:path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.349 DEBUG:boto:auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.349 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.349 DEBUG:boto:Path: /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.349 DEBUG:boto:Data: 2024-04-16T18:48:43.350 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.350 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.350 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.350 DEBUG:boto:Params: {} 2024-04-16T18:48:43.350 DEBUG:boto:Token: None 2024-04-16T18:48:43.350 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.350 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg= 2024-04-16T18:48:43.350 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg=', 'Content-Length': '0'} 2024-04-16T18:48:43.352 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bf900c98161b516-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.352 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:48:43.352 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.352 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.352 DEBUG:boto:path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.353 DEBUG:boto:auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.353 DEBUG:boto:Method: GET 2024-04-16T18:48:43.353 DEBUG:boto:Path: /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.353 DEBUG:boto:Data: 2024-04-16T18:48:43.353 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.353 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.353 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.353 DEBUG:boto:Params: {} 2024-04-16T18:48:43.353 DEBUG:boto:Token: None 2024-04-16T18:48:43.353 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.354 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T18:48:43.354 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T18:48:43.355 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066de308def1464ce-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.398 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.398 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.398 DEBUG:boto:path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.399 DEBUG:boto:auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.399 DEBUG:boto:Method: GET 2024-04-16T18:48:43.399 DEBUG:boto:Path: /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.399 DEBUG:boto:Data: 2024-04-16T18:48:43.399 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.399 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.399 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.399 DEBUG:boto:Params: {} 2024-04-16T18:48:43.399 DEBUG:boto:Token: None 2024-04-16T18:48:43.399 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74?versionId=null 2024-04-16T18:48:43.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T18:48:43.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T18:48:43.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce27acce64e90324-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.402 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.402 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.402 DEBUG:boto:path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.402 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.402 DEBUG:boto:Method: GET 2024-04-16T18:48:43.402 DEBUG:boto:Path: /cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.402 DEBUG:boto:Data: 2024-04-16T18:48:43.402 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.402 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.402 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.402 DEBUG:boto:Params: {} 2024-04-16T18:48:43.403 DEBUG:boto:Token: None 2024-04-16T18:48:43.403 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.403 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.403 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.405 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b7566a10376788a-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.446 DEBUG:boto:b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.447 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.447 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.447 DEBUG:boto:path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.447 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.447 DEBUG:boto:Method: GET 2024-04-16T18:48:43.447 DEBUG:boto:Path: /cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.447 DEBUG:boto:Data: 2024-04-16T18:48:43.447 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.447 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.447 DEBUG:boto:Params: {} 2024-04-16T18:48:43.448 DEBUG:boto:Token: None 2024-04-16T18:48:43.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1b80cbf0dbc2fb1-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.451 DEBUG:boto:b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.451 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.452 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.452 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.452 DEBUG:boto:Path: /cjqttm-56/obj74 2024-04-16T18:48:43.452 DEBUG:boto:Data: 2024-04-16T18:48:43.452 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.452 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.452 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.452 DEBUG:boto:Params: {} 2024-04-16T18:48:43.452 DEBUG:boto:Token: None 2024-04-16T18:48:43.452 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74 2024-04-16T18:48:43.453 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U= 2024-04-16T18:48:43.453 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U=', 'Content-Length': '0'} 2024-04-16T18:48:43.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092131a087fda4155-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.455 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.455 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.455 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.455 DEBUG:boto:Path: /cjqttm-56/obj74 2024-04-16T18:48:43.455 DEBUG:boto:Data: 2024-04-16T18:48:43.455 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.455 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.455 DEBUG:boto:Params: {} 2024-04-16T18:48:43.456 DEBUG:boto:Token: None 2024-04-16T18:48:43.456 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74 2024-04-16T18:48:43.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U= 2024-04-16T18:48:43.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U=', 'Content-Length': '0'} 2024-04-16T18:48:43.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc183e836702be59-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.458 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj74 2024-04-16T18:48:43.458 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.458 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.458 DEBUG:boto:Method: GET 2024-04-16T18:48:43.458 DEBUG:boto:Path: /cjqttm-56/obj74 2024-04-16T18:48:43.459 DEBUG:boto:Data: 2024-04-16T18:48:43.459 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.459 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.459 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.459 DEBUG:boto:Params: {} 2024-04-16T18:48:43.459 DEBUG:boto:Token: None 2024-04-16T18:48:43.459 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74 2024-04-16T18:48:43.459 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8= 2024-04-16T18:48:43.459 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8=', 'Content-Length': '0'} 2024-04-16T18:48:43.461 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006952ac0e3ff29a52-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.502 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:43.502 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:43.503 DEBUG:boto:Method: GET 2024-04-16T18:48:43.503 DEBUG:boto:Path: /cjqttm-56/obj74 2024-04-16T18:48:43.503 DEBUG:boto:Data: 2024-04-16T18:48:43.503 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.503 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.503 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.503 DEBUG:boto:Params: {} 2024-04-16T18:48:43.503 DEBUG:boto:Token: None 2024-04-16T18:48:43.503 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj74 2024-04-16T18:48:43.503 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8= 2024-04-16T18:48:43.503 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8=', 'Content-Length': '0'} 2024-04-16T18:48:43.505 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fe4f2acc05cbd50-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.505 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.506 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.506 DEBUG:boto:path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.506 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.506 DEBUG:boto:Method: GET 2024-04-16T18:48:43.506 DEBUG:boto:Path: /cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.506 DEBUG:boto:Data: 2024-04-16T18:48:43.506 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.506 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.506 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.506 DEBUG:boto:Params: {} 2024-04-16T18:48:43.506 DEBUG:boto:Token: None 2024-04-16T18:48:43.507 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.507 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.507 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.509 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f764c64014b9f9a-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.550 DEBUG:boto:b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.551 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.551 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.551 DEBUG:boto:path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.551 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.551 DEBUG:boto:Method: GET 2024-04-16T18:48:43.551 DEBUG:boto:Path: /cjqttm-56/?prefix=obj74 2024-04-16T18:48:43.551 DEBUG:boto:Data: 2024-04-16T18:48:43.551 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.551 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.551 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.551 DEBUG:boto:Params: {} 2024-04-16T18:48:43.552 DEBUG:boto:Token: None 2024-04-16T18:48:43.552 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.552 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.555 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002822a0fb5263a604-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.555 DEBUG:boto:b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.556 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:48:43.556 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.556 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.556 DEBUG:boto:path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.556 DEBUG:boto:auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.556 DEBUG:boto:Method: GET 2024-04-16T18:48:43.556 DEBUG:boto:Path: /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.556 DEBUG:boto:Data: 2024-04-16T18:48:43.556 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.557 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.557 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.557 DEBUG:boto:Params: {} 2024-04-16T18:48:43.557 DEBUG:boto:Token: None 2024-04-16T18:48:43.557 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.557 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T18:48:43.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T18:48:43.559 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009202c69920701489-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.602 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.602 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.603 DEBUG:boto:path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.603 DEBUG:boto:auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.603 DEBUG:boto:Method: GET 2024-04-16T18:48:43.603 DEBUG:boto:Path: /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.603 DEBUG:boto:Data: 2024-04-16T18:48:43.603 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.603 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.603 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.603 DEBUG:boto:Params: {} 2024-04-16T18:48:43.603 DEBUG:boto:Token: None 2024-04-16T18:48:43.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T18:48:43.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T18:48:43.606 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc730b7d98263f09-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.606 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.606 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.606 DEBUG:boto:path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.607 DEBUG:boto:auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.607 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.607 DEBUG:boto:Path: /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.607 DEBUG:boto:Data: 2024-04-16T18:48:43.607 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.607 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.607 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.607 DEBUG:boto:Params: {} 2024-04-16T18:48:43.607 DEBUG:boto:Token: None 2024-04-16T18:48:43.607 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.608 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ= 2024-04-16T18:48:43.608 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ=', 'Content-Length': '0'} 2024-04-16T18:48:43.609 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd605f490ea1fdc8-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.610 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.610 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.610 DEBUG:boto:path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.610 DEBUG:boto:auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.610 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.610 DEBUG:boto:Path: /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.610 DEBUG:boto:Data: 2024-04-16T18:48:43.610 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.611 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.611 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.611 DEBUG:boto:Params: {} 2024-04-16T18:48:43.611 DEBUG:boto:Token: None 2024-04-16T18:48:43.611 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.611 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ= 2024-04-16T18:48:43.611 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ=', 'Content-Length': '0'} 2024-04-16T18:48:43.613 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003154c17b21829473-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.613 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:48:43.613 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.613 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.613 DEBUG:boto:path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.613 DEBUG:boto:auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.614 DEBUG:boto:Method: GET 2024-04-16T18:48:43.614 DEBUG:boto:Path: /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.614 DEBUG:boto:Data: 2024-04-16T18:48:43.614 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.614 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.614 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.614 DEBUG:boto:Params: {} 2024-04-16T18:48:43.614 DEBUG:boto:Token: None 2024-04-16T18:48:43.614 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.615 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T18:48:43.615 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T18:48:43.617 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b53ce9ee8f6cd4b-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.658 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.658 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.659 DEBUG:boto:path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.659 DEBUG:boto:auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.659 DEBUG:boto:Method: GET 2024-04-16T18:48:43.659 DEBUG:boto:Path: /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.659 DEBUG:boto:Data: 2024-04-16T18:48:43.659 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.659 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.659 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.659 DEBUG:boto:Params: {} 2024-04-16T18:48:43.659 DEBUG:boto:Token: None 2024-04-16T18:48:43.659 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76?versionId=null 2024-04-16T18:48:43.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T18:48:43.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T18:48:43.661 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abf52e49ab91bb51-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.662 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.662 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.662 DEBUG:boto:path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.662 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.662 DEBUG:boto:Method: GET 2024-04-16T18:48:43.662 DEBUG:boto:Path: /cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.662 DEBUG:boto:Data: 2024-04-16T18:48:43.662 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.663 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.663 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.663 DEBUG:boto:Params: {} 2024-04-16T18:48:43.663 DEBUG:boto:Token: None 2024-04-16T18:48:43.663 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.665 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cde1769862dfb540-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.706 DEBUG:boto:b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.707 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.707 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.707 DEBUG:boto:path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.707 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.707 DEBUG:boto:Method: GET 2024-04-16T18:48:43.707 DEBUG:boto:Path: /cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.707 DEBUG:boto:Data: 2024-04-16T18:48:43.707 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.707 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.707 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.707 DEBUG:boto:Params: {} 2024-04-16T18:48:43.708 DEBUG:boto:Token: None 2024-04-16T18:48:43.708 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.708 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.708 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.711 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e158e8b3a2dfded-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.711 DEBUG:boto:b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.712 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.712 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.712 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.712 DEBUG:boto:Path: /cjqttm-56/obj76 2024-04-16T18:48:43.712 DEBUG:boto:Data: 2024-04-16T18:48:43.712 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.712 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.712 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.712 DEBUG:boto:Params: {} 2024-04-16T18:48:43.713 DEBUG:boto:Token: None 2024-04-16T18:48:43.713 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76 2024-04-16T18:48:43.713 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc= 2024-04-16T18:48:43.713 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc=', 'Content-Length': '0'} 2024-04-16T18:48:43.715 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ac0a0198d9c136e-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.715 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.715 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.715 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.715 DEBUG:boto:Path: /cjqttm-56/obj76 2024-04-16T18:48:43.715 DEBUG:boto:Data: 2024-04-16T18:48:43.716 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.716 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.716 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.716 DEBUG:boto:Params: {} 2024-04-16T18:48:43.716 DEBUG:boto:Token: None 2024-04-16T18:48:43.716 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76 2024-04-16T18:48:43.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc= 2024-04-16T18:48:43.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc=', 'Content-Length': '0'} 2024-04-16T18:48:43.718 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8adca3150b6916e-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.718 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj76 2024-04-16T18:48:43.718 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.718 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.719 DEBUG:boto:Method: GET 2024-04-16T18:48:43.719 DEBUG:boto:Path: /cjqttm-56/obj76 2024-04-16T18:48:43.719 DEBUG:boto:Data: 2024-04-16T18:48:43.719 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.719 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.719 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.719 DEBUG:boto:Params: {} 2024-04-16T18:48:43.719 DEBUG:boto:Token: None 2024-04-16T18:48:43.719 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76 2024-04-16T18:48:43.719 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU= 2024-04-16T18:48:43.719 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU=', 'Content-Length': '0'} 2024-04-16T18:48:43.721 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000694a4040ee598a08-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.762 DEBUG:boto:path=/cjqttm-56/obj76 2024-04-16T18:48:43.762 DEBUG:boto:auth_path=/cjqttm-56/obj76 2024-04-16T18:48:43.763 DEBUG:boto:Method: GET 2024-04-16T18:48:43.763 DEBUG:boto:Path: /cjqttm-56/obj76 2024-04-16T18:48:43.763 DEBUG:boto:Data: 2024-04-16T18:48:43.763 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.763 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.763 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.763 DEBUG:boto:Params: {} 2024-04-16T18:48:43.763 DEBUG:boto:Token: None 2024-04-16T18:48:43.763 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj76 2024-04-16T18:48:43.763 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU= 2024-04-16T18:48:43.763 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU=', 'Content-Length': '0'} 2024-04-16T18:48:43.765 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb95e5a08dd8e335-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.766 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.766 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.766 DEBUG:boto:path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.766 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.766 DEBUG:boto:Method: GET 2024-04-16T18:48:43.766 DEBUG:boto:Path: /cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.766 DEBUG:boto:Data: 2024-04-16T18:48:43.766 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.766 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.766 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.767 DEBUG:boto:Params: {} 2024-04-16T18:48:43.767 DEBUG:boto:Token: None 2024-04-16T18:48:43.767 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.767 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.767 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.769 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008823745d7ecdd2b6-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.810 DEBUG:boto:b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.811 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.811 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.811 DEBUG:boto:path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.811 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.811 DEBUG:boto:Method: GET 2024-04-16T18:48:43.811 DEBUG:boto:Path: /cjqttm-56/?prefix=obj76 2024-04-16T18:48:43.811 DEBUG:boto:Data: 2024-04-16T18:48:43.811 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.811 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.811 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.811 DEBUG:boto:Params: {} 2024-04-16T18:48:43.812 DEBUG:boto:Token: None 2024-04-16T18:48:43.812 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.812 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.812 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.816 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f7417dfdfc7ded8-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.816 DEBUG:boto:b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.816 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:48:43.816 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.816 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.816 DEBUG:boto:path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.816 DEBUG:boto:auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.816 DEBUG:boto:Method: GET 2024-04-16T18:48:43.817 DEBUG:boto:Path: /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.817 DEBUG:boto:Data: 2024-04-16T18:48:43.817 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.817 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.817 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.817 DEBUG:boto:Params: {} 2024-04-16T18:48:43.817 DEBUG:boto:Token: None 2024-04-16T18:48:43.817 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.817 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T18:48:43.817 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T18:48:43.819 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009490afb9fbc15db2-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.862 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.863 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.863 DEBUG:boto:path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.863 DEBUG:boto:auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.863 DEBUG:boto:Method: GET 2024-04-16T18:48:43.863 DEBUG:boto:Path: /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.863 DEBUG:boto:Data: 2024-04-16T18:48:43.863 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.863 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.863 DEBUG:boto:Params: {} 2024-04-16T18:48:43.863 DEBUG:boto:Token: None 2024-04-16T18:48:43.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T18:48:43.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T18:48:43.866 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc668c93af97d158-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.866 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.866 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.866 DEBUG:boto:path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.866 DEBUG:boto:auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.866 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.866 DEBUG:boto:Path: /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.867 DEBUG:boto:Data: 2024-04-16T18:48:43.867 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.867 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.867 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.867 DEBUG:boto:Params: {} 2024-04-16T18:48:43.867 DEBUG:boto:Token: None 2024-04-16T18:48:43.867 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.867 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY= 2024-04-16T18:48:43.867 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY=', 'Content-Length': '0'} 2024-04-16T18:48:43.869 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d5d465f17f943d1-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.869 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.869 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.870 DEBUG:boto:path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.870 DEBUG:boto:auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.870 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.870 DEBUG:boto:Path: /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.870 DEBUG:boto:Data: 2024-04-16T18:48:43.870 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.870 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.870 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.870 DEBUG:boto:Params: {} 2024-04-16T18:48:43.870 DEBUG:boto:Token: None 2024-04-16T18:48:43.871 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.871 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY= 2024-04-16T18:48:43.871 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY=', 'Content-Length': '0'} 2024-04-16T18:48:43.872 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007897a81376da5413-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.873 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:48:43.873 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.873 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.873 DEBUG:boto:path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.873 DEBUG:boto:auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.873 DEBUG:boto:Method: GET 2024-04-16T18:48:43.873 DEBUG:boto:Path: /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.873 DEBUG:boto:Data: 2024-04-16T18:48:43.873 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.874 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.874 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.874 DEBUG:boto:Params: {} 2024-04-16T18:48:43.874 DEBUG:boto:Token: None 2024-04-16T18:48:43.874 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.874 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T18:48:43.874 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T18:48:43.876 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec14f12275761fc4-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.918 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.918 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.919 DEBUG:boto:path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.919 DEBUG:boto:auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.919 DEBUG:boto:Method: GET 2024-04-16T18:48:43.919 DEBUG:boto:Path: /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.919 DEBUG:boto:Data: 2024-04-16T18:48:43.919 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.919 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.919 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.919 DEBUG:boto:Params: {} 2024-04-16T18:48:43.919 DEBUG:boto:Token: None 2024-04-16T18:48:43.919 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85?versionId=null 2024-04-16T18:48:43.920 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T18:48:43.920 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T18:48:43.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043c48b04a9f4c8e8-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.922 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.922 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.922 DEBUG:boto:path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:43.922 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:43.922 DEBUG:boto:Method: GET 2024-04-16T18:48:43.922 DEBUG:boto:Path: /cjqttm-56/?prefix=obj85 2024-04-16T18:48:43.922 DEBUG:boto:Data: 2024-04-16T18:48:43.922 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.922 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.922 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.922 DEBUG:boto:Params: {} 2024-04-16T18:48:43.923 DEBUG:boto:Token: None 2024-04-16T18:48:43.923 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.925 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e016b2b56405ff4f-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.966 DEBUG:boto:b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.967 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:43.967 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:43.967 DEBUG:boto:path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:43.967 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:43.967 DEBUG:boto:Method: GET 2024-04-16T18:48:43.967 DEBUG:boto:Path: /cjqttm-56/?prefix=obj85 2024-04-16T18:48:43.967 DEBUG:boto:Data: 2024-04-16T18:48:43.967 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.967 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.967 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.967 DEBUG:boto:Params: {} 2024-04-16T18:48:43.968 DEBUG:boto:Token: None 2024-04-16T18:48:43.968 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/ 2024-04-16T18:48:43.968 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T18:48:43.968 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T18:48:43.971 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000611d60301ab809bb-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.971 DEBUG:boto:b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:43.972 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.972 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.972 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.972 DEBUG:boto:Path: /cjqttm-56/obj85 2024-04-16T18:48:43.972 DEBUG:boto:Data: 2024-04-16T18:48:43.972 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.972 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.972 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.972 DEBUG:boto:Params: {} 2024-04-16T18:48:43.973 DEBUG:boto:Token: None 2024-04-16T18:48:43.973 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85 2024-04-16T18:48:43.973 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0= 2024-04-16T18:48:43.973 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0=', 'Content-Length': '0'} 2024-04-16T18:48:43.975 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8290527d98211b7-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.975 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.975 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.975 DEBUG:boto:Method: HEAD 2024-04-16T18:48:43.975 DEBUG:boto:Path: /cjqttm-56/obj85 2024-04-16T18:48:43.975 DEBUG:boto:Data: 2024-04-16T18:48:43.975 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.975 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:43.975 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.976 DEBUG:boto:Params: {} 2024-04-16T18:48:43.976 DEBUG:boto:Token: None 2024-04-16T18:48:43.976 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85 2024-04-16T18:48:43.976 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0= 2024-04-16T18:48:43.976 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0=', 'Content-Length': '0'} 2024-04-16T18:48:43.978 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003734f2e08d97d251-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:43.978 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj85 2024-04-16T18:48:43.978 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:43.978 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:43.978 DEBUG:boto:Method: GET 2024-04-16T18:48:43.978 DEBUG:boto:Path: /cjqttm-56/obj85 2024-04-16T18:48:43.979 DEBUG:boto:Data: 2024-04-16T18:48:43.979 DEBUG:boto:Headers: {} 2024-04-16T18:48:43.979 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:43.979 DEBUG:boto:Port: 8000 2024-04-16T18:48:43.979 DEBUG:boto:Params: {} 2024-04-16T18:48:43.979 DEBUG:boto:Token: None 2024-04-16T18:48:43.979 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:43 GMT /cjqttm-56/obj85 2024-04-16T18:48:43.979 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:T5yLgmWaNjRz0pI+o+taE5SLXU0= 2024-04-16T18:48:43.979 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T5yLgmWaNjRz0pI+o+taE5SLXU0=', 'Content-Length': '0'} 2024-04-16T18:48:43.981 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c474ad52fe6eecfe-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.022 DEBUG:boto:path=/cjqttm-56/obj85 2024-04-16T18:48:44.022 DEBUG:boto:auth_path=/cjqttm-56/obj85 2024-04-16T18:48:44.023 DEBUG:boto:Method: GET 2024-04-16T18:48:44.023 DEBUG:boto:Path: /cjqttm-56/obj85 2024-04-16T18:48:44.023 DEBUG:boto:Data: 2024-04-16T18:48:44.023 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.023 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.023 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.023 DEBUG:boto:Params: {} 2024-04-16T18:48:44.023 DEBUG:boto:Token: None 2024-04-16T18:48:44.023 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj85 2024-04-16T18:48:44.023 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/dJwG0I+DUIlqNECdhOVx10iEn4= 2024-04-16T18:48:44.023 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/dJwG0I+DUIlqNECdhOVx10iEn4=', 'Content-Length': '0'} 2024-04-16T18:48:44.025 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b52f66ce2151e895-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.026 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.026 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.026 DEBUG:boto:path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:44.026 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:44.026 DEBUG:boto:Method: GET 2024-04-16T18:48:44.026 DEBUG:boto:Path: /cjqttm-56/?prefix=obj85 2024-04-16T18:48:44.026 DEBUG:boto:Data: 2024-04-16T18:48:44.026 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.026 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.026 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.026 DEBUG:boto:Params: {} 2024-04-16T18:48:44.027 DEBUG:boto:Token: None 2024-04-16T18:48:44.027 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.027 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.027 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.030 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1c2948474417f53-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.074 DEBUG:boto:b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.075 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.075 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.075 DEBUG:boto:path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:44.075 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T18:48:44.075 DEBUG:boto:Method: GET 2024-04-16T18:48:44.075 DEBUG:boto:Path: /cjqttm-56/?prefix=obj85 2024-04-16T18:48:44.075 DEBUG:boto:Data: 2024-04-16T18:48:44.075 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.075 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.075 DEBUG:boto:Params: {} 2024-04-16T18:48:44.076 DEBUG:boto:Token: None 2024-04-16T18:48:44.076 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.080 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000714a9535e9eb800f-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.080 DEBUG:boto:b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:48:44.080 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.081 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.081 DEBUG:boto:path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.081 DEBUG:boto:auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.081 DEBUG:boto:Method: GET 2024-04-16T18:48:44.081 DEBUG:boto:Path: /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.081 DEBUG:boto:Data: 2024-04-16T18:48:44.081 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.081 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.081 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.081 DEBUG:boto:Params: {} 2024-04-16T18:48:44.081 DEBUG:boto:Token: None 2024-04-16T18:48:44.081 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.082 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T18:48:44.082 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T18:48:44.084 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075068b372d2364d3-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.126 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.127 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.127 DEBUG:boto:path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.127 DEBUG:boto:auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.127 DEBUG:boto:Method: GET 2024-04-16T18:48:44.127 DEBUG:boto:Path: /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.127 DEBUG:boto:Data: 2024-04-16T18:48:44.127 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.127 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.127 DEBUG:boto:Params: {} 2024-04-16T18:48:44.127 DEBUG:boto:Token: None 2024-04-16T18:48:44.128 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T18:48:44.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T18:48:44.130 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0a41ede4b402e51-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.130 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.130 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.131 DEBUG:boto:path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.131 DEBUG:boto:auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.131 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.131 DEBUG:boto:Path: /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.131 DEBUG:boto:Data: 2024-04-16T18:48:44.131 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.131 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.131 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.131 DEBUG:boto:Params: {} 2024-04-16T18:48:44.131 DEBUG:boto:Token: None 2024-04-16T18:48:44.131 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ= 2024-04-16T18:48:44.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ=', 'Content-Length': '0'} 2024-04-16T18:48:44.134 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8fff536147ae245-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.134 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.134 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.134 DEBUG:boto:path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.134 DEBUG:boto:auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.134 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.134 DEBUG:boto:Path: /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.134 DEBUG:boto:Data: 2024-04-16T18:48:44.134 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.135 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.135 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.135 DEBUG:boto:Params: {} 2024-04-16T18:48:44.135 DEBUG:boto:Token: None 2024-04-16T18:48:44.135 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.135 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ= 2024-04-16T18:48:44.135 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ=', 'Content-Length': '0'} 2024-04-16T18:48:44.137 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ac91ce9e7eed93c-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:48:44.138 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.138 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.138 DEBUG:boto:path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.138 DEBUG:boto:auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.138 DEBUG:boto:Method: GET 2024-04-16T18:48:44.138 DEBUG:boto:Path: /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.138 DEBUG:boto:Data: 2024-04-16T18:48:44.138 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.138 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.138 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.138 DEBUG:boto:Params: {} 2024-04-16T18:48:44.139 DEBUG:boto:Token: None 2024-04-16T18:48:44.139 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.139 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T18:48:44.139 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T18:48:44.141 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000820e2ac0d7fb2e16-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.182 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.182 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.183 DEBUG:boto:path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.183 DEBUG:boto:auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.183 DEBUG:boto:Method: GET 2024-04-16T18:48:44.183 DEBUG:boto:Path: /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.183 DEBUG:boto:Data: 2024-04-16T18:48:44.183 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.183 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.183 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.183 DEBUG:boto:Params: {} 2024-04-16T18:48:44.183 DEBUG:boto:Token: None 2024-04-16T18:48:44.183 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87?versionId=null 2024-04-16T18:48:44.184 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T18:48:44.184 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T18:48:44.186 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a401e5f6e13c522b-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.186 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.186 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.186 DEBUG:boto:path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.186 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.186 DEBUG:boto:Method: GET 2024-04-16T18:48:44.187 DEBUG:boto:Path: /cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.187 DEBUG:boto:Data: 2024-04-16T18:48:44.187 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.187 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.187 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.187 DEBUG:boto:Params: {} 2024-04-16T18:48:44.187 DEBUG:boto:Token: None 2024-04-16T18:48:44.187 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.187 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.187 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.189 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a2fbfae20e52775-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.230 DEBUG:boto:b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.231 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.231 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.231 DEBUG:boto:path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.231 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.231 DEBUG:boto:Method: GET 2024-04-16T18:48:44.231 DEBUG:boto:Path: /cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.231 DEBUG:boto:Data: 2024-04-16T18:48:44.232 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.232 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.232 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.232 DEBUG:boto:Params: {} 2024-04-16T18:48:44.232 DEBUG:boto:Token: None 2024-04-16T18:48:44.232 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.236 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097ba378ea644a383-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.236 DEBUG:boto:b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.236 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.236 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.236 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.236 DEBUG:boto:Path: /cjqttm-56/obj87 2024-04-16T18:48:44.236 DEBUG:boto:Data: 2024-04-16T18:48:44.237 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.237 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.237 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.237 DEBUG:boto:Params: {} 2024-04-16T18:48:44.237 DEBUG:boto:Token: None 2024-04-16T18:48:44.237 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87 2024-04-16T18:48:44.237 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E= 2024-04-16T18:48:44.237 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E=', 'Content-Length': '0'} 2024-04-16T18:48:44.239 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb70d526cbb41443-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.239 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.240 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.240 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.240 DEBUG:boto:Path: /cjqttm-56/obj87 2024-04-16T18:48:44.240 DEBUG:boto:Data: 2024-04-16T18:48:44.240 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.240 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.240 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.240 DEBUG:boto:Params: {} 2024-04-16T18:48:44.240 DEBUG:boto:Token: None 2024-04-16T18:48:44.240 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87 2024-04-16T18:48:44.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E= 2024-04-16T18:48:44.241 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E=', 'Content-Length': '0'} 2024-04-16T18:48:44.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062f6c099dfe3e69f-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.242 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj87 2024-04-16T18:48:44.243 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.243 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.243 DEBUG:boto:Method: GET 2024-04-16T18:48:44.243 DEBUG:boto:Path: /cjqttm-56/obj87 2024-04-16T18:48:44.243 DEBUG:boto:Data: 2024-04-16T18:48:44.243 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.243 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.243 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.243 DEBUG:boto:Params: {} 2024-04-16T18:48:44.243 DEBUG:boto:Token: None 2024-04-16T18:48:44.244 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87 2024-04-16T18:48:44.244 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM= 2024-04-16T18:48:44.244 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM=', 'Content-Length': '0'} 2024-04-16T18:48:44.245 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6315813ca592e63-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.286 DEBUG:boto:path=/cjqttm-56/obj87 2024-04-16T18:48:44.286 DEBUG:boto:auth_path=/cjqttm-56/obj87 2024-04-16T18:48:44.287 DEBUG:boto:Method: GET 2024-04-16T18:48:44.287 DEBUG:boto:Path: /cjqttm-56/obj87 2024-04-16T18:48:44.287 DEBUG:boto:Data: 2024-04-16T18:48:44.287 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.287 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.287 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.287 DEBUG:boto:Params: {} 2024-04-16T18:48:44.287 DEBUG:boto:Token: None 2024-04-16T18:48:44.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj87 2024-04-16T18:48:44.287 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM= 2024-04-16T18:48:44.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM=', 'Content-Length': '0'} 2024-04-16T18:48:44.289 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e349b9186d0a8435-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.289 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.290 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.290 DEBUG:boto:path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.290 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.290 DEBUG:boto:Method: GET 2024-04-16T18:48:44.290 DEBUG:boto:Path: /cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.290 DEBUG:boto:Data: 2024-04-16T18:48:44.290 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.290 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.290 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.290 DEBUG:boto:Params: {} 2024-04-16T18:48:44.291 DEBUG:boto:Token: None 2024-04-16T18:48:44.291 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.291 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.291 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.293 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c19abc9e2542b6bf-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.334 DEBUG:boto:b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.335 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.335 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.335 DEBUG:boto:path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.335 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.335 DEBUG:boto:Method: GET 2024-04-16T18:48:44.335 DEBUG:boto:Path: /cjqttm-56/?prefix=obj87 2024-04-16T18:48:44.335 DEBUG:boto:Data: 2024-04-16T18:48:44.335 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.335 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.335 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.336 DEBUG:boto:Params: {} 2024-04-16T18:48:44.336 DEBUG:boto:Token: None 2024-04-16T18:48:44.336 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.336 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.339 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f45c3189d003bcad-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.340 DEBUG:boto:b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:48:44.340 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.340 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.340 DEBUG:boto:path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.340 DEBUG:boto:auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.340 DEBUG:boto:Method: GET 2024-04-16T18:48:44.340 DEBUG:boto:Path: /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.341 DEBUG:boto:Data: 2024-04-16T18:48:44.341 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.341 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.341 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.341 DEBUG:boto:Params: {} 2024-04-16T18:48:44.341 DEBUG:boto:Token: None 2024-04-16T18:48:44.341 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.341 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T18:48:44.341 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T18:48:44.344 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005731ec984081cd9e-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.386 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.386 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.386 DEBUG:boto:path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.387 DEBUG:boto:auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.387 DEBUG:boto:Method: GET 2024-04-16T18:48:44.387 DEBUG:boto:Path: /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.387 DEBUG:boto:Data: 2024-04-16T18:48:44.387 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.387 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.387 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.387 DEBUG:boto:Params: {} 2024-04-16T18:48:44.387 DEBUG:boto:Token: None 2024-04-16T18:48:44.387 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.388 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T18:48:44.388 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T18:48:44.390 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087c7e5558a256208-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.390 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.390 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.390 DEBUG:boto:path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.390 DEBUG:boto:auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.391 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.391 DEBUG:boto:Path: /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.391 DEBUG:boto:Data: 2024-04-16T18:48:44.391 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.391 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.391 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.391 DEBUG:boto:Params: {} 2024-04-16T18:48:44.391 DEBUG:boto:Token: None 2024-04-16T18:48:44.391 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.391 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU= 2024-04-16T18:48:44.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU=', 'Content-Length': '0'} 2024-04-16T18:48:44.393 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000435f0c169caa4db4-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.394 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.394 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.394 DEBUG:boto:path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.394 DEBUG:boto:auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.394 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.394 DEBUG:boto:Path: /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.394 DEBUG:boto:Data: 2024-04-16T18:48:44.394 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.394 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.394 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.395 DEBUG:boto:Params: {} 2024-04-16T18:48:44.395 DEBUG:boto:Token: None 2024-04-16T18:48:44.395 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.395 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU= 2024-04-16T18:48:44.395 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU=', 'Content-Length': '0'} 2024-04-16T18:48:44.397 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9f0cdce18ef472c-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.397 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:48:44.397 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.397 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.397 DEBUG:boto:path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.398 DEBUG:boto:auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.398 DEBUG:boto:Method: GET 2024-04-16T18:48:44.398 DEBUG:boto:Path: /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.398 DEBUG:boto:Data: 2024-04-16T18:48:44.398 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.398 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.398 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.398 DEBUG:boto:Params: {} 2024-04-16T18:48:44.398 DEBUG:boto:Token: None 2024-04-16T18:48:44.398 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.399 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T18:48:44.399 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T18:48:44.401 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5d533bd091e6984-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.442 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.443 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.443 DEBUG:boto:path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.443 DEBUG:boto:auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.443 DEBUG:boto:Method: GET 2024-04-16T18:48:44.443 DEBUG:boto:Path: /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.443 DEBUG:boto:Data: 2024-04-16T18:48:44.443 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.443 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.443 DEBUG:boto:Params: {} 2024-04-16T18:48:44.443 DEBUG:boto:Token: None 2024-04-16T18:48:44.443 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92?versionId=null 2024-04-16T18:48:44.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T18:48:44.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T18:48:44.446 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c6538f40167b14e-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.447 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.447 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.447 DEBUG:boto:path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.447 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.447 DEBUG:boto:Method: GET 2024-04-16T18:48:44.447 DEBUG:boto:Path: /cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.447 DEBUG:boto:Data: 2024-04-16T18:48:44.447 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.447 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.447 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.447 DEBUG:boto:Params: {} 2024-04-16T18:48:44.448 DEBUG:boto:Token: None 2024-04-16T18:48:44.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.451 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6c0baf83366a21a-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.494 DEBUG:boto:b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.495 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.495 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.495 DEBUG:boto:path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.495 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.495 DEBUG:boto:Method: GET 2024-04-16T18:48:44.495 DEBUG:boto:Path: /cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.495 DEBUG:boto:Data: 2024-04-16T18:48:44.495 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.495 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.495 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.495 DEBUG:boto:Params: {} 2024-04-16T18:48:44.496 DEBUG:boto:Token: None 2024-04-16T18:48:44.496 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.496 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.496 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.499 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008cb7409a730b1ea-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.499 DEBUG:boto:b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.499 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.500 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.500 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.500 DEBUG:boto:Path: /cjqttm-56/obj92 2024-04-16T18:48:44.500 DEBUG:boto:Data: 2024-04-16T18:48:44.500 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.500 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.500 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.500 DEBUG:boto:Params: {} 2024-04-16T18:48:44.500 DEBUG:boto:Token: None 2024-04-16T18:48:44.501 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92 2024-04-16T18:48:44.501 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA= 2024-04-16T18:48:44.501 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA=', 'Content-Length': '0'} 2024-04-16T18:48:44.503 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d417a398678fbd9f-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.503 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.503 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.503 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.503 DEBUG:boto:Path: /cjqttm-56/obj92 2024-04-16T18:48:44.503 DEBUG:boto:Data: 2024-04-16T18:48:44.504 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.504 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.504 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.504 DEBUG:boto:Params: {} 2024-04-16T18:48:44.504 DEBUG:boto:Token: None 2024-04-16T18:48:44.504 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92 2024-04-16T18:48:44.504 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA= 2024-04-16T18:48:44.504 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA=', 'Content-Length': '0'} 2024-04-16T18:48:44.507 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049afdf8ecc3ddcde-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.507 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj92 2024-04-16T18:48:44.507 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.507 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.507 DEBUG:boto:Method: GET 2024-04-16T18:48:44.507 DEBUG:boto:Path: /cjqttm-56/obj92 2024-04-16T18:48:44.507 DEBUG:boto:Data: 2024-04-16T18:48:44.507 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.508 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.508 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.508 DEBUG:boto:Params: {} 2024-04-16T18:48:44.508 DEBUG:boto:Token: None 2024-04-16T18:48:44.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92 2024-04-16T18:48:44.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE= 2024-04-16T18:48:44.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE=', 'Content-Length': '0'} 2024-04-16T18:48:44.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000251b016b8b8914ee-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.554 DEBUG:boto:path=/cjqttm-56/obj92 2024-04-16T18:48:44.554 DEBUG:boto:auth_path=/cjqttm-56/obj92 2024-04-16T18:48:44.555 DEBUG:boto:Method: GET 2024-04-16T18:48:44.555 DEBUG:boto:Path: /cjqttm-56/obj92 2024-04-16T18:48:44.555 DEBUG:boto:Data: 2024-04-16T18:48:44.555 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.555 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.555 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.555 DEBUG:boto:Params: {} 2024-04-16T18:48:44.555 DEBUG:boto:Token: None 2024-04-16T18:48:44.555 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj92 2024-04-16T18:48:44.555 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE= 2024-04-16T18:48:44.556 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE=', 'Content-Length': '0'} 2024-04-16T18:48:44.557 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b85a581985354e28-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.557 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.558 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.558 DEBUG:boto:path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.558 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.558 DEBUG:boto:Method: GET 2024-04-16T18:48:44.558 DEBUG:boto:Path: /cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.558 DEBUG:boto:Data: 2024-04-16T18:48:44.558 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.558 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.558 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.559 DEBUG:boto:Params: {} 2024-04-16T18:48:44.559 DEBUG:boto:Token: None 2024-04-16T18:48:44.559 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.559 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.559 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.561 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb8cc5141f8df787-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.602 DEBUG:boto:b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.603 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.603 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.603 DEBUG:boto:path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.603 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.603 DEBUG:boto:Method: GET 2024-04-16T18:48:44.603 DEBUG:boto:Path: /cjqttm-56/?prefix=obj92 2024-04-16T18:48:44.603 DEBUG:boto:Data: 2024-04-16T18:48:44.604 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.604 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.604 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.604 DEBUG:boto:Params: {} 2024-04-16T18:48:44.604 DEBUG:boto:Token: None 2024-04-16T18:48:44.604 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.604 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.608 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e2ef1f83f668921-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.608 DEBUG:boto:b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.608 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:48:44.608 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.609 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.609 DEBUG:boto:path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.609 DEBUG:boto:auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.609 DEBUG:boto:Method: GET 2024-04-16T18:48:44.609 DEBUG:boto:Path: /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.609 DEBUG:boto:Data: 2024-04-16T18:48:44.609 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.609 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.609 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.609 DEBUG:boto:Params: {} 2024-04-16T18:48:44.609 DEBUG:boto:Token: None 2024-04-16T18:48:44.610 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T18:48:44.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T18:48:44.612 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018e7978a357e08bb-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.654 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.655 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.655 DEBUG:boto:path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.655 DEBUG:boto:auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.655 DEBUG:boto:Method: GET 2024-04-16T18:48:44.655 DEBUG:boto:Path: /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.655 DEBUG:boto:Data: 2024-04-16T18:48:44.655 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.655 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.655 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.655 DEBUG:boto:Params: {} 2024-04-16T18:48:44.655 DEBUG:boto:Token: None 2024-04-16T18:48:44.656 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.656 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T18:48:44.656 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T18:48:44.658 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e498f36258e1309-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.658 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.658 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.659 DEBUG:boto:path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.659 DEBUG:boto:auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.659 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.659 DEBUG:boto:Path: /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.659 DEBUG:boto:Data: 2024-04-16T18:48:44.659 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.659 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.659 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.659 DEBUG:boto:Params: {} 2024-04-16T18:48:44.659 DEBUG:boto:Token: None 2024-04-16T18:48:44.660 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.660 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0= 2024-04-16T18:48:44.660 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0=', 'Content-Length': '0'} 2024-04-16T18:48:44.662 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000804ffc89855bab67-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.662 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.662 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.662 DEBUG:boto:path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.662 DEBUG:boto:auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.662 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.662 DEBUG:boto:Path: /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.663 DEBUG:boto:Data: 2024-04-16T18:48:44.663 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.663 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.663 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.663 DEBUG:boto:Params: {} 2024-04-16T18:48:44.663 DEBUG:boto:Token: None 2024-04-16T18:48:44.663 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.663 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0= 2024-04-16T18:48:44.663 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0=', 'Content-Length': '0'} 2024-04-16T18:48:44.665 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092d82fec13060062-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.666 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:48:44.666 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.666 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.666 DEBUG:boto:path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.666 DEBUG:boto:auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.666 DEBUG:boto:Method: GET 2024-04-16T18:48:44.666 DEBUG:boto:Path: /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.666 DEBUG:boto:Data: 2024-04-16T18:48:44.666 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.667 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.667 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.667 DEBUG:boto:Params: {} 2024-04-16T18:48:44.667 DEBUG:boto:Token: None 2024-04-16T18:48:44.667 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.667 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T18:48:44.667 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T18:48:44.669 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ba7fba074534281-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.710 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.710 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.711 DEBUG:boto:path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.711 DEBUG:boto:auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.711 DEBUG:boto:Method: GET 2024-04-16T18:48:44.711 DEBUG:boto:Path: /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.711 DEBUG:boto:Data: 2024-04-16T18:48:44.711 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.711 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.711 DEBUG:boto:Params: {} 2024-04-16T18:48:44.711 DEBUG:boto:Token: None 2024-04-16T18:48:44.712 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93?versionId=null 2024-04-16T18:48:44.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T18:48:44.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T18:48:44.714 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e647403906ab7b-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.714 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.714 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.714 DEBUG:boto:path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.714 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.715 DEBUG:boto:Method: GET 2024-04-16T18:48:44.715 DEBUG:boto:Path: /cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.715 DEBUG:boto:Data: 2024-04-16T18:48:44.715 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.715 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.715 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.715 DEBUG:boto:Params: {} 2024-04-16T18:48:44.715 DEBUG:boto:Token: None 2024-04-16T18:48:44.715 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.715 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.715 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.718 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004aa4002f7f8504d-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.758 DEBUG:boto:b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.759 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.759 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.759 DEBUG:boto:path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.759 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.759 DEBUG:boto:Method: GET 2024-04-16T18:48:44.759 DEBUG:boto:Path: /cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.759 DEBUG:boto:Data: 2024-04-16T18:48:44.759 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.759 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.759 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.760 DEBUG:boto:Params: {} 2024-04-16T18:48:44.760 DEBUG:boto:Token: None 2024-04-16T18:48:44.760 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.760 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.760 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.764 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023426b5fae258f91-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.764 DEBUG:boto:b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.764 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.764 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.764 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.765 DEBUG:boto:Path: /cjqttm-56/obj93 2024-04-16T18:48:44.765 DEBUG:boto:Data: 2024-04-16T18:48:44.765 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.765 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.765 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.765 DEBUG:boto:Params: {} 2024-04-16T18:48:44.765 DEBUG:boto:Token: None 2024-04-16T18:48:44.765 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93 2024-04-16T18:48:44.765 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA= 2024-04-16T18:48:44.765 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA=', 'Content-Length': '0'} 2024-04-16T18:48:44.767 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d1b92ade608c5fc-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.768 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.768 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.768 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.768 DEBUG:boto:Path: /cjqttm-56/obj93 2024-04-16T18:48:44.768 DEBUG:boto:Data: 2024-04-16T18:48:44.768 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.768 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.768 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.768 DEBUG:boto:Params: {} 2024-04-16T18:48:44.768 DEBUG:boto:Token: None 2024-04-16T18:48:44.768 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93 2024-04-16T18:48:44.769 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA= 2024-04-16T18:48:44.769 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA=', 'Content-Length': '0'} 2024-04-16T18:48:44.771 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094eebb4a36dba758-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.771 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj93 2024-04-16T18:48:44.771 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.771 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.771 DEBUG:boto:Method: GET 2024-04-16T18:48:44.771 DEBUG:boto:Path: /cjqttm-56/obj93 2024-04-16T18:48:44.771 DEBUG:boto:Data: 2024-04-16T18:48:44.772 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.772 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.772 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.772 DEBUG:boto:Params: {} 2024-04-16T18:48:44.772 DEBUG:boto:Token: None 2024-04-16T18:48:44.772 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93 2024-04-16T18:48:44.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM= 2024-04-16T18:48:44.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM=', 'Content-Length': '0'} 2024-04-16T18:48:44.774 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009405d66546684d37-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.814 DEBUG:boto:path=/cjqttm-56/obj93 2024-04-16T18:48:44.814 DEBUG:boto:auth_path=/cjqttm-56/obj93 2024-04-16T18:48:44.815 DEBUG:boto:Method: GET 2024-04-16T18:48:44.815 DEBUG:boto:Path: /cjqttm-56/obj93 2024-04-16T18:48:44.815 DEBUG:boto:Data: 2024-04-16T18:48:44.815 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.815 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.815 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.815 DEBUG:boto:Params: {} 2024-04-16T18:48:44.815 DEBUG:boto:Token: None 2024-04-16T18:48:44.815 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj93 2024-04-16T18:48:44.815 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM= 2024-04-16T18:48:44.815 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM=', 'Content-Length': '0'} 2024-04-16T18:48:44.818 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025ac429589de69a7-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.818 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.818 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.818 DEBUG:boto:path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.818 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.818 DEBUG:boto:Method: GET 2024-04-16T18:48:44.819 DEBUG:boto:Path: /cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.819 DEBUG:boto:Data: 2024-04-16T18:48:44.819 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.819 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.819 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.819 DEBUG:boto:Params: {} 2024-04-16T18:48:44.819 DEBUG:boto:Token: None 2024-04-16T18:48:44.819 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.819 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.819 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.821 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f0fa6dc1ce98329-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.862 DEBUG:boto:b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.863 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.863 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.863 DEBUG:boto:path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.863 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.863 DEBUG:boto:Method: GET 2024-04-16T18:48:44.863 DEBUG:boto:Path: /cjqttm-56/?prefix=obj93 2024-04-16T18:48:44.863 DEBUG:boto:Data: 2024-04-16T18:48:44.863 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.863 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.863 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.863 DEBUG:boto:Params: {} 2024-04-16T18:48:44.864 DEBUG:boto:Token: None 2024-04-16T18:48:44.864 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.864 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.864 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.867 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000916bb368a5f2b669-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.868 DEBUG:boto:b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:44.868 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:48:44.868 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:44.868 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:44.868 DEBUG:boto:path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.868 DEBUG:boto:auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.868 DEBUG:boto:Method: GET 2024-04-16T18:48:44.868 DEBUG:boto:Path: /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.869 DEBUG:boto:Data: 2024-04-16T18:48:44.869 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.869 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.869 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.869 DEBUG:boto:Params: {} 2024-04-16T18:48:44.869 DEBUG:boto:Token: None 2024-04-16T18:48:44.869 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.869 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T18:48:44.869 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T18:48:44.871 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aab34ee619373cc4-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.914 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:44.915 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:44.915 DEBUG:boto:path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.915 DEBUG:boto:auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.915 DEBUG:boto:Method: GET 2024-04-16T18:48:44.915 DEBUG:boto:Path: /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.915 DEBUG:boto:Data: 2024-04-16T18:48:44.915 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.915 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.915 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.915 DEBUG:boto:Params: {} 2024-04-16T18:48:44.916 DEBUG:boto:Token: None 2024-04-16T18:48:44.916 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.916 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T18:48:44.916 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T18:48:44.918 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e199995cd009512-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.918 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:44.918 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:44.918 DEBUG:boto:path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.918 DEBUG:boto:auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.918 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.918 DEBUG:boto:Path: /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.919 DEBUG:boto:Data: 2024-04-16T18:48:44.919 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.919 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.919 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.919 DEBUG:boto:Params: {} 2024-04-16T18:48:44.919 DEBUG:boto:Token: None 2024-04-16T18:48:44.919 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.919 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI= 2024-04-16T18:48:44.919 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI=', 'Content-Length': '0'} 2024-04-16T18:48:44.921 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037ce6d30c38c5fb4-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.921 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:44.921 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:44.921 DEBUG:boto:path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.922 DEBUG:boto:auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.922 DEBUG:boto:Method: HEAD 2024-04-16T18:48:44.922 DEBUG:boto:Path: /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.922 DEBUG:boto:Data: 2024-04-16T18:48:44.922 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.922 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.922 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.922 DEBUG:boto:Params: {} 2024-04-16T18:48:44.922 DEBUG:boto:Token: None 2024-04-16T18:48:44.922 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.922 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI= 2024-04-16T18:48:44.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI=', 'Content-Length': '0'} 2024-04-16T18:48:44.924 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000803b259f555b8c08-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.924 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:48:44.925 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:44.925 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:44.925 DEBUG:boto:path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.925 DEBUG:boto:auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.925 DEBUG:boto:Method: GET 2024-04-16T18:48:44.925 DEBUG:boto:Path: /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.925 DEBUG:boto:Data: 2024-04-16T18:48:44.925 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.925 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.925 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.925 DEBUG:boto:Params: {} 2024-04-16T18:48:44.926 DEBUG:boto:Token: None 2024-04-16T18:48:44.926 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.926 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T18:48:44.926 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T18:48:44.928 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca2f316497ee146d-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.970 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:44.971 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:44.971 DEBUG:boto:path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.971 DEBUG:boto:auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.971 DEBUG:boto:Method: GET 2024-04-16T18:48:44.971 DEBUG:boto:Path: /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.971 DEBUG:boto:Data: 2024-04-16T18:48:44.971 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.971 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:44.971 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.971 DEBUG:boto:Params: {} 2024-04-16T18:48:44.972 DEBUG:boto:Token: None 2024-04-16T18:48:44.972 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/obj95?versionId=null 2024-04-16T18:48:44.972 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T18:48:44.972 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T18:48:44.974 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a0f9fb8274001a0-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:44.974 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:44.974 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:44.974 DEBUG:boto:path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:44.974 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:44.974 DEBUG:boto:Method: GET 2024-04-16T18:48:44.975 DEBUG:boto:Path: /cjqttm-56/?prefix=obj95 2024-04-16T18:48:44.975 DEBUG:boto:Data: 2024-04-16T18:48:44.975 DEBUG:boto:Headers: {} 2024-04-16T18:48:44.975 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:44.975 DEBUG:boto:Port: 8000 2024-04-16T18:48:44.975 DEBUG:boto:Params: {} 2024-04-16T18:48:44.975 DEBUG:boto:Token: None 2024-04-16T18:48:44.975 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:44 GMT /cjqttm-56/ 2024-04-16T18:48:44.975 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T18:48:44.975 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T18:48:44.978 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a4cf67f7c63e293-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.018 DEBUG:boto:b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:45.019 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:45.019 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:45.019 DEBUG:boto:path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.019 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.019 DEBUG:boto:Method: GET 2024-04-16T18:48:45.019 DEBUG:boto:Path: /cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.019 DEBUG:boto:Data: 2024-04-16T18:48:45.019 DEBUG:boto:Headers: {} 2024-04-16T18:48:45.019 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:45.019 DEBUG:boto:Port: 8000 2024-04-16T18:48:45.020 DEBUG:boto:Params: {} 2024-04-16T18:48:45.020 DEBUG:boto:Token: None 2024-04-16T18:48:45.020 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:45 GMT /cjqttm-56/ 2024-04-16T18:48:45.020 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo= 2024-04-16T18:48:45.020 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo=', 'Content-Length': '0'} 2024-04-16T18:48:45.024 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e908b7e152a10b34-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.024 DEBUG:boto:b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:45.024 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:45.024 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:45.024 DEBUG:boto:Method: HEAD 2024-04-16T18:48:45.024 DEBUG:boto:Path: /cjqttm-56/obj95 2024-04-16T18:48:45.024 DEBUG:boto:Data: 2024-04-16T18:48:45.025 DEBUG:boto:Headers: {} 2024-04-16T18:48:45.025 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:45.025 DEBUG:boto:Port: 8000 2024-04-16T18:48:45.025 DEBUG:boto:Params: {} 2024-04-16T18:48:45.025 DEBUG:boto:Token: None 2024-04-16T18:48:45.025 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:45 GMT /cjqttm-56/obj95 2024-04-16T18:48:45.025 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs= 2024-04-16T18:48:45.025 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs=', 'Content-Length': '0'} 2024-04-16T18:48:45.027 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ae19cf2188780c3-00661ec80d-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.027 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:45.027 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:45.027 DEBUG:boto:Method: HEAD 2024-04-16T18:48:45.028 DEBUG:boto:Path: /cjqttm-56/obj95 2024-04-16T18:48:45.028 DEBUG:boto:Data: 2024-04-16T18:48:45.028 DEBUG:boto:Headers: {} 2024-04-16T18:48:45.028 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:45.028 DEBUG:boto:Port: 8000 2024-04-16T18:48:45.028 DEBUG:boto:Params: {} 2024-04-16T18:48:45.028 DEBUG:boto:Token: None 2024-04-16T18:48:45.028 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:45 GMT /cjqttm-56/obj95 2024-04-16T18:48:45.028 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs= 2024-04-16T18:48:45.028 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs=', 'Content-Length': '0'} 2024-04-16T18:48:45.030 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cd7077d1efe247b-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.031 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj95 2024-04-16T18:48:45.031 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:45.031 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:45.031 DEBUG:boto:Method: GET 2024-04-16T18:48:45.031 DEBUG:boto:Path: /cjqttm-56/obj95 2024-04-16T18:48:45.031 DEBUG:boto:Data: 2024-04-16T18:48:45.031 DEBUG:boto:Headers: {} 2024-04-16T18:48:45.031 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:45.031 DEBUG:boto:Port: 8000 2024-04-16T18:48:45.031 DEBUG:boto:Params: {} 2024-04-16T18:48:45.032 DEBUG:boto:Token: None 2024-04-16T18:48:45.032 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:45 GMT /cjqttm-56/obj95 2024-04-16T18:48:45.032 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU= 2024-04-16T18:48:45.032 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU=', 'Content-Length': '0'} 2024-04-16T18:48:45.034 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0628b5dc9d0d9d2-00661ec80d-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.074 DEBUG:boto:path=/cjqttm-56/obj95 2024-04-16T18:48:45.074 DEBUG:boto:auth_path=/cjqttm-56/obj95 2024-04-16T18:48:45.075 DEBUG:boto:Method: GET 2024-04-16T18:48:45.075 DEBUG:boto:Path: /cjqttm-56/obj95 2024-04-16T18:48:45.075 DEBUG:boto:Data: 2024-04-16T18:48:45.075 DEBUG:boto:Headers: {} 2024-04-16T18:48:45.075 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:45.075 DEBUG:boto:Port: 8000 2024-04-16T18:48:45.075 DEBUG:boto:Params: {} 2024-04-16T18:48:45.075 DEBUG:boto:Token: None 2024-04-16T18:48:45.075 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:45 GMT /cjqttm-56/obj95 2024-04-16T18:48:45.076 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU= 2024-04-16T18:48:45.076 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU=', 'Content-Length': '0'} 2024-04-16T18:48:45.077 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f007e9016e896a9-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.078 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:45.078 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:45.078 DEBUG:boto:path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.078 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.078 DEBUG:boto:Method: GET 2024-04-16T18:48:45.078 DEBUG:boto:Path: /cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.078 DEBUG:boto:Data: 2024-04-16T18:48:45.079 DEBUG:boto:Headers: {} 2024-04-16T18:48:45.079 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:45.079 DEBUG:boto:Port: 8000 2024-04-16T18:48:45.079 DEBUG:boto:Params: {} 2024-04-16T18:48:45.079 DEBUG:boto:Token: None 2024-04-16T18:48:45.079 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:45 GMT /cjqttm-56/ 2024-04-16T18:48:45.079 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo= 2024-04-16T18:48:45.079 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo=', 'Content-Length': '0'} 2024-04-16T18:48:45.082 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047e600837ac0c0db-00661ec80d-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.122 DEBUG:boto:b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:45.123 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:45.123 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:45.123 DEBUG:boto:path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.123 DEBUG:boto:auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.123 DEBUG:boto:Method: GET 2024-04-16T18:48:45.123 DEBUG:boto:Path: /cjqttm-56/?prefix=obj95 2024-04-16T18:48:45.123 DEBUG:boto:Data: 2024-04-16T18:48:45.123 DEBUG:boto:Headers: {} 2024-04-16T18:48:45.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:45.123 DEBUG:boto:Port: 8000 2024-04-16T18:48:45.124 DEBUG:boto:Params: {} 2024-04-16T18:48:45.124 DEBUG:boto:Token: None 2024-04-16T18:48:45.124 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:48:45 GMT /cjqttm-56/ 2024-04-16T18:48:45.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo= 2024-04-16T18:48:45.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo=', 'Content-Length': '0'} 2024-04-16T18:48:45.127 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5961240e8bba34d-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:45.128 DEBUG:boto:b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:48:45.128 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-56 zones={test-zone2, test-zone1} 2024-04-16T18:48:45.129 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:48:45.129 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:48:45.130 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:48:45.131+0000 7f5d6d673640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 212645) UID: 0 2024-04-16T18:48:45.130 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:48:45.131+0000 7f5d70ecc880 -1 shutting down 2024-04-16T18:48:48.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:48:51.229 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:48:51.229 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:51.229 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:51.230 DEBUG:boto:Method: HEAD 2024-04-16T18:48:51.230 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:48:51.230 DEBUG:boto:Data: 2024-04-16T18:48:51.230 DEBUG:boto:Headers: {} 2024-04-16T18:48:51.230 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.230 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.230 DEBUG:boto:Params: {} 2024-04-16T18:48:51.231 DEBUG:boto:Token: None 2024-04-16T18:48:51.231 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/ 2024-04-16T18:48:51.231 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T18:48:51.231 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T18:48:51.236 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005b05e08051960a9b-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.236 DEBUG:boto:path=/cjqttm-56/obj37 2024-04-16T18:48:51.236 DEBUG:boto:auth_path=/cjqttm-56/obj37 2024-04-16T18:48:51.236 DEBUG:boto:Method: PUT 2024-04-16T18:48:51.237 DEBUG:boto:Path: /cjqttm-56/obj37 2024-04-16T18:48:51.237 DEBUG:boto:Data: 2024-04-16T18:48:51.237 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:48:51.237 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.237 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.237 DEBUG:boto:Params: {} 2024-04-16T18:48:51.237 DEBUG:boto:Token: None 2024-04-16T18:48:51.238 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/obj37 2024-04-16T18:48:51.238 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:aLi91ushZoLRLcq6kQqvSp5DLgU= 2024-04-16T18:48:51.238 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aLi91ushZoLRLcq6kQqvSp5DLgU='} 2024-04-16T18:48:51.247 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fa91b293fc832def-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.247 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:51.247 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:51.247 DEBUG:boto:Method: HEAD 2024-04-16T18:48:51.247 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:48:51.247 DEBUG:boto:Data: 2024-04-16T18:48:51.248 DEBUG:boto:Headers: {} 2024-04-16T18:48:51.248 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.248 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.248 DEBUG:boto:Params: {} 2024-04-16T18:48:51.248 DEBUG:boto:Token: None 2024-04-16T18:48:51.248 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/ 2024-04-16T18:48:51.248 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T18:48:51.249 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T18:48:51.252 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a1fb2623571fa274-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.252 DEBUG:boto:path=/cjqttm-56/obj74 2024-04-16T18:48:51.252 DEBUG:boto:auth_path=/cjqttm-56/obj74 2024-04-16T18:48:51.253 DEBUG:boto:Method: PUT 2024-04-16T18:48:51.253 DEBUG:boto:Path: /cjqttm-56/obj74 2024-04-16T18:48:51.253 DEBUG:boto:Data: 2024-04-16T18:48:51.253 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:48:51.253 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.253 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.253 DEBUG:boto:Params: {} 2024-04-16T18:48:51.253 DEBUG:boto:Token: None 2024-04-16T18:48:51.254 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/obj74 2024-04-16T18:48:51.254 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NQvgbw9K6d+sZ02vqLzprbanB7U= 2024-04-16T18:48:51.254 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NQvgbw9K6d+sZ02vqLzprbanB7U='} 2024-04-16T18:48:51.298 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a1920b4ef003231b-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.299 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:51.299 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:51.299 DEBUG:boto:Method: HEAD 2024-04-16T18:48:51.299 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:48:51.299 DEBUG:boto:Data: 2024-04-16T18:48:51.299 DEBUG:boto:Headers: {} 2024-04-16T18:48:51.300 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.300 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.300 DEBUG:boto:Params: {} 2024-04-16T18:48:51.300 DEBUG:boto:Token: None 2024-04-16T18:48:51.300 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/ 2024-04-16T18:48:51.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T18:48:51.301 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T18:48:51.304 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fbc1be1a6a4c5788-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.304 DEBUG:boto:path=/cjqttm-56/obj111 2024-04-16T18:48:51.304 DEBUG:boto:auth_path=/cjqttm-56/obj111 2024-04-16T18:48:51.304 DEBUG:boto:Method: PUT 2024-04-16T18:48:51.305 DEBUG:boto:Path: /cjqttm-56/obj111 2024-04-16T18:48:51.305 DEBUG:boto:Data: 2024-04-16T18:48:51.305 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:48:51.305 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.305 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.305 DEBUG:boto:Params: {} 2024-04-16T18:48:51.305 DEBUG:boto:Token: None 2024-04-16T18:48:51.306 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/obj111 2024-04-16T18:48:51.306 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Ev/kCDlUiK5jewA47OHSK9nPQOk= 2024-04-16T18:48:51.306 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ev/kCDlUiK5jewA47OHSK9nPQOk='} 2024-04-16T18:48:51.315 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b844003a0fdf1a0-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.315 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:51.315 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:51.315 DEBUG:boto:Method: HEAD 2024-04-16T18:48:51.316 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:48:51.316 DEBUG:boto:Data: 2024-04-16T18:48:51.316 DEBUG:boto:Headers: {} 2024-04-16T18:48:51.316 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.316 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.316 DEBUG:boto:Params: {} 2024-04-16T18:48:51.316 DEBUG:boto:Token: None 2024-04-16T18:48:51.316 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/ 2024-04-16T18:48:51.317 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T18:48:51.317 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T18:48:51.320 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009b3e130323aeb44b-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.320 DEBUG:boto:path=/cjqttm-56/obj148 2024-04-16T18:48:51.320 DEBUG:boto:auth_path=/cjqttm-56/obj148 2024-04-16T18:48:51.321 DEBUG:boto:Method: PUT 2024-04-16T18:48:51.321 DEBUG:boto:Path: /cjqttm-56/obj148 2024-04-16T18:48:51.321 DEBUG:boto:Data: 2024-04-16T18:48:51.321 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:48:51.321 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.321 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.321 DEBUG:boto:Params: {} 2024-04-16T18:48:51.322 DEBUG:boto:Token: None 2024-04-16T18:48:51.322 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/obj148 2024-04-16T18:48:51.322 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:b15WWJnR2oDtt5SccbAgOPF7QwI= 2024-04-16T18:48:51.322 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b15WWJnR2oDtt5SccbAgOPF7QwI='} 2024-04-16T18:48:51.367 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b2051def13ceb7e0-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.367 DEBUG:boto:path=/cjqttm-56/ 2024-04-16T18:48:51.367 DEBUG:boto:auth_path=/cjqttm-56/ 2024-04-16T18:48:51.367 DEBUG:boto:Method: HEAD 2024-04-16T18:48:51.367 DEBUG:boto:Path: /cjqttm-56/ 2024-04-16T18:48:51.368 DEBUG:boto:Data: 2024-04-16T18:48:51.368 DEBUG:boto:Headers: {} 2024-04-16T18:48:51.368 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.368 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.368 DEBUG:boto:Params: {} 2024-04-16T18:48:51.368 DEBUG:boto:Token: None 2024-04-16T18:48:51.368 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/ 2024-04-16T18:48:51.369 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T18:48:51.369 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T18:48:51.372 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000021fbb97da2b041e-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.372 DEBUG:boto:path=/cjqttm-56/obj185 2024-04-16T18:48:51.373 DEBUG:boto:auth_path=/cjqttm-56/obj185 2024-04-16T18:48:51.373 DEBUG:boto:Method: PUT 2024-04-16T18:48:51.373 DEBUG:boto:Path: /cjqttm-56/obj185 2024-04-16T18:48:51.373 DEBUG:boto:Data: 2024-04-16T18:48:51.373 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:48:51.373 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:48:51.373 DEBUG:boto:Port: 8000 2024-04-16T18:48:51.373 DEBUG:boto:Params: {} 2024-04-16T18:48:51.374 DEBUG:boto:Token: None 2024-04-16T18:48:51.374 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:48:51 GMT /cjqttm-56/obj185 2024-04-16T18:48:51.374 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iB3raoSiccNcBE0CWKmhPVyNXHY= 2024-04-16T18:48:51.374 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iB3raoSiccNcBE0CWKmhPVyNXHY='} 2024-04-16T18:48:51.383 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a18ef720dbcbc3cc-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:48:51.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:48:51.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:48:51.384 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:48:51.441 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:48:51.442 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:48:51.500 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:48:51.500+0000 7f17a9b2d800 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-16T18:48:51.501 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:48:51.502+0000 7f17a9b2d800 5 RGW-SYNC:data: acquired data sync status lease 2024-04-16T18:48:51.534 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:48:51.535 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:48:51.537 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:48:51.538 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:51.557 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:48:51.558 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:48:51.558 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:48:51.559 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:48:51.559 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:48:51.741 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:48:51.742+0000 7f69a962d880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:48:52.560 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:48:52.581 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:48:52.581 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:48:52.582 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:48:52.583 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:48:52.583 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-56 2024-04-16T18:48:52.583 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:48:52.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:48:52.584 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:48:52.678 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:48:52.679 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:48:52.738 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:48:52.738+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:48:52.738 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:48:52.738 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:48:54.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:48:57.741 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:48:57.741+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:48:57.741 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:48:57.741 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:02.743 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:02.743+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:02.743 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:02.743 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:07.745 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:07.745+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:07.745 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:07.745 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:12.747 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:12.748+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:12.748 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:12.748 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:17.750 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:17.750+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:17.750 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:17.750 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:22.753 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:22.754+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:22.753 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:22.753 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:27.755 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:27.756+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:27.755 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:27.755 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:32.757 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:32.759+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:32.758 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:32.758 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:37.760 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:37.760+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:37.760 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:37.760 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:42.763 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:42.763+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:42.763 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:42.763 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:47.765 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:47.765+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:47.765 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:47.765 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:52.767 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:52.767+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:52.768 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:52.768 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:49:57.769 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:49:57.769+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:49:57.769 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:49:57.769 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:02.771 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:02.771+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:02.771 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:50:02.771 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:07.773 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:07.774+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:07.773 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:50:07.774 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:12.776 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:12.777+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:12.776 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:50:12.776 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:17.778 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:17.779+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:17.778 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:50:17.778 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:22.780 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:22.780+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:22.781 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T18:50:22.781 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:27.783 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:27.782+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:27.783 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:27.783 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:32.785 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:32.785+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:32.786 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:32.786 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:37.787 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:37.787+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:37.788 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:37.788 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:42.789 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:42.789+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:42.789 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:42.790 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:47.791 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:47.791+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:47.791 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:47.791 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:52.794 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:52.795+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:52.794 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:52.794 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:57.796 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:50:57.797+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:50:57.796 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:50:57.796 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:02.798 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:02.799+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:02.798 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:02.798 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:07.800 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:07.800+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:07.801 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:07.801 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:12.802 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:12.802+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:12.803 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:12.803 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:17.805 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:17.805+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:17.805 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:17.805 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:22.807 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:22.807+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:22.807 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:22.807 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:27.809 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:27.809+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:27.809 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:27.810 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:32.811 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:32.811+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:32.811 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:32.811 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:37.814 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:37.814+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:37.814 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:37.815 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:42.817 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:42.817+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:42.817 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:42.817 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:47.819 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:47.820+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:47.819 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:47.819 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:52.820 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:52.820+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:52.820 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:52.820 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:57.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:51:57.822+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:51:57.823 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:51:57.823 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:02.825 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:02.824+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:02.825 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:02.825 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:07.827 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:07.826+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:07.827 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:07.827 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:12.829 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:12.829+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:12.829 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:12.829 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:17.831 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:17.831+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:17.832 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:17.832 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:22.833 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:22.833+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:22.834 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:22.834 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:27.836 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:27.837+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:27.836 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:27.836 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:32.838 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:32.839+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:32.838 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:32.839 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:37.841 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:37.842+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:37.841 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:37.842 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:42.843 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:42.843+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:42.844 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:42.844 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:47.846 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:47.845+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:47.846 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:47.846 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:52.848 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:52.848+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:52.848 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:52.848 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:57.850 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:52:57.850+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:52:57.851 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:52:57.851 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:02.853 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:02.852+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:02.853 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:02.853 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:07.855 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:07.855+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:07.855 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:07.855 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:12.857 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:12.858+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:12.857 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:12.857 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:17.859 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:17.860+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:17.859 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:17.859 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:22.861 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:22.862+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:22.862 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:22.862 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:27.863 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:27.863+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:27.864 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:27.864 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:32.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:32.866+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:32.866 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:32.866 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:37.868 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:37.868+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:37.869 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:37.869 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:42.871 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:42.870+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T18:53:42.871 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:42.871 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T18:53:47.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:47.873+0000 7f2372a9d800 0 bucket checkpoint timed out waiting for incremental sync to catch up 2024-04-16T18:53:47.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:47.873+0000 7f2372a9d800 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T18:53:47.873 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:47.873+0000 7f2372a9d800 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T18:53:47.902 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-04-16T18:53:48.038 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_incremental_sync_latest_after_data_sync_init ... FAIL 2024-04-16T18:53:48.040 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:48.041 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:48.041 DEBUG:boto:Method: PUT 2024-04-16T18:53:48.041 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:48.041 DEBUG:boto:Data: 2024-04-16T18:53:48.041 DEBUG:boto:Headers: {} 2024-04-16T18:53:48.041 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:48.042 DEBUG:boto:Port: 8000 2024-04-16T18:53:48.042 DEBUG:boto:Params: {} 2024-04-16T18:53:48.042 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:53:48.043 DEBUG:boto:Token: None 2024-04-16T18:53:48.043 DEBUG:boto:StringToSign: PUT Tue, 16 Apr 2024 18:53:48 GMT /cjqttm-57/ 2024-04-16T18:53:48.043 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:3FuDWQ1dGXDiJdRGoQzWhpIRvKM= 2024-04-16T18:53:48.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3FuDWQ1dGXDiJdRGoQzWhpIRvKM=', 'Content-Length': '0'} 2024-04-16T18:53:48.091 DEBUG:boto:Response headers: [('x-amz-request-id', 'tx00000b3a0259a5f8bb399-00661ec93c-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:48.092 DEBUG:rgw_multi.tests:created bucket=cjqttm-57 2024-04-16T18:53:48.092 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:53:48.092 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:53:48.093 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:53:48.146 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:53:48.146 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:53:48.202 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:53:48.226 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293628.089303_1644.1","last_update":"2024-04-16T18:53:48.089303Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:53:48.226 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:53:48.226 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:53:48.226 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:53:48.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:53:48.227 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:53:48.283 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:53:48.283 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:53:48.338 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:48.338+0000 7fefd9436800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:53:48.339 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:48.339+0000 7fefd9436800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:53:48.365 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.079653_1641.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.079653Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:48Z"} 2024-04-16T18:53:48.366 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.079653_1641.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.079653Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:48Z"} 2024-04-16T18:53:48.366 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.079653_1641.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.079653Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:53:48.366 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:53:48.366 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.079653_1641.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:53:48.367 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293628.089303_1644.1 target=1_1713293628.079653_1641.1 2024-04-16T18:53:53.368 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:53:53.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:53:53.368 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:53:53.424 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:53:53.425 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:53:53.480 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:53.480+0000 7f8bed067800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:53:53.482 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:53.482+0000 7f8bed067800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:53:53.507 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:53Z"} 2024-04-16T18:53:53.507 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:53Z"} 2024-04-16T18:53:53.508 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:53:53.508 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:53:53.508 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:53:53.508 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2024-04-16T18:53:53.508 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:53.508 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:53.509 DEBUG:boto:Method: HEAD 2024-04-16T18:53:53.509 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:53.509 DEBUG:boto:Data: 2024-04-16T18:53:53.509 DEBUG:boto:Headers: {} 2024-04-16T18:53:53.509 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.509 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.509 DEBUG:boto:Params: {} 2024-04-16T18:53:53.510 DEBUG:boto:Token: None 2024-04-16T18:53:53.510 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/ 2024-04-16T18:53:53.510 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T18:53:53.510 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T18:53:53.513 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000085b899e99e214eb3-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.514 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:53.514 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:53.514 DEBUG:boto:Method: PUT 2024-04-16T18:53:53.514 DEBUG:boto:Path: /cjqttm-57/obj11 2024-04-16T18:53:53.514 DEBUG:boto:Data: 2024-04-16T18:53:53.515 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:53:53.515 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.515 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.515 DEBUG:boto:Params: {} 2024-04-16T18:53:53.515 DEBUG:boto:Token: None 2024-04-16T18:53:53.515 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/obj11 2024-04-16T18:53:53.516 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:FQZGjG9WXQLIuSBQTP6gn7+XIaE= 2024-04-16T18:53:53.516 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FQZGjG9WXQLIuSBQTP6gn7+XIaE='} 2024-04-16T18:53:53.524 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ac5955d488c14ae6-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.525 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:53.525 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:53.525 DEBUG:boto:Method: HEAD 2024-04-16T18:53:53.525 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:53.525 DEBUG:boto:Data: 2024-04-16T18:53:53.525 DEBUG:boto:Headers: {} 2024-04-16T18:53:53.525 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.526 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.526 DEBUG:boto:Params: {} 2024-04-16T18:53:53.526 DEBUG:boto:Token: None 2024-04-16T18:53:53.526 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/ 2024-04-16T18:53:53.526 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T18:53:53.526 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T18:53:53.529 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000528935e0923ccfa6-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.530 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:53.530 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:53.530 DEBUG:boto:Method: PUT 2024-04-16T18:53:53.530 DEBUG:boto:Path: /cjqttm-57/obj22 2024-04-16T18:53:53.530 DEBUG:boto:Data: 2024-04-16T18:53:53.530 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:53:53.530 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.531 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.531 DEBUG:boto:Params: {} 2024-04-16T18:53:53.531 DEBUG:boto:Token: None 2024-04-16T18:53:53.531 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/obj22 2024-04-16T18:53:53.531 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ahMnzIOTpVT+zfiKLrGPsXARnlA= 2024-04-16T18:53:53.532 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ahMnzIOTpVT+zfiKLrGPsXARnlA='} 2024-04-16T18:53:53.536 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f590d9301b28412-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.537 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:53.537 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:53.537 DEBUG:boto:Method: HEAD 2024-04-16T18:53:53.538 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:53.538 DEBUG:boto:Data: 2024-04-16T18:53:53.538 DEBUG:boto:Headers: {} 2024-04-16T18:53:53.538 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.538 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.538 DEBUG:boto:Params: {} 2024-04-16T18:53:53.538 DEBUG:boto:Token: None 2024-04-16T18:53:53.539 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/ 2024-04-16T18:53:53.539 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T18:53:53.539 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T18:53:53.542 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d257001dd238caea-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.542 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:53.542 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:53.542 DEBUG:boto:Method: PUT 2024-04-16T18:53:53.543 DEBUG:boto:Path: /cjqttm-57/obj33 2024-04-16T18:53:53.543 DEBUG:boto:Data: 2024-04-16T18:53:53.543 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:53:53.543 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.543 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.543 DEBUG:boto:Params: {} 2024-04-16T18:53:53.543 DEBUG:boto:Token: None 2024-04-16T18:53:53.543 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/obj33 2024-04-16T18:53:53.544 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s8WMaGyAUrr3+8inA+wuFgvgdCU= 2024-04-16T18:53:53.544 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8WMaGyAUrr3+8inA+wuFgvgdCU='} 2024-04-16T18:53:53.551 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000000cb1ca02a60417-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.551 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:53.551 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:53.551 DEBUG:boto:Method: HEAD 2024-04-16T18:53:53.551 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:53.551 DEBUG:boto:Data: 2024-04-16T18:53:53.552 DEBUG:boto:Headers: {} 2024-04-16T18:53:53.552 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.552 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.552 DEBUG:boto:Params: {} 2024-04-16T18:53:53.552 DEBUG:boto:Token: None 2024-04-16T18:53:53.552 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/ 2024-04-16T18:53:53.552 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T18:53:53.553 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T18:53:53.555 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ac4235bfacca679-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.555 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:53.555 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:53.555 DEBUG:boto:Method: PUT 2024-04-16T18:53:53.556 DEBUG:boto:Path: /cjqttm-57/obj44 2024-04-16T18:53:53.556 DEBUG:boto:Data: 2024-04-16T18:53:53.556 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:53:53.556 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.556 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.556 DEBUG:boto:Params: {} 2024-04-16T18:53:53.556 DEBUG:boto:Token: None 2024-04-16T18:53:53.556 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/obj44 2024-04-16T18:53:53.557 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:GQJucKnJC6/T9remf/mX7jp1CIw= 2024-04-16T18:53:53.557 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GQJucKnJC6/T9remf/mX7jp1CIw='} 2024-04-16T18:53:53.603 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ea83380cefa36f9-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.603 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:53.603 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:53.603 DEBUG:boto:Method: HEAD 2024-04-16T18:53:53.603 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:53.603 DEBUG:boto:Data: 2024-04-16T18:53:53.604 DEBUG:boto:Headers: {} 2024-04-16T18:53:53.604 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.604 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.604 DEBUG:boto:Params: {} 2024-04-16T18:53:53.604 DEBUG:boto:Token: None 2024-04-16T18:53:53.604 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/ 2024-04-16T18:53:53.604 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T18:53:53.605 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T18:53:53.608 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e583d6a4cef5f69b-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.608 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:53:53.608 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:53:53.608 DEBUG:boto:Method: PUT 2024-04-16T18:53:53.609 DEBUG:boto:Path: /cjqttm-57/obj55 2024-04-16T18:53:53.609 DEBUG:boto:Data: 2024-04-16T18:53:53.609 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:53:53.609 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:53.609 DEBUG:boto:Port: 8000 2024-04-16T18:53:53.609 DEBUG:boto:Params: {} 2024-04-16T18:53:53.609 DEBUG:boto:Token: None 2024-04-16T18:53:53.609 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:53:53 GMT /cjqttm-57/obj55 2024-04-16T18:53:53.610 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:XP0wSaSuSH3Y3YiGFQPPUJB+1dw= 2024-04-16T18:53:53.610 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XP0wSaSuSH3Y3YiGFQPPUJB+1dw='} 2024-04-16T18:53:53.615 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003caf2398a9d856c5-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:53.615 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-57 2024-04-16T18:53:53.615 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:53:53.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:53:53.616 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-57 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:53:53.672 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:53:53.672 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:53:53.729 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:53.729+0000 7fd3c9533800 1 waiting to reach incremental sync.. 2024-04-16T18:53:58.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:58.732+0000 7fd3c9533800 1 bucket sync caught up with source: 2024-04-16T18:53:58.732 INFO:teuthology.orchestra.run.smithi139.stderr: local status: [, , , , , , , , 00000000001.124.6, 00000000002.132.6, 00000000002.140.6] 2024-04-16T18:53:58.732 INFO:teuthology.orchestra.run.smithi139.stderr: remote markers: [, , , , , , , , 00000000001.124.6, 00000000002.132.6, 00000000002.140.6] 2024-04-16T18:53:58.732 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:53:58.732+0000 7fd3c9533800 0 bucket checkpoint complete 2024-04-16T18:53:58.762 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-57 2024-04-16T18:53:58.762 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:53:58.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:53:58.763 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-57 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T18:53:58.826 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:53:58.827 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:53:58.889 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:53:58.889+0000 7f5118c9d800 1 bucket sync caught up with source: 2024-04-16T18:53:58.889 INFO:teuthology.orchestra.run.smithi016.stderr: local status: [, , , , , , , , 00000000001.632.6, 00000000002.557.6, 00000000002.1477.6] 2024-04-16T18:53:58.890 INFO:teuthology.orchestra.run.smithi016.stderr: remote markers: [, , , , , , , , 00000000001.632.6, 00000000002.557.6, 00000000002.1477.6] 2024-04-16T18:53:58.890 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T18:53:58.889+0000 7f5118c9d800 0 bucket checkpoint complete 2024-04-16T18:53:58.912 INFO:tasks.rgw_multi.zone_rados:comparing bucket=cjqttm-57 zones={test-zone2, test-zone1} 2024-04-16T18:53:58.912 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:58.912 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:58.913 DEBUG:boto:Method: HEAD 2024-04-16T18:53:58.913 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:58.913 DEBUG:boto:Data: 2024-04-16T18:53:58.913 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.913 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:58.913 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.913 DEBUG:boto:Params: {} 2024-04-16T18:53:58.914 DEBUG:boto:establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T18:53:58.914 DEBUG:boto:Token: None 2024-04-16T18:53:58.914 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/ 2024-04-16T18:53:58.914 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4= 2024-04-16T18:53:58.915 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4=', 'Content-Length': '0'} 2024-04-16T18:53:58.921 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d8b50263449f31e-00661ec946-6424-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.921 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:58.921 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:58.922 DEBUG:boto:Method: HEAD 2024-04-16T18:53:58.922 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:53:58.922 DEBUG:boto:Data: 2024-04-16T18:53:58.922 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.922 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:58.922 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.922 DEBUG:boto:Params: {} 2024-04-16T18:53:58.922 DEBUG:boto:Token: None 2024-04-16T18:53:58.923 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/ 2024-04-16T18:53:58.923 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4= 2024-04-16T18:53:58.923 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4=', 'Content-Length': '0'} 2024-04-16T18:53:58.925 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000024abe21c8e649aa6-00661ec946-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.926 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2024-04-16T18:53:58.926 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:58.926 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:58.926 DEBUG:boto:path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.926 DEBUG:boto:auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.926 DEBUG:boto:Method: GET 2024-04-16T18:53:58.927 DEBUG:boto:Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.927 DEBUG:boto:Data: 2024-04-16T18:53:58.927 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.927 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:58.927 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.927 DEBUG:boto:Params: {} 2024-04-16T18:53:58.927 DEBUG:boto:Token: None 2024-04-16T18:53:58.927 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/?versions 2024-04-16T18:53:58.928 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T18:53:58.928 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T18:53:58.930 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094c94f2e05b7d174-00661ec946-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.931 DEBUG:boto:b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:58.932 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:53:58.932 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:53:58.932 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:53:58.932 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:53:58.932 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:53:58.932 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2024-04-16T18:53:58.933 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:58.933 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:58.933 DEBUG:boto:path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.933 DEBUG:boto:auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.933 DEBUG:boto:Method: GET 2024-04-16T18:53:58.933 DEBUG:boto:Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.933 DEBUG:boto:Data: 2024-04-16T18:53:58.933 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.933 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:58.934 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.934 DEBUG:boto:Params: {} 2024-04-16T18:53:58.934 DEBUG:boto:Token: None 2024-04-16T18:53:58.934 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/?versions 2024-04-16T18:53:58.934 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T18:53:58.934 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T18:53:58.936 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c4ce5f667e9f835-00661ec946-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.937 DEBUG:boto:b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:58.937 DEBUG:tasks.rgw_multi.zone_rados:o=obj11 2024-04-16T18:53:58.937 DEBUG:tasks.rgw_multi.zone_rados:o=obj22 2024-04-16T18:53:58.937 DEBUG:tasks.rgw_multi.zone_rados:o=obj33 2024-04-16T18:53:58.938 DEBUG:tasks.rgw_multi.zone_rados:o=obj44 2024-04-16T18:53:58.938 DEBUG:tasks.rgw_multi.zone_rados:o=obj55 2024-04-16T18:53:58.938 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:58.938 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:58.938 DEBUG:boto:path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.938 DEBUG:boto:auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.938 DEBUG:boto:Method: GET 2024-04-16T18:53:58.939 DEBUG:boto:Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.939 DEBUG:boto:Data: 2024-04-16T18:53:58.939 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:58.939 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.939 DEBUG:boto:Params: {} 2024-04-16T18:53:58.939 DEBUG:boto:Token: None 2024-04-16T18:53:58.939 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/?versions 2024-04-16T18:53:58.940 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T18:53:58.940 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T18:53:58.942 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000277078ad74445667-00661ec946-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.943 DEBUG:boto:b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:58.943 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:58.943 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:58.943 DEBUG:boto:path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.943 DEBUG:boto:auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.944 DEBUG:boto:Method: GET 2024-04-16T18:53:58.944 DEBUG:boto:Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T18:53:58.944 DEBUG:boto:Data: 2024-04-16T18:53:58.944 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.944 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:58.944 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.944 DEBUG:boto:Params: {} 2024-04-16T18:53:58.944 DEBUG:boto:Token: None 2024-04-16T18:53:58.944 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/?versions 2024-04-16T18:53:58.945 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T18:53:58.945 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T18:53:58.947 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2b58e3850456e74-00661ec946-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.947 DEBUG:boto:b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:58.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:53:58.948 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:58.948 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:58.948 DEBUG:boto:path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.948 DEBUG:boto:auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.949 DEBUG:boto:Method: GET 2024-04-16T18:53:58.949 DEBUG:boto:Path: /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.949 DEBUG:boto:Data: 2024-04-16T18:53:58.949 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.949 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:58.949 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.949 DEBUG:boto:Params: {} 2024-04-16T18:53:58.949 DEBUG:boto:Token: None 2024-04-16T18:53:58.950 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.950 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw= 2024-04-16T18:53:58.950 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw=', 'Content-Length': '0'} 2024-04-16T18:53:58.953 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a0d2e13e66542ce-00661ec946-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.994 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:58.995 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:58.995 DEBUG:boto:path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.995 DEBUG:boto:auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.995 DEBUG:boto:Method: GET 2024-04-16T18:53:58.995 DEBUG:boto:Path: /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.995 DEBUG:boto:Data: 2024-04-16T18:53:58.995 DEBUG:boto:Headers: {} 2024-04-16T18:53:58.995 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:58.995 DEBUG:boto:Port: 8000 2024-04-16T18:53:58.996 DEBUG:boto:Params: {} 2024-04-16T18:53:58.996 DEBUG:boto:Token: None 2024-04-16T18:53:58.996 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:58 GMT /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.996 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw= 2024-04-16T18:53:58.996 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw=', 'Content-Length': '0'} 2024-04-16T18:53:58.998 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ae1ab12dfc6dbc6-00661ec946-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:58.999 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:58.999 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:58.999 DEBUG:boto:path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.999 DEBUG:boto:auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.999 DEBUG:boto:Method: HEAD 2024-04-16T18:53:58.999 DEBUG:boto:Path: /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:58.999 DEBUG:boto:Data: 2024-04-16T18:53:59.000 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.000 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.000 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.000 DEBUG:boto:Params: {} 2024-04-16T18:53:59.000 DEBUG:boto:Token: None 2024-04-16T18:53:59.000 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.000 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98= 2024-04-16T18:53:59.001 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98=', 'Content-Length': '0'} 2024-04-16T18:53:59.003 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c2c983a56cc4bbc-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.003 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:59.003 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:59.003 DEBUG:boto:path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.003 DEBUG:boto:auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.004 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.004 DEBUG:boto:Path: /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.004 DEBUG:boto:Data: 2024-04-16T18:53:59.004 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.004 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.004 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.004 DEBUG:boto:Params: {} 2024-04-16T18:53:59.004 DEBUG:boto:Token: None 2024-04-16T18:53:59.005 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.005 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98= 2024-04-16T18:53:59.005 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98=', 'Content-Length': '0'} 2024-04-16T18:53:59.007 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000169adc08c75c8e70-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.007 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:53:59.007 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:59.008 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:59.008 DEBUG:boto:path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.008 DEBUG:boto:auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.008 DEBUG:boto:Method: GET 2024-04-16T18:53:59.008 DEBUG:boto:Path: /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.008 DEBUG:boto:Data: 2024-04-16T18:53:59.008 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.008 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.008 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.009 DEBUG:boto:Params: {} 2024-04-16T18:53:59.009 DEBUG:boto:Token: None 2024-04-16T18:53:59.009 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.009 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ= 2024-04-16T18:53:59.009 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ=', 'Content-Length': '0'} 2024-04-16T18:53:59.011 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000140f09f97e76f8a-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.012 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:59.012 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:59.012 DEBUG:boto:path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.012 DEBUG:boto:auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.012 DEBUG:boto:Method: GET 2024-04-16T18:53:59.012 DEBUG:boto:Path: /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.012 DEBUG:boto:Data: 2024-04-16T18:53:59.013 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.013 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.013 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.013 DEBUG:boto:Params: {} 2024-04-16T18:53:59.013 DEBUG:boto:Token: None 2024-04-16T18:53:59.013 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11?versionId=null 2024-04-16T18:53:59.013 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ= 2024-04-16T18:53:59.013 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ=', 'Content-Length': '0'} 2024-04-16T18:53:59.015 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2bb2ede5319da47-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.016 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.016 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.016 DEBUG:boto:path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.016 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.016 DEBUG:boto:Method: GET 2024-04-16T18:53:59.016 DEBUG:boto:Path: /cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.017 DEBUG:boto:Data: 2024-04-16T18:53:59.017 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.017 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.017 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.017 DEBUG:boto:Params: {} 2024-04-16T18:53:59.017 DEBUG:boto:Token: None 2024-04-16T18:53:59.017 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.017 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.017 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.020 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088a656959e65df6c-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.062 DEBUG:boto:b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.063 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.063 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.063 DEBUG:boto:path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.063 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.063 DEBUG:boto:Method: GET 2024-04-16T18:53:59.063 DEBUG:boto:Path: /cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.063 DEBUG:boto:Data: 2024-04-16T18:53:59.064 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.064 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.064 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.064 DEBUG:boto:Params: {} 2024-04-16T18:53:59.064 DEBUG:boto:Token: None 2024-04-16T18:53:59.064 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.067 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1042a7d0cf5a604-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.067 DEBUG:boto:b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.067 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:59.067 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:59.067 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.068 DEBUG:boto:Path: /cjqttm-57/obj11 2024-04-16T18:53:59.068 DEBUG:boto:Data: 2024-04-16T18:53:59.068 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.068 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.068 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.068 DEBUG:boto:Params: {} 2024-04-16T18:53:59.068 DEBUG:boto:Token: None 2024-04-16T18:53:59.068 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11 2024-04-16T18:53:59.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c= 2024-04-16T18:53:59.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c=', 'Content-Length': '0'} 2024-04-16T18:53:59.071 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b393532acc27d0d1-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.071 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:59.072 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:59.072 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.072 DEBUG:boto:Path: /cjqttm-57/obj11 2024-04-16T18:53:59.072 DEBUG:boto:Data: 2024-04-16T18:53:59.072 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.072 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.072 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.072 DEBUG:boto:Params: {} 2024-04-16T18:53:59.072 DEBUG:boto:Token: None 2024-04-16T18:53:59.073 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11 2024-04-16T18:53:59.073 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c= 2024-04-16T18:53:59.073 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c=', 'Content-Length': '0'} 2024-04-16T18:53:59.075 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011d665f85e27f747-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj11 2024-04-16T18:53:59.075 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:59.075 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:59.076 DEBUG:boto:Method: GET 2024-04-16T18:53:59.076 DEBUG:boto:Path: /cjqttm-57/obj11 2024-04-16T18:53:59.076 DEBUG:boto:Data: 2024-04-16T18:53:59.076 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.076 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.076 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.076 DEBUG:boto:Params: {} 2024-04-16T18:53:59.076 DEBUG:boto:Token: None 2024-04-16T18:53:59.076 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11 2024-04-16T18:53:59.077 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o= 2024-04-16T18:53:59.077 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o=', 'Content-Length': '0'} 2024-04-16T18:53:59.079 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001554b08100cd5fd1-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.122 DEBUG:boto:path=/cjqttm-57/obj11 2024-04-16T18:53:59.123 DEBUG:boto:auth_path=/cjqttm-57/obj11 2024-04-16T18:53:59.123 DEBUG:boto:Method: GET 2024-04-16T18:53:59.123 DEBUG:boto:Path: /cjqttm-57/obj11 2024-04-16T18:53:59.123 DEBUG:boto:Data: 2024-04-16T18:53:59.123 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.123 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.123 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.123 DEBUG:boto:Params: {} 2024-04-16T18:53:59.123 DEBUG:boto:Token: None 2024-04-16T18:53:59.124 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj11 2024-04-16T18:53:59.124 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o= 2024-04-16T18:53:59.124 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o=', 'Content-Length': '0'} 2024-04-16T18:53:59.126 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb836ffd5650db7d-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.126 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.126 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.127 DEBUG:boto:path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.127 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.127 DEBUG:boto:Method: GET 2024-04-16T18:53:59.127 DEBUG:boto:Path: /cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.127 DEBUG:boto:Data: 2024-04-16T18:53:59.127 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.127 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.127 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.127 DEBUG:boto:Params: {} 2024-04-16T18:53:59.127 DEBUG:boto:Token: None 2024-04-16T18:53:59.128 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.130 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000080305634ca1817b4-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.174 DEBUG:boto:b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.175 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.175 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.175 DEBUG:boto:path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.175 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.175 DEBUG:boto:Method: GET 2024-04-16T18:53:59.175 DEBUG:boto:Path: /cjqttm-57/?prefix=obj11 2024-04-16T18:53:59.175 DEBUG:boto:Data: 2024-04-16T18:53:59.175 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.176 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.176 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.176 DEBUG:boto:Params: {} 2024-04-16T18:53:59.176 DEBUG:boto:Token: None 2024-04-16T18:53:59.176 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.176 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.176 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.178 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c10dd81de39ae789-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.179 DEBUG:boto:b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:53:59.179 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.179 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.179 DEBUG:boto:path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.179 DEBUG:boto:auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.180 DEBUG:boto:Method: GET 2024-04-16T18:53:59.180 DEBUG:boto:Path: /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.180 DEBUG:boto:Data: 2024-04-16T18:53:59.180 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.180 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.180 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.180 DEBUG:boto:Params: {} 2024-04-16T18:53:59.180 DEBUG:boto:Token: None 2024-04-16T18:53:59.180 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.181 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T18:53:59.181 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T18:53:59.183 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060fbc6f75f99941e-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.226 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.227 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.227 DEBUG:boto:path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.227 DEBUG:boto:auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.227 DEBUG:boto:Method: GET 2024-04-16T18:53:59.227 DEBUG:boto:Path: /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.227 DEBUG:boto:Data: 2024-04-16T18:53:59.227 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.227 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.227 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.227 DEBUG:boto:Params: {} 2024-04-16T18:53:59.228 DEBUG:boto:Token: None 2024-04-16T18:53:59.228 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.228 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T18:53:59.228 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T18:53:59.230 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcdcf2aba80fff3a-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.231 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.231 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.231 DEBUG:boto:path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.231 DEBUG:boto:auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.231 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.231 DEBUG:boto:Path: /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.231 DEBUG:boto:Data: 2024-04-16T18:53:59.231 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.231 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.232 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.232 DEBUG:boto:Params: {} 2024-04-16T18:53:59.232 DEBUG:boto:Token: None 2024-04-16T18:53:59.232 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.232 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU= 2024-04-16T18:53:59.232 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU=', 'Content-Length': '0'} 2024-04-16T18:53:59.234 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e6566834cc59f66-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.235 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.235 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.235 DEBUG:boto:path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.235 DEBUG:boto:auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.235 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.235 DEBUG:boto:Path: /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.235 DEBUG:boto:Data: 2024-04-16T18:53:59.235 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.235 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.236 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.236 DEBUG:boto:Params: {} 2024-04-16T18:53:59.236 DEBUG:boto:Token: None 2024-04-16T18:53:59.236 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.236 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU= 2024-04-16T18:53:59.236 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU=', 'Content-Length': '0'} 2024-04-16T18:53:59.238 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d699efafce29c57d-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.238 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:53:59.238 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.239 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.239 DEBUG:boto:path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.239 DEBUG:boto:auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.239 DEBUG:boto:Method: GET 2024-04-16T18:53:59.239 DEBUG:boto:Path: /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.239 DEBUG:boto:Data: 2024-04-16T18:53:59.239 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.239 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.239 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.239 DEBUG:boto:Params: {} 2024-04-16T18:53:59.240 DEBUG:boto:Token: None 2024-04-16T18:53:59.240 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.240 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T18:53:59.240 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T18:53:59.242 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f62c99e37ba7b4e8-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.282 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.283 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.283 DEBUG:boto:path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.283 DEBUG:boto:auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.283 DEBUG:boto:Method: GET 2024-04-16T18:53:59.283 DEBUG:boto:Path: /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.283 DEBUG:boto:Data: 2024-04-16T18:53:59.283 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.283 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.283 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.283 DEBUG:boto:Params: {} 2024-04-16T18:53:59.284 DEBUG:boto:Token: None 2024-04-16T18:53:59.284 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22?versionId=null 2024-04-16T18:53:59.284 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T18:53:59.284 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T18:53:59.286 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b388b56d5a5e3f7f-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.286 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.286 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.286 DEBUG:boto:path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.286 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.287 DEBUG:boto:Method: GET 2024-04-16T18:53:59.287 DEBUG:boto:Path: /cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.287 DEBUG:boto:Data: 2024-04-16T18:53:59.287 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.287 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.287 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.287 DEBUG:boto:Params: {} 2024-04-16T18:53:59.287 DEBUG:boto:Token: None 2024-04-16T18:53:59.287 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.288 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.288 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.290 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb1359d29a920f23-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.290 DEBUG:boto:b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.290 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.291 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.291 DEBUG:boto:path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.291 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.291 DEBUG:boto:Method: GET 2024-04-16T18:53:59.291 DEBUG:boto:Path: /cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.291 DEBUG:boto:Data: 2024-04-16T18:53:59.291 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.291 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.291 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.291 DEBUG:boto:Params: {} 2024-04-16T18:53:59.292 DEBUG:boto:Token: None 2024-04-16T18:53:59.292 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.292 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.292 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.294 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ed9b2ee317eda45-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.294 DEBUG:boto:b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.295 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.295 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.295 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.295 DEBUG:boto:Path: /cjqttm-57/obj22 2024-04-16T18:53:59.295 DEBUG:boto:Data: 2024-04-16T18:53:59.295 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.295 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.295 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.296 DEBUG:boto:Params: {} 2024-04-16T18:53:59.296 DEBUG:boto:Token: None 2024-04-16T18:53:59.296 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22 2024-04-16T18:53:59.296 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA= 2024-04-16T18:53:59.296 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA=', 'Content-Length': '0'} 2024-04-16T18:53:59.299 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c578a22fcfe08b45-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.299 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.299 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.299 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.299 DEBUG:boto:Path: /cjqttm-57/obj22 2024-04-16T18:53:59.299 DEBUG:boto:Data: 2024-04-16T18:53:59.299 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.300 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.300 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.300 DEBUG:boto:Params: {} 2024-04-16T18:53:59.300 DEBUG:boto:Token: None 2024-04-16T18:53:59.300 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22 2024-04-16T18:53:59.300 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA= 2024-04-16T18:53:59.300 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA=', 'Content-Length': '0'} 2024-04-16T18:53:59.302 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071049c150735993d-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.302 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj22 2024-04-16T18:53:59.303 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.303 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.303 DEBUG:boto:Method: GET 2024-04-16T18:53:59.303 DEBUG:boto:Path: /cjqttm-57/obj22 2024-04-16T18:53:59.303 DEBUG:boto:Data: 2024-04-16T18:53:59.303 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.303 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.303 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.303 DEBUG:boto:Params: {} 2024-04-16T18:53:59.304 DEBUG:boto:Token: None 2024-04-16T18:53:59.304 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22 2024-04-16T18:53:59.304 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c= 2024-04-16T18:53:59.304 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c=', 'Content-Length': '0'} 2024-04-16T18:53:59.306 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9723721ed3e176b-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.346 DEBUG:boto:path=/cjqttm-57/obj22 2024-04-16T18:53:59.346 DEBUG:boto:auth_path=/cjqttm-57/obj22 2024-04-16T18:53:59.347 DEBUG:boto:Method: GET 2024-04-16T18:53:59.347 DEBUG:boto:Path: /cjqttm-57/obj22 2024-04-16T18:53:59.347 DEBUG:boto:Data: 2024-04-16T18:53:59.347 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.347 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.347 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.347 DEBUG:boto:Params: {} 2024-04-16T18:53:59.347 DEBUG:boto:Token: None 2024-04-16T18:53:59.347 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj22 2024-04-16T18:53:59.348 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c= 2024-04-16T18:53:59.348 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c=', 'Content-Length': '0'} 2024-04-16T18:53:59.350 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c84f1389ddde6032-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.350 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.350 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.351 DEBUG:boto:path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.351 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.351 DEBUG:boto:Method: GET 2024-04-16T18:53:59.351 DEBUG:boto:Path: /cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.351 DEBUG:boto:Data: 2024-04-16T18:53:59.351 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.351 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.351 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.351 DEBUG:boto:Params: {} 2024-04-16T18:53:59.351 DEBUG:boto:Token: None 2024-04-16T18:53:59.352 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.352 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.352 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.354 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0b478460db9ec63-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.394 DEBUG:boto:b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.395 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.395 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.395 DEBUG:boto:path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.395 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.395 DEBUG:boto:Method: GET 2024-04-16T18:53:59.395 DEBUG:boto:Path: /cjqttm-57/?prefix=obj22 2024-04-16T18:53:59.395 DEBUG:boto:Data: 2024-04-16T18:53:59.395 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.395 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.395 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.396 DEBUG:boto:Params: {} 2024-04-16T18:53:59.396 DEBUG:boto:Token: None 2024-04-16T18:53:59.396 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.396 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.396 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.398 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b33330fbfedfe1d8-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.398 DEBUG:boto:b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.399 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:53:59.399 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.399 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.399 DEBUG:boto:path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.399 DEBUG:boto:auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.399 DEBUG:boto:Method: GET 2024-04-16T18:53:59.399 DEBUG:boto:Path: /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.400 DEBUG:boto:Data: 2024-04-16T18:53:59.400 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.400 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.400 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.400 DEBUG:boto:Params: {} 2024-04-16T18:53:59.400 DEBUG:boto:Token: None 2024-04-16T18:53:59.400 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.400 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T18:53:59.400 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T18:53:59.403 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093582018afe83342-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.446 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.447 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.447 DEBUG:boto:path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.447 DEBUG:boto:auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.447 DEBUG:boto:Method: GET 2024-04-16T18:53:59.447 DEBUG:boto:Path: /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.447 DEBUG:boto:Data: 2024-04-16T18:53:59.447 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.447 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.447 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.447 DEBUG:boto:Params: {} 2024-04-16T18:53:59.448 DEBUG:boto:Token: None 2024-04-16T18:53:59.448 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.448 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T18:53:59.448 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T18:53:59.450 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000337ab826adb5e86-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.450 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.451 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.451 DEBUG:boto:path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.451 DEBUG:boto:auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.451 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.451 DEBUG:boto:Path: /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.451 DEBUG:boto:Data: 2024-04-16T18:53:59.451 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.451 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.451 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.451 DEBUG:boto:Params: {} 2024-04-16T18:53:59.452 DEBUG:boto:Token: None 2024-04-16T18:53:59.452 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.452 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0= 2024-04-16T18:53:59.452 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0=', 'Content-Length': '0'} 2024-04-16T18:53:59.454 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029df7e10f81dd229-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.454 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.455 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.455 DEBUG:boto:path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.455 DEBUG:boto:auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.455 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.455 DEBUG:boto:Path: /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.455 DEBUG:boto:Data: 2024-04-16T18:53:59.455 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.455 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.455 DEBUG:boto:Params: {} 2024-04-16T18:53:59.456 DEBUG:boto:Token: None 2024-04-16T18:53:59.456 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.456 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0= 2024-04-16T18:53:59.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0=', 'Content-Length': '0'} 2024-04-16T18:53:59.458 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b495d440deef6436-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.459 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:53:59.459 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.459 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.459 DEBUG:boto:path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.459 DEBUG:boto:auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.459 DEBUG:boto:Method: GET 2024-04-16T18:53:59.459 DEBUG:boto:Path: /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.459 DEBUG:boto:Data: 2024-04-16T18:53:59.459 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.460 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.460 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.460 DEBUG:boto:Params: {} 2024-04-16T18:53:59.460 DEBUG:boto:Token: None 2024-04-16T18:53:59.460 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.460 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T18:53:59.460 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T18:53:59.463 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f78bb7440d2e95b5-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.506 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.507 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.507 DEBUG:boto:path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.507 DEBUG:boto:auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.507 DEBUG:boto:Method: GET 2024-04-16T18:53:59.507 DEBUG:boto:Path: /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.507 DEBUG:boto:Data: 2024-04-16T18:53:59.507 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.507 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.507 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.507 DEBUG:boto:Params: {} 2024-04-16T18:53:59.508 DEBUG:boto:Token: None 2024-04-16T18:53:59.508 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33?versionId=null 2024-04-16T18:53:59.508 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T18:53:59.508 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T18:53:59.510 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e651b2ce6220d7ed-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.510 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.511 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.511 DEBUG:boto:path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.511 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.511 DEBUG:boto:Method: GET 2024-04-16T18:53:59.511 DEBUG:boto:Path: /cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.511 DEBUG:boto:Data: 2024-04-16T18:53:59.511 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.511 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.511 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.511 DEBUG:boto:Params: {} 2024-04-16T18:53:59.512 DEBUG:boto:Token: None 2024-04-16T18:53:59.512 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.512 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.512 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.514 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d89702a262035920-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.558 DEBUG:boto:b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.559 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.559 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.559 DEBUG:boto:path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.559 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.559 DEBUG:boto:Method: GET 2024-04-16T18:53:59.559 DEBUG:boto:Path: /cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.559 DEBUG:boto:Data: 2024-04-16T18:53:59.559 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.560 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.560 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.560 DEBUG:boto:Params: {} 2024-04-16T18:53:59.560 DEBUG:boto:Token: None 2024-04-16T18:53:59.560 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.560 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.560 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.562 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfd7687b6ebedc4a-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.563 DEBUG:boto:b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.563 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.563 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.563 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.563 DEBUG:boto:Path: /cjqttm-57/obj33 2024-04-16T18:53:59.563 DEBUG:boto:Data: 2024-04-16T18:53:59.564 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.564 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.564 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.564 DEBUG:boto:Params: {} 2024-04-16T18:53:59.564 DEBUG:boto:Token: None 2024-04-16T18:53:59.564 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33 2024-04-16T18:53:59.564 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU= 2024-04-16T18:53:59.564 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU=', 'Content-Length': '0'} 2024-04-16T18:53:59.566 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000966a4f3d6149c61b-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.567 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.567 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.567 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.567 DEBUG:boto:Path: /cjqttm-57/obj33 2024-04-16T18:53:59.567 DEBUG:boto:Data: 2024-04-16T18:53:59.567 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.567 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.567 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.568 DEBUG:boto:Params: {} 2024-04-16T18:53:59.568 DEBUG:boto:Token: None 2024-04-16T18:53:59.568 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33 2024-04-16T18:53:59.568 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU= 2024-04-16T18:53:59.568 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU=', 'Content-Length': '0'} 2024-04-16T18:53:59.570 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb0bcea31c2a32d0-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.570 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj33 2024-04-16T18:53:59.570 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.571 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.571 DEBUG:boto:Method: GET 2024-04-16T18:53:59.571 DEBUG:boto:Path: /cjqttm-57/obj33 2024-04-16T18:53:59.571 DEBUG:boto:Data: 2024-04-16T18:53:59.571 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.571 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.571 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.571 DEBUG:boto:Params: {} 2024-04-16T18:53:59.571 DEBUG:boto:Token: None 2024-04-16T18:53:59.572 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33 2024-04-16T18:53:59.572 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0= 2024-04-16T18:53:59.572 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0=', 'Content-Length': '0'} 2024-04-16T18:53:59.574 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eae179354636eb61-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.614 DEBUG:boto:path=/cjqttm-57/obj33 2024-04-16T18:53:59.615 DEBUG:boto:auth_path=/cjqttm-57/obj33 2024-04-16T18:53:59.615 DEBUG:boto:Method: GET 2024-04-16T18:53:59.615 DEBUG:boto:Path: /cjqttm-57/obj33 2024-04-16T18:53:59.615 DEBUG:boto:Data: 2024-04-16T18:53:59.615 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.615 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.615 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.615 DEBUG:boto:Params: {} 2024-04-16T18:53:59.615 DEBUG:boto:Token: None 2024-04-16T18:53:59.615 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj33 2024-04-16T18:53:59.616 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0= 2024-04-16T18:53:59.616 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0=', 'Content-Length': '0'} 2024-04-16T18:53:59.618 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072dc29b05cfb1c94-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.618 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.618 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.619 DEBUG:boto:path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.619 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.619 DEBUG:boto:Method: GET 2024-04-16T18:53:59.619 DEBUG:boto:Path: /cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.619 DEBUG:boto:Data: 2024-04-16T18:53:59.619 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.619 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.619 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.619 DEBUG:boto:Params: {} 2024-04-16T18:53:59.619 DEBUG:boto:Token: None 2024-04-16T18:53:59.620 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.620 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.620 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.622 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bf79455867a689d-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.666 DEBUG:boto:b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.667 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.667 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.667 DEBUG:boto:path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.667 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.667 DEBUG:boto:Method: GET 2024-04-16T18:53:59.667 DEBUG:boto:Path: /cjqttm-57/?prefix=obj33 2024-04-16T18:53:59.667 DEBUG:boto:Data: 2024-04-16T18:53:59.667 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.668 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.668 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.668 DEBUG:boto:Params: {} 2024-04-16T18:53:59.668 DEBUG:boto:Token: None 2024-04-16T18:53:59.668 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.668 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.668 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.670 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000fa7b4b957f57bd4-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.671 DEBUG:boto:b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:53:59.671 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.671 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.671 DEBUG:boto:path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.672 DEBUG:boto:auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.672 DEBUG:boto:Method: GET 2024-04-16T18:53:59.672 DEBUG:boto:Path: /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.672 DEBUG:boto:Data: 2024-04-16T18:53:59.672 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.672 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.672 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.672 DEBUG:boto:Params: {} 2024-04-16T18:53:59.672 DEBUG:boto:Token: None 2024-04-16T18:53:59.672 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.673 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T18:53:59.673 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T18:53:59.675 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008458e2963da694a7-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.718 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.719 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.719 DEBUG:boto:path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.719 DEBUG:boto:auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.719 DEBUG:boto:Method: GET 2024-04-16T18:53:59.719 DEBUG:boto:Path: /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.719 DEBUG:boto:Data: 2024-04-16T18:53:59.719 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.719 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.719 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.719 DEBUG:boto:Params: {} 2024-04-16T18:53:59.720 DEBUG:boto:Token: None 2024-04-16T18:53:59.720 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.720 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T18:53:59.720 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T18:53:59.722 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082299aacea2f4c6a-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.722 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.722 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.723 DEBUG:boto:path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.723 DEBUG:boto:auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.723 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.723 DEBUG:boto:Path: /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.723 DEBUG:boto:Data: 2024-04-16T18:53:59.723 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.723 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.723 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.723 DEBUG:boto:Params: {} 2024-04-16T18:53:59.723 DEBUG:boto:Token: None 2024-04-16T18:53:59.724 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.724 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs= 2024-04-16T18:53:59.724 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs=', 'Content-Length': '0'} 2024-04-16T18:53:59.725 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b564477d3f94aa07-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.726 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.726 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.726 DEBUG:boto:path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.726 DEBUG:boto:auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.726 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.726 DEBUG:boto:Path: /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.726 DEBUG:boto:Data: 2024-04-16T18:53:59.727 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.727 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.727 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.727 DEBUG:boto:Params: {} 2024-04-16T18:53:59.727 DEBUG:boto:Token: None 2024-04-16T18:53:59.727 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.727 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs= 2024-04-16T18:53:59.727 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs=', 'Content-Length': '0'} 2024-04-16T18:53:59.729 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fe3a2aff40ee24c-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:53:59.729 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.730 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.730 DEBUG:boto:path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.730 DEBUG:boto:auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.730 DEBUG:boto:Method: GET 2024-04-16T18:53:59.730 DEBUG:boto:Path: /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.730 DEBUG:boto:Data: 2024-04-16T18:53:59.730 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.730 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.730 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.730 DEBUG:boto:Params: {} 2024-04-16T18:53:59.731 DEBUG:boto:Token: None 2024-04-16T18:53:59.731 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.731 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T18:53:59.731 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T18:53:59.733 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000301b5133e273c9ac-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.774 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.775 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.775 DEBUG:boto:path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.775 DEBUG:boto:auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.775 DEBUG:boto:Method: GET 2024-04-16T18:53:59.775 DEBUG:boto:Path: /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.775 DEBUG:boto:Data: 2024-04-16T18:53:59.775 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.775 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.775 DEBUG:boto:Params: {} 2024-04-16T18:53:59.776 DEBUG:boto:Token: None 2024-04-16T18:53:59.776 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44?versionId=null 2024-04-16T18:53:59.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T18:53:59.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T18:53:59.778 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e16dd7e45f5ddb5-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.778 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.778 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.778 DEBUG:boto:path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.779 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.779 DEBUG:boto:Method: GET 2024-04-16T18:53:59.779 DEBUG:boto:Path: /cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.779 DEBUG:boto:Data: 2024-04-16T18:53:59.779 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.779 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.779 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.779 DEBUG:boto:Params: {} 2024-04-16T18:53:59.779 DEBUG:boto:Token: None 2024-04-16T18:53:59.779 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.780 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.780 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.782 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e7422bc5b5a3987-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.822 DEBUG:boto:b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.823 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.823 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.823 DEBUG:boto:path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.823 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.823 DEBUG:boto:Method: GET 2024-04-16T18:53:59.823 DEBUG:boto:Path: /cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.823 DEBUG:boto:Data: 2024-04-16T18:53:59.823 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.823 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.824 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.824 DEBUG:boto:Params: {} 2024-04-16T18:53:59.824 DEBUG:boto:Token: None 2024-04-16T18:53:59.824 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.824 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.824 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.826 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f101ba638ce4949b-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.827 DEBUG:boto:b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.827 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.827 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.827 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.827 DEBUG:boto:Path: /cjqttm-57/obj44 2024-04-16T18:53:59.827 DEBUG:boto:Data: 2024-04-16T18:53:59.828 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.828 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.828 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.828 DEBUG:boto:Params: {} 2024-04-16T18:53:59.828 DEBUG:boto:Token: None 2024-04-16T18:53:59.828 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44 2024-04-16T18:53:59.828 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw= 2024-04-16T18:53:59.828 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw=', 'Content-Length': '0'} 2024-04-16T18:53:59.830 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000308d5a015deb7e08-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.831 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.831 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.831 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.831 DEBUG:boto:Path: /cjqttm-57/obj44 2024-04-16T18:53:59.831 DEBUG:boto:Data: 2024-04-16T18:53:59.831 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.831 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.831 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.831 DEBUG:boto:Params: {} 2024-04-16T18:53:59.832 DEBUG:boto:Token: None 2024-04-16T18:53:59.832 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44 2024-04-16T18:53:59.832 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw= 2024-04-16T18:53:59.832 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw=', 'Content-Length': '0'} 2024-04-16T18:53:59.834 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000985a28bf2cec2dac-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.834 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj44 2024-04-16T18:53:59.834 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.834 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.835 DEBUG:boto:Method: GET 2024-04-16T18:53:59.835 DEBUG:boto:Path: /cjqttm-57/obj44 2024-04-16T18:53:59.835 DEBUG:boto:Data: 2024-04-16T18:53:59.835 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.835 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.835 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.835 DEBUG:boto:Params: {} 2024-04-16T18:53:59.835 DEBUG:boto:Token: None 2024-04-16T18:53:59.835 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44 2024-04-16T18:53:59.836 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg= 2024-04-16T18:53:59.836 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg=', 'Content-Length': '0'} 2024-04-16T18:53:59.837 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000092b8f967111d00f-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.878 DEBUG:boto:path=/cjqttm-57/obj44 2024-04-16T18:53:59.878 DEBUG:boto:auth_path=/cjqttm-57/obj44 2024-04-16T18:53:59.879 DEBUG:boto:Method: GET 2024-04-16T18:53:59.879 DEBUG:boto:Path: /cjqttm-57/obj44 2024-04-16T18:53:59.879 DEBUG:boto:Data: 2024-04-16T18:53:59.879 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.879 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.879 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.879 DEBUG:boto:Params: {} 2024-04-16T18:53:59.879 DEBUG:boto:Token: None 2024-04-16T18:53:59.879 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj44 2024-04-16T18:53:59.880 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg= 2024-04-16T18:53:59.880 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg=', 'Content-Length': '0'} 2024-04-16T18:53:59.881 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033925c134d6d5055-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.882 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.882 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.882 DEBUG:boto:path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.882 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.882 DEBUG:boto:Method: GET 2024-04-16T18:53:59.882 DEBUG:boto:Path: /cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.883 DEBUG:boto:Data: 2024-04-16T18:53:59.883 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.883 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.883 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.883 DEBUG:boto:Params: {} 2024-04-16T18:53:59.883 DEBUG:boto:Token: None 2024-04-16T18:53:59.883 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.883 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.883 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.886 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008ee93d02a9a74ef-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.886 DEBUG:boto:b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.886 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.886 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.886 DEBUG:boto:path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.886 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.887 DEBUG:boto:Method: GET 2024-04-16T18:53:59.887 DEBUG:boto:Path: /cjqttm-57/?prefix=obj44 2024-04-16T18:53:59.887 DEBUG:boto:Data: 2024-04-16T18:53:59.887 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.887 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.887 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.887 DEBUG:boto:Params: {} 2024-04-16T18:53:59.887 DEBUG:boto:Token: None 2024-04-16T18:53:59.887 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.887 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.888 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.890 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1a333a5fc9e3718-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.890 DEBUG:boto:b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.890 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:53:59.891 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:53:59.891 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:53:59.891 DEBUG:boto:path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.891 DEBUG:boto:auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.891 DEBUG:boto:Method: GET 2024-04-16T18:53:59.891 DEBUG:boto:Path: /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.891 DEBUG:boto:Data: 2024-04-16T18:53:59.891 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.891 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.891 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.891 DEBUG:boto:Params: {} 2024-04-16T18:53:59.892 DEBUG:boto:Token: None 2024-04-16T18:53:59.892 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.892 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T18:53:59.892 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T18:53:59.893 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1f21a4bb373f638-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.934 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:53:59.934 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:53:59.935 DEBUG:boto:path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.935 DEBUG:boto:auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.935 DEBUG:boto:Method: GET 2024-04-16T18:53:59.935 DEBUG:boto:Path: /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.935 DEBUG:boto:Data: 2024-04-16T18:53:59.935 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.935 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.935 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.935 DEBUG:boto:Params: {} 2024-04-16T18:53:59.935 DEBUG:boto:Token: None 2024-04-16T18:53:59.935 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.936 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T18:53:59.936 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T18:53:59.937 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adab0f5fbc530f6e-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.938 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:53:59.938 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:53:59.938 DEBUG:boto:path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.938 DEBUG:boto:auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.938 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.938 DEBUG:boto:Path: /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.938 DEBUG:boto:Data: 2024-04-16T18:53:59.939 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.939 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.939 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.939 DEBUG:boto:Params: {} 2024-04-16T18:53:59.939 DEBUG:boto:Token: None 2024-04-16T18:53:59.939 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.939 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE= 2024-04-16T18:53:59.939 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE=', 'Content-Length': '0'} 2024-04-16T18:53:59.941 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f122502243116df-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.941 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:53:59.941 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:53:59.942 DEBUG:boto:path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.942 DEBUG:boto:auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.942 DEBUG:boto:Method: HEAD 2024-04-16T18:53:59.942 DEBUG:boto:Path: /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.942 DEBUG:boto:Data: 2024-04-16T18:53:59.942 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.942 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.942 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.942 DEBUG:boto:Params: {} 2024-04-16T18:53:59.942 DEBUG:boto:Token: None 2024-04-16T18:53:59.942 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.943 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE= 2024-04-16T18:53:59.943 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE=', 'Content-Length': '0'} 2024-04-16T18:53:59.944 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009beeeda9d6b11ca1-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.944 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:53:59.945 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:53:59.945 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:53:59.945 DEBUG:boto:path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.945 DEBUG:boto:auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.945 DEBUG:boto:Method: GET 2024-04-16T18:53:59.945 DEBUG:boto:Path: /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.945 DEBUG:boto:Data: 2024-04-16T18:53:59.945 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.945 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.945 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.945 DEBUG:boto:Params: {} 2024-04-16T18:53:59.946 DEBUG:boto:Token: None 2024-04-16T18:53:59.946 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.946 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T18:53:59.946 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T18:53:59.948 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7c7a7c6ca9524d1-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.990 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:53:59.990 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:53:59.990 DEBUG:boto:path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.991 DEBUG:boto:auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.991 DEBUG:boto:Method: GET 2024-04-16T18:53:59.991 DEBUG:boto:Path: /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.991 DEBUG:boto:Data: 2024-04-16T18:53:59.991 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.991 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.991 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.991 DEBUG:boto:Params: {} 2024-04-16T18:53:59.991 DEBUG:boto:Token: None 2024-04-16T18:53:59.991 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/obj55?versionId=null 2024-04-16T18:53:59.991 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T18:53:59.992 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T18:53:59.993 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9a8417ac427aa2e-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.994 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.994 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.994 DEBUG:boto:path=/cjqttm-57/?prefix=obj55 2024-04-16T18:53:59.994 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T18:53:59.994 DEBUG:boto:Method: GET 2024-04-16T18:53:59.994 DEBUG:boto:Path: /cjqttm-57/?prefix=obj55 2024-04-16T18:53:59.994 DEBUG:boto:Data: 2024-04-16T18:53:59.994 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.994 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:53:59.995 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.995 DEBUG:boto:Params: {} 2024-04-16T18:53:59.995 DEBUG:boto:Token: None 2024-04-16T18:53:59.995 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.995 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.995 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:53:59.997 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e73c4a5db17f16d9-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:53:59.998 DEBUG:boto:b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:53:59.998 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:53:59.998 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:53:59.998 DEBUG:boto:path=/cjqttm-57/?prefix=obj55 2024-04-16T18:53:59.998 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T18:53:59.998 DEBUG:boto:Method: GET 2024-04-16T18:53:59.999 DEBUG:boto:Path: /cjqttm-57/?prefix=obj55 2024-04-16T18:53:59.999 DEBUG:boto:Data: 2024-04-16T18:53:59.999 DEBUG:boto:Headers: {} 2024-04-16T18:53:59.999 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:53:59.999 DEBUG:boto:Port: 8000 2024-04-16T18:53:59.999 DEBUG:boto:Params: {} 2024-04-16T18:53:59.999 DEBUG:boto:Token: None 2024-04-16T18:53:59.999 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:53:59 GMT /cjqttm-57/ 2024-04-16T18:53:59.999 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T18:53:59.999 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T18:54:00.001 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0f9f486d0652ade-00661ec948-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:00.002 DEBUG:boto:b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:54:00.002 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:54:00.002 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:54:00.002 DEBUG:boto:Method: HEAD 2024-04-16T18:54:00.002 DEBUG:boto:Path: /cjqttm-57/obj55 2024-04-16T18:54:00.003 DEBUG:boto:Data: 2024-04-16T18:54:00.003 DEBUG:boto:Headers: {} 2024-04-16T18:54:00.003 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:54:00.003 DEBUG:boto:Port: 8000 2024-04-16T18:54:00.003 DEBUG:boto:Params: {} 2024-04-16T18:54:00.003 DEBUG:boto:Token: None 2024-04-16T18:54:00.003 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:00 GMT /cjqttm-57/obj55 2024-04-16T18:54:00.003 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA= 2024-04-16T18:54:00.003 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA=', 'Content-Length': '0'} 2024-04-16T18:54:00.005 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006232d0246334435f-00661ec948-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:00.005 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:54:00.005 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:54:00.006 DEBUG:boto:Method: HEAD 2024-04-16T18:54:00.006 DEBUG:boto:Path: /cjqttm-57/obj55 2024-04-16T18:54:00.006 DEBUG:boto:Data: 2024-04-16T18:54:00.006 DEBUG:boto:Headers: {} 2024-04-16T18:54:00.006 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:00.006 DEBUG:boto:Port: 8000 2024-04-16T18:54:00.006 DEBUG:boto:Params: {} 2024-04-16T18:54:00.006 DEBUG:boto:Token: None 2024-04-16T18:54:00.006 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:00 GMT /cjqttm-57/obj55 2024-04-16T18:54:00.006 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA= 2024-04-16T18:54:00.007 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA=', 'Content-Length': '0'} 2024-04-16T18:54:00.010 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f20dcf4a091493cf-00661ec948-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:00.010 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj55 2024-04-16T18:54:00.010 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:54:00.010 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:54:00.010 DEBUG:boto:Method: GET 2024-04-16T18:54:00.011 DEBUG:boto:Path: /cjqttm-57/obj55 2024-04-16T18:54:00.011 DEBUG:boto:Data: 2024-04-16T18:54:00.011 DEBUG:boto:Headers: {} 2024-04-16T18:54:00.011 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:54:00.011 DEBUG:boto:Port: 8000 2024-04-16T18:54:00.011 DEBUG:boto:Params: {} 2024-04-16T18:54:00.011 DEBUG:boto:Token: None 2024-04-16T18:54:00.011 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:54:00 GMT /cjqttm-57/obj55 2024-04-16T18:54:00.011 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98= 2024-04-16T18:54:00.012 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98=', 'Content-Length': '0'} 2024-04-16T18:54:00.013 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ca7b8709bdf8fe5-00661ec948-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:00.054 DEBUG:boto:path=/cjqttm-57/obj55 2024-04-16T18:54:00.055 DEBUG:boto:auth_path=/cjqttm-57/obj55 2024-04-16T18:54:00.055 DEBUG:boto:Method: GET 2024-04-16T18:54:00.055 DEBUG:boto:Path: /cjqttm-57/obj55 2024-04-16T18:54:00.055 DEBUG:boto:Data: 2024-04-16T18:54:00.055 DEBUG:boto:Headers: {} 2024-04-16T18:54:00.055 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:00.055 DEBUG:boto:Port: 8000 2024-04-16T18:54:00.055 DEBUG:boto:Params: {} 2024-04-16T18:54:00.055 DEBUG:boto:Token: None 2024-04-16T18:54:00.056 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:54:00 GMT /cjqttm-57/obj55 2024-04-16T18:54:00.056 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98= 2024-04-16T18:54:00.056 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98=', 'Content-Length': '0'} 2024-04-16T18:54:00.058 DEBUG:boto:Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f503371cf82592d6-00661ec948-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:00.058 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:00.058 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:00.058 DEBUG:boto:path=/cjqttm-57/?prefix=obj55 2024-04-16T18:54:00.059 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T18:54:00.059 DEBUG:boto:Method: GET 2024-04-16T18:54:00.059 DEBUG:boto:Path: /cjqttm-57/?prefix=obj55 2024-04-16T18:54:00.059 DEBUG:boto:Data: 2024-04-16T18:54:00.059 DEBUG:boto:Headers: {} 2024-04-16T18:54:00.059 DEBUG:boto:Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T18:54:00.059 DEBUG:boto:Port: 8000 2024-04-16T18:54:00.059 DEBUG:boto:Params: {} 2024-04-16T18:54:00.059 DEBUG:boto:Token: None 2024-04-16T18:54:00.059 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:54:00 GMT /cjqttm-57/ 2024-04-16T18:54:00.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw= 2024-04-16T18:54:00.060 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw=', 'Content-Length': '0'} 2024-04-16T18:54:00.062 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a523d62212f20268-00661ec948-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:00.062 DEBUG:boto:b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:54:00.062 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:00.063 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:00.063 DEBUG:boto:path=/cjqttm-57/?prefix=obj55 2024-04-16T18:54:00.063 DEBUG:boto:auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T18:54:00.063 DEBUG:boto:Method: GET 2024-04-16T18:54:00.063 DEBUG:boto:Path: /cjqttm-57/?prefix=obj55 2024-04-16T18:54:00.063 DEBUG:boto:Data: 2024-04-16T18:54:00.063 DEBUG:boto:Headers: {} 2024-04-16T18:54:00.063 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:00.063 DEBUG:boto:Port: 8000 2024-04-16T18:54:00.063 DEBUG:boto:Params: {} 2024-04-16T18:54:00.063 DEBUG:boto:Token: None 2024-04-16T18:54:00.063 DEBUG:boto:StringToSign: GET Tue, 16 Apr 2024 18:54:00 GMT /cjqttm-57/ 2024-04-16T18:54:00.064 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw= 2024-04-16T18:54:00.064 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw=', 'Content-Length': '0'} 2024-04-16T18:54:00.066 DEBUG:boto:Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094412f44360a1aea-00661ec948-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:00.066 DEBUG:boto:b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T18:54:00.066 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=cjqttm-57 zones={test-zone2, test-zone1} 2024-04-16T18:54:00.067 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T18:54:00.067 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T18:54:00.068 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:54:00.069+0000 7f69a3642640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 220675) UID: 0 2024-04-16T18:54:00.068 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:54:00.069+0000 7f69a962d880 -1 shutting down 2024-04-16T18:54:00.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:54:06.167 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T18:54:06.167 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:06.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:06.168 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:54:06.227 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:06.227 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:06.302 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:54:06.302 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-57 2024-04-16T18:54:06.307 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 5 2024-04-16T18:54:06.359 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.359 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.359 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.359 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.359 DEBUG:boto:Data: 2024-04-16T18:54:06.359 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.360 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.360 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.360 DEBUG:boto:Params: {} 2024-04-16T18:54:06.360 DEBUG:boto:Token: None 2024-04-16T18:54:06.360 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.360 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.361 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.363 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b7c6ed3feb0dfe6-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.364 DEBUG:boto:path=/cjqttm-57/obj17 2024-04-16T18:54:06.364 DEBUG:boto:auth_path=/cjqttm-57/obj17 2024-04-16T18:54:06.364 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.364 DEBUG:boto:Path: /cjqttm-57/obj17 2024-04-16T18:54:06.365 DEBUG:boto:Data: 2024-04-16T18:54:06.365 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.365 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.365 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.365 DEBUG:boto:Params: {} 2024-04-16T18:54:06.365 DEBUG:boto:Token: None 2024-04-16T18:54:06.365 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj17 2024-04-16T18:54:06.365 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jnXPQsU9vazsLjFgyYwMb3RH9G8= 2024-04-16T18:54:06.366 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jnXPQsU9vazsLjFgyYwMb3RH9G8='} 2024-04-16T18:54:06.371 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b3d348ff99709dff-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.371 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.371 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.372 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.372 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.372 DEBUG:boto:Data: 2024-04-16T18:54:06.372 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.372 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.372 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.372 DEBUG:boto:Params: {} 2024-04-16T18:54:06.372 DEBUG:boto:Token: None 2024-04-16T18:54:06.373 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.373 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.373 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.376 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0b4be6d11b394f3-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.376 DEBUG:boto:path=/cjqttm-57/obj34 2024-04-16T18:54:06.376 DEBUG:boto:auth_path=/cjqttm-57/obj34 2024-04-16T18:54:06.376 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.376 DEBUG:boto:Path: /cjqttm-57/obj34 2024-04-16T18:54:06.376 DEBUG:boto:Data: 2024-04-16T18:54:06.377 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.377 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.377 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.377 DEBUG:boto:Params: {} 2024-04-16T18:54:06.377 DEBUG:boto:Token: None 2024-04-16T18:54:06.377 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj34 2024-04-16T18:54:06.377 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nDNvp65ocjIcmisYE1ko9B6S3j8= 2024-04-16T18:54:06.378 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nDNvp65ocjIcmisYE1ko9B6S3j8='} 2024-04-16T18:54:06.423 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000606a85d761496049-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.423 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.423 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.423 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.423 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.424 DEBUG:boto:Data: 2024-04-16T18:54:06.424 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.424 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.424 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.424 DEBUG:boto:Params: {} 2024-04-16T18:54:06.424 DEBUG:boto:Token: None 2024-04-16T18:54:06.424 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.424 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.425 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.427 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf4c7cd10ffe6c89-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.427 DEBUG:boto:path=/cjqttm-57/obj51 2024-04-16T18:54:06.427 DEBUG:boto:auth_path=/cjqttm-57/obj51 2024-04-16T18:54:06.428 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.428 DEBUG:boto:Path: /cjqttm-57/obj51 2024-04-16T18:54:06.428 DEBUG:boto:Data: 2024-04-16T18:54:06.428 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.428 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.428 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.428 DEBUG:boto:Params: {} 2024-04-16T18:54:06.428 DEBUG:boto:Token: None 2024-04-16T18:54:06.429 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj51 2024-04-16T18:54:06.429 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Yy2ENnajmNRATZNLtWecvg7JJSM= 2024-04-16T18:54:06.429 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yy2ENnajmNRATZNLtWecvg7JJSM='} 2024-04-16T18:54:06.434 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000041825c0a24c902ae-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.434 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.434 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.434 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.435 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.435 DEBUG:boto:Data: 2024-04-16T18:54:06.435 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.435 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.435 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.435 DEBUG:boto:Params: {} 2024-04-16T18:54:06.435 DEBUG:boto:Token: None 2024-04-16T18:54:06.435 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.436 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.436 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.438 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000534f78da3fd21ab6-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.439 DEBUG:boto:path=/cjqttm-57/obj68 2024-04-16T18:54:06.439 DEBUG:boto:auth_path=/cjqttm-57/obj68 2024-04-16T18:54:06.439 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.439 DEBUG:boto:Path: /cjqttm-57/obj68 2024-04-16T18:54:06.439 DEBUG:boto:Data: 2024-04-16T18:54:06.439 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.439 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.440 DEBUG:boto:Params: {} 2024-04-16T18:54:06.440 DEBUG:boto:Token: None 2024-04-16T18:54:06.440 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj68 2024-04-16T18:54:06.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:fXfrThp+3fA3+BkzZjocn8agGqk= 2024-04-16T18:54:06.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fXfrThp+3fA3+BkzZjocn8agGqk='} 2024-04-16T18:54:06.482 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c6e985dbff03a21d-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.483 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.483 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.483 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.483 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.483 DEBUG:boto:Data: 2024-04-16T18:54:06.483 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.484 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.484 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.484 DEBUG:boto:Params: {} 2024-04-16T18:54:06.484 DEBUG:boto:Token: None 2024-04-16T18:54:06.484 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.484 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.484 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.487 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a4453086e3d79010-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.487 DEBUG:boto:path=/cjqttm-57/obj85 2024-04-16T18:54:06.487 DEBUG:boto:auth_path=/cjqttm-57/obj85 2024-04-16T18:54:06.487 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.488 DEBUG:boto:Path: /cjqttm-57/obj85 2024-04-16T18:54:06.488 DEBUG:boto:Data: 2024-04-16T18:54:06.488 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.488 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.488 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.488 DEBUG:boto:Params: {} 2024-04-16T18:54:06.488 DEBUG:boto:Token: None 2024-04-16T18:54:06.488 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj85 2024-04-16T18:54:06.489 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/gSaPm1HQu0bACSnZOVmBUzNdY4= 2024-04-16T18:54:06.489 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/gSaPm1HQu0bACSnZOVmBUzNdY4='} 2024-04-16T18:54:06.494 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000032ae7c176ff09c93-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.495 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:06.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:06.495 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:54:06.547 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:06.548 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:06.615 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:54:06.615 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-57 2024-04-16T18:54:06.623 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 10 2024-04-16T18:54:06.679 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.679 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.679 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.680 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.680 DEBUG:boto:Data: 2024-04-16T18:54:06.680 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.680 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.680 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.680 DEBUG:boto:Params: {} 2024-04-16T18:54:06.680 DEBUG:boto:Token: None 2024-04-16T18:54:06.681 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.681 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.681 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.684 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087b1f4d549bc1b4c-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.684 DEBUG:boto:path=/cjqttm-57/obj19 2024-04-16T18:54:06.684 DEBUG:boto:auth_path=/cjqttm-57/obj19 2024-04-16T18:54:06.684 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.684 DEBUG:boto:Path: /cjqttm-57/obj19 2024-04-16T18:54:06.685 DEBUG:boto:Data: 2024-04-16T18:54:06.685 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.685 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.685 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.685 DEBUG:boto:Params: {} 2024-04-16T18:54:06.685 DEBUG:boto:Token: None 2024-04-16T18:54:06.685 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj19 2024-04-16T18:54:06.686 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L8y/vh2lZj68Popl+EuEmvWn7C0= 2024-04-16T18:54:06.686 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L8y/vh2lZj68Popl+EuEmvWn7C0='} 2024-04-16T18:54:06.731 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f6e50a6e92b23f0-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.731 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.731 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.731 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.731 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.731 DEBUG:boto:Data: 2024-04-16T18:54:06.732 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.732 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.732 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.732 DEBUG:boto:Params: {} 2024-04-16T18:54:06.732 DEBUG:boto:Token: None 2024-04-16T18:54:06.732 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.732 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.733 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.735 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fdb92120137b0b49-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.736 DEBUG:boto:path=/cjqttm-57/obj38 2024-04-16T18:54:06.736 DEBUG:boto:auth_path=/cjqttm-57/obj38 2024-04-16T18:54:06.736 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.736 DEBUG:boto:Path: /cjqttm-57/obj38 2024-04-16T18:54:06.736 DEBUG:boto:Data: 2024-04-16T18:54:06.736 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.736 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.736 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.737 DEBUG:boto:Params: {} 2024-04-16T18:54:06.737 DEBUG:boto:Token: None 2024-04-16T18:54:06.737 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj38 2024-04-16T18:54:06.737 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ItUrI+664oHdtMeqsLAyFfu+2Jw= 2024-04-16T18:54:06.737 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ItUrI+664oHdtMeqsLAyFfu+2Jw='} 2024-04-16T18:54:06.742 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bd015ffed6880bc5-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.742 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.743 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.743 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.743 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.743 DEBUG:boto:Data: 2024-04-16T18:54:06.743 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.743 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.743 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.743 DEBUG:boto:Params: {} 2024-04-16T18:54:06.744 DEBUG:boto:Token: None 2024-04-16T18:54:06.744 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.744 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.744 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.746 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8d0e5dab205019a-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.747 DEBUG:boto:path=/cjqttm-57/obj57 2024-04-16T18:54:06.747 DEBUG:boto:auth_path=/cjqttm-57/obj57 2024-04-16T18:54:06.747 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.747 DEBUG:boto:Path: /cjqttm-57/obj57 2024-04-16T18:54:06.747 DEBUG:boto:Data: 2024-04-16T18:54:06.747 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.747 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.748 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.748 DEBUG:boto:Params: {} 2024-04-16T18:54:06.748 DEBUG:boto:Token: None 2024-04-16T18:54:06.748 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj57 2024-04-16T18:54:06.748 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ADuHdlkuyG3hSRWGYBOdb9o1D3U= 2024-04-16T18:54:06.748 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ADuHdlkuyG3hSRWGYBOdb9o1D3U='} 2024-04-16T18:54:06.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2024-04-16T18:54:06.791 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000445584fd83c77677-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.791 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.791 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.791 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.791 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.791 DEBUG:boto:Data: 2024-04-16T18:54:06.791 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.792 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.792 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.792 DEBUG:boto:Params: {} 2024-04-16T18:54:06.792 DEBUG:boto:Token: None 2024-04-16T18:54:06.792 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.792 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.792 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.795 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000022250a9bd32349c4-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.795 DEBUG:boto:path=/cjqttm-57/obj76 2024-04-16T18:54:06.795 DEBUG:boto:auth_path=/cjqttm-57/obj76 2024-04-16T18:54:06.795 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.796 DEBUG:boto:Path: /cjqttm-57/obj76 2024-04-16T18:54:06.796 DEBUG:boto:Data: 2024-04-16T18:54:06.796 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.796 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.796 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.796 DEBUG:boto:Params: {} 2024-04-16T18:54:06.796 DEBUG:boto:Token: None 2024-04-16T18:54:06.796 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj76 2024-04-16T18:54:06.797 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uGTq8hvnxCIL+dGg+W4ycilMIoo= 2024-04-16T18:54:06.797 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uGTq8hvnxCIL+dGg+W4ycilMIoo='} 2024-04-16T18:54:06.802 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005bf2c86e50bfe05a-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.802 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:06.803 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:06.803 DEBUG:boto:Method: HEAD 2024-04-16T18:54:06.803 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:06.803 DEBUG:boto:Data: 2024-04-16T18:54:06.803 DEBUG:boto:Headers: {} 2024-04-16T18:54:06.803 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.803 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.803 DEBUG:boto:Params: {} 2024-04-16T18:54:06.804 DEBUG:boto:Token: None 2024-04-16T18:54:06.804 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/ 2024-04-16T18:54:06.804 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T18:54:06.804 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T18:54:06.806 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d94481e4dc4c3e5-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.807 DEBUG:boto:path=/cjqttm-57/obj95 2024-04-16T18:54:06.807 DEBUG:boto:auth_path=/cjqttm-57/obj95 2024-04-16T18:54:06.807 DEBUG:boto:Method: PUT 2024-04-16T18:54:06.807 DEBUG:boto:Path: /cjqttm-57/obj95 2024-04-16T18:54:06.807 DEBUG:boto:Data: 2024-04-16T18:54:06.807 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:06.807 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:06.807 DEBUG:boto:Port: 8000 2024-04-16T18:54:06.808 DEBUG:boto:Params: {} 2024-04-16T18:54:06.808 DEBUG:boto:Token: None 2024-04-16T18:54:06.808 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:06 GMT /cjqttm-57/obj95 2024-04-16T18:54:06.808 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:L+pat7p93EbqmODSIKyDwwqx5bA= 2024-04-16T18:54:06.808 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L+pat7p93EbqmODSIKyDwwqx5bA='} 2024-04-16T18:54:06.850 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004bded76d76a8a292-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:06.851 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:06.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:06.851 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:54:06.902 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:06.903 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:06.975 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:54:06.976 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-57 2024-04-16T18:54:06.984 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 15 2024-04-16T18:54:07.045 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.045 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.045 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.045 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.046 DEBUG:boto:Data: 2024-04-16T18:54:07.046 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.046 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.046 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.046 DEBUG:boto:Params: {} 2024-04-16T18:54:07.046 DEBUG:boto:Token: None 2024-04-16T18:54:07.046 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.047 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.047 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.050 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000020dc9969e245f9ff-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.050 DEBUG:boto:path=/cjqttm-57/obj23 2024-04-16T18:54:07.050 DEBUG:boto:auth_path=/cjqttm-57/obj23 2024-04-16T18:54:07.050 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.050 DEBUG:boto:Path: /cjqttm-57/obj23 2024-04-16T18:54:07.051 DEBUG:boto:Data: 2024-04-16T18:54:07.051 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.051 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.051 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.051 DEBUG:boto:Params: {} 2024-04-16T18:54:07.051 DEBUG:boto:Token: None 2024-04-16T18:54:07.051 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj23 2024-04-16T18:54:07.051 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:1XHlv6f5vPO3pK8Os5h804HD3Tk= 2024-04-16T18:54:07.052 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1XHlv6f5vPO3pK8Os5h804HD3Tk='} 2024-04-16T18:54:07.058 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000016c52ae579f22fd8-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.058 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.058 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.058 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.058 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.058 DEBUG:boto:Data: 2024-04-16T18:54:07.059 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.059 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.059 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.059 DEBUG:boto:Params: {} 2024-04-16T18:54:07.059 DEBUG:boto:Token: None 2024-04-16T18:54:07.059 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.062 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000843b9679b73bfecc-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.062 DEBUG:boto:path=/cjqttm-57/obj46 2024-04-16T18:54:07.062 DEBUG:boto:auth_path=/cjqttm-57/obj46 2024-04-16T18:54:07.062 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.062 DEBUG:boto:Path: /cjqttm-57/obj46 2024-04-16T18:54:07.062 DEBUG:boto:Data: 2024-04-16T18:54:07.063 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.063 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.063 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.063 DEBUG:boto:Params: {} 2024-04-16T18:54:07.063 DEBUG:boto:Token: None 2024-04-16T18:54:07.063 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj46 2024-04-16T18:54:07.063 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:uXlFOd0NqIROBqgK71BFCB/5EGY= 2024-04-16T18:54:07.063 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uXlFOd0NqIROBqgK71BFCB/5EGY='} 2024-04-16T18:54:07.068 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009e2b01753a2ffa3f-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.069 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.069 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.069 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.069 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.069 DEBUG:boto:Data: 2024-04-16T18:54:07.069 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.069 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.069 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.070 DEBUG:boto:Params: {} 2024-04-16T18:54:07.070 DEBUG:boto:Token: None 2024-04-16T18:54:07.070 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.070 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.070 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.072 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b612cea04151426-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.073 DEBUG:boto:path=/cjqttm-57/obj69 2024-04-16T18:54:07.073 DEBUG:boto:auth_path=/cjqttm-57/obj69 2024-04-16T18:54:07.073 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.073 DEBUG:boto:Path: /cjqttm-57/obj69 2024-04-16T18:54:07.073 DEBUG:boto:Data: 2024-04-16T18:54:07.073 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.073 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.074 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.074 DEBUG:boto:Params: {} 2024-04-16T18:54:07.074 DEBUG:boto:Token: None 2024-04-16T18:54:07.074 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj69 2024-04-16T18:54:07.074 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:iJOJufduyjd7u2X2b4Ncw7V0qqw= 2024-04-16T18:54:07.074 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iJOJufduyjd7u2X2b4Ncw7V0qqw='} 2024-04-16T18:54:07.079 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd496eb7eae58c3f-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.079 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.079 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.079 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.080 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.080 DEBUG:boto:Data: 2024-04-16T18:54:07.080 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.080 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.080 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.080 DEBUG:boto:Params: {} 2024-04-16T18:54:07.080 DEBUG:boto:Token: None 2024-04-16T18:54:07.080 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.080 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.081 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.083 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000036efae93879eacc8-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.083 DEBUG:boto:path=/cjqttm-57/obj92 2024-04-16T18:54:07.083 DEBUG:boto:auth_path=/cjqttm-57/obj92 2024-04-16T18:54:07.083 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.084 DEBUG:boto:Path: /cjqttm-57/obj92 2024-04-16T18:54:07.084 DEBUG:boto:Data: 2024-04-16T18:54:07.084 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.084 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.084 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.084 DEBUG:boto:Params: {} 2024-04-16T18:54:07.084 DEBUG:boto:Token: None 2024-04-16T18:54:07.084 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj92 2024-04-16T18:54:07.085 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zCw+VlmNMoDF+XA0B3ygcqCTnx8= 2024-04-16T18:54:07.085 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zCw+VlmNMoDF+XA0B3ygcqCTnx8='} 2024-04-16T18:54:07.127 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ea24e0420d6e5b62-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.127 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.127 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.127 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.127 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.127 DEBUG:boto:Data: 2024-04-16T18:54:07.127 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.127 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.128 DEBUG:boto:Params: {} 2024-04-16T18:54:07.128 DEBUG:boto:Token: None 2024-04-16T18:54:07.128 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.128 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.128 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.131 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b75001826de90071-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.131 DEBUG:boto:path=/cjqttm-57/obj115 2024-04-16T18:54:07.131 DEBUG:boto:auth_path=/cjqttm-57/obj115 2024-04-16T18:54:07.131 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.131 DEBUG:boto:Path: /cjqttm-57/obj115 2024-04-16T18:54:07.131 DEBUG:boto:Data: 2024-04-16T18:54:07.131 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.132 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.132 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.132 DEBUG:boto:Params: {} 2024-04-16T18:54:07.132 DEBUG:boto:Token: None 2024-04-16T18:54:07.132 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj115 2024-04-16T18:54:07.132 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ufG/BYQrD094G/n0aQFgk03u3o0= 2024-04-16T18:54:07.132 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ufG/BYQrD094G/n0aQFgk03u3o0='} 2024-04-16T18:54:07.138 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b9c68e19ce1f2d43-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.138 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:07.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:07.138 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:54:07.189 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:07.189 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:54:07.256 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-57 2024-04-16T18:54:07.266 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 20 2024-04-16T18:54:07.330 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.331 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.331 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.331 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.331 DEBUG:boto:Data: 2024-04-16T18:54:07.331 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.331 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.331 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.331 DEBUG:boto:Params: {} 2024-04-16T18:54:07.332 DEBUG:boto:Token: None 2024-04-16T18:54:07.332 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.332 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.332 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.335 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000046f9d853ddec9208-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.335 DEBUG:boto:path=/cjqttm-57/obj29 2024-04-16T18:54:07.335 DEBUG:boto:auth_path=/cjqttm-57/obj29 2024-04-16T18:54:07.335 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.336 DEBUG:boto:Path: /cjqttm-57/obj29 2024-04-16T18:54:07.336 DEBUG:boto:Data: 2024-04-16T18:54:07.336 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.336 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.336 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.336 DEBUG:boto:Params: {} 2024-04-16T18:54:07.336 DEBUG:boto:Token: None 2024-04-16T18:54:07.336 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj29 2024-04-16T18:54:07.336 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:zRukanuIzw5xuU0PcbTjequ2S5M= 2024-04-16T18:54:07.337 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zRukanuIzw5xuU0PcbTjequ2S5M='} 2024-04-16T18:54:07.379 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000442913feb91c4f93-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.379 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.379 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.379 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.379 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.379 DEBUG:boto:Data: 2024-04-16T18:54:07.379 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.380 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.380 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.380 DEBUG:boto:Params: {} 2024-04-16T18:54:07.380 DEBUG:boto:Token: None 2024-04-16T18:54:07.380 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.380 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.380 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.383 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d247d5cf8b4299b-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.383 DEBUG:boto:path=/cjqttm-57/obj58 2024-04-16T18:54:07.384 DEBUG:boto:auth_path=/cjqttm-57/obj58 2024-04-16T18:54:07.384 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.384 DEBUG:boto:Path: /cjqttm-57/obj58 2024-04-16T18:54:07.384 DEBUG:boto:Data: 2024-04-16T18:54:07.384 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.384 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.384 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.384 DEBUG:boto:Params: {} 2024-04-16T18:54:07.384 DEBUG:boto:Token: None 2024-04-16T18:54:07.385 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj58 2024-04-16T18:54:07.385 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:/RW6NddmYDRoLZBquqDOlOtRm2U= 2024-04-16T18:54:07.385 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/RW6NddmYDRoLZBquqDOlOtRm2U='} 2024-04-16T18:54:07.391 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006420d0cb3c55eaa0-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.391 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.391 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.391 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.391 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.392 DEBUG:boto:Data: 2024-04-16T18:54:07.392 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.392 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.392 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.392 DEBUG:boto:Params: {} 2024-04-16T18:54:07.392 DEBUG:boto:Token: None 2024-04-16T18:54:07.392 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.392 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.392 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.395 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083d8012325078fe5-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.395 DEBUG:boto:path=/cjqttm-57/obj87 2024-04-16T18:54:07.396 DEBUG:boto:auth_path=/cjqttm-57/obj87 2024-04-16T18:54:07.396 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.396 DEBUG:boto:Path: /cjqttm-57/obj87 2024-04-16T18:54:07.396 DEBUG:boto:Data: 2024-04-16T18:54:07.396 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.396 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.396 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.396 DEBUG:boto:Params: {} 2024-04-16T18:54:07.396 DEBUG:boto:Token: None 2024-04-16T18:54:07.397 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj87 2024-04-16T18:54:07.397 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:jipW1e1hSrNWES5XdSb3H/IIHlo= 2024-04-16T18:54:07.397 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jipW1e1hSrNWES5XdSb3H/IIHlo='} 2024-04-16T18:54:07.439 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005dffed98a291603e-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.439 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.439 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.439 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.439 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.439 DEBUG:boto:Data: 2024-04-16T18:54:07.439 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.439 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.439 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.440 DEBUG:boto:Params: {} 2024-04-16T18:54:07.440 DEBUG:boto:Token: None 2024-04-16T18:54:07.440 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.440 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.440 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.442 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f352e9e143a9cb68-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.443 DEBUG:boto:path=/cjqttm-57/obj116 2024-04-16T18:54:07.443 DEBUG:boto:auth_path=/cjqttm-57/obj116 2024-04-16T18:54:07.443 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.443 DEBUG:boto:Path: /cjqttm-57/obj116 2024-04-16T18:54:07.443 DEBUG:boto:Data: 2024-04-16T18:54:07.443 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.443 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.444 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.444 DEBUG:boto:Params: {} 2024-04-16T18:54:07.444 DEBUG:boto:Token: None 2024-04-16T18:54:07.444 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj116 2024-04-16T18:54:07.444 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:Nymbyn56vdj1/4vnNfaXiV7nmNQ= 2024-04-16T18:54:07.444 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nymbyn56vdj1/4vnNfaXiV7nmNQ='} 2024-04-16T18:54:07.450 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000093518bdcd026e789-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.450 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.450 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.450 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.450 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.450 DEBUG:boto:Data: 2024-04-16T18:54:07.450 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.450 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.451 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.451 DEBUG:boto:Params: {} 2024-04-16T18:54:07.451 DEBUG:boto:Token: None 2024-04-16T18:54:07.451 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.451 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.451 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.454 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000088699a19f86430fb-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.454 DEBUG:boto:path=/cjqttm-57/obj145 2024-04-16T18:54:07.454 DEBUG:boto:auth_path=/cjqttm-57/obj145 2024-04-16T18:54:07.454 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.454 DEBUG:boto:Path: /cjqttm-57/obj145 2024-04-16T18:54:07.455 DEBUG:boto:Data: 2024-04-16T18:54:07.455 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.455 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.455 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.455 DEBUG:boto:Params: {} 2024-04-16T18:54:07.455 DEBUG:boto:Token: None 2024-04-16T18:54:07.455 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj145 2024-04-16T18:54:07.455 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:gjOlW66IQd9u8zJfIOAd2p5Axhg= 2024-04-16T18:54:07.456 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gjOlW66IQd9u8zJfIOAd2p5Axhg='} 2024-04-16T18:54:07.499 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000613c6c2706d0e441-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.499 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:07.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:07.499 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:54:07.550 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:07.550 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:07.615 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:54:07.615 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-57 2024-04-16T18:54:07.627 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 25 2024-04-16T18:54:07.699 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.700 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.700 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.700 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.700 DEBUG:boto:Data: 2024-04-16T18:54:07.700 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.700 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.700 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.700 DEBUG:boto:Params: {} 2024-04-16T18:54:07.700 DEBUG:boto:Token: None 2024-04-16T18:54:07.701 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.701 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.701 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.704 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb3d781a143e1b01-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.704 DEBUG:boto:path=/cjqttm-57/obj31 2024-04-16T18:54:07.704 DEBUG:boto:auth_path=/cjqttm-57/obj31 2024-04-16T18:54:07.704 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.704 DEBUG:boto:Path: /cjqttm-57/obj31 2024-04-16T18:54:07.704 DEBUG:boto:Data: 2024-04-16T18:54:07.704 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.704 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.705 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.705 DEBUG:boto:Params: {} 2024-04-16T18:54:07.705 DEBUG:boto:Token: None 2024-04-16T18:54:07.705 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj31 2024-04-16T18:54:07.705 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:dlIEk9t9zx+e0wLW9FmAljqnPiA= 2024-04-16T18:54:07.705 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dlIEk9t9zx+e0wLW9FmAljqnPiA='} 2024-04-16T18:54:07.710 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003a7dfd1a60f07874-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.710 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.711 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.711 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.711 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.711 DEBUG:boto:Data: 2024-04-16T18:54:07.711 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.711 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.711 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.711 DEBUG:boto:Params: {} 2024-04-16T18:54:07.711 DEBUG:boto:Token: None 2024-04-16T18:54:07.711 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.712 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.712 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.714 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bac7669d0728cd28-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.714 DEBUG:boto:path=/cjqttm-57/obj62 2024-04-16T18:54:07.714 DEBUG:boto:auth_path=/cjqttm-57/obj62 2024-04-16T18:54:07.715 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.715 DEBUG:boto:Path: /cjqttm-57/obj62 2024-04-16T18:54:07.715 DEBUG:boto:Data: 2024-04-16T18:54:07.715 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.715 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.715 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.715 DEBUG:boto:Params: {} 2024-04-16T18:54:07.715 DEBUG:boto:Token: None 2024-04-16T18:54:07.715 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj62 2024-04-16T18:54:07.716 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:NNTm7tMgTPriMzt5RY8vyRbe/M4= 2024-04-16T18:54:07.716 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NNTm7tMgTPriMzt5RY8vyRbe/M4='} 2024-04-16T18:54:07.720 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ff784702e51ee80c-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.721 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.721 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.721 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.721 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.721 DEBUG:boto:Data: 2024-04-16T18:54:07.721 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.721 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.721 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.721 DEBUG:boto:Params: {} 2024-04-16T18:54:07.722 DEBUG:boto:Token: None 2024-04-16T18:54:07.722 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.722 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.722 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.724 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000132b78bc4959b14d-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.725 DEBUG:boto:path=/cjqttm-57/obj93 2024-04-16T18:54:07.725 DEBUG:boto:auth_path=/cjqttm-57/obj93 2024-04-16T18:54:07.725 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.725 DEBUG:boto:Path: /cjqttm-57/obj93 2024-04-16T18:54:07.725 DEBUG:boto:Data: 2024-04-16T18:54:07.725 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.725 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.725 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.725 DEBUG:boto:Params: {} 2024-04-16T18:54:07.726 DEBUG:boto:Token: None 2024-04-16T18:54:07.726 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj93 2024-04-16T18:54:07.726 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:cVgN7RXHP9hV3mSDuFPD9YEfccY= 2024-04-16T18:54:07.726 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cVgN7RXHP9hV3mSDuFPD9YEfccY='} 2024-04-16T18:54:07.770 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000326ef27eda29ccbd-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.771 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.771 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.771 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.771 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.771 DEBUG:boto:Data: 2024-04-16T18:54:07.771 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.771 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.771 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.772 DEBUG:boto:Params: {} 2024-04-16T18:54:07.772 DEBUG:boto:Token: None 2024-04-16T18:54:07.772 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.772 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.772 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.774 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e0015420ee72aacc-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.774 DEBUG:boto:path=/cjqttm-57/obj124 2024-04-16T18:54:07.775 DEBUG:boto:auth_path=/cjqttm-57/obj124 2024-04-16T18:54:07.775 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.775 DEBUG:boto:Path: /cjqttm-57/obj124 2024-04-16T18:54:07.775 DEBUG:boto:Data: 2024-04-16T18:54:07.775 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.775 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.775 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.775 DEBUG:boto:Params: {} 2024-04-16T18:54:07.775 DEBUG:boto:Token: None 2024-04-16T18:54:07.776 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj124 2024-04-16T18:54:07.776 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:nLLiYNyyX1ux73840y161y8hHBs= 2024-04-16T18:54:07.776 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nLLiYNyyX1ux73840y161y8hHBs='} 2024-04-16T18:54:07.781 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009ba5eefe6745bc43-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.781 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:07.781 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:07.781 DEBUG:boto:Method: HEAD 2024-04-16T18:54:07.781 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:07.781 DEBUG:boto:Data: 2024-04-16T18:54:07.781 DEBUG:boto:Headers: {} 2024-04-16T18:54:07.781 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.781 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.782 DEBUG:boto:Params: {} 2024-04-16T18:54:07.782 DEBUG:boto:Token: None 2024-04-16T18:54:07.782 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/ 2024-04-16T18:54:07.782 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T18:54:07.782 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T18:54:07.785 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000834289447d7c0d7b-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.785 DEBUG:boto:path=/cjqttm-57/obj155 2024-04-16T18:54:07.785 DEBUG:boto:auth_path=/cjqttm-57/obj155 2024-04-16T18:54:07.785 DEBUG:boto:Method: PUT 2024-04-16T18:54:07.785 DEBUG:boto:Path: /cjqttm-57/obj155 2024-04-16T18:54:07.785 DEBUG:boto:Data: 2024-04-16T18:54:07.785 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:07.786 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:07.786 DEBUG:boto:Port: 8000 2024-04-16T18:54:07.786 DEBUG:boto:Params: {} 2024-04-16T18:54:07.786 DEBUG:boto:Token: None 2024-04-16T18:54:07.786 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:07 GMT /cjqttm-57/obj155 2024-04-16T18:54:07.786 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+p7ShhMYPefNMiygcO/Jj7NWUhI= 2024-04-16T18:54:07.786 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+p7ShhMYPefNMiygcO/Jj7NWUhI='} 2024-04-16T18:54:07.830 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000bf3bc22adba5761-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:07.831 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:07.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:07.831 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T18:54:07.882 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:07.882 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:07.957 INFO:teuthology.orchestra.run.smithi016.stdout:tenant: 2024-04-16T18:54:07.957 INFO:teuthology.orchestra.run.smithi016.stdout:bucket name: cjqttm-57 2024-04-16T18:54:07.971 INFO:teuthology.orchestra.run.smithi016.stdout:total entries: 30 2024-04-16T18:54:08.043 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:08.043 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:08.043 DEBUG:boto:Method: HEAD 2024-04-16T18:54:08.043 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:08.044 DEBUG:boto:Data: 2024-04-16T18:54:08.044 DEBUG:boto:Headers: {} 2024-04-16T18:54:08.044 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.044 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.044 DEBUG:boto:Params: {} 2024-04-16T18:54:08.044 DEBUG:boto:Token: None 2024-04-16T18:54:08.044 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/ 2024-04-16T18:54:08.044 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T18:54:08.044 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T18:54:08.047 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d881716cd292a3e-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.047 DEBUG:boto:path=/cjqttm-57/obj37 2024-04-16T18:54:08.048 DEBUG:boto:auth_path=/cjqttm-57/obj37 2024-04-16T18:54:08.048 DEBUG:boto:Method: PUT 2024-04-16T18:54:08.048 DEBUG:boto:Path: /cjqttm-57/obj37 2024-04-16T18:54:08.048 DEBUG:boto:Data: 2024-04-16T18:54:08.048 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:08.048 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.048 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.048 DEBUG:boto:Params: {} 2024-04-16T18:54:08.048 DEBUG:boto:Token: None 2024-04-16T18:54:08.048 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/obj37 2024-04-16T18:54:08.049 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:+Y/UsU3ZIP6DJqd5VG54C2PgD34= 2024-04-16T18:54:08.049 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Y/UsU3ZIP6DJqd5VG54C2PgD34='} 2024-04-16T18:54:08.054 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000000bc035d6c11d248-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.054 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:08.054 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:08.054 DEBUG:boto:Method: HEAD 2024-04-16T18:54:08.054 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:08.054 DEBUG:boto:Data: 2024-04-16T18:54:08.054 DEBUG:boto:Headers: {} 2024-04-16T18:54:08.054 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.054 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.054 DEBUG:boto:Params: {} 2024-04-16T18:54:08.055 DEBUG:boto:Token: None 2024-04-16T18:54:08.055 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/ 2024-04-16T18:54:08.055 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T18:54:08.055 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T18:54:08.058 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000065d4f582e932b190-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.058 DEBUG:boto:path=/cjqttm-57/obj74 2024-04-16T18:54:08.058 DEBUG:boto:auth_path=/cjqttm-57/obj74 2024-04-16T18:54:08.058 DEBUG:boto:Method: PUT 2024-04-16T18:54:08.058 DEBUG:boto:Path: /cjqttm-57/obj74 2024-04-16T18:54:08.058 DEBUG:boto:Data: 2024-04-16T18:54:08.058 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:08.058 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.059 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.059 DEBUG:boto:Params: {} 2024-04-16T18:54:08.059 DEBUG:boto:Token: None 2024-04-16T18:54:08.059 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/obj74 2024-04-16T18:54:08.059 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:YkmR2dEgOvipOVZeR26dQped7Zc= 2024-04-16T18:54:08.059 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkmR2dEgOvipOVZeR26dQped7Zc='} 2024-04-16T18:54:08.064 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000084bed06d83d29bdb-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.064 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:08.064 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:08.064 DEBUG:boto:Method: HEAD 2024-04-16T18:54:08.064 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:08.064 DEBUG:boto:Data: 2024-04-16T18:54:08.064 DEBUG:boto:Headers: {} 2024-04-16T18:54:08.065 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.065 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.065 DEBUG:boto:Params: {} 2024-04-16T18:54:08.065 DEBUG:boto:Token: None 2024-04-16T18:54:08.065 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/ 2024-04-16T18:54:08.065 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T18:54:08.065 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T18:54:08.068 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f74cc247439e8ef8-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.068 DEBUG:boto:path=/cjqttm-57/obj111 2024-04-16T18:54:08.068 DEBUG:boto:auth_path=/cjqttm-57/obj111 2024-04-16T18:54:08.068 DEBUG:boto:Method: PUT 2024-04-16T18:54:08.068 DEBUG:boto:Path: /cjqttm-57/obj111 2024-04-16T18:54:08.068 DEBUG:boto:Data: 2024-04-16T18:54:08.068 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:08.069 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.069 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.069 DEBUG:boto:Params: {} 2024-04-16T18:54:08.069 DEBUG:boto:Token: None 2024-04-16T18:54:08.069 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/obj111 2024-04-16T18:54:08.069 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:e4dl4RbJvRBUFGSzAZlrIp1jSpQ= 2024-04-16T18:54:08.069 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e4dl4RbJvRBUFGSzAZlrIp1jSpQ='} 2024-04-16T18:54:08.110 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000992453845b3f5a6d-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.111 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:08.111 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:08.111 DEBUG:boto:Method: HEAD 2024-04-16T18:54:08.111 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:08.111 DEBUG:boto:Data: 2024-04-16T18:54:08.111 DEBUG:boto:Headers: {} 2024-04-16T18:54:08.111 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.111 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.111 DEBUG:boto:Params: {} 2024-04-16T18:54:08.112 DEBUG:boto:Token: None 2024-04-16T18:54:08.112 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/ 2024-04-16T18:54:08.112 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T18:54:08.112 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T18:54:08.115 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000022d15874b0c7d62f-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.115 DEBUG:boto:path=/cjqttm-57/obj148 2024-04-16T18:54:08.115 DEBUG:boto:auth_path=/cjqttm-57/obj148 2024-04-16T18:54:08.115 DEBUG:boto:Method: PUT 2024-04-16T18:54:08.115 DEBUG:boto:Path: /cjqttm-57/obj148 2024-04-16T18:54:08.116 DEBUG:boto:Data: 2024-04-16T18:54:08.116 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:08.116 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.116 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.116 DEBUG:boto:Params: {} 2024-04-16T18:54:08.116 DEBUG:boto:Token: None 2024-04-16T18:54:08.116 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/obj148 2024-04-16T18:54:08.116 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:ZCrJGMLQg+UUTovNz/IwTTqfeqw= 2024-04-16T18:54:08.116 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZCrJGMLQg+UUTovNz/IwTTqfeqw='} 2024-04-16T18:54:08.121 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a7e856a1ed80aa3f-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.122 DEBUG:boto:path=/cjqttm-57/ 2024-04-16T18:54:08.122 DEBUG:boto:auth_path=/cjqttm-57/ 2024-04-16T18:54:08.122 DEBUG:boto:Method: HEAD 2024-04-16T18:54:08.122 DEBUG:boto:Path: /cjqttm-57/ 2024-04-16T18:54:08.122 DEBUG:boto:Data: 2024-04-16T18:54:08.122 DEBUG:boto:Headers: {} 2024-04-16T18:54:08.122 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.122 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.122 DEBUG:boto:Params: {} 2024-04-16T18:54:08.123 DEBUG:boto:Token: None 2024-04-16T18:54:08.123 DEBUG:boto:StringToSign: HEAD Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/ 2024-04-16T18:54:08.123 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T18:54:08.123 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T18:54:08.126 DEBUG:boto:Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008c0242c320d37085-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.126 DEBUG:boto:path=/cjqttm-57/obj185 2024-04-16T18:54:08.126 DEBUG:boto:auth_path=/cjqttm-57/obj185 2024-04-16T18:54:08.126 DEBUG:boto:Method: PUT 2024-04-16T18:54:08.126 DEBUG:boto:Path: /cjqttm-57/obj185 2024-04-16T18:54:08.126 DEBUG:boto:Data: 2024-04-16T18:54:08.127 DEBUG:boto:Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T18:54:08.127 DEBUG:boto:Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T18:54:08.127 DEBUG:boto:Port: 8000 2024-04-16T18:54:08.127 DEBUG:boto:Params: {} 2024-04-16T18:54:08.127 DEBUG:boto:Token: None 2024-04-16T18:54:08.127 DEBUG:boto:StringToSign: PUT rL0Y20zC+Fzt72VPzMSk2A== application/octet-stream Tue, 16 Apr 2024 18:54:08 GMT /cjqttm-57/obj185 2024-04-16T18:54:08.127 DEBUG:boto:Signature: AWS 51CH7DEF4C5TK3K8FIQL:DbSUq7+L0xzyHRDPXd6bNmvwyuM= 2024-04-16T18:54:08.127 DEBUG:boto:Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DbSUq7+L0xzyHRDPXd6bNmvwyuM='} 2024-04-16T18:54:08.170 DEBUG:boto:Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e00302594b15f0a3-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T18:54:08.171 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:08.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T18:54:08.171 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T18:54:08.228 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:08.228 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:08.286 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:08.287+0000 7ff40b644800 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-16T18:54:08.288 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:08.289+0000 7ff40b644800 5 RGW-SYNC:data: acquired data sync status lease 2024-04-16T18:54:08.320 INFO:tasks.rgw.c2.client.0:Restarting daemon 2024-04-16T18:54:08.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T18:54:08.322 INFO:tasks.rgw.c2.client.0:Started 2024-04-16T18:54:08.322 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:54:08.341 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:54:08.341 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:54:08.341 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T18:54:08.342 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-16T18:54:08.342 INFO:teuthology.orchestra.run.smithi139.stderr:curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T18:54:08.528 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:54:08.530+0000 7fd935e63880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T18:54:09.343 DEBUG:teuthology.orchestra.run.smithi139:> curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T18:54:09.364 INFO:teuthology.orchestra.run.smithi139.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T18:54:09.364 INFO:teuthology.orchestra.run.smithi139.stderr: Dload Upload Total Spent Left Speed 2024-04-16T18:54:09.365 INFO:teuthology.orchestra.run.smithi139.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T18:54:09.365 INFO:teuthology.orchestra.run.smithi139.stdout:anonymous 2024-04-16T18:54:09.365 DEBUG:rgw_multi.tests:bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-57 2024-04-16T18:54:09.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:54:09.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T18:54:09.366 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-57 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T18:54:09.460 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:54:09.460 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:54:09.518 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:09.519+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:14.519 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:14.519+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:19.520 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:19.520+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:24.521 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:24.521+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:29.522 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:29.522+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:34.523 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:34.522+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:39.524 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:39.524+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:44.525 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:44.526+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:49.526 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:49.527+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:54.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:54.527+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:54:59.527 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:54:59.527+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:04.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:04.528+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:09.529 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:09.529+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:14.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:14.531+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:19.531 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:19.532+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:24.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:24.533+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:29.533 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:29.534+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:34.534 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:34.535+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:39.535 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:39.536+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:42.286 INFO:tasks.rgw.c2.client.0.smithi139.stdout:*** Caught signal (Segmentation fault) ** 2024-04-16T18:55:42.286 INFO:tasks.rgw.c2.client.0.smithi139.stdout: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T18:55:42.287 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout:2024-04-16T18:55:42.287+0000 7fd811bc9640 -1 *** Caught signal (Segmentation fault) ** 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T18:55:42.288 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T18:55:42.289 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T18:55:42.290 INFO:tasks.rgw.c2.client.0.smithi139.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T18:55:42.290 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2024-04-16T18:55:42.299 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 0> 2024-04-16T18:55:42.287+0000 7fd811bc9640 -1 *** Caught signal (Segmentation fault) ** 2024-04-16T18:55:42.299 INFO:tasks.rgw.c2.client.0.smithi139.stdout: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T18:55:42.299 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2024-04-16T18:55:42.299 INFO:tasks.rgw.c2.client.0.smithi139.stdout: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T18:55:42.299 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T18:55:42.300 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T18:55:42.301 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T18:55:42.301 INFO:tasks.rgw.c2.client.0.smithi139.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T18:55:42.301 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2024-04-16T18:55:42.308 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 0> 2024-04-16T18:55:42.287+0000 7fd811bc9640 -1 *** Caught signal (Segmentation fault) ** 2024-04-16T18:55:42.308 INFO:tasks.rgw.c2.client.0.smithi139.stdout: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T18:55:42.308 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2024-04-16T18:55:42.308 INFO:tasks.rgw.c2.client.0.smithi139.stdout: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T18:55:42.308 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T18:55:42.309 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T18:55:42.310 INFO:tasks.rgw.c2.client.0.smithi139.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T18:55:42.310 INFO:tasks.rgw.c2.client.0.smithi139.stdout: 2024-04-16T18:55:42.510 INFO:tasks.rgw.c2.client.0.smithi139.stderr:daemon-helper: command crashed with signal 11 2024-04-16T18:55:42.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T18:55:44.536 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:44.536+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:48.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~6s 2024-04-16T18:55:49.537 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:49.537+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:54.538 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:54.538+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:55:54.607 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~12s 2024-04-16T18:55:59.539 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:55:59.539+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:00.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~18s 2024-04-16T18:56:04.540 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:04.540+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:06.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~24s 2024-04-16T18:56:09.541 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:09.541+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:12.334 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~30s 2024-04-16T18:56:14.542 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:14.543+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:18.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~35s 2024-04-16T18:56:19.543 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:19.544+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:24.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~41s 2024-04-16T18:56:24.544 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:24.545+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:29.545 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:29.545+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:30.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~47s 2024-04-16T18:56:34.546 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:34.546+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:35.961 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~53s 2024-04-16T18:56:39.547 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:39.547+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:41.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~59s 2024-04-16T18:56:44.548 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:44.548+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:47.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~65s 2024-04-16T18:56:49.549 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:49.549+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:53.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~71s 2024-04-16T18:56:54.550 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:54.551+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:59.551 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:56:59.552+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:56:59.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~77s 2024-04-16T18:57:04.552 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:04.553+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:05.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~83s 2024-04-16T18:57:09.553 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:09.554+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:11.411 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~89s 2024-04-16T18:57:14.554 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:14.554+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:17.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~95s 2024-04-16T18:57:19.555 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:19.555+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:23.228 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~100s 2024-04-16T18:57:24.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:24.555+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:29.137 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~106s 2024-04-16T18:57:29.556 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:29.556+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:34.557 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:34.557+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:35.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~112s 2024-04-16T18:57:39.558 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:39.558+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:40.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~118s 2024-04-16T18:57:44.559 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:44.559+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:46.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~124s 2024-04-16T18:57:49.560 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:49.560+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:52.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~130s 2024-04-16T18:57:54.561 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:54.561+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:57:58.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~136s 2024-04-16T18:57:59.562 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:57:59.561+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:04.563 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:04.562+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:04.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~142s 2024-04-16T18:58:09.564 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:09.563+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:10.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~148s 2024-04-16T18:58:14.565 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:14.564+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:16.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~154s 2024-04-16T18:58:19.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:19.565+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:22.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~160s 2024-04-16T18:58:24.566 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:24.566+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:28.222 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~165s 2024-04-16T18:58:29.567 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:29.568+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:34.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~171s 2024-04-16T18:58:34.568 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:34.569+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:39.569 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:39.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:40.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~177s 2024-04-16T18:58:44.570 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:44.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:45.944 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~183s 2024-04-16T18:58:49.571 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:49.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:51.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~189s 2024-04-16T18:58:54.574 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:54.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:58:57.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~195s 2024-04-16T18:58:59.572 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:58:59.571+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T18:59:03.722 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~201s 2024-04-16T18:59:04.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:04.572+0000 7f9884f28800 -1 bucket checkpoint timed out waiting to reach latest generation 6 2024-04-16T18:59:04.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:04.572+0000 7f9884f28800 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T18:59:04.573 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:04.572+0000 7f9884f28800 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T18:59:04.602 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-04-16T18:59:04.615 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_resharded_bucket_incremental_sync_oldest_after_data_sync_init ... FAIL 2024-04-16T18:59:04.616 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:04.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:04.617 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:04.672 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:04.672 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:04.729 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T18:59:04.754 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T18:59:04.754 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:04.754 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T18:59:04.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:04.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:04.755 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:04.809 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:04.809 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:04.866 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:04.866+0000 7fee6bd2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:04.867 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:04.867+0000 7fee6bd2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:04.895 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:04Z"} 2024-04-16T18:59:04.959 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:04Z"} 2024-04-16T18:59:04.959 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:04.959 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:04.959 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:04.960 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:09.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~207s 2024-04-16T18:59:09.961 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:09.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:09.961 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:10.017 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:10.017 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:10.073 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:10.073+0000 7f2806c16800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:10.074 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:10.074+0000 7f2806c16800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:10.098 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:10Z"} 2024-04-16T18:59:10.098 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:10Z"} 2024-04-16T18:59:10.099 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:10.099 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:10.099 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:10.099 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:15.099 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:15.100 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:15.100 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:15.155 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:15.211 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:15.212+0000 7fc563f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:15.212 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:15.213+0000 7fc563f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:15.236 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:15Z"} 2024-04-16T18:59:15.237 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:15Z"} 2024-04-16T18:59:15.237 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:15.237 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:15.237 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:15.237 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:15.537 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~213s 2024-04-16T18:59:20.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:20.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:20.239 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:20.294 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:20.294 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:20.350 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:20.351+0000 7fa7f9e12800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:20.351 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:20.352+0000 7fa7f9e12800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:20.375 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:20Z"} 2024-04-16T18:59:20.375 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:20Z"} 2024-04-16T18:59:20.375 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:20.375 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:20.376 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:20.376 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:21.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~219s 2024-04-16T18:59:25.376 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:25.377 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:25.377 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:25.432 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:25.432 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:25.488 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:25.489+0000 7f076b40f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:25.489 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:25.490+0000 7f076b40f800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:25.513 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:25Z"} 2024-04-16T18:59:25.514 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:25Z"} 2024-04-16T18:59:25.514 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:25.514 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:25.514 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:25.514 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:27.352 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~225s 2024-04-16T18:59:30.515 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:30.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:30.515 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:30.570 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:30.571 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:30.626 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:30.626+0000 7f6082c67800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:30.627 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:30.627+0000 7f6082c67800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:30.652 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:30Z"} 2024-04-16T18:59:30.652 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:30Z"} 2024-04-16T18:59:30.652 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:30.652 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:30.652 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:30.653 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:33.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~230s 2024-04-16T18:59:35.654 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:35.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:35.654 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:35.710 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:35.710 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:35.766 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:35.766+0000 7f8c407af800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:35.768 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:35.767+0000 7f8c407af800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:35.794 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:35Z"} 2024-04-16T18:59:35.794 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:35Z"} 2024-04-16T18:59:35.794 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:35.794 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:35.795 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:35.795 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:39.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~236s 2024-04-16T18:59:40.796 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:40.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:40.796 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:40.851 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:40.852 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:40.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:40.908+0000 7f6d35928800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:40.909 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:40.909+0000 7f6d35928800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:40.933 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:40Z"} 2024-04-16T18:59:40.933 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:40Z"} 2024-04-16T18:59:40.933 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:40.933 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:40.934 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:40.934 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:45.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~242s 2024-04-16T18:59:45.934 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:45.935 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:45.935 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:45.989 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:45.990 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:46.045 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:46.045+0000 7f5fb0a24800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:46.047 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:46.046+0000 7f5fb0a24800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:46.071 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:46Z"} 2024-04-16T18:59:46.071 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:46Z"} 2024-04-16T18:59:46.071 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:46.071 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:46.071 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:46.072 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:50.978 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~248s 2024-04-16T18:59:51.072 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:51.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:51.073 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:51.128 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:51.128 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:51.184 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:51.184+0000 7fe76732d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:51.185 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:51.185+0000 7fe76732d800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:51.209 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:51Z"} 2024-04-16T18:59:51.209 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:51Z"} 2024-04-16T18:59:51.209 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:51.209 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:51.209 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:51.209 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:56.210 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:56.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T18:59:56.211 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T18:59:56.268 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T18:59:56.268 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T18:59:56.323 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:56.322+0000 7f4f3c433800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:56.324 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T18:59:56.324+0000 7f4f3c433800 20 RGW-SYNC:meta: read sync status 2024-04-16T18:59:56.348 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:56Z"} 2024-04-16T18:59:56.348 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:56Z"} 2024-04-16T18:59:56.348 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T18:59:56.348 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:56.348 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T18:59:56.349 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T18:59:56.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~254s 2024-04-16T19:00:01.349 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:01.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:01.350 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:01.405 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:01.460 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:01.461+0000 7fea10933800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:01.462 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:01.462+0000 7fea10933800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:01.486 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:01Z"} 2024-04-16T19:00:01.486 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:01Z"} 2024-04-16T19:00:01.486 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:01.486 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:01.486 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:01.487 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:02.793 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~260s 2024-04-16T19:00:06.487 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:06.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:06.488 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:06.544 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:06.544 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:06.600 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:06.601+0000 7fab5c611800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:06.602 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:06.603+0000 7fab5c611800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:06.629 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:06Z"} 2024-04-16T19:00:06.629 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:06Z"} 2024-04-16T19:00:06.629 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:06.629 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:06.630 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:06.630 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:08.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~266s 2024-04-16T19:00:11.631 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:11.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:11.631 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:11.686 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:11.686 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:11.744 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:11.745+0000 7f47f2d20800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:11.746 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:11.747+0000 7f47f2d20800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:11.770 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:11Z"} 2024-04-16T19:00:11.770 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:11Z"} 2024-04-16T19:00:11.771 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:11.771 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:11.771 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:11.771 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:14.606 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~272s 2024-04-16T19:00:16.772 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:16.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:16.773 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:16.827 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:16.827 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:16.883 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:16.883+0000 7fb51d42e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:16.884 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:16.884+0000 7fb51d42e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:16.908 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:16Z"} 2024-04-16T19:00:16.909 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:16Z"} 2024-04-16T19:00:16.909 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:16.909 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:16.909 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:16.909 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:20.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~278s 2024-04-16T19:00:21.910 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:21.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:21.910 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:21.965 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:21.965 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:22.021 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:22.021+0000 7f04d7e11800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:22.022 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:22.022+0000 7f04d7e11800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:22.047 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:22Z"} 2024-04-16T19:00:22.047 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:22Z"} 2024-04-16T19:00:22.047 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:22.047 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:22.047 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:22.047 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:26.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~284s 2024-04-16T19:00:27.049 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:27.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:27.049 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:27.105 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:27.161 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:27.161+0000 7f4bff610800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:27.163 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:27.162+0000 7f4bff610800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:27.186 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:27Z"} 2024-04-16T19:00:27.186 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:27Z"} 2024-04-16T19:00:27.187 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:27.187 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:27.187 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:27.187 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:32.188 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:32.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:32.188 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:32.243 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:32.243 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:32.299 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:32.299+0000 7f9908130800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:32.301 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:32.301+0000 7f9908130800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:32.324 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:32Z"} 2024-04-16T19:00:32.324 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:32Z"} 2024-04-16T19:00:32.324 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:32.325 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:32.325 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:32.325 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:32.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~290s 2024-04-16T19:00:37.326 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:37.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:37.327 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:37.382 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:37.382 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:37.438 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:37.438+0000 7f4e3731e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:37.439 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:37.439+0000 7f4e3731e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:37.463 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:37Z"} 2024-04-16T19:00:37.463 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:37Z"} 2024-04-16T19:00:37.463 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:37.463 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:37.463 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:37.464 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:38.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~295s 2024-04-16T19:00:42.464 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:42.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:42.465 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:42.520 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:42.520 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:00:42.577 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:42.576+0000 7fec3bc10800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:42.578 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:00:42.578+0000 7fec3bc10800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:00:42.601 INFO:teuthology.orchestra.run.smithi139.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:42Z"} 2024-04-16T19:00:42.602 DEBUG:rgw_multi.tests:current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:42Z"} 2024-04-16T19:00:42.602 DEBUG:rgw_multi.tests:sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:00:42.602 DEBUG:rgw_multi.tests:log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:42.602 DEBUG:rgw_multi.tests:sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:00:42.603 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:00:44.148 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~301s 2024-04-16T19:00:44.148 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-04-16T19:00:45.054 INFO:tasks.ceph.c2.osd.0:Sent signal 15 2024-04-16T19:00:45.055 INFO:tasks.ceph.c2.osd.1:Sent signal 15 2024-04-16T19:00:45.055 INFO:tasks.ceph.c2.osd.2:Sent signal 15 2024-04-16T19:00:45.056 INFO:tasks.ceph.c2.osd.3:Sent signal 15 2024-04-16T19:00:45.056 INFO:tasks.ceph.c2.osd.4:Sent signal 15 2024-04-16T19:00:45.056 INFO:tasks.ceph.c2.osd.5:Sent signal 15 2024-04-16T19:00:45.057 INFO:tasks.ceph.c2.mon.a:Sent signal 15 2024-04-16T19:00:45.057 INFO:tasks.rgw.c2.client.1:Sent signal 15 2024-04-16T19:00:45.057 INFO:tasks.ceph.c2.mgr.x:Sent signal 15 2024-04-16T19:00:45.058 INFO:tasks.ceph.c2.osd.3.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fe4bc5b6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 3 (PID: 32286) UID: 0 2024-04-16T19:00:45.058 INFO:tasks.ceph.c2.osd.3.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fe4bc5b6640 -1 osd.3 55 *** Got signal Terminated *** 2024-04-16T19:00:45.059 INFO:tasks.ceph.c2.osd.0.smithi139.stderr:2024-04-16T19:00:45.056+0000 7fbbdbb57640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 0 (PID: 32369) UID: 0 2024-04-16T19:00:45.059 INFO:tasks.ceph.c2.osd.0.smithi139.stderr:2024-04-16T19:00:45.056+0000 7fbbdbb57640 -1 osd.0 55 *** Got signal Terminated *** 2024-04-16T19:00:45.059 INFO:tasks.ceph.c2.osd.0.smithi139.stderr:2024-04-16T19:00:45.056+0000 7fbbdbb57640 -1 osd.0 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:00:45.059 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fe4159a5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 4 (PID: 32288) UID: 0 2024-04-16T19:00:45.059 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fe4159a5640 -1 osd.4 55 *** Got signal Terminated *** 2024-04-16T19:00:45.060 INFO:tasks.ceph.c2.osd.1.smithi139.stderr:2024-04-16T19:00:45.057+0000 7f8243dcf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 1 (PID: 32370) UID: 0 2024-04-16T19:00:45.060 INFO:tasks.ceph.c2.osd.1.smithi139.stderr:2024-04-16T19:00:45.057+0000 7f8243dcf640 -1 osd.1 55 *** Got signal Terminated *** 2024-04-16T19:00:45.060 INFO:tasks.ceph.c2.osd.1.smithi139.stderr:2024-04-16T19:00:45.057+0000 7f8243dcf640 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:00:45.060 INFO:tasks.ceph.c2.osd.5.smithi163.stderr:2024-04-16T19:00:45.058+0000 7f1487757640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 5 (PID: 32290) UID: 0 2024-04-16T19:00:45.061 INFO:tasks.ceph.c2.osd.2.smithi139.stderr:2024-04-16T19:00:45.057+0000 7f9629b45640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 2 (PID: 32373) UID: 0 2024-04-16T19:00:45.061 INFO:tasks.ceph.c2.osd.2.smithi139.stderr:2024-04-16T19:00:45.057+0000 7f9629b45640 -1 osd.2 55 *** Got signal Terminated *** 2024-04-16T19:00:45.061 INFO:tasks.ceph.c2.osd.2.smithi139.stderr:2024-04-16T19:00:45.057+0000 7f9629b45640 -1 osd.2 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:00:45.061 INFO:tasks.ceph.c2.osd.3.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fe4bc5b6640 -1 osd.3 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:00:45.061 INFO:tasks.ceph.c2.mon.a.smithi139.stderr:2024-04-16T19:00:45.058+0000 7fc5ce9ad640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster c2 -i a (PID: 32184) UID: 0 2024-04-16T19:00:45.061 INFO:tasks.ceph.c2.mon.a.smithi139.stderr:2024-04-16T19:00:45.058+0000 7fc5ce9ad640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-16T19:00:45.062 INFO:tasks.ceph.c2.osd.4.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fe4159a5640 -1 osd.4 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:00:45.062 INFO:tasks.rgw.c2.client.1.smithi163.stdout:2024-04-16T19:00:45.058+0000 7fbdc64b7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 36855) UID: 0 2024-04-16T19:00:45.062 INFO:tasks.ceph.c2.osd.5.smithi163.stderr:2024-04-16T19:00:45.058+0000 7f1487757640 -1 osd.5 55 *** Got signal Terminated *** 2024-04-16T19:00:45.063 INFO:tasks.ceph.c2.osd.5.smithi163.stderr:2024-04-16T19:00:45.058+0000 7f1487757640 -1 osd.5 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:00:45.063 INFO:tasks.rgw.c2.client.1.smithi163.stdout:2024-04-16T19:00:45.058+0000 7fbdc9d08880 -1 shutting down 2024-04-16T19:00:45.063 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fcf93b91640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster c2 -i x (PID: 31914) UID: 0 2024-04-16T19:00:45.063 INFO:tasks.ceph.c2.mgr.x.smithi163.stderr:2024-04-16T19:00:45.058+0000 7fcf93b91640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-16T19:00:47.604 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:47.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:00:47.604 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:00:47.660 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:00:47.660 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:05:47.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:05:47.689 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:05:47.661+0000 7ff503b3b800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:05:47.689 INFO:teuthology.orchestra.run.smithi139.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:05:47.735 INFO:tasks.rgw_multisite_tests:test_sync_policy_config_zonegroup: ... FAIL 2024-04-16T19:05:47.737 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:05:47.738 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:05:47.738 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:05:47.793 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:05:47.887 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:05:47.888 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:05:47.889 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:05:47.890 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:05:47.890 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T19:05:47.890 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:05:47.890 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:05:47.891 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:05:47.946 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:05:47.946 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:10:47.949 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:10:47.948+0000 7fb71409d800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:10:47.969 INFO:teuthology.orchestra.run.smithi139.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:10:47.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:10:47.971 INFO:tasks.rgw_multisite_tests:test_sync_flow_symmetrical_zonegroup_all: ... FAIL 2024-04-16T19:10:47.973 INFO:tasks.rgw_multisite_tests:test_sync_flow_symmetrical_zonegroup_select: ... SKIP: test_sync_flow_symmetrical_zonegroup_select skipped. Requires 3 or more zones in master zonegroup. 2024-04-16T19:10:47.973 INFO:tasks.rgw_multisite_tests:test_sync_flow_directional_zonegroup_select: ... SKIP: test_sync_flow_symmetrical_zonegroup_select skipped. Requires 3 or more zones in master zonegroup. 2024-04-16T19:10:47.974 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:10:47.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:10:47.975 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:10:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:10:48.029 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:10:48.086 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:10:48.110 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:10:48.111 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:10:48.111 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T19:10:48.111 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:10:48.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:10:48.111 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:10:48.165 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:10:48.166 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:15:48.168 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:15:48.167+0000 7f668d733800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:15:48.192 INFO:teuthology.orchestra.run.smithi139.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:15:48.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:15:48.195 INFO:tasks.rgw_multisite_tests:test_sync_single_bucket: ... FAIL 2024-04-16T19:15:48.196 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:15:48.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:15:48.197 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:15:48.253 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:15:48.254 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:15:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:15:48.335 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:15:48.335 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:15:48.336 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T19:15:48.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:15:48.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:15:48.336 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:15:48.391 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:15:48.392 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:20:48.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:20:48.397 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:20:48.393+0000 7f885652c800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:20:48.397 INFO:teuthology.orchestra.run.smithi139.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:20:48.399 INFO:tasks.rgw_multisite_tests:test_sync_different_buckets: ... FAIL 2024-04-16T19:20:48.402 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:20:48.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:20:48.403 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:20:48.458 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:20:48.458 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:20:48.514 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:20:48.538 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:20:48.539 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:20:48.539 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T19:20:48.539 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:20:48.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:20:48.540 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:20:48.595 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:20:48.595 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:25:48.598 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:25:48.596+0000 7f8daabaf800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:25:48.599 INFO:teuthology.orchestra.run.smithi139.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:25:48.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:25:48.601 INFO:tasks.rgw_multisite_tests:test_sync_multiple_buckets_to_single: ... FAIL 2024-04-16T19:25:48.603 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:25:48.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:25:48.604 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:25:48.659 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:25:48.660 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:25:48.715 INFO:teuthology.orchestra.run.smithi016.stderr:No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:25:48.740 INFO:teuthology.orchestra.run.smithi016.stdout:[{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:25:48.740 DEBUG:rgw_multi.tests:master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:25:48.740 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2024-04-16T19:25:48.740 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:25:48.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:25:48.741 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:25:48.796 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:25:48.796 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:30:48.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:30:48.822 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:30:48.797+0000 7f28fcc24800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:30:48.822 INFO:teuthology.orchestra.run.smithi139.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:30:48.825 INFO:tasks.rgw_multisite_tests:test_sync_single_bucket_to_multiple: ... FAIL 2024-04-16T19:30:48.827 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create_rgw_down ... SKIP: test_bucket_create_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.827 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove_rgw_down ... SKIP: test_bucket_remove_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.828 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync_rgw_down ... SKIP: test_object_sync_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.828 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete_rgw_down ... SKIP: test_object_delete_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.828 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync_rgw_down ... SKIP: test_concurrent_versioned_object_incremental_sync_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.829 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync_rgw_down ... SKIP: test_suspended_delete_marker_full_sync_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.829 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl_rgw_down ... SKIP: test_bucket_acl_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.829 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable_rgw_down ... SKIP: test_bucket_sync_enable_right_after_disable_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.830 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync_rgw_down ... SKIP: test_multipart_object_sync_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.830 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_run_basic_incremental_rgw_down ... SKIP: test_bucket_sync_run_basic_incremental_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.831 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_role_sync_rgw_down ... SKIP: test_role_sync_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.831 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_full_sync_after_data_sync_init_rgw_down ... SKIP: test_bucket_full_sync_after_data_sync_init_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.832 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_sync_policy_config_zonegroup_rgw_down ... SKIP: test_sync_policy_config_zonegroup_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.832 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_sync_flow_symmetrical_zonegroup_all_rgw_down ... SKIP: test_sync_flow_symmetrical_zonegroup_all_rgw_down skipped. More than one rgw needed in any one or multiple zone(s). 2024-04-16T19:30:48.832 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.832 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests:ERROR: rgw_multi.tests.test_topic_notification_sync 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 1788, in test_topic_notification_sync 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests: zone_conn.create_notification(bucket.name, [topic_conf]) 2024-04-16T19:30:48.833 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw_multi/zone_rados.py", line 160, in create_notification 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests: return self.s3_client.put_bucket_notification_configuration( 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/client.py", line 553, in _api_call 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests: return self._make_api_call(operation_name, kwargs) 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/botocore/client.py", line 1009, in _make_api_call 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests: raise error_class(parsed_response, operation_name) 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests:botocore.exceptions.ClientError: An error occurred (ConcurrentModification) when calling the PutBucketNotificationConfiguration operation: None 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:48.834 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713291314.180915_350.1","last_update":"2024-04-16T18:15:14.180915Z"}] 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:15:14.670+0000 7f35aed2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:15:14.672+0000 7f35aed2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:48.835 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291314.180915_350.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:14.180915Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291314.180915_350.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:14.180915Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:14Z"} 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291314.180915_350.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:14.180915Z', 'realm_epoch': 2}}] 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291314.180915_350.1'} 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create topic zone=test-zone1 name=topic-cjqttm-1 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.sns.CreateTopic: calling handler 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2024-04-16T19:30:48.836 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Making request for OperationModel(name=CreateTopic) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateTopic', 'Version': '2010-03-31', 'Name': 'topic-cjqttm-1', 'Attributes.entry.1.key': 'push-endpoint', 'Attributes.entry.1.value': 'http://kaboom:9999', 'Attributes.entry.2.key': 'persistent', 'Attributes.entry.2.value': 'true'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler > 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event choose-signer.sns.CreateTopic: calling handler 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: CanonicalRequest: 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:POST 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:/ 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:content-type:application/x-www-form-urlencoded; charset=utf-8 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:host:smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests:x-amz-date:20240416T181519Z 2024-04-16T19:30:48.837 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:content-type;host;x-amz-date 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:143e8697d4d1b89ffe8717ebae450129ef0779812ba4588b7aa438384e39b1b2 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: StringToSign: 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:20240416T181519Z 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:20240416/test-zonegroup/sns/aws4_request 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:54286e1399496909cbbddae0ca49766bdf2d833083a0e7ae7cfc9b71ed116ed9 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Signature: 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:ec6ba6bbec73bdd5791dd39cd492ab3457bcc32f8a4b30720e3c420bf89e55d4 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Sending http request: 2024-04-16T19:30:48.838 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000ce204c6e1c75c5b7-00661ec037-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '337', 'Date': 'Tue, 16 Apr 2024 18:15:19 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response body: 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:b'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-19ba59572-f51c-4bce-9578-e6350e822996.4816.14852955606875489719' 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.sns.CreateTopic: calling handler 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.retryhandler: DEBUG: No retry needed. 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create topic zone=test-zone2 name=topic-cjqttm-2 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.sns.CreateTopic: calling handler 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.CreateTopic: calling handler 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Making request for OperationModel(name=CreateTopic) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'CreateTopic', 'Version': '2010-03-31', 'Name': 'topic-cjqttm-2', 'Attributes.entry.1.key': 'push-endpoint', 'Attributes.entry.1.value': 'http://kaboom:9999', 'Attributes.entry.2.key': 'persistent', 'Attributes.entry.2.value': 'true'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T19:30:48.839 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler > 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event choose-signer.sns.CreateTopic: calling handler 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: CanonicalRequest: 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:POST 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:/ 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:content-type:application/x-www-form-urlencoded; charset=utf-8 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:host:smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:x-amz-date:20240416T181519Z 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:content-type;host;x-amz-date 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:eab586312b6fe392ab072b498350a9e2e6af69ab7b2a7f151f87ed7361d24143 2024-04-16T19:30:48.840 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: StringToSign: 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:20240416T181519Z 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:20240416/test-zonegroup/sns/aws4_request 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:6ced9799f72148de04ec9c8c0240c456083e59e5de0ad6e20cb51225cc496142 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Signature: 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:986a53a11a04c6c6ed7a3dea3c36197b9e17957c3e5259f6c5ead84e53988bc8 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.CreateTopic: calling handler 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Sending http request: 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000136a03545c59897d-00661ec037-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '336', 'Date': 'Tue, 16 Apr 2024 18:15:19 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response body: 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:b'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2316ebd79-1e8f-459c-be24-e6b3e0dc08e5.5447.1398934295113468285' 2024-04-16T19:30:48.841 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.sns.CreateTopic: calling handler 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:botocore.retryhandler: DEBUG: No retry needed. 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: topic_arns: ['arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1', 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2'] 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291179.531605_696.1","last_update":"2024-04-16T18:12:59.531605Z"},{"marker":"1_1713291319.732978_352.1","last_update":"2024-04-16T18:15:19.732978Z"}] 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T19:30:48.842 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:15:19.987+0000 7fc59e12f800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:15:19.989+0000 7fc59e12f800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:19Z"} 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291179.531605_696.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:12:59.531605Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:19Z"} 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291179.531605_696.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:12:59.531605Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291319.732978_352.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:19.732978Z', 'realm_epoch': 2}}] 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T19:30:48.843 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291179.531605_696.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.sns.ListTopics: calling handler 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000'} 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.ListTopics: calling handler 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.ListTopics: calling handler 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Making request for OperationModel(name=ListTopics) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListTopics', 'Version': '2010-03-31'}, 'url': 'http://smithi016.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.ListTopics: calling handler > 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event choose-signer.sns.ListTopics: calling handler 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: CanonicalRequest: 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:POST 2024-04-16T19:30:48.844 INFO:tasks.rgw_multisite_tests:/ 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:content-type:application/x-www-form-urlencoded; charset=utf-8 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:host:smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:x-amz-date:20240416T181520Z 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:content-type;host;x-amz-date 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:55e772bd3d832d8507965af84ab07fd17d9be3cbb788151ceb0d7fc2be442a54 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: StringToSign: 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:20240416T181520Z 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:20240416/test-zonegroup/sns/aws4_request 2024-04-16T19:30:48.845 INFO:tasks.rgw_multisite_tests:3eb3e654525218ab8b46bf1bb96ec27bc05ff3ff0099448fb02c4d680e9704b8 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Signature: 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:8be91d1ba0ead1604afe82574cd8cf38aef4cbdebb01664a569481c1e064430b 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.ListTopics: calling handler 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Sending http request: 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000f814ad404aa5e6bf-00661ec038-4816-test-zone1', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1415', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response body: 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:b'RGW11111111111111111topic-cjqttm-1http://kaboom:9999Version=2010-03-31topic-cjqttm-1FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1RGW11111111111111111topic-cjqttm-2http://kaboom:9999Version=2010-03-31&rgwx-uid=RGW11111111111111111&rgwx-zonegroup=test-zonegrouptopic-cjqttm-2FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-29ba59572-f51c-4bce-9578-e6350e822996.4816.17876103312582239935' 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.sns.ListTopics: calling handler 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.retryhandler: DEBUG: No retry needed. 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: topics for zone=test-zone1 = [{'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1'}, {'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2'}] 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.sns.ListTopics: calling handler 2024-04-16T19:30:48.846 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Region': 'test-zonegroup', 'UseDualStack': False, 'UseFIPS': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000'} 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.ListTopics: calling handler 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.sns.ListTopics: calling handler 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Making request for OperationModel(name=ListTopics) with params: {'url_path': '/', 'query_string': '', 'method': 'POST', 'headers': {'Content-Type': 'application/x-www-form-urlencoded; charset=utf-8', 'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': {'Action': 'ListTopics', 'Version': '2010-03-31'}, 'url': 'http://smithi139.front.sepia.ceph.com:8000/', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': None}} 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.ListTopics: calling handler > 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event choose-signer.sns.ListTopics: calling handler 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: CanonicalRequest: 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:POST 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:/ 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:content-type:application/x-www-form-urlencoded; charset=utf-8 2024-04-16T19:30:48.847 INFO:tasks.rgw_multisite_tests:host:smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:x-amz-date:20240416T181520Z 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:content-type;host;x-amz-date 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:55e772bd3d832d8507965af84ab07fd17d9be3cbb788151ceb0d7fc2be442a54 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: StringToSign: 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:20240416T181520Z 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:20240416/test-zonegroup/sns/aws4_request 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:3b028bc1933c690628a4ede59671e938c615aafbe7df102c22c60837cd3a3604 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Signature: 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:f2150ad8a63614bfea53643f1e44b819586eb8d9665429c3bc7150b427d09ac6 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.sns.ListTopics: calling handler 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Sending http request: 2024-04-16T19:30:48.848 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000087c3181813bde49-00661ec038-5447-test-zone2', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '1413', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response body: 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:b'RGW11111111111111111topic-cjqttm-1http://kaboom:9999Version=2010-03-31topic-cjqttm-1FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1RGW11111111111111111topic-cjqttm-2http://kaboom:9999Version=2010-03-31&rgwx-uid=RGW11111111111111111&rgwx-zonegroup=test-zonegrouptopic-cjqttm-2FalseTrueNoneNoneNonearn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2316ebd79-1e8f-459c-be24-e6b3e0dc08e5.5447.611418081704271433' 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.sns.ListTopics: calling handler 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:botocore.retryhandler: DEBUG: No retry needed. 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: topics for zone=test-zone2 = [{'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1'}, {'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2'}] 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-49/ 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-49/ 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-49/ 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:15:20 GMT 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:/cjqttm-49/ 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5ToqELyd2y37zEYZX6tO/d95TAg= 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5ToqELyd2y37zEYZX6tO/d95TAg=', 'Content-Length': '0'} 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000054d36cfab5e34f29-00661ec038-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:15:20 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.850 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=cjqttm-49 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713291320.041920_721.1","last_update":"2024-04-16T18:15:20.041920Z"},{"marker":"1_1713291319.732978_352.1","last_update":"2024-04-16T18:15:19.732978Z"}] 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291320.041920_721.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.851 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:15:20.269+0000 7fde21e16800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:15:20.271+0000 7fde21e16800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291320.041920_721.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:20.041920Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:20Z"} 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713291320.041920_721.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:20.041920Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291319.732978_352.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:19.732978Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:15:20Z"} 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713291320.041920_721.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:20.041920Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291319.732978_352.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:19.732978Z', 'realm_epoch': 2}}] 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291320.041920_721.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713291320.041920_721.1', 3: '1_1713291319.732978_352.1'} 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-16T19:30:48.852 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: creating bucket notification for zone=test-zone1 name=bn-cjqttm-1 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler > 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Bucket': 'cjqttm-49', 'Region': 'test-zonegroup', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://smithi016.front.sepia.ceph.com:8000', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True} 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Endpoint provider result: http://smithi016.front.sepia.ceph.com:8000/cjqttm-49 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None" 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Selected auth type "v4" as "v4" with signing context params: {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True} 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.853 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Making request for OperationModel(name=PutBucketNotificationConfiguration) with params: {'url_path': '?notification', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': b'bn-cjqttm-1arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1s3:ObjectCreated:*', 'auth_path': '/cjqttm-49/', 'url': 'http://smithi016.front.sepia.ceph.com:8000/cjqttm-49?notification', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'cjqttm-49', 'params': {'Bucket': 'cjqttm-49', 'NotificationConfiguration': {'TopicConfigurations': [{'Id': 'bn-cjqttm-1', 'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-1', 'Events': ['s3:ObjectCreated:*']}]}}}, 'S3Express': {'bucket_name': 'cjqttm-49'}, 'signing': {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'test-zonegroup'}]}}} 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: CanonicalRequest: 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:/cjqttm-49 2024-04-16T19:30:48.854 INFO:tasks.rgw_multisite_tests:notification= 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:host:smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:x-amz-content-sha256:d11c39716a8496def07b586cb60f26239aad49faa703a743fe0923189299507f 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:x-amz-date:20240416T181520Z 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:host;x-amz-content-sha256;x-amz-date 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:d11c39716a8496def07b586cb60f26239aad49faa703a743fe0923189299507f 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: StringToSign: 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:20240416T181520Z 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:20240416/test-zonegroup/s3/aws4_request 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:497d5f2adb1bf890ee7a9a7b966230cc4c69d83e1a9686edd68155058b9e1ec4 2024-04-16T19:30:48.855 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Signature: 2024-04-16T19:30:48.856 INFO:tasks.rgw_multisite_tests:739f626990db4e7d5b8a1a2f9703c1fe75bc6a2e823aaee8e9fde2495c5df5ef 2024-04-16T19:30:48.856 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.856 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Sending http request: 2024-04-16T19:30:48.856 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response headers: {'x-amz-request-id': 'tx00000df1ee8fa502afd43-00661ec038-4816-test-zone1', 'Server': 'Ceph Object Gateway (squid)', 'Content-Length': '0', 'Date': 'Tue, 16 Apr 2024 18:15:20 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T19:30:48.856 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response body: 2024-04-16T19:30:48.856 INFO:tasks.rgw_multisite_tests:b'' 2024-04-16T19:30:48.856 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.retryhandler: DEBUG: No retry needed. 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: creating bucket notification for zone=test-zone2 name=bn-cjqttm-2 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-parameter-build.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-endpoint-resolution.s3: calling handler > 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Calling endpoint provider with parameters: {'Bucket': 'cjqttm-49', 'Region': 'test-zonegroup', 'UseFIPS': False, 'UseDualStack': False, 'Endpoint': 'http://smithi139.front.sepia.ceph.com:8000', 'ForcePathStyle': True, 'Accelerate': False, 'UseGlobalEndpoint': False, 'DisableMultiRegionAccessPoints': False, 'UseArnRegion': True, 'UseS3ExpressControlEndpoint': True} 2024-04-16T19:30:48.857 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Endpoint provider result: http://smithi139.front.sepia.ceph.com:8000/cjqttm-49 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Selecting from endpoint provider's list of auth schemes: "sigv4". User selected auth scheme is: "None" 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.regions: DEBUG: Selected auth type "v4" as "v4" with signing context params: {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True} 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-call.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Making request for OperationModel(name=PutBucketNotificationConfiguration) with params: {'url_path': '?notification', 'query_string': {}, 'method': 'PUT', 'headers': {'User-Agent': 'Boto3/1.34.8 md/Botocore#1.34.8 ua/2.0 os/linux#5.4.0-166-generic md/arch#x86_64 lang/python#3.8.10 md/pyimpl#CPython cfg/retry-mode#legacy Botocore/1.34.8'}, 'body': b'bn-cjqttm-2arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2s3:ObjectCreated:*', 'auth_path': '/cjqttm-49/', 'url': 'http://smithi139.front.sepia.ceph.com:8000/cjqttm-49?notification', 'context': {'client_region': 'test-zonegroup', 'client_config': , 'has_streaming_input': False, 'auth_type': 'v4', 's3_redirect': {'redirected': False, 'bucket': 'cjqttm-49', 'params': {'Bucket': 'cjqttm-49', 'NotificationConfiguration': {'TopicConfigurations': [{'Id': 'bn-cjqttm-2', 'TopicArn': 'arn:aws:sns:test-zonegroup:RGW11111111111111111:topic-cjqttm-2', 'Events': ['s3:ObjectCreated:*']}]}}}, 'S3Express': {'bucket_name': 'cjqttm-49'}, 'signing': {'region': 'test-zonegroup', 'signing_name': 's3', 'disableDoubleEncoding': True}, 'endpoint_properties': {'authSchemes': [{'disableDoubleEncoding': True, 'name': 'sigv4', 'signingName': 's3', 'signingRegion': 'test-zonegroup'}]}}} 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event choose-signer.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.858 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event before-sign.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Calculating signature using v4 auth. 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: CanonicalRequest: 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:/cjqttm-49 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:notification= 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:host:smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:x-amz-content-sha256:759a7fbb80932044083686943d25476291ae96db6e81495b86d1c90721e1d90c 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:x-amz-date:20240416T181520Z 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:host;x-amz-content-sha256;x-amz-date 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:759a7fbb80932044083686943d25476291ae96db6e81495b86d1c90721e1d90c 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: StringToSign: 2024-04-16T19:30:48.859 INFO:tasks.rgw_multisite_tests:AWS4-HMAC-SHA256 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:20240416T181520Z 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:20240416/test-zonegroup/s3/aws4_request 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:e74b0feb7f36acdd89560fdd3d6e9193e1a4ed9ec63f0818d92cf97721024709 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:botocore.auth: DEBUG: Signature: 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:eff9ae3e9aafb78cf44757a088f15e662253f683894a8ef1da03c5687bc778a1 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event request-created.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:botocore.endpoint: DEBUG: Sending http request: 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response headers: {'Content-Length': '261', 'x-amz-request-id': 'tx000001c6cf4aef8b4a664-00661ec038-5447-test-zone2', 'Accept-Ranges': 'bytes', 'Content-Type': 'application/xml', 'Server': 'Ceph Object Gateway (squid)', 'Date': 'Tue, 16 Apr 2024 18:15:21 GMT', 'Connection': 'Keep-Alive'} 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:botocore.parsers: DEBUG: Response body: 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:b'ConcurrentModificationcjqttm-49tx000001c6cf4aef8b4a664-00661ec038-5447-test-zone25447-test-zone2-test-zonegroup' 2024-04-16T19:30:48.860 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler 2024-04-16T19:30:48.861 INFO:tasks.rgw_multisite_tests:botocore.retryhandler: DEBUG: No retry needed. 2024-04-16T19:30:48.861 INFO:tasks.rgw_multisite_tests:botocore.hooks: DEBUG: Event needs-retry.s3.PutBucketNotificationConfiguration: calling handler > 2024-04-16T19:30:48.861 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:48.861 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.861 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:48.861 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_multi_object_delete 2024-04-16T19:30:48.861 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:48.863 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:48.863 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:48.863 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:48.863 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 880, in test_multi_object_delete 2024-04-16T19:30:48.863 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket.name) 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 390, in zone_bucket_checkpoint 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests: target_zone.cluster.admin(cmd, debug_rgw=1) 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw_multisite.py", line 197, in admin 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests: assert r == 0 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create bucket zone=test-zone1 name=cjqttm-11 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.865 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:25 GMT 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:FYA0tXr0MkdyhfMe2AKxrugecto= 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FYA0tXr0MkdyhfMe2AKxrugecto=', 'Content-Length': '0'} 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000002876d9e283da8fc6-00661eb9ad-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: create bucket zone=test-zone2 name=cjqttm-12 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:48.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:25 GMT 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.867 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PrxbRwxu9IIxJNUMrfz03PGUUdQ= 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PrxbRwxu9IIxJNUMrfz03PGUUdQ=', 'Content-Length': '0'} 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx0000051fc48eecc40bcc7-00661eb9ad-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:25 GMT 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NZrbhgLey558jneK9DvoA1CEz2U= 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NZrbhgLey558jneK9DvoA1CEz2U=', 'Content-Length': '0'} 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000afb051af02c6eafc-00661eb9ad-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj1 2024-04-16T19:30:48.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj1 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj1 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.870 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:25 GMT 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj1 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4OPod198yM/KER+h/KTmaepOM1M= 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:25 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4OPod198yM/KER+h/KTmaepOM1M='} 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004671fa29aff6db59-00661eb9ad-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:25 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000303ce4891a8cdf60-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj2 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj2 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj2 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.873 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj2 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:d3rsHYqWDwJ7bSTuoKexGt8TDSI= 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:d3rsHYqWDwJ7bSTuoKexGt8TDSI='} 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004795aa1fc7529ba0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000414c3b51e26523a1-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj3 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj3 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj3 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj3 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:dKBnj/19xy9l4VCAV1+8bo7ssDg= 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dKBnj/19xy9l4VCAV1+8bo7ssDg='} 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000059f49ea8ade7bab8-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000da3de7ebc3963e91-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj4 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj4 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj4 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj4 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:niGBsT6O68NGyGjIDhgFJCXQO1A= 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:niGBsT6O68NGyGjIDhgFJCXQO1A='} 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d2f25f5580dbb814-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8da54ee4895b54e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj5 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj5 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj5 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.882 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj5 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vLquXldup+EvxTL9+WUXY3iL9sY= 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLquXldup+EvxTL9+WUXY3iL9sY='} 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000068fc6d4904e5a608-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003369d9be87062499-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj6 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj6 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj6 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.885 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj6 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:V4wsWZoiYrGdrx+Wtd0oaEpnO7k= 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:V4wsWZoiYrGdrx+Wtd0oaEpnO7k='} 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008214225667663fd3-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006aa3fc1b3d6a666e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj7 2024-04-16T19:30:48.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj7 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj7 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj7 2024-04-16T19:30:48.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oLuuZO9Od2W81ovnXq4xESNX4rM= 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oLuuZO9Od2W81ovnXq4xESNX4rM='} 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002a7e89eb89280f75-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000003f239ecbfa8f0f07-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj8 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj8 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj8 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj8 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.891 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zE1PDEHp34itBxJNknZfaq5h6z0= 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zE1PDEHp34itBxJNknZfaq5h6z0='} 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000249ee1e6e386e8fc-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000c661dae56b52e4f-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj9 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj9 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj9 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj9 2024-04-16T19:30:48.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:jCDYNUTlntoYu68IKYrv6E50LWM= 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jCDYNUTlntoYu68IKYrv6E50LWM='} 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d64b9f9b248be01a-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a81ccc34d4d49e4d-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj10 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj10 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj10 2024-04-16T19:30:48.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj10 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1av36fivsduuMxnzaJ8vsboOuN4= 2024-04-16T19:30:48.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1av36fivsduuMxnzaJ8vsboOuN4='} 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000551a1d8b76ac4ab6-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.898 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000677ce7b9d4b09a83-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj11 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj11 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj11 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj11 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2nmvozd+ZG18ehO/M3JBZe/cgog= 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2nmvozd+ZG18ehO/M3JBZe/cgog='} 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000527b1e265805c5d4-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.901 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001790a02ed1c6b468-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj12 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj12 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj12 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj12 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:qowW0Kf/IqIZ85gDmtjaWAxtT+A= 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qowW0Kf/IqIZ85gDmtjaWAxtT+A='} 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d89393059ee80060-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.904 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000752c6e161b2ed4ca-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj13 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj13 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj13 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj13 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:dvzcvrbsdHcsrdnhF09OVZ0CECk= 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dvzcvrbsdHcsrdnhF09OVZ0CECk='} 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000aaeafd5527927613-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.907 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b737a2366e199060-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj14 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj14 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj14 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.908 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj14 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WIMSuQIQM627BQoT5K0haqJi1zE= 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WIMSuQIQM627BQoT5K0haqJi1zE='} 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bee7d1f04f739207-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f33e4b7ab0a54c8c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj15 2024-04-16T19:30:48.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj15 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj15 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj15 2024-04-16T19:30:48.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8R9H7uX2E8P/vlnBVq219Dto1Rk= 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8R9H7uX2E8P/vlnBVq219Dto1Rk='} 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004efb1bc4d3cd2d8e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000074b436e2f42fc691-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj16 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj16 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj16 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj16 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YesXTthbfx3TI6MDTl1TaGhLYRo= 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YesXTthbfx3TI6MDTl1TaGhLYRo='} 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e4a6859b4e84ac79-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.915 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000049c731f3c2255d28-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj17 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj17 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj17 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj17 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wzvCOySsPL4BwTDnpAwcYz8sjwc= 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wzvCOySsPL4BwTDnpAwcYz8sjwc='} 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c3b9da5aae9efc8-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008d6f2ac1c505bd0c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj18 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj18 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj18 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.919 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj18 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:FHRakz0t9qgEKD5OS/7dCyYxFpw= 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FHRakz0t9qgEKD5OS/7dCyYxFpw='} 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000193f017d09f9c0ad-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000068d62ef8e7f4b2c1-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj19 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj19 2024-04-16T19:30:48.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj19 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj19 2024-04-16T19:30:48.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DDAgIKOPRAMN35z1tiE+Fp8++jo= 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DDAgIKOPRAMN35z1tiE+Fp8++jo='} 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000070d2435db5420d7e-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000f51e85757924128-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj20 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj20 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj20 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj20 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8dJtSC70CFKCsshF3zvUwhFPTOg= 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8dJtSC70CFKCsshF3zvUwhFPTOg='} 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dfe3b607bdfc2c74-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.926 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006c923ca1b74de2ca-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj21 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj21 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj21 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj21 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:c276dX12dw96Hfjo3N9ARjsGkkc= 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:c276dX12dw96Hfjo3N9ARjsGkkc='} 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d8cd0fc31a5ac63c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d9b3ebcdffb293d-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj22 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj22 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj22 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.930 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj22 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Gzp4jKRe8WivcVy+nb7YKcWunCM= 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Gzp4jKRe8WivcVy+nb7YKcWunCM='} 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cfc190819ae96f86-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '132'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d7573fcb64e100b2-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj23 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj23 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj23 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.933 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj23 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:gIjrQaq5/23rJ+LTEQOpcFfzCk8= 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gIjrQaq5/23rJ+LTEQOpcFfzCk8='} 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ab1581bdf59e7799-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a9cba2ccc92e6ff7-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj24 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj24 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj24 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj24 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:x3sCHAwaxXhUiuDhp4nUucv20a0= 2024-04-16T19:30:48.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:x3sCHAwaxXhUiuDhp4nUucv20a0='} 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a690e597cb619c55-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.937 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f841cbfcee6b3eea-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj25 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj25 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj25 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj25 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZO8FtU5U7wLsSBhEDrA6p5HkI3k= 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZO8FtU5U7wLsSBhEDrA6p5HkI3k='} 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e4731b777057d382-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000eb4de812624a5058-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj26 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj26 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj26 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.941 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj26 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:JPl2s8Ea0jm0LFyrm/0NUNfWOY4= 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JPl2s8Ea0jm0LFyrm/0NUNfWOY4='} 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005dbe754b8f1532b9-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000420ef169bddc0f59-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj27 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj27 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj27 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj27 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vfWS9yZgfuVJKdF0tVfzKobygyg= 2024-04-16T19:30:48.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vfWS9yZgfuVJKdF0tVfzKobygyg='} 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002d9ed16775113082-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.945 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007d23daa80542f52a-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj28 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj28 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj28 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj28 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rBUta3LMtjkRnlH8ANK6s3jvoRw= 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rBUta3LMtjkRnlH8ANK6s3jvoRw='} 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000751cdde29fe4cb57-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058cac51eed7d39a2-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj29 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj29 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj29 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.949 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj29 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ymhfDZZDd8lfwydw7LPJxsHf8Mg= 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ymhfDZZDd8lfwydw7LPJxsHf8Mg='} 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ee95dc10a6f1d521-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b088c2888316d739-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj30 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj30 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj30 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj30 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.952 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vJwbMqXs3FAoF8Re6a/uwENKMGQ= 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vJwbMqXs3FAoF8Re6a/uwENKMGQ='} 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e76566e2c6f96475-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.953 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '180'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005ef62977ea61ccb0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj31 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj31 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj31 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj31 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:xwA7bf6aRt9dffAKEEK0pmvTReg= 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xwA7bf6aRt9dffAKEEK0pmvTReg='} 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008605fcd4ce1e27f0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.956 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '186'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e311532400912f74-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj32 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj32 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj32 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.957 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj32 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:7/+1yBKsegt1GFyxspchKf6lOW4= 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7/+1yBKsegt1GFyxspchKf6lOW4='} 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004dfdba08e18bb832-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '192'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000013ef02e591929cef-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj33 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj33 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj33 2024-04-16T19:30:48.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj33 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vLE1CQvuIJEWjlWLaTEteZehzbo= 2024-04-16T19:30:48.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLE1CQvuIJEWjlWLaTEteZehzbo='} 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000034067af6dacca90f-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.963 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '198'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c8faf401036a69ee-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj34 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj34 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj34 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj34 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:H/WVZnbS3NfwDSMIWZzf3nETE6Q= 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H/WVZnbS3NfwDSMIWZzf3nETE6Q='} 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000262e6166454003f1-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '204'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ff81e53753f4a24-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj35 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj35 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj35 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.967 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj35 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ftDpX6qnJ1hCT+Mk4iGSfsKUR8o= 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ftDpX6qnJ1hCT+Mk4iGSfsKUR8o='} 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004779d93f83659ac4-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '210'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f88fc273ea1362a0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj36 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj36 2024-04-16T19:30:48.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj36 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.970 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj36 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:7yH1T3/zoKKRTOlXBh7DfsWdY9Q= 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:7yH1T3/zoKKRTOlXBh7DfsWdY9Q='} 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fd5836bcdf865fa2-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '216'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d7827da6120a420-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj37 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj37 2024-04-16T19:30:48.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj37 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj37 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.973 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:xM+Ml5XTLbBEJTsMtN8YnlFLOcw= 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xM+Ml5XTLbBEJTsMtN8YnlFLOcw='} 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000988c7422f809e322-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.974 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '222'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000048fa7afc4557d24b-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj38 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj38 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj38 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj38 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fZ3jssVhNWHavEtb9Nwg6j1j1dU= 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fZ3jssVhNWHavEtb9Nwg6j1j1dU='} 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007a9e369de7b069b0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.977 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '228'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000986c2ad5e9324bbf-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj39 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj39 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj39 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.978 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj39 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Si/6fml6PyQHFJDheAmftroRjB4= 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Si/6fml6PyQHFJDheAmftroRjB4='} 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ab1a7cba0394898-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '234'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000034139396922f65b7-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj40 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj40 2024-04-16T19:30:48.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj40 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj40 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.981 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VzU13Da8Rt/XNUNBH1FTXyMB6N4= 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VzU13Da8Rt/XNUNBH1FTXyMB6N4='} 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000013f6c3950b6a1e32-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.982 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '240'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c3e72e236d72988c-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj41 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj41 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj41 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj41 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HL7j6iHyIuhrysEpY/2gTQ9NJvg= 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HL7j6iHyIuhrysEpY/2gTQ9NJvg='} 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000973edb00e241038-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '246'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c1199ede6db6dcba-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj42 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj42 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj42 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj42 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:H0Ddww+f9hfQdoQ6Z+qZ3U76OA8= 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H0Ddww+f9hfQdoQ6Z+qZ3U76OA8='} 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ed362cca4a9815d7-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '252'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000079bbded0d3552086-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj43 2024-04-16T19:30:48.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj43 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj43 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj43 2024-04-16T19:30:48.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:to4evVLrTvZs56dmswqijFH/srU= 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:to4evVLrTvZs56dmswqijFH/srU='} 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c61336e516a868db-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y= 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E7F1KbwSvaQvAHZfDNfKZa4cu5Y=', 'Content-Length': '0'} 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '258'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fd34f5634ae4af1f-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj44 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj44 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj44 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:26 GMT 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj44 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:MvD6leINCegpPbJAmVpY2icC9UQ= 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:26 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:MvD6leINCegpPbJAmVpY2icC9UQ='} 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f931c4fc8057df0-00661eb9ae-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:26 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:48.993 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '44'), ('X-RGW-Bytes-Used', '264'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d1cb7135bfc0c34b-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj45 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj45 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj45 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj45 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2yVwYK88b8yiX3IXpXjBbMwioyk= 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2yVwYK88b8yiX3IXpXjBbMwioyk='} 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b766d7e6a4386716-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T19:30:48.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '270'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000dff0fb670c52189d-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj46 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj46 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj46 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:48.997 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj46 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rPmfI5vgcackT216SI4tCTHbR2E= 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rPmfI5vgcackT216SI4tCTHbR2E='} 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000781c3364a6754da4-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:48.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '276'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000029e5668c7fcb80a-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj47 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj47 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:48.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj47 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj47 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3/44dLXvZSykB3x98gaayNvTez0= 2024-04-16T19:30:49.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3/44dLXvZSykB3x98gaayNvTez0='} 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003816e6b7eeaf9604-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.001 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '282'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c3c209f761339fae-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj48 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj48 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj48 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj48 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZQCa8u32Gf08G7EBhUo3r4NhavU= 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZQCa8u32Gf08G7EBhUo3r4NhavU='} 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000eb9e436e18448b9d-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/ 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/ 2024-04-16T19:30:49.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/ 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:/cjqttm-11/ 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.004 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8= 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3K3vb3hiQpbCsRv81s7d+s1tmR8=', 'Content-Length': '0'} 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '288'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000091b97ffc0c1f958-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-11/obj49 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-11/obj49 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-11/obj49 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.005 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:/cjqttm-11/obj49 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:pavBdtCbPYJFFO0M9Rdw2nJ6CIM= 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pavBdtCbPYJFFO0M9Rdw2nJ6CIM='} 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000712a5b3ee2f15988-00661eb9af-4365-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000051612fda4195febb-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj1 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj1 2024-04-16T19:30:49.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj1 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj1 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.008 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:dtwTi8nzqaP8iu7l2sQxhDdFPEY= 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dtwTi8nzqaP8iu7l2sQxhDdFPEY='} 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c07b55cb4091039a-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.009 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e81f0dab7cfc764e-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj2 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj2 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj2 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj2 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4pj2X71LvLJ09PQg5ygciFvubSg= 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4pj2X71LvLJ09PQg5ygciFvubSg='} 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000019b43bc628b036e5-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007595d8cc2b431178-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj3 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj3 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj3 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.013 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj3 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:H4GbpkzJ2LFaD6SMbuf/qwj7JI0= 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:H4GbpkzJ2LFaD6SMbuf/qwj7JI0='} 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fca27330a7eb3470-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f5d7d63f0309f984-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj4 2024-04-16T19:30:49.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj4 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj4 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.016 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj4 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XlX9x/hI/T8J9QjZvyhMDmpY/Tk= 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XlX9x/hI/T8J9QjZvyhMDmpY/Tk='} 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000052256bc8e4fa5df5-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b01685cc6cfd146c-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj5 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj5 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj5 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj5 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.019 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zYUD7pA0fOiBkRCqcnPMvJVOOEg= 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zYUD7pA0fOiBkRCqcnPMvJVOOEg='} 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009adc32f771bdcc6e-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.020 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d234dfed51e2ab42-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj6 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj6 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj6 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj6 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ymbsspnvdt4HH10vo/68Z/I4qt8= 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ymbsspnvdt4HH10vo/68Z/I4qt8='} 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b32973b5803417ed-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9e937e435073380-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj7 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj7 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj7 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj7 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:SjvY1vNx0kkD+wmyV+/X3rYWxVI= 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SjvY1vNx0kkD+wmyV+/X3rYWxVI='} 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000039d573e872043953-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.026 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e5443d9c31446065-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj8 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj8 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj8 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj8 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:lK3jk9EkgJHxreAcnNilA50tCqQ= 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lK3jk9EkgJHxreAcnNilA50tCqQ='} 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003dc266d054cf2c6a-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.029 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d24811c4a9f0187b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj9 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj9 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj9 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj9 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/8oE/V3qliIyzOoj7Aj5VQXUb6U= 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/8oE/V3qliIyzOoj7Aj5VQXUb6U='} 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005d90bbd99bf84196-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d3752ffb9770fa96-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj10 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj10 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj10 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj10 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:pN3xzNK8fHfGgNQOjJAez8bA7Bg= 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pN3xzNK8fHfGgNQOjJAez8bA7Bg='} 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000577f157752bd10d-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000334439debb568f58-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj11 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj11 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj11 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.036 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj11 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:h03jb1q2BKCJbtyTtQSQfj3Wmj0= 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:h03jb1q2BKCJbtyTtQSQfj3Wmj0='} 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005f2e4f4e35f9806b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005a447a172246b47b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj12 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj12 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj12 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.039 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj12 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vcn3ZW2QhkDviUrrneshx7yAsUQ= 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vcn3ZW2QhkDviUrrneshx7yAsUQ='} 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a98c7982e4cbe3f8-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000921235918ab0dbd-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj13 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj13 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj13 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj13 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iNdj9KEq3K9bpUMOiq4F0301EIw= 2024-04-16T19:30:49.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iNdj9KEq3K9bpUMOiq4F0301EIw='} 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000dd690c1dc1944e45-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.043 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8dc32ea7db87846-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj14 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj14 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj14 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj14 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cVok4EWYLJ6UaUGrC7dXYqDMrF4= 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cVok4EWYLJ6UaUGrC7dXYqDMrF4='} 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003d08f41fb983b327-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.046 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000aa84b48c32c29090-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj15 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj15 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj15 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.047 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj15 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:TCZCwSX6jUoGgt+263Lir6D6TwM= 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TCZCwSX6jUoGgt+263Lir6D6TwM='} 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a547353236d0ad2c-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.048 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c10dfc0b7607d2b0-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj16 2024-04-16T19:30:49.049 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj16 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj16 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.050 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj16 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:a2xPEzq2hI8k1tN54vB7Ul3Whqo= 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a2xPEzq2hI8k1tN54vB7Ul3Whqo='} 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004b92da91fe4d3851-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.051 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000630f1183d853085c-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj17 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj17 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.052 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj17 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj17 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YomLWsfrZxSxAmqDL9pBaQ8AaV0= 2024-04-16T19:30:49.053 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YomLWsfrZxSxAmqDL9pBaQ8AaV0='} 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f72f6d1b388e6c22-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.054 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000337389457ea4f6a9-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj18 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj18 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj18 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.055 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj18 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VYpgO4LZDOUBxuAaESL0z19LWQg= 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VYpgO4LZDOUBxuAaESL0z19LWQg='} 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000317ae3a8300913b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.056 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.057 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '108'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a79b4ee3ec463304-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj19 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj19 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj19 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.058 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj19 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:z8xugLqlf7zoHF3QrJaN9GlZiAM= 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:z8xugLqlf7zoHF3QrJaN9GlZiAM='} 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009491646ad86c2bdd-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.059 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.060 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '114'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007aa89724ba1565c1-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj20 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj20 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj20 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.061 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj20 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:gtg5cmd8plBykBsCA4qigDbcmUQ= 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gtg5cmd8plBykBsCA4qigDbcmUQ='} 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f35ccc7755780cce-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.062 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '120'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000023ab5c5cffccf1c4-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj21 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj21 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj21 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.064 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj21 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:yooXc58byo5iGm7JT8MDwj8qXJ0= 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yooXc58byo5iGm7JT8MDwj8qXJ0='} 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bf6dc037ff1909bb-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '126'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000e18c70bc104bbee-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj22 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj22 2024-04-16T19:30:49.066 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj22 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj22 2024-04-16T19:30:49.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:blYKtmgh7rPx4uRjsR/2p70Afng= 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:blYKtmgh7rPx4uRjsR/2p70Afng='} 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004c12ccf61c5275bc-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.068 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '132'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009076920a6f03f642-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj23 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj23 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj23 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj23 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3egx1jxuTTNXTSoSrYOesz6pGdg= 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3egx1jxuTTNXTSoSrYOesz6pGdg='} 2024-04-16T19:30:49.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001c00ab9af0024a2d-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.071 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '138'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004da523b27301ff56-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj24 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj24 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj24 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj24 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DI4xojSMFqjUrN+B2I+6fskvDww= 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DI4xojSMFqjUrN+B2I+6fskvDww='} 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ceee4859c0006a8-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.074 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '144'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000067d931ada935d76a-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj25 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj25 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj25 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.075 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj25 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XpssgDk5KroJOMFzddNCQX2b7uY= 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XpssgDk5KroJOMFzddNCQX2b7uY='} 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b388cb90e5b8d042-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '150'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008642a02c673b679f-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj26 2024-04-16T19:30:49.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj26 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj26 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.078 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj26 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2AcccMAupdLX9Pl7EWA6o/B6eLg= 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2AcccMAupdLX9Pl7EWA6o/B6eLg='} 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009f96cd4c4ca7ecda-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '156'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000045a0fd3d8220fa4b-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj27 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj27 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj27 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj27 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:74JMhRLo/Q+nmKetVbejvpPzn6o= 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:74JMhRLo/Q+nmKetVbejvpPzn6o='} 2024-04-16T19:30:49.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d47e384b834e52c6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.082 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '162'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f1d7b07f47c000f-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj28 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj28 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj28 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj28 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:0qfZ5RDzqdIcztq06EjldkJ9A9E= 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0qfZ5RDzqdIcztq06EjldkJ9A9E='} 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d48e4bccc1ef3ac6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.085 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '168'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000044cc6569fafbdbce-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj29 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj29 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj29 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.086 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj29 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VtG94HENJReqYPSJ0AOyDd2kkOU= 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VtG94HENJReqYPSJ0AOyDd2kkOU='} 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d7816c7e05f143f6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '174'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d19ed080dcaf1fe-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj30 2024-04-16T19:30:49.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj30 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj30 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj30 2024-04-16T19:30:49.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:krUMyViK+rLpdrFe9hGtRohP9h0= 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:krUMyViK+rLpdrFe9hGtRohP9h0='} 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000232a7f0c694c84d5-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '180'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ecbf814b6e88c74d-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj31 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj31 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj31 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj31 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:LLctdF6FUegKxxZlOjd88n4TaUQ= 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LLctdF6FUegKxxZlOjd88n4TaUQ='} 2024-04-16T19:30:49.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000a7d16010a6b2bb2-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.093 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '186'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000462d330aea30b0c2-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj32 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj32 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj32 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj32 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:QVMjgmIQET20R5mU+shdkalIvGo= 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QVMjgmIQET20R5mU+shdkalIvGo='} 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c44d49c9cb1cca96-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '192'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000530cfadfa6223ee3-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj33 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj33 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj33 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj33 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:TNypBiE+QMKl46lh4FKFrnTejxI= 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TNypBiE+QMKl46lh4FKFrnTejxI='} 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000af166c0795c5d173-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo= 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bt4gag5xq8B5kYv0YWIsm8j9Jpo=', 'Content-Length': '0'} 2024-04-16T19:30:49.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '198'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ef3b8e88212a92d6-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj34 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj34 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj34 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.100 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:27 GMT 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj34 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Lgs2WRKcIsFiia0Vu2OQsDSftQw= 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:27 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Lgs2WRKcIsFiia0Vu2OQsDSftQw='} 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000067c76515085ea9c3-00661eb9af-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:27 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '204'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000be91d240b4c0da74-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj35 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj35 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj35 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.103 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj35 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:hT5ezXzpS6RYuQijnhnWWNAKaD0= 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hT5ezXzpS6RYuQijnhnWWNAKaD0='} 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005ecc65aeff1f596b-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '210'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000888f85e4eb033ad0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj36 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj36 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj36 2024-04-16T19:30:49.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj36 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.106 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:yFKSBKcssb0owrR1l7wXTKvyFpE= 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:yFKSBKcssb0owrR1l7wXTKvyFpE='} 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000097f22078d29db560-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.107 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '36'), ('X-RGW-Bytes-Used', '216'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a2616ab8c9c7f694-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj37 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj37 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj37 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj37 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rX/Oy8T0MYGnaxPfPDBkF5VRWNw= 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rX/Oy8T0MYGnaxPfPDBkF5VRWNw='} 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000213efa7c5662813d-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '37'), ('X-RGW-Bytes-Used', '222'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002850e3050b8ddb18-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj38 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj38 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj38 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj38 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sPArBvCXE7DwHenyg+w6tHn4qmI= 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sPArBvCXE7DwHenyg+w6tHn4qmI='} 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000091944b08f745ac78-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '38'), ('X-RGW-Bytes-Used', '228'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f4dd9b142e819c0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj39 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj39 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj39 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.114 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj39 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DI7xmQuagI+6Mow3OgMz1l5ePpw= 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DI7xmQuagI+6Mow3OgMz1l5ePpw='} 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001bbbb458118bc92e-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '39'), ('X-RGW-Bytes-Used', '234'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000ecd0a4e838b6281b-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj40 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj40 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj40 2024-04-16T19:30:49.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj40 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:xoHEf1A9lvxvVThonzepguZAGL8= 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xoHEf1A9lvxvVThonzepguZAGL8='} 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f0271afd6e214e3f-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.118 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '40'), ('X-RGW-Bytes-Used', '240'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087960575f62b4cba-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj41 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj41 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj41 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj41 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4InBuOtg4mXxG+DQ0MjJLbQu+js= 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4InBuOtg4mXxG+DQ0MjJLbQu+js='} 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000063811427d0a4cc0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.121 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '41'), ('X-RGW-Bytes-Used', '246'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bd5d99eba2d511a6-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj42 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj42 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj42 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj42 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:92OkW2dTpSGmYtGK1S1NwfhMK5Y= 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:92OkW2dTpSGmYtGK1S1NwfhMK5Y='} 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000b4268c5bccfa6c9-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '42'), ('X-RGW-Bytes-Used', '252'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006362a047328857b5-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj43 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj43 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj43 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.125 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj43 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fO9VIl483kOVzTBRCDGsgnCPyuQ= 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fO9VIl483kOVzTBRCDGsgnCPyuQ='} 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000091d256a4c925dbd0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '43'), ('X-RGW-Bytes-Used', '258'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c38136f9a27ee9a5-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj44 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj44 2024-04-16T19:30:49.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj44 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj44 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.128 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XJRBLiATpaWFkOoMLjovr0EIaTI= 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XJRBLiATpaWFkOoMLjovr0EIaTI='} 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000005e699ceb55d68e4-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.129 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '44'), ('X-RGW-Bytes-Used', '264'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d6556edbac6f88a-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj45 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj45 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj45 2024-04-16T19:30:49.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj45 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:LbNlWcQ1Sfl3qisaBdRxlXS2hCM= 2024-04-16T19:30:49.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LbNlWcQ1Sfl3qisaBdRxlXS2hCM='} 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005e4a3796bbe7bdf6-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.132 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '45'), ('X-RGW-Bytes-Used', '270'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f45c4f31df39473d-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj46 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj46 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj46 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj46 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:a4qZm0tcYjJr/FMchlzL/ZHi6Ug= 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a4qZm0tcYjJr/FMchlzL/ZHi6Ug='} 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a712bb86e186661-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.135 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '46'), ('X-RGW-Bytes-Used', '276'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bdd608dfe66c00a9-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj47 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj47 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj47 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj47 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:LTqPo0Yqe2kSVBLRRh0mI/52VpA= 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LTqPo0Yqe2kSVBLRRh0mI/52VpA='} 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000928547df8e5086f0-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '47'), ('X-RGW-Bytes-Used', '282'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000714c1dbab33a4dc-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj48 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj48 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj48 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.139 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj48 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kTTWPsLi54l2Wi6xf9/czfU7toc= 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kTTWPsLi54l2Wi6xf9/czfU7toc='} 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002cf798e9b2d2616a-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/ 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/ 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/ 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:/cjqttm-12/ 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts= 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4LywOIhlgnihfV5VCE9mmplCLts=', 'Content-Length': '0'} 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '48'), ('X-RGW-Bytes-Used', '288'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fc99a0f121c7ef8c-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-12/obj49 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-12/obj49 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-12/obj49 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue'} 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:qPXxZ/RPSWTmyZje6CcRDA== 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 17:47:28 GMT 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:/cjqttm-12/obj49 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.142 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:OwlVj7IITuO8RepeKuk6SnmG0VM= 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'qPXxZ/RPSWTmyZje6CcRDA==', 'Content-Length': '6', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 17:47:28 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:OwlVj7IITuO8RepeKuk6SnmG0VM='} 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"a8f5f167f44f4964e6c998dee827110c"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000031a3e8543944da7e-00661eb9b0-4336-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 17:47:28 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713289576.271577_55.1","last_update":"2024-04-16T17:46:16.271577Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1713289645.949278_54.1","last_update":"2024-04-16T17:47:25.949278Z"},{"marker":"1_1713289624.386720_84.1","last_update":"2024-04-16T17:47:04.386720Z"}] 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289645.949278_54.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:49.143 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:28.600+0000 7f9da7644800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:28.601+0000 7f9da7644800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289645.949278_54.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:25.949278Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:28Z"} 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713289576.271577_55.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T17:46:16.271577Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713289645.949278_54.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:25.949278Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713289624.386720_84.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T17:47:04.386720Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T17:47:28Z"} 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713289576.271577_55.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T17:46:16.271577Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '0.000000', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713289645.949278_54.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:25.949278Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713289624.386720_84.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T17:47:04.386720Z', 'realm_epoch': 2}}] 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289645.949278_54.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713289576.271577_55.1', 1: '', 2: '1_1713289645.949278_54.1', 3: '1_1713289624.386720_84.1'} 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-11', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-11 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.144 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:28.735+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:33.735+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:38.736+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:43.737+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:48.738+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:53.739+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:47:58.741+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:03.741+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:08.743+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:13.743+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:18.744+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:23.745+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:28.746+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:33.746+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:38.747+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.145 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:43.748+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:48.749+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:53.751+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:48:58.752+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:03.753+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:08.753+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:13.754+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:18.755+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:23.756+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:28.757+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:33.758+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:38.760+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:43.761+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:48.762+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.146 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:53.763+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:49:58.762+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:03.763+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:08.764+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:13.765+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:18.767+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:23.767+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:28.769+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:33.770+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:38.771+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:43.771+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:48.772+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:53.773+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:50:58.774+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:03.775+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:08.776+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.147 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:13.778+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:18.778+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:23.779+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:28.779+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:33.780+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:38.781+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:43.782+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:48.783+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:53.784+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:51:58.785+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:52:03.787+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:52:08.788+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:52:13.789+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:52:18.789+0000 7f716a733800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:52:23.790+0000 7f716a733800 -1 bucket checkpoint timed out waiting to reach incremental sync 2024-04-16T19:30:49.148 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:52:23.790+0000 7f716a733800 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T19:30:49.149 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T17:52:23.790+0000 7f716a733800 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T19:30:49.149 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 110 2024-04-16T19:30:49.149 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:49.149 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.149 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:49.149 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_resharded_bucket_incremental_sync_latest_after_data_sync_init 2024-04-16T19:30:49.149 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:49.152 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:49.152 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:49.152 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:49.152 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 2288, in test_resharded_bucket_incremental_sync_latest_after_data_sync_init 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 398, in zonegroup_bucket_checkpoint 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 390, in zone_bucket_checkpoint 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests: target_zone.cluster.admin(cmd, debug_rgw=1) 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw_multisite.py", line 197, in admin 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests: assert r == 0 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:45 GMT 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iWCEbqwcqYfpIGfEDpz4TGOYeOI= 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iWCEbqwcqYfpIGfEDpz4TGOYeOI=', 'Content-Length': '0'} 2024-04-16T19:30:49.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx000006677816fc5c92a13-00661ec6a5-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=cjqttm-56 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713292965.337055_1519.1","last_update":"2024-04-16T18:42:45.337055Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.155 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:42:45.558+0000 7f7c4bc9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:42:45.559+0000 7f7c4bc9d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.328527_1516.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.328527Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.328527_1516.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.328527Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:45Z"} 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292965.328527_1516.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:42:45.328527Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.328527_1516.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713292965.337055_1519.1 target=1_1713292965.328527_1516.1 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.156 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:42:50.695+0000 7f0b7572d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:42:50.696+0000 7f0b7572d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.337055_1519.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.337055Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:50Z"} 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713292965.337055_1519.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:42:45.337055Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:42:50Z"} 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713292965.337055_1519.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:42:45.337055Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713292965.337055_1519.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8f761e1ee9cb26d-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11 2024-04-16T19:30:49.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:9n432fczakdTocgXO29t+0JDdAc= 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9n432fczakdTocgXO29t+0JDdAc='} 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e847ba94d939acd1-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000058940e18de043fae-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22 2024-04-16T19:30:49.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22 2024-04-16T19:30:49.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ziBg22lpIw+gG41427G878dwRsk= 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ziBg22lpIw+gG41427G878dwRsk='} 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b0aecd9205bbe49f-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.163 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008275fa7b1549a9ea-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2hbLh494JlA+LawFSFor/xX8xNs= 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2hbLh494JlA+LawFSFor/xX8xNs='} 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000059eb6cc8f6b9afee-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.166 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004f76066edd6a0130-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2kgNjs/gMgOQRKlLU0ZbSFnNG6k= 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2kgNjs/gMgOQRKlLU0ZbSFnNG6k='} 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ee70de23ae502779-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.169 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fff602b8e0854d29-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:g5MF38Yez2GwnSm04cbhZw7Y1Dk= 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:g5MF38Yez2GwnSm04cbhZw7Y1Dk='} 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008a5bebc8883c1aeb-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.171 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-56 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 5 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM= 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4Zvv61WcVbzoYXeFDQle7kmHVEM=', 'Content-Length': '0'} 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001b0480eb1d4623f0-00661ec6aa-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17 2024-04-16T19:30:49.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:50 GMT 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.174 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1qqdvYnF3dSMRAEpF9H7rwTlODM= 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:50 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1qqdvYnF3dSMRAEpF9H7rwTlODM='} 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007201649e2ae5acda-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.175 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000001f51904fca6d08e6-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.176 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:UjsECQNdrVXuChV/Cxb/5hxEDJA= 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UjsECQNdrVXuChV/Cxb/5hxEDJA='} 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b38d00d38e313cff-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.178 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004ecea42105b9abf8-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:FlfESczYpEMR4BodJuRGYNcjYaE= 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FlfESczYpEMR4BodJuRGYNcjYaE='} 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000683503253ff08ad3-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006a1dae2edcb81bad-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ff4vuNE3YhepeqXT2gqYXSxKaks= 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ff4vuNE3YhepeqXT2gqYXSxKaks='} 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ab4c06106b16ef2a-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000002a11de3bcde35e25-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.185 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PPjRU+iCe7aMerPOiyp6RqYes8w= 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PPjRU+iCe7aMerPOiyp6RqYes8w='} 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a24c31e66791d225-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-56 2024-04-16T19:30:49.186 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 10 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.187 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c228094d1c586ee6-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:K/a7L/JVWYIkQk9YHf+MzY4oreY= 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:K/a7L/JVWYIkQk9YHf+MzY4oreY='} 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d84f476598770234-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.190 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0b4a92006c705b1-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.191 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:l037I96dlBO/4ky1qJ6IrsQpFtE= 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l037I96dlBO/4ky1qJ6IrsQpFtE='} 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000004fcf1f960f0a3bd-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000a4fea64600b7ac7-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57 2024-04-16T19:30:49.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ESXpOES9CI/e6w2OrNlggUnH4Iw= 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ESXpOES9CI/e6w2OrNlggUnH4Iw='} 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000203473c0266559d4-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.195 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f383b877cb7c869b-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sjRqY3vaWqfshMC7HshfV5JsCRg= 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sjRqY3vaWqfshMC7HshfV5JsCRg='} 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000007ef9b12279d3a5f5-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.198 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008498eb47949becb8-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fLGlChFvg5s+V4H6wqRpj5NVt3A= 2024-04-16T19:30:49.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fLGlChFvg5s+V4H6wqRpj5NVt3A='} 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b0194dc35a1e46d5-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-56 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 15 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000025e821a9be5421ac-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.203 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:xOZYbS3qCgintPc6PAJvwc1/iCM= 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:xOZYbS3qCgintPc6PAJvwc1/iCM='} 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bdf6676a0027f2ae-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000092413e44a9bb6edc-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:avEUhSLI9VDq+KVQcFdUhyF9XEY= 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:avEUhSLI9VDq+KVQcFdUhyF9XEY='} 2024-04-16T19:30:49.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d20af17950be618f-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.207 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000943016b7718b6b9-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2RBi9xCxreEuLdTqL8KNsI1991g= 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2RBi9xCxreEuLdTqL8KNsI1991g='} 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005e2b02e23aea2429-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000efb49bc6b5ef62e3-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.211 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Qd9KY5Hzdk2o8n60SiMjWBG3mu8= 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Qd9KY5Hzdk2o8n60SiMjWBG3mu8='} 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f7f606ac928c03d7-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005eddac03db1b2d0f-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ecKcJJkI3K+1jOnpxIaeMe0lTvc= 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ecKcJJkI3K+1jOnpxIaeMe0lTvc='} 2024-04-16T19:30:49.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001abd26b7057d32f9-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-56 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 20 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005dda7359ea2dcce1-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29 2024-04-16T19:30:49.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:pvDloHz2JZATcCvJWZOttoaL4JE= 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pvDloHz2JZATcCvJWZOttoaL4JE='} 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a277df49cdebdb95-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000475a303646bee164-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.220 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Ab/GA7BaT1lE8N4QnprEmAfkCzs= 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ab/GA7BaT1lE8N4QnprEmAfkCzs='} 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e9293394fb51e95e-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000c9b928958f4d9b1e-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.223 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:42ynO98hN6PPb6dfR5LT0AGSRRQ= 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:42ynO98hN6PPb6dfR5LT0AGSRRQ='} 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000053a12b2825ad4df0-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.224 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:51 GMT 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E= 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sUVcJMdMx/oMqRJuKQCwEemy80E=', 'Content-Length': '0'} 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000069956cf7fbf61c3b-00661ec6ab-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Cve8Q2BQeszmDLWhUKzNd+shQjA= 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cve8Q2BQeszmDLWhUKzNd+shQjA='} 2024-04-16T19:30:49.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009c0bf820bb710825-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.227 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000741a5c258cc792ac-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NDceUCFGHFqQBqLNhyE56izniUI= 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NDceUCFGHFqQBqLNhyE56izniUI='} 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009fae2a2747ecd540-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-56 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 25 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bc4d5372801084ef-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31 2024-04-16T19:30:49.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:+1cxUiVSJJYcv+I2tGqW/v9cxIU= 2024-04-16T19:30:49.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+1cxUiVSJJYcv+I2tGqW/v9cxIU='} 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000002bfddcee9f7098dc-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.233 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007c942ea456b57114-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5EWUaTgXe9dukKIjmXaw1qrost0= 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5EWUaTgXe9dukKIjmXaw1qrost0='} 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000d368574e00d98fe2-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.236 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009c990a39147acd4b-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.237 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:0W58CJwz0+9J8w+qqwMWRz2Grns= 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:0W58CJwz0+9J8w+qqwMWRz2Grns='} 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006efa18f40f11cc9b-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000228c453943f8d435-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.240 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3cftKEJa+xR0zhNh7QV0Nnp/Euk= 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3cftKEJa+xR0zhNh7QV0Nnp/Euk='} 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b2e55ea115cf7c3-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000014e893090e7872b2-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155 2024-04-16T19:30:49.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kGhsC43RlVCBbTk2pPSaI1OBCE4= 2024-04-16T19:30:49.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kGhsC43RlVCBbTk2pPSaI1OBCE4='} 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000001e30eca7c33ec12e-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-56', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-56 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-56 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 30 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000009ff425282b9af40-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.246 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vLJ/4/M5hOP/7P+1PyGJ8SlR5Ls= 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vLJ/4/M5hOP/7P+1PyGJ8SlR5Ls='} 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000026c2365e95f6bdde-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000af7f3286d1a2713a-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74 2024-04-16T19:30:49.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vKzru+0rkFXSPrju6mN75yA1yl8= 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vKzru+0rkFXSPrju6mN75yA1yl8='} 2024-04-16T19:30:49.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ccfc50785e21975-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.250 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000171580f0ad32f1fe-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:hzh56HETtd5gFJ9eazBGpZDHnw8= 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hzh56HETtd5gFJ9eazBGpZDHnw8='} 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004f282ee3719d500d-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006a4bcd6984081245-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.254 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZVzlLFG/OB0lWHL9LRf+Ma0Fy7s= 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZVzlLFG/OB0lWHL9LRf+Ma0Fy7s='} 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e20df072fa161440-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0= 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ndJXAadDjNjyrDKDRc9r53eZ2e0=', 'Content-Length': '0'} 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d172993a2f8c6017-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:49.257 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:42:52 GMT 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s2yv3I//5HPkMcXBVZMRth4k0Bk= 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:42:52 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s2yv3I//5HPkMcXBVZMRth4k0Bk='} 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000f6be7309c7ef2e1f-00661ec6ac-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-56 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:42:52.855+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 4.. 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:42:57.856+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.258 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:02.857+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:07.858+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:12.858+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:17.859+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:22.858+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:27.859+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:32.860+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:37.860+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:42.861+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:47.861+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:52.862+0000 7f648a0e4800 1 waiting to reach latest gen 6, on 5.. 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:43:57.866+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:02.868+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.259 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:07.869+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , , , , , , 00000000002.119.6, , , , , , , , , , , , , , , , , , , ] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:12.872+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , , , , , , 00000000002.119.6, , , , , , , , , , , , , , , , , , , ] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:17.874+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , , , , , , 00000000002.119.6, , , , , , , , , , , , , , , , , , , ] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:22.876+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:27.879+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.260 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:32.881+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:37.885+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:42.888+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:47.890+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.261 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:52.893+0000 7f648a0e4800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:57.894+0000 7f648a0e4800 1 bucket sync caught up with source: 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:44:57.894+0000 7f648a0e4800 0 bucket checkpoint complete 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-56 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-56 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:49.262 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:44:58.055+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:03.055+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:08.055+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:13.057+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:18.057+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:23.058+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:28.059+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:33.059+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:38.060+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:43.060+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:48.061+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:53.062+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:45:58.062+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.263 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:03.063+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:08.063+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:13.064+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:18.065+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:23.066+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:28.067+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:33.067+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:38.068+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:43.068+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:48.069+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:53.070+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:46:58.070+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:03.071+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:08.072+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:13.071+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.264 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:18.072+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:23.073+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:28.074+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:33.075+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:38.075+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:43.076+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:48.077+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:53.077+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:47:58.078+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:03.079+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:08.080+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:13.079+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:18.080+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:23.081+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.265 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:28.082+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:33.082+0000 7f520c930800 1 waiting to reach incremental sync.. 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:38.084+0000 7f520c930800 1 bucket sync caught up with source: 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: local status: [, 00000000003.1441.6, 00000000002.450.6, 00000000002.538.6, 00000000005.799.6, 00000000004.526.6, 00000000001.339.6, 00000000001.307.6, 00000000004.318.6, 00000000007.584.6, 00000000006.517.6] 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: remote markers: [, 00000000003.1441.6, 00000000002.450.6, 00000000002.538.6, 00000000005.799.6, 00000000004.526.6, 00000000001.339.6, 00000000001.307.6, 00000000004.318.6, 00000000007.584.6, 00000000006.517.6] 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:48:38.084+0000 7f520c930800 0 bucket checkpoint complete 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: comparing bucket=cjqttm-56 zones={test-zone2, test-zone1} 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M= 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M=', 'Content-Length': '0'} 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000007ebc25f469d0e06a-00661ec806-6331-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.268 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M= 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:G1spWAW0WDMC0Z+bPUhbPMUf04M=', 'Content-Length': '0'} 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000054572a59fbdfa91f-00661ec806-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket1 objects: 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:/cjqttm-56/?versions 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T19:30:49.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000089b053e407e844ae-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj11 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj111 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj115 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj116 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj124 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj145 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj148 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj155 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj17 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj185 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj19 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj22 2024-04-16T19:30:49.271 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj23 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj29 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj31 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj33 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj34 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj37 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj38 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj44 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj46 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj51 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj55 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj57 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj58 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj62 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj68 2024-04-16T19:30:49.272 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj69 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj74 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj76 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj85 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj87 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj92 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj93 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj95 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket2 objects: 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:/cjqttm-56/?versions 2024-04-16T19:30:49.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009f66e9973d4a7b57-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj11 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj111 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj115 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj116 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj124 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj145 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj148 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj155 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj17 2024-04-16T19:30:49.275 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj185 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj19 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj22 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj23 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj29 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj31 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj33 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj34 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj37 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj38 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj44 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj46 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj51 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj55 2024-04-16T19:30:49.276 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj57 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj58 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj62 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj68 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj69 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj74 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj76 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj85 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj87 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj92 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj93 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj95 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:/cjqttm-56/?versions 2024-04-16T19:30:49.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f84b6eaadf734f40-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?versions&max-keys=999 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:/cjqttm-56/?versions 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo= 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3zoSBVujB0+nu6DQKKHpx1ZyxCo=', 'Content-Length': '0'} 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020b26873bf05f0b8-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56999falseobj11nulltrue2024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj111nulltrue2024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj115nulltrue2024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj116nulltrue2024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj124nulltrue2024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj145nulltrue2024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj148nulltrue2024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj155nulltrue2024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj17nulltrue2024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj185nulltrue2024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj19nulltrue2024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj23nulltrue2024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj29nulltrue2024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj31nulltrue2024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj34nulltrue2024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj37nulltrue2024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj38nulltrue2024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj46nulltrue2024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj51nulltrue2024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj57nulltrue2024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj58nulltrue2024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj62nulltrue2024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj68nulltrue2024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj69nulltrue2024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj74nulltrue2024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj76nulltrue2024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj85nulltrue2024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj87nulltrue2024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj92nulltrue2024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj93nulltrue2024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj95nulltrue2024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.280 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.281 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bba30accabaad3ea-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T19:30:49.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000096aeb559754f9e79-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.284 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws= 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws=', 'Content-Length': '0'} 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000deea1ff4be0b10f6-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.285 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws= 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:pg+Nncx2le2clp5BNu/0wv7tyws=', 'Content-Length': '0'} 2024-04-16T19:30:49.286 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003867618bb4cd939f-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.287 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000344b9316ca1e0296-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.288 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11?versionId=null 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0= 2024-04-16T19:30:49.289 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GMeXyVimv0HB4CETQM2ZJwUVUl0=', 'Content-Length': '0'} 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a53316c5656e1a95-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.290 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0d9d4e6d6ed267d-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.291 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.292 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a1b3edebd0c4fba0-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.293 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g= 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g=', 'Content-Length': '0'} 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ac36759225ea7009-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.294 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g= 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mQQP6iyk9qPY7Fjw5LwHG6Jxt/g=', 'Content-Length': '0'} 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b744963a92b62595-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.295 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.296 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg= 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg=', 'Content-Length': '0'} 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000040af00eac00f8c3a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj11 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj11 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj11 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.297 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj11 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg= 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PPucMu35Cbq2F31aUhiKnTk5pAg=', 'Content-Length': '0'} 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d73ac06147821c6-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.298 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.299 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009a4dec327a678e8-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj11 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.300 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003496f4b072dd1b3-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.301 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj111000falseobj112024-04-16T18:42:50.728Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj111 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.302 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e27f4512993bb3c-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.303 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T19:30:49.304 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005be53c535e238f7e-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.305 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ= 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000af5dd340b43bd336-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.306 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ= 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C6g1RG6dcGD4TTKtazvnni+uhGQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.307 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a0b9123429d29114-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj111 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.308 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000764940d62d5c4314-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.309 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111?versionId=null 2024-04-16T19:30:49.310 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM= 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VszHXfb1zqmkGdeKobryrLdzcwM=', 'Content-Length': '0'} 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007522a9ff1904611a-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.311 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003119fe3ffe9ef429-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.312 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.313 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f87bf769438a5fc-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.314 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE= 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE=', 'Content-Length': '0'} 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041c41c5c5d3490a5-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111 2024-04-16T19:30:49.315 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE= 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UaN4UQAiBS+icNw8djh2jdZjrNE=', 'Content-Length': '0'} 2024-04-16T19:30:49.316 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebb287d2fd1fffe4-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj111 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.317 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64= 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64=', 'Content-Length': '0'} 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000004501008b7594207-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.318 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64= 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AlJg+DXCSMMN3Vhvi9gOdH+6E64=', 'Content-Length': '0'} 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a7eafec84a50b73d-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.319 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.320 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002ffa1a0cd9a0e344-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.321 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj111 2024-04-16T19:30:49.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.322 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.323 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007d09c79ea5fbd976-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1111000falseobj1112024-04-16T18:42:52.667Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj115 2024-04-16T19:30:49.324 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.325 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bae94cb569b835e-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.326 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.327 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000023a8d68b3497cd0d-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.328 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s= 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s=', 'Content-Length': '0'} 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8d737080f61cb19-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.329 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s= 2024-04-16T19:30:49.330 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iQ6gNFSuO2857SPha5DMbCl9C6s=', 'Content-Length': '0'} 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d3855b76e25dbeda-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj115 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.331 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d97f47e680992bb6-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.332 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115?versionId=null 2024-04-16T19:30:49.333 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ= 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5NhYd6grU4Q1TKlAQxnPNAiPyDQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004f353715209302e9-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.334 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000ec2718dc4508c30-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.335 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.336 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006fc95130d4bf4612-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.337 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE= 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE=', 'Content-Length': '0'} 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbeba11be591baa2-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.338 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.339 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE= 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ooqSG3F1H9Rrtlh707ZJ8DZpOZE=', 'Content-Length': '0'} 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000044e48c0eddbd34f3-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj115 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.340 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ= 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a8b7eb01626e6d2f-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj115 2024-04-16T19:30:49.341 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj115 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj115 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.342 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj115 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ= 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VpjHSG+Or2gzehoTZkoxpOlNMPQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e93855f1be472daa-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.343 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b8f03202df08c8c1-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.344 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj115 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.345 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b57739c9770b9812-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1151000falseobj1152024-04-16T18:42:51.692Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj116 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.346 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T19:30:49.347 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eed116a6070b4515-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.348 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003dc4c2b38a8326b0-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.349 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk= 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk=', 'Content-Length': '0'} 2024-04-16T19:30:49.350 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbb5048863a8fd47-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.351 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk= 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YuKmWcJBJR5m5D3ZjVcam1qbbUk=', 'Content-Length': '0'} 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059cab1db2d9c1ea6-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj116 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.352 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T19:30:49.353 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d07fcc30aa713ddf-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.354 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116?versionId=null 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY= 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3d072J2/613HMqWS/knDqIzzCPY=', 'Content-Length': '0'} 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ba7e27e0f6e27685-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.355 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.356 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000b4d1aeab9101486-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.357 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005f3f8dbe8de91e82-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116 2024-04-16T19:30:49.358 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4= 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4=', 'Content-Length': '0'} 2024-04-16T19:30:49.359 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000778a57a6d8d98e22-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.360 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4= 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dlONbt8aI0cPVJoLmrlVnsm5rR4=', 'Content-Length': '0'} 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000283bdf8644b0db4c-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj116 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.361 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A= 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A=', 'Content-Length': '0'} 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c41277eca0b80978-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj116 2024-04-16T19:30:49.362 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj116 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj116 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj116 2024-04-16T19:30:49.363 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A= 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wd8pvJxf7JHIF49qC5DN9SNjN0A=', 'Content-Length': '0'} 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f8d7e37267cf27fb-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.364 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004a3be140999470e2-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.365 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj116 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.366 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005b154804b802c478-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1161000falseobj1162024-04-16T18:42:52.003Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj124 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.367 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T19:30:49.368 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c702b9f16bf3b0ee-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.369 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9111c77e087016b-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.370 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.371 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM= 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM=', 'Content-Length': '0'} 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002cf56d4115da8933-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.372 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM= 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fqqyZMFnXKu3XuKsrJHShL6z2tM=', 'Content-Length': '0'} 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000038938200562a92f9-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj124 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.373 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.374 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000763638ac6aae68dc-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.375 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124?versionId=null 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E= 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lsk7a4nEk9jOL1lV33XsNBhWl4E=', 'Content-Length': '0'} 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c47579fb67640d8e-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.376 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.377 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001979074d4bb920ae-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.378 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007ebf768f1d057e3c-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.379 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124 2024-04-16T19:30:49.380 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A= 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A=', 'Content-Length': '0'} 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009d20ffda4e793160-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.381 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A= 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DLGvz0T+MHpf2keiGK2VgHTZ16A=', 'Content-Length': '0'} 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e4da1fd245596594-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj124 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.382 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA= 2024-04-16T19:30:49.383 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA=', 'Content-Length': '0'} 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c51a695b7d9aa87-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj124 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj124 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj124 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.384 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj124 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA= 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DATaYykG6j0MW2YKpzQlCjltJDA=', 'Content-Length': '0'} 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a14df4b784c55630-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.385 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013e8f29bf57c4b2a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.386 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj124 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.387 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5eef6f3ff759a0c-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1241000falseobj1242024-04-16T18:42:52.331Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj145 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.388 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.389 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de3218dadd36b4b5-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.390 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009334eef4a39692b6-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.391 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.392 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ= 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000550e5abcee964f79-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.393 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ= 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDvD7U5DQWcUeremuJjpVLG3BmQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df48ec4b5c0265d8-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj145 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.394 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.395 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066db4fda75439668-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.396 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145?versionId=null 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI= 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ytOZ+1tzSI7Dqt6aNCcgbpXjPoI=', 'Content-Length': '0'} 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7e14b19b0917171-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.397 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.398 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003cd0018484e7ff79-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.399 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.400 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bcca8448b43e66f1-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.401 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM= 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM=', 'Content-Length': '0'} 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006882ce9025851911-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.402 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM= 2024-04-16T19:30:49.403 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhe3QT+CkmQSNSxjOHZzkatS9wM=', 'Content-Length': '0'} 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a398e15105804969-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj145 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.404 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU= 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU=', 'Content-Length': '0'} 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047751d0415b4bf0c-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj145 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj145 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj145 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.405 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj145 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU= 2024-04-16T19:30:49.406 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:i3Y7bgxOoXahRdCja677YJ0BUYU=', 'Content-Length': '0'} 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a3d8a4bd390a399-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.407 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000362dce2719bc4724-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.408 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj145 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.409 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000540831647ba61157-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1451000falseobj1452024-04-16T18:42:52.014Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj148 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.410 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e2fbf8408d0458b-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.411 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.412 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002b5ab58ff321db64-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.413 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA= 2024-04-16T19:30:49.414 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA=', 'Content-Length': '0'} 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d7c47539e6c9fe93-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.415 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA= 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HV3Wlm5JsI+6o0+hrCHFRMSR0gA=', 'Content-Length': '0'} 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049650a4deb7c366d-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj148 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.416 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.417 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001deda49941ec8138-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.418 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148?versionId=null 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI= 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mMzM1e9b3X3qG6Egd4Na8kTOSUI=', 'Content-Length': '0'} 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009eb2ba29d4efbc77-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.419 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.420 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000042422ba083750874-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.421 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c426cbbe8d7cba41-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.422 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.423 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg= 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg=', 'Content-Length': '0'} 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8354a8ea491d68a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.424 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg= 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bOnTMr83HB8Sod2oawK21WgonXg=', 'Content-Length': '0'} 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ccf030dc269786f-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj148 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.425 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4= 2024-04-16T19:30:49.426 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4=', 'Content-Length': '0'} 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc481f18d4c69d23-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.427 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4= 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bhXWe9LZ0w/Dx5xL8KCFox4IFm4=', 'Content-Length': '0'} 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5c5160ba543ad95-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.428 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000be85cc208a24b528-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.429 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj148 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.430 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000064002f2f00345f67-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1481000falseobj1482024-04-16T18:42:52.677Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj155 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.431 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.432 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dcefba4889a26591-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.433 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4763280a60520f0-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.434 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.435 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM= 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM=', 'Content-Length': '0'} 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026735328a0e46df1-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.436 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM= 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:a0TSOW/heVILVouXbD5PjK5OQrM=', 'Content-Length': '0'} 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e02f8c2d227d4419-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj155 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.437 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.438 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043ac4e76bbf69dc3-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.439 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155?versionId=null 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw= 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3I0/g2Gr2bc2hKrkl24sopoqEFw=', 'Content-Length': '0'} 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c947a30bd72c421-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.440 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.441 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003835c8dbc556ea7-00661ec806-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.442 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E= 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Uetw7zQKAfixLSAN09RPx+PZE7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000053f95790dde3dfa5-00661ec806-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.443 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.444 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ= 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000016b045c2c2a74c4a-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.445 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ= 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YGbLjsqHf7KyQFjwPciAsfEnYgQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000842fb27f1e22e8d7-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj155 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.446 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155 2024-04-16T19:30:49.447 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI= 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI=', 'Content-Length': '0'} 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a5c6759679b163f-00661ec806-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:38 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj155 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj155 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj155 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.448 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:38 GMT 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj155 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI= 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:38 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9g6b7ktc9RtsZng37EQtK978akI=', 'Content-Length': '0'} 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098048dbec5dc1daf-00661ec806-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.449 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.450 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007dccaf0f9ac193e8-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj155 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.451 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000519a9e9535d9705e-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1551000falseobj1552024-04-16T18:42:52.341Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj17 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.452 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.453 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e53f9f875309ef4e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.454 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ebe846a80d5028ad-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.455 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.456 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM= 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM=', 'Content-Length': '0'} 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000655da89eba5d8988-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.457 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM= 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2JQxmy3HUrVyD4IYs9EycZyEZjM=', 'Content-Length': '0'} 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000047fc3ee6e31bb435-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj17 2024-04-16T19:30:49.458 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.459 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ab682430d6a2462c-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.460 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17?versionId=null 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4= 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZDLdLZYll2qIvrvUxiUtA3h5fW4=', 'Content-Length': '0'} 2024-04-16T19:30:49.461 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc132ef0ce9404d5-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.462 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dd9eea2e61c8f0c1-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.463 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.464 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000002dfbd0b52698ac6-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.465 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.466 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U= 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U=', 'Content-Length': '0'} 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c5c989274d96d5d-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17 2024-04-16T19:30:49.467 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U= 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LpGbgvreYtOzzNHKrHVIGM5Bo3U=', 'Content-Length': '0'} 2024-04-16T19:30:49.468 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000661e3ba4fd445daf-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj17 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.469 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg= 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg=', 'Content-Length': '0'} 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0e2f918e716e0eb-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj17 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj17 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj17 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.470 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj17 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg= 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SlGG5av05zaos/pYC78aVpkXLpg=', 'Content-Length': '0'} 2024-04-16T19:30:49.471 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000460f4cac14a97c2d-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.472 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2ac735624e1c171-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.473 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj17 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.474 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003274470a15f75df0-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj171000falseobj172024-04-16T18:42:51.001Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj185 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.475 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000020fcfbd2fe00765-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.476 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.477 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e5dccdcc6f4bcde-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.478 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk= 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk=', 'Content-Length': '0'} 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000095d9d7ce4a697271-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.479 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.480 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk= 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:POBPNngWxcbs0ea7ndFr6lpPttk=', 'Content-Length': '0'} 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000065ffb32ad49a3aa6-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj185 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.481 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T19:30:49.482 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000052b8302c29e6d2c-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.483 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185?versionId=null 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8= 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kUsExt4L4LKutlxvv1YBtDsw/m8=', 'Content-Length': '0'} 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a34e725ad934125b-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.484 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.485 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000045969e8430a8ac21-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.486 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e2882b2229729853-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.487 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q= 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q=', 'Content-Length': '0'} 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000005a7f55a951a831c-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.488 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.489 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q= 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A8C/t4NwGIx8J8oPRLCsKcR3r1Q=', 'Content-Length': '0'} 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093f7b64187e096c0-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj185 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.490 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo= 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo=', 'Content-Length': '0'} 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8ce0300f719bfc0-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:49.491 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.492 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo= 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hnsHbFF9BBMEphHa2QPPomF0eoo=', 'Content-Length': '0'} 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005e8c917bc315e96c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.493 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007f1cfcbd13b7d1e8-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.494 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj185 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.495 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d483e0d8ea317433-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj1851000falseobj1852024-04-16T18:42:52.727Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj19 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.496 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000031a3d2dd2e42c118-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.497 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.498 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dfc7a3285836593c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.499 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io= 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io=', 'Content-Length': '0'} 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000007af9aae14ea09d4-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.500 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.501 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io= 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:tG8gRVod3Rr9lmli+o3y29gD4Io=', 'Content-Length': '0'} 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d60a7c49bca5376e-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj19 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.502 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T19:30:49.503 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd988a745cf5796f-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.504 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19?versionId=null 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI= 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xlc1DWJ3607ZwBrwQXUO296PHHI=', 'Content-Length': '0'} 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a41cf9f04448c4e6-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.505 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.506 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e879a31b71c969b-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.507 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048323b8512fb9418-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.508 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.509 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg= 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg=', 'Content-Length': '0'} 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000077dcf7243858e13e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.510 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg= 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M1SECx5vMQYj1P8oNL8qE2aP2sg=', 'Content-Length': '0'} 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000263e05404a9def05-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj19 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19 2024-04-16T19:30:49.511 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60= 2024-04-16T19:30:49.512 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60=', 'Content-Length': '0'} 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c410f84f5bfea13-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj19 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj19 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj19 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.513 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj19 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60= 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eSH4Ald0My4feFwIjPcW0x4Ws60=', 'Content-Length': '0'} 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000039c57e2bc2a7bb46-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.514 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000713b1c8c7ab3e280-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.515 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj19 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.516 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000013e0dda2d06ad028-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj191000falseobj192024-04-16T18:42:51.301Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.517 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.518 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f0ce199b92b1c296-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.519 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003d6d9d3859241e23-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.520 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.521 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk= 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk=', 'Content-Length': '0'} 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e63dd1c6303ab389-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.522 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk= 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JCU69So2J/wf9jcNYkWDD+pF1Mk=', 'Content-Length': '0'} 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000041dd2a73b6a8aa0a-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-16T19:30:49.523 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.524 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b99fafcd5f21c57e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.525 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22?versionId=null 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc= 2024-04-16T19:30:49.526 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rqSC7Wn4GxV4wZbnNRK/sZvYUgc=', 'Content-Length': '0'} 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f4731b09902624f-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.527 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f285ae8102f43f30-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.528 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.529 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c9d8ff39e357d44c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.530 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM= 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM=', 'Content-Length': '0'} 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002737caba62de7349-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22 2024-04-16T19:30:49.531 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM= 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PLpnazRsMb2oKm/ClOafnJNlPZM=', 'Content-Length': '0'} 2024-04-16T19:30:49.532 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000036744af83ffb907c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.533 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE= 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE=', 'Content-Length': '0'} 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e35d1b3a5ddc481d-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj22 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj22 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj22 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.534 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj22 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE= 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2rz0zDDYxVzNm1cmx4xczA7n0gE=', 'Content-Length': '0'} 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000b3272580d186292-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.535 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.536 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000732190ce74cf4587-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj22 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.537 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000038949e8d6818fabc-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.538 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj221000falseobj222024-04-16T18:42:50.741Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj23 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.539 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018f59502e23df71e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.540 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T19:30:49.541 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d35c8783f21b2172-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.542 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k= 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k=', 'Content-Length': '0'} 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009590ca35535638ec-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.543 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k= 2024-04-16T19:30:49.544 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UdwIFVGzUfGQNyBdAfaImUMJ05k=', 'Content-Length': '0'} 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000912ddba86eab18aa-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj23 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.545 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b98936fed8d12e36-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.546 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23?versionId=null 2024-04-16T19:30:49.547 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg= 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1aDlyGshDGWYgNFCRjPU8efWCfg=', 'Content-Length': '0'} 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009344cf5cc802ea7c-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.548 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000147d13e3ed55c292-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.549 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.550 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004d66379e2e0343a8-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.551 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4= 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4=', 'Content-Length': '0'} 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029a7147789c5bf10-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.552 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4= 2024-04-16T19:30:49.553 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2QrtDjEjhTbFAmlabvHhspWG/i4=', 'Content-Length': '0'} 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2c123de6131ac4d-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj23 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.554 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M= 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M=', 'Content-Length': '0'} 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d67b19087d680272-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj23 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj23 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj23 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.555 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj23 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M= 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:spmNLYcMoodVXjsQYt0hecfMt1M=', 'Content-Length': '0'} 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcacf48a0b252334-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.556 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.557 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000581438104e8a0736-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj23 2024-04-16T19:30:49.558 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.559 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003de73b84384cc498-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj231000falseobj232024-04-16T18:42:51.615Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj29 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.560 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dba09a8cab864587-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.561 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.562 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000804b35ce124846af-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.563 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8= 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8=', 'Content-Length': '0'} 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000074c6fd5d152d93e8-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.564 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.565 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8= 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2FuqCv8bIORC+9CDheqQCOummB8=', 'Content-Length': '0'} 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003bcf65a6eaf897eb-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj29 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.566 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006c1559712af264c5-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.567 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.568 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29?versionId=null 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8= 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Las6l9GcKfAjS+457YH7A+fNWw8=', 'Content-Length': '0'} 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009b91cc3d93ab2f0a-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.569 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000af9e7a00dc40889e-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.570 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.571 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094cc7f12a8259704-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.572 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E= 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E=', 'Content-Length': '0'} 2024-04-16T19:30:49.573 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000706c782d00db7f91-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.574 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E= 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cXaBQRuiPxQrRiYy1crAMF6wG5E=', 'Content-Length': '0'} 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fc76d179c78dd05d-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj29 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.575 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw= 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw=', 'Content-Length': '0'} 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004bcef60cd1bd1b1d-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj29 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj29 2024-04-16T19:30:49.576 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj29 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj29 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.577 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw= 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/dTTZdQ20qcDkktEx5lCAQwbGw=', 'Content-Length': '0'} 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019733b20d291564b-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.578 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000068b26c521102f956-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.579 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj29 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.580 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000ba176ba3c6dcd57a-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj291000falseobj292024-04-16T18:42:51.892Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj31 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.581 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002dfd58c46fa8e8c5-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.582 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.583 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005279200d526b8798-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.584 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc= 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc=', 'Content-Length': '0'} 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033910ee2228cab84-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.585 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.586 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc= 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:toQjvSdMK/CZLtmroeH7yynrVqc=', 'Content-Length': '0'} 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e8633bf3f460f109-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj31 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.587 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004ab7be2c1f6ecff4-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.588 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.589 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31?versionId=null 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI= 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sfQzPw7fLw/3kwCRLnH3prM5wPI=', 'Content-Length': '0'} 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008cf1c796f70852c3-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.590 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001c9770c6c27ccd80-00661ec807-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.591 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.592 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg= 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2IFRqD8GaMAkYS9GpKfH5ipGHTg=', 'Content-Length': '0'} 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006ccc5478024b8a87-00661ec807-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.593 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs= 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs=', 'Content-Length': '0'} 2024-04-16T19:30:49.594 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ee6403c816e4acd-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.595 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs= 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:acgLUk3bR5A580nl+d3uWq3JfEs=', 'Content-Length': '0'} 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e095a8258074e75-00661ec807-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj31 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.596 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:39 GMT 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DZP2lUQEiFjgMMra0kL7PQtDISs= 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:39 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DZP2lUQEiFjgMMra0kL7PQtDISs=', 'Content-Length': '0'} 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000022d901571e6a8f30-00661ec807-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:39 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj31 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj31 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.597 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj31 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj31 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.598 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:O0Sc4yB8f+UvQv5VbRJel6CoOhw= 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:O0Sc4yB8f+UvQv5VbRJel6CoOhw=', 'Content-Length': '0'} 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000080c11055832cc8d3-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.599 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002cd53e041460aa70-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.600 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj31 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.601 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b92f560c40ba1041-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj311000falseobj312024-04-16T18:42:52.263Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.602 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000849320a59c3df09-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.603 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.604 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bec29eae3b77facd-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.605 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU= 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU=', 'Content-Length': '0'} 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093f5a29477355fbc-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.606 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.607 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU= 2024-04-16T19:30:49.608 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:23WaqG+XnmxAqiBUO8dHVrlTMfU=', 'Content-Length': '0'} 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd2a54aa17932c22-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.609 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.610 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cf99451df0afba1a-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.611 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33?versionId=null 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE= 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:VVL9uCyGtfKOqy3GzYlOdnhKmHE=', 'Content-Length': '0'} 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000003a9856e4e482133-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.612 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.613 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000815194c1a0b6549f-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.614 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000445e40d37e6c445c-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.615 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.616 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4= 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4=', 'Content-Length': '0'} 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a4e978f824669608-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.617 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4= 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:C8HfU2Kurmd4pNWymn5SvwtfpM4=', 'Content-Length': '0'} 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bd368397171b5f91-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.618 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY= 2024-04-16T19:30:49.619 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY=', 'Content-Length': '0'} 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c2d52f5568dfa04-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj33 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj33 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj33 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.620 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj33 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY= 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZiOjarZ1uItg35v6GdoW/CSvWAY=', 'Content-Length': '0'} 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dabf341212edb411-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.621 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.622 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007c8297bf5168a3d0-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj33 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.623 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000016d2cf6e7915da80-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj331000falseobj332024-04-16T18:42:50.750Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj34 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.624 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.625 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d67e24388d02ce55-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.626 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b964f5afc0eae03b-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.627 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.628 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8= 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8=', 'Content-Length': '0'} 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d6bb8e248bf730cc-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.629 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8= 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Td+4B+N6wR3nP3CgSYW1+yOYYL8=', 'Content-Length': '0'} 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001b8a7bc8d3600100-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj34 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.630 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.631 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000006bc6f03df472a11-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.632 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34?versionId=null 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I= 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XMEHGQWeHc1MxU1L9epr15gEg1I=', 'Content-Length': '0'} 2024-04-16T19:30:49.633 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000477fb57604c7260b-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.634 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004e52b425f618dbeb-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.635 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.636 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075363831206f11a2-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.637 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g= 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g=', 'Content-Length': '0'} 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8b2eef8740507f9-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.638 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g= 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RX6migHyZefFG2tV3ejaHQNXn0g=', 'Content-Length': '0'} 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bffe6ebab238852e-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.639 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj34 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.640 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4= 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4=', 'Content-Length': '0'} 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008b92414cafb36051-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj34 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj34 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj34 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.641 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj34 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4= 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:eeqs8Zzba8+J6V/KzhXmJh9PFH4=', 'Content-Length': '0'} 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049013b57bbba3f45-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.642 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.643 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000024c3f016647f515d-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj34 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.644 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000834b320b6e5a6a64-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj341000falseobj342024-04-16T18:42:51.011Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.645 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj37 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.646 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007a14d443f2a5ed1f-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.647 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T19:30:49.648 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dc75d6f00722576-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.649 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk= 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk=', 'Content-Length': '0'} 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030f84b15b6326a3d-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.650 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk= 2024-04-16T19:30:49.651 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:KetT/0ZwhKEasvl/Z+Zjs3R8fvk=', 'Content-Length': '0'} 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000bc98940897dfbe2-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj37 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.652 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000800057e2ad149dcf-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.653 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37?versionId=null 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo= 2024-04-16T19:30:49.654 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fB6fUQ3BgiMlqzAqYVmLhgejALo=', 'Content-Length': '0'} 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bf489791708e15f4-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.655 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007654050432dc826b-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.656 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.657 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f6ce1e62d13568c-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.658 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo= 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo=', 'Content-Length': '0'} 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000df913867efdc85c-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37 2024-04-16T19:30:49.659 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo= 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bO7N9wIU92pujZzN2o/g9ZYbsgo=', 'Content-Length': '0'} 2024-04-16T19:30:49.660 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f3fdc45162f596c-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj37 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.661 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI= 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI=', 'Content-Length': '0'} 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:06 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db7ab101ba0ea232-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.662 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI= 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8NZHu3YzX4lnLwFALt10Fs6/MfI=', 'Content-Length': '0'} 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fdc1ff319fae30e1-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.663 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.664 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000598543cd1238e2ad-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj37 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.665 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2107a742770297d-00661ec808-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.666 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj371000falseobj372024-04-16T18:42:52.609Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj38 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.667 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fa521af35f8a37c9-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.668 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T19:30:49.669 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c2c7ea869acff6a9-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.670 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg= 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg=', 'Content-Length': '0'} 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007c9fe58958af7e52-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.671 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.672 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg= 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RpifGF376tokhTiihc59BImp7Hg=', 'Content-Length': '0'} 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000a1b0c26c30982a4-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj38 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.673 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002f5becf4bad4500c-00661ec808-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.674 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38?versionId=null 2024-04-16T19:30:49.675 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4= 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:M22ZJ+kbgW4HXThu5GoGMXwekT4=', 'Content-Length': '0'} 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ba4ee77a3b5172a-00661ec808-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.676 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:40 GMT 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk= 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:40 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:D3Hcq3pLwQWitVrcEoqFAhCczVk=', 'Content-Length': '0'} 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000003e094800ae8b2a0-00661ec808-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:40 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.677 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.678 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000df5da3267b91523b-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.679 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg= 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg=', 'Content-Length': '0'} 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e13262c0e11cc645-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.680 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.681 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg= 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:SUea0f9KG4s9MZH8E96oc7bpaLg=', 'Content-Length': '0'} 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000024f98ddf63bcc8ae-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj38 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.682 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44= 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44=', 'Content-Length': '0'} 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000019bbf93d20e0e053-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj38 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj38 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj38 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.683 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj38 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44= 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YA3pBH+n4p7cvBgdEi4aoBd8P44=', 'Content-Length': '0'} 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000098717e21245c0218-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.684 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.685 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dde3e6d4c3032ca9-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj38 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.686 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000446c8388ceae2bbc-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.687 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj381000falseobj382024-04-16T18:42:51.311Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.688 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000293a60f34a7d0cd3-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.689 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.690 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cfde078f340fc20a-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.691 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc= 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc=', 'Content-Length': '0'} 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000012b61e421a20d9eb-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.692 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.693 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc= 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:E2xWzcOTrFuohOLqIfPwInhCLVc=', 'Content-Length': '0'} 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fedeea4fbe5cd18-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.694 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dd0d50b2b6285ff9-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.695 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.696 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44?versionId=null 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw= 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:QbPGUfD0JqqwBPMcgQcO00QU9Mw=', 'Content-Length': '0'} 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000149780c37aaf99c8-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.697 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e3c3711ed967174-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.698 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.699 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f21b098851b5656e-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44 2024-04-16T19:30:49.700 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0= 2024-04-16T19:30:49.701 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0=', 'Content-Length': '0'} 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bc494762ecb919f0-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.702 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0= 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GRsEj34XpDy8KfDe4ivpzoAHTv0=', 'Content-Length': '0'} 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000666122fcccfd03be-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.703 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4= 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4=', 'Content-Length': '0'} 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003097294665d1b704-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.704 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj44 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj44 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj44 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.705 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj44 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4= 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wvtM+oWUEJUreCaUoLOrWAN5LH4=', 'Content-Length': '0'} 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006e156a0cc776c645-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.706 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e066443132788179-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.707 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj44 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.708 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c28362f4f5a1102e-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj441000falseobj442024-04-16T18:42:50.798Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj46 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.709 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.710 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001f16837101c53333-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.711 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000db33158c00ce4fcc-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.712 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.713 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw= 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw=', 'Content-Length': '0'} 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a23e2e6837bb55ab-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.714 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw= 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xom/SZVcQyVBFUKMcJx+Clbh8sw=', 'Content-Length': '0'} 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000032c6ffe3827819a4-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj46 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.715 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.716 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e798db64aa77983e-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.717 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46?versionId=null 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0= 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:2ucUnyWCLAFM1w5YwGS6rnY26M0=', 'Content-Length': '0'} 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eaf966fd8bcf40ef-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.718 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.719 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000001ae13e588803ac4d-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.720 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.721 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a19ad0d3ef9f4a96-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.722 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E= 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018724143886cc2bc-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.723 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E= 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:v/oKCl0fr8CDasWVa87o208xC7E=', 'Content-Length': '0'} 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004dacfc5e7926a516-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj46 2024-04-16T19:30:49.724 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.725 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE= 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE=', 'Content-Length': '0'} 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5d893f3c4541cc8-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj46 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj46 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj46 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.726 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj46 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE= 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:frYgcSKVI+FffsnSjaQOzef8sBE=', 'Content-Length': '0'} 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c33836823227a04f-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.727 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.728 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000009cee60535835827-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj46 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.729 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000caa84c7733ca5fc2-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj461000falseobj462024-04-16T18:42:51.626Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.730 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj51 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.731 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d04eea7098cabc2d-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.732 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.733 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000057cc04dc47779de4-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.734 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0= 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0=', 'Content-Length': '0'} 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000030ffbad206862c42-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.735 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.736 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0= 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sz0hYHjNsNfGdOvEnst6b3lAD+0=', 'Content-Length': '0'} 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d5d7e2a0c9635160-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj51 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.737 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee50b97532404167-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.738 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.739 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51?versionId=null 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0= 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HRCU8i+ILTkdr3lW9+yS3dh0Q+0=', 'Content-Length': '0'} 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000046dd5eeec392cbb9-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.740 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8f51ef6c5b6d7d7-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.741 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.742 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006b64638569f3cb7d-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.743 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE= 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE=', 'Content-Length': '0'} 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000091dba91d910ad8e-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.744 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.745 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE= 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ws0thpguyk1DrhE0+AHsYoKYSbE=', 'Content-Length': '0'} 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075a844dd9de30174-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj51 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.746 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.747 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ= 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005245c0a3f9bef664-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj51 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj51 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj51 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.748 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj51 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.749 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ= 2024-04-16T19:30:49.750 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jwFmrIb8fEuDh1pvUrNoQDG0yXQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.750 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000de24a053f4a4c8a1-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.750 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.750 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.750 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.750 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.750 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.751 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000098d65b8c5ed1c46d-00661ec809-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.752 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj51 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.753 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.754 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU= 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oKSSIiGZAUFCXIQ46zqJLL4WawU=', 'Content-Length': '0'} 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000856831ce619d23ed-00661ec809-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj511000falseobj512024-04-16T18:42:51.058Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.755 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.756 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a91909dcb1514fc-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.757 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T19:30:49.758 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bed2eee5193b4fc4-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.759 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk= 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk=', 'Content-Length': '0'} 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b0f1c9425fe3f769-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.760 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk= 2024-04-16T19:30:49.761 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Cfhasqn+EMjFwNh++7I19hCIFdk=', 'Content-Length': '0'} 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004958c01b1df6aaa2-00661ec809-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.762 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000245deb9412b37d61-00661ec809-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:41 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.763 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:41 GMT 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55?versionId=null 2024-04-16T19:30:49.764 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE= 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:41 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:BOHDmqbGQHZmhceDx3XJ2J34aTE=', 'Content-Length': '0'} 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000dc662d9ffee70cb-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.765 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000019aacbc351a44cfd-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.766 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.767 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000075077d47a9478d73-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.768 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI= 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI=', 'Content-Length': '0'} 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000009558f397b09322-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.769 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.770 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI= 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:AU9oJNwDclyJJboMH2eETzJ9wOI=', 'Content-Length': '0'} 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002aee45235641d618-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.771 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk= 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk=', 'Content-Length': '0'} 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000026f822e5bd96321b-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj55 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj55 2024-04-16T19:30:49.772 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj55 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj55 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.773 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk= 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:clUz1FLC1xAJVhy+g25VGlHkcKk=', 'Content-Length': '0'} 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:50 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e133859e76880d-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.774 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020a8751fa4a19e66-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.775 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.776 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj55 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.777 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006c6c1513a608c997-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj551000falseobj552024-04-16T18:42:50.810Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj57 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.778 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.779 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000008daca9604e99c17-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.780 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c53e21cacf43bed7-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.781 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.782 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A= 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A=', 'Content-Length': '0'} 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fbc8bd5d00f12848-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.783 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A= 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:oBUaKUFaTRWDl/gbGK5IoTyKb0A=', 'Content-Length': '0'} 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000822414ed1525a48a-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj57 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.784 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.785 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a2f6b3f75972d6c-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.786 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57?versionId=null 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ= 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WKqj4qEiin8eZCULSVYIb/o36dQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009a3facf42beb85f0-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.787 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.788 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000510176982a1d699f-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.789 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.790 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000652ddc86b71c4267-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.791 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw= 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw=', 'Content-Length': '0'} 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f41add25cef22b82-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.792 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw= 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:qDUCrVze7Pjc+/i1GLI3M/kg3Cw=', 'Content-Length': '0'} 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ee71e4fe351df223-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj57 2024-04-16T19:30:49.793 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.794 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8= 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8=', 'Content-Length': '0'} 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000048f47c43324385cb-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj57 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj57 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj57 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.795 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj57 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8= 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ctf0Oap39J4tTJi9NF7i8B6EAd8=', 'Content-Length': '0'} 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000059089a80238dcc91-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.796 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.797 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000090a5addb17ddb237-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj57 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.798 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000020889063495d0a48-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj571000falseobj572024-04-16T18:42:51.359Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj58 2024-04-16T19:30:49.799 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.800 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1258f34cd26fbc0-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.801 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000042b19bf82a2848b1-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.802 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.803 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM= 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM=', 'Content-Length': '0'} 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f7105974c8875c8-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.804 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM= 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:55w6yHf3S34doUFDEQgLbv65QOM=', 'Content-Length': '0'} 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb517906b67f12e3-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.805 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj58 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.806 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e3171b9c77ed773-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.807 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58?versionId=null 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310= 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:RxZj+sGBAKB8/OQ4VCLYir5n310=', 'Content-Length': '0'} 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000660b6752d52cc642-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.808 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.809 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000076672478817bf606-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.810 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.811 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bad25775a3ac225-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.812 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o= 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o=', 'Content-Length': '0'} 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000817b949aaac65484-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.813 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o= 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GL2LhwjmunQyaLBw6Llu4l3k39o=', 'Content-Length': '0'} 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005927da772a51af17-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj58 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.814 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.815 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk= 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk=', 'Content-Length': '0'} 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5d14e6f89a77899-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj58 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj58 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj58 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.816 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj58 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk= 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:9l+5LNA9BbKIWMmTBkUtdBGMDyk=', 'Content-Length': '0'} 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000000f69654f634f48f-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.817 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.818 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f74e8f5d30161956-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj58 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.819 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000048d4a85e5fa2581e-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj581000falseobj582024-04-16T18:42:51.943Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj62 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.820 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.821 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009c1ee23ceeb50850-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.822 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T19:30:49.823 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001fb0d0eca4060daa-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.824 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg= 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg=', 'Content-Length': '0'} 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b4eb39b12a8706ed-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.825 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.826 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg= 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n16Po/OEW7BgQzq8iSe3W1QkTIg=', 'Content-Length': '0'} 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a69512d5efbdabeb-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj62 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.827 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000384fa3c907d903f-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.828 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.829 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62?versionId=null 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw= 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:l9R3f9VW6d9FAg7FzwZYk1hezIw=', 'Content-Length': '0'} 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008aa9764acc86aace-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.830 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000081dc9f866f69ff7a-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.831 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.832 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b6647e3b25a77654-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.833 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00= 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00=', 'Content-Length': '0'} 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ed1cb3543a1397a1-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.834 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62 2024-04-16T19:30:49.835 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00= 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n31qkFnWITp565T/Nw9s+xAxx00=', 'Content-Length': '0'} 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007be3baea587bce9b-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj62 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.836 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM= 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM=', 'Content-Length': '0'} 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:43:10 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d55364f456c7b77b-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj62 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj62 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj62 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.837 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj62 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM= 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/Y/I1RNwdZ1AUUBzTGtu7pQPOkM=', 'Content-Length': '0'} 2024-04-16T19:30:49.838 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f84ce12f1d77f569-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.839 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009664f201a1071ebd-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.840 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj62 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.841 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002e2d5feb9133ef3c-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj621000falseobj622024-04-16T18:42:52.273Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj68 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.842 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cc8d249d5a96909-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.843 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.844 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d76db62569ef44cd-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.845 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic= 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic=', 'Content-Length': '0'} 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009f5babd7797161cb-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.846 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.847 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic= 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fOzuIqsZn0gMyckp/wHgXg/qWic=', 'Content-Length': '0'} 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb948959db3c2353-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj68 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.848 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007463fff8d0e6289b-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.849 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68?versionId=null 2024-04-16T19:30:49.850 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU= 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WduWWZRvLtJf+FdQqhMT+HXLZgU=', 'Content-Length': '0'} 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b80f664495cb6749-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.851 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007796c9a7bac90579-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.852 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.853 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000e8f7c9022380235-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.854 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE= 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE=', 'Content-Length': '0'} 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f657241bccae92e9-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.855 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.856 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE= 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Sqj6V0QlnfV9BuQc8myKR6uvhYE=', 'Content-Length': '0'} 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005605444c8f7a4271-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj68 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.857 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo= 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo=', 'Content-Length': '0'} 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003abc4c265566762c-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj68 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj68 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj68 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.858 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj68 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo= 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6CDL3g6DV0d7AB9MA9VzXtsGfTo=', 'Content-Length': '0'} 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000427436d3ada75e65-00661ec80a-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.859 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.860 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:42 GMT 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA= 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:42 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fmWGJNVGOCyCJG0sV0+r6t38ZJA=', 'Content-Length': '0'} 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000003b33387ad2b60493-00661ec80a-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:42 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj68 2024-04-16T19:30:49.861 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.862 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b316dd4bf7dca0db-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj681000falseobj682024-04-16T18:42:51.068Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj69 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.863 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c0a2c3dbf9494607-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.864 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.865 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ef76a41dee4a926f-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.866 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw= 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw=', 'Content-Length': '0'} 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001cac3f85ee4c4dcb-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.867 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.868 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw= 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZUdrfbiS3XM1/2Pn0387vKUnTiw=', 'Content-Length': '0'} 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064cce74e7d99b7d4-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj69 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.869 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec8b33e41bce70ac-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.870 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.871 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69?versionId=null 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU= 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:U1+r+knk0LN3hhxpEEZlEyGBBYU=', 'Content-Length': '0'} 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000df6b158b60fe127b-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.872 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000bdbde76d06547c52-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.873 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.874 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e8177d2b9bdb3146-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.875 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY= 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY=', 'Content-Length': '0'} 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049ee44f2cc295806-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.876 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY= 2024-04-16T19:30:49.877 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6SuHsIe0OpilgK7wIzBQbQ/ImnY=', 'Content-Length': '0'} 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005208de64c05f52f0-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj69 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.878 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE= 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE=', 'Content-Length': '0'} 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000064f4382ca758b228-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj69 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj69 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj69 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.879 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj69 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE= 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:hstbDllLvyWsRR97ZDoNAnMDwoE=', 'Content-Length': '0'} 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003c03b585bef6cb97-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.880 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.881 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002fdb2e1cfdf4dfc4-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj69 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.882 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000aee76e197c3fa077-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.883 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj691000falseobj692024-04-16T18:42:51.636Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj74 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.884 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ae0795202f85482-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.885 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.886 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001dfd7892dff873e7-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.887 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg= 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg=', 'Content-Length': '0'} 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009389771ffdb43220-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.888 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg= 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:kPqB2piO12wESZYS0qKRaTC0zRg=', 'Content-Length': '0'} 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001bf900c98161b516-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.889 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj74 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.890 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000066de308def1464ce-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.891 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74?versionId=null 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ= 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3NC1UhmAEwF45qMp7Wz2RMSp0gQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.892 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ce27acce64e90324-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.893 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009b7566a10376788a-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.894 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.895 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1b80cbf0dbc2fb1-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.896 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U= 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U=', 'Content-Length': '0'} 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092131a087fda4155-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.897 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.898 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U= 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:B2k6MVuxhWy0XuJgu/s8YrG5o+U=', 'Content-Length': '0'} 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cc183e836702be59-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj74 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.899 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8= 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8=', 'Content-Length': '0'} 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:44:20 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006952ac0e3ff29a52-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.900 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8= 2024-04-16T19:30:49.901 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:sX/NiFk6q07+nthJz/T21EZ3Wa8=', 'Content-Length': '0'} 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000fe4f2acc05cbd50-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.902 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008f764c64014b9f9a-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.903 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj74 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.904 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002822a0fb5263a604-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj741000falseobj742024-04-16T18:42:52.620Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj76 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.905 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009202c69920701489-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.906 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.907 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc730b7d98263f09-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.908 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ= 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fd605f490ea1fdc8-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.909 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.910 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ= 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A5mF6+lTcMyE02TlrDOvYmWKspQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003154c17b21829473-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj76 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.911 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T19:30:49.912 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006b53ce9ee8f6cd4b-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.913 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76?versionId=null 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY= 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WHsXocrKIWy2M6AZvpzG518qGGY=', 'Content-Length': '0'} 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000abf52e49ab91bb51-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.914 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.915 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cde1769862dfb540-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.916 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005e158e8b3a2dfded-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76 2024-04-16T19:30:49.917 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc= 2024-04-16T19:30:49.918 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc=', 'Content-Length': '0'} 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ac0a0198d9c136e-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.919 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc= 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wa0B9/Ia1xEi9SKIhEnFalkuUzc=', 'Content-Length': '0'} 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b8adca3150b6916e-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj76 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.920 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU= 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU=', 'Content-Length': '0'} 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000694a4040ee598a08-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.921 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj76 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj76 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj76 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.922 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj76 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU= 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HwEFSjXEF3/mOTtJuUJtUb0HLZU=', 'Content-Length': '0'} 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000cb95e5a08dd8e335-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.923 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008823745d7ecdd2b6-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.924 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj76 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.925 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004f7417dfdfc7ded8-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj761000falseobj762024-04-16T18:42:51.367Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj85 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.926 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T19:30:49.927 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009490afb9fbc15db2-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.928 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000dc668c93af97d158-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.929 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY= 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY=', 'Content-Length': '0'} 2024-04-16T19:30:49.930 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000d5d465f17f943d1-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.931 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY= 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NKCAHM3VRBUxCQm16zpN5TgZJeY=', 'Content-Length': '0'} 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007897a81376da5413-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj85 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.932 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T19:30:49.933 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ec14f12275761fc4-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.934 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85?versionId=null 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc= 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vDRhmYVN9ADB/EA0VRxM99EN1Jc=', 'Content-Length': '0'} 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000043c48b04a9f4c8e8-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.935 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.936 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e016b2b56405ff4f-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.937 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY= 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Q6ba4JljmY0+qqb0Aup6nPbIQgY=', 'Content-Length': '0'} 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000611d60301ab809bb-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85 2024-04-16T19:30:49.938 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0= 2024-04-16T19:30:49.939 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0=', 'Content-Length': '0'} 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8290527d98211b7-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.940 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0= 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zZBAoMsC/Wv2FnIeGRigkmXJzx0=', 'Content-Length': '0'} 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003734f2e08d97d251-00661ec80b-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj85 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.941 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:43 GMT 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:T5yLgmWaNjRz0pI+o+taE5SLXU0= 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:43 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:T5yLgmWaNjRz0pI+o+taE5SLXU0=', 'Content-Length': '0'} 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c474ad52fe6eecfe-00661ec80b-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:43 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj85 2024-04-16T19:30:49.942 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj85 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj85 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj85 2024-04-16T19:30:49.943 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/dJwG0I+DUIlqNECdhOVx10iEn4= 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/dJwG0I+DUIlqNECdhOVx10iEn4=', 'Content-Length': '0'} 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b52f66ce2151e895-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.944 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b1c2948474417f53-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.945 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj85 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.946 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000714a9535e9eb800f-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj851000falseobj852024-04-16T18:42:51.114Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj87 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.947 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000075068b372d2364d3-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.948 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.949 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d0a41ede4b402e51-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.950 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ= 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c8fff536147ae245-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.951 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.952 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ= 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6XUb9KE2ul5tqo52rRKhFQkNeLQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003ac91ce9e7eed93c-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj87 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.953 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T19:30:49.954 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000820e2ac0d7fb2e16-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.955 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87?versionId=null 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk= 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iO/FoWZUxhVaiitiGS9K7yBq2yk=', 'Content-Length': '0'} 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a401e5f6e13c522b-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.956 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.957 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006a2fbfae20e52775-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.958 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000097ba378ea644a383-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.959 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E= 2024-04-16T19:30:49.960 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E=', 'Content-Length': '0'} 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb70d526cbb41443-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.961 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E= 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jLCXqq3EUSGngo/Jwxk2t7DXa6E=', 'Content-Length': '0'} 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000062f6c099dfe3e69f-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj87 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.962 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM= 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM=', 'Content-Length': '0'} 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e6315813ca592e63-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj87 2024-04-16T19:30:49.963 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj87 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj87 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj87 2024-04-16T19:30:49.964 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM= 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:JnkhnT7H83WMI8uEY9If4A0VbAM=', 'Content-Length': '0'} 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e349b9186d0a8435-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.965 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c19abc9e2542b6bf-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.966 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj87 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.967 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f45c3189d003bcad-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj871000falseobj872024-04-16T18:42:51.954Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj92 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.968 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T19:30:49.969 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005731ec984081cd9e-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.970 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000087c7e5558a256208-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.971 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU= 2024-04-16T19:30:49.972 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU=', 'Content-Length': '0'} 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000435f0c169caa4db4-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.973 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU= 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:TEU15Hzuh0TuOt4qO65j9ymS+BU=', 'Content-Length': '0'} 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c9f0cdce18ef472c-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj92 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.974 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T19:30:49.975 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e5d533bd091e6984-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.976 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92?versionId=null 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA= 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b5B0TOqtxw6W4CjJkpaafcrCwXA=', 'Content-Length': '0'} 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001c6538f40167b14e-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.977 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.978 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d6c0baf83366a21a-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.979 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008cb7409a730b1ea-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.980 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA= 2024-04-16T19:30:49.981 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA=', 'Content-Length': '0'} 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d417a398678fbd9f-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.982 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA= 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZRQUP3V03TDkDWIKkcFk6KKkjPA=', 'Content-Length': '0'} 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000049afdf8ecc3ddcde-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj92 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.983 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE= 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE=', 'Content-Length': '0'} 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000251b016b8b8914ee-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.984 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj92 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj92 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj92 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.985 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj92 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE= 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k8Rj7JDElRuOxibOSmxFXXd4RtE=', 'Content-Length': '0'} 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b85a581985354e28-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.986 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000eb8cc5141f8df787-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.987 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj92 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.988 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000009e2ef1f83f668921-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj921000falseobj922024-04-16T18:42:51.682Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj93 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.989 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T19:30:49.990 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000018e7978a357e08bb-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.991 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007e498f36258e1309-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.992 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0= 2024-04-16T19:30:49.993 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0=', 'Content-Length': '0'} 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000804ffc89855bab67-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.994 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0= 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NqTbcdpw1VIhmG4SXZCKUJrtAb0=', 'Content-Length': '0'} 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000092d82fec13060062-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj93 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.995 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.996 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000005ba7fba074534281-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.997 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93?versionId=null 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ= 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Xjt6lNC/tmqjHw7QKyd8CuqWzRQ=', 'Content-Length': '0'} 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000010e647403906ab7b-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:49.998 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj93 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:49.999 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000004aa4002f7f8504d-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.000 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000023426b5fae258f91-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:50.001 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93 2024-04-16T19:30:50.002 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA= 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA=', 'Content-Length': '0'} 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000004d1b92ade608c5fc-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.003 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA= 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:mtsWvCy97rDW5apZyRPcfIhdNOA=', 'Content-Length': '0'} 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000094eebb4a36dba758-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj93 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.004 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM= 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM=', 'Content-Length': '0'} 2024-04-16T19:30:50.005 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:56 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009405d66546684d37-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj93 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj93 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj93 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.006 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj93 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM= 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:WVF48DBOQHBLWcijvj+xVUoUViM=', 'Content-Length': '0'} 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000025ac429589de69a7-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.007 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000002f0fa6dc1ce98329-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.008 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj93 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.009 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000916bb368a5f2b669-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj931000falseobj932024-04-16T18:42:52.283Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj95 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.010 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T19:30:50.011 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000aab34ee619373cc4-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.012 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009e199995cd009512-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.013 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI= 2024-04-16T19:30:50.014 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI=', 'Content-Length': '0'} 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000037ce6d30c38c5fb4-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.015 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI= 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:PW/jmERhPV9f/Y35sYWUKAKJNqI=', 'Content-Length': '0'} 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000803b259f555b8c08-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj95 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.016 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.017 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000ca2f316497ee146d-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.018 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95?versionId=null 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk= 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:da5ss9iQHvt78xk7k9snTuAHDZk=', 'Content-Length': '0'} 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002a0f9fb8274001a0-00661ec80c-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.019 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.020 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:44 GMT 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M= 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:44 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:vIGkymkJipDdRAmKcemmESJ0k+M=', 'Content-Length': '0'} 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000005a4cf67f7c63e293-00661ec80c-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:44 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.021 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:45 GMT 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo= 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo=', 'Content-Length': '0'} 2024-04-16T19:30:50.022 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e908b7e152a10b34-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.023 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:45 GMT 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs= 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs=', 'Content-Length': '0'} 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000ae19cf2188780c3-00661ec80d-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.024 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:45 GMT 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs= 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DuZH07b1VzpZsUFCYS+qwaS9FSs=', 'Content-Length': '0'} 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000003cd7077d1efe247b-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.025 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj95 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.026 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:45 GMT 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU= 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU=', 'Content-Length': '0'} 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-56:9ba59572-f51c-4bce-9578-e6350e822996.4816.25'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:42:52 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e0628b5dc9d0d9d2-00661ec80d-6331-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj95 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj95 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj95 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.027 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:45 GMT 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj95 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU= 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cDPtiAl4ixw6gO13yKo1dL5FyRU=', 'Content-Length': '0'} 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:42:51 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000f007e9016e896a9-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.028 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.029 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:45 GMT 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo= 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo=', 'Content-Length': '0'} 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000047e600837ac0c0db-00661ec80d-6331-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.030 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/?prefix=obj95 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:45 GMT 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo= 2024-04-16T19:30:50.031 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:45 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:wjQr6tqd76ojxZB4yJ1Pe48OlZo=', 'Content-Length': '0'} 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c5961240e8bba34d-00661ec80d-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:45 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-56obj951000falseobj952024-04-16T18:42:51.377Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: success, bucket identical: bucket=cjqttm-56 zones={test-zone2, test-zone1} 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: DEBUG: waiting for process to exit 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: INFO: waiting for 300 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T18:48:45.131+0000 7f5d6d673640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 212645) UID: 0 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T18:48:45.131+0000 7f5d70ecc880 -1 shutting down 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Stopped 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:50.032 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T19:30:50.033 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000005b05e08051960a9b-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj37 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj37 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj37 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.034 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj37 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:aLi91ushZoLRLcq6kQqvSp5DLgU= 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:aLi91ushZoLRLcq6kQqvSp5DLgU='} 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000fa91b293fc832def-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.035 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a1fb2623571fa274-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj74 2024-04-16T19:30:50.036 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj74 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj74 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.037 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj74 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NQvgbw9K6d+sZ02vqLzprbanB7U= 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NQvgbw9K6d+sZ02vqLzprbanB7U='} 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a1920b4ef003231b-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.038 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fbc1be1a6a4c5788-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj111 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj111 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj111 2024-04-16T19:30:50.039 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj111 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Ev/kCDlUiK5jewA47OHSK9nPQOk= 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Ev/kCDlUiK5jewA47OHSK9nPQOk='} 2024-04-16T19:30:50.040 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005b844003a0fdf1a0-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.041 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000009b3e130323aeb44b-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj148 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj148 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj148 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.042 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj148 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:b15WWJnR2oDtt5SccbAgOPF7QwI= 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:b15WWJnR2oDtt5SccbAgOPF7QwI='} 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b2051def13ceb7e0-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/ 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/ 2024-04-16T19:30:50.043 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/ 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:/cjqttm-56/ 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.044 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y= 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e5SVtJwt2AFsE2SFWzhhiCIMG1Y=', 'Content-Length': '0'} 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '35'), ('X-RGW-Bytes-Used', '105'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000021fbb97da2b041e-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-56/obj185 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-56/obj185 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-56/obj185 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.045 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:48:51 GMT 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:/cjqttm-56/obj185 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iB3raoSiccNcBE0CWKmhPVyNXHY= 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:48:51 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iB3raoSiccNcBE0CWKmhPVyNXHY='} 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a18ef720dbcbc3cc-00661ec813-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:48:51 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:48:51.500+0000 7f17a9b2d800 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-16T19:30:50.046 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:48:51.502+0000 7f17a9b2d800 5 RGW-SYNC:data: acquired data sync status lease 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Restarting daemon 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Started 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: Dload Upload Total Spent Left Speed 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 7 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T18:48:51.742+0000 7f69a962d880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: Dload Upload Total Spent Left Speed 2024-04-16T19:30:50.047 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: anonymous 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-56 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-56', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-56 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:48:52.738+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 has been restored 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:48:57.741+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.048 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:02.743+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:07.745+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:12.748+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:17.750+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:22.754+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.049 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:27.756+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:32.759+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:37.760+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:42.763+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.050 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:47.765+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:52.767+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:49:57.769+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:02.771+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:07.774+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.051 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:12.777+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:17.779+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:22.780+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000002.127.6, , , , , , 00000000002.131.6, , , , , 00000000002.119.6, , , , , , , , , , , , , , , 00000000001.112.6, , , , 00000000001.131.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:27.782+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:32.785+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.052 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:37.787+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:42.789+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:47.791+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:52.795+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:50:57.797+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.053 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:02.799+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:07.800+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:12.802+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:17.805+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.054 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:22.807+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:27.809+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:32.811+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:37.814+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:42.817+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.055 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:47.820+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:52.820+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:51:57.822+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:02.824+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:07.826+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.056 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:12.829+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:17.831+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:22.833+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:27.837+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:32.839+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.057 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:37.842+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:42.843+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:47.845+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:52.848+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.058 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:52:57.850+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:02.852+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:07.855+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:12.858+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:17.860+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.059 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:22.862+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:27.863+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:32.866+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:37.868+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:42.870+0000 7f2372a9d800 1 waiting for incremental sync to catch up: 2024-04-16T19:30:50.060 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , 00000000003.129.6, , , , , , 00000000002.131.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.061 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , 00000000003.129.6, , , , , , 00000000003.133.6, , , , , 00000000003.121.6, , , , , , , , , , , , , , , 00000000002.114.6, , , , 00000000002.133.6] 2024-04-16T19:30:50.061 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:47.873+0000 7f2372a9d800 0 bucket checkpoint timed out waiting for incremental sync to catch up 2024-04-16T19:30:50.061 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:47.873+0000 7f2372a9d800 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T19:30:50.061 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:47.873+0000 7f2372a9d800 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T19:30:50.061 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 110 2024-04-16T19:30:50.061 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.061 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.062 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:50.062 INFO:tasks.rgw_multisite_tests:FAIL: rgw_multi.tests.test_resharded_bucket_incremental_sync_oldest_after_data_sync_init 2024-04-16T19:30:50.062 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.062 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:50.062 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:50.062 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 2332, in test_resharded_bucket_incremental_sync_oldest_after_data_sync_init 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 398, in zonegroup_bucket_checkpoint 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 390, in zone_bucket_checkpoint 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: target_zone.cluster.admin(cmd, debug_rgw=1) 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw_multisite.py", line 197, in admin 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests: assert r == 0 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.063 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:48 GMT 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.064 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:3FuDWQ1dGXDiJdRGoQzWhpIRvKM= 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:48 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:3FuDWQ1dGXDiJdRGoQzWhpIRvKM=', 'Content-Length': '0'} 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('x-amz-request-id', 'tx00000b3a0259a5f8bb399-00661ec93c-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:48 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: created bucket=cjqttm-57 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293628.089303_1644.1","last_update":"2024-04-16T18:53:48.089303Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.065 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:48.338+0000 7fefd9436800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:48.339+0000 7fefd9436800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.079653_1641.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.079653Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:48Z"} 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.079653_1641.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.079653Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:48Z"} 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.079653_1641.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.079653Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.079653_1641.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293628.089303_1644.1 target=1_1713293628.079653_1641.1 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.066 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:53.480+0000 7f8bed067800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:53.482+0000 7f8bed067800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:53Z"} 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:53:53Z"} 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: finish meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.067 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.068 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '0'), ('X-RGW-Bytes-Used', '0'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000085b899e99e214eb3-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.069 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:FQZGjG9WXQLIuSBQTP6gn7+XIaE= 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:FQZGjG9WXQLIuSBQTP6gn7+XIaE='} 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ac5955d488c14ae6-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.070 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '1'), ('X-RGW-Bytes-Used', '3'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000528935e0923ccfa6-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.071 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.072 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ahMnzIOTpVT+zfiKLrGPsXARnlA= 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ahMnzIOTpVT+zfiKLrGPsXARnlA='} 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f590d9301b28412-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.073 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '2'), ('X-RGW-Bytes-Used', '6'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000d257001dd238caea-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.074 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.075 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s8WMaGyAUrr3+8inA+wuFgvgdCU= 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s8WMaGyAUrr3+8inA+wuFgvgdCU='} 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000000cb1ca02a60417-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.076 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '3'), ('X-RGW-Bytes-Used', '9'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008ac4235bfacca679-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.077 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:GQJucKnJC6/T9remf/mX7jp1CIw= 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:GQJucKnJC6/T9remf/mX7jp1CIw='} 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000ea83380cefa36f9-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.078 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.079 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk= 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:4UXQg2iD/jNjDJEyEVjkgJIMxNk=', 'Content-Length': '0'} 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '4'), ('X-RGW-Bytes-Used', '12'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e583d6a4cef5f69b-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.080 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:53 GMT 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:XP0wSaSuSH3Y3YiGFQPPUJB+1dw= 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:53:53 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:XP0wSaSuSH3Y3YiGFQPPUJB+1dw='} 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003caf2398a9d856c5-00661ec941-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-57 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-57 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.081 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:53.729+0000 7fd3c9533800 1 waiting to reach incremental sync.. 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:58.732+0000 7fd3c9533800 1 bucket sync caught up with source: 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: local status: [, , , , , , , , 00000000001.124.6, 00000000002.132.6, 00000000002.140.6] 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: remote markers: [, , , , , , , , 00000000001.124.6, 00000000002.132.6, 00000000002.140.6] 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:53:58.732+0000 7fd3c9533800 0 bucket checkpoint complete 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone2 target=test-zone1 bucket=cjqttm-57 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone2', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync checkpoint --bucket cjqttm-57 --source-zone test-zone2 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 1 --debug-ms 0 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:53:58.889+0000 7f5118c9d800 1 bucket sync caught up with source: 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: local status: [, , , , , , , , 00000000001.632.6, 00000000002.557.6, 00000000002.1477.6] 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: remote markers: [, , , , , , , , 00000000001.632.6, 00000000002.557.6, 00000000002.1477.6] 2024-04-16T19:30:50.082 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: 2024-04-16T18:53:58.889+0000 7f5118c9d800 0 bucket checkpoint complete 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: comparing bucket=cjqttm-57 zones={test-zone2, test-zone1} 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: establishing HTTP connection: kwargs={'timeout': 70, 'port': 8000} 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.083 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4= 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4=', 'Content-Length': '0'} 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d8b50263449f31e-00661ec946-6424-test-zone2'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.084 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4= 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:UlF8Wp/puJNB/LuLbQQmNN4JuC4=', 'Content-Length': '0'} 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000024abe21c8e649aa6-00661ec946-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket1 objects: 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.085 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.086 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:/cjqttm-57/?versions 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094c94f2e05b7d174-00661ec946-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj11 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj22 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj33 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj44 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj55 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: bucket2 objects: 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.087 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.088 INFO:tasks.rgw_multisite_tests:/cjqttm-57/?versions 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000008c4ce5f667e9f835-00661ec946-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj11 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj22 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj33 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj44 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: o=obj55 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.089 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:/cjqttm-57/?versions 2024-04-16T19:30:50.090 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000277078ad74445667-00661ec946-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?versions&max-keys=999 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.091 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:/cjqttm-57/?versions 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8= 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/L3cmYzbiSIoWPjKqWiKR28i9C8=', 'Content-Length': '0'} 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d2b58e3850456e74-00661ec946-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.092 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57999falseobj11nulltrue2024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj22nulltrue2024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj33nulltrue2024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj44nulltrue2024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normalobj55nulltrue2024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.093 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw= 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw=', 'Content-Length': '0'} 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006a0d2e13e66542ce-00661ec946-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.094 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:58 GMT 2024-04-16T19:30:50.095 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw= 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:58 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:lt2nK4MNJKV97oZ3cS6WrrFYQNw=', 'Content-Length': '0'} 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002ae1ab12dfc6dbc6-00661ec946-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:58 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.096 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98= 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98=', 'Content-Length': '0'} 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008c2c983a56cc4bbc-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.097 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.098 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98= 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:6UwGfgYaWGQolo49oSP0xB5XW98=', 'Content-Length': '0'} 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000169adc08c75c8e70-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.099 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ= 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ=', 'Content-Length': '0'} 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000140f09f97e76f8a-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.100 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.101 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11?versionId=null 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ= 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1unFoDPM4qpSevHKF7Plmw40HYQ=', 'Content-Length': '0'} 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000a2bb2ede5319da47-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.102 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.103 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000088a656959e65df6c-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.104 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d1042a7d0cf5a604-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.105 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c= 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c=', 'Content-Length': '0'} 2024-04-16T19:30:50.106 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b393532acc27d0d1-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.107 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c= 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zU8C35yqQfOyQ1t/nHVnbQQev8c=', 'Content-Length': '0'} 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000011d665f85e27f747-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj11 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.108 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o= 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o=', 'Content-Length': '0'} 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000001554b08100cd5fd1-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj11 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj11 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.109 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj11 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj11 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.110 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o= 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5S+iB6qhxJFRlFwx0UKtenGF60o=', 'Content-Length': '0'} 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eb836ffd5650db7d-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.111 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000080305634ca1817b4-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.112 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj11 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.113 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c10dd81de39ae789-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj111000falseobj112024-04-16T18:53:53.519Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.114 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000060fbc6f75f99941e-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.115 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.116 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000fcdcf2aba80fff3a-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.117 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU= 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU=', 'Content-Length': '0'} 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000002e6566834cc59f66-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.118 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.119 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU= 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HdTjxLQdbgESwFBHmHGMKe37voU=', 'Content-Length': '0'} 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000d699efafce29c57d-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.120 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f62c99e37ba7b4e8-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.121 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.122 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22?versionId=null 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE= 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rONexIJbznIcyEO9/ICclI3kFXE=', 'Content-Length': '0'} 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b388b56d5a5e3f7f-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.123 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.124 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000cb1359d29a920f23-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.125 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000004ed9b2ee317eda45-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22 2024-04-16T19:30:50.126 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA= 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA=', 'Content-Length': '0'} 2024-04-16T19:30:50.127 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c578a22fcfe08b45-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.128 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA= 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Dnfc4BuNRA1M4BGQ1SyLifIhMfA=', 'Content-Length': '0'} 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000071049c150735993d-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj22 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.129 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c= 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c=', 'Content-Length': '0'} 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e9723721ed3e176b-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj22 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj22 2024-04-16T19:30:50.130 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj22 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj22 2024-04-16T19:30:50.131 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c= 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:X4WVBC8zffqwT7gZla4VklSFT2c=', 'Content-Length': '0'} 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000c84f1389ddde6032-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.132 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c0b478460db9ec63-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.133 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj22 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.134 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000b33330fbfedfe1d8-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj221000falseobj222024-04-16T18:53:53.534Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.135 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000093582018afe83342-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.136 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.137 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000000337ab826adb5e86-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.138 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0= 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0=', 'Content-Length': '0'} 2024-04-16T19:30:50.139 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000029df7e10f81dd229-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.140 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0= 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:I8B/WuP3Ya2pW8vB11QR+WNflx0=', 'Content-Length': '0'} 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b495d440deef6436-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.141 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T19:30:50.142 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f78bb7440d2e95b5-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.143 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33?versionId=null 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs= 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:bbmTsIFqkRk8oiWGOI//I5W+AUs=', 'Content-Length': '0'} 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e651b2ce6220d7ed-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.144 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.145 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d89702a262035920-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.146 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000dfd7687b6ebedc4a-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.147 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU= 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU=', 'Content-Length': '0'} 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000966a4f3d6149c61b-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.148 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.149 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU= 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:LGFoPm6ettVdpi7DrcTK/d4TZJU=', 'Content-Length': '0'} 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000bb0bcea31c2a32d0-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj33 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.150 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0= 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0=', 'Content-Length': '0'} 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000eae179354636eb61-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj33 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj33 2024-04-16T19:30:50.151 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj33 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj33 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.152 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0= 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/MQHdJf751lS7cWOKClHKb3y1A0=', 'Content-Length': '0'} 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000072dc29b05cfb1c94-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.153 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000007bf79455867a689d-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.154 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj33 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.155 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000000fa7b4b957f57bd4-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj331000falseobj332024-04-16T18:53:53.547Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.156 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008458e2963da694a7-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.157 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.158 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000082299aacea2f4c6a-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.159 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs= 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs=', 'Content-Length': '0'} 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b564477d3f94aa07-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.160 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.161 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs= 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:04cCq2G63wE+qVFd7+QvUJmpvSs=', 'Content-Length': '0'} 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000007fe3a2aff40ee24c-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.162 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T19:30:50.163 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000301b5133e273c9ac-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.164 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44?versionId=null 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA= 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iMh62FWtbPV07gvr7y8UyqBd/cA=', 'Content-Length': '0'} 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008e16dd7e45f5ddb5-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.165 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx000006e7422bc5b5a3987-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.166 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.167 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000f101ba638ce4949b-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44 2024-04-16T19:30:50.168 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw= 2024-04-16T19:30:50.169 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw=', 'Content-Length': '0'} 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000308d5a015deb7e08-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.170 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw= 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:A395WNFwL2dCWPT0VXrq6BUhJiw=', 'Content-Length': '0'} 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000985a28bf2cec2dac-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj44 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.171 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg= 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg=', 'Content-Length': '0'} 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000092b8f967111d00f-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj44 2024-04-16T19:30:50.172 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj44 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj44 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj44 2024-04-16T19:30:50.173 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg= 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cN5u8uTkxxikq1v25PFyMdgTgFg=', 'Content-Length': '0'} 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx0000033925c134d6d5055-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.174 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.175 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000008ee93d02a9a74ef-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.177 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj44 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.178 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000c1a333a5fc9e3718-00661ec947-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj441000falseobj442024-04-16T18:53:53.560Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.179 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T19:30:50.180 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000e1f21a4bb373f638-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.181 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000adab0f5fbc530f6e-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.182 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE= 2024-04-16T19:30:50.183 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE=', 'Content-Length': '0'} 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000008f122502243116df-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.184 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE= 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:403nLOw62TjVvtFFZZNkt3ZJqFE=', 'Content-Length': '0'} 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009beeeda9d6b11ca1-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.185 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.186 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f7c7a7c6ca9524d1-00661ec947-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.187 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55?versionId=null 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI= 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:HjKwc2/1qNj8gDHluQRFNxXMTnI=', 'Content-Length': '0'} 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-amz-version-id', 'null'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000b9a8417ac427aa2e-00661ec947-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.188 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.189 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000e73c4a5db17f16d9-00661ec947-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:53:59 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.190 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:53:59 GMT 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI= 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:53:59 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:n5GciaZVQiXQE37kJM4+E50g/bI=', 'Content-Length': '0'} 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000d0f9f486d0652ade-00661ec948-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55 2024-04-16T19:30:50.191 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:00 GMT 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA= 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA=', 'Content-Length': '0'} 2024-04-16T19:30:50.192 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000006232d0246334435f-00661ec948-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.193 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:00 GMT 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA= 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:k1BDcBkV4mlwjzbAtZjXEpHzToA=', 'Content-Length': '0'} 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f20dcf4a091493cf-00661ec948-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: DEBUG: comparing key name=obj55 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.194 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:00 GMT 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98= 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98=', 'Content-Length': '0'} 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('x-amz-replication-status', 'REPLICA'), ('x-rgw-replicated-from', '9ba59572-f51c-4bce-9578-e6350e822996:cjqttm-57:9ba59572-f51c-4bce-9578-e6350e822996.4816.26'), ('x-rgw-replicated-at', 'Tue, 16 Apr 2024 18:53:55 GMT'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx000009ca7b8709bdf8fe5-00661ec948-6424-test-zone2'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj55 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj55 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.195 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj55 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:00 GMT 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj55 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98= 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ogFx0YgX/k99dNjA/a6rDXtcp98=', 'Content-Length': '0'} 2024-04-16T19:30:50.196 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '3'), ('Accept-Ranges', 'bytes'), ('Last-Modified', 'Tue, 16 Apr 2024 18:53:53 GMT'), ('x-rgw-object-type', 'Normal'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('x-amz-request-id', 'tx00000f503371cf82592d6-00661ec948-4816-test-zone1'), ('Content-Type', 'application/octet-stream'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.197 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:00 GMT 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw= 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw=', 'Content-Length': '0'} 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx00000a523d62212f20268-00661ec948-6424-test-zone2'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: GET 2024-04-16T19:30:50.198 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/?prefix=obj55 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:GET 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:00 GMT 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw= 2024-04-16T19:30:50.199 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:00 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:rZEanIH+chZiNJ84pU4YZ83yhHw=', 'Content-Length': '0'} 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Transfer-Encoding', 'chunked'), ('x-amz-request-id', 'tx0000094412f44360a1aea-00661ec948-4816-test-zone1'), ('Content-Type', 'application/xml'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:00 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:boto: DEBUG: b'cjqttm-57obj551000falseobj552024-04-16T18:53:53.613Z"acbd18db4cc2f85cedef654fccc4a4d8"3STANDARDRGW11111111111111111Normal' 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.zone_rados: INFO: success, bucket identical: bucket=cjqttm-57 zones={test-zone2, test-zone1} 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: DEBUG: waiting for process to exit 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: INFO: waiting for 300 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T18:54:00.069+0000 7f69a3642640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 220675) UID: 0 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T18:54:00.069+0000 7f69a962d880 -1 shutting down 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Stopped 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '17', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 17 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.200 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-57 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 5 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.201 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '5'), ('X-RGW-Bytes-Used', '15'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b7c6ed3feb0dfe6-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj17 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj17 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj17 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.202 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj17 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:jnXPQsU9vazsLjFgyYwMb3RH9G8= 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jnXPQsU9vazsLjFgyYwMb3RH9G8='} 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b3d348ff99709dff-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.203 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.204 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '6'), ('X-RGW-Bytes-Used', '18'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b0b4be6d11b394f3-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj34 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj34 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj34 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.205 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj34 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:nDNvp65ocjIcmisYE1ko9B6S3j8= 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nDNvp65ocjIcmisYE1ko9B6S3j8='} 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000606a85d761496049-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.206 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '7'), ('X-RGW-Bytes-Used', '21'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000cf4c7cd10ffe6c89-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.207 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj51 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj51 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj51 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.208 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj51 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Yy2ENnajmNRATZNLtWecvg7JJSM= 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Yy2ENnajmNRATZNLtWecvg7JJSM='} 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000041825c0a24c902ae-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.209 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '8'), ('X-RGW-Bytes-Used', '24'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000534f78da3fd21ab6-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj68 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj68 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj68 2024-04-16T19:30:50.210 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj68 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:fXfrThp+3fA3+BkzZjocn8agGqk= 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:fXfrThp+3fA3+BkzZjocn8agGqk='} 2024-04-16T19:30:50.211 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000c6e985dbff03a21d-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.212 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '9'), ('X-RGW-Bytes-Used', '27'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000a4453086e3d79010-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj85 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj85 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj85 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.213 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj85 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/gSaPm1HQu0bACSnZOVmBUzNdY4= 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/gSaPm1HQu0bACSnZOVmBUzNdY4='} 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000032ae7c176ff09c93-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '19', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.214 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 19 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-57 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 10 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.215 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '10'), ('X-RGW-Bytes-Used', '30'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000087b1f4d549bc1b4c-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj19 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj19 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj19 2024-04-16T19:30:50.216 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj19 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:L8y/vh2lZj68Popl+EuEmvWn7C0= 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L8y/vh2lZj68Popl+EuEmvWn7C0='} 2024-04-16T19:30:50.217 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000008f6e50a6e92b23f0-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.218 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '11'), ('X-RGW-Bytes-Used', '33'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fdb92120137b0b49-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj38 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj38 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj38 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.219 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj38 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ItUrI+664oHdtMeqsLAyFfu+2Jw= 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ItUrI+664oHdtMeqsLAyFfu+2Jw='} 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000bd015ffed6880bc5-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.220 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.221 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '12'), ('X-RGW-Bytes-Used', '36'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e8d0e5dab205019a-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj57 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj57 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj57 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.222 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj57 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ADuHdlkuyG3hSRWGYBOdb9o1D3U= 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ADuHdlkuyG3hSRWGYBOdb9o1D3U='} 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 has been restored 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000445584fd83c77677-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.223 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '13'), ('X-RGW-Bytes-Used', '39'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000022250a9bd32349c4-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.224 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj76 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj76 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj76 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj76 2024-04-16T19:30:50.225 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:uGTq8hvnxCIL+dGg+W4ycilMIoo= 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uGTq8hvnxCIL+dGg+W4ycilMIoo='} 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005bf2c86e50bfe05a-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.226 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0= 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:8J9m1RE7UFETKi+Y4PSoZYN71M0=', 'Content-Length': '0'} 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '14'), ('X-RGW-Bytes-Used', '42'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000000d94481e4dc4c3e5-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj95 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj95 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj95 2024-04-16T19:30:50.227 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:06 GMT 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj95 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:L+pat7p93EbqmODSIKyDwwqx5bA= 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:06 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:L+pat7p93EbqmODSIKyDwwqx5bA='} 2024-04-16T19:30:50.228 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000004bded76d76a8a292-00661ec94e-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:06 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '23', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 23 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-57 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 15 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.229 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '15'), ('X-RGW-Bytes-Used', '45'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000020dc9969e245f9ff-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj23 2024-04-16T19:30:50.230 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj23 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj23 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj23 2024-04-16T19:30:50.231 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:1XHlv6f5vPO3pK8Os5h804HD3Tk= 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:1XHlv6f5vPO3pK8Os5h804HD3Tk='} 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000016c52ae579f22fd8-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.232 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '16'), ('X-RGW-Bytes-Used', '48'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000843b9679b73bfecc-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj46 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj46 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj46 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.233 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj46 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:uXlFOd0NqIROBqgK71BFCB/5EGY= 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:uXlFOd0NqIROBqgK71BFCB/5EGY='} 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009e2b01753a2ffa3f-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.234 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.235 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '17'), ('X-RGW-Bytes-Used', '51'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008b612cea04151426-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj69 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj69 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj69 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.236 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj69 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:iJOJufduyjd7u2X2b4Ncw7V0qqw= 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:iJOJufduyjd7u2X2b4Ncw7V0qqw='} 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000cd496eb7eae58c3f-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.237 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '18'), ('X-RGW-Bytes-Used', '54'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000036efae93879eacc8-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.238 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj92 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj92 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj92 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj92 2024-04-16T19:30:50.239 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zCw+VlmNMoDF+XA0B3ygcqCTnx8= 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zCw+VlmNMoDF+XA0B3ygcqCTnx8='} 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ea24e0420d6e5b62-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.240 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '19'), ('X-RGW-Bytes-Used', '57'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000b75001826de90071-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj115 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj115 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj115 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.241 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj115 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ufG/BYQrD094G/n0aQFgk03u3o0= 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ufG/BYQrD094G/n0aQFgk03u3o0='} 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000b9c68e19ce1f2d43-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.242 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '29', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 29 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-57 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 20 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.243 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '20'), ('X-RGW-Bytes-Used', '60'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000046f9d853ddec9208-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj29 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj29 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.244 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj29 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj29 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:zRukanuIzw5xuU0PcbTjequ2S5M= 2024-04-16T19:30:50.245 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:zRukanuIzw5xuU0PcbTjequ2S5M='} 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000442913feb91c4f93-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.246 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '21'), ('X-RGW-Bytes-Used', '63'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000004d247d5cf8b4299b-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj58 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj58 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj58 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.247 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj58 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:/RW6NddmYDRoLZBquqDOlOtRm2U= 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:/RW6NddmYDRoLZBquqDOlOtRm2U='} 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000006420d0cb3c55eaa0-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.248 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.249 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '22'), ('X-RGW-Bytes-Used', '66'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000083d8012325078fe5-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj87 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj87 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj87 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.250 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj87 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:jipW1e1hSrNWES5XdSb3H/IIHlo= 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:jipW1e1hSrNWES5XdSb3H/IIHlo='} 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000005dffed98a291603e-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.251 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '23'), ('X-RGW-Bytes-Used', '69'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f352e9e143a9cb68-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj116 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj116 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.252 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj116 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj116 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:Nymbyn56vdj1/4vnNfaXiV7nmNQ= 2024-04-16T19:30:50.253 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:Nymbyn56vdj1/4vnNfaXiV7nmNQ='} 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000093518bdcd026e789-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.254 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '24'), ('X-RGW-Bytes-Used', '72'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000088699a19f86430fb-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj145 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj145 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj145 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.255 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj145 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:gjOlW66IQd9u8zJfIOAd2p5Axhg= 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:gjOlW66IQd9u8zJfIOAd2p5Axhg='} 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000613c6c2706d0e441-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '31', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 31 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.256 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-57 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 25 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.257 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '25'), ('X-RGW-Bytes-Used', '75'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000fb3d781a143e1b01-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj31 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj31 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj31 2024-04-16T19:30:50.258 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj31 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:dlIEk9t9zx+e0wLW9FmAljqnPiA= 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:dlIEk9t9zx+e0wLW9FmAljqnPiA='} 2024-04-16T19:30:50.259 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000003a7dfd1a60f07874-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.260 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '26'), ('X-RGW-Bytes-Used', '78'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000bac7669d0728cd28-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj62 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj62 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj62 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.261 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj62 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:NNTm7tMgTPriMzt5RY8vyRbe/M4= 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:NNTm7tMgTPriMzt5RY8vyRbe/M4='} 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000ff784702e51ee80c-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.262 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '27'), ('X-RGW-Bytes-Used', '81'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000132b78bc4959b14d-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.263 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj93 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj93 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj93 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.264 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj93 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:cVgN7RXHP9hV3mSDuFPD9YEfccY= 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:cVgN7RXHP9hV3mSDuFPD9YEfccY='} 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000326ef27eda29ccbd-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.265 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '28'), ('X-RGW-Bytes-Used', '84'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000e0015420ee72aacc-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj124 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj124 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj124 2024-04-16T19:30:50.266 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj124 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:nLLiYNyyX1ux73840y161y8hHBs= 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:nLLiYNyyX1ux73840y161y8hHBs='} 2024-04-16T19:30:50.267 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000009ba5eefe6745bc43-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.268 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc= 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:s6qAQr6XPUFNPBALW0+GMS2UXWc=', 'Content-Length': '0'} 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '29'), ('X-RGW-Bytes-Used', '87'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000834289447d7c0d7b-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj155 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj155 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj155 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.269 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:07 GMT 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj155 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:+p7ShhMYPefNMiygcO/Jj7NWUhI= 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:07 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+p7ShhMYPefNMiygcO/Jj7NWUhI='} 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx000000bf3bc22adba5761-00661ec94f-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:07 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'reshard', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'cjqttm-57', '--num-shards', '37', '--yes-i-really-mean-it', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket reshard --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket cjqttm-57 --num-shards 37 --yes-i-really-mean-it --cluster c1 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.270 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: tenant: 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: bucket name: cjqttm-57 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: total entries: 30 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.271 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '30'), ('X-RGW-Bytes-Used', '90'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000006d881716cd292a3e-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj37 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj37 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj37 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.272 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj37 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:+Y/UsU3ZIP6DJqd5VG54C2PgD34= 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:+Y/UsU3ZIP6DJqd5VG54C2PgD34='} 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000000bc035d6c11d248-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.273 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.274 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '31'), ('X-RGW-Bytes-Used', '93'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000065d4f582e932b190-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj74 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj74 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj74 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.275 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj74 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:YkmR2dEgOvipOVZeR26dQped7Zc= 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:YkmR2dEgOvipOVZeR26dQped7Zc='} 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx0000084bed06d83d29bdb-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.276 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '32'), ('X-RGW-Bytes-Used', '96'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx00000f74cc247439e8ef8-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.277 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj111 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj111 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj111 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.278 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj111 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:e4dl4RbJvRBUFGSzAZlrIp1jSpQ= 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:e4dl4RbJvRBUFGSzAZlrIp1jSpQ='} 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000992453845b3f5a6d-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.279 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '33'), ('X-RGW-Bytes-Used', '99'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx0000022d15874b0c7d62f-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj148 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj148 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj148 2024-04-16T19:30:50.280 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj148 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:ZCrJGMLQg+UUTovNz/IwTTqfeqw= 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:ZCrJGMLQg+UUTovNz/IwTTqfeqw='} 2024-04-16T19:30:50.281 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000a7e856a1ed80aa3f-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/ 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/ 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: HEAD 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/ 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {} 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:HEAD 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.282 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:/cjqttm-57/ 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY= 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:5Me1p+7v0AwdqR4ggbk0muMjeLY=', 'Content-Length': '0'} 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('X-RGW-Object-Count', '34'), ('X-RGW-Bytes-Used', '102'), ('X-RGW-Quota-User-Size', '-1'), ('X-RGW-Quota-User-Objects', '-1'), ('X-RGW-Quota-Max-Buckets', '1000'), ('X-RGW-Quota-Bucket-Size', '-1'), ('X-RGW-Quota-Bucket-Objects', '-1'), ('x-amz-request-id', 'tx000008c0242c320d37085-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Content-Length', '0'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: path=/cjqttm-57/obj185 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: auth_path=/cjqttm-57/obj185 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Method: PUT 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Path: /cjqttm-57/obj185 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Data: 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue'} 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Host: smithi016.front.sepia.ceph.com:8000 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Port: 8000 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Params: {} 2024-04-16T19:30:50.283 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Token: None 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: StringToSign: 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:PUT 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:rL0Y20zC+Fzt72VPzMSk2A== 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:application/octet-stream 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:Tue, 16 Apr 2024 18:54:08 GMT 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:/cjqttm-57/obj185 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Signature: 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:AWS 51CH7DEF4C5TK3K8FIQL:DbSUq7+L0xzyHRDPXd6bNmvwyuM= 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Final headers: {'User-Agent': 'Boto/2.49.0 Python/3.8.10 Linux/5.4.0-166-generic', 'Content-Type': 'application/octet-stream', 'Content-MD5': 'rL0Y20zC+Fzt72VPzMSk2A==', 'Content-Length': '3', 'Expect': '100-Continue', 'Date': 'Tue, 16 Apr 2024 18:54:08 GMT', 'Authorization': 'AWS 51CH7DEF4C5TK3K8FIQL:DbSUq7+L0xzyHRDPXd6bNmvwyuM='} 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:boto: DEBUG: Response headers: [('Content-Length', '0'), ('ETag', '"acbd18db4cc2f85cedef654fccc4a4d8"'), ('Accept-Ranges', 'bytes'), ('x-amz-request-id', 'tx00000e00302594b15f0a3-00661ec950-4816-test-zone1'), ('Server', 'Ceph Object Gateway (squid)'), ('Date', 'Tue, 16 Apr 2024 18:54:08 GMT'), ('Connection', 'Keep-Alive')] 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'init', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync init --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.284 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:08.287+0000 7ff40b644800 5 RGW-SYNC:data: waiting on data sync status lease 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:08.289+0000 7ff40b644800 5 RGW-SYNC:data: acquired data sync status lease 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Restarting daemon 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0: INFO: Started 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: Dload Upload Total Spent Left Speed 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 7 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: curl: (7) Failed to connect to smithi139.front.sepia.ceph.com port 8000: Connection refused 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T18:54:08.530+0000 7fd935e63880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > curl http://smithi139.front.sepia.ceph.com:8000 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-16T19:30:50.285 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: Dload Upload Total Spent Left Speed 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 182k 0 --:--:-- --:--:-- --:--:-- 182k 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: anonymous 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: bucket checkpoint: source=test-zone1 target=test-zone2 bucket=cjqttm-57 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'checkpoint', '--bucket', 'cjqttm-57', '--source-zone', 'test-zone1', '--retry-delay-ms', '5000', '--timeout-sec', '300', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '1', '--debug-ms', '0'] 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync checkpoint --bucket cjqttm-57 --source-zone test-zone1 --retry-delay-ms 5000 --timeout-sec 300 --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 1 --debug-ms 0 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:09.519+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:14.519+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:19.520+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:24.521+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:29.522+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.286 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:34.522+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:39.524+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:44.526+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:49.527+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:54.527+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:54:59.527+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:04.528+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:09.529+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:14.531+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:19.532+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:24.533+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:29.534+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:34.535+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:39.536+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: *** Caught signal (Segmentation fault) ** 2024-04-16T19:30:50.287 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T19:30:50.288 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T18:55:42.287+0000 7fd811bc9640 -1 *** Caught signal (Segmentation fault) ** 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T19:30:50.289 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 0> 2024-04-16T18:55:42.287+0000 7fd811bc9640 -1 *** Caught signal (Segmentation fault) ** 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T19:30:50.290 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 0> 2024-04-16T18:55:42.287+0000 7fd811bc9640 -1 *** Caught signal (Segmentation fault) ** 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: in thread 7fd811bc9640 thread_name:data-sync 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: ceph version 19.0.0-3089-gb0c7b917 (b0c7b917267c471208541fdeb652f5e897d00086) squid (dev) 2024-04-16T19:30:50.291 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 1: /lib64/libc.so.6(+0x54db0) [0x7fd938054db0] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2: /lib64/libc.so.6(+0xc1992) [0x7fd9380c1992] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 3: radosgw(+0xe3f9dc) [0x558c6d4e79dc] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 4: radosgw(+0x4130e2) [0x558c6cabb0e2] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 5: radosgw(+0x8e01b9) [0x558c6cf881b9] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 6: radosgw(+0xac6a87) [0x558c6d16ea87] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 7: (RGWCoroutinesStack::operate(DoutPrefixProvider const*, RGWCoroutinesEnv*)+0x130) [0x558c6ccee830] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 8: (RGWCoroutinesManager::run(DoutPrefixProvider const*, std::__cxx11::list >&)+0x481) [0x558c6ccf0381] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 9: (RGWCoroutinesManager::run(DoutPrefixProvider const*, RGWCoroutine*)+0xad) [0x558c6ccf115d] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 10: (RGWRemoteDataLog::run_sync(DoutPrefixProvider const*, int)+0x4bf) [0x558c6d175aef] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 11: radosgw(+0x81bba8) [0x558c6cec3ba8] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 12: (RGWRadosThread::Worker::entry()+0xb3) [0x558c6cec50b3] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 13: /lib64/libc.so.6(+0x9f802) [0x7fd93809f802] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 14: /lib64/libc.so.6(+0x3f450) [0x7fd93803f450] 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-16T19:30:50.292 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stdout: INFO: 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.0.smithi139.stderr: INFO: daemon-helper: command crashed with signal 11 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~0s 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:44.536+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~6s 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:49.537+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:54.538+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~12s 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:55:59.539+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~18s 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:04.540+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~24s 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:09.541+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~30s 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:14.543+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.293 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~35s 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:19.544+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~41s 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:24.545+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:29.545+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~47s 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:34.546+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~53s 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:39.547+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~59s 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:44.548+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~65s 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:49.549+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~71s 2024-04-16T19:30:50.294 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:54.551+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:56:59.552+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~77s 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:04.553+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~83s 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:09.554+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~89s 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:14.554+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~95s 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:19.555+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~100s 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:24.555+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~106s 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:29.556+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:34.557+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~112s 2024-04-16T19:30:50.295 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:39.558+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~118s 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:44.559+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~124s 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:49.560+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~130s 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:54.561+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~136s 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:57:59.561+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:04.562+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~142s 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:09.563+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~148s 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:14.564+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~154s 2024-04-16T19:30:50.296 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:19.565+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~160s 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:24.566+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~165s 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:29.568+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~171s 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:34.569+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:39.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~177s 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:44.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~183s 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:49.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~189s 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:54.570+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~195s 2024-04-16T19:30:50.297 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:58:59.571+0000 7f9884f28800 1 waiting to reach latest gen 6, on 0.. 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~201s 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:04.572+0000 7f9884f28800 -1 bucket checkpoint timed out waiting to reach latest generation 6 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:04.572+0000 7f9884f28800 0 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:04.572+0000 7f9884f28800 -1 bucket sync checkpoint failed: (110) Connection timed out 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 110 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:FAIL: test_sync_policy_config_zonegroup: 2024-04-16T19:30:50.298 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 2461, in test_sync_policy_config_zonegroup 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: zonegroup_meta_checkpoint(zonegroup) 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 211, in zonegroup_meta_checkpoint 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: zone_meta_checkpoint(zone, meta_master_zone, master_status) 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 186, in zone_meta_checkpoint 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: global_status, period, realm_epoch, num_shards, sync_status = meta_sync_status(zone) 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 143, in meta_sync_status 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests: assert(retcode == 2) # ENOENT 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:50.299 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:04.866+0000 7fee6bd2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.300 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:04.867+0000 7fee6bd2c800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:04Z"} 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:04Z"} 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~207s 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.301 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:10.073+0000 7f2806c16800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:10.074+0000 7f2806c16800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:10Z"} 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:10Z"} 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.302 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:15.212+0000 7fc563f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:15.213+0000 7fc563f2d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:15Z"} 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:15Z"} 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~213s 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:20.351+0000 7fa7f9e12800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.303 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:20.352+0000 7fa7f9e12800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:20Z"} 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:20Z"} 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~219s 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:25.489+0000 7f076b40f800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.304 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:25.490+0000 7f076b40f800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:25Z"} 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:25Z"} 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~225s 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.305 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:30.626+0000 7f6082c67800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:30.627+0000 7f6082c67800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:30Z"} 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:30Z"} 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~230s 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.306 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:35.766+0000 7f8c407af800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:35.767+0000 7f8c407af800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:35Z"} 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:35Z"} 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~236s 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.307 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:40.908+0000 7f6d35928800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:40.909+0000 7f6d35928800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:40Z"} 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:40Z"} 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~242s 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.308 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:46.045+0000 7f5fb0a24800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:46.046+0000 7f5fb0a24800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:46Z"} 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:46Z"} 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.309 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~248s 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:51.184+0000 7fe76732d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:51.185+0000 7fe76732d800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:51Z"} 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:51Z"} 2024-04-16T19:30:50.310 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:56.322+0000 7f4f3c433800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T18:59:56.324+0000 7f4f3c433800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:56Z"} 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T18:59:56Z"} 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.311 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~254s 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:01.461+0000 7fea10933800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:01.462+0000 7fea10933800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:01Z"} 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:01Z"} 2024-04-16T19:30:50.312 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~260s 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:06.601+0000 7fab5c611800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:06.603+0000 7fab5c611800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:06Z"} 2024-04-16T19:30:50.313 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:06Z"} 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~266s 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:11.745+0000 7f47f2d20800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:11.747+0000 7f47f2d20800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.314 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:11Z"} 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:11Z"} 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~272s 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:16.883+0000 7fb51d42e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:16.884+0000 7fb51d42e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.315 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:16Z"} 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:16Z"} 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~278s 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:22.021+0000 7f04d7e11800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:22.022+0000 7f04d7e11800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.316 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:22Z"} 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:22Z"} 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~284s 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:27.161+0000 7f4bff610800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.317 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:27.162+0000 7f4bff610800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:27Z"} 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:27Z"} 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:32.299+0000 7f9908130800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.318 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:32.301+0000 7f9908130800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:32Z"} 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:32Z"} 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~290s 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:37.438+0000 7f4e3731e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.319 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:37.439+0000 7f4e3731e800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:37Z"} 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:37Z"} 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~295s 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:42.576+0000 7fec3bc10800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.320 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:00:42.578+0000 7fec3bc10800 20 RGW-SYNC:meta: read sync status 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stdout: INFO: {"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:42Z"} 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: current meta sync status={"sync_status":{"info":{"status":"sync","num_shards":4,"period":"224d2f86-f40f-4dbd-9d55-5b22f2e34bfe","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1713291328.887167_587.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2024-04-16T18:15:28.887167Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1713291329.391157_239.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:29.391157Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1713293628.089303_1644.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:53:48.089303Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1713291328.617182_358.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2024-04-16T18:15:28.617182Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1},"current_time":"2024-04-16T19:00:42Z"} 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_markers=[{'key': 0, 'val': {'state': 1, 'marker': '1_1713291328.887167_587.1', 'next_step_marker': '', 'total_entries': 1, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.887167Z', 'realm_epoch': 2}}, {'key': 1, 'val': {'state': 1, 'marker': '1_1713291329.391157_239.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:29.391157Z', 'realm_epoch': 2}}, {'key': 2, 'val': {'state': 1, 'marker': '1_1713293628.089303_1644.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:53:48.089303Z', 'realm_epoch': 2}}, {'key': 3, 'val': {'state': 1, 'marker': '1_1713291328.617182_358.1', 'next_step_marker': '', 'total_entries': 0, 'pos': 0, 'timestamp': '2024-04-16T18:15:28.617182Z', 'realm_epoch': 2}}] 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: log_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: sync_status={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293628.089303_1644.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: WARNING: zone test-zone2 behind master: shard=2 master=1_1713293647.979982_1681.1 target=1_1713293628.089303_1644.1 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: daemon c2.rgw.client.0 is failed for ~301s 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.daemonwatchdog.daemon_watchdog: INFO: BARK! unmounting mounts and killing all daemons 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0: INFO: Sent signal 15 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1: INFO: Sent signal 15 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2: INFO: Sent signal 15 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3: INFO: Sent signal 15 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4: INFO: Sent signal 15 2024-04-16T19:30:50.321 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5: INFO: Sent signal 15 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mon.a: INFO: Sent signal 15 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.1: INFO: Sent signal 15 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mgr.x: INFO: Sent signal 15 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fe4bc5b6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 3 (PID: 32286) UID: 0 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fe4bc5b6640 -1 osd.3 55 *** Got signal Terminated *** 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0.smithi139.stderr: INFO: 2024-04-16T19:00:45.056+0000 7fbbdbb57640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 0 (PID: 32369) UID: 0 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0.smithi139.stderr: INFO: 2024-04-16T19:00:45.056+0000 7fbbdbb57640 -1 osd.0 55 *** Got signal Terminated *** 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.0.smithi139.stderr: INFO: 2024-04-16T19:00:45.056+0000 7fbbdbb57640 -1 osd.0 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fe4159a5640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 4 (PID: 32288) UID: 0 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fe4159a5640 -1 osd.4 55 *** Got signal Terminated *** 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1.smithi139.stderr: INFO: 2024-04-16T19:00:45.057+0000 7f8243dcf640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 1 (PID: 32370) UID: 0 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1.smithi139.stderr: INFO: 2024-04-16T19:00:45.057+0000 7f8243dcf640 -1 osd.1 55 *** Got signal Terminated *** 2024-04-16T19:30:50.322 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.1.smithi139.stderr: INFO: 2024-04-16T19:00:45.057+0000 7f8243dcf640 -1 osd.1 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7f1487757640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 5 (PID: 32290) UID: 0 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2.smithi139.stderr: INFO: 2024-04-16T19:00:45.057+0000 7f9629b45640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster c2 -i 2 (PID: 32373) UID: 0 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2.smithi139.stderr: INFO: 2024-04-16T19:00:45.057+0000 7f9629b45640 -1 osd.2 55 *** Got signal Terminated *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.2.smithi139.stderr: INFO: 2024-04-16T19:00:45.057+0000 7f9629b45640 -1 osd.2 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.3.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fe4bc5b6640 -1 osd.3 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mon.a.smithi139.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fc5ce9ad640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster c2 -i a (PID: 32184) UID: 0 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mon.a.smithi139.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fc5ce9ad640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.4.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fe4159a5640 -1 osd.4 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.1.smithi163.stdout: INFO: 2024-04-16T19:00:45.058+0000 7fbdc64b7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 36855) UID: 0 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7f1487757640 -1 osd.5 55 *** Got signal Terminated *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.osd.5.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7f1487757640 -1 osd.5 55 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.rgw.c2.client.1.smithi163.stdout: INFO: 2024-04-16T19:00:45.058+0000 7fbdc9d08880 -1 shutting down 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mgr.x.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fcf93b91640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster c2 -i x (PID: 31914) UID: 0 2024-04-16T19:30:50.323 INFO:tasks.rgw_multisite_tests:tasks.ceph.c2.mgr.x.smithi163.stderr: INFO: 2024-04-16T19:00:45.058+0000 7fcf93b91640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 1 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:05:47.661+0000 7ff503b3b800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:FAIL: test_sync_flow_symmetrical_zonegroup_all: 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.324 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 2534, in test_sync_flow_symmetrical_zonegroup_all 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: zonegroup_meta_checkpoint(zonegroup) 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 211, in zonegroup_meta_checkpoint 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: zone_meta_checkpoint(zone, meta_master_zone, master_status) 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 186, in zone_meta_checkpoint 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: global_status, period, realm_epoch, num_shards, sync_status = meta_sync_status(zone) 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 143, in meta_sync_status 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests: assert(retcode == 2) # ENOENT 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.325 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:10:47.948+0000 7fb71409d800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:30:50.326 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 1 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests:FAIL: test_sync_single_bucket: 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 2783, in test_sync_single_bucket 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: zonegroup_meta_checkpoint(zonegroup) 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 211, in zonegroup_meta_checkpoint 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: zone_meta_checkpoint(zone, meta_master_zone, master_status) 2024-04-16T19:30:50.327 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 186, in zone_meta_checkpoint 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests: global_status, period, realm_epoch, num_shards, sync_status = meta_sync_status(zone) 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 143, in meta_sync_status 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests: assert(retcode == 2) # ENOENT 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.328 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:15:48.167+0000 7f668d733800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 1 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:FAIL: test_sync_different_buckets: 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.329 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 2901, in test_sync_different_buckets 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: zonegroup_meta_checkpoint(zonegroup) 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 211, in zonegroup_meta_checkpoint 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: zone_meta_checkpoint(zone, meta_master_zone, master_status) 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 186, in zone_meta_checkpoint 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: global_status, period, realm_epoch, num_shards, sync_status = meta_sync_status(zone) 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 143, in meta_sync_status 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests: assert(retcode == 2) # ENOENT 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.330 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.331 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 1 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:20:48.393+0000 7f885652c800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests:FAIL: test_sync_multiple_buckets_to_single: 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 3048, in test_sync_multiple_buckets_to_single 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests: zonegroup_meta_checkpoint(zonegroup) 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 211, in zonegroup_meta_checkpoint 2024-04-16T19:30:50.332 INFO:tasks.rgw_multisite_tests: zone_meta_checkpoint(zone, meta_master_zone, master_status) 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 186, in zone_meta_checkpoint 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests: global_status, period, realm_epoch, num_shards, sync_status = meta_sync_status(zone) 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 143, in meta_sync_status 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests: assert(retcode == 2) # ENOENT 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.333 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:25:48.596+0000 7f8daabaf800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 1 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:====================================================================== 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:FAIL: test_sync_single_bucket_to_multiple: 2024-04-16T19:30:50.334 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/lib/python3.8/site-packages/nose/case.py", line 198, in runTest 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 3170, in test_sync_single_bucket_to_multiple 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: zonegroup_meta_checkpoint(zonegroup) 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 211, in zonegroup_meta_checkpoint 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: zone_meta_checkpoint(zone, meta_master_zone, master_status) 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 186, in zone_meta_checkpoint 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: global_status, period, realm_epoch, num_shards, sync_status = meta_sync_status(zone) 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/../src/test/rgw/rgw_multi/tests.py", line 143, in meta_sync_status 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests: assert(retcode == 2) # ENOENT 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests:AssertionError: 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests:-------------------- >> begin captured logging << -------------------- 2024-04-16T19:30:50.335 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stderr: INFO: No --period given, using current period=224d2f86-f40f-4dbd-9d55-5b22f2e34bfe 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi016.stdout: INFO: [{"marker":"1_1713291328.887167_587.1","last_update":"2024-04-16T18:15:28.887167Z"},{"marker":"1_1713291329.391157_239.1","last_update":"2024-04-16T18:15:29.391157Z"},{"marker":"1_1713293647.979982_1681.1","last_update":"2024-04-16T18:54:07.979982Z"},{"marker":"1_1713291328.617182_358.1","last_update":"2024-04-16T18:15:28.617182Z"}] 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: DEBUG: master meta markers={0: '1_1713291328.887167_587.1', 1: '1_1713291329.391157_239.1', 2: '1_1713293647.979982_1681.1', 3: '1_1713291328.617182_358.1'} 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:rgw_multi.tests: INFO: starting meta checkpoint for zone=test-zone2 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: INFO: rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:tasks.util.rgw: DEBUG: rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139: DEBUG: > adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setuser ceph since I am not root 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: ignoring --setgroup ceph since I am not root 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run: DEBUG: got remote process result: 1 2024-04-16T19:30:50.336 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: 2024-04-16T19:30:48.797+0000 7f28fcc24800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:30:50.337 INFO:tasks.rgw_multisite_tests:teuthology.orchestra.run.smithi139.stderr: INFO: failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:30:50.337 INFO:tasks.rgw_multisite_tests:--------------------- >> end captured logging << --------------------- 2024-04-16T19:30:50.337 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.337 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2024-04-16T19:30:50.337 INFO:tasks.rgw_multisite_tests:Ran 65 tests in 6266.510s 2024-04-16T19:30:50.337 INFO:tasks.rgw_multisite_tests: 2024-04-16T19:30:50.337 INFO:tasks.rgw_multisite_tests:FAILED (SKIP=18, errors=1, failures=9) 2024-04-16T19:30:50.340 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw_multisite_tests.py", line 96, in begin assert nose.run(argv=argv, config=conf), 'rgw multisite test failures' AssertionError: rgw multisite test failures 2024-04-16T19:30:50.492 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=38445471e01f42f191e80545bec06893 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw_multisite_tests.py", line 96, in begin assert nose.run(argv=argv, config=conf), 'rgw multisite test failures' AssertionError: rgw multisite test failures 2024-04-16T19:30:50.493 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite-tests 2024-04-16T19:30:50.509 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite 2024-04-16T19:30:50.520 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-16T19:30:50.528 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2024-04-16T19:30:50.528 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:30:50.533 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T19:30:50.528+0000 7f0328d9b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 41789) UID: 0 2024-04-16T19:30:50.533 INFO:tasks.rgw.c1.client.0.smithi016.stdout:2024-04-16T19:30:50.528+0000 7f032c5f4880 -1 shutting down 2024-04-16T19:30:53.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2024-04-16T19:30:56.630 INFO:tasks.rgw.c1.client.0:Stopped 2024-04-16T19:30:56.631 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock 2024-04-16T19:30:56.652 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /etc/ceph/vault-root-token 2024-04-16T19:30:56.728 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-16T19:30:56.800 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['gc', 'process', '--include-all'] 2024-04-16T19:30:56.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'gc', 'process', '--include-all'] 2024-04-16T19:30:56.801 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 gc process --include-all 2024-04-16T19:30:56.889 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:30:56.889 INFO:teuthology.orchestra.run.smithi016.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:30:56.924 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.923+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.924+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T19:30:56.925 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.924+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.924+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=110 2024-04-16T19:30:56.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.924+0000 7f2ce7322800 20 realm test-realm c3c61b36-e722-463c-9f73-5156628a053b 2024-04-16T19:30:56.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.924+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.927 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=110 2024-04-16T19:30:56.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=10 2024-04-16T19:30:56.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=1380 2024-04-16T19:30:56.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.928 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T19:30:56.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.925+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.926+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=110 2024-04-16T19:30:56.929 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.926+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.926+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T19:30:56.931 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.926+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 20 rados_obj.operate() r=0 bl.length=1165 2024-04-16T19:30:56.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 20 zone test-zone1 found 2024-04-16T19:30:56.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 4 Realm: test-realm (c3c61b36-e722-463c-9f73-5156628a053b) 2024-04-16T19:30:56.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 4 ZoneGroup: test-zonegroup (test-zonegroup) 2024-04-16T19:30:56.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 4 Zone: test-zone1 (9ba59572-f51c-4bce-9578-e6350e822996) 2024-04-16T19:30:56.932 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 4 using period configuration: 224d2f86-f40f-4dbd-9d55-5b22f2e34bfe:10 2024-04-16T19:30:56.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 20 period zonegroup name test-zonegroup 2024-04-16T19:30:56.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 20 using current period zonegroup test-zonegroup 2024-04-16T19:30:56.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.927+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.928+0000 7f2ce7322800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:30:56.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.928+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.933 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:30:56.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 init(): pipe_map (zone=316ebd79-1e8f-459c-be24-e6b3e0dc08e5 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-16T19:30:56.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} 2024-04-16T19:30:56.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0},d={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0}} 2024-04-16T19:30:56.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:30:56.934 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 rados->read ofs=0 len=0 2024-04-16T19:30:56.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:30:56.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 init(): pipe_map (zone=9ba59572-f51c-4bce-9578-e6350e822996 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-16T19:30:56.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0},d={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0}} 2024-04-16T19:30:56.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} 2024-04-16T19:30:56.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0},d={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0}} 2024-04-16T19:30:56.935 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} 2024-04-16T19:30:56.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 started sync module instance, tier type = 2024-04-16T19:30:56.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 generating connection object for zone test-zone2 id 316ebd79-1e8f-459c-be24-e6b3e0dc08e5 2024-04-16T19:30:56.936 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.929+0000 7f2ce7322800 20 started zone id=9ba59572-f51c-4bce-9578-e6350e822996 (name=test-zone1) with tier type = 2024-04-16T19:30:56.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.940+0000 7f2ce7322800 20 add_watcher() i=0 2024-04-16T19:30:56.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.940+0000 7f2ce7322800 20 add_watcher() i=1 2024-04-16T19:30:56.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.940+0000 7f2ce7322800 20 add_watcher() i=2 2024-04-16T19:30:56.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.940+0000 7f2ce7322800 20 add_watcher() i=3 2024-04-16T19:30:56.942 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.940+0000 7f2ce7322800 20 add_watcher() i=4 2024-04-16T19:30:56.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.940+0000 7f2ce7322800 20 add_watcher() i=5 2024-04-16T19:30:56.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.940+0000 7f2ce7322800 20 add_watcher() i=6 2024-04-16T19:30:56.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.941+0000 7f2ce7322800 20 add_watcher() i=7 2024-04-16T19:30:56.943 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.941+0000 7f2ce7322800 2 all 8 watchers are set, enabling cache 2024-04-16T19:30:56.944 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.943+0000 7f2b997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T19:30:56.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.943+0000 7f2ce7322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T19:30:56.945 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.943+0000 7f2ce7322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T19:30:56.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.995+0000 7f2b13fff640 20 reqs_thread_entry: start 2024-04-16T19:30:56.997 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.996+0000 7f2ce7322800 20 init_complete bucket index max shards: 11 2024-04-16T19:30:56.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.996+0000 7f2ce7322800 20 Filter name: none 2024-04-16T19:30:56.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.996+0000 7f2b11ffb640 20 reqs_thread_entry: start 2024-04-16T19:30:56.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.996+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-16T19:30:56.998 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.997+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:56.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.998+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:56.999 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.998+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.000 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:56.999+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-16T19:30:57.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.001+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.002 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.001+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.003 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.001+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.004 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.003+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-16T19:30:57.005 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.004+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.004+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.006 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.005+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.007 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.005+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-16T19:30:57.008 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.007+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.008+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.009 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.008+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.010 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.009+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-16T19:30:57.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.010+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.011+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.012 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.011+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.013 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.012+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-16T19:30:57.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.014+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.015 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.014+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.014+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.016 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.015+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-16T19:30:57.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.016+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.018 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.017+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.019 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.017+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.020 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.018+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-16T19:30:57.021 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.020+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.020+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.022 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.021+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.023 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.022+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-16T19:30:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.024+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.025 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.024+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.026 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.025+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.027 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.026+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-16T19:30:57.028 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.027+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.028+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.029 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.028+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.030 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.029+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-16T19:30:57.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.031+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.032 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.031+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.031+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.033 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.032+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-16T19:30:57.035 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.034+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.035+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.036 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.035+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.037 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.036+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-16T19:30:57.038 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.037+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.038+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.039 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.038+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.040 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.039+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-16T19:30:57.041 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.040+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.041+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.042 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.041+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.043 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.042+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-16T19:30:57.044 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.043+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.043+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.045 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.044+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.046 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.045+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-16T19:30:57.048 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.047+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.047+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.049 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.048+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.050 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.049+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-16T19:30:57.051 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.050+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.051+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.052 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.051+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.053 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.052+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-16T19:30:57.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.054+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.055 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.054+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.056 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.054+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.057 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.055+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-16T19:30:57.058 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.057+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.057+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.059 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.058+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.060 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.059+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-16T19:30:57.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.061+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.062 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.061+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.061+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.063 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.062+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-16T19:30:57.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.064+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.065 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.064+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.064+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.066 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.065+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-16T19:30:57.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.068+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.069 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.068+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.070 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.068+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.071 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.069+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-16T19:30:57.073 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.072+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.073+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.074 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.073+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.076 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.075+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-16T19:30:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.076+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.077 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.076+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.076+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.078 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.077+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-16T19:30:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.078+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.079+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.079+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.081 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.080+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-16T19:30:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.081+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.082+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.083 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.082+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.084 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.083+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-16T19:30:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.084+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.085+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.086 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.085+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.087 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.086+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-16T19:30:57.089 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.088+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.089+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.090 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.089+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.092 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.090+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-16T19:30:57.093 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.092+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.093+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.094 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.093+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.095 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.094+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-16T19:30:57.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.095+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.096+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.097 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.096+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.098 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.097+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-16T19:30:57.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.099+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.100 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.099+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.101 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.099+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.102 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.100+0000 7f2ce7322800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-16T19:30:57.103 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.102+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.102+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:30:57.104 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.103+0000 7f2ce7322800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:30:57.105 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.104+0000 7f2b997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T19:30:57.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.107+0000 7f2ce7322800 20 remove_watcher() i=0 2024-04-16T19:30:57.108 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.107+0000 7f2ce7322800 2 removed watcher, disabling cache 2024-04-16T19:30:57.109 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.108+0000 7f2ce7322800 20 remove_watcher() i=1 2024-04-16T19:30:57.110 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.109+0000 7f2ce7322800 20 remove_watcher() i=2 2024-04-16T19:30:57.111 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.110+0000 7f2ce7322800 20 remove_watcher() i=3 2024-04-16T19:30:57.112 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.111+0000 7f2ce7322800 20 remove_watcher() i=4 2024-04-16T19:30:57.114 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.113+0000 7f2ce7322800 20 remove_watcher() i=5 2024-04-16T19:30:57.115 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.114+0000 7f2ce7322800 20 remove_watcher() i=6 2024-04-16T19:30:57.116 INFO:teuthology.orchestra.run.smithi016.stderr:2024-04-16T19:30:57.115+0000 7f2ce7322800 20 remove_watcher() i=7 2024-04-16T19:30:57.127 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2024-04-16T19:30:57.128 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:30:57.130 INFO:tasks.rgw.c1.client.1.smithi023.stdout:2024-04-16T19:30:57.128+0000 7f7f30a02640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground (PID: 36512) UID: 0 2024-04-16T19:30:57.130 INFO:tasks.rgw.c1.client.1.smithi023.stdout:2024-04-16T19:30:57.128+0000 7f7f36a2f880 -1 shutting down 2024-04-16T19:30:59.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 is failed for ~0s 2024-04-16T19:30:59.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2024-04-16T19:31:03.230 INFO:tasks.rgw.c1.client.1:Stopped 2024-04-16T19:31:03.231 DEBUG:teuthology.orchestra.run.smithi023:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock 2024-04-16T19:31:03.252 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f /etc/ceph/vault-root-token 2024-04-16T19:31:03.329 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-16T19:31:03.401 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['gc', 'process', '--include-all'] 2024-04-16T19:31:03.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'gc', 'process', '--include-all'] 2024-04-16T19:31:03.401 DEBUG:teuthology.orchestra.run.smithi023:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 gc process --include-all 2024-04-16T19:31:03.489 INFO:teuthology.orchestra.run.smithi023.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:31:03.489 INFO:teuthology.orchestra.run.smithi023.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:31:03.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.526+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.527 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.527+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T19:31:03.528 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.527+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.528+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=110 2024-04-16T19:31:03.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.528+0000 7f04a091f800 20 realm test-realm c3c61b36-e722-463c-9f73-5156628a053b 2024-04-16T19:31:03.530 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.528+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.528+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=110 2024-04-16T19:31:03.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.528+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.528+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=10 2024-04-16T19:31:03.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.528+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.529+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=1380 2024-04-16T19:31:03.531 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.529+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.529+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T19:31:03.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.529+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.529+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=110 2024-04-16T19:31:03.532 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.529+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.530+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-16T19:31:03.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.530+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 20 rados_obj.operate() r=0 bl.length=1165 2024-04-16T19:31:03.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 20 zone test-zone1 found 2024-04-16T19:31:03.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 4 Realm: test-realm (c3c61b36-e722-463c-9f73-5156628a053b) 2024-04-16T19:31:03.535 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 4 ZoneGroup: test-zonegroup (test-zonegroup) 2024-04-16T19:31:03.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 4 Zone: test-zone1 (9ba59572-f51c-4bce-9578-e6350e822996) 2024-04-16T19:31:03.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 4 using period configuration: 224d2f86-f40f-4dbd-9d55-5b22f2e34bfe:10 2024-04-16T19:31:03.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 20 period zonegroup name test-zonegroup 2024-04-16T19:31:03.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 20 using current period zonegroup test-zonegroup 2024-04-16T19:31:03.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.536 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:31:03.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.531+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.532+0000 7f04a091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:31:03.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.532+0000 7f04a091f800 20 init(): pipe_map (zone=316ebd79-1e8f-459c-be24-e6b3e0dc08e5 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-16T19:31:03.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.532+0000 7f04a091f800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} 2024-04-16T19:31:03.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.532+0000 7f04a091f800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0},d={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0}} 2024-04-16T19:31:03.537 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.532+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.532+0000 7f04a091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:31:03.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.532+0000 7f04a091f800 20 rados->read ofs=0 len=0 2024-04-16T19:31:03.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-16T19:31:03.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 init(): pipe_map (zone=9ba59572-f51c-4bce-9578-e6350e822996 bucket=*): adding potential pipe: {id=all,s={b=*,z=},d={b=*,z=}} 2024-04-16T19:31:03.538 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0},d={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0}} 2024-04-16T19:31:03.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} 2024-04-16T19:31:03.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 reflect(): flow manager (bucket=): adding source pipe: {s={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0},d={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0}} 2024-04-16T19:31:03.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 reflect(): flow manager (bucket=): adding dest pipe: {s={b=*,z=9ba59572-f51c-4bce-9578-e6350e822996,az=0},d={b=*,z=316ebd79-1e8f-459c-be24-e6b3e0dc08e5,az=0}} 2024-04-16T19:31:03.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 started sync module instance, tier type = 2024-04-16T19:31:03.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 generating connection object for zone test-zone2 id 316ebd79-1e8f-459c-be24-e6b3e0dc08e5 2024-04-16T19:31:03.539 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.533+0000 7f04a091f800 20 started zone id=9ba59572-f51c-4bce-9578-e6350e822996 (name=test-zone1) with tier type = 2024-04-16T19:31:03.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.544+0000 7f04a091f800 20 add_watcher() i=0 2024-04-16T19:31:03.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.544+0000 7f04a091f800 20 add_watcher() i=1 2024-04-16T19:31:03.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.544+0000 7f04a091f800 20 add_watcher() i=2 2024-04-16T19:31:03.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.544+0000 7f04a091f800 20 add_watcher() i=3 2024-04-16T19:31:03.545 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.544+0000 7f04a091f800 20 add_watcher() i=4 2024-04-16T19:31:03.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.544+0000 7f04a091f800 20 add_watcher() i=5 2024-04-16T19:31:03.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.544+0000 7f04a091f800 20 add_watcher() i=6 2024-04-16T19:31:03.546 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.545+0000 7f04a091f800 20 add_watcher() i=7 2024-04-16T19:31:03.547 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.545+0000 7f04a091f800 2 all 8 watchers are set, enabling cache 2024-04-16T19:31:03.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.547+0000 7f0352fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T19:31:03.548 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.547+0000 7f04a091f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-16T19:31:03.549 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.547+0000 7f04a091f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-16T19:31:03.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.597+0000 7f0351fdb640 20 reqs_thread_entry: start 2024-04-16T19:31:03.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.597+0000 7f04a091f800 20 init_complete bucket index max shards: 11 2024-04-16T19:31:03.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.597+0000 7f04a091f800 20 Filter name: none 2024-04-16T19:31:03.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.597+0000 7f02c37fe640 20 reqs_thread_entry: start 2024-04-16T19:31:03.599 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.597+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-16T19:31:03.600 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.599+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.600+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.601 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.600+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.602 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.601+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-16T19:31:03.604 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.603+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.605 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.603+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.605 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.604+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.606 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.605+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-16T19:31:03.607 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.607+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.607+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.608 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.607+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.609 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.608+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-16T19:31:03.611 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.610+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.612 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.610+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.612 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.611+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.612 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.612+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-16T19:31:03.615 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.614+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.615 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.614+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.615 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.614+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.617 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.616+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-16T19:31:03.618 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.617+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.618+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.618+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.619 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.619+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-16T19:31:03.622 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.621+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.622 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.622+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.623 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.622+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.624 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.624+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-16T19:31:03.626 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.625+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.625+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.627 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.626+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.628 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.627+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-16T19:31:03.629 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.628+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.628+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.629+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.630 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.630+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-16T19:31:03.632 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.631+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.632+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.633 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.632+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.634 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.633+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-16T19:31:03.635 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.634+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.635+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.636 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.635+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.637 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.636+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-16T19:31:03.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.637+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.638+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.639 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.638+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.640 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.639+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-16T19:31:03.642 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.640+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.642 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.641+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.642 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.641+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.643 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.642+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-16T19:31:03.644 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.644+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.644+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.645 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.644+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.646 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.645+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-16T19:31:03.647 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.647+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.647+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.648 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.647+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.650 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.649+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-16T19:31:03.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.651+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.652 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.651+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.653 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.651+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.654 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.653+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-16T19:31:03.655 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.654+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.655+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.655+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.656 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.656+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-16T19:31:03.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.657+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.658 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.657+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.658+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.659 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.658+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-16T19:31:03.660 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.660+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.660+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.661 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.660+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.662 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.661+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-16T19:31:03.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.663+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.663+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.664 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.664+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.665 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.664+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-16T19:31:03.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.666+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.666+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.667 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.666+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.668 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.667+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-16T19:31:03.670 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.669+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.670+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.671 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.670+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.672 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.671+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-16T19:31:03.674 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.673+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.674+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.675 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.674+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.676 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.675+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-16T19:31:03.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.677+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.678 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.677+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.678+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.679 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.679+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-16T19:31:03.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.680+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.681 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.681+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.681+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.682 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.682+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-16T19:31:03.684 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.683+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.684+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.685 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.684+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.686 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.685+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-16T19:31:03.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.687+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.688 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.688+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.689 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.688+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.691 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.690+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-16T19:31:03.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.691+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.692 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.692+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.693 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.692+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.695 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.694+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-16T19:31:03.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.695+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.696+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.697 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.696+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.698 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.697+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-16T19:31:03.699 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.698+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.699+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.700 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.699+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.701 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.700+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-16T19:31:03.702 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.701+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.702+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.703 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.702+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.704 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.703+0000 7f04a091f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-16T19:31:03.705 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.704+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.705+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-16T19:31:03.706 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.705+0000 7f04a091f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-16T19:31:03.708 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.707+0000 7f0352fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-16T19:31:03.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.710+0000 7f04a091f800 20 remove_watcher() i=0 2024-04-16T19:31:03.711 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.710+0000 7f04a091f800 2 removed watcher, disabling cache 2024-04-16T19:31:03.712 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.711+0000 7f04a091f800 20 remove_watcher() i=1 2024-04-16T19:31:03.713 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.712+0000 7f04a091f800 20 remove_watcher() i=2 2024-04-16T19:31:03.714 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.713+0000 7f04a091f800 20 remove_watcher() i=3 2024-04-16T19:31:03.715 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.715+0000 7f04a091f800 20 remove_watcher() i=4 2024-04-16T19:31:03.717 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.716+0000 7f04a091f800 20 remove_watcher() i=5 2024-04-16T19:31:03.718 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.717+0000 7f04a091f800 20 remove_watcher() i=6 2024-04-16T19:31:03.719 INFO:teuthology.orchestra.run.smithi023.stderr:2024-04-16T19:31:03.718+0000 7f04a091f800 20 remove_watcher() i=7 2024-04-16T19:31:03.730 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2024-04-16T19:31:03.730 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:31:03.731 INFO:tasks.rgw.c2.client.0:Stopped 2024-04-16T19:31:03.731 DEBUG:teuthology.orchestra.run.smithi139:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock 2024-04-16T19:31:03.751 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /etc/ceph/vault-root-token 2024-04-16T19:31:03.826 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-16T19:31:03.898 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['gc', 'process', '--include-all'] 2024-04-16T19:31:03.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'gc', 'process', '--include-all'] 2024-04-16T19:31:03.898 DEBUG:teuthology.orchestra.run.smithi139:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all 2024-04-16T19:31:03.986 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setuser ceph since I am not root 2024-04-16T19:31:03.986 INFO:teuthology.orchestra.run.smithi139.stderr:ignoring --setgroup ceph since I am not root 2024-04-16T19:31:05.372 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.1 has been restored 2024-04-16T19:36:03.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:36:03.991 INFO:teuthology.orchestra.run.smithi139.stderr:2024-04-16T19:36:03.986+0000 7fdc251a2800 0 monclient(hunting): authenticate timed out after 300 2024-04-16T19:36:03.991 INFO:teuthology.orchestra.run.smithi139.stderr:failed to fetch mon config (--no-mon-config to skip) 2024-04-16T19:36:03.992 ERROR:teuthology.run_tasks:Manager failed: rgw Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 556, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 364, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 269, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2024-04-16T19:36:04.005 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T19:36:04.052 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2024-04-16T19:36:04.052 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2024-04-16T19:38:04.098 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-16T19:38:04.099 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 556, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 364, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 269, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json' 2024-04-16T19:38:04.121 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T19:38:04.121 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T19:38:04.121 DEBUG:tasks.ceph.c2.osd.0:waiting for process to exit 2024-04-16T19:38:04.121 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.126 INFO:tasks.ceph.c2.osd.0:Stopped 2024-04-16T19:38:04.126 DEBUG:tasks.ceph.c2.osd.1:waiting for process to exit 2024-04-16T19:38:04.126 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.127 INFO:tasks.ceph.c2.osd.1:Stopped 2024-04-16T19:38:04.127 DEBUG:tasks.ceph.c2.osd.2:waiting for process to exit 2024-04-16T19:38:04.127 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.127 INFO:tasks.ceph.c2.osd.2:Stopped 2024-04-16T19:38:04.128 DEBUG:tasks.ceph.c2.osd.3:waiting for process to exit 2024-04-16T19:38:04.128 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.128 INFO:tasks.ceph.c2.osd.3:Stopped 2024-04-16T19:38:04.128 DEBUG:tasks.ceph.c2.osd.4:waiting for process to exit 2024-04-16T19:38:04.128 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.129 INFO:tasks.ceph.c2.osd.4:Stopped 2024-04-16T19:38:04.129 DEBUG:tasks.ceph.c2.osd.5:waiting for process to exit 2024-04-16T19:38:04.129 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.129 INFO:tasks.ceph.c2.osd.5:Stopped 2024-04-16T19:38:04.130 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T19:38:04.130 DEBUG:tasks.ceph.c2.mgr.x:waiting for process to exit 2024-04-16T19:38:04.130 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.130 INFO:tasks.ceph.c2.mgr.x:Stopped 2024-04-16T19:38:04.131 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T19:38:04.131 DEBUG:tasks.ceph.c2.mon.a:waiting for process to exit 2024-04-16T19:38:04.131 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:38:04.131 INFO:tasks.ceph.c2.mon.a:Stopped 2024-04-16T19:38:04.132 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T19:38:04.132 DEBUG:teuthology.orchestra.run.smithi139:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c2.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-16T19:38:04.172 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-0 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T19:38:04.172 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/c2-0 2024-04-16T19:38:04.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-1 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T19:38:04.268 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/c2-1 2024-04-16T19:38:04.326 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-2 on ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T19:38:04.326 DEBUG:teuthology.orchestra.run.smithi139:> sync && sudo umount -f /var/lib/ceph/osd/c2-2 2024-04-16T19:38:04.383 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-3 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T19:38:04.383 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/c2-3 2024-04-16T19:38:04.460 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-4 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T19:38:04.461 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/c2-4 2024-04-16T19:38:04.523 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-5 on ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T19:38:04.524 DEBUG:teuthology.orchestra.run.smithi163:> sync && sudo umount -f /var/lib/ceph/osd/c2-5 2024-04-16T19:38:04.588 INFO:tasks.ceph:Archiving mon data... 2024-04-16T19:38:04.589 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/mon/c2-a to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/data/c2.mon.a.tgz 2024-04-16T19:38:04.590 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2024-04-16T19:38:04.606 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.WLvDg5CTBm 2024-04-16T19:38:04.607 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/mon/c2-a -- . > /tmp/tmp.WLvDg5CTBm 2024-04-16T19:38:04.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.WLvDg5CTBm 2024-04-16T19:38:04.845 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.WLvDg5CTBm is 319KB 2024-04-16T19:38:04.943 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.WLvDg5CTBm 2024-04-16T19:38:04.958 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T19:38:04.959 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:38:04.962 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:38:04.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:38:05.000 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:38:05.033 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 556, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 364, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 269, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json' 2024-04-16T19:38:05.040 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-16T19:38:05.053 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2024-04-16T19:38:05.053 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:38:05.410 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:38:05.435 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:38:05.438 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3459,"stamp":"2024-04-16T19:38:04.493973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35609,"ondisk_log_size":35609,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":334184,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":322998,"kb_avail":628811416,"statfs":{"total":644245094400,"available":643902889984,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":330750625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005423"},"pg_stats":[{"pgid":"9.35","version":"53'18","reported_seq":516,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556486+0000","last_change":"2024-04-16T17:45:45.459835+0000","last_active":"2024-04-16T19:34:34.556486+0000","last_peered":"2024-04-16T19:34:34.556486+0000","last_clean":"2024-04-16T19:34:34.556486+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:34:34.556486+0000","last_undegraded":"2024-04-16T19:34:34.556486+0000","last_fullsized":"2024-04-16T19:34:34.556486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:41.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382165+0000","last_change":"2024-04-16T17:45:08.383247+0000","last_active":"2024-04-16T19:35:34.382165+0000","last_peered":"2024-04-16T19:35:34.382165+0000","last_clean":"2024-04-16T19:35:34.382165+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:35:34.382165+0000","last_undegraded":"2024-04-16T19:35:34.382165+0000","last_fullsized":"2024-04-16T19:35:34.382165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:20.213795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378639+0000","last_change":"2024-04-16T17:45:10.400343+0000","last_active":"2024-04-16T19:35:14.378639+0000","last_peered":"2024-04-16T19:35:14.378639+0000","last_clean":"2024-04-16T19:35:14.378639+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:35:14.378639+0000","last_undegraded":"2024-04-16T19:35:14.378639+0000","last_fullsized":"2024-04-16T19:35:14.378639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:34:35.746556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'6","reported_seq":288,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372581+0000","last_change":"2024-04-16T17:45:45.464134+0000","last_active":"2024-04-16T19:34:34.372581+0000","last_peered":"2024-04-16T19:34:34.372581+0000","last_clean":"2024-04-16T19:34:34.372581+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:34:34.372581+0000","last_undegraded":"2024-04-16T19:34:34.372581+0000","last_fullsized":"2024-04-16T19:34:34.372581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:29:54.124351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567746+0000","last_change":"2024-04-16T17:45:08.381595+0000","last_active":"2024-04-16T19:35:34.567746+0000","last_peered":"2024-04-16T19:35:34.567746+0000","last_clean":"2024-04-16T19:35:34.567746+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:35:34.567746+0000","last_undegraded":"2024-04-16T19:35:34.567746+0000","last_fullsized":"2024-04-16T19:35:34.567746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378769+0000","last_change":"2024-04-16T17:45:10.390675+0000","last_active":"2024-04-16T19:35:14.378769+0000","last_peered":"2024-04-16T19:35:14.378769+0000","last_clean":"2024-04-16T19:35:14.378769+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:35:14.378769+0000","last_undegraded":"2024-04-16T19:35:14.378769+0000","last_fullsized":"2024-04-16T19:35:14.378769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:26.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'7","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375036+0000","last_change":"2024-04-16T17:45:45.461571+0000","last_active":"2024-04-16T19:34:54.375036+0000","last_peered":"2024-04-16T19:34:54.375036+0000","last_clean":"2024-04-16T19:34:54.375036+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:34:54.375036+0000","last_undegraded":"2024-04-16T19:34:54.375036+0000","last_fullsized":"2024-04-16T19:34:54.375036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:19.904572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384092+0000","last_change":"2024-04-16T17:45:08.381577+0000","last_active":"2024-04-16T19:35:34.384092+0000","last_peered":"2024-04-16T19:35:34.384092+0000","last_clean":"2024-04-16T19:35:34.384092+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:35:34.384092+0000","last_undegraded":"2024-04-16T19:35:34.384092+0000","last_fullsized":"2024-04-16T19:35:34.384092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:58.984483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378103+0000","last_change":"2024-04-16T17:45:10.394273+0000","last_active":"2024-04-16T19:35:14.378103+0000","last_peered":"2024-04-16T19:35:14.378103+0000","last_clean":"2024-04-16T19:35:14.378103+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:35:14.378103+0000","last_undegraded":"2024-04-16T19:35:14.378103+0000","last_fullsized":"2024-04-16T19:35:14.378103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:54.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'7","reported_seq":246,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556535+0000","last_change":"2024-04-16T17:45:45.464927+0000","last_active":"2024-04-16T19:34:34.556535+0000","last_peered":"2024-04-16T19:34:34.556535+0000","last_clean":"2024-04-16T19:34:34.556535+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:34:34.556535+0000","last_undegraded":"2024-04-16T19:34:34.556535+0000","last_fullsized":"2024-04-16T19:34:34.556535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:29:54.124351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381354+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:35:29.381354+0000","last_peered":"2024-04-16T19:35:29.381354+0000","last_clean":"2024-04-16T19:35:29.381354+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:35:29.381354+0000","last_undegraded":"2024-04-16T19:35:29.381354+0000","last_fullsized":"2024-04-16T19:35:29.381354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:22.068786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.380496+0000","last_change":"2024-04-16T17:45:10.398320+0000","last_active":"2024-04-16T19:35:14.380496+0000","last_peered":"2024-04-16T19:35:14.380496+0000","last_clean":"2024-04-16T19:35:14.380496+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:35:14.380496+0000","last_undegraded":"2024-04-16T19:35:14.380496+0000","last_fullsized":"2024-04-16T19:35:14.380496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:10.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'7","reported_seq":515,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380346+0000","last_change":"2024-04-16T17:45:45.455611+0000","last_active":"2024-04-16T19:35:29.380346+0000","last_peered":"2024-04-16T19:35:29.380346+0000","last_clean":"2024-04-16T19:35:29.380346+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:35:29.380346+0000","last_undegraded":"2024-04-16T19:35:29.380346+0000","last_fullsized":"2024-04-16T19:35:29.380346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:39:55.884585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377968+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:35:09.377968+0000","last_peered":"2024-04-16T19:35:09.377968+0000","last_clean":"2024-04-16T19:35:09.377968+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:35:09.377968+0000","last_undegraded":"2024-04-16T19:35:09.377968+0000","last_fullsized":"2024-04-16T19:35:09.377968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382143+0000","last_change":"2024-04-16T17:45:10.395553+0000","last_active":"2024-04-16T19:35:34.382143+0000","last_peered":"2024-04-16T19:35:34.382143+0000","last_clean":"2024-04-16T19:35:34.382143+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:35:34.382143+0000","last_undegraded":"2024-04-16T19:35:34.382143+0000","last_fullsized":"2024-04-16T19:35:34.382143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:25.987507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'8","reported_seq":315,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383101+0000","last_change":"2024-04-16T17:45:45.464732+0000","last_active":"2024-04-16T19:35:29.383101+0000","last_peered":"2024-04-16T19:35:29.383101+0000","last_clean":"2024-04-16T19:35:29.383101+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:35:29.383101+0000","last_undegraded":"2024-04-16T19:35:29.383101+0000","last_fullsized":"2024-04-16T19:35:29.383101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:04.543134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547400+0000","last_change":"2024-04-16T17:46:16.500171+0000","last_active":"2024-04-16T19:33:49.547400+0000","last_peered":"2024-04-16T19:33:49.547400+0000","last_clean":"2024-04-16T19:33:49.547400+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:33:49.547400+0000","last_undegraded":"2024-04-16T19:33:49.547400+0000","last_fullsized":"2024-04-16T19:33:49.547400+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:24.673211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382318+0000","last_change":"2024-04-16T17:45:10.397556+0000","last_active":"2024-04-16T19:35:39.382318+0000","last_peered":"2024-04-16T19:35:39.382318+0000","last_clean":"2024-04-16T19:35:39.382318+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:35:39.382318+0000","last_undegraded":"2024-04-16T19:35:39.382318+0000","last_fullsized":"2024-04-16T19:35:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:31.534272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'8","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372376+0000","last_change":"2024-04-16T17:45:45.463411+0000","last_active":"2024-04-16T19:34:34.372376+0000","last_peered":"2024-04-16T19:34:34.372376+0000","last_clean":"2024-04-16T19:34:34.372376+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:34:34.372376+0000","last_undegraded":"2024-04-16T19:34:34.372376+0000","last_fullsized":"2024-04-16T19:34:34.372376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:36:34.046647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377851+0000","last_change":"2024-04-16T17:45:08.383652+0000","last_active":"2024-04-16T19:35:09.377851+0000","last_peered":"2024-04-16T19:35:09.377851+0000","last_clean":"2024-04-16T19:35:09.377851+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:35:09.377851+0000","last_undegraded":"2024-04-16T19:35:09.377851+0000","last_fullsized":"2024-04-16T19:35:09.377851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:04.729085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382949+0000","last_change":"2024-04-16T17:45:10.395876+0000","last_active":"2024-04-16T19:35:39.382949+0000","last_peered":"2024-04-16T19:35:39.382949+0000","last_clean":"2024-04-16T19:35:39.382949+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:35:39.382949+0000","last_undegraded":"2024-04-16T19:35:39.382949+0000","last_fullsized":"2024-04-16T19:35:39.382949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:22.221256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'6","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:29.360665+0000","last_change":"2024-04-16T17:45:45.457177+0000","last_active":"2024-04-16T19:33:29.360665+0000","last_peered":"2024-04-16T19:33:29.360665+0000","last_clean":"2024-04-16T19:33:29.360665+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:33:29.360665+0000","last_undegraded":"2024-04-16T19:33:29.360665+0000","last_fullsized":"2024-04-16T19:33:29.360665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:26.573550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562807+0000","last_change":"2024-04-16T17:45:08.389961+0000","last_active":"2024-04-16T19:35:09.562807+0000","last_peered":"2024-04-16T19:35:09.562807+0000","last_clean":"2024-04-16T19:35:09.562807+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:35:09.562807+0000","last_undegraded":"2024-04-16T19:35:09.562807+0000","last_fullsized":"2024-04-16T19:35:09.562807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:26.050144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568772+0000","last_change":"2024-04-16T17:45:10.399056+0000","last_active":"2024-04-16T19:35:39.568772+0000","last_peered":"2024-04-16T19:35:39.568772+0000","last_clean":"2024-04-16T19:35:39.568772+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:35:39.568772+0000","last_undegraded":"2024-04-16T19:35:39.568772+0000","last_fullsized":"2024-04-16T19:35:39.568772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:21.082747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'5","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368622+0000","last_change":"2024-04-16T17:45:45.462628+0000","last_active":"2024-04-16T19:34:09.368622+0000","last_peered":"2024-04-16T19:34:09.368622+0000","last_clean":"2024-04-16T19:34:09.368622+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:34:09.368622+0000","last_undegraded":"2024-04-16T19:34:09.368622+0000","last_fullsized":"2024-04-16T19:34:09.368622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374833+0000","last_change":"2024-04-16T17:45:10.394927+0000","last_active":"2024-04-16T19:34:54.374833+0000","last_peered":"2024-04-16T19:34:54.374833+0000","last_clean":"2024-04-16T19:34:54.374833+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:34:54.374833+0000","last_undegraded":"2024-04-16T19:34:54.374833+0000","last_fullsized":"2024-04-16T19:34:54.374833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:24.076247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369185+0000","last_change":"2024-04-16T17:45:08.388693+0000","last_active":"2024-04-16T19:34:14.369185+0000","last_peered":"2024-04-16T19:34:14.369185+0000","last_clean":"2024-04-16T19:34:14.369185+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:34:14.369185+0000","last_undegraded":"2024-04-16T19:34:14.369185+0000","last_fullsized":"2024-04-16T19:34:14.369185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.696516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'6","reported_seq":347,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368195+0000","last_change":"2024-04-16T17:45:45.462192+0000","last_active":"2024-04-16T19:34:09.368195+0000","last_peered":"2024-04-16T19:34:09.368195+0000","last_clean":"2024-04-16T19:34:09.368195+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:34:09.368195+0000","last_undegraded":"2024-04-16T19:34:09.368195+0000","last_fullsized":"2024-04-16T19:34:09.368195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:37.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375417+0000","last_change":"2024-04-16T17:45:10.393548+0000","last_active":"2024-04-16T19:34:54.375417+0000","last_peered":"2024-04-16T19:34:54.375417+0000","last_clean":"2024-04-16T19:34:54.375417+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:34:54.375417+0000","last_undegraded":"2024-04-16T19:34:54.375417+0000","last_fullsized":"2024-04-16T19:34:54.375417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:47.251006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365741+0000","last_change":"2024-04-16T17:45:08.388744+0000","last_active":"2024-04-16T19:33:54.365741+0000","last_peered":"2024-04-16T19:33:54.365741+0000","last_clean":"2024-04-16T19:33:54.365741+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:33:54.365741+0000","last_undegraded":"2024-04-16T19:33:54.365741+0000","last_fullsized":"2024-04-16T19:33:54.365741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'5","reported_seq":511,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551551+0000","last_change":"2024-04-16T17:45:45.456392+0000","last_active":"2024-04-16T19:34:09.551551+0000","last_peered":"2024-04-16T19:34:09.551551+0000","last_clean":"2024-04-16T19:34:09.551551+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:34:09.551551+0000","last_undegraded":"2024-04-16T19:34:09.551551+0000","last_fullsized":"2024-04-16T19:34:09.551551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:58:40.868531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378717+0000","last_change":"2024-04-16T17:45:10.392335+0000","last_active":"2024-04-16T19:35:14.378717+0000","last_peered":"2024-04-16T19:35:14.378717+0000","last_clean":"2024-04-16T19:35:14.378717+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:35:14.378717+0000","last_undegraded":"2024-04-16T19:35:14.378717+0000","last_fullsized":"2024-04-16T19:35:14.378717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:16.297430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365744+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:33:54.365744+0000","last_peered":"2024-04-16T19:33:54.365744+0000","last_clean":"2024-04-16T19:33:54.365744+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:33:54.365744+0000","last_undegraded":"2024-04-16T19:33:54.365744+0000","last_fullsized":"2024-04-16T19:33:54.365744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:36.615698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'10","reported_seq":234,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551468+0000","last_change":"2024-04-16T17:45:45.455448+0000","last_active":"2024-04-16T19:34:09.551468+0000","last_peered":"2024-04-16T19:34:09.551468+0000","last_clean":"2024-04-16T19:34:09.551468+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:34:09.551468+0000","last_undegraded":"2024-04-16T19:34:09.551468+0000","last_fullsized":"2024-04-16T19:34:09.551468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:50.309523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549442+0000","last_change":"2024-04-16T17:45:10.391411+0000","last_active":"2024-04-16T19:33:59.549442+0000","last_peered":"2024-04-16T19:33:59.549442+0000","last_clean":"2024-04-16T19:33:59.549442+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:33:59.549442+0000","last_undegraded":"2024-04-16T19:33:59.549442+0000","last_fullsized":"2024-04-16T19:33:59.549442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:30:53.218689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365154+0000","last_change":"2024-04-16T17:45:08.382324+0000","last_active":"2024-04-16T19:33:54.365154+0000","last_peered":"2024-04-16T19:33:54.365154+0000","last_clean":"2024-04-16T19:33:54.365154+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:33:54.365154+0000","last_undegraded":"2024-04-16T19:33:54.365154+0000","last_fullsized":"2024-04-16T19:33:54.365154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"48'6","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360042+0000","last_change":"2024-04-16T17:45:45.460928+0000","last_active":"2024-04-16T19:33:19.360042+0000","last_peered":"2024-04-16T19:33:19.360042+0000","last_clean":"2024-04-16T19:33:19.360042+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:33:19.360042+0000","last_undegraded":"2024-04-16T19:33:19.360042+0000","last_fullsized":"2024-04-16T19:33:19.360042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549478+0000","last_change":"2024-04-16T17:45:10.393503+0000","last_active":"2024-04-16T19:33:59.549478+0000","last_peered":"2024-04-16T19:33:59.549478+0000","last_clean":"2024-04-16T19:33:59.549478+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:33:59.549478+0000","last_undegraded":"2024-04-16T19:33:59.549478+0000","last_fullsized":"2024-04-16T19:33:59.549478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:06:00.869577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367265+0000","last_change":"2024-04-16T17:45:08.387116+0000","last_active":"2024-04-16T19:33:54.367265+0000","last_peered":"2024-04-16T19:33:54.367265+0000","last_clean":"2024-04-16T19:33:54.367265+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:33:54.367265+0000","last_undegraded":"2024-04-16T19:33:54.367265+0000","last_fullsized":"2024-04-16T19:33:54.367265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:04.729085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"48'1","reported_seq":222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541511+0000","last_change":"2024-04-16T17:45:45.455236+0000","last_active":"2024-04-16T19:33:19.541511+0000","last_peered":"2024-04-16T19:33:19.541511+0000","last_clean":"2024-04-16T19:33:19.541511+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:33:19.541511+0000","last_undegraded":"2024-04-16T19:33:19.541511+0000","last_fullsized":"2024-04-16T19:33:19.541511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:40.520396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366097+0000","last_change":"2024-04-16T17:45:10.397627+0000","last_active":"2024-04-16T19:33:59.366097+0000","last_peered":"2024-04-16T19:33:59.366097+0000","last_clean":"2024-04-16T19:33:59.366097+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:33:59.366097+0000","last_undegraded":"2024-04-16T19:33:59.366097+0000","last_fullsized":"2024-04-16T19:33:59.366097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:50.581378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.548455+0000","last_change":"2024-04-16T17:46:16.498581+0000","last_active":"2024-04-16T19:33:54.548455+0000","last_peered":"2024-04-16T19:33:54.548455+0000","last_clean":"2024-04-16T19:33:54.548455+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:33:54.548455+0000","last_undegraded":"2024-04-16T19:33:54.548455+0000","last_fullsized":"2024-04-16T19:33:54.548455+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:53.339943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555516+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:34:29.555516+0000","last_peered":"2024-04-16T19:34:29.555516+0000","last_clean":"2024-04-16T19:34:29.555516+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:34:29.555516+0000","last_undegraded":"2024-04-16T19:34:29.555516+0000","last_fullsized":"2024-04-16T19:34:29.555516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:29:46.401023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'145","reported_seq":2257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374839+0000","last_change":"2024-04-16T17:46:25.527767+0000","last_active":"2024-04-16T19:34:49.374839+0000","last_peered":"2024-04-16T19:34:49.374839+0000","last_clean":"2024-04-16T19:34:49.374839+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:34:49.374839+0000","last_undegraded":"2024-04-16T19:34:49.374839+0000","last_fullsized":"2024-04-16T19:34:49.374839+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:25.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364929+0000","last_change":"2024-04-16T17:46:17.511976+0000","last_active":"2024-04-16T19:33:49.364929+0000","last_peered":"2024-04-16T19:33:49.364929+0000","last_clean":"2024-04-16T19:33:49.364929+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:33:49.364929+0000","last_undegraded":"2024-04-16T19:33:49.364929+0000","last_fullsized":"2024-04-16T19:33:49.364929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'20","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.362629+0000","last_change":"2024-04-16T17:45:51.478677+0000","last_active":"2024-04-16T19:33:24.362629+0000","last_peered":"2024-04-16T19:33:24.362629+0000","last_clean":"2024-04-16T19:33:24.362629+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:33:24.362629+0000","last_undegraded":"2024-04-16T19:33:24.362629+0000","last_fullsized":"2024-04-16T19:33:24.362629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:04.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359188+0000","last_change":"2024-04-16T17:45:49.472385+0000","last_active":"2024-04-16T19:33:19.359188+0000","last_peered":"2024-04-16T19:33:19.359188+0000","last_clean":"2024-04-16T19:33:19.359188+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:33:19.359188+0000","last_undegraded":"2024-04-16T19:33:19.359188+0000","last_fullsized":"2024-04-16T19:33:19.359188+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:24.302917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'243","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360107+0000","last_change":"2024-04-16T17:45:47.462219+0000","last_active":"2024-04-16T19:33:19.360107+0000","last_peered":"2024-04-16T19:33:19.360107+0000","last_clean":"2024-04-16T19:33:19.360107+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:33:19.360107+0000","last_undegraded":"2024-04-16T19:33:19.360107+0000","last_fullsized":"2024-04-16T19:33:19.360107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:34.349862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'9","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379588+0000","last_change":"2024-04-16T17:46:16.500449+0000","last_active":"2024-04-16T19:35:24.379588+0000","last_peered":"2024-04-16T19:35:24.379588+0000","last_clean":"2024-04-16T19:35:24.379588+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:35:24.379588+0000","last_undegraded":"2024-04-16T19:35:24.379588+0000","last_fullsized":"2024-04-16T19:35:24.379588+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368583+0000","last_change":"2024-04-16T17:45:26.430602+0000","last_active":"2024-04-16T19:34:14.368583+0000","last_peered":"2024-04-16T19:34:14.368583+0000","last_clean":"2024-04-16T19:34:14.368583+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:34:14.368583+0000","last_undegraded":"2024-04-16T19:34:14.368583+0000","last_fullsized":"2024-04-16T19:34:14.368583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:21.500912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562932+0000","last_change":"2024-04-16T17:45:10.400976+0000","last_active":"2024-04-16T19:35:09.562932+0000","last_peered":"2024-04-16T19:35:09.562932+0000","last_clean":"2024-04-16T19:35:09.562932+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:35:09.562932+0000","last_undegraded":"2024-04-16T19:35:09.562932+0000","last_fullsized":"2024-04-16T19:35:09.562932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:58.273468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374754+0000","last_change":"2024-04-16T17:45:08.388375+0000","last_active":"2024-04-16T19:34:49.374754+0000","last_peered":"2024-04-16T19:34:49.374754+0000","last_clean":"2024-04-16T19:34:49.374754+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:34:49.374754+0000","last_undegraded":"2024-04-16T19:34:49.374754+0000","last_fullsized":"2024-04-16T19:34:49.374754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:23.980045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368590+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:34:09.368590+0000","last_peered":"2024-04-16T19:34:09.368590+0000","last_clean":"2024-04-16T19:34:09.368590+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:34:09.368590+0000","last_undegraded":"2024-04-16T19:34:09.368590+0000","last_fullsized":"2024-04-16T19:34:09.368590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:29.584282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370069+0000","last_change":"2024-04-16T17:45:22.417279+0000","last_active":"2024-04-16T19:34:09.370069+0000","last_peered":"2024-04-16T19:34:09.370069+0000","last_clean":"2024-04-16T19:34:09.370069+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:34:09.370069+0000","last_undegraded":"2024-04-16T19:34:09.370069+0000","last_fullsized":"2024-04-16T19:34:09.370069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:45.675762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368788+0000","last_change":"2024-04-16T17:45:24.425550+0000","last_active":"2024-04-16T19:34:09.368788+0000","last_peered":"2024-04-16T19:34:09.368788+0000","last_clean":"2024-04-16T19:34:09.368788+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:34:09.368788+0000","last_undegraded":"2024-04-16T19:34:09.368788+0000","last_fullsized":"2024-04-16T19:34:09.368788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:35.470227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.565057+0000","last_change":"2024-04-16T18:09:02.170333+0000","last_active":"2024-04-16T19:35:19.565057+0000","last_peered":"2024-04-16T19:35:19.565057+0000","last_clean":"2024-04-16T19:35:19.565057+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:35:19.565057+0000","last_undegraded":"2024-04-16T19:35:19.565057+0000","last_fullsized":"2024-04-16T19:35:19.565057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:27:55.951446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1987,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382967+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:35:39.382967+0000","last_peered":"2024-04-16T19:35:39.382967+0000","last_clean":"2024-04-16T19:35:39.382967+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:35:39.382967+0000","last_undegraded":"2024-04-16T19:35:39.382967+0000","last_fullsized":"2024-04-16T19:35:39.382967+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:13:06.759819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:46:17.506966+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'7","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.362660+0000","last_change":"2024-04-16T17:45:51.478975+0000","last_active":"2024-04-16T19:33:24.362660+0000","last_peered":"2024-04-16T19:33:24.362660+0000","last_clean":"2024-04-16T19:33:24.362660+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:33:24.362660+0000","last_undegraded":"2024-04-16T19:33:24.362660+0000","last_fullsized":"2024-04-16T19:33:24.362660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:26.313448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359820+0000","last_change":"2024-04-16T17:45:49.473313+0000","last_active":"2024-04-16T19:33:19.359820+0000","last_peered":"2024-04-16T19:33:19.359820+0000","last_clean":"2024-04-16T19:33:19.359820+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:33:19.359820+0000","last_undegraded":"2024-04-16T19:33:19.359820+0000","last_fullsized":"2024-04-16T19:33:19.359820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:36.356992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'189","reported_seq":458,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541651+0000","last_change":"2024-04-16T17:45:47.463699+0000","last_active":"2024-04-16T19:33:19.541651+0000","last_peered":"2024-04-16T19:33:19.541651+0000","last_clean":"2024-04-16T19:33:19.541651+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:33:19.541651+0000","last_undegraded":"2024-04-16T19:33:19.541651+0000","last_fullsized":"2024-04-16T19:33:19.541651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:18:11.449981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'28","reported_seq":315,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372405+0000","last_change":"2024-04-16T17:45:45.456848+0000","last_active":"2024-04-16T19:34:34.372405+0000","last_peered":"2024-04-16T19:34:34.372405+0000","last_clean":"2024-04-16T19:34:34.372405+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:34:34.372405+0000","last_undegraded":"2024-04-16T19:34:34.372405+0000","last_fullsized":"2024-04-16T19:34:34.372405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:38.609449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:26.439840+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.458913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366576+0000","last_change":"2024-04-16T17:45:10.395070+0000","last_active":"2024-04-16T19:33:59.366576+0000","last_peered":"2024-04-16T19:33:59.366576+0000","last_clean":"2024-04-16T19:33:59.366576+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:33:59.366576+0000","last_undegraded":"2024-04-16T19:33:59.366576+0000","last_fullsized":"2024-04-16T19:33:59.366576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:00.458421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376338+0000","last_change":"2024-04-16T17:45:08.390752+0000","last_active":"2024-04-16T19:34:49.376338+0000","last_peered":"2024-04-16T19:34:49.376338+0000","last_clean":"2024-04-16T19:34:49.376338+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:34:49.376338+0000","last_undegraded":"2024-04-16T19:34:49.376338+0000","last_fullsized":"2024-04-16T19:34:49.376338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:51.718429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"48'17","reported_seq":894,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382229+0000","last_change":"2024-04-16T17:45:20.413278+0000","last_active":"2024-04-16T19:35:24.382229+0000","last_peered":"2024-04-16T19:35:24.382229+0000","last_clean":"2024-04-16T19:35:24.382229+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:35:24.382229+0000","last_undegraded":"2024-04-16T19:35:24.382229+0000","last_fullsized":"2024-04-16T19:35:24.382229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:21:09.196060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'72","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368021+0000","last_change":"2024-04-16T17:45:22.414776+0000","last_active":"2024-04-16T19:34:09.368021+0000","last_peered":"2024-04-16T19:34:09.368021+0000","last_clean":"2024-04-16T19:34:09.368021+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:34:09.368021+0000","last_undegraded":"2024-04-16T19:34:09.368021+0000","last_fullsized":"2024-04-16T19:34:09.368021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:22.839078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367997+0000","last_change":"2024-04-16T17:45:24.423655+0000","last_active":"2024-04-16T19:34:09.367997+0000","last_peered":"2024-04-16T19:34:09.367997+0000","last_clean":"2024-04-16T19:34:09.367997+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:34:09.367997+0000","last_undegraded":"2024-04-16T19:34:09.367997+0000","last_fullsized":"2024-04-16T19:34:09.367997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:24.311652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366892+0000","last_change":"2024-04-16T18:09:02.164735+0000","last_active":"2024-04-16T19:34:04.366892+0000","last_peered":"2024-04-16T19:34:04.366892+0000","last_clean":"2024-04-16T19:34:04.366892+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:34:04.366892+0000","last_undegraded":"2024-04-16T19:34:04.366892+0000","last_fullsized":"2024-04-16T19:34:04.366892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:53:57.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'228","reported_seq":2120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368272+0000","last_change":"2024-04-16T17:46:25.526441+0000","last_active":"2024-04-16T19:33:59.368272+0000","last_peered":"2024-04-16T19:33:59.368272+0000","last_clean":"2024-04-16T19:33:59.368272+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:33:59.368272+0000","last_undegraded":"2024-04-16T19:33:59.368272+0000","last_fullsized":"2024-04-16T19:33:59.368272+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:53:10.911757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372528+0000","last_change":"2024-04-16T17:46:17.506064+0000","last_active":"2024-04-16T19:34:39.372528+0000","last_peered":"2024-04-16T19:34:39.372528+0000","last_clean":"2024-04-16T19:34:39.372528+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:34:39.372528+0000","last_undegraded":"2024-04-16T19:34:39.372528+0000","last_fullsized":"2024-04-16T19:34:39.372528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:04.395735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'7","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368727+0000","last_change":"2024-04-16T17:45:51.480549+0000","last_active":"2024-04-16T19:34:14.368727+0000","last_peered":"2024-04-16T19:34:14.368727+0000","last_clean":"2024-04-16T19:34:14.368727+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:34:14.368727+0000","last_undegraded":"2024-04-16T19:34:14.368727+0000","last_fullsized":"2024-04-16T19:34:14.368727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:40.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.377125+0000","last_change":"2024-04-16T17:45:49.476408+0000","last_active":"2024-04-16T19:34:54.377125+0000","last_peered":"2024-04-16T19:34:54.377125+0000","last_clean":"2024-04-16T19:34:54.377125+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:34:54.377125+0000","last_undegraded":"2024-04-16T19:34:54.377125+0000","last_fullsized":"2024-04-16T19:34:54.377125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:00.700374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'266","reported_seq":586,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556354+0000","last_change":"2024-04-16T17:45:47.458082+0000","last_active":"2024-04-16T19:34:34.556354+0000","last_peered":"2024-04-16T19:34:34.556354+0000","last_clean":"2024-04-16T19:34:34.556354+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:34:34.556354+0000","last_undegraded":"2024-04-16T19:34:34.556354+0000","last_fullsized":"2024-04-16T19:34:34.556354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:28.580742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'11","reported_seq":187,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361676+0000","last_change":"2024-04-16T17:45:45.463326+0000","last_active":"2024-04-16T19:33:19.361676+0000","last_peered":"2024-04-16T19:33:19.361676+0000","last_clean":"2024-04-16T19:33:19.361676+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:33:19.361676+0000","last_undegraded":"2024-04-16T19:33:19.361676+0000","last_fullsized":"2024-04-16T19:33:19.361676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:14.781901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383151+0000","last_change":"2024-04-16T17:45:26.438624+0000","last_active":"2024-04-16T19:35:29.383151+0000","last_peered":"2024-04-16T19:35:29.383151+0000","last_clean":"2024-04-16T19:35:29.383151+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:35:29.383151+0000","last_undegraded":"2024-04-16T19:35:29.383151+0000","last_fullsized":"2024-04-16T19:35:29.383151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:47.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368347+0000","last_change":"2024-04-16T17:45:10.398271+0000","last_active":"2024-04-16T19:33:59.368347+0000","last_peered":"2024-04-16T19:33:59.368347+0000","last_clean":"2024-04-16T19:33:59.368347+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:33:59.368347+0000","last_undegraded":"2024-04-16T19:33:59.368347+0000","last_fullsized":"2024-04-16T19:33:59.368347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:27.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374677+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:34:49.374677+0000","last_peered":"2024-04-16T19:34:49.374677+0000","last_clean":"2024-04-16T19:34:49.374677+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:34:49.374677+0000","last_undegraded":"2024-04-16T19:34:49.374677+0000","last_fullsized":"2024-04-16T19:34:49.374677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:37.582239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551538+0000","last_change":"2024-04-16T17:45:20.406137+0000","last_active":"2024-04-16T19:34:09.551538+0000","last_peered":"2024-04-16T19:34:09.551538+0000","last_clean":"2024-04-16T19:34:09.551538+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:34:09.551538+0000","last_undegraded":"2024-04-16T19:34:09.551538+0000","last_fullsized":"2024-04-16T19:34:09.551538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:49.607445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'120","reported_seq":294,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.565010+0000","last_change":"2024-04-16T17:45:22.421567+0000","last_active":"2024-04-16T19:35:19.565010+0000","last_peered":"2024-04-16T19:35:19.565010+0000","last_clean":"2024-04-16T19:35:19.565010+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:35:19.565010+0000","last_undegraded":"2024-04-16T19:35:19.565010+0000","last_fullsized":"2024-04-16T19:35:19.565010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:08.015854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'12","reported_seq":1387,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368244+0000","last_change":"2024-04-16T17:45:24.425583+0000","last_active":"2024-04-16T19:34:09.368244+0000","last_peered":"2024-04-16T19:34:09.368244+0000","last_clean":"2024-04-16T19:34:09.368244+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:34:09.368244+0000","last_undegraded":"2024-04-16T19:34:09.368244+0000","last_fullsized":"2024-04-16T19:34:09.368244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:56.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550442+0000","last_change":"2024-04-16T18:09:02.169752+0000","last_active":"2024-04-16T19:34:04.550442+0000","last_peered":"2024-04-16T19:34:04.550442+0000","last_clean":"2024-04-16T19:34:04.550442+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:34:04.550442+0000","last_undegraded":"2024-04-16T19:34:04.550442+0000","last_fullsized":"2024-04-16T19:34:04.550442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:22:34.279270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'151","reported_seq":2294,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368309+0000","last_change":"2024-04-16T17:46:25.529267+0000","last_active":"2024-04-16T19:33:59.368309+0000","last_peered":"2024-04-16T19:33:59.368309+0000","last_clean":"2024-04-16T19:33:59.368309+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:33:59.368309+0000","last_undegraded":"2024-04-16T19:33:59.368309+0000","last_fullsized":"2024-04-16T19:33:59.368309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:31.289154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372494+0000","last_change":"2024-04-16T17:46:17.509588+0000","last_active":"2024-04-16T19:34:39.372494+0000","last_peered":"2024-04-16T19:34:39.372494+0000","last_clean":"2024-04-16T19:34:39.372494+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:34:39.372494+0000","last_undegraded":"2024-04-16T19:34:39.372494+0000","last_fullsized":"2024-04-16T19:34:39.372494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:18:19.084200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'9","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369221+0000","last_change":"2024-04-16T17:45:51.478968+0000","last_active":"2024-04-16T19:34:14.369221+0000","last_peered":"2024-04-16T19:34:14.369221+0000","last_clean":"2024-04-16T19:34:14.369221+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:34:14.369221+0000","last_undegraded":"2024-04-16T19:34:14.369221+0000","last_fullsized":"2024-04-16T19:34:14.369221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556324+0000","last_change":"2024-04-16T17:45:49.463675+0000","last_active":"2024-04-16T19:34:34.556324+0000","last_peered":"2024-04-16T19:34:34.556324+0000","last_clean":"2024-04-16T19:34:34.556324+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:34:34.556324+0000","last_undegraded":"2024-04-16T19:34:34.556324+0000","last_fullsized":"2024-04-16T19:34:34.556324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:07:05.659899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5965","reported_seq":12521,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559078+0000","last_change":"2024-04-16T17:45:47.459844+0000","last_active":"2024-04-16T19:34:49.559078+0000","last_peered":"2024-04-16T19:34:49.559078+0000","last_clean":"2024-04-16T19:34:49.559078+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:34:49.559078+0000","last_undegraded":"2024-04-16T19:34:49.559078+0000","last_fullsized":"2024-04-16T19:34:49.559078+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1765,"log_dups_size":3000,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:32.414801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'8","reported_seq":567,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541614+0000","last_change":"2024-04-16T17:45:45.457864+0000","last_active":"2024-04-16T19:33:19.541614+0000","last_peered":"2024-04-16T19:33:19.541614+0000","last_clean":"2024-04-16T19:33:19.541614+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:33:19.541614+0000","last_undegraded":"2024-04-16T19:33:19.541614+0000","last_fullsized":"2024-04-16T19:33:19.541614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.288595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380397+0000","last_change":"2024-04-16T17:45:26.848748+0000","last_active":"2024-04-16T19:35:29.380397+0000","last_peered":"2024-04-16T19:35:29.380397+0000","last_clean":"2024-04-16T19:35:29.380397+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:35:29.380397+0000","last_undegraded":"2024-04-16T19:35:29.380397+0000","last_fullsized":"2024-04-16T19:35:29.380397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:47.873610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368378+0000","last_change":"2024-04-16T17:45:10.391762+0000","last_active":"2024-04-16T19:33:59.368378+0000","last_peered":"2024-04-16T19:33:59.368378+0000","last_clean":"2024-04-16T19:33:59.368378+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:33:59.368378+0000","last_undegraded":"2024-04-16T19:33:59.368378+0000","last_fullsized":"2024-04-16T19:33:59.368378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:22:56.234389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374595+0000","last_change":"2024-04-16T17:45:08.387257+0000","last_active":"2024-04-16T19:34:49.374595+0000","last_peered":"2024-04-16T19:34:49.374595+0000","last_clean":"2024-04-16T19:34:49.374595+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:34:49.374595+0000","last_undegraded":"2024-04-16T19:34:49.374595+0000","last_fullsized":"2024-04-16T19:34:49.374595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"48'1","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368272+0000","last_change":"2024-04-16T17:45:20.405143+0000","last_active":"2024-04-16T19:34:09.368272+0000","last_peered":"2024-04-16T19:34:09.368272+0000","last_clean":"2024-04-16T19:34:09.368272+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:34:09.368272+0000","last_undegraded":"2024-04-16T19:34:09.368272+0000","last_fullsized":"2024-04-16T19:34:09.368272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:09.457037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368233+0000","last_change":"2024-04-16T17:45:22.421942+0000","last_active":"2024-04-16T19:34:09.368233+0000","last_peered":"2024-04-16T19:34:09.368233+0000","last_clean":"2024-04-16T19:34:09.368233+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:34:09.368233+0000","last_undegraded":"2024-04-16T19:34:09.368233+0000","last_fullsized":"2024-04-16T19:34:09.368233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:15.139787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'12","reported_seq":1389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564929+0000","last_change":"2024-04-16T17:45:24.424033+0000","last_active":"2024-04-16T19:35:19.564929+0000","last_peered":"2024-04-16T19:35:19.564929+0000","last_clean":"2024-04-16T19:35:19.564929+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:35:19.564929+0000","last_undegraded":"2024-04-16T19:35:19.564929+0000","last_fullsized":"2024-04-16T19:35:19.564929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:45.865876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370952+0000","last_change":"2024-04-16T18:09:02.168123+0000","last_active":"2024-04-16T19:34:29.370952+0000","last_peered":"2024-04-16T19:34:29.370952+0000","last_clean":"2024-04-16T19:34:29.370952+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:34:29.370952+0000","last_undegraded":"2024-04-16T19:34:29.370952+0000","last_fullsized":"2024-04-16T19:34:29.370952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:02.737644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374715+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:34:49.374715+0000","last_peered":"2024-04-16T19:34:49.374715+0000","last_clean":"2024-04-16T19:34:49.374715+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:34:49.374715+0000","last_undegraded":"2024-04-16T19:34:49.374715+0000","last_fullsized":"2024-04-16T19:34:49.374715+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:18:49.538603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373127+0000","last_change":"2024-04-16T17:46:17.508941+0000","last_active":"2024-04-16T19:34:39.373127+0000","last_peered":"2024-04-16T19:34:39.373127+0000","last_clean":"2024-04-16T19:34:39.373127+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:34:39.373127+0000","last_undegraded":"2024-04-16T19:34:39.373127+0000","last_fullsized":"2024-04-16T19:34:39.373127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'11","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368550+0000","last_change":"2024-04-16T17:45:51.478686+0000","last_active":"2024-04-16T19:34:14.368550+0000","last_peered":"2024-04-16T19:34:14.368550+0000","last_clean":"2024-04-16T19:34:14.368550+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:34:14.368550+0000","last_undegraded":"2024-04-16T19:34:14.368550+0000","last_fullsized":"2024-04-16T19:34:14.368550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:45.109744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368764+0000","last_change":"2024-04-16T17:45:49.469263+0000","last_active":"2024-04-16T19:34:09.368764+0000","last_peered":"2024-04-16T19:34:09.368764+0000","last_clean":"2024-04-16T19:34:09.368764+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:34:09.368764+0000","last_undegraded":"2024-04-16T19:34:09.368764+0000","last_fullsized":"2024-04-16T19:34:09.368764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:05.755199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1575","reported_seq":46963,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368707+0000","last_change":"2024-04-16T17:45:47.466556+0000","last_active":"2024-04-16T19:34:09.368707+0000","last_peered":"2024-04-16T19:34:09.368707+0000","last_clean":"2024-04-16T19:34:09.368707+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:34:09.368707+0000","last_undegraded":"2024-04-16T19:34:09.368707+0000","last_fullsized":"2024-04-16T19:34:09.368707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:29.536656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'6","reported_seq":221,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373464+0000","last_change":"2024-04-16T17:45:45.466165+0000","last_active":"2024-04-16T19:34:29.373464+0000","last_peered":"2024-04-16T19:34:29.373464+0000","last_clean":"2024-04-16T19:34:29.373464+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:34:29.373464+0000","last_undegraded":"2024-04-16T19:34:29.373464+0000","last_fullsized":"2024-04-16T19:34:29.373464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:58.879936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383551+0000","last_change":"2024-04-16T17:45:10.393324+0000","last_active":"2024-04-16T19:35:44.383551+0000","last_peered":"2024-04-16T19:35:44.383551+0000","last_clean":"2024-04-16T19:35:44.383551+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:35:44.383551+0000","last_undegraded":"2024-04-16T19:35:44.383551+0000","last_fullsized":"2024-04-16T19:35:44.383551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:27.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383794+0000","last_change":"2024-04-16T17:45:08.389843+0000","last_active":"2024-04-16T19:35:44.383794+0000","last_peered":"2024-04-16T19:35:44.383794+0000","last_clean":"2024-04-16T19:35:44.383794+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:35:44.383794+0000","last_undegraded":"2024-04-16T19:35:44.383794+0000","last_fullsized":"2024-04-16T19:35:44.383794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"48'5","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385115+0000","last_change":"2024-04-16T17:45:20.407401+0000","last_active":"2024-04-16T19:35:54.385115+0000","last_peered":"2024-04-16T19:35:54.385115+0000","last_clean":"2024-04-16T19:35:54.385115+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:35:54.385115+0000","last_undegraded":"2024-04-16T19:35:54.385115+0000","last_fullsized":"2024-04-16T19:35:54.385115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:50.080567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'200","reported_seq":422,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367499+0000","last_change":"2024-04-16T17:45:22.417459+0000","last_active":"2024-04-16T19:34:04.367499+0000","last_peered":"2024-04-16T19:34:04.367499+0000","last_clean":"2024-04-16T19:34:04.367499+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:34:04.367499+0000","last_undegraded":"2024-04-16T19:34:04.367499+0000","last_fullsized":"2024-04-16T19:34:04.367499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:29.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568642+0000","last_change":"2024-04-16T17:45:24.430630+0000","last_active":"2024-04-16T19:35:39.568642+0000","last_peered":"2024-04-16T19:35:39.568642+0000","last_clean":"2024-04-16T19:35:39.568642+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:35:39.568642+0000","last_undegraded":"2024-04-16T19:35:39.568642+0000","last_fullsized":"2024-04-16T19:35:39.568642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:31.152537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385225+0000","last_change":"2024-04-16T17:45:26.438929+0000","last_active":"2024-04-16T19:35:54.385225+0000","last_peered":"2024-04-16T19:35:54.385225+0000","last_clean":"2024-04-16T19:35:54.385225+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:35:54.385225+0000","last_undegraded":"2024-04-16T19:35:54.385225+0000","last_fullsized":"2024-04-16T19:35:54.385225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:58.263370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555397+0000","last_change":"2024-04-16T18:09:02.169539+0000","last_active":"2024-04-16T19:34:29.555397+0000","last_peered":"2024-04-16T19:34:29.555397+0000","last_clean":"2024-04-16T19:34:29.555397+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:34:29.555397+0000","last_undegraded":"2024-04-16T19:34:29.555397+0000","last_fullsized":"2024-04-16T19:34:29.555397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:10.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376408+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:34:49.376408+0000","last_peered":"2024-04-16T19:34:49.376408+0000","last_clean":"2024-04-16T19:34:49.376408+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:34:49.376408+0000","last_undegraded":"2024-04-16T19:34:49.376408+0000","last_fullsized":"2024-04-16T19:34:49.376408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:21.896379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373066+0000","last_change":"2024-04-16T17:46:17.512578+0000","last_active":"2024-04-16T19:34:39.373066+0000","last_peered":"2024-04-16T19:34:39.373066+0000","last_clean":"2024-04-16T19:34:39.373066+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:34:39.373066+0000","last_undegraded":"2024-04-16T19:34:39.373066+0000","last_fullsized":"2024-04-16T19:34:39.373066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"48'3","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368951+0000","last_change":"2024-04-16T17:45:51.480862+0000","last_active":"2024-04-16T19:34:14.368951+0000","last_peered":"2024-04-16T19:34:14.368951+0000","last_clean":"2024-04-16T19:34:14.368951+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:34:14.368951+0000","last_undegraded":"2024-04-16T19:34:14.368951+0000","last_fullsized":"2024-04-16T19:34:14.368951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:04.680783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370021+0000","last_change":"2024-04-16T17:45:49.473179+0000","last_active":"2024-04-16T19:34:09.370021+0000","last_peered":"2024-04-16T19:34:09.370021+0000","last_clean":"2024-04-16T19:34:09.370021+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:34:09.370021+0000","last_undegraded":"2024-04-16T19:34:09.370021+0000","last_fullsized":"2024-04-16T19:34:09.370021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:05.755199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'338","reported_seq":637,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368333+0000","last_change":"2024-04-16T17:45:47.458262+0000","last_active":"2024-04-16T19:34:09.368333+0000","last_peered":"2024-04-16T19:34:09.368333+0000","last_clean":"2024-04-16T19:34:09.368333+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:34:09.368333+0000","last_undegraded":"2024-04-16T19:34:09.368333+0000","last_fullsized":"2024-04-16T19:34:09.368333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:56.475222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'10","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551369+0000","last_change":"2024-04-16T17:45:45.466171+0000","last_active":"2024-04-16T19:34:09.551369+0000","last_peered":"2024-04-16T19:34:09.551369+0000","last_clean":"2024-04-16T19:34:09.551369+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:34:09.551369+0000","last_undegraded":"2024-04-16T19:34:09.551369+0000","last_fullsized":"2024-04-16T19:34:09.551369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:55:30.430838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.382936+0000","last_change":"2024-04-16T17:45:10.402167+0000","last_active":"2024-04-16T19:35:44.382936+0000","last_peered":"2024-04-16T19:35:44.382936+0000","last_clean":"2024-04-16T19:35:44.382936+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:35:44.382936+0000","last_undegraded":"2024-04-16T19:35:44.382936+0000","last_fullsized":"2024-04-16T19:35:44.382936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:38.623160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380567+0000","last_change":"2024-04-16T17:45:08.388824+0000","last_active":"2024-04-16T19:35:24.380567+0000","last_peered":"2024-04-16T19:35:24.380567+0000","last_clean":"2024-04-16T19:35:24.380567+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:35:24.380567+0000","last_undegraded":"2024-04-16T19:35:24.380567+0000","last_fullsized":"2024-04-16T19:35:24.380567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546334+0000","last_change":"2024-04-16T17:45:20.407298+0000","last_active":"2024-04-16T19:33:44.546334+0000","last_peered":"2024-04-16T19:33:44.546334+0000","last_clean":"2024-04-16T19:33:44.546334+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:33:44.546334+0000","last_undegraded":"2024-04-16T19:33:44.546334+0000","last_fullsized":"2024-04-16T19:33:44.546334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:10.777542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'80","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568625+0000","last_change":"2024-04-16T17:45:22.422669+0000","last_active":"2024-04-16T19:35:39.568625+0000","last_peered":"2024-04-16T19:35:39.568625+0000","last_clean":"2024-04-16T19:35:39.568625+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:35:39.568625+0000","last_undegraded":"2024-04-16T19:35:39.568625+0000","last_fullsized":"2024-04-16T19:35:39.568625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:31.592115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549386+0000","last_change":"2024-04-16T17:45:24.425962+0000","last_active":"2024-04-16T19:33:59.549386+0000","last_peered":"2024-04-16T19:33:59.549386+0000","last_clean":"2024-04-16T19:33:59.549386+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:33:59.549386+0000","last_undegraded":"2024-04-16T19:33:59.549386+0000","last_fullsized":"2024-04-16T19:33:59.549386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:55.736964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367958+0000","last_change":"2024-04-16T17:45:26.429668+0000","last_active":"2024-04-16T19:34:09.367958+0000","last_peered":"2024-04-16T19:34:09.367958+0000","last_clean":"2024-04-16T19:34:09.367958+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:34:09.367958+0000","last_undegraded":"2024-04-16T19:34:09.367958+0000","last_fullsized":"2024-04-16T19:34:09.367958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:33.160271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371461+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:34:29.371461+0000","last_peered":"2024-04-16T19:34:29.371461+0000","last_clean":"2024-04-16T19:34:29.371461+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:34:29.371461+0000","last_undegraded":"2024-04-16T19:34:29.371461+0000","last_fullsized":"2024-04-16T19:34:29.371461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'120","reported_seq":2585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.558155+0000","last_change":"2024-04-16T17:46:25.531706+0000","last_active":"2024-04-16T19:34:44.558155+0000","last_peered":"2024-04-16T19:34:44.558155+0000","last_clean":"2024-04-16T19:34:44.558155+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:34:44.558155+0000","last_undegraded":"2024-04-16T19:34:44.558155+0000","last_fullsized":"2024-04-16T19:34:44.558155+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:15.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.374879+0000","last_change":"2024-04-16T17:46:17.508571+0000","last_active":"2024-04-16T19:34:39.374879+0000","last_peered":"2024-04-16T19:34:39.374879+0000","last_clean":"2024-04-16T19:34:39.374879+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:34:39.374879+0000","last_undegraded":"2024-04-16T19:34:39.374879+0000","last_fullsized":"2024-04-16T19:34:39.374879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'18","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369024+0000","last_change":"2024-04-16T17:45:51.479804+0000","last_active":"2024-04-16T19:34:14.369024+0000","last_peered":"2024-04-16T19:34:14.369024+0000","last_clean":"2024-04-16T19:34:14.369024+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:34:14.369024+0000","last_undegraded":"2024-04-16T19:34:14.369024+0000","last_fullsized":"2024-04-16T19:34:14.369024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:04.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370998+0000","last_change":"2024-04-16T17:45:49.471470+0000","last_active":"2024-04-16T19:34:29.370998+0000","last_peered":"2024-04-16T19:34:29.370998+0000","last_clean":"2024-04-16T19:34:29.370998+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:34:29.370998+0000","last_undegraded":"2024-04-16T19:34:29.370998+0000","last_fullsized":"2024-04-16T19:34:29.370998+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:24.434279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'907","reported_seq":3798,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369979+0000","last_change":"2024-04-16T17:45:47.466560+0000","last_active":"2024-04-16T19:34:09.369979+0000","last_peered":"2024-04-16T19:34:09.369979+0000","last_clean":"2024-04-16T19:34:09.369979+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:34:09.369979+0000","last_undegraded":"2024-04-16T19:34:09.369979+0000","last_fullsized":"2024-04-16T19:34:09.369979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:24.659574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'18","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368748+0000","last_change":"2024-04-16T17:45:45.464240+0000","last_active":"2024-04-16T19:34:09.368748+0000","last_peered":"2024-04-16T19:34:09.368748+0000","last_clean":"2024-04-16T19:34:09.368748+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:34:09.368748+0000","last_undegraded":"2024-04-16T19:34:09.368748+0000","last_fullsized":"2024-04-16T19:34:09.368748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:26.089403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365646+0000","last_change":"2024-04-16T17:45:10.394156+0000","last_active":"2024-04-16T19:33:54.365646+0000","last_peered":"2024-04-16T19:33:54.365646+0000","last_clean":"2024-04-16T19:33:54.365646+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:33:54.365646+0000","last_undegraded":"2024-04-16T19:33:54.365646+0000","last_fullsized":"2024-04-16T19:33:54.365646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:04.267541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.553316+0000","last_change":"2024-04-16T17:46:16.499439+0000","last_active":"2024-04-16T19:34:19.553316+0000","last_peered":"2024-04-16T19:34:19.553316+0000","last_clean":"2024-04-16T19:34:19.553316+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:34:19.553316+0000","last_undegraded":"2024-04-16T19:34:19.553316+0000","last_fullsized":"2024-04-16T19:34:19.553316+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:19.618386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568606+0000","last_change":"2024-04-16T17:45:20.408040+0000","last_active":"2024-04-16T19:35:39.568606+0000","last_peered":"2024-04-16T19:35:39.568606+0000","last_clean":"2024-04-16T19:35:39.568606+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:35:39.568606+0000","last_undegraded":"2024-04-16T19:35:39.568606+0000","last_fullsized":"2024-04-16T19:35:39.568606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.875311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'152","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385171+0000","last_change":"2024-04-16T17:45:22.415394+0000","last_active":"2024-04-16T19:35:54.385171+0000","last_peered":"2024-04-16T19:35:54.385171+0000","last_clean":"2024-04-16T19:35:54.385171+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:35:54.385171+0000","last_undegraded":"2024-04-16T19:35:54.385171+0000","last_fullsized":"2024-04-16T19:35:54.385171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:27.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'12","reported_seq":1393,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387342+0000","last_change":"2024-04-16T17:45:24.424024+0000","last_active":"2024-04-16T19:35:54.387342+0000","last_peered":"2024-04-16T19:35:54.387342+0000","last_clean":"2024-04-16T19:35:54.387342+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:35:54.387342+0000","last_undegraded":"2024-04-16T19:35:54.387342+0000","last_fullsized":"2024-04-16T19:35:54.387342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:55.371897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366654+0000","last_change":"2024-04-16T17:45:26.438562+0000","last_active":"2024-04-16T19:33:49.366654+0000","last_peered":"2024-04-16T19:33:49.366654+0000","last_clean":"2024-04-16T19:33:49.366654+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:33:49.366654+0000","last_undegraded":"2024-04-16T19:33:49.366654+0000","last_fullsized":"2024-04-16T19:33:49.366654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:01.400474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564870+0000","last_change":"2024-04-16T18:09:02.168408+0000","last_active":"2024-04-16T19:35:19.564870+0000","last_peered":"2024-04-16T19:35:19.564870+0000","last_clean":"2024-04-16T19:35:19.564870+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:35:19.564870+0000","last_undegraded":"2024-04-16T19:35:19.564870+0000","last_fullsized":"2024-04-16T19:35:19.564870+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:38.652580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'164","reported_seq":2348,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559049+0000","last_change":"2024-04-16T17:46:25.526845+0000","last_active":"2024-04-16T19:34:49.559049+0000","last_peered":"2024-04-16T19:34:49.559049+0000","last_clean":"2024-04-16T19:34:49.559049+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:34:49.559049+0000","last_undegraded":"2024-04-16T19:34:49.559049+0000","last_fullsized":"2024-04-16T19:34:49.559049+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:44.078795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373289+0000","last_change":"2024-04-16T17:46:17.504931+0000","last_active":"2024-04-16T19:34:39.373289+0000","last_peered":"2024-04-16T19:34:39.373289+0000","last_clean":"2024-04-16T19:34:39.373289+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:34:39.373289+0000","last_undegraded":"2024-04-16T19:34:39.373289+0000","last_fullsized":"2024-04-16T19:34:39.373289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'19","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.370911+0000","last_change":"2024-04-16T17:45:51.481046+0000","last_active":"2024-04-16T19:34:14.370911+0000","last_peered":"2024-04-16T19:34:14.370911+0000","last_clean":"2024-04-16T19:34:14.370911+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:34:14.370911+0000","last_undegraded":"2024-04-16T19:34:14.370911+0000","last_fullsized":"2024-04-16T19:34:14.370911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:09.427080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368525+0000","last_change":"2024-04-16T17:45:49.473468+0000","last_active":"2024-04-16T19:34:09.368525+0000","last_peered":"2024-04-16T19:34:09.368525+0000","last_clean":"2024-04-16T19:34:09.368525+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:34:09.368525+0000","last_undegraded":"2024-04-16T19:34:09.368525+0000","last_fullsized":"2024-04-16T19:34:09.368525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:38.069196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'592","reported_seq":3225,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554434+0000","last_change":"2024-04-16T17:45:47.465484+0000","last_active":"2024-04-16T19:34:24.554434+0000","last_peered":"2024-04-16T19:34:24.554434+0000","last_clean":"2024-04-16T19:34:24.554434+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:34:24.554434+0000","last_undegraded":"2024-04-16T19:34:24.554434+0000","last_fullsized":"2024-04-16T19:34:24.554434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:29.485588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'23","reported_seq":340,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368689+0000","last_change":"2024-04-16T17:45:45.460199+0000","last_active":"2024-04-16T19:34:09.368689+0000","last_peered":"2024-04-16T19:34:09.368689+0000","last_clean":"2024-04-16T19:34:09.368689+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:34:09.368689+0000","last_undegraded":"2024-04-16T19:34:09.368689+0000","last_fullsized":"2024-04-16T19:34:09.368689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:30.407609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383191+0000","last_change":"2024-04-16T17:45:10.392991+0000","last_active":"2024-04-16T19:35:29.383191+0000","last_peered":"2024-04-16T19:35:29.383191+0000","last_clean":"2024-04-16T19:35:29.383191+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:35:29.383191+0000","last_undegraded":"2024-04-16T19:35:29.383191+0000","last_fullsized":"2024-04-16T19:35:29.383191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:22.221256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380477+0000","last_change":"2024-04-16T17:45:08.387422+0000","last_active":"2024-04-16T19:35:24.380477+0000","last_peered":"2024-04-16T19:35:24.380477+0000","last_clean":"2024-04-16T19:35:24.380477+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:35:24.380477+0000","last_undegraded":"2024-04-16T19:35:24.380477+0000","last_fullsized":"2024-04-16T19:35:24.380477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"48'3","reported_seq":182,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549346+0000","last_change":"2024-04-16T17:45:20.412558+0000","last_active":"2024-04-16T19:33:59.549346+0000","last_peered":"2024-04-16T19:33:59.549346+0000","last_clean":"2024-04-16T19:33:59.549346+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:33:59.549346+0000","last_undegraded":"2024-04-16T19:33:59.549346+0000","last_fullsized":"2024-04-16T19:33:59.549346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:48.640904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'88","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387311+0000","last_change":"2024-04-16T17:45:22.414488+0000","last_active":"2024-04-16T19:35:54.387311+0000","last_peered":"2024-04-16T19:35:54.387311+0000","last_clean":"2024-04-16T19:35:54.387311+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:35:54.387311+0000","last_undegraded":"2024-04-16T19:35:54.387311+0000","last_fullsized":"2024-04-16T19:35:54.387311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:41.992526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546362+0000","last_change":"2024-04-16T17:45:24.422626+0000","last_active":"2024-04-16T19:33:44.546362+0000","last_peered":"2024-04-16T19:33:44.546362+0000","last_clean":"2024-04-16T19:33:44.546362+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:33:44.546362+0000","last_undegraded":"2024-04-16T19:33:44.546362+0000","last_fullsized":"2024-04-16T19:33:44.546362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:10.255140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547629+0000","last_change":"2024-04-16T17:45:26.438504+0000","last_active":"2024-04-16T19:33:49.547629+0000","last_peered":"2024-04-16T19:33:49.547629+0000","last_clean":"2024-04-16T19:33:49.547629+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:33:49.547629+0000","last_undegraded":"2024-04-16T19:33:49.547629+0000","last_fullsized":"2024-04-16T19:33:49.547629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:07.554066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569813+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:35:44.569813+0000","last_peered":"2024-04-16T19:35:44.569813+0000","last_clean":"2024-04-16T19:35:44.569813+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:35:44.569813+0000","last_undegraded":"2024-04-16T19:35:44.569813+0000","last_fullsized":"2024-04-16T19:35:44.569813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:12:06.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'131","reported_seq":1905,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376474+0000","last_change":"2024-04-16T17:46:25.527139+0000","last_active":"2024-04-16T19:34:49.376474+0000","last_peered":"2024-04-16T19:34:49.376474+0000","last_clean":"2024-04-16T19:34:49.376474+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:34:49.376474+0000","last_undegraded":"2024-04-16T19:34:49.376474+0000","last_fullsized":"2024-04-16T19:34:49.376474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:25.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:59.375692+0000","last_change":"2024-04-16T17:46:17.507808+0000","last_active":"2024-04-16T19:34:59.375692+0000","last_peered":"2024-04-16T19:34:59.375692+0000","last_clean":"2024-04-16T19:34:59.375692+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:34:59.375692+0000","last_undegraded":"2024-04-16T19:34:59.375692+0000","last_fullsized":"2024-04-16T19:34:59.375692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:54.705447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'10","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369417+0000","last_change":"2024-04-16T17:45:51.480080+0000","last_active":"2024-04-16T19:34:14.369417+0000","last_peered":"2024-04-16T19:34:14.369417+0000","last_clean":"2024-04-16T19:34:14.369417+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:34:14.369417+0000","last_undegraded":"2024-04-16T19:34:14.369417+0000","last_fullsized":"2024-04-16T19:34:14.369417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:32.349071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'651","reported_seq":2203,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368151+0000","last_change":"2024-04-16T17:45:49.472107+0000","last_active":"2024-04-16T19:34:09.368151+0000","last_peered":"2024-04-16T19:34:09.368151+0000","last_clean":"2024-04-16T19:34:09.368151+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:34:09.368151+0000","last_undegraded":"2024-04-16T19:34:09.368151+0000","last_fullsized":"2024-04-16T19:34:09.368151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:10.741937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'306","reported_seq":576,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551277+0000","last_change":"2024-04-16T17:45:47.460175+0000","last_active":"2024-04-16T19:34:09.551277+0000","last_peered":"2024-04-16T19:34:09.551277+0000","last_clean":"2024-04-16T19:34:09.551277+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:34:09.551277+0000","last_undegraded":"2024-04-16T19:34:09.551277+0000","last_fullsized":"2024-04-16T19:34:09.551277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:36.850360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'6","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369905+0000","last_change":"2024-04-16T17:45:45.468347+0000","last_active":"2024-04-16T19:34:09.369905+0000","last_peered":"2024-04-16T19:34:09.369905+0000","last_clean":"2024-04-16T19:34:09.369905+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:34:09.369905+0000","last_undegraded":"2024-04-16T19:34:09.369905+0000","last_fullsized":"2024-04-16T19:34:09.369905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:35.038003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380444+0000","last_change":"2024-04-16T17:45:10.402046+0000","last_active":"2024-04-16T19:35:29.380444+0000","last_peered":"2024-04-16T19:35:29.380444+0000","last_clean":"2024-04-16T19:35:29.380444+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:35:29.380444+0000","last_undegraded":"2024-04-16T19:35:29.380444+0000","last_fullsized":"2024-04-16T19:35:29.380444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:06.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565768+0000","last_change":"2024-04-16T17:45:08.384395+0000","last_active":"2024-04-16T19:35:24.565768+0000","last_peered":"2024-04-16T19:35:24.565768+0000","last_clean":"2024-04-16T19:35:24.565768+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:35:24.565768+0000","last_undegraded":"2024-04-16T19:35:24.565768+0000","last_fullsized":"2024-04-16T19:35:24.565768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:03.600126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"30'3","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568667+0000","last_change":"2024-04-16T17:45:20.406255+0000","last_active":"2024-04-16T19:35:39.568667+0000","last_peered":"2024-04-16T19:35:39.568667+0000","last_clean":"2024-04-16T19:35:39.568667+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:35:39.568667+0000","last_undegraded":"2024-04-16T19:35:39.568667+0000","last_fullsized":"2024-04-16T19:35:39.568667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:03.743635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'104","reported_seq":277,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382359+0000","last_change":"2024-04-16T17:45:22.416167+0000","last_active":"2024-04-16T19:35:39.382359+0000","last_peered":"2024-04-16T19:35:39.382359+0000","last_clean":"2024-04-16T19:35:39.382359+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:35:39.382359+0000","last_undegraded":"2024-04-16T19:35:39.382359+0000","last_fullsized":"2024-04-16T19:35:39.382359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:08.259967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.365906+0000","last_change":"2024-04-16T17:45:24.422761+0000","last_active":"2024-04-16T19:33:44.365906+0000","last_peered":"2024-04-16T19:33:44.365906+0000","last_clean":"2024-04-16T19:33:44.365906+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:33:44.365906+0000","last_undegraded":"2024-04-16T19:33:44.365906+0000","last_fullsized":"2024-04-16T19:33:44.365906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:44.189297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569509+0000","last_change":"2024-04-16T17:45:26.433444+0000","last_active":"2024-04-16T19:35:44.569509+0000","last_peered":"2024-04-16T19:35:44.569509+0000","last_clean":"2024-04-16T19:35:44.569509+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:35:44.569509+0000","last_undegraded":"2024-04-16T19:35:44.569509+0000","last_fullsized":"2024-04-16T19:35:44.569509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:37.477962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385770+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:35:44.385770+0000","last_peered":"2024-04-16T19:35:44.385770+0000","last_clean":"2024-04-16T19:35:44.385770+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:35:44.385770+0000","last_undegraded":"2024-04-16T19:35:44.385770+0000","last_fullsized":"2024-04-16T19:35:44.385770+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:48.103141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'156","reported_seq":2122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374807+0000","last_change":"2024-04-16T17:46:25.522062+0000","last_active":"2024-04-16T19:34:49.374807+0000","last_peered":"2024-04-16T19:34:49.374807+0000","last_clean":"2024-04-16T19:34:49.374807+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:34:49.374807+0000","last_undegraded":"2024-04-16T19:34:49.374807+0000","last_fullsized":"2024-04-16T19:34:49.374807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:10:38.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373333+0000","last_change":"2024-04-16T17:46:17.511574+0000","last_active":"2024-04-16T19:34:39.373333+0000","last_peered":"2024-04-16T19:34:39.373333+0000","last_clean":"2024-04-16T19:34:39.373333+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:34:39.373333+0000","last_undegraded":"2024-04-16T19:34:39.373333+0000","last_fullsized":"2024-04-16T19:34:39.373333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'144","reported_seq":327,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:51.478987+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:26.313448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551333+0000","last_change":"2024-04-16T17:45:49.467901+0000","last_active":"2024-04-16T19:34:09.551333+0000","last_peered":"2024-04-16T19:34:09.551333+0000","last_clean":"2024-04-16T19:34:09.551333+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:34:09.551333+0000","last_undegraded":"2024-04-16T19:34:09.551333+0000","last_fullsized":"2024-04-16T19:34:09.551333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:24.687044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'820","reported_seq":1799,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551379+0000","last_change":"2024-04-16T17:45:47.465634+0000","last_active":"2024-04-16T19:34:09.551379+0000","last_peered":"2024-04-16T19:34:09.551379+0000","last_clean":"2024-04-16T19:34:09.551379+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:34:09.551379+0000","last_undegraded":"2024-04-16T19:34:09.551379+0000","last_fullsized":"2024-04-16T19:34:09.551379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:18.406307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'4","reported_seq":269,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550309+0000","last_change":"2024-04-16T17:45:45.460111+0000","last_active":"2024-04-16T19:34:04.550309+0000","last_peered":"2024-04-16T19:34:04.550309+0000","last_clean":"2024-04-16T19:34:04.550309+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:34:04.550309+0000","last_undegraded":"2024-04-16T19:34:04.550309+0000","last_fullsized":"2024-04-16T19:34:04.550309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:20.419958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381397+0000","last_change":"2024-04-16T17:45:10.387439+0000","last_active":"2024-04-16T19:35:29.381397+0000","last_peered":"2024-04-16T19:35:29.381397+0000","last_clean":"2024-04-16T19:35:29.381397+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:35:29.381397+0000","last_undegraded":"2024-04-16T19:35:29.381397+0000","last_fullsized":"2024-04-16T19:35:29.381397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:19.082808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364852+0000","last_change":"2024-04-16T17:45:08.386819+0000","last_active":"2024-04-16T19:33:49.364852+0000","last_peered":"2024-04-16T19:33:49.364852+0000","last_clean":"2024-04-16T19:33:49.364852+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:33:49.364852+0000","last_undegraded":"2024-04-16T19:33:49.364852+0000","last_fullsized":"2024-04-16T19:33:49.364852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"48'13","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568711+0000","last_change":"2024-04-16T17:45:20.413420+0000","last_active":"2024-04-16T19:35:39.568711+0000","last_peered":"2024-04-16T19:35:39.568711+0000","last_clean":"2024-04-16T19:35:39.568711+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:35:39.568711+0000","last_undegraded":"2024-04-16T19:35:39.568711+0000","last_fullsized":"2024-04-16T19:35:39.568711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:07.256474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'152","reported_seq":348,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545609+0000","last_change":"2024-04-16T17:45:22.414344+0000","last_active":"2024-04-16T19:33:39.545609+0000","last_peered":"2024-04-16T19:33:39.545609+0000","last_clean":"2024-04-16T19:33:39.545609+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:33:39.545609+0000","last_undegraded":"2024-04-16T19:33:39.545609+0000","last_fullsized":"2024-04-16T19:33:39.545609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:59.276583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'12","reported_seq":1391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568700+0000","last_change":"2024-04-16T17:45:24.430890+0000","last_active":"2024-04-16T19:35:39.568700+0000","last_peered":"2024-04-16T19:35:39.568700+0000","last_clean":"2024-04-16T19:35:39.568700+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:35:39.568700+0000","last_undegraded":"2024-04-16T19:35:39.568700+0000","last_fullsized":"2024-04-16T19:35:39.568700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:11.271716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571455+0000","last_change":"2024-04-16T17:45:26.428823+0000","last_active":"2024-04-16T19:35:54.571455+0000","last_peered":"2024-04-16T19:35:54.571455+0000","last_clean":"2024-04-16T19:35:54.571455+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:35:54.571455+0000","last_undegraded":"2024-04-16T19:35:54.571455+0000","last_fullsized":"2024-04-16T19:35:54.571455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:08.709599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373933+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:34:44.373933+0000","last_peered":"2024-04-16T19:34:44.373933+0000","last_clean":"2024-04-16T19:34:44.373933+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:34:44.373933+0000","last_undegraded":"2024-04-16T19:34:44.373933+0000","last_fullsized":"2024-04-16T19:34:44.373933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:08.722479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'84","reported_seq":1607,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374780+0000","last_change":"2024-04-16T17:46:25.527208+0000","last_active":"2024-04-16T19:34:49.374780+0000","last_peered":"2024-04-16T19:34:49.374780+0000","last_clean":"2024-04-16T19:34:49.374780+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:34:49.374780+0000","last_undegraded":"2024-04-16T19:34:49.374780+0000","last_fullsized":"2024-04-16T19:34:49.374780+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.607096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373249+0000","last_change":"2024-04-16T17:46:17.513992+0000","last_active":"2024-04-16T19:34:39.373249+0000","last_peered":"2024-04-16T19:34:39.373249+0000","last_clean":"2024-04-16T19:34:39.373249+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:34:39.373249+0000","last_undegraded":"2024-04-16T19:34:39.373249+0000","last_fullsized":"2024-04-16T19:34:39.373249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'17","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552285+0000","last_change":"2024-04-16T17:45:51.480268+0000","last_active":"2024-04-16T19:34:14.552285+0000","last_peered":"2024-04-16T19:34:14.552285+0000","last_clean":"2024-04-16T19:34:14.552285+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:34:14.552285+0000","last_undegraded":"2024-04-16T19:34:14.552285+0000","last_fullsized":"2024-04-16T19:34:14.552285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:10:40.755507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367826+0000","last_change":"2024-04-16T17:45:49.472397+0000","last_active":"2024-04-16T19:34:09.367826+0000","last_peered":"2024-04-16T19:34:09.367826+0000","last_clean":"2024-04-16T19:34:09.367826+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:34:09.367826+0000","last_undegraded":"2024-04-16T19:34:09.367826+0000","last_fullsized":"2024-04-16T19:34:09.367826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:02.894263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'526","reported_seq":907,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368367+0000","last_change":"2024-04-16T17:45:47.465575+0000","last_active":"2024-04-16T19:34:09.368367+0000","last_peered":"2024-04-16T19:34:09.368367+0000","last_clean":"2024-04-16T19:34:09.368367+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:34:09.368367+0000","last_undegraded":"2024-04-16T19:34:09.368367+0000","last_fullsized":"2024-04-16T19:34:09.368367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:42.534287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'10","reported_seq":383,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368166+0000","last_change":"2024-04-16T17:45:45.461495+0000","last_active":"2024-04-16T19:34:09.368166+0000","last_peered":"2024-04-16T19:34:09.368166+0000","last_clean":"2024-04-16T19:34:09.368166+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:34:09.368166+0000","last_undegraded":"2024-04-16T19:34:09.368166+0000","last_fullsized":"2024-04-16T19:34:09.368166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:23.315560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380526+0000","last_change":"2024-04-16T17:45:10.394926+0000","last_active":"2024-04-16T19:35:29.380526+0000","last_peered":"2024-04-16T19:35:29.380526+0000","last_clean":"2024-04-16T19:35:29.380526+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:35:29.380526+0000","last_undegraded":"2024-04-16T19:35:29.380526+0000","last_fullsized":"2024-04-16T19:35:29.380526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:53.484971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382188+0000","last_change":"2024-04-16T17:45:08.382545+0000","last_active":"2024-04-16T19:35:39.382188+0000","last_peered":"2024-04-16T19:35:39.382188+0000","last_clean":"2024-04-16T19:35:39.382188+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:35:39.382188+0000","last_undegraded":"2024-04-16T19:35:39.382188+0000","last_fullsized":"2024-04-16T19:35:39.382188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"48'17","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.364227+0000","last_change":"2024-04-16T17:45:20.412524+0000","last_active":"2024-04-16T19:33:44.364227+0000","last_peered":"2024-04-16T19:33:44.364227+0000","last_clean":"2024-04-16T19:33:44.364227+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:33:44.364227+0000","last_undegraded":"2024-04-16T19:33:44.364227+0000","last_fullsized":"2024-04-16T19:33:44.364227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:20.296409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'120","reported_seq":296,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568730+0000","last_change":"2024-04-16T17:45:22.414750+0000","last_active":"2024-04-16T19:35:39.568730+0000","last_peered":"2024-04-16T19:35:39.568730+0000","last_clean":"2024-04-16T19:35:39.568730+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:35:39.568730+0000","last_undegraded":"2024-04-16T19:35:39.568730+0000","last_fullsized":"2024-04-16T19:35:39.568730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:22.304242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'12","reported_seq":1391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382297+0000","last_change":"2024-04-16T17:45:24.423828+0000","last_active":"2024-04-16T19:35:39.382297+0000","last_peered":"2024-04-16T19:35:39.382297+0000","last_clean":"2024-04-16T19:35:39.382297+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:35:39.382297+0000","last_undegraded":"2024-04-16T19:35:39.382297+0000","last_fullsized":"2024-04-16T19:35:39.382297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:54.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.384551+0000","last_change":"2024-04-16T17:45:26.429874+0000","last_active":"2024-04-16T19:35:54.384551+0000","last_peered":"2024-04-16T19:35:54.384551+0000","last_clean":"2024-04-16T19:35:54.384551+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:35:54.384551+0000","last_undegraded":"2024-04-16T19:35:54.384551+0000","last_fullsized":"2024-04-16T19:35:54.384551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:16.546602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555434+0000","last_change":"2024-04-16T18:09:02.169496+0000","last_active":"2024-04-16T19:34:29.555434+0000","last_peered":"2024-04-16T19:34:29.555434+0000","last_clean":"2024-04-16T19:34:29.555434+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:34:29.555434+0000","last_undegraded":"2024-04-16T19:34:29.555434+0000","last_fullsized":"2024-04-16T19:34:29.555434+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:44.423508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'130","reported_seq":1976,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.379689+0000","last_change":"2024-04-16T17:46:25.525792+0000","last_active":"2024-04-16T19:35:09.379689+0000","last_peered":"2024-04-16T19:35:09.379689+0000","last_clean":"2024-04-16T19:35:09.379689+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:35:09.379689+0000","last_undegraded":"2024-04-16T19:35:09.379689+0000","last_fullsized":"2024-04-16T19:35:09.379689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:51.015603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373227+0000","last_change":"2024-04-16T17:46:17.512275+0000","last_active":"2024-04-16T19:34:39.373227+0000","last_peered":"2024-04-16T19:34:39.373227+0000","last_clean":"2024-04-16T19:34:39.373227+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:34:39.373227+0000","last_undegraded":"2024-04-16T19:34:39.373227+0000","last_fullsized":"2024-04-16T19:34:39.373227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'16","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552355+0000","last_change":"2024-04-16T17:45:51.480112+0000","last_active":"2024-04-16T19:34:14.552355+0000","last_peered":"2024-04-16T19:34:14.552355+0000","last_clean":"2024-04-16T19:34:14.552355+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:34:14.552355+0000","last_undegraded":"2024-04-16T19:34:14.552355+0000","last_fullsized":"2024-04-16T19:34:14.552355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:58.876769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'651","reported_seq":2211,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550264+0000","last_change":"2024-04-16T17:45:49.470044+0000","last_active":"2024-04-16T19:34:04.550264+0000","last_peered":"2024-04-16T19:34:04.550264+0000","last_clean":"2024-04-16T19:34:04.550264+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:34:04.550264+0000","last_undegraded":"2024-04-16T19:34:04.550264+0000","last_fullsized":"2024-04-16T19:34:04.550264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:33.520085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'424","reported_seq":710,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367800+0000","last_change":"2024-04-16T17:45:47.461193+0000","last_active":"2024-04-16T19:34:09.367800+0000","last_peered":"2024-04-16T19:34:09.367800+0000","last_clean":"2024-04-16T19:34:09.367800+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:34:09.367800+0000","last_undegraded":"2024-04-16T19:34:09.367800+0000","last_fullsized":"2024-04-16T19:34:09.367800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:59:35.710148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'28","reported_seq":524,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551319+0000","last_change":"2024-04-16T17:45:45.458470+0000","last_active":"2024-04-16T19:34:09.551319+0000","last_peered":"2024-04-16T19:34:09.551319+0000","last_clean":"2024-04-16T19:34:09.551319+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:34:09.551319+0000","last_undegraded":"2024-04-16T19:34:09.551319+0000","last_fullsized":"2024-04-16T19:34:09.551319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.314430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556590+0000","last_change":"2024-04-16T17:46:16.501988+0000","last_active":"2024-04-16T19:34:34.556590+0000","last_peered":"2024-04-16T19:34:34.556590+0000","last_clean":"2024-04-16T19:34:34.556590+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:34:34.556590+0000","last_undegraded":"2024-04-16T19:34:34.556590+0000","last_fullsized":"2024-04-16T19:34:34.556590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:04.853827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568467+0000","last_change":"2024-04-16T17:45:08.381995+0000","last_active":"2024-04-16T19:35:39.568467+0000","last_peered":"2024-04-16T19:35:39.568467+0000","last_clean":"2024-04-16T19:35:39.568467+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:35:39.568467+0000","last_undegraded":"2024-04-16T19:35:39.568467+0000","last_fullsized":"2024-04-16T19:35:39.568467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:09.343973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382943+0000","last_change":"2024-04-16T17:45:20.407642+0000","last_active":"2024-04-16T19:35:39.382943+0000","last_peered":"2024-04-16T19:35:39.382943+0000","last_clean":"2024-04-16T19:35:39.382943+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:35:39.382943+0000","last_undegraded":"2024-04-16T19:35:39.382943+0000","last_fullsized":"2024-04-16T19:35:39.382943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:15.477935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'176","reported_seq":385,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382915+0000","last_change":"2024-04-16T17:45:22.414672+0000","last_active":"2024-04-16T19:35:39.382915+0000","last_peered":"2024-04-16T19:35:39.382915+0000","last_clean":"2024-04-16T19:35:39.382915+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:35:39.382915+0000","last_undegraded":"2024-04-16T19:35:39.382915+0000","last_fullsized":"2024-04-16T19:35:39.382915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:49.342017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382893+0000","last_change":"2024-04-16T17:45:24.425728+0000","last_active":"2024-04-16T19:35:39.382893+0000","last_peered":"2024-04-16T19:35:39.382893+0000","last_clean":"2024-04-16T19:35:39.382893+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:35:39.382893+0000","last_undegraded":"2024-04-16T19:35:39.382893+0000","last_fullsized":"2024-04-16T19:35:39.382893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:48.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571522+0000","last_change":"2024-04-16T17:45:26.433385+0000","last_active":"2024-04-16T19:35:54.571522+0000","last_peered":"2024-04-16T19:35:54.571522+0000","last_clean":"2024-04-16T19:35:54.571522+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:35:54.571522+0000","last_undegraded":"2024-04-16T19:35:54.571522+0000","last_fullsized":"2024-04-16T19:35:54.571522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:00.885088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556570+0000","last_change":"2024-04-16T18:09:02.173431+0000","last_active":"2024-04-16T19:34:34.556570+0000","last_peered":"2024-04-16T19:34:34.556570+0000","last_clean":"2024-04-16T19:34:34.556570+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:34:34.556570+0000","last_undegraded":"2024-04-16T19:34:34.556570+0000","last_fullsized":"2024-04-16T19:34:34.556570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:47.114929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'117","reported_seq":1947,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374129+0000","last_change":"2024-04-16T17:46:25.530014+0000","last_active":"2024-04-16T19:34:49.374129+0000","last_peered":"2024-04-16T19:34:49.374129+0000","last_clean":"2024-04-16T19:34:49.374129+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:34:49.374129+0000","last_undegraded":"2024-04-16T19:34:49.374129+0000","last_fullsized":"2024-04-16T19:34:49.374129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:46.795658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.553245+0000","last_change":"2024-04-16T17:46:17.512764+0000","last_active":"2024-04-16T19:34:19.553245+0000","last_peered":"2024-04-16T19:34:19.553245+0000","last_clean":"2024-04-16T19:34:19.553245+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:34:19.553245+0000","last_undegraded":"2024-04-16T19:34:19.553245+0000","last_fullsized":"2024-04-16T19:34:19.553245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:58.381096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'24","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365186+0000","last_change":"2024-04-16T17:45:51.482816+0000","last_active":"2024-04-16T19:33:54.365186+0000","last_peered":"2024-04-16T19:33:54.365186+0000","last_clean":"2024-04-16T19:33:54.365186+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:33:54.365186+0000","last_undegraded":"2024-04-16T19:33:54.365186+0000","last_fullsized":"2024-04-16T19:33:54.365186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:57.211121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554350+0000","last_change":"2024-04-16T17:45:49.472014+0000","last_active":"2024-04-16T19:34:24.554350+0000","last_peered":"2024-04-16T19:34:24.554350+0000","last_clean":"2024-04-16T19:34:24.554350+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:34:24.554350+0000","last_undegraded":"2024-04-16T19:34:24.554350+0000","last_fullsized":"2024-04-16T19:34:24.554350+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:44.541417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'291","reported_seq":535,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364960+0000","last_change":"2024-04-16T17:45:47.466159+0000","last_active":"2024-04-16T19:33:49.364960+0000","last_peered":"2024-04-16T19:33:49.364960+0000","last_clean":"2024-04-16T19:33:49.364960+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:33:49.364960+0000","last_undegraded":"2024-04-16T19:33:49.364960+0000","last_fullsized":"2024-04-16T19:33:49.364960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:37.045194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'11","reported_seq":456,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551199+0000","last_change":"2024-04-16T17:45:45.461762+0000","last_active":"2024-04-16T19:34:09.551199+0000","last_peered":"2024-04-16T19:34:09.551199+0000","last_clean":"2024-04-16T19:34:09.551199+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:34:09.551199+0000","last_undegraded":"2024-04-16T19:34:09.551199+0000","last_fullsized":"2024-04-16T19:34:09.551199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:35.566086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.386083+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:35:59.386083+0000","last_peered":"2024-04-16T19:35:59.386083+0000","last_clean":"2024-04-16T19:35:59.386083+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:35:59.386083+0000","last_undegraded":"2024-04-16T19:35:59.386083+0000","last_fullsized":"2024-04-16T19:35:59.386083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:01.549347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":296,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373805+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T19:34:44.373805+0000","last_peered":"2024-04-16T19:34:44.373805+0000","last_clean":"2024-04-16T19:34:44.373805+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:34:44.373805+0000","last_undegraded":"2024-04-16T19:34:44.373805+0000","last_fullsized":"2024-04-16T19:34:44.373805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:56.418777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374723+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:34:49.374723+0000","last_peered":"2024-04-16T19:34:49.374723+0000","last_clean":"2024-04-16T19:34:49.374723+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:34:49.374723+0000","last_undegraded":"2024-04-16T19:34:49.374723+0000","last_fullsized":"2024-04-16T19:34:49.374723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567575+0000","last_change":"2024-04-16T17:45:08.387550+0000","last_active":"2024-04-16T19:35:34.567575+0000","last_peered":"2024-04-16T19:35:34.567575+0000","last_clean":"2024-04-16T19:35:34.567575+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:35:34.567575+0000","last_undegraded":"2024-04-16T19:35:34.567575+0000","last_fullsized":"2024-04-16T19:35:34.567575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383732+0000","last_change":"2024-04-16T17:45:20.412324+0000","last_active":"2024-04-16T19:35:49.383732+0000","last_peered":"2024-04-16T19:35:49.383732+0000","last_clean":"2024-04-16T19:35:49.383732+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:35:49.383732+0000","last_undegraded":"2024-04-16T19:35:49.383732+0000","last_fullsized":"2024-04-16T19:35:49.383732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:06.239898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'72","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385321+0000","last_change":"2024-04-16T17:45:22.415579+0000","last_active":"2024-04-16T19:35:54.385321+0000","last_peered":"2024-04-16T19:35:54.385321+0000","last_clean":"2024-04-16T19:35:54.385321+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:35:54.385321+0000","last_undegraded":"2024-04-16T19:35:54.385321+0000","last_fullsized":"2024-04-16T19:35:54.385321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:40.426580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387491+0000","last_change":"2024-04-16T17:45:24.422064+0000","last_active":"2024-04-16T19:35:54.387491+0000","last_peered":"2024-04-16T19:35:54.387491+0000","last_clean":"2024-04-16T19:35:54.387491+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:35:54.387491+0000","last_undegraded":"2024-04-16T19:35:54.387491+0000","last_fullsized":"2024-04-16T19:35:54.387491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:56.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364911+0000","last_change":"2024-04-16T17:45:26.439130+0000","last_active":"2024-04-16T19:33:49.364911+0000","last_peered":"2024-04-16T19:33:49.364911+0000","last_clean":"2024-04-16T19:33:49.364911+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:33:49.364911+0000","last_undegraded":"2024-04-16T19:33:49.364911+0000","last_fullsized":"2024-04-16T19:33:49.364911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:21.169043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371730+0000","last_change":"2024-04-16T18:09:02.168908+0000","last_active":"2024-04-16T19:34:34.371730+0000","last_peered":"2024-04-16T19:34:34.371730+0000","last_clean":"2024-04-16T19:34:34.371730+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:34:34.371730+0000","last_undegraded":"2024-04-16T19:34:34.371730+0000","last_fullsized":"2024-04-16T19:34:34.371730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:56.187557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'150","reported_seq":2025,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373426+0000","last_change":"2024-04-16T17:46:25.527679+0000","last_active":"2024-04-16T19:34:29.373426+0000","last_peered":"2024-04-16T19:34:29.373426+0000","last_clean":"2024-04-16T19:34:29.373426+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:34:29.373426+0000","last_undegraded":"2024-04-16T19:34:29.373426+0000","last_fullsized":"2024-04-16T19:34:29.373426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.607096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373443+0000","last_change":"2024-04-16T17:46:17.514358+0000","last_active":"2024-04-16T19:34:39.373443+0000","last_peered":"2024-04-16T19:34:39.373443+0000","last_clean":"2024-04-16T19:34:39.373443+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:34:39.373443+0000","last_undegraded":"2024-04-16T19:34:39.373443+0000","last_fullsized":"2024-04-16T19:34:39.373443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:01.622597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'5","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367358+0000","last_change":"2024-04-16T17:45:51.481385+0000","last_active":"2024-04-16T19:33:54.367358+0000","last_peered":"2024-04-16T19:33:54.367358+0000","last_clean":"2024-04-16T19:33:54.367358+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:33:54.367358+0000","last_undegraded":"2024-04-16T19:33:54.367358+0000","last_fullsized":"2024-04-16T19:33:54.367358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'651","reported_seq":2342,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551310+0000","last_change":"2024-04-16T17:45:49.469823+0000","last_active":"2024-04-16T19:34:09.551310+0000","last_peered":"2024-04-16T19:34:09.551310+0000","last_clean":"2024-04-16T19:34:09.551310+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:34:09.551310+0000","last_undegraded":"2024-04-16T19:34:09.551310+0000","last_fullsized":"2024-04-16T19:34:09.551310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:31.511049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'439","reported_seq":733,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369820+0000","last_change":"2024-04-16T17:45:47.465291+0000","last_active":"2024-04-16T19:34:09.369820+0000","last_peered":"2024-04-16T19:34:09.369820+0000","last_clean":"2024-04-16T19:34:09.369820+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:34:09.369820+0000","last_undegraded":"2024-04-16T19:34:09.369820+0000","last_fullsized":"2024-04-16T19:34:09.369820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:49.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'13","reported_seq":540,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366573+0000","last_change":"2024-04-16T17:45:45.460969+0000","last_active":"2024-04-16T19:33:49.366573+0000","last_peered":"2024-04-16T19:33:49.366573+0000","last_clean":"2024-04-16T19:33:49.366573+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:33:49.366573+0000","last_undegraded":"2024-04-16T19:33:49.366573+0000","last_fullsized":"2024-04-16T19:33:49.366573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:23.315560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385802+0000","last_change":"2024-04-16T17:45:10.396755+0000","last_active":"2024-04-16T19:35:44.385802+0000","last_peered":"2024-04-16T19:35:44.385802+0000","last_clean":"2024-04-16T19:35:44.385802+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:35:44.385802+0000","last_undegraded":"2024-04-16T19:35:44.385802+0000","last_fullsized":"2024-04-16T19:35:44.385802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:41.531980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373829+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T19:34:44.373829+0000","last_peered":"2024-04-16T19:34:44.373829+0000","last_clean":"2024-04-16T19:34:44.373829+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:34:44.373829+0000","last_undegraded":"2024-04-16T19:34:44.373829+0000","last_fullsized":"2024-04-16T19:34:44.373829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:33.735299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557306+0000","last_change":"2024-04-16T17:46:16.500353+0000","last_active":"2024-04-16T19:34:39.557306+0000","last_peered":"2024-04-16T19:34:39.557306+0000","last_clean":"2024-04-16T19:34:39.557306+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:34:39.557306+0000","last_undegraded":"2024-04-16T19:34:39.557306+0000","last_fullsized":"2024-04-16T19:34:39.557306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:15.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"48'13","reported_seq":582,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385339+0000","last_change":"2024-04-16T17:45:20.412363+0000","last_active":"2024-04-16T19:35:54.385339+0000","last_peered":"2024-04-16T19:35:54.385339+0000","last_clean":"2024-04-16T19:35:54.385339+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:35:54.385339+0000","last_undegraded":"2024-04-16T19:35:54.385339+0000","last_fullsized":"2024-04-16T19:35:54.385339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:51.744736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'177","reported_seq":1667,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570636+0000","last_change":"2024-04-16T17:45:22.412577+0000","last_active":"2024-04-16T19:35:49.570636+0000","last_peered":"2024-04-16T19:35:49.570636+0000","last_clean":"2024-04-16T19:35:49.570636+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:35:49.570636+0000","last_undegraded":"2024-04-16T19:35:49.570636+0000","last_fullsized":"2024-04-16T19:35:49.570636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:53.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366956+0000","last_change":"2024-04-16T17:45:24.422901+0000","last_active":"2024-04-16T19:34:04.366956+0000","last_peered":"2024-04-16T19:34:04.366956+0000","last_clean":"2024-04-16T19:34:04.366956+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:34:04.366956+0000","last_undegraded":"2024-04-16T19:34:04.366956+0000","last_fullsized":"2024-04-16T19:34:04.366956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:55.759978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550383+0000","last_change":"2024-04-16T17:45:26.847528+0000","last_active":"2024-04-16T19:34:04.550383+0000","last_peered":"2024-04-16T19:34:04.550383+0000","last_clean":"2024-04-16T19:34:04.550383+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:34:04.550383+0000","last_undegraded":"2024-04-16T19:34:04.550383+0000","last_fullsized":"2024-04-16T19:34:04.550383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:39:36.865102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372561+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:34:34.372561+0000","last_peered":"2024-04-16T19:34:34.372561+0000","last_clean":"2024-04-16T19:34:34.372561+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:34:34.372561+0000","last_undegraded":"2024-04-16T19:34:34.372561+0000","last_fullsized":"2024-04-16T19:34:34.372561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'137","reported_seq":1599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371844+0000","last_change":"2024-04-16T17:46:25.524587+0000","last_active":"2024-04-16T19:34:29.371844+0000","last_peered":"2024-04-16T19:34:29.371844+0000","last_clean":"2024-04-16T19:34:29.371844+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:34:29.371844+0000","last_undegraded":"2024-04-16T19:34:29.371844+0000","last_fullsized":"2024-04-16T19:34:29.371844+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:51.963525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.370234+0000","last_change":"2024-04-16T17:46:17.512533+0000","last_active":"2024-04-16T19:34:19.370234+0000","last_peered":"2024-04-16T19:34:19.370234+0000","last_clean":"2024-04-16T19:34:19.370234+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:34:19.370234+0000","last_undegraded":"2024-04-16T19:34:19.370234+0000","last_fullsized":"2024-04-16T19:34:19.370234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'22","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369157+0000","last_change":"2024-04-16T17:45:51.482872+0000","last_active":"2024-04-16T19:34:14.369157+0000","last_peered":"2024-04-16T19:34:14.369157+0000","last_clean":"2024-04-16T19:34:14.369157+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:34:14.369157+0000","last_undegraded":"2024-04-16T19:34:14.369157+0000","last_fullsized":"2024-04-16T19:34:14.369157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:41:19.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551235+0000","last_change":"2024-04-16T17:45:49.469833+0000","last_active":"2024-04-16T19:34:09.551235+0000","last_peered":"2024-04-16T19:34:09.551235+0000","last_clean":"2024-04-16T19:34:09.551235+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:34:09.551235+0000","last_undegraded":"2024-04-16T19:34:09.551235+0000","last_fullsized":"2024-04-16T19:34:09.551235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:38.617917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4935","reported_seq":7414,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368062+0000","last_change":"2024-04-16T17:45:47.459129+0000","last_active":"2024-04-16T19:34:09.368062+0000","last_peered":"2024-04-16T19:34:09.368062+0000","last_clean":"2024-04-16T19:34:09.368062+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:34:09.368062+0000","last_undegraded":"2024-04-16T19:34:09.368062+0000","last_fullsized":"2024-04-16T19:34:09.368062+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":3000,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:16.005223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'5","reported_seq":257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371575+0000","last_change":"2024-04-16T17:45:45.465878+0000","last_active":"2024-04-16T19:34:29.371575+0000","last_peered":"2024-04-16T19:34:29.371575+0000","last_clean":"2024-04-16T19:34:29.371575+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:34:29.371575+0000","last_undegraded":"2024-04-16T19:34:29.371575+0000","last_fullsized":"2024-04-16T19:34:29.371575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:14.781901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569790+0000","last_change":"2024-04-16T17:45:10.401015+0000","last_active":"2024-04-16T19:35:44.569790+0000","last_peered":"2024-04-16T19:35:44.569790+0000","last_clean":"2024-04-16T19:35:44.569790+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:35:44.569790+0000","last_undegraded":"2024-04-16T19:35:44.569790+0000","last_fullsized":"2024-04-16T19:35:44.569790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:24.037647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559082+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T19:34:49.559082+0000","last_peered":"2024-04-16T19:34:49.559082+0000","last_clean":"2024-04-16T19:34:49.559082+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:34:49.559082+0000","last_undegraded":"2024-04-16T19:34:49.559082+0000","last_fullsized":"2024-04-16T19:34:49.559082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:57.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565632+0000","last_change":"2024-04-16T17:45:08.382479+0000","last_active":"2024-04-16T19:35:24.565632+0000","last_peered":"2024-04-16T19:35:24.565632+0000","last_clean":"2024-04-16T19:35:24.565632+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:35:24.565632+0000","last_undegraded":"2024-04-16T19:35:24.565632+0000","last_fullsized":"2024-04-16T19:35:24.565632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:35:30.412079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"48'3","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546535+0000","last_change":"2024-04-16T17:45:20.413451+0000","last_active":"2024-04-16T19:33:44.546535+0000","last_peered":"2024-04-16T19:33:44.546535+0000","last_clean":"2024-04-16T19:33:44.546535+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:33:44.546535+0000","last_undegraded":"2024-04-16T19:33:44.546535+0000","last_fullsized":"2024-04-16T19:33:44.546535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:16.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'151","reported_seq":1610,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367608+0000","last_change":"2024-04-16T17:45:22.416277+0000","last_active":"2024-04-16T19:34:04.367608+0000","last_peered":"2024-04-16T19:34:04.367608+0000","last_clean":"2024-04-16T19:34:04.367608+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:34:04.367608+0000","last_undegraded":"2024-04-16T19:34:04.367608+0000","last_fullsized":"2024-04-16T19:34:04.367608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:43.858466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386521+0000","last_change":"2024-04-16T17:45:24.426509+0000","last_active":"2024-04-16T19:35:49.386521+0000","last_peered":"2024-04-16T19:35:49.386521+0000","last_clean":"2024-04-16T19:35:49.386521+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:35:49.386521+0000","last_undegraded":"2024-04-16T19:35:49.386521+0000","last_fullsized":"2024-04-16T19:35:49.386521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:19.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385695+0000","last_change":"2024-04-16T17:45:26.439231+0000","last_active":"2024-04-16T19:35:44.385695+0000","last_peered":"2024-04-16T19:35:44.385695+0000","last_clean":"2024-04-16T19:35:44.385695+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:35:44.385695+0000","last_undegraded":"2024-04-16T19:35:44.385695+0000","last_fullsized":"2024-04-16T19:35:44.385695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:15.584111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374893+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:34:49.374893+0000","last_peered":"2024-04-16T19:34:49.374893+0000","last_clean":"2024-04-16T19:34:49.374893+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:34:49.374893+0000","last_undegraded":"2024-04-16T19:34:49.374893+0000","last_fullsized":"2024-04-16T19:34:49.374893+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:07.763412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'135","reported_seq":2026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371048+0000","last_change":"2024-04-16T17:46:25.529983+0000","last_active":"2024-04-16T19:34:29.371048+0000","last_peered":"2024-04-16T19:34:29.371048+0000","last_clean":"2024-04-16T19:34:29.371048+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:34:29.371048+0000","last_undegraded":"2024-04-16T19:34:29.371048+0000","last_fullsized":"2024-04-16T19:34:29.371048+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:45:31.421525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369527+0000","last_change":"2024-04-16T17:46:17.508075+0000","last_active":"2024-04-16T19:34:19.369527+0000","last_peered":"2024-04-16T19:34:19.369527+0000","last_clean":"2024-04-16T19:34:19.369527+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:34:19.369527+0000","last_undegraded":"2024-04-16T19:34:19.369527+0000","last_fullsized":"2024-04-16T19:34:19.369527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:48.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"48'2","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367303+0000","last_change":"2024-04-16T17:45:51.484218+0000","last_active":"2024-04-16T19:33:54.367303+0000","last_peered":"2024-04-16T19:33:54.367303+0000","last_clean":"2024-04-16T19:33:54.367303+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:33:54.367303+0000","last_undegraded":"2024-04-16T19:33:54.367303+0000","last_fullsized":"2024-04-16T19:33:54.367303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:41:19.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547483+0000","last_change":"2024-04-16T17:45:49.469114+0000","last_active":"2024-04-16T19:33:49.547483+0000","last_peered":"2024-04-16T19:33:49.547483+0000","last_clean":"2024-04-16T19:33:49.547483+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:33:49.547483+0000","last_undegraded":"2024-04-16T19:33:49.547483+0000","last_fullsized":"2024-04-16T19:33:49.547483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:10.917939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'472","reported_seq":939,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370916+0000","last_change":"2024-04-16T17:45:47.463058+0000","last_active":"2024-04-16T19:34:29.370916+0000","last_peered":"2024-04-16T19:34:29.370916+0000","last_clean":"2024-04-16T19:34:29.370916+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:34:29.370916+0000","last_undegraded":"2024-04-16T19:34:29.370916+0000","last_fullsized":"2024-04-16T19:34:29.370916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:54:56.798962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'6","reported_seq":418,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369890+0000","last_change":"2024-04-16T17:45:45.463642+0000","last_active":"2024-04-16T19:34:09.369890+0000","last_peered":"2024-04-16T19:34:09.369890+0000","last_clean":"2024-04-16T19:34:09.369890+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:34:09.369890+0000","last_undegraded":"2024-04-16T19:34:09.369890+0000","last_fullsized":"2024-04-16T19:34:09.369890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568687+0000","last_change":"2024-04-16T17:45:10.396905+0000","last_active":"2024-04-16T19:35:39.568687+0000","last_peered":"2024-04-16T19:35:39.568687+0000","last_clean":"2024-04-16T19:35:39.568687+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:35:39.568687+0000","last_undegraded":"2024-04-16T19:35:39.568687+0000","last_fullsized":"2024-04-16T19:35:39.568687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:49:42.077116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374696+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T19:34:49.374696+0000","last_peered":"2024-04-16T19:34:49.374696+0000","last_clean":"2024-04-16T19:34:49.374696+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:34:49.374696+0000","last_undegraded":"2024-04-16T19:34:49.374696+0000","last_fullsized":"2024-04-16T19:34:49.374696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381333+0000","last_change":"2024-04-16T17:45:08.382355+0000","last_active":"2024-04-16T19:35:34.381333+0000","last_peered":"2024-04-16T19:35:34.381333+0000","last_clean":"2024-04-16T19:35:34.381333+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:35:34.381333+0000","last_undegraded":"2024-04-16T19:35:34.381333+0000","last_fullsized":"2024-04-16T19:35:34.381333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:26.849118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":876,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.369133+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:34:04.369133+0000","last_peered":"2024-04-16T19:34:04.369133+0000","last_clean":"2024-04-16T19:34:04.369133+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:34:04.369133+0000","last_undegraded":"2024-04-16T19:34:04.369133+0000","last_fullsized":"2024-04-16T19:34:04.369133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:49:00.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'144","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546574+0000","last_change":"2024-04-16T17:45:22.417967+0000","last_active":"2024-04-16T19:33:44.546574+0000","last_peered":"2024-04-16T19:33:44.546574+0000","last_clean":"2024-04-16T19:33:44.546574+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:33:44.546574+0000","last_undegraded":"2024-04-16T19:33:44.546574+0000","last_fullsized":"2024-04-16T19:33:44.546574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:52.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385378+0000","last_change":"2024-04-16T17:45:24.430854+0000","last_active":"2024-04-16T19:35:54.385378+0000","last_peered":"2024-04-16T19:35:54.385378+0000","last_clean":"2024-04-16T19:35:54.385378+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:35:54.385378+0000","last_undegraded":"2024-04-16T19:35:54.385378+0000","last_fullsized":"2024-04-16T19:35:54.385378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:44.189297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364886+0000","last_change":"2024-04-16T17:45:26.433033+0000","last_active":"2024-04-16T19:33:49.364886+0000","last_peered":"2024-04-16T19:33:49.364886+0000","last_clean":"2024-04-16T19:33:49.364886+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:33:49.364886+0000","last_undegraded":"2024-04-16T19:33:49.364886+0000","last_fullsized":"2024-04-16T19:33:49.364886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:50.423306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383610+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:35:44.383610+0000","last_peered":"2024-04-16T19:35:44.383610+0000","last_clean":"2024-04-16T19:35:44.383610+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:35:44.383610+0000","last_undegraded":"2024-04-16T19:35:44.383610+0000","last_fullsized":"2024-04-16T19:35:44.383610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:02:50.648888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1711,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382752+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:35:39.382752+0000","last_peered":"2024-04-16T19:35:39.382752+0000","last_clean":"2024-04-16T19:35:39.382752+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:35:39.382752+0000","last_undegraded":"2024-04-16T19:35:39.382752+0000","last_fullsized":"2024-04-16T19:35:39.382752+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:19:32.647068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369878+0000","last_change":"2024-04-16T17:46:17.507415+0000","last_active":"2024-04-16T19:34:19.369878+0000","last_peered":"2024-04-16T19:34:19.369878+0000","last_clean":"2024-04-16T19:34:19.369878+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:34:19.369878+0000","last_undegraded":"2024-04-16T19:34:19.369878+0000","last_fullsized":"2024-04-16T19:34:19.369878+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'8","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555429+0000","last_change":"2024-04-16T17:45:51.479839+0000","last_active":"2024-04-16T19:34:29.555429+0000","last_peered":"2024-04-16T19:34:29.555429+0000","last_clean":"2024-04-16T19:34:29.555429+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:34:29.555429+0000","last_undegraded":"2024-04-16T19:34:29.555429+0000","last_fullsized":"2024-04-16T19:34:29.555429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:47.902420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'651","reported_seq":2230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547568+0000","last_change":"2024-04-16T17:45:49.468732+0000","last_active":"2024-04-16T19:33:49.547568+0000","last_peered":"2024-04-16T19:33:49.547568+0000","last_clean":"2024-04-16T19:33:49.547568+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:33:49.547568+0000","last_undegraded":"2024-04-16T19:33:49.547568+0000","last_fullsized":"2024-04-16T19:33:49.547568+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:02.894263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'344","reported_seq":642,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364192+0000","last_change":"2024-04-16T17:45:47.460745+0000","last_active":"2024-04-16T19:33:49.364192+0000","last_peered":"2024-04-16T19:33:49.364192+0000","last_clean":"2024-04-16T19:33:49.364192+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:33:49.364192+0000","last_undegraded":"2024-04-16T19:33:49.364192+0000","last_fullsized":"2024-04-16T19:33:49.364192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.165117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'13","reported_seq":452,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368729+0000","last_change":"2024-04-16T17:45:45.462237+0000","last_active":"2024-04-16T19:34:09.368729+0000","last_peered":"2024-04-16T19:34:09.368729+0000","last_clean":"2024-04-16T19:34:09.368729+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:34:09.368729+0000","last_undegraded":"2024-04-16T19:34:09.368729+0000","last_fullsized":"2024-04-16T19:34:09.368729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:24.020867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568580+0000","last_change":"2024-04-16T17:45:10.399758+0000","last_active":"2024-04-16T19:35:39.568580+0000","last_peered":"2024-04-16T19:35:39.568580+0000","last_clean":"2024-04-16T19:35:39.568580+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:35:39.568580+0000","last_undegraded":"2024-04-16T19:35:39.568580+0000","last_fullsized":"2024-04-16T19:35:39.568580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:50.581378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385247+0000","last_change":"2024-04-16T17:45:08.386614+0000","last_active":"2024-04-16T19:35:54.385247+0000","last_peered":"2024-04-16T19:35:54.385247+0000","last_clean":"2024-04-16T19:35:54.385247+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:35:54.385247+0000","last_undegraded":"2024-04-16T19:35:54.385247+0000","last_fullsized":"2024-04-16T19:35:54.385247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:51.477510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559198+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T19:34:49.559198+0000","last_peered":"2024-04-16T19:34:49.559198+0000","last_clean":"2024-04-16T19:34:49.559198+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:34:49.559198+0000","last_undegraded":"2024-04-16T19:34:49.559198+0000","last_fullsized":"2024-04-16T19:34:49.559198+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386464+0000","last_change":"2024-04-16T17:45:20.414740+0000","last_active":"2024-04-16T19:35:49.386464+0000","last_peered":"2024-04-16T19:35:49.386464+0000","last_clean":"2024-04-16T19:35:49.386464+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:35:49.386464+0000","last_undegraded":"2024-04-16T19:35:49.386464+0000","last_fullsized":"2024-04-16T19:35:49.386464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:35.855849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'160","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385606+0000","last_change":"2024-04-16T17:45:22.416454+0000","last_active":"2024-04-16T19:35:44.385606+0000","last_peered":"2024-04-16T19:35:44.385606+0000","last_clean":"2024-04-16T19:35:44.385606+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:35:44.385606+0000","last_undegraded":"2024-04-16T19:35:44.385606+0000","last_fullsized":"2024-04-16T19:35:44.385606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:29.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383620+0000","last_change":"2024-04-16T17:45:24.425127+0000","last_active":"2024-04-16T19:35:49.383620+0000","last_peered":"2024-04-16T19:35:49.383620+0000","last_clean":"2024-04-16T19:35:49.383620+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:35:49.383620+0000","last_undegraded":"2024-04-16T19:35:49.383620+0000","last_fullsized":"2024-04-16T19:35:49.383620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:12.945022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385788+0000","last_change":"2024-04-16T17:45:26.849850+0000","last_active":"2024-04-16T19:35:44.385788+0000","last_peered":"2024-04-16T19:35:44.385788+0000","last_clean":"2024-04-16T19:35:44.385788+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:35:44.385788+0000","last_undegraded":"2024-04-16T19:35:44.385788+0000","last_fullsized":"2024-04-16T19:35:44.385788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:07.528720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569526+0000","last_change":"2024-04-16T18:09:02.175274+0000","last_active":"2024-04-16T19:35:44.569526+0000","last_peered":"2024-04-16T19:35:44.569526+0000","last_clean":"2024-04-16T19:35:44.569526+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:35:44.569526+0000","last_undegraded":"2024-04-16T19:35:44.569526+0000","last_fullsized":"2024-04-16T19:35:44.569526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:34:45.630832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1689,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374645+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:34:49.374645+0000","last_peered":"2024-04-16T19:34:49.374645+0000","last_clean":"2024-04-16T19:34:49.374645+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:34:49.374645+0000","last_undegraded":"2024-04-16T19:34:49.374645+0000","last_fullsized":"2024-04-16T19:34:49.374645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:00:32.605132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560062+0000","last_change":"2024-04-16T17:46:17.509389+0000","last_active":"2024-04-16T19:34:54.560062+0000","last_peered":"2024-04-16T19:34:54.560062+0000","last_clean":"2024-04-16T19:34:54.560062+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:34:54.560062+0000","last_undegraded":"2024-04-16T19:34:54.560062+0000","last_fullsized":"2024-04-16T19:34:54.560062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:55.368624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"48'7","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367239+0000","last_change":"2024-04-16T17:45:51.478774+0000","last_active":"2024-04-16T19:33:54.367239+0000","last_peered":"2024-04-16T19:33:54.367239+0000","last_clean":"2024-04-16T19:33:54.367239+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:33:54.367239+0000","last_undegraded":"2024-04-16T19:33:54.367239+0000","last_fullsized":"2024-04-16T19:33:54.367239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:20:52.903342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547518+0000","last_change":"2024-04-16T17:45:49.472675+0000","last_active":"2024-04-16T19:33:49.547518+0000","last_peered":"2024-04-16T19:33:49.547518+0000","last_clean":"2024-04-16T19:33:49.547518+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:33:49.547518+0000","last_undegraded":"2024-04-16T19:33:49.547518+0000","last_fullsized":"2024-04-16T19:33:49.547518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:41.374233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'500","reported_seq":832,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364226+0000","last_change":"2024-04-16T17:45:47.461629+0000","last_active":"2024-04-16T19:33:49.364226+0000","last_peered":"2024-04-16T19:33:49.364226+0000","last_clean":"2024-04-16T19:33:49.364226+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:33:49.364226+0000","last_undegraded":"2024-04-16T19:33:49.364226+0000","last_fullsized":"2024-04-16T19:33:49.364226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:08.910809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'23","reported_seq":293,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:45:45.457257+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384823+0000","last_change":"2024-04-16T17:45:10.392387+0000","last_active":"2024-04-16T19:35:39.384823+0000","last_peered":"2024-04-16T19:35:39.384823+0000","last_clean":"2024-04-16T19:35:39.384823+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:35:39.384823+0000","last_undegraded":"2024-04-16T19:35:39.384823+0000","last_fullsized":"2024-04-16T19:35:39.384823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:56.222153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567683+0000","last_change":"2024-04-16T17:45:08.383729+0000","last_active":"2024-04-16T19:35:34.567683+0000","last_peered":"2024-04-16T19:35:34.567683+0000","last_clean":"2024-04-16T19:35:34.567683+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:35:34.567683+0000","last_undegraded":"2024-04-16T19:35:34.567683+0000","last_fullsized":"2024-04-16T19:35:34.567683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:37.824496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378047+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T19:35:09.378047+0000","last_peered":"2024-04-16T19:35:09.378047+0000","last_clean":"2024-04-16T19:35:09.378047+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:35:09.378047+0000","last_undegraded":"2024-04-16T19:35:09.378047+0000","last_fullsized":"2024-04-16T19:35:09.378047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:22.591585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384362+0000","last_change":"2024-04-16T17:45:20.408473+0000","last_active":"2024-04-16T19:35:49.384362+0000","last_peered":"2024-04-16T19:35:49.384362+0000","last_clean":"2024-04-16T19:35:49.384362+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:35:49.384362+0000","last_undegraded":"2024-04-16T19:35:49.384362+0000","last_fullsized":"2024-04-16T19:35:49.384362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:08.929780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'168","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570487+0000","last_change":"2024-04-16T17:45:22.422298+0000","last_active":"2024-04-16T19:35:49.570487+0000","last_peered":"2024-04-16T19:35:49.570487+0000","last_clean":"2024-04-16T19:35:49.570487+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:35:49.570487+0000","last_undegraded":"2024-04-16T19:35:49.570487+0000","last_fullsized":"2024-04-16T19:35:49.570487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:52.088400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'12","reported_seq":1397,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383571+0000","last_change":"2024-04-16T17:45:24.421136+0000","last_active":"2024-04-16T19:35:44.383571+0000","last_peered":"2024-04-16T19:35:44.383571+0000","last_clean":"2024-04-16T19:35:44.383571+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:35:44.383571+0000","last_undegraded":"2024-04-16T19:35:44.383571+0000","last_fullsized":"2024-04-16T19:35:44.383571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:58:19.841313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366688+0000","last_change":"2024-04-16T17:45:26.848234+0000","last_active":"2024-04-16T19:33:49.366688+0000","last_peered":"2024-04-16T19:33:49.366688+0000","last_clean":"2024-04-16T19:33:49.366688+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:33:49.366688+0000","last_undegraded":"2024-04-16T19:33:49.366688+0000","last_fullsized":"2024-04-16T19:33:49.366688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:01.269112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556474+0000","last_change":"2024-04-16T18:09:02.167725+0000","last_active":"2024-04-16T19:34:34.556474+0000","last_peered":"2024-04-16T19:34:34.556474+0000","last_clean":"2024-04-16T19:34:34.556474+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:34:34.556474+0000","last_undegraded":"2024-04-16T19:34:34.556474+0000","last_fullsized":"2024-04-16T19:34:34.556474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:58.398812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1836,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377912+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:35:09.377912+0000","last_peered":"2024-04-16T19:35:09.377912+0000","last_clean":"2024-04-16T19:35:09.377912+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:35:09.377912+0000","last_undegraded":"2024-04-16T19:35:09.377912+0000","last_fullsized":"2024-04-16T19:35:09.377912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:53:10.911757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373250+0000","last_change":"2024-04-16T17:46:17.508698+0000","last_active":"2024-04-16T19:34:39.373250+0000","last_peered":"2024-04-16T19:34:39.373250+0000","last_clean":"2024-04-16T19:34:39.373250+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:34:39.373250+0000","last_undegraded":"2024-04-16T19:34:39.373250+0000","last_fullsized":"2024-04-16T19:34:39.373250+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:43.428844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'1","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552153+0000","last_change":"2024-04-16T17:45:51.481009+0000","last_active":"2024-04-16T19:34:14.552153+0000","last_peered":"2024-04-16T19:34:14.552153+0000","last_clean":"2024-04-16T19:34:14.552153+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:34:14.552153+0000","last_undegraded":"2024-04-16T19:34:14.552153+0000","last_fullsized":"2024-04-16T19:34:14.552153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:41:38.373017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368296+0000","last_change":"2024-04-16T17:45:49.472070+0000","last_active":"2024-04-16T19:34:09.368296+0000","last_peered":"2024-04-16T19:34:09.368296+0000","last_clean":"2024-04-16T19:34:09.368296+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:34:09.368296+0000","last_undegraded":"2024-04-16T19:34:09.368296+0000","last_fullsized":"2024-04-16T19:34:09.368296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:41.089795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'322","reported_seq":583,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364288+0000","last_change":"2024-04-16T17:45:47.464210+0000","last_active":"2024-04-16T19:33:49.364288+0000","last_peered":"2024-04-16T19:33:49.364288+0000","last_clean":"2024-04-16T19:33:49.364288+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:33:49.364288+0000","last_undegraded":"2024-04-16T19:33:49.364288+0000","last_fullsized":"2024-04-16T19:33:49.364288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:19.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'20","reported_seq":575,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364941+0000","last_change":"2024-04-16T17:45:45.465938+0000","last_active":"2024-04-16T19:33:49.364941+0000","last_peered":"2024-04-16T19:33:49.364941+0000","last_clean":"2024-04-16T19:33:49.364941+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:33:49.364941+0000","last_undegraded":"2024-04-16T19:33:49.364941+0000","last_fullsized":"2024-04-16T19:33:49.364941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:40.527095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.383949+0000","last_change":"2024-04-16T17:45:10.400196+0000","last_active":"2024-04-16T19:35:34.383949+0000","last_peered":"2024-04-16T19:35:34.383949+0000","last_clean":"2024-04-16T19:35:34.383949+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:35:34.383949+0000","last_undegraded":"2024-04-16T19:35:34.383949+0000","last_fullsized":"2024-04-16T19:35:34.383949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:25.987507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568727+0000","last_change":"2024-04-16T17:45:08.382982+0000","last_active":"2024-04-16T19:35:39.568727+0000","last_peered":"2024-04-16T19:35:39.568727+0000","last_clean":"2024-04-16T19:35:39.568727+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:35:39.568727+0000","last_undegraded":"2024-04-16T19:35:39.568727+0000","last_fullsized":"2024-04-16T19:35:39.568727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:20.573792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560153+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T19:34:54.560153+0000","last_peered":"2024-04-16T19:34:54.560153+0000","last_clean":"2024-04-16T19:34:54.560153+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:34:54.560153+0000","last_undegraded":"2024-04-16T19:34:54.560153+0000","last_fullsized":"2024-04-16T19:34:54.560153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"48'3","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384408+0000","last_change":"2024-04-16T17:45:20.407710+0000","last_active":"2024-04-16T19:35:49.384408+0000","last_peered":"2024-04-16T19:35:49.384408+0000","last_clean":"2024-04-16T19:35:49.384408+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:35:49.384408+0000","last_undegraded":"2024-04-16T19:35:49.384408+0000","last_fullsized":"2024-04-16T19:35:49.384408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:05:22.200949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'120","reported_seq":300,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384447+0000","last_change":"2024-04-16T17:45:22.416114+0000","last_active":"2024-04-16T19:35:49.384447+0000","last_peered":"2024-04-16T19:35:49.384447+0000","last_clean":"2024-04-16T19:35:49.384447+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:35:49.384447+0000","last_undegraded":"2024-04-16T19:35:49.384447+0000","last_fullsized":"2024-04-16T19:35:49.384447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:41.992526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'12","reported_seq":1395,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386482+0000","last_change":"2024-04-16T17:45:24.423991+0000","last_active":"2024-04-16T19:35:49.386482+0000","last_peered":"2024-04-16T19:35:49.386482+0000","last_clean":"2024-04-16T19:35:49.386482+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:35:49.386482+0000","last_undegraded":"2024-04-16T19:35:49.386482+0000","last_fullsized":"2024-04-16T19:35:49.386482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:27.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385733+0000","last_change":"2024-04-16T17:45:26.847697+0000","last_active":"2024-04-16T19:35:44.385733+0000","last_peered":"2024-04-16T19:35:44.385733+0000","last_clean":"2024-04-16T19:35:44.385733+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:35:44.385733+0000","last_undegraded":"2024-04-16T19:35:44.385733+0000","last_fullsized":"2024-04-16T19:35:44.385733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:01.653239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547405+0000","last_change":"2024-04-16T18:09:02.166269+0000","last_active":"2024-04-16T19:33:49.547405+0000","last_peered":"2024-04-16T19:33:49.547405+0000","last_clean":"2024-04-16T19:33:49.547405+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:33:49.547405+0000","last_undegraded":"2024-04-16T19:33:49.547405+0000","last_fullsized":"2024-04-16T19:33:49.547405+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:39.706202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2088,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373365+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:34:29.373365+0000","last_peered":"2024-04-16T19:34:29.373365+0000","last_clean":"2024-04-16T19:34:29.373365+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:34:29.373365+0000","last_undegraded":"2024-04-16T19:34:29.373365+0000","last_fullsized":"2024-04-16T19:34:29.373365+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:13:09.115332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557253+0000","last_change":"2024-04-16T17:46:17.513695+0000","last_active":"2024-04-16T19:34:39.557253+0000","last_peered":"2024-04-16T19:34:39.557253+0000","last_clean":"2024-04-16T19:34:39.557253+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:34:39.557253+0000","last_undegraded":"2024-04-16T19:34:39.557253+0000","last_fullsized":"2024-04-16T19:34:39.557253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:36.596198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'6","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552231+0000","last_change":"2024-04-16T17:45:51.483674+0000","last_active":"2024-04-16T19:34:14.552231+0000","last_peered":"2024-04-16T19:34:14.552231+0000","last_clean":"2024-04-16T19:34:14.552231+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:34:14.552231+0000","last_undegraded":"2024-04-16T19:34:14.552231+0000","last_fullsized":"2024-04-16T19:34:14.552231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:44.630489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'651","reported_seq":2202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364275+0000","last_change":"2024-04-16T17:45:49.466697+0000","last_active":"2024-04-16T19:33:49.364275+0000","last_peered":"2024-04-16T19:33:49.364275+0000","last_clean":"2024-04-16T19:33:49.364275+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:33:49.364275+0000","last_undegraded":"2024-04-16T19:33:49.364275+0000","last_fullsized":"2024-04-16T19:33:49.364275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:59.328751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5527","reported_seq":10317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368349+0000","last_change":"2024-04-16T17:45:47.459919+0000","last_active":"2024-04-16T19:34:09.368349+0000","last_peered":"2024-04-16T19:34:09.368349+0000","last_clean":"2024-04-16T19:34:09.368349+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:34:09.368349+0000","last_undegraded":"2024-04-16T19:34:09.368349+0000","last_fullsized":"2024-04-16T19:34:09.368349+0000","mapping_epoch":33,"log_start":"53'3700","ondisk_log_start":"53'3700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":3000,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:18.684283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'12","reported_seq":686,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547542+0000","last_change":"2024-04-16T17:45:45.456575+0000","last_active":"2024-04-16T19:33:49.547542+0000","last_peered":"2024-04-16T19:33:49.547542+0000","last_clean":"2024-04-16T19:33:49.547542+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:33:49.547542+0000","last_undegraded":"2024-04-16T19:33:49.547542+0000","last_fullsized":"2024-04-16T19:33:49.547542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:52.179755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382207+0000","last_change":"2024-04-16T17:45:10.399687+0000","last_active":"2024-04-16T19:35:39.382207+0000","last_peered":"2024-04-16T19:35:39.382207+0000","last_clean":"2024-04-16T19:35:39.382207+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:35:39.382207+0000","last_undegraded":"2024-04-16T19:35:39.382207+0000","last_fullsized":"2024-04-16T19:35:39.382207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:09.857567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384942+0000","last_change":"2024-04-16T17:45:08.381368+0000","last_active":"2024-04-16T19:35:39.384942+0000","last_peered":"2024-04-16T19:35:39.384942+0000","last_clean":"2024-04-16T19:35:39.384942+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:35:39.384942+0000","last_undegraded":"2024-04-16T19:35:39.384942+0000","last_fullsized":"2024-04-16T19:35:39.384942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:56.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375597+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:34:54.375597+0000","last_peered":"2024-04-16T19:34:54.375597+0000","last_clean":"2024-04-16T19:34:54.375597+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:34:54.375597+0000","last_undegraded":"2024-04-16T19:34:54.375597+0000","last_fullsized":"2024-04-16T19:34:54.375597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:37.225695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'1","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568508+0000","last_change":"2024-04-16T17:45:20.403582+0000","last_active":"2024-04-16T19:35:39.568508+0000","last_peered":"2024-04-16T19:35:39.568508+0000","last_clean":"2024-04-16T19:35:39.568508+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:35:39.568508+0000","last_undegraded":"2024-04-16T19:35:39.568508+0000","last_fullsized":"2024-04-16T19:35:39.568508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:24.706560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'144","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383684+0000","last_change":"2024-04-16T17:45:22.414745+0000","last_active":"2024-04-16T19:35:49.383684+0000","last_peered":"2024-04-16T19:35:49.383684+0000","last_clean":"2024-04-16T19:35:49.383684+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:35:49.383684+0000","last_undegraded":"2024-04-16T19:35:49.383684+0000","last_fullsized":"2024-04-16T19:35:49.383684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:39.722446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570534+0000","last_change":"2024-04-16T17:45:24.425364+0000","last_active":"2024-04-16T19:35:49.570534+0000","last_peered":"2024-04-16T19:35:49.570534+0000","last_clean":"2024-04-16T19:35:49.570534+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:35:49.570534+0000","last_undegraded":"2024-04-16T19:35:49.570534+0000","last_fullsized":"2024-04-16T19:35:49.570534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:30.330417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383746+0000","last_change":"2024-04-16T17:45:26.438987+0000","last_active":"2024-04-16T19:35:44.383746+0000","last_peered":"2024-04-16T19:35:44.383746+0000","last_clean":"2024-04-16T19:35:44.383746+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:35:44.383746+0000","last_undegraded":"2024-04-16T19:35:44.383746+0000","last_fullsized":"2024-04-16T19:35:44.383746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:46.197032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.364975+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:33:39.364975+0000","last_peered":"2024-04-16T19:33:39.364975+0000","last_clean":"2024-04-16T19:33:39.364975+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:33:39.364975+0000","last_undegraded":"2024-04-16T19:33:39.364975+0000","last_fullsized":"2024-04-16T19:33:39.364975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:53.017679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'101","reported_seq":1735,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381973+0000","last_change":"2024-04-16T17:46:25.527509+0000","last_active":"2024-04-16T19:35:34.381973+0000","last_peered":"2024-04-16T19:35:34.381973+0000","last_clean":"2024-04-16T19:35:34.381973+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:35:34.381973+0000","last_undegraded":"2024-04-16T19:35:34.381973+0000","last_fullsized":"2024-04-16T19:35:34.381973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:21:20.635118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547428+0000","last_change":"2024-04-16T17:46:17.509709+0000","last_active":"2024-04-16T19:33:49.547428+0000","last_peered":"2024-04-16T19:33:49.547428+0000","last_clean":"2024-04-16T19:33:49.547428+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:33:49.547428+0000","last_undegraded":"2024-04-16T19:33:49.547428+0000","last_fullsized":"2024-04-16T19:33:49.547428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:47.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'19","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359896+0000","last_change":"2024-04-16T17:45:51.477907+0000","last_active":"2024-04-16T19:33:24.359896+0000","last_peered":"2024-04-16T19:33:24.359896+0000","last_clean":"2024-04-16T19:33:24.359896+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:33:24.359896+0000","last_undegraded":"2024-04-16T19:33:24.359896+0000","last_fullsized":"2024-04-16T19:33:24.359896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:36.428648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359952+0000","last_change":"2024-04-16T17:45:49.470293+0000","last_active":"2024-04-16T19:33:19.359952+0000","last_peered":"2024-04-16T19:33:19.359952+0000","last_clean":"2024-04-16T19:33:19.359952+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:33:19.359952+0000","last_undegraded":"2024-04-16T19:33:19.359952+0000","last_fullsized":"2024-04-16T19:33:19.359952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:00.700374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'320","reported_seq":621,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359234+0000","last_change":"2024-04-16T17:45:47.462032+0000","last_active":"2024-04-16T19:33:19.359234+0000","last_peered":"2024-04-16T19:33:19.359234+0000","last_clean":"2024-04-16T19:33:19.359234+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:33:19.359234+0000","last_undegraded":"2024-04-16T19:33:19.359234+0000","last_fullsized":"2024-04-16T19:33:19.359234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:07:03.652770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'7","reported_seq":610,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370042+0000","last_change":"2024-04-16T17:45:45.462463+0000","last_active":"2024-04-16T19:34:09.370042+0000","last_peered":"2024-04-16T19:34:09.370042+0000","last_clean":"2024-04-16T19:34:09.370042+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:34:09.370042+0000","last_undegraded":"2024-04-16T19:34:09.370042+0000","last_fullsized":"2024-04-16T19:34:09.370042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:29.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387507+0000","last_change":"2024-04-16T17:45:26.438380+0000","last_active":"2024-04-16T19:35:54.387507+0000","last_peered":"2024-04-16T19:35:54.387507+0000","last_clean":"2024-04-16T19:35:54.387507+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:35:54.387507+0000","last_undegraded":"2024-04-16T19:35:54.387507+0000","last_fullsized":"2024-04-16T19:35:54.387507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:39.860458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374918+0000","last_change":"2024-04-16T17:45:10.393485+0000","last_active":"2024-04-16T19:34:54.374918+0000","last_peered":"2024-04-16T19:34:54.374918+0000","last_clean":"2024-04-16T19:34:54.374918+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:34:54.374918+0000","last_undegraded":"2024-04-16T19:34:54.374918+0000","last_fullsized":"2024-04-16T19:34:54.374918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:39.589700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378001+0000","last_change":"2024-04-16T17:45:08.386299+0000","last_active":"2024-04-16T19:35:09.378001+0000","last_peered":"2024-04-16T19:35:09.378001+0000","last_clean":"2024-04-16T19:35:09.378001+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:35:09.378001+0000","last_undegraded":"2024-04-16T19:35:09.378001+0000","last_fullsized":"2024-04-16T19:35:09.378001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:20:58.450960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"30'1","reported_seq":209,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561968+0000","last_change":"2024-04-16T17:45:20.412485+0000","last_active":"2024-04-16T19:35:04.561968+0000","last_peered":"2024-04-16T19:35:04.561968+0000","last_clean":"2024-04-16T19:35:04.561968+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:35:04.561968+0000","last_undegraded":"2024-04-16T19:35:04.561968+0000","last_fullsized":"2024-04-16T19:35:04.561968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:51.721722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'104","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561932+0000","last_change":"2024-04-16T17:45:22.416196+0000","last_active":"2024-04-16T19:35:04.561932+0000","last_peered":"2024-04-16T19:35:04.561932+0000","last_clean":"2024-04-16T19:35:04.561932+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:35:04.561932+0000","last_undegraded":"2024-04-16T19:35:04.561932+0000","last_fullsized":"2024-04-16T19:35:04.561932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:07.744516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561881+0000","last_change":"2024-04-16T17:45:24.424718+0000","last_active":"2024-04-16T19:35:04.561881+0000","last_peered":"2024-04-16T19:35:04.561881+0000","last_clean":"2024-04-16T19:35:04.561881+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:35:04.561881+0000","last_undegraded":"2024-04-16T19:35:04.561881+0000","last_fullsized":"2024-04-16T19:35:04.561881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:19.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365069+0000","last_change":"2024-04-16T18:09:02.165652+0000","last_active":"2024-04-16T19:33:54.365069+0000","last_peered":"2024-04-16T19:33:54.365069+0000","last_clean":"2024-04-16T19:33:54.365069+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:33:54.365069+0000","last_undegraded":"2024-04-16T19:33:54.365069+0000","last_fullsized":"2024-04-16T19:33:54.365069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:43:38.642286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'147","reported_seq":1630,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563777+0000","last_change":"2024-04-16T17:46:25.533095+0000","last_active":"2024-04-16T19:35:14.563777+0000","last_peered":"2024-04-16T19:35:14.563777+0000","last_clean":"2024-04-16T19:35:14.563777+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:35:14.563777+0000","last_undegraded":"2024-04-16T19:35:14.563777+0000","last_fullsized":"2024-04-16T19:35:14.563777+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:43.474084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364167+0000","last_change":"2024-04-16T17:46:17.509499+0000","last_active":"2024-04-16T19:33:49.364167+0000","last_peered":"2024-04-16T19:33:49.364167+0000","last_clean":"2024-04-16T19:33:49.364167+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:33:49.364167+0000","last_undegraded":"2024-04-16T19:33:49.364167+0000","last_fullsized":"2024-04-16T19:33:49.364167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:29.073777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'12","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359843+0000","last_change":"2024-04-16T17:47:16.567012+0000","last_active":"2024-04-16T19:33:24.359843+0000","last_peered":"2024-04-16T19:33:24.359843+0000","last_clean":"2024-04-16T19:33:24.359843+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:33:24.359843+0000","last_undegraded":"2024-04-16T19:33:24.359843+0000","last_fullsized":"2024-04-16T19:33:24.359843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:10.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360192+0000","last_change":"2024-04-16T17:45:49.471808+0000","last_active":"2024-04-16T19:33:19.360192+0000","last_peered":"2024-04-16T19:33:19.360192+0000","last_clean":"2024-04-16T19:33:19.360192+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:33:19.360192+0000","last_undegraded":"2024-04-16T19:33:19.360192+0000","last_fullsized":"2024-04-16T19:33:19.360192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:34.249301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'442","reported_seq":2030,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359929+0000","last_change":"2024-04-16T17:45:47.465673+0000","last_active":"2024-04-16T19:33:19.359929+0000","last_peered":"2024-04-16T19:33:19.359929+0000","last_clean":"2024-04-16T19:33:19.359929+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:33:19.359929+0000","last_undegraded":"2024-04-16T19:33:19.359929+0000","last_fullsized":"2024-04-16T19:33:19.359929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:53.982530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'17","reported_seq":461,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551476+0000","last_change":"2024-04-16T17:45:45.465670+0000","last_active":"2024-04-16T19:34:09.551476+0000","last_peered":"2024-04-16T19:34:09.551476+0000","last_clean":"2024-04-16T19:34:09.551476+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:34:09.551476+0000","last_undegraded":"2024-04-16T19:34:09.551476+0000","last_fullsized":"2024-04-16T19:34:09.551476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:14.079978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569743+0000","last_change":"2024-04-16T17:45:26.432878+0000","last_active":"2024-04-16T19:35:44.569743+0000","last_peered":"2024-04-16T19:35:44.569743+0000","last_clean":"2024-04-16T19:35:44.569743+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:35:44.569743+0000","last_undegraded":"2024-04-16T19:35:44.569743+0000","last_fullsized":"2024-04-16T19:35:44.569743+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:57.379632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560037+0000","last_change":"2024-04-16T17:45:10.394503+0000","last_active":"2024-04-16T19:34:54.560037+0000","last_peered":"2024-04-16T19:34:54.560037+0000","last_clean":"2024-04-16T19:34:54.560037+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:34:54.560037+0000","last_undegraded":"2024-04-16T19:34:54.560037+0000","last_fullsized":"2024-04-16T19:34:54.560037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:31.534272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365715+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:33:54.365715+0000","last_peered":"2024-04-16T19:33:54.365715+0000","last_clean":"2024-04-16T19:33:54.365715+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:33:54.365715+0000","last_undegraded":"2024-04-16T19:33:54.365715+0000","last_fullsized":"2024-04-16T19:33:54.365715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:45.243544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.562014+0000","last_change":"2024-04-16T17:45:20.407788+0000","last_active":"2024-04-16T19:35:04.562014+0000","last_peered":"2024-04-16T19:35:04.562014+0000","last_clean":"2024-04-16T19:35:04.562014+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:35:04.562014+0000","last_undegraded":"2024-04-16T19:35:04.562014+0000","last_fullsized":"2024-04-16T19:35:04.562014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:26.315175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'50","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378804+0000","last_change":"2024-04-16T17:45:22.421476+0000","last_active":"2024-04-16T19:35:04.378804+0000","last_peered":"2024-04-16T19:35:04.378804+0000","last_clean":"2024-04-16T19:35:04.378804+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:35:04.378804+0000","last_undegraded":"2024-04-16T19:35:04.378804+0000","last_fullsized":"2024-04-16T19:35:04.378804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:38.752189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376965+0000","last_change":"2024-04-16T17:45:24.430870+0000","last_active":"2024-04-16T19:35:04.376965+0000","last_peered":"2024-04-16T19:35:04.376965+0000","last_clean":"2024-04-16T19:35:04.376965+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:35:04.376965+0000","last_undegraded":"2024-04-16T19:35:04.376965+0000","last_fullsized":"2024-04-16T19:35:04.376965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:19.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367440+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:34:04.367440+0000","last_peered":"2024-04-16T19:34:04.367440+0000","last_clean":"2024-04-16T19:34:04.367440+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:34:04.367440+0000","last_undegraded":"2024-04-16T19:34:04.367440+0000","last_fullsized":"2024-04-16T19:34:04.367440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:38.119812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'109","reported_seq":1796,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549363+0000","last_change":"2024-04-16T17:46:25.527453+0000","last_active":"2024-04-16T19:33:59.549363+0000","last_peered":"2024-04-16T19:33:59.549363+0000","last_clean":"2024-04-16T19:33:59.549363+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:33:59.549363+0000","last_undegraded":"2024-04-16T19:33:59.549363+0000","last_fullsized":"2024-04-16T19:33:59.549363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:48:39.537015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376799+0000","last_change":"2024-04-16T17:46:17.506081+0000","last_active":"2024-04-16T19:35:04.376799+0000","last_peered":"2024-04-16T19:35:04.376799+0000","last_clean":"2024-04-16T19:35:04.376799+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:35:04.376799+0000","last_undegraded":"2024-04-16T19:35:04.376799+0000","last_fullsized":"2024-04-16T19:35:04.376799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:44:37.801667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'14","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:59.377912+0000","last_change":"2024-04-16T17:45:51.484484+0000","last_active":"2024-04-16T19:34:59.377912+0000","last_peered":"2024-04-16T19:34:59.377912+0000","last_clean":"2024-04-16T19:34:59.377912+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:34:59.377912+0000","last_undegraded":"2024-04-16T19:34:59.377912+0000","last_fullsized":"2024-04-16T19:34:59.377912+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:35.709508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368662+0000","last_change":"2024-04-16T17:45:49.473382+0000","last_active":"2024-04-16T19:34:09.368662+0000","last_peered":"2024-04-16T19:34:09.368662+0000","last_clean":"2024-04-16T19:34:09.368662+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:34:09.368662+0000","last_undegraded":"2024-04-16T19:34:09.368662+0000","last_fullsized":"2024-04-16T19:34:09.368662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:18.012352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'659","reported_seq":2170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368312+0000","last_change":"2024-04-16T17:45:47.461388+0000","last_active":"2024-04-16T19:34:09.368312+0000","last_peered":"2024-04-16T19:34:09.368312+0000","last_clean":"2024-04-16T19:34:09.368312+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:34:09.368312+0000","last_undegraded":"2024-04-16T19:34:09.368312+0000","last_fullsized":"2024-04-16T19:34:09.368312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:49.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'31","reported_seq":357,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361706+0000","last_change":"2024-04-16T17:45:45.467998+0000","last_active":"2024-04-16T19:33:19.361706+0000","last_peered":"2024-04-16T19:33:19.361706+0000","last_clean":"2024-04-16T19:33:19.361706+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:33:19.361706+0000","last_undegraded":"2024-04-16T19:33:19.361706+0000","last_fullsized":"2024-04-16T19:33:19.361706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383273+0000","last_change":"2024-04-16T17:45:26.427816+0000","last_active":"2024-04-16T19:35:29.383273+0000","last_peered":"2024-04-16T19:35:29.383273+0000","last_clean":"2024-04-16T19:35:29.383273+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:35:29.383273+0000","last_undegraded":"2024-04-16T19:35:29.383273+0000","last_fullsized":"2024-04-16T19:35:29.383273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:08.477244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560005+0000","last_change":"2024-04-16T17:45:10.395061+0000","last_active":"2024-04-16T19:34:54.560005+0000","last_peered":"2024-04-16T19:34:54.560005+0000","last_clean":"2024-04-16T19:34:54.560005+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:34:54.560005+0000","last_undegraded":"2024-04-16T19:34:54.560005+0000","last_fullsized":"2024-04-16T19:34:54.560005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:31.050543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365780+0000","last_change":"2024-04-16T17:45:08.389656+0000","last_active":"2024-04-16T19:33:54.365780+0000","last_peered":"2024-04-16T19:33:54.365780+0000","last_clean":"2024-04-16T19:33:54.365780+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:33:54.365780+0000","last_undegraded":"2024-04-16T19:33:54.365780+0000","last_fullsized":"2024-04-16T19:33:54.365780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:58.984483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376423+0000","last_change":"2024-04-16T17:45:20.407054+0000","last_active":"2024-04-16T19:35:04.376423+0000","last_peered":"2024-04-16T19:35:04.376423+0000","last_clean":"2024-04-16T19:35:04.376423+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:35:04.376423+0000","last_undegraded":"2024-04-16T19:35:04.376423+0000","last_fullsized":"2024-04-16T19:35:04.376423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:14.285286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'104","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.562025+0000","last_change":"2024-04-16T17:45:22.415814+0000","last_active":"2024-04-16T19:35:04.562025+0000","last_peered":"2024-04-16T19:35:04.562025+0000","last_clean":"2024-04-16T19:35:04.562025+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:35:04.562025+0000","last_undegraded":"2024-04-16T19:35:04.562025+0000","last_fullsized":"2024-04-16T19:35:04.562025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:36.063225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376882+0000","last_change":"2024-04-16T17:45:24.425524+0000","last_active":"2024-04-16T19:35:04.376882+0000","last_peered":"2024-04-16T19:35:04.376882+0000","last_clean":"2024-04-16T19:35:04.376882+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:35:04.376882+0000","last_undegraded":"2024-04-16T19:35:04.376882+0000","last_fullsized":"2024-04-16T19:35:04.376882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:17.147197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367227+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:34:04.367227+0000","last_peered":"2024-04-16T19:34:04.367227+0000","last_clean":"2024-04-16T19:34:04.367227+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:34:04.367227+0000","last_undegraded":"2024-04-16T19:34:04.367227+0000","last_fullsized":"2024-04-16T19:34:04.367227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2057,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368201+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:33:59.368201+0000","last_peered":"2024-04-16T19:33:59.368201+0000","last_clean":"2024-04-16T19:33:59.368201+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:33:59.368201+0000","last_undegraded":"2024-04-16T19:33:59.368201+0000","last_fullsized":"2024-04-16T19:33:59.368201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:18:49.538603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564906+0000","last_change":"2024-04-16T17:46:17.512965+0000","last_active":"2024-04-16T19:35:19.564906+0000","last_peered":"2024-04-16T19:35:19.564906+0000","last_clean":"2024-04-16T19:35:19.564906+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:35:19.564906+0000","last_undegraded":"2024-04-16T19:35:19.564906+0000","last_fullsized":"2024-04-16T19:35:19.564906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:46.834965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'12","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557237+0000","last_change":"2024-04-16T17:45:51.477961+0000","last_active":"2024-04-16T19:34:39.557237+0000","last_peered":"2024-04-16T19:34:39.557237+0000","last_clean":"2024-04-16T19:34:39.557237+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:34:39.557237+0000","last_undegraded":"2024-04-16T19:34:39.557237+0000","last_fullsized":"2024-04-16T19:34:39.557237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:47.996402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'651","reported_seq":2194,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551499+0000","last_change":"2024-04-16T17:45:49.469998+0000","last_active":"2024-04-16T19:34:09.551499+0000","last_peered":"2024-04-16T19:34:09.551499+0000","last_clean":"2024-04-16T19:34:09.551499+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:34:09.551499+0000","last_undegraded":"2024-04-16T19:34:09.551499+0000","last_fullsized":"2024-04-16T19:34:09.551499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:24.434279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'720","reported_seq":3524,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370031+0000","last_change":"2024-04-16T17:45:47.463990+0000","last_active":"2024-04-16T19:34:09.370031+0000","last_peered":"2024-04-16T19:34:09.370031+0000","last_clean":"2024-04-16T19:34:09.370031+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:34:09.370031+0000","last_undegraded":"2024-04-16T19:34:09.370031+0000","last_fullsized":"2024-04-16T19:34:09.370031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:34.349862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'9","reported_seq":282,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361724+0000","last_change":"2024-04-16T17:45:45.465394+0000","last_active":"2024-04-16T19:33:19.361724+0000","last_peered":"2024-04-16T19:33:19.361724+0000","last_clean":"2024-04-16T19:33:19.361724+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:33:19.361724+0000","last_undegraded":"2024-04-16T19:33:19.361724+0000","last_fullsized":"2024-04-16T19:33:19.361724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:27.529464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381373+0000","last_change":"2024-04-16T17:45:26.438413+0000","last_active":"2024-04-16T19:35:29.381373+0000","last_peered":"2024-04-16T19:35:29.381373+0000","last_clean":"2024-04-16T19:35:29.381373+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:35:29.381373+0000","last_undegraded":"2024-04-16T19:35:29.381373+0000","last_fullsized":"2024-04-16T19:35:29.381373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:29.732765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.559943+0000","last_change":"2024-04-16T17:45:10.402839+0000","last_active":"2024-04-16T19:34:54.559943+0000","last_peered":"2024-04-16T19:34:54.559943+0000","last_clean":"2024-04-16T19:34:54.559943+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:34:54.559943+0000","last_undegraded":"2024-04-16T19:34:54.559943+0000","last_fullsized":"2024-04-16T19:34:54.559943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:09.857567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367401+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:33:54.367401+0000","last_peered":"2024-04-16T19:33:54.367401+0000","last_clean":"2024-04-16T19:33:54.367401+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:33:54.367401+0000","last_undegraded":"2024-04-16T19:33:54.367401+0000","last_fullsized":"2024-04-16T19:33:54.367401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:34:33.739095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"48'4","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376995+0000","last_change":"2024-04-16T17:45:20.413469+0000","last_active":"2024-04-16T19:35:04.376995+0000","last_peered":"2024-04-16T19:35:04.376995+0000","last_clean":"2024-04-16T19:35:04.376995+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:35:04.376995+0000","last_undegraded":"2024-04-16T19:35:04.376995+0000","last_fullsized":"2024-04-16T19:35:04.376995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:49:00.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'80","reported_seq":239,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376922+0000","last_change":"2024-04-16T17:45:22.415761+0000","last_active":"2024-04-16T19:35:04.376922+0000","last_peered":"2024-04-16T19:35:04.376922+0000","last_clean":"2024-04-16T19:35:04.376922+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:35:04.376922+0000","last_undegraded":"2024-04-16T19:35:04.376922+0000","last_fullsized":"2024-04-16T19:35:04.376922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:17.485768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378903+0000","last_change":"2024-04-16T17:45:24.426374+0000","last_active":"2024-04-16T19:35:04.378903+0000","last_peered":"2024-04-16T19:35:04.378903+0000","last_clean":"2024-04-16T19:35:04.378903+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:35:04.378903+0000","last_undegraded":"2024-04-16T19:35:04.378903+0000","last_fullsized":"2024-04-16T19:35:04.378903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:48.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382870+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:35:39.382870+0000","last_peered":"2024-04-16T19:35:39.382870+0000","last_clean":"2024-04-16T19:35:39.382870+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:35:39.382870+0000","last_undegraded":"2024-04-16T19:35:39.382870+0000","last_fullsized":"2024-04-16T19:35:39.382870+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:01.886612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'112","reported_seq":1493,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378892+0000","last_change":"2024-04-16T17:46:25.525571+0000","last_active":"2024-04-16T19:35:14.378892+0000","last_peered":"2024-04-16T19:35:14.378892+0000","last_clean":"2024-04-16T19:35:14.378892+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:35:14.378892+0000","last_undegraded":"2024-04-16T19:35:14.378892+0000","last_fullsized":"2024-04-16T19:35:14.378892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:13:09.115332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378980+0000","last_change":"2024-04-16T17:46:17.504593+0000","last_active":"2024-04-16T19:35:04.378980+0000","last_peered":"2024-04-16T19:35:04.378980+0000","last_clean":"2024-04-16T19:35:04.378980+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:35:04.378980+0000","last_undegraded":"2024-04-16T19:35:04.378980+0000","last_fullsized":"2024-04-16T19:35:04.378980+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"51'2","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372544+0000","last_change":"2024-04-16T17:45:51.480201+0000","last_active":"2024-04-16T19:34:39.372544+0000","last_peered":"2024-04-16T19:34:39.372544+0000","last_clean":"2024-04-16T19:34:39.372544+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:34:39.372544+0000","last_undegraded":"2024-04-16T19:34:39.372544+0000","last_fullsized":"2024-04-16T19:34:39.372544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:45.935071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383071+0000","last_change":"2024-04-16T17:45:49.476432+0000","last_active":"2024-04-16T19:35:29.383071+0000","last_peered":"2024-04-16T19:35:29.383071+0000","last_clean":"2024-04-16T19:35:29.383071+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:35:29.383071+0000","last_undegraded":"2024-04-16T19:35:29.383071+0000","last_fullsized":"2024-04-16T19:35:29.383071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:38:03.985918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'369","reported_seq":693,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381232+0000","last_change":"2024-04-16T17:45:47.464967+0000","last_active":"2024-04-16T19:35:29.381232+0000","last_peered":"2024-04-16T19:35:29.381232+0000","last_clean":"2024-04-16T19:35:29.381232+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:35:29.381232+0000","last_undegraded":"2024-04-16T19:35:29.381232+0000","last_fullsized":"2024-04-16T19:35:29.381232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:39.367104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'16","reported_seq":322,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381287+0000","last_change":"2024-04-16T17:45:45.461625+0000","last_active":"2024-04-16T19:35:29.381287+0000","last_peered":"2024-04-16T19:35:29.381287+0000","last_clean":"2024-04-16T19:35:29.381287+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:35:29.381287+0000","last_undegraded":"2024-04-16T19:35:29.381287+0000","last_fullsized":"2024-04-16T19:35:29.381287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:34.843168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382983+0000","last_change":"2024-04-16T17:45:10.396745+0000","last_active":"2024-04-16T19:35:39.382983+0000","last_peered":"2024-04-16T19:35:39.382983+0000","last_clean":"2024-04-16T19:35:39.382983+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:35:39.382983+0000","last_undegraded":"2024-04-16T19:35:39.382983+0000","last_fullsized":"2024-04-16T19:35:39.382983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:40.062822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.548366+0000","last_change":"2024-04-16T17:45:08.384480+0000","last_active":"2024-04-16T19:33:54.548366+0000","last_peered":"2024-04-16T19:33:54.548366+0000","last_clean":"2024-04-16T19:33:54.548366+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:33:54.548366+0000","last_undegraded":"2024-04-16T19:33:54.548366+0000","last_fullsized":"2024-04-16T19:33:54.548366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:09.600364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385816+0000","last_change":"2024-04-16T17:45:20.414382+0000","last_active":"2024-04-16T19:35:44.385816+0000","last_peered":"2024-04-16T19:35:44.385816+0000","last_clean":"2024-04-16T19:35:44.385816+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:35:44.385816+0000","last_undegraded":"2024-04-16T19:35:44.385816+0000","last_fullsized":"2024-04-16T19:35:44.385816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:53:22.840598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'88","reported_seq":253,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565896+0000","last_change":"2024-04-16T17:45:22.421515+0000","last_active":"2024-04-16T19:35:24.565896+0000","last_peered":"2024-04-16T19:35:24.565896+0000","last_clean":"2024-04-16T19:35:24.565896+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:35:24.565896+0000","last_undegraded":"2024-04-16T19:35:24.565896+0000","last_fullsized":"2024-04-16T19:35:24.565896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:10.937613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380602+0000","last_change":"2024-04-16T17:45:24.425946+0000","last_active":"2024-04-16T19:35:24.380602+0000","last_peered":"2024-04-16T19:35:24.380602+0000","last_clean":"2024-04-16T19:35:24.380602+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:35:24.380602+0000","last_undegraded":"2024-04-16T19:35:24.380602+0000","last_fullsized":"2024-04-16T19:35:24.380602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.451179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562876+0000","last_change":"2024-04-16T17:45:26.849050+0000","last_active":"2024-04-16T19:35:09.562876+0000","last_peered":"2024-04-16T19:35:09.562876+0000","last_clean":"2024-04-16T19:35:09.562876+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:35:09.562876+0000","last_undegraded":"2024-04-16T19:35:09.562876+0000","last_fullsized":"2024-04-16T19:35:09.562876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:33:47.186912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363192+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:33:39.363192+0000","last_peered":"2024-04-16T19:33:39.363192+0000","last_clean":"2024-04-16T19:33:39.363192+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:33:39.363192+0000","last_undegraded":"2024-04-16T19:33:39.363192+0000","last_fullsized":"2024-04-16T19:33:39.363192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'112","reported_seq":1323,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367908+0000","last_change":"2024-04-16T17:46:25.530104+0000","last_active":"2024-04-16T19:34:09.367908+0000","last_peered":"2024-04-16T19:34:09.367908+0000","last_clean":"2024-04-16T19:34:09.367908+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:34:09.367908+0000","last_undegraded":"2024-04-16T19:34:09.367908+0000","last_fullsized":"2024-04-16T19:34:09.367908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:48:32.234084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.377062+0000","last_change":"2024-04-16T17:46:17.511681+0000","last_active":"2024-04-16T19:35:04.377062+0000","last_peered":"2024-04-16T19:35:04.377062+0000","last_clean":"2024-04-16T19:35:04.377062+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:35:04.377062+0000","last_undegraded":"2024-04-16T19:35:04.377062+0000","last_fullsized":"2024-04-16T19:35:04.377062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"48'9","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373396+0000","last_change":"2024-04-16T17:45:51.480247+0000","last_active":"2024-04-16T19:34:39.373396+0000","last_peered":"2024-04-16T19:34:39.373396+0000","last_clean":"2024-04-16T19:34:39.373396+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:34:39.373396+0000","last_undegraded":"2024-04-16T19:34:39.373396+0000","last_fullsized":"2024-04-16T19:34:39.373396+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:20.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566625+0000","last_change":"2024-04-16T17:45:49.469762+0000","last_active":"2024-04-16T19:35:29.566625+0000","last_peered":"2024-04-16T19:35:29.566625+0000","last_clean":"2024-04-16T19:35:29.566625+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:35:29.566625+0000","last_undegraded":"2024-04-16T19:35:29.566625+0000","last_fullsized":"2024-04-16T19:35:29.566625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:21.265143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'216","reported_seq":394,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380298+0000","last_change":"2024-04-16T17:45:47.460038+0000","last_active":"2024-04-16T19:35:29.380298+0000","last_peered":"2024-04-16T19:35:29.380298+0000","last_clean":"2024-04-16T19:35:29.380298+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:35:29.380298+0000","last_undegraded":"2024-04-16T19:35:29.380298+0000","last_fullsized":"2024-04-16T19:35:29.380298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:51:10.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'24","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372382+0000","last_change":"2024-04-16T17:47:16.558050+0000","last_active":"2024-04-16T19:34:39.372382+0000","last_peered":"2024-04-16T19:34:39.372382+0000","last_clean":"2024-04-16T19:34:39.372382+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:34:39.372382+0000","last_undegraded":"2024-04-16T19:34:39.372382+0000","last_fullsized":"2024-04-16T19:34:39.372382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:03.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384130+0000","last_change":"2024-04-16T17:45:10.400195+0000","last_active":"2024-04-16T19:35:34.384130+0000","last_peered":"2024-04-16T19:35:34.384130+0000","last_clean":"2024-04-16T19:35:34.384130+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:35:34.384130+0000","last_undegraded":"2024-04-16T19:35:34.384130+0000","last_fullsized":"2024-04-16T19:35:34.384130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:41.703977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551224+0000","last_change":"2024-04-16T17:45:08.388718+0000","last_active":"2024-04-16T19:34:09.551224+0000","last_peered":"2024-04-16T19:34:09.551224+0000","last_clean":"2024-04-16T19:34:09.551224+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:34:09.551224+0000","last_undegraded":"2024-04-16T19:34:09.551224+0000","last_fullsized":"2024-04-16T19:34:09.551224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'2","reported_seq":562,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384626+0000","last_change":"2024-04-16T17:45:20.407653+0000","last_active":"2024-04-16T19:35:49.384626+0000","last_peered":"2024-04-16T19:35:49.384626+0000","last_clean":"2024-04-16T19:35:49.384626+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:35:49.384626+0000","last_undegraded":"2024-04-16T19:35:49.384626+0000","last_fullsized":"2024-04-16T19:35:49.384626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:10.523626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'152","reported_seq":344,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380618+0000","last_change":"2024-04-16T17:45:22.417131+0000","last_active":"2024-04-16T19:35:24.380618+0000","last_peered":"2024-04-16T19:35:24.380618+0000","last_clean":"2024-04-16T19:35:24.380618+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:35:24.380618+0000","last_undegraded":"2024-04-16T19:35:24.380618+0000","last_fullsized":"2024-04-16T19:35:24.380618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:45.675762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565883+0000","last_change":"2024-04-16T17:45:24.427273+0000","last_active":"2024-04-16T19:35:24.565883+0000","last_peered":"2024-04-16T19:35:24.565883+0000","last_clean":"2024-04-16T19:35:24.565883+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:35:24.565883+0000","last_undegraded":"2024-04-16T19:35:24.565883+0000","last_fullsized":"2024-04-16T19:35:24.565883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:51.349426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377945+0000","last_change":"2024-04-16T17:45:26.849595+0000","last_active":"2024-04-16T19:35:09.377945+0000","last_peered":"2024-04-16T19:35:09.377945+0000","last_clean":"2024-04-16T19:35:09.377945+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:35:09.377945+0000","last_undegraded":"2024-04-16T19:35:09.377945+0000","last_fullsized":"2024-04-16T19:35:09.377945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:01.653239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.365153+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:33:39.365153+0000","last_peered":"2024-04-16T19:33:39.365153+0000","last_clean":"2024-04-16T19:33:39.365153+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:33:39.365153+0000","last_undegraded":"2024-04-16T19:33:39.365153+0000","last_fullsized":"2024-04-16T19:33:39.365153+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:01:36.294431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'110","reported_seq":1957,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.564046+0000","last_change":"2024-04-16T17:46:25.522673+0000","last_active":"2024-04-16T19:35:14.564046+0000","last_peered":"2024-04-16T19:35:14.564046+0000","last_clean":"2024-04-16T19:35:14.564046+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:35:14.564046+0000","last_undegraded":"2024-04-16T19:35:14.564046+0000","last_fullsized":"2024-04-16T19:35:14.564046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:49.571002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368287+0000","last_change":"2024-04-16T17:46:17.504674+0000","last_active":"2024-04-16T19:33:59.368287+0000","last_peered":"2024-04-16T19:33:59.368287+0000","last_clean":"2024-04-16T19:33:59.368287+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:33:59.368287+0000","last_undegraded":"2024-04-16T19:33:59.368287+0000","last_fullsized":"2024-04-16T19:33:59.368287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"48'3","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373369+0000","last_change":"2024-04-16T17:45:51.482374+0000","last_active":"2024-04-16T19:34:39.373369+0000","last_peered":"2024-04-16T19:34:39.373369+0000","last_clean":"2024-04-16T19:34:39.373369+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:34:39.373369+0000","last_undegraded":"2024-04-16T19:34:39.373369+0000","last_fullsized":"2024-04-16T19:34:39.373369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:35.709508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'20","reported_seq":1478,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381300+0000","last_change":"2024-04-16T17:45:49.473331+0000","last_active":"2024-04-16T19:35:29.381300+0000","last_peered":"2024-04-16T19:35:29.381300+0000","last_clean":"2024-04-16T19:35:29.381300+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:35:29.381300+0000","last_undegraded":"2024-04-16T19:35:29.381300+0000","last_fullsized":"2024-04-16T19:35:29.381300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:55.367803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'661","reported_seq":3301,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566715+0000","last_change":"2024-04-16T17:45:47.459310+0000","last_active":"2024-04-16T19:35:29.566715+0000","last_peered":"2024-04-16T19:35:29.566715+0000","last_clean":"2024-04-16T19:35:29.566715+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:35:29.566715+0000","last_undegraded":"2024-04-16T19:35:29.566715+0000","last_fullsized":"2024-04-16T19:35:29.566715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:41.921224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'6","reported_seq":503,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380329+0000","last_change":"2024-04-16T17:45:45.461393+0000","last_active":"2024-04-16T19:35:29.380329+0000","last_peered":"2024-04-16T19:35:29.380329+0000","last_clean":"2024-04-16T19:35:29.380329+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:35:29.380329+0000","last_undegraded":"2024-04-16T19:35:29.380329+0000","last_fullsized":"2024-04-16T19:35:29.380329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:06.206396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.380558+0000","last_change":"2024-04-16T17:45:10.393491+0000","last_active":"2024-04-16T19:35:14.380558+0000","last_peered":"2024-04-16T19:35:14.380558+0000","last_clean":"2024-04-16T19:35:14.380558+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:35:14.380558+0000","last_undegraded":"2024-04-16T19:35:14.380558+0000","last_fullsized":"2024-04-16T19:35:14.380558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:16.297430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377316+0000","last_change":"2024-04-16T17:45:08.380598+0000","last_active":"2024-04-16T19:35:09.377316+0000","last_peered":"2024-04-16T19:35:09.377316+0000","last_clean":"2024-04-16T19:35:09.377316+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:35:09.377316+0000","last_undegraded":"2024-04-16T19:35:09.377316+0000","last_fullsized":"2024-04-16T19:35:09.377316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:19.075286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"48'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379730+0000","last_change":"2024-04-16T17:45:20.412352+0000","last_active":"2024-04-16T19:35:24.379730+0000","last_peered":"2024-04-16T19:35:24.379730+0000","last_clean":"2024-04-16T19:35:24.379730+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:35:24.379730+0000","last_undegraded":"2024-04-16T19:35:24.379730+0000","last_fullsized":"2024-04-16T19:35:24.379730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:32.239001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'104","reported_seq":281,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570694+0000","last_change":"2024-04-16T17:45:22.417121+0000","last_active":"2024-04-16T19:35:49.570694+0000","last_peered":"2024-04-16T19:35:49.570694+0000","last_clean":"2024-04-16T19:35:49.570694+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:35:49.570694+0000","last_undegraded":"2024-04-16T19:35:49.570694+0000","last_fullsized":"2024-04-16T19:35:49.570694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:09.722112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568794+0000","last_change":"2024-04-16T17:45:24.425363+0000","last_active":"2024-04-16T19:35:39.568794+0000","last_peered":"2024-04-16T19:35:39.568794+0000","last_clean":"2024-04-16T19:35:39.568794+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:35:39.568794+0000","last_undegraded":"2024-04-16T19:35:39.568794+0000","last_fullsized":"2024-04-16T19:35:39.568794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:14.538868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377883+0000","last_change":"2024-04-16T17:45:26.438576+0000","last_active":"2024-04-16T19:35:09.377883+0000","last_peered":"2024-04-16T19:35:09.377883+0000","last_clean":"2024-04-16T19:35:09.377883+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:35:09.377883+0000","last_undegraded":"2024-04-16T19:35:09.377883+0000","last_fullsized":"2024-04-16T19:35:09.377883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:47.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.362625+0000","last_change":"2024-04-16T18:09:02.173368+0000","last_active":"2024-04-16T19:33:39.362625+0000","last_peered":"2024-04-16T19:33:39.362625+0000","last_clean":"2024-04-16T19:33:39.362625+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:33:39.362625+0000","last_undegraded":"2024-04-16T19:33:39.362625+0000","last_fullsized":"2024-04-16T19:33:39.362625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:29.850916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'146","reported_seq":1638,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563993+0000","last_change":"2024-04-16T17:46:25.529669+0000","last_active":"2024-04-16T19:35:14.563993+0000","last_peered":"2024-04-16T19:35:14.563993+0000","last_clean":"2024-04-16T19:35:14.563993+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:35:14.563993+0000","last_undegraded":"2024-04-16T19:35:14.563993+0000","last_fullsized":"2024-04-16T19:35:14.563993+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:46.675908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376562+0000","last_change":"2024-04-16T17:46:17.507982+0000","last_active":"2024-04-16T19:35:04.376562+0000","last_peered":"2024-04-16T19:35:04.376562+0000","last_clean":"2024-04-16T19:35:04.376562+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:35:04.376562+0000","last_undegraded":"2024-04-16T19:35:04.376562+0000","last_fullsized":"2024-04-16T19:35:04.376562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:17:26.521094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:34.362268+0000","last_change":"2024-04-16T17:45:51.480412+0000","last_active":"2024-04-16T19:33:34.362268+0000","last_peered":"2024-04-16T19:33:34.362268+0000","last_clean":"2024-04-16T19:33:34.362268+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:33:34.362268+0000","last_undegraded":"2024-04-16T19:33:34.362268+0000","last_fullsized":"2024-04-16T19:33:34.362268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:28.168213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381317+0000","last_change":"2024-04-16T17:45:49.471149+0000","last_active":"2024-04-16T19:35:29.381317+0000","last_peered":"2024-04-16T19:35:29.381317+0000","last_clean":"2024-04-16T19:35:29.381317+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:35:29.381317+0000","last_undegraded":"2024-04-16T19:35:29.381317+0000","last_fullsized":"2024-04-16T19:35:29.381317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:20.691413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'543","reported_seq":45408,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381269+0000","last_change":"2024-04-16T17:45:47.464982+0000","last_active":"2024-04-16T19:35:29.381269+0000","last_peered":"2024-04-16T19:35:29.381269+0000","last_clean":"2024-04-16T19:35:29.381269+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:35:29.381269+0000","last_undegraded":"2024-04-16T19:35:29.381269+0000","last_fullsized":"2024-04-16T19:35:29.381269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:18.772947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'9","reported_seq":399,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381245+0000","last_change":"2024-04-16T17:45:45.466563+0000","last_active":"2024-04-16T19:35:29.381245+0000","last_peered":"2024-04-16T19:35:29.381245+0000","last_clean":"2024-04-16T19:35:29.381245+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:35:29.381245+0000","last_undegraded":"2024-04-16T19:35:29.381245+0000","last_fullsized":"2024-04-16T19:35:29.381245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:04.543134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563895+0000","last_change":"2024-04-16T17:45:10.395688+0000","last_active":"2024-04-16T19:35:14.563895+0000","last_peered":"2024-04-16T19:35:14.563895+0000","last_clean":"2024-04-16T19:35:14.563895+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:35:14.563895+0000","last_undegraded":"2024-04-16T19:35:14.563895+0000","last_fullsized":"2024-04-16T19:35:14.563895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:35:32.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.379632+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:35:09.379632+0000","last_peered":"2024-04-16T19:35:09.379632+0000","last_clean":"2024-04-16T19:35:09.379632+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:35:09.379632+0000","last_undegraded":"2024-04-16T19:35:09.379632+0000","last_fullsized":"2024-04-16T19:35:09.379632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"48'2","reported_seq":500,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565852+0000","last_change":"2024-04-16T17:45:20.412567+0000","last_active":"2024-04-16T19:35:24.565852+0000","last_peered":"2024-04-16T19:35:24.565852+0000","last_clean":"2024-04-16T19:35:24.565852+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:35:24.565852+0000","last_undegraded":"2024-04-16T19:35:24.565852+0000","last_fullsized":"2024-04-16T19:35:24.565852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:51.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'120","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383728+0000","last_change":"2024-04-16T17:45:22.416448+0000","last_active":"2024-04-16T19:35:44.383728+0000","last_peered":"2024-04-16T19:35:44.383728+0000","last_clean":"2024-04-16T19:35:44.383728+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:35:44.383728+0000","last_undegraded":"2024-04-16T19:35:44.383728+0000","last_fullsized":"2024-04-16T19:35:44.383728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:14.322665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'12","reported_seq":1395,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384532+0000","last_change":"2024-04-16T17:45:24.426319+0000","last_active":"2024-04-16T19:35:49.384532+0000","last_peered":"2024-04-16T19:35:49.384532+0000","last_clean":"2024-04-16T19:35:49.384532+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:35:49.384532+0000","last_undegraded":"2024-04-16T19:35:49.384532+0000","last_fullsized":"2024-04-16T19:35:49.384532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:33.417685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377809+0000","last_change":"2024-04-16T17:45:26.433965+0000","last_active":"2024-04-16T19:35:09.377809+0000","last_peered":"2024-04-16T19:35:09.377809+0000","last_clean":"2024-04-16T19:35:09.377809+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:35:09.377809+0000","last_undegraded":"2024-04-16T19:35:09.377809+0000","last_fullsized":"2024-04-16T19:35:09.377809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:05:58.231337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568462+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:35:39.568462+0000","last_peered":"2024-04-16T19:35:39.568462+0000","last_clean":"2024-04-16T19:35:39.568462+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:35:39.568462+0000","last_undegraded":"2024-04-16T19:35:39.568462+0000","last_fullsized":"2024-04-16T19:35:39.568462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:55:14.707665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'89","reported_seq":1549,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364103+0000","last_change":"2024-04-16T17:46:25.522263+0000","last_active":"2024-04-16T19:33:49.364103+0000","last_peered":"2024-04-16T19:33:49.364103+0000","last_clean":"2024-04-16T19:33:49.364103+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:33:49.364103+0000","last_undegraded":"2024-04-16T19:33:49.364103+0000","last_fullsized":"2024-04-16T19:33:49.364103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:41.808921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.365032+0000","last_change":"2024-04-16T17:46:17.502070+0000","last_active":"2024-04-16T19:33:39.365032+0000","last_peered":"2024-04-16T19:33:39.365032+0000","last_clean":"2024-04-16T19:33:39.365032+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:33:39.365032+0000","last_undegraded":"2024-04-16T19:33:39.365032+0000","last_fullsized":"2024-04-16T19:33:39.365032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'16","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567630+0000","last_change":"2024-04-16T17:45:51.481303+0000","last_active":"2024-04-16T19:35:34.567630+0000","last_peered":"2024-04-16T19:35:34.567630+0000","last_clean":"2024-04-16T19:35:34.567630+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:35:34.567630+0000","last_undegraded":"2024-04-16T19:35:34.567630+0000","last_fullsized":"2024-04-16T19:35:34.567630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:17.044957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'651","reported_seq":2560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:29.361739+0000","last_change":"2024-04-16T17:45:49.469698+0000","last_active":"2024-04-16T19:33:29.361739+0000","last_peered":"2024-04-16T19:33:29.361739+0000","last_clean":"2024-04-16T19:33:29.361739+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:33:29.361739+0000","last_undegraded":"2024-04-16T19:33:29.361739+0000","last_fullsized":"2024-04-16T19:33:29.361739+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:57:05.931727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'518","reported_seq":957,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.374199+0000","last_change":"2024-04-16T17:45:47.462089+0000","last_active":"2024-04-16T19:34:34.374199+0000","last_peered":"2024-04-16T19:34:34.374199+0000","last_clean":"2024-04-16T19:34:34.374199+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:34:34.374199+0000","last_undegraded":"2024-04-16T19:34:34.374199+0000","last_fullsized":"2024-04-16T19:34:34.374199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:56.475222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'8","reported_seq":371,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371775+0000","last_change":"2024-04-16T17:45:45.457866+0000","last_active":"2024-04-16T19:34:34.371775+0000","last_peered":"2024-04-16T19:34:34.371775+0000","last_clean":"2024-04-16T19:34:34.371775+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:34:34.371775+0000","last_undegraded":"2024-04-16T19:34:34.371775+0000","last_fullsized":"2024-04-16T19:34:34.371775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:18:09.442789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378153+0000","last_change":"2024-04-16T17:45:10.402149+0000","last_active":"2024-04-16T19:35:14.378153+0000","last_peered":"2024-04-16T19:35:14.378153+0000","last_clean":"2024-04-16T19:35:14.378153+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:35:14.378153+0000","last_undegraded":"2024-04-16T19:35:14.378153+0000","last_fullsized":"2024-04-16T19:35:14.378153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:14.688816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377861+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:35:09.377861+0000","last_peered":"2024-04-16T19:35:09.377861+0000","last_clean":"2024-04-16T19:35:09.377861+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:35:09.377861+0000","last_undegraded":"2024-04-16T19:35:09.377861+0000","last_fullsized":"2024-04-16T19:35:09.377861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:49:40.069655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379655+0000","last_change":"2024-04-16T17:45:20.409559+0000","last_active":"2024-04-16T19:35:24.379655+0000","last_peered":"2024-04-16T19:35:24.379655+0000","last_clean":"2024-04-16T19:35:24.379655+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:35:24.379655+0000","last_undegraded":"2024-04-16T19:35:24.379655+0000","last_fullsized":"2024-04-16T19:35:24.379655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:10.476166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'152","reported_seq":345,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371721+0000","last_change":"2024-04-16T17:45:22.415559+0000","last_active":"2024-04-16T19:34:29.371721+0000","last_peered":"2024-04-16T19:34:29.371721+0000","last_clean":"2024-04-16T19:34:29.371721+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:34:29.371721+0000","last_undegraded":"2024-04-16T19:34:29.371721+0000","last_fullsized":"2024-04-16T19:34:29.371721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:12.531458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369795+0000","last_change":"2024-04-16T17:45:24.421195+0000","last_active":"2024-04-16T19:34:09.369795+0000","last_peered":"2024-04-16T19:34:09.369795+0000","last_clean":"2024-04-16T19:34:09.369795+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:34:09.369795+0000","last_undegraded":"2024-04-16T19:34:09.369795+0000","last_fullsized":"2024-04-16T19:34:09.369795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:05.546332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369207+0000","last_change":"2024-04-16T17:45:26.432510+0000","last_active":"2024-04-16T19:34:14.369207+0000","last_peered":"2024-04-16T19:34:14.369207+0000","last_clean":"2024-04-16T19:34:14.369207+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:34:14.369207+0000","last_undegraded":"2024-04-16T19:34:14.369207+0000","last_fullsized":"2024-04-16T19:34:14.369207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:08.477244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565769+0000","last_change":"2024-04-16T18:09:02.169659+0000","last_active":"2024-04-16T19:35:24.565769+0000","last_peered":"2024-04-16T19:35:24.565769+0000","last_clean":"2024-04-16T19:35:24.565769+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:35:24.565769+0000","last_undegraded":"2024-04-16T19:35:24.565769+0000","last_fullsized":"2024-04-16T19:35:24.565769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:46.538084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'119","reported_seq":2030,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547309+0000","last_change":"2024-04-16T17:46:25.523284+0000","last_active":"2024-04-16T19:33:49.547309+0000","last_peered":"2024-04-16T19:33:49.547309+0000","last_clean":"2024-04-16T19:33:49.547309+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:33:49.547309+0000","last_undegraded":"2024-04-16T19:33:49.547309+0000","last_fullsized":"2024-04-16T19:33:49.547309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:27:21.692424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363115+0000","last_change":"2024-04-16T17:46:17.506836+0000","last_active":"2024-04-16T19:33:39.363115+0000","last_peered":"2024-04-16T19:33:39.363115+0000","last_clean":"2024-04-16T19:33:39.363115+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:33:39.363115+0000","last_undegraded":"2024-04-16T19:33:39.363115+0000","last_fullsized":"2024-04-16T19:33:39.363115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'2","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384013+0000","last_change":"2024-04-16T17:45:51.481129+0000","last_active":"2024-04-16T19:35:34.384013+0000","last_peered":"2024-04-16T19:35:34.384013+0000","last_clean":"2024-04-16T19:35:34.384013+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:35:34.384013+0000","last_undegraded":"2024-04-16T19:35:34.384013+0000","last_fullsized":"2024-04-16T19:35:34.384013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:04.680783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'651","reported_seq":2212,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556521+0000","last_change":"2024-04-16T17:45:49.467008+0000","last_active":"2024-04-16T19:34:34.556521+0000","last_peered":"2024-04-16T19:34:34.556521+0000","last_clean":"2024-04-16T19:34:34.556521+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:34:34.556521+0000","last_undegraded":"2024-04-16T19:34:34.556521+0000","last_fullsized":"2024-04-16T19:34:34.556521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:30.562525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'281","reported_seq":571,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.542577+0000","last_change":"2024-04-16T17:45:47.463063+0000","last_active":"2024-04-16T19:33:24.542577+0000","last_peered":"2024-04-16T19:33:24.542577+0000","last_clean":"2024-04-16T19:33:24.542577+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:33:24.542577+0000","last_undegraded":"2024-04-16T19:33:24.542577+0000","last_fullsized":"2024-04-16T19:33:24.542577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:53.197273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'12","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372532+0000","last_change":"2024-04-16T17:45:45.465787+0000","last_active":"2024-04-16T19:34:34.372532+0000","last_peered":"2024-04-16T19:34:34.372532+0000","last_clean":"2024-04-16T19:34:34.372532+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:34:34.372532+0000","last_undegraded":"2024-04-16T19:34:34.372532+0000","last_fullsized":"2024-04-16T19:34:34.372532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378129+0000","last_change":"2024-04-16T17:45:10.392781+0000","last_active":"2024-04-16T19:35:14.378129+0000","last_peered":"2024-04-16T19:35:14.378129+0000","last_clean":"2024-04-16T19:35:14.378129+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:35:14.378129+0000","last_undegraded":"2024-04-16T19:35:14.378129+0000","last_fullsized":"2024-04-16T19:35:14.378129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:39.831957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377922+0000","last_change":"2024-04-16T17:45:08.386175+0000","last_active":"2024-04-16T19:35:09.377922+0000","last_peered":"2024-04-16T19:35:09.377922+0000","last_clean":"2024-04-16T19:35:09.377922+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:35:09.377922+0000","last_undegraded":"2024-04-16T19:35:09.377922+0000","last_fullsized":"2024-04-16T19:35:09.377922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"48'11","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380444+0000","last_change":"2024-04-16T17:45:20.407986+0000","last_active":"2024-04-16T19:35:24.380444+0000","last_peered":"2024-04-16T19:35:24.380444+0000","last_clean":"2024-04-16T19:35:24.380444+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:35:24.380444+0000","last_undegraded":"2024-04-16T19:35:24.380444+0000","last_fullsized":"2024-04-16T19:35:24.380444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:11.567092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369836+0000","last_change":"2024-04-16T17:45:22.415078+0000","last_active":"2024-04-16T19:34:09.369836+0000","last_peered":"2024-04-16T19:34:09.369836+0000","last_clean":"2024-04-16T19:34:09.369836+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:34:09.369836+0000","last_undegraded":"2024-04-16T19:34:09.369836+0000","last_fullsized":"2024-04-16T19:34:09.369836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:40.426580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371537+0000","last_change":"2024-04-16T17:45:24.425398+0000","last_active":"2024-04-16T19:34:29.371537+0000","last_peered":"2024-04-16T19:34:29.371537+0000","last_clean":"2024-04-16T19:34:29.371537+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:34:29.371537+0000","last_undegraded":"2024-04-16T19:34:29.371537+0000","last_fullsized":"2024-04-16T19:34:29.371537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:27.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552315+0000","last_change":"2024-04-16T17:45:26.849126+0000","last_active":"2024-04-16T19:34:14.552315+0000","last_peered":"2024-04-16T19:34:14.552315+0000","last_clean":"2024-04-16T19:34:14.552315+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:34:14.552315+0000","last_undegraded":"2024-04-16T19:34:14.552315+0000","last_fullsized":"2024-04-16T19:34:14.552315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:50.423306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382138+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:35:24.382138+0000","last_peered":"2024-04-16T19:35:24.382138+0000","last_clean":"2024-04-16T19:35:24.382138+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:35:24.382138+0000","last_undegraded":"2024-04-16T19:35:24.382138+0000","last_fullsized":"2024-04-16T19:35:24.382138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:39.644301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'120","reported_seq":1725,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547466+0000","last_change":"2024-04-16T17:46:25.526370+0000","last_active":"2024-04-16T19:33:49.547466+0000","last_peered":"2024-04-16T19:33:49.547466+0000","last_clean":"2024-04-16T19:33:49.547466+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:33:49.547466+0000","last_undegraded":"2024-04-16T19:33:49.547466+0000","last_fullsized":"2024-04-16T19:33:49.547466+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:22.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545358+0000","last_change":"2024-04-16T17:46:17.500988+0000","last_active":"2024-04-16T19:33:39.545358+0000","last_peered":"2024-04-16T19:33:39.545358+0000","last_clean":"2024-04-16T19:33:39.545358+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:33:39.545358+0000","last_undegraded":"2024-04-16T19:33:39.545358+0000","last_fullsized":"2024-04-16T19:33:39.545358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:54.079540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'19","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382058+0000","last_change":"2024-04-16T17:45:51.478621+0000","last_active":"2024-04-16T19:35:34.382058+0000","last_peered":"2024-04-16T19:35:34.382058+0000","last_clean":"2024-04-16T19:35:34.382058+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:35:34.382058+0000","last_undegraded":"2024-04-16T19:35:34.382058+0000","last_fullsized":"2024-04-16T19:35:34.382058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:28.047515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372631+0000","last_change":"2024-04-16T17:45:49.474101+0000","last_active":"2024-04-16T19:34:34.372631+0000","last_peered":"2024-04-16T19:34:34.372631+0000","last_clean":"2024-04-16T19:34:34.372631+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:34:34.372631+0000","last_undegraded":"2024-04-16T19:34:34.372631+0000","last_fullsized":"2024-04-16T19:34:34.372631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:47:15.346074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5043","reported_seq":7393,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372551+0000","last_change":"2024-04-16T17:45:47.462940+0000","last_active":"2024-04-16T19:34:34.372551+0000","last_peered":"2024-04-16T19:34:34.372551+0000","last_clean":"2024-04-16T19:34:34.372551+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:34:34.372551+0000","last_undegraded":"2024-04-16T19:34:34.372551+0000","last_fullsized":"2024-04-16T19:34:34.372551+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":3000,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:36.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'13","reported_seq":440,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.542611+0000","last_change":"2024-04-16T17:45:45.458908+0000","last_active":"2024-04-16T19:33:24.542611+0000","last_peered":"2024-04-16T19:33:24.542611+0000","last_clean":"2024-04-16T19:33:24.542611+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:33:24.542611+0000","last_undegraded":"2024-04-16T19:33:24.542611+0000","last_fullsized":"2024-04-16T19:33:24.542611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:41:32.351978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.371697+0000","last_change":"2024-04-16T17:45:10.397270+0000","last_active":"2024-04-16T19:34:19.371697+0000","last_peered":"2024-04-16T19:34:19.371697+0000","last_clean":"2024-04-16T19:34:19.371697+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:34:19.371697+0000","last_undegraded":"2024-04-16T19:34:19.371697+0000","last_fullsized":"2024-04-16T19:34:19.371697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:04.267541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565907+0000","last_change":"2024-04-16T17:45:08.385404+0000","last_active":"2024-04-16T19:35:24.565907+0000","last_peered":"2024-04-16T19:35:24.565907+0000","last_clean":"2024-04-16T19:35:24.565907+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:35:24.565907+0000","last_undegraded":"2024-04-16T19:35:24.565907+0000","last_fullsized":"2024-04-16T19:35:24.565907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'6","reported_seq":1404,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367767+0000","last_change":"2024-04-16T17:45:20.413621+0000","last_active":"2024-04-16T19:34:09.367767+0000","last_peered":"2024-04-16T19:34:09.367767+0000","last_clean":"2024-04-16T19:34:09.367767+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:34:09.367767+0000","last_undegraded":"2024-04-16T19:34:09.367767+0000","last_fullsized":"2024-04-16T19:34:09.367767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:36.005251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'32","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382168+0000","last_change":"2024-04-16T17:45:22.415077+0000","last_active":"2024-04-16T19:35:24.382168+0000","last_peered":"2024-04-16T19:35:24.382168+0000","last_clean":"2024-04-16T19:35:24.382168+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:35:24.382168+0000","last_undegraded":"2024-04-16T19:35:24.382168+0000","last_fullsized":"2024-04-16T19:35:24.382168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:27.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380516+0000","last_change":"2024-04-16T17:45:24.430903+0000","last_active":"2024-04-16T19:35:24.380516+0000","last_peered":"2024-04-16T19:35:24.380516+0000","last_clean":"2024-04-16T19:35:24.380516+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:35:24.380516+0000","last_undegraded":"2024-04-16T19:35:24.380516+0000","last_fullsized":"2024-04-16T19:35:24.380516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:55.371897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369101+0000","last_change":"2024-04-16T17:45:26.438619+0000","last_active":"2024-04-16T19:34:14.369101+0000","last_peered":"2024-04-16T19:34:14.369101+0000","last_clean":"2024-04-16T19:34:14.369101+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:34:14.369101+0000","last_undegraded":"2024-04-16T19:34:14.369101+0000","last_fullsized":"2024-04-16T19:34:14.369101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:15.584111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565746+0000","last_change":"2024-04-16T18:09:02.166083+0000","last_active":"2024-04-16T19:35:24.565746+0000","last_peered":"2024-04-16T19:35:24.565746+0000","last_clean":"2024-04-16T19:35:24.565746+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:35:24.565746+0000","last_undegraded":"2024-04-16T19:35:24.565746+0000","last_fullsized":"2024-04-16T19:35:24.565746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:14.230771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'126","reported_seq":1716,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547364+0000","last_change":"2024-04-16T17:46:25.531755+0000","last_active":"2024-04-16T19:33:49.547364+0000","last_peered":"2024-04-16T19:33:49.547364+0000","last_clean":"2024-04-16T19:33:49.547364+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:33:49.547364+0000","last_undegraded":"2024-04-16T19:33:49.547364+0000","last_fullsized":"2024-04-16T19:33:49.547364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:38.947978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545431+0000","last_change":"2024-04-16T17:46:17.505902+0000","last_active":"2024-04-16T19:33:39.545431+0000","last_peered":"2024-04-16T19:33:39.545431+0000","last_clean":"2024-04-16T19:33:39.545431+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:33:39.545431+0000","last_undegraded":"2024-04-16T19:33:39.545431+0000","last_fullsized":"2024-04-16T19:33:39.545431+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:54.200238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'10","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.383978+0000","last_change":"2024-04-16T17:45:51.478912+0000","last_active":"2024-04-16T19:35:34.383978+0000","last_peered":"2024-04-16T19:35:34.383978+0000","last_clean":"2024-04-16T19:35:34.383978+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:35:34.383978+0000","last_undegraded":"2024-04-16T19:35:34.383978+0000","last_fullsized":"2024-04-16T19:35:34.383978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:20.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372659+0000","last_change":"2024-04-16T17:45:49.470949+0000","last_active":"2024-04-16T19:34:34.372659+0000","last_peered":"2024-04-16T19:34:34.372659+0000","last_clean":"2024-04-16T19:34:34.372659+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:34:34.372659+0000","last_undegraded":"2024-04-16T19:34:34.372659+0000","last_fullsized":"2024-04-16T19:34:34.372659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:38:03.985918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'554","reported_seq":1527,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372495+0000","last_change":"2024-04-16T17:45:47.464106+0000","last_active":"2024-04-16T19:34:34.372495+0000","last_peered":"2024-04-16T19:34:34.372495+0000","last_clean":"2024-04-16T19:34:34.372495+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:34:34.372495+0000","last_undegraded":"2024-04-16T19:34:34.372495+0000","last_fullsized":"2024-04-16T19:34:34.372495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:24.659574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'6","reported_seq":517,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371703+0000","last_change":"2024-04-16T17:45:45.454923+0000","last_active":"2024-04-16T19:34:34.371703+0000","last_peered":"2024-04-16T19:34:34.371703+0000","last_clean":"2024-04-16T19:34:34.371703+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:34:34.371703+0000","last_undegraded":"2024-04-16T19:34:34.371703+0000","last_fullsized":"2024-04-16T19:34:34.371703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:16.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366331+0000","last_change":"2024-04-16T17:45:10.400150+0000","last_active":"2024-04-16T19:33:59.366331+0000","last_peered":"2024-04-16T19:33:59.366331+0000","last_clean":"2024-04-16T19:33:59.366331+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:33:59.366331+0000","last_undegraded":"2024-04-16T19:33:59.366331+0000","last_fullsized":"2024-04-16T19:33:59.366331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:22:56.234389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384160+0000","last_change":"2024-04-16T17:45:08.386622+0000","last_active":"2024-04-16T19:35:34.384160+0000","last_peered":"2024-04-16T19:35:34.384160+0000","last_clean":"2024-04-16T19:35:34.384160+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:35:34.384160+0000","last_undegraded":"2024-04-16T19:35:34.384160+0000","last_fullsized":"2024-04-16T19:35:34.384160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:45.243544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554295+0000","last_change":"2024-04-16T17:45:20.412420+0000","last_active":"2024-04-16T19:34:24.554295+0000","last_peered":"2024-04-16T19:34:24.554295+0000","last_clean":"2024-04-16T19:34:24.554295+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:34:24.554295+0000","last_undegraded":"2024-04-16T19:34:24.554295+0000","last_fullsized":"2024-04-16T19:34:24.554295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:06.239898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'80","reported_seq":236,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379675+0000","last_change":"2024-04-16T17:45:22.421586+0000","last_active":"2024-04-16T19:35:24.379675+0000","last_peered":"2024-04-16T19:35:24.379675+0000","last_clean":"2024-04-16T19:35:24.379675+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:35:24.379675+0000","last_undegraded":"2024-04-16T19:35:24.379675+0000","last_fullsized":"2024-04-16T19:35:24.379675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:38.487045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382204+0000","last_change":"2024-04-16T17:45:24.424290+0000","last_active":"2024-04-16T19:35:24.382204+0000","last_peered":"2024-04-16T19:35:24.382204+0000","last_clean":"2024-04-16T19:35:24.382204+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:35:24.382204+0000","last_undegraded":"2024-04-16T19:35:24.382204+0000","last_fullsized":"2024-04-16T19:35:24.382204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.451179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380429+0000","last_change":"2024-04-16T17:45:26.433279+0000","last_active":"2024-04-16T19:35:29.380429+0000","last_peered":"2024-04-16T19:35:29.380429+0000","last_clean":"2024-04-16T19:35:29.380429+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:35:29.380429+0000","last_undegraded":"2024-04-16T19:35:29.380429+0000","last_fullsized":"2024-04-16T19:35:29.380429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:53.357161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'5","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547447+0000","last_change":"2024-04-16T17:45:45.455663+0000","last_active":"2024-04-16T19:33:49.547447+0000","last_peered":"2024-04-16T19:33:49.547447+0000","last_clean":"2024-04-16T19:33:49.547447+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:33:49.547447+0000","last_undegraded":"2024-04-16T19:33:49.547447+0000","last_fullsized":"2024-04-16T19:33:49.547447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:03.461208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557429+0000","last_change":"2024-04-16T17:46:16.500595+0000","last_active":"2024-04-16T19:34:39.557429+0000","last_peered":"2024-04-16T19:34:39.557429+0000","last_clean":"2024-04-16T19:34:39.557429+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:34:39.557429+0000","last_undegraded":"2024-04-16T19:34:39.557429+0000","last_fullsized":"2024-04-16T19:34:39.557429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:59.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381260+0000","last_change":"2024-04-16T17:45:08.383072+0000","last_active":"2024-04-16T19:35:34.381260+0000","last_peered":"2024-04-16T19:35:34.381260+0000","last_clean":"2024-04-16T19:35:34.381260+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:35:34.381260+0000","last_undegraded":"2024-04-16T19:35:34.381260+0000","last_fullsized":"2024-04-16T19:35:34.381260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:05:58.862115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'15","reported_seq":225,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364974+0000","last_change":"2024-04-16T17:45:45.464950+0000","last_active":"2024-04-16T19:33:49.364974+0000","last_peered":"2024-04-16T19:33:49.364974+0000","last_clean":"2024-04-16T19:33:49.364974+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:33:49.364974+0000","last_undegraded":"2024-04-16T19:33:49.364974+0000","last_fullsized":"2024-04-16T19:33:49.364974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:39.088704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569767+0000","last_change":"2024-04-16T17:45:10.396086+0000","last_active":"2024-04-16T19:35:44.569767+0000","last_peered":"2024-04-16T19:35:44.569767+0000","last_clean":"2024-04-16T19:35:44.569767+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:35:44.569767+0000","last_undegraded":"2024-04-16T19:35:44.569767+0000","last_fullsized":"2024-04-16T19:35:44.569767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:53.484971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567556+0000","last_change":"2024-04-16T17:45:08.390555+0000","last_active":"2024-04-16T19:35:34.567556+0000","last_peered":"2024-04-16T19:35:34.567556+0000","last_clean":"2024-04-16T19:35:34.567556+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:35:34.567556+0000","last_undegraded":"2024-04-16T19:35:34.567556+0000","last_fullsized":"2024-04-16T19:35:34.567556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:29.317076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'18","reported_seq":469,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371671+0000","last_change":"2024-04-16T17:45:45.464620+0000","last_active":"2024-04-16T19:34:29.371671+0000","last_peered":"2024-04-16T19:34:29.371671+0000","last_clean":"2024-04-16T19:34:29.371671+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:34:29.371671+0000","last_undegraded":"2024-04-16T19:34:29.371671+0000","last_fullsized":"2024-04-16T19:34:29.371671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:41.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383715+0000","last_change":"2024-04-16T17:45:10.400426+0000","last_active":"2024-04-16T19:35:44.383715+0000","last_peered":"2024-04-16T19:35:44.383715+0000","last_clean":"2024-04-16T19:35:44.383715+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:35:44.383715+0000","last_undegraded":"2024-04-16T19:35:44.383715+0000","last_fullsized":"2024-04-16T19:35:44.383715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:57.696534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557330+0000","last_change":"2024-04-16T17:46:16.499950+0000","last_active":"2024-04-16T19:34:39.557330+0000","last_peered":"2024-04-16T19:34:39.557330+0000","last_clean":"2024-04-16T19:34:39.557330+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:34:39.557330+0000","last_undegraded":"2024-04-16T19:34:39.557330+0000","last_fullsized":"2024-04-16T19:34:39.557330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:37:22.903930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'9","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369392+0000","last_change":"2024-04-16T17:46:16.503571+0000","last_active":"2024-04-16T19:34:19.369392+0000","last_peered":"2024-04-16T19:34:19.369392+0000","last_clean":"2024-04-16T19:34:19.369392+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:34:19.369392+0000","last_undegraded":"2024-04-16T19:34:19.369392+0000","last_fullsized":"2024-04-16T19:34:19.369392+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569655+0000","last_change":"2024-04-16T17:45:10.394142+0000","last_active":"2024-04-16T19:35:44.569655+0000","last_peered":"2024-04-16T19:35:44.569655+0000","last_clean":"2024-04-16T19:35:44.569655+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:35:44.569655+0000","last_undegraded":"2024-04-16T19:35:44.569655+0000","last_fullsized":"2024-04-16T19:35:44.569655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:55.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387387+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:35:54.387387+0000","last_peered":"2024-04-16T19:35:54.387387+0000","last_clean":"2024-04-16T19:35:54.387387+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:35:54.387387+0000","last_undegraded":"2024-04-16T19:35:54.387387+0000","last_fullsized":"2024-04-16T19:35:54.387387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:51.477510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'6","reported_seq":218,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381435+0000","last_change":"2024-04-16T17:45:45.463398+0000","last_active":"2024-04-16T19:35:29.381435+0000","last_peered":"2024-04-16T19:35:29.381435+0000","last_clean":"2024-04-16T19:35:29.381435+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:35:29.381435+0000","last_undegraded":"2024-04-16T19:35:29.381435+0000","last_fullsized":"2024-04-16T19:35:29.381435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:07.065221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571544+0000","last_change":"2024-04-16T17:45:10.394131+0000","last_active":"2024-04-16T19:35:54.571544+0000","last_peered":"2024-04-16T19:35:54.571544+0000","last_clean":"2024-04-16T19:35:54.571544+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:35:54.571544+0000","last_undegraded":"2024-04-16T19:35:54.571544+0000","last_fullsized":"2024-04-16T19:35:54.571544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:18:12.092314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384888+0000","last_change":"2024-04-16T17:45:08.390961+0000","last_active":"2024-04-16T19:35:39.384888+0000","last_peered":"2024-04-16T19:35:39.384888+0000","last_clean":"2024-04-16T19:35:39.384888+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:35:39.384888+0000","last_undegraded":"2024-04-16T19:35:39.384888+0000","last_fullsized":"2024-04-16T19:35:39.384888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:36.615698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'50","reported_seq":632,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566804+0000","last_change":"2024-04-16T17:45:45.465543+0000","last_active":"2024-04-16T19:35:29.566804+0000","last_peered":"2024-04-16T19:35:29.566804+0000","last_clean":"2024-04-16T19:35:29.566804+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:35:29.566804+0000","last_undegraded":"2024-04-16T19:35:29.566804+0000","last_fullsized":"2024-04-16T19:35:29.566804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:54.444903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382232+0000","last_change":"2024-04-16T17:45:10.394908+0000","last_active":"2024-04-16T19:35:39.382232+0000","last_peered":"2024-04-16T19:35:39.382232+0000","last_clean":"2024-04-16T19:35:39.382232+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:35:39.382232+0000","last_undegraded":"2024-04-16T19:35:39.382232+0000","last_fullsized":"2024-04-16T19:35:39.382232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:00.759798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568749+0000","last_change":"2024-04-16T17:45:08.382445+0000","last_active":"2024-04-16T19:35:39.568749+0000","last_peered":"2024-04-16T19:35:39.568749+0000","last_clean":"2024-04-16T19:35:39.568749+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:35:39.568749+0000","last_undegraded":"2024-04-16T19:35:39.568749+0000","last_fullsized":"2024-04-16T19:35:39.568749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:46:03.130129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'9","reported_seq":157,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547546+0000","last_change":"2024-04-16T17:45:45.459475+0000","last_active":"2024-04-16T19:33:49.547546+0000","last_peered":"2024-04-16T19:33:49.547546+0000","last_clean":"2024-04-16T19:33:49.547546+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:33:49.547546+0000","last_undegraded":"2024-04-16T19:33:49.547546+0000","last_fullsized":"2024-04-16T19:33:49.547546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:38.609449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568527+0000","last_change":"2024-04-16T17:45:10.398439+0000","last_active":"2024-04-16T19:35:39.568527+0000","last_peered":"2024-04-16T19:35:39.568527+0000","last_clean":"2024-04-16T19:35:39.568527+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:35:39.568527+0000","last_undegraded":"2024-04-16T19:35:39.568527+0000","last_fullsized":"2024-04-16T19:35:39.568527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:39.589700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382931+0000","last_change":"2024-04-16T17:45:08.388353+0000","last_active":"2024-04-16T19:35:39.382931+0000","last_peered":"2024-04-16T19:35:39.382931+0000","last_clean":"2024-04-16T19:35:39.382931+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:35:39.382931+0000","last_undegraded":"2024-04-16T19:35:39.382931+0000","last_fullsized":"2024-04-16T19:35:39.382931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'11","reported_seq":529,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550415+0000","last_change":"2024-04-16T17:45:45.461419+0000","last_active":"2024-04-16T19:34:04.550415+0000","last_peered":"2024-04-16T19:34:04.550415+0000","last_clean":"2024-04-16T19:34:04.550415+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:34:04.550415+0000","last_undegraded":"2024-04-16T19:34:04.550415+0000","last_fullsized":"2024-04-16T19:34:04.550415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:58:08.710389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382760+0000","last_change":"2024-04-16T17:45:10.393085+0000","last_active":"2024-04-16T19:35:39.382760+0000","last_peered":"2024-04-16T19:35:39.382760+0000","last_clean":"2024-04-16T19:35:39.382760+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:35:39.382760+0000","last_undegraded":"2024-04-16T19:35:39.382760+0000","last_fullsized":"2024-04-16T19:35:39.382760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:10.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568742+0000","last_change":"2024-04-16T17:45:08.387778+0000","last_active":"2024-04-16T19:35:39.568742+0000","last_peered":"2024-04-16T19:35:39.568742+0000","last_clean":"2024-04-16T19:35:39.568742+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:35:39.568742+0000","last_undegraded":"2024-04-16T19:35:39.568742+0000","last_fullsized":"2024-04-16T19:35:39.568742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:58.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'6","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368125+0000","last_change":"2024-04-16T17:45:45.460984+0000","last_active":"2024-04-16T19:34:09.368125+0000","last_peered":"2024-04-16T19:34:09.368125+0000","last_clean":"2024-04-16T19:34:09.368125+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:34:09.368125+0000","last_undegraded":"2024-04-16T19:34:09.368125+0000","last_fullsized":"2024-04-16T19:34:09.368125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:54:54.185407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.377274+0000","last_change":"2024-04-16T17:45:10.397793+0000","last_active":"2024-04-16T19:34:54.377274+0000","last_peered":"2024-04-16T19:34:54.377274+0000","last_clean":"2024-04-16T19:34:54.377274+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:34:54.377274+0000","last_undegraded":"2024-04-16T19:34:54.377274+0000","last_fullsized":"2024-04-16T19:34:54.377274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:26.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364845+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:33:49.364845+0000","last_peered":"2024-04-16T19:33:49.364845+0000","last_clean":"2024-04-16T19:33:49.364845+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:33:49.364845+0000","last_undegraded":"2024-04-16T19:33:49.364845+0000","last_fullsized":"2024-04-16T19:33:49.364845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'6","reported_seq":365,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554372+0000","last_change":"2024-04-16T17:45:45.454358+0000","last_active":"2024-04-16T19:34:24.554372+0000","last_peered":"2024-04-16T19:34:24.554372+0000","last_clean":"2024-04-16T19:34:24.554372+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:34:24.554372+0000","last_undegraded":"2024-04-16T19:34:24.554372+0000","last_fullsized":"2024-04-16T19:34:24.554372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:05.027153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375005+0000","last_change":"2024-04-16T17:45:10.390881+0000","last_active":"2024-04-16T19:34:54.375005+0000","last_peered":"2024-04-16T19:34:54.375005+0000","last_clean":"2024-04-16T19:34:54.375005+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:34:54.375005+0000","last_undegraded":"2024-04-16T19:34:54.375005+0000","last_fullsized":"2024-04-16T19:34:54.375005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:58.273468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382101+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:35:24.382101+0000","last_peered":"2024-04-16T19:35:24.382101+0000","last_clean":"2024-04-16T19:35:24.382101+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:35:24.382101+0000","last_undegraded":"2024-04-16T19:35:24.382101+0000","last_fullsized":"2024-04-16T19:35:24.382101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'12","reported_seq":411,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369866+0000","last_change":"2024-04-16T17:45:45.466651+0000","last_active":"2024-04-16T19:34:09.369866+0000","last_peered":"2024-04-16T19:34:09.369866+0000","last_clean":"2024-04-16T19:34:09.369866+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:34:09.369866+0000","last_undegraded":"2024-04-16T19:34:09.369866+0000","last_fullsized":"2024-04-16T19:34:09.369866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:40.527095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569671+0000","last_change":"2024-04-16T17:45:10.393700+0000","last_active":"2024-04-16T19:35:44.569671+0000","last_peered":"2024-04-16T19:35:44.569671+0000","last_clean":"2024-04-16T19:35:44.569671+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:35:44.569671+0000","last_undegraded":"2024-04-16T19:35:44.569671+0000","last_fullsized":"2024-04-16T19:35:44.569671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:02:23.287018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380398+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:35:24.380398+0000","last_peered":"2024-04-16T19:35:24.380398+0000","last_clean":"2024-04-16T19:35:24.380398+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:35:24.380398+0000","last_undegraded":"2024-04-16T19:35:24.380398+0000","last_fullsized":"2024-04-16T19:35:24.380398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:58.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'14","reported_seq":681,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551292+0000","last_change":"2024-04-16T17:45:45.455567+0000","last_active":"2024-04-16T19:34:09.551292+0000","last_peered":"2024-04-16T19:34:09.551292+0000","last_clean":"2024-04-16T19:34:09.551292+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:34:09.551292+0000","last_undegraded":"2024-04-16T19:34:09.551292+0000","last_fullsized":"2024-04-16T19:34:09.551292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:53:12.376645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381352+0000","last_change":"2024-04-16T17:45:10.390598+0000","last_active":"2024-04-16T19:35:29.381352+0000","last_peered":"2024-04-16T19:35:29.381352+0000","last_clean":"2024-04-16T19:35:29.381352+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:35:29.381352+0000","last_undegraded":"2024-04-16T19:35:29.381352+0000","last_fullsized":"2024-04-16T19:35:29.381352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:19.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382184+0000","last_change":"2024-04-16T17:45:08.389493+0000","last_active":"2024-04-16T19:35:24.382184+0000","last_peered":"2024-04-16T19:35:24.382184+0000","last_clean":"2024-04-16T19:35:24.382184+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:35:24.382184+0000","last_undegraded":"2024-04-16T19:35:24.382184+0000","last_fullsized":"2024-04-16T19:35:24.382184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'15","reported_seq":211,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368646+0000","last_change":"2024-04-16T17:45:45.464470+0000","last_active":"2024-04-16T19:34:09.368646+0000","last_peered":"2024-04-16T19:34:09.368646+0000","last_clean":"2024-04-16T19:34:09.368646+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:34:09.368646+0000","last_undegraded":"2024-04-16T19:34:09.368646+0000","last_fullsized":"2024-04-16T19:34:09.368646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:14.079978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380416+0000","last_change":"2024-04-16T17:45:10.397665+0000","last_active":"2024-04-16T19:35:29.380416+0000","last_peered":"2024-04-16T19:35:29.380416+0000","last_clean":"2024-04-16T19:35:29.380416+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:35:29.380416+0000","last_undegraded":"2024-04-16T19:35:29.380416+0000","last_fullsized":"2024-04-16T19:35:29.380416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:53.725890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380581+0000","last_change":"2024-04-16T17:45:08.386399+0000","last_active":"2024-04-16T19:35:24.380581+0000","last_peered":"2024-04-16T19:35:24.380581+0000","last_clean":"2024-04-16T19:35:24.380581+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:35:24.380581+0000","last_undegraded":"2024-04-16T19:35:24.380581+0000","last_fullsized":"2024-04-16T19:35:24.380581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:55.689073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'3","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551522+0000","last_change":"2024-04-16T17:45:45.455538+0000","last_active":"2024-04-16T19:34:09.551522+0000","last_peered":"2024-04-16T19:34:09.551522+0000","last_clean":"2024-04-16T19:34:09.551522+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:34:09.551522+0000","last_undegraded":"2024-04-16T19:34:09.551522+0000","last_fullsized":"2024-04-16T19:34:09.551522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:38.174415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383169+0000","last_change":"2024-04-16T17:45:10.393634+0000","last_active":"2024-04-16T19:35:29.383169+0000","last_peered":"2024-04-16T19:35:29.383169+0000","last_clean":"2024-04-16T19:35:29.383169+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:35:29.383169+0000","last_undegraded":"2024-04-16T19:35:29.383169+0000","last_fullsized":"2024-04-16T19:35:29.383169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:00.458421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383699+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:35:44.383699+0000","last_peered":"2024-04-16T19:35:44.383699+0000","last_clean":"2024-04-16T19:35:44.383699+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:35:44.383699+0000","last_undegraded":"2024-04-16T19:35:44.383699+0000","last_fullsized":"2024-04-16T19:35:44.383699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:55.231268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'9","reported_seq":448,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551428+0000","last_change":"2024-04-16T17:45:45.454411+0000","last_active":"2024-04-16T19:34:09.551428+0000","last_peered":"2024-04-16T19:34:09.551428+0000","last_clean":"2024-04-16T19:34:09.551428+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:34:09.551428+0000","last_undegraded":"2024-04-16T19:34:09.551428+0000","last_fullsized":"2024-04-16T19:34:09.551428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:55:01.786817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566621+0000","last_change":"2024-04-16T17:45:10.399193+0000","last_active":"2024-04-16T19:35:29.566621+0000","last_peered":"2024-04-16T19:35:29.566621+0000","last_clean":"2024-04-16T19:35:29.566621+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:35:29.566621+0000","last_undegraded":"2024-04-16T19:35:29.566621+0000","last_fullsized":"2024-04-16T19:35:29.566621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:06.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559232+0000","last_change":"2024-04-16T17:45:08.388974+0000","last_active":"2024-04-16T19:34:49.559232+0000","last_peered":"2024-04-16T19:34:49.559232+0000","last_clean":"2024-04-16T19:34:49.559232+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:34:49.559232+0000","last_undegraded":"2024-04-16T19:34:49.559232+0000","last_fullsized":"2024-04-16T19:34:49.559232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:35.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'3","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370003+0000","last_change":"2024-04-16T17:45:45.466411+0000","last_active":"2024-04-16T19:34:09.370003+0000","last_peered":"2024-04-16T19:34:09.370003+0000","last_clean":"2024-04-16T19:34:09.370003+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:34:09.370003+0000","last_undegraded":"2024-04-16T19:34:09.370003+0000","last_fullsized":"2024-04-16T19:34:09.370003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:41.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365563+0000","last_change":"2024-04-16T17:45:10.392230+0000","last_active":"2024-04-16T19:33:54.365563+0000","last_peered":"2024-04-16T19:33:54.365563+0000","last_clean":"2024-04-16T19:33:54.365563+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:33:54.365563+0000","last_undegraded":"2024-04-16T19:33:54.365563+0000","last_fullsized":"2024-04-16T19:33:54.365563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:41.531980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374829+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:34:49.374829+0000","last_peered":"2024-04-16T19:34:49.374829+0000","last_clean":"2024-04-16T19:34:49.374829+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:34:49.374829+0000","last_undegraded":"2024-04-16T19:34:49.374829+0000","last_fullsized":"2024-04-16T19:34:49.374829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:56.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'7","reported_seq":317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361610+0000","last_change":"2024-04-16T17:45:45.467943+0000","last_active":"2024-04-16T19:33:19.361610+0000","last_peered":"2024-04-16T19:33:19.361610+0000","last_clean":"2024-04-16T19:33:19.361610+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:33:19.361610+0000","last_undegraded":"2024-04-16T19:33:19.361610+0000","last_fullsized":"2024-04-16T19:33:19.361610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:37.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374628+0000","last_change":"2024-04-16T17:45:08.386818+0000","last_active":"2024-04-16T19:34:49.374628+0000","last_peered":"2024-04-16T19:34:49.374628+0000","last_clean":"2024-04-16T19:34:49.374628+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:34:49.374628+0000","last_undegraded":"2024-04-16T19:34:49.374628+0000","last_fullsized":"2024-04-16T19:34:49.374628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:29.526811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.371846+0000","last_change":"2024-04-16T17:45:10.391395+0000","last_active":"2024-04-16T19:34:19.371846+0000","last_peered":"2024-04-16T19:34:19.371846+0000","last_clean":"2024-04-16T19:34:19.371846+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:34:19.371846+0000","last_undegraded":"2024-04-16T19:34:19.371846+0000","last_fullsized":"2024-04-16T19:34:19.371846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:57.238729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'29","reported_seq":754,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541691+0000","last_change":"2024-04-16T17:45:45.461627+0000","last_active":"2024-04-16T19:33:19.541691+0000","last_peered":"2024-04-16T19:33:19.541691+0000","last_clean":"2024-04-16T19:33:19.541691+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:33:19.541691+0000","last_undegraded":"2024-04-16T19:33:19.541691+0000","last_fullsized":"2024-04-16T19:33:19.541691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:37.357293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559097+0000","last_change":"2024-04-16T17:45:08.389341+0000","last_active":"2024-04-16T19:34:49.559097+0000","last_peered":"2024-04-16T19:34:49.559097+0000","last_clean":"2024-04-16T19:34:49.559097+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:34:49.559097+0000","last_undegraded":"2024-04-16T19:34:49.559097+0000","last_fullsized":"2024-04-16T19:34:49.559097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:35.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366646+0000","last_change":"2024-04-16T17:45:10.395147+0000","last_active":"2024-04-16T19:33:59.366646+0000","last_peered":"2024-04-16T19:33:59.366646+0000","last_clean":"2024-04-16T19:33:59.366646+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:33:59.366646+0000","last_undegraded":"2024-04-16T19:33:59.366646+0000","last_fullsized":"2024-04-16T19:33:59.366646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:56.222153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4205,"ondisk_log_size":4205,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3706,"ondisk_log_size":3706,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":749,"ondisk_log_size":749,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20907,"ondisk_log_size":20907,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5228,"ondisk_log_size":5228,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641624,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46644,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810956,"statfs":{"total":107374182400,"available":107326418944,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641623,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":58984,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798616,"statfs":{"total":107374182400,"available":107313782784,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641624,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":83468,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":104774132,"statfs":{"total":107374182400,"available":107288711168,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641623,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46796,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810804,"statfs":{"total":107374182400,"available":107326263296,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641622,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46772,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810828,"statfs":{"total":107374182400,"available":107326287872,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641624,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51520,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806080,"statfs":{"total":107374182400,"available":107321425920,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:38:05.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:38:05.803 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:38:05.820 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:38:05.822 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3459,"stamp":"2024-04-16T19:38:04.493973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35609,"ondisk_log_size":35609,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":334184,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":322998,"kb_avail":628811416,"statfs":{"total":644245094400,"available":643902889984,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":330750625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005423"},"pg_stats":[{"pgid":"9.35","version":"53'18","reported_seq":516,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556486+0000","last_change":"2024-04-16T17:45:45.459835+0000","last_active":"2024-04-16T19:34:34.556486+0000","last_peered":"2024-04-16T19:34:34.556486+0000","last_clean":"2024-04-16T19:34:34.556486+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:34:34.556486+0000","last_undegraded":"2024-04-16T19:34:34.556486+0000","last_fullsized":"2024-04-16T19:34:34.556486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:41.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382165+0000","last_change":"2024-04-16T17:45:08.383247+0000","last_active":"2024-04-16T19:35:34.382165+0000","last_peered":"2024-04-16T19:35:34.382165+0000","last_clean":"2024-04-16T19:35:34.382165+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:35:34.382165+0000","last_undegraded":"2024-04-16T19:35:34.382165+0000","last_fullsized":"2024-04-16T19:35:34.382165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:20.213795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378639+0000","last_change":"2024-04-16T17:45:10.400343+0000","last_active":"2024-04-16T19:35:14.378639+0000","last_peered":"2024-04-16T19:35:14.378639+0000","last_clean":"2024-04-16T19:35:14.378639+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:35:14.378639+0000","last_undegraded":"2024-04-16T19:35:14.378639+0000","last_fullsized":"2024-04-16T19:35:14.378639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:34:35.746556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'6","reported_seq":288,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372581+0000","last_change":"2024-04-16T17:45:45.464134+0000","last_active":"2024-04-16T19:34:34.372581+0000","last_peered":"2024-04-16T19:34:34.372581+0000","last_clean":"2024-04-16T19:34:34.372581+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:34:34.372581+0000","last_undegraded":"2024-04-16T19:34:34.372581+0000","last_fullsized":"2024-04-16T19:34:34.372581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:29:54.124351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567746+0000","last_change":"2024-04-16T17:45:08.381595+0000","last_active":"2024-04-16T19:35:34.567746+0000","last_peered":"2024-04-16T19:35:34.567746+0000","last_clean":"2024-04-16T19:35:34.567746+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:35:34.567746+0000","last_undegraded":"2024-04-16T19:35:34.567746+0000","last_fullsized":"2024-04-16T19:35:34.567746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378769+0000","last_change":"2024-04-16T17:45:10.390675+0000","last_active":"2024-04-16T19:35:14.378769+0000","last_peered":"2024-04-16T19:35:14.378769+0000","last_clean":"2024-04-16T19:35:14.378769+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:35:14.378769+0000","last_undegraded":"2024-04-16T19:35:14.378769+0000","last_fullsized":"2024-04-16T19:35:14.378769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:26.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'7","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375036+0000","last_change":"2024-04-16T17:45:45.461571+0000","last_active":"2024-04-16T19:34:54.375036+0000","last_peered":"2024-04-16T19:34:54.375036+0000","last_clean":"2024-04-16T19:34:54.375036+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:34:54.375036+0000","last_undegraded":"2024-04-16T19:34:54.375036+0000","last_fullsized":"2024-04-16T19:34:54.375036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:19.904572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384092+0000","last_change":"2024-04-16T17:45:08.381577+0000","last_active":"2024-04-16T19:35:34.384092+0000","last_peered":"2024-04-16T19:35:34.384092+0000","last_clean":"2024-04-16T19:35:34.384092+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:35:34.384092+0000","last_undegraded":"2024-04-16T19:35:34.384092+0000","last_fullsized":"2024-04-16T19:35:34.384092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:58.984483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378103+0000","last_change":"2024-04-16T17:45:10.394273+0000","last_active":"2024-04-16T19:35:14.378103+0000","last_peered":"2024-04-16T19:35:14.378103+0000","last_clean":"2024-04-16T19:35:14.378103+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:35:14.378103+0000","last_undegraded":"2024-04-16T19:35:14.378103+0000","last_fullsized":"2024-04-16T19:35:14.378103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:54.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'7","reported_seq":246,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556535+0000","last_change":"2024-04-16T17:45:45.464927+0000","last_active":"2024-04-16T19:34:34.556535+0000","last_peered":"2024-04-16T19:34:34.556535+0000","last_clean":"2024-04-16T19:34:34.556535+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:34:34.556535+0000","last_undegraded":"2024-04-16T19:34:34.556535+0000","last_fullsized":"2024-04-16T19:34:34.556535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:29:54.124351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381354+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:35:29.381354+0000","last_peered":"2024-04-16T19:35:29.381354+0000","last_clean":"2024-04-16T19:35:29.381354+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:35:29.381354+0000","last_undegraded":"2024-04-16T19:35:29.381354+0000","last_fullsized":"2024-04-16T19:35:29.381354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:22.068786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.380496+0000","last_change":"2024-04-16T17:45:10.398320+0000","last_active":"2024-04-16T19:35:14.380496+0000","last_peered":"2024-04-16T19:35:14.380496+0000","last_clean":"2024-04-16T19:35:14.380496+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:35:14.380496+0000","last_undegraded":"2024-04-16T19:35:14.380496+0000","last_fullsized":"2024-04-16T19:35:14.380496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:10.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'7","reported_seq":515,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380346+0000","last_change":"2024-04-16T17:45:45.455611+0000","last_active":"2024-04-16T19:35:29.380346+0000","last_peered":"2024-04-16T19:35:29.380346+0000","last_clean":"2024-04-16T19:35:29.380346+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:35:29.380346+0000","last_undegraded":"2024-04-16T19:35:29.380346+0000","last_fullsized":"2024-04-16T19:35:29.380346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:39:55.884585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377968+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:35:09.377968+0000","last_peered":"2024-04-16T19:35:09.377968+0000","last_clean":"2024-04-16T19:35:09.377968+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:35:09.377968+0000","last_undegraded":"2024-04-16T19:35:09.377968+0000","last_fullsized":"2024-04-16T19:35:09.377968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382143+0000","last_change":"2024-04-16T17:45:10.395553+0000","last_active":"2024-04-16T19:35:34.382143+0000","last_peered":"2024-04-16T19:35:34.382143+0000","last_clean":"2024-04-16T19:35:34.382143+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:35:34.382143+0000","last_undegraded":"2024-04-16T19:35:34.382143+0000","last_fullsized":"2024-04-16T19:35:34.382143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:25.987507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'8","reported_seq":315,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383101+0000","last_change":"2024-04-16T17:45:45.464732+0000","last_active":"2024-04-16T19:35:29.383101+0000","last_peered":"2024-04-16T19:35:29.383101+0000","last_clean":"2024-04-16T19:35:29.383101+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:35:29.383101+0000","last_undegraded":"2024-04-16T19:35:29.383101+0000","last_fullsized":"2024-04-16T19:35:29.383101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:04.543134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547400+0000","last_change":"2024-04-16T17:46:16.500171+0000","last_active":"2024-04-16T19:33:49.547400+0000","last_peered":"2024-04-16T19:33:49.547400+0000","last_clean":"2024-04-16T19:33:49.547400+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:33:49.547400+0000","last_undegraded":"2024-04-16T19:33:49.547400+0000","last_fullsized":"2024-04-16T19:33:49.547400+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:24.673211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382318+0000","last_change":"2024-04-16T17:45:10.397556+0000","last_active":"2024-04-16T19:35:39.382318+0000","last_peered":"2024-04-16T19:35:39.382318+0000","last_clean":"2024-04-16T19:35:39.382318+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:35:39.382318+0000","last_undegraded":"2024-04-16T19:35:39.382318+0000","last_fullsized":"2024-04-16T19:35:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:31.534272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'8","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372376+0000","last_change":"2024-04-16T17:45:45.463411+0000","last_active":"2024-04-16T19:34:34.372376+0000","last_peered":"2024-04-16T19:34:34.372376+0000","last_clean":"2024-04-16T19:34:34.372376+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:34:34.372376+0000","last_undegraded":"2024-04-16T19:34:34.372376+0000","last_fullsized":"2024-04-16T19:34:34.372376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:36:34.046647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377851+0000","last_change":"2024-04-16T17:45:08.383652+0000","last_active":"2024-04-16T19:35:09.377851+0000","last_peered":"2024-04-16T19:35:09.377851+0000","last_clean":"2024-04-16T19:35:09.377851+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:35:09.377851+0000","last_undegraded":"2024-04-16T19:35:09.377851+0000","last_fullsized":"2024-04-16T19:35:09.377851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:04.729085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382949+0000","last_change":"2024-04-16T17:45:10.395876+0000","last_active":"2024-04-16T19:35:39.382949+0000","last_peered":"2024-04-16T19:35:39.382949+0000","last_clean":"2024-04-16T19:35:39.382949+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:35:39.382949+0000","last_undegraded":"2024-04-16T19:35:39.382949+0000","last_fullsized":"2024-04-16T19:35:39.382949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:22.221256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'6","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:29.360665+0000","last_change":"2024-04-16T17:45:45.457177+0000","last_active":"2024-04-16T19:33:29.360665+0000","last_peered":"2024-04-16T19:33:29.360665+0000","last_clean":"2024-04-16T19:33:29.360665+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:33:29.360665+0000","last_undegraded":"2024-04-16T19:33:29.360665+0000","last_fullsized":"2024-04-16T19:33:29.360665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:26.573550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562807+0000","last_change":"2024-04-16T17:45:08.389961+0000","last_active":"2024-04-16T19:35:09.562807+0000","last_peered":"2024-04-16T19:35:09.562807+0000","last_clean":"2024-04-16T19:35:09.562807+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:35:09.562807+0000","last_undegraded":"2024-04-16T19:35:09.562807+0000","last_fullsized":"2024-04-16T19:35:09.562807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:26.050144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568772+0000","last_change":"2024-04-16T17:45:10.399056+0000","last_active":"2024-04-16T19:35:39.568772+0000","last_peered":"2024-04-16T19:35:39.568772+0000","last_clean":"2024-04-16T19:35:39.568772+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:35:39.568772+0000","last_undegraded":"2024-04-16T19:35:39.568772+0000","last_fullsized":"2024-04-16T19:35:39.568772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:21.082747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'5","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368622+0000","last_change":"2024-04-16T17:45:45.462628+0000","last_active":"2024-04-16T19:34:09.368622+0000","last_peered":"2024-04-16T19:34:09.368622+0000","last_clean":"2024-04-16T19:34:09.368622+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:34:09.368622+0000","last_undegraded":"2024-04-16T19:34:09.368622+0000","last_fullsized":"2024-04-16T19:34:09.368622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374833+0000","last_change":"2024-04-16T17:45:10.394927+0000","last_active":"2024-04-16T19:34:54.374833+0000","last_peered":"2024-04-16T19:34:54.374833+0000","last_clean":"2024-04-16T19:34:54.374833+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:34:54.374833+0000","last_undegraded":"2024-04-16T19:34:54.374833+0000","last_fullsized":"2024-04-16T19:34:54.374833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:24.076247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369185+0000","last_change":"2024-04-16T17:45:08.388693+0000","last_active":"2024-04-16T19:34:14.369185+0000","last_peered":"2024-04-16T19:34:14.369185+0000","last_clean":"2024-04-16T19:34:14.369185+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:34:14.369185+0000","last_undegraded":"2024-04-16T19:34:14.369185+0000","last_fullsized":"2024-04-16T19:34:14.369185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.696516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'6","reported_seq":347,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368195+0000","last_change":"2024-04-16T17:45:45.462192+0000","last_active":"2024-04-16T19:34:09.368195+0000","last_peered":"2024-04-16T19:34:09.368195+0000","last_clean":"2024-04-16T19:34:09.368195+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:34:09.368195+0000","last_undegraded":"2024-04-16T19:34:09.368195+0000","last_fullsized":"2024-04-16T19:34:09.368195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:37.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375417+0000","last_change":"2024-04-16T17:45:10.393548+0000","last_active":"2024-04-16T19:34:54.375417+0000","last_peered":"2024-04-16T19:34:54.375417+0000","last_clean":"2024-04-16T19:34:54.375417+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:34:54.375417+0000","last_undegraded":"2024-04-16T19:34:54.375417+0000","last_fullsized":"2024-04-16T19:34:54.375417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:47.251006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365741+0000","last_change":"2024-04-16T17:45:08.388744+0000","last_active":"2024-04-16T19:33:54.365741+0000","last_peered":"2024-04-16T19:33:54.365741+0000","last_clean":"2024-04-16T19:33:54.365741+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:33:54.365741+0000","last_undegraded":"2024-04-16T19:33:54.365741+0000","last_fullsized":"2024-04-16T19:33:54.365741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'5","reported_seq":511,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551551+0000","last_change":"2024-04-16T17:45:45.456392+0000","last_active":"2024-04-16T19:34:09.551551+0000","last_peered":"2024-04-16T19:34:09.551551+0000","last_clean":"2024-04-16T19:34:09.551551+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:34:09.551551+0000","last_undegraded":"2024-04-16T19:34:09.551551+0000","last_fullsized":"2024-04-16T19:34:09.551551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:58:40.868531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378717+0000","last_change":"2024-04-16T17:45:10.392335+0000","last_active":"2024-04-16T19:35:14.378717+0000","last_peered":"2024-04-16T19:35:14.378717+0000","last_clean":"2024-04-16T19:35:14.378717+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:35:14.378717+0000","last_undegraded":"2024-04-16T19:35:14.378717+0000","last_fullsized":"2024-04-16T19:35:14.378717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:16.297430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365744+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:33:54.365744+0000","last_peered":"2024-04-16T19:33:54.365744+0000","last_clean":"2024-04-16T19:33:54.365744+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:33:54.365744+0000","last_undegraded":"2024-04-16T19:33:54.365744+0000","last_fullsized":"2024-04-16T19:33:54.365744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:36.615698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'10","reported_seq":234,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551468+0000","last_change":"2024-04-16T17:45:45.455448+0000","last_active":"2024-04-16T19:34:09.551468+0000","last_peered":"2024-04-16T19:34:09.551468+0000","last_clean":"2024-04-16T19:34:09.551468+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:34:09.551468+0000","last_undegraded":"2024-04-16T19:34:09.551468+0000","last_fullsized":"2024-04-16T19:34:09.551468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:50.309523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549442+0000","last_change":"2024-04-16T17:45:10.391411+0000","last_active":"2024-04-16T19:33:59.549442+0000","last_peered":"2024-04-16T19:33:59.549442+0000","last_clean":"2024-04-16T19:33:59.549442+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:33:59.549442+0000","last_undegraded":"2024-04-16T19:33:59.549442+0000","last_fullsized":"2024-04-16T19:33:59.549442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:30:53.218689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365154+0000","last_change":"2024-04-16T17:45:08.382324+0000","last_active":"2024-04-16T19:33:54.365154+0000","last_peered":"2024-04-16T19:33:54.365154+0000","last_clean":"2024-04-16T19:33:54.365154+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:33:54.365154+0000","last_undegraded":"2024-04-16T19:33:54.365154+0000","last_fullsized":"2024-04-16T19:33:54.365154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"48'6","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360042+0000","last_change":"2024-04-16T17:45:45.460928+0000","last_active":"2024-04-16T19:33:19.360042+0000","last_peered":"2024-04-16T19:33:19.360042+0000","last_clean":"2024-04-16T19:33:19.360042+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:33:19.360042+0000","last_undegraded":"2024-04-16T19:33:19.360042+0000","last_fullsized":"2024-04-16T19:33:19.360042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549478+0000","last_change":"2024-04-16T17:45:10.393503+0000","last_active":"2024-04-16T19:33:59.549478+0000","last_peered":"2024-04-16T19:33:59.549478+0000","last_clean":"2024-04-16T19:33:59.549478+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:33:59.549478+0000","last_undegraded":"2024-04-16T19:33:59.549478+0000","last_fullsized":"2024-04-16T19:33:59.549478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:06:00.869577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367265+0000","last_change":"2024-04-16T17:45:08.387116+0000","last_active":"2024-04-16T19:33:54.367265+0000","last_peered":"2024-04-16T19:33:54.367265+0000","last_clean":"2024-04-16T19:33:54.367265+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:33:54.367265+0000","last_undegraded":"2024-04-16T19:33:54.367265+0000","last_fullsized":"2024-04-16T19:33:54.367265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:04.729085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"48'1","reported_seq":222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541511+0000","last_change":"2024-04-16T17:45:45.455236+0000","last_active":"2024-04-16T19:33:19.541511+0000","last_peered":"2024-04-16T19:33:19.541511+0000","last_clean":"2024-04-16T19:33:19.541511+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:33:19.541511+0000","last_undegraded":"2024-04-16T19:33:19.541511+0000","last_fullsized":"2024-04-16T19:33:19.541511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:40.520396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366097+0000","last_change":"2024-04-16T17:45:10.397627+0000","last_active":"2024-04-16T19:33:59.366097+0000","last_peered":"2024-04-16T19:33:59.366097+0000","last_clean":"2024-04-16T19:33:59.366097+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:33:59.366097+0000","last_undegraded":"2024-04-16T19:33:59.366097+0000","last_fullsized":"2024-04-16T19:33:59.366097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:50.581378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.548455+0000","last_change":"2024-04-16T17:46:16.498581+0000","last_active":"2024-04-16T19:33:54.548455+0000","last_peered":"2024-04-16T19:33:54.548455+0000","last_clean":"2024-04-16T19:33:54.548455+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:33:54.548455+0000","last_undegraded":"2024-04-16T19:33:54.548455+0000","last_fullsized":"2024-04-16T19:33:54.548455+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:53.339943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555516+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:34:29.555516+0000","last_peered":"2024-04-16T19:34:29.555516+0000","last_clean":"2024-04-16T19:34:29.555516+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:34:29.555516+0000","last_undegraded":"2024-04-16T19:34:29.555516+0000","last_fullsized":"2024-04-16T19:34:29.555516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:29:46.401023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'145","reported_seq":2257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374839+0000","last_change":"2024-04-16T17:46:25.527767+0000","last_active":"2024-04-16T19:34:49.374839+0000","last_peered":"2024-04-16T19:34:49.374839+0000","last_clean":"2024-04-16T19:34:49.374839+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:34:49.374839+0000","last_undegraded":"2024-04-16T19:34:49.374839+0000","last_fullsized":"2024-04-16T19:34:49.374839+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:25.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364929+0000","last_change":"2024-04-16T17:46:17.511976+0000","last_active":"2024-04-16T19:33:49.364929+0000","last_peered":"2024-04-16T19:33:49.364929+0000","last_clean":"2024-04-16T19:33:49.364929+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:33:49.364929+0000","last_undegraded":"2024-04-16T19:33:49.364929+0000","last_fullsized":"2024-04-16T19:33:49.364929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'20","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.362629+0000","last_change":"2024-04-16T17:45:51.478677+0000","last_active":"2024-04-16T19:33:24.362629+0000","last_peered":"2024-04-16T19:33:24.362629+0000","last_clean":"2024-04-16T19:33:24.362629+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:33:24.362629+0000","last_undegraded":"2024-04-16T19:33:24.362629+0000","last_fullsized":"2024-04-16T19:33:24.362629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:04.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359188+0000","last_change":"2024-04-16T17:45:49.472385+0000","last_active":"2024-04-16T19:33:19.359188+0000","last_peered":"2024-04-16T19:33:19.359188+0000","last_clean":"2024-04-16T19:33:19.359188+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:33:19.359188+0000","last_undegraded":"2024-04-16T19:33:19.359188+0000","last_fullsized":"2024-04-16T19:33:19.359188+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:24.302917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'243","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360107+0000","last_change":"2024-04-16T17:45:47.462219+0000","last_active":"2024-04-16T19:33:19.360107+0000","last_peered":"2024-04-16T19:33:19.360107+0000","last_clean":"2024-04-16T19:33:19.360107+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:33:19.360107+0000","last_undegraded":"2024-04-16T19:33:19.360107+0000","last_fullsized":"2024-04-16T19:33:19.360107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:34.349862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'9","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379588+0000","last_change":"2024-04-16T17:46:16.500449+0000","last_active":"2024-04-16T19:35:24.379588+0000","last_peered":"2024-04-16T19:35:24.379588+0000","last_clean":"2024-04-16T19:35:24.379588+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:35:24.379588+0000","last_undegraded":"2024-04-16T19:35:24.379588+0000","last_fullsized":"2024-04-16T19:35:24.379588+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368583+0000","last_change":"2024-04-16T17:45:26.430602+0000","last_active":"2024-04-16T19:34:14.368583+0000","last_peered":"2024-04-16T19:34:14.368583+0000","last_clean":"2024-04-16T19:34:14.368583+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:34:14.368583+0000","last_undegraded":"2024-04-16T19:34:14.368583+0000","last_fullsized":"2024-04-16T19:34:14.368583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:21.500912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562932+0000","last_change":"2024-04-16T17:45:10.400976+0000","last_active":"2024-04-16T19:35:09.562932+0000","last_peered":"2024-04-16T19:35:09.562932+0000","last_clean":"2024-04-16T19:35:09.562932+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:35:09.562932+0000","last_undegraded":"2024-04-16T19:35:09.562932+0000","last_fullsized":"2024-04-16T19:35:09.562932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:58.273468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374754+0000","last_change":"2024-04-16T17:45:08.388375+0000","last_active":"2024-04-16T19:34:49.374754+0000","last_peered":"2024-04-16T19:34:49.374754+0000","last_clean":"2024-04-16T19:34:49.374754+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:34:49.374754+0000","last_undegraded":"2024-04-16T19:34:49.374754+0000","last_fullsized":"2024-04-16T19:34:49.374754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:23.980045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368590+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:34:09.368590+0000","last_peered":"2024-04-16T19:34:09.368590+0000","last_clean":"2024-04-16T19:34:09.368590+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:34:09.368590+0000","last_undegraded":"2024-04-16T19:34:09.368590+0000","last_fullsized":"2024-04-16T19:34:09.368590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:29.584282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370069+0000","last_change":"2024-04-16T17:45:22.417279+0000","last_active":"2024-04-16T19:34:09.370069+0000","last_peered":"2024-04-16T19:34:09.370069+0000","last_clean":"2024-04-16T19:34:09.370069+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:34:09.370069+0000","last_undegraded":"2024-04-16T19:34:09.370069+0000","last_fullsized":"2024-04-16T19:34:09.370069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:45.675762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368788+0000","last_change":"2024-04-16T17:45:24.425550+0000","last_active":"2024-04-16T19:34:09.368788+0000","last_peered":"2024-04-16T19:34:09.368788+0000","last_clean":"2024-04-16T19:34:09.368788+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:34:09.368788+0000","last_undegraded":"2024-04-16T19:34:09.368788+0000","last_fullsized":"2024-04-16T19:34:09.368788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:35.470227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.565057+0000","last_change":"2024-04-16T18:09:02.170333+0000","last_active":"2024-04-16T19:35:19.565057+0000","last_peered":"2024-04-16T19:35:19.565057+0000","last_clean":"2024-04-16T19:35:19.565057+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:35:19.565057+0000","last_undegraded":"2024-04-16T19:35:19.565057+0000","last_fullsized":"2024-04-16T19:35:19.565057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:27:55.951446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1987,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382967+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:35:39.382967+0000","last_peered":"2024-04-16T19:35:39.382967+0000","last_clean":"2024-04-16T19:35:39.382967+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:35:39.382967+0000","last_undegraded":"2024-04-16T19:35:39.382967+0000","last_fullsized":"2024-04-16T19:35:39.382967+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:13:06.759819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:46:17.506966+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'7","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.362660+0000","last_change":"2024-04-16T17:45:51.478975+0000","last_active":"2024-04-16T19:33:24.362660+0000","last_peered":"2024-04-16T19:33:24.362660+0000","last_clean":"2024-04-16T19:33:24.362660+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:33:24.362660+0000","last_undegraded":"2024-04-16T19:33:24.362660+0000","last_fullsized":"2024-04-16T19:33:24.362660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:26.313448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359820+0000","last_change":"2024-04-16T17:45:49.473313+0000","last_active":"2024-04-16T19:33:19.359820+0000","last_peered":"2024-04-16T19:33:19.359820+0000","last_clean":"2024-04-16T19:33:19.359820+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:33:19.359820+0000","last_undegraded":"2024-04-16T19:33:19.359820+0000","last_fullsized":"2024-04-16T19:33:19.359820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:36.356992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'189","reported_seq":458,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541651+0000","last_change":"2024-04-16T17:45:47.463699+0000","last_active":"2024-04-16T19:33:19.541651+0000","last_peered":"2024-04-16T19:33:19.541651+0000","last_clean":"2024-04-16T19:33:19.541651+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:33:19.541651+0000","last_undegraded":"2024-04-16T19:33:19.541651+0000","last_fullsized":"2024-04-16T19:33:19.541651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:18:11.449981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'28","reported_seq":315,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372405+0000","last_change":"2024-04-16T17:45:45.456848+0000","last_active":"2024-04-16T19:34:34.372405+0000","last_peered":"2024-04-16T19:34:34.372405+0000","last_clean":"2024-04-16T19:34:34.372405+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:34:34.372405+0000","last_undegraded":"2024-04-16T19:34:34.372405+0000","last_fullsized":"2024-04-16T19:34:34.372405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:38.609449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:26.439840+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.458913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366576+0000","last_change":"2024-04-16T17:45:10.395070+0000","last_active":"2024-04-16T19:33:59.366576+0000","last_peered":"2024-04-16T19:33:59.366576+0000","last_clean":"2024-04-16T19:33:59.366576+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:33:59.366576+0000","last_undegraded":"2024-04-16T19:33:59.366576+0000","last_fullsized":"2024-04-16T19:33:59.366576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:00.458421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376338+0000","last_change":"2024-04-16T17:45:08.390752+0000","last_active":"2024-04-16T19:34:49.376338+0000","last_peered":"2024-04-16T19:34:49.376338+0000","last_clean":"2024-04-16T19:34:49.376338+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:34:49.376338+0000","last_undegraded":"2024-04-16T19:34:49.376338+0000","last_fullsized":"2024-04-16T19:34:49.376338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:51.718429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"48'17","reported_seq":894,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382229+0000","last_change":"2024-04-16T17:45:20.413278+0000","last_active":"2024-04-16T19:35:24.382229+0000","last_peered":"2024-04-16T19:35:24.382229+0000","last_clean":"2024-04-16T19:35:24.382229+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:35:24.382229+0000","last_undegraded":"2024-04-16T19:35:24.382229+0000","last_fullsized":"2024-04-16T19:35:24.382229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:21:09.196060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'72","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368021+0000","last_change":"2024-04-16T17:45:22.414776+0000","last_active":"2024-04-16T19:34:09.368021+0000","last_peered":"2024-04-16T19:34:09.368021+0000","last_clean":"2024-04-16T19:34:09.368021+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:34:09.368021+0000","last_undegraded":"2024-04-16T19:34:09.368021+0000","last_fullsized":"2024-04-16T19:34:09.368021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:22.839078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367997+0000","last_change":"2024-04-16T17:45:24.423655+0000","last_active":"2024-04-16T19:34:09.367997+0000","last_peered":"2024-04-16T19:34:09.367997+0000","last_clean":"2024-04-16T19:34:09.367997+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:34:09.367997+0000","last_undegraded":"2024-04-16T19:34:09.367997+0000","last_fullsized":"2024-04-16T19:34:09.367997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:24.311652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366892+0000","last_change":"2024-04-16T18:09:02.164735+0000","last_active":"2024-04-16T19:34:04.366892+0000","last_peered":"2024-04-16T19:34:04.366892+0000","last_clean":"2024-04-16T19:34:04.366892+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:34:04.366892+0000","last_undegraded":"2024-04-16T19:34:04.366892+0000","last_fullsized":"2024-04-16T19:34:04.366892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:53:57.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'228","reported_seq":2120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368272+0000","last_change":"2024-04-16T17:46:25.526441+0000","last_active":"2024-04-16T19:33:59.368272+0000","last_peered":"2024-04-16T19:33:59.368272+0000","last_clean":"2024-04-16T19:33:59.368272+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:33:59.368272+0000","last_undegraded":"2024-04-16T19:33:59.368272+0000","last_fullsized":"2024-04-16T19:33:59.368272+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:53:10.911757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372528+0000","last_change":"2024-04-16T17:46:17.506064+0000","last_active":"2024-04-16T19:34:39.372528+0000","last_peered":"2024-04-16T19:34:39.372528+0000","last_clean":"2024-04-16T19:34:39.372528+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:34:39.372528+0000","last_undegraded":"2024-04-16T19:34:39.372528+0000","last_fullsized":"2024-04-16T19:34:39.372528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:04.395735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'7","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368727+0000","last_change":"2024-04-16T17:45:51.480549+0000","last_active":"2024-04-16T19:34:14.368727+0000","last_peered":"2024-04-16T19:34:14.368727+0000","last_clean":"2024-04-16T19:34:14.368727+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:34:14.368727+0000","last_undegraded":"2024-04-16T19:34:14.368727+0000","last_fullsized":"2024-04-16T19:34:14.368727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:40.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.377125+0000","last_change":"2024-04-16T17:45:49.476408+0000","last_active":"2024-04-16T19:34:54.377125+0000","last_peered":"2024-04-16T19:34:54.377125+0000","last_clean":"2024-04-16T19:34:54.377125+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:34:54.377125+0000","last_undegraded":"2024-04-16T19:34:54.377125+0000","last_fullsized":"2024-04-16T19:34:54.377125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:00.700374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'266","reported_seq":586,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556354+0000","last_change":"2024-04-16T17:45:47.458082+0000","last_active":"2024-04-16T19:34:34.556354+0000","last_peered":"2024-04-16T19:34:34.556354+0000","last_clean":"2024-04-16T19:34:34.556354+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:34:34.556354+0000","last_undegraded":"2024-04-16T19:34:34.556354+0000","last_fullsized":"2024-04-16T19:34:34.556354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:28.580742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'11","reported_seq":187,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361676+0000","last_change":"2024-04-16T17:45:45.463326+0000","last_active":"2024-04-16T19:33:19.361676+0000","last_peered":"2024-04-16T19:33:19.361676+0000","last_clean":"2024-04-16T19:33:19.361676+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:33:19.361676+0000","last_undegraded":"2024-04-16T19:33:19.361676+0000","last_fullsized":"2024-04-16T19:33:19.361676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:14.781901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383151+0000","last_change":"2024-04-16T17:45:26.438624+0000","last_active":"2024-04-16T19:35:29.383151+0000","last_peered":"2024-04-16T19:35:29.383151+0000","last_clean":"2024-04-16T19:35:29.383151+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:35:29.383151+0000","last_undegraded":"2024-04-16T19:35:29.383151+0000","last_fullsized":"2024-04-16T19:35:29.383151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:47.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368347+0000","last_change":"2024-04-16T17:45:10.398271+0000","last_active":"2024-04-16T19:33:59.368347+0000","last_peered":"2024-04-16T19:33:59.368347+0000","last_clean":"2024-04-16T19:33:59.368347+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:33:59.368347+0000","last_undegraded":"2024-04-16T19:33:59.368347+0000","last_fullsized":"2024-04-16T19:33:59.368347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:27.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374677+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:34:49.374677+0000","last_peered":"2024-04-16T19:34:49.374677+0000","last_clean":"2024-04-16T19:34:49.374677+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:34:49.374677+0000","last_undegraded":"2024-04-16T19:34:49.374677+0000","last_fullsized":"2024-04-16T19:34:49.374677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:37.582239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551538+0000","last_change":"2024-04-16T17:45:20.406137+0000","last_active":"2024-04-16T19:34:09.551538+0000","last_peered":"2024-04-16T19:34:09.551538+0000","last_clean":"2024-04-16T19:34:09.551538+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:34:09.551538+0000","last_undegraded":"2024-04-16T19:34:09.551538+0000","last_fullsized":"2024-04-16T19:34:09.551538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:49.607445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'120","reported_seq":294,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.565010+0000","last_change":"2024-04-16T17:45:22.421567+0000","last_active":"2024-04-16T19:35:19.565010+0000","last_peered":"2024-04-16T19:35:19.565010+0000","last_clean":"2024-04-16T19:35:19.565010+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:35:19.565010+0000","last_undegraded":"2024-04-16T19:35:19.565010+0000","last_fullsized":"2024-04-16T19:35:19.565010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:08.015854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'12","reported_seq":1387,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368244+0000","last_change":"2024-04-16T17:45:24.425583+0000","last_active":"2024-04-16T19:34:09.368244+0000","last_peered":"2024-04-16T19:34:09.368244+0000","last_clean":"2024-04-16T19:34:09.368244+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:34:09.368244+0000","last_undegraded":"2024-04-16T19:34:09.368244+0000","last_fullsized":"2024-04-16T19:34:09.368244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:56.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550442+0000","last_change":"2024-04-16T18:09:02.169752+0000","last_active":"2024-04-16T19:34:04.550442+0000","last_peered":"2024-04-16T19:34:04.550442+0000","last_clean":"2024-04-16T19:34:04.550442+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:34:04.550442+0000","last_undegraded":"2024-04-16T19:34:04.550442+0000","last_fullsized":"2024-04-16T19:34:04.550442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:22:34.279270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'151","reported_seq":2294,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368309+0000","last_change":"2024-04-16T17:46:25.529267+0000","last_active":"2024-04-16T19:33:59.368309+0000","last_peered":"2024-04-16T19:33:59.368309+0000","last_clean":"2024-04-16T19:33:59.368309+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:33:59.368309+0000","last_undegraded":"2024-04-16T19:33:59.368309+0000","last_fullsized":"2024-04-16T19:33:59.368309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:31.289154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372494+0000","last_change":"2024-04-16T17:46:17.509588+0000","last_active":"2024-04-16T19:34:39.372494+0000","last_peered":"2024-04-16T19:34:39.372494+0000","last_clean":"2024-04-16T19:34:39.372494+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:34:39.372494+0000","last_undegraded":"2024-04-16T19:34:39.372494+0000","last_fullsized":"2024-04-16T19:34:39.372494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:18:19.084200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'9","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369221+0000","last_change":"2024-04-16T17:45:51.478968+0000","last_active":"2024-04-16T19:34:14.369221+0000","last_peered":"2024-04-16T19:34:14.369221+0000","last_clean":"2024-04-16T19:34:14.369221+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:34:14.369221+0000","last_undegraded":"2024-04-16T19:34:14.369221+0000","last_fullsized":"2024-04-16T19:34:14.369221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556324+0000","last_change":"2024-04-16T17:45:49.463675+0000","last_active":"2024-04-16T19:34:34.556324+0000","last_peered":"2024-04-16T19:34:34.556324+0000","last_clean":"2024-04-16T19:34:34.556324+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:34:34.556324+0000","last_undegraded":"2024-04-16T19:34:34.556324+0000","last_fullsized":"2024-04-16T19:34:34.556324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:07:05.659899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5965","reported_seq":12521,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559078+0000","last_change":"2024-04-16T17:45:47.459844+0000","last_active":"2024-04-16T19:34:49.559078+0000","last_peered":"2024-04-16T19:34:49.559078+0000","last_clean":"2024-04-16T19:34:49.559078+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:34:49.559078+0000","last_undegraded":"2024-04-16T19:34:49.559078+0000","last_fullsized":"2024-04-16T19:34:49.559078+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1765,"log_dups_size":3000,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:32.414801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'8","reported_seq":567,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541614+0000","last_change":"2024-04-16T17:45:45.457864+0000","last_active":"2024-04-16T19:33:19.541614+0000","last_peered":"2024-04-16T19:33:19.541614+0000","last_clean":"2024-04-16T19:33:19.541614+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:33:19.541614+0000","last_undegraded":"2024-04-16T19:33:19.541614+0000","last_fullsized":"2024-04-16T19:33:19.541614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.288595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380397+0000","last_change":"2024-04-16T17:45:26.848748+0000","last_active":"2024-04-16T19:35:29.380397+0000","last_peered":"2024-04-16T19:35:29.380397+0000","last_clean":"2024-04-16T19:35:29.380397+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:35:29.380397+0000","last_undegraded":"2024-04-16T19:35:29.380397+0000","last_fullsized":"2024-04-16T19:35:29.380397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:47.873610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368378+0000","last_change":"2024-04-16T17:45:10.391762+0000","last_active":"2024-04-16T19:33:59.368378+0000","last_peered":"2024-04-16T19:33:59.368378+0000","last_clean":"2024-04-16T19:33:59.368378+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:33:59.368378+0000","last_undegraded":"2024-04-16T19:33:59.368378+0000","last_fullsized":"2024-04-16T19:33:59.368378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:22:56.234389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374595+0000","last_change":"2024-04-16T17:45:08.387257+0000","last_active":"2024-04-16T19:34:49.374595+0000","last_peered":"2024-04-16T19:34:49.374595+0000","last_clean":"2024-04-16T19:34:49.374595+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:34:49.374595+0000","last_undegraded":"2024-04-16T19:34:49.374595+0000","last_fullsized":"2024-04-16T19:34:49.374595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"48'1","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368272+0000","last_change":"2024-04-16T17:45:20.405143+0000","last_active":"2024-04-16T19:34:09.368272+0000","last_peered":"2024-04-16T19:34:09.368272+0000","last_clean":"2024-04-16T19:34:09.368272+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:34:09.368272+0000","last_undegraded":"2024-04-16T19:34:09.368272+0000","last_fullsized":"2024-04-16T19:34:09.368272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:09.457037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368233+0000","last_change":"2024-04-16T17:45:22.421942+0000","last_active":"2024-04-16T19:34:09.368233+0000","last_peered":"2024-04-16T19:34:09.368233+0000","last_clean":"2024-04-16T19:34:09.368233+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:34:09.368233+0000","last_undegraded":"2024-04-16T19:34:09.368233+0000","last_fullsized":"2024-04-16T19:34:09.368233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:15.139787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'12","reported_seq":1389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564929+0000","last_change":"2024-04-16T17:45:24.424033+0000","last_active":"2024-04-16T19:35:19.564929+0000","last_peered":"2024-04-16T19:35:19.564929+0000","last_clean":"2024-04-16T19:35:19.564929+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:35:19.564929+0000","last_undegraded":"2024-04-16T19:35:19.564929+0000","last_fullsized":"2024-04-16T19:35:19.564929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:45.865876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370952+0000","last_change":"2024-04-16T18:09:02.168123+0000","last_active":"2024-04-16T19:34:29.370952+0000","last_peered":"2024-04-16T19:34:29.370952+0000","last_clean":"2024-04-16T19:34:29.370952+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:34:29.370952+0000","last_undegraded":"2024-04-16T19:34:29.370952+0000","last_fullsized":"2024-04-16T19:34:29.370952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:02.737644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374715+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:34:49.374715+0000","last_peered":"2024-04-16T19:34:49.374715+0000","last_clean":"2024-04-16T19:34:49.374715+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:34:49.374715+0000","last_undegraded":"2024-04-16T19:34:49.374715+0000","last_fullsized":"2024-04-16T19:34:49.374715+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:18:49.538603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373127+0000","last_change":"2024-04-16T17:46:17.508941+0000","last_active":"2024-04-16T19:34:39.373127+0000","last_peered":"2024-04-16T19:34:39.373127+0000","last_clean":"2024-04-16T19:34:39.373127+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:34:39.373127+0000","last_undegraded":"2024-04-16T19:34:39.373127+0000","last_fullsized":"2024-04-16T19:34:39.373127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'11","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368550+0000","last_change":"2024-04-16T17:45:51.478686+0000","last_active":"2024-04-16T19:34:14.368550+0000","last_peered":"2024-04-16T19:34:14.368550+0000","last_clean":"2024-04-16T19:34:14.368550+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:34:14.368550+0000","last_undegraded":"2024-04-16T19:34:14.368550+0000","last_fullsized":"2024-04-16T19:34:14.368550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:45.109744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368764+0000","last_change":"2024-04-16T17:45:49.469263+0000","last_active":"2024-04-16T19:34:09.368764+0000","last_peered":"2024-04-16T19:34:09.368764+0000","last_clean":"2024-04-16T19:34:09.368764+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:34:09.368764+0000","last_undegraded":"2024-04-16T19:34:09.368764+0000","last_fullsized":"2024-04-16T19:34:09.368764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:05.755199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1575","reported_seq":46963,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368707+0000","last_change":"2024-04-16T17:45:47.466556+0000","last_active":"2024-04-16T19:34:09.368707+0000","last_peered":"2024-04-16T19:34:09.368707+0000","last_clean":"2024-04-16T19:34:09.368707+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:34:09.368707+0000","last_undegraded":"2024-04-16T19:34:09.368707+0000","last_fullsized":"2024-04-16T19:34:09.368707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:29.536656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'6","reported_seq":221,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373464+0000","last_change":"2024-04-16T17:45:45.466165+0000","last_active":"2024-04-16T19:34:29.373464+0000","last_peered":"2024-04-16T19:34:29.373464+0000","last_clean":"2024-04-16T19:34:29.373464+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:34:29.373464+0000","last_undegraded":"2024-04-16T19:34:29.373464+0000","last_fullsized":"2024-04-16T19:34:29.373464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:58.879936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383551+0000","last_change":"2024-04-16T17:45:10.393324+0000","last_active":"2024-04-16T19:35:44.383551+0000","last_peered":"2024-04-16T19:35:44.383551+0000","last_clean":"2024-04-16T19:35:44.383551+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:35:44.383551+0000","last_undegraded":"2024-04-16T19:35:44.383551+0000","last_fullsized":"2024-04-16T19:35:44.383551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:27.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383794+0000","last_change":"2024-04-16T17:45:08.389843+0000","last_active":"2024-04-16T19:35:44.383794+0000","last_peered":"2024-04-16T19:35:44.383794+0000","last_clean":"2024-04-16T19:35:44.383794+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:35:44.383794+0000","last_undegraded":"2024-04-16T19:35:44.383794+0000","last_fullsized":"2024-04-16T19:35:44.383794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"48'5","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385115+0000","last_change":"2024-04-16T17:45:20.407401+0000","last_active":"2024-04-16T19:35:54.385115+0000","last_peered":"2024-04-16T19:35:54.385115+0000","last_clean":"2024-04-16T19:35:54.385115+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:35:54.385115+0000","last_undegraded":"2024-04-16T19:35:54.385115+0000","last_fullsized":"2024-04-16T19:35:54.385115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:50.080567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'200","reported_seq":422,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367499+0000","last_change":"2024-04-16T17:45:22.417459+0000","last_active":"2024-04-16T19:34:04.367499+0000","last_peered":"2024-04-16T19:34:04.367499+0000","last_clean":"2024-04-16T19:34:04.367499+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:34:04.367499+0000","last_undegraded":"2024-04-16T19:34:04.367499+0000","last_fullsized":"2024-04-16T19:34:04.367499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:29.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568642+0000","last_change":"2024-04-16T17:45:24.430630+0000","last_active":"2024-04-16T19:35:39.568642+0000","last_peered":"2024-04-16T19:35:39.568642+0000","last_clean":"2024-04-16T19:35:39.568642+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:35:39.568642+0000","last_undegraded":"2024-04-16T19:35:39.568642+0000","last_fullsized":"2024-04-16T19:35:39.568642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:31.152537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385225+0000","last_change":"2024-04-16T17:45:26.438929+0000","last_active":"2024-04-16T19:35:54.385225+0000","last_peered":"2024-04-16T19:35:54.385225+0000","last_clean":"2024-04-16T19:35:54.385225+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:35:54.385225+0000","last_undegraded":"2024-04-16T19:35:54.385225+0000","last_fullsized":"2024-04-16T19:35:54.385225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:58.263370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555397+0000","last_change":"2024-04-16T18:09:02.169539+0000","last_active":"2024-04-16T19:34:29.555397+0000","last_peered":"2024-04-16T19:34:29.555397+0000","last_clean":"2024-04-16T19:34:29.555397+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:34:29.555397+0000","last_undegraded":"2024-04-16T19:34:29.555397+0000","last_fullsized":"2024-04-16T19:34:29.555397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:10.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376408+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:34:49.376408+0000","last_peered":"2024-04-16T19:34:49.376408+0000","last_clean":"2024-04-16T19:34:49.376408+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:34:49.376408+0000","last_undegraded":"2024-04-16T19:34:49.376408+0000","last_fullsized":"2024-04-16T19:34:49.376408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:21.896379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373066+0000","last_change":"2024-04-16T17:46:17.512578+0000","last_active":"2024-04-16T19:34:39.373066+0000","last_peered":"2024-04-16T19:34:39.373066+0000","last_clean":"2024-04-16T19:34:39.373066+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:34:39.373066+0000","last_undegraded":"2024-04-16T19:34:39.373066+0000","last_fullsized":"2024-04-16T19:34:39.373066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"48'3","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368951+0000","last_change":"2024-04-16T17:45:51.480862+0000","last_active":"2024-04-16T19:34:14.368951+0000","last_peered":"2024-04-16T19:34:14.368951+0000","last_clean":"2024-04-16T19:34:14.368951+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:34:14.368951+0000","last_undegraded":"2024-04-16T19:34:14.368951+0000","last_fullsized":"2024-04-16T19:34:14.368951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:04.680783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370021+0000","last_change":"2024-04-16T17:45:49.473179+0000","last_active":"2024-04-16T19:34:09.370021+0000","last_peered":"2024-04-16T19:34:09.370021+0000","last_clean":"2024-04-16T19:34:09.370021+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:34:09.370021+0000","last_undegraded":"2024-04-16T19:34:09.370021+0000","last_fullsized":"2024-04-16T19:34:09.370021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:05.755199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'338","reported_seq":637,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368333+0000","last_change":"2024-04-16T17:45:47.458262+0000","last_active":"2024-04-16T19:34:09.368333+0000","last_peered":"2024-04-16T19:34:09.368333+0000","last_clean":"2024-04-16T19:34:09.368333+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:34:09.368333+0000","last_undegraded":"2024-04-16T19:34:09.368333+0000","last_fullsized":"2024-04-16T19:34:09.368333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:56.475222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'10","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551369+0000","last_change":"2024-04-16T17:45:45.466171+0000","last_active":"2024-04-16T19:34:09.551369+0000","last_peered":"2024-04-16T19:34:09.551369+0000","last_clean":"2024-04-16T19:34:09.551369+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:34:09.551369+0000","last_undegraded":"2024-04-16T19:34:09.551369+0000","last_fullsized":"2024-04-16T19:34:09.551369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:55:30.430838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.382936+0000","last_change":"2024-04-16T17:45:10.402167+0000","last_active":"2024-04-16T19:35:44.382936+0000","last_peered":"2024-04-16T19:35:44.382936+0000","last_clean":"2024-04-16T19:35:44.382936+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:35:44.382936+0000","last_undegraded":"2024-04-16T19:35:44.382936+0000","last_fullsized":"2024-04-16T19:35:44.382936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:38.623160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380567+0000","last_change":"2024-04-16T17:45:08.388824+0000","last_active":"2024-04-16T19:35:24.380567+0000","last_peered":"2024-04-16T19:35:24.380567+0000","last_clean":"2024-04-16T19:35:24.380567+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:35:24.380567+0000","last_undegraded":"2024-04-16T19:35:24.380567+0000","last_fullsized":"2024-04-16T19:35:24.380567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546334+0000","last_change":"2024-04-16T17:45:20.407298+0000","last_active":"2024-04-16T19:33:44.546334+0000","last_peered":"2024-04-16T19:33:44.546334+0000","last_clean":"2024-04-16T19:33:44.546334+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:33:44.546334+0000","last_undegraded":"2024-04-16T19:33:44.546334+0000","last_fullsized":"2024-04-16T19:33:44.546334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:10.777542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'80","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568625+0000","last_change":"2024-04-16T17:45:22.422669+0000","last_active":"2024-04-16T19:35:39.568625+0000","last_peered":"2024-04-16T19:35:39.568625+0000","last_clean":"2024-04-16T19:35:39.568625+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:35:39.568625+0000","last_undegraded":"2024-04-16T19:35:39.568625+0000","last_fullsized":"2024-04-16T19:35:39.568625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:31.592115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549386+0000","last_change":"2024-04-16T17:45:24.425962+0000","last_active":"2024-04-16T19:33:59.549386+0000","last_peered":"2024-04-16T19:33:59.549386+0000","last_clean":"2024-04-16T19:33:59.549386+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:33:59.549386+0000","last_undegraded":"2024-04-16T19:33:59.549386+0000","last_fullsized":"2024-04-16T19:33:59.549386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:55.736964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367958+0000","last_change":"2024-04-16T17:45:26.429668+0000","last_active":"2024-04-16T19:34:09.367958+0000","last_peered":"2024-04-16T19:34:09.367958+0000","last_clean":"2024-04-16T19:34:09.367958+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:34:09.367958+0000","last_undegraded":"2024-04-16T19:34:09.367958+0000","last_fullsized":"2024-04-16T19:34:09.367958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:33.160271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371461+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:34:29.371461+0000","last_peered":"2024-04-16T19:34:29.371461+0000","last_clean":"2024-04-16T19:34:29.371461+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:34:29.371461+0000","last_undegraded":"2024-04-16T19:34:29.371461+0000","last_fullsized":"2024-04-16T19:34:29.371461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'120","reported_seq":2585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.558155+0000","last_change":"2024-04-16T17:46:25.531706+0000","last_active":"2024-04-16T19:34:44.558155+0000","last_peered":"2024-04-16T19:34:44.558155+0000","last_clean":"2024-04-16T19:34:44.558155+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:34:44.558155+0000","last_undegraded":"2024-04-16T19:34:44.558155+0000","last_fullsized":"2024-04-16T19:34:44.558155+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:15.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.374879+0000","last_change":"2024-04-16T17:46:17.508571+0000","last_active":"2024-04-16T19:34:39.374879+0000","last_peered":"2024-04-16T19:34:39.374879+0000","last_clean":"2024-04-16T19:34:39.374879+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:34:39.374879+0000","last_undegraded":"2024-04-16T19:34:39.374879+0000","last_fullsized":"2024-04-16T19:34:39.374879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'18","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369024+0000","last_change":"2024-04-16T17:45:51.479804+0000","last_active":"2024-04-16T19:34:14.369024+0000","last_peered":"2024-04-16T19:34:14.369024+0000","last_clean":"2024-04-16T19:34:14.369024+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:34:14.369024+0000","last_undegraded":"2024-04-16T19:34:14.369024+0000","last_fullsized":"2024-04-16T19:34:14.369024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:04.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370998+0000","last_change":"2024-04-16T17:45:49.471470+0000","last_active":"2024-04-16T19:34:29.370998+0000","last_peered":"2024-04-16T19:34:29.370998+0000","last_clean":"2024-04-16T19:34:29.370998+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:34:29.370998+0000","last_undegraded":"2024-04-16T19:34:29.370998+0000","last_fullsized":"2024-04-16T19:34:29.370998+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:24.434279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'907","reported_seq":3798,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369979+0000","last_change":"2024-04-16T17:45:47.466560+0000","last_active":"2024-04-16T19:34:09.369979+0000","last_peered":"2024-04-16T19:34:09.369979+0000","last_clean":"2024-04-16T19:34:09.369979+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:34:09.369979+0000","last_undegraded":"2024-04-16T19:34:09.369979+0000","last_fullsized":"2024-04-16T19:34:09.369979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:24.659574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'18","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368748+0000","last_change":"2024-04-16T17:45:45.464240+0000","last_active":"2024-04-16T19:34:09.368748+0000","last_peered":"2024-04-16T19:34:09.368748+0000","last_clean":"2024-04-16T19:34:09.368748+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:34:09.368748+0000","last_undegraded":"2024-04-16T19:34:09.368748+0000","last_fullsized":"2024-04-16T19:34:09.368748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:26.089403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365646+0000","last_change":"2024-04-16T17:45:10.394156+0000","last_active":"2024-04-16T19:33:54.365646+0000","last_peered":"2024-04-16T19:33:54.365646+0000","last_clean":"2024-04-16T19:33:54.365646+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:33:54.365646+0000","last_undegraded":"2024-04-16T19:33:54.365646+0000","last_fullsized":"2024-04-16T19:33:54.365646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:04.267541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.553316+0000","last_change":"2024-04-16T17:46:16.499439+0000","last_active":"2024-04-16T19:34:19.553316+0000","last_peered":"2024-04-16T19:34:19.553316+0000","last_clean":"2024-04-16T19:34:19.553316+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:34:19.553316+0000","last_undegraded":"2024-04-16T19:34:19.553316+0000","last_fullsized":"2024-04-16T19:34:19.553316+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:19.618386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568606+0000","last_change":"2024-04-16T17:45:20.408040+0000","last_active":"2024-04-16T19:35:39.568606+0000","last_peered":"2024-04-16T19:35:39.568606+0000","last_clean":"2024-04-16T19:35:39.568606+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:35:39.568606+0000","last_undegraded":"2024-04-16T19:35:39.568606+0000","last_fullsized":"2024-04-16T19:35:39.568606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.875311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'152","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385171+0000","last_change":"2024-04-16T17:45:22.415394+0000","last_active":"2024-04-16T19:35:54.385171+0000","last_peered":"2024-04-16T19:35:54.385171+0000","last_clean":"2024-04-16T19:35:54.385171+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:35:54.385171+0000","last_undegraded":"2024-04-16T19:35:54.385171+0000","last_fullsized":"2024-04-16T19:35:54.385171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:27.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'12","reported_seq":1393,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387342+0000","last_change":"2024-04-16T17:45:24.424024+0000","last_active":"2024-04-16T19:35:54.387342+0000","last_peered":"2024-04-16T19:35:54.387342+0000","last_clean":"2024-04-16T19:35:54.387342+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:35:54.387342+0000","last_undegraded":"2024-04-16T19:35:54.387342+0000","last_fullsized":"2024-04-16T19:35:54.387342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:55.371897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366654+0000","last_change":"2024-04-16T17:45:26.438562+0000","last_active":"2024-04-16T19:33:49.366654+0000","last_peered":"2024-04-16T19:33:49.366654+0000","last_clean":"2024-04-16T19:33:49.366654+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:33:49.366654+0000","last_undegraded":"2024-04-16T19:33:49.366654+0000","last_fullsized":"2024-04-16T19:33:49.366654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:01.400474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564870+0000","last_change":"2024-04-16T18:09:02.168408+0000","last_active":"2024-04-16T19:35:19.564870+0000","last_peered":"2024-04-16T19:35:19.564870+0000","last_clean":"2024-04-16T19:35:19.564870+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:35:19.564870+0000","last_undegraded":"2024-04-16T19:35:19.564870+0000","last_fullsized":"2024-04-16T19:35:19.564870+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:38.652580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'164","reported_seq":2348,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559049+0000","last_change":"2024-04-16T17:46:25.526845+0000","last_active":"2024-04-16T19:34:49.559049+0000","last_peered":"2024-04-16T19:34:49.559049+0000","last_clean":"2024-04-16T19:34:49.559049+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:34:49.559049+0000","last_undegraded":"2024-04-16T19:34:49.559049+0000","last_fullsized":"2024-04-16T19:34:49.559049+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:44.078795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373289+0000","last_change":"2024-04-16T17:46:17.504931+0000","last_active":"2024-04-16T19:34:39.373289+0000","last_peered":"2024-04-16T19:34:39.373289+0000","last_clean":"2024-04-16T19:34:39.373289+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:34:39.373289+0000","last_undegraded":"2024-04-16T19:34:39.373289+0000","last_fullsized":"2024-04-16T19:34:39.373289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'19","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.370911+0000","last_change":"2024-04-16T17:45:51.481046+0000","last_active":"2024-04-16T19:34:14.370911+0000","last_peered":"2024-04-16T19:34:14.370911+0000","last_clean":"2024-04-16T19:34:14.370911+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:34:14.370911+0000","last_undegraded":"2024-04-16T19:34:14.370911+0000","last_fullsized":"2024-04-16T19:34:14.370911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:09.427080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368525+0000","last_change":"2024-04-16T17:45:49.473468+0000","last_active":"2024-04-16T19:34:09.368525+0000","last_peered":"2024-04-16T19:34:09.368525+0000","last_clean":"2024-04-16T19:34:09.368525+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:34:09.368525+0000","last_undegraded":"2024-04-16T19:34:09.368525+0000","last_fullsized":"2024-04-16T19:34:09.368525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:38.069196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'592","reported_seq":3225,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554434+0000","last_change":"2024-04-16T17:45:47.465484+0000","last_active":"2024-04-16T19:34:24.554434+0000","last_peered":"2024-04-16T19:34:24.554434+0000","last_clean":"2024-04-16T19:34:24.554434+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:34:24.554434+0000","last_undegraded":"2024-04-16T19:34:24.554434+0000","last_fullsized":"2024-04-16T19:34:24.554434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:29.485588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'23","reported_seq":340,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368689+0000","last_change":"2024-04-16T17:45:45.460199+0000","last_active":"2024-04-16T19:34:09.368689+0000","last_peered":"2024-04-16T19:34:09.368689+0000","last_clean":"2024-04-16T19:34:09.368689+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:34:09.368689+0000","last_undegraded":"2024-04-16T19:34:09.368689+0000","last_fullsized":"2024-04-16T19:34:09.368689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:30.407609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383191+0000","last_change":"2024-04-16T17:45:10.392991+0000","last_active":"2024-04-16T19:35:29.383191+0000","last_peered":"2024-04-16T19:35:29.383191+0000","last_clean":"2024-04-16T19:35:29.383191+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:35:29.383191+0000","last_undegraded":"2024-04-16T19:35:29.383191+0000","last_fullsized":"2024-04-16T19:35:29.383191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:22.221256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380477+0000","last_change":"2024-04-16T17:45:08.387422+0000","last_active":"2024-04-16T19:35:24.380477+0000","last_peered":"2024-04-16T19:35:24.380477+0000","last_clean":"2024-04-16T19:35:24.380477+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:35:24.380477+0000","last_undegraded":"2024-04-16T19:35:24.380477+0000","last_fullsized":"2024-04-16T19:35:24.380477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"48'3","reported_seq":182,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549346+0000","last_change":"2024-04-16T17:45:20.412558+0000","last_active":"2024-04-16T19:33:59.549346+0000","last_peered":"2024-04-16T19:33:59.549346+0000","last_clean":"2024-04-16T19:33:59.549346+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:33:59.549346+0000","last_undegraded":"2024-04-16T19:33:59.549346+0000","last_fullsized":"2024-04-16T19:33:59.549346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:48.640904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'88","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387311+0000","last_change":"2024-04-16T17:45:22.414488+0000","last_active":"2024-04-16T19:35:54.387311+0000","last_peered":"2024-04-16T19:35:54.387311+0000","last_clean":"2024-04-16T19:35:54.387311+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:35:54.387311+0000","last_undegraded":"2024-04-16T19:35:54.387311+0000","last_fullsized":"2024-04-16T19:35:54.387311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:41.992526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546362+0000","last_change":"2024-04-16T17:45:24.422626+0000","last_active":"2024-04-16T19:33:44.546362+0000","last_peered":"2024-04-16T19:33:44.546362+0000","last_clean":"2024-04-16T19:33:44.546362+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:33:44.546362+0000","last_undegraded":"2024-04-16T19:33:44.546362+0000","last_fullsized":"2024-04-16T19:33:44.546362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:10.255140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547629+0000","last_change":"2024-04-16T17:45:26.438504+0000","last_active":"2024-04-16T19:33:49.547629+0000","last_peered":"2024-04-16T19:33:49.547629+0000","last_clean":"2024-04-16T19:33:49.547629+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:33:49.547629+0000","last_undegraded":"2024-04-16T19:33:49.547629+0000","last_fullsized":"2024-04-16T19:33:49.547629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:07.554066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569813+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:35:44.569813+0000","last_peered":"2024-04-16T19:35:44.569813+0000","last_clean":"2024-04-16T19:35:44.569813+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:35:44.569813+0000","last_undegraded":"2024-04-16T19:35:44.569813+0000","last_fullsized":"2024-04-16T19:35:44.569813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:12:06.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'131","reported_seq":1905,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376474+0000","last_change":"2024-04-16T17:46:25.527139+0000","last_active":"2024-04-16T19:34:49.376474+0000","last_peered":"2024-04-16T19:34:49.376474+0000","last_clean":"2024-04-16T19:34:49.376474+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:34:49.376474+0000","last_undegraded":"2024-04-16T19:34:49.376474+0000","last_fullsized":"2024-04-16T19:34:49.376474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:25.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:59.375692+0000","last_change":"2024-04-16T17:46:17.507808+0000","last_active":"2024-04-16T19:34:59.375692+0000","last_peered":"2024-04-16T19:34:59.375692+0000","last_clean":"2024-04-16T19:34:59.375692+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:34:59.375692+0000","last_undegraded":"2024-04-16T19:34:59.375692+0000","last_fullsized":"2024-04-16T19:34:59.375692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:54.705447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'10","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369417+0000","last_change":"2024-04-16T17:45:51.480080+0000","last_active":"2024-04-16T19:34:14.369417+0000","last_peered":"2024-04-16T19:34:14.369417+0000","last_clean":"2024-04-16T19:34:14.369417+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:34:14.369417+0000","last_undegraded":"2024-04-16T19:34:14.369417+0000","last_fullsized":"2024-04-16T19:34:14.369417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:32.349071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'651","reported_seq":2203,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368151+0000","last_change":"2024-04-16T17:45:49.472107+0000","last_active":"2024-04-16T19:34:09.368151+0000","last_peered":"2024-04-16T19:34:09.368151+0000","last_clean":"2024-04-16T19:34:09.368151+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:34:09.368151+0000","last_undegraded":"2024-04-16T19:34:09.368151+0000","last_fullsized":"2024-04-16T19:34:09.368151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:10.741937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'306","reported_seq":576,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551277+0000","last_change":"2024-04-16T17:45:47.460175+0000","last_active":"2024-04-16T19:34:09.551277+0000","last_peered":"2024-04-16T19:34:09.551277+0000","last_clean":"2024-04-16T19:34:09.551277+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:34:09.551277+0000","last_undegraded":"2024-04-16T19:34:09.551277+0000","last_fullsized":"2024-04-16T19:34:09.551277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:36.850360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'6","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369905+0000","last_change":"2024-04-16T17:45:45.468347+0000","last_active":"2024-04-16T19:34:09.369905+0000","last_peered":"2024-04-16T19:34:09.369905+0000","last_clean":"2024-04-16T19:34:09.369905+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:34:09.369905+0000","last_undegraded":"2024-04-16T19:34:09.369905+0000","last_fullsized":"2024-04-16T19:34:09.369905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:35.038003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380444+0000","last_change":"2024-04-16T17:45:10.402046+0000","last_active":"2024-04-16T19:35:29.380444+0000","last_peered":"2024-04-16T19:35:29.380444+0000","last_clean":"2024-04-16T19:35:29.380444+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:35:29.380444+0000","last_undegraded":"2024-04-16T19:35:29.380444+0000","last_fullsized":"2024-04-16T19:35:29.380444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:06.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565768+0000","last_change":"2024-04-16T17:45:08.384395+0000","last_active":"2024-04-16T19:35:24.565768+0000","last_peered":"2024-04-16T19:35:24.565768+0000","last_clean":"2024-04-16T19:35:24.565768+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:35:24.565768+0000","last_undegraded":"2024-04-16T19:35:24.565768+0000","last_fullsized":"2024-04-16T19:35:24.565768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:03.600126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"30'3","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568667+0000","last_change":"2024-04-16T17:45:20.406255+0000","last_active":"2024-04-16T19:35:39.568667+0000","last_peered":"2024-04-16T19:35:39.568667+0000","last_clean":"2024-04-16T19:35:39.568667+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:35:39.568667+0000","last_undegraded":"2024-04-16T19:35:39.568667+0000","last_fullsized":"2024-04-16T19:35:39.568667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:03.743635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'104","reported_seq":277,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382359+0000","last_change":"2024-04-16T17:45:22.416167+0000","last_active":"2024-04-16T19:35:39.382359+0000","last_peered":"2024-04-16T19:35:39.382359+0000","last_clean":"2024-04-16T19:35:39.382359+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:35:39.382359+0000","last_undegraded":"2024-04-16T19:35:39.382359+0000","last_fullsized":"2024-04-16T19:35:39.382359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:08.259967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.365906+0000","last_change":"2024-04-16T17:45:24.422761+0000","last_active":"2024-04-16T19:33:44.365906+0000","last_peered":"2024-04-16T19:33:44.365906+0000","last_clean":"2024-04-16T19:33:44.365906+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:33:44.365906+0000","last_undegraded":"2024-04-16T19:33:44.365906+0000","last_fullsized":"2024-04-16T19:33:44.365906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:44.189297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569509+0000","last_change":"2024-04-16T17:45:26.433444+0000","last_active":"2024-04-16T19:35:44.569509+0000","last_peered":"2024-04-16T19:35:44.569509+0000","last_clean":"2024-04-16T19:35:44.569509+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:35:44.569509+0000","last_undegraded":"2024-04-16T19:35:44.569509+0000","last_fullsized":"2024-04-16T19:35:44.569509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:37.477962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385770+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:35:44.385770+0000","last_peered":"2024-04-16T19:35:44.385770+0000","last_clean":"2024-04-16T19:35:44.385770+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:35:44.385770+0000","last_undegraded":"2024-04-16T19:35:44.385770+0000","last_fullsized":"2024-04-16T19:35:44.385770+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:48.103141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'156","reported_seq":2122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374807+0000","last_change":"2024-04-16T17:46:25.522062+0000","last_active":"2024-04-16T19:34:49.374807+0000","last_peered":"2024-04-16T19:34:49.374807+0000","last_clean":"2024-04-16T19:34:49.374807+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:34:49.374807+0000","last_undegraded":"2024-04-16T19:34:49.374807+0000","last_fullsized":"2024-04-16T19:34:49.374807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:10:38.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373333+0000","last_change":"2024-04-16T17:46:17.511574+0000","last_active":"2024-04-16T19:34:39.373333+0000","last_peered":"2024-04-16T19:34:39.373333+0000","last_clean":"2024-04-16T19:34:39.373333+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:34:39.373333+0000","last_undegraded":"2024-04-16T19:34:39.373333+0000","last_fullsized":"2024-04-16T19:34:39.373333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'144","reported_seq":327,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:51.478987+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:26.313448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551333+0000","last_change":"2024-04-16T17:45:49.467901+0000","last_active":"2024-04-16T19:34:09.551333+0000","last_peered":"2024-04-16T19:34:09.551333+0000","last_clean":"2024-04-16T19:34:09.551333+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:34:09.551333+0000","last_undegraded":"2024-04-16T19:34:09.551333+0000","last_fullsized":"2024-04-16T19:34:09.551333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:24.687044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'820","reported_seq":1799,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551379+0000","last_change":"2024-04-16T17:45:47.465634+0000","last_active":"2024-04-16T19:34:09.551379+0000","last_peered":"2024-04-16T19:34:09.551379+0000","last_clean":"2024-04-16T19:34:09.551379+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:34:09.551379+0000","last_undegraded":"2024-04-16T19:34:09.551379+0000","last_fullsized":"2024-04-16T19:34:09.551379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:18.406307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'4","reported_seq":269,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550309+0000","last_change":"2024-04-16T17:45:45.460111+0000","last_active":"2024-04-16T19:34:04.550309+0000","last_peered":"2024-04-16T19:34:04.550309+0000","last_clean":"2024-04-16T19:34:04.550309+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:34:04.550309+0000","last_undegraded":"2024-04-16T19:34:04.550309+0000","last_fullsized":"2024-04-16T19:34:04.550309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:20.419958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381397+0000","last_change":"2024-04-16T17:45:10.387439+0000","last_active":"2024-04-16T19:35:29.381397+0000","last_peered":"2024-04-16T19:35:29.381397+0000","last_clean":"2024-04-16T19:35:29.381397+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:35:29.381397+0000","last_undegraded":"2024-04-16T19:35:29.381397+0000","last_fullsized":"2024-04-16T19:35:29.381397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:19.082808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364852+0000","last_change":"2024-04-16T17:45:08.386819+0000","last_active":"2024-04-16T19:33:49.364852+0000","last_peered":"2024-04-16T19:33:49.364852+0000","last_clean":"2024-04-16T19:33:49.364852+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:33:49.364852+0000","last_undegraded":"2024-04-16T19:33:49.364852+0000","last_fullsized":"2024-04-16T19:33:49.364852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"48'13","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568711+0000","last_change":"2024-04-16T17:45:20.413420+0000","last_active":"2024-04-16T19:35:39.568711+0000","last_peered":"2024-04-16T19:35:39.568711+0000","last_clean":"2024-04-16T19:35:39.568711+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:35:39.568711+0000","last_undegraded":"2024-04-16T19:35:39.568711+0000","last_fullsized":"2024-04-16T19:35:39.568711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:07.256474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'152","reported_seq":348,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545609+0000","last_change":"2024-04-16T17:45:22.414344+0000","last_active":"2024-04-16T19:33:39.545609+0000","last_peered":"2024-04-16T19:33:39.545609+0000","last_clean":"2024-04-16T19:33:39.545609+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:33:39.545609+0000","last_undegraded":"2024-04-16T19:33:39.545609+0000","last_fullsized":"2024-04-16T19:33:39.545609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:59.276583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'12","reported_seq":1391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568700+0000","last_change":"2024-04-16T17:45:24.430890+0000","last_active":"2024-04-16T19:35:39.568700+0000","last_peered":"2024-04-16T19:35:39.568700+0000","last_clean":"2024-04-16T19:35:39.568700+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:35:39.568700+0000","last_undegraded":"2024-04-16T19:35:39.568700+0000","last_fullsized":"2024-04-16T19:35:39.568700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:11.271716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571455+0000","last_change":"2024-04-16T17:45:26.428823+0000","last_active":"2024-04-16T19:35:54.571455+0000","last_peered":"2024-04-16T19:35:54.571455+0000","last_clean":"2024-04-16T19:35:54.571455+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:35:54.571455+0000","last_undegraded":"2024-04-16T19:35:54.571455+0000","last_fullsized":"2024-04-16T19:35:54.571455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:08.709599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373933+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:34:44.373933+0000","last_peered":"2024-04-16T19:34:44.373933+0000","last_clean":"2024-04-16T19:34:44.373933+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:34:44.373933+0000","last_undegraded":"2024-04-16T19:34:44.373933+0000","last_fullsized":"2024-04-16T19:34:44.373933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:08.722479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'84","reported_seq":1607,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374780+0000","last_change":"2024-04-16T17:46:25.527208+0000","last_active":"2024-04-16T19:34:49.374780+0000","last_peered":"2024-04-16T19:34:49.374780+0000","last_clean":"2024-04-16T19:34:49.374780+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:34:49.374780+0000","last_undegraded":"2024-04-16T19:34:49.374780+0000","last_fullsized":"2024-04-16T19:34:49.374780+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.607096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373249+0000","last_change":"2024-04-16T17:46:17.513992+0000","last_active":"2024-04-16T19:34:39.373249+0000","last_peered":"2024-04-16T19:34:39.373249+0000","last_clean":"2024-04-16T19:34:39.373249+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:34:39.373249+0000","last_undegraded":"2024-04-16T19:34:39.373249+0000","last_fullsized":"2024-04-16T19:34:39.373249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'17","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552285+0000","last_change":"2024-04-16T17:45:51.480268+0000","last_active":"2024-04-16T19:34:14.552285+0000","last_peered":"2024-04-16T19:34:14.552285+0000","last_clean":"2024-04-16T19:34:14.552285+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:34:14.552285+0000","last_undegraded":"2024-04-16T19:34:14.552285+0000","last_fullsized":"2024-04-16T19:34:14.552285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:10:40.755507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367826+0000","last_change":"2024-04-16T17:45:49.472397+0000","last_active":"2024-04-16T19:34:09.367826+0000","last_peered":"2024-04-16T19:34:09.367826+0000","last_clean":"2024-04-16T19:34:09.367826+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:34:09.367826+0000","last_undegraded":"2024-04-16T19:34:09.367826+0000","last_fullsized":"2024-04-16T19:34:09.367826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:02.894263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'526","reported_seq":907,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368367+0000","last_change":"2024-04-16T17:45:47.465575+0000","last_active":"2024-04-16T19:34:09.368367+0000","last_peered":"2024-04-16T19:34:09.368367+0000","last_clean":"2024-04-16T19:34:09.368367+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:34:09.368367+0000","last_undegraded":"2024-04-16T19:34:09.368367+0000","last_fullsized":"2024-04-16T19:34:09.368367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:42.534287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'10","reported_seq":383,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368166+0000","last_change":"2024-04-16T17:45:45.461495+0000","last_active":"2024-04-16T19:34:09.368166+0000","last_peered":"2024-04-16T19:34:09.368166+0000","last_clean":"2024-04-16T19:34:09.368166+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:34:09.368166+0000","last_undegraded":"2024-04-16T19:34:09.368166+0000","last_fullsized":"2024-04-16T19:34:09.368166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:23.315560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380526+0000","last_change":"2024-04-16T17:45:10.394926+0000","last_active":"2024-04-16T19:35:29.380526+0000","last_peered":"2024-04-16T19:35:29.380526+0000","last_clean":"2024-04-16T19:35:29.380526+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:35:29.380526+0000","last_undegraded":"2024-04-16T19:35:29.380526+0000","last_fullsized":"2024-04-16T19:35:29.380526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:53.484971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382188+0000","last_change":"2024-04-16T17:45:08.382545+0000","last_active":"2024-04-16T19:35:39.382188+0000","last_peered":"2024-04-16T19:35:39.382188+0000","last_clean":"2024-04-16T19:35:39.382188+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:35:39.382188+0000","last_undegraded":"2024-04-16T19:35:39.382188+0000","last_fullsized":"2024-04-16T19:35:39.382188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"48'17","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.364227+0000","last_change":"2024-04-16T17:45:20.412524+0000","last_active":"2024-04-16T19:33:44.364227+0000","last_peered":"2024-04-16T19:33:44.364227+0000","last_clean":"2024-04-16T19:33:44.364227+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:33:44.364227+0000","last_undegraded":"2024-04-16T19:33:44.364227+0000","last_fullsized":"2024-04-16T19:33:44.364227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:20.296409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'120","reported_seq":296,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568730+0000","last_change":"2024-04-16T17:45:22.414750+0000","last_active":"2024-04-16T19:35:39.568730+0000","last_peered":"2024-04-16T19:35:39.568730+0000","last_clean":"2024-04-16T19:35:39.568730+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:35:39.568730+0000","last_undegraded":"2024-04-16T19:35:39.568730+0000","last_fullsized":"2024-04-16T19:35:39.568730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:22.304242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'12","reported_seq":1391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382297+0000","last_change":"2024-04-16T17:45:24.423828+0000","last_active":"2024-04-16T19:35:39.382297+0000","last_peered":"2024-04-16T19:35:39.382297+0000","last_clean":"2024-04-16T19:35:39.382297+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:35:39.382297+0000","last_undegraded":"2024-04-16T19:35:39.382297+0000","last_fullsized":"2024-04-16T19:35:39.382297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:54.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.384551+0000","last_change":"2024-04-16T17:45:26.429874+0000","last_active":"2024-04-16T19:35:54.384551+0000","last_peered":"2024-04-16T19:35:54.384551+0000","last_clean":"2024-04-16T19:35:54.384551+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:35:54.384551+0000","last_undegraded":"2024-04-16T19:35:54.384551+0000","last_fullsized":"2024-04-16T19:35:54.384551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:16.546602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555434+0000","last_change":"2024-04-16T18:09:02.169496+0000","last_active":"2024-04-16T19:34:29.555434+0000","last_peered":"2024-04-16T19:34:29.555434+0000","last_clean":"2024-04-16T19:34:29.555434+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:34:29.555434+0000","last_undegraded":"2024-04-16T19:34:29.555434+0000","last_fullsized":"2024-04-16T19:34:29.555434+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:44.423508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'130","reported_seq":1976,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.379689+0000","last_change":"2024-04-16T17:46:25.525792+0000","last_active":"2024-04-16T19:35:09.379689+0000","last_peered":"2024-04-16T19:35:09.379689+0000","last_clean":"2024-04-16T19:35:09.379689+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:35:09.379689+0000","last_undegraded":"2024-04-16T19:35:09.379689+0000","last_fullsized":"2024-04-16T19:35:09.379689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:51.015603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373227+0000","last_change":"2024-04-16T17:46:17.512275+0000","last_active":"2024-04-16T19:34:39.373227+0000","last_peered":"2024-04-16T19:34:39.373227+0000","last_clean":"2024-04-16T19:34:39.373227+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:34:39.373227+0000","last_undegraded":"2024-04-16T19:34:39.373227+0000","last_fullsized":"2024-04-16T19:34:39.373227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'16","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552355+0000","last_change":"2024-04-16T17:45:51.480112+0000","last_active":"2024-04-16T19:34:14.552355+0000","last_peered":"2024-04-16T19:34:14.552355+0000","last_clean":"2024-04-16T19:34:14.552355+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:34:14.552355+0000","last_undegraded":"2024-04-16T19:34:14.552355+0000","last_fullsized":"2024-04-16T19:34:14.552355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:58.876769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'651","reported_seq":2211,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550264+0000","last_change":"2024-04-16T17:45:49.470044+0000","last_active":"2024-04-16T19:34:04.550264+0000","last_peered":"2024-04-16T19:34:04.550264+0000","last_clean":"2024-04-16T19:34:04.550264+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:34:04.550264+0000","last_undegraded":"2024-04-16T19:34:04.550264+0000","last_fullsized":"2024-04-16T19:34:04.550264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:33.520085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'424","reported_seq":710,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367800+0000","last_change":"2024-04-16T17:45:47.461193+0000","last_active":"2024-04-16T19:34:09.367800+0000","last_peered":"2024-04-16T19:34:09.367800+0000","last_clean":"2024-04-16T19:34:09.367800+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:34:09.367800+0000","last_undegraded":"2024-04-16T19:34:09.367800+0000","last_fullsized":"2024-04-16T19:34:09.367800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:59:35.710148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'28","reported_seq":524,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551319+0000","last_change":"2024-04-16T17:45:45.458470+0000","last_active":"2024-04-16T19:34:09.551319+0000","last_peered":"2024-04-16T19:34:09.551319+0000","last_clean":"2024-04-16T19:34:09.551319+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:34:09.551319+0000","last_undegraded":"2024-04-16T19:34:09.551319+0000","last_fullsized":"2024-04-16T19:34:09.551319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.314430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556590+0000","last_change":"2024-04-16T17:46:16.501988+0000","last_active":"2024-04-16T19:34:34.556590+0000","last_peered":"2024-04-16T19:34:34.556590+0000","last_clean":"2024-04-16T19:34:34.556590+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:34:34.556590+0000","last_undegraded":"2024-04-16T19:34:34.556590+0000","last_fullsized":"2024-04-16T19:34:34.556590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:04.853827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568467+0000","last_change":"2024-04-16T17:45:08.381995+0000","last_active":"2024-04-16T19:35:39.568467+0000","last_peered":"2024-04-16T19:35:39.568467+0000","last_clean":"2024-04-16T19:35:39.568467+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:35:39.568467+0000","last_undegraded":"2024-04-16T19:35:39.568467+0000","last_fullsized":"2024-04-16T19:35:39.568467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:09.343973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382943+0000","last_change":"2024-04-16T17:45:20.407642+0000","last_active":"2024-04-16T19:35:39.382943+0000","last_peered":"2024-04-16T19:35:39.382943+0000","last_clean":"2024-04-16T19:35:39.382943+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:35:39.382943+0000","last_undegraded":"2024-04-16T19:35:39.382943+0000","last_fullsized":"2024-04-16T19:35:39.382943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:15.477935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'176","reported_seq":385,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382915+0000","last_change":"2024-04-16T17:45:22.414672+0000","last_active":"2024-04-16T19:35:39.382915+0000","last_peered":"2024-04-16T19:35:39.382915+0000","last_clean":"2024-04-16T19:35:39.382915+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:35:39.382915+0000","last_undegraded":"2024-04-16T19:35:39.382915+0000","last_fullsized":"2024-04-16T19:35:39.382915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:49.342017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382893+0000","last_change":"2024-04-16T17:45:24.425728+0000","last_active":"2024-04-16T19:35:39.382893+0000","last_peered":"2024-04-16T19:35:39.382893+0000","last_clean":"2024-04-16T19:35:39.382893+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:35:39.382893+0000","last_undegraded":"2024-04-16T19:35:39.382893+0000","last_fullsized":"2024-04-16T19:35:39.382893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:48.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571522+0000","last_change":"2024-04-16T17:45:26.433385+0000","last_active":"2024-04-16T19:35:54.571522+0000","last_peered":"2024-04-16T19:35:54.571522+0000","last_clean":"2024-04-16T19:35:54.571522+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:35:54.571522+0000","last_undegraded":"2024-04-16T19:35:54.571522+0000","last_fullsized":"2024-04-16T19:35:54.571522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:00.885088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556570+0000","last_change":"2024-04-16T18:09:02.173431+0000","last_active":"2024-04-16T19:34:34.556570+0000","last_peered":"2024-04-16T19:34:34.556570+0000","last_clean":"2024-04-16T19:34:34.556570+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:34:34.556570+0000","last_undegraded":"2024-04-16T19:34:34.556570+0000","last_fullsized":"2024-04-16T19:34:34.556570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:47.114929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'117","reported_seq":1947,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374129+0000","last_change":"2024-04-16T17:46:25.530014+0000","last_active":"2024-04-16T19:34:49.374129+0000","last_peered":"2024-04-16T19:34:49.374129+0000","last_clean":"2024-04-16T19:34:49.374129+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:34:49.374129+0000","last_undegraded":"2024-04-16T19:34:49.374129+0000","last_fullsized":"2024-04-16T19:34:49.374129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:46.795658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.553245+0000","last_change":"2024-04-16T17:46:17.512764+0000","last_active":"2024-04-16T19:34:19.553245+0000","last_peered":"2024-04-16T19:34:19.553245+0000","last_clean":"2024-04-16T19:34:19.553245+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:34:19.553245+0000","last_undegraded":"2024-04-16T19:34:19.553245+0000","last_fullsized":"2024-04-16T19:34:19.553245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:58.381096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'24","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365186+0000","last_change":"2024-04-16T17:45:51.482816+0000","last_active":"2024-04-16T19:33:54.365186+0000","last_peered":"2024-04-16T19:33:54.365186+0000","last_clean":"2024-04-16T19:33:54.365186+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:33:54.365186+0000","last_undegraded":"2024-04-16T19:33:54.365186+0000","last_fullsized":"2024-04-16T19:33:54.365186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:57.211121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554350+0000","last_change":"2024-04-16T17:45:49.472014+0000","last_active":"2024-04-16T19:34:24.554350+0000","last_peered":"2024-04-16T19:34:24.554350+0000","last_clean":"2024-04-16T19:34:24.554350+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:34:24.554350+0000","last_undegraded":"2024-04-16T19:34:24.554350+0000","last_fullsized":"2024-04-16T19:34:24.554350+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:44.541417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'291","reported_seq":535,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364960+0000","last_change":"2024-04-16T17:45:47.466159+0000","last_active":"2024-04-16T19:33:49.364960+0000","last_peered":"2024-04-16T19:33:49.364960+0000","last_clean":"2024-04-16T19:33:49.364960+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:33:49.364960+0000","last_undegraded":"2024-04-16T19:33:49.364960+0000","last_fullsized":"2024-04-16T19:33:49.364960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:37.045194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'11","reported_seq":456,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551199+0000","last_change":"2024-04-16T17:45:45.461762+0000","last_active":"2024-04-16T19:34:09.551199+0000","last_peered":"2024-04-16T19:34:09.551199+0000","last_clean":"2024-04-16T19:34:09.551199+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:34:09.551199+0000","last_undegraded":"2024-04-16T19:34:09.551199+0000","last_fullsized":"2024-04-16T19:34:09.551199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:35.566086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.386083+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:35:59.386083+0000","last_peered":"2024-04-16T19:35:59.386083+0000","last_clean":"2024-04-16T19:35:59.386083+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:35:59.386083+0000","last_undegraded":"2024-04-16T19:35:59.386083+0000","last_fullsized":"2024-04-16T19:35:59.386083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:01.549347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":296,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373805+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T19:34:44.373805+0000","last_peered":"2024-04-16T19:34:44.373805+0000","last_clean":"2024-04-16T19:34:44.373805+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:34:44.373805+0000","last_undegraded":"2024-04-16T19:34:44.373805+0000","last_fullsized":"2024-04-16T19:34:44.373805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:56.418777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374723+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:34:49.374723+0000","last_peered":"2024-04-16T19:34:49.374723+0000","last_clean":"2024-04-16T19:34:49.374723+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:34:49.374723+0000","last_undegraded":"2024-04-16T19:34:49.374723+0000","last_fullsized":"2024-04-16T19:34:49.374723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567575+0000","last_change":"2024-04-16T17:45:08.387550+0000","last_active":"2024-04-16T19:35:34.567575+0000","last_peered":"2024-04-16T19:35:34.567575+0000","last_clean":"2024-04-16T19:35:34.567575+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:35:34.567575+0000","last_undegraded":"2024-04-16T19:35:34.567575+0000","last_fullsized":"2024-04-16T19:35:34.567575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383732+0000","last_change":"2024-04-16T17:45:20.412324+0000","last_active":"2024-04-16T19:35:49.383732+0000","last_peered":"2024-04-16T19:35:49.383732+0000","last_clean":"2024-04-16T19:35:49.383732+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:35:49.383732+0000","last_undegraded":"2024-04-16T19:35:49.383732+0000","last_fullsized":"2024-04-16T19:35:49.383732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:06.239898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'72","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385321+0000","last_change":"2024-04-16T17:45:22.415579+0000","last_active":"2024-04-16T19:35:54.385321+0000","last_peered":"2024-04-16T19:35:54.385321+0000","last_clean":"2024-04-16T19:35:54.385321+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:35:54.385321+0000","last_undegraded":"2024-04-16T19:35:54.385321+0000","last_fullsized":"2024-04-16T19:35:54.385321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:40.426580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387491+0000","last_change":"2024-04-16T17:45:24.422064+0000","last_active":"2024-04-16T19:35:54.387491+0000","last_peered":"2024-04-16T19:35:54.387491+0000","last_clean":"2024-04-16T19:35:54.387491+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:35:54.387491+0000","last_undegraded":"2024-04-16T19:35:54.387491+0000","last_fullsized":"2024-04-16T19:35:54.387491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:56.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364911+0000","last_change":"2024-04-16T17:45:26.439130+0000","last_active":"2024-04-16T19:33:49.364911+0000","last_peered":"2024-04-16T19:33:49.364911+0000","last_clean":"2024-04-16T19:33:49.364911+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:33:49.364911+0000","last_undegraded":"2024-04-16T19:33:49.364911+0000","last_fullsized":"2024-04-16T19:33:49.364911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:21.169043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371730+0000","last_change":"2024-04-16T18:09:02.168908+0000","last_active":"2024-04-16T19:34:34.371730+0000","last_peered":"2024-04-16T19:34:34.371730+0000","last_clean":"2024-04-16T19:34:34.371730+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:34:34.371730+0000","last_undegraded":"2024-04-16T19:34:34.371730+0000","last_fullsized":"2024-04-16T19:34:34.371730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:56.187557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'150","reported_seq":2025,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373426+0000","last_change":"2024-04-16T17:46:25.527679+0000","last_active":"2024-04-16T19:34:29.373426+0000","last_peered":"2024-04-16T19:34:29.373426+0000","last_clean":"2024-04-16T19:34:29.373426+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:34:29.373426+0000","last_undegraded":"2024-04-16T19:34:29.373426+0000","last_fullsized":"2024-04-16T19:34:29.373426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.607096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373443+0000","last_change":"2024-04-16T17:46:17.514358+0000","last_active":"2024-04-16T19:34:39.373443+0000","last_peered":"2024-04-16T19:34:39.373443+0000","last_clean":"2024-04-16T19:34:39.373443+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:34:39.373443+0000","last_undegraded":"2024-04-16T19:34:39.373443+0000","last_fullsized":"2024-04-16T19:34:39.373443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:01.622597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'5","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367358+0000","last_change":"2024-04-16T17:45:51.481385+0000","last_active":"2024-04-16T19:33:54.367358+0000","last_peered":"2024-04-16T19:33:54.367358+0000","last_clean":"2024-04-16T19:33:54.367358+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:33:54.367358+0000","last_undegraded":"2024-04-16T19:33:54.367358+0000","last_fullsized":"2024-04-16T19:33:54.367358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'651","reported_seq":2342,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551310+0000","last_change":"2024-04-16T17:45:49.469823+0000","last_active":"2024-04-16T19:34:09.551310+0000","last_peered":"2024-04-16T19:34:09.551310+0000","last_clean":"2024-04-16T19:34:09.551310+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:34:09.551310+0000","last_undegraded":"2024-04-16T19:34:09.551310+0000","last_fullsized":"2024-04-16T19:34:09.551310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:31.511049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'439","reported_seq":733,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369820+0000","last_change":"2024-04-16T17:45:47.465291+0000","last_active":"2024-04-16T19:34:09.369820+0000","last_peered":"2024-04-16T19:34:09.369820+0000","last_clean":"2024-04-16T19:34:09.369820+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:34:09.369820+0000","last_undegraded":"2024-04-16T19:34:09.369820+0000","last_fullsized":"2024-04-16T19:34:09.369820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:49.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'13","reported_seq":540,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366573+0000","last_change":"2024-04-16T17:45:45.460969+0000","last_active":"2024-04-16T19:33:49.366573+0000","last_peered":"2024-04-16T19:33:49.366573+0000","last_clean":"2024-04-16T19:33:49.366573+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:33:49.366573+0000","last_undegraded":"2024-04-16T19:33:49.366573+0000","last_fullsized":"2024-04-16T19:33:49.366573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:23.315560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385802+0000","last_change":"2024-04-16T17:45:10.396755+0000","last_active":"2024-04-16T19:35:44.385802+0000","last_peered":"2024-04-16T19:35:44.385802+0000","last_clean":"2024-04-16T19:35:44.385802+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:35:44.385802+0000","last_undegraded":"2024-04-16T19:35:44.385802+0000","last_fullsized":"2024-04-16T19:35:44.385802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:41.531980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373829+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T19:34:44.373829+0000","last_peered":"2024-04-16T19:34:44.373829+0000","last_clean":"2024-04-16T19:34:44.373829+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:34:44.373829+0000","last_undegraded":"2024-04-16T19:34:44.373829+0000","last_fullsized":"2024-04-16T19:34:44.373829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:33.735299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557306+0000","last_change":"2024-04-16T17:46:16.500353+0000","last_active":"2024-04-16T19:34:39.557306+0000","last_peered":"2024-04-16T19:34:39.557306+0000","last_clean":"2024-04-16T19:34:39.557306+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:34:39.557306+0000","last_undegraded":"2024-04-16T19:34:39.557306+0000","last_fullsized":"2024-04-16T19:34:39.557306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:15.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"48'13","reported_seq":582,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385339+0000","last_change":"2024-04-16T17:45:20.412363+0000","last_active":"2024-04-16T19:35:54.385339+0000","last_peered":"2024-04-16T19:35:54.385339+0000","last_clean":"2024-04-16T19:35:54.385339+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:35:54.385339+0000","last_undegraded":"2024-04-16T19:35:54.385339+0000","last_fullsized":"2024-04-16T19:35:54.385339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:51.744736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'177","reported_seq":1667,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570636+0000","last_change":"2024-04-16T17:45:22.412577+0000","last_active":"2024-04-16T19:35:49.570636+0000","last_peered":"2024-04-16T19:35:49.570636+0000","last_clean":"2024-04-16T19:35:49.570636+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:35:49.570636+0000","last_undegraded":"2024-04-16T19:35:49.570636+0000","last_fullsized":"2024-04-16T19:35:49.570636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:53.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366956+0000","last_change":"2024-04-16T17:45:24.422901+0000","last_active":"2024-04-16T19:34:04.366956+0000","last_peered":"2024-04-16T19:34:04.366956+0000","last_clean":"2024-04-16T19:34:04.366956+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:34:04.366956+0000","last_undegraded":"2024-04-16T19:34:04.366956+0000","last_fullsized":"2024-04-16T19:34:04.366956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:55.759978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550383+0000","last_change":"2024-04-16T17:45:26.847528+0000","last_active":"2024-04-16T19:34:04.550383+0000","last_peered":"2024-04-16T19:34:04.550383+0000","last_clean":"2024-04-16T19:34:04.550383+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:34:04.550383+0000","last_undegraded":"2024-04-16T19:34:04.550383+0000","last_fullsized":"2024-04-16T19:34:04.550383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:39:36.865102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372561+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:34:34.372561+0000","last_peered":"2024-04-16T19:34:34.372561+0000","last_clean":"2024-04-16T19:34:34.372561+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:34:34.372561+0000","last_undegraded":"2024-04-16T19:34:34.372561+0000","last_fullsized":"2024-04-16T19:34:34.372561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'137","reported_seq":1599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371844+0000","last_change":"2024-04-16T17:46:25.524587+0000","last_active":"2024-04-16T19:34:29.371844+0000","last_peered":"2024-04-16T19:34:29.371844+0000","last_clean":"2024-04-16T19:34:29.371844+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:34:29.371844+0000","last_undegraded":"2024-04-16T19:34:29.371844+0000","last_fullsized":"2024-04-16T19:34:29.371844+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:51.963525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.370234+0000","last_change":"2024-04-16T17:46:17.512533+0000","last_active":"2024-04-16T19:34:19.370234+0000","last_peered":"2024-04-16T19:34:19.370234+0000","last_clean":"2024-04-16T19:34:19.370234+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:34:19.370234+0000","last_undegraded":"2024-04-16T19:34:19.370234+0000","last_fullsized":"2024-04-16T19:34:19.370234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'22","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369157+0000","last_change":"2024-04-16T17:45:51.482872+0000","last_active":"2024-04-16T19:34:14.369157+0000","last_peered":"2024-04-16T19:34:14.369157+0000","last_clean":"2024-04-16T19:34:14.369157+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:34:14.369157+0000","last_undegraded":"2024-04-16T19:34:14.369157+0000","last_fullsized":"2024-04-16T19:34:14.369157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:41:19.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551235+0000","last_change":"2024-04-16T17:45:49.469833+0000","last_active":"2024-04-16T19:34:09.551235+0000","last_peered":"2024-04-16T19:34:09.551235+0000","last_clean":"2024-04-16T19:34:09.551235+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:34:09.551235+0000","last_undegraded":"2024-04-16T19:34:09.551235+0000","last_fullsized":"2024-04-16T19:34:09.551235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:38.617917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4935","reported_seq":7414,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368062+0000","last_change":"2024-04-16T17:45:47.459129+0000","last_active":"2024-04-16T19:34:09.368062+0000","last_peered":"2024-04-16T19:34:09.368062+0000","last_clean":"2024-04-16T19:34:09.368062+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:34:09.368062+0000","last_undegraded":"2024-04-16T19:34:09.368062+0000","last_fullsized":"2024-04-16T19:34:09.368062+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":3000,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:16.005223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'5","reported_seq":257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371575+0000","last_change":"2024-04-16T17:45:45.465878+0000","last_active":"2024-04-16T19:34:29.371575+0000","last_peered":"2024-04-16T19:34:29.371575+0000","last_clean":"2024-04-16T19:34:29.371575+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:34:29.371575+0000","last_undegraded":"2024-04-16T19:34:29.371575+0000","last_fullsized":"2024-04-16T19:34:29.371575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:14.781901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569790+0000","last_change":"2024-04-16T17:45:10.401015+0000","last_active":"2024-04-16T19:35:44.569790+0000","last_peered":"2024-04-16T19:35:44.569790+0000","last_clean":"2024-04-16T19:35:44.569790+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:35:44.569790+0000","last_undegraded":"2024-04-16T19:35:44.569790+0000","last_fullsized":"2024-04-16T19:35:44.569790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:24.037647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559082+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T19:34:49.559082+0000","last_peered":"2024-04-16T19:34:49.559082+0000","last_clean":"2024-04-16T19:34:49.559082+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:34:49.559082+0000","last_undegraded":"2024-04-16T19:34:49.559082+0000","last_fullsized":"2024-04-16T19:34:49.559082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:57.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565632+0000","last_change":"2024-04-16T17:45:08.382479+0000","last_active":"2024-04-16T19:35:24.565632+0000","last_peered":"2024-04-16T19:35:24.565632+0000","last_clean":"2024-04-16T19:35:24.565632+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:35:24.565632+0000","last_undegraded":"2024-04-16T19:35:24.565632+0000","last_fullsized":"2024-04-16T19:35:24.565632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:35:30.412079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"48'3","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546535+0000","last_change":"2024-04-16T17:45:20.413451+0000","last_active":"2024-04-16T19:33:44.546535+0000","last_peered":"2024-04-16T19:33:44.546535+0000","last_clean":"2024-04-16T19:33:44.546535+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:33:44.546535+0000","last_undegraded":"2024-04-16T19:33:44.546535+0000","last_fullsized":"2024-04-16T19:33:44.546535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:16.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'151","reported_seq":1610,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367608+0000","last_change":"2024-04-16T17:45:22.416277+0000","last_active":"2024-04-16T19:34:04.367608+0000","last_peered":"2024-04-16T19:34:04.367608+0000","last_clean":"2024-04-16T19:34:04.367608+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:34:04.367608+0000","last_undegraded":"2024-04-16T19:34:04.367608+0000","last_fullsized":"2024-04-16T19:34:04.367608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:43.858466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386521+0000","last_change":"2024-04-16T17:45:24.426509+0000","last_active":"2024-04-16T19:35:49.386521+0000","last_peered":"2024-04-16T19:35:49.386521+0000","last_clean":"2024-04-16T19:35:49.386521+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:35:49.386521+0000","last_undegraded":"2024-04-16T19:35:49.386521+0000","last_fullsized":"2024-04-16T19:35:49.386521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:19.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385695+0000","last_change":"2024-04-16T17:45:26.439231+0000","last_active":"2024-04-16T19:35:44.385695+0000","last_peered":"2024-04-16T19:35:44.385695+0000","last_clean":"2024-04-16T19:35:44.385695+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:35:44.385695+0000","last_undegraded":"2024-04-16T19:35:44.385695+0000","last_fullsized":"2024-04-16T19:35:44.385695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:15.584111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374893+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:34:49.374893+0000","last_peered":"2024-04-16T19:34:49.374893+0000","last_clean":"2024-04-16T19:34:49.374893+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:34:49.374893+0000","last_undegraded":"2024-04-16T19:34:49.374893+0000","last_fullsized":"2024-04-16T19:34:49.374893+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:07.763412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'135","reported_seq":2026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371048+0000","last_change":"2024-04-16T17:46:25.529983+0000","last_active":"2024-04-16T19:34:29.371048+0000","last_peered":"2024-04-16T19:34:29.371048+0000","last_clean":"2024-04-16T19:34:29.371048+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:34:29.371048+0000","last_undegraded":"2024-04-16T19:34:29.371048+0000","last_fullsized":"2024-04-16T19:34:29.371048+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:45:31.421525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369527+0000","last_change":"2024-04-16T17:46:17.508075+0000","last_active":"2024-04-16T19:34:19.369527+0000","last_peered":"2024-04-16T19:34:19.369527+0000","last_clean":"2024-04-16T19:34:19.369527+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:34:19.369527+0000","last_undegraded":"2024-04-16T19:34:19.369527+0000","last_fullsized":"2024-04-16T19:34:19.369527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:48.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"48'2","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367303+0000","last_change":"2024-04-16T17:45:51.484218+0000","last_active":"2024-04-16T19:33:54.367303+0000","last_peered":"2024-04-16T19:33:54.367303+0000","last_clean":"2024-04-16T19:33:54.367303+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:33:54.367303+0000","last_undegraded":"2024-04-16T19:33:54.367303+0000","last_fullsized":"2024-04-16T19:33:54.367303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:41:19.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547483+0000","last_change":"2024-04-16T17:45:49.469114+0000","last_active":"2024-04-16T19:33:49.547483+0000","last_peered":"2024-04-16T19:33:49.547483+0000","last_clean":"2024-04-16T19:33:49.547483+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:33:49.547483+0000","last_undegraded":"2024-04-16T19:33:49.547483+0000","last_fullsized":"2024-04-16T19:33:49.547483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:10.917939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'472","reported_seq":939,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370916+0000","last_change":"2024-04-16T17:45:47.463058+0000","last_active":"2024-04-16T19:34:29.370916+0000","last_peered":"2024-04-16T19:34:29.370916+0000","last_clean":"2024-04-16T19:34:29.370916+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:34:29.370916+0000","last_undegraded":"2024-04-16T19:34:29.370916+0000","last_fullsized":"2024-04-16T19:34:29.370916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:54:56.798962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'6","reported_seq":418,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369890+0000","last_change":"2024-04-16T17:45:45.463642+0000","last_active":"2024-04-16T19:34:09.369890+0000","last_peered":"2024-04-16T19:34:09.369890+0000","last_clean":"2024-04-16T19:34:09.369890+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:34:09.369890+0000","last_undegraded":"2024-04-16T19:34:09.369890+0000","last_fullsized":"2024-04-16T19:34:09.369890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568687+0000","last_change":"2024-04-16T17:45:10.396905+0000","last_active":"2024-04-16T19:35:39.568687+0000","last_peered":"2024-04-16T19:35:39.568687+0000","last_clean":"2024-04-16T19:35:39.568687+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:35:39.568687+0000","last_undegraded":"2024-04-16T19:35:39.568687+0000","last_fullsized":"2024-04-16T19:35:39.568687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:49:42.077116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374696+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T19:34:49.374696+0000","last_peered":"2024-04-16T19:34:49.374696+0000","last_clean":"2024-04-16T19:34:49.374696+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:34:49.374696+0000","last_undegraded":"2024-04-16T19:34:49.374696+0000","last_fullsized":"2024-04-16T19:34:49.374696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381333+0000","last_change":"2024-04-16T17:45:08.382355+0000","last_active":"2024-04-16T19:35:34.381333+0000","last_peered":"2024-04-16T19:35:34.381333+0000","last_clean":"2024-04-16T19:35:34.381333+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:35:34.381333+0000","last_undegraded":"2024-04-16T19:35:34.381333+0000","last_fullsized":"2024-04-16T19:35:34.381333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:26.849118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":876,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.369133+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:34:04.369133+0000","last_peered":"2024-04-16T19:34:04.369133+0000","last_clean":"2024-04-16T19:34:04.369133+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:34:04.369133+0000","last_undegraded":"2024-04-16T19:34:04.369133+0000","last_fullsized":"2024-04-16T19:34:04.369133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:49:00.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'144","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546574+0000","last_change":"2024-04-16T17:45:22.417967+0000","last_active":"2024-04-16T19:33:44.546574+0000","last_peered":"2024-04-16T19:33:44.546574+0000","last_clean":"2024-04-16T19:33:44.546574+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:33:44.546574+0000","last_undegraded":"2024-04-16T19:33:44.546574+0000","last_fullsized":"2024-04-16T19:33:44.546574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:52.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385378+0000","last_change":"2024-04-16T17:45:24.430854+0000","last_active":"2024-04-16T19:35:54.385378+0000","last_peered":"2024-04-16T19:35:54.385378+0000","last_clean":"2024-04-16T19:35:54.385378+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:35:54.385378+0000","last_undegraded":"2024-04-16T19:35:54.385378+0000","last_fullsized":"2024-04-16T19:35:54.385378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:44.189297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364886+0000","last_change":"2024-04-16T17:45:26.433033+0000","last_active":"2024-04-16T19:33:49.364886+0000","last_peered":"2024-04-16T19:33:49.364886+0000","last_clean":"2024-04-16T19:33:49.364886+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:33:49.364886+0000","last_undegraded":"2024-04-16T19:33:49.364886+0000","last_fullsized":"2024-04-16T19:33:49.364886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:50.423306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383610+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:35:44.383610+0000","last_peered":"2024-04-16T19:35:44.383610+0000","last_clean":"2024-04-16T19:35:44.383610+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:35:44.383610+0000","last_undegraded":"2024-04-16T19:35:44.383610+0000","last_fullsized":"2024-04-16T19:35:44.383610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:02:50.648888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1711,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382752+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:35:39.382752+0000","last_peered":"2024-04-16T19:35:39.382752+0000","last_clean":"2024-04-16T19:35:39.382752+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:35:39.382752+0000","last_undegraded":"2024-04-16T19:35:39.382752+0000","last_fullsized":"2024-04-16T19:35:39.382752+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:19:32.647068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369878+0000","last_change":"2024-04-16T17:46:17.507415+0000","last_active":"2024-04-16T19:34:19.369878+0000","last_peered":"2024-04-16T19:34:19.369878+0000","last_clean":"2024-04-16T19:34:19.369878+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:34:19.369878+0000","last_undegraded":"2024-04-16T19:34:19.369878+0000","last_fullsized":"2024-04-16T19:34:19.369878+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'8","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555429+0000","last_change":"2024-04-16T17:45:51.479839+0000","last_active":"2024-04-16T19:34:29.555429+0000","last_peered":"2024-04-16T19:34:29.555429+0000","last_clean":"2024-04-16T19:34:29.555429+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:34:29.555429+0000","last_undegraded":"2024-04-16T19:34:29.555429+0000","last_fullsized":"2024-04-16T19:34:29.555429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:47.902420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'651","reported_seq":2230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547568+0000","last_change":"2024-04-16T17:45:49.468732+0000","last_active":"2024-04-16T19:33:49.547568+0000","last_peered":"2024-04-16T19:33:49.547568+0000","last_clean":"2024-04-16T19:33:49.547568+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:33:49.547568+0000","last_undegraded":"2024-04-16T19:33:49.547568+0000","last_fullsized":"2024-04-16T19:33:49.547568+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:02.894263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'344","reported_seq":642,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364192+0000","last_change":"2024-04-16T17:45:47.460745+0000","last_active":"2024-04-16T19:33:49.364192+0000","last_peered":"2024-04-16T19:33:49.364192+0000","last_clean":"2024-04-16T19:33:49.364192+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:33:49.364192+0000","last_undegraded":"2024-04-16T19:33:49.364192+0000","last_fullsized":"2024-04-16T19:33:49.364192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.165117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'13","reported_seq":452,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368729+0000","last_change":"2024-04-16T17:45:45.462237+0000","last_active":"2024-04-16T19:34:09.368729+0000","last_peered":"2024-04-16T19:34:09.368729+0000","last_clean":"2024-04-16T19:34:09.368729+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:34:09.368729+0000","last_undegraded":"2024-04-16T19:34:09.368729+0000","last_fullsized":"2024-04-16T19:34:09.368729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:24.020867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568580+0000","last_change":"2024-04-16T17:45:10.399758+0000","last_active":"2024-04-16T19:35:39.568580+0000","last_peered":"2024-04-16T19:35:39.568580+0000","last_clean":"2024-04-16T19:35:39.568580+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:35:39.568580+0000","last_undegraded":"2024-04-16T19:35:39.568580+0000","last_fullsized":"2024-04-16T19:35:39.568580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:50.581378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385247+0000","last_change":"2024-04-16T17:45:08.386614+0000","last_active":"2024-04-16T19:35:54.385247+0000","last_peered":"2024-04-16T19:35:54.385247+0000","last_clean":"2024-04-16T19:35:54.385247+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:35:54.385247+0000","last_undegraded":"2024-04-16T19:35:54.385247+0000","last_fullsized":"2024-04-16T19:35:54.385247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:51.477510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559198+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T19:34:49.559198+0000","last_peered":"2024-04-16T19:34:49.559198+0000","last_clean":"2024-04-16T19:34:49.559198+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:34:49.559198+0000","last_undegraded":"2024-04-16T19:34:49.559198+0000","last_fullsized":"2024-04-16T19:34:49.559198+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386464+0000","last_change":"2024-04-16T17:45:20.414740+0000","last_active":"2024-04-16T19:35:49.386464+0000","last_peered":"2024-04-16T19:35:49.386464+0000","last_clean":"2024-04-16T19:35:49.386464+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:35:49.386464+0000","last_undegraded":"2024-04-16T19:35:49.386464+0000","last_fullsized":"2024-04-16T19:35:49.386464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:35.855849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'160","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385606+0000","last_change":"2024-04-16T17:45:22.416454+0000","last_active":"2024-04-16T19:35:44.385606+0000","last_peered":"2024-04-16T19:35:44.385606+0000","last_clean":"2024-04-16T19:35:44.385606+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:35:44.385606+0000","last_undegraded":"2024-04-16T19:35:44.385606+0000","last_fullsized":"2024-04-16T19:35:44.385606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:29.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383620+0000","last_change":"2024-04-16T17:45:24.425127+0000","last_active":"2024-04-16T19:35:49.383620+0000","last_peered":"2024-04-16T19:35:49.383620+0000","last_clean":"2024-04-16T19:35:49.383620+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:35:49.383620+0000","last_undegraded":"2024-04-16T19:35:49.383620+0000","last_fullsized":"2024-04-16T19:35:49.383620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:12.945022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385788+0000","last_change":"2024-04-16T17:45:26.849850+0000","last_active":"2024-04-16T19:35:44.385788+0000","last_peered":"2024-04-16T19:35:44.385788+0000","last_clean":"2024-04-16T19:35:44.385788+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:35:44.385788+0000","last_undegraded":"2024-04-16T19:35:44.385788+0000","last_fullsized":"2024-04-16T19:35:44.385788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:07.528720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569526+0000","last_change":"2024-04-16T18:09:02.175274+0000","last_active":"2024-04-16T19:35:44.569526+0000","last_peered":"2024-04-16T19:35:44.569526+0000","last_clean":"2024-04-16T19:35:44.569526+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:35:44.569526+0000","last_undegraded":"2024-04-16T19:35:44.569526+0000","last_fullsized":"2024-04-16T19:35:44.569526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:34:45.630832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1689,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374645+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:34:49.374645+0000","last_peered":"2024-04-16T19:34:49.374645+0000","last_clean":"2024-04-16T19:34:49.374645+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:34:49.374645+0000","last_undegraded":"2024-04-16T19:34:49.374645+0000","last_fullsized":"2024-04-16T19:34:49.374645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:00:32.605132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560062+0000","last_change":"2024-04-16T17:46:17.509389+0000","last_active":"2024-04-16T19:34:54.560062+0000","last_peered":"2024-04-16T19:34:54.560062+0000","last_clean":"2024-04-16T19:34:54.560062+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:34:54.560062+0000","last_undegraded":"2024-04-16T19:34:54.560062+0000","last_fullsized":"2024-04-16T19:34:54.560062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:55.368624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"48'7","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367239+0000","last_change":"2024-04-16T17:45:51.478774+0000","last_active":"2024-04-16T19:33:54.367239+0000","last_peered":"2024-04-16T19:33:54.367239+0000","last_clean":"2024-04-16T19:33:54.367239+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:33:54.367239+0000","last_undegraded":"2024-04-16T19:33:54.367239+0000","last_fullsized":"2024-04-16T19:33:54.367239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:20:52.903342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547518+0000","last_change":"2024-04-16T17:45:49.472675+0000","last_active":"2024-04-16T19:33:49.547518+0000","last_peered":"2024-04-16T19:33:49.547518+0000","last_clean":"2024-04-16T19:33:49.547518+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:33:49.547518+0000","last_undegraded":"2024-04-16T19:33:49.547518+0000","last_fullsized":"2024-04-16T19:33:49.547518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:41.374233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'500","reported_seq":832,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364226+0000","last_change":"2024-04-16T17:45:47.461629+0000","last_active":"2024-04-16T19:33:49.364226+0000","last_peered":"2024-04-16T19:33:49.364226+0000","last_clean":"2024-04-16T19:33:49.364226+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:33:49.364226+0000","last_undegraded":"2024-04-16T19:33:49.364226+0000","last_fullsized":"2024-04-16T19:33:49.364226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:08.910809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'23","reported_seq":293,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:45:45.457257+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384823+0000","last_change":"2024-04-16T17:45:10.392387+0000","last_active":"2024-04-16T19:35:39.384823+0000","last_peered":"2024-04-16T19:35:39.384823+0000","last_clean":"2024-04-16T19:35:39.384823+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:35:39.384823+0000","last_undegraded":"2024-04-16T19:35:39.384823+0000","last_fullsized":"2024-04-16T19:35:39.384823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:56.222153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567683+0000","last_change":"2024-04-16T17:45:08.383729+0000","last_active":"2024-04-16T19:35:34.567683+0000","last_peered":"2024-04-16T19:35:34.567683+0000","last_clean":"2024-04-16T19:35:34.567683+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:35:34.567683+0000","last_undegraded":"2024-04-16T19:35:34.567683+0000","last_fullsized":"2024-04-16T19:35:34.567683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:37.824496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378047+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T19:35:09.378047+0000","last_peered":"2024-04-16T19:35:09.378047+0000","last_clean":"2024-04-16T19:35:09.378047+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:35:09.378047+0000","last_undegraded":"2024-04-16T19:35:09.378047+0000","last_fullsized":"2024-04-16T19:35:09.378047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:22.591585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384362+0000","last_change":"2024-04-16T17:45:20.408473+0000","last_active":"2024-04-16T19:35:49.384362+0000","last_peered":"2024-04-16T19:35:49.384362+0000","last_clean":"2024-04-16T19:35:49.384362+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:35:49.384362+0000","last_undegraded":"2024-04-16T19:35:49.384362+0000","last_fullsized":"2024-04-16T19:35:49.384362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:08.929780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'168","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570487+0000","last_change":"2024-04-16T17:45:22.422298+0000","last_active":"2024-04-16T19:35:49.570487+0000","last_peered":"2024-04-16T19:35:49.570487+0000","last_clean":"2024-04-16T19:35:49.570487+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:35:49.570487+0000","last_undegraded":"2024-04-16T19:35:49.570487+0000","last_fullsized":"2024-04-16T19:35:49.570487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:52.088400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'12","reported_seq":1397,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383571+0000","last_change":"2024-04-16T17:45:24.421136+0000","last_active":"2024-04-16T19:35:44.383571+0000","last_peered":"2024-04-16T19:35:44.383571+0000","last_clean":"2024-04-16T19:35:44.383571+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:35:44.383571+0000","last_undegraded":"2024-04-16T19:35:44.383571+0000","last_fullsized":"2024-04-16T19:35:44.383571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:58:19.841313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366688+0000","last_change":"2024-04-16T17:45:26.848234+0000","last_active":"2024-04-16T19:33:49.366688+0000","last_peered":"2024-04-16T19:33:49.366688+0000","last_clean":"2024-04-16T19:33:49.366688+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:33:49.366688+0000","last_undegraded":"2024-04-16T19:33:49.366688+0000","last_fullsized":"2024-04-16T19:33:49.366688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:01.269112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556474+0000","last_change":"2024-04-16T18:09:02.167725+0000","last_active":"2024-04-16T19:34:34.556474+0000","last_peered":"2024-04-16T19:34:34.556474+0000","last_clean":"2024-04-16T19:34:34.556474+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:34:34.556474+0000","last_undegraded":"2024-04-16T19:34:34.556474+0000","last_fullsized":"2024-04-16T19:34:34.556474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:58.398812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1836,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377912+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:35:09.377912+0000","last_peered":"2024-04-16T19:35:09.377912+0000","last_clean":"2024-04-16T19:35:09.377912+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:35:09.377912+0000","last_undegraded":"2024-04-16T19:35:09.377912+0000","last_fullsized":"2024-04-16T19:35:09.377912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:53:10.911757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373250+0000","last_change":"2024-04-16T17:46:17.508698+0000","last_active":"2024-04-16T19:34:39.373250+0000","last_peered":"2024-04-16T19:34:39.373250+0000","last_clean":"2024-04-16T19:34:39.373250+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:34:39.373250+0000","last_undegraded":"2024-04-16T19:34:39.373250+0000","last_fullsized":"2024-04-16T19:34:39.373250+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:43.428844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'1","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552153+0000","last_change":"2024-04-16T17:45:51.481009+0000","last_active":"2024-04-16T19:34:14.552153+0000","last_peered":"2024-04-16T19:34:14.552153+0000","last_clean":"2024-04-16T19:34:14.552153+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:34:14.552153+0000","last_undegraded":"2024-04-16T19:34:14.552153+0000","last_fullsized":"2024-04-16T19:34:14.552153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:41:38.373017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368296+0000","last_change":"2024-04-16T17:45:49.472070+0000","last_active":"2024-04-16T19:34:09.368296+0000","last_peered":"2024-04-16T19:34:09.368296+0000","last_clean":"2024-04-16T19:34:09.368296+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:34:09.368296+0000","last_undegraded":"2024-04-16T19:34:09.368296+0000","last_fullsized":"2024-04-16T19:34:09.368296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:41.089795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'322","reported_seq":583,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364288+0000","last_change":"2024-04-16T17:45:47.464210+0000","last_active":"2024-04-16T19:33:49.364288+0000","last_peered":"2024-04-16T19:33:49.364288+0000","last_clean":"2024-04-16T19:33:49.364288+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:33:49.364288+0000","last_undegraded":"2024-04-16T19:33:49.364288+0000","last_fullsized":"2024-04-16T19:33:49.364288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:19.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'20","reported_seq":575,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364941+0000","last_change":"2024-04-16T17:45:45.465938+0000","last_active":"2024-04-16T19:33:49.364941+0000","last_peered":"2024-04-16T19:33:49.364941+0000","last_clean":"2024-04-16T19:33:49.364941+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:33:49.364941+0000","last_undegraded":"2024-04-16T19:33:49.364941+0000","last_fullsized":"2024-04-16T19:33:49.364941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:40.527095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.383949+0000","last_change":"2024-04-16T17:45:10.400196+0000","last_active":"2024-04-16T19:35:34.383949+0000","last_peered":"2024-04-16T19:35:34.383949+0000","last_clean":"2024-04-16T19:35:34.383949+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:35:34.383949+0000","last_undegraded":"2024-04-16T19:35:34.383949+0000","last_fullsized":"2024-04-16T19:35:34.383949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:25.987507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568727+0000","last_change":"2024-04-16T17:45:08.382982+0000","last_active":"2024-04-16T19:35:39.568727+0000","last_peered":"2024-04-16T19:35:39.568727+0000","last_clean":"2024-04-16T19:35:39.568727+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:35:39.568727+0000","last_undegraded":"2024-04-16T19:35:39.568727+0000","last_fullsized":"2024-04-16T19:35:39.568727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:20.573792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560153+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T19:34:54.560153+0000","last_peered":"2024-04-16T19:34:54.560153+0000","last_clean":"2024-04-16T19:34:54.560153+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:34:54.560153+0000","last_undegraded":"2024-04-16T19:34:54.560153+0000","last_fullsized":"2024-04-16T19:34:54.560153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"48'3","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384408+0000","last_change":"2024-04-16T17:45:20.407710+0000","last_active":"2024-04-16T19:35:49.384408+0000","last_peered":"2024-04-16T19:35:49.384408+0000","last_clean":"2024-04-16T19:35:49.384408+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:35:49.384408+0000","last_undegraded":"2024-04-16T19:35:49.384408+0000","last_fullsized":"2024-04-16T19:35:49.384408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:05:22.200949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'120","reported_seq":300,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384447+0000","last_change":"2024-04-16T17:45:22.416114+0000","last_active":"2024-04-16T19:35:49.384447+0000","last_peered":"2024-04-16T19:35:49.384447+0000","last_clean":"2024-04-16T19:35:49.384447+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:35:49.384447+0000","last_undegraded":"2024-04-16T19:35:49.384447+0000","last_fullsized":"2024-04-16T19:35:49.384447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:41.992526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'12","reported_seq":1395,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386482+0000","last_change":"2024-04-16T17:45:24.423991+0000","last_active":"2024-04-16T19:35:49.386482+0000","last_peered":"2024-04-16T19:35:49.386482+0000","last_clean":"2024-04-16T19:35:49.386482+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:35:49.386482+0000","last_undegraded":"2024-04-16T19:35:49.386482+0000","last_fullsized":"2024-04-16T19:35:49.386482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:27.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385733+0000","last_change":"2024-04-16T17:45:26.847697+0000","last_active":"2024-04-16T19:35:44.385733+0000","last_peered":"2024-04-16T19:35:44.385733+0000","last_clean":"2024-04-16T19:35:44.385733+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:35:44.385733+0000","last_undegraded":"2024-04-16T19:35:44.385733+0000","last_fullsized":"2024-04-16T19:35:44.385733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:01.653239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547405+0000","last_change":"2024-04-16T18:09:02.166269+0000","last_active":"2024-04-16T19:33:49.547405+0000","last_peered":"2024-04-16T19:33:49.547405+0000","last_clean":"2024-04-16T19:33:49.547405+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:33:49.547405+0000","last_undegraded":"2024-04-16T19:33:49.547405+0000","last_fullsized":"2024-04-16T19:33:49.547405+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:39.706202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2088,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373365+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:34:29.373365+0000","last_peered":"2024-04-16T19:34:29.373365+0000","last_clean":"2024-04-16T19:34:29.373365+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:34:29.373365+0000","last_undegraded":"2024-04-16T19:34:29.373365+0000","last_fullsized":"2024-04-16T19:34:29.373365+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:13:09.115332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557253+0000","last_change":"2024-04-16T17:46:17.513695+0000","last_active":"2024-04-16T19:34:39.557253+0000","last_peered":"2024-04-16T19:34:39.557253+0000","last_clean":"2024-04-16T19:34:39.557253+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:34:39.557253+0000","last_undegraded":"2024-04-16T19:34:39.557253+0000","last_fullsized":"2024-04-16T19:34:39.557253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:36.596198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'6","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552231+0000","last_change":"2024-04-16T17:45:51.483674+0000","last_active":"2024-04-16T19:34:14.552231+0000","last_peered":"2024-04-16T19:34:14.552231+0000","last_clean":"2024-04-16T19:34:14.552231+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:34:14.552231+0000","last_undegraded":"2024-04-16T19:34:14.552231+0000","last_fullsized":"2024-04-16T19:34:14.552231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:44.630489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'651","reported_seq":2202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364275+0000","last_change":"2024-04-16T17:45:49.466697+0000","last_active":"2024-04-16T19:33:49.364275+0000","last_peered":"2024-04-16T19:33:49.364275+0000","last_clean":"2024-04-16T19:33:49.364275+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:33:49.364275+0000","last_undegraded":"2024-04-16T19:33:49.364275+0000","last_fullsized":"2024-04-16T19:33:49.364275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:59.328751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5527","reported_seq":10317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368349+0000","last_change":"2024-04-16T17:45:47.459919+0000","last_active":"2024-04-16T19:34:09.368349+0000","last_peered":"2024-04-16T19:34:09.368349+0000","last_clean":"2024-04-16T19:34:09.368349+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:34:09.368349+0000","last_undegraded":"2024-04-16T19:34:09.368349+0000","last_fullsized":"2024-04-16T19:34:09.368349+0000","mapping_epoch":33,"log_start":"53'3700","ondisk_log_start":"53'3700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":3000,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:18.684283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'12","reported_seq":686,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547542+0000","last_change":"2024-04-16T17:45:45.456575+0000","last_active":"2024-04-16T19:33:49.547542+0000","last_peered":"2024-04-16T19:33:49.547542+0000","last_clean":"2024-04-16T19:33:49.547542+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:33:49.547542+0000","last_undegraded":"2024-04-16T19:33:49.547542+0000","last_fullsized":"2024-04-16T19:33:49.547542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:52.179755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382207+0000","last_change":"2024-04-16T17:45:10.399687+0000","last_active":"2024-04-16T19:35:39.382207+0000","last_peered":"2024-04-16T19:35:39.382207+0000","last_clean":"2024-04-16T19:35:39.382207+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:35:39.382207+0000","last_undegraded":"2024-04-16T19:35:39.382207+0000","last_fullsized":"2024-04-16T19:35:39.382207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:09.857567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384942+0000","last_change":"2024-04-16T17:45:08.381368+0000","last_active":"2024-04-16T19:35:39.384942+0000","last_peered":"2024-04-16T19:35:39.384942+0000","last_clean":"2024-04-16T19:35:39.384942+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:35:39.384942+0000","last_undegraded":"2024-04-16T19:35:39.384942+0000","last_fullsized":"2024-04-16T19:35:39.384942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:56.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375597+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:34:54.375597+0000","last_peered":"2024-04-16T19:34:54.375597+0000","last_clean":"2024-04-16T19:34:54.375597+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:34:54.375597+0000","last_undegraded":"2024-04-16T19:34:54.375597+0000","last_fullsized":"2024-04-16T19:34:54.375597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:37.225695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'1","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568508+0000","last_change":"2024-04-16T17:45:20.403582+0000","last_active":"2024-04-16T19:35:39.568508+0000","last_peered":"2024-04-16T19:35:39.568508+0000","last_clean":"2024-04-16T19:35:39.568508+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:35:39.568508+0000","last_undegraded":"2024-04-16T19:35:39.568508+0000","last_fullsized":"2024-04-16T19:35:39.568508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:24.706560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'144","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383684+0000","last_change":"2024-04-16T17:45:22.414745+0000","last_active":"2024-04-16T19:35:49.383684+0000","last_peered":"2024-04-16T19:35:49.383684+0000","last_clean":"2024-04-16T19:35:49.383684+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:35:49.383684+0000","last_undegraded":"2024-04-16T19:35:49.383684+0000","last_fullsized":"2024-04-16T19:35:49.383684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:39.722446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570534+0000","last_change":"2024-04-16T17:45:24.425364+0000","last_active":"2024-04-16T19:35:49.570534+0000","last_peered":"2024-04-16T19:35:49.570534+0000","last_clean":"2024-04-16T19:35:49.570534+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:35:49.570534+0000","last_undegraded":"2024-04-16T19:35:49.570534+0000","last_fullsized":"2024-04-16T19:35:49.570534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:30.330417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383746+0000","last_change":"2024-04-16T17:45:26.438987+0000","last_active":"2024-04-16T19:35:44.383746+0000","last_peered":"2024-04-16T19:35:44.383746+0000","last_clean":"2024-04-16T19:35:44.383746+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:35:44.383746+0000","last_undegraded":"2024-04-16T19:35:44.383746+0000","last_fullsized":"2024-04-16T19:35:44.383746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:46.197032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.364975+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:33:39.364975+0000","last_peered":"2024-04-16T19:33:39.364975+0000","last_clean":"2024-04-16T19:33:39.364975+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:33:39.364975+0000","last_undegraded":"2024-04-16T19:33:39.364975+0000","last_fullsized":"2024-04-16T19:33:39.364975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:53.017679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'101","reported_seq":1735,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381973+0000","last_change":"2024-04-16T17:46:25.527509+0000","last_active":"2024-04-16T19:35:34.381973+0000","last_peered":"2024-04-16T19:35:34.381973+0000","last_clean":"2024-04-16T19:35:34.381973+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:35:34.381973+0000","last_undegraded":"2024-04-16T19:35:34.381973+0000","last_fullsized":"2024-04-16T19:35:34.381973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:21:20.635118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547428+0000","last_change":"2024-04-16T17:46:17.509709+0000","last_active":"2024-04-16T19:33:49.547428+0000","last_peered":"2024-04-16T19:33:49.547428+0000","last_clean":"2024-04-16T19:33:49.547428+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:33:49.547428+0000","last_undegraded":"2024-04-16T19:33:49.547428+0000","last_fullsized":"2024-04-16T19:33:49.547428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:47.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'19","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359896+0000","last_change":"2024-04-16T17:45:51.477907+0000","last_active":"2024-04-16T19:33:24.359896+0000","last_peered":"2024-04-16T19:33:24.359896+0000","last_clean":"2024-04-16T19:33:24.359896+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:33:24.359896+0000","last_undegraded":"2024-04-16T19:33:24.359896+0000","last_fullsized":"2024-04-16T19:33:24.359896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:36.428648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359952+0000","last_change":"2024-04-16T17:45:49.470293+0000","last_active":"2024-04-16T19:33:19.359952+0000","last_peered":"2024-04-16T19:33:19.359952+0000","last_clean":"2024-04-16T19:33:19.359952+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:33:19.359952+0000","last_undegraded":"2024-04-16T19:33:19.359952+0000","last_fullsized":"2024-04-16T19:33:19.359952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:00.700374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'320","reported_seq":621,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359234+0000","last_change":"2024-04-16T17:45:47.462032+0000","last_active":"2024-04-16T19:33:19.359234+0000","last_peered":"2024-04-16T19:33:19.359234+0000","last_clean":"2024-04-16T19:33:19.359234+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:33:19.359234+0000","last_undegraded":"2024-04-16T19:33:19.359234+0000","last_fullsized":"2024-04-16T19:33:19.359234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:07:03.652770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'7","reported_seq":610,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370042+0000","last_change":"2024-04-16T17:45:45.462463+0000","last_active":"2024-04-16T19:34:09.370042+0000","last_peered":"2024-04-16T19:34:09.370042+0000","last_clean":"2024-04-16T19:34:09.370042+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:34:09.370042+0000","last_undegraded":"2024-04-16T19:34:09.370042+0000","last_fullsized":"2024-04-16T19:34:09.370042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:29.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387507+0000","last_change":"2024-04-16T17:45:26.438380+0000","last_active":"2024-04-16T19:35:54.387507+0000","last_peered":"2024-04-16T19:35:54.387507+0000","last_clean":"2024-04-16T19:35:54.387507+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:35:54.387507+0000","last_undegraded":"2024-04-16T19:35:54.387507+0000","last_fullsized":"2024-04-16T19:35:54.387507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:39.860458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374918+0000","last_change":"2024-04-16T17:45:10.393485+0000","last_active":"2024-04-16T19:34:54.374918+0000","last_peered":"2024-04-16T19:34:54.374918+0000","last_clean":"2024-04-16T19:34:54.374918+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:34:54.374918+0000","last_undegraded":"2024-04-16T19:34:54.374918+0000","last_fullsized":"2024-04-16T19:34:54.374918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:39.589700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378001+0000","last_change":"2024-04-16T17:45:08.386299+0000","last_active":"2024-04-16T19:35:09.378001+0000","last_peered":"2024-04-16T19:35:09.378001+0000","last_clean":"2024-04-16T19:35:09.378001+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:35:09.378001+0000","last_undegraded":"2024-04-16T19:35:09.378001+0000","last_fullsized":"2024-04-16T19:35:09.378001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:20:58.450960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"30'1","reported_seq":209,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561968+0000","last_change":"2024-04-16T17:45:20.412485+0000","last_active":"2024-04-16T19:35:04.561968+0000","last_peered":"2024-04-16T19:35:04.561968+0000","last_clean":"2024-04-16T19:35:04.561968+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:35:04.561968+0000","last_undegraded":"2024-04-16T19:35:04.561968+0000","last_fullsized":"2024-04-16T19:35:04.561968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:51.721722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'104","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561932+0000","last_change":"2024-04-16T17:45:22.416196+0000","last_active":"2024-04-16T19:35:04.561932+0000","last_peered":"2024-04-16T19:35:04.561932+0000","last_clean":"2024-04-16T19:35:04.561932+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:35:04.561932+0000","last_undegraded":"2024-04-16T19:35:04.561932+0000","last_fullsized":"2024-04-16T19:35:04.561932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:07.744516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561881+0000","last_change":"2024-04-16T17:45:24.424718+0000","last_active":"2024-04-16T19:35:04.561881+0000","last_peered":"2024-04-16T19:35:04.561881+0000","last_clean":"2024-04-16T19:35:04.561881+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:35:04.561881+0000","last_undegraded":"2024-04-16T19:35:04.561881+0000","last_fullsized":"2024-04-16T19:35:04.561881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:19.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365069+0000","last_change":"2024-04-16T18:09:02.165652+0000","last_active":"2024-04-16T19:33:54.365069+0000","last_peered":"2024-04-16T19:33:54.365069+0000","last_clean":"2024-04-16T19:33:54.365069+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:33:54.365069+0000","last_undegraded":"2024-04-16T19:33:54.365069+0000","last_fullsized":"2024-04-16T19:33:54.365069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:43:38.642286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'147","reported_seq":1630,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563777+0000","last_change":"2024-04-16T17:46:25.533095+0000","last_active":"2024-04-16T19:35:14.563777+0000","last_peered":"2024-04-16T19:35:14.563777+0000","last_clean":"2024-04-16T19:35:14.563777+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:35:14.563777+0000","last_undegraded":"2024-04-16T19:35:14.563777+0000","last_fullsized":"2024-04-16T19:35:14.563777+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:43.474084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364167+0000","last_change":"2024-04-16T17:46:17.509499+0000","last_active":"2024-04-16T19:33:49.364167+0000","last_peered":"2024-04-16T19:33:49.364167+0000","last_clean":"2024-04-16T19:33:49.364167+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:33:49.364167+0000","last_undegraded":"2024-04-16T19:33:49.364167+0000","last_fullsized":"2024-04-16T19:33:49.364167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:29.073777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'12","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359843+0000","last_change":"2024-04-16T17:47:16.567012+0000","last_active":"2024-04-16T19:33:24.359843+0000","last_peered":"2024-04-16T19:33:24.359843+0000","last_clean":"2024-04-16T19:33:24.359843+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:33:24.359843+0000","last_undegraded":"2024-04-16T19:33:24.359843+0000","last_fullsized":"2024-04-16T19:33:24.359843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:10.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360192+0000","last_change":"2024-04-16T17:45:49.471808+0000","last_active":"2024-04-16T19:33:19.360192+0000","last_peered":"2024-04-16T19:33:19.360192+0000","last_clean":"2024-04-16T19:33:19.360192+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:33:19.360192+0000","last_undegraded":"2024-04-16T19:33:19.360192+0000","last_fullsized":"2024-04-16T19:33:19.360192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:34.249301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'442","reported_seq":2030,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359929+0000","last_change":"2024-04-16T17:45:47.465673+0000","last_active":"2024-04-16T19:33:19.359929+0000","last_peered":"2024-04-16T19:33:19.359929+0000","last_clean":"2024-04-16T19:33:19.359929+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:33:19.359929+0000","last_undegraded":"2024-04-16T19:33:19.359929+0000","last_fullsized":"2024-04-16T19:33:19.359929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:53.982530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'17","reported_seq":461,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551476+0000","last_change":"2024-04-16T17:45:45.465670+0000","last_active":"2024-04-16T19:34:09.551476+0000","last_peered":"2024-04-16T19:34:09.551476+0000","last_clean":"2024-04-16T19:34:09.551476+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:34:09.551476+0000","last_undegraded":"2024-04-16T19:34:09.551476+0000","last_fullsized":"2024-04-16T19:34:09.551476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:14.079978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569743+0000","last_change":"2024-04-16T17:45:26.432878+0000","last_active":"2024-04-16T19:35:44.569743+0000","last_peered":"2024-04-16T19:35:44.569743+0000","last_clean":"2024-04-16T19:35:44.569743+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:35:44.569743+0000","last_undegraded":"2024-04-16T19:35:44.569743+0000","last_fullsized":"2024-04-16T19:35:44.569743+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:57.379632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560037+0000","last_change":"2024-04-16T17:45:10.394503+0000","last_active":"2024-04-16T19:34:54.560037+0000","last_peered":"2024-04-16T19:34:54.560037+0000","last_clean":"2024-04-16T19:34:54.560037+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:34:54.560037+0000","last_undegraded":"2024-04-16T19:34:54.560037+0000","last_fullsized":"2024-04-16T19:34:54.560037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:31.534272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365715+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:33:54.365715+0000","last_peered":"2024-04-16T19:33:54.365715+0000","last_clean":"2024-04-16T19:33:54.365715+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:33:54.365715+0000","last_undegraded":"2024-04-16T19:33:54.365715+0000","last_fullsized":"2024-04-16T19:33:54.365715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:45.243544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.562014+0000","last_change":"2024-04-16T17:45:20.407788+0000","last_active":"2024-04-16T19:35:04.562014+0000","last_peered":"2024-04-16T19:35:04.562014+0000","last_clean":"2024-04-16T19:35:04.562014+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:35:04.562014+0000","last_undegraded":"2024-04-16T19:35:04.562014+0000","last_fullsized":"2024-04-16T19:35:04.562014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:26.315175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'50","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378804+0000","last_change":"2024-04-16T17:45:22.421476+0000","last_active":"2024-04-16T19:35:04.378804+0000","last_peered":"2024-04-16T19:35:04.378804+0000","last_clean":"2024-04-16T19:35:04.378804+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:35:04.378804+0000","last_undegraded":"2024-04-16T19:35:04.378804+0000","last_fullsized":"2024-04-16T19:35:04.378804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:38.752189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376965+0000","last_change":"2024-04-16T17:45:24.430870+0000","last_active":"2024-04-16T19:35:04.376965+0000","last_peered":"2024-04-16T19:35:04.376965+0000","last_clean":"2024-04-16T19:35:04.376965+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:35:04.376965+0000","last_undegraded":"2024-04-16T19:35:04.376965+0000","last_fullsized":"2024-04-16T19:35:04.376965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:19.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367440+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:34:04.367440+0000","last_peered":"2024-04-16T19:34:04.367440+0000","last_clean":"2024-04-16T19:34:04.367440+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:34:04.367440+0000","last_undegraded":"2024-04-16T19:34:04.367440+0000","last_fullsized":"2024-04-16T19:34:04.367440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:38.119812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'109","reported_seq":1796,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549363+0000","last_change":"2024-04-16T17:46:25.527453+0000","last_active":"2024-04-16T19:33:59.549363+0000","last_peered":"2024-04-16T19:33:59.549363+0000","last_clean":"2024-04-16T19:33:59.549363+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:33:59.549363+0000","last_undegraded":"2024-04-16T19:33:59.549363+0000","last_fullsized":"2024-04-16T19:33:59.549363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:48:39.537015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376799+0000","last_change":"2024-04-16T17:46:17.506081+0000","last_active":"2024-04-16T19:35:04.376799+0000","last_peered":"2024-04-16T19:35:04.376799+0000","last_clean":"2024-04-16T19:35:04.376799+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:35:04.376799+0000","last_undegraded":"2024-04-16T19:35:04.376799+0000","last_fullsized":"2024-04-16T19:35:04.376799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:44:37.801667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'14","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:59.377912+0000","last_change":"2024-04-16T17:45:51.484484+0000","last_active":"2024-04-16T19:34:59.377912+0000","last_peered":"2024-04-16T19:34:59.377912+0000","last_clean":"2024-04-16T19:34:59.377912+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:34:59.377912+0000","last_undegraded":"2024-04-16T19:34:59.377912+0000","last_fullsized":"2024-04-16T19:34:59.377912+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:35.709508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368662+0000","last_change":"2024-04-16T17:45:49.473382+0000","last_active":"2024-04-16T19:34:09.368662+0000","last_peered":"2024-04-16T19:34:09.368662+0000","last_clean":"2024-04-16T19:34:09.368662+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:34:09.368662+0000","last_undegraded":"2024-04-16T19:34:09.368662+0000","last_fullsized":"2024-04-16T19:34:09.368662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:18.012352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'659","reported_seq":2170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368312+0000","last_change":"2024-04-16T17:45:47.461388+0000","last_active":"2024-04-16T19:34:09.368312+0000","last_peered":"2024-04-16T19:34:09.368312+0000","last_clean":"2024-04-16T19:34:09.368312+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:34:09.368312+0000","last_undegraded":"2024-04-16T19:34:09.368312+0000","last_fullsized":"2024-04-16T19:34:09.368312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:49.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'31","reported_seq":357,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361706+0000","last_change":"2024-04-16T17:45:45.467998+0000","last_active":"2024-04-16T19:33:19.361706+0000","last_peered":"2024-04-16T19:33:19.361706+0000","last_clean":"2024-04-16T19:33:19.361706+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:33:19.361706+0000","last_undegraded":"2024-04-16T19:33:19.361706+0000","last_fullsized":"2024-04-16T19:33:19.361706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383273+0000","last_change":"2024-04-16T17:45:26.427816+0000","last_active":"2024-04-16T19:35:29.383273+0000","last_peered":"2024-04-16T19:35:29.383273+0000","last_clean":"2024-04-16T19:35:29.383273+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:35:29.383273+0000","last_undegraded":"2024-04-16T19:35:29.383273+0000","last_fullsized":"2024-04-16T19:35:29.383273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:08.477244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560005+0000","last_change":"2024-04-16T17:45:10.395061+0000","last_active":"2024-04-16T19:34:54.560005+0000","last_peered":"2024-04-16T19:34:54.560005+0000","last_clean":"2024-04-16T19:34:54.560005+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:34:54.560005+0000","last_undegraded":"2024-04-16T19:34:54.560005+0000","last_fullsized":"2024-04-16T19:34:54.560005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:31.050543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365780+0000","last_change":"2024-04-16T17:45:08.389656+0000","last_active":"2024-04-16T19:33:54.365780+0000","last_peered":"2024-04-16T19:33:54.365780+0000","last_clean":"2024-04-16T19:33:54.365780+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:33:54.365780+0000","last_undegraded":"2024-04-16T19:33:54.365780+0000","last_fullsized":"2024-04-16T19:33:54.365780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:58.984483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376423+0000","last_change":"2024-04-16T17:45:20.407054+0000","last_active":"2024-04-16T19:35:04.376423+0000","last_peered":"2024-04-16T19:35:04.376423+0000","last_clean":"2024-04-16T19:35:04.376423+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:35:04.376423+0000","last_undegraded":"2024-04-16T19:35:04.376423+0000","last_fullsized":"2024-04-16T19:35:04.376423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:14.285286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'104","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.562025+0000","last_change":"2024-04-16T17:45:22.415814+0000","last_active":"2024-04-16T19:35:04.562025+0000","last_peered":"2024-04-16T19:35:04.562025+0000","last_clean":"2024-04-16T19:35:04.562025+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:35:04.562025+0000","last_undegraded":"2024-04-16T19:35:04.562025+0000","last_fullsized":"2024-04-16T19:35:04.562025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:36.063225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376882+0000","last_change":"2024-04-16T17:45:24.425524+0000","last_active":"2024-04-16T19:35:04.376882+0000","last_peered":"2024-04-16T19:35:04.376882+0000","last_clean":"2024-04-16T19:35:04.376882+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:35:04.376882+0000","last_undegraded":"2024-04-16T19:35:04.376882+0000","last_fullsized":"2024-04-16T19:35:04.376882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:17.147197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367227+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:34:04.367227+0000","last_peered":"2024-04-16T19:34:04.367227+0000","last_clean":"2024-04-16T19:34:04.367227+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:34:04.367227+0000","last_undegraded":"2024-04-16T19:34:04.367227+0000","last_fullsized":"2024-04-16T19:34:04.367227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2057,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368201+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:33:59.368201+0000","last_peered":"2024-04-16T19:33:59.368201+0000","last_clean":"2024-04-16T19:33:59.368201+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:33:59.368201+0000","last_undegraded":"2024-04-16T19:33:59.368201+0000","last_fullsized":"2024-04-16T19:33:59.368201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:18:49.538603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564906+0000","last_change":"2024-04-16T17:46:17.512965+0000","last_active":"2024-04-16T19:35:19.564906+0000","last_peered":"2024-04-16T19:35:19.564906+0000","last_clean":"2024-04-16T19:35:19.564906+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:35:19.564906+0000","last_undegraded":"2024-04-16T19:35:19.564906+0000","last_fullsized":"2024-04-16T19:35:19.564906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:46.834965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'12","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557237+0000","last_change":"2024-04-16T17:45:51.477961+0000","last_active":"2024-04-16T19:34:39.557237+0000","last_peered":"2024-04-16T19:34:39.557237+0000","last_clean":"2024-04-16T19:34:39.557237+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:34:39.557237+0000","last_undegraded":"2024-04-16T19:34:39.557237+0000","last_fullsized":"2024-04-16T19:34:39.557237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:47.996402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'651","reported_seq":2194,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551499+0000","last_change":"2024-04-16T17:45:49.469998+0000","last_active":"2024-04-16T19:34:09.551499+0000","last_peered":"2024-04-16T19:34:09.551499+0000","last_clean":"2024-04-16T19:34:09.551499+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:34:09.551499+0000","last_undegraded":"2024-04-16T19:34:09.551499+0000","last_fullsized":"2024-04-16T19:34:09.551499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:24.434279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'720","reported_seq":3524,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370031+0000","last_change":"2024-04-16T17:45:47.463990+0000","last_active":"2024-04-16T19:34:09.370031+0000","last_peered":"2024-04-16T19:34:09.370031+0000","last_clean":"2024-04-16T19:34:09.370031+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:34:09.370031+0000","last_undegraded":"2024-04-16T19:34:09.370031+0000","last_fullsized":"2024-04-16T19:34:09.370031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:34.349862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'9","reported_seq":282,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361724+0000","last_change":"2024-04-16T17:45:45.465394+0000","last_active":"2024-04-16T19:33:19.361724+0000","last_peered":"2024-04-16T19:33:19.361724+0000","last_clean":"2024-04-16T19:33:19.361724+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:33:19.361724+0000","last_undegraded":"2024-04-16T19:33:19.361724+0000","last_fullsized":"2024-04-16T19:33:19.361724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:27.529464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381373+0000","last_change":"2024-04-16T17:45:26.438413+0000","last_active":"2024-04-16T19:35:29.381373+0000","last_peered":"2024-04-16T19:35:29.381373+0000","last_clean":"2024-04-16T19:35:29.381373+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:35:29.381373+0000","last_undegraded":"2024-04-16T19:35:29.381373+0000","last_fullsized":"2024-04-16T19:35:29.381373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:29.732765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.559943+0000","last_change":"2024-04-16T17:45:10.402839+0000","last_active":"2024-04-16T19:34:54.559943+0000","last_peered":"2024-04-16T19:34:54.559943+0000","last_clean":"2024-04-16T19:34:54.559943+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:34:54.559943+0000","last_undegraded":"2024-04-16T19:34:54.559943+0000","last_fullsized":"2024-04-16T19:34:54.559943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:09.857567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367401+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:33:54.367401+0000","last_peered":"2024-04-16T19:33:54.367401+0000","last_clean":"2024-04-16T19:33:54.367401+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:33:54.367401+0000","last_undegraded":"2024-04-16T19:33:54.367401+0000","last_fullsized":"2024-04-16T19:33:54.367401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:34:33.739095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"48'4","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376995+0000","last_change":"2024-04-16T17:45:20.413469+0000","last_active":"2024-04-16T19:35:04.376995+0000","last_peered":"2024-04-16T19:35:04.376995+0000","last_clean":"2024-04-16T19:35:04.376995+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:35:04.376995+0000","last_undegraded":"2024-04-16T19:35:04.376995+0000","last_fullsized":"2024-04-16T19:35:04.376995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:49:00.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'80","reported_seq":239,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376922+0000","last_change":"2024-04-16T17:45:22.415761+0000","last_active":"2024-04-16T19:35:04.376922+0000","last_peered":"2024-04-16T19:35:04.376922+0000","last_clean":"2024-04-16T19:35:04.376922+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:35:04.376922+0000","last_undegraded":"2024-04-16T19:35:04.376922+0000","last_fullsized":"2024-04-16T19:35:04.376922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:17.485768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378903+0000","last_change":"2024-04-16T17:45:24.426374+0000","last_active":"2024-04-16T19:35:04.378903+0000","last_peered":"2024-04-16T19:35:04.378903+0000","last_clean":"2024-04-16T19:35:04.378903+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:35:04.378903+0000","last_undegraded":"2024-04-16T19:35:04.378903+0000","last_fullsized":"2024-04-16T19:35:04.378903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:48.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382870+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:35:39.382870+0000","last_peered":"2024-04-16T19:35:39.382870+0000","last_clean":"2024-04-16T19:35:39.382870+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:35:39.382870+0000","last_undegraded":"2024-04-16T19:35:39.382870+0000","last_fullsized":"2024-04-16T19:35:39.382870+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:01.886612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'112","reported_seq":1493,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378892+0000","last_change":"2024-04-16T17:46:25.525571+0000","last_active":"2024-04-16T19:35:14.378892+0000","last_peered":"2024-04-16T19:35:14.378892+0000","last_clean":"2024-04-16T19:35:14.378892+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:35:14.378892+0000","last_undegraded":"2024-04-16T19:35:14.378892+0000","last_fullsized":"2024-04-16T19:35:14.378892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:13:09.115332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378980+0000","last_change":"2024-04-16T17:46:17.504593+0000","last_active":"2024-04-16T19:35:04.378980+0000","last_peered":"2024-04-16T19:35:04.378980+0000","last_clean":"2024-04-16T19:35:04.378980+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:35:04.378980+0000","last_undegraded":"2024-04-16T19:35:04.378980+0000","last_fullsized":"2024-04-16T19:35:04.378980+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"51'2","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372544+0000","last_change":"2024-04-16T17:45:51.480201+0000","last_active":"2024-04-16T19:34:39.372544+0000","last_peered":"2024-04-16T19:34:39.372544+0000","last_clean":"2024-04-16T19:34:39.372544+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:34:39.372544+0000","last_undegraded":"2024-04-16T19:34:39.372544+0000","last_fullsized":"2024-04-16T19:34:39.372544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:45.935071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383071+0000","last_change":"2024-04-16T17:45:49.476432+0000","last_active":"2024-04-16T19:35:29.383071+0000","last_peered":"2024-04-16T19:35:29.383071+0000","last_clean":"2024-04-16T19:35:29.383071+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:35:29.383071+0000","last_undegraded":"2024-04-16T19:35:29.383071+0000","last_fullsized":"2024-04-16T19:35:29.383071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:38:03.985918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'369","reported_seq":693,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381232+0000","last_change":"2024-04-16T17:45:47.464967+0000","last_active":"2024-04-16T19:35:29.381232+0000","last_peered":"2024-04-16T19:35:29.381232+0000","last_clean":"2024-04-16T19:35:29.381232+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:35:29.381232+0000","last_undegraded":"2024-04-16T19:35:29.381232+0000","last_fullsized":"2024-04-16T19:35:29.381232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:39.367104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'16","reported_seq":322,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381287+0000","last_change":"2024-04-16T17:45:45.461625+0000","last_active":"2024-04-16T19:35:29.381287+0000","last_peered":"2024-04-16T19:35:29.381287+0000","last_clean":"2024-04-16T19:35:29.381287+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:35:29.381287+0000","last_undegraded":"2024-04-16T19:35:29.381287+0000","last_fullsized":"2024-04-16T19:35:29.381287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:34.843168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382983+0000","last_change":"2024-04-16T17:45:10.396745+0000","last_active":"2024-04-16T19:35:39.382983+0000","last_peered":"2024-04-16T19:35:39.382983+0000","last_clean":"2024-04-16T19:35:39.382983+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:35:39.382983+0000","last_undegraded":"2024-04-16T19:35:39.382983+0000","last_fullsized":"2024-04-16T19:35:39.382983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:40.062822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.548366+0000","last_change":"2024-04-16T17:45:08.384480+0000","last_active":"2024-04-16T19:33:54.548366+0000","last_peered":"2024-04-16T19:33:54.548366+0000","last_clean":"2024-04-16T19:33:54.548366+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:33:54.548366+0000","last_undegraded":"2024-04-16T19:33:54.548366+0000","last_fullsized":"2024-04-16T19:33:54.548366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:09.600364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385816+0000","last_change":"2024-04-16T17:45:20.414382+0000","last_active":"2024-04-16T19:35:44.385816+0000","last_peered":"2024-04-16T19:35:44.385816+0000","last_clean":"2024-04-16T19:35:44.385816+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:35:44.385816+0000","last_undegraded":"2024-04-16T19:35:44.385816+0000","last_fullsized":"2024-04-16T19:35:44.385816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:53:22.840598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'88","reported_seq":253,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565896+0000","last_change":"2024-04-16T17:45:22.421515+0000","last_active":"2024-04-16T19:35:24.565896+0000","last_peered":"2024-04-16T19:35:24.565896+0000","last_clean":"2024-04-16T19:35:24.565896+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:35:24.565896+0000","last_undegraded":"2024-04-16T19:35:24.565896+0000","last_fullsized":"2024-04-16T19:35:24.565896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:10.937613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380602+0000","last_change":"2024-04-16T17:45:24.425946+0000","last_active":"2024-04-16T19:35:24.380602+0000","last_peered":"2024-04-16T19:35:24.380602+0000","last_clean":"2024-04-16T19:35:24.380602+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:35:24.380602+0000","last_undegraded":"2024-04-16T19:35:24.380602+0000","last_fullsized":"2024-04-16T19:35:24.380602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.451179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562876+0000","last_change":"2024-04-16T17:45:26.849050+0000","last_active":"2024-04-16T19:35:09.562876+0000","last_peered":"2024-04-16T19:35:09.562876+0000","last_clean":"2024-04-16T19:35:09.562876+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:35:09.562876+0000","last_undegraded":"2024-04-16T19:35:09.562876+0000","last_fullsized":"2024-04-16T19:35:09.562876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:33:47.186912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363192+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:33:39.363192+0000","last_peered":"2024-04-16T19:33:39.363192+0000","last_clean":"2024-04-16T19:33:39.363192+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:33:39.363192+0000","last_undegraded":"2024-04-16T19:33:39.363192+0000","last_fullsized":"2024-04-16T19:33:39.363192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'112","reported_seq":1323,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367908+0000","last_change":"2024-04-16T17:46:25.530104+0000","last_active":"2024-04-16T19:34:09.367908+0000","last_peered":"2024-04-16T19:34:09.367908+0000","last_clean":"2024-04-16T19:34:09.367908+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:34:09.367908+0000","last_undegraded":"2024-04-16T19:34:09.367908+0000","last_fullsized":"2024-04-16T19:34:09.367908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:48:32.234084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.377062+0000","last_change":"2024-04-16T17:46:17.511681+0000","last_active":"2024-04-16T19:35:04.377062+0000","last_peered":"2024-04-16T19:35:04.377062+0000","last_clean":"2024-04-16T19:35:04.377062+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:35:04.377062+0000","last_undegraded":"2024-04-16T19:35:04.377062+0000","last_fullsized":"2024-04-16T19:35:04.377062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"48'9","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373396+0000","last_change":"2024-04-16T17:45:51.480247+0000","last_active":"2024-04-16T19:34:39.373396+0000","last_peered":"2024-04-16T19:34:39.373396+0000","last_clean":"2024-04-16T19:34:39.373396+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:34:39.373396+0000","last_undegraded":"2024-04-16T19:34:39.373396+0000","last_fullsized":"2024-04-16T19:34:39.373396+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:20.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566625+0000","last_change":"2024-04-16T17:45:49.469762+0000","last_active":"2024-04-16T19:35:29.566625+0000","last_peered":"2024-04-16T19:35:29.566625+0000","last_clean":"2024-04-16T19:35:29.566625+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:35:29.566625+0000","last_undegraded":"2024-04-16T19:35:29.566625+0000","last_fullsized":"2024-04-16T19:35:29.566625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:21.265143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'216","reported_seq":394,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380298+0000","last_change":"2024-04-16T17:45:47.460038+0000","last_active":"2024-04-16T19:35:29.380298+0000","last_peered":"2024-04-16T19:35:29.380298+0000","last_clean":"2024-04-16T19:35:29.380298+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:35:29.380298+0000","last_undegraded":"2024-04-16T19:35:29.380298+0000","last_fullsized":"2024-04-16T19:35:29.380298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:51:10.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'24","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372382+0000","last_change":"2024-04-16T17:47:16.558050+0000","last_active":"2024-04-16T19:34:39.372382+0000","last_peered":"2024-04-16T19:34:39.372382+0000","last_clean":"2024-04-16T19:34:39.372382+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:34:39.372382+0000","last_undegraded":"2024-04-16T19:34:39.372382+0000","last_fullsized":"2024-04-16T19:34:39.372382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:03.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384130+0000","last_change":"2024-04-16T17:45:10.400195+0000","last_active":"2024-04-16T19:35:34.384130+0000","last_peered":"2024-04-16T19:35:34.384130+0000","last_clean":"2024-04-16T19:35:34.384130+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:35:34.384130+0000","last_undegraded":"2024-04-16T19:35:34.384130+0000","last_fullsized":"2024-04-16T19:35:34.384130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:41.703977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551224+0000","last_change":"2024-04-16T17:45:08.388718+0000","last_active":"2024-04-16T19:34:09.551224+0000","last_peered":"2024-04-16T19:34:09.551224+0000","last_clean":"2024-04-16T19:34:09.551224+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:34:09.551224+0000","last_undegraded":"2024-04-16T19:34:09.551224+0000","last_fullsized":"2024-04-16T19:34:09.551224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'2","reported_seq":562,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384626+0000","last_change":"2024-04-16T17:45:20.407653+0000","last_active":"2024-04-16T19:35:49.384626+0000","last_peered":"2024-04-16T19:35:49.384626+0000","last_clean":"2024-04-16T19:35:49.384626+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:35:49.384626+0000","last_undegraded":"2024-04-16T19:35:49.384626+0000","last_fullsized":"2024-04-16T19:35:49.384626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:10.523626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'152","reported_seq":344,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380618+0000","last_change":"2024-04-16T17:45:22.417131+0000","last_active":"2024-04-16T19:35:24.380618+0000","last_peered":"2024-04-16T19:35:24.380618+0000","last_clean":"2024-04-16T19:35:24.380618+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:35:24.380618+0000","last_undegraded":"2024-04-16T19:35:24.380618+0000","last_fullsized":"2024-04-16T19:35:24.380618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:45.675762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565883+0000","last_change":"2024-04-16T17:45:24.427273+0000","last_active":"2024-04-16T19:35:24.565883+0000","last_peered":"2024-04-16T19:35:24.565883+0000","last_clean":"2024-04-16T19:35:24.565883+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:35:24.565883+0000","last_undegraded":"2024-04-16T19:35:24.565883+0000","last_fullsized":"2024-04-16T19:35:24.565883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:51.349426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377945+0000","last_change":"2024-04-16T17:45:26.849595+0000","last_active":"2024-04-16T19:35:09.377945+0000","last_peered":"2024-04-16T19:35:09.377945+0000","last_clean":"2024-04-16T19:35:09.377945+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:35:09.377945+0000","last_undegraded":"2024-04-16T19:35:09.377945+0000","last_fullsized":"2024-04-16T19:35:09.377945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:01.653239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.365153+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:33:39.365153+0000","last_peered":"2024-04-16T19:33:39.365153+0000","last_clean":"2024-04-16T19:33:39.365153+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:33:39.365153+0000","last_undegraded":"2024-04-16T19:33:39.365153+0000","last_fullsized":"2024-04-16T19:33:39.365153+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:01:36.294431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'110","reported_seq":1957,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.564046+0000","last_change":"2024-04-16T17:46:25.522673+0000","last_active":"2024-04-16T19:35:14.564046+0000","last_peered":"2024-04-16T19:35:14.564046+0000","last_clean":"2024-04-16T19:35:14.564046+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:35:14.564046+0000","last_undegraded":"2024-04-16T19:35:14.564046+0000","last_fullsized":"2024-04-16T19:35:14.564046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:49.571002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368287+0000","last_change":"2024-04-16T17:46:17.504674+0000","last_active":"2024-04-16T19:33:59.368287+0000","last_peered":"2024-04-16T19:33:59.368287+0000","last_clean":"2024-04-16T19:33:59.368287+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:33:59.368287+0000","last_undegraded":"2024-04-16T19:33:59.368287+0000","last_fullsized":"2024-04-16T19:33:59.368287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"48'3","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373369+0000","last_change":"2024-04-16T17:45:51.482374+0000","last_active":"2024-04-16T19:34:39.373369+0000","last_peered":"2024-04-16T19:34:39.373369+0000","last_clean":"2024-04-16T19:34:39.373369+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:34:39.373369+0000","last_undegraded":"2024-04-16T19:34:39.373369+0000","last_fullsized":"2024-04-16T19:34:39.373369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:35.709508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'20","reported_seq":1478,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381300+0000","last_change":"2024-04-16T17:45:49.473331+0000","last_active":"2024-04-16T19:35:29.381300+0000","last_peered":"2024-04-16T19:35:29.381300+0000","last_clean":"2024-04-16T19:35:29.381300+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:35:29.381300+0000","last_undegraded":"2024-04-16T19:35:29.381300+0000","last_fullsized":"2024-04-16T19:35:29.381300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:55.367803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'661","reported_seq":3301,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566715+0000","last_change":"2024-04-16T17:45:47.459310+0000","last_active":"2024-04-16T19:35:29.566715+0000","last_peered":"2024-04-16T19:35:29.566715+0000","last_clean":"2024-04-16T19:35:29.566715+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:35:29.566715+0000","last_undegraded":"2024-04-16T19:35:29.566715+0000","last_fullsized":"2024-04-16T19:35:29.566715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:41.921224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'6","reported_seq":503,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380329+0000","last_change":"2024-04-16T17:45:45.461393+0000","last_active":"2024-04-16T19:35:29.380329+0000","last_peered":"2024-04-16T19:35:29.380329+0000","last_clean":"2024-04-16T19:35:29.380329+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:35:29.380329+0000","last_undegraded":"2024-04-16T19:35:29.380329+0000","last_fullsized":"2024-04-16T19:35:29.380329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:06.206396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.380558+0000","last_change":"2024-04-16T17:45:10.393491+0000","last_active":"2024-04-16T19:35:14.380558+0000","last_peered":"2024-04-16T19:35:14.380558+0000","last_clean":"2024-04-16T19:35:14.380558+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:35:14.380558+0000","last_undegraded":"2024-04-16T19:35:14.380558+0000","last_fullsized":"2024-04-16T19:35:14.380558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:16.297430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377316+0000","last_change":"2024-04-16T17:45:08.380598+0000","last_active":"2024-04-16T19:35:09.377316+0000","last_peered":"2024-04-16T19:35:09.377316+0000","last_clean":"2024-04-16T19:35:09.377316+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:35:09.377316+0000","last_undegraded":"2024-04-16T19:35:09.377316+0000","last_fullsized":"2024-04-16T19:35:09.377316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:19.075286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"48'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379730+0000","last_change":"2024-04-16T17:45:20.412352+0000","last_active":"2024-04-16T19:35:24.379730+0000","last_peered":"2024-04-16T19:35:24.379730+0000","last_clean":"2024-04-16T19:35:24.379730+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:35:24.379730+0000","last_undegraded":"2024-04-16T19:35:24.379730+0000","last_fullsized":"2024-04-16T19:35:24.379730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:32.239001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'104","reported_seq":281,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570694+0000","last_change":"2024-04-16T17:45:22.417121+0000","last_active":"2024-04-16T19:35:49.570694+0000","last_peered":"2024-04-16T19:35:49.570694+0000","last_clean":"2024-04-16T19:35:49.570694+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:35:49.570694+0000","last_undegraded":"2024-04-16T19:35:49.570694+0000","last_fullsized":"2024-04-16T19:35:49.570694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:09.722112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568794+0000","last_change":"2024-04-16T17:45:24.425363+0000","last_active":"2024-04-16T19:35:39.568794+0000","last_peered":"2024-04-16T19:35:39.568794+0000","last_clean":"2024-04-16T19:35:39.568794+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:35:39.568794+0000","last_undegraded":"2024-04-16T19:35:39.568794+0000","last_fullsized":"2024-04-16T19:35:39.568794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:14.538868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377883+0000","last_change":"2024-04-16T17:45:26.438576+0000","last_active":"2024-04-16T19:35:09.377883+0000","last_peered":"2024-04-16T19:35:09.377883+0000","last_clean":"2024-04-16T19:35:09.377883+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:35:09.377883+0000","last_undegraded":"2024-04-16T19:35:09.377883+0000","last_fullsized":"2024-04-16T19:35:09.377883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:47.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.362625+0000","last_change":"2024-04-16T18:09:02.173368+0000","last_active":"2024-04-16T19:33:39.362625+0000","last_peered":"2024-04-16T19:33:39.362625+0000","last_clean":"2024-04-16T19:33:39.362625+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:33:39.362625+0000","last_undegraded":"2024-04-16T19:33:39.362625+0000","last_fullsized":"2024-04-16T19:33:39.362625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:29.850916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'146","reported_seq":1638,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563993+0000","last_change":"2024-04-16T17:46:25.529669+0000","last_active":"2024-04-16T19:35:14.563993+0000","last_peered":"2024-04-16T19:35:14.563993+0000","last_clean":"2024-04-16T19:35:14.563993+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:35:14.563993+0000","last_undegraded":"2024-04-16T19:35:14.563993+0000","last_fullsized":"2024-04-16T19:35:14.563993+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:46.675908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376562+0000","last_change":"2024-04-16T17:46:17.507982+0000","last_active":"2024-04-16T19:35:04.376562+0000","last_peered":"2024-04-16T19:35:04.376562+0000","last_clean":"2024-04-16T19:35:04.376562+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:35:04.376562+0000","last_undegraded":"2024-04-16T19:35:04.376562+0000","last_fullsized":"2024-04-16T19:35:04.376562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:17:26.521094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:34.362268+0000","last_change":"2024-04-16T17:45:51.480412+0000","last_active":"2024-04-16T19:33:34.362268+0000","last_peered":"2024-04-16T19:33:34.362268+0000","last_clean":"2024-04-16T19:33:34.362268+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:33:34.362268+0000","last_undegraded":"2024-04-16T19:33:34.362268+0000","last_fullsized":"2024-04-16T19:33:34.362268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:28.168213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381317+0000","last_change":"2024-04-16T17:45:49.471149+0000","last_active":"2024-04-16T19:35:29.381317+0000","last_peered":"2024-04-16T19:35:29.381317+0000","last_clean":"2024-04-16T19:35:29.381317+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:35:29.381317+0000","last_undegraded":"2024-04-16T19:35:29.381317+0000","last_fullsized":"2024-04-16T19:35:29.381317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:20.691413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'543","reported_seq":45408,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381269+0000","last_change":"2024-04-16T17:45:47.464982+0000","last_active":"2024-04-16T19:35:29.381269+0000","last_peered":"2024-04-16T19:35:29.381269+0000","last_clean":"2024-04-16T19:35:29.381269+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:35:29.381269+0000","last_undegraded":"2024-04-16T19:35:29.381269+0000","last_fullsized":"2024-04-16T19:35:29.381269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:18.772947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'9","reported_seq":399,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381245+0000","last_change":"2024-04-16T17:45:45.466563+0000","last_active":"2024-04-16T19:35:29.381245+0000","last_peered":"2024-04-16T19:35:29.381245+0000","last_clean":"2024-04-16T19:35:29.381245+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:35:29.381245+0000","last_undegraded":"2024-04-16T19:35:29.381245+0000","last_fullsized":"2024-04-16T19:35:29.381245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:04.543134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563895+0000","last_change":"2024-04-16T17:45:10.395688+0000","last_active":"2024-04-16T19:35:14.563895+0000","last_peered":"2024-04-16T19:35:14.563895+0000","last_clean":"2024-04-16T19:35:14.563895+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:35:14.563895+0000","last_undegraded":"2024-04-16T19:35:14.563895+0000","last_fullsized":"2024-04-16T19:35:14.563895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:35:32.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.379632+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:35:09.379632+0000","last_peered":"2024-04-16T19:35:09.379632+0000","last_clean":"2024-04-16T19:35:09.379632+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:35:09.379632+0000","last_undegraded":"2024-04-16T19:35:09.379632+0000","last_fullsized":"2024-04-16T19:35:09.379632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"48'2","reported_seq":500,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565852+0000","last_change":"2024-04-16T17:45:20.412567+0000","last_active":"2024-04-16T19:35:24.565852+0000","last_peered":"2024-04-16T19:35:24.565852+0000","last_clean":"2024-04-16T19:35:24.565852+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:35:24.565852+0000","last_undegraded":"2024-04-16T19:35:24.565852+0000","last_fullsized":"2024-04-16T19:35:24.565852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:51.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'120","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383728+0000","last_change":"2024-04-16T17:45:22.416448+0000","last_active":"2024-04-16T19:35:44.383728+0000","last_peered":"2024-04-16T19:35:44.383728+0000","last_clean":"2024-04-16T19:35:44.383728+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:35:44.383728+0000","last_undegraded":"2024-04-16T19:35:44.383728+0000","last_fullsized":"2024-04-16T19:35:44.383728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:14.322665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'12","reported_seq":1395,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384532+0000","last_change":"2024-04-16T17:45:24.426319+0000","last_active":"2024-04-16T19:35:49.384532+0000","last_peered":"2024-04-16T19:35:49.384532+0000","last_clean":"2024-04-16T19:35:49.384532+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:35:49.384532+0000","last_undegraded":"2024-04-16T19:35:49.384532+0000","last_fullsized":"2024-04-16T19:35:49.384532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:33.417685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377809+0000","last_change":"2024-04-16T17:45:26.433965+0000","last_active":"2024-04-16T19:35:09.377809+0000","last_peered":"2024-04-16T19:35:09.377809+0000","last_clean":"2024-04-16T19:35:09.377809+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:35:09.377809+0000","last_undegraded":"2024-04-16T19:35:09.377809+0000","last_fullsized":"2024-04-16T19:35:09.377809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:05:58.231337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568462+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:35:39.568462+0000","last_peered":"2024-04-16T19:35:39.568462+0000","last_clean":"2024-04-16T19:35:39.568462+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:35:39.568462+0000","last_undegraded":"2024-04-16T19:35:39.568462+0000","last_fullsized":"2024-04-16T19:35:39.568462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:55:14.707665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'89","reported_seq":1549,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364103+0000","last_change":"2024-04-16T17:46:25.522263+0000","last_active":"2024-04-16T19:33:49.364103+0000","last_peered":"2024-04-16T19:33:49.364103+0000","last_clean":"2024-04-16T19:33:49.364103+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:33:49.364103+0000","last_undegraded":"2024-04-16T19:33:49.364103+0000","last_fullsized":"2024-04-16T19:33:49.364103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:41.808921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.365032+0000","last_change":"2024-04-16T17:46:17.502070+0000","last_active":"2024-04-16T19:33:39.365032+0000","last_peered":"2024-04-16T19:33:39.365032+0000","last_clean":"2024-04-16T19:33:39.365032+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:33:39.365032+0000","last_undegraded":"2024-04-16T19:33:39.365032+0000","last_fullsized":"2024-04-16T19:33:39.365032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'16","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567630+0000","last_change":"2024-04-16T17:45:51.481303+0000","last_active":"2024-04-16T19:35:34.567630+0000","last_peered":"2024-04-16T19:35:34.567630+0000","last_clean":"2024-04-16T19:35:34.567630+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:35:34.567630+0000","last_undegraded":"2024-04-16T19:35:34.567630+0000","last_fullsized":"2024-04-16T19:35:34.567630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:17.044957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'651","reported_seq":2560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:29.361739+0000","last_change":"2024-04-16T17:45:49.469698+0000","last_active":"2024-04-16T19:33:29.361739+0000","last_peered":"2024-04-16T19:33:29.361739+0000","last_clean":"2024-04-16T19:33:29.361739+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:33:29.361739+0000","last_undegraded":"2024-04-16T19:33:29.361739+0000","last_fullsized":"2024-04-16T19:33:29.361739+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:57:05.931727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'518","reported_seq":957,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.374199+0000","last_change":"2024-04-16T17:45:47.462089+0000","last_active":"2024-04-16T19:34:34.374199+0000","last_peered":"2024-04-16T19:34:34.374199+0000","last_clean":"2024-04-16T19:34:34.374199+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:34:34.374199+0000","last_undegraded":"2024-04-16T19:34:34.374199+0000","last_fullsized":"2024-04-16T19:34:34.374199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:56.475222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'8","reported_seq":371,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371775+0000","last_change":"2024-04-16T17:45:45.457866+0000","last_active":"2024-04-16T19:34:34.371775+0000","last_peered":"2024-04-16T19:34:34.371775+0000","last_clean":"2024-04-16T19:34:34.371775+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:34:34.371775+0000","last_undegraded":"2024-04-16T19:34:34.371775+0000","last_fullsized":"2024-04-16T19:34:34.371775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:18:09.442789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378153+0000","last_change":"2024-04-16T17:45:10.402149+0000","last_active":"2024-04-16T19:35:14.378153+0000","last_peered":"2024-04-16T19:35:14.378153+0000","last_clean":"2024-04-16T19:35:14.378153+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:35:14.378153+0000","last_undegraded":"2024-04-16T19:35:14.378153+0000","last_fullsized":"2024-04-16T19:35:14.378153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:14.688816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377861+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:35:09.377861+0000","last_peered":"2024-04-16T19:35:09.377861+0000","last_clean":"2024-04-16T19:35:09.377861+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:35:09.377861+0000","last_undegraded":"2024-04-16T19:35:09.377861+0000","last_fullsized":"2024-04-16T19:35:09.377861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:49:40.069655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379655+0000","last_change":"2024-04-16T17:45:20.409559+0000","last_active":"2024-04-16T19:35:24.379655+0000","last_peered":"2024-04-16T19:35:24.379655+0000","last_clean":"2024-04-16T19:35:24.379655+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:35:24.379655+0000","last_undegraded":"2024-04-16T19:35:24.379655+0000","last_fullsized":"2024-04-16T19:35:24.379655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:10.476166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'152","reported_seq":345,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371721+0000","last_change":"2024-04-16T17:45:22.415559+0000","last_active":"2024-04-16T19:34:29.371721+0000","last_peered":"2024-04-16T19:34:29.371721+0000","last_clean":"2024-04-16T19:34:29.371721+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:34:29.371721+0000","last_undegraded":"2024-04-16T19:34:29.371721+0000","last_fullsized":"2024-04-16T19:34:29.371721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:12.531458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369795+0000","last_change":"2024-04-16T17:45:24.421195+0000","last_active":"2024-04-16T19:34:09.369795+0000","last_peered":"2024-04-16T19:34:09.369795+0000","last_clean":"2024-04-16T19:34:09.369795+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:34:09.369795+0000","last_undegraded":"2024-04-16T19:34:09.369795+0000","last_fullsized":"2024-04-16T19:34:09.369795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:05.546332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369207+0000","last_change":"2024-04-16T17:45:26.432510+0000","last_active":"2024-04-16T19:34:14.369207+0000","last_peered":"2024-04-16T19:34:14.369207+0000","last_clean":"2024-04-16T19:34:14.369207+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:34:14.369207+0000","last_undegraded":"2024-04-16T19:34:14.369207+0000","last_fullsized":"2024-04-16T19:34:14.369207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:08.477244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565769+0000","last_change":"2024-04-16T18:09:02.169659+0000","last_active":"2024-04-16T19:35:24.565769+0000","last_peered":"2024-04-16T19:35:24.565769+0000","last_clean":"2024-04-16T19:35:24.565769+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:35:24.565769+0000","last_undegraded":"2024-04-16T19:35:24.565769+0000","last_fullsized":"2024-04-16T19:35:24.565769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:46.538084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'119","reported_seq":2030,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547309+0000","last_change":"2024-04-16T17:46:25.523284+0000","last_active":"2024-04-16T19:33:49.547309+0000","last_peered":"2024-04-16T19:33:49.547309+0000","last_clean":"2024-04-16T19:33:49.547309+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:33:49.547309+0000","last_undegraded":"2024-04-16T19:33:49.547309+0000","last_fullsized":"2024-04-16T19:33:49.547309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:27:21.692424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363115+0000","last_change":"2024-04-16T17:46:17.506836+0000","last_active":"2024-04-16T19:33:39.363115+0000","last_peered":"2024-04-16T19:33:39.363115+0000","last_clean":"2024-04-16T19:33:39.363115+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:33:39.363115+0000","last_undegraded":"2024-04-16T19:33:39.363115+0000","last_fullsized":"2024-04-16T19:33:39.363115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'2","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384013+0000","last_change":"2024-04-16T17:45:51.481129+0000","last_active":"2024-04-16T19:35:34.384013+0000","last_peered":"2024-04-16T19:35:34.384013+0000","last_clean":"2024-04-16T19:35:34.384013+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:35:34.384013+0000","last_undegraded":"2024-04-16T19:35:34.384013+0000","last_fullsized":"2024-04-16T19:35:34.384013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:04.680783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'651","reported_seq":2212,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556521+0000","last_change":"2024-04-16T17:45:49.467008+0000","last_active":"2024-04-16T19:34:34.556521+0000","last_peered":"2024-04-16T19:34:34.556521+0000","last_clean":"2024-04-16T19:34:34.556521+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:34:34.556521+0000","last_undegraded":"2024-04-16T19:34:34.556521+0000","last_fullsized":"2024-04-16T19:34:34.556521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:30.562525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'281","reported_seq":571,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.542577+0000","last_change":"2024-04-16T17:45:47.463063+0000","last_active":"2024-04-16T19:33:24.542577+0000","last_peered":"2024-04-16T19:33:24.542577+0000","last_clean":"2024-04-16T19:33:24.542577+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:33:24.542577+0000","last_undegraded":"2024-04-16T19:33:24.542577+0000","last_fullsized":"2024-04-16T19:33:24.542577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:53.197273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'12","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372532+0000","last_change":"2024-04-16T17:45:45.465787+0000","last_active":"2024-04-16T19:34:34.372532+0000","last_peered":"2024-04-16T19:34:34.372532+0000","last_clean":"2024-04-16T19:34:34.372532+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:34:34.372532+0000","last_undegraded":"2024-04-16T19:34:34.372532+0000","last_fullsized":"2024-04-16T19:34:34.372532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378129+0000","last_change":"2024-04-16T17:45:10.392781+0000","last_active":"2024-04-16T19:35:14.378129+0000","last_peered":"2024-04-16T19:35:14.378129+0000","last_clean":"2024-04-16T19:35:14.378129+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:35:14.378129+0000","last_undegraded":"2024-04-16T19:35:14.378129+0000","last_fullsized":"2024-04-16T19:35:14.378129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:39.831957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377922+0000","last_change":"2024-04-16T17:45:08.386175+0000","last_active":"2024-04-16T19:35:09.377922+0000","last_peered":"2024-04-16T19:35:09.377922+0000","last_clean":"2024-04-16T19:35:09.377922+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:35:09.377922+0000","last_undegraded":"2024-04-16T19:35:09.377922+0000","last_fullsized":"2024-04-16T19:35:09.377922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"48'11","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380444+0000","last_change":"2024-04-16T17:45:20.407986+0000","last_active":"2024-04-16T19:35:24.380444+0000","last_peered":"2024-04-16T19:35:24.380444+0000","last_clean":"2024-04-16T19:35:24.380444+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:35:24.380444+0000","last_undegraded":"2024-04-16T19:35:24.380444+0000","last_fullsized":"2024-04-16T19:35:24.380444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:11.567092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369836+0000","last_change":"2024-04-16T17:45:22.415078+0000","last_active":"2024-04-16T19:34:09.369836+0000","last_peered":"2024-04-16T19:34:09.369836+0000","last_clean":"2024-04-16T19:34:09.369836+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:34:09.369836+0000","last_undegraded":"2024-04-16T19:34:09.369836+0000","last_fullsized":"2024-04-16T19:34:09.369836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:40.426580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371537+0000","last_change":"2024-04-16T17:45:24.425398+0000","last_active":"2024-04-16T19:34:29.371537+0000","last_peered":"2024-04-16T19:34:29.371537+0000","last_clean":"2024-04-16T19:34:29.371537+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:34:29.371537+0000","last_undegraded":"2024-04-16T19:34:29.371537+0000","last_fullsized":"2024-04-16T19:34:29.371537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:27.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552315+0000","last_change":"2024-04-16T17:45:26.849126+0000","last_active":"2024-04-16T19:34:14.552315+0000","last_peered":"2024-04-16T19:34:14.552315+0000","last_clean":"2024-04-16T19:34:14.552315+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:34:14.552315+0000","last_undegraded":"2024-04-16T19:34:14.552315+0000","last_fullsized":"2024-04-16T19:34:14.552315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:50.423306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382138+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:35:24.382138+0000","last_peered":"2024-04-16T19:35:24.382138+0000","last_clean":"2024-04-16T19:35:24.382138+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:35:24.382138+0000","last_undegraded":"2024-04-16T19:35:24.382138+0000","last_fullsized":"2024-04-16T19:35:24.382138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:39.644301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'120","reported_seq":1725,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547466+0000","last_change":"2024-04-16T17:46:25.526370+0000","last_active":"2024-04-16T19:33:49.547466+0000","last_peered":"2024-04-16T19:33:49.547466+0000","last_clean":"2024-04-16T19:33:49.547466+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:33:49.547466+0000","last_undegraded":"2024-04-16T19:33:49.547466+0000","last_fullsized":"2024-04-16T19:33:49.547466+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:22.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545358+0000","last_change":"2024-04-16T17:46:17.500988+0000","last_active":"2024-04-16T19:33:39.545358+0000","last_peered":"2024-04-16T19:33:39.545358+0000","last_clean":"2024-04-16T19:33:39.545358+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:33:39.545358+0000","last_undegraded":"2024-04-16T19:33:39.545358+0000","last_fullsized":"2024-04-16T19:33:39.545358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:54.079540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'19","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382058+0000","last_change":"2024-04-16T17:45:51.478621+0000","last_active":"2024-04-16T19:35:34.382058+0000","last_peered":"2024-04-16T19:35:34.382058+0000","last_clean":"2024-04-16T19:35:34.382058+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:35:34.382058+0000","last_undegraded":"2024-04-16T19:35:34.382058+0000","last_fullsized":"2024-04-16T19:35:34.382058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:28.047515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372631+0000","last_change":"2024-04-16T17:45:49.474101+0000","last_active":"2024-04-16T19:34:34.372631+0000","last_peered":"2024-04-16T19:34:34.372631+0000","last_clean":"2024-04-16T19:34:34.372631+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:34:34.372631+0000","last_undegraded":"2024-04-16T19:34:34.372631+0000","last_fullsized":"2024-04-16T19:34:34.372631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:47:15.346074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5043","reported_seq":7393,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372551+0000","last_change":"2024-04-16T17:45:47.462940+0000","last_active":"2024-04-16T19:34:34.372551+0000","last_peered":"2024-04-16T19:34:34.372551+0000","last_clean":"2024-04-16T19:34:34.372551+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:34:34.372551+0000","last_undegraded":"2024-04-16T19:34:34.372551+0000","last_fullsized":"2024-04-16T19:34:34.372551+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":3000,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:36.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'13","reported_seq":440,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.542611+0000","last_change":"2024-04-16T17:45:45.458908+0000","last_active":"2024-04-16T19:33:24.542611+0000","last_peered":"2024-04-16T19:33:24.542611+0000","last_clean":"2024-04-16T19:33:24.542611+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:33:24.542611+0000","last_undegraded":"2024-04-16T19:33:24.542611+0000","last_fullsized":"2024-04-16T19:33:24.542611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:41:32.351978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.371697+0000","last_change":"2024-04-16T17:45:10.397270+0000","last_active":"2024-04-16T19:34:19.371697+0000","last_peered":"2024-04-16T19:34:19.371697+0000","last_clean":"2024-04-16T19:34:19.371697+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:34:19.371697+0000","last_undegraded":"2024-04-16T19:34:19.371697+0000","last_fullsized":"2024-04-16T19:34:19.371697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:04.267541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565907+0000","last_change":"2024-04-16T17:45:08.385404+0000","last_active":"2024-04-16T19:35:24.565907+0000","last_peered":"2024-04-16T19:35:24.565907+0000","last_clean":"2024-04-16T19:35:24.565907+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:35:24.565907+0000","last_undegraded":"2024-04-16T19:35:24.565907+0000","last_fullsized":"2024-04-16T19:35:24.565907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'6","reported_seq":1404,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367767+0000","last_change":"2024-04-16T17:45:20.413621+0000","last_active":"2024-04-16T19:34:09.367767+0000","last_peered":"2024-04-16T19:34:09.367767+0000","last_clean":"2024-04-16T19:34:09.367767+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:34:09.367767+0000","last_undegraded":"2024-04-16T19:34:09.367767+0000","last_fullsized":"2024-04-16T19:34:09.367767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:36.005251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'32","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382168+0000","last_change":"2024-04-16T17:45:22.415077+0000","last_active":"2024-04-16T19:35:24.382168+0000","last_peered":"2024-04-16T19:35:24.382168+0000","last_clean":"2024-04-16T19:35:24.382168+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:35:24.382168+0000","last_undegraded":"2024-04-16T19:35:24.382168+0000","last_fullsized":"2024-04-16T19:35:24.382168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:27.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380516+0000","last_change":"2024-04-16T17:45:24.430903+0000","last_active":"2024-04-16T19:35:24.380516+0000","last_peered":"2024-04-16T19:35:24.380516+0000","last_clean":"2024-04-16T19:35:24.380516+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:35:24.380516+0000","last_undegraded":"2024-04-16T19:35:24.380516+0000","last_fullsized":"2024-04-16T19:35:24.380516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:55.371897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369101+0000","last_change":"2024-04-16T17:45:26.438619+0000","last_active":"2024-04-16T19:34:14.369101+0000","last_peered":"2024-04-16T19:34:14.369101+0000","last_clean":"2024-04-16T19:34:14.369101+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:34:14.369101+0000","last_undegraded":"2024-04-16T19:34:14.369101+0000","last_fullsized":"2024-04-16T19:34:14.369101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:15.584111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565746+0000","last_change":"2024-04-16T18:09:02.166083+0000","last_active":"2024-04-16T19:35:24.565746+0000","last_peered":"2024-04-16T19:35:24.565746+0000","last_clean":"2024-04-16T19:35:24.565746+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:35:24.565746+0000","last_undegraded":"2024-04-16T19:35:24.565746+0000","last_fullsized":"2024-04-16T19:35:24.565746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:14.230771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'126","reported_seq":1716,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547364+0000","last_change":"2024-04-16T17:46:25.531755+0000","last_active":"2024-04-16T19:33:49.547364+0000","last_peered":"2024-04-16T19:33:49.547364+0000","last_clean":"2024-04-16T19:33:49.547364+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:33:49.547364+0000","last_undegraded":"2024-04-16T19:33:49.547364+0000","last_fullsized":"2024-04-16T19:33:49.547364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:38.947978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545431+0000","last_change":"2024-04-16T17:46:17.505902+0000","last_active":"2024-04-16T19:33:39.545431+0000","last_peered":"2024-04-16T19:33:39.545431+0000","last_clean":"2024-04-16T19:33:39.545431+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:33:39.545431+0000","last_undegraded":"2024-04-16T19:33:39.545431+0000","last_fullsized":"2024-04-16T19:33:39.545431+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:54.200238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'10","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.383978+0000","last_change":"2024-04-16T17:45:51.478912+0000","last_active":"2024-04-16T19:35:34.383978+0000","last_peered":"2024-04-16T19:35:34.383978+0000","last_clean":"2024-04-16T19:35:34.383978+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:35:34.383978+0000","last_undegraded":"2024-04-16T19:35:34.383978+0000","last_fullsized":"2024-04-16T19:35:34.383978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:20.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372659+0000","last_change":"2024-04-16T17:45:49.470949+0000","last_active":"2024-04-16T19:34:34.372659+0000","last_peered":"2024-04-16T19:34:34.372659+0000","last_clean":"2024-04-16T19:34:34.372659+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:34:34.372659+0000","last_undegraded":"2024-04-16T19:34:34.372659+0000","last_fullsized":"2024-04-16T19:34:34.372659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:38:03.985918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'554","reported_seq":1527,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372495+0000","last_change":"2024-04-16T17:45:47.464106+0000","last_active":"2024-04-16T19:34:34.372495+0000","last_peered":"2024-04-16T19:34:34.372495+0000","last_clean":"2024-04-16T19:34:34.372495+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:34:34.372495+0000","last_undegraded":"2024-04-16T19:34:34.372495+0000","last_fullsized":"2024-04-16T19:34:34.372495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:24.659574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'6","reported_seq":517,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371703+0000","last_change":"2024-04-16T17:45:45.454923+0000","last_active":"2024-04-16T19:34:34.371703+0000","last_peered":"2024-04-16T19:34:34.371703+0000","last_clean":"2024-04-16T19:34:34.371703+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:34:34.371703+0000","last_undegraded":"2024-04-16T19:34:34.371703+0000","last_fullsized":"2024-04-16T19:34:34.371703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:16.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366331+0000","last_change":"2024-04-16T17:45:10.400150+0000","last_active":"2024-04-16T19:33:59.366331+0000","last_peered":"2024-04-16T19:33:59.366331+0000","last_clean":"2024-04-16T19:33:59.366331+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:33:59.366331+0000","last_undegraded":"2024-04-16T19:33:59.366331+0000","last_fullsized":"2024-04-16T19:33:59.366331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:22:56.234389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384160+0000","last_change":"2024-04-16T17:45:08.386622+0000","last_active":"2024-04-16T19:35:34.384160+0000","last_peered":"2024-04-16T19:35:34.384160+0000","last_clean":"2024-04-16T19:35:34.384160+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:35:34.384160+0000","last_undegraded":"2024-04-16T19:35:34.384160+0000","last_fullsized":"2024-04-16T19:35:34.384160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:45.243544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554295+0000","last_change":"2024-04-16T17:45:20.412420+0000","last_active":"2024-04-16T19:34:24.554295+0000","last_peered":"2024-04-16T19:34:24.554295+0000","last_clean":"2024-04-16T19:34:24.554295+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:34:24.554295+0000","last_undegraded":"2024-04-16T19:34:24.554295+0000","last_fullsized":"2024-04-16T19:34:24.554295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:06.239898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'80","reported_seq":236,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379675+0000","last_change":"2024-04-16T17:45:22.421586+0000","last_active":"2024-04-16T19:35:24.379675+0000","last_peered":"2024-04-16T19:35:24.379675+0000","last_clean":"2024-04-16T19:35:24.379675+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:35:24.379675+0000","last_undegraded":"2024-04-16T19:35:24.379675+0000","last_fullsized":"2024-04-16T19:35:24.379675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:38.487045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382204+0000","last_change":"2024-04-16T17:45:24.424290+0000","last_active":"2024-04-16T19:35:24.382204+0000","last_peered":"2024-04-16T19:35:24.382204+0000","last_clean":"2024-04-16T19:35:24.382204+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:35:24.382204+0000","last_undegraded":"2024-04-16T19:35:24.382204+0000","last_fullsized":"2024-04-16T19:35:24.382204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.451179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380429+0000","last_change":"2024-04-16T17:45:26.433279+0000","last_active":"2024-04-16T19:35:29.380429+0000","last_peered":"2024-04-16T19:35:29.380429+0000","last_clean":"2024-04-16T19:35:29.380429+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:35:29.380429+0000","last_undegraded":"2024-04-16T19:35:29.380429+0000","last_fullsized":"2024-04-16T19:35:29.380429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:53.357161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'5","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547447+0000","last_change":"2024-04-16T17:45:45.455663+0000","last_active":"2024-04-16T19:33:49.547447+0000","last_peered":"2024-04-16T19:33:49.547447+0000","last_clean":"2024-04-16T19:33:49.547447+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:33:49.547447+0000","last_undegraded":"2024-04-16T19:33:49.547447+0000","last_fullsized":"2024-04-16T19:33:49.547447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:03.461208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557429+0000","last_change":"2024-04-16T17:46:16.500595+0000","last_active":"2024-04-16T19:34:39.557429+0000","last_peered":"2024-04-16T19:34:39.557429+0000","last_clean":"2024-04-16T19:34:39.557429+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:34:39.557429+0000","last_undegraded":"2024-04-16T19:34:39.557429+0000","last_fullsized":"2024-04-16T19:34:39.557429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:59.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381260+0000","last_change":"2024-04-16T17:45:08.383072+0000","last_active":"2024-04-16T19:35:34.381260+0000","last_peered":"2024-04-16T19:35:34.381260+0000","last_clean":"2024-04-16T19:35:34.381260+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:35:34.381260+0000","last_undegraded":"2024-04-16T19:35:34.381260+0000","last_fullsized":"2024-04-16T19:35:34.381260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:05:58.862115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'15","reported_seq":225,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364974+0000","last_change":"2024-04-16T17:45:45.464950+0000","last_active":"2024-04-16T19:33:49.364974+0000","last_peered":"2024-04-16T19:33:49.364974+0000","last_clean":"2024-04-16T19:33:49.364974+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:33:49.364974+0000","last_undegraded":"2024-04-16T19:33:49.364974+0000","last_fullsized":"2024-04-16T19:33:49.364974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:39.088704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569767+0000","last_change":"2024-04-16T17:45:10.396086+0000","last_active":"2024-04-16T19:35:44.569767+0000","last_peered":"2024-04-16T19:35:44.569767+0000","last_clean":"2024-04-16T19:35:44.569767+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:35:44.569767+0000","last_undegraded":"2024-04-16T19:35:44.569767+0000","last_fullsized":"2024-04-16T19:35:44.569767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:53.484971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567556+0000","last_change":"2024-04-16T17:45:08.390555+0000","last_active":"2024-04-16T19:35:34.567556+0000","last_peered":"2024-04-16T19:35:34.567556+0000","last_clean":"2024-04-16T19:35:34.567556+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:35:34.567556+0000","last_undegraded":"2024-04-16T19:35:34.567556+0000","last_fullsized":"2024-04-16T19:35:34.567556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:29.317076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'18","reported_seq":469,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371671+0000","last_change":"2024-04-16T17:45:45.464620+0000","last_active":"2024-04-16T19:34:29.371671+0000","last_peered":"2024-04-16T19:34:29.371671+0000","last_clean":"2024-04-16T19:34:29.371671+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:34:29.371671+0000","last_undegraded":"2024-04-16T19:34:29.371671+0000","last_fullsized":"2024-04-16T19:34:29.371671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:41.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383715+0000","last_change":"2024-04-16T17:45:10.400426+0000","last_active":"2024-04-16T19:35:44.383715+0000","last_peered":"2024-04-16T19:35:44.383715+0000","last_clean":"2024-04-16T19:35:44.383715+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:35:44.383715+0000","last_undegraded":"2024-04-16T19:35:44.383715+0000","last_fullsized":"2024-04-16T19:35:44.383715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:57.696534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557330+0000","last_change":"2024-04-16T17:46:16.499950+0000","last_active":"2024-04-16T19:34:39.557330+0000","last_peered":"2024-04-16T19:34:39.557330+0000","last_clean":"2024-04-16T19:34:39.557330+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:34:39.557330+0000","last_undegraded":"2024-04-16T19:34:39.557330+0000","last_fullsized":"2024-04-16T19:34:39.557330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:37:22.903930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'9","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369392+0000","last_change":"2024-04-16T17:46:16.503571+0000","last_active":"2024-04-16T19:34:19.369392+0000","last_peered":"2024-04-16T19:34:19.369392+0000","last_clean":"2024-04-16T19:34:19.369392+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:34:19.369392+0000","last_undegraded":"2024-04-16T19:34:19.369392+0000","last_fullsized":"2024-04-16T19:34:19.369392+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569655+0000","last_change":"2024-04-16T17:45:10.394142+0000","last_active":"2024-04-16T19:35:44.569655+0000","last_peered":"2024-04-16T19:35:44.569655+0000","last_clean":"2024-04-16T19:35:44.569655+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:35:44.569655+0000","last_undegraded":"2024-04-16T19:35:44.569655+0000","last_fullsized":"2024-04-16T19:35:44.569655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:55.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387387+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:35:54.387387+0000","last_peered":"2024-04-16T19:35:54.387387+0000","last_clean":"2024-04-16T19:35:54.387387+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:35:54.387387+0000","last_undegraded":"2024-04-16T19:35:54.387387+0000","last_fullsized":"2024-04-16T19:35:54.387387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:51.477510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'6","reported_seq":218,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381435+0000","last_change":"2024-04-16T17:45:45.463398+0000","last_active":"2024-04-16T19:35:29.381435+0000","last_peered":"2024-04-16T19:35:29.381435+0000","last_clean":"2024-04-16T19:35:29.381435+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:35:29.381435+0000","last_undegraded":"2024-04-16T19:35:29.381435+0000","last_fullsized":"2024-04-16T19:35:29.381435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:07.065221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571544+0000","last_change":"2024-04-16T17:45:10.394131+0000","last_active":"2024-04-16T19:35:54.571544+0000","last_peered":"2024-04-16T19:35:54.571544+0000","last_clean":"2024-04-16T19:35:54.571544+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:35:54.571544+0000","last_undegraded":"2024-04-16T19:35:54.571544+0000","last_fullsized":"2024-04-16T19:35:54.571544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:18:12.092314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384888+0000","last_change":"2024-04-16T17:45:08.390961+0000","last_active":"2024-04-16T19:35:39.384888+0000","last_peered":"2024-04-16T19:35:39.384888+0000","last_clean":"2024-04-16T19:35:39.384888+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:35:39.384888+0000","last_undegraded":"2024-04-16T19:35:39.384888+0000","last_fullsized":"2024-04-16T19:35:39.384888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:36.615698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'50","reported_seq":632,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566804+0000","last_change":"2024-04-16T17:45:45.465543+0000","last_active":"2024-04-16T19:35:29.566804+0000","last_peered":"2024-04-16T19:35:29.566804+0000","last_clean":"2024-04-16T19:35:29.566804+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:35:29.566804+0000","last_undegraded":"2024-04-16T19:35:29.566804+0000","last_fullsized":"2024-04-16T19:35:29.566804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:54.444903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382232+0000","last_change":"2024-04-16T17:45:10.394908+0000","last_active":"2024-04-16T19:35:39.382232+0000","last_peered":"2024-04-16T19:35:39.382232+0000","last_clean":"2024-04-16T19:35:39.382232+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:35:39.382232+0000","last_undegraded":"2024-04-16T19:35:39.382232+0000","last_fullsized":"2024-04-16T19:35:39.382232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:00.759798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568749+0000","last_change":"2024-04-16T17:45:08.382445+0000","last_active":"2024-04-16T19:35:39.568749+0000","last_peered":"2024-04-16T19:35:39.568749+0000","last_clean":"2024-04-16T19:35:39.568749+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:35:39.568749+0000","last_undegraded":"2024-04-16T19:35:39.568749+0000","last_fullsized":"2024-04-16T19:35:39.568749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:46:03.130129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'9","reported_seq":157,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547546+0000","last_change":"2024-04-16T17:45:45.459475+0000","last_active":"2024-04-16T19:33:49.547546+0000","last_peered":"2024-04-16T19:33:49.547546+0000","last_clean":"2024-04-16T19:33:49.547546+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:33:49.547546+0000","last_undegraded":"2024-04-16T19:33:49.547546+0000","last_fullsized":"2024-04-16T19:33:49.547546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:38.609449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568527+0000","last_change":"2024-04-16T17:45:10.398439+0000","last_active":"2024-04-16T19:35:39.568527+0000","last_peered":"2024-04-16T19:35:39.568527+0000","last_clean":"2024-04-16T19:35:39.568527+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:35:39.568527+0000","last_undegraded":"2024-04-16T19:35:39.568527+0000","last_fullsized":"2024-04-16T19:35:39.568527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:39.589700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382931+0000","last_change":"2024-04-16T17:45:08.388353+0000","last_active":"2024-04-16T19:35:39.382931+0000","last_peered":"2024-04-16T19:35:39.382931+0000","last_clean":"2024-04-16T19:35:39.382931+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:35:39.382931+0000","last_undegraded":"2024-04-16T19:35:39.382931+0000","last_fullsized":"2024-04-16T19:35:39.382931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'11","reported_seq":529,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550415+0000","last_change":"2024-04-16T17:45:45.461419+0000","last_active":"2024-04-16T19:34:04.550415+0000","last_peered":"2024-04-16T19:34:04.550415+0000","last_clean":"2024-04-16T19:34:04.550415+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:34:04.550415+0000","last_undegraded":"2024-04-16T19:34:04.550415+0000","last_fullsized":"2024-04-16T19:34:04.550415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:58:08.710389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382760+0000","last_change":"2024-04-16T17:45:10.393085+0000","last_active":"2024-04-16T19:35:39.382760+0000","last_peered":"2024-04-16T19:35:39.382760+0000","last_clean":"2024-04-16T19:35:39.382760+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:35:39.382760+0000","last_undegraded":"2024-04-16T19:35:39.382760+0000","last_fullsized":"2024-04-16T19:35:39.382760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:10.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568742+0000","last_change":"2024-04-16T17:45:08.387778+0000","last_active":"2024-04-16T19:35:39.568742+0000","last_peered":"2024-04-16T19:35:39.568742+0000","last_clean":"2024-04-16T19:35:39.568742+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:35:39.568742+0000","last_undegraded":"2024-04-16T19:35:39.568742+0000","last_fullsized":"2024-04-16T19:35:39.568742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:58.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'6","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368125+0000","last_change":"2024-04-16T17:45:45.460984+0000","last_active":"2024-04-16T19:34:09.368125+0000","last_peered":"2024-04-16T19:34:09.368125+0000","last_clean":"2024-04-16T19:34:09.368125+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:34:09.368125+0000","last_undegraded":"2024-04-16T19:34:09.368125+0000","last_fullsized":"2024-04-16T19:34:09.368125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:54:54.185407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.377274+0000","last_change":"2024-04-16T17:45:10.397793+0000","last_active":"2024-04-16T19:34:54.377274+0000","last_peered":"2024-04-16T19:34:54.377274+0000","last_clean":"2024-04-16T19:34:54.377274+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:34:54.377274+0000","last_undegraded":"2024-04-16T19:34:54.377274+0000","last_fullsized":"2024-04-16T19:34:54.377274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:26.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364845+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:33:49.364845+0000","last_peered":"2024-04-16T19:33:49.364845+0000","last_clean":"2024-04-16T19:33:49.364845+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:33:49.364845+0000","last_undegraded":"2024-04-16T19:33:49.364845+0000","last_fullsized":"2024-04-16T19:33:49.364845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'6","reported_seq":365,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554372+0000","last_change":"2024-04-16T17:45:45.454358+0000","last_active":"2024-04-16T19:34:24.554372+0000","last_peered":"2024-04-16T19:34:24.554372+0000","last_clean":"2024-04-16T19:34:24.554372+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:34:24.554372+0000","last_undegraded":"2024-04-16T19:34:24.554372+0000","last_fullsized":"2024-04-16T19:34:24.554372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:05.027153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375005+0000","last_change":"2024-04-16T17:45:10.390881+0000","last_active":"2024-04-16T19:34:54.375005+0000","last_peered":"2024-04-16T19:34:54.375005+0000","last_clean":"2024-04-16T19:34:54.375005+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:34:54.375005+0000","last_undegraded":"2024-04-16T19:34:54.375005+0000","last_fullsized":"2024-04-16T19:34:54.375005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:58.273468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382101+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:35:24.382101+0000","last_peered":"2024-04-16T19:35:24.382101+0000","last_clean":"2024-04-16T19:35:24.382101+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:35:24.382101+0000","last_undegraded":"2024-04-16T19:35:24.382101+0000","last_fullsized":"2024-04-16T19:35:24.382101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'12","reported_seq":411,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369866+0000","last_change":"2024-04-16T17:45:45.466651+0000","last_active":"2024-04-16T19:34:09.369866+0000","last_peered":"2024-04-16T19:34:09.369866+0000","last_clean":"2024-04-16T19:34:09.369866+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:34:09.369866+0000","last_undegraded":"2024-04-16T19:34:09.369866+0000","last_fullsized":"2024-04-16T19:34:09.369866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:40.527095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569671+0000","last_change":"2024-04-16T17:45:10.393700+0000","last_active":"2024-04-16T19:35:44.569671+0000","last_peered":"2024-04-16T19:35:44.569671+0000","last_clean":"2024-04-16T19:35:44.569671+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:35:44.569671+0000","last_undegraded":"2024-04-16T19:35:44.569671+0000","last_fullsized":"2024-04-16T19:35:44.569671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:02:23.287018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380398+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:35:24.380398+0000","last_peered":"2024-04-16T19:35:24.380398+0000","last_clean":"2024-04-16T19:35:24.380398+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:35:24.380398+0000","last_undegraded":"2024-04-16T19:35:24.380398+0000","last_fullsized":"2024-04-16T19:35:24.380398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:58.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'14","reported_seq":681,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551292+0000","last_change":"2024-04-16T17:45:45.455567+0000","last_active":"2024-04-16T19:34:09.551292+0000","last_peered":"2024-04-16T19:34:09.551292+0000","last_clean":"2024-04-16T19:34:09.551292+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:34:09.551292+0000","last_undegraded":"2024-04-16T19:34:09.551292+0000","last_fullsized":"2024-04-16T19:34:09.551292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:53:12.376645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381352+0000","last_change":"2024-04-16T17:45:10.390598+0000","last_active":"2024-04-16T19:35:29.381352+0000","last_peered":"2024-04-16T19:35:29.381352+0000","last_clean":"2024-04-16T19:35:29.381352+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:35:29.381352+0000","last_undegraded":"2024-04-16T19:35:29.381352+0000","last_fullsized":"2024-04-16T19:35:29.381352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:19.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382184+0000","last_change":"2024-04-16T17:45:08.389493+0000","last_active":"2024-04-16T19:35:24.382184+0000","last_peered":"2024-04-16T19:35:24.382184+0000","last_clean":"2024-04-16T19:35:24.382184+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:35:24.382184+0000","last_undegraded":"2024-04-16T19:35:24.382184+0000","last_fullsized":"2024-04-16T19:35:24.382184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'15","reported_seq":211,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368646+0000","last_change":"2024-04-16T17:45:45.464470+0000","last_active":"2024-04-16T19:34:09.368646+0000","last_peered":"2024-04-16T19:34:09.368646+0000","last_clean":"2024-04-16T19:34:09.368646+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:34:09.368646+0000","last_undegraded":"2024-04-16T19:34:09.368646+0000","last_fullsized":"2024-04-16T19:34:09.368646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:14.079978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380416+0000","last_change":"2024-04-16T17:45:10.397665+0000","last_active":"2024-04-16T19:35:29.380416+0000","last_peered":"2024-04-16T19:35:29.380416+0000","last_clean":"2024-04-16T19:35:29.380416+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:35:29.380416+0000","last_undegraded":"2024-04-16T19:35:29.380416+0000","last_fullsized":"2024-04-16T19:35:29.380416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:53.725890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380581+0000","last_change":"2024-04-16T17:45:08.386399+0000","last_active":"2024-04-16T19:35:24.380581+0000","last_peered":"2024-04-16T19:35:24.380581+0000","last_clean":"2024-04-16T19:35:24.380581+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:35:24.380581+0000","last_undegraded":"2024-04-16T19:35:24.380581+0000","last_fullsized":"2024-04-16T19:35:24.380581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:55.689073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'3","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551522+0000","last_change":"2024-04-16T17:45:45.455538+0000","last_active":"2024-04-16T19:34:09.551522+0000","last_peered":"2024-04-16T19:34:09.551522+0000","last_clean":"2024-04-16T19:34:09.551522+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:34:09.551522+0000","last_undegraded":"2024-04-16T19:34:09.551522+0000","last_fullsized":"2024-04-16T19:34:09.551522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:38.174415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383169+0000","last_change":"2024-04-16T17:45:10.393634+0000","last_active":"2024-04-16T19:35:29.383169+0000","last_peered":"2024-04-16T19:35:29.383169+0000","last_clean":"2024-04-16T19:35:29.383169+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:35:29.383169+0000","last_undegraded":"2024-04-16T19:35:29.383169+0000","last_fullsized":"2024-04-16T19:35:29.383169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:00.458421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383699+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:35:44.383699+0000","last_peered":"2024-04-16T19:35:44.383699+0000","last_clean":"2024-04-16T19:35:44.383699+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:35:44.383699+0000","last_undegraded":"2024-04-16T19:35:44.383699+0000","last_fullsized":"2024-04-16T19:35:44.383699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:55.231268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'9","reported_seq":448,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551428+0000","last_change":"2024-04-16T17:45:45.454411+0000","last_active":"2024-04-16T19:34:09.551428+0000","last_peered":"2024-04-16T19:34:09.551428+0000","last_clean":"2024-04-16T19:34:09.551428+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:34:09.551428+0000","last_undegraded":"2024-04-16T19:34:09.551428+0000","last_fullsized":"2024-04-16T19:34:09.551428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:55:01.786817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566621+0000","last_change":"2024-04-16T17:45:10.399193+0000","last_active":"2024-04-16T19:35:29.566621+0000","last_peered":"2024-04-16T19:35:29.566621+0000","last_clean":"2024-04-16T19:35:29.566621+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:35:29.566621+0000","last_undegraded":"2024-04-16T19:35:29.566621+0000","last_fullsized":"2024-04-16T19:35:29.566621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:06.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559232+0000","last_change":"2024-04-16T17:45:08.388974+0000","last_active":"2024-04-16T19:34:49.559232+0000","last_peered":"2024-04-16T19:34:49.559232+0000","last_clean":"2024-04-16T19:34:49.559232+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:34:49.559232+0000","last_undegraded":"2024-04-16T19:34:49.559232+0000","last_fullsized":"2024-04-16T19:34:49.559232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:35.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'3","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370003+0000","last_change":"2024-04-16T17:45:45.466411+0000","last_active":"2024-04-16T19:34:09.370003+0000","last_peered":"2024-04-16T19:34:09.370003+0000","last_clean":"2024-04-16T19:34:09.370003+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:34:09.370003+0000","last_undegraded":"2024-04-16T19:34:09.370003+0000","last_fullsized":"2024-04-16T19:34:09.370003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:41.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365563+0000","last_change":"2024-04-16T17:45:10.392230+0000","last_active":"2024-04-16T19:33:54.365563+0000","last_peered":"2024-04-16T19:33:54.365563+0000","last_clean":"2024-04-16T19:33:54.365563+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:33:54.365563+0000","last_undegraded":"2024-04-16T19:33:54.365563+0000","last_fullsized":"2024-04-16T19:33:54.365563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:41.531980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374829+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:34:49.374829+0000","last_peered":"2024-04-16T19:34:49.374829+0000","last_clean":"2024-04-16T19:34:49.374829+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:34:49.374829+0000","last_undegraded":"2024-04-16T19:34:49.374829+0000","last_fullsized":"2024-04-16T19:34:49.374829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:56.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'7","reported_seq":317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361610+0000","last_change":"2024-04-16T17:45:45.467943+0000","last_active":"2024-04-16T19:33:19.361610+0000","last_peered":"2024-04-16T19:33:19.361610+0000","last_clean":"2024-04-16T19:33:19.361610+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:33:19.361610+0000","last_undegraded":"2024-04-16T19:33:19.361610+0000","last_fullsized":"2024-04-16T19:33:19.361610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:37.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374628+0000","last_change":"2024-04-16T17:45:08.386818+0000","last_active":"2024-04-16T19:34:49.374628+0000","last_peered":"2024-04-16T19:34:49.374628+0000","last_clean":"2024-04-16T19:34:49.374628+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:34:49.374628+0000","last_undegraded":"2024-04-16T19:34:49.374628+0000","last_fullsized":"2024-04-16T19:34:49.374628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:29.526811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.371846+0000","last_change":"2024-04-16T17:45:10.391395+0000","last_active":"2024-04-16T19:34:19.371846+0000","last_peered":"2024-04-16T19:34:19.371846+0000","last_clean":"2024-04-16T19:34:19.371846+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:34:19.371846+0000","last_undegraded":"2024-04-16T19:34:19.371846+0000","last_fullsized":"2024-04-16T19:34:19.371846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:57.238729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'29","reported_seq":754,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541691+0000","last_change":"2024-04-16T17:45:45.461627+0000","last_active":"2024-04-16T19:33:19.541691+0000","last_peered":"2024-04-16T19:33:19.541691+0000","last_clean":"2024-04-16T19:33:19.541691+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:33:19.541691+0000","last_undegraded":"2024-04-16T19:33:19.541691+0000","last_fullsized":"2024-04-16T19:33:19.541691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:37.357293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559097+0000","last_change":"2024-04-16T17:45:08.389341+0000","last_active":"2024-04-16T19:34:49.559097+0000","last_peered":"2024-04-16T19:34:49.559097+0000","last_clean":"2024-04-16T19:34:49.559097+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:34:49.559097+0000","last_undegraded":"2024-04-16T19:34:49.559097+0000","last_fullsized":"2024-04-16T19:34:49.559097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:35.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366646+0000","last_change":"2024-04-16T17:45:10.395147+0000","last_active":"2024-04-16T19:33:59.366646+0000","last_peered":"2024-04-16T19:33:59.366646+0000","last_clean":"2024-04-16T19:33:59.366646+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:33:59.366646+0000","last_undegraded":"2024-04-16T19:33:59.366646+0000","last_fullsized":"2024-04-16T19:33:59.366646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:56.222153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4205,"ondisk_log_size":4205,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3706,"ondisk_log_size":3706,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":749,"ondisk_log_size":749,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20907,"ondisk_log_size":20907,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5228,"ondisk_log_size":5228,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641624,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46644,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810956,"statfs":{"total":107374182400,"available":107326418944,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641623,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":58984,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798616,"statfs":{"total":107374182400,"available":107313782784,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641624,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":83468,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":104774132,"statfs":{"total":107374182400,"available":107288711168,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641623,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46796,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810804,"statfs":{"total":107374182400,"available":107326263296,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641622,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46772,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810828,"statfs":{"total":107374182400,"available":107326287872,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641624,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51520,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806080,"statfs":{"total":107374182400,"available":107321425920,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:38:05.919 INFO:tasks.ceph.ceph_manager.c1:clean! 2024-04-16T19:38:05.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:38:06.258 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:38:06.278 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:38:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3459,"stamp":"2024-04-16T19:38:04.493973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35609,"ondisk_log_size":35609,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":334184,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":322998,"kb_avail":628811416,"statfs":{"total":644245094400,"available":643902889984,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":330750625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005423"},"pg_stats":[{"pgid":"9.35","version":"53'18","reported_seq":516,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556486+0000","last_change":"2024-04-16T17:45:45.459835+0000","last_active":"2024-04-16T19:34:34.556486+0000","last_peered":"2024-04-16T19:34:34.556486+0000","last_clean":"2024-04-16T19:34:34.556486+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:34:34.556486+0000","last_undegraded":"2024-04-16T19:34:34.556486+0000","last_fullsized":"2024-04-16T19:34:34.556486+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:41.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382165+0000","last_change":"2024-04-16T17:45:08.383247+0000","last_active":"2024-04-16T19:35:34.382165+0000","last_peered":"2024-04-16T19:35:34.382165+0000","last_clean":"2024-04-16T19:35:34.382165+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:35:34.382165+0000","last_undegraded":"2024-04-16T19:35:34.382165+0000","last_fullsized":"2024-04-16T19:35:34.382165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:20.213795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378639+0000","last_change":"2024-04-16T17:45:10.400343+0000","last_active":"2024-04-16T19:35:14.378639+0000","last_peered":"2024-04-16T19:35:14.378639+0000","last_clean":"2024-04-16T19:35:14.378639+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:35:14.378639+0000","last_undegraded":"2024-04-16T19:35:14.378639+0000","last_fullsized":"2024-04-16T19:35:14.378639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:34:35.746556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'6","reported_seq":288,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372581+0000","last_change":"2024-04-16T17:45:45.464134+0000","last_active":"2024-04-16T19:34:34.372581+0000","last_peered":"2024-04-16T19:34:34.372581+0000","last_clean":"2024-04-16T19:34:34.372581+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:34:34.372581+0000","last_undegraded":"2024-04-16T19:34:34.372581+0000","last_fullsized":"2024-04-16T19:34:34.372581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:29:54.124351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567746+0000","last_change":"2024-04-16T17:45:08.381595+0000","last_active":"2024-04-16T19:35:34.567746+0000","last_peered":"2024-04-16T19:35:34.567746+0000","last_clean":"2024-04-16T19:35:34.567746+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:35:34.567746+0000","last_undegraded":"2024-04-16T19:35:34.567746+0000","last_fullsized":"2024-04-16T19:35:34.567746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378769+0000","last_change":"2024-04-16T17:45:10.390675+0000","last_active":"2024-04-16T19:35:14.378769+0000","last_peered":"2024-04-16T19:35:14.378769+0000","last_clean":"2024-04-16T19:35:14.378769+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:35:14.378769+0000","last_undegraded":"2024-04-16T19:35:14.378769+0000","last_fullsized":"2024-04-16T19:35:14.378769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:26.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'7","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375036+0000","last_change":"2024-04-16T17:45:45.461571+0000","last_active":"2024-04-16T19:34:54.375036+0000","last_peered":"2024-04-16T19:34:54.375036+0000","last_clean":"2024-04-16T19:34:54.375036+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:34:54.375036+0000","last_undegraded":"2024-04-16T19:34:54.375036+0000","last_fullsized":"2024-04-16T19:34:54.375036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:19.904572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384092+0000","last_change":"2024-04-16T17:45:08.381577+0000","last_active":"2024-04-16T19:35:34.384092+0000","last_peered":"2024-04-16T19:35:34.384092+0000","last_clean":"2024-04-16T19:35:34.384092+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:35:34.384092+0000","last_undegraded":"2024-04-16T19:35:34.384092+0000","last_fullsized":"2024-04-16T19:35:34.384092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:58.984483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378103+0000","last_change":"2024-04-16T17:45:10.394273+0000","last_active":"2024-04-16T19:35:14.378103+0000","last_peered":"2024-04-16T19:35:14.378103+0000","last_clean":"2024-04-16T19:35:14.378103+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:35:14.378103+0000","last_undegraded":"2024-04-16T19:35:14.378103+0000","last_fullsized":"2024-04-16T19:35:14.378103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:54.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'7","reported_seq":246,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556535+0000","last_change":"2024-04-16T17:45:45.464927+0000","last_active":"2024-04-16T19:34:34.556535+0000","last_peered":"2024-04-16T19:34:34.556535+0000","last_clean":"2024-04-16T19:34:34.556535+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:34:34.556535+0000","last_undegraded":"2024-04-16T19:34:34.556535+0000","last_fullsized":"2024-04-16T19:34:34.556535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:29:54.124351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381354+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:35:29.381354+0000","last_peered":"2024-04-16T19:35:29.381354+0000","last_clean":"2024-04-16T19:35:29.381354+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:35:29.381354+0000","last_undegraded":"2024-04-16T19:35:29.381354+0000","last_fullsized":"2024-04-16T19:35:29.381354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:22.068786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.380496+0000","last_change":"2024-04-16T17:45:10.398320+0000","last_active":"2024-04-16T19:35:14.380496+0000","last_peered":"2024-04-16T19:35:14.380496+0000","last_clean":"2024-04-16T19:35:14.380496+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:35:14.380496+0000","last_undegraded":"2024-04-16T19:35:14.380496+0000","last_fullsized":"2024-04-16T19:35:14.380496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:10.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'7","reported_seq":515,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380346+0000","last_change":"2024-04-16T17:45:45.455611+0000","last_active":"2024-04-16T19:35:29.380346+0000","last_peered":"2024-04-16T19:35:29.380346+0000","last_clean":"2024-04-16T19:35:29.380346+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:35:29.380346+0000","last_undegraded":"2024-04-16T19:35:29.380346+0000","last_fullsized":"2024-04-16T19:35:29.380346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:39:55.884585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377968+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:35:09.377968+0000","last_peered":"2024-04-16T19:35:09.377968+0000","last_clean":"2024-04-16T19:35:09.377968+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:35:09.377968+0000","last_undegraded":"2024-04-16T19:35:09.377968+0000","last_fullsized":"2024-04-16T19:35:09.377968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382143+0000","last_change":"2024-04-16T17:45:10.395553+0000","last_active":"2024-04-16T19:35:34.382143+0000","last_peered":"2024-04-16T19:35:34.382143+0000","last_clean":"2024-04-16T19:35:34.382143+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:35:34.382143+0000","last_undegraded":"2024-04-16T19:35:34.382143+0000","last_fullsized":"2024-04-16T19:35:34.382143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:25.987507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'8","reported_seq":315,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383101+0000","last_change":"2024-04-16T17:45:45.464732+0000","last_active":"2024-04-16T19:35:29.383101+0000","last_peered":"2024-04-16T19:35:29.383101+0000","last_clean":"2024-04-16T19:35:29.383101+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:35:29.383101+0000","last_undegraded":"2024-04-16T19:35:29.383101+0000","last_fullsized":"2024-04-16T19:35:29.383101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:04.543134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547400+0000","last_change":"2024-04-16T17:46:16.500171+0000","last_active":"2024-04-16T19:33:49.547400+0000","last_peered":"2024-04-16T19:33:49.547400+0000","last_clean":"2024-04-16T19:33:49.547400+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:33:49.547400+0000","last_undegraded":"2024-04-16T19:33:49.547400+0000","last_fullsized":"2024-04-16T19:33:49.547400+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:53:24.673211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382318+0000","last_change":"2024-04-16T17:45:10.397556+0000","last_active":"2024-04-16T19:35:39.382318+0000","last_peered":"2024-04-16T19:35:39.382318+0000","last_clean":"2024-04-16T19:35:39.382318+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:35:39.382318+0000","last_undegraded":"2024-04-16T19:35:39.382318+0000","last_fullsized":"2024-04-16T19:35:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:31.534272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'8","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372376+0000","last_change":"2024-04-16T17:45:45.463411+0000","last_active":"2024-04-16T19:34:34.372376+0000","last_peered":"2024-04-16T19:34:34.372376+0000","last_clean":"2024-04-16T19:34:34.372376+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:34:34.372376+0000","last_undegraded":"2024-04-16T19:34:34.372376+0000","last_fullsized":"2024-04-16T19:34:34.372376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:36:34.046647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377851+0000","last_change":"2024-04-16T17:45:08.383652+0000","last_active":"2024-04-16T19:35:09.377851+0000","last_peered":"2024-04-16T19:35:09.377851+0000","last_clean":"2024-04-16T19:35:09.377851+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:35:09.377851+0000","last_undegraded":"2024-04-16T19:35:09.377851+0000","last_fullsized":"2024-04-16T19:35:09.377851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:04.729085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382949+0000","last_change":"2024-04-16T17:45:10.395876+0000","last_active":"2024-04-16T19:35:39.382949+0000","last_peered":"2024-04-16T19:35:39.382949+0000","last_clean":"2024-04-16T19:35:39.382949+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:35:39.382949+0000","last_undegraded":"2024-04-16T19:35:39.382949+0000","last_fullsized":"2024-04-16T19:35:39.382949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:22.221256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'6","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:29.360665+0000","last_change":"2024-04-16T17:45:45.457177+0000","last_active":"2024-04-16T19:33:29.360665+0000","last_peered":"2024-04-16T19:33:29.360665+0000","last_clean":"2024-04-16T19:33:29.360665+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:33:29.360665+0000","last_undegraded":"2024-04-16T19:33:29.360665+0000","last_fullsized":"2024-04-16T19:33:29.360665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:26.573550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562807+0000","last_change":"2024-04-16T17:45:08.389961+0000","last_active":"2024-04-16T19:35:09.562807+0000","last_peered":"2024-04-16T19:35:09.562807+0000","last_clean":"2024-04-16T19:35:09.562807+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:35:09.562807+0000","last_undegraded":"2024-04-16T19:35:09.562807+0000","last_fullsized":"2024-04-16T19:35:09.562807+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:26.050144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568772+0000","last_change":"2024-04-16T17:45:10.399056+0000","last_active":"2024-04-16T19:35:39.568772+0000","last_peered":"2024-04-16T19:35:39.568772+0000","last_clean":"2024-04-16T19:35:39.568772+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:35:39.568772+0000","last_undegraded":"2024-04-16T19:35:39.568772+0000","last_fullsized":"2024-04-16T19:35:39.568772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:21.082747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'5","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368622+0000","last_change":"2024-04-16T17:45:45.462628+0000","last_active":"2024-04-16T19:34:09.368622+0000","last_peered":"2024-04-16T19:34:09.368622+0000","last_clean":"2024-04-16T19:34:09.368622+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:34:09.368622+0000","last_undegraded":"2024-04-16T19:34:09.368622+0000","last_fullsized":"2024-04-16T19:34:09.368622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374833+0000","last_change":"2024-04-16T17:45:10.394927+0000","last_active":"2024-04-16T19:34:54.374833+0000","last_peered":"2024-04-16T19:34:54.374833+0000","last_clean":"2024-04-16T19:34:54.374833+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:34:54.374833+0000","last_undegraded":"2024-04-16T19:34:54.374833+0000","last_fullsized":"2024-04-16T19:34:54.374833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:24.076247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369185+0000","last_change":"2024-04-16T17:45:08.388693+0000","last_active":"2024-04-16T19:34:14.369185+0000","last_peered":"2024-04-16T19:34:14.369185+0000","last_clean":"2024-04-16T19:34:14.369185+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:34:14.369185+0000","last_undegraded":"2024-04-16T19:34:14.369185+0000","last_fullsized":"2024-04-16T19:34:14.369185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.696516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'6","reported_seq":347,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368195+0000","last_change":"2024-04-16T17:45:45.462192+0000","last_active":"2024-04-16T19:34:09.368195+0000","last_peered":"2024-04-16T19:34:09.368195+0000","last_clean":"2024-04-16T19:34:09.368195+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:34:09.368195+0000","last_undegraded":"2024-04-16T19:34:09.368195+0000","last_fullsized":"2024-04-16T19:34:09.368195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:37.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375417+0000","last_change":"2024-04-16T17:45:10.393548+0000","last_active":"2024-04-16T19:34:54.375417+0000","last_peered":"2024-04-16T19:34:54.375417+0000","last_clean":"2024-04-16T19:34:54.375417+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:34:54.375417+0000","last_undegraded":"2024-04-16T19:34:54.375417+0000","last_fullsized":"2024-04-16T19:34:54.375417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:47.251006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365741+0000","last_change":"2024-04-16T17:45:08.388744+0000","last_active":"2024-04-16T19:33:54.365741+0000","last_peered":"2024-04-16T19:33:54.365741+0000","last_clean":"2024-04-16T19:33:54.365741+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:33:54.365741+0000","last_undegraded":"2024-04-16T19:33:54.365741+0000","last_fullsized":"2024-04-16T19:33:54.365741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'5","reported_seq":511,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551551+0000","last_change":"2024-04-16T17:45:45.456392+0000","last_active":"2024-04-16T19:34:09.551551+0000","last_peered":"2024-04-16T19:34:09.551551+0000","last_clean":"2024-04-16T19:34:09.551551+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:34:09.551551+0000","last_undegraded":"2024-04-16T19:34:09.551551+0000","last_fullsized":"2024-04-16T19:34:09.551551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:58:40.868531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378717+0000","last_change":"2024-04-16T17:45:10.392335+0000","last_active":"2024-04-16T19:35:14.378717+0000","last_peered":"2024-04-16T19:35:14.378717+0000","last_clean":"2024-04-16T19:35:14.378717+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:35:14.378717+0000","last_undegraded":"2024-04-16T19:35:14.378717+0000","last_fullsized":"2024-04-16T19:35:14.378717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:16.297430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365744+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:33:54.365744+0000","last_peered":"2024-04-16T19:33:54.365744+0000","last_clean":"2024-04-16T19:33:54.365744+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:33:54.365744+0000","last_undegraded":"2024-04-16T19:33:54.365744+0000","last_fullsized":"2024-04-16T19:33:54.365744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:36.615698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'10","reported_seq":234,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551468+0000","last_change":"2024-04-16T17:45:45.455448+0000","last_active":"2024-04-16T19:34:09.551468+0000","last_peered":"2024-04-16T19:34:09.551468+0000","last_clean":"2024-04-16T19:34:09.551468+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:34:09.551468+0000","last_undegraded":"2024-04-16T19:34:09.551468+0000","last_fullsized":"2024-04-16T19:34:09.551468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:50.309523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549442+0000","last_change":"2024-04-16T17:45:10.391411+0000","last_active":"2024-04-16T19:33:59.549442+0000","last_peered":"2024-04-16T19:33:59.549442+0000","last_clean":"2024-04-16T19:33:59.549442+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:33:59.549442+0000","last_undegraded":"2024-04-16T19:33:59.549442+0000","last_fullsized":"2024-04-16T19:33:59.549442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:30:53.218689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365154+0000","last_change":"2024-04-16T17:45:08.382324+0000","last_active":"2024-04-16T19:33:54.365154+0000","last_peered":"2024-04-16T19:33:54.365154+0000","last_clean":"2024-04-16T19:33:54.365154+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:33:54.365154+0000","last_undegraded":"2024-04-16T19:33:54.365154+0000","last_fullsized":"2024-04-16T19:33:54.365154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"48'6","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360042+0000","last_change":"2024-04-16T17:45:45.460928+0000","last_active":"2024-04-16T19:33:19.360042+0000","last_peered":"2024-04-16T19:33:19.360042+0000","last_clean":"2024-04-16T19:33:19.360042+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:33:19.360042+0000","last_undegraded":"2024-04-16T19:33:19.360042+0000","last_fullsized":"2024-04-16T19:33:19.360042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549478+0000","last_change":"2024-04-16T17:45:10.393503+0000","last_active":"2024-04-16T19:33:59.549478+0000","last_peered":"2024-04-16T19:33:59.549478+0000","last_clean":"2024-04-16T19:33:59.549478+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:33:59.549478+0000","last_undegraded":"2024-04-16T19:33:59.549478+0000","last_fullsized":"2024-04-16T19:33:59.549478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:06:00.869577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367265+0000","last_change":"2024-04-16T17:45:08.387116+0000","last_active":"2024-04-16T19:33:54.367265+0000","last_peered":"2024-04-16T19:33:54.367265+0000","last_clean":"2024-04-16T19:33:54.367265+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:33:54.367265+0000","last_undegraded":"2024-04-16T19:33:54.367265+0000","last_fullsized":"2024-04-16T19:33:54.367265+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:04.729085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"48'1","reported_seq":222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541511+0000","last_change":"2024-04-16T17:45:45.455236+0000","last_active":"2024-04-16T19:33:19.541511+0000","last_peered":"2024-04-16T19:33:19.541511+0000","last_clean":"2024-04-16T19:33:19.541511+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:33:19.541511+0000","last_undegraded":"2024-04-16T19:33:19.541511+0000","last_fullsized":"2024-04-16T19:33:19.541511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:40.520396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366097+0000","last_change":"2024-04-16T17:45:10.397627+0000","last_active":"2024-04-16T19:33:59.366097+0000","last_peered":"2024-04-16T19:33:59.366097+0000","last_clean":"2024-04-16T19:33:59.366097+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:33:59.366097+0000","last_undegraded":"2024-04-16T19:33:59.366097+0000","last_fullsized":"2024-04-16T19:33:59.366097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:50.581378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.548455+0000","last_change":"2024-04-16T17:46:16.498581+0000","last_active":"2024-04-16T19:33:54.548455+0000","last_peered":"2024-04-16T19:33:54.548455+0000","last_clean":"2024-04-16T19:33:54.548455+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:33:54.548455+0000","last_undegraded":"2024-04-16T19:33:54.548455+0000","last_fullsized":"2024-04-16T19:33:54.548455+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:53.339943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555516+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:34:29.555516+0000","last_peered":"2024-04-16T19:34:29.555516+0000","last_clean":"2024-04-16T19:34:29.555516+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:34:29.555516+0000","last_undegraded":"2024-04-16T19:34:29.555516+0000","last_fullsized":"2024-04-16T19:34:29.555516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:29:46.401023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'145","reported_seq":2257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374839+0000","last_change":"2024-04-16T17:46:25.527767+0000","last_active":"2024-04-16T19:34:49.374839+0000","last_peered":"2024-04-16T19:34:49.374839+0000","last_clean":"2024-04-16T19:34:49.374839+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:34:49.374839+0000","last_undegraded":"2024-04-16T19:34:49.374839+0000","last_fullsized":"2024-04-16T19:34:49.374839+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:25.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364929+0000","last_change":"2024-04-16T17:46:17.511976+0000","last_active":"2024-04-16T19:33:49.364929+0000","last_peered":"2024-04-16T19:33:49.364929+0000","last_clean":"2024-04-16T19:33:49.364929+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:33:49.364929+0000","last_undegraded":"2024-04-16T19:33:49.364929+0000","last_fullsized":"2024-04-16T19:33:49.364929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'20","reported_seq":156,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.362629+0000","last_change":"2024-04-16T17:45:51.478677+0000","last_active":"2024-04-16T19:33:24.362629+0000","last_peered":"2024-04-16T19:33:24.362629+0000","last_clean":"2024-04-16T19:33:24.362629+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:33:24.362629+0000","last_undegraded":"2024-04-16T19:33:24.362629+0000","last_fullsized":"2024-04-16T19:33:24.362629+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:04.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359188+0000","last_change":"2024-04-16T17:45:49.472385+0000","last_active":"2024-04-16T19:33:19.359188+0000","last_peered":"2024-04-16T19:33:19.359188+0000","last_clean":"2024-04-16T19:33:19.359188+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:33:19.359188+0000","last_undegraded":"2024-04-16T19:33:19.359188+0000","last_fullsized":"2024-04-16T19:33:19.359188+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:24.302917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'243","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360107+0000","last_change":"2024-04-16T17:45:47.462219+0000","last_active":"2024-04-16T19:33:19.360107+0000","last_peered":"2024-04-16T19:33:19.360107+0000","last_clean":"2024-04-16T19:33:19.360107+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:33:19.360107+0000","last_undegraded":"2024-04-16T19:33:19.360107+0000","last_fullsized":"2024-04-16T19:33:19.360107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:34.349862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'9","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379588+0000","last_change":"2024-04-16T17:46:16.500449+0000","last_active":"2024-04-16T19:35:24.379588+0000","last_peered":"2024-04-16T19:35:24.379588+0000","last_clean":"2024-04-16T19:35:24.379588+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:35:24.379588+0000","last_undegraded":"2024-04-16T19:35:24.379588+0000","last_fullsized":"2024-04-16T19:35:24.379588+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368583+0000","last_change":"2024-04-16T17:45:26.430602+0000","last_active":"2024-04-16T19:34:14.368583+0000","last_peered":"2024-04-16T19:34:14.368583+0000","last_clean":"2024-04-16T19:34:14.368583+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:34:14.368583+0000","last_undegraded":"2024-04-16T19:34:14.368583+0000","last_fullsized":"2024-04-16T19:34:14.368583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:21.500912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562932+0000","last_change":"2024-04-16T17:45:10.400976+0000","last_active":"2024-04-16T19:35:09.562932+0000","last_peered":"2024-04-16T19:35:09.562932+0000","last_clean":"2024-04-16T19:35:09.562932+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:35:09.562932+0000","last_undegraded":"2024-04-16T19:35:09.562932+0000","last_fullsized":"2024-04-16T19:35:09.562932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:58.273468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374754+0000","last_change":"2024-04-16T17:45:08.388375+0000","last_active":"2024-04-16T19:34:49.374754+0000","last_peered":"2024-04-16T19:34:49.374754+0000","last_clean":"2024-04-16T19:34:49.374754+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:34:49.374754+0000","last_undegraded":"2024-04-16T19:34:49.374754+0000","last_fullsized":"2024-04-16T19:34:49.374754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:23.980045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368590+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:34:09.368590+0000","last_peered":"2024-04-16T19:34:09.368590+0000","last_clean":"2024-04-16T19:34:09.368590+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:34:09.368590+0000","last_undegraded":"2024-04-16T19:34:09.368590+0000","last_fullsized":"2024-04-16T19:34:09.368590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:29.584282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370069+0000","last_change":"2024-04-16T17:45:22.417279+0000","last_active":"2024-04-16T19:34:09.370069+0000","last_peered":"2024-04-16T19:34:09.370069+0000","last_clean":"2024-04-16T19:34:09.370069+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:34:09.370069+0000","last_undegraded":"2024-04-16T19:34:09.370069+0000","last_fullsized":"2024-04-16T19:34:09.370069+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:45.675762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368788+0000","last_change":"2024-04-16T17:45:24.425550+0000","last_active":"2024-04-16T19:34:09.368788+0000","last_peered":"2024-04-16T19:34:09.368788+0000","last_clean":"2024-04-16T19:34:09.368788+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:34:09.368788+0000","last_undegraded":"2024-04-16T19:34:09.368788+0000","last_fullsized":"2024-04-16T19:34:09.368788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:35.470227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.565057+0000","last_change":"2024-04-16T18:09:02.170333+0000","last_active":"2024-04-16T19:35:19.565057+0000","last_peered":"2024-04-16T19:35:19.565057+0000","last_clean":"2024-04-16T19:35:19.565057+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:35:19.565057+0000","last_undegraded":"2024-04-16T19:35:19.565057+0000","last_fullsized":"2024-04-16T19:35:19.565057+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:27:55.951446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1987,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382967+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:35:39.382967+0000","last_peered":"2024-04-16T19:35:39.382967+0000","last_clean":"2024-04-16T19:35:39.382967+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:35:39.382967+0000","last_undegraded":"2024-04-16T19:35:39.382967+0000","last_fullsized":"2024-04-16T19:35:39.382967+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:13:06.759819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:46:17.506966+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'7","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.362660+0000","last_change":"2024-04-16T17:45:51.478975+0000","last_active":"2024-04-16T19:33:24.362660+0000","last_peered":"2024-04-16T19:33:24.362660+0000","last_clean":"2024-04-16T19:33:24.362660+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:33:24.362660+0000","last_undegraded":"2024-04-16T19:33:24.362660+0000","last_fullsized":"2024-04-16T19:33:24.362660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:26.313448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359820+0000","last_change":"2024-04-16T17:45:49.473313+0000","last_active":"2024-04-16T19:33:19.359820+0000","last_peered":"2024-04-16T19:33:19.359820+0000","last_clean":"2024-04-16T19:33:19.359820+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:33:19.359820+0000","last_undegraded":"2024-04-16T19:33:19.359820+0000","last_fullsized":"2024-04-16T19:33:19.359820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:36.356992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'189","reported_seq":458,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541651+0000","last_change":"2024-04-16T17:45:47.463699+0000","last_active":"2024-04-16T19:33:19.541651+0000","last_peered":"2024-04-16T19:33:19.541651+0000","last_clean":"2024-04-16T19:33:19.541651+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:33:19.541651+0000","last_undegraded":"2024-04-16T19:33:19.541651+0000","last_fullsized":"2024-04-16T19:33:19.541651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:18:11.449981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'28","reported_seq":315,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372405+0000","last_change":"2024-04-16T17:45:45.456848+0000","last_active":"2024-04-16T19:34:34.372405+0000","last_peered":"2024-04-16T19:34:34.372405+0000","last_clean":"2024-04-16T19:34:34.372405+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:34:34.372405+0000","last_undegraded":"2024-04-16T19:34:34.372405+0000","last_fullsized":"2024-04-16T19:34:34.372405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:38.609449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:26.439840+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.458913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366576+0000","last_change":"2024-04-16T17:45:10.395070+0000","last_active":"2024-04-16T19:33:59.366576+0000","last_peered":"2024-04-16T19:33:59.366576+0000","last_clean":"2024-04-16T19:33:59.366576+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:33:59.366576+0000","last_undegraded":"2024-04-16T19:33:59.366576+0000","last_fullsized":"2024-04-16T19:33:59.366576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:00.458421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376338+0000","last_change":"2024-04-16T17:45:08.390752+0000","last_active":"2024-04-16T19:34:49.376338+0000","last_peered":"2024-04-16T19:34:49.376338+0000","last_clean":"2024-04-16T19:34:49.376338+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:34:49.376338+0000","last_undegraded":"2024-04-16T19:34:49.376338+0000","last_fullsized":"2024-04-16T19:34:49.376338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:51.718429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"48'17","reported_seq":894,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382229+0000","last_change":"2024-04-16T17:45:20.413278+0000","last_active":"2024-04-16T19:35:24.382229+0000","last_peered":"2024-04-16T19:35:24.382229+0000","last_clean":"2024-04-16T19:35:24.382229+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:35:24.382229+0000","last_undegraded":"2024-04-16T19:35:24.382229+0000","last_fullsized":"2024-04-16T19:35:24.382229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:21:09.196060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'72","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368021+0000","last_change":"2024-04-16T17:45:22.414776+0000","last_active":"2024-04-16T19:34:09.368021+0000","last_peered":"2024-04-16T19:34:09.368021+0000","last_clean":"2024-04-16T19:34:09.368021+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:34:09.368021+0000","last_undegraded":"2024-04-16T19:34:09.368021+0000","last_fullsized":"2024-04-16T19:34:09.368021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:22.839078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367997+0000","last_change":"2024-04-16T17:45:24.423655+0000","last_active":"2024-04-16T19:34:09.367997+0000","last_peered":"2024-04-16T19:34:09.367997+0000","last_clean":"2024-04-16T19:34:09.367997+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:34:09.367997+0000","last_undegraded":"2024-04-16T19:34:09.367997+0000","last_fullsized":"2024-04-16T19:34:09.367997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:24.311652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366892+0000","last_change":"2024-04-16T18:09:02.164735+0000","last_active":"2024-04-16T19:34:04.366892+0000","last_peered":"2024-04-16T19:34:04.366892+0000","last_clean":"2024-04-16T19:34:04.366892+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:34:04.366892+0000","last_undegraded":"2024-04-16T19:34:04.366892+0000","last_fullsized":"2024-04-16T19:34:04.366892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:53:57.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'228","reported_seq":2120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368272+0000","last_change":"2024-04-16T17:46:25.526441+0000","last_active":"2024-04-16T19:33:59.368272+0000","last_peered":"2024-04-16T19:33:59.368272+0000","last_clean":"2024-04-16T19:33:59.368272+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:33:59.368272+0000","last_undegraded":"2024-04-16T19:33:59.368272+0000","last_fullsized":"2024-04-16T19:33:59.368272+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:53:10.911757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372528+0000","last_change":"2024-04-16T17:46:17.506064+0000","last_active":"2024-04-16T19:34:39.372528+0000","last_peered":"2024-04-16T19:34:39.372528+0000","last_clean":"2024-04-16T19:34:39.372528+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:34:39.372528+0000","last_undegraded":"2024-04-16T19:34:39.372528+0000","last_fullsized":"2024-04-16T19:34:39.372528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:04.395735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'7","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368727+0000","last_change":"2024-04-16T17:45:51.480549+0000","last_active":"2024-04-16T19:34:14.368727+0000","last_peered":"2024-04-16T19:34:14.368727+0000","last_clean":"2024-04-16T19:34:14.368727+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:34:14.368727+0000","last_undegraded":"2024-04-16T19:34:14.368727+0000","last_fullsized":"2024-04-16T19:34:14.368727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:40.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.377125+0000","last_change":"2024-04-16T17:45:49.476408+0000","last_active":"2024-04-16T19:34:54.377125+0000","last_peered":"2024-04-16T19:34:54.377125+0000","last_clean":"2024-04-16T19:34:54.377125+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:34:54.377125+0000","last_undegraded":"2024-04-16T19:34:54.377125+0000","last_fullsized":"2024-04-16T19:34:54.377125+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:00.700374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'266","reported_seq":586,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556354+0000","last_change":"2024-04-16T17:45:47.458082+0000","last_active":"2024-04-16T19:34:34.556354+0000","last_peered":"2024-04-16T19:34:34.556354+0000","last_clean":"2024-04-16T19:34:34.556354+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:34:34.556354+0000","last_undegraded":"2024-04-16T19:34:34.556354+0000","last_fullsized":"2024-04-16T19:34:34.556354+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:28.580742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'11","reported_seq":187,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361676+0000","last_change":"2024-04-16T17:45:45.463326+0000","last_active":"2024-04-16T19:33:19.361676+0000","last_peered":"2024-04-16T19:33:19.361676+0000","last_clean":"2024-04-16T19:33:19.361676+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:33:19.361676+0000","last_undegraded":"2024-04-16T19:33:19.361676+0000","last_fullsized":"2024-04-16T19:33:19.361676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:14.781901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383151+0000","last_change":"2024-04-16T17:45:26.438624+0000","last_active":"2024-04-16T19:35:29.383151+0000","last_peered":"2024-04-16T19:35:29.383151+0000","last_clean":"2024-04-16T19:35:29.383151+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:35:29.383151+0000","last_undegraded":"2024-04-16T19:35:29.383151+0000","last_fullsized":"2024-04-16T19:35:29.383151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:47.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368347+0000","last_change":"2024-04-16T17:45:10.398271+0000","last_active":"2024-04-16T19:33:59.368347+0000","last_peered":"2024-04-16T19:33:59.368347+0000","last_clean":"2024-04-16T19:33:59.368347+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:33:59.368347+0000","last_undegraded":"2024-04-16T19:33:59.368347+0000","last_fullsized":"2024-04-16T19:33:59.368347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:27.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374677+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:34:49.374677+0000","last_peered":"2024-04-16T19:34:49.374677+0000","last_clean":"2024-04-16T19:34:49.374677+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:34:49.374677+0000","last_undegraded":"2024-04-16T19:34:49.374677+0000","last_fullsized":"2024-04-16T19:34:49.374677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:37.582239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551538+0000","last_change":"2024-04-16T17:45:20.406137+0000","last_active":"2024-04-16T19:34:09.551538+0000","last_peered":"2024-04-16T19:34:09.551538+0000","last_clean":"2024-04-16T19:34:09.551538+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:34:09.551538+0000","last_undegraded":"2024-04-16T19:34:09.551538+0000","last_fullsized":"2024-04-16T19:34:09.551538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:49.607445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'120","reported_seq":294,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.565010+0000","last_change":"2024-04-16T17:45:22.421567+0000","last_active":"2024-04-16T19:35:19.565010+0000","last_peered":"2024-04-16T19:35:19.565010+0000","last_clean":"2024-04-16T19:35:19.565010+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:35:19.565010+0000","last_undegraded":"2024-04-16T19:35:19.565010+0000","last_fullsized":"2024-04-16T19:35:19.565010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:08.015854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'12","reported_seq":1387,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368244+0000","last_change":"2024-04-16T17:45:24.425583+0000","last_active":"2024-04-16T19:34:09.368244+0000","last_peered":"2024-04-16T19:34:09.368244+0000","last_clean":"2024-04-16T19:34:09.368244+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:34:09.368244+0000","last_undegraded":"2024-04-16T19:34:09.368244+0000","last_fullsized":"2024-04-16T19:34:09.368244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:56.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550442+0000","last_change":"2024-04-16T18:09:02.169752+0000","last_active":"2024-04-16T19:34:04.550442+0000","last_peered":"2024-04-16T19:34:04.550442+0000","last_clean":"2024-04-16T19:34:04.550442+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:34:04.550442+0000","last_undegraded":"2024-04-16T19:34:04.550442+0000","last_fullsized":"2024-04-16T19:34:04.550442+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:22:34.279270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'151","reported_seq":2294,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368309+0000","last_change":"2024-04-16T17:46:25.529267+0000","last_active":"2024-04-16T19:33:59.368309+0000","last_peered":"2024-04-16T19:33:59.368309+0000","last_clean":"2024-04-16T19:33:59.368309+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:33:59.368309+0000","last_undegraded":"2024-04-16T19:33:59.368309+0000","last_fullsized":"2024-04-16T19:33:59.368309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:31.289154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372494+0000","last_change":"2024-04-16T17:46:17.509588+0000","last_active":"2024-04-16T19:34:39.372494+0000","last_peered":"2024-04-16T19:34:39.372494+0000","last_clean":"2024-04-16T19:34:39.372494+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:34:39.372494+0000","last_undegraded":"2024-04-16T19:34:39.372494+0000","last_fullsized":"2024-04-16T19:34:39.372494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:18:19.084200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'9","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369221+0000","last_change":"2024-04-16T17:45:51.478968+0000","last_active":"2024-04-16T19:34:14.369221+0000","last_peered":"2024-04-16T19:34:14.369221+0000","last_clean":"2024-04-16T19:34:14.369221+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:34:14.369221+0000","last_undegraded":"2024-04-16T19:34:14.369221+0000","last_fullsized":"2024-04-16T19:34:14.369221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556324+0000","last_change":"2024-04-16T17:45:49.463675+0000","last_active":"2024-04-16T19:34:34.556324+0000","last_peered":"2024-04-16T19:34:34.556324+0000","last_clean":"2024-04-16T19:34:34.556324+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:34:34.556324+0000","last_undegraded":"2024-04-16T19:34:34.556324+0000","last_fullsized":"2024-04-16T19:34:34.556324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:07:05.659899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5965","reported_seq":12521,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559078+0000","last_change":"2024-04-16T17:45:47.459844+0000","last_active":"2024-04-16T19:34:49.559078+0000","last_peered":"2024-04-16T19:34:49.559078+0000","last_clean":"2024-04-16T19:34:49.559078+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:34:49.559078+0000","last_undegraded":"2024-04-16T19:34:49.559078+0000","last_fullsized":"2024-04-16T19:34:49.559078+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1765,"log_dups_size":3000,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:32.414801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'8","reported_seq":567,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541614+0000","last_change":"2024-04-16T17:45:45.457864+0000","last_active":"2024-04-16T19:33:19.541614+0000","last_peered":"2024-04-16T19:33:19.541614+0000","last_clean":"2024-04-16T19:33:19.541614+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:33:19.541614+0000","last_undegraded":"2024-04-16T19:33:19.541614+0000","last_fullsized":"2024-04-16T19:33:19.541614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.288595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380397+0000","last_change":"2024-04-16T17:45:26.848748+0000","last_active":"2024-04-16T19:35:29.380397+0000","last_peered":"2024-04-16T19:35:29.380397+0000","last_clean":"2024-04-16T19:35:29.380397+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:35:29.380397+0000","last_undegraded":"2024-04-16T19:35:29.380397+0000","last_fullsized":"2024-04-16T19:35:29.380397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:47.873610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368378+0000","last_change":"2024-04-16T17:45:10.391762+0000","last_active":"2024-04-16T19:33:59.368378+0000","last_peered":"2024-04-16T19:33:59.368378+0000","last_clean":"2024-04-16T19:33:59.368378+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:33:59.368378+0000","last_undegraded":"2024-04-16T19:33:59.368378+0000","last_fullsized":"2024-04-16T19:33:59.368378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:22:56.234389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374595+0000","last_change":"2024-04-16T17:45:08.387257+0000","last_active":"2024-04-16T19:34:49.374595+0000","last_peered":"2024-04-16T19:34:49.374595+0000","last_clean":"2024-04-16T19:34:49.374595+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:34:49.374595+0000","last_undegraded":"2024-04-16T19:34:49.374595+0000","last_fullsized":"2024-04-16T19:34:49.374595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"48'1","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368272+0000","last_change":"2024-04-16T17:45:20.405143+0000","last_active":"2024-04-16T19:34:09.368272+0000","last_peered":"2024-04-16T19:34:09.368272+0000","last_clean":"2024-04-16T19:34:09.368272+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:34:09.368272+0000","last_undegraded":"2024-04-16T19:34:09.368272+0000","last_fullsized":"2024-04-16T19:34:09.368272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:09.457037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368233+0000","last_change":"2024-04-16T17:45:22.421942+0000","last_active":"2024-04-16T19:34:09.368233+0000","last_peered":"2024-04-16T19:34:09.368233+0000","last_clean":"2024-04-16T19:34:09.368233+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:34:09.368233+0000","last_undegraded":"2024-04-16T19:34:09.368233+0000","last_fullsized":"2024-04-16T19:34:09.368233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:15.139787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'12","reported_seq":1389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564929+0000","last_change":"2024-04-16T17:45:24.424033+0000","last_active":"2024-04-16T19:35:19.564929+0000","last_peered":"2024-04-16T19:35:19.564929+0000","last_clean":"2024-04-16T19:35:19.564929+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:35:19.564929+0000","last_undegraded":"2024-04-16T19:35:19.564929+0000","last_fullsized":"2024-04-16T19:35:19.564929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:45.865876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370952+0000","last_change":"2024-04-16T18:09:02.168123+0000","last_active":"2024-04-16T19:34:29.370952+0000","last_peered":"2024-04-16T19:34:29.370952+0000","last_clean":"2024-04-16T19:34:29.370952+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:34:29.370952+0000","last_undegraded":"2024-04-16T19:34:29.370952+0000","last_fullsized":"2024-04-16T19:34:29.370952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:02.737644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374715+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:34:49.374715+0000","last_peered":"2024-04-16T19:34:49.374715+0000","last_clean":"2024-04-16T19:34:49.374715+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:34:49.374715+0000","last_undegraded":"2024-04-16T19:34:49.374715+0000","last_fullsized":"2024-04-16T19:34:49.374715+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:18:49.538603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373127+0000","last_change":"2024-04-16T17:46:17.508941+0000","last_active":"2024-04-16T19:34:39.373127+0000","last_peered":"2024-04-16T19:34:39.373127+0000","last_clean":"2024-04-16T19:34:39.373127+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:34:39.373127+0000","last_undegraded":"2024-04-16T19:34:39.373127+0000","last_fullsized":"2024-04-16T19:34:39.373127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'11","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368550+0000","last_change":"2024-04-16T17:45:51.478686+0000","last_active":"2024-04-16T19:34:14.368550+0000","last_peered":"2024-04-16T19:34:14.368550+0000","last_clean":"2024-04-16T19:34:14.368550+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:34:14.368550+0000","last_undegraded":"2024-04-16T19:34:14.368550+0000","last_fullsized":"2024-04-16T19:34:14.368550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:45.109744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368764+0000","last_change":"2024-04-16T17:45:49.469263+0000","last_active":"2024-04-16T19:34:09.368764+0000","last_peered":"2024-04-16T19:34:09.368764+0000","last_clean":"2024-04-16T19:34:09.368764+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:34:09.368764+0000","last_undegraded":"2024-04-16T19:34:09.368764+0000","last_fullsized":"2024-04-16T19:34:09.368764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:05.755199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1575","reported_seq":46963,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368707+0000","last_change":"2024-04-16T17:45:47.466556+0000","last_active":"2024-04-16T19:34:09.368707+0000","last_peered":"2024-04-16T19:34:09.368707+0000","last_clean":"2024-04-16T19:34:09.368707+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:34:09.368707+0000","last_undegraded":"2024-04-16T19:34:09.368707+0000","last_fullsized":"2024-04-16T19:34:09.368707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:29.536656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'6","reported_seq":221,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373464+0000","last_change":"2024-04-16T17:45:45.466165+0000","last_active":"2024-04-16T19:34:29.373464+0000","last_peered":"2024-04-16T19:34:29.373464+0000","last_clean":"2024-04-16T19:34:29.373464+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:34:29.373464+0000","last_undegraded":"2024-04-16T19:34:29.373464+0000","last_fullsized":"2024-04-16T19:34:29.373464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:40:58.879936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383551+0000","last_change":"2024-04-16T17:45:10.393324+0000","last_active":"2024-04-16T19:35:44.383551+0000","last_peered":"2024-04-16T19:35:44.383551+0000","last_clean":"2024-04-16T19:35:44.383551+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:35:44.383551+0000","last_undegraded":"2024-04-16T19:35:44.383551+0000","last_fullsized":"2024-04-16T19:35:44.383551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:27.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383794+0000","last_change":"2024-04-16T17:45:08.389843+0000","last_active":"2024-04-16T19:35:44.383794+0000","last_peered":"2024-04-16T19:35:44.383794+0000","last_clean":"2024-04-16T19:35:44.383794+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:35:44.383794+0000","last_undegraded":"2024-04-16T19:35:44.383794+0000","last_fullsized":"2024-04-16T19:35:44.383794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"48'5","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385115+0000","last_change":"2024-04-16T17:45:20.407401+0000","last_active":"2024-04-16T19:35:54.385115+0000","last_peered":"2024-04-16T19:35:54.385115+0000","last_clean":"2024-04-16T19:35:54.385115+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:35:54.385115+0000","last_undegraded":"2024-04-16T19:35:54.385115+0000","last_fullsized":"2024-04-16T19:35:54.385115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:50.080567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'200","reported_seq":422,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367499+0000","last_change":"2024-04-16T17:45:22.417459+0000","last_active":"2024-04-16T19:34:04.367499+0000","last_peered":"2024-04-16T19:34:04.367499+0000","last_clean":"2024-04-16T19:34:04.367499+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:34:04.367499+0000","last_undegraded":"2024-04-16T19:34:04.367499+0000","last_fullsized":"2024-04-16T19:34:04.367499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:29.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568642+0000","last_change":"2024-04-16T17:45:24.430630+0000","last_active":"2024-04-16T19:35:39.568642+0000","last_peered":"2024-04-16T19:35:39.568642+0000","last_clean":"2024-04-16T19:35:39.568642+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:35:39.568642+0000","last_undegraded":"2024-04-16T19:35:39.568642+0000","last_fullsized":"2024-04-16T19:35:39.568642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:31.152537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385225+0000","last_change":"2024-04-16T17:45:26.438929+0000","last_active":"2024-04-16T19:35:54.385225+0000","last_peered":"2024-04-16T19:35:54.385225+0000","last_clean":"2024-04-16T19:35:54.385225+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:35:54.385225+0000","last_undegraded":"2024-04-16T19:35:54.385225+0000","last_fullsized":"2024-04-16T19:35:54.385225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:58.263370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555397+0000","last_change":"2024-04-16T18:09:02.169539+0000","last_active":"2024-04-16T19:34:29.555397+0000","last_peered":"2024-04-16T19:34:29.555397+0000","last_clean":"2024-04-16T19:34:29.555397+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:34:29.555397+0000","last_undegraded":"2024-04-16T19:34:29.555397+0000","last_fullsized":"2024-04-16T19:34:29.555397+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:10.869988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376408+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:34:49.376408+0000","last_peered":"2024-04-16T19:34:49.376408+0000","last_clean":"2024-04-16T19:34:49.376408+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:34:49.376408+0000","last_undegraded":"2024-04-16T19:34:49.376408+0000","last_fullsized":"2024-04-16T19:34:49.376408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:08:21.896379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373066+0000","last_change":"2024-04-16T17:46:17.512578+0000","last_active":"2024-04-16T19:34:39.373066+0000","last_peered":"2024-04-16T19:34:39.373066+0000","last_clean":"2024-04-16T19:34:39.373066+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:34:39.373066+0000","last_undegraded":"2024-04-16T19:34:39.373066+0000","last_fullsized":"2024-04-16T19:34:39.373066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"48'3","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368951+0000","last_change":"2024-04-16T17:45:51.480862+0000","last_active":"2024-04-16T19:34:14.368951+0000","last_peered":"2024-04-16T19:34:14.368951+0000","last_clean":"2024-04-16T19:34:14.368951+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:34:14.368951+0000","last_undegraded":"2024-04-16T19:34:14.368951+0000","last_fullsized":"2024-04-16T19:34:14.368951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:04.680783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370021+0000","last_change":"2024-04-16T17:45:49.473179+0000","last_active":"2024-04-16T19:34:09.370021+0000","last_peered":"2024-04-16T19:34:09.370021+0000","last_clean":"2024-04-16T19:34:09.370021+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:34:09.370021+0000","last_undegraded":"2024-04-16T19:34:09.370021+0000","last_fullsized":"2024-04-16T19:34:09.370021+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:05.755199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'338","reported_seq":637,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368333+0000","last_change":"2024-04-16T17:45:47.458262+0000","last_active":"2024-04-16T19:34:09.368333+0000","last_peered":"2024-04-16T19:34:09.368333+0000","last_clean":"2024-04-16T19:34:09.368333+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:34:09.368333+0000","last_undegraded":"2024-04-16T19:34:09.368333+0000","last_fullsized":"2024-04-16T19:34:09.368333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:56.475222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'10","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551369+0000","last_change":"2024-04-16T17:45:45.466171+0000","last_active":"2024-04-16T19:34:09.551369+0000","last_peered":"2024-04-16T19:34:09.551369+0000","last_clean":"2024-04-16T19:34:09.551369+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:34:09.551369+0000","last_undegraded":"2024-04-16T19:34:09.551369+0000","last_fullsized":"2024-04-16T19:34:09.551369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:55:30.430838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.382936+0000","last_change":"2024-04-16T17:45:10.402167+0000","last_active":"2024-04-16T19:35:44.382936+0000","last_peered":"2024-04-16T19:35:44.382936+0000","last_clean":"2024-04-16T19:35:44.382936+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:35:44.382936+0000","last_undegraded":"2024-04-16T19:35:44.382936+0000","last_fullsized":"2024-04-16T19:35:44.382936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:38.623160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380567+0000","last_change":"2024-04-16T17:45:08.388824+0000","last_active":"2024-04-16T19:35:24.380567+0000","last_peered":"2024-04-16T19:35:24.380567+0000","last_clean":"2024-04-16T19:35:24.380567+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:35:24.380567+0000","last_undegraded":"2024-04-16T19:35:24.380567+0000","last_fullsized":"2024-04-16T19:35:24.380567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546334+0000","last_change":"2024-04-16T17:45:20.407298+0000","last_active":"2024-04-16T19:33:44.546334+0000","last_peered":"2024-04-16T19:33:44.546334+0000","last_clean":"2024-04-16T19:33:44.546334+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:33:44.546334+0000","last_undegraded":"2024-04-16T19:33:44.546334+0000","last_fullsized":"2024-04-16T19:33:44.546334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:10.777542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'80","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568625+0000","last_change":"2024-04-16T17:45:22.422669+0000","last_active":"2024-04-16T19:35:39.568625+0000","last_peered":"2024-04-16T19:35:39.568625+0000","last_clean":"2024-04-16T19:35:39.568625+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:35:39.568625+0000","last_undegraded":"2024-04-16T19:35:39.568625+0000","last_fullsized":"2024-04-16T19:35:39.568625+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:31.592115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549386+0000","last_change":"2024-04-16T17:45:24.425962+0000","last_active":"2024-04-16T19:33:59.549386+0000","last_peered":"2024-04-16T19:33:59.549386+0000","last_clean":"2024-04-16T19:33:59.549386+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:33:59.549386+0000","last_undegraded":"2024-04-16T19:33:59.549386+0000","last_fullsized":"2024-04-16T19:33:59.549386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:55.736964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367958+0000","last_change":"2024-04-16T17:45:26.429668+0000","last_active":"2024-04-16T19:34:09.367958+0000","last_peered":"2024-04-16T19:34:09.367958+0000","last_clean":"2024-04-16T19:34:09.367958+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:34:09.367958+0000","last_undegraded":"2024-04-16T19:34:09.367958+0000","last_fullsized":"2024-04-16T19:34:09.367958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:33.160271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371461+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:34:29.371461+0000","last_peered":"2024-04-16T19:34:29.371461+0000","last_clean":"2024-04-16T19:34:29.371461+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:34:29.371461+0000","last_undegraded":"2024-04-16T19:34:29.371461+0000","last_fullsized":"2024-04-16T19:34:29.371461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'120","reported_seq":2585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.558155+0000","last_change":"2024-04-16T17:46:25.531706+0000","last_active":"2024-04-16T19:34:44.558155+0000","last_peered":"2024-04-16T19:34:44.558155+0000","last_clean":"2024-04-16T19:34:44.558155+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:34:44.558155+0000","last_undegraded":"2024-04-16T19:34:44.558155+0000","last_fullsized":"2024-04-16T19:34:44.558155+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:32:15.106046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.374879+0000","last_change":"2024-04-16T17:46:17.508571+0000","last_active":"2024-04-16T19:34:39.374879+0000","last_peered":"2024-04-16T19:34:39.374879+0000","last_clean":"2024-04-16T19:34:39.374879+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:34:39.374879+0000","last_undegraded":"2024-04-16T19:34:39.374879+0000","last_fullsized":"2024-04-16T19:34:39.374879+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'18","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369024+0000","last_change":"2024-04-16T17:45:51.479804+0000","last_active":"2024-04-16T19:34:14.369024+0000","last_peered":"2024-04-16T19:34:14.369024+0000","last_clean":"2024-04-16T19:34:14.369024+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:34:14.369024+0000","last_undegraded":"2024-04-16T19:34:14.369024+0000","last_fullsized":"2024-04-16T19:34:14.369024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:04.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370998+0000","last_change":"2024-04-16T17:45:49.471470+0000","last_active":"2024-04-16T19:34:29.370998+0000","last_peered":"2024-04-16T19:34:29.370998+0000","last_clean":"2024-04-16T19:34:29.370998+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:34:29.370998+0000","last_undegraded":"2024-04-16T19:34:29.370998+0000","last_fullsized":"2024-04-16T19:34:29.370998+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:24.434279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'907","reported_seq":3798,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369979+0000","last_change":"2024-04-16T17:45:47.466560+0000","last_active":"2024-04-16T19:34:09.369979+0000","last_peered":"2024-04-16T19:34:09.369979+0000","last_clean":"2024-04-16T19:34:09.369979+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:34:09.369979+0000","last_undegraded":"2024-04-16T19:34:09.369979+0000","last_fullsized":"2024-04-16T19:34:09.369979+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:24.659574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'18","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368748+0000","last_change":"2024-04-16T17:45:45.464240+0000","last_active":"2024-04-16T19:34:09.368748+0000","last_peered":"2024-04-16T19:34:09.368748+0000","last_clean":"2024-04-16T19:34:09.368748+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:34:09.368748+0000","last_undegraded":"2024-04-16T19:34:09.368748+0000","last_fullsized":"2024-04-16T19:34:09.368748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:26.089403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365646+0000","last_change":"2024-04-16T17:45:10.394156+0000","last_active":"2024-04-16T19:33:54.365646+0000","last_peered":"2024-04-16T19:33:54.365646+0000","last_clean":"2024-04-16T19:33:54.365646+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:33:54.365646+0000","last_undegraded":"2024-04-16T19:33:54.365646+0000","last_fullsized":"2024-04-16T19:33:54.365646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:04.267541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.553316+0000","last_change":"2024-04-16T17:46:16.499439+0000","last_active":"2024-04-16T19:34:19.553316+0000","last_peered":"2024-04-16T19:34:19.553316+0000","last_clean":"2024-04-16T19:34:19.553316+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:34:19.553316+0000","last_undegraded":"2024-04-16T19:34:19.553316+0000","last_fullsized":"2024-04-16T19:34:19.553316+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:25:19.618386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568606+0000","last_change":"2024-04-16T17:45:20.408040+0000","last_active":"2024-04-16T19:35:39.568606+0000","last_peered":"2024-04-16T19:35:39.568606+0000","last_clean":"2024-04-16T19:35:39.568606+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:35:39.568606+0000","last_undegraded":"2024-04-16T19:35:39.568606+0000","last_fullsized":"2024-04-16T19:35:39.568606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:19.875311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'152","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385171+0000","last_change":"2024-04-16T17:45:22.415394+0000","last_active":"2024-04-16T19:35:54.385171+0000","last_peered":"2024-04-16T19:35:54.385171+0000","last_clean":"2024-04-16T19:35:54.385171+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:35:54.385171+0000","last_undegraded":"2024-04-16T19:35:54.385171+0000","last_fullsized":"2024-04-16T19:35:54.385171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:27.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'12","reported_seq":1393,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387342+0000","last_change":"2024-04-16T17:45:24.424024+0000","last_active":"2024-04-16T19:35:54.387342+0000","last_peered":"2024-04-16T19:35:54.387342+0000","last_clean":"2024-04-16T19:35:54.387342+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:35:54.387342+0000","last_undegraded":"2024-04-16T19:35:54.387342+0000","last_fullsized":"2024-04-16T19:35:54.387342+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:55.371897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366654+0000","last_change":"2024-04-16T17:45:26.438562+0000","last_active":"2024-04-16T19:33:49.366654+0000","last_peered":"2024-04-16T19:33:49.366654+0000","last_clean":"2024-04-16T19:33:49.366654+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:33:49.366654+0000","last_undegraded":"2024-04-16T19:33:49.366654+0000","last_fullsized":"2024-04-16T19:33:49.366654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:01.400474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564870+0000","last_change":"2024-04-16T18:09:02.168408+0000","last_active":"2024-04-16T19:35:19.564870+0000","last_peered":"2024-04-16T19:35:19.564870+0000","last_clean":"2024-04-16T19:35:19.564870+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:35:19.564870+0000","last_undegraded":"2024-04-16T19:35:19.564870+0000","last_fullsized":"2024-04-16T19:35:19.564870+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:02:38.652580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'164","reported_seq":2348,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559049+0000","last_change":"2024-04-16T17:46:25.526845+0000","last_active":"2024-04-16T19:34:49.559049+0000","last_peered":"2024-04-16T19:34:49.559049+0000","last_clean":"2024-04-16T19:34:49.559049+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:34:49.559049+0000","last_undegraded":"2024-04-16T19:34:49.559049+0000","last_fullsized":"2024-04-16T19:34:49.559049+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:44.078795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373289+0000","last_change":"2024-04-16T17:46:17.504931+0000","last_active":"2024-04-16T19:34:39.373289+0000","last_peered":"2024-04-16T19:34:39.373289+0000","last_clean":"2024-04-16T19:34:39.373289+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:34:39.373289+0000","last_undegraded":"2024-04-16T19:34:39.373289+0000","last_fullsized":"2024-04-16T19:34:39.373289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'19","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.370911+0000","last_change":"2024-04-16T17:45:51.481046+0000","last_active":"2024-04-16T19:34:14.370911+0000","last_peered":"2024-04-16T19:34:14.370911+0000","last_clean":"2024-04-16T19:34:14.370911+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:34:14.370911+0000","last_undegraded":"2024-04-16T19:34:14.370911+0000","last_fullsized":"2024-04-16T19:34:14.370911+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:09.427080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368525+0000","last_change":"2024-04-16T17:45:49.473468+0000","last_active":"2024-04-16T19:34:09.368525+0000","last_peered":"2024-04-16T19:34:09.368525+0000","last_clean":"2024-04-16T19:34:09.368525+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:34:09.368525+0000","last_undegraded":"2024-04-16T19:34:09.368525+0000","last_fullsized":"2024-04-16T19:34:09.368525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:38.069196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'592","reported_seq":3225,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554434+0000","last_change":"2024-04-16T17:45:47.465484+0000","last_active":"2024-04-16T19:34:24.554434+0000","last_peered":"2024-04-16T19:34:24.554434+0000","last_clean":"2024-04-16T19:34:24.554434+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:34:24.554434+0000","last_undegraded":"2024-04-16T19:34:24.554434+0000","last_fullsized":"2024-04-16T19:34:24.554434+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:29.485588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'23","reported_seq":340,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368689+0000","last_change":"2024-04-16T17:45:45.460199+0000","last_active":"2024-04-16T19:34:09.368689+0000","last_peered":"2024-04-16T19:34:09.368689+0000","last_clean":"2024-04-16T19:34:09.368689+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:34:09.368689+0000","last_undegraded":"2024-04-16T19:34:09.368689+0000","last_fullsized":"2024-04-16T19:34:09.368689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:30.407609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383191+0000","last_change":"2024-04-16T17:45:10.392991+0000","last_active":"2024-04-16T19:35:29.383191+0000","last_peered":"2024-04-16T19:35:29.383191+0000","last_clean":"2024-04-16T19:35:29.383191+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:35:29.383191+0000","last_undegraded":"2024-04-16T19:35:29.383191+0000","last_fullsized":"2024-04-16T19:35:29.383191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:22.221256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380477+0000","last_change":"2024-04-16T17:45:08.387422+0000","last_active":"2024-04-16T19:35:24.380477+0000","last_peered":"2024-04-16T19:35:24.380477+0000","last_clean":"2024-04-16T19:35:24.380477+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:35:24.380477+0000","last_undegraded":"2024-04-16T19:35:24.380477+0000","last_fullsized":"2024-04-16T19:35:24.380477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"48'3","reported_seq":182,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549346+0000","last_change":"2024-04-16T17:45:20.412558+0000","last_active":"2024-04-16T19:33:59.549346+0000","last_peered":"2024-04-16T19:33:59.549346+0000","last_clean":"2024-04-16T19:33:59.549346+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:33:59.549346+0000","last_undegraded":"2024-04-16T19:33:59.549346+0000","last_fullsized":"2024-04-16T19:33:59.549346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:48.640904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'88","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387311+0000","last_change":"2024-04-16T17:45:22.414488+0000","last_active":"2024-04-16T19:35:54.387311+0000","last_peered":"2024-04-16T19:35:54.387311+0000","last_clean":"2024-04-16T19:35:54.387311+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:35:54.387311+0000","last_undegraded":"2024-04-16T19:35:54.387311+0000","last_fullsized":"2024-04-16T19:35:54.387311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:41.992526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546362+0000","last_change":"2024-04-16T17:45:24.422626+0000","last_active":"2024-04-16T19:33:44.546362+0000","last_peered":"2024-04-16T19:33:44.546362+0000","last_clean":"2024-04-16T19:33:44.546362+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:33:44.546362+0000","last_undegraded":"2024-04-16T19:33:44.546362+0000","last_fullsized":"2024-04-16T19:33:44.546362+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:10.255140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547629+0000","last_change":"2024-04-16T17:45:26.438504+0000","last_active":"2024-04-16T19:33:49.547629+0000","last_peered":"2024-04-16T19:33:49.547629+0000","last_clean":"2024-04-16T19:33:49.547629+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:33:49.547629+0000","last_undegraded":"2024-04-16T19:33:49.547629+0000","last_fullsized":"2024-04-16T19:33:49.547629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:07.554066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569813+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:35:44.569813+0000","last_peered":"2024-04-16T19:35:44.569813+0000","last_clean":"2024-04-16T19:35:44.569813+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:35:44.569813+0000","last_undegraded":"2024-04-16T19:35:44.569813+0000","last_fullsized":"2024-04-16T19:35:44.569813+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:12:06.661201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'131","reported_seq":1905,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.376474+0000","last_change":"2024-04-16T17:46:25.527139+0000","last_active":"2024-04-16T19:34:49.376474+0000","last_peered":"2024-04-16T19:34:49.376474+0000","last_clean":"2024-04-16T19:34:49.376474+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:34:49.376474+0000","last_undegraded":"2024-04-16T19:34:49.376474+0000","last_fullsized":"2024-04-16T19:34:49.376474+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:25.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:59.375692+0000","last_change":"2024-04-16T17:46:17.507808+0000","last_active":"2024-04-16T19:34:59.375692+0000","last_peered":"2024-04-16T19:34:59.375692+0000","last_clean":"2024-04-16T19:34:59.375692+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:34:59.375692+0000","last_undegraded":"2024-04-16T19:34:59.375692+0000","last_fullsized":"2024-04-16T19:34:59.375692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:54.705447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'10","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369417+0000","last_change":"2024-04-16T17:45:51.480080+0000","last_active":"2024-04-16T19:34:14.369417+0000","last_peered":"2024-04-16T19:34:14.369417+0000","last_clean":"2024-04-16T19:34:14.369417+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:34:14.369417+0000","last_undegraded":"2024-04-16T19:34:14.369417+0000","last_fullsized":"2024-04-16T19:34:14.369417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:32.349071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'651","reported_seq":2203,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368151+0000","last_change":"2024-04-16T17:45:49.472107+0000","last_active":"2024-04-16T19:34:09.368151+0000","last_peered":"2024-04-16T19:34:09.368151+0000","last_clean":"2024-04-16T19:34:09.368151+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:34:09.368151+0000","last_undegraded":"2024-04-16T19:34:09.368151+0000","last_fullsized":"2024-04-16T19:34:09.368151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:10.741937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'306","reported_seq":576,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551277+0000","last_change":"2024-04-16T17:45:47.460175+0000","last_active":"2024-04-16T19:34:09.551277+0000","last_peered":"2024-04-16T19:34:09.551277+0000","last_clean":"2024-04-16T19:34:09.551277+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:34:09.551277+0000","last_undegraded":"2024-04-16T19:34:09.551277+0000","last_fullsized":"2024-04-16T19:34:09.551277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:36.850360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'6","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369905+0000","last_change":"2024-04-16T17:45:45.468347+0000","last_active":"2024-04-16T19:34:09.369905+0000","last_peered":"2024-04-16T19:34:09.369905+0000","last_clean":"2024-04-16T19:34:09.369905+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:34:09.369905+0000","last_undegraded":"2024-04-16T19:34:09.369905+0000","last_fullsized":"2024-04-16T19:34:09.369905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:35.038003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380444+0000","last_change":"2024-04-16T17:45:10.402046+0000","last_active":"2024-04-16T19:35:29.380444+0000","last_peered":"2024-04-16T19:35:29.380444+0000","last_clean":"2024-04-16T19:35:29.380444+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:35:29.380444+0000","last_undegraded":"2024-04-16T19:35:29.380444+0000","last_fullsized":"2024-04-16T19:35:29.380444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:06.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565768+0000","last_change":"2024-04-16T17:45:08.384395+0000","last_active":"2024-04-16T19:35:24.565768+0000","last_peered":"2024-04-16T19:35:24.565768+0000","last_clean":"2024-04-16T19:35:24.565768+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:35:24.565768+0000","last_undegraded":"2024-04-16T19:35:24.565768+0000","last_fullsized":"2024-04-16T19:35:24.565768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:26:03.600126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"30'3","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568667+0000","last_change":"2024-04-16T17:45:20.406255+0000","last_active":"2024-04-16T19:35:39.568667+0000","last_peered":"2024-04-16T19:35:39.568667+0000","last_clean":"2024-04-16T19:35:39.568667+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:35:39.568667+0000","last_undegraded":"2024-04-16T19:35:39.568667+0000","last_fullsized":"2024-04-16T19:35:39.568667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:03.743635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'104","reported_seq":277,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382359+0000","last_change":"2024-04-16T17:45:22.416167+0000","last_active":"2024-04-16T19:35:39.382359+0000","last_peered":"2024-04-16T19:35:39.382359+0000","last_clean":"2024-04-16T19:35:39.382359+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:35:39.382359+0000","last_undegraded":"2024-04-16T19:35:39.382359+0000","last_fullsized":"2024-04-16T19:35:39.382359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:08.259967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.365906+0000","last_change":"2024-04-16T17:45:24.422761+0000","last_active":"2024-04-16T19:33:44.365906+0000","last_peered":"2024-04-16T19:33:44.365906+0000","last_clean":"2024-04-16T19:33:44.365906+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:33:44.365906+0000","last_undegraded":"2024-04-16T19:33:44.365906+0000","last_fullsized":"2024-04-16T19:33:44.365906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:44.189297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569509+0000","last_change":"2024-04-16T17:45:26.433444+0000","last_active":"2024-04-16T19:35:44.569509+0000","last_peered":"2024-04-16T19:35:44.569509+0000","last_clean":"2024-04-16T19:35:44.569509+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:35:44.569509+0000","last_undegraded":"2024-04-16T19:35:44.569509+0000","last_fullsized":"2024-04-16T19:35:44.569509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:37.477962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385770+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:35:44.385770+0000","last_peered":"2024-04-16T19:35:44.385770+0000","last_clean":"2024-04-16T19:35:44.385770+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:35:44.385770+0000","last_undegraded":"2024-04-16T19:35:44.385770+0000","last_fullsized":"2024-04-16T19:35:44.385770+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:48.103141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'156","reported_seq":2122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374807+0000","last_change":"2024-04-16T17:46:25.522062+0000","last_active":"2024-04-16T19:34:49.374807+0000","last_peered":"2024-04-16T19:34:49.374807+0000","last_clean":"2024-04-16T19:34:49.374807+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:34:49.374807+0000","last_undegraded":"2024-04-16T19:34:49.374807+0000","last_fullsized":"2024-04-16T19:34:49.374807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:10:38.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373333+0000","last_change":"2024-04-16T17:46:17.511574+0000","last_active":"2024-04-16T19:34:39.373333+0000","last_peered":"2024-04-16T19:34:39.373333+0000","last_clean":"2024-04-16T19:34:39.373333+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:34:39.373333+0000","last_undegraded":"2024-04-16T19:34:39.373333+0000","last_fullsized":"2024-04-16T19:34:39.373333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'144","reported_seq":327,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:51.478987+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:26.313448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551333+0000","last_change":"2024-04-16T17:45:49.467901+0000","last_active":"2024-04-16T19:34:09.551333+0000","last_peered":"2024-04-16T19:34:09.551333+0000","last_clean":"2024-04-16T19:34:09.551333+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:34:09.551333+0000","last_undegraded":"2024-04-16T19:34:09.551333+0000","last_fullsized":"2024-04-16T19:34:09.551333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:24.687044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'820","reported_seq":1799,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551379+0000","last_change":"2024-04-16T17:45:47.465634+0000","last_active":"2024-04-16T19:34:09.551379+0000","last_peered":"2024-04-16T19:34:09.551379+0000","last_clean":"2024-04-16T19:34:09.551379+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:34:09.551379+0000","last_undegraded":"2024-04-16T19:34:09.551379+0000","last_fullsized":"2024-04-16T19:34:09.551379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:18.406307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'4","reported_seq":269,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550309+0000","last_change":"2024-04-16T17:45:45.460111+0000","last_active":"2024-04-16T19:34:04.550309+0000","last_peered":"2024-04-16T19:34:04.550309+0000","last_clean":"2024-04-16T19:34:04.550309+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:34:04.550309+0000","last_undegraded":"2024-04-16T19:34:04.550309+0000","last_fullsized":"2024-04-16T19:34:04.550309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:20.419958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381397+0000","last_change":"2024-04-16T17:45:10.387439+0000","last_active":"2024-04-16T19:35:29.381397+0000","last_peered":"2024-04-16T19:35:29.381397+0000","last_clean":"2024-04-16T19:35:29.381397+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:35:29.381397+0000","last_undegraded":"2024-04-16T19:35:29.381397+0000","last_fullsized":"2024-04-16T19:35:29.381397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:19.082808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364852+0000","last_change":"2024-04-16T17:45:08.386819+0000","last_active":"2024-04-16T19:33:49.364852+0000","last_peered":"2024-04-16T19:33:49.364852+0000","last_clean":"2024-04-16T19:33:49.364852+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:33:49.364852+0000","last_undegraded":"2024-04-16T19:33:49.364852+0000","last_fullsized":"2024-04-16T19:33:49.364852+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"48'13","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568711+0000","last_change":"2024-04-16T17:45:20.413420+0000","last_active":"2024-04-16T19:35:39.568711+0000","last_peered":"2024-04-16T19:35:39.568711+0000","last_clean":"2024-04-16T19:35:39.568711+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:35:39.568711+0000","last_undegraded":"2024-04-16T19:35:39.568711+0000","last_fullsized":"2024-04-16T19:35:39.568711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:07.256474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'152","reported_seq":348,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545609+0000","last_change":"2024-04-16T17:45:22.414344+0000","last_active":"2024-04-16T19:33:39.545609+0000","last_peered":"2024-04-16T19:33:39.545609+0000","last_clean":"2024-04-16T19:33:39.545609+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:33:39.545609+0000","last_undegraded":"2024-04-16T19:33:39.545609+0000","last_fullsized":"2024-04-16T19:33:39.545609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:59.276583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'12","reported_seq":1391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568700+0000","last_change":"2024-04-16T17:45:24.430890+0000","last_active":"2024-04-16T19:35:39.568700+0000","last_peered":"2024-04-16T19:35:39.568700+0000","last_clean":"2024-04-16T19:35:39.568700+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:35:39.568700+0000","last_undegraded":"2024-04-16T19:35:39.568700+0000","last_fullsized":"2024-04-16T19:35:39.568700+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:30:11.271716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571455+0000","last_change":"2024-04-16T17:45:26.428823+0000","last_active":"2024-04-16T19:35:54.571455+0000","last_peered":"2024-04-16T19:35:54.571455+0000","last_clean":"2024-04-16T19:35:54.571455+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:35:54.571455+0000","last_undegraded":"2024-04-16T19:35:54.571455+0000","last_fullsized":"2024-04-16T19:35:54.571455+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:08.709599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373933+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:34:44.373933+0000","last_peered":"2024-04-16T19:34:44.373933+0000","last_clean":"2024-04-16T19:34:44.373933+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:34:44.373933+0000","last_undegraded":"2024-04-16T19:34:44.373933+0000","last_fullsized":"2024-04-16T19:34:44.373933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:08.722479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'84","reported_seq":1607,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374780+0000","last_change":"2024-04-16T17:46:25.527208+0000","last_active":"2024-04-16T19:34:49.374780+0000","last_peered":"2024-04-16T19:34:49.374780+0000","last_clean":"2024-04-16T19:34:49.374780+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:34:49.374780+0000","last_undegraded":"2024-04-16T19:34:49.374780+0000","last_fullsized":"2024-04-16T19:34:49.374780+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.607096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373249+0000","last_change":"2024-04-16T17:46:17.513992+0000","last_active":"2024-04-16T19:34:39.373249+0000","last_peered":"2024-04-16T19:34:39.373249+0000","last_clean":"2024-04-16T19:34:39.373249+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:34:39.373249+0000","last_undegraded":"2024-04-16T19:34:39.373249+0000","last_fullsized":"2024-04-16T19:34:39.373249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'17","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552285+0000","last_change":"2024-04-16T17:45:51.480268+0000","last_active":"2024-04-16T19:34:14.552285+0000","last_peered":"2024-04-16T19:34:14.552285+0000","last_clean":"2024-04-16T19:34:14.552285+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:34:14.552285+0000","last_undegraded":"2024-04-16T19:34:14.552285+0000","last_fullsized":"2024-04-16T19:34:14.552285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:10:40.755507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367826+0000","last_change":"2024-04-16T17:45:49.472397+0000","last_active":"2024-04-16T19:34:09.367826+0000","last_peered":"2024-04-16T19:34:09.367826+0000","last_clean":"2024-04-16T19:34:09.367826+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:34:09.367826+0000","last_undegraded":"2024-04-16T19:34:09.367826+0000","last_fullsized":"2024-04-16T19:34:09.367826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:02.894263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'526","reported_seq":907,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368367+0000","last_change":"2024-04-16T17:45:47.465575+0000","last_active":"2024-04-16T19:34:09.368367+0000","last_peered":"2024-04-16T19:34:09.368367+0000","last_clean":"2024-04-16T19:34:09.368367+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:34:09.368367+0000","last_undegraded":"2024-04-16T19:34:09.368367+0000","last_fullsized":"2024-04-16T19:34:09.368367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:42.534287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'10","reported_seq":383,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368166+0000","last_change":"2024-04-16T17:45:45.461495+0000","last_active":"2024-04-16T19:34:09.368166+0000","last_peered":"2024-04-16T19:34:09.368166+0000","last_clean":"2024-04-16T19:34:09.368166+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:34:09.368166+0000","last_undegraded":"2024-04-16T19:34:09.368166+0000","last_fullsized":"2024-04-16T19:34:09.368166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:23.315560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380526+0000","last_change":"2024-04-16T17:45:10.394926+0000","last_active":"2024-04-16T19:35:29.380526+0000","last_peered":"2024-04-16T19:35:29.380526+0000","last_clean":"2024-04-16T19:35:29.380526+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:35:29.380526+0000","last_undegraded":"2024-04-16T19:35:29.380526+0000","last_fullsized":"2024-04-16T19:35:29.380526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:53.484971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382188+0000","last_change":"2024-04-16T17:45:08.382545+0000","last_active":"2024-04-16T19:35:39.382188+0000","last_peered":"2024-04-16T19:35:39.382188+0000","last_clean":"2024-04-16T19:35:39.382188+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:35:39.382188+0000","last_undegraded":"2024-04-16T19:35:39.382188+0000","last_fullsized":"2024-04-16T19:35:39.382188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"48'17","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.364227+0000","last_change":"2024-04-16T17:45:20.412524+0000","last_active":"2024-04-16T19:33:44.364227+0000","last_peered":"2024-04-16T19:33:44.364227+0000","last_clean":"2024-04-16T19:33:44.364227+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:33:44.364227+0000","last_undegraded":"2024-04-16T19:33:44.364227+0000","last_fullsized":"2024-04-16T19:33:44.364227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:20.296409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'120","reported_seq":296,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568730+0000","last_change":"2024-04-16T17:45:22.414750+0000","last_active":"2024-04-16T19:35:39.568730+0000","last_peered":"2024-04-16T19:35:39.568730+0000","last_clean":"2024-04-16T19:35:39.568730+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:35:39.568730+0000","last_undegraded":"2024-04-16T19:35:39.568730+0000","last_fullsized":"2024-04-16T19:35:39.568730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:22.304242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'12","reported_seq":1391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382297+0000","last_change":"2024-04-16T17:45:24.423828+0000","last_active":"2024-04-16T19:35:39.382297+0000","last_peered":"2024-04-16T19:35:39.382297+0000","last_clean":"2024-04-16T19:35:39.382297+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:35:39.382297+0000","last_undegraded":"2024-04-16T19:35:39.382297+0000","last_fullsized":"2024-04-16T19:35:39.382297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:54.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.384551+0000","last_change":"2024-04-16T17:45:26.429874+0000","last_active":"2024-04-16T19:35:54.384551+0000","last_peered":"2024-04-16T19:35:54.384551+0000","last_clean":"2024-04-16T19:35:54.384551+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:35:54.384551+0000","last_undegraded":"2024-04-16T19:35:54.384551+0000","last_fullsized":"2024-04-16T19:35:54.384551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:16.546602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555434+0000","last_change":"2024-04-16T18:09:02.169496+0000","last_active":"2024-04-16T19:34:29.555434+0000","last_peered":"2024-04-16T19:34:29.555434+0000","last_clean":"2024-04-16T19:34:29.555434+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:34:29.555434+0000","last_undegraded":"2024-04-16T19:34:29.555434+0000","last_fullsized":"2024-04-16T19:34:29.555434+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:08:44.423508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'130","reported_seq":1976,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.379689+0000","last_change":"2024-04-16T17:46:25.525792+0000","last_active":"2024-04-16T19:35:09.379689+0000","last_peered":"2024-04-16T19:35:09.379689+0000","last_clean":"2024-04-16T19:35:09.379689+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:35:09.379689+0000","last_undegraded":"2024-04-16T19:35:09.379689+0000","last_fullsized":"2024-04-16T19:35:09.379689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:51.015603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373227+0000","last_change":"2024-04-16T17:46:17.512275+0000","last_active":"2024-04-16T19:34:39.373227+0000","last_peered":"2024-04-16T19:34:39.373227+0000","last_clean":"2024-04-16T19:34:39.373227+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:34:39.373227+0000","last_undegraded":"2024-04-16T19:34:39.373227+0000","last_fullsized":"2024-04-16T19:34:39.373227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'16","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552355+0000","last_change":"2024-04-16T17:45:51.480112+0000","last_active":"2024-04-16T19:34:14.552355+0000","last_peered":"2024-04-16T19:34:14.552355+0000","last_clean":"2024-04-16T19:34:14.552355+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:34:14.552355+0000","last_undegraded":"2024-04-16T19:34:14.552355+0000","last_fullsized":"2024-04-16T19:34:14.552355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:58.876769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'651","reported_seq":2211,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550264+0000","last_change":"2024-04-16T17:45:49.470044+0000","last_active":"2024-04-16T19:34:04.550264+0000","last_peered":"2024-04-16T19:34:04.550264+0000","last_clean":"2024-04-16T19:34:04.550264+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:34:04.550264+0000","last_undegraded":"2024-04-16T19:34:04.550264+0000","last_fullsized":"2024-04-16T19:34:04.550264+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:33.520085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'424","reported_seq":710,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367800+0000","last_change":"2024-04-16T17:45:47.461193+0000","last_active":"2024-04-16T19:34:09.367800+0000","last_peered":"2024-04-16T19:34:09.367800+0000","last_clean":"2024-04-16T19:34:09.367800+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:34:09.367800+0000","last_undegraded":"2024-04-16T19:34:09.367800+0000","last_fullsized":"2024-04-16T19:34:09.367800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:59:35.710148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'28","reported_seq":524,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551319+0000","last_change":"2024-04-16T17:45:45.458470+0000","last_active":"2024-04-16T19:34:09.551319+0000","last_peered":"2024-04-16T19:34:09.551319+0000","last_clean":"2024-04-16T19:34:09.551319+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:34:09.551319+0000","last_undegraded":"2024-04-16T19:34:09.551319+0000","last_fullsized":"2024-04-16T19:34:09.551319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:55.314430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556590+0000","last_change":"2024-04-16T17:46:16.501988+0000","last_active":"2024-04-16T19:34:34.556590+0000","last_peered":"2024-04-16T19:34:34.556590+0000","last_clean":"2024-04-16T19:34:34.556590+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:34:34.556590+0000","last_undegraded":"2024-04-16T19:34:34.556590+0000","last_fullsized":"2024-04-16T19:34:34.556590+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:04.853827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568467+0000","last_change":"2024-04-16T17:45:08.381995+0000","last_active":"2024-04-16T19:35:39.568467+0000","last_peered":"2024-04-16T19:35:39.568467+0000","last_clean":"2024-04-16T19:35:39.568467+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:35:39.568467+0000","last_undegraded":"2024-04-16T19:35:39.568467+0000","last_fullsized":"2024-04-16T19:35:39.568467+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:09.343973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382943+0000","last_change":"2024-04-16T17:45:20.407642+0000","last_active":"2024-04-16T19:35:39.382943+0000","last_peered":"2024-04-16T19:35:39.382943+0000","last_clean":"2024-04-16T19:35:39.382943+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:35:39.382943+0000","last_undegraded":"2024-04-16T19:35:39.382943+0000","last_fullsized":"2024-04-16T19:35:39.382943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:15.477935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'176","reported_seq":385,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382915+0000","last_change":"2024-04-16T17:45:22.414672+0000","last_active":"2024-04-16T19:35:39.382915+0000","last_peered":"2024-04-16T19:35:39.382915+0000","last_clean":"2024-04-16T19:35:39.382915+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:35:39.382915+0000","last_undegraded":"2024-04-16T19:35:39.382915+0000","last_fullsized":"2024-04-16T19:35:39.382915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:49.342017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382893+0000","last_change":"2024-04-16T17:45:24.425728+0000","last_active":"2024-04-16T19:35:39.382893+0000","last_peered":"2024-04-16T19:35:39.382893+0000","last_clean":"2024-04-16T19:35:39.382893+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:35:39.382893+0000","last_undegraded":"2024-04-16T19:35:39.382893+0000","last_fullsized":"2024-04-16T19:35:39.382893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:48.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571522+0000","last_change":"2024-04-16T17:45:26.433385+0000","last_active":"2024-04-16T19:35:54.571522+0000","last_peered":"2024-04-16T19:35:54.571522+0000","last_clean":"2024-04-16T19:35:54.571522+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:35:54.571522+0000","last_undegraded":"2024-04-16T19:35:54.571522+0000","last_fullsized":"2024-04-16T19:35:54.571522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:00.885088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556570+0000","last_change":"2024-04-16T18:09:02.173431+0000","last_active":"2024-04-16T19:34:34.556570+0000","last_peered":"2024-04-16T19:34:34.556570+0000","last_clean":"2024-04-16T19:34:34.556570+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:34:34.556570+0000","last_undegraded":"2024-04-16T19:34:34.556570+0000","last_fullsized":"2024-04-16T19:34:34.556570+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:13:47.114929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'117","reported_seq":1947,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374129+0000","last_change":"2024-04-16T17:46:25.530014+0000","last_active":"2024-04-16T19:34:49.374129+0000","last_peered":"2024-04-16T19:34:49.374129+0000","last_clean":"2024-04-16T19:34:49.374129+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:34:49.374129+0000","last_undegraded":"2024-04-16T19:34:49.374129+0000","last_fullsized":"2024-04-16T19:34:49.374129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:46.795658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.553245+0000","last_change":"2024-04-16T17:46:17.512764+0000","last_active":"2024-04-16T19:34:19.553245+0000","last_peered":"2024-04-16T19:34:19.553245+0000","last_clean":"2024-04-16T19:34:19.553245+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:34:19.553245+0000","last_undegraded":"2024-04-16T19:34:19.553245+0000","last_fullsized":"2024-04-16T19:34:19.553245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:58.381096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'24","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365186+0000","last_change":"2024-04-16T17:45:51.482816+0000","last_active":"2024-04-16T19:33:54.365186+0000","last_peered":"2024-04-16T19:33:54.365186+0000","last_clean":"2024-04-16T19:33:54.365186+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:33:54.365186+0000","last_undegraded":"2024-04-16T19:33:54.365186+0000","last_fullsized":"2024-04-16T19:33:54.365186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:57.211121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554350+0000","last_change":"2024-04-16T17:45:49.472014+0000","last_active":"2024-04-16T19:34:24.554350+0000","last_peered":"2024-04-16T19:34:24.554350+0000","last_clean":"2024-04-16T19:34:24.554350+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:34:24.554350+0000","last_undegraded":"2024-04-16T19:34:24.554350+0000","last_fullsized":"2024-04-16T19:34:24.554350+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:44.541417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'291","reported_seq":535,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364960+0000","last_change":"2024-04-16T17:45:47.466159+0000","last_active":"2024-04-16T19:33:49.364960+0000","last_peered":"2024-04-16T19:33:49.364960+0000","last_clean":"2024-04-16T19:33:49.364960+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:33:49.364960+0000","last_undegraded":"2024-04-16T19:33:49.364960+0000","last_fullsized":"2024-04-16T19:33:49.364960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:37.045194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'11","reported_seq":456,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551199+0000","last_change":"2024-04-16T17:45:45.461762+0000","last_active":"2024-04-16T19:34:09.551199+0000","last_peered":"2024-04-16T19:34:09.551199+0000","last_clean":"2024-04-16T19:34:09.551199+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:34:09.551199+0000","last_undegraded":"2024-04-16T19:34:09.551199+0000","last_fullsized":"2024-04-16T19:34:09.551199+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:35.566086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.386083+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:35:59.386083+0000","last_peered":"2024-04-16T19:35:59.386083+0000","last_clean":"2024-04-16T19:35:59.386083+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:35:59.386083+0000","last_undegraded":"2024-04-16T19:35:59.386083+0000","last_fullsized":"2024-04-16T19:35:59.386083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:01.549347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":296,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373805+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T19:34:44.373805+0000","last_peered":"2024-04-16T19:34:44.373805+0000","last_clean":"2024-04-16T19:34:44.373805+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:34:44.373805+0000","last_undegraded":"2024-04-16T19:34:44.373805+0000","last_fullsized":"2024-04-16T19:34:44.373805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:56.418777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374723+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:34:49.374723+0000","last_peered":"2024-04-16T19:34:49.374723+0000","last_clean":"2024-04-16T19:34:49.374723+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:34:49.374723+0000","last_undegraded":"2024-04-16T19:34:49.374723+0000","last_fullsized":"2024-04-16T19:34:49.374723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567575+0000","last_change":"2024-04-16T17:45:08.387550+0000","last_active":"2024-04-16T19:35:34.567575+0000","last_peered":"2024-04-16T19:35:34.567575+0000","last_clean":"2024-04-16T19:35:34.567575+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:35:34.567575+0000","last_undegraded":"2024-04-16T19:35:34.567575+0000","last_fullsized":"2024-04-16T19:35:34.567575+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383732+0000","last_change":"2024-04-16T17:45:20.412324+0000","last_active":"2024-04-16T19:35:49.383732+0000","last_peered":"2024-04-16T19:35:49.383732+0000","last_clean":"2024-04-16T19:35:49.383732+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:35:49.383732+0000","last_undegraded":"2024-04-16T19:35:49.383732+0000","last_fullsized":"2024-04-16T19:35:49.383732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:06.239898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'72","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385321+0000","last_change":"2024-04-16T17:45:22.415579+0000","last_active":"2024-04-16T19:35:54.385321+0000","last_peered":"2024-04-16T19:35:54.385321+0000","last_clean":"2024-04-16T19:35:54.385321+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:35:54.385321+0000","last_undegraded":"2024-04-16T19:35:54.385321+0000","last_fullsized":"2024-04-16T19:35:54.385321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:40.426580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387491+0000","last_change":"2024-04-16T17:45:24.422064+0000","last_active":"2024-04-16T19:35:54.387491+0000","last_peered":"2024-04-16T19:35:54.387491+0000","last_clean":"2024-04-16T19:35:54.387491+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:35:54.387491+0000","last_undegraded":"2024-04-16T19:35:54.387491+0000","last_fullsized":"2024-04-16T19:35:54.387491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:56.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364911+0000","last_change":"2024-04-16T17:45:26.439130+0000","last_active":"2024-04-16T19:33:49.364911+0000","last_peered":"2024-04-16T19:33:49.364911+0000","last_clean":"2024-04-16T19:33:49.364911+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:33:49.364911+0000","last_undegraded":"2024-04-16T19:33:49.364911+0000","last_fullsized":"2024-04-16T19:33:49.364911+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:21.169043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371730+0000","last_change":"2024-04-16T18:09:02.168908+0000","last_active":"2024-04-16T19:34:34.371730+0000","last_peered":"2024-04-16T19:34:34.371730+0000","last_clean":"2024-04-16T19:34:34.371730+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:34:34.371730+0000","last_undegraded":"2024-04-16T19:34:34.371730+0000","last_fullsized":"2024-04-16T19:34:34.371730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:56.187557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'150","reported_seq":2025,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373426+0000","last_change":"2024-04-16T17:46:25.527679+0000","last_active":"2024-04-16T19:34:29.373426+0000","last_peered":"2024-04-16T19:34:29.373426+0000","last_clean":"2024-04-16T19:34:29.373426+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:34:29.373426+0000","last_undegraded":"2024-04-16T19:34:29.373426+0000","last_fullsized":"2024-04-16T19:34:29.373426+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.607096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373443+0000","last_change":"2024-04-16T17:46:17.514358+0000","last_active":"2024-04-16T19:34:39.373443+0000","last_peered":"2024-04-16T19:34:39.373443+0000","last_clean":"2024-04-16T19:34:39.373443+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:34:39.373443+0000","last_undegraded":"2024-04-16T19:34:39.373443+0000","last_fullsized":"2024-04-16T19:34:39.373443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:01.622597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'5","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367358+0000","last_change":"2024-04-16T17:45:51.481385+0000","last_active":"2024-04-16T19:33:54.367358+0000","last_peered":"2024-04-16T19:33:54.367358+0000","last_clean":"2024-04-16T19:33:54.367358+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:33:54.367358+0000","last_undegraded":"2024-04-16T19:33:54.367358+0000","last_fullsized":"2024-04-16T19:33:54.367358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'651","reported_seq":2342,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551310+0000","last_change":"2024-04-16T17:45:49.469823+0000","last_active":"2024-04-16T19:34:09.551310+0000","last_peered":"2024-04-16T19:34:09.551310+0000","last_clean":"2024-04-16T19:34:09.551310+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:34:09.551310+0000","last_undegraded":"2024-04-16T19:34:09.551310+0000","last_fullsized":"2024-04-16T19:34:09.551310+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:31.511049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'439","reported_seq":733,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369820+0000","last_change":"2024-04-16T17:45:47.465291+0000","last_active":"2024-04-16T19:34:09.369820+0000","last_peered":"2024-04-16T19:34:09.369820+0000","last_clean":"2024-04-16T19:34:09.369820+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:34:09.369820+0000","last_undegraded":"2024-04-16T19:34:09.369820+0000","last_fullsized":"2024-04-16T19:34:09.369820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:49.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'13","reported_seq":540,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366573+0000","last_change":"2024-04-16T17:45:45.460969+0000","last_active":"2024-04-16T19:33:49.366573+0000","last_peered":"2024-04-16T19:33:49.366573+0000","last_clean":"2024-04-16T19:33:49.366573+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:33:49.366573+0000","last_undegraded":"2024-04-16T19:33:49.366573+0000","last_fullsized":"2024-04-16T19:33:49.366573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:23.315560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385802+0000","last_change":"2024-04-16T17:45:10.396755+0000","last_active":"2024-04-16T19:35:44.385802+0000","last_peered":"2024-04-16T19:35:44.385802+0000","last_clean":"2024-04-16T19:35:44.385802+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:35:44.385802+0000","last_undegraded":"2024-04-16T19:35:44.385802+0000","last_fullsized":"2024-04-16T19:35:44.385802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:41.531980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373829+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T19:34:44.373829+0000","last_peered":"2024-04-16T19:34:44.373829+0000","last_clean":"2024-04-16T19:34:44.373829+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:34:44.373829+0000","last_undegraded":"2024-04-16T19:34:44.373829+0000","last_fullsized":"2024-04-16T19:34:44.373829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:33.735299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557306+0000","last_change":"2024-04-16T17:46:16.500353+0000","last_active":"2024-04-16T19:34:39.557306+0000","last_peered":"2024-04-16T19:34:39.557306+0000","last_clean":"2024-04-16T19:34:39.557306+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:34:39.557306+0000","last_undegraded":"2024-04-16T19:34:39.557306+0000","last_fullsized":"2024-04-16T19:34:39.557306+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:15.098375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"48'13","reported_seq":582,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385339+0000","last_change":"2024-04-16T17:45:20.412363+0000","last_active":"2024-04-16T19:35:54.385339+0000","last_peered":"2024-04-16T19:35:54.385339+0000","last_clean":"2024-04-16T19:35:54.385339+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:35:54.385339+0000","last_undegraded":"2024-04-16T19:35:54.385339+0000","last_fullsized":"2024-04-16T19:35:54.385339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:51.744736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'177","reported_seq":1667,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570636+0000","last_change":"2024-04-16T17:45:22.412577+0000","last_active":"2024-04-16T19:35:49.570636+0000","last_peered":"2024-04-16T19:35:49.570636+0000","last_clean":"2024-04-16T19:35:49.570636+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:35:49.570636+0000","last_undegraded":"2024-04-16T19:35:49.570636+0000","last_fullsized":"2024-04-16T19:35:49.570636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:53.752569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366956+0000","last_change":"2024-04-16T17:45:24.422901+0000","last_active":"2024-04-16T19:34:04.366956+0000","last_peered":"2024-04-16T19:34:04.366956+0000","last_clean":"2024-04-16T19:34:04.366956+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:34:04.366956+0000","last_undegraded":"2024-04-16T19:34:04.366956+0000","last_fullsized":"2024-04-16T19:34:04.366956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:55.759978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550383+0000","last_change":"2024-04-16T17:45:26.847528+0000","last_active":"2024-04-16T19:34:04.550383+0000","last_peered":"2024-04-16T19:34:04.550383+0000","last_clean":"2024-04-16T19:34:04.550383+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:34:04.550383+0000","last_undegraded":"2024-04-16T19:34:04.550383+0000","last_fullsized":"2024-04-16T19:34:04.550383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:39:36.865102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372561+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:34:34.372561+0000","last_peered":"2024-04-16T19:34:34.372561+0000","last_clean":"2024-04-16T19:34:34.372561+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:34:34.372561+0000","last_undegraded":"2024-04-16T19:34:34.372561+0000","last_fullsized":"2024-04-16T19:34:34.372561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'137","reported_seq":1599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371844+0000","last_change":"2024-04-16T17:46:25.524587+0000","last_active":"2024-04-16T19:34:29.371844+0000","last_peered":"2024-04-16T19:34:29.371844+0000","last_clean":"2024-04-16T19:34:29.371844+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:34:29.371844+0000","last_undegraded":"2024-04-16T19:34:29.371844+0000","last_fullsized":"2024-04-16T19:34:29.371844+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:51.963525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.370234+0000","last_change":"2024-04-16T17:46:17.512533+0000","last_active":"2024-04-16T19:34:19.370234+0000","last_peered":"2024-04-16T19:34:19.370234+0000","last_clean":"2024-04-16T19:34:19.370234+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:34:19.370234+0000","last_undegraded":"2024-04-16T19:34:19.370234+0000","last_fullsized":"2024-04-16T19:34:19.370234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'22","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369157+0000","last_change":"2024-04-16T17:45:51.482872+0000","last_active":"2024-04-16T19:34:14.369157+0000","last_peered":"2024-04-16T19:34:14.369157+0000","last_clean":"2024-04-16T19:34:14.369157+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:34:14.369157+0000","last_undegraded":"2024-04-16T19:34:14.369157+0000","last_fullsized":"2024-04-16T19:34:14.369157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:41:19.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551235+0000","last_change":"2024-04-16T17:45:49.469833+0000","last_active":"2024-04-16T19:34:09.551235+0000","last_peered":"2024-04-16T19:34:09.551235+0000","last_clean":"2024-04-16T19:34:09.551235+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:34:09.551235+0000","last_undegraded":"2024-04-16T19:34:09.551235+0000","last_fullsized":"2024-04-16T19:34:09.551235+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:38.617917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4935","reported_seq":7414,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368062+0000","last_change":"2024-04-16T17:45:47.459129+0000","last_active":"2024-04-16T19:34:09.368062+0000","last_peered":"2024-04-16T19:34:09.368062+0000","last_clean":"2024-04-16T19:34:09.368062+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:34:09.368062+0000","last_undegraded":"2024-04-16T19:34:09.368062+0000","last_fullsized":"2024-04-16T19:34:09.368062+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":3000,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:16.005223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'5","reported_seq":257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371575+0000","last_change":"2024-04-16T17:45:45.465878+0000","last_active":"2024-04-16T19:34:29.371575+0000","last_peered":"2024-04-16T19:34:29.371575+0000","last_clean":"2024-04-16T19:34:29.371575+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:34:29.371575+0000","last_undegraded":"2024-04-16T19:34:29.371575+0000","last_fullsized":"2024-04-16T19:34:29.371575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:14.781901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569790+0000","last_change":"2024-04-16T17:45:10.401015+0000","last_active":"2024-04-16T19:35:44.569790+0000","last_peered":"2024-04-16T19:35:44.569790+0000","last_clean":"2024-04-16T19:35:44.569790+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:35:44.569790+0000","last_undegraded":"2024-04-16T19:35:44.569790+0000","last_fullsized":"2024-04-16T19:35:44.569790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:24.037647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559082+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T19:34:49.559082+0000","last_peered":"2024-04-16T19:34:49.559082+0000","last_clean":"2024-04-16T19:34:49.559082+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:34:49.559082+0000","last_undegraded":"2024-04-16T19:34:49.559082+0000","last_fullsized":"2024-04-16T19:34:49.559082+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:57.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565632+0000","last_change":"2024-04-16T17:45:08.382479+0000","last_active":"2024-04-16T19:35:24.565632+0000","last_peered":"2024-04-16T19:35:24.565632+0000","last_clean":"2024-04-16T19:35:24.565632+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:35:24.565632+0000","last_undegraded":"2024-04-16T19:35:24.565632+0000","last_fullsized":"2024-04-16T19:35:24.565632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:35:30.412079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"48'3","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546535+0000","last_change":"2024-04-16T17:45:20.413451+0000","last_active":"2024-04-16T19:33:44.546535+0000","last_peered":"2024-04-16T19:33:44.546535+0000","last_clean":"2024-04-16T19:33:44.546535+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:33:44.546535+0000","last_undegraded":"2024-04-16T19:33:44.546535+0000","last_fullsized":"2024-04-16T19:33:44.546535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:16.754291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'151","reported_seq":1610,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367608+0000","last_change":"2024-04-16T17:45:22.416277+0000","last_active":"2024-04-16T19:34:04.367608+0000","last_peered":"2024-04-16T19:34:04.367608+0000","last_clean":"2024-04-16T19:34:04.367608+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:34:04.367608+0000","last_undegraded":"2024-04-16T19:34:04.367608+0000","last_fullsized":"2024-04-16T19:34:04.367608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:43.858466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386521+0000","last_change":"2024-04-16T17:45:24.426509+0000","last_active":"2024-04-16T19:35:49.386521+0000","last_peered":"2024-04-16T19:35:49.386521+0000","last_clean":"2024-04-16T19:35:49.386521+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:35:49.386521+0000","last_undegraded":"2024-04-16T19:35:49.386521+0000","last_fullsized":"2024-04-16T19:35:49.386521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:19.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385695+0000","last_change":"2024-04-16T17:45:26.439231+0000","last_active":"2024-04-16T19:35:44.385695+0000","last_peered":"2024-04-16T19:35:44.385695+0000","last_clean":"2024-04-16T19:35:44.385695+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:35:44.385695+0000","last_undegraded":"2024-04-16T19:35:44.385695+0000","last_fullsized":"2024-04-16T19:35:44.385695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:15.584111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374893+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:34:49.374893+0000","last_peered":"2024-04-16T19:34:49.374893+0000","last_clean":"2024-04-16T19:34:49.374893+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:34:49.374893+0000","last_undegraded":"2024-04-16T19:34:49.374893+0000","last_fullsized":"2024-04-16T19:34:49.374893+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:07.763412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'135","reported_seq":2026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371048+0000","last_change":"2024-04-16T17:46:25.529983+0000","last_active":"2024-04-16T19:34:29.371048+0000","last_peered":"2024-04-16T19:34:29.371048+0000","last_clean":"2024-04-16T19:34:29.371048+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:34:29.371048+0000","last_undegraded":"2024-04-16T19:34:29.371048+0000","last_fullsized":"2024-04-16T19:34:29.371048+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:45:31.421525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369527+0000","last_change":"2024-04-16T17:46:17.508075+0000","last_active":"2024-04-16T19:34:19.369527+0000","last_peered":"2024-04-16T19:34:19.369527+0000","last_clean":"2024-04-16T19:34:19.369527+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:34:19.369527+0000","last_undegraded":"2024-04-16T19:34:19.369527+0000","last_fullsized":"2024-04-16T19:34:19.369527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:48.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"48'2","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367303+0000","last_change":"2024-04-16T17:45:51.484218+0000","last_active":"2024-04-16T19:33:54.367303+0000","last_peered":"2024-04-16T19:33:54.367303+0000","last_clean":"2024-04-16T19:33:54.367303+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:33:54.367303+0000","last_undegraded":"2024-04-16T19:33:54.367303+0000","last_fullsized":"2024-04-16T19:33:54.367303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:41:19.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547483+0000","last_change":"2024-04-16T17:45:49.469114+0000","last_active":"2024-04-16T19:33:49.547483+0000","last_peered":"2024-04-16T19:33:49.547483+0000","last_clean":"2024-04-16T19:33:49.547483+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:33:49.547483+0000","last_undegraded":"2024-04-16T19:33:49.547483+0000","last_fullsized":"2024-04-16T19:33:49.547483+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:10.917939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'472","reported_seq":939,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370916+0000","last_change":"2024-04-16T17:45:47.463058+0000","last_active":"2024-04-16T19:34:29.370916+0000","last_peered":"2024-04-16T19:34:29.370916+0000","last_clean":"2024-04-16T19:34:29.370916+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:34:29.370916+0000","last_undegraded":"2024-04-16T19:34:29.370916+0000","last_fullsized":"2024-04-16T19:34:29.370916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:54:56.798962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'6","reported_seq":418,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369890+0000","last_change":"2024-04-16T17:45:45.463642+0000","last_active":"2024-04-16T19:34:09.369890+0000","last_peered":"2024-04-16T19:34:09.369890+0000","last_clean":"2024-04-16T19:34:09.369890+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:34:09.369890+0000","last_undegraded":"2024-04-16T19:34:09.369890+0000","last_fullsized":"2024-04-16T19:34:09.369890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568687+0000","last_change":"2024-04-16T17:45:10.396905+0000","last_active":"2024-04-16T19:35:39.568687+0000","last_peered":"2024-04-16T19:35:39.568687+0000","last_clean":"2024-04-16T19:35:39.568687+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:35:39.568687+0000","last_undegraded":"2024-04-16T19:35:39.568687+0000","last_fullsized":"2024-04-16T19:35:39.568687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:49:42.077116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374696+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T19:34:49.374696+0000","last_peered":"2024-04-16T19:34:49.374696+0000","last_clean":"2024-04-16T19:34:49.374696+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:34:49.374696+0000","last_undegraded":"2024-04-16T19:34:49.374696+0000","last_fullsized":"2024-04-16T19:34:49.374696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381333+0000","last_change":"2024-04-16T17:45:08.382355+0000","last_active":"2024-04-16T19:35:34.381333+0000","last_peered":"2024-04-16T19:35:34.381333+0000","last_clean":"2024-04-16T19:35:34.381333+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:35:34.381333+0000","last_undegraded":"2024-04-16T19:35:34.381333+0000","last_fullsized":"2024-04-16T19:35:34.381333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:26.849118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":876,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.369133+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:34:04.369133+0000","last_peered":"2024-04-16T19:34:04.369133+0000","last_clean":"2024-04-16T19:34:04.369133+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:34:04.369133+0000","last_undegraded":"2024-04-16T19:34:04.369133+0000","last_fullsized":"2024-04-16T19:34:04.369133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:49:00.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'144","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.546574+0000","last_change":"2024-04-16T17:45:22.417967+0000","last_active":"2024-04-16T19:33:44.546574+0000","last_peered":"2024-04-16T19:33:44.546574+0000","last_clean":"2024-04-16T19:33:44.546574+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:33:44.546574+0000","last_undegraded":"2024-04-16T19:33:44.546574+0000","last_fullsized":"2024-04-16T19:33:44.546574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:52.145153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385378+0000","last_change":"2024-04-16T17:45:24.430854+0000","last_active":"2024-04-16T19:35:54.385378+0000","last_peered":"2024-04-16T19:35:54.385378+0000","last_clean":"2024-04-16T19:35:54.385378+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:35:54.385378+0000","last_undegraded":"2024-04-16T19:35:54.385378+0000","last_fullsized":"2024-04-16T19:35:54.385378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:44.189297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364886+0000","last_change":"2024-04-16T17:45:26.433033+0000","last_active":"2024-04-16T19:33:49.364886+0000","last_peered":"2024-04-16T19:33:49.364886+0000","last_clean":"2024-04-16T19:33:49.364886+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:33:49.364886+0000","last_undegraded":"2024-04-16T19:33:49.364886+0000","last_fullsized":"2024-04-16T19:33:49.364886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:50.423306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383610+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:35:44.383610+0000","last_peered":"2024-04-16T19:35:44.383610+0000","last_clean":"2024-04-16T19:35:44.383610+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:35:44.383610+0000","last_undegraded":"2024-04-16T19:35:44.383610+0000","last_fullsized":"2024-04-16T19:35:44.383610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:02:50.648888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1711,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382752+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:35:39.382752+0000","last_peered":"2024-04-16T19:35:39.382752+0000","last_clean":"2024-04-16T19:35:39.382752+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:35:39.382752+0000","last_undegraded":"2024-04-16T19:35:39.382752+0000","last_fullsized":"2024-04-16T19:35:39.382752+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:19:32.647068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369878+0000","last_change":"2024-04-16T17:46:17.507415+0000","last_active":"2024-04-16T19:34:19.369878+0000","last_peered":"2024-04-16T19:34:19.369878+0000","last_clean":"2024-04-16T19:34:19.369878+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:34:19.369878+0000","last_undegraded":"2024-04-16T19:34:19.369878+0000","last_fullsized":"2024-04-16T19:34:19.369878+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'8","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.555429+0000","last_change":"2024-04-16T17:45:51.479839+0000","last_active":"2024-04-16T19:34:29.555429+0000","last_peered":"2024-04-16T19:34:29.555429+0000","last_clean":"2024-04-16T19:34:29.555429+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:34:29.555429+0000","last_undegraded":"2024-04-16T19:34:29.555429+0000","last_fullsized":"2024-04-16T19:34:29.555429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:47.902420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'651","reported_seq":2230,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547568+0000","last_change":"2024-04-16T17:45:49.468732+0000","last_active":"2024-04-16T19:33:49.547568+0000","last_peered":"2024-04-16T19:33:49.547568+0000","last_clean":"2024-04-16T19:33:49.547568+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:33:49.547568+0000","last_undegraded":"2024-04-16T19:33:49.547568+0000","last_fullsized":"2024-04-16T19:33:49.547568+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:02.894263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'344","reported_seq":642,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364192+0000","last_change":"2024-04-16T17:45:47.460745+0000","last_active":"2024-04-16T19:33:49.364192+0000","last_peered":"2024-04-16T19:33:49.364192+0000","last_clean":"2024-04-16T19:33:49.364192+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:33:49.364192+0000","last_undegraded":"2024-04-16T19:33:49.364192+0000","last_fullsized":"2024-04-16T19:33:49.364192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.165117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'13","reported_seq":452,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368729+0000","last_change":"2024-04-16T17:45:45.462237+0000","last_active":"2024-04-16T19:34:09.368729+0000","last_peered":"2024-04-16T19:34:09.368729+0000","last_clean":"2024-04-16T19:34:09.368729+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:34:09.368729+0000","last_undegraded":"2024-04-16T19:34:09.368729+0000","last_fullsized":"2024-04-16T19:34:09.368729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:24.020867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568580+0000","last_change":"2024-04-16T17:45:10.399758+0000","last_active":"2024-04-16T19:35:39.568580+0000","last_peered":"2024-04-16T19:35:39.568580+0000","last_clean":"2024-04-16T19:35:39.568580+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:35:39.568580+0000","last_undegraded":"2024-04-16T19:35:39.568580+0000","last_fullsized":"2024-04-16T19:35:39.568580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:50.581378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385247+0000","last_change":"2024-04-16T17:45:08.386614+0000","last_active":"2024-04-16T19:35:54.385247+0000","last_peered":"2024-04-16T19:35:54.385247+0000","last_clean":"2024-04-16T19:35:54.385247+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:35:54.385247+0000","last_undegraded":"2024-04-16T19:35:54.385247+0000","last_fullsized":"2024-04-16T19:35:54.385247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:51.477510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559198+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T19:34:49.559198+0000","last_peered":"2024-04-16T19:34:49.559198+0000","last_clean":"2024-04-16T19:34:49.559198+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:34:49.559198+0000","last_undegraded":"2024-04-16T19:34:49.559198+0000","last_fullsized":"2024-04-16T19:34:49.559198+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386464+0000","last_change":"2024-04-16T17:45:20.414740+0000","last_active":"2024-04-16T19:35:49.386464+0000","last_peered":"2024-04-16T19:35:49.386464+0000","last_clean":"2024-04-16T19:35:49.386464+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:35:49.386464+0000","last_undegraded":"2024-04-16T19:35:49.386464+0000","last_fullsized":"2024-04-16T19:35:49.386464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:35.855849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'160","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385606+0000","last_change":"2024-04-16T17:45:22.416454+0000","last_active":"2024-04-16T19:35:44.385606+0000","last_peered":"2024-04-16T19:35:44.385606+0000","last_clean":"2024-04-16T19:35:44.385606+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:35:44.385606+0000","last_undegraded":"2024-04-16T19:35:44.385606+0000","last_fullsized":"2024-04-16T19:35:44.385606+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:29.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383620+0000","last_change":"2024-04-16T17:45:24.425127+0000","last_active":"2024-04-16T19:35:49.383620+0000","last_peered":"2024-04-16T19:35:49.383620+0000","last_clean":"2024-04-16T19:35:49.383620+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:35:49.383620+0000","last_undegraded":"2024-04-16T19:35:49.383620+0000","last_fullsized":"2024-04-16T19:35:49.383620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:12.945022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385788+0000","last_change":"2024-04-16T17:45:26.849850+0000","last_active":"2024-04-16T19:35:44.385788+0000","last_peered":"2024-04-16T19:35:44.385788+0000","last_clean":"2024-04-16T19:35:44.385788+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:35:44.385788+0000","last_undegraded":"2024-04-16T19:35:44.385788+0000","last_fullsized":"2024-04-16T19:35:44.385788+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:07.528720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569526+0000","last_change":"2024-04-16T18:09:02.175274+0000","last_active":"2024-04-16T19:35:44.569526+0000","last_peered":"2024-04-16T19:35:44.569526+0000","last_clean":"2024-04-16T19:35:44.569526+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:35:44.569526+0000","last_undegraded":"2024-04-16T19:35:44.569526+0000","last_fullsized":"2024-04-16T19:35:44.569526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:34:45.630832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1689,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374645+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:34:49.374645+0000","last_peered":"2024-04-16T19:34:49.374645+0000","last_clean":"2024-04-16T19:34:49.374645+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:34:49.374645+0000","last_undegraded":"2024-04-16T19:34:49.374645+0000","last_fullsized":"2024-04-16T19:34:49.374645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:00:32.605132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560062+0000","last_change":"2024-04-16T17:46:17.509389+0000","last_active":"2024-04-16T19:34:54.560062+0000","last_peered":"2024-04-16T19:34:54.560062+0000","last_clean":"2024-04-16T19:34:54.560062+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:34:54.560062+0000","last_undegraded":"2024-04-16T19:34:54.560062+0000","last_fullsized":"2024-04-16T19:34:54.560062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:55.368624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"48'7","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367239+0000","last_change":"2024-04-16T17:45:51.478774+0000","last_active":"2024-04-16T19:33:54.367239+0000","last_peered":"2024-04-16T19:33:54.367239+0000","last_clean":"2024-04-16T19:33:54.367239+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:33:54.367239+0000","last_undegraded":"2024-04-16T19:33:54.367239+0000","last_fullsized":"2024-04-16T19:33:54.367239+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:20:52.903342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547518+0000","last_change":"2024-04-16T17:45:49.472675+0000","last_active":"2024-04-16T19:33:49.547518+0000","last_peered":"2024-04-16T19:33:49.547518+0000","last_clean":"2024-04-16T19:33:49.547518+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:33:49.547518+0000","last_undegraded":"2024-04-16T19:33:49.547518+0000","last_fullsized":"2024-04-16T19:33:49.547518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:41.374233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'500","reported_seq":832,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364226+0000","last_change":"2024-04-16T17:45:47.461629+0000","last_active":"2024-04-16T19:33:49.364226+0000","last_peered":"2024-04-16T19:33:49.364226+0000","last_clean":"2024-04-16T19:33:49.364226+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:33:49.364226+0000","last_undegraded":"2024-04-16T19:33:49.364226+0000","last_fullsized":"2024-04-16T19:33:49.364226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:08.910809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'23","reported_seq":293,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:45:45.457257+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384823+0000","last_change":"2024-04-16T17:45:10.392387+0000","last_active":"2024-04-16T19:35:39.384823+0000","last_peered":"2024-04-16T19:35:39.384823+0000","last_clean":"2024-04-16T19:35:39.384823+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:35:39.384823+0000","last_undegraded":"2024-04-16T19:35:39.384823+0000","last_fullsized":"2024-04-16T19:35:39.384823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:56.222153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567683+0000","last_change":"2024-04-16T17:45:08.383729+0000","last_active":"2024-04-16T19:35:34.567683+0000","last_peered":"2024-04-16T19:35:34.567683+0000","last_clean":"2024-04-16T19:35:34.567683+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:35:34.567683+0000","last_undegraded":"2024-04-16T19:35:34.567683+0000","last_fullsized":"2024-04-16T19:35:34.567683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:37.824496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378047+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T19:35:09.378047+0000","last_peered":"2024-04-16T19:35:09.378047+0000","last_clean":"2024-04-16T19:35:09.378047+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:35:09.378047+0000","last_undegraded":"2024-04-16T19:35:09.378047+0000","last_fullsized":"2024-04-16T19:35:09.378047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:22.591585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384362+0000","last_change":"2024-04-16T17:45:20.408473+0000","last_active":"2024-04-16T19:35:49.384362+0000","last_peered":"2024-04-16T19:35:49.384362+0000","last_clean":"2024-04-16T19:35:49.384362+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:35:49.384362+0000","last_undegraded":"2024-04-16T19:35:49.384362+0000","last_fullsized":"2024-04-16T19:35:49.384362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:08.929780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'168","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570487+0000","last_change":"2024-04-16T17:45:22.422298+0000","last_active":"2024-04-16T19:35:49.570487+0000","last_peered":"2024-04-16T19:35:49.570487+0000","last_clean":"2024-04-16T19:35:49.570487+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:35:49.570487+0000","last_undegraded":"2024-04-16T19:35:49.570487+0000","last_fullsized":"2024-04-16T19:35:49.570487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:52.088400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'12","reported_seq":1397,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383571+0000","last_change":"2024-04-16T17:45:24.421136+0000","last_active":"2024-04-16T19:35:44.383571+0000","last_peered":"2024-04-16T19:35:44.383571+0000","last_clean":"2024-04-16T19:35:44.383571+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:35:44.383571+0000","last_undegraded":"2024-04-16T19:35:44.383571+0000","last_fullsized":"2024-04-16T19:35:44.383571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:58:19.841313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.366688+0000","last_change":"2024-04-16T17:45:26.848234+0000","last_active":"2024-04-16T19:33:49.366688+0000","last_peered":"2024-04-16T19:33:49.366688+0000","last_clean":"2024-04-16T19:33:49.366688+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:33:49.366688+0000","last_undegraded":"2024-04-16T19:33:49.366688+0000","last_fullsized":"2024-04-16T19:33:49.366688+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:01.269112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556474+0000","last_change":"2024-04-16T18:09:02.167725+0000","last_active":"2024-04-16T19:34:34.556474+0000","last_peered":"2024-04-16T19:34:34.556474+0000","last_clean":"2024-04-16T19:34:34.556474+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:34:34.556474+0000","last_undegraded":"2024-04-16T19:34:34.556474+0000","last_fullsized":"2024-04-16T19:34:34.556474+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:58.398812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1836,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377912+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:35:09.377912+0000","last_peered":"2024-04-16T19:35:09.377912+0000","last_clean":"2024-04-16T19:35:09.377912+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:35:09.377912+0000","last_undegraded":"2024-04-16T19:35:09.377912+0000","last_fullsized":"2024-04-16T19:35:09.377912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:53:10.911757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373250+0000","last_change":"2024-04-16T17:46:17.508698+0000","last_active":"2024-04-16T19:34:39.373250+0000","last_peered":"2024-04-16T19:34:39.373250+0000","last_clean":"2024-04-16T19:34:39.373250+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:34:39.373250+0000","last_undegraded":"2024-04-16T19:34:39.373250+0000","last_fullsized":"2024-04-16T19:34:39.373250+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:43.428844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'1","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552153+0000","last_change":"2024-04-16T17:45:51.481009+0000","last_active":"2024-04-16T19:34:14.552153+0000","last_peered":"2024-04-16T19:34:14.552153+0000","last_clean":"2024-04-16T19:34:14.552153+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:34:14.552153+0000","last_undegraded":"2024-04-16T19:34:14.552153+0000","last_fullsized":"2024-04-16T19:34:14.552153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:41:38.373017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368296+0000","last_change":"2024-04-16T17:45:49.472070+0000","last_active":"2024-04-16T19:34:09.368296+0000","last_peered":"2024-04-16T19:34:09.368296+0000","last_clean":"2024-04-16T19:34:09.368296+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:34:09.368296+0000","last_undegraded":"2024-04-16T19:34:09.368296+0000","last_fullsized":"2024-04-16T19:34:09.368296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:41.089795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'322","reported_seq":583,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364288+0000","last_change":"2024-04-16T17:45:47.464210+0000","last_active":"2024-04-16T19:33:49.364288+0000","last_peered":"2024-04-16T19:33:49.364288+0000","last_clean":"2024-04-16T19:33:49.364288+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:33:49.364288+0000","last_undegraded":"2024-04-16T19:33:49.364288+0000","last_fullsized":"2024-04-16T19:33:49.364288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:19.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'20","reported_seq":575,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364941+0000","last_change":"2024-04-16T17:45:45.465938+0000","last_active":"2024-04-16T19:33:49.364941+0000","last_peered":"2024-04-16T19:33:49.364941+0000","last_clean":"2024-04-16T19:33:49.364941+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:33:49.364941+0000","last_undegraded":"2024-04-16T19:33:49.364941+0000","last_fullsized":"2024-04-16T19:33:49.364941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:40.527095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.383949+0000","last_change":"2024-04-16T17:45:10.400196+0000","last_active":"2024-04-16T19:35:34.383949+0000","last_peered":"2024-04-16T19:35:34.383949+0000","last_clean":"2024-04-16T19:35:34.383949+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:35:34.383949+0000","last_undegraded":"2024-04-16T19:35:34.383949+0000","last_fullsized":"2024-04-16T19:35:34.383949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:25.987507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568727+0000","last_change":"2024-04-16T17:45:08.382982+0000","last_active":"2024-04-16T19:35:39.568727+0000","last_peered":"2024-04-16T19:35:39.568727+0000","last_clean":"2024-04-16T19:35:39.568727+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:35:39.568727+0000","last_undegraded":"2024-04-16T19:35:39.568727+0000","last_fullsized":"2024-04-16T19:35:39.568727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:20.573792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560153+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T19:34:54.560153+0000","last_peered":"2024-04-16T19:34:54.560153+0000","last_clean":"2024-04-16T19:34:54.560153+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:34:54.560153+0000","last_undegraded":"2024-04-16T19:34:54.560153+0000","last_fullsized":"2024-04-16T19:34:54.560153+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"48'3","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384408+0000","last_change":"2024-04-16T17:45:20.407710+0000","last_active":"2024-04-16T19:35:49.384408+0000","last_peered":"2024-04-16T19:35:49.384408+0000","last_clean":"2024-04-16T19:35:49.384408+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:35:49.384408+0000","last_undegraded":"2024-04-16T19:35:49.384408+0000","last_fullsized":"2024-04-16T19:35:49.384408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:05:22.200949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'120","reported_seq":300,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384447+0000","last_change":"2024-04-16T17:45:22.416114+0000","last_active":"2024-04-16T19:35:49.384447+0000","last_peered":"2024-04-16T19:35:49.384447+0000","last_clean":"2024-04-16T19:35:49.384447+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:35:49.384447+0000","last_undegraded":"2024-04-16T19:35:49.384447+0000","last_fullsized":"2024-04-16T19:35:49.384447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:41.992526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'12","reported_seq":1395,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386482+0000","last_change":"2024-04-16T17:45:24.423991+0000","last_active":"2024-04-16T19:35:49.386482+0000","last_peered":"2024-04-16T19:35:49.386482+0000","last_clean":"2024-04-16T19:35:49.386482+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:35:49.386482+0000","last_undegraded":"2024-04-16T19:35:49.386482+0000","last_fullsized":"2024-04-16T19:35:49.386482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:27.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385733+0000","last_change":"2024-04-16T17:45:26.847697+0000","last_active":"2024-04-16T19:35:44.385733+0000","last_peered":"2024-04-16T19:35:44.385733+0000","last_clean":"2024-04-16T19:35:44.385733+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:35:44.385733+0000","last_undegraded":"2024-04-16T19:35:44.385733+0000","last_fullsized":"2024-04-16T19:35:44.385733+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:01.653239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547405+0000","last_change":"2024-04-16T18:09:02.166269+0000","last_active":"2024-04-16T19:33:49.547405+0000","last_peered":"2024-04-16T19:33:49.547405+0000","last_clean":"2024-04-16T19:33:49.547405+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:33:49.547405+0000","last_undegraded":"2024-04-16T19:33:49.547405+0000","last_fullsized":"2024-04-16T19:33:49.547405+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:29:39.706202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2088,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.373365+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:34:29.373365+0000","last_peered":"2024-04-16T19:34:29.373365+0000","last_clean":"2024-04-16T19:34:29.373365+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:34:29.373365+0000","last_undegraded":"2024-04-16T19:34:29.373365+0000","last_fullsized":"2024-04-16T19:34:29.373365+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:13:09.115332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557253+0000","last_change":"2024-04-16T17:46:17.513695+0000","last_active":"2024-04-16T19:34:39.557253+0000","last_peered":"2024-04-16T19:34:39.557253+0000","last_clean":"2024-04-16T19:34:39.557253+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:34:39.557253+0000","last_undegraded":"2024-04-16T19:34:39.557253+0000","last_fullsized":"2024-04-16T19:34:39.557253+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:36.596198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'6","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552231+0000","last_change":"2024-04-16T17:45:51.483674+0000","last_active":"2024-04-16T19:34:14.552231+0000","last_peered":"2024-04-16T19:34:14.552231+0000","last_clean":"2024-04-16T19:34:14.552231+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:34:14.552231+0000","last_undegraded":"2024-04-16T19:34:14.552231+0000","last_fullsized":"2024-04-16T19:34:14.552231+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:44.630489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'651","reported_seq":2202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364275+0000","last_change":"2024-04-16T17:45:49.466697+0000","last_active":"2024-04-16T19:33:49.364275+0000","last_peered":"2024-04-16T19:33:49.364275+0000","last_clean":"2024-04-16T19:33:49.364275+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:33:49.364275+0000","last_undegraded":"2024-04-16T19:33:49.364275+0000","last_fullsized":"2024-04-16T19:33:49.364275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:59.328751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5527","reported_seq":10317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368349+0000","last_change":"2024-04-16T17:45:47.459919+0000","last_active":"2024-04-16T19:34:09.368349+0000","last_peered":"2024-04-16T19:34:09.368349+0000","last_clean":"2024-04-16T19:34:09.368349+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:34:09.368349+0000","last_undegraded":"2024-04-16T19:34:09.368349+0000","last_fullsized":"2024-04-16T19:34:09.368349+0000","mapping_epoch":33,"log_start":"53'3700","ondisk_log_start":"53'3700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":3000,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:18.684283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'12","reported_seq":686,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547542+0000","last_change":"2024-04-16T17:45:45.456575+0000","last_active":"2024-04-16T19:33:49.547542+0000","last_peered":"2024-04-16T19:33:49.547542+0000","last_clean":"2024-04-16T19:33:49.547542+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:33:49.547542+0000","last_undegraded":"2024-04-16T19:33:49.547542+0000","last_fullsized":"2024-04-16T19:33:49.547542+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:52.179755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382207+0000","last_change":"2024-04-16T17:45:10.399687+0000","last_active":"2024-04-16T19:35:39.382207+0000","last_peered":"2024-04-16T19:35:39.382207+0000","last_clean":"2024-04-16T19:35:39.382207+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:35:39.382207+0000","last_undegraded":"2024-04-16T19:35:39.382207+0000","last_fullsized":"2024-04-16T19:35:39.382207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:09.857567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384942+0000","last_change":"2024-04-16T17:45:08.381368+0000","last_active":"2024-04-16T19:35:39.384942+0000","last_peered":"2024-04-16T19:35:39.384942+0000","last_clean":"2024-04-16T19:35:39.384942+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:35:39.384942+0000","last_undegraded":"2024-04-16T19:35:39.384942+0000","last_fullsized":"2024-04-16T19:35:39.384942+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:56.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375597+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:34:54.375597+0000","last_peered":"2024-04-16T19:34:54.375597+0000","last_clean":"2024-04-16T19:34:54.375597+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:34:54.375597+0000","last_undegraded":"2024-04-16T19:34:54.375597+0000","last_fullsized":"2024-04-16T19:34:54.375597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:37.225695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'1","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568508+0000","last_change":"2024-04-16T17:45:20.403582+0000","last_active":"2024-04-16T19:35:39.568508+0000","last_peered":"2024-04-16T19:35:39.568508+0000","last_clean":"2024-04-16T19:35:39.568508+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:35:39.568508+0000","last_undegraded":"2024-04-16T19:35:39.568508+0000","last_fullsized":"2024-04-16T19:35:39.568508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:24.706560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'144","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383684+0000","last_change":"2024-04-16T17:45:22.414745+0000","last_active":"2024-04-16T19:35:49.383684+0000","last_peered":"2024-04-16T19:35:49.383684+0000","last_clean":"2024-04-16T19:35:49.383684+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:35:49.383684+0000","last_undegraded":"2024-04-16T19:35:49.383684+0000","last_fullsized":"2024-04-16T19:35:49.383684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:39.722446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570534+0000","last_change":"2024-04-16T17:45:24.425364+0000","last_active":"2024-04-16T19:35:49.570534+0000","last_peered":"2024-04-16T19:35:49.570534+0000","last_clean":"2024-04-16T19:35:49.570534+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:35:49.570534+0000","last_undegraded":"2024-04-16T19:35:49.570534+0000","last_fullsized":"2024-04-16T19:35:49.570534+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:30.330417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383746+0000","last_change":"2024-04-16T17:45:26.438987+0000","last_active":"2024-04-16T19:35:44.383746+0000","last_peered":"2024-04-16T19:35:44.383746+0000","last_clean":"2024-04-16T19:35:44.383746+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:35:44.383746+0000","last_undegraded":"2024-04-16T19:35:44.383746+0000","last_fullsized":"2024-04-16T19:35:44.383746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:46.197032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.364975+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:33:39.364975+0000","last_peered":"2024-04-16T19:33:39.364975+0000","last_clean":"2024-04-16T19:33:39.364975+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:33:39.364975+0000","last_undegraded":"2024-04-16T19:33:39.364975+0000","last_fullsized":"2024-04-16T19:33:39.364975+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:01:53.017679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'101","reported_seq":1735,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381973+0000","last_change":"2024-04-16T17:46:25.527509+0000","last_active":"2024-04-16T19:35:34.381973+0000","last_peered":"2024-04-16T19:35:34.381973+0000","last_clean":"2024-04-16T19:35:34.381973+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:35:34.381973+0000","last_undegraded":"2024-04-16T19:35:34.381973+0000","last_fullsized":"2024-04-16T19:35:34.381973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:21:20.635118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547428+0000","last_change":"2024-04-16T17:46:17.509709+0000","last_active":"2024-04-16T19:33:49.547428+0000","last_peered":"2024-04-16T19:33:49.547428+0000","last_clean":"2024-04-16T19:33:49.547428+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:33:49.547428+0000","last_undegraded":"2024-04-16T19:33:49.547428+0000","last_fullsized":"2024-04-16T19:33:49.547428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:47.005389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'19","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359896+0000","last_change":"2024-04-16T17:45:51.477907+0000","last_active":"2024-04-16T19:33:24.359896+0000","last_peered":"2024-04-16T19:33:24.359896+0000","last_clean":"2024-04-16T19:33:24.359896+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:33:24.359896+0000","last_undegraded":"2024-04-16T19:33:24.359896+0000","last_fullsized":"2024-04-16T19:33:24.359896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:36.428648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359952+0000","last_change":"2024-04-16T17:45:49.470293+0000","last_active":"2024-04-16T19:33:19.359952+0000","last_peered":"2024-04-16T19:33:19.359952+0000","last_clean":"2024-04-16T19:33:19.359952+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:33:19.359952+0000","last_undegraded":"2024-04-16T19:33:19.359952+0000","last_fullsized":"2024-04-16T19:33:19.359952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:00.700374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'320","reported_seq":621,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359234+0000","last_change":"2024-04-16T17:45:47.462032+0000","last_active":"2024-04-16T19:33:19.359234+0000","last_peered":"2024-04-16T19:33:19.359234+0000","last_clean":"2024-04-16T19:33:19.359234+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:33:19.359234+0000","last_undegraded":"2024-04-16T19:33:19.359234+0000","last_fullsized":"2024-04-16T19:33:19.359234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:07:03.652770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'7","reported_seq":610,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370042+0000","last_change":"2024-04-16T17:45:45.462463+0000","last_active":"2024-04-16T19:34:09.370042+0000","last_peered":"2024-04-16T19:34:09.370042+0000","last_clean":"2024-04-16T19:34:09.370042+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:34:09.370042+0000","last_undegraded":"2024-04-16T19:34:09.370042+0000","last_fullsized":"2024-04-16T19:34:09.370042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:29.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387507+0000","last_change":"2024-04-16T17:45:26.438380+0000","last_active":"2024-04-16T19:35:54.387507+0000","last_peered":"2024-04-16T19:35:54.387507+0000","last_clean":"2024-04-16T19:35:54.387507+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:35:54.387507+0000","last_undegraded":"2024-04-16T19:35:54.387507+0000","last_fullsized":"2024-04-16T19:35:54.387507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:27:39.860458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374918+0000","last_change":"2024-04-16T17:45:10.393485+0000","last_active":"2024-04-16T19:34:54.374918+0000","last_peered":"2024-04-16T19:34:54.374918+0000","last_clean":"2024-04-16T19:34:54.374918+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:34:54.374918+0000","last_undegraded":"2024-04-16T19:34:54.374918+0000","last_fullsized":"2024-04-16T19:34:54.374918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:39.589700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378001+0000","last_change":"2024-04-16T17:45:08.386299+0000","last_active":"2024-04-16T19:35:09.378001+0000","last_peered":"2024-04-16T19:35:09.378001+0000","last_clean":"2024-04-16T19:35:09.378001+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:35:09.378001+0000","last_undegraded":"2024-04-16T19:35:09.378001+0000","last_fullsized":"2024-04-16T19:35:09.378001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:20:58.450960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"30'1","reported_seq":209,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561968+0000","last_change":"2024-04-16T17:45:20.412485+0000","last_active":"2024-04-16T19:35:04.561968+0000","last_peered":"2024-04-16T19:35:04.561968+0000","last_clean":"2024-04-16T19:35:04.561968+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:35:04.561968+0000","last_undegraded":"2024-04-16T19:35:04.561968+0000","last_fullsized":"2024-04-16T19:35:04.561968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:51.721722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'104","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561932+0000","last_change":"2024-04-16T17:45:22.416196+0000","last_active":"2024-04-16T19:35:04.561932+0000","last_peered":"2024-04-16T19:35:04.561932+0000","last_clean":"2024-04-16T19:35:04.561932+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:35:04.561932+0000","last_undegraded":"2024-04-16T19:35:04.561932+0000","last_fullsized":"2024-04-16T19:35:04.561932+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:07.744516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.561881+0000","last_change":"2024-04-16T17:45:24.424718+0000","last_active":"2024-04-16T19:35:04.561881+0000","last_peered":"2024-04-16T19:35:04.561881+0000","last_clean":"2024-04-16T19:35:04.561881+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:35:04.561881+0000","last_undegraded":"2024-04-16T19:35:04.561881+0000","last_fullsized":"2024-04-16T19:35:04.561881+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:19.493177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365069+0000","last_change":"2024-04-16T18:09:02.165652+0000","last_active":"2024-04-16T19:33:54.365069+0000","last_peered":"2024-04-16T19:33:54.365069+0000","last_clean":"2024-04-16T19:33:54.365069+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:33:54.365069+0000","last_undegraded":"2024-04-16T19:33:54.365069+0000","last_fullsized":"2024-04-16T19:33:54.365069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:43:38.642286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'147","reported_seq":1630,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563777+0000","last_change":"2024-04-16T17:46:25.533095+0000","last_active":"2024-04-16T19:35:14.563777+0000","last_peered":"2024-04-16T19:35:14.563777+0000","last_clean":"2024-04-16T19:35:14.563777+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:35:14.563777+0000","last_undegraded":"2024-04-16T19:35:14.563777+0000","last_fullsized":"2024-04-16T19:35:14.563777+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:43.474084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364167+0000","last_change":"2024-04-16T17:46:17.509499+0000","last_active":"2024-04-16T19:33:49.364167+0000","last_peered":"2024-04-16T19:33:49.364167+0000","last_clean":"2024-04-16T19:33:49.364167+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:33:49.364167+0000","last_undegraded":"2024-04-16T19:33:49.364167+0000","last_fullsized":"2024-04-16T19:33:49.364167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:29.073777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'12","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359843+0000","last_change":"2024-04-16T17:47:16.567012+0000","last_active":"2024-04-16T19:33:24.359843+0000","last_peered":"2024-04-16T19:33:24.359843+0000","last_clean":"2024-04-16T19:33:24.359843+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:33:24.359843+0000","last_undegraded":"2024-04-16T19:33:24.359843+0000","last_fullsized":"2024-04-16T19:33:24.359843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:10.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360192+0000","last_change":"2024-04-16T17:45:49.471808+0000","last_active":"2024-04-16T19:33:19.360192+0000","last_peered":"2024-04-16T19:33:19.360192+0000","last_clean":"2024-04-16T19:33:19.360192+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:33:19.360192+0000","last_undegraded":"2024-04-16T19:33:19.360192+0000","last_fullsized":"2024-04-16T19:33:19.360192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:34.249301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'442","reported_seq":2030,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359929+0000","last_change":"2024-04-16T17:45:47.465673+0000","last_active":"2024-04-16T19:33:19.359929+0000","last_peered":"2024-04-16T19:33:19.359929+0000","last_clean":"2024-04-16T19:33:19.359929+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:33:19.359929+0000","last_undegraded":"2024-04-16T19:33:19.359929+0000","last_fullsized":"2024-04-16T19:33:19.359929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:53.982530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'17","reported_seq":461,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551476+0000","last_change":"2024-04-16T17:45:45.465670+0000","last_active":"2024-04-16T19:34:09.551476+0000","last_peered":"2024-04-16T19:34:09.551476+0000","last_clean":"2024-04-16T19:34:09.551476+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:34:09.551476+0000","last_undegraded":"2024-04-16T19:34:09.551476+0000","last_fullsized":"2024-04-16T19:34:09.551476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:14.079978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569743+0000","last_change":"2024-04-16T17:45:26.432878+0000","last_active":"2024-04-16T19:35:44.569743+0000","last_peered":"2024-04-16T19:35:44.569743+0000","last_clean":"2024-04-16T19:35:44.569743+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:35:44.569743+0000","last_undegraded":"2024-04-16T19:35:44.569743+0000","last_fullsized":"2024-04-16T19:35:44.569743+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:57.379632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560037+0000","last_change":"2024-04-16T17:45:10.394503+0000","last_active":"2024-04-16T19:34:54.560037+0000","last_peered":"2024-04-16T19:34:54.560037+0000","last_clean":"2024-04-16T19:34:54.560037+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:34:54.560037+0000","last_undegraded":"2024-04-16T19:34:54.560037+0000","last_fullsized":"2024-04-16T19:34:54.560037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:31.534272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365715+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:33:54.365715+0000","last_peered":"2024-04-16T19:33:54.365715+0000","last_clean":"2024-04-16T19:33:54.365715+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:33:54.365715+0000","last_undegraded":"2024-04-16T19:33:54.365715+0000","last_fullsized":"2024-04-16T19:33:54.365715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:45.243544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'1","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.562014+0000","last_change":"2024-04-16T17:45:20.407788+0000","last_active":"2024-04-16T19:35:04.562014+0000","last_peered":"2024-04-16T19:35:04.562014+0000","last_clean":"2024-04-16T19:35:04.562014+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:35:04.562014+0000","last_undegraded":"2024-04-16T19:35:04.562014+0000","last_fullsized":"2024-04-16T19:35:04.562014+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:26.315175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'50","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378804+0000","last_change":"2024-04-16T17:45:22.421476+0000","last_active":"2024-04-16T19:35:04.378804+0000","last_peered":"2024-04-16T19:35:04.378804+0000","last_clean":"2024-04-16T19:35:04.378804+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:35:04.378804+0000","last_undegraded":"2024-04-16T19:35:04.378804+0000","last_fullsized":"2024-04-16T19:35:04.378804+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:38.752189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376965+0000","last_change":"2024-04-16T17:45:24.430870+0000","last_active":"2024-04-16T19:35:04.376965+0000","last_peered":"2024-04-16T19:35:04.376965+0000","last_clean":"2024-04-16T19:35:04.376965+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:35:04.376965+0000","last_undegraded":"2024-04-16T19:35:04.376965+0000","last_fullsized":"2024-04-16T19:35:04.376965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:19.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367440+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:34:04.367440+0000","last_peered":"2024-04-16T19:34:04.367440+0000","last_clean":"2024-04-16T19:34:04.367440+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:34:04.367440+0000","last_undegraded":"2024-04-16T19:34:04.367440+0000","last_fullsized":"2024-04-16T19:34:04.367440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:38.119812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'109","reported_seq":1796,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.549363+0000","last_change":"2024-04-16T17:46:25.527453+0000","last_active":"2024-04-16T19:33:59.549363+0000","last_peered":"2024-04-16T19:33:59.549363+0000","last_clean":"2024-04-16T19:33:59.549363+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:33:59.549363+0000","last_undegraded":"2024-04-16T19:33:59.549363+0000","last_fullsized":"2024-04-16T19:33:59.549363+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:48:39.537015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376799+0000","last_change":"2024-04-16T17:46:17.506081+0000","last_active":"2024-04-16T19:35:04.376799+0000","last_peered":"2024-04-16T19:35:04.376799+0000","last_clean":"2024-04-16T19:35:04.376799+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:35:04.376799+0000","last_undegraded":"2024-04-16T19:35:04.376799+0000","last_fullsized":"2024-04-16T19:35:04.376799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:44:37.801667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'14","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:59.377912+0000","last_change":"2024-04-16T17:45:51.484484+0000","last_active":"2024-04-16T19:34:59.377912+0000","last_peered":"2024-04-16T19:34:59.377912+0000","last_clean":"2024-04-16T19:34:59.377912+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:34:59.377912+0000","last_undegraded":"2024-04-16T19:34:59.377912+0000","last_fullsized":"2024-04-16T19:34:59.377912+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:35.709508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368662+0000","last_change":"2024-04-16T17:45:49.473382+0000","last_active":"2024-04-16T19:34:09.368662+0000","last_peered":"2024-04-16T19:34:09.368662+0000","last_clean":"2024-04-16T19:34:09.368662+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:34:09.368662+0000","last_undegraded":"2024-04-16T19:34:09.368662+0000","last_fullsized":"2024-04-16T19:34:09.368662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:18.012352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'659","reported_seq":2170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368312+0000","last_change":"2024-04-16T17:45:47.461388+0000","last_active":"2024-04-16T19:34:09.368312+0000","last_peered":"2024-04-16T19:34:09.368312+0000","last_clean":"2024-04-16T19:34:09.368312+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:34:09.368312+0000","last_undegraded":"2024-04-16T19:34:09.368312+0000","last_fullsized":"2024-04-16T19:34:09.368312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:49.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'31","reported_seq":357,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361706+0000","last_change":"2024-04-16T17:45:45.467998+0000","last_active":"2024-04-16T19:33:19.361706+0000","last_peered":"2024-04-16T19:33:19.361706+0000","last_clean":"2024-04-16T19:33:19.361706+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:33:19.361706+0000","last_undegraded":"2024-04-16T19:33:19.361706+0000","last_fullsized":"2024-04-16T19:33:19.361706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383273+0000","last_change":"2024-04-16T17:45:26.427816+0000","last_active":"2024-04-16T19:35:29.383273+0000","last_peered":"2024-04-16T19:35:29.383273+0000","last_clean":"2024-04-16T19:35:29.383273+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:35:29.383273+0000","last_undegraded":"2024-04-16T19:35:29.383273+0000","last_fullsized":"2024-04-16T19:35:29.383273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:08.477244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.560005+0000","last_change":"2024-04-16T17:45:10.395061+0000","last_active":"2024-04-16T19:34:54.560005+0000","last_peered":"2024-04-16T19:34:54.560005+0000","last_clean":"2024-04-16T19:34:54.560005+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:34:54.560005+0000","last_undegraded":"2024-04-16T19:34:54.560005+0000","last_fullsized":"2024-04-16T19:34:54.560005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:25:31.050543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365780+0000","last_change":"2024-04-16T17:45:08.389656+0000","last_active":"2024-04-16T19:33:54.365780+0000","last_peered":"2024-04-16T19:33:54.365780+0000","last_clean":"2024-04-16T19:33:54.365780+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:33:54.365780+0000","last_undegraded":"2024-04-16T19:33:54.365780+0000","last_fullsized":"2024-04-16T19:33:54.365780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:58.984483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376423+0000","last_change":"2024-04-16T17:45:20.407054+0000","last_active":"2024-04-16T19:35:04.376423+0000","last_peered":"2024-04-16T19:35:04.376423+0000","last_clean":"2024-04-16T19:35:04.376423+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:35:04.376423+0000","last_undegraded":"2024-04-16T19:35:04.376423+0000","last_fullsized":"2024-04-16T19:35:04.376423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:14.285286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'104","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.562025+0000","last_change":"2024-04-16T17:45:22.415814+0000","last_active":"2024-04-16T19:35:04.562025+0000","last_peered":"2024-04-16T19:35:04.562025+0000","last_clean":"2024-04-16T19:35:04.562025+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:35:04.562025+0000","last_undegraded":"2024-04-16T19:35:04.562025+0000","last_fullsized":"2024-04-16T19:35:04.562025+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:36.063225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376882+0000","last_change":"2024-04-16T17:45:24.425524+0000","last_active":"2024-04-16T19:35:04.376882+0000","last_peered":"2024-04-16T19:35:04.376882+0000","last_clean":"2024-04-16T19:35:04.376882+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:35:04.376882+0000","last_undegraded":"2024-04-16T19:35:04.376882+0000","last_fullsized":"2024-04-16T19:35:04.376882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:17.147197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367227+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:34:04.367227+0000","last_peered":"2024-04-16T19:34:04.367227+0000","last_clean":"2024-04-16T19:34:04.367227+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:34:04.367227+0000","last_undegraded":"2024-04-16T19:34:04.367227+0000","last_fullsized":"2024-04-16T19:34:04.367227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2057,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368201+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:33:59.368201+0000","last_peered":"2024-04-16T19:33:59.368201+0000","last_clean":"2024-04-16T19:33:59.368201+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:33:59.368201+0000","last_undegraded":"2024-04-16T19:33:59.368201+0000","last_fullsized":"2024-04-16T19:33:59.368201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:18:49.538603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:19.564906+0000","last_change":"2024-04-16T17:46:17.512965+0000","last_active":"2024-04-16T19:35:19.564906+0000","last_peered":"2024-04-16T19:35:19.564906+0000","last_clean":"2024-04-16T19:35:19.564906+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:35:19.564906+0000","last_undegraded":"2024-04-16T19:35:19.564906+0000","last_fullsized":"2024-04-16T19:35:19.564906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:46.834965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'12","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557237+0000","last_change":"2024-04-16T17:45:51.477961+0000","last_active":"2024-04-16T19:34:39.557237+0000","last_peered":"2024-04-16T19:34:39.557237+0000","last_clean":"2024-04-16T19:34:39.557237+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:34:39.557237+0000","last_undegraded":"2024-04-16T19:34:39.557237+0000","last_fullsized":"2024-04-16T19:34:39.557237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:47.996402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'651","reported_seq":2194,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551499+0000","last_change":"2024-04-16T17:45:49.469998+0000","last_active":"2024-04-16T19:34:09.551499+0000","last_peered":"2024-04-16T19:34:09.551499+0000","last_clean":"2024-04-16T19:34:09.551499+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:34:09.551499+0000","last_undegraded":"2024-04-16T19:34:09.551499+0000","last_fullsized":"2024-04-16T19:34:09.551499+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:24.434279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'720","reported_seq":3524,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370031+0000","last_change":"2024-04-16T17:45:47.463990+0000","last_active":"2024-04-16T19:34:09.370031+0000","last_peered":"2024-04-16T19:34:09.370031+0000","last_clean":"2024-04-16T19:34:09.370031+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:34:09.370031+0000","last_undegraded":"2024-04-16T19:34:09.370031+0000","last_fullsized":"2024-04-16T19:34:09.370031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:34.349862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'9","reported_seq":282,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361724+0000","last_change":"2024-04-16T17:45:45.465394+0000","last_active":"2024-04-16T19:33:19.361724+0000","last_peered":"2024-04-16T19:33:19.361724+0000","last_clean":"2024-04-16T19:33:19.361724+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:33:19.361724+0000","last_undegraded":"2024-04-16T19:33:19.361724+0000","last_fullsized":"2024-04-16T19:33:19.361724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:27.529464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381373+0000","last_change":"2024-04-16T17:45:26.438413+0000","last_active":"2024-04-16T19:35:29.381373+0000","last_peered":"2024-04-16T19:35:29.381373+0000","last_clean":"2024-04-16T19:35:29.381373+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:35:29.381373+0000","last_undegraded":"2024-04-16T19:35:29.381373+0000","last_fullsized":"2024-04-16T19:35:29.381373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:29.732765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.559943+0000","last_change":"2024-04-16T17:45:10.402839+0000","last_active":"2024-04-16T19:34:54.559943+0000","last_peered":"2024-04-16T19:34:54.559943+0000","last_clean":"2024-04-16T19:34:54.559943+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:34:54.559943+0000","last_undegraded":"2024-04-16T19:34:54.559943+0000","last_fullsized":"2024-04-16T19:34:54.559943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:09.857567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.367401+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:33:54.367401+0000","last_peered":"2024-04-16T19:33:54.367401+0000","last_clean":"2024-04-16T19:33:54.367401+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:33:54.367401+0000","last_undegraded":"2024-04-16T19:33:54.367401+0000","last_fullsized":"2024-04-16T19:33:54.367401+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:34:33.739095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"48'4","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376995+0000","last_change":"2024-04-16T17:45:20.413469+0000","last_active":"2024-04-16T19:35:04.376995+0000","last_peered":"2024-04-16T19:35:04.376995+0000","last_clean":"2024-04-16T19:35:04.376995+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:35:04.376995+0000","last_undegraded":"2024-04-16T19:35:04.376995+0000","last_fullsized":"2024-04-16T19:35:04.376995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:49:00.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'80","reported_seq":239,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376922+0000","last_change":"2024-04-16T17:45:22.415761+0000","last_active":"2024-04-16T19:35:04.376922+0000","last_peered":"2024-04-16T19:35:04.376922+0000","last_clean":"2024-04-16T19:35:04.376922+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:35:04.376922+0000","last_undegraded":"2024-04-16T19:35:04.376922+0000","last_fullsized":"2024-04-16T19:35:04.376922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:17.485768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378903+0000","last_change":"2024-04-16T17:45:24.426374+0000","last_active":"2024-04-16T19:35:04.378903+0000","last_peered":"2024-04-16T19:35:04.378903+0000","last_clean":"2024-04-16T19:35:04.378903+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:35:04.378903+0000","last_undegraded":"2024-04-16T19:35:04.378903+0000","last_fullsized":"2024-04-16T19:35:04.378903+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:48.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382870+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:35:39.382870+0000","last_peered":"2024-04-16T19:35:39.382870+0000","last_clean":"2024-04-16T19:35:39.382870+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:35:39.382870+0000","last_undegraded":"2024-04-16T19:35:39.382870+0000","last_fullsized":"2024-04-16T19:35:39.382870+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:01.886612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'112","reported_seq":1493,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378892+0000","last_change":"2024-04-16T17:46:25.525571+0000","last_active":"2024-04-16T19:35:14.378892+0000","last_peered":"2024-04-16T19:35:14.378892+0000","last_clean":"2024-04-16T19:35:14.378892+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:35:14.378892+0000","last_undegraded":"2024-04-16T19:35:14.378892+0000","last_fullsized":"2024-04-16T19:35:14.378892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:13:09.115332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.378980+0000","last_change":"2024-04-16T17:46:17.504593+0000","last_active":"2024-04-16T19:35:04.378980+0000","last_peered":"2024-04-16T19:35:04.378980+0000","last_clean":"2024-04-16T19:35:04.378980+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:35:04.378980+0000","last_undegraded":"2024-04-16T19:35:04.378980+0000","last_fullsized":"2024-04-16T19:35:04.378980+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"51'2","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372544+0000","last_change":"2024-04-16T17:45:51.480201+0000","last_active":"2024-04-16T19:34:39.372544+0000","last_peered":"2024-04-16T19:34:39.372544+0000","last_clean":"2024-04-16T19:34:39.372544+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:34:39.372544+0000","last_undegraded":"2024-04-16T19:34:39.372544+0000","last_fullsized":"2024-04-16T19:34:39.372544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:45.935071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383071+0000","last_change":"2024-04-16T17:45:49.476432+0000","last_active":"2024-04-16T19:35:29.383071+0000","last_peered":"2024-04-16T19:35:29.383071+0000","last_clean":"2024-04-16T19:35:29.383071+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:35:29.383071+0000","last_undegraded":"2024-04-16T19:35:29.383071+0000","last_fullsized":"2024-04-16T19:35:29.383071+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:38:03.985918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'369","reported_seq":693,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381232+0000","last_change":"2024-04-16T17:45:47.464967+0000","last_active":"2024-04-16T19:35:29.381232+0000","last_peered":"2024-04-16T19:35:29.381232+0000","last_clean":"2024-04-16T19:35:29.381232+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:35:29.381232+0000","last_undegraded":"2024-04-16T19:35:29.381232+0000","last_fullsized":"2024-04-16T19:35:29.381232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:39.367104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'16","reported_seq":322,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381287+0000","last_change":"2024-04-16T17:45:45.461625+0000","last_active":"2024-04-16T19:35:29.381287+0000","last_peered":"2024-04-16T19:35:29.381287+0000","last_clean":"2024-04-16T19:35:29.381287+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:35:29.381287+0000","last_undegraded":"2024-04-16T19:35:29.381287+0000","last_fullsized":"2024-04-16T19:35:29.381287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:34.843168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382983+0000","last_change":"2024-04-16T17:45:10.396745+0000","last_active":"2024-04-16T19:35:39.382983+0000","last_peered":"2024-04-16T19:35:39.382983+0000","last_clean":"2024-04-16T19:35:39.382983+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:35:39.382983+0000","last_undegraded":"2024-04-16T19:35:39.382983+0000","last_fullsized":"2024-04-16T19:35:39.382983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:40.062822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.548366+0000","last_change":"2024-04-16T17:45:08.384480+0000","last_active":"2024-04-16T19:33:54.548366+0000","last_peered":"2024-04-16T19:33:54.548366+0000","last_clean":"2024-04-16T19:33:54.548366+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:33:54.548366+0000","last_undegraded":"2024-04-16T19:33:54.548366+0000","last_fullsized":"2024-04-16T19:33:54.548366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:09.600364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.385816+0000","last_change":"2024-04-16T17:45:20.414382+0000","last_active":"2024-04-16T19:35:44.385816+0000","last_peered":"2024-04-16T19:35:44.385816+0000","last_clean":"2024-04-16T19:35:44.385816+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:35:44.385816+0000","last_undegraded":"2024-04-16T19:35:44.385816+0000","last_fullsized":"2024-04-16T19:35:44.385816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:53:22.840598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'88","reported_seq":253,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565896+0000","last_change":"2024-04-16T17:45:22.421515+0000","last_active":"2024-04-16T19:35:24.565896+0000","last_peered":"2024-04-16T19:35:24.565896+0000","last_clean":"2024-04-16T19:35:24.565896+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:35:24.565896+0000","last_undegraded":"2024-04-16T19:35:24.565896+0000","last_fullsized":"2024-04-16T19:35:24.565896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:10.937613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380602+0000","last_change":"2024-04-16T17:45:24.425946+0000","last_active":"2024-04-16T19:35:24.380602+0000","last_peered":"2024-04-16T19:35:24.380602+0000","last_clean":"2024-04-16T19:35:24.380602+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:35:24.380602+0000","last_undegraded":"2024-04-16T19:35:24.380602+0000","last_fullsized":"2024-04-16T19:35:24.380602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.451179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.562876+0000","last_change":"2024-04-16T17:45:26.849050+0000","last_active":"2024-04-16T19:35:09.562876+0000","last_peered":"2024-04-16T19:35:09.562876+0000","last_clean":"2024-04-16T19:35:09.562876+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:35:09.562876+0000","last_undegraded":"2024-04-16T19:35:09.562876+0000","last_fullsized":"2024-04-16T19:35:09.562876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:33:47.186912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363192+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:33:39.363192+0000","last_peered":"2024-04-16T19:33:39.363192+0000","last_clean":"2024-04-16T19:33:39.363192+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:33:39.363192+0000","last_undegraded":"2024-04-16T19:33:39.363192+0000","last_fullsized":"2024-04-16T19:33:39.363192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'112","reported_seq":1323,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367908+0000","last_change":"2024-04-16T17:46:25.530104+0000","last_active":"2024-04-16T19:34:09.367908+0000","last_peered":"2024-04-16T19:34:09.367908+0000","last_clean":"2024-04-16T19:34:09.367908+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:34:09.367908+0000","last_undegraded":"2024-04-16T19:34:09.367908+0000","last_fullsized":"2024-04-16T19:34:09.367908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:48:32.234084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.377062+0000","last_change":"2024-04-16T17:46:17.511681+0000","last_active":"2024-04-16T19:35:04.377062+0000","last_peered":"2024-04-16T19:35:04.377062+0000","last_clean":"2024-04-16T19:35:04.377062+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:35:04.377062+0000","last_undegraded":"2024-04-16T19:35:04.377062+0000","last_fullsized":"2024-04-16T19:35:04.377062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"48'9","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373396+0000","last_change":"2024-04-16T17:45:51.480247+0000","last_active":"2024-04-16T19:34:39.373396+0000","last_peered":"2024-04-16T19:34:39.373396+0000","last_clean":"2024-04-16T19:34:39.373396+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:34:39.373396+0000","last_undegraded":"2024-04-16T19:34:39.373396+0000","last_fullsized":"2024-04-16T19:34:39.373396+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:20.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566625+0000","last_change":"2024-04-16T17:45:49.469762+0000","last_active":"2024-04-16T19:35:29.566625+0000","last_peered":"2024-04-16T19:35:29.566625+0000","last_clean":"2024-04-16T19:35:29.566625+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:35:29.566625+0000","last_undegraded":"2024-04-16T19:35:29.566625+0000","last_fullsized":"2024-04-16T19:35:29.566625+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:21.265143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'216","reported_seq":394,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380298+0000","last_change":"2024-04-16T17:45:47.460038+0000","last_active":"2024-04-16T19:35:29.380298+0000","last_peered":"2024-04-16T19:35:29.380298+0000","last_clean":"2024-04-16T19:35:29.380298+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:35:29.380298+0000","last_undegraded":"2024-04-16T19:35:29.380298+0000","last_fullsized":"2024-04-16T19:35:29.380298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:51:10.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'24","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372382+0000","last_change":"2024-04-16T17:47:16.558050+0000","last_active":"2024-04-16T19:34:39.372382+0000","last_peered":"2024-04-16T19:34:39.372382+0000","last_clean":"2024-04-16T19:34:39.372382+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:34:39.372382+0000","last_undegraded":"2024-04-16T19:34:39.372382+0000","last_fullsized":"2024-04-16T19:34:39.372382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:03.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384130+0000","last_change":"2024-04-16T17:45:10.400195+0000","last_active":"2024-04-16T19:35:34.384130+0000","last_peered":"2024-04-16T19:35:34.384130+0000","last_clean":"2024-04-16T19:35:34.384130+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:35:34.384130+0000","last_undegraded":"2024-04-16T19:35:34.384130+0000","last_fullsized":"2024-04-16T19:35:34.384130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:41.703977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551224+0000","last_change":"2024-04-16T17:45:08.388718+0000","last_active":"2024-04-16T19:34:09.551224+0000","last_peered":"2024-04-16T19:34:09.551224+0000","last_clean":"2024-04-16T19:34:09.551224+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:34:09.551224+0000","last_undegraded":"2024-04-16T19:34:09.551224+0000","last_fullsized":"2024-04-16T19:34:09.551224+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'2","reported_seq":562,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384626+0000","last_change":"2024-04-16T17:45:20.407653+0000","last_active":"2024-04-16T19:35:49.384626+0000","last_peered":"2024-04-16T19:35:49.384626+0000","last_clean":"2024-04-16T19:35:49.384626+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:35:49.384626+0000","last_undegraded":"2024-04-16T19:35:49.384626+0000","last_fullsized":"2024-04-16T19:35:49.384626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:10.523626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'152","reported_seq":344,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380618+0000","last_change":"2024-04-16T17:45:22.417131+0000","last_active":"2024-04-16T19:35:24.380618+0000","last_peered":"2024-04-16T19:35:24.380618+0000","last_clean":"2024-04-16T19:35:24.380618+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:35:24.380618+0000","last_undegraded":"2024-04-16T19:35:24.380618+0000","last_fullsized":"2024-04-16T19:35:24.380618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:45.675762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565883+0000","last_change":"2024-04-16T17:45:24.427273+0000","last_active":"2024-04-16T19:35:24.565883+0000","last_peered":"2024-04-16T19:35:24.565883+0000","last_clean":"2024-04-16T19:35:24.565883+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:35:24.565883+0000","last_undegraded":"2024-04-16T19:35:24.565883+0000","last_fullsized":"2024-04-16T19:35:24.565883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:51.349426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377945+0000","last_change":"2024-04-16T17:45:26.849595+0000","last_active":"2024-04-16T19:35:09.377945+0000","last_peered":"2024-04-16T19:35:09.377945+0000","last_clean":"2024-04-16T19:35:09.377945+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:35:09.377945+0000","last_undegraded":"2024-04-16T19:35:09.377945+0000","last_fullsized":"2024-04-16T19:35:09.377945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:01.653239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.365153+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:33:39.365153+0000","last_peered":"2024-04-16T19:33:39.365153+0000","last_clean":"2024-04-16T19:33:39.365153+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:33:39.365153+0000","last_undegraded":"2024-04-16T19:33:39.365153+0000","last_fullsized":"2024-04-16T19:33:39.365153+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:01:36.294431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'110","reported_seq":1957,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.564046+0000","last_change":"2024-04-16T17:46:25.522673+0000","last_active":"2024-04-16T19:35:14.564046+0000","last_peered":"2024-04-16T19:35:14.564046+0000","last_clean":"2024-04-16T19:35:14.564046+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:35:14.564046+0000","last_undegraded":"2024-04-16T19:35:14.564046+0000","last_fullsized":"2024-04-16T19:35:14.564046+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:19:49.571002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.368287+0000","last_change":"2024-04-16T17:46:17.504674+0000","last_active":"2024-04-16T19:33:59.368287+0000","last_peered":"2024-04-16T19:33:59.368287+0000","last_clean":"2024-04-16T19:33:59.368287+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:33:59.368287+0000","last_undegraded":"2024-04-16T19:33:59.368287+0000","last_fullsized":"2024-04-16T19:33:59.368287+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"48'3","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373369+0000","last_change":"2024-04-16T17:45:51.482374+0000","last_active":"2024-04-16T19:34:39.373369+0000","last_peered":"2024-04-16T19:34:39.373369+0000","last_clean":"2024-04-16T19:34:39.373369+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:34:39.373369+0000","last_undegraded":"2024-04-16T19:34:39.373369+0000","last_fullsized":"2024-04-16T19:34:39.373369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:35.709508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'20","reported_seq":1478,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381300+0000","last_change":"2024-04-16T17:45:49.473331+0000","last_active":"2024-04-16T19:35:29.381300+0000","last_peered":"2024-04-16T19:35:29.381300+0000","last_clean":"2024-04-16T19:35:29.381300+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:35:29.381300+0000","last_undegraded":"2024-04-16T19:35:29.381300+0000","last_fullsized":"2024-04-16T19:35:29.381300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:55.367803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'661","reported_seq":3301,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566715+0000","last_change":"2024-04-16T17:45:47.459310+0000","last_active":"2024-04-16T19:35:29.566715+0000","last_peered":"2024-04-16T19:35:29.566715+0000","last_clean":"2024-04-16T19:35:29.566715+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:35:29.566715+0000","last_undegraded":"2024-04-16T19:35:29.566715+0000","last_fullsized":"2024-04-16T19:35:29.566715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:41.921224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'6","reported_seq":503,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380329+0000","last_change":"2024-04-16T17:45:45.461393+0000","last_active":"2024-04-16T19:35:29.380329+0000","last_peered":"2024-04-16T19:35:29.380329+0000","last_clean":"2024-04-16T19:35:29.380329+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:35:29.380329+0000","last_undegraded":"2024-04-16T19:35:29.380329+0000","last_fullsized":"2024-04-16T19:35:29.380329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:06.206396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.380558+0000","last_change":"2024-04-16T17:45:10.393491+0000","last_active":"2024-04-16T19:35:14.380558+0000","last_peered":"2024-04-16T19:35:14.380558+0000","last_clean":"2024-04-16T19:35:14.380558+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:35:14.380558+0000","last_undegraded":"2024-04-16T19:35:14.380558+0000","last_fullsized":"2024-04-16T19:35:14.380558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:16.297430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377316+0000","last_change":"2024-04-16T17:45:08.380598+0000","last_active":"2024-04-16T19:35:09.377316+0000","last_peered":"2024-04-16T19:35:09.377316+0000","last_clean":"2024-04-16T19:35:09.377316+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:35:09.377316+0000","last_undegraded":"2024-04-16T19:35:09.377316+0000","last_fullsized":"2024-04-16T19:35:09.377316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:19.075286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"48'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379730+0000","last_change":"2024-04-16T17:45:20.412352+0000","last_active":"2024-04-16T19:35:24.379730+0000","last_peered":"2024-04-16T19:35:24.379730+0000","last_clean":"2024-04-16T19:35:24.379730+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:35:24.379730+0000","last_undegraded":"2024-04-16T19:35:24.379730+0000","last_fullsized":"2024-04-16T19:35:24.379730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:32.239001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'104","reported_seq":281,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570694+0000","last_change":"2024-04-16T17:45:22.417121+0000","last_active":"2024-04-16T19:35:49.570694+0000","last_peered":"2024-04-16T19:35:49.570694+0000","last_clean":"2024-04-16T19:35:49.570694+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:35:49.570694+0000","last_undegraded":"2024-04-16T19:35:49.570694+0000","last_fullsized":"2024-04-16T19:35:49.570694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:09.722112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568794+0000","last_change":"2024-04-16T17:45:24.425363+0000","last_active":"2024-04-16T19:35:39.568794+0000","last_peered":"2024-04-16T19:35:39.568794+0000","last_clean":"2024-04-16T19:35:39.568794+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:35:39.568794+0000","last_undegraded":"2024-04-16T19:35:39.568794+0000","last_fullsized":"2024-04-16T19:35:39.568794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:14.538868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377883+0000","last_change":"2024-04-16T17:45:26.438576+0000","last_active":"2024-04-16T19:35:09.377883+0000","last_peered":"2024-04-16T19:35:09.377883+0000","last_clean":"2024-04-16T19:35:09.377883+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:35:09.377883+0000","last_undegraded":"2024-04-16T19:35:09.377883+0000","last_fullsized":"2024-04-16T19:35:09.377883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:47.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.362625+0000","last_change":"2024-04-16T18:09:02.173368+0000","last_active":"2024-04-16T19:33:39.362625+0000","last_peered":"2024-04-16T19:33:39.362625+0000","last_clean":"2024-04-16T19:33:39.362625+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:33:39.362625+0000","last_undegraded":"2024-04-16T19:33:39.362625+0000","last_fullsized":"2024-04-16T19:33:39.362625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:29.850916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'146","reported_seq":1638,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563993+0000","last_change":"2024-04-16T17:46:25.529669+0000","last_active":"2024-04-16T19:35:14.563993+0000","last_peered":"2024-04-16T19:35:14.563993+0000","last_clean":"2024-04-16T19:35:14.563993+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:35:14.563993+0000","last_undegraded":"2024-04-16T19:35:14.563993+0000","last_fullsized":"2024-04-16T19:35:14.563993+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:12:46.675908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376562+0000","last_change":"2024-04-16T17:46:17.507982+0000","last_active":"2024-04-16T19:35:04.376562+0000","last_peered":"2024-04-16T19:35:04.376562+0000","last_clean":"2024-04-16T19:35:04.376562+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:35:04.376562+0000","last_undegraded":"2024-04-16T19:35:04.376562+0000","last_fullsized":"2024-04-16T19:35:04.376562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:17:26.521094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:34.362268+0000","last_change":"2024-04-16T17:45:51.480412+0000","last_active":"2024-04-16T19:33:34.362268+0000","last_peered":"2024-04-16T19:33:34.362268+0000","last_clean":"2024-04-16T19:33:34.362268+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:33:34.362268+0000","last_undegraded":"2024-04-16T19:33:34.362268+0000","last_fullsized":"2024-04-16T19:33:34.362268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:28.168213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381317+0000","last_change":"2024-04-16T17:45:49.471149+0000","last_active":"2024-04-16T19:35:29.381317+0000","last_peered":"2024-04-16T19:35:29.381317+0000","last_clean":"2024-04-16T19:35:29.381317+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:35:29.381317+0000","last_undegraded":"2024-04-16T19:35:29.381317+0000","last_fullsized":"2024-04-16T19:35:29.381317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:20.691413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'543","reported_seq":45408,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381269+0000","last_change":"2024-04-16T17:45:47.464982+0000","last_active":"2024-04-16T19:35:29.381269+0000","last_peered":"2024-04-16T19:35:29.381269+0000","last_clean":"2024-04-16T19:35:29.381269+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:35:29.381269+0000","last_undegraded":"2024-04-16T19:35:29.381269+0000","last_fullsized":"2024-04-16T19:35:29.381269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:18.772947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'9","reported_seq":399,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381245+0000","last_change":"2024-04-16T17:45:45.466563+0000","last_active":"2024-04-16T19:35:29.381245+0000","last_peered":"2024-04-16T19:35:29.381245+0000","last_clean":"2024-04-16T19:35:29.381245+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:35:29.381245+0000","last_undegraded":"2024-04-16T19:35:29.381245+0000","last_fullsized":"2024-04-16T19:35:29.381245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:04.543134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.563895+0000","last_change":"2024-04-16T17:45:10.395688+0000","last_active":"2024-04-16T19:35:14.563895+0000","last_peered":"2024-04-16T19:35:14.563895+0000","last_clean":"2024-04-16T19:35:14.563895+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:35:14.563895+0000","last_undegraded":"2024-04-16T19:35:14.563895+0000","last_fullsized":"2024-04-16T19:35:14.563895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:35:32.419541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.379632+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:35:09.379632+0000","last_peered":"2024-04-16T19:35:09.379632+0000","last_clean":"2024-04-16T19:35:09.379632+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:35:09.379632+0000","last_undegraded":"2024-04-16T19:35:09.379632+0000","last_fullsized":"2024-04-16T19:35:09.379632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"48'2","reported_seq":500,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565852+0000","last_change":"2024-04-16T17:45:20.412567+0000","last_active":"2024-04-16T19:35:24.565852+0000","last_peered":"2024-04-16T19:35:24.565852+0000","last_clean":"2024-04-16T19:35:24.565852+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:35:24.565852+0000","last_undegraded":"2024-04-16T19:35:24.565852+0000","last_fullsized":"2024-04-16T19:35:24.565852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:51.549725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'120","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383728+0000","last_change":"2024-04-16T17:45:22.416448+0000","last_active":"2024-04-16T19:35:44.383728+0000","last_peered":"2024-04-16T19:35:44.383728+0000","last_clean":"2024-04-16T19:35:44.383728+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:35:44.383728+0000","last_undegraded":"2024-04-16T19:35:44.383728+0000","last_fullsized":"2024-04-16T19:35:44.383728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:14.322665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'12","reported_seq":1395,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384532+0000","last_change":"2024-04-16T17:45:24.426319+0000","last_active":"2024-04-16T19:35:49.384532+0000","last_peered":"2024-04-16T19:35:49.384532+0000","last_clean":"2024-04-16T19:35:49.384532+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:35:49.384532+0000","last_undegraded":"2024-04-16T19:35:49.384532+0000","last_fullsized":"2024-04-16T19:35:49.384532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:33.417685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377809+0000","last_change":"2024-04-16T17:45:26.433965+0000","last_active":"2024-04-16T19:35:09.377809+0000","last_peered":"2024-04-16T19:35:09.377809+0000","last_clean":"2024-04-16T19:35:09.377809+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:35:09.377809+0000","last_undegraded":"2024-04-16T19:35:09.377809+0000","last_fullsized":"2024-04-16T19:35:09.377809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:05:58.231337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":48,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568462+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:35:39.568462+0000","last_peered":"2024-04-16T19:35:39.568462+0000","last_clean":"2024-04-16T19:35:39.568462+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:35:39.568462+0000","last_undegraded":"2024-04-16T19:35:39.568462+0000","last_fullsized":"2024-04-16T19:35:39.568462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:55:14.707665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'89","reported_seq":1549,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364103+0000","last_change":"2024-04-16T17:46:25.522263+0000","last_active":"2024-04-16T19:33:49.364103+0000","last_peered":"2024-04-16T19:33:49.364103+0000","last_clean":"2024-04-16T19:33:49.364103+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:33:49.364103+0000","last_undegraded":"2024-04-16T19:33:49.364103+0000","last_fullsized":"2024-04-16T19:33:49.364103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:41.808921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.365032+0000","last_change":"2024-04-16T17:46:17.502070+0000","last_active":"2024-04-16T19:33:39.365032+0000","last_peered":"2024-04-16T19:33:39.365032+0000","last_clean":"2024-04-16T19:33:39.365032+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:33:39.365032+0000","last_undegraded":"2024-04-16T19:33:39.365032+0000","last_fullsized":"2024-04-16T19:33:39.365032+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'16","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567630+0000","last_change":"2024-04-16T17:45:51.481303+0000","last_active":"2024-04-16T19:35:34.567630+0000","last_peered":"2024-04-16T19:35:34.567630+0000","last_clean":"2024-04-16T19:35:34.567630+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:35:34.567630+0000","last_undegraded":"2024-04-16T19:35:34.567630+0000","last_fullsized":"2024-04-16T19:35:34.567630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:17.044957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'651","reported_seq":2560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:29.361739+0000","last_change":"2024-04-16T17:45:49.469698+0000","last_active":"2024-04-16T19:33:29.361739+0000","last_peered":"2024-04-16T19:33:29.361739+0000","last_clean":"2024-04-16T19:33:29.361739+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:33:29.361739+0000","last_undegraded":"2024-04-16T19:33:29.361739+0000","last_fullsized":"2024-04-16T19:33:29.361739+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:57:05.931727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'518","reported_seq":957,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.374199+0000","last_change":"2024-04-16T17:45:47.462089+0000","last_active":"2024-04-16T19:34:34.374199+0000","last_peered":"2024-04-16T19:34:34.374199+0000","last_clean":"2024-04-16T19:34:34.374199+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:34:34.374199+0000","last_undegraded":"2024-04-16T19:34:34.374199+0000","last_fullsized":"2024-04-16T19:34:34.374199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:56.475222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'8","reported_seq":371,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371775+0000","last_change":"2024-04-16T17:45:45.457866+0000","last_active":"2024-04-16T19:34:34.371775+0000","last_peered":"2024-04-16T19:34:34.371775+0000","last_clean":"2024-04-16T19:34:34.371775+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:34:34.371775+0000","last_undegraded":"2024-04-16T19:34:34.371775+0000","last_fullsized":"2024-04-16T19:34:34.371775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:18:09.442789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378153+0000","last_change":"2024-04-16T17:45:10.402149+0000","last_active":"2024-04-16T19:35:14.378153+0000","last_peered":"2024-04-16T19:35:14.378153+0000","last_clean":"2024-04-16T19:35:14.378153+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:35:14.378153+0000","last_undegraded":"2024-04-16T19:35:14.378153+0000","last_fullsized":"2024-04-16T19:35:14.378153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:14.688816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377861+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:35:09.377861+0000","last_peered":"2024-04-16T19:35:09.377861+0000","last_clean":"2024-04-16T19:35:09.377861+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:35:09.377861+0000","last_undegraded":"2024-04-16T19:35:09.377861+0000","last_fullsized":"2024-04-16T19:35:09.377861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:49:40.069655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379655+0000","last_change":"2024-04-16T17:45:20.409559+0000","last_active":"2024-04-16T19:35:24.379655+0000","last_peered":"2024-04-16T19:35:24.379655+0000","last_clean":"2024-04-16T19:35:24.379655+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:35:24.379655+0000","last_undegraded":"2024-04-16T19:35:24.379655+0000","last_fullsized":"2024-04-16T19:35:24.379655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:10.476166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'152","reported_seq":345,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371721+0000","last_change":"2024-04-16T17:45:22.415559+0000","last_active":"2024-04-16T19:34:29.371721+0000","last_peered":"2024-04-16T19:34:29.371721+0000","last_clean":"2024-04-16T19:34:29.371721+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:34:29.371721+0000","last_undegraded":"2024-04-16T19:34:29.371721+0000","last_fullsized":"2024-04-16T19:34:29.371721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:12.531458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369795+0000","last_change":"2024-04-16T17:45:24.421195+0000","last_active":"2024-04-16T19:34:09.369795+0000","last_peered":"2024-04-16T19:34:09.369795+0000","last_clean":"2024-04-16T19:34:09.369795+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:34:09.369795+0000","last_undegraded":"2024-04-16T19:34:09.369795+0000","last_fullsized":"2024-04-16T19:34:09.369795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:05.546332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369207+0000","last_change":"2024-04-16T17:45:26.432510+0000","last_active":"2024-04-16T19:34:14.369207+0000","last_peered":"2024-04-16T19:34:14.369207+0000","last_clean":"2024-04-16T19:34:14.369207+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:34:14.369207+0000","last_undegraded":"2024-04-16T19:34:14.369207+0000","last_fullsized":"2024-04-16T19:34:14.369207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:08.477244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565769+0000","last_change":"2024-04-16T18:09:02.169659+0000","last_active":"2024-04-16T19:35:24.565769+0000","last_peered":"2024-04-16T19:35:24.565769+0000","last_clean":"2024-04-16T19:35:24.565769+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:35:24.565769+0000","last_undegraded":"2024-04-16T19:35:24.565769+0000","last_fullsized":"2024-04-16T19:35:24.565769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:01:46.538084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'119","reported_seq":2030,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547309+0000","last_change":"2024-04-16T17:46:25.523284+0000","last_active":"2024-04-16T19:33:49.547309+0000","last_peered":"2024-04-16T19:33:49.547309+0000","last_clean":"2024-04-16T19:33:49.547309+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:33:49.547309+0000","last_undegraded":"2024-04-16T19:33:49.547309+0000","last_fullsized":"2024-04-16T19:33:49.547309+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:27:21.692424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363115+0000","last_change":"2024-04-16T17:46:17.506836+0000","last_active":"2024-04-16T19:33:39.363115+0000","last_peered":"2024-04-16T19:33:39.363115+0000","last_clean":"2024-04-16T19:33:39.363115+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:33:39.363115+0000","last_undegraded":"2024-04-16T19:33:39.363115+0000","last_fullsized":"2024-04-16T19:33:39.363115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'2","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384013+0000","last_change":"2024-04-16T17:45:51.481129+0000","last_active":"2024-04-16T19:35:34.384013+0000","last_peered":"2024-04-16T19:35:34.384013+0000","last_clean":"2024-04-16T19:35:34.384013+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:35:34.384013+0000","last_undegraded":"2024-04-16T19:35:34.384013+0000","last_fullsized":"2024-04-16T19:35:34.384013+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:04.680783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'651","reported_seq":2212,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.556521+0000","last_change":"2024-04-16T17:45:49.467008+0000","last_active":"2024-04-16T19:34:34.556521+0000","last_peered":"2024-04-16T19:34:34.556521+0000","last_clean":"2024-04-16T19:34:34.556521+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:34:34.556521+0000","last_undegraded":"2024-04-16T19:34:34.556521+0000","last_fullsized":"2024-04-16T19:34:34.556521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:30.562525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'281","reported_seq":571,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.542577+0000","last_change":"2024-04-16T17:45:47.463063+0000","last_active":"2024-04-16T19:33:24.542577+0000","last_peered":"2024-04-16T19:33:24.542577+0000","last_clean":"2024-04-16T19:33:24.542577+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:33:24.542577+0000","last_undegraded":"2024-04-16T19:33:24.542577+0000","last_fullsized":"2024-04-16T19:33:24.542577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:53.197273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'12","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372532+0000","last_change":"2024-04-16T17:45:45.465787+0000","last_active":"2024-04-16T19:34:34.372532+0000","last_peered":"2024-04-16T19:34:34.372532+0000","last_clean":"2024-04-16T19:34:34.372532+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:34:34.372532+0000","last_undegraded":"2024-04-16T19:34:34.372532+0000","last_fullsized":"2024-04-16T19:34:34.372532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378129+0000","last_change":"2024-04-16T17:45:10.392781+0000","last_active":"2024-04-16T19:35:14.378129+0000","last_peered":"2024-04-16T19:35:14.378129+0000","last_clean":"2024-04-16T19:35:14.378129+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:35:14.378129+0000","last_undegraded":"2024-04-16T19:35:14.378129+0000","last_fullsized":"2024-04-16T19:35:14.378129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:39.831957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377922+0000","last_change":"2024-04-16T17:45:08.386175+0000","last_active":"2024-04-16T19:35:09.377922+0000","last_peered":"2024-04-16T19:35:09.377922+0000","last_clean":"2024-04-16T19:35:09.377922+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:35:09.377922+0000","last_undegraded":"2024-04-16T19:35:09.377922+0000","last_fullsized":"2024-04-16T19:35:09.377922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"48'11","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380444+0000","last_change":"2024-04-16T17:45:20.407986+0000","last_active":"2024-04-16T19:35:24.380444+0000","last_peered":"2024-04-16T19:35:24.380444+0000","last_clean":"2024-04-16T19:35:24.380444+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:35:24.380444+0000","last_undegraded":"2024-04-16T19:35:24.380444+0000","last_fullsized":"2024-04-16T19:35:24.380444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:11.567092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369836+0000","last_change":"2024-04-16T17:45:22.415078+0000","last_active":"2024-04-16T19:34:09.369836+0000","last_peered":"2024-04-16T19:34:09.369836+0000","last_clean":"2024-04-16T19:34:09.369836+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:34:09.369836+0000","last_undegraded":"2024-04-16T19:34:09.369836+0000","last_fullsized":"2024-04-16T19:34:09.369836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:40.426580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371537+0000","last_change":"2024-04-16T17:45:24.425398+0000","last_active":"2024-04-16T19:34:29.371537+0000","last_peered":"2024-04-16T19:34:29.371537+0000","last_clean":"2024-04-16T19:34:29.371537+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:34:29.371537+0000","last_undegraded":"2024-04-16T19:34:29.371537+0000","last_fullsized":"2024-04-16T19:34:29.371537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:27.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.552315+0000","last_change":"2024-04-16T17:45:26.849126+0000","last_active":"2024-04-16T19:34:14.552315+0000","last_peered":"2024-04-16T19:34:14.552315+0000","last_clean":"2024-04-16T19:34:14.552315+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:34:14.552315+0000","last_undegraded":"2024-04-16T19:34:14.552315+0000","last_fullsized":"2024-04-16T19:34:14.552315+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:50.423306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382138+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:35:24.382138+0000","last_peered":"2024-04-16T19:35:24.382138+0000","last_clean":"2024-04-16T19:35:24.382138+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:35:24.382138+0000","last_undegraded":"2024-04-16T19:35:24.382138+0000","last_fullsized":"2024-04-16T19:35:24.382138+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:39.644301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'120","reported_seq":1725,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547466+0000","last_change":"2024-04-16T17:46:25.526370+0000","last_active":"2024-04-16T19:33:49.547466+0000","last_peered":"2024-04-16T19:33:49.547466+0000","last_clean":"2024-04-16T19:33:49.547466+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:33:49.547466+0000","last_undegraded":"2024-04-16T19:33:49.547466+0000","last_fullsized":"2024-04-16T19:33:49.547466+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:37:22.043406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545358+0000","last_change":"2024-04-16T17:46:17.500988+0000","last_active":"2024-04-16T19:33:39.545358+0000","last_peered":"2024-04-16T19:33:39.545358+0000","last_clean":"2024-04-16T19:33:39.545358+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:33:39.545358+0000","last_undegraded":"2024-04-16T19:33:39.545358+0000","last_fullsized":"2024-04-16T19:33:39.545358+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:54.079540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'19","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382058+0000","last_change":"2024-04-16T17:45:51.478621+0000","last_active":"2024-04-16T19:35:34.382058+0000","last_peered":"2024-04-16T19:35:34.382058+0000","last_clean":"2024-04-16T19:35:34.382058+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:35:34.382058+0000","last_undegraded":"2024-04-16T19:35:34.382058+0000","last_fullsized":"2024-04-16T19:35:34.382058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:28.047515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372631+0000","last_change":"2024-04-16T17:45:49.474101+0000","last_active":"2024-04-16T19:34:34.372631+0000","last_peered":"2024-04-16T19:34:34.372631+0000","last_clean":"2024-04-16T19:34:34.372631+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:34:34.372631+0000","last_undegraded":"2024-04-16T19:34:34.372631+0000","last_fullsized":"2024-04-16T19:34:34.372631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:47:15.346074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5043","reported_seq":7393,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372551+0000","last_change":"2024-04-16T17:45:47.462940+0000","last_active":"2024-04-16T19:34:34.372551+0000","last_peered":"2024-04-16T19:34:34.372551+0000","last_clean":"2024-04-16T19:34:34.372551+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:34:34.372551+0000","last_undegraded":"2024-04-16T19:34:34.372551+0000","last_fullsized":"2024-04-16T19:34:34.372551+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":3000,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:36.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'13","reported_seq":440,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.542611+0000","last_change":"2024-04-16T17:45:45.458908+0000","last_active":"2024-04-16T19:33:24.542611+0000","last_peered":"2024-04-16T19:33:24.542611+0000","last_clean":"2024-04-16T19:33:24.542611+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:33:24.542611+0000","last_undegraded":"2024-04-16T19:33:24.542611+0000","last_fullsized":"2024-04-16T19:33:24.542611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:41:32.351978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.371697+0000","last_change":"2024-04-16T17:45:10.397270+0000","last_active":"2024-04-16T19:34:19.371697+0000","last_peered":"2024-04-16T19:34:19.371697+0000","last_clean":"2024-04-16T19:34:19.371697+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:34:19.371697+0000","last_undegraded":"2024-04-16T19:34:19.371697+0000","last_fullsized":"2024-04-16T19:34:19.371697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:04.267541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565907+0000","last_change":"2024-04-16T17:45:08.385404+0000","last_active":"2024-04-16T19:35:24.565907+0000","last_peered":"2024-04-16T19:35:24.565907+0000","last_clean":"2024-04-16T19:35:24.565907+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:35:24.565907+0000","last_undegraded":"2024-04-16T19:35:24.565907+0000","last_fullsized":"2024-04-16T19:35:24.565907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'6","reported_seq":1404,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367767+0000","last_change":"2024-04-16T17:45:20.413621+0000","last_active":"2024-04-16T19:34:09.367767+0000","last_peered":"2024-04-16T19:34:09.367767+0000","last_clean":"2024-04-16T19:34:09.367767+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:34:09.367767+0000","last_undegraded":"2024-04-16T19:34:09.367767+0000","last_fullsized":"2024-04-16T19:34:09.367767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:36.005251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'32","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382168+0000","last_change":"2024-04-16T17:45:22.415077+0000","last_active":"2024-04-16T19:35:24.382168+0000","last_peered":"2024-04-16T19:35:24.382168+0000","last_clean":"2024-04-16T19:35:24.382168+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:35:24.382168+0000","last_undegraded":"2024-04-16T19:35:24.382168+0000","last_fullsized":"2024-04-16T19:35:24.382168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:27.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380516+0000","last_change":"2024-04-16T17:45:24.430903+0000","last_active":"2024-04-16T19:35:24.380516+0000","last_peered":"2024-04-16T19:35:24.380516+0000","last_clean":"2024-04-16T19:35:24.380516+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:35:24.380516+0000","last_undegraded":"2024-04-16T19:35:24.380516+0000","last_fullsized":"2024-04-16T19:35:24.380516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:55.371897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369101+0000","last_change":"2024-04-16T17:45:26.438619+0000","last_active":"2024-04-16T19:34:14.369101+0000","last_peered":"2024-04-16T19:34:14.369101+0000","last_clean":"2024-04-16T19:34:14.369101+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:34:14.369101+0000","last_undegraded":"2024-04-16T19:34:14.369101+0000","last_fullsized":"2024-04-16T19:34:14.369101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:15.584111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.565746+0000","last_change":"2024-04-16T18:09:02.166083+0000","last_active":"2024-04-16T19:35:24.565746+0000","last_peered":"2024-04-16T19:35:24.565746+0000","last_clean":"2024-04-16T19:35:24.565746+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:35:24.565746+0000","last_undegraded":"2024-04-16T19:35:24.565746+0000","last_fullsized":"2024-04-16T19:35:24.565746+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:52:14.230771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'126","reported_seq":1716,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547364+0000","last_change":"2024-04-16T17:46:25.531755+0000","last_active":"2024-04-16T19:33:49.547364+0000","last_peered":"2024-04-16T19:33:49.547364+0000","last_clean":"2024-04-16T19:33:49.547364+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:33:49.547364+0000","last_undegraded":"2024-04-16T19:33:49.547364+0000","last_fullsized":"2024-04-16T19:33:49.547364+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:38.947978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.545431+0000","last_change":"2024-04-16T17:46:17.505902+0000","last_active":"2024-04-16T19:33:39.545431+0000","last_peered":"2024-04-16T19:33:39.545431+0000","last_clean":"2024-04-16T19:33:39.545431+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:33:39.545431+0000","last_undegraded":"2024-04-16T19:33:39.545431+0000","last_fullsized":"2024-04-16T19:33:39.545431+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:54.200238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'10","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.383978+0000","last_change":"2024-04-16T17:45:51.478912+0000","last_active":"2024-04-16T19:35:34.383978+0000","last_peered":"2024-04-16T19:35:34.383978+0000","last_clean":"2024-04-16T19:35:34.383978+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:35:34.383978+0000","last_undegraded":"2024-04-16T19:35:34.383978+0000","last_fullsized":"2024-04-16T19:35:34.383978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:20.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372659+0000","last_change":"2024-04-16T17:45:49.470949+0000","last_active":"2024-04-16T19:34:34.372659+0000","last_peered":"2024-04-16T19:34:34.372659+0000","last_clean":"2024-04-16T19:34:34.372659+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:34:34.372659+0000","last_undegraded":"2024-04-16T19:34:34.372659+0000","last_fullsized":"2024-04-16T19:34:34.372659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:38:03.985918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'554","reported_seq":1527,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372495+0000","last_change":"2024-04-16T17:45:47.464106+0000","last_active":"2024-04-16T19:34:34.372495+0000","last_peered":"2024-04-16T19:34:34.372495+0000","last_clean":"2024-04-16T19:34:34.372495+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:34:34.372495+0000","last_undegraded":"2024-04-16T19:34:34.372495+0000","last_fullsized":"2024-04-16T19:34:34.372495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:24.659574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'6","reported_seq":517,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371703+0000","last_change":"2024-04-16T17:45:45.454923+0000","last_active":"2024-04-16T19:34:34.371703+0000","last_peered":"2024-04-16T19:34:34.371703+0000","last_clean":"2024-04-16T19:34:34.371703+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:34:34.371703+0000","last_undegraded":"2024-04-16T19:34:34.371703+0000","last_fullsized":"2024-04-16T19:34:34.371703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:16.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366331+0000","last_change":"2024-04-16T17:45:10.400150+0000","last_active":"2024-04-16T19:33:59.366331+0000","last_peered":"2024-04-16T19:33:59.366331+0000","last_clean":"2024-04-16T19:33:59.366331+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:33:59.366331+0000","last_undegraded":"2024-04-16T19:33:59.366331+0000","last_fullsized":"2024-04-16T19:33:59.366331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:22:56.234389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.384160+0000","last_change":"2024-04-16T17:45:08.386622+0000","last_active":"2024-04-16T19:35:34.384160+0000","last_peered":"2024-04-16T19:35:34.384160+0000","last_clean":"2024-04-16T19:35:34.384160+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:35:34.384160+0000","last_undegraded":"2024-04-16T19:35:34.384160+0000","last_fullsized":"2024-04-16T19:35:34.384160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:45.243544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554295+0000","last_change":"2024-04-16T17:45:20.412420+0000","last_active":"2024-04-16T19:34:24.554295+0000","last_peered":"2024-04-16T19:34:24.554295+0000","last_clean":"2024-04-16T19:34:24.554295+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:34:24.554295+0000","last_undegraded":"2024-04-16T19:34:24.554295+0000","last_fullsized":"2024-04-16T19:34:24.554295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:06.239898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'80","reported_seq":236,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379675+0000","last_change":"2024-04-16T17:45:22.421586+0000","last_active":"2024-04-16T19:35:24.379675+0000","last_peered":"2024-04-16T19:35:24.379675+0000","last_clean":"2024-04-16T19:35:24.379675+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:35:24.379675+0000","last_undegraded":"2024-04-16T19:35:24.379675+0000","last_fullsized":"2024-04-16T19:35:24.379675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:38.487045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382204+0000","last_change":"2024-04-16T17:45:24.424290+0000","last_active":"2024-04-16T19:35:24.382204+0000","last_peered":"2024-04-16T19:35:24.382204+0000","last_clean":"2024-04-16T19:35:24.382204+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:35:24.382204+0000","last_undegraded":"2024-04-16T19:35:24.382204+0000","last_fullsized":"2024-04-16T19:35:24.382204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.451179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380429+0000","last_change":"2024-04-16T17:45:26.433279+0000","last_active":"2024-04-16T19:35:29.380429+0000","last_peered":"2024-04-16T19:35:29.380429+0000","last_clean":"2024-04-16T19:35:29.380429+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:35:29.380429+0000","last_undegraded":"2024-04-16T19:35:29.380429+0000","last_fullsized":"2024-04-16T19:35:29.380429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:53.357161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'5","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547447+0000","last_change":"2024-04-16T17:45:45.455663+0000","last_active":"2024-04-16T19:33:49.547447+0000","last_peered":"2024-04-16T19:33:49.547447+0000","last_clean":"2024-04-16T19:33:49.547447+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:33:49.547447+0000","last_undegraded":"2024-04-16T19:33:49.547447+0000","last_fullsized":"2024-04-16T19:33:49.547447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:03.461208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557429+0000","last_change":"2024-04-16T17:46:16.500595+0000","last_active":"2024-04-16T19:34:39.557429+0000","last_peered":"2024-04-16T19:34:39.557429+0000","last_clean":"2024-04-16T19:34:39.557429+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:34:39.557429+0000","last_undegraded":"2024-04-16T19:34:39.557429+0000","last_fullsized":"2024-04-16T19:34:39.557429+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:51:59.782963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381260+0000","last_change":"2024-04-16T17:45:08.383072+0000","last_active":"2024-04-16T19:35:34.381260+0000","last_peered":"2024-04-16T19:35:34.381260+0000","last_clean":"2024-04-16T19:35:34.381260+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:35:34.381260+0000","last_undegraded":"2024-04-16T19:35:34.381260+0000","last_fullsized":"2024-04-16T19:35:34.381260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:05:58.862115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'15","reported_seq":225,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364974+0000","last_change":"2024-04-16T17:45:45.464950+0000","last_active":"2024-04-16T19:33:49.364974+0000","last_peered":"2024-04-16T19:33:49.364974+0000","last_clean":"2024-04-16T19:33:49.364974+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:33:49.364974+0000","last_undegraded":"2024-04-16T19:33:49.364974+0000","last_fullsized":"2024-04-16T19:33:49.364974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:39.088704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569767+0000","last_change":"2024-04-16T17:45:10.396086+0000","last_active":"2024-04-16T19:35:44.569767+0000","last_peered":"2024-04-16T19:35:44.569767+0000","last_clean":"2024-04-16T19:35:44.569767+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:35:44.569767+0000","last_undegraded":"2024-04-16T19:35:44.569767+0000","last_fullsized":"2024-04-16T19:35:44.569767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:53.484971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.567556+0000","last_change":"2024-04-16T17:45:08.390555+0000","last_active":"2024-04-16T19:35:34.567556+0000","last_peered":"2024-04-16T19:35:34.567556+0000","last_clean":"2024-04-16T19:35:34.567556+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:35:34.567556+0000","last_undegraded":"2024-04-16T19:35:34.567556+0000","last_fullsized":"2024-04-16T19:35:34.567556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:29.317076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'18","reported_seq":469,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371671+0000","last_change":"2024-04-16T17:45:45.464620+0000","last_active":"2024-04-16T19:34:29.371671+0000","last_peered":"2024-04-16T19:34:29.371671+0000","last_clean":"2024-04-16T19:34:29.371671+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:34:29.371671+0000","last_undegraded":"2024-04-16T19:34:29.371671+0000","last_fullsized":"2024-04-16T19:34:29.371671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:41.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383715+0000","last_change":"2024-04-16T17:45:10.400426+0000","last_active":"2024-04-16T19:35:44.383715+0000","last_peered":"2024-04-16T19:35:44.383715+0000","last_clean":"2024-04-16T19:35:44.383715+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:35:44.383715+0000","last_undegraded":"2024-04-16T19:35:44.383715+0000","last_fullsized":"2024-04-16T19:35:44.383715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:57.696534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.557330+0000","last_change":"2024-04-16T17:46:16.499950+0000","last_active":"2024-04-16T19:34:39.557330+0000","last_peered":"2024-04-16T19:34:39.557330+0000","last_clean":"2024-04-16T19:34:39.557330+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:34:39.557330+0000","last_undegraded":"2024-04-16T19:34:39.557330+0000","last_fullsized":"2024-04-16T19:34:39.557330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:37:22.903930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'9","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369392+0000","last_change":"2024-04-16T17:46:16.503571+0000","last_active":"2024-04-16T19:34:19.369392+0000","last_peered":"2024-04-16T19:34:19.369392+0000","last_clean":"2024-04-16T19:34:19.369392+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:34:19.369392+0000","last_undegraded":"2024-04-16T19:34:19.369392+0000","last_fullsized":"2024-04-16T19:34:19.369392+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569655+0000","last_change":"2024-04-16T17:45:10.394142+0000","last_active":"2024-04-16T19:35:44.569655+0000","last_peered":"2024-04-16T19:35:44.569655+0000","last_clean":"2024-04-16T19:35:44.569655+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:35:44.569655+0000","last_undegraded":"2024-04-16T19:35:44.569655+0000","last_fullsized":"2024-04-16T19:35:44.569655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:55.718938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387387+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:35:54.387387+0000","last_peered":"2024-04-16T19:35:54.387387+0000","last_clean":"2024-04-16T19:35:54.387387+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:35:54.387387+0000","last_undegraded":"2024-04-16T19:35:54.387387+0000","last_fullsized":"2024-04-16T19:35:54.387387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:51.477510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'6","reported_seq":218,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381435+0000","last_change":"2024-04-16T17:45:45.463398+0000","last_active":"2024-04-16T19:35:29.381435+0000","last_peered":"2024-04-16T19:35:29.381435+0000","last_clean":"2024-04-16T19:35:29.381435+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:35:29.381435+0000","last_undegraded":"2024-04-16T19:35:29.381435+0000","last_fullsized":"2024-04-16T19:35:29.381435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:07.065221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.571544+0000","last_change":"2024-04-16T17:45:10.394131+0000","last_active":"2024-04-16T19:35:54.571544+0000","last_peered":"2024-04-16T19:35:54.571544+0000","last_clean":"2024-04-16T19:35:54.571544+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:35:54.571544+0000","last_undegraded":"2024-04-16T19:35:54.571544+0000","last_fullsized":"2024-04-16T19:35:54.571544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:18:12.092314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.384888+0000","last_change":"2024-04-16T17:45:08.390961+0000","last_active":"2024-04-16T19:35:39.384888+0000","last_peered":"2024-04-16T19:35:39.384888+0000","last_clean":"2024-04-16T19:35:39.384888+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:35:39.384888+0000","last_undegraded":"2024-04-16T19:35:39.384888+0000","last_fullsized":"2024-04-16T19:35:39.384888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:36.615698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'50","reported_seq":632,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566804+0000","last_change":"2024-04-16T17:45:45.465543+0000","last_active":"2024-04-16T19:35:29.566804+0000","last_peered":"2024-04-16T19:35:29.566804+0000","last_clean":"2024-04-16T19:35:29.566804+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:35:29.566804+0000","last_undegraded":"2024-04-16T19:35:29.566804+0000","last_fullsized":"2024-04-16T19:35:29.566804+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:54.444903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382232+0000","last_change":"2024-04-16T17:45:10.394908+0000","last_active":"2024-04-16T19:35:39.382232+0000","last_peered":"2024-04-16T19:35:39.382232+0000","last_clean":"2024-04-16T19:35:39.382232+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:35:39.382232+0000","last_undegraded":"2024-04-16T19:35:39.382232+0000","last_fullsized":"2024-04-16T19:35:39.382232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:00.759798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568749+0000","last_change":"2024-04-16T17:45:08.382445+0000","last_active":"2024-04-16T19:35:39.568749+0000","last_peered":"2024-04-16T19:35:39.568749+0000","last_clean":"2024-04-16T19:35:39.568749+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:35:39.568749+0000","last_undegraded":"2024-04-16T19:35:39.568749+0000","last_fullsized":"2024-04-16T19:35:39.568749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:46:03.130129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'9","reported_seq":157,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.547546+0000","last_change":"2024-04-16T17:45:45.459475+0000","last_active":"2024-04-16T19:33:49.547546+0000","last_peered":"2024-04-16T19:33:49.547546+0000","last_clean":"2024-04-16T19:33:49.547546+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:33:49.547546+0000","last_undegraded":"2024-04-16T19:33:49.547546+0000","last_fullsized":"2024-04-16T19:33:49.547546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:38.609449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568527+0000","last_change":"2024-04-16T17:45:10.398439+0000","last_active":"2024-04-16T19:35:39.568527+0000","last_peered":"2024-04-16T19:35:39.568527+0000","last_clean":"2024-04-16T19:35:39.568527+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:35:39.568527+0000","last_undegraded":"2024-04-16T19:35:39.568527+0000","last_fullsized":"2024-04-16T19:35:39.568527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:39.589700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382931+0000","last_change":"2024-04-16T17:45:08.388353+0000","last_active":"2024-04-16T19:35:39.382931+0000","last_peered":"2024-04-16T19:35:39.382931+0000","last_clean":"2024-04-16T19:35:39.382931+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:35:39.382931+0000","last_undegraded":"2024-04-16T19:35:39.382931+0000","last_fullsized":"2024-04-16T19:35:39.382931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'11","reported_seq":529,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.550415+0000","last_change":"2024-04-16T17:45:45.461419+0000","last_active":"2024-04-16T19:34:04.550415+0000","last_peered":"2024-04-16T19:34:04.550415+0000","last_clean":"2024-04-16T19:34:04.550415+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:34:04.550415+0000","last_undegraded":"2024-04-16T19:34:04.550415+0000","last_fullsized":"2024-04-16T19:34:04.550415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:58:08.710389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382760+0000","last_change":"2024-04-16T17:45:10.393085+0000","last_active":"2024-04-16T19:35:39.382760+0000","last_peered":"2024-04-16T19:35:39.382760+0000","last_clean":"2024-04-16T19:35:39.382760+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:35:39.382760+0000","last_undegraded":"2024-04-16T19:35:39.382760+0000","last_fullsized":"2024-04-16T19:35:39.382760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:10.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.568742+0000","last_change":"2024-04-16T17:45:08.387778+0000","last_active":"2024-04-16T19:35:39.568742+0000","last_peered":"2024-04-16T19:35:39.568742+0000","last_clean":"2024-04-16T19:35:39.568742+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:35:39.568742+0000","last_undegraded":"2024-04-16T19:35:39.568742+0000","last_fullsized":"2024-04-16T19:35:39.568742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:00:58.627086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'6","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368125+0000","last_change":"2024-04-16T17:45:45.460984+0000","last_active":"2024-04-16T19:34:09.368125+0000","last_peered":"2024-04-16T19:34:09.368125+0000","last_clean":"2024-04-16T19:34:09.368125+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:34:09.368125+0000","last_undegraded":"2024-04-16T19:34:09.368125+0000","last_fullsized":"2024-04-16T19:34:09.368125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:54:54.185407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.377274+0000","last_change":"2024-04-16T17:45:10.397793+0000","last_active":"2024-04-16T19:34:54.377274+0000","last_peered":"2024-04-16T19:34:54.377274+0000","last_clean":"2024-04-16T19:34:54.377274+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:34:54.377274+0000","last_undegraded":"2024-04-16T19:34:54.377274+0000","last_fullsized":"2024-04-16T19:34:54.377274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:26.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364845+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:33:49.364845+0000","last_peered":"2024-04-16T19:33:49.364845+0000","last_clean":"2024-04-16T19:33:49.364845+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:33:49.364845+0000","last_undegraded":"2024-04-16T19:33:49.364845+0000","last_fullsized":"2024-04-16T19:33:49.364845+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'6","reported_seq":365,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:24.554372+0000","last_change":"2024-04-16T17:45:45.454358+0000","last_active":"2024-04-16T19:34:24.554372+0000","last_peered":"2024-04-16T19:34:24.554372+0000","last_clean":"2024-04-16T19:34:24.554372+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:34:24.554372+0000","last_undegraded":"2024-04-16T19:34:24.554372+0000","last_fullsized":"2024-04-16T19:34:24.554372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:05.027153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375005+0000","last_change":"2024-04-16T17:45:10.390881+0000","last_active":"2024-04-16T19:34:54.375005+0000","last_peered":"2024-04-16T19:34:54.375005+0000","last_clean":"2024-04-16T19:34:54.375005+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:34:54.375005+0000","last_undegraded":"2024-04-16T19:34:54.375005+0000","last_fullsized":"2024-04-16T19:34:54.375005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:58.273468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382101+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:35:24.382101+0000","last_peered":"2024-04-16T19:35:24.382101+0000","last_clean":"2024-04-16T19:35:24.382101+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:35:24.382101+0000","last_undegraded":"2024-04-16T19:35:24.382101+0000","last_fullsized":"2024-04-16T19:35:24.382101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'12","reported_seq":411,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.369866+0000","last_change":"2024-04-16T17:45:45.466651+0000","last_active":"2024-04-16T19:34:09.369866+0000","last_peered":"2024-04-16T19:34:09.369866+0000","last_clean":"2024-04-16T19:34:09.369866+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:34:09.369866+0000","last_undegraded":"2024-04-16T19:34:09.369866+0000","last_fullsized":"2024-04-16T19:34:09.369866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:40.527095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.569671+0000","last_change":"2024-04-16T17:45:10.393700+0000","last_active":"2024-04-16T19:35:44.569671+0000","last_peered":"2024-04-16T19:35:44.569671+0000","last_clean":"2024-04-16T19:35:44.569671+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:35:44.569671+0000","last_undegraded":"2024-04-16T19:35:44.569671+0000","last_fullsized":"2024-04-16T19:35:44.569671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:02:23.287018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380398+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:35:24.380398+0000","last_peered":"2024-04-16T19:35:24.380398+0000","last_clean":"2024-04-16T19:35:24.380398+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:35:24.380398+0000","last_undegraded":"2024-04-16T19:35:24.380398+0000","last_fullsized":"2024-04-16T19:35:24.380398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:58.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'14","reported_seq":681,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551292+0000","last_change":"2024-04-16T17:45:45.455567+0000","last_active":"2024-04-16T19:34:09.551292+0000","last_peered":"2024-04-16T19:34:09.551292+0000","last_clean":"2024-04-16T19:34:09.551292+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:34:09.551292+0000","last_undegraded":"2024-04-16T19:34:09.551292+0000","last_fullsized":"2024-04-16T19:34:09.551292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:53:12.376645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381352+0000","last_change":"2024-04-16T17:45:10.390598+0000","last_active":"2024-04-16T19:35:29.381352+0000","last_peered":"2024-04-16T19:35:29.381352+0000","last_clean":"2024-04-16T19:35:29.381352+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:35:29.381352+0000","last_undegraded":"2024-04-16T19:35:29.381352+0000","last_fullsized":"2024-04-16T19:35:29.381352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:19.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.382184+0000","last_change":"2024-04-16T17:45:08.389493+0000","last_active":"2024-04-16T19:35:24.382184+0000","last_peered":"2024-04-16T19:35:24.382184+0000","last_clean":"2024-04-16T19:35:24.382184+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:35:24.382184+0000","last_undegraded":"2024-04-16T19:35:24.382184+0000","last_fullsized":"2024-04-16T19:35:24.382184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'15","reported_seq":211,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368646+0000","last_change":"2024-04-16T17:45:45.464470+0000","last_active":"2024-04-16T19:34:09.368646+0000","last_peered":"2024-04-16T19:34:09.368646+0000","last_clean":"2024-04-16T19:34:09.368646+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:34:09.368646+0000","last_undegraded":"2024-04-16T19:34:09.368646+0000","last_fullsized":"2024-04-16T19:34:09.368646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:14.079978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380416+0000","last_change":"2024-04-16T17:45:10.397665+0000","last_active":"2024-04-16T19:35:29.380416+0000","last_peered":"2024-04-16T19:35:29.380416+0000","last_clean":"2024-04-16T19:35:29.380416+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:35:29.380416+0000","last_undegraded":"2024-04-16T19:35:29.380416+0000","last_fullsized":"2024-04-16T19:35:29.380416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:53.725890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380581+0000","last_change":"2024-04-16T17:45:08.386399+0000","last_active":"2024-04-16T19:35:24.380581+0000","last_peered":"2024-04-16T19:35:24.380581+0000","last_clean":"2024-04-16T19:35:24.380581+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:35:24.380581+0000","last_undegraded":"2024-04-16T19:35:24.380581+0000","last_fullsized":"2024-04-16T19:35:24.380581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:55.689073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'3","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551522+0000","last_change":"2024-04-16T17:45:45.455538+0000","last_active":"2024-04-16T19:34:09.551522+0000","last_peered":"2024-04-16T19:34:09.551522+0000","last_clean":"2024-04-16T19:34:09.551522+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:34:09.551522+0000","last_undegraded":"2024-04-16T19:34:09.551522+0000","last_fullsized":"2024-04-16T19:34:09.551522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:38.174415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.383169+0000","last_change":"2024-04-16T17:45:10.393634+0000","last_active":"2024-04-16T19:35:29.383169+0000","last_peered":"2024-04-16T19:35:29.383169+0000","last_clean":"2024-04-16T19:35:29.383169+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:35:29.383169+0000","last_undegraded":"2024-04-16T19:35:29.383169+0000","last_fullsized":"2024-04-16T19:35:29.383169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:00.458421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383699+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:35:44.383699+0000","last_peered":"2024-04-16T19:35:44.383699+0000","last_clean":"2024-04-16T19:35:44.383699+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:35:44.383699+0000","last_undegraded":"2024-04-16T19:35:44.383699+0000","last_fullsized":"2024-04-16T19:35:44.383699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:55.231268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'9","reported_seq":448,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.551428+0000","last_change":"2024-04-16T17:45:45.454411+0000","last_active":"2024-04-16T19:34:09.551428+0000","last_peered":"2024-04-16T19:34:09.551428+0000","last_clean":"2024-04-16T19:34:09.551428+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:34:09.551428+0000","last_undegraded":"2024-04-16T19:34:09.551428+0000","last_fullsized":"2024-04-16T19:34:09.551428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:55:01.786817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.566621+0000","last_change":"2024-04-16T17:45:10.399193+0000","last_active":"2024-04-16T19:35:29.566621+0000","last_peered":"2024-04-16T19:35:29.566621+0000","last_clean":"2024-04-16T19:35:29.566621+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:35:29.566621+0000","last_undegraded":"2024-04-16T19:35:29.566621+0000","last_fullsized":"2024-04-16T19:35:29.566621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:06.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559232+0000","last_change":"2024-04-16T17:45:08.388974+0000","last_active":"2024-04-16T19:34:49.559232+0000","last_peered":"2024-04-16T19:34:49.559232+0000","last_clean":"2024-04-16T19:34:49.559232+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:34:49.559232+0000","last_undegraded":"2024-04-16T19:34:49.559232+0000","last_fullsized":"2024-04-16T19:34:49.559232+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:35.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'3","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.370003+0000","last_change":"2024-04-16T17:45:45.466411+0000","last_active":"2024-04-16T19:34:09.370003+0000","last_peered":"2024-04-16T19:34:09.370003+0000","last_clean":"2024-04-16T19:34:09.370003+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:34:09.370003+0000","last_undegraded":"2024-04-16T19:34:09.370003+0000","last_fullsized":"2024-04-16T19:34:09.370003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:41.975363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365563+0000","last_change":"2024-04-16T17:45:10.392230+0000","last_active":"2024-04-16T19:33:54.365563+0000","last_peered":"2024-04-16T19:33:54.365563+0000","last_clean":"2024-04-16T19:33:54.365563+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:33:54.365563+0000","last_undegraded":"2024-04-16T19:33:54.365563+0000","last_fullsized":"2024-04-16T19:33:54.365563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:41.531980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374829+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:34:49.374829+0000","last_peered":"2024-04-16T19:34:49.374829+0000","last_clean":"2024-04-16T19:34:49.374829+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:34:49.374829+0000","last_undegraded":"2024-04-16T19:34:49.374829+0000","last_fullsized":"2024-04-16T19:34:49.374829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:56.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'7","reported_seq":317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.361610+0000","last_change":"2024-04-16T17:45:45.467943+0000","last_active":"2024-04-16T19:33:19.361610+0000","last_peered":"2024-04-16T19:33:19.361610+0000","last_clean":"2024-04-16T19:33:19.361610+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:33:19.361610+0000","last_undegraded":"2024-04-16T19:33:19.361610+0000","last_fullsized":"2024-04-16T19:33:19.361610+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:37.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374628+0000","last_change":"2024-04-16T17:45:08.386818+0000","last_active":"2024-04-16T19:34:49.374628+0000","last_peered":"2024-04-16T19:34:49.374628+0000","last_clean":"2024-04-16T19:34:49.374628+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:34:49.374628+0000","last_undegraded":"2024-04-16T19:34:49.374628+0000","last_fullsized":"2024-04-16T19:34:49.374628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:29.526811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.371846+0000","last_change":"2024-04-16T17:45:10.391395+0000","last_active":"2024-04-16T19:34:19.371846+0000","last_peered":"2024-04-16T19:34:19.371846+0000","last_clean":"2024-04-16T19:34:19.371846+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:34:19.371846+0000","last_undegraded":"2024-04-16T19:34:19.371846+0000","last_fullsized":"2024-04-16T19:34:19.371846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:57.238729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'29","reported_seq":754,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.541691+0000","last_change":"2024-04-16T17:45:45.461627+0000","last_active":"2024-04-16T19:33:19.541691+0000","last_peered":"2024-04-16T19:33:19.541691+0000","last_clean":"2024-04-16T19:33:19.541691+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:33:19.541691+0000","last_undegraded":"2024-04-16T19:33:19.541691+0000","last_fullsized":"2024-04-16T19:33:19.541691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:37.357293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.559097+0000","last_change":"2024-04-16T17:45:08.389341+0000","last_active":"2024-04-16T19:34:49.559097+0000","last_peered":"2024-04-16T19:34:49.559097+0000","last_clean":"2024-04-16T19:34:49.559097+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:34:49.559097+0000","last_undegraded":"2024-04-16T19:34:49.559097+0000","last_fullsized":"2024-04-16T19:34:49.559097+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:35.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366646+0000","last_change":"2024-04-16T17:45:10.395147+0000","last_active":"2024-04-16T19:33:59.366646+0000","last_peered":"2024-04-16T19:33:59.366646+0000","last_clean":"2024-04-16T19:33:59.366646+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:33:59.366646+0000","last_undegraded":"2024-04-16T19:33:59.366646+0000","last_fullsized":"2024-04-16T19:33:59.366646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:56.222153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4205,"ondisk_log_size":4205,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3706,"ondisk_log_size":3706,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":749,"ondisk_log_size":749,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20907,"ondisk_log_size":20907,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5228,"ondisk_log_size":5228,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641624,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46644,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810956,"statfs":{"total":107374182400,"available":107326418944,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641623,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":58984,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798616,"statfs":{"total":107374182400,"available":107313782784,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641624,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":83468,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":104774132,"statfs":{"total":107374182400,"available":107288711168,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641623,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46796,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810804,"statfs":{"total":107374182400,"available":107326263296,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641622,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46772,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810828,"statfs":{"total":107374182400,"available":107326287872,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641624,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51520,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806080,"statfs":{"total":107374182400,"available":107321425920,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:38:06.298 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2024-04-16T19:38:06.602 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:38:06.602 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":53,"fsid":"5a17fdec-f013-46d8-9b9d-5b1671d92bcc","created":"2024-04-16T17:44:10.966929+0000","modified":"2024-04-16T18:09:18.170569+0000","last_up_change":"2024-04-16T17:44:19.154954+0000","last_in_change":"2024-04-16T17:44:12.675987+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-16T17:44:19.269588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-16T17:44:20.904428+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-16T17:45:07.073762+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-16T17:45:08.702623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-16T17:45:18.658700+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-16T17:45:20.463522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-16T17:45:22.426597+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-16T17:45:24.456369+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"test-zone1.rgw.buckets.data","create_time":"2024-04-16T17:45:43.473042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.2200000286102295,"score_stable":1.2200000286102295,"optimal_score":1,"raw_score_acting":1.2200000286102295,"raw_score_stable":1.2200000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"test-zone1.rgw.log","create_time":"2024-04-16T17:45:45.668840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"test-zone1.rgw.control","create_time":"2024-04-16T17:45:47.470364+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"test-zone1.rgw.meta","create_time":"2024-04-16T17:45:49.494710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"test-zone1.rgw.otp","create_time":"2024-04-16T17:46:15.533061+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"test-zone1.rgw.buckets.index","create_time":"2024-04-16T17:46:24.336268+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"test-zone1.rgw.buckets.non-ec","create_time":"2024-04-16T18:09:00.713202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b9330710-cd51-41be-a800-9a62853fcbef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6801","nonce":4036709287}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6803","nonce":4036709287}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6807","nonce":4036709287}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4036709287},{"type":"v1","addr":"172.21.15.16:6805","nonce":4036709287}]},"public_addr":"172.21.15.16:6801/4036709287","cluster_addr":"172.21.15.16:6803/4036709287","heartbeat_back_addr":"172.21.15.16:6807/4036709287","heartbeat_front_addr":"172.21.15.16:6805/4036709287","state":["exists","up"]},{"osd":1,"uuid":"fff6601f-7171-4f90-96fa-7797fd3cbf1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6808","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6809","nonce":2385164393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6811","nonce":2385164393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6814","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6815","nonce":2385164393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":2385164393},{"type":"v1","addr":"172.21.15.16:6813","nonce":2385164393}]},"public_addr":"172.21.15.16:6809/2385164393","cluster_addr":"172.21.15.16:6811/2385164393","heartbeat_back_addr":"172.21.15.16:6815/2385164393","heartbeat_front_addr":"172.21.15.16:6813/2385164393","state":["exists","up"]},{"osd":2,"uuid":"05b27816-aed9-4771-90a5-7cccae7f5301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6817","nonce":1917968682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6818","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6819","nonce":1917968682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6822","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6823","nonce":1917968682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1917968682},{"type":"v1","addr":"172.21.15.16:6821","nonce":1917968682}]},"public_addr":"172.21.15.16:6817/1917968682","cluster_addr":"172.21.15.16:6819/1917968682","heartbeat_back_addr":"172.21.15.16:6823/1917968682","heartbeat_front_addr":"172.21.15.16:6821/1917968682","state":["exists","up"]},{"osd":3,"uuid":"624812b4-4b0d-47d9-a062-2fca11a9094b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6800","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6801","nonce":519987536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6802","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6803","nonce":519987536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6806","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6807","nonce":519987536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6804","nonce":519987536},{"type":"v1","addr":"172.21.15.23:6805","nonce":519987536}]},"public_addr":"172.21.15.23:6801/519987536","cluster_addr":"172.21.15.23:6803/519987536","heartbeat_back_addr":"172.21.15.23:6807/519987536","heartbeat_front_addr":"172.21.15.23:6805/519987536","state":["exists","up"]},{"osd":4,"uuid":"66f06127-813c-4e57-bf5d-994dc1afcd1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6808","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6809","nonce":446546393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6810","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6811","nonce":446546393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6814","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6815","nonce":446546393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6812","nonce":446546393},{"type":"v1","addr":"172.21.15.23:6813","nonce":446546393}]},"public_addr":"172.21.15.23:6809/446546393","cluster_addr":"172.21.15.23:6811/446546393","heartbeat_back_addr":"172.21.15.23:6815/446546393","heartbeat_front_addr":"172.21.15.23:6813/446546393","state":["exists","up"]},{"osd":5,"uuid":"29d6da0e-9853-43c9-a4ef-21e94efb9723","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6816","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6817","nonce":2284545740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6818","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6819","nonce":2284545740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6822","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6823","nonce":2284545740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.23:6820","nonce":2284545740},{"type":"v1","addr":"172.21.15.23:6821","nonce":2284545740}]},"public_addr":"172.21.15.23:6817/2284545740","cluster_addr":"172.21.15.23:6819/2284545740","heartbeat_back_addr":"172.21.15.23:6823/2284545740","heartbeat_front_addr":"172.21.15.23:6821/2284545740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.937779+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.043968+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.056051+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:17.035710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.985059+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-16T17:44:16.981088+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1","mappings":[{"from":0,"to":1}]},{"pgid":"3.d","mappings":[{"from":3,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.32","mappings":[{"from":0,"to":2}]},{"pgid":"3.3a","mappings":[{"from":0,"to":2},{"from":5,"to":1}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.27","mappings":[{"from":1,"to":2}]},{"pgid":"9.13","mappings":[{"from":3,"to":4}]},{"pgid":"9.19","mappings":[{"from":2,"to":4}]},{"pgid":"9.29","mappings":[{"from":3,"to":4}]},{"pgid":"12.1a","mappings":[{"from":0,"to":3}]},{"pgid":"14.8","mappings":[{"from":0,"to":5}]},{"pgid":"14.1f","mappings":[{"from":0,"to":5}]},{"pgid":"15.10","mappings":[{"from":4,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-16T19:38:07.615 INFO:tasks.ceph:Scrubbing c1.osd.0 2024-04-16T19:38:07.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-16T19:38:07.757 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-16T19:38:07.758 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T19:38:07.758 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-16T19:38:07.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 0 2024-04-16T19:38:08.069 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2024-04-16T19:38:08.083 INFO:tasks.ceph:Scrubbing c1.osd.1 2024-04-16T19:38:08.083 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-16T19:38:08.211 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-16T19:38:08.211 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T19:38:08.212 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-16T19:38:08.222 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 1 2024-04-16T19:38:08.523 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2024-04-16T19:38:08.537 INFO:tasks.ceph:Scrubbing c1.osd.2 2024-04-16T19:38:08.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-16T19:38:08.666 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-16T19:38:08.666 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T19:38:08.666 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-16T19:38:08.676 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 2 2024-04-16T19:38:08.976 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2024-04-16T19:38:08.989 INFO:tasks.ceph:Scrubbing c1.osd.3 2024-04-16T19:38:08.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-16T19:38:09.118 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-16T19:38:09.118 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T19:38:09.118 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-16T19:38:09.129 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 3 2024-04-16T19:38:09.429 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2024-04-16T19:38:09.442 INFO:tasks.ceph:Scrubbing c1.osd.4 2024-04-16T19:38:09.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-16T19:38:09.570 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-16T19:38:09.571 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T19:38:09.571 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-16T19:38:09.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 4 2024-04-16T19:38:09.886 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2024-04-16T19:38:09.899 INFO:tasks.ceph:Scrubbing c1.osd.5 2024-04-16T19:38:09.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-16T19:38:10.028 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2024-04-16T19:38:10.028 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-16T19:38:10.028 INFO:teuthology.orchestra.run.smithi016.stdout:} 2024-04-16T19:38:10.039 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd deep-scrub 5 2024-04-16T19:38:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2024-04-16T19:38:10.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:38:10.699 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:38:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:38:10.731 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3462,"stamp":"2024-04-16T19:38:10.496822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35633,"ondisk_log_size":35633,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":334184,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":322998,"kb_avail":628811416,"statfs":{"total":644245094400,"available":643902889984,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":330750625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005636"},"pg_stats":[{"pgid":"9.35","version":"53'18","reported_seq":517,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.584631+0000","last_change":"2024-04-16T17:45:45.459835+0000","last_active":"2024-04-16T19:36:59.584631+0000","last_peered":"2024-04-16T19:36:59.584631+0000","last_clean":"2024-04-16T19:36:59.584631+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:36:59.584631+0000","last_undegraded":"2024-04-16T19:36:59.584631+0000","last_fullsized":"2024-04-16T19:36:59.584631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382165+0000","last_change":"2024-04-16T17:45:08.383247+0000","last_active":"2024-04-16T19:35:34.382165+0000","last_peered":"2024-04-16T19:35:34.382165+0000","last_clean":"2024-04-16T19:35:34.382165+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:35:34.382165+0000","last_undegraded":"2024-04-16T19:35:34.382165+0000","last_fullsized":"2024-04-16T19:35:34.382165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:20.213795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378639+0000","last_change":"2024-04-16T17:45:10.400343+0000","last_active":"2024-04-16T19:35:14.378639+0000","last_peered":"2024-04-16T19:35:14.378639+0000","last_clean":"2024-04-16T19:35:14.378639+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:35:14.378639+0000","last_undegraded":"2024-04-16T19:35:14.378639+0000","last_fullsized":"2024-04-16T19:35:14.378639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:34:35.746556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'6","reported_seq":288,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372581+0000","last_change":"2024-04-16T17:45:45.464134+0000","last_active":"2024-04-16T19:34:34.372581+0000","last_peered":"2024-04-16T19:34:34.372581+0000","last_clean":"2024-04-16T19:34:34.372581+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:34:34.372581+0000","last_undegraded":"2024-04-16T19:34:34.372581+0000","last_fullsized":"2024-04-16T19:34:34.372581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:29:54.124351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592809+0000","last_change":"2024-04-16T17:45:08.381595+0000","last_active":"2024-04-16T19:37:39.592809+0000","last_peered":"2024-04-16T19:37:39.592809+0000","last_clean":"2024-04-16T19:37:39.592809+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:37:39.592809+0000","last_undegraded":"2024-04-16T19:37:39.592809+0000","last_fullsized":"2024-04-16T19:37:39.592809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378769+0000","last_change":"2024-04-16T17:45:10.390675+0000","last_active":"2024-04-16T19:35:14.378769+0000","last_peered":"2024-04-16T19:35:14.378769+0000","last_clean":"2024-04-16T19:35:14.378769+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:35:14.378769+0000","last_undegraded":"2024-04-16T19:35:14.378769+0000","last_fullsized":"2024-04-16T19:35:14.378769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:26.461468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'7","reported_seq":260,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375036+0000","last_change":"2024-04-16T17:45:45.461571+0000","last_active":"2024-04-16T19:34:54.375036+0000","last_peered":"2024-04-16T19:34:54.375036+0000","last_clean":"2024-04-16T19:34:54.375036+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:34:54.375036+0000","last_undegraded":"2024-04-16T19:34:54.375036+0000","last_fullsized":"2024-04-16T19:34:54.375036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:58:19.904572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404360+0000","last_change":"2024-04-16T17:45:08.381577+0000","last_active":"2024-04-16T19:37:39.404360+0000","last_peered":"2024-04-16T19:37:39.404360+0000","last_clean":"2024-04-16T19:37:39.404360+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:37:39.404360+0000","last_undegraded":"2024-04-16T19:37:39.404360+0000","last_fullsized":"2024-04-16T19:37:39.404360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378103+0000","last_change":"2024-04-16T17:45:10.394273+0000","last_active":"2024-04-16T19:35:14.378103+0000","last_peered":"2024-04-16T19:35:14.378103+0000","last_clean":"2024-04-16T19:35:14.378103+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:35:14.378103+0000","last_undegraded":"2024-04-16T19:35:14.378103+0000","last_fullsized":"2024-04-16T19:35:14.378103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:11:54.131308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'7","reported_seq":247,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.584683+0000","last_change":"2024-04-16T17:45:45.464927+0000","last_active":"2024-04-16T19:36:59.584683+0000","last_peered":"2024-04-16T19:36:59.584683+0000","last_clean":"2024-04-16T19:36:59.584683+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:36:59.584683+0000","last_undegraded":"2024-04-16T19:36:59.584683+0000","last_fullsized":"2024-04-16T19:36:59.584683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381354+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:35:29.381354+0000","last_peered":"2024-04-16T19:35:29.381354+0000","last_clean":"2024-04-16T19:35:29.381354+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:35:29.381354+0000","last_undegraded":"2024-04-16T19:35:29.381354+0000","last_fullsized":"2024-04-16T19:35:29.381354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:22.068786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405200+0000","last_change":"2024-04-16T17:45:10.398320+0000","last_active":"2024-04-16T19:37:44.405200+0000","last_peered":"2024-04-16T19:37:44.405200+0000","last_clean":"2024-04-16T19:37:44.405200+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:37:44.405200+0000","last_undegraded":"2024-04-16T19:37:44.405200+0000","last_fullsized":"2024-04-16T19:37:44.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'7","reported_seq":515,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380346+0000","last_change":"2024-04-16T17:45:45.455611+0000","last_active":"2024-04-16T19:35:29.380346+0000","last_peered":"2024-04-16T19:35:29.380346+0000","last_clean":"2024-04-16T19:35:29.380346+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:35:29.380346+0000","last_undegraded":"2024-04-16T19:35:29.380346+0000","last_fullsized":"2024-04-16T19:35:29.380346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:39:55.884585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377968+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:35:09.377968+0000","last_peered":"2024-04-16T19:35:09.377968+0000","last_clean":"2024-04-16T19:35:09.377968+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:35:09.377968+0000","last_undegraded":"2024-04-16T19:35:09.377968+0000","last_fullsized":"2024-04-16T19:35:09.377968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382143+0000","last_change":"2024-04-16T17:45:10.395553+0000","last_active":"2024-04-16T19:35:34.382143+0000","last_peered":"2024-04-16T19:35:34.382143+0000","last_clean":"2024-04-16T19:35:34.382143+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:35:34.382143+0000","last_undegraded":"2024-04-16T19:35:34.382143+0000","last_fullsized":"2024-04-16T19:35:34.382143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:25.987507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'8","reported_seq":316,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406051+0000","last_change":"2024-04-16T17:45:45.464732+0000","last_active":"2024-04-16T19:37:49.406051+0000","last_peered":"2024-04-16T19:37:49.406051+0000","last_clean":"2024-04-16T19:37:49.406051+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:37:49.406051+0000","last_undegraded":"2024-04-16T19:37:49.406051+0000","last_fullsized":"2024-04-16T19:37:49.406051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576438+0000","last_change":"2024-04-16T17:46:16.500171+0000","last_active":"2024-04-16T19:36:19.576438+0000","last_peered":"2024-04-16T19:36:19.576438+0000","last_clean":"2024-04-16T19:36:19.576438+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:36:19.576438+0000","last_undegraded":"2024-04-16T19:36:19.576438+0000","last_fullsized":"2024-04-16T19:36:19.576438+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382318+0000","last_change":"2024-04-16T17:45:10.397556+0000","last_active":"2024-04-16T19:35:39.382318+0000","last_peered":"2024-04-16T19:35:39.382318+0000","last_clean":"2024-04-16T19:35:39.382318+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:35:39.382318+0000","last_undegraded":"2024-04-16T19:35:39.382318+0000","last_fullsized":"2024-04-16T19:35:39.382318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:31.534272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'8","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372376+0000","last_change":"2024-04-16T17:45:45.463411+0000","last_active":"2024-04-16T19:34:34.372376+0000","last_peered":"2024-04-16T19:34:34.372376+0000","last_clean":"2024-04-16T19:34:34.372376+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:34:34.372376+0000","last_undegraded":"2024-04-16T19:34:34.372376+0000","last_fullsized":"2024-04-16T19:34:34.372376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:36:34.046647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377851+0000","last_change":"2024-04-16T17:45:08.383652+0000","last_active":"2024-04-16T19:35:09.377851+0000","last_peered":"2024-04-16T19:35:09.377851+0000","last_clean":"2024-04-16T19:35:09.377851+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:35:09.377851+0000","last_undegraded":"2024-04-16T19:35:09.377851+0000","last_fullsized":"2024-04-16T19:35:09.377851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:04.729085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382949+0000","last_change":"2024-04-16T17:45:10.395876+0000","last_active":"2024-04-16T19:35:39.382949+0000","last_peered":"2024-04-16T19:35:39.382949+0000","last_clean":"2024-04-16T19:35:39.382949+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:35:39.382949+0000","last_undegraded":"2024-04-16T19:35:39.382949+0000","last_fullsized":"2024-04-16T19:35:39.382949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:22.221256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'6","reported_seq":430,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383657+0000","last_change":"2024-04-16T17:45:45.457177+0000","last_active":"2024-04-16T19:35:49.383657+0000","last_peered":"2024-04-16T19:35:49.383657+0000","last_clean":"2024-04-16T19:35:49.383657+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:35:49.383657+0000","last_undegraded":"2024-04-16T19:35:49.383657+0000","last_fullsized":"2024-04-16T19:35:49.383657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:12:26.573550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592526+0000","last_change":"2024-04-16T17:45:08.389961+0000","last_active":"2024-04-16T19:37:39.592526+0000","last_peered":"2024-04-16T19:37:39.592526+0000","last_clean":"2024-04-16T19:37:39.592526+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:37:39.592526+0000","last_undegraded":"2024-04-16T19:37:39.592526+0000","last_fullsized":"2024-04-16T19:37:39.592526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593660+0000","last_change":"2024-04-16T17:45:10.399056+0000","last_active":"2024-04-16T19:37:44.593660+0000","last_peered":"2024-04-16T19:37:44.593660+0000","last_clean":"2024-04-16T19:37:44.593660+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:37:44.593660+0000","last_undegraded":"2024-04-16T19:37:44.593660+0000","last_fullsized":"2024-04-16T19:37:44.593660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'5","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368622+0000","last_change":"2024-04-16T17:45:45.462628+0000","last_active":"2024-04-16T19:34:09.368622+0000","last_peered":"2024-04-16T19:34:09.368622+0000","last_clean":"2024-04-16T19:34:09.368622+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:34:09.368622+0000","last_undegraded":"2024-04-16T19:34:09.368622+0000","last_fullsized":"2024-04-16T19:34:09.368622+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374833+0000","last_change":"2024-04-16T17:45:10.394927+0000","last_active":"2024-04-16T19:34:54.374833+0000","last_peered":"2024-04-16T19:34:54.374833+0000","last_clean":"2024-04-16T19:34:54.374833+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:34:54.374833+0000","last_undegraded":"2024-04-16T19:34:54.374833+0000","last_fullsized":"2024-04-16T19:34:54.374833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:22:24.076247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369185+0000","last_change":"2024-04-16T17:45:08.388693+0000","last_active":"2024-04-16T19:34:14.369185+0000","last_peered":"2024-04-16T19:34:14.369185+0000","last_clean":"2024-04-16T19:34:14.369185+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:34:14.369185+0000","last_undegraded":"2024-04-16T19:34:14.369185+0000","last_fullsized":"2024-04-16T19:34:14.369185+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.696516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'6","reported_seq":348,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.387596+0000","last_change":"2024-04-16T17:45:45.462192+0000","last_active":"2024-04-16T19:36:09.387596+0000","last_peered":"2024-04-16T19:36:09.387596+0000","last_clean":"2024-04-16T19:36:09.387596+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:36:09.387596+0000","last_undegraded":"2024-04-16T19:36:09.387596+0000","last_fullsized":"2024-04-16T19:36:09.387596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:37.359912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375417+0000","last_change":"2024-04-16T17:45:10.393548+0000","last_active":"2024-04-16T19:34:54.375417+0000","last_peered":"2024-04-16T19:34:54.375417+0000","last_clean":"2024-04-16T19:34:54.375417+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:34:54.375417+0000","last_undegraded":"2024-04-16T19:34:54.375417+0000","last_fullsized":"2024-04-16T19:34:54.375417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:47.251006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365741+0000","last_change":"2024-04-16T17:45:08.388744+0000","last_active":"2024-04-16T19:33:54.365741+0000","last_peered":"2024-04-16T19:33:54.365741+0000","last_clean":"2024-04-16T19:33:54.365741+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:33:54.365741+0000","last_undegraded":"2024-04-16T19:33:54.365741+0000","last_fullsized":"2024-04-16T19:33:54.365741+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'5","reported_seq":512,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575609+0000","last_change":"2024-04-16T17:45:45.456392+0000","last_active":"2024-04-16T19:36:14.575609+0000","last_peered":"2024-04-16T19:36:14.575609+0000","last_clean":"2024-04-16T19:36:14.575609+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:36:14.575609+0000","last_undegraded":"2024-04-16T19:36:14.575609+0000","last_fullsized":"2024-04-16T19:36:14.575609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378717+0000","last_change":"2024-04-16T17:45:10.392335+0000","last_active":"2024-04-16T19:35:14.378717+0000","last_peered":"2024-04-16T19:35:14.378717+0000","last_clean":"2024-04-16T19:35:14.378717+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:35:14.378717+0000","last_undegraded":"2024-04-16T19:35:14.378717+0000","last_fullsized":"2024-04-16T19:35:14.378717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:48:16.297430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365744+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:33:54.365744+0000","last_peered":"2024-04-16T19:33:54.365744+0000","last_clean":"2024-04-16T19:33:54.365744+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:33:54.365744+0000","last_undegraded":"2024-04-16T19:33:54.365744+0000","last_fullsized":"2024-04-16T19:33:54.365744+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:36.615698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'10","reported_seq":235,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575549+0000","last_change":"2024-04-16T17:45:45.455448+0000","last_active":"2024-04-16T19:36:14.575549+0000","last_peered":"2024-04-16T19:36:14.575549+0000","last_clean":"2024-04-16T19:36:14.575549+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:36:14.575549+0000","last_undegraded":"2024-04-16T19:36:14.575549+0000","last_fullsized":"2024-04-16T19:36:14.575549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577524+0000","last_change":"2024-04-16T17:45:10.391411+0000","last_active":"2024-04-16T19:36:24.577524+0000","last_peered":"2024-04-16T19:36:24.577524+0000","last_clean":"2024-04-16T19:36:24.577524+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:36:24.577524+0000","last_undegraded":"2024-04-16T19:36:24.577524+0000","last_fullsized":"2024-04-16T19:36:24.577524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365154+0000","last_change":"2024-04-16T17:45:08.382324+0000","last_active":"2024-04-16T19:33:54.365154+0000","last_peered":"2024-04-16T19:33:54.365154+0000","last_clean":"2024-04-16T19:33:54.365154+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:33:54.365154+0000","last_undegraded":"2024-04-16T19:33:54.365154+0000","last_fullsized":"2024-04-16T19:33:54.365154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:35.887381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"48'6","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360042+0000","last_change":"2024-04-16T17:45:45.460928+0000","last_active":"2024-04-16T19:33:19.360042+0000","last_peered":"2024-04-16T19:33:19.360042+0000","last_clean":"2024-04-16T19:33:19.360042+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:33:19.360042+0000","last_undegraded":"2024-04-16T19:33:19.360042+0000","last_fullsized":"2024-04-16T19:33:19.360042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:39.914032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577561+0000","last_change":"2024-04-16T17:45:10.393503+0000","last_active":"2024-04-16T19:36:24.577561+0000","last_peered":"2024-04-16T19:36:24.577561+0000","last_clean":"2024-04-16T19:36:24.577561+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:36:24.577561+0000","last_undegraded":"2024-04-16T19:36:24.577561+0000","last_fullsized":"2024-04-16T19:36:24.577561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391358+0000","last_change":"2024-04-16T17:45:08.387116+0000","last_active":"2024-04-16T19:36:19.391358+0000","last_peered":"2024-04-16T19:36:19.391358+0000","last_clean":"2024-04-16T19:36:19.391358+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:36:19.391358+0000","last_undegraded":"2024-04-16T19:36:19.391358+0000","last_fullsized":"2024-04-16T19:36:19.391358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"48'1","reported_seq":223,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570425+0000","last_change":"2024-04-16T17:45:45.455236+0000","last_active":"2024-04-16T19:35:49.570425+0000","last_peered":"2024-04-16T19:35:49.570425+0000","last_clean":"2024-04-16T19:35:49.570425+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:35:49.570425+0000","last_undegraded":"2024-04-16T19:35:49.570425+0000","last_fullsized":"2024-04-16T19:35:49.570425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366097+0000","last_change":"2024-04-16T17:45:10.397627+0000","last_active":"2024-04-16T19:33:59.366097+0000","last_peered":"2024-04-16T19:33:59.366097+0000","last_clean":"2024-04-16T19:33:59.366097+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:33:59.366097+0000","last_undegraded":"2024-04-16T19:33:59.366097+0000","last_fullsized":"2024-04-16T19:33:59.366097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:50.581378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575413+0000","last_change":"2024-04-16T17:46:16.498581+0000","last_active":"2024-04-16T19:36:14.575413+0000","last_peered":"2024-04-16T19:36:14.575413+0000","last_clean":"2024-04-16T19:36:14.575413+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:36:14.575413+0000","last_undegraded":"2024-04-16T19:36:14.575413+0000","last_fullsized":"2024-04-16T19:36:14.575413+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579644+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:36:34.579644+0000","last_peered":"2024-04-16T19:36:34.579644+0000","last_clean":"2024-04-16T19:36:34.579644+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:36:34.579644+0000","last_undegraded":"2024-04-16T19:36:34.579644+0000","last_fullsized":"2024-04-16T19:36:34.579644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'145","reported_seq":2257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374839+0000","last_change":"2024-04-16T17:46:25.527767+0000","last_active":"2024-04-16T19:34:49.374839+0000","last_peered":"2024-04-16T19:34:49.374839+0000","last_clean":"2024-04-16T19:34:49.374839+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:34:49.374839+0000","last_undegraded":"2024-04-16T19:34:49.374839+0000","last_fullsized":"2024-04-16T19:34:49.374839+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:25.946687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364929+0000","last_change":"2024-04-16T17:46:17.511976+0000","last_active":"2024-04-16T19:33:49.364929+0000","last_peered":"2024-04-16T19:33:49.364929+0000","last_clean":"2024-04-16T19:33:49.364929+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:33:49.364929+0000","last_undegraded":"2024-04-16T19:33:49.364929+0000","last_fullsized":"2024-04-16T19:33:49.364929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'20","reported_seq":157,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387427+0000","last_change":"2024-04-16T17:45:51.478677+0000","last_active":"2024-04-16T19:35:54.387427+0000","last_peered":"2024-04-16T19:35:54.387427+0000","last_clean":"2024-04-16T19:35:54.387427+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:35:54.387427+0000","last_undegraded":"2024-04-16T19:35:54.387427+0000","last_fullsized":"2024-04-16T19:35:54.387427+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359188+0000","last_change":"2024-04-16T17:45:49.472385+0000","last_active":"2024-04-16T19:33:19.359188+0000","last_peered":"2024-04-16T19:33:19.359188+0000","last_clean":"2024-04-16T19:33:19.359188+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:33:19.359188+0000","last_undegraded":"2024-04-16T19:33:19.359188+0000","last_fullsized":"2024-04-16T19:33:19.359188+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:24.302917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'243","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360107+0000","last_change":"2024-04-16T17:45:47.462219+0000","last_active":"2024-04-16T19:33:19.360107+0000","last_peered":"2024-04-16T19:33:19.360107+0000","last_clean":"2024-04-16T19:33:19.360107+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:33:19.360107+0000","last_undegraded":"2024-04-16T19:33:19.360107+0000","last_fullsized":"2024-04-16T19:33:19.360107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:34.349862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'9","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379588+0000","last_change":"2024-04-16T17:46:16.500449+0000","last_active":"2024-04-16T19:35:24.379588+0000","last_peered":"2024-04-16T19:35:24.379588+0000","last_clean":"2024-04-16T19:35:24.379588+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:35:24.379588+0000","last_undegraded":"2024-04-16T19:35:24.379588+0000","last_fullsized":"2024-04-16T19:35:24.379588+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368583+0000","last_change":"2024-04-16T17:45:26.430602+0000","last_active":"2024-04-16T19:34:14.368583+0000","last_peered":"2024-04-16T19:34:14.368583+0000","last_clean":"2024-04-16T19:34:14.368583+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:34:14.368583+0000","last_undegraded":"2024-04-16T19:34:14.368583+0000","last_fullsized":"2024-04-16T19:34:14.368583+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:21.500912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.590783+0000","last_change":"2024-04-16T17:45:10.400976+0000","last_active":"2024-04-16T19:37:29.590783+0000","last_peered":"2024-04-16T19:37:29.590783+0000","last_clean":"2024-04-16T19:37:29.590783+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:37:29.590783+0000","last_undegraded":"2024-04-16T19:37:29.590783+0000","last_fullsized":"2024-04-16T19:37:29.590783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374754+0000","last_change":"2024-04-16T17:45:08.388375+0000","last_active":"2024-04-16T19:34:49.374754+0000","last_peered":"2024-04-16T19:34:49.374754+0000","last_clean":"2024-04-16T19:34:49.374754+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:34:49.374754+0000","last_undegraded":"2024-04-16T19:34:49.374754+0000","last_fullsized":"2024-04-16T19:34:49.374754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:23.980045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368590+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:34:09.368590+0000","last_peered":"2024-04-16T19:34:09.368590+0000","last_clean":"2024-04-16T19:34:09.368590+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:34:09.368590+0000","last_undegraded":"2024-04-16T19:34:09.368590+0000","last_fullsized":"2024-04-16T19:34:09.368590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:29.584282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.394003+0000","last_change":"2024-04-16T17:45:22.417279+0000","last_active":"2024-04-16T19:36:34.394003+0000","last_peered":"2024-04-16T19:36:34.394003+0000","last_clean":"2024-04-16T19:36:34.394003+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:36:34.394003+0000","last_undegraded":"2024-04-16T19:36:34.394003+0000","last_fullsized":"2024-04-16T19:36:34.394003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368788+0000","last_change":"2024-04-16T17:45:24.425550+0000","last_active":"2024-04-16T19:34:09.368788+0000","last_peered":"2024-04-16T19:34:09.368788+0000","last_clean":"2024-04-16T19:34:09.368788+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:34:09.368788+0000","last_undegraded":"2024-04-16T19:34:09.368788+0000","last_fullsized":"2024-04-16T19:34:09.368788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:35.470227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588660+0000","last_change":"2024-04-16T18:09:02.170333+0000","last_active":"2024-04-16T19:37:19.588660+0000","last_peered":"2024-04-16T19:37:19.588660+0000","last_clean":"2024-04-16T19:37:19.588660+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:37:19.588660+0000","last_undegraded":"2024-04-16T19:37:19.588660+0000","last_fullsized":"2024-04-16T19:37:19.588660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1987,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382967+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:35:39.382967+0000","last_peered":"2024-04-16T19:35:39.382967+0000","last_clean":"2024-04-16T19:35:39.382967+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:35:39.382967+0000","last_undegraded":"2024-04-16T19:35:39.382967+0000","last_fullsized":"2024-04-16T19:35:39.382967+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:13:06.759819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:46:17.506966+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'7","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.387446+0000","last_change":"2024-04-16T17:45:51.478975+0000","last_active":"2024-04-16T19:35:54.387446+0000","last_peered":"2024-04-16T19:35:54.387446+0000","last_clean":"2024-04-16T19:35:54.387446+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:35:54.387446+0000","last_undegraded":"2024-04-16T19:35:54.387446+0000","last_fullsized":"2024-04-16T19:35:54.387446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359820+0000","last_change":"2024-04-16T17:45:49.473313+0000","last_active":"2024-04-16T19:33:19.359820+0000","last_peered":"2024-04-16T19:33:19.359820+0000","last_clean":"2024-04-16T19:33:19.359820+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:33:19.359820+0000","last_undegraded":"2024-04-16T19:33:19.359820+0000","last_fullsized":"2024-04-16T19:33:19.359820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:50:36.356992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'189","reported_seq":459,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570571+0000","last_change":"2024-04-16T17:45:47.463699+0000","last_active":"2024-04-16T19:35:49.570571+0000","last_peered":"2024-04-16T19:35:49.570571+0000","last_clean":"2024-04-16T19:35:49.570571+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:35:49.570571+0000","last_undegraded":"2024-04-16T19:35:49.570571+0000","last_fullsized":"2024-04-16T19:35:49.570571+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'28","reported_seq":315,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372405+0000","last_change":"2024-04-16T17:45:45.456848+0000","last_active":"2024-04-16T19:34:34.372405+0000","last_peered":"2024-04-16T19:34:34.372405+0000","last_clean":"2024-04-16T19:34:34.372405+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:34:34.372405+0000","last_undegraded":"2024-04-16T19:34:34.372405+0000","last_fullsized":"2024-04-16T19:34:34.372405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:31:38.609449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:26.439840+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.458913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366576+0000","last_change":"2024-04-16T17:45:10.395070+0000","last_active":"2024-04-16T19:33:59.366576+0000","last_peered":"2024-04-16T19:33:59.366576+0000","last_clean":"2024-04-16T19:33:59.366576+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:33:59.366576+0000","last_undegraded":"2024-04-16T19:33:59.366576+0000","last_fullsized":"2024-04-16T19:33:59.366576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:00.458421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.399332+0000","last_change":"2024-04-16T17:45:08.390752+0000","last_active":"2024-04-16T19:37:09.399332+0000","last_peered":"2024-04-16T19:37:09.399332+0000","last_clean":"2024-04-16T19:37:09.399332+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:37:09.399332+0000","last_undegraded":"2024-04-16T19:37:09.399332+0000","last_fullsized":"2024-04-16T19:37:09.399332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"48'17","reported_seq":895,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405226+0000","last_change":"2024-04-16T17:45:20.413278+0000","last_active":"2024-04-16T19:37:44.405226+0000","last_peered":"2024-04-16T19:37:44.405226+0000","last_clean":"2024-04-16T19:37:44.405226+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:37:44.405226+0000","last_undegraded":"2024-04-16T19:37:44.405226+0000","last_fullsized":"2024-04-16T19:37:44.405226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'72","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368021+0000","last_change":"2024-04-16T17:45:22.414776+0000","last_active":"2024-04-16T19:34:09.368021+0000","last_peered":"2024-04-16T19:34:09.368021+0000","last_clean":"2024-04-16T19:34:09.368021+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:34:09.368021+0000","last_undegraded":"2024-04-16T19:34:09.368021+0000","last_fullsized":"2024-04-16T19:34:09.368021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:22.839078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367997+0000","last_change":"2024-04-16T17:45:24.423655+0000","last_active":"2024-04-16T19:34:09.367997+0000","last_peered":"2024-04-16T19:34:09.367997+0000","last_clean":"2024-04-16T19:34:09.367997+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:34:09.367997+0000","last_undegraded":"2024-04-16T19:34:09.367997+0000","last_fullsized":"2024-04-16T19:34:09.367997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:24.311652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366892+0000","last_change":"2024-04-16T18:09:02.164735+0000","last_active":"2024-04-16T19:34:04.366892+0000","last_peered":"2024-04-16T19:34:04.366892+0000","last_clean":"2024-04-16T19:34:04.366892+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:34:04.366892+0000","last_undegraded":"2024-04-16T19:34:04.366892+0000","last_fullsized":"2024-04-16T19:34:04.366892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:53:57.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'228","reported_seq":2121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393114+0000","last_change":"2024-04-16T17:46:25.526441+0000","last_active":"2024-04-16T19:36:29.393114+0000","last_peered":"2024-04-16T19:36:29.393114+0000","last_clean":"2024-04-16T19:36:29.393114+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:36:29.393114+0000","last_undegraded":"2024-04-16T19:36:29.393114+0000","last_fullsized":"2024-04-16T19:36:29.393114+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372528+0000","last_change":"2024-04-16T17:46:17.506064+0000","last_active":"2024-04-16T19:34:39.372528+0000","last_peered":"2024-04-16T19:34:39.372528+0000","last_clean":"2024-04-16T19:34:39.372528+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:34:39.372528+0000","last_undegraded":"2024-04-16T19:34:39.372528+0000","last_fullsized":"2024-04-16T19:34:39.372528+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:04.395735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'7","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368727+0000","last_change":"2024-04-16T17:45:51.480549+0000","last_active":"2024-04-16T19:34:14.368727+0000","last_peered":"2024-04-16T19:34:14.368727+0000","last_clean":"2024-04-16T19:34:14.368727+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:34:14.368727+0000","last_undegraded":"2024-04-16T19:34:14.368727+0000","last_fullsized":"2024-04-16T19:34:14.368727+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:40.864207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.401152+0000","last_change":"2024-04-16T17:45:49.476408+0000","last_active":"2024-04-16T19:37:19.401152+0000","last_peered":"2024-04-16T19:37:19.401152+0000","last_clean":"2024-04-16T19:37:19.401152+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:37:19.401152+0000","last_undegraded":"2024-04-16T19:37:19.401152+0000","last_fullsized":"2024-04-16T19:37:19.401152+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'266","reported_seq":587,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.584435+0000","last_change":"2024-04-16T17:45:47.458082+0000","last_active":"2024-04-16T19:36:59.584435+0000","last_peered":"2024-04-16T19:36:59.584435+0000","last_clean":"2024-04-16T19:36:59.584435+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:36:59.584435+0000","last_undegraded":"2024-04-16T19:36:59.584435+0000","last_fullsized":"2024-04-16T19:36:59.584435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'11","reported_seq":188,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386499+0000","last_change":"2024-04-16T17:45:45.463326+0000","last_active":"2024-04-16T19:35:49.386499+0000","last_peered":"2024-04-16T19:35:49.386499+0000","last_clean":"2024-04-16T19:35:49.386499+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:35:49.386499+0000","last_undegraded":"2024-04-16T19:35:49.386499+0000","last_fullsized":"2024-04-16T19:35:49.386499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407657+0000","last_change":"2024-04-16T17:45:26.438624+0000","last_active":"2024-04-16T19:37:59.407657+0000","last_peered":"2024-04-16T19:37:59.407657+0000","last_clean":"2024-04-16T19:37:59.407657+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:37:59.407657+0000","last_undegraded":"2024-04-16T19:37:59.407657+0000","last_fullsized":"2024-04-16T19:37:59.407657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.392392+0000","last_change":"2024-04-16T17:45:10.398271+0000","last_active":"2024-04-16T19:36:24.392392+0000","last_peered":"2024-04-16T19:36:24.392392+0000","last_clean":"2024-04-16T19:36:24.392392+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:36:24.392392+0000","last_undegraded":"2024-04-16T19:36:24.392392+0000","last_fullsized":"2024-04-16T19:36:24.392392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374677+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:34:49.374677+0000","last_peered":"2024-04-16T19:34:49.374677+0000","last_clean":"2024-04-16T19:34:49.374677+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:34:49.374677+0000","last_undegraded":"2024-04-16T19:34:49.374677+0000","last_fullsized":"2024-04-16T19:34:49.374677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:37.582239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579542+0000","last_change":"2024-04-16T17:45:20.406137+0000","last_active":"2024-04-16T19:36:34.579542+0000","last_peered":"2024-04-16T19:36:34.579542+0000","last_clean":"2024-04-16T19:36:34.579542+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:36:34.579542+0000","last_undegraded":"2024-04-16T19:36:34.579542+0000","last_fullsized":"2024-04-16T19:36:34.579542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'120","reported_seq":295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592694+0000","last_change":"2024-04-16T17:45:22.421567+0000","last_active":"2024-04-16T19:37:39.592694+0000","last_peered":"2024-04-16T19:37:39.592694+0000","last_clean":"2024-04-16T19:37:39.592694+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:37:39.592694+0000","last_undegraded":"2024-04-16T19:37:39.592694+0000","last_fullsized":"2024-04-16T19:37:39.592694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'12","reported_seq":1387,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368244+0000","last_change":"2024-04-16T17:45:24.425583+0000","last_active":"2024-04-16T19:34:09.368244+0000","last_peered":"2024-04-16T19:34:09.368244+0000","last_clean":"2024-04-16T19:34:09.368244+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:34:09.368244+0000","last_undegraded":"2024-04-16T19:34:09.368244+0000","last_fullsized":"2024-04-16T19:34:09.368244+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:56.255636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579535+0000","last_change":"2024-04-16T18:09:02.169752+0000","last_active":"2024-04-16T19:36:34.579535+0000","last_peered":"2024-04-16T19:36:34.579535+0000","last_clean":"2024-04-16T19:36:34.579535+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:36:34.579535+0000","last_undegraded":"2024-04-16T19:36:34.579535+0000","last_fullsized":"2024-04-16T19:36:34.579535+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'151","reported_seq":2295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393145+0000","last_change":"2024-04-16T17:46:25.529267+0000","last_active":"2024-04-16T19:36:29.393145+0000","last_peered":"2024-04-16T19:36:29.393145+0000","last_clean":"2024-04-16T19:36:29.393145+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:36:29.393145+0000","last_undegraded":"2024-04-16T19:36:29.393145+0000","last_fullsized":"2024-04-16T19:36:29.393145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372494+0000","last_change":"2024-04-16T17:46:17.509588+0000","last_active":"2024-04-16T19:34:39.372494+0000","last_peered":"2024-04-16T19:34:39.372494+0000","last_clean":"2024-04-16T19:34:39.372494+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:34:39.372494+0000","last_undegraded":"2024-04-16T19:34:39.372494+0000","last_fullsized":"2024-04-16T19:34:39.372494+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:18:19.084200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'9","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369221+0000","last_change":"2024-04-16T17:45:51.478968+0000","last_active":"2024-04-16T19:34:14.369221+0000","last_peered":"2024-04-16T19:34:14.369221+0000","last_clean":"2024-04-16T19:34:14.369221+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:34:14.369221+0000","last_undegraded":"2024-04-16T19:34:14.369221+0000","last_fullsized":"2024-04-16T19:34:14.369221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.610125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.107369+0000","last_change":"2024-04-16T19:38:09.107389+0000","last_active":"2024-04-16T19:38:09.107369+0000","last_peered":"2024-04-16T19:38:09.107369+0000","last_clean":"2024-04-16T19:38:09.107369+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:38:09.107369+0000","last_undegraded":"2024-04-16T19:38:09.107369+0000","last_fullsized":"2024-04-16T19:38:09.107369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.107315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:06.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5965","reported_seq":12522,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587434+0000","last_change":"2024-04-16T17:45:47.459844+0000","last_active":"2024-04-16T19:37:14.587434+0000","last_peered":"2024-04-16T19:37:14.587434+0000","last_clean":"2024-04-16T19:37:14.587434+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:37:14.587434+0000","last_undegraded":"2024-04-16T19:37:14.587434+0000","last_fullsized":"2024-04-16T19:37:14.587434+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1765,"log_dups_size":3000,"ondisk_log_size":1765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'8","reported_seq":568,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570546+0000","last_change":"2024-04-16T17:45:45.457864+0000","last_active":"2024-04-16T19:35:49.570546+0000","last_peered":"2024-04-16T19:35:49.570546+0000","last_clean":"2024-04-16T19:35:49.570546+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:35:49.570546+0000","last_undegraded":"2024-04-16T19:35:49.570546+0000","last_fullsized":"2024-04-16T19:35:49.570546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380397+0000","last_change":"2024-04-16T17:45:26.848748+0000","last_active":"2024-04-16T19:35:29.380397+0000","last_peered":"2024-04-16T19:35:29.380397+0000","last_clean":"2024-04-16T19:35:29.380397+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:35:29.380397+0000","last_undegraded":"2024-04-16T19:35:29.380397+0000","last_fullsized":"2024-04-16T19:35:29.380397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:47.873610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.392438+0000","last_change":"2024-04-16T17:45:10.391762+0000","last_active":"2024-04-16T19:36:24.392438+0000","last_peered":"2024-04-16T19:36:24.392438+0000","last_clean":"2024-04-16T19:36:24.392438+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:36:24.392438+0000","last_undegraded":"2024-04-16T19:36:24.392438+0000","last_fullsized":"2024-04-16T19:36:24.392438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374595+0000","last_change":"2024-04-16T17:45:08.387257+0000","last_active":"2024-04-16T19:34:49.374595+0000","last_peered":"2024-04-16T19:34:49.374595+0000","last_clean":"2024-04-16T19:34:49.374595+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:34:49.374595+0000","last_undegraded":"2024-04-16T19:34:49.374595+0000","last_fullsized":"2024-04-16T19:34:49.374595+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"48'1","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368272+0000","last_change":"2024-04-16T17:45:20.405143+0000","last_active":"2024-04-16T19:34:09.368272+0000","last_peered":"2024-04-16T19:34:09.368272+0000","last_clean":"2024-04-16T19:34:09.368272+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:34:09.368272+0000","last_undegraded":"2024-04-16T19:34:09.368272+0000","last_fullsized":"2024-04-16T19:34:09.368272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:09.457037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368233+0000","last_change":"2024-04-16T17:45:22.421942+0000","last_active":"2024-04-16T19:34:09.368233+0000","last_peered":"2024-04-16T19:34:09.368233+0000","last_clean":"2024-04-16T19:34:09.368233+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:34:09.368233+0000","last_undegraded":"2024-04-16T19:34:09.368233+0000","last_fullsized":"2024-04-16T19:34:09.368233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:15.139787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'12","reported_seq":1390,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592709+0000","last_change":"2024-04-16T17:45:24.424033+0000","last_active":"2024-04-16T19:37:39.592709+0000","last_peered":"2024-04-16T19:37:39.592709+0000","last_clean":"2024-04-16T19:37:39.592709+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:37:39.592709+0000","last_undegraded":"2024-04-16T19:37:39.592709+0000","last_fullsized":"2024-04-16T19:37:39.592709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370952+0000","last_change":"2024-04-16T18:09:02.168123+0000","last_active":"2024-04-16T19:34:29.370952+0000","last_peered":"2024-04-16T19:34:29.370952+0000","last_clean":"2024-04-16T19:34:29.370952+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:34:29.370952+0000","last_undegraded":"2024-04-16T19:34:29.370952+0000","last_fullsized":"2024-04-16T19:34:29.370952+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:45:02.737644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374715+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:34:49.374715+0000","last_peered":"2024-04-16T19:34:49.374715+0000","last_clean":"2024-04-16T19:34:49.374715+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:34:49.374715+0000","last_undegraded":"2024-04-16T19:34:49.374715+0000","last_fullsized":"2024-04-16T19:34:49.374715+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:18:49.538603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373127+0000","last_change":"2024-04-16T17:46:17.508941+0000","last_active":"2024-04-16T19:34:39.373127+0000","last_peered":"2024-04-16T19:34:39.373127+0000","last_clean":"2024-04-16T19:34:39.373127+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:34:39.373127+0000","last_undegraded":"2024-04-16T19:34:39.373127+0000","last_fullsized":"2024-04-16T19:34:39.373127+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:55.108482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'11","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368550+0000","last_change":"2024-04-16T17:45:51.478686+0000","last_active":"2024-04-16T19:34:14.368550+0000","last_peered":"2024-04-16T19:34:14.368550+0000","last_clean":"2024-04-16T19:34:14.368550+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:34:14.368550+0000","last_undegraded":"2024-04-16T19:34:14.368550+0000","last_fullsized":"2024-04-16T19:34:14.368550+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:45.109744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368764+0000","last_change":"2024-04-16T17:45:49.469263+0000","last_active":"2024-04-16T19:34:09.368764+0000","last_peered":"2024-04-16T19:34:09.368764+0000","last_clean":"2024-04-16T19:34:09.368764+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:34:09.368764+0000","last_undegraded":"2024-04-16T19:34:09.368764+0000","last_fullsized":"2024-04-16T19:34:09.368764+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:05.755199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1575","reported_seq":46963,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368707+0000","last_change":"2024-04-16T17:45:47.466556+0000","last_active":"2024-04-16T19:34:09.368707+0000","last_peered":"2024-04-16T19:34:09.368707+0000","last_clean":"2024-04-16T19:34:09.368707+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:34:09.368707+0000","last_undegraded":"2024-04-16T19:34:09.368707+0000","last_fullsized":"2024-04-16T19:34:09.368707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1575,"log_dups_size":0,"ondisk_log_size":1575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:29.536656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'6","reported_seq":222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.393956+0000","last_change":"2024-04-16T17:45:45.466165+0000","last_active":"2024-04-16T19:36:34.393956+0000","last_peered":"2024-04-16T19:36:34.393956+0000","last_clean":"2024-04-16T19:36:34.393956+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:36:34.393956+0000","last_undegraded":"2024-04-16T19:36:34.393956+0000","last_fullsized":"2024-04-16T19:36:34.393956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383551+0000","last_change":"2024-04-16T17:45:10.393324+0000","last_active":"2024-04-16T19:35:44.383551+0000","last_peered":"2024-04-16T19:35:44.383551+0000","last_clean":"2024-04-16T19:35:44.383551+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:35:44.383551+0000","last_undegraded":"2024-04-16T19:35:44.383551+0000","last_fullsized":"2024-04-16T19:35:44.383551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:27.696868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383794+0000","last_change":"2024-04-16T17:45:08.389843+0000","last_active":"2024-04-16T19:35:44.383794+0000","last_peered":"2024-04-16T19:35:44.383794+0000","last_clean":"2024-04-16T19:35:44.383794+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:35:44.383794+0000","last_undegraded":"2024-04-16T19:35:44.383794+0000","last_fullsized":"2024-04-16T19:35:44.383794+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"48'5","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385115+0000","last_change":"2024-04-16T17:45:20.407401+0000","last_active":"2024-04-16T19:35:54.385115+0000","last_peered":"2024-04-16T19:35:54.385115+0000","last_clean":"2024-04-16T19:35:54.385115+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:35:54.385115+0000","last_undegraded":"2024-04-16T19:35:54.385115+0000","last_fullsized":"2024-04-16T19:35:54.385115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:50.080567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'200","reported_seq":422,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367499+0000","last_change":"2024-04-16T17:45:22.417459+0000","last_active":"2024-04-16T19:34:04.367499+0000","last_peered":"2024-04-16T19:34:04.367499+0000","last_clean":"2024-04-16T19:34:04.367499+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:34:04.367499+0000","last_undegraded":"2024-04-16T19:34:04.367499+0000","last_fullsized":"2024-04-16T19:34:04.367499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:29.145127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595769+0000","last_change":"2024-04-16T17:45:24.430630+0000","last_active":"2024-04-16T19:37:54.595769+0000","last_peered":"2024-04-16T19:37:54.595769+0000","last_clean":"2024-04-16T19:37:54.595769+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:37:54.595769+0000","last_undegraded":"2024-04-16T19:37:54.595769+0000","last_fullsized":"2024-04-16T19:37:54.595769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385225+0000","last_change":"2024-04-16T17:45:26.438929+0000","last_active":"2024-04-16T19:35:54.385225+0000","last_peered":"2024-04-16T19:35:54.385225+0000","last_clean":"2024-04-16T19:35:54.385225+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:35:54.385225+0000","last_undegraded":"2024-04-16T19:35:54.385225+0000","last_fullsized":"2024-04-16T19:35:54.385225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:58.263370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579395+0000","last_change":"2024-04-16T18:09:02.169539+0000","last_active":"2024-04-16T19:36:34.579395+0000","last_peered":"2024-04-16T19:36:34.579395+0000","last_clean":"2024-04-16T19:36:34.579395+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:36:34.579395+0000","last_undegraded":"2024-04-16T19:36:34.579395+0000","last_fullsized":"2024-04-16T19:36:34.579395+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1473,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.397060+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:36:54.397060+0000","last_peered":"2024-04-16T19:36:54.397060+0000","last_clean":"2024-04-16T19:36:54.397060+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:36:54.397060+0000","last_undegraded":"2024-04-16T19:36:54.397060+0000","last_fullsized":"2024-04-16T19:36:54.397060+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373066+0000","last_change":"2024-04-16T17:46:17.512578+0000","last_active":"2024-04-16T19:34:39.373066+0000","last_peered":"2024-04-16T19:34:39.373066+0000","last_clean":"2024-04-16T19:34:39.373066+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:34:39.373066+0000","last_undegraded":"2024-04-16T19:34:39.373066+0000","last_fullsized":"2024-04-16T19:34:39.373066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"48'3","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.368951+0000","last_change":"2024-04-16T17:45:51.480862+0000","last_active":"2024-04-16T19:34:14.368951+0000","last_peered":"2024-04-16T19:34:14.368951+0000","last_clean":"2024-04-16T19:34:14.368951+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:34:14.368951+0000","last_undegraded":"2024-04-16T19:34:14.368951+0000","last_fullsized":"2024-04-16T19:34:14.368951+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:46:04.680783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":96,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391452+0000","last_change":"2024-04-16T17:45:49.473179+0000","last_active":"2024-04-16T19:36:19.391452+0000","last_peered":"2024-04-16T19:36:19.391452+0000","last_clean":"2024-04-16T19:36:19.391452+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:36:19.391452+0000","last_undegraded":"2024-04-16T19:36:19.391452+0000","last_fullsized":"2024-04-16T19:36:19.391452+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'338","reported_seq":637,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368333+0000","last_change":"2024-04-16T17:45:47.458262+0000","last_active":"2024-04-16T19:34:09.368333+0000","last_peered":"2024-04-16T19:34:09.368333+0000","last_clean":"2024-04-16T19:34:09.368333+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:34:09.368333+0000","last_undegraded":"2024-04-16T19:34:09.368333+0000","last_fullsized":"2024-04-16T19:34:09.368333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:16:56.475222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'19","reported_seq":603,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.829499+0000","last_change":"2024-04-16T19:38:08.829535+0000","last_active":"2024-04-16T19:38:08.829499+0000","last_peered":"2024-04-16T19:38:08.829499+0000","last_clean":"2024-04-16T19:38:08.829499+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:38:08.829499+0000","last_undegraded":"2024-04-16T19:38:08.829499+0000","last_fullsized":"2024-04-16T19:38:08.829499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'19","last_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_deep_scrub":"53'19","last_deep_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.829450+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:30.796211+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.382936+0000","last_change":"2024-04-16T17:45:10.402167+0000","last_active":"2024-04-16T19:35:44.382936+0000","last_peered":"2024-04-16T19:35:44.382936+0000","last_clean":"2024-04-16T19:35:44.382936+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:35:44.382936+0000","last_undegraded":"2024-04-16T19:35:44.382936+0000","last_fullsized":"2024-04-16T19:35:44.382936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:38.623160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380567+0000","last_change":"2024-04-16T17:45:08.388824+0000","last_active":"2024-04-16T19:35:24.380567+0000","last_peered":"2024-04-16T19:35:24.380567+0000","last_clean":"2024-04-16T19:35:24.380567+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:35:24.380567+0000","last_undegraded":"2024-04-16T19:35:24.380567+0000","last_fullsized":"2024-04-16T19:35:24.380567+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:03:22.030186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597777+0000","last_change":"2024-04-16T17:45:20.407298+0000","last_active":"2024-04-16T19:38:04.597777+0000","last_peered":"2024-04-16T19:38:04.597777+0000","last_clean":"2024-04-16T19:38:04.597777+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:38:04.597777+0000","last_undegraded":"2024-04-16T19:38:04.597777+0000","last_fullsized":"2024-04-16T19:38:04.597777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'80","reported_seq":242,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595753+0000","last_change":"2024-04-16T17:45:22.422669+0000","last_active":"2024-04-16T19:37:54.595753+0000","last_peered":"2024-04-16T19:37:54.595753+0000","last_clean":"2024-04-16T19:37:54.595753+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:37:54.595753+0000","last_undegraded":"2024-04-16T19:37:54.595753+0000","last_fullsized":"2024-04-16T19:37:54.595753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.574433+0000","last_change":"2024-04-16T17:45:24.425962+0000","last_active":"2024-04-16T19:36:09.574433+0000","last_peered":"2024-04-16T19:36:09.574433+0000","last_clean":"2024-04-16T19:36:09.574433+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:36:09.574433+0000","last_undegraded":"2024-04-16T19:36:09.574433+0000","last_fullsized":"2024-04-16T19:36:09.574433+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367958+0000","last_change":"2024-04-16T17:45:26.429668+0000","last_active":"2024-04-16T19:34:09.367958+0000","last_peered":"2024-04-16T19:34:09.367958+0000","last_clean":"2024-04-16T19:34:09.367958+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:34:09.367958+0000","last_undegraded":"2024-04-16T19:34:09.367958+0000","last_fullsized":"2024-04-16T19:34:09.367958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:33.160271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371461+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:34:29.371461+0000","last_peered":"2024-04-16T19:34:29.371461+0000","last_clean":"2024-04-16T19:34:29.371461+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:34:29.371461+0000","last_undegraded":"2024-04-16T19:34:29.371461+0000","last_fullsized":"2024-04-16T19:34:29.371461+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'120","reported_seq":2586,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.581384+0000","last_change":"2024-04-16T17:46:25.531706+0000","last_active":"2024-04-16T19:36:44.581384+0000","last_peered":"2024-04-16T19:36:44.581384+0000","last_clean":"2024-04-16T19:36:44.581384+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:36:44.581384+0000","last_undegraded":"2024-04-16T19:36:44.581384+0000","last_fullsized":"2024-04-16T19:36:44.581384+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395650+0000","last_change":"2024-04-16T17:46:17.508571+0000","last_active":"2024-04-16T19:36:44.395650+0000","last_peered":"2024-04-16T19:36:44.395650+0000","last_clean":"2024-04-16T19:36:44.395650+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:36:44.395650+0000","last_undegraded":"2024-04-16T19:36:44.395650+0000","last_fullsized":"2024-04-16T19:36:44.395650+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'18","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369024+0000","last_change":"2024-04-16T17:45:51.479804+0000","last_active":"2024-04-16T19:34:14.369024+0000","last_peered":"2024-04-16T19:34:14.369024+0000","last_clean":"2024-04-16T19:34:14.369024+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:34:14.369024+0000","last_undegraded":"2024-04-16T19:34:14.369024+0000","last_fullsized":"2024-04-16T19:34:14.369024+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:03:04.068785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370998+0000","last_change":"2024-04-16T17:45:49.471470+0000","last_active":"2024-04-16T19:34:29.370998+0000","last_peered":"2024-04-16T19:34:29.370998+0000","last_clean":"2024-04-16T19:34:29.370998+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:34:29.370998+0000","last_undegraded":"2024-04-16T19:34:29.370998+0000","last_fullsized":"2024-04-16T19:34:29.370998+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:17:24.434279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'907","reported_seq":3799,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.390538+0000","last_change":"2024-04-16T17:45:47.466560+0000","last_active":"2024-04-16T19:36:14.390538+0000","last_peered":"2024-04-16T19:36:14.390538+0000","last_clean":"2024-04-16T19:36:14.390538+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:36:14.390538+0000","last_undegraded":"2024-04-16T19:36:14.390538+0000","last_fullsized":"2024-04-16T19:36:14.390538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":907,"log_dups_size":0,"ondisk_log_size":907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'18","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368748+0000","last_change":"2024-04-16T17:45:45.464240+0000","last_active":"2024-04-16T19:34:09.368748+0000","last_peered":"2024-04-16T19:34:09.368748+0000","last_clean":"2024-04-16T19:34:09.368748+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:34:09.368748+0000","last_undegraded":"2024-04-16T19:34:09.368748+0000","last_fullsized":"2024-04-16T19:34:09.368748+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:26.089403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365646+0000","last_change":"2024-04-16T17:45:10.394156+0000","last_active":"2024-04-16T19:33:54.365646+0000","last_peered":"2024-04-16T19:33:54.365646+0000","last_clean":"2024-04-16T19:33:54.365646+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:33:54.365646+0000","last_undegraded":"2024-04-16T19:33:54.365646+0000","last_fullsized":"2024-04-16T19:33:54.365646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:04.267541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579591+0000","last_change":"2024-04-16T17:46:16.499439+0000","last_active":"2024-04-16T19:36:34.579591+0000","last_peered":"2024-04-16T19:36:34.579591+0000","last_clean":"2024-04-16T19:36:34.579591+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:36:34.579591+0000","last_undegraded":"2024-04-16T19:36:34.579591+0000","last_fullsized":"2024-04-16T19:36:34.579591+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595764+0000","last_change":"2024-04-16T17:45:20.408040+0000","last_active":"2024-04-16T19:37:54.595764+0000","last_peered":"2024-04-16T19:37:54.595764+0000","last_clean":"2024-04-16T19:37:54.595764+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:37:54.595764+0000","last_undegraded":"2024-04-16T19:37:54.595764+0000","last_fullsized":"2024-04-16T19:37:54.595764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'152","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385171+0000","last_change":"2024-04-16T17:45:22.415394+0000","last_active":"2024-04-16T19:35:54.385171+0000","last_peered":"2024-04-16T19:35:54.385171+0000","last_clean":"2024-04-16T19:35:54.385171+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:35:54.385171+0000","last_undegraded":"2024-04-16T19:35:54.385171+0000","last_fullsized":"2024-04-16T19:35:54.385171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:05:27.274896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'12","reported_seq":1394,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408525+0000","last_change":"2024-04-16T17:45:24.424024+0000","last_active":"2024-04-16T19:38:04.408525+0000","last_peered":"2024-04-16T19:38:04.408525+0000","last_clean":"2024-04-16T19:38:04.408525+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:38:04.408525+0000","last_undegraded":"2024-04-16T19:38:04.408525+0000","last_fullsized":"2024-04-16T19:38:04.408525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069229+0000","last_change":"2024-04-16T17:45:26.438562+0000","last_active":"2024-04-16T19:38:08.069229+0000","last_peered":"2024-04-16T19:38:08.069229+0000","last_clean":"2024-04-16T19:38:08.069229+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:38:08.069229+0000","last_undegraded":"2024-04-16T19:38:08.069229+0000","last_fullsized":"2024-04-16T19:38:08.069229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588489+0000","last_change":"2024-04-16T18:09:02.168408+0000","last_active":"2024-04-16T19:37:19.588489+0000","last_peered":"2024-04-16T19:37:19.588489+0000","last_clean":"2024-04-16T19:37:19.588489+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:37:19.588489+0000","last_undegraded":"2024-04-16T19:37:19.588489+0000","last_fullsized":"2024-04-16T19:37:19.588489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'164","reported_seq":2349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583511+0000","last_change":"2024-04-16T17:46:25.526845+0000","last_active":"2024-04-16T19:36:54.583511+0000","last_peered":"2024-04-16T19:36:54.583511+0000","last_clean":"2024-04-16T19:36:54.583511+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:36:54.583511+0000","last_undegraded":"2024-04-16T19:36:54.583511+0000","last_fullsized":"2024-04-16T19:36:54.583511+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373289+0000","last_change":"2024-04-16T17:46:17.504931+0000","last_active":"2024-04-16T19:34:39.373289+0000","last_peered":"2024-04-16T19:34:39.373289+0000","last_clean":"2024-04-16T19:34:39.373289+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:34:39.373289+0000","last_undegraded":"2024-04-16T19:34:39.373289+0000","last_fullsized":"2024-04-16T19:34:39.373289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:46.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'19","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391339+0000","last_change":"2024-04-16T17:45:51.481046+0000","last_active":"2024-04-16T19:36:19.391339+0000","last_peered":"2024-04-16T19:36:19.391339+0000","last_clean":"2024-04-16T19:36:19.391339+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:36:19.391339+0000","last_undegraded":"2024-04-16T19:36:19.391339+0000","last_fullsized":"2024-04-16T19:36:19.391339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368525+0000","last_change":"2024-04-16T17:45:49.473468+0000","last_active":"2024-04-16T19:34:09.368525+0000","last_peered":"2024-04-16T19:34:09.368525+0000","last_clean":"2024-04-16T19:34:09.368525+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:34:09.368525+0000","last_undegraded":"2024-04-16T19:34:09.368525+0000","last_fullsized":"2024-04-16T19:34:09.368525+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:38.069196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'592","reported_seq":3226,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.578536+0000","last_change":"2024-04-16T17:45:47.465484+0000","last_active":"2024-04-16T19:36:29.578536+0000","last_peered":"2024-04-16T19:36:29.578536+0000","last_clean":"2024-04-16T19:36:29.578536+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:36:29.578536+0000","last_undegraded":"2024-04-16T19:36:29.578536+0000","last_fullsized":"2024-04-16T19:36:29.578536+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'23","reported_seq":340,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368689+0000","last_change":"2024-04-16T17:45:45.460199+0000","last_active":"2024-04-16T19:34:09.368689+0000","last_peered":"2024-04-16T19:34:09.368689+0000","last_clean":"2024-04-16T19:34:09.368689+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:34:09.368689+0000","last_undegraded":"2024-04-16T19:34:09.368689+0000","last_fullsized":"2024-04-16T19:34:09.368689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:30.407609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405163+0000","last_change":"2024-04-16T17:45:10.392991+0000","last_active":"2024-04-16T19:37:44.405163+0000","last_peered":"2024-04-16T19:37:44.405163+0000","last_clean":"2024-04-16T19:37:44.405163+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:37:44.405163+0000","last_undegraded":"2024-04-16T19:37:44.405163+0000","last_fullsized":"2024-04-16T19:37:44.405163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380477+0000","last_change":"2024-04-16T17:45:08.387422+0000","last_active":"2024-04-16T19:35:24.380477+0000","last_peered":"2024-04-16T19:35:24.380477+0000","last_clean":"2024-04-16T19:35:24.380477+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:35:24.380477+0000","last_undegraded":"2024-04-16T19:35:24.380477+0000","last_fullsized":"2024-04-16T19:35:24.380477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"48'3","reported_seq":183,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.574393+0000","last_change":"2024-04-16T17:45:20.412558+0000","last_active":"2024-04-16T19:36:09.574393+0000","last_peered":"2024-04-16T19:36:09.574393+0000","last_clean":"2024-04-16T19:36:09.574393+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:36:09.574393+0000","last_undegraded":"2024-04-16T19:36:09.574393+0000","last_fullsized":"2024-04-16T19:36:09.574393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'88","reported_seq":261,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408498+0000","last_change":"2024-04-16T17:45:22.414488+0000","last_active":"2024-04-16T19:38:04.408498+0000","last_peered":"2024-04-16T19:38:04.408498+0000","last_clean":"2024-04-16T19:38:04.408498+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:38:04.408498+0000","last_undegraded":"2024-04-16T19:38:04.408498+0000","last_fullsized":"2024-04-16T19:38:04.408498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597809+0000","last_change":"2024-04-16T17:45:24.422626+0000","last_active":"2024-04-16T19:38:04.597809+0000","last_peered":"2024-04-16T19:38:04.597809+0000","last_clean":"2024-04-16T19:38:04.597809+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:38:04.597809+0000","last_undegraded":"2024-04-16T19:38:04.597809+0000","last_fullsized":"2024-04-16T19:38:04.597809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524063+0000","last_change":"2024-04-16T17:45:26.438504+0000","last_active":"2024-04-16T19:38:08.524063+0000","last_peered":"2024-04-16T19:38:08.524063+0000","last_clean":"2024-04-16T19:38:08.524063+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:38:08.524063+0000","last_undegraded":"2024-04-16T19:38:08.524063+0000","last_fullsized":"2024-04-16T19:38:08.524063+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596023+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:37:54.596023+0000","last_peered":"2024-04-16T19:37:54.596023+0000","last_clean":"2024-04-16T19:37:54.596023+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:37:54.596023+0000","last_undegraded":"2024-04-16T19:37:54.596023+0000","last_fullsized":"2024-04-16T19:37:54.596023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'131","reported_seq":1906,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.397930+0000","last_change":"2024-04-16T17:46:25.527139+0000","last_active":"2024-04-16T19:36:59.397930+0000","last_peered":"2024-04-16T19:36:59.397930+0000","last_clean":"2024-04-16T19:36:59.397930+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:36:59.397930+0000","last_undegraded":"2024-04-16T19:36:59.397930+0000","last_fullsized":"2024-04-16T19:36:59.397930+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:59.375692+0000","last_change":"2024-04-16T17:46:17.507808+0000","last_active":"2024-04-16T19:34:59.375692+0000","last_peered":"2024-04-16T19:34:59.375692+0000","last_clean":"2024-04-16T19:34:59.375692+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:34:59.375692+0000","last_undegraded":"2024-04-16T19:34:59.375692+0000","last_fullsized":"2024-04-16T19:34:59.375692+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:54.705447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'10","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369417+0000","last_change":"2024-04-16T17:45:51.480080+0000","last_active":"2024-04-16T19:34:14.369417+0000","last_peered":"2024-04-16T19:34:14.369417+0000","last_clean":"2024-04-16T19:34:14.369417+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:34:14.369417+0000","last_undegraded":"2024-04-16T19:34:14.369417+0000","last_fullsized":"2024-04-16T19:34:14.369417+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:32.349071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'651","reported_seq":2203,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368151+0000","last_change":"2024-04-16T17:45:49.472107+0000","last_active":"2024-04-16T19:34:09.368151+0000","last_peered":"2024-04-16T19:34:09.368151+0000","last_clean":"2024-04-16T19:34:09.368151+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:34:09.368151+0000","last_undegraded":"2024-04-16T19:34:09.368151+0000","last_fullsized":"2024-04-16T19:34:09.368151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:10.741937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'306","reported_seq":577,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575372+0000","last_change":"2024-04-16T17:45:47.460175+0000","last_active":"2024-04-16T19:36:14.575372+0000","last_peered":"2024-04-16T19:36:14.575372+0000","last_clean":"2024-04-16T19:36:14.575372+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:36:14.575372+0000","last_undegraded":"2024-04-16T19:36:14.575372+0000","last_fullsized":"2024-04-16T19:36:14.575372+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'6","reported_seq":542,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.390460+0000","last_change":"2024-04-16T17:45:45.468347+0000","last_active":"2024-04-16T19:36:14.390460+0000","last_peered":"2024-04-16T19:36:14.390460+0000","last_clean":"2024-04-16T19:36:14.390460+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:36:14.390460+0000","last_undegraded":"2024-04-16T19:36:14.390460+0000","last_fullsized":"2024-04-16T19:36:14.390460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380444+0000","last_change":"2024-04-16T17:45:10.402046+0000","last_active":"2024-04-16T19:35:29.380444+0000","last_peered":"2024-04-16T19:35:29.380444+0000","last_clean":"2024-04-16T19:35:29.380444+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:35:29.380444+0000","last_undegraded":"2024-04-16T19:35:29.380444+0000","last_fullsized":"2024-04-16T19:35:29.380444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:43:06.736546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592657+0000","last_change":"2024-04-16T17:45:08.384395+0000","last_active":"2024-04-16T19:37:39.592657+0000","last_peered":"2024-04-16T19:37:39.592657+0000","last_clean":"2024-04-16T19:37:39.592657+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:37:39.592657+0000","last_undegraded":"2024-04-16T19:37:39.592657+0000","last_fullsized":"2024-04-16T19:37:39.592657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"30'3","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595823+0000","last_change":"2024-04-16T17:45:20.406255+0000","last_active":"2024-04-16T19:37:54.595823+0000","last_peered":"2024-04-16T19:37:54.595823+0000","last_clean":"2024-04-16T19:37:54.595823+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:37:54.595823+0000","last_undegraded":"2024-04-16T19:37:54.595823+0000","last_fullsized":"2024-04-16T19:37:54.595823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'104","reported_seq":277,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382359+0000","last_change":"2024-04-16T17:45:22.416167+0000","last_active":"2024-04-16T19:35:39.382359+0000","last_peered":"2024-04-16T19:35:39.382359+0000","last_clean":"2024-04-16T19:35:39.382359+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:35:39.382359+0000","last_undegraded":"2024-04-16T19:35:39.382359+0000","last_fullsized":"2024-04-16T19:35:39.382359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:08.259967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.388245+0000","last_change":"2024-04-16T17:45:24.422761+0000","last_active":"2024-04-16T19:35:59.388245+0000","last_peered":"2024-04-16T19:35:59.388245+0000","last_clean":"2024-04-16T19:35:59.388245+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:35:59.388245+0000","last_undegraded":"2024-04-16T19:35:59.388245+0000","last_fullsized":"2024-04-16T19:35:59.388245+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593546+0000","last_change":"2024-04-16T17:45:26.433444+0000","last_active":"2024-04-16T19:37:44.593546+0000","last_peered":"2024-04-16T19:37:44.593546+0000","last_clean":"2024-04-16T19:37:44.593546+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:37:44.593546+0000","last_undegraded":"2024-04-16T19:37:44.593546+0000","last_fullsized":"2024-04-16T19:37:44.593546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407078+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:37:54.407078+0000","last_peered":"2024-04-16T19:37:54.407078+0000","last_clean":"2024-04-16T19:37:54.407078+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:37:54.407078+0000","last_undegraded":"2024-04-16T19:37:54.407078+0000","last_fullsized":"2024-04-16T19:37:54.407078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'156","reported_seq":2122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374807+0000","last_change":"2024-04-16T17:46:25.522062+0000","last_active":"2024-04-16T19:34:49.374807+0000","last_peered":"2024-04-16T19:34:49.374807+0000","last_clean":"2024-04-16T19:34:49.374807+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:34:49.374807+0000","last_undegraded":"2024-04-16T19:34:49.374807+0000","last_fullsized":"2024-04-16T19:34:49.374807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:10:38.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":85,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373333+0000","last_change":"2024-04-16T17:46:17.511574+0000","last_active":"2024-04-16T19:34:39.373333+0000","last_peered":"2024-04-16T19:34:39.373333+0000","last_clean":"2024-04-16T19:34:39.373333+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:34:39.373333+0000","last_undegraded":"2024-04-16T19:34:39.373333+0000","last_fullsized":"2024-04-16T19:34:39.373333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:51.160843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'144","reported_seq":327,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372456+0000","last_change":"2024-04-16T17:45:51.478987+0000","last_active":"2024-04-16T19:34:34.372456+0000","last_peered":"2024-04-16T19:34:34.372456+0000","last_clean":"2024-04-16T19:34:34.372456+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:34:34.372456+0000","last_undegraded":"2024-04-16T19:34:34.372456+0000","last_fullsized":"2024-04-16T19:34:34.372456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:03:26.313448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575397+0000","last_change":"2024-04-16T17:45:49.467901+0000","last_active":"2024-04-16T19:36:14.575397+0000","last_peered":"2024-04-16T19:36:14.575397+0000","last_clean":"2024-04-16T19:36:14.575397+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:36:14.575397+0000","last_undegraded":"2024-04-16T19:36:14.575397+0000","last_fullsized":"2024-04-16T19:36:14.575397+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'820","reported_seq":1800,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575472+0000","last_change":"2024-04-16T17:45:47.465634+0000","last_active":"2024-04-16T19:36:14.575472+0000","last_peered":"2024-04-16T19:36:14.575472+0000","last_clean":"2024-04-16T19:36:14.575472+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:36:14.575472+0000","last_undegraded":"2024-04-16T19:36:14.575472+0000","last_fullsized":"2024-04-16T19:36:14.575472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'4","reported_seq":271,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597807+0000","last_change":"2024-04-16T17:45:45.460111+0000","last_active":"2024-04-16T19:38:04.597807+0000","last_peered":"2024-04-16T19:38:04.597807+0000","last_clean":"2024-04-16T19:38:04.597807+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:38:04.597807+0000","last_undegraded":"2024-04-16T19:38:04.597807+0000","last_fullsized":"2024-04-16T19:38:04.597807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381397+0000","last_change":"2024-04-16T17:45:10.387439+0000","last_active":"2024-04-16T19:35:29.381397+0000","last_peered":"2024-04-16T19:35:29.381397+0000","last_clean":"2024-04-16T19:35:29.381397+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:35:29.381397+0000","last_undegraded":"2024-04-16T19:35:29.381397+0000","last_fullsized":"2024-04-16T19:35:29.381397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:19.082808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.385992+0000","last_change":"2024-04-16T17:45:08.386819+0000","last_active":"2024-04-16T19:35:59.385992+0000","last_peered":"2024-04-16T19:35:59.385992+0000","last_clean":"2024-04-16T19:35:59.385992+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:35:59.385992+0000","last_undegraded":"2024-04-16T19:35:59.385992+0000","last_fullsized":"2024-04-16T19:35:59.385992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:35:53.711477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"48'13","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595838+0000","last_change":"2024-04-16T17:45:20.413420+0000","last_active":"2024-04-16T19:37:54.595838+0000","last_peered":"2024-04-16T19:37:54.595838+0000","last_clean":"2024-04-16T19:37:54.595838+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:37:54.595838+0000","last_undegraded":"2024-04-16T19:37:54.595838+0000","last_fullsized":"2024-04-16T19:37:54.595838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'152","reported_seq":350,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976594+0000","last_change":"2024-04-16T17:45:22.414344+0000","last_active":"2024-04-16T19:38:08.976594+0000","last_peered":"2024-04-16T19:38:08.976594+0000","last_clean":"2024-04-16T19:38:08.976594+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:38:08.976594+0000","last_undegraded":"2024-04-16T19:38:08.976594+0000","last_fullsized":"2024-04-16T19:38:08.976594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'12","reported_seq":1392,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595871+0000","last_change":"2024-04-16T17:45:24.430890+0000","last_active":"2024-04-16T19:37:54.595871+0000","last_peered":"2024-04-16T19:37:54.595871+0000","last_clean":"2024-04-16T19:37:54.595871+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:37:54.595871+0000","last_undegraded":"2024-04-16T19:37:54.595871+0000","last_fullsized":"2024-04-16T19:37:54.595871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596765+0000","last_change":"2024-04-16T17:45:26.428823+0000","last_active":"2024-04-16T19:37:59.596765+0000","last_peered":"2024-04-16T19:37:59.596765+0000","last_clean":"2024-04-16T19:37:59.596765+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:37:59.596765+0000","last_undegraded":"2024-04-16T19:37:59.596765+0000","last_fullsized":"2024-04-16T19:37:59.596765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373933+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:34:44.373933+0000","last_peered":"2024-04-16T19:34:44.373933+0000","last_clean":"2024-04-16T19:34:44.373933+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:34:44.373933+0000","last_undegraded":"2024-04-16T19:34:44.373933+0000","last_fullsized":"2024-04-16T19:34:44.373933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:19:08.722479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'84","reported_seq":1607,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374780+0000","last_change":"2024-04-16T17:46:25.527208+0000","last_active":"2024-04-16T19:34:49.374780+0000","last_peered":"2024-04-16T19:34:49.374780+0000","last_clean":"2024-04-16T19:34:49.374780+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:34:49.374780+0000","last_undegraded":"2024-04-16T19:34:49.374780+0000","last_fullsized":"2024-04-16T19:34:49.374780+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:41:39.607096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373249+0000","last_change":"2024-04-16T17:46:17.513992+0000","last_active":"2024-04-16T19:34:39.373249+0000","last_peered":"2024-04-16T19:34:39.373249+0000","last_clean":"2024-04-16T19:34:39.373249+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:34:39.373249+0000","last_undegraded":"2024-04-16T19:34:39.373249+0000","last_fullsized":"2024-04-16T19:34:39.373249+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'17","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577560+0000","last_change":"2024-04-16T17:45:51.480268+0000","last_active":"2024-04-16T19:36:24.577560+0000","last_peered":"2024-04-16T19:36:24.577560+0000","last_clean":"2024-04-16T19:36:24.577560+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:36:24.577560+0000","last_undegraded":"2024-04-16T19:36:24.577560+0000","last_fullsized":"2024-04-16T19:36:24.577560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367826+0000","last_change":"2024-04-16T17:45:49.472397+0000","last_active":"2024-04-16T19:34:09.367826+0000","last_peered":"2024-04-16T19:34:09.367826+0000","last_clean":"2024-04-16T19:34:09.367826+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:34:09.367826+0000","last_undegraded":"2024-04-16T19:34:09.367826+0000","last_fullsized":"2024-04-16T19:34:09.367826+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:02.894263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'526","reported_seq":908,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.387282+0000","last_change":"2024-04-16T17:45:47.465575+0000","last_active":"2024-04-16T19:36:09.387282+0000","last_peered":"2024-04-16T19:36:09.387282+0000","last_clean":"2024-04-16T19:36:09.387282+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:36:09.387282+0000","last_undegraded":"2024-04-16T19:36:09.387282+0000","last_fullsized":"2024-04-16T19:36:09.387282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:42.534287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'10","reported_seq":383,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368166+0000","last_change":"2024-04-16T17:45:45.461495+0000","last_active":"2024-04-16T19:34:09.368166+0000","last_peered":"2024-04-16T19:34:09.368166+0000","last_clean":"2024-04-16T19:34:09.368166+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:34:09.368166+0000","last_undegraded":"2024-04-16T19:34:09.368166+0000","last_fullsized":"2024-04-16T19:34:09.368166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:50:23.315560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380526+0000","last_change":"2024-04-16T17:45:10.394926+0000","last_active":"2024-04-16T19:35:29.380526+0000","last_peered":"2024-04-16T19:35:29.380526+0000","last_clean":"2024-04-16T19:35:29.380526+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:35:29.380526+0000","last_undegraded":"2024-04-16T19:35:29.380526+0000","last_fullsized":"2024-04-16T19:35:29.380526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:53.484971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382188+0000","last_change":"2024-04-16T17:45:08.382545+0000","last_active":"2024-04-16T19:35:39.382188+0000","last_peered":"2024-04-16T19:35:39.382188+0000","last_clean":"2024-04-16T19:35:39.382188+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:35:39.382188+0000","last_undegraded":"2024-04-16T19:35:39.382188+0000","last_fullsized":"2024-04-16T19:35:39.382188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:42:32.600947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"48'17","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:44.364227+0000","last_change":"2024-04-16T17:45:20.412524+0000","last_active":"2024-04-16T19:33:44.364227+0000","last_peered":"2024-04-16T19:33:44.364227+0000","last_clean":"2024-04-16T19:33:44.364227+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:33:44.364227+0000","last_undegraded":"2024-04-16T19:33:44.364227+0000","last_fullsized":"2024-04-16T19:33:44.364227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:26:20.296409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'120","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595888+0000","last_change":"2024-04-16T17:45:22.414750+0000","last_active":"2024-04-16T19:37:54.595888+0000","last_peered":"2024-04-16T19:37:54.595888+0000","last_clean":"2024-04-16T19:37:54.595888+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:37:54.595888+0000","last_undegraded":"2024-04-16T19:37:54.595888+0000","last_fullsized":"2024-04-16T19:37:54.595888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'12","reported_seq":1391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382297+0000","last_change":"2024-04-16T17:45:24.423828+0000","last_active":"2024-04-16T19:35:39.382297+0000","last_peered":"2024-04-16T19:35:39.382297+0000","last_clean":"2024-04-16T19:35:39.382297+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:35:39.382297+0000","last_undegraded":"2024-04-16T19:35:39.382297+0000","last_fullsized":"2024-04-16T19:35:39.382297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:48:54.152562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.384551+0000","last_change":"2024-04-16T17:45:26.429874+0000","last_active":"2024-04-16T19:35:54.384551+0000","last_peered":"2024-04-16T19:35:54.384551+0000","last_clean":"2024-04-16T19:35:54.384551+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:35:54.384551+0000","last_undegraded":"2024-04-16T19:35:54.384551+0000","last_fullsized":"2024-04-16T19:35:54.384551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:16.546602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579566+0000","last_change":"2024-04-16T18:09:02.169496+0000","last_active":"2024-04-16T19:36:34.579566+0000","last_peered":"2024-04-16T19:36:34.579566+0000","last_clean":"2024-04-16T19:36:34.579566+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:36:34.579566+0000","last_undegraded":"2024-04-16T19:36:34.579566+0000","last_fullsized":"2024-04-16T19:36:34.579566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'130","reported_seq":1977,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.400285+0000","last_change":"2024-04-16T17:46:25.525792+0000","last_active":"2024-04-16T19:37:14.400285+0000","last_peered":"2024-04-16T19:37:14.400285+0000","last_clean":"2024-04-16T19:37:14.400285+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:37:14.400285+0000","last_undegraded":"2024-04-16T19:37:14.400285+0000","last_fullsized":"2024-04-16T19:37:14.400285+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373227+0000","last_change":"2024-04-16T17:46:17.512275+0000","last_active":"2024-04-16T19:34:39.373227+0000","last_peered":"2024-04-16T19:34:39.373227+0000","last_clean":"2024-04-16T19:34:39.373227+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:34:39.373227+0000","last_undegraded":"2024-04-16T19:34:39.373227+0000","last_fullsized":"2024-04-16T19:34:39.373227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'16","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577619+0000","last_change":"2024-04-16T17:45:51.480112+0000","last_active":"2024-04-16T19:36:24.577619+0000","last_peered":"2024-04-16T19:36:24.577619+0000","last_clean":"2024-04-16T19:36:24.577619+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:36:24.577619+0000","last_undegraded":"2024-04-16T19:36:24.577619+0000","last_fullsized":"2024-04-16T19:36:24.577619+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'651","reported_seq":2213,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597753+0000","last_change":"2024-04-16T17:45:49.470044+0000","last_active":"2024-04-16T19:38:04.597753+0000","last_peered":"2024-04-16T19:38:04.597753+0000","last_clean":"2024-04-16T19:38:04.597753+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:38:04.597753+0000","last_undegraded":"2024-04-16T19:38:04.597753+0000","last_fullsized":"2024-04-16T19:38:04.597753+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'424","reported_seq":710,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367800+0000","last_change":"2024-04-16T17:45:47.461193+0000","last_active":"2024-04-16T19:34:09.367800+0000","last_peered":"2024-04-16T19:34:09.367800+0000","last_clean":"2024-04-16T19:34:09.367800+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:34:09.367800+0000","last_undegraded":"2024-04-16T19:34:09.367800+0000","last_fullsized":"2024-04-16T19:34:09.367800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:59:35.710148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'28","reported_seq":525,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575438+0000","last_change":"2024-04-16T17:45:45.458470+0000","last_active":"2024-04-16T19:36:14.575438+0000","last_peered":"2024-04-16T19:36:14.575438+0000","last_clean":"2024-04-16T19:36:14.575438+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:36:14.575438+0000","last_undegraded":"2024-04-16T19:36:14.575438+0000","last_fullsized":"2024-04-16T19:36:14.575438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582632+0000","last_change":"2024-04-16T17:46:16.501988+0000","last_active":"2024-04-16T19:36:49.582632+0000","last_peered":"2024-04-16T19:36:49.582632+0000","last_clean":"2024-04-16T19:36:49.582632+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:36:49.582632+0000","last_undegraded":"2024-04-16T19:36:49.582632+0000","last_fullsized":"2024-04-16T19:36:49.582632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594561+0000","last_change":"2024-04-16T17:45:08.381995+0000","last_active":"2024-04-16T19:37:49.594561+0000","last_peered":"2024-04-16T19:37:49.594561+0000","last_clean":"2024-04-16T19:37:49.594561+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:37:49.594561+0000","last_undegraded":"2024-04-16T19:37:49.594561+0000","last_fullsized":"2024-04-16T19:37:49.594561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382943+0000","last_change":"2024-04-16T17:45:20.407642+0000","last_active":"2024-04-16T19:35:39.382943+0000","last_peered":"2024-04-16T19:35:39.382943+0000","last_clean":"2024-04-16T19:35:39.382943+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:35:39.382943+0000","last_undegraded":"2024-04-16T19:35:39.382943+0000","last_fullsized":"2024-04-16T19:35:39.382943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:15.477935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'176","reported_seq":385,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382915+0000","last_change":"2024-04-16T17:45:22.414672+0000","last_active":"2024-04-16T19:35:39.382915+0000","last_peered":"2024-04-16T19:35:39.382915+0000","last_clean":"2024-04-16T19:35:39.382915+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:35:39.382915+0000","last_undegraded":"2024-04-16T19:35:39.382915+0000","last_fullsized":"2024-04-16T19:35:39.382915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:49.342017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382893+0000","last_change":"2024-04-16T17:45:24.425728+0000","last_active":"2024-04-16T19:35:39.382893+0000","last_peered":"2024-04-16T19:35:39.382893+0000","last_clean":"2024-04-16T19:35:39.382893+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:35:39.382893+0000","last_undegraded":"2024-04-16T19:35:39.382893+0000","last_fullsized":"2024-04-16T19:35:39.382893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:48.415571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596827+0000","last_change":"2024-04-16T17:45:26.433385+0000","last_active":"2024-04-16T19:37:59.596827+0000","last_peered":"2024-04-16T19:37:59.596827+0000","last_clean":"2024-04-16T19:37:59.596827+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:37:59.596827+0000","last_undegraded":"2024-04-16T19:37:59.596827+0000","last_fullsized":"2024-04-16T19:37:59.596827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582600+0000","last_change":"2024-04-16T18:09:02.173431+0000","last_active":"2024-04-16T19:36:49.582600+0000","last_peered":"2024-04-16T19:36:49.582600+0000","last_clean":"2024-04-16T19:36:49.582600+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:36:49.582600+0000","last_undegraded":"2024-04-16T19:36:49.582600+0000","last_fullsized":"2024-04-16T19:36:49.582600+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'117","reported_seq":1947,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374129+0000","last_change":"2024-04-16T17:46:25.530014+0000","last_active":"2024-04-16T19:34:49.374129+0000","last_peered":"2024-04-16T19:34:49.374129+0000","last_clean":"2024-04-16T19:34:49.374129+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:34:49.374129+0000","last_undegraded":"2024-04-16T19:34:49.374129+0000","last_fullsized":"2024-04-16T19:34:49.374129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:55:46.795658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579507+0000","last_change":"2024-04-16T17:46:17.512764+0000","last_active":"2024-04-16T19:36:34.579507+0000","last_peered":"2024-04-16T19:36:34.579507+0000","last_clean":"2024-04-16T19:36:34.579507+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:36:34.579507+0000","last_undegraded":"2024-04-16T19:36:34.579507+0000","last_fullsized":"2024-04-16T19:36:34.579507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'24","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365186+0000","last_change":"2024-04-16T17:45:51.482816+0000","last_active":"2024-04-16T19:33:54.365186+0000","last_peered":"2024-04-16T19:33:54.365186+0000","last_clean":"2024-04-16T19:33:54.365186+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:33:54.365186+0000","last_undegraded":"2024-04-16T19:33:54.365186+0000","last_fullsized":"2024-04-16T19:33:54.365186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:57.211121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":96,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579442+0000","last_change":"2024-04-16T17:45:49.472014+0000","last_active":"2024-04-16T19:36:34.579442+0000","last_peered":"2024-04-16T19:36:34.579442+0000","last_clean":"2024-04-16T19:36:34.579442+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:36:34.579442+0000","last_undegraded":"2024-04-16T19:36:34.579442+0000","last_fullsized":"2024-04-16T19:36:34.579442+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'291","reported_seq":535,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364960+0000","last_change":"2024-04-16T17:45:47.466159+0000","last_active":"2024-04-16T19:33:49.364960+0000","last_peered":"2024-04-16T19:33:49.364960+0000","last_clean":"2024-04-16T19:33:49.364960+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:33:49.364960+0000","last_undegraded":"2024-04-16T19:33:49.364960+0000","last_fullsized":"2024-04-16T19:33:49.364960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:31:37.045194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'11","reported_seq":457,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576423+0000","last_change":"2024-04-16T17:45:45.461762+0000","last_active":"2024-04-16T19:36:19.576423+0000","last_peered":"2024-04-16T19:36:19.576423+0000","last_clean":"2024-04-16T19:36:19.576423+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:36:19.576423+0000","last_undegraded":"2024-04-16T19:36:19.576423+0000","last_fullsized":"2024-04-16T19:36:19.576423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.386083+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:35:59.386083+0000","last_peered":"2024-04-16T19:35:59.386083+0000","last_clean":"2024-04-16T19:35:59.386083+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:35:59.386083+0000","last_undegraded":"2024-04-16T19:35:59.386083+0000","last_fullsized":"2024-04-16T19:35:59.386083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:01.549347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":296,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373805+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T19:34:44.373805+0000","last_peered":"2024-04-16T19:34:44.373805+0000","last_clean":"2024-04-16T19:34:44.373805+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:34:44.373805+0000","last_undegraded":"2024-04-16T19:34:44.373805+0000","last_fullsized":"2024-04-16T19:34:44.373805+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:56.418777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374723+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:34:49.374723+0000","last_peered":"2024-04-16T19:34:49.374723+0000","last_clean":"2024-04-16T19:34:49.374723+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:34:49.374723+0000","last_undegraded":"2024-04-16T19:34:49.374723+0000","last_fullsized":"2024-04-16T19:34:49.374723+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:12.642700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592615+0000","last_change":"2024-04-16T17:45:08.387550+0000","last_active":"2024-04-16T19:37:39.592615+0000","last_peered":"2024-04-16T19:37:39.592615+0000","last_clean":"2024-04-16T19:37:39.592615+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:37:39.592615+0000","last_undegraded":"2024-04-16T19:37:39.592615+0000","last_fullsized":"2024-04-16T19:37:39.592615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383732+0000","last_change":"2024-04-16T17:45:20.412324+0000","last_active":"2024-04-16T19:35:49.383732+0000","last_peered":"2024-04-16T19:35:49.383732+0000","last_clean":"2024-04-16T19:35:49.383732+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:35:49.383732+0000","last_undegraded":"2024-04-16T19:35:49.383732+0000","last_fullsized":"2024-04-16T19:35:49.383732+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:06.239898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'72","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385321+0000","last_change":"2024-04-16T17:45:22.415579+0000","last_active":"2024-04-16T19:35:54.385321+0000","last_peered":"2024-04-16T19:35:54.385321+0000","last_clean":"2024-04-16T19:35:54.385321+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:35:54.385321+0000","last_undegraded":"2024-04-16T19:35:54.385321+0000","last_fullsized":"2024-04-16T19:35:54.385321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:28:40.426580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408644+0000","last_change":"2024-04-16T17:45:24.422064+0000","last_active":"2024-04-16T19:38:04.408644+0000","last_peered":"2024-04-16T19:38:04.408644+0000","last_clean":"2024-04-16T19:38:04.408644+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:38:04.408644+0000","last_undegraded":"2024-04-16T19:38:04.408644+0000","last_fullsized":"2024-04-16T19:38:04.408644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.385888+0000","last_change":"2024-04-16T17:45:26.439130+0000","last_active":"2024-04-16T19:35:59.385888+0000","last_peered":"2024-04-16T19:35:59.385888+0000","last_clean":"2024-04-16T19:35:59.385888+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:35:59.385888+0000","last_undegraded":"2024-04-16T19:35:59.385888+0000","last_fullsized":"2024-04-16T19:35:59.385888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:21.169043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371730+0000","last_change":"2024-04-16T18:09:02.168908+0000","last_active":"2024-04-16T19:34:34.371730+0000","last_peered":"2024-04-16T19:34:34.371730+0000","last_clean":"2024-04-16T19:34:34.371730+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:34:34.371730+0000","last_undegraded":"2024-04-16T19:34:34.371730+0000","last_fullsized":"2024-04-16T19:34:34.371730+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:37:56.187557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'150","reported_seq":2026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395682+0000","last_change":"2024-04-16T17:46:25.527679+0000","last_active":"2024-04-16T19:36:44.395682+0000","last_peered":"2024-04-16T19:36:44.395682+0000","last_clean":"2024-04-16T19:36:44.395682+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:36:44.395682+0000","last_undegraded":"2024-04-16T19:36:44.395682+0000","last_fullsized":"2024-04-16T19:36:44.395682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373443+0000","last_change":"2024-04-16T17:46:17.514358+0000","last_active":"2024-04-16T19:34:39.373443+0000","last_peered":"2024-04-16T19:34:39.373443+0000","last_clean":"2024-04-16T19:34:39.373443+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:34:39.373443+0000","last_undegraded":"2024-04-16T19:34:39.373443+0000","last_fullsized":"2024-04-16T19:34:39.373443+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:01.622597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'5","reported_seq":102,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.389841+0000","last_change":"2024-04-16T17:45:51.481385+0000","last_active":"2024-04-16T19:36:09.389841+0000","last_peered":"2024-04-16T19:36:09.389841+0000","last_clean":"2024-04-16T19:36:09.389841+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:36:09.389841+0000","last_undegraded":"2024-04-16T19:36:09.389841+0000","last_fullsized":"2024-04-16T19:36:09.389841+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'651","reported_seq":2343,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576512+0000","last_change":"2024-04-16T17:45:49.469823+0000","last_active":"2024-04-16T19:36:19.576512+0000","last_peered":"2024-04-16T19:36:19.576512+0000","last_clean":"2024-04-16T19:36:19.576512+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:36:19.576512+0000","last_undegraded":"2024-04-16T19:36:19.576512+0000","last_fullsized":"2024-04-16T19:36:19.576512+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'439","reported_seq":734,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391236+0000","last_change":"2024-04-16T17:45:47.465291+0000","last_active":"2024-04-16T19:36:19.391236+0000","last_peered":"2024-04-16T19:36:19.391236+0000","last_clean":"2024-04-16T19:36:19.391236+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:36:19.391236+0000","last_undegraded":"2024-04-16T19:36:19.391236+0000","last_fullsized":"2024-04-16T19:36:19.391236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'13","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.388952+0000","last_change":"2024-04-16T17:45:45.460969+0000","last_active":"2024-04-16T19:36:04.388952+0000","last_peered":"2024-04-16T19:36:04.388952+0000","last_clean":"2024-04-16T19:36:04.388952+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:36:04.388952+0000","last_undegraded":"2024-04-16T19:36:04.388952+0000","last_fullsized":"2024-04-16T19:36:04.388952+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407098+0000","last_change":"2024-04-16T17:45:10.396755+0000","last_active":"2024-04-16T19:37:54.407098+0000","last_peered":"2024-04-16T19:37:54.407098+0000","last_clean":"2024-04-16T19:37:54.407098+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:37:54.407098+0000","last_undegraded":"2024-04-16T19:37:54.407098+0000","last_fullsized":"2024-04-16T19:37:54.407098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:44.373829+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T19:34:44.373829+0000","last_peered":"2024-04-16T19:34:44.373829+0000","last_clean":"2024-04-16T19:34:44.373829+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:34:44.373829+0000","last_undegraded":"2024-04-16T19:34:44.373829+0000","last_fullsized":"2024-04-16T19:34:44.373829+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:04:33.735299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.581436+0000","last_change":"2024-04-16T17:46:16.500353+0000","last_active":"2024-04-16T19:36:44.581436+0000","last_peered":"2024-04-16T19:36:44.581436+0000","last_clean":"2024-04-16T19:36:44.581436+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:36:44.581436+0000","last_undegraded":"2024-04-16T19:36:44.581436+0000","last_fullsized":"2024-04-16T19:36:44.581436+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"48'13","reported_seq":582,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385339+0000","last_change":"2024-04-16T17:45:20.412363+0000","last_active":"2024-04-16T19:35:54.385339+0000","last_peered":"2024-04-16T19:35:54.385339+0000","last_clean":"2024-04-16T19:35:54.385339+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:35:54.385339+0000","last_undegraded":"2024-04-16T19:35:54.385339+0000","last_fullsized":"2024-04-16T19:35:54.385339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:51.744736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'177","reported_seq":1668,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595869+0000","last_change":"2024-04-16T17:45:22.412577+0000","last_active":"2024-04-16T19:37:54.595869+0000","last_peered":"2024-04-16T19:37:54.595869+0000","last_clean":"2024-04-16T19:37:54.595869+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:37:54.595869+0000","last_undegraded":"2024-04-16T19:37:54.595869+0000","last_fullsized":"2024-04-16T19:37:54.595869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.366956+0000","last_change":"2024-04-16T17:45:24.422901+0000","last_active":"2024-04-16T19:34:04.366956+0000","last_peered":"2024-04-16T19:34:04.366956+0000","last_clean":"2024-04-16T19:34:04.366956+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:34:04.366956+0000","last_undegraded":"2024-04-16T19:34:04.366956+0000","last_fullsized":"2024-04-16T19:34:04.366956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:55.759978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575421+0000","last_change":"2024-04-16T17:45:26.847528+0000","last_active":"2024-04-16T19:36:14.575421+0000","last_peered":"2024-04-16T19:36:14.575421+0000","last_clean":"2024-04-16T19:36:14.575421+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:36:14.575421+0000","last_undegraded":"2024-04-16T19:36:14.575421+0000","last_fullsized":"2024-04-16T19:36:14.575421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372561+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:34:34.372561+0000","last_peered":"2024-04-16T19:34:34.372561+0000","last_clean":"2024-04-16T19:34:34.372561+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:34:34.372561+0000","last_undegraded":"2024-04-16T19:34:34.372561+0000","last_fullsized":"2024-04-16T19:34:34.372561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'137","reported_seq":1599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371844+0000","last_change":"2024-04-16T17:46:25.524587+0000","last_active":"2024-04-16T19:34:29.371844+0000","last_peered":"2024-04-16T19:34:29.371844+0000","last_clean":"2024-04-16T19:34:29.371844+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:34:29.371844+0000","last_undegraded":"2024-04-16T19:34:29.371844+0000","last_fullsized":"2024-04-16T19:34:29.371844+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:25:51.963525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.370234+0000","last_change":"2024-04-16T17:46:17.512533+0000","last_active":"2024-04-16T19:34:19.370234+0000","last_peered":"2024-04-16T19:34:19.370234+0000","last_clean":"2024-04-16T19:34:19.370234+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:34:19.370234+0000","last_undegraded":"2024-04-16T19:34:19.370234+0000","last_fullsized":"2024-04-16T19:34:19.370234+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:15:08.644185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'22","reported_seq":190,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369157+0000","last_change":"2024-04-16T17:45:51.482872+0000","last_active":"2024-04-16T19:34:14.369157+0000","last_peered":"2024-04-16T19:34:14.369157+0000","last_clean":"2024-04-16T19:34:14.369157+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:34:14.369157+0000","last_undegraded":"2024-04-16T19:34:14.369157+0000","last_fullsized":"2024-04-16T19:34:14.369157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:41:19.126676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":96,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576443+0000","last_change":"2024-04-16T17:45:49.469833+0000","last_active":"2024-04-16T19:36:19.576443+0000","last_peered":"2024-04-16T19:36:19.576443+0000","last_clean":"2024-04-16T19:36:19.576443+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:36:19.576443+0000","last_undegraded":"2024-04-16T19:36:19.576443+0000","last_fullsized":"2024-04-16T19:36:19.576443+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4935","reported_seq":7414,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368062+0000","last_change":"2024-04-16T17:45:47.459129+0000","last_active":"2024-04-16T19:34:09.368062+0000","last_peered":"2024-04-16T19:34:09.368062+0000","last_clean":"2024-04-16T19:34:09.368062+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:34:09.368062+0000","last_undegraded":"2024-04-16T19:34:09.368062+0000","last_fullsized":"2024-04-16T19:34:09.368062+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":3000,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:16.005223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'5","reported_seq":257,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371575+0000","last_change":"2024-04-16T17:45:45.465878+0000","last_active":"2024-04-16T19:34:29.371575+0000","last_peered":"2024-04-16T19:34:29.371575+0000","last_clean":"2024-04-16T19:34:29.371575+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:34:29.371575+0000","last_undegraded":"2024-04-16T19:34:29.371575+0000","last_fullsized":"2024-04-16T19:34:29.371575+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:08:14.781901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596005+0000","last_change":"2024-04-16T17:45:10.401015+0000","last_active":"2024-04-16T19:37:54.596005+0000","last_peered":"2024-04-16T19:37:54.596005+0000","last_clean":"2024-04-16T19:37:54.596005+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:37:54.596005+0000","last_undegraded":"2024-04-16T19:37:54.596005+0000","last_fullsized":"2024-04-16T19:37:54.596005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583527+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T19:36:54.583527+0000","last_peered":"2024-04-16T19:36:54.583527+0000","last_clean":"2024-04-16T19:36:54.583527+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:36:54.583527+0000","last_undegraded":"2024-04-16T19:36:54.583527+0000","last_fullsized":"2024-04-16T19:36:54.583527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589471+0000","last_change":"2024-04-16T17:45:08.382479+0000","last_active":"2024-04-16T19:37:24.589471+0000","last_peered":"2024-04-16T19:37:24.589471+0000","last_clean":"2024-04-16T19:37:24.589471+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:37:24.589471+0000","last_undegraded":"2024-04-16T19:37:24.589471+0000","last_fullsized":"2024-04-16T19:37:24.589471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"48'3","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597957+0000","last_change":"2024-04-16T17:45:20.413451+0000","last_active":"2024-04-16T19:38:04.597957+0000","last_peered":"2024-04-16T19:38:04.597957+0000","last_clean":"2024-04-16T19:38:04.597957+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:38:04.597957+0000","last_undegraded":"2024-04-16T19:38:04.597957+0000","last_fullsized":"2024-04-16T19:38:04.597957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'151","reported_seq":1610,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367608+0000","last_change":"2024-04-16T17:45:22.416277+0000","last_active":"2024-04-16T19:34:04.367608+0000","last_peered":"2024-04-16T19:34:04.367608+0000","last_clean":"2024-04-16T19:34:04.367608+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:34:04.367608+0000","last_undegraded":"2024-04-16T19:34:04.367608+0000","last_fullsized":"2024-04-16T19:34:04.367608+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:56:43.858466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407046+0000","last_change":"2024-04-16T17:45:24.426509+0000","last_active":"2024-04-16T19:37:54.407046+0000","last_peered":"2024-04-16T19:37:54.407046+0000","last_clean":"2024-04-16T19:37:54.407046+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:37:54.407046+0000","last_undegraded":"2024-04-16T19:37:54.407046+0000","last_fullsized":"2024-04-16T19:37:54.407046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407712+0000","last_change":"2024-04-16T17:45:26.439231+0000","last_active":"2024-04-16T19:37:59.407712+0000","last_peered":"2024-04-16T19:37:59.407712+0000","last_clean":"2024-04-16T19:37:59.407712+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:37:59.407712+0000","last_undegraded":"2024-04-16T19:37:59.407712+0000","last_fullsized":"2024-04-16T19:37:59.407712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374893+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:34:49.374893+0000","last_peered":"2024-04-16T19:34:49.374893+0000","last_clean":"2024-04-16T19:34:49.374893+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:34:49.374893+0000","last_undegraded":"2024-04-16T19:34:49.374893+0000","last_fullsized":"2024-04-16T19:34:49.374893+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:41:07.763412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'135","reported_seq":2026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371048+0000","last_change":"2024-04-16T17:46:25.529983+0000","last_active":"2024-04-16T19:34:29.371048+0000","last_peered":"2024-04-16T19:34:29.371048+0000","last_clean":"2024-04-16T19:34:29.371048+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:34:29.371048+0000","last_undegraded":"2024-04-16T19:34:29.371048+0000","last_fullsized":"2024-04-16T19:34:29.371048+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:45:31.421525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369527+0000","last_change":"2024-04-16T17:46:17.508075+0000","last_active":"2024-04-16T19:34:19.369527+0000","last_peered":"2024-04-16T19:34:19.369527+0000","last_clean":"2024-04-16T19:34:19.369527+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:34:19.369527+0000","last_undegraded":"2024-04-16T19:34:19.369527+0000","last_fullsized":"2024-04-16T19:34:19.369527+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:48.730155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"48'2","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.389756+0000","last_change":"2024-04-16T17:45:51.484218+0000","last_active":"2024-04-16T19:36:09.389756+0000","last_peered":"2024-04-16T19:36:09.389756+0000","last_clean":"2024-04-16T19:36:09.389756+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:36:09.389756+0000","last_undegraded":"2024-04-16T19:36:09.389756+0000","last_fullsized":"2024-04-16T19:36:09.389756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.573402+0000","last_change":"2024-04-16T17:45:49.469114+0000","last_active":"2024-04-16T19:36:04.573402+0000","last_peered":"2024-04-16T19:36:04.573402+0000","last_clean":"2024-04-16T19:36:04.573402+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:36:04.573402+0000","last_undegraded":"2024-04-16T19:36:04.573402+0000","last_fullsized":"2024-04-16T19:36:04.573402+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'472","reported_seq":939,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.370916+0000","last_change":"2024-04-16T17:45:47.463058+0000","last_active":"2024-04-16T19:34:29.370916+0000","last_peered":"2024-04-16T19:34:29.370916+0000","last_clean":"2024-04-16T19:34:29.370916+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:34:29.370916+0000","last_undegraded":"2024-04-16T19:34:29.370916+0000","last_fullsized":"2024-04-16T19:34:29.370916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:54:56.798962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'6","reported_seq":419,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391289+0000","last_change":"2024-04-16T17:45:45.463642+0000","last_active":"2024-04-16T19:36:19.391289+0000","last_peered":"2024-04-16T19:36:19.391289+0000","last_clean":"2024-04-16T19:36:19.391289+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:36:19.391289+0000","last_undegraded":"2024-04-16T19:36:19.391289+0000","last_fullsized":"2024-04-16T19:36:19.391289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593760+0000","last_change":"2024-04-16T17:45:10.396905+0000","last_active":"2024-04-16T19:37:44.593760+0000","last_peered":"2024-04-16T19:37:44.593760+0000","last_clean":"2024-04-16T19:37:44.593760+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:37:44.593760+0000","last_undegraded":"2024-04-16T19:37:44.593760+0000","last_fullsized":"2024-04-16T19:37:44.593760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374696+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T19:34:49.374696+0000","last_peered":"2024-04-16T19:34:49.374696+0000","last_clean":"2024-04-16T19:34:49.374696+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:34:49.374696+0000","last_undegraded":"2024-04-16T19:34:49.374696+0000","last_fullsized":"2024-04-16T19:34:49.374696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:11:55.476277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381333+0000","last_change":"2024-04-16T17:45:08.382355+0000","last_active":"2024-04-16T19:35:34.381333+0000","last_peered":"2024-04-16T19:35:34.381333+0000","last_clean":"2024-04-16T19:35:34.381333+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:35:34.381333+0000","last_undegraded":"2024-04-16T19:35:34.381333+0000","last_fullsized":"2024-04-16T19:35:34.381333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:13:26.849118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":877,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.389795+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:36:09.389795+0000","last_peered":"2024-04-16T19:36:09.389795+0000","last_clean":"2024-04-16T19:36:09.389795+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:36:09.389795+0000","last_undegraded":"2024-04-16T19:36:09.389795+0000","last_fullsized":"2024-04-16T19:36:09.389795+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'144","reported_seq":335,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.598054+0000","last_change":"2024-04-16T17:45:22.417967+0000","last_active":"2024-04-16T19:38:04.598054+0000","last_peered":"2024-04-16T19:38:04.598054+0000","last_clean":"2024-04-16T19:38:04.598054+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:38:04.598054+0000","last_undegraded":"2024-04-16T19:38:04.598054+0000","last_fullsized":"2024-04-16T19:38:04.598054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385378+0000","last_change":"2024-04-16T17:45:24.430854+0000","last_active":"2024-04-16T19:35:54.385378+0000","last_peered":"2024-04-16T19:35:54.385378+0000","last_clean":"2024-04-16T19:35:54.385378+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:35:54.385378+0000","last_undegraded":"2024-04-16T19:35:54.385378+0000","last_fullsized":"2024-04-16T19:35:54.385378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:44.189297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.385871+0000","last_change":"2024-04-16T17:45:26.433033+0000","last_active":"2024-04-16T19:35:59.385871+0000","last_peered":"2024-04-16T19:35:59.385871+0000","last_clean":"2024-04-16T19:35:59.385871+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:35:59.385871+0000","last_undegraded":"2024-04-16T19:35:59.385871+0000","last_fullsized":"2024-04-16T19:35:59.385871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:50.423306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383610+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:35:44.383610+0000","last_peered":"2024-04-16T19:35:44.383610+0000","last_clean":"2024-04-16T19:35:44.383610+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:35:44.383610+0000","last_undegraded":"2024-04-16T19:35:44.383610+0000","last_fullsized":"2024-04-16T19:35:44.383610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:02:50.648888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1711,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382752+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:35:39.382752+0000","last_peered":"2024-04-16T19:35:39.382752+0000","last_clean":"2024-04-16T19:35:39.382752+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:35:39.382752+0000","last_undegraded":"2024-04-16T19:35:39.382752+0000","last_fullsized":"2024-04-16T19:35:39.382752+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:19:32.647068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369878+0000","last_change":"2024-04-16T17:46:17.507415+0000","last_active":"2024-04-16T19:34:19.369878+0000","last_peered":"2024-04-16T19:34:19.369878+0000","last_clean":"2024-04-16T19:34:19.369878+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:34:19.369878+0000","last_undegraded":"2024-04-16T19:34:19.369878+0000","last_fullsized":"2024-04-16T19:34:19.369878+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'8","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.580553+0000","last_change":"2024-04-16T17:45:51.479839+0000","last_active":"2024-04-16T19:36:39.580553+0000","last_peered":"2024-04-16T19:36:39.580553+0000","last_clean":"2024-04-16T19:36:39.580553+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:36:39.580553+0000","last_undegraded":"2024-04-16T19:36:39.580553+0000","last_fullsized":"2024-04-16T19:36:39.580553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'651","reported_seq":2231,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.573477+0000","last_change":"2024-04-16T17:45:49.468732+0000","last_active":"2024-04-16T19:36:04.573477+0000","last_peered":"2024-04-16T19:36:04.573477+0000","last_clean":"2024-04-16T19:36:04.573477+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:36:04.573477+0000","last_undegraded":"2024-04-16T19:36:04.573477+0000","last_fullsized":"2024-04-16T19:36:04.573477+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'344","reported_seq":642,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364192+0000","last_change":"2024-04-16T17:45:47.460745+0000","last_active":"2024-04-16T19:33:49.364192+0000","last_peered":"2024-04-16T19:33:49.364192+0000","last_clean":"2024-04-16T19:33:49.364192+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:33:49.364192+0000","last_undegraded":"2024-04-16T19:33:49.364192+0000","last_fullsized":"2024-04-16T19:33:49.364192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:54:01.165117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'13","reported_seq":452,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368729+0000","last_change":"2024-04-16T17:45:45.462237+0000","last_active":"2024-04-16T19:34:09.368729+0000","last_peered":"2024-04-16T19:34:09.368729+0000","last_clean":"2024-04-16T19:34:09.368729+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:34:09.368729+0000","last_undegraded":"2024-04-16T19:34:09.368729+0000","last_fullsized":"2024-04-16T19:34:09.368729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:16:24.020867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593675+0000","last_change":"2024-04-16T17:45:10.399758+0000","last_active":"2024-04-16T19:37:44.593675+0000","last_peered":"2024-04-16T19:37:44.593675+0000","last_clean":"2024-04-16T19:37:44.593675+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:37:44.593675+0000","last_undegraded":"2024-04-16T19:37:44.593675+0000","last_fullsized":"2024-04-16T19:37:44.593675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:54.385247+0000","last_change":"2024-04-16T17:45:08.386614+0000","last_active":"2024-04-16T19:35:54.385247+0000","last_peered":"2024-04-16T19:35:54.385247+0000","last_clean":"2024-04-16T19:35:54.385247+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:35:54.385247+0000","last_undegraded":"2024-04-16T19:35:54.385247+0000","last_fullsized":"2024-04-16T19:35:54.385247+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:29:51.477510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583633+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T19:36:54.583633+0000","last_peered":"2024-04-16T19:36:54.583633+0000","last_clean":"2024-04-16T19:36:54.583633+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:36:54.583633+0000","last_undegraded":"2024-04-16T19:36:54.583633+0000","last_fullsized":"2024-04-16T19:36:54.583633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406997+0000","last_change":"2024-04-16T17:45:20.414740+0000","last_active":"2024-04-16T19:37:54.406997+0000","last_peered":"2024-04-16T19:37:54.406997+0000","last_clean":"2024-04-16T19:37:54.406997+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:37:54.406997+0000","last_undegraded":"2024-04-16T19:37:54.406997+0000","last_fullsized":"2024-04-16T19:37:54.406997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'160","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405063+0000","last_change":"2024-04-16T17:45:22.416454+0000","last_active":"2024-04-16T19:37:44.405063+0000","last_peered":"2024-04-16T19:37:44.405063+0000","last_clean":"2024-04-16T19:37:44.405063+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:37:44.405063+0000","last_undegraded":"2024-04-16T19:37:44.405063+0000","last_fullsized":"2024-04-16T19:37:44.405063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383620+0000","last_change":"2024-04-16T17:45:24.425127+0000","last_active":"2024-04-16T19:35:49.383620+0000","last_peered":"2024-04-16T19:35:49.383620+0000","last_clean":"2024-04-16T19:35:49.383620+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:35:49.383620+0000","last_undegraded":"2024-04-16T19:35:49.383620+0000","last_fullsized":"2024-04-16T19:35:49.383620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:12.945022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407789+0000","last_change":"2024-04-16T17:45:26.849850+0000","last_active":"2024-04-16T19:37:59.407789+0000","last_peered":"2024-04-16T19:37:59.407789+0000","last_clean":"2024-04-16T19:37:59.407789+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:37:59.407789+0000","last_undegraded":"2024-04-16T19:37:59.407789+0000","last_fullsized":"2024-04-16T19:37:59.407789+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595633+0000","last_change":"2024-04-16T18:09:02.175274+0000","last_active":"2024-04-16T19:37:54.595633+0000","last_peered":"2024-04-16T19:37:54.595633+0000","last_clean":"2024-04-16T19:37:54.595633+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:37:54.595633+0000","last_undegraded":"2024-04-16T19:37:54.595633+0000","last_fullsized":"2024-04-16T19:37:54.595633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1689,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374645+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:34:49.374645+0000","last_peered":"2024-04-16T19:34:49.374645+0000","last_clean":"2024-04-16T19:34:49.374645+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:34:49.374645+0000","last_undegraded":"2024-04-16T19:34:49.374645+0000","last_fullsized":"2024-04-16T19:34:49.374645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:00:32.605132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.585369+0000","last_change":"2024-04-16T17:46:17.509389+0000","last_active":"2024-04-16T19:37:04.585369+0000","last_peered":"2024-04-16T19:37:04.585369+0000","last_clean":"2024-04-16T19:37:04.585369+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:37:04.585369+0000","last_undegraded":"2024-04-16T19:37:04.585369+0000","last_fullsized":"2024-04-16T19:37:04.585369+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"48'7","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.389697+0000","last_change":"2024-04-16T17:45:51.478774+0000","last_active":"2024-04-16T19:36:09.389697+0000","last_peered":"2024-04-16T19:36:09.389697+0000","last_clean":"2024-04-16T19:36:09.389697+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:36:09.389697+0000","last_undegraded":"2024-04-16T19:36:09.389697+0000","last_fullsized":"2024-04-16T19:36:09.389697+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.573458+0000","last_change":"2024-04-16T17:45:49.472675+0000","last_active":"2024-04-16T19:36:04.573458+0000","last_peered":"2024-04-16T19:36:04.573458+0000","last_clean":"2024-04-16T19:36:04.573458+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:36:04.573458+0000","last_undegraded":"2024-04-16T19:36:04.573458+0000","last_fullsized":"2024-04-16T19:36:04.573458+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'500","reported_seq":832,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364226+0000","last_change":"2024-04-16T17:45:47.461629+0000","last_active":"2024-04-16T19:33:49.364226+0000","last_peered":"2024-04-16T19:33:49.364226+0000","last_clean":"2024-04-16T19:33:49.364226+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:33:49.364226+0000","last_undegraded":"2024-04-16T19:33:49.364226+0000","last_fullsized":"2024-04-16T19:33:49.364226+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:44:08.910809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'23","reported_seq":293,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364983+0000","last_change":"2024-04-16T17:45:45.457257+0000","last_active":"2024-04-16T19:33:49.364983+0000","last_peered":"2024-04-16T19:33:49.364983+0000","last_clean":"2024-04-16T19:33:49.364983+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:33:49.364983+0000","last_undegraded":"2024-04-16T19:33:49.364983+0000","last_fullsized":"2024-04-16T19:33:49.364983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:51.975338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405174+0000","last_change":"2024-04-16T17:45:10.392387+0000","last_active":"2024-04-16T19:37:44.405174+0000","last_peered":"2024-04-16T19:37:44.405174+0000","last_clean":"2024-04-16T19:37:44.405174+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:37:44.405174+0000","last_undegraded":"2024-04-16T19:37:44.405174+0000","last_fullsized":"2024-04-16T19:37:44.405174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592730+0000","last_change":"2024-04-16T17:45:08.383729+0000","last_active":"2024-04-16T19:37:39.592730+0000","last_peered":"2024-04-16T19:37:39.592730+0000","last_clean":"2024-04-16T19:37:39.592730+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:37:39.592730+0000","last_undegraded":"2024-04-16T19:37:39.592730+0000","last_fullsized":"2024-04-16T19:37:39.592730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378047+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T19:35:09.378047+0000","last_peered":"2024-04-16T19:35:09.378047+0000","last_clean":"2024-04-16T19:35:09.378047+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:35:09.378047+0000","last_undegraded":"2024-04-16T19:35:09.378047+0000","last_fullsized":"2024-04-16T19:35:09.378047+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:51:22.591585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384362+0000","last_change":"2024-04-16T17:45:20.408473+0000","last_active":"2024-04-16T19:35:49.384362+0000","last_peered":"2024-04-16T19:35:49.384362+0000","last_clean":"2024-04-16T19:35:49.384362+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:35:49.384362+0000","last_undegraded":"2024-04-16T19:35:49.384362+0000","last_fullsized":"2024-04-16T19:35:49.384362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:08.929780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'168","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595653+0000","last_change":"2024-04-16T17:45:22.422298+0000","last_active":"2024-04-16T19:37:54.595653+0000","last_peered":"2024-04-16T19:37:54.595653+0000","last_clean":"2024-04-16T19:37:54.595653+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:37:54.595653+0000","last_undegraded":"2024-04-16T19:37:54.595653+0000","last_fullsized":"2024-04-16T19:37:54.595653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'12","reported_seq":1397,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383571+0000","last_change":"2024-04-16T17:45:24.421136+0000","last_active":"2024-04-16T19:35:44.383571+0000","last_peered":"2024-04-16T19:35:44.383571+0000","last_clean":"2024-04-16T19:35:44.383571+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:35:44.383571+0000","last_undegraded":"2024-04-16T19:35:44.383571+0000","last_fullsized":"2024-04-16T19:35:44.383571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:58:19.841313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.389055+0000","last_change":"2024-04-16T17:45:26.848234+0000","last_active":"2024-04-16T19:36:04.389055+0000","last_peered":"2024-04-16T19:36:04.389055+0000","last_clean":"2024-04-16T19:36:04.389055+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:36:04.389055+0000","last_undegraded":"2024-04-16T19:36:04.389055+0000","last_fullsized":"2024-04-16T19:36:04.389055+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582520+0000","last_change":"2024-04-16T18:09:02.167725+0000","last_active":"2024-04-16T19:36:49.582520+0000","last_peered":"2024-04-16T19:36:49.582520+0000","last_clean":"2024-04-16T19:36:49.582520+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:36:49.582520+0000","last_undegraded":"2024-04-16T19:36:49.582520+0000","last_fullsized":"2024-04-16T19:36:49.582520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1836,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377912+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:35:09.377912+0000","last_peered":"2024-04-16T19:35:09.377912+0000","last_clean":"2024-04-16T19:35:09.377912+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:35:09.377912+0000","last_undegraded":"2024-04-16T19:35:09.377912+0000","last_fullsized":"2024-04-16T19:35:09.377912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:53:10.911757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373250+0000","last_change":"2024-04-16T17:46:17.508698+0000","last_active":"2024-04-16T19:34:39.373250+0000","last_peered":"2024-04-16T19:34:39.373250+0000","last_clean":"2024-04-16T19:34:39.373250+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:34:39.373250+0000","last_undegraded":"2024-04-16T19:34:39.373250+0000","last_fullsized":"2024-04-16T19:34:39.373250+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:01:43.428844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'1","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577340+0000","last_change":"2024-04-16T17:45:51.481009+0000","last_active":"2024-04-16T19:36:24.577340+0000","last_peered":"2024-04-16T19:36:24.577340+0000","last_clean":"2024-04-16T19:36:24.577340+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:36:24.577340+0000","last_undegraded":"2024-04-16T19:36:24.577340+0000","last_fullsized":"2024-04-16T19:36:24.577340+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368296+0000","last_change":"2024-04-16T17:45:49.472070+0000","last_active":"2024-04-16T19:34:09.368296+0000","last_peered":"2024-04-16T19:34:09.368296+0000","last_clean":"2024-04-16T19:34:09.368296+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:34:09.368296+0000","last_undegraded":"2024-04-16T19:34:09.368296+0000","last_fullsized":"2024-04-16T19:34:09.368296+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:41.089795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'322","reported_seq":583,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364288+0000","last_change":"2024-04-16T17:45:47.464210+0000","last_active":"2024-04-16T19:33:49.364288+0000","last_peered":"2024-04-16T19:33:49.364288+0000","last_clean":"2024-04-16T19:33:49.364288+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:33:49.364288+0000","last_undegraded":"2024-04-16T19:33:49.364288+0000","last_fullsized":"2024-04-16T19:33:49.364288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:19.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'20","reported_seq":575,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364941+0000","last_change":"2024-04-16T17:45:45.465938+0000","last_active":"2024-04-16T19:33:49.364941+0000","last_peered":"2024-04-16T19:33:49.364941+0000","last_clean":"2024-04-16T19:33:49.364941+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:33:49.364941+0000","last_undegraded":"2024-04-16T19:33:49.364941+0000","last_fullsized":"2024-04-16T19:33:49.364941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:11:40.527095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403394+0000","last_change":"2024-04-16T17:45:10.400196+0000","last_active":"2024-04-16T19:37:34.403394+0000","last_peered":"2024-04-16T19:37:34.403394+0000","last_clean":"2024-04-16T19:37:34.403394+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:37:34.403394+0000","last_undegraded":"2024-04-16T19:37:34.403394+0000","last_fullsized":"2024-04-16T19:37:34.403394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594796+0000","last_change":"2024-04-16T17:45:08.382982+0000","last_active":"2024-04-16T19:37:49.594796+0000","last_peered":"2024-04-16T19:37:49.594796+0000","last_clean":"2024-04-16T19:37:49.594796+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:37:49.594796+0000","last_undegraded":"2024-04-16T19:37:49.594796+0000","last_fullsized":"2024-04-16T19:37:49.594796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.585551+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T19:37:04.585551+0000","last_peered":"2024-04-16T19:37:04.585551+0000","last_clean":"2024-04-16T19:37:04.585551+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:37:04.585551+0000","last_undegraded":"2024-04-16T19:37:04.585551+0000","last_fullsized":"2024-04-16T19:37:04.585551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"48'3","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384408+0000","last_change":"2024-04-16T17:45:20.407710+0000","last_active":"2024-04-16T19:35:49.384408+0000","last_peered":"2024-04-16T19:35:49.384408+0000","last_clean":"2024-04-16T19:35:49.384408+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:35:49.384408+0000","last_undegraded":"2024-04-16T19:35:49.384408+0000","last_fullsized":"2024-04-16T19:35:49.384408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:05:22.200949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'120","reported_seq":300,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384447+0000","last_change":"2024-04-16T17:45:22.416114+0000","last_active":"2024-04-16T19:35:49.384447+0000","last_peered":"2024-04-16T19:35:49.384447+0000","last_clean":"2024-04-16T19:35:49.384447+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:35:49.384447+0000","last_undegraded":"2024-04-16T19:35:49.384447+0000","last_fullsized":"2024-04-16T19:35:49.384447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:41.992526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'12","reported_seq":1396,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407012+0000","last_change":"2024-04-16T17:45:24.423991+0000","last_active":"2024-04-16T19:37:54.407012+0000","last_peered":"2024-04-16T19:37:54.407012+0000","last_clean":"2024-04-16T19:37:54.407012+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:37:54.407012+0000","last_undegraded":"2024-04-16T19:37:54.407012+0000","last_fullsized":"2024-04-16T19:37:54.407012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407743+0000","last_change":"2024-04-16T17:45:26.847697+0000","last_active":"2024-04-16T19:37:59.407743+0000","last_peered":"2024-04-16T19:37:59.407743+0000","last_clean":"2024-04-16T19:37:59.407743+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:37:59.407743+0000","last_undegraded":"2024-04-16T19:37:59.407743+0000","last_fullsized":"2024-04-16T19:37:59.407743+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977348+0000","last_change":"2024-04-16T18:09:02.166269+0000","last_active":"2024-04-16T19:38:08.977348+0000","last_peered":"2024-04-16T19:38:08.977348+0000","last_clean":"2024-04-16T19:38:08.977348+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:38:08.977348+0000","last_undegraded":"2024-04-16T19:38:08.977348+0000","last_fullsized":"2024-04-16T19:38:08.977348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2089,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395625+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:36:44.395625+0000","last_peered":"2024-04-16T19:36:44.395625+0000","last_clean":"2024-04-16T19:36:44.395625+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:36:44.395625+0000","last_undegraded":"2024-04-16T19:36:44.395625+0000","last_fullsized":"2024-04-16T19:36:44.395625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582395+0000","last_change":"2024-04-16T17:46:17.513695+0000","last_active":"2024-04-16T19:36:49.582395+0000","last_peered":"2024-04-16T19:36:49.582395+0000","last_clean":"2024-04-16T19:36:49.582395+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:36:49.582395+0000","last_undegraded":"2024-04-16T19:36:49.582395+0000","last_fullsized":"2024-04-16T19:36:49.582395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'6","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577422+0000","last_change":"2024-04-16T17:45:51.483674+0000","last_active":"2024-04-16T19:36:24.577422+0000","last_peered":"2024-04-16T19:36:24.577422+0000","last_clean":"2024-04-16T19:36:24.577422+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:36:24.577422+0000","last_undegraded":"2024-04-16T19:36:24.577422+0000","last_fullsized":"2024-04-16T19:36:24.577422+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'651","reported_seq":2202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364275+0000","last_change":"2024-04-16T17:45:49.466697+0000","last_active":"2024-04-16T19:33:49.364275+0000","last_peered":"2024-04-16T19:33:49.364275+0000","last_clean":"2024-04-16T19:33:49.364275+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:33:49.364275+0000","last_undegraded":"2024-04-16T19:33:49.364275+0000","last_fullsized":"2024-04-16T19:33:49.364275+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:59.328751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5527","reported_seq":10317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368349+0000","last_change":"2024-04-16T17:45:47.459919+0000","last_active":"2024-04-16T19:34:09.368349+0000","last_peered":"2024-04-16T19:34:09.368349+0000","last_clean":"2024-04-16T19:34:09.368349+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:34:09.368349+0000","last_undegraded":"2024-04-16T19:34:09.368349+0000","last_fullsized":"2024-04-16T19:34:09.368349+0000","mapping_epoch":33,"log_start":"53'3700","ondisk_log_start":"53'3700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1827,"log_dups_size":3000,"ondisk_log_size":1827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:18.684283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'12","reported_seq":687,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.573449+0000","last_change":"2024-04-16T17:45:45.456575+0000","last_active":"2024-04-16T19:36:04.573449+0000","last_peered":"2024-04-16T19:36:04.573449+0000","last_clean":"2024-04-16T19:36:04.573449+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:36:04.573449+0000","last_undegraded":"2024-04-16T19:36:04.573449+0000","last_fullsized":"2024-04-16T19:36:04.573449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382207+0000","last_change":"2024-04-16T17:45:10.399687+0000","last_active":"2024-04-16T19:35:39.382207+0000","last_peered":"2024-04-16T19:35:39.382207+0000","last_clean":"2024-04-16T19:35:39.382207+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:35:39.382207+0000","last_undegraded":"2024-04-16T19:35:39.382207+0000","last_fullsized":"2024-04-16T19:35:39.382207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:06:09.857567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406184+0000","last_change":"2024-04-16T17:45:08.381368+0000","last_active":"2024-04-16T19:37:49.406184+0000","last_peered":"2024-04-16T19:37:49.406184+0000","last_clean":"2024-04-16T19:37:49.406184+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:37:49.406184+0000","last_undegraded":"2024-04-16T19:37:49.406184+0000","last_fullsized":"2024-04-16T19:37:49.406184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375597+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:34:54.375597+0000","last_peered":"2024-04-16T19:34:54.375597+0000","last_clean":"2024-04-16T19:34:54.375597+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:34:54.375597+0000","last_undegraded":"2024-04-16T19:34:54.375597+0000","last_fullsized":"2024-04-16T19:34:54.375597+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:37.225695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'1","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592560+0000","last_change":"2024-04-16T17:45:20.403582+0000","last_active":"2024-04-16T19:37:39.592560+0000","last_peered":"2024-04-16T19:37:39.592560+0000","last_clean":"2024-04-16T19:37:39.592560+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:37:39.592560+0000","last_undegraded":"2024-04-16T19:37:39.592560+0000","last_fullsized":"2024-04-16T19:37:39.592560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'144","reported_seq":351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.383684+0000","last_change":"2024-04-16T17:45:22.414745+0000","last_active":"2024-04-16T19:35:49.383684+0000","last_peered":"2024-04-16T19:35:49.383684+0000","last_clean":"2024-04-16T19:35:49.383684+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:35:49.383684+0000","last_undegraded":"2024-04-16T19:35:49.383684+0000","last_fullsized":"2024-04-16T19:35:49.383684+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:39.722446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595723+0000","last_change":"2024-04-16T17:45:24.425364+0000","last_active":"2024-04-16T19:37:54.595723+0000","last_peered":"2024-04-16T19:37:54.595723+0000","last_clean":"2024-04-16T19:37:54.595723+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:37:54.595723+0000","last_undegraded":"2024-04-16T19:37:54.595723+0000","last_fullsized":"2024-04-16T19:37:54.595723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383746+0000","last_change":"2024-04-16T17:45:26.438987+0000","last_active":"2024-04-16T19:35:44.383746+0000","last_peered":"2024-04-16T19:35:44.383746+0000","last_clean":"2024-04-16T19:35:44.383746+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:35:44.383746+0000","last_undegraded":"2024-04-16T19:35:44.383746+0000","last_fullsized":"2024-04-16T19:35:44.383746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:46.197032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.388839+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:36:04.388839+0000","last_peered":"2024-04-16T19:36:04.388839+0000","last_clean":"2024-04-16T19:36:04.388839+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:36:04.388839+0000","last_undegraded":"2024-04-16T19:36:04.388839+0000","last_fullsized":"2024-04-16T19:36:04.388839+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'101","reported_seq":1735,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381973+0000","last_change":"2024-04-16T17:46:25.527509+0000","last_active":"2024-04-16T19:35:34.381973+0000","last_peered":"2024-04-16T19:35:34.381973+0000","last_clean":"2024-04-16T19:35:34.381973+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:35:34.381973+0000","last_undegraded":"2024-04-16T19:35:34.381973+0000","last_fullsized":"2024-04-16T19:35:34.381973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:21:20.635118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576472+0000","last_change":"2024-04-16T17:46:17.509709+0000","last_active":"2024-04-16T19:36:19.576472+0000","last_peered":"2024-04-16T19:36:19.576472+0000","last_clean":"2024-04-16T19:36:19.576472+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:36:19.576472+0000","last_undegraded":"2024-04-16T19:36:19.576472+0000","last_fullsized":"2024-04-16T19:36:19.576472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'19","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359896+0000","last_change":"2024-04-16T17:45:51.477907+0000","last_active":"2024-04-16T19:33:24.359896+0000","last_peered":"2024-04-16T19:33:24.359896+0000","last_clean":"2024-04-16T19:33:24.359896+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:33:24.359896+0000","last_undegraded":"2024-04-16T19:33:24.359896+0000","last_fullsized":"2024-04-16T19:33:24.359896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:36.428648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359952+0000","last_change":"2024-04-16T17:45:49.470293+0000","last_active":"2024-04-16T19:33:19.359952+0000","last_peered":"2024-04-16T19:33:19.359952+0000","last_clean":"2024-04-16T19:33:19.359952+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:33:19.359952+0000","last_undegraded":"2024-04-16T19:33:19.359952+0000","last_fullsized":"2024-04-16T19:33:19.359952+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:26:00.700374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'320","reported_seq":621,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359234+0000","last_change":"2024-04-16T17:45:47.462032+0000","last_active":"2024-04-16T19:33:19.359234+0000","last_peered":"2024-04-16T19:33:19.359234+0000","last_clean":"2024-04-16T19:33:19.359234+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:33:19.359234+0000","last_undegraded":"2024-04-16T19:33:19.359234+0000","last_fullsized":"2024-04-16T19:33:19.359234+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:07:03.652770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'7","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069470+0000","last_change":"2024-04-16T17:45:45.462463+0000","last_active":"2024-04-16T19:38:08.069470+0000","last_peered":"2024-04-16T19:38:08.069470+0000","last_clean":"2024-04-16T19:38:08.069470+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:38:08.069470+0000","last_undegraded":"2024-04-16T19:38:08.069470+0000","last_fullsized":"2024-04-16T19:38:08.069470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407815+0000","last_change":"2024-04-16T17:45:26.438380+0000","last_active":"2024-04-16T19:37:59.407815+0000","last_peered":"2024-04-16T19:37:59.407815+0000","last_clean":"2024-04-16T19:37:59.407815+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:37:59.407815+0000","last_undegraded":"2024-04-16T19:37:59.407815+0000","last_fullsized":"2024-04-16T19:37:59.407815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.374918+0000","last_change":"2024-04-16T17:45:10.393485+0000","last_active":"2024-04-16T19:34:54.374918+0000","last_peered":"2024-04-16T19:34:54.374918+0000","last_clean":"2024-04-16T19:34:54.374918+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:34:54.374918+0000","last_undegraded":"2024-04-16T19:34:54.374918+0000","last_fullsized":"2024-04-16T19:34:54.374918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:53:39.589700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.378001+0000","last_change":"2024-04-16T17:45:08.386299+0000","last_active":"2024-04-16T19:35:09.378001+0000","last_peered":"2024-04-16T19:35:09.378001+0000","last_clean":"2024-04-16T19:35:09.378001+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:35:09.378001+0000","last_undegraded":"2024-04-16T19:35:09.378001+0000","last_fullsized":"2024-04-16T19:35:09.378001+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:20:58.450960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"30'1","reported_seq":210,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589587+0000","last_change":"2024-04-16T17:45:20.412485+0000","last_active":"2024-04-16T19:37:24.589587+0000","last_peered":"2024-04-16T19:37:24.589587+0000","last_clean":"2024-04-16T19:37:24.589587+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:37:24.589587+0000","last_undegraded":"2024-04-16T19:37:24.589587+0000","last_fullsized":"2024-04-16T19:37:24.589587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'104","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589523+0000","last_change":"2024-04-16T17:45:22.416196+0000","last_active":"2024-04-16T19:37:24.589523+0000","last_peered":"2024-04-16T19:37:24.589523+0000","last_clean":"2024-04-16T19:37:24.589523+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:37:24.589523+0000","last_undegraded":"2024-04-16T19:37:24.589523+0000","last_fullsized":"2024-04-16T19:37:24.589523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589517+0000","last_change":"2024-04-16T17:45:24.424718+0000","last_active":"2024-04-16T19:37:24.589517+0000","last_peered":"2024-04-16T19:37:24.589517+0000","last_clean":"2024-04-16T19:37:24.589517+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:37:24.589517+0000","last_undegraded":"2024-04-16T19:37:24.589517+0000","last_fullsized":"2024-04-16T19:37:24.589517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365069+0000","last_change":"2024-04-16T18:09:02.165652+0000","last_active":"2024-04-16T19:33:54.365069+0000","last_peered":"2024-04-16T19:33:54.365069+0000","last_clean":"2024-04-16T19:33:54.365069+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:33:54.365069+0000","last_undegraded":"2024-04-16T19:33:54.365069+0000","last_fullsized":"2024-04-16T19:33:54.365069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:43:38.642286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'147","reported_seq":1631,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592501+0000","last_change":"2024-04-16T17:46:25.533095+0000","last_active":"2024-04-16T19:37:39.592501+0000","last_peered":"2024-04-16T19:37:39.592501+0000","last_clean":"2024-04-16T19:37:39.592501+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:37:39.592501+0000","last_undegraded":"2024-04-16T19:37:39.592501+0000","last_fullsized":"2024-04-16T19:37:39.592501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364167+0000","last_change":"2024-04-16T17:46:17.509499+0000","last_active":"2024-04-16T19:33:49.364167+0000","last_peered":"2024-04-16T19:33:49.364167+0000","last_clean":"2024-04-16T19:33:49.364167+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:33:49.364167+0000","last_undegraded":"2024-04-16T19:33:49.364167+0000","last_fullsized":"2024-04-16T19:33:49.364167+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:13:29.073777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'12","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:24.359843+0000","last_change":"2024-04-16T17:47:16.567012+0000","last_active":"2024-04-16T19:33:24.359843+0000","last_peered":"2024-04-16T19:33:24.359843+0000","last_clean":"2024-04-16T19:33:24.359843+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:33:24.359843+0000","last_undegraded":"2024-04-16T19:33:24.359843+0000","last_fullsized":"2024-04-16T19:33:24.359843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:40:10.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.360192+0000","last_change":"2024-04-16T17:45:49.471808+0000","last_active":"2024-04-16T19:33:19.360192+0000","last_peered":"2024-04-16T19:33:19.360192+0000","last_clean":"2024-04-16T19:33:19.360192+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:33:19.360192+0000","last_undegraded":"2024-04-16T19:33:19.360192+0000","last_fullsized":"2024-04-16T19:33:19.360192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:49:34.249301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'442","reported_seq":2030,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:19.359929+0000","last_change":"2024-04-16T17:45:47.465673+0000","last_active":"2024-04-16T19:33:19.359929+0000","last_peered":"2024-04-16T19:33:19.359929+0000","last_clean":"2024-04-16T19:33:19.359929+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:33:19.359929+0000","last_undegraded":"2024-04-16T19:33:19.359929+0000","last_fullsized":"2024-04-16T19:33:19.359929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:53.982530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'17","reported_seq":462,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575593+0000","last_change":"2024-04-16T17:45:45.465670+0000","last_active":"2024-04-16T19:36:14.575593+0000","last_peered":"2024-04-16T19:36:14.575593+0000","last_clean":"2024-04-16T19:36:14.575593+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:36:14.575593+0000","last_undegraded":"2024-04-16T19:36:14.575593+0000","last_fullsized":"2024-04-16T19:36:14.575593+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593803+0000","last_change":"2024-04-16T17:45:26.432878+0000","last_active":"2024-04-16T19:37:44.593803+0000","last_peered":"2024-04-16T19:37:44.593803+0000","last_clean":"2024-04-16T19:37:44.593803+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:37:44.593803+0000","last_undegraded":"2024-04-16T19:37:44.593803+0000","last_fullsized":"2024-04-16T19:37:44.593803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587504+0000","last_change":"2024-04-16T17:45:10.394503+0000","last_active":"2024-04-16T19:37:14.587504+0000","last_peered":"2024-04-16T19:37:14.587504+0000","last_clean":"2024-04-16T19:37:14.587504+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:37:14.587504+0000","last_undegraded":"2024-04-16T19:37:14.587504+0000","last_fullsized":"2024-04-16T19:37:14.587504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365715+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:33:54.365715+0000","last_peered":"2024-04-16T19:33:54.365715+0000","last_clean":"2024-04-16T19:33:54.365715+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:33:54.365715+0000","last_undegraded":"2024-04-16T19:33:54.365715+0000","last_fullsized":"2024-04-16T19:33:54.365715+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:22:45.243544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'1","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589634+0000","last_change":"2024-04-16T17:45:20.407788+0000","last_active":"2024-04-16T19:37:24.589634+0000","last_peered":"2024-04-16T19:37:24.589634+0000","last_clean":"2024-04-16T19:37:24.589634+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:37:24.589634+0000","last_undegraded":"2024-04-16T19:37:24.589634+0000","last_fullsized":"2024-04-16T19:37:24.589634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'50","reported_seq":189,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.401888+0000","last_change":"2024-04-16T17:45:22.421476+0000","last_active":"2024-04-16T19:37:24.401888+0000","last_peered":"2024-04-16T19:37:24.401888+0000","last_clean":"2024-04-16T19:37:24.401888+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:37:24.401888+0000","last_undegraded":"2024-04-16T19:37:24.401888+0000","last_fullsized":"2024-04-16T19:37:24.401888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376965+0000","last_change":"2024-04-16T17:45:24.430870+0000","last_active":"2024-04-16T19:35:04.376965+0000","last_peered":"2024-04-16T19:35:04.376965+0000","last_clean":"2024-04-16T19:35:04.376965+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:35:04.376965+0000","last_undegraded":"2024-04-16T19:35:04.376965+0000","last_fullsized":"2024-04-16T19:35:04.376965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:19.161308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":51,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367440+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:34:04.367440+0000","last_peered":"2024-04-16T19:34:04.367440+0000","last_clean":"2024-04-16T19:34:04.367440+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:34:04.367440+0000","last_undegraded":"2024-04-16T19:34:04.367440+0000","last_fullsized":"2024-04-16T19:34:04.367440+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:38.119812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'109","reported_seq":1797,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.578457+0000","last_change":"2024-04-16T17:46:25.527453+0000","last_active":"2024-04-16T19:36:29.578457+0000","last_peered":"2024-04-16T19:36:29.578457+0000","last_clean":"2024-04-16T19:36:29.578457+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:36:29.578457+0000","last_undegraded":"2024-04-16T19:36:29.578457+0000","last_fullsized":"2024-04-16T19:36:29.578457+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376799+0000","last_change":"2024-04-16T17:46:17.506081+0000","last_active":"2024-04-16T19:35:04.376799+0000","last_peered":"2024-04-16T19:35:04.376799+0000","last_clean":"2024-04-16T19:35:04.376799+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:35:04.376799+0000","last_undegraded":"2024-04-16T19:35:04.376799+0000","last_fullsized":"2024-04-16T19:35:04.376799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:44:37.801667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'14","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.401920+0000","last_change":"2024-04-16T17:45:51.484484+0000","last_active":"2024-04-16T19:37:24.401920+0000","last_peered":"2024-04-16T19:37:24.401920+0000","last_clean":"2024-04-16T19:37:24.401920+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:37:24.401920+0000","last_undegraded":"2024-04-16T19:37:24.401920+0000","last_fullsized":"2024-04-16T19:37:24.401920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.387521+0000","last_change":"2024-04-16T17:45:49.473382+0000","last_active":"2024-04-16T19:36:09.387521+0000","last_peered":"2024-04-16T19:36:09.387521+0000","last_clean":"2024-04-16T19:36:09.387521+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:36:09.387521+0000","last_undegraded":"2024-04-16T19:36:09.387521+0000","last_fullsized":"2024-04-16T19:36:09.387521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:06:18.012352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'659","reported_seq":2170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368312+0000","last_change":"2024-04-16T17:45:47.461388+0000","last_active":"2024-04-16T19:34:09.368312+0000","last_peered":"2024-04-16T19:34:09.368312+0000","last_clean":"2024-04-16T19:34:09.368312+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:34:09.368312+0000","last_undegraded":"2024-04-16T19:34:09.368312+0000","last_fullsized":"2024-04-16T19:34:09.368312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:49.038328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'31","reported_seq":358,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386532+0000","last_change":"2024-04-16T17:45:45.467998+0000","last_active":"2024-04-16T19:35:49.386532+0000","last_peered":"2024-04-16T19:35:49.386532+0000","last_clean":"2024-04-16T19:35:49.386532+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:35:49.386532+0000","last_undegraded":"2024-04-16T19:35:49.386532+0000","last_fullsized":"2024-04-16T19:35:49.386532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407774+0000","last_change":"2024-04-16T17:45:26.427816+0000","last_active":"2024-04-16T19:37:59.407774+0000","last_peered":"2024-04-16T19:37:59.407774+0000","last_clean":"2024-04-16T19:37:59.407774+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:37:59.407774+0000","last_undegraded":"2024-04-16T19:37:59.407774+0000","last_fullsized":"2024-04-16T19:37:59.407774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587429+0000","last_change":"2024-04-16T17:45:10.395061+0000","last_active":"2024-04-16T19:37:14.587429+0000","last_peered":"2024-04-16T19:37:14.587429+0000","last_clean":"2024-04-16T19:37:14.587429+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:37:14.587429+0000","last_undegraded":"2024-04-16T19:37:14.587429+0000","last_fullsized":"2024-04-16T19:37:14.587429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365780+0000","last_change":"2024-04-16T17:45:08.389656+0000","last_active":"2024-04-16T19:33:54.365780+0000","last_peered":"2024-04-16T19:33:54.365780+0000","last_clean":"2024-04-16T19:33:54.365780+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:33:54.365780+0000","last_undegraded":"2024-04-16T19:33:54.365780+0000","last_fullsized":"2024-04-16T19:33:54.365780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:58.984483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376423+0000","last_change":"2024-04-16T17:45:20.407054+0000","last_active":"2024-04-16T19:35:04.376423+0000","last_peered":"2024-04-16T19:35:04.376423+0000","last_clean":"2024-04-16T19:35:04.376423+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:35:04.376423+0000","last_undegraded":"2024-04-16T19:35:04.376423+0000","last_fullsized":"2024-04-16T19:35:04.376423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:14.285286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'104","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589631+0000","last_change":"2024-04-16T17:45:22.415814+0000","last_active":"2024-04-16T19:37:24.589631+0000","last_peered":"2024-04-16T19:37:24.589631+0000","last_clean":"2024-04-16T19:37:24.589631+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:37:24.589631+0000","last_undegraded":"2024-04-16T19:37:24.589631+0000","last_fullsized":"2024-04-16T19:37:24.589631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376882+0000","last_change":"2024-04-16T17:45:24.425524+0000","last_active":"2024-04-16T19:35:04.376882+0000","last_peered":"2024-04-16T19:35:04.376882+0000","last_clean":"2024-04-16T19:35:04.376882+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:35:04.376882+0000","last_undegraded":"2024-04-16T19:35:04.376882+0000","last_fullsized":"2024-04-16T19:35:04.376882+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:50:17.147197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":74,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:04.367227+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:34:04.367227+0000","last_peered":"2024-04-16T19:34:04.367227+0000","last_clean":"2024-04-16T19:34:04.367227+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:34:04.367227+0000","last_undegraded":"2024-04-16T19:34:04.367227+0000","last_fullsized":"2024-04-16T19:34:04.367227+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:36.222063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2058,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393038+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:36:29.393038+0000","last_peered":"2024-04-16T19:36:29.393038+0000","last_clean":"2024-04-16T19:36:29.393038+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:36:29.393038+0000","last_undegraded":"2024-04-16T19:36:29.393038+0000","last_fullsized":"2024-04-16T19:36:29.393038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593433+0000","last_change":"2024-04-16T17:46:17.512965+0000","last_active":"2024-04-16T19:37:44.593433+0000","last_peered":"2024-04-16T19:37:44.593433+0000","last_clean":"2024-04-16T19:37:44.593433+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:37:44.593433+0000","last_undegraded":"2024-04-16T19:37:44.593433+0000","last_fullsized":"2024-04-16T19:37:44.593433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'12","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.585350+0000","last_change":"2024-04-16T17:45:51.477961+0000","last_active":"2024-04-16T19:37:04.585350+0000","last_peered":"2024-04-16T19:37:04.585350+0000","last_clean":"2024-04-16T19:37:04.585350+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:37:04.585350+0000","last_undegraded":"2024-04-16T19:37:04.585350+0000","last_fullsized":"2024-04-16T19:37:04.585350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'651","reported_seq":2195,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575582+0000","last_change":"2024-04-16T17:45:49.469998+0000","last_active":"2024-04-16T19:36:14.575582+0000","last_peered":"2024-04-16T19:36:14.575582+0000","last_clean":"2024-04-16T19:36:14.575582+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:36:14.575582+0000","last_undegraded":"2024-04-16T19:36:14.575582+0000","last_fullsized":"2024-04-16T19:36:14.575582+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'720","reported_seq":3526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069589+0000","last_change":"2024-04-16T17:45:47.463990+0000","last_active":"2024-04-16T19:38:08.069589+0000","last_peered":"2024-04-16T19:38:08.069589+0000","last_clean":"2024-04-16T19:38:08.069589+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:38:08.069589+0000","last_undegraded":"2024-04-16T19:38:08.069589+0000","last_fullsized":"2024-04-16T19:38:08.069589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'9","reported_seq":283,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.386550+0000","last_change":"2024-04-16T17:45:45.465394+0000","last_active":"2024-04-16T19:35:49.386550+0000","last_peered":"2024-04-16T19:35:49.386550+0000","last_clean":"2024-04-16T19:35:49.386550+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:35:49.386550+0000","last_undegraded":"2024-04-16T19:35:49.386550+0000","last_fullsized":"2024-04-16T19:35:49.386550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381373+0000","last_change":"2024-04-16T17:45:26.438413+0000","last_active":"2024-04-16T19:35:29.381373+0000","last_peered":"2024-04-16T19:35:29.381373+0000","last_clean":"2024-04-16T19:35:29.381373+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:35:29.381373+0000","last_undegraded":"2024-04-16T19:35:29.381373+0000","last_fullsized":"2024-04-16T19:35:29.381373+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:29.732765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587391+0000","last_change":"2024-04-16T17:45:10.402839+0000","last_active":"2024-04-16T19:37:14.587391+0000","last_peered":"2024-04-16T19:37:14.587391+0000","last_clean":"2024-04-16T19:37:14.587391+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:37:14.587391+0000","last_undegraded":"2024-04-16T19:37:14.587391+0000","last_fullsized":"2024-04-16T19:37:14.587391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391498+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:36:19.391498+0000","last_peered":"2024-04-16T19:36:19.391498+0000","last_clean":"2024-04-16T19:36:19.391498+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:36:19.391498+0000","last_undegraded":"2024-04-16T19:36:19.391498+0000","last_fullsized":"2024-04-16T19:36:19.391498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"48'4","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376995+0000","last_change":"2024-04-16T17:45:20.413469+0000","last_active":"2024-04-16T19:35:04.376995+0000","last_peered":"2024-04-16T19:35:04.376995+0000","last_clean":"2024-04-16T19:35:04.376995+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:35:04.376995+0000","last_undegraded":"2024-04-16T19:35:04.376995+0000","last_fullsized":"2024-04-16T19:35:04.376995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:49:00.814146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'80","reported_seq":239,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376922+0000","last_change":"2024-04-16T17:45:22.415761+0000","last_active":"2024-04-16T19:35:04.376922+0000","last_peered":"2024-04-16T19:35:04.376922+0000","last_clean":"2024-04-16T19:35:04.376922+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:35:04.376922+0000","last_undegraded":"2024-04-16T19:35:04.376922+0000","last_fullsized":"2024-04-16T19:35:04.376922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:07:17.485768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.401993+0000","last_change":"2024-04-16T17:45:24.426374+0000","last_active":"2024-04-16T19:37:24.401993+0000","last_peered":"2024-04-16T19:37:24.401993+0000","last_clean":"2024-04-16T19:37:24.401993+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:37:24.401993+0000","last_undegraded":"2024-04-16T19:37:24.401993+0000","last_fullsized":"2024-04-16T19:37:24.401993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382870+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:35:39.382870+0000","last_peered":"2024-04-16T19:35:39.382870+0000","last_clean":"2024-04-16T19:35:39.382870+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:35:39.382870+0000","last_undegraded":"2024-04-16T19:35:39.382870+0000","last_fullsized":"2024-04-16T19:35:39.382870+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:42:01.886612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'112","reported_seq":1493,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378892+0000","last_change":"2024-04-16T17:46:25.525571+0000","last_active":"2024-04-16T19:35:14.378892+0000","last_peered":"2024-04-16T19:35:14.378892+0000","last_clean":"2024-04-16T19:35:14.378892+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:35:14.378892+0000","last_undegraded":"2024-04-16T19:35:14.378892+0000","last_fullsized":"2024-04-16T19:35:14.378892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:13:09.115332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.402802+0000","last_change":"2024-04-16T17:46:17.504593+0000","last_active":"2024-04-16T19:37:29.402802+0000","last_peered":"2024-04-16T19:37:29.402802+0000","last_clean":"2024-04-16T19:37:29.402802+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:37:29.402802+0000","last_undegraded":"2024-04-16T19:37:29.402802+0000","last_fullsized":"2024-04-16T19:37:29.402802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"51'2","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372544+0000","last_change":"2024-04-16T17:45:51.480201+0000","last_active":"2024-04-16T19:34:39.372544+0000","last_peered":"2024-04-16T19:34:39.372544+0000","last_clean":"2024-04-16T19:34:39.372544+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:34:39.372544+0000","last_undegraded":"2024-04-16T19:34:39.372544+0000","last_fullsized":"2024-04-16T19:34:39.372544+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:45.935071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406026+0000","last_change":"2024-04-16T17:45:49.476432+0000","last_active":"2024-04-16T19:37:49.406026+0000","last_peered":"2024-04-16T19:37:49.406026+0000","last_clean":"2024-04-16T19:37:49.406026+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:37:49.406026+0000","last_undegraded":"2024-04-16T19:37:49.406026+0000","last_fullsized":"2024-04-16T19:37:49.406026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'369","reported_seq":693,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381232+0000","last_change":"2024-04-16T17:45:47.464967+0000","last_active":"2024-04-16T19:35:29.381232+0000","last_peered":"2024-04-16T19:35:29.381232+0000","last_clean":"2024-04-16T19:35:29.381232+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:35:29.381232+0000","last_undegraded":"2024-04-16T19:35:29.381232+0000","last_fullsized":"2024-04-16T19:35:29.381232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:24:39.367104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'16","reported_seq":322,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381287+0000","last_change":"2024-04-16T17:45:45.461625+0000","last_active":"2024-04-16T19:35:29.381287+0000","last_peered":"2024-04-16T19:35:29.381287+0000","last_clean":"2024-04-16T19:35:29.381287+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:35:29.381287+0000","last_undegraded":"2024-04-16T19:35:29.381287+0000","last_fullsized":"2024-04-16T19:35:29.381287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:52:34.843168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382983+0000","last_change":"2024-04-16T17:45:10.396745+0000","last_active":"2024-04-16T19:35:39.382983+0000","last_peered":"2024-04-16T19:35:39.382983+0000","last_clean":"2024-04-16T19:35:39.382983+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:35:39.382983+0000","last_undegraded":"2024-04-16T19:35:39.382983+0000","last_fullsized":"2024-04-16T19:35:39.382983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:40.062822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576386+0000","last_change":"2024-04-16T17:45:08.384480+0000","last_active":"2024-04-16T19:36:19.576386+0000","last_peered":"2024-04-16T19:36:19.576386+0000","last_clean":"2024-04-16T19:36:19.576386+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:36:19.576386+0000","last_undegraded":"2024-04-16T19:36:19.576386+0000","last_fullsized":"2024-04-16T19:36:19.576386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405292+0000","last_change":"2024-04-16T17:45:20.414382+0000","last_active":"2024-04-16T19:37:44.405292+0000","last_peered":"2024-04-16T19:37:44.405292+0000","last_clean":"2024-04-16T19:37:44.405292+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:37:44.405292+0000","last_undegraded":"2024-04-16T19:37:44.405292+0000","last_fullsized":"2024-04-16T19:37:44.405292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'88","reported_seq":254,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595941+0000","last_change":"2024-04-16T17:45:22.421515+0000","last_active":"2024-04-16T19:37:54.595941+0000","last_peered":"2024-04-16T19:37:54.595941+0000","last_clean":"2024-04-16T19:37:54.595941+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:37:54.595941+0000","last_undegraded":"2024-04-16T19:37:54.595941+0000","last_fullsized":"2024-04-16T19:37:54.595941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380602+0000","last_change":"2024-04-16T17:45:24.425946+0000","last_active":"2024-04-16T19:35:24.380602+0000","last_peered":"2024-04-16T19:35:24.380602+0000","last_clean":"2024-04-16T19:35:24.380602+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:35:24.380602+0000","last_undegraded":"2024-04-16T19:35:24.380602+0000","last_fullsized":"2024-04-16T19:35:24.380602+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:06.451179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.590722+0000","last_change":"2024-04-16T17:45:26.849050+0000","last_active":"2024-04-16T19:37:29.590722+0000","last_peered":"2024-04-16T19:37:29.590722+0000","last_clean":"2024-04-16T19:37:29.590722+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:37:29.590722+0000","last_undegraded":"2024-04-16T19:37:29.590722+0000","last_fullsized":"2024-04-16T19:37:29.590722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363192+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:33:39.363192+0000","last_peered":"2024-04-16T19:33:39.363192+0000","last_clean":"2024-04-16T19:33:39.363192+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:33:39.363192+0000","last_undegraded":"2024-04-16T19:33:39.363192+0000","last_fullsized":"2024-04-16T19:33:39.363192+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:56.767294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'112","reported_seq":1323,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367908+0000","last_change":"2024-04-16T17:46:25.530104+0000","last_active":"2024-04-16T19:34:09.367908+0000","last_peered":"2024-04-16T19:34:09.367908+0000","last_clean":"2024-04-16T19:34:09.367908+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:34:09.367908+0000","last_undegraded":"2024-04-16T19:34:09.367908+0000","last_fullsized":"2024-04-16T19:34:09.367908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:48:32.234084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.377062+0000","last_change":"2024-04-16T17:46:17.511681+0000","last_active":"2024-04-16T19:35:04.377062+0000","last_peered":"2024-04-16T19:35:04.377062+0000","last_clean":"2024-04-16T19:35:04.377062+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:35:04.377062+0000","last_undegraded":"2024-04-16T19:35:04.377062+0000","last_fullsized":"2024-04-16T19:35:04.377062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:52:02.027921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"48'9","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373396+0000","last_change":"2024-04-16T17:45:51.480247+0000","last_active":"2024-04-16T19:34:39.373396+0000","last_peered":"2024-04-16T19:34:39.373396+0000","last_clean":"2024-04-16T19:34:39.373396+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:34:39.373396+0000","last_undegraded":"2024-04-16T19:34:39.373396+0000","last_fullsized":"2024-04-16T19:34:39.373396+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:54:20.973364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594637+0000","last_change":"2024-04-16T17:45:49.469762+0000","last_active":"2024-04-16T19:37:49.594637+0000","last_peered":"2024-04-16T19:37:49.594637+0000","last_clean":"2024-04-16T19:37:49.594637+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:37:49.594637+0000","last_undegraded":"2024-04-16T19:37:49.594637+0000","last_fullsized":"2024-04-16T19:37:49.594637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'216","reported_seq":394,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380298+0000","last_change":"2024-04-16T17:45:47.460038+0000","last_active":"2024-04-16T19:35:29.380298+0000","last_peered":"2024-04-16T19:35:29.380298+0000","last_clean":"2024-04-16T19:35:29.380298+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:35:29.380298+0000","last_undegraded":"2024-04-16T19:35:29.380298+0000","last_fullsized":"2024-04-16T19:35:29.380298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:51:10.033074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'24","reported_seq":472,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.372382+0000","last_change":"2024-04-16T17:47:16.558050+0000","last_active":"2024-04-16T19:34:39.372382+0000","last_peered":"2024-04-16T19:34:39.372382+0000","last_clean":"2024-04-16T19:34:39.372382+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:34:39.372382+0000","last_undegraded":"2024-04-16T19:34:39.372382+0000","last_fullsized":"2024-04-16T19:34:39.372382+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:03.406041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403553+0000","last_change":"2024-04-16T17:45:10.400195+0000","last_active":"2024-04-16T19:37:34.403553+0000","last_peered":"2024-04-16T19:37:34.403553+0000","last_clean":"2024-04-16T19:37:34.403553+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:37:34.403553+0000","last_undegraded":"2024-04-16T19:37:34.403553+0000","last_fullsized":"2024-04-16T19:37:34.403553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579382+0000","last_change":"2024-04-16T17:45:08.388718+0000","last_active":"2024-04-16T19:36:34.579382+0000","last_peered":"2024-04-16T19:36:34.579382+0000","last_clean":"2024-04-16T19:36:34.579382+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:36:34.579382+0000","last_undegraded":"2024-04-16T19:36:34.579382+0000","last_fullsized":"2024-04-16T19:36:34.579382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'2","reported_seq":562,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384626+0000","last_change":"2024-04-16T17:45:20.407653+0000","last_active":"2024-04-16T19:35:49.384626+0000","last_peered":"2024-04-16T19:35:49.384626+0000","last_clean":"2024-04-16T19:35:49.384626+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:35:49.384626+0000","last_undegraded":"2024-04-16T19:35:49.384626+0000","last_fullsized":"2024-04-16T19:35:49.384626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:10.523626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'152","reported_seq":344,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380618+0000","last_change":"2024-04-16T17:45:22.417131+0000","last_active":"2024-04-16T19:35:24.380618+0000","last_peered":"2024-04-16T19:35:24.380618+0000","last_clean":"2024-04-16T19:35:24.380618+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:35:24.380618+0000","last_undegraded":"2024-04-16T19:35:24.380618+0000","last_fullsized":"2024-04-16T19:35:24.380618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:45.675762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595926+0000","last_change":"2024-04-16T17:45:24.427273+0000","last_active":"2024-04-16T19:37:54.595926+0000","last_peered":"2024-04-16T19:37:54.595926+0000","last_clean":"2024-04-16T19:37:54.595926+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:37:54.595926+0000","last_undegraded":"2024-04-16T19:37:54.595926+0000","last_fullsized":"2024-04-16T19:37:54.595926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377945+0000","last_change":"2024-04-16T17:45:26.849595+0000","last_active":"2024-04-16T19:35:09.377945+0000","last_peered":"2024-04-16T19:35:09.377945+0000","last_clean":"2024-04-16T19:35:09.377945+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:35:09.377945+0000","last_undegraded":"2024-04-16T19:35:09.377945+0000","last_fullsized":"2024-04-16T19:35:09.377945+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:50:01.653239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.389034+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:36:04.389034+0000","last_peered":"2024-04-16T19:36:04.389034+0000","last_clean":"2024-04-16T19:36:04.389034+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:36:04.389034+0000","last_undegraded":"2024-04-16T19:36:04.389034+0000","last_fullsized":"2024-04-16T19:36:04.389034+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'110","reported_seq":1958,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592872+0000","last_change":"2024-04-16T17:46:25.522673+0000","last_active":"2024-04-16T19:37:39.592872+0000","last_peered":"2024-04-16T19:37:39.592872+0000","last_clean":"2024-04-16T19:37:39.592872+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:37:39.592872+0000","last_undegraded":"2024-04-16T19:37:39.592872+0000","last_fullsized":"2024-04-16T19:37:39.592872+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391395+0000","last_change":"2024-04-16T17:46:17.504674+0000","last_active":"2024-04-16T19:36:19.391395+0000","last_peered":"2024-04-16T19:36:19.391395+0000","last_clean":"2024-04-16T19:36:19.391395+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:36:19.391395+0000","last_undegraded":"2024-04-16T19:36:19.391395+0000","last_fullsized":"2024-04-16T19:36:19.391395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"48'3","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:39.373369+0000","last_change":"2024-04-16T17:45:51.482374+0000","last_active":"2024-04-16T19:34:39.373369+0000","last_peered":"2024-04-16T19:34:39.373369+0000","last_clean":"2024-04-16T19:34:39.373369+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:34:39.373369+0000","last_undegraded":"2024-04-16T19:34:39.373369+0000","last_fullsized":"2024-04-16T19:34:39.373369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:17:35.709508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'20","reported_seq":1478,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381300+0000","last_change":"2024-04-16T17:45:49.473331+0000","last_active":"2024-04-16T19:35:29.381300+0000","last_peered":"2024-04-16T19:35:29.381300+0000","last_clean":"2024-04-16T19:35:29.381300+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:35:29.381300+0000","last_undegraded":"2024-04-16T19:35:29.381300+0000","last_fullsized":"2024-04-16T19:35:29.381300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:44:55.367803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'661","reported_seq":3302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594723+0000","last_change":"2024-04-16T17:45:47.459310+0000","last_active":"2024-04-16T19:37:49.594723+0000","last_peered":"2024-04-16T19:37:49.594723+0000","last_clean":"2024-04-16T19:37:49.594723+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:37:49.594723+0000","last_undegraded":"2024-04-16T19:37:49.594723+0000","last_fullsized":"2024-04-16T19:37:49.594723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'6","reported_seq":503,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380329+0000","last_change":"2024-04-16T17:45:45.461393+0000","last_active":"2024-04-16T19:35:29.380329+0000","last_peered":"2024-04-16T19:35:29.380329+0000","last_clean":"2024-04-16T19:35:29.380329+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:35:29.380329+0000","last_undegraded":"2024-04-16T19:35:29.380329+0000","last_fullsized":"2024-04-16T19:35:29.380329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:34:06.206396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405254+0000","last_change":"2024-04-16T17:45:10.393491+0000","last_active":"2024-04-16T19:37:44.405254+0000","last_peered":"2024-04-16T19:37:44.405254+0000","last_clean":"2024-04-16T19:37:44.405254+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:37:44.405254+0000","last_undegraded":"2024-04-16T19:37:44.405254+0000","last_fullsized":"2024-04-16T19:37:44.405254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377316+0000","last_change":"2024-04-16T17:45:08.380598+0000","last_active":"2024-04-16T19:35:09.377316+0000","last_peered":"2024-04-16T19:35:09.377316+0000","last_clean":"2024-04-16T19:35:09.377316+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:35:09.377316+0000","last_undegraded":"2024-04-16T19:35:09.377316+0000","last_fullsized":"2024-04-16T19:35:09.377316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:16:19.075286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"48'2","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379730+0000","last_change":"2024-04-16T17:45:20.412352+0000","last_active":"2024-04-16T19:35:24.379730+0000","last_peered":"2024-04-16T19:35:24.379730+0000","last_clean":"2024-04-16T19:35:24.379730+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:35:24.379730+0000","last_undegraded":"2024-04-16T19:35:24.379730+0000","last_fullsized":"2024-04-16T19:35:24.379730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:32.239001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'104","reported_seq":282,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595912+0000","last_change":"2024-04-16T17:45:22.417121+0000","last_active":"2024-04-16T19:37:54.595912+0000","last_peered":"2024-04-16T19:37:54.595912+0000","last_clean":"2024-04-16T19:37:54.595912+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:37:54.595912+0000","last_undegraded":"2024-04-16T19:37:54.595912+0000","last_fullsized":"2024-04-16T19:37:54.595912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592829+0000","last_change":"2024-04-16T17:45:24.425363+0000","last_active":"2024-04-16T19:37:39.592829+0000","last_peered":"2024-04-16T19:37:39.592829+0000","last_clean":"2024-04-16T19:37:39.592829+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:37:39.592829+0000","last_undegraded":"2024-04-16T19:37:39.592829+0000","last_fullsized":"2024-04-16T19:37:39.592829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377883+0000","last_change":"2024-04-16T17:45:26.438576+0000","last_active":"2024-04-16T19:35:09.377883+0000","last_peered":"2024-04-16T19:35:09.377883+0000","last_clean":"2024-04-16T19:35:09.377883+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:35:09.377883+0000","last_undegraded":"2024-04-16T19:35:09.377883+0000","last_fullsized":"2024-04-16T19:35:09.377883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:47.884134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.362625+0000","last_change":"2024-04-16T18:09:02.173368+0000","last_active":"2024-04-16T19:33:39.362625+0000","last_peered":"2024-04-16T19:33:39.362625+0000","last_clean":"2024-04-16T19:33:39.362625+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:33:39.362625+0000","last_undegraded":"2024-04-16T19:33:39.362625+0000","last_fullsized":"2024-04-16T19:33:39.362625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:29.850916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'146","reported_seq":1639,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592782+0000","last_change":"2024-04-16T17:46:25.529669+0000","last_active":"2024-04-16T19:37:39.592782+0000","last_peered":"2024-04-16T19:37:39.592782+0000","last_clean":"2024-04-16T19:37:39.592782+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:37:39.592782+0000","last_undegraded":"2024-04-16T19:37:39.592782+0000","last_fullsized":"2024-04-16T19:37:39.592782+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":78,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:04.376562+0000","last_change":"2024-04-16T17:46:17.507982+0000","last_active":"2024-04-16T19:35:04.376562+0000","last_peered":"2024-04-16T19:35:04.376562+0000","last_clean":"2024-04-16T19:35:04.376562+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:35:04.376562+0000","last_undegraded":"2024-04-16T19:35:04.376562+0000","last_fullsized":"2024-04-16T19:35:04.376562+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:17:26.521094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:34.362268+0000","last_change":"2024-04-16T17:45:51.480412+0000","last_active":"2024-04-16T19:33:34.362268+0000","last_peered":"2024-04-16T19:33:34.362268+0000","last_clean":"2024-04-16T19:33:34.362268+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:33:34.362268+0000","last_undegraded":"2024-04-16T19:33:34.362268+0000","last_fullsized":"2024-04-16T19:33:34.362268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:48:28.168213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381317+0000","last_change":"2024-04-16T17:45:49.471149+0000","last_active":"2024-04-16T19:35:29.381317+0000","last_peered":"2024-04-16T19:35:29.381317+0000","last_clean":"2024-04-16T19:35:29.381317+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:35:29.381317+0000","last_undegraded":"2024-04-16T19:35:29.381317+0000","last_fullsized":"2024-04-16T19:35:29.381317+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:20.691413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'543","reported_seq":45408,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381269+0000","last_change":"2024-04-16T17:45:47.464982+0000","last_active":"2024-04-16T19:35:29.381269+0000","last_peered":"2024-04-16T19:35:29.381269+0000","last_clean":"2024-04-16T19:35:29.381269+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:35:29.381269+0000","last_undegraded":"2024-04-16T19:35:29.381269+0000","last_fullsized":"2024-04-16T19:35:29.381269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:18.772947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'9","reported_seq":399,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381245+0000","last_change":"2024-04-16T17:45:45.466563+0000","last_active":"2024-04-16T19:35:29.381245+0000","last_peered":"2024-04-16T19:35:29.381245+0000","last_clean":"2024-04-16T19:35:29.381245+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:35:29.381245+0000","last_undegraded":"2024-04-16T19:35:29.381245+0000","last_fullsized":"2024-04-16T19:35:29.381245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:04:04.543134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593568+0000","last_change":"2024-04-16T17:45:10.395688+0000","last_active":"2024-04-16T19:37:44.593568+0000","last_peered":"2024-04-16T19:37:44.593568+0000","last_clean":"2024-04-16T19:37:44.593568+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:37:44.593568+0000","last_undegraded":"2024-04-16T19:37:44.593568+0000","last_fullsized":"2024-04-16T19:37:44.593568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404315+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:37:39.404315+0000","last_peered":"2024-04-16T19:37:39.404315+0000","last_clean":"2024-04-16T19:37:39.404315+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:37:39.404315+0000","last_undegraded":"2024-04-16T19:37:39.404315+0000","last_fullsized":"2024-04-16T19:37:39.404315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"48'2","reported_seq":501,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595909+0000","last_change":"2024-04-16T17:45:20.412567+0000","last_active":"2024-04-16T19:37:54.595909+0000","last_peered":"2024-04-16T19:37:54.595909+0000","last_clean":"2024-04-16T19:37:54.595909+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:37:54.595909+0000","last_undegraded":"2024-04-16T19:37:54.595909+0000","last_fullsized":"2024-04-16T19:37:54.595909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'120","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383728+0000","last_change":"2024-04-16T17:45:22.416448+0000","last_active":"2024-04-16T19:35:44.383728+0000","last_peered":"2024-04-16T19:35:44.383728+0000","last_clean":"2024-04-16T19:35:44.383728+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:35:44.383728+0000","last_undegraded":"2024-04-16T19:35:44.383728+0000","last_fullsized":"2024-04-16T19:35:44.383728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:00:14.322665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'12","reported_seq":1395,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384532+0000","last_change":"2024-04-16T17:45:24.426319+0000","last_active":"2024-04-16T19:35:49.384532+0000","last_peered":"2024-04-16T19:35:49.384532+0000","last_clean":"2024-04-16T19:35:49.384532+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:35:49.384532+0000","last_undegraded":"2024-04-16T19:35:49.384532+0000","last_fullsized":"2024-04-16T19:35:49.384532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:23:33.417685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377809+0000","last_change":"2024-04-16T17:45:26.433965+0000","last_active":"2024-04-16T19:35:09.377809+0000","last_peered":"2024-04-16T19:35:09.377809+0000","last_clean":"2024-04-16T19:35:09.377809+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:35:09.377809+0000","last_undegraded":"2024-04-16T19:35:09.377809+0000","last_fullsized":"2024-04-16T19:35:09.377809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:05:58.231337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596673+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:37:59.596673+0000","last_peered":"2024-04-16T19:37:59.596673+0000","last_clean":"2024-04-16T19:37:59.596673+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:37:59.596673+0000","last_undegraded":"2024-04-16T19:37:59.596673+0000","last_fullsized":"2024-04-16T19:37:59.596673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'89","reported_seq":1549,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364103+0000","last_change":"2024-04-16T17:46:25.522263+0000","last_active":"2024-04-16T19:33:49.364103+0000","last_peered":"2024-04-16T19:33:49.364103+0000","last_clean":"2024-04-16T19:33:49.364103+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:33:49.364103+0000","last_undegraded":"2024-04-16T19:33:49.364103+0000","last_fullsized":"2024-04-16T19:33:49.364103+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:54:41.808921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.388092+0000","last_change":"2024-04-16T17:46:17.502070+0000","last_active":"2024-04-16T19:35:59.388092+0000","last_peered":"2024-04-16T19:35:59.388092+0000","last_clean":"2024-04-16T19:35:59.388092+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:35:59.388092+0000","last_undegraded":"2024-04-16T19:35:59.388092+0000","last_fullsized":"2024-04-16T19:35:59.388092+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'16","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595730+0000","last_change":"2024-04-16T17:45:51.481303+0000","last_active":"2024-04-16T19:37:54.595730+0000","last_peered":"2024-04-16T19:37:54.595730+0000","last_clean":"2024-04-16T19:37:54.595730+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:37:54.595730+0000","last_undegraded":"2024-04-16T19:37:54.595730+0000","last_fullsized":"2024-04-16T19:37:54.595730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'651","reported_seq":2561,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.384518+0000","last_change":"2024-04-16T17:45:49.469698+0000","last_active":"2024-04-16T19:35:49.384518+0000","last_peered":"2024-04-16T19:35:49.384518+0000","last_clean":"2024-04-16T19:35:49.384518+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:35:49.384518+0000","last_undegraded":"2024-04-16T19:35:49.384518+0000","last_fullsized":"2024-04-16T19:35:49.384518+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:57:05.931727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'518","reported_seq":958,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.397892+0000","last_change":"2024-04-16T17:45:47.462089+0000","last_active":"2024-04-16T19:36:59.397892+0000","last_peered":"2024-04-16T19:36:59.397892+0000","last_clean":"2024-04-16T19:36:59.397892+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:36:59.397892+0000","last_undegraded":"2024-04-16T19:36:59.397892+0000","last_fullsized":"2024-04-16T19:36:59.397892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":518,"log_dups_size":0,"ondisk_log_size":518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'8","reported_seq":371,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371775+0000","last_change":"2024-04-16T17:45:45.457866+0000","last_active":"2024-04-16T19:34:34.371775+0000","last_peered":"2024-04-16T19:34:34.371775+0000","last_clean":"2024-04-16T19:34:34.371775+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:34:34.371775+0000","last_undegraded":"2024-04-16T19:34:34.371775+0000","last_fullsized":"2024-04-16T19:34:34.371775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:18:09.442789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378153+0000","last_change":"2024-04-16T17:45:10.402149+0000","last_active":"2024-04-16T19:35:14.378153+0000","last_peered":"2024-04-16T19:35:14.378153+0000","last_clean":"2024-04-16T19:35:14.378153+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:35:14.378153+0000","last_undegraded":"2024-04-16T19:35:14.378153+0000","last_fullsized":"2024-04-16T19:35:14.378153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:29:14.688816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377861+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:35:09.377861+0000","last_peered":"2024-04-16T19:35:09.377861+0000","last_clean":"2024-04-16T19:35:09.377861+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:35:09.377861+0000","last_undegraded":"2024-04-16T19:35:09.377861+0000","last_fullsized":"2024-04-16T19:35:09.377861+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:49:40.069655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379655+0000","last_change":"2024-04-16T17:45:20.409559+0000","last_active":"2024-04-16T19:35:24.379655+0000","last_peered":"2024-04-16T19:35:24.379655+0000","last_clean":"2024-04-16T19:35:24.379655+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:35:24.379655+0000","last_undegraded":"2024-04-16T19:35:24.379655+0000","last_fullsized":"2024-04-16T19:35:24.379655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:21:10.476166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'152","reported_seq":345,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371721+0000","last_change":"2024-04-16T17:45:22.415559+0000","last_active":"2024-04-16T19:34:29.371721+0000","last_peered":"2024-04-16T19:34:29.371721+0000","last_clean":"2024-04-16T19:34:29.371721+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:34:29.371721+0000","last_undegraded":"2024-04-16T19:34:29.371721+0000","last_fullsized":"2024-04-16T19:34:29.371721+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T17:48:12.531458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.393792+0000","last_change":"2024-04-16T17:45:24.421195+0000","last_active":"2024-04-16T19:36:34.393792+0000","last_peered":"2024-04-16T19:36:34.393792+0000","last_clean":"2024-04-16T19:36:34.393792+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:36:34.393792+0000","last_undegraded":"2024-04-16T19:36:34.393792+0000","last_fullsized":"2024-04-16T19:36:34.393792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369207+0000","last_change":"2024-04-16T17:45:26.432510+0000","last_active":"2024-04-16T19:34:14.369207+0000","last_peered":"2024-04-16T19:34:14.369207+0000","last_clean":"2024-04-16T19:34:14.369207+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:34:14.369207+0000","last_undegraded":"2024-04-16T19:34:14.369207+0000","last_fullsized":"2024-04-16T19:34:14.369207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:08.477244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593484+0000","last_change":"2024-04-16T18:09:02.169659+0000","last_active":"2024-04-16T19:37:44.593484+0000","last_peered":"2024-04-16T19:37:44.593484+0000","last_clean":"2024-04-16T19:37:44.593484+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:37:44.593484+0000","last_undegraded":"2024-04-16T19:37:44.593484+0000","last_fullsized":"2024-04-16T19:37:44.593484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'119","reported_seq":2031,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.574326+0000","last_change":"2024-04-16T17:46:25.523284+0000","last_active":"2024-04-16T19:36:09.574326+0000","last_peered":"2024-04-16T19:36:09.574326+0000","last_clean":"2024-04-16T19:36:09.574326+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:36:09.574326+0000","last_undegraded":"2024-04-16T19:36:09.574326+0000","last_fullsized":"2024-04-16T19:36:09.574326+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:39.363115+0000","last_change":"2024-04-16T17:46:17.506836+0000","last_active":"2024-04-16T19:33:39.363115+0000","last_peered":"2024-04-16T19:33:39.363115+0000","last_clean":"2024-04-16T19:33:39.363115+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:33:39.363115+0000","last_undegraded":"2024-04-16T19:33:39.363115+0000","last_fullsized":"2024-04-16T19:33:39.363115+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:54:08.981167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'2","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406956+0000","last_change":"2024-04-16T17:45:51.481129+0000","last_active":"2024-04-16T19:37:54.406956+0000","last_peered":"2024-04-16T19:37:54.406956+0000","last_clean":"2024-04-16T19:37:54.406956+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:37:54.406956+0000","last_undegraded":"2024-04-16T19:37:54.406956+0000","last_fullsized":"2024-04-16T19:37:54.406956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'651","reported_seq":2213,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.584593+0000","last_change":"2024-04-16T17:45:49.467008+0000","last_active":"2024-04-16T19:36:59.584593+0000","last_peered":"2024-04-16T19:36:59.584593+0000","last_clean":"2024-04-16T19:36:59.584593+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:36:59.584593+0000","last_undegraded":"2024-04-16T19:36:59.584593+0000","last_fullsized":"2024-04-16T19:36:59.584593+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'281","reported_seq":573,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597945+0000","last_change":"2024-04-16T17:45:47.463063+0000","last_active":"2024-04-16T19:38:04.597945+0000","last_peered":"2024-04-16T19:38:04.597945+0000","last_clean":"2024-04-16T19:38:04.597945+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:38:04.597945+0000","last_undegraded":"2024-04-16T19:38:04.597945+0000","last_fullsized":"2024-04-16T19:38:04.597945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":281,"log_dups_size":0,"ondisk_log_size":281,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'12","reported_seq":372,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372532+0000","last_change":"2024-04-16T17:45:45.465787+0000","last_active":"2024-04-16T19:34:34.372532+0000","last_peered":"2024-04-16T19:34:34.372532+0000","last_clean":"2024-04-16T19:34:34.372532+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:34:34.372532+0000","last_undegraded":"2024-04-16T19:34:34.372532+0000","last_fullsized":"2024-04-16T19:34:34.372532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:14.378129+0000","last_change":"2024-04-16T17:45:10.392781+0000","last_active":"2024-04-16T19:35:14.378129+0000","last_peered":"2024-04-16T19:35:14.378129+0000","last_clean":"2024-04-16T19:35:14.378129+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:35:14.378129+0000","last_undegraded":"2024-04-16T19:35:14.378129+0000","last_fullsized":"2024-04-16T19:35:14.378129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:39.831957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:09.377922+0000","last_change":"2024-04-16T17:45:08.386175+0000","last_active":"2024-04-16T19:35:09.377922+0000","last_peered":"2024-04-16T19:35:09.377922+0000","last_clean":"2024-04-16T19:35:09.377922+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:35:09.377922+0000","last_undegraded":"2024-04-16T19:35:09.377922+0000","last_fullsized":"2024-04-16T19:35:09.377922+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:28:48.573916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"48'11","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380444+0000","last_change":"2024-04-16T17:45:20.407986+0000","last_active":"2024-04-16T19:35:24.380444+0000","last_peered":"2024-04-16T19:35:24.380444+0000","last_clean":"2024-04-16T19:35:24.380444+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:35:24.380444+0000","last_undegraded":"2024-04-16T19:35:24.380444+0000","last_fullsized":"2024-04-16T19:35:24.380444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:11.567092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.393825+0000","last_change":"2024-04-16T17:45:22.415078+0000","last_active":"2024-04-16T19:36:34.393825+0000","last_peered":"2024-04-16T19:36:34.393825+0000","last_clean":"2024-04-16T19:36:34.393825+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:36:34.393825+0000","last_undegraded":"2024-04-16T19:36:34.393825+0000","last_fullsized":"2024-04-16T19:36:34.393825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371537+0000","last_change":"2024-04-16T17:45:24.425398+0000","last_active":"2024-04-16T19:34:29.371537+0000","last_peered":"2024-04-16T19:34:29.371537+0000","last_clean":"2024-04-16T19:34:29.371537+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:34:29.371537+0000","last_undegraded":"2024-04-16T19:34:29.371537+0000","last_fullsized":"2024-04-16T19:34:29.371537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T18:01:27.725031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.580652+0000","last_change":"2024-04-16T17:45:26.849126+0000","last_active":"2024-04-16T19:36:39.580652+0000","last_peered":"2024-04-16T19:36:39.580652+0000","last_clean":"2024-04-16T19:36:39.580652+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:36:39.580652+0000","last_undegraded":"2024-04-16T19:36:39.580652+0000","last_fullsized":"2024-04-16T19:36:39.580652+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405131+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:37:44.405131+0000","last_peered":"2024-04-16T19:37:44.405131+0000","last_clean":"2024-04-16T19:37:44.405131+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:37:44.405131+0000","last_undegraded":"2024-04-16T19:37:44.405131+0000","last_fullsized":"2024-04-16T19:37:44.405131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'120","reported_seq":1726,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.574456+0000","last_change":"2024-04-16T17:46:25.526370+0000","last_active":"2024-04-16T19:36:09.574456+0000","last_peered":"2024-04-16T19:36:09.574456+0000","last_clean":"2024-04-16T19:36:09.574456+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:36:09.574456+0000","last_undegraded":"2024-04-16T19:36:09.574456+0000","last_fullsized":"2024-04-16T19:36:09.574456+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.572352+0000","last_change":"2024-04-16T17:46:17.500988+0000","last_active":"2024-04-16T19:35:59.572352+0000","last_peered":"2024-04-16T19:35:59.572352+0000","last_clean":"2024-04-16T19:35:59.572352+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:35:59.572352+0000","last_undegraded":"2024-04-16T19:35:59.572352+0000","last_fullsized":"2024-04-16T19:35:59.572352+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'19","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.382058+0000","last_change":"2024-04-16T17:45:51.478621+0000","last_active":"2024-04-16T19:35:34.382058+0000","last_peered":"2024-04-16T19:35:34.382058+0000","last_clean":"2024-04-16T19:35:34.382058+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:35:34.382058+0000","last_undegraded":"2024-04-16T19:35:34.382058+0000","last_fullsized":"2024-04-16T19:35:34.382058+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:28.047515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372631+0000","last_change":"2024-04-16T17:45:49.474101+0000","last_active":"2024-04-16T19:34:34.372631+0000","last_peered":"2024-04-16T19:34:34.372631+0000","last_clean":"2024-04-16T19:34:34.372631+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:34:34.372631+0000","last_undegraded":"2024-04-16T19:34:34.372631+0000","last_fullsized":"2024-04-16T19:34:34.372631+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:47:15.346074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5043","reported_seq":7393,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372551+0000","last_change":"2024-04-16T17:45:47.462940+0000","last_active":"2024-04-16T19:34:34.372551+0000","last_peered":"2024-04-16T19:34:34.372551+0000","last_clean":"2024-04-16T19:34:34.372551+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:34:34.372551+0000","last_undegraded":"2024-04-16T19:34:34.372551+0000","last_fullsized":"2024-04-16T19:34:34.372551+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":1743,"log_dups_size":3000,"ondisk_log_size":1743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:47:36.062066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'13","reported_seq":442,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597988+0000","last_change":"2024-04-16T17:45:45.458908+0000","last_active":"2024-04-16T19:38:04.597988+0000","last_peered":"2024-04-16T19:38:04.597988+0000","last_clean":"2024-04-16T19:38:04.597988+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:38:04.597988+0000","last_undegraded":"2024-04-16T19:38:04.597988+0000","last_fullsized":"2024-04-16T19:38:04.597988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395573+0000","last_change":"2024-04-16T17:45:10.397270+0000","last_active":"2024-04-16T19:36:44.395573+0000","last_peered":"2024-04-16T19:36:44.395573+0000","last_clean":"2024-04-16T19:36:44.395573+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:36:44.395573+0000","last_undegraded":"2024-04-16T19:36:44.395573+0000","last_fullsized":"2024-04-16T19:36:44.395573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589689+0000","last_change":"2024-04-16T17:45:08.385404+0000","last_active":"2024-04-16T19:37:24.589689+0000","last_peered":"2024-04-16T19:37:24.589689+0000","last_clean":"2024-04-16T19:37:24.589689+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:37:24.589689+0000","last_undegraded":"2024-04-16T19:37:24.589689+0000","last_fullsized":"2024-04-16T19:37:24.589689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'6","reported_seq":1404,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.367767+0000","last_change":"2024-04-16T17:45:20.413621+0000","last_active":"2024-04-16T19:34:09.367767+0000","last_peered":"2024-04-16T19:34:09.367767+0000","last_clean":"2024-04-16T19:34:09.367767+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:34:09.367767+0000","last_undegraded":"2024-04-16T19:34:09.367767+0000","last_fullsized":"2024-04-16T19:34:09.367767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:32:36.005251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'32","reported_seq":165,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406982+0000","last_change":"2024-04-16T17:45:22.415077+0000","last_active":"2024-04-16T19:37:54.406982+0000","last_peered":"2024-04-16T19:37:54.406982+0000","last_clean":"2024-04-16T19:37:54.406982+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:37:54.406982+0000","last_undegraded":"2024-04-16T19:37:54.406982+0000","last_fullsized":"2024-04-16T19:37:54.406982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380516+0000","last_change":"2024-04-16T17:45:24.430903+0000","last_active":"2024-04-16T19:35:24.380516+0000","last_peered":"2024-04-16T19:35:24.380516+0000","last_clean":"2024-04-16T19:35:24.380516+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:35:24.380516+0000","last_undegraded":"2024-04-16T19:35:24.380516+0000","last_fullsized":"2024-04-16T19:35:24.380516+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:16:55.371897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:14.369101+0000","last_change":"2024-04-16T17:45:26.438619+0000","last_active":"2024-04-16T19:34:14.369101+0000","last_peered":"2024-04-16T19:34:14.369101+0000","last_clean":"2024-04-16T19:34:14.369101+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:34:14.369101+0000","last_undegraded":"2024-04-16T19:34:14.369101+0000","last_fullsized":"2024-04-16T19:34:14.369101+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:15:15.584111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593702+0000","last_change":"2024-04-16T18:09:02.166083+0000","last_active":"2024-04-16T19:37:44.593702+0000","last_peered":"2024-04-16T19:37:44.593702+0000","last_clean":"2024-04-16T19:37:44.593702+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:37:44.593702+0000","last_undegraded":"2024-04-16T19:37:44.593702+0000","last_fullsized":"2024-04-16T19:37:44.593702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'126","reported_seq":1717,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:09.574357+0000","last_change":"2024-04-16T17:46:25.531755+0000","last_active":"2024-04-16T19:36:09.574357+0000","last_peered":"2024-04-16T19:36:09.574357+0000","last_clean":"2024-04-16T19:36:09.574357+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:36:09.574357+0000","last_undegraded":"2024-04-16T19:36:09.574357+0000","last_fullsized":"2024-04-16T19:36:09.574357+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.572428+0000","last_change":"2024-04-16T17:46:17.505902+0000","last_active":"2024-04-16T19:35:59.572428+0000","last_peered":"2024-04-16T19:35:59.572428+0000","last_clean":"2024-04-16T19:35:59.572428+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:35:59.572428+0000","last_undegraded":"2024-04-16T19:35:59.572428+0000","last_fullsized":"2024-04-16T19:35:59.572428+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'10","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406910+0000","last_change":"2024-04-16T17:45:51.478912+0000","last_active":"2024-04-16T19:37:54.406910+0000","last_peered":"2024-04-16T19:37:54.406910+0000","last_clean":"2024-04-16T19:37:54.406910+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:37:54.406910+0000","last_undegraded":"2024-04-16T19:37:54.406910+0000","last_fullsized":"2024-04-16T19:37:54.406910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372659+0000","last_change":"2024-04-16T17:45:49.470949+0000","last_active":"2024-04-16T19:34:34.372659+0000","last_peered":"2024-04-16T19:34:34.372659+0000","last_clean":"2024-04-16T19:34:34.372659+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:34:34.372659+0000","last_undegraded":"2024-04-16T19:34:34.372659+0000","last_fullsized":"2024-04-16T19:34:34.372659+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:38:03.985918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'554","reported_seq":1527,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.372495+0000","last_change":"2024-04-16T17:45:47.464106+0000","last_active":"2024-04-16T19:34:34.372495+0000","last_peered":"2024-04-16T19:34:34.372495+0000","last_clean":"2024-04-16T19:34:34.372495+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:34:34.372495+0000","last_undegraded":"2024-04-16T19:34:34.372495+0000","last_fullsized":"2024-04-16T19:34:34.372495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:46.441235+0000","last_clean_scrub_stamp":"2024-04-16T17:45:46.441235+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:06:24.659574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'6","reported_seq":517,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:34.371703+0000","last_change":"2024-04-16T17:45:45.454923+0000","last_active":"2024-04-16T19:34:34.371703+0000","last_peered":"2024-04-16T19:34:34.371703+0000","last_clean":"2024-04-16T19:34:34.371703+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:34:34.371703+0000","last_undegraded":"2024-04-16T19:34:34.371703+0000","last_fullsized":"2024-04-16T19:34:34.371703+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:17:16.399115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366331+0000","last_change":"2024-04-16T17:45:10.400150+0000","last_active":"2024-04-16T19:33:59.366331+0000","last_peered":"2024-04-16T19:33:59.366331+0000","last_clean":"2024-04-16T19:33:59.366331+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:33:59.366331+0000","last_undegraded":"2024-04-16T19:33:59.366331+0000","last_fullsized":"2024-04-16T19:33:59.366331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:22:56.234389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404415+0000","last_change":"2024-04-16T17:45:08.386622+0000","last_active":"2024-04-16T19:37:39.404415+0000","last_peered":"2024-04-16T19:37:39.404415+0000","last_clean":"2024-04-16T19:37:39.404415+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:37:39.404415+0000","last_undegraded":"2024-04-16T19:37:39.404415+0000","last_fullsized":"2024-04-16T19:37:39.404415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582442+0000","last_change":"2024-04-16T17:45:20.412420+0000","last_active":"2024-04-16T19:36:49.582442+0000","last_peered":"2024-04-16T19:36:49.582442+0000","last_clean":"2024-04-16T19:36:49.582442+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:36:49.582442+0000","last_undegraded":"2024-04-16T19:36:49.582442+0000","last_fullsized":"2024-04-16T19:36:49.582442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'80","reported_seq":236,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.379675+0000","last_change":"2024-04-16T17:45:22.421586+0000","last_active":"2024-04-16T19:35:24.379675+0000","last_peered":"2024-04-16T19:35:24.379675+0000","last_clean":"2024-04-16T19:35:24.379675+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:35:24.379675+0000","last_undegraded":"2024-04-16T19:35:24.379675+0000","last_fullsized":"2024-04-16T19:35:24.379675+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:08:38.487045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407022+0000","last_change":"2024-04-16T17:45:24.424290+0000","last_active":"2024-04-16T19:37:54.407022+0000","last_peered":"2024-04-16T19:37:54.407022+0000","last_clean":"2024-04-16T19:37:54.407022+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:37:54.407022+0000","last_undegraded":"2024-04-16T19:37:54.407022+0000","last_fullsized":"2024-04-16T19:37:54.407022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380429+0000","last_change":"2024-04-16T17:45:26.433279+0000","last_active":"2024-04-16T19:35:29.380429+0000","last_peered":"2024-04-16T19:35:29.380429+0000","last_clean":"2024-04-16T19:35:29.380429+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:35:29.380429+0000","last_undegraded":"2024-04-16T19:35:29.380429+0000","last_fullsized":"2024-04-16T19:35:29.380429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:53.357161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'5","reported_seq":191,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.573368+0000","last_change":"2024-04-16T17:45:45.455663+0000","last_active":"2024-04-16T19:36:04.573368+0000","last_peered":"2024-04-16T19:36:04.573368+0000","last_clean":"2024-04-16T19:36:04.573368+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:36:04.573368+0000","last_undegraded":"2024-04-16T19:36:04.573368+0000","last_fullsized":"2024-04-16T19:36:04.573368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582618+0000","last_change":"2024-04-16T17:46:16.500595+0000","last_active":"2024-04-16T19:36:49.582618+0000","last_peered":"2024-04-16T19:36:49.582618+0000","last_clean":"2024-04-16T19:36:49.582618+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:36:49.582618+0000","last_undegraded":"2024-04-16T19:36:49.582618+0000","last_fullsized":"2024-04-16T19:36:49.582618+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:34.381260+0000","last_change":"2024-04-16T17:45:08.383072+0000","last_active":"2024-04-16T19:35:34.381260+0000","last_peered":"2024-04-16T19:35:34.381260+0000","last_clean":"2024-04-16T19:35:34.381260+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:35:34.381260+0000","last_undegraded":"2024-04-16T19:35:34.381260+0000","last_fullsized":"2024-04-16T19:35:34.381260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:05:58.862115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'15","reported_seq":225,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:49.364974+0000","last_change":"2024-04-16T17:45:45.464950+0000","last_active":"2024-04-16T19:33:49.364974+0000","last_peered":"2024-04-16T19:33:49.364974+0000","last_clean":"2024-04-16T19:33:49.364974+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:33:49.364974+0000","last_undegraded":"2024-04-16T19:33:49.364974+0000","last_fullsized":"2024-04-16T19:33:49.364974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:16:39.088704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595980+0000","last_change":"2024-04-16T17:45:10.396086+0000","last_active":"2024-04-16T19:37:54.595980+0000","last_peered":"2024-04-16T19:37:54.595980+0000","last_clean":"2024-04-16T19:37:54.595980+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:37:54.595980+0000","last_undegraded":"2024-04-16T19:37:54.595980+0000","last_fullsized":"2024-04-16T19:37:54.595980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592600+0000","last_change":"2024-04-16T17:45:08.390555+0000","last_active":"2024-04-16T19:37:39.592600+0000","last_peered":"2024-04-16T19:37:39.592600+0000","last_clean":"2024-04-16T19:37:39.592600+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:37:39.592600+0000","last_undegraded":"2024-04-16T19:37:39.592600+0000","last_fullsized":"2024-04-16T19:37:39.592600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'18","reported_seq":469,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:29.371671+0000","last_change":"2024-04-16T17:45:45.464620+0000","last_active":"2024-04-16T19:34:29.371671+0000","last_peered":"2024-04-16T19:34:29.371671+0000","last_clean":"2024-04-16T19:34:29.371671+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:34:29.371671+0000","last_undegraded":"2024-04-16T19:34:29.371671+0000","last_fullsized":"2024-04-16T19:34:29.371671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:41.881380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383715+0000","last_change":"2024-04-16T17:45:10.400426+0000","last_active":"2024-04-16T19:35:44.383715+0000","last_peered":"2024-04-16T19:35:44.383715+0000","last_clean":"2024-04-16T19:35:44.383715+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:35:44.383715+0000","last_undegraded":"2024-04-16T19:35:44.383715+0000","last_fullsized":"2024-04-16T19:35:44.383715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:57.696534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.581469+0000","last_change":"2024-04-16T17:46:16.499950+0000","last_active":"2024-04-16T19:36:44.581469+0000","last_peered":"2024-04-16T19:36:44.581469+0000","last_clean":"2024-04-16T19:36:44.581469+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:36:44.581469+0000","last_undegraded":"2024-04-16T19:36:44.581469+0000","last_fullsized":"2024-04-16T19:36:44.581469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'9","reported_seq":302,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:19.369392+0000","last_change":"2024-04-16T17:46:16.503571+0000","last_active":"2024-04-16T19:34:19.369392+0000","last_peered":"2024-04-16T19:34:19.369392+0000","last_clean":"2024-04-16T19:34:19.369392+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:34:19.369392+0000","last_undegraded":"2024-04-16T19:34:19.369392+0000","last_fullsized":"2024-04-16T19:34:19.369392+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:16:16.765755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595799+0000","last_change":"2024-04-16T17:45:10.394142+0000","last_active":"2024-04-16T19:37:54.595799+0000","last_peered":"2024-04-16T19:37:54.595799+0000","last_clean":"2024-04-16T19:37:54.595799+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:37:54.595799+0000","last_undegraded":"2024-04-16T19:37:54.595799+0000","last_fullsized":"2024-04-16T19:37:54.595799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407703+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:37:59.407703+0000","last_peered":"2024-04-16T19:37:59.407703+0000","last_clean":"2024-04-16T19:37:59.407703+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:37:59.407703+0000","last_undegraded":"2024-04-16T19:37:59.407703+0000","last_fullsized":"2024-04-16T19:37:59.407703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'6","reported_seq":218,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381435+0000","last_change":"2024-04-16T17:45:45.463398+0000","last_active":"2024-04-16T19:35:29.381435+0000","last_peered":"2024-04-16T19:35:29.381435+0000","last_clean":"2024-04-16T19:35:29.381435+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:35:29.381435+0000","last_undegraded":"2024-04-16T19:35:29.381435+0000","last_fullsized":"2024-04-16T19:35:29.381435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:24:07.065221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596769+0000","last_change":"2024-04-16T17:45:10.394131+0000","last_active":"2024-04-16T19:37:59.596769+0000","last_peered":"2024-04-16T19:37:59.596769+0000","last_clean":"2024-04-16T19:37:59.596769+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:37:59.596769+0000","last_undegraded":"2024-04-16T19:37:59.596769+0000","last_fullsized":"2024-04-16T19:37:59.596769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406132+0000","last_change":"2024-04-16T17:45:08.390961+0000","last_active":"2024-04-16T19:37:49.406132+0000","last_peered":"2024-04-16T19:37:49.406132+0000","last_clean":"2024-04-16T19:37:49.406132+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:37:49.406132+0000","last_undegraded":"2024-04-16T19:37:49.406132+0000","last_fullsized":"2024-04-16T19:37:49.406132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'50","reported_seq":633,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594848+0000","last_change":"2024-04-16T17:45:45.465543+0000","last_active":"2024-04-16T19:37:49.594848+0000","last_peered":"2024-04-16T19:37:49.594848+0000","last_clean":"2024-04-16T19:37:49.594848+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:37:49.594848+0000","last_undegraded":"2024-04-16T19:37:49.594848+0000","last_fullsized":"2024-04-16T19:37:49.594848+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382232+0000","last_change":"2024-04-16T17:45:10.394908+0000","last_active":"2024-04-16T19:35:39.382232+0000","last_peered":"2024-04-16T19:35:39.382232+0000","last_clean":"2024-04-16T19:35:39.382232+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:35:39.382232+0000","last_undegraded":"2024-04-16T19:35:39.382232+0000","last_fullsized":"2024-04-16T19:35:39.382232+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:46:00.759798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594801+0000","last_change":"2024-04-16T17:45:08.382445+0000","last_active":"2024-04-16T19:37:49.594801+0000","last_peered":"2024-04-16T19:37:49.594801+0000","last_clean":"2024-04-16T19:37:49.594801+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:37:49.594801+0000","last_undegraded":"2024-04-16T19:37:49.594801+0000","last_fullsized":"2024-04-16T19:37:49.594801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'9","reported_seq":158,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:04.573491+0000","last_change":"2024-04-16T17:45:45.459475+0000","last_active":"2024-04-16T19:36:04.573491+0000","last_peered":"2024-04-16T19:36:04.573491+0000","last_clean":"2024-04-16T19:36:04.573491+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:36:04.573491+0000","last_undegraded":"2024-04-16T19:36:04.573491+0000","last_fullsized":"2024-04-16T19:36:04.573491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593593+0000","last_change":"2024-04-16T17:45:10.398439+0000","last_active":"2024-04-16T19:37:44.593593+0000","last_peered":"2024-04-16T19:37:44.593593+0000","last_clean":"2024-04-16T19:37:44.593593+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:37:44.593593+0000","last_undegraded":"2024-04-16T19:37:44.593593+0000","last_fullsized":"2024-04-16T19:37:44.593593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382931+0000","last_change":"2024-04-16T17:45:08.388353+0000","last_active":"2024-04-16T19:35:39.382931+0000","last_peered":"2024-04-16T19:35:39.382931+0000","last_clean":"2024-04-16T19:35:39.382931+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:35:39.382931+0000","last_undegraded":"2024-04-16T19:35:39.382931+0000","last_fullsized":"2024-04-16T19:35:39.382931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:06:53.982815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'11","reported_seq":530,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576624+0000","last_change":"2024-04-16T17:45:45.461419+0000","last_active":"2024-04-16T19:36:19.576624+0000","last_peered":"2024-04-16T19:36:19.576624+0000","last_clean":"2024-04-16T19:36:19.576624+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:36:19.576624+0000","last_undegraded":"2024-04-16T19:36:19.576624+0000","last_fullsized":"2024-04-16T19:36:19.576624+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:39.382760+0000","last_change":"2024-04-16T17:45:10.393085+0000","last_active":"2024-04-16T19:35:39.382760+0000","last_peered":"2024-04-16T19:35:39.382760+0000","last_clean":"2024-04-16T19:35:39.382760+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:35:39.382760+0000","last_undegraded":"2024-04-16T19:35:39.382760+0000","last_fullsized":"2024-04-16T19:35:39.382760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:01:10.813500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594821+0000","last_change":"2024-04-16T17:45:08.387778+0000","last_active":"2024-04-16T19:37:49.594821+0000","last_peered":"2024-04-16T19:37:49.594821+0000","last_clean":"2024-04-16T19:37:49.594821+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:37:49.594821+0000","last_undegraded":"2024-04-16T19:37:49.594821+0000","last_fullsized":"2024-04-16T19:37:49.594821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'6","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368125+0000","last_change":"2024-04-16T17:45:45.460984+0000","last_active":"2024-04-16T19:34:09.368125+0000","last_peered":"2024-04-16T19:34:09.368125+0000","last_clean":"2024-04-16T19:34:09.368125+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:34:09.368125+0000","last_undegraded":"2024-04-16T19:34:09.368125+0000","last_fullsized":"2024-04-16T19:34:09.368125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:54:54.185407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.400360+0000","last_change":"2024-04-16T17:45:10.397793+0000","last_active":"2024-04-16T19:37:14.400360+0000","last_peered":"2024-04-16T19:37:14.400360+0000","last_clean":"2024-04-16T19:37:14.400360+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:37:14.400360+0000","last_undegraded":"2024-04-16T19:37:14.400360+0000","last_fullsized":"2024-04-16T19:37:14.400360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:59.385842+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:35:59.385842+0000","last_peered":"2024-04-16T19:35:59.385842+0000","last_clean":"2024-04-16T19:35:59.385842+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:35:59.385842+0000","last_undegraded":"2024-04-16T19:35:59.385842+0000","last_fullsized":"2024-04-16T19:35:59.385842+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:08.382972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'6","reported_seq":366,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.578461+0000","last_change":"2024-04-16T17:45:45.454358+0000","last_active":"2024-04-16T19:36:29.578461+0000","last_peered":"2024-04-16T19:36:29.578461+0000","last_clean":"2024-04-16T19:36:29.578461+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:36:29.578461+0000","last_undegraded":"2024-04-16T19:36:29.578461+0000","last_fullsized":"2024-04-16T19:36:29.578461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:54.375005+0000","last_change":"2024-04-16T17:45:10.390881+0000","last_active":"2024-04-16T19:34:54.375005+0000","last_peered":"2024-04-16T19:34:54.375005+0000","last_clean":"2024-04-16T19:34:54.375005+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:34:54.375005+0000","last_undegraded":"2024-04-16T19:34:54.375005+0000","last_fullsized":"2024-04-16T19:34:54.375005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:58.273468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404236+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:37:39.404236+0000","last_peered":"2024-04-16T19:37:39.404236+0000","last_clean":"2024-04-16T19:37:39.404236+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:37:39.404236+0000","last_undegraded":"2024-04-16T19:37:39.404236+0000","last_fullsized":"2024-04-16T19:37:39.404236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'20","reported_seq":428,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.253459+0000","last_change":"2024-04-16T19:38:09.253495+0000","last_active":"2024-04-16T19:38:09.253459+0000","last_peered":"2024-04-16T19:38:09.253459+0000","last_clean":"2024-04-16T19:38:09.253459+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:38:09.253459+0000","last_undegraded":"2024-04-16T19:38:09.253459+0000","last_fullsized":"2024-04-16T19:38:09.253459+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.253410+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:49.003227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596830+0000","last_change":"2024-04-16T17:45:10.393700+0000","last_active":"2024-04-16T19:37:59.596830+0000","last_peered":"2024-04-16T19:37:59.596830+0000","last_clean":"2024-04-16T19:37:59.596830+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:37:59.596830+0000","last_undegraded":"2024-04-16T19:37:59.596830+0000","last_fullsized":"2024-04-16T19:37:59.596830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380398+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:35:24.380398+0000","last_peered":"2024-04-16T19:35:24.380398+0000","last_clean":"2024-04-16T19:35:24.380398+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:35:24.380398+0000","last_undegraded":"2024-04-16T19:35:24.380398+0000","last_fullsized":"2024-04-16T19:35:24.380398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:58.752336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'14","reported_seq":682,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:14.575358+0000","last_change":"2024-04-16T17:45:45.455567+0000","last_active":"2024-04-16T19:36:14.575358+0000","last_peered":"2024-04-16T19:36:14.575358+0000","last_clean":"2024-04-16T19:36:14.575358+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:36:14.575358+0000","last_undegraded":"2024-04-16T19:36:14.575358+0000","last_fullsized":"2024-04-16T19:36:14.575358+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.381352+0000","last_change":"2024-04-16T17:45:10.390598+0000","last_active":"2024-04-16T19:35:29.381352+0000","last_peered":"2024-04-16T19:35:29.381352+0000","last_clean":"2024-04-16T19:35:29.381352+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:35:29.381352+0000","last_undegraded":"2024-04-16T19:35:29.381352+0000","last_fullsized":"2024-04-16T19:35:29.381352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:28:19.566537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404301+0000","last_change":"2024-04-16T17:45:08.389493+0000","last_active":"2024-04-16T19:37:39.404301+0000","last_peered":"2024-04-16T19:37:39.404301+0000","last_clean":"2024-04-16T19:37:39.404301+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:37:39.404301+0000","last_undegraded":"2024-04-16T19:37:39.404301+0000","last_fullsized":"2024-04-16T19:37:39.404301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'15","reported_seq":211,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:09.368646+0000","last_change":"2024-04-16T17:45:45.464470+0000","last_active":"2024-04-16T19:34:09.368646+0000","last_peered":"2024-04-16T19:34:09.368646+0000","last_clean":"2024-04-16T19:34:09.368646+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:34:09.368646+0000","last_undegraded":"2024-04-16T19:34:09.368646+0000","last_fullsized":"2024-04-16T19:34:09.368646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:44:14.079978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:29.380416+0000","last_change":"2024-04-16T17:45:10.397665+0000","last_active":"2024-04-16T19:35:29.380416+0000","last_peered":"2024-04-16T19:35:29.380416+0000","last_clean":"2024-04-16T19:35:29.380416+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:35:29.380416+0000","last_undegraded":"2024-04-16T19:35:29.380416+0000","last_fullsized":"2024-04-16T19:35:29.380416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:37:53.725890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:24.380581+0000","last_change":"2024-04-16T17:45:08.386399+0000","last_active":"2024-04-16T19:35:24.380581+0000","last_peered":"2024-04-16T19:35:24.380581+0000","last_clean":"2024-04-16T19:35:24.380581+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:35:24.380581+0000","last_undegraded":"2024-04-16T19:35:24.380581+0000","last_fullsized":"2024-04-16T19:35:24.380581+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:27:55.689073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'3","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576679+0000","last_change":"2024-04-16T17:45:45.455538+0000","last_active":"2024-04-16T19:36:19.576679+0000","last_peered":"2024-04-16T19:36:19.576679+0000","last_clean":"2024-04-16T19:36:19.576679+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:36:19.576679+0000","last_undegraded":"2024-04-16T19:36:19.576679+0000","last_fullsized":"2024-04-16T19:36:19.576679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405149+0000","last_change":"2024-04-16T17:45:10.393634+0000","last_active":"2024-04-16T19:37:44.405149+0000","last_peered":"2024-04-16T19:37:44.405149+0000","last_clean":"2024-04-16T19:37:44.405149+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:37:44.405149+0000","last_undegraded":"2024-04-16T19:37:44.405149+0000","last_fullsized":"2024-04-16T19:37:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:44.383699+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:35:44.383699+0000","last_peered":"2024-04-16T19:35:44.383699+0000","last_clean":"2024-04-16T19:35:44.383699+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:35:44.383699+0000","last_undegraded":"2024-04-16T19:35:44.383699+0000","last_fullsized":"2024-04-16T19:35:44.383699+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:29:55.231268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'9","reported_seq":449,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576599+0000","last_change":"2024-04-16T17:45:45.454411+0000","last_active":"2024-04-16T19:36:19.576599+0000","last_peered":"2024-04-16T19:36:19.576599+0000","last_clean":"2024-04-16T19:36:19.576599+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:36:19.576599+0000","last_undegraded":"2024-04-16T19:36:19.576599+0000","last_fullsized":"2024-04-16T19:36:19.576599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593626+0000","last_change":"2024-04-16T17:45:10.399193+0000","last_active":"2024-04-16T19:37:44.593626+0000","last_peered":"2024-04-16T19:37:44.593626+0000","last_clean":"2024-04-16T19:37:44.593626+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:37:44.593626+0000","last_undegraded":"2024-04-16T19:37:44.593626+0000","last_fullsized":"2024-04-16T19:37:44.593626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586630+0000","last_change":"2024-04-16T17:45:08.388974+0000","last_active":"2024-04-16T19:37:09.586630+0000","last_peered":"2024-04-16T19:37:09.586630+0000","last_clean":"2024-04-16T19:37:09.586630+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:37:09.586630+0000","last_undegraded":"2024-04-16T19:37:09.586630+0000","last_fullsized":"2024-04-16T19:37:09.586630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'3","reported_seq":163,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391432+0000","last_change":"2024-04-16T17:45:45.466411+0000","last_active":"2024-04-16T19:36:19.391432+0000","last_peered":"2024-04-16T19:36:19.391432+0000","last_clean":"2024-04-16T19:36:19.391432+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:36:19.391432+0000","last_undegraded":"2024-04-16T19:36:19.391432+0000","last_fullsized":"2024-04-16T19:36:19.391432+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:54.365563+0000","last_change":"2024-04-16T17:45:10.392230+0000","last_active":"2024-04-16T19:33:54.365563+0000","last_peered":"2024-04-16T19:33:54.365563+0000","last_clean":"2024-04-16T19:33:54.365563+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:33:54.365563+0000","last_undegraded":"2024-04-16T19:33:54.365563+0000","last_fullsized":"2024-04-16T19:33:54.365563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:45:41.531980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374829+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:34:49.374829+0000","last_peered":"2024-04-16T19:34:49.374829+0000","last_clean":"2024-04-16T19:34:49.374829+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:34:49.374829+0000","last_undegraded":"2024-04-16T19:34:49.374829+0000","last_fullsized":"2024-04-16T19:34:49.374829+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:56.266007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'14","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.249586+0000","last_change":"2024-04-16T19:38:08.249652+0000","last_active":"2024-04-16T19:38:08.249586+0000","last_peered":"2024-04-16T19:38:08.249586+0000","last_clean":"2024-04-16T19:38:08.249586+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:38:08.249586+0000","last_undegraded":"2024-04-16T19:38:08.249586+0000","last_fullsized":"2024-04-16T19:38:08.249586+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.249524+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:54.283196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:34:49.374628+0000","last_change":"2024-04-16T17:45:08.386818+0000","last_active":"2024-04-16T19:34:49.374628+0000","last_peered":"2024-04-16T19:34:49.374628+0000","last_clean":"2024-04-16T19:34:49.374628+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:34:49.374628+0000","last_undegraded":"2024-04-16T19:34:49.374628+0000","last_fullsized":"2024-04-16T19:34:49.374628+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:46:29.526811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395757+0000","last_change":"2024-04-16T17:45:10.391395+0000","last_active":"2024-04-16T19:36:44.395757+0000","last_peered":"2024-04-16T19:36:44.395757+0000","last_clean":"2024-04-16T19:36:44.395757+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:36:44.395757+0000","last_undegraded":"2024-04-16T19:36:44.395757+0000","last_fullsized":"2024-04-16T19:36:44.395757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'29","reported_seq":755,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:35:49.570606+0000","last_change":"2024-04-16T17:45:45.461627+0000","last_active":"2024-04-16T19:35:49.570606+0000","last_peered":"2024-04-16T19:35:49.570606+0000","last_clean":"2024-04-16T19:35:49.570606+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:35:49.570606+0000","last_undegraded":"2024-04-16T19:35:49.570606+0000","last_fullsized":"2024-04-16T19:35:49.570606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586482+0000","last_change":"2024-04-16T17:45:08.389341+0000","last_active":"2024-04-16T19:37:09.586482+0000","last_peered":"2024-04-16T19:37:09.586482+0000","last_clean":"2024-04-16T19:37:09.586482+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:37:09.586482+0000","last_undegraded":"2024-04-16T19:37:09.586482+0000","last_fullsized":"2024-04-16T19:37:09.586482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:33:59.366646+0000","last_change":"2024-04-16T17:45:10.395147+0000","last_active":"2024-04-16T19:33:59.366646+0000","last_peered":"2024-04-16T19:33:59.366646+0000","last_clean":"2024-04-16T19:33:59.366646+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:33:59.366646+0000","last_undegraded":"2024-04-16T19:33:59.366646+0000","last_fullsized":"2024-04-16T19:33:59.366646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:21:56.222153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4205,"ondisk_log_size":4205,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3706,"ondisk_log_size":3706,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20907,"ondisk_log_size":20907,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5228,"ondisk_log_size":5228,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641625,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46644,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810956,"statfs":{"total":107374182400,"available":107326418944,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641624,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":58984,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104798616,"statfs":{"total":107374182400,"available":107313782784,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641625,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":83468,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":104774132,"statfs":{"total":107374182400,"available":107288711168,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641625,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46796,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810804,"statfs":{"total":107374182400,"available":107326263296,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641624,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46772,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810828,"statfs":{"total":107374182400,"available":107326287872,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641625,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":51520,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806080,"statfs":{"total":107374182400,"available":107321425920,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:38:10.754 INFO:tasks.ceph:pgid 9.35 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.754 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.755 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.755 INFO:tasks.ceph:pgid 9.34 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.755 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.755 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.755 INFO:tasks.ceph:pgid 9.37 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.756 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.756 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.756 INFO:tasks.ceph:pgid 9.36 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.756 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.757 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.757 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.757 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.757 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.757 INFO:tasks.ceph:pgid 9.30 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.758 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.758 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.758 INFO:tasks.ceph:pgid 9.33 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.758 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.759 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.759 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.759 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.759 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.759 INFO:tasks.ceph:pgid 9.3d last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.760 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.760 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.760 INFO:tasks.ceph:pgid 9.3c last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.760 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.760 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.761 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.761 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.761 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.761 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.761 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.762 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.762 INFO:tasks.ceph:pgid 9.39 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.762 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.762 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.763 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.763 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.763 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.764 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.764 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.764 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.764 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.764 INFO:tasks.ceph:pgid 11.1b last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.765 INFO:tasks.ceph:pgid 10.1a last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.765 INFO:tasks.ceph:pgid 9.19 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.765 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.765 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.765 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.766 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.766 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.766 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.766 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.767 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.767 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.767 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.767 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.768 INFO:tasks.ceph:pgid 10.1b last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.768 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.768 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.768 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.768 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.769 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.769 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.769 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.769 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.770 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.770 INFO:tasks.ceph:pgid 13.1f last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.770 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.770 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.770 INFO:tasks.ceph:pgid 10.18 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.771 INFO:tasks.ceph:pgid 9.1b last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.771 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.771 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.771 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.772 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.772 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.772 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.772 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.773 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.773 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.773 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.773 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.774 INFO:tasks.ceph:pgid 9.1a last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.774 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.774 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.774 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.774 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.775 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.775 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.775 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.775 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.775 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.776 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.776 INFO:tasks.ceph:pgid 11.7 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.776 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.776 INFO:tasks.ceph:pgid 9.5 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.777 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.777 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.777 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.777 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.777 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.778 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.778 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.778 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.778 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.779 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.779 INFO:tasks.ceph:pgid 11.6 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.779 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.779 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.779 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.780 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.780 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.780 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.780 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.780 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.781 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.781 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.781 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.781 INFO:tasks.ceph:pgid 11.5 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.781 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.782 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.782 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.782 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.782 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.783 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.783 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.783 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.783 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.783 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.783 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.784 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.784 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.784 INFO:tasks.ceph:pgid 10.5 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.784 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.784 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.785 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.785 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.785 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.785 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.785 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.786 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.786 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.786 INFO:tasks.ceph:pgid 13.5 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.786 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.786 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.787 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.787 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.787 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.787 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.787 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.788 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.788 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.788 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.788 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.788 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.789 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.789 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.789 INFO:tasks.ceph:pgid 11.2 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.789 INFO:tasks.ceph:pgid 10.3 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.789 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.789 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.790 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.790 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.790 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.790 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.790 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.791 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.791 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.791 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.791 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.792 INFO:tasks.ceph:pgid 11.1 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.792 INFO:tasks.ceph:pgid 10.0 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.792 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.792 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.792 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.793 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.793 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.793 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.793 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.793 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.794 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.794 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.794 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.794 INFO:tasks.ceph:pgid 11.0 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.794 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.795 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.795 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.795 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.795 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.795 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.796 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.796 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.796 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.796 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.796 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.797 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.797 INFO:tasks.ceph:pgid 11.a last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.797 INFO:tasks.ceph:pgid 10.b last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.797 INFO:tasks.ceph:pgid 9.8 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.797 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.798 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T17:44:20.155639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=20, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.798 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.798 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.798 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.798 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.799 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.799 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.799 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.799 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.799 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.800 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.800 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.800 INFO:tasks.ceph:pgid 10.8 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.800 INFO:tasks.ceph:pgid 9.b last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.800 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.801 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.801 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.801 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.801 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.801 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.801 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.802 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.802 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.802 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.802 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.803 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.803 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.803 INFO:tasks.ceph:pgid 9.a last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.803 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.803 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.803 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.804 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.804 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.804 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.804 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.804 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.805 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.805 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.805 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.805 INFO:tasks.ceph:pgid 11.b last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.805 INFO:tasks.ceph:pgid 10.a last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.805 INFO:tasks.ceph:pgid 9.9 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.806 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.806 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.806 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.806 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.806 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.807 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.807 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.807 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.807 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.807 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.808 INFO:tasks.ceph:pgid 12.a last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.808 INFO:tasks.ceph:pgid 11.d last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.808 INFO:tasks.ceph:pgid 10.c last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.808 INFO:tasks.ceph:pgid 9.f last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.808 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.808 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.809 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.809 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.809 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.809 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.809 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.810 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.810 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.810 INFO:tasks.ceph:pgid 13.a last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.810 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.810 INFO:tasks.ceph:pgid 11.c last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.811 INFO:tasks.ceph:pgid 10.d last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.811 INFO:tasks.ceph:pgid 9.e last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.811 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.811 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.811 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.812 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.812 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.812 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.812 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.812 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.813 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.813 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.813 INFO:tasks.ceph:pgid 12.8 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.813 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.813 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.813 INFO:tasks.ceph:pgid 9.d last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.814 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.814 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.814 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.814 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.814 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.815 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.815 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.815 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.815 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.815 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.815 INFO:tasks.ceph:pgid 12.9 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.816 INFO:tasks.ceph:pgid 11.e last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.816 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.816 INFO:tasks.ceph:pgid 9.c last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.816 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.817 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.817 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.817 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.817 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.817 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.818 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.818 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.818 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.818 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.818 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.819 INFO:tasks.ceph:pgid 11.1c last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.819 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.819 INFO:tasks.ceph:pgid 9.1e last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.819 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.819 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.820 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.820 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.820 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.820 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.820 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.820 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.821 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.821 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.821 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.821 INFO:tasks.ceph:pgid 10.1c last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.821 INFO:tasks.ceph:pgid 9.1f last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.822 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.822 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.822 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.822 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.822 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.823 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.823 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.823 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.823 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.823 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.824 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.824 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.824 INFO:tasks.ceph:pgid 9.1c last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.824 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.824 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.825 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.825 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.825 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.825 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.825 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.825 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.826 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.826 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.826 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.826 INFO:tasks.ceph:pgid 10.1e last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.826 INFO:tasks.ceph:pgid 9.1d last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.827 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.827 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.827 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.827 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.827 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.828 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.828 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.828 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.828 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.828 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.828 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.829 INFO:tasks.ceph:pgid 10.11 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.829 INFO:tasks.ceph:pgid 9.12 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.829 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.829 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.829 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.829 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.830 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.830 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.830 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.830 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.830 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.831 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.831 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.831 INFO:tasks.ceph:pgid 10.10 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.831 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.831 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.832 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.832 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.832 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.832 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.832 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.833 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.833 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.833 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.833 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.833 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.833 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.834 INFO:tasks.ceph:pgid 9.10 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.834 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.834 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.834 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.834 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.835 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.835 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.835 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.835 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.835 INFO:tasks.ceph:pgid 13.15 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.835 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.836 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.836 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.836 INFO:tasks.ceph:pgid 9.11 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.836 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.836 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.837 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.837 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.837 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.837 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.837 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.837 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.838 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.838 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.838 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.838 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.838 INFO:tasks.ceph:pgid 9.16 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.839 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.839 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.839 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.839 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.839 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.840 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.840 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.840 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.840 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.840 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.840 INFO:tasks.ceph:pgid 11.15 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.841 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.841 INFO:tasks.ceph:pgid 9.17 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.841 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.841 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.841 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.842 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.842 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.842 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.842 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.842 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.842 INFO:tasks.ceph:pgid 13.10 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.843 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.843 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.843 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.843 INFO:tasks.ceph:pgid 9.14 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.843 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.843 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.844 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.844 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.844 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.844 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.844 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.845 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.845 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.845 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.845 INFO:tasks.ceph:pgid 11.17 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.845 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2024-04-16T17:45:46.441235+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=46, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.845 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.846 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.846 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.846 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.846 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.846 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.847 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.847 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.847 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.847 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.847 INFO:tasks.ceph:pgid 9.2b last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.847 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.848 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.848 INFO:tasks.ceph:pgid 9.28 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.848 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.848 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.848 INFO:tasks.ceph:pgid 9.29 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.848 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.849 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.849 INFO:tasks.ceph:pgid 9.2e last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.849 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.849 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.849 INFO:tasks.ceph:pgid 9.2f last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.850 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.850 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.850 INFO:tasks.ceph:pgid 9.2c last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.850 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.850 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.850 INFO:tasks.ceph:pgid 9.2d last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.851 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.851 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.851 INFO:tasks.ceph:pgid 9.22 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.851 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.851 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.852 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.852 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.852 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.852 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.852 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.853 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.853 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.853 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.853 INFO:tasks.ceph:pgid 9.26 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.853 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.853 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.854 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.854 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.854 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.854 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.854 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.854 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.855 INFO:tasks.ceph:pgid 9.25 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.855 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.855 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.855 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.855 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.856 INFO:tasks.ceph:pgid 9.3b last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.856 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.856 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:10.856 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T19:38:30.857 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:38:31.211 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:38:31.230 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:38:31.232 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3472,"stamp":"2024-04-16T19:38:30.506593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":365336,"num_omap_keys":1682,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36601,"ondisk_log_size":36601,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":354984,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":343798,"kb_avail":628790616,"statfs":{"total":644245094400,"available":643881590784,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":352049825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":115691,"num_omap_keys":558,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005490"},"pg_stats":[{"pgid":"9.35","version":"53'26","reported_seq":533,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.834637+0000","last_change":"2024-04-16T19:38:15.834693+0000","last_active":"2024-04-16T19:38:15.834637+0000","last_peered":"2024-04-16T19:38:15.834637+0000","last_clean":"2024-04-16T19:38:15.834637+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:38:15.834637+0000","last_undegraded":"2024-04-16T19:38:15.834637+0000","last_fullsized":"2024-04-16T19:38:15.834637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.834573+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:46.410400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.402007+0000","last_change":"2024-04-16T17:45:08.383247+0000","last_active":"2024-04-16T19:37:39.402007+0000","last_peered":"2024-04-16T19:37:39.402007+0000","last_clean":"2024-04-16T19:37:39.402007+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:37:39.402007+0000","last_undegraded":"2024-04-16T19:37:39.402007+0000","last_fullsized":"2024-04-16T19:37:39.402007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401790+0000","last_change":"2024-04-16T17:45:10.400343+0000","last_active":"2024-04-16T19:37:44.401790+0000","last_peered":"2024-04-16T19:37:44.401790+0000","last_clean":"2024-04-16T19:37:44.401790+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:37:44.401790+0000","last_undegraded":"2024-04-16T19:37:44.401790+0000","last_fullsized":"2024-04-16T19:37:44.401790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'12","reported_seq":303,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.799796+0000","last_change":"2024-04-16T19:38:20.799846+0000","last_active":"2024-04-16T19:38:20.799796+0000","last_peered":"2024-04-16T19:38:20.799796+0000","last_clean":"2024-04-16T19:38:20.799796+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:38:20.799796+0000","last_undegraded":"2024-04-16T19:38:20.799796+0000","last_fullsized":"2024-04-16T19:38:20.799796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.799730+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:28.459361+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592809+0000","last_change":"2024-04-16T17:45:08.381595+0000","last_active":"2024-04-16T19:37:39.592809+0000","last_peered":"2024-04-16T19:37:39.592809+0000","last_clean":"2024-04-16T19:37:39.592809+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:37:39.592809+0000","last_undegraded":"2024-04-16T19:37:39.592809+0000","last_fullsized":"2024-04-16T19:37:39.592809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402554+0000","last_change":"2024-04-16T17:45:10.390675+0000","last_active":"2024-04-16T19:37:44.402554+0000","last_peered":"2024-04-16T19:37:44.402554+0000","last_clean":"2024-04-16T19:37:44.402554+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:37:44.402554+0000","last_undegraded":"2024-04-16T19:37:44.402554+0000","last_fullsized":"2024-04-16T19:37:44.402554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'13","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.533976+0000","last_change":"2024-04-16T19:38:20.534037+0000","last_active":"2024-04-16T19:38:20.533976+0000","last_peered":"2024-04-16T19:38:20.533976+0000","last_clean":"2024-04-16T19:38:20.533976+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:38:20.533976+0000","last_undegraded":"2024-04-16T19:38:20.533976+0000","last_fullsized":"2024-04-16T19:38:20.533976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.533905+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:22.838173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404360+0000","last_change":"2024-04-16T17:45:08.381577+0000","last_active":"2024-04-16T19:37:39.404360+0000","last_peered":"2024-04-16T19:37:39.404360+0000","last_clean":"2024-04-16T19:37:39.404360+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:37:39.404360+0000","last_undegraded":"2024-04-16T19:37:39.404360+0000","last_fullsized":"2024-04-16T19:37:39.404360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401570+0000","last_change":"2024-04-16T17:45:10.394273+0000","last_active":"2024-04-16T19:37:44.401570+0000","last_peered":"2024-04-16T19:37:44.401570+0000","last_clean":"2024-04-16T19:37:44.401570+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:37:44.401570+0000","last_undegraded":"2024-04-16T19:37:44.401570+0000","last_fullsized":"2024-04-16T19:37:44.401570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'14","reported_seq":262,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.837756+0000","last_change":"2024-04-16T19:38:11.837803+0000","last_active":"2024-04-16T19:38:11.837756+0000","last_peered":"2024-04-16T19:38:11.837756+0000","last_clean":"2024-04-16T19:38:11.837756+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:38:11.837756+0000","last_undegraded":"2024-04-16T19:38:11.837756+0000","last_fullsized":"2024-04-16T19:38:11.837756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.837694+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:14.141962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.399688+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:37:29.399688+0000","last_peered":"2024-04-16T19:37:29.399688+0000","last_clean":"2024-04-16T19:37:29.399688+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:37:29.399688+0000","last_undegraded":"2024-04-16T19:37:29.399688+0000","last_fullsized":"2024-04-16T19:37:29.399688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405200+0000","last_change":"2024-04-16T17:45:10.398320+0000","last_active":"2024-04-16T19:37:44.405200+0000","last_peered":"2024-04-16T19:37:44.405200+0000","last_clean":"2024-04-16T19:37:44.405200+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:37:44.405200+0000","last_undegraded":"2024-04-16T19:37:44.405200+0000","last_fullsized":"2024-04-16T19:37:44.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'7","reported_seq":516,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402270+0000","last_change":"2024-04-16T17:45:45.455611+0000","last_active":"2024-04-16T19:37:49.402270+0000","last_peered":"2024-04-16T19:37:49.402270+0000","last_clean":"2024-04-16T19:37:49.402270+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:37:49.402270+0000","last_undegraded":"2024-04-16T19:37:49.402270+0000","last_fullsized":"2024-04-16T19:37:49.402270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401891+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:37:39.401891+0000","last_peered":"2024-04-16T19:37:39.401891+0000","last_clean":"2024-04-16T19:37:39.401891+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:37:39.401891+0000","last_undegraded":"2024-04-16T19:37:39.401891+0000","last_fullsized":"2024-04-16T19:37:39.401891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.400385+0000","last_change":"2024-04-16T17:45:10.395553+0000","last_active":"2024-04-16T19:37:34.400385+0000","last_peered":"2024-04-16T19:37:34.400385+0000","last_clean":"2024-04-16T19:37:34.400385+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:37:34.400385+0000","last_undegraded":"2024-04-16T19:37:34.400385+0000","last_fullsized":"2024-04-16T19:37:34.400385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'16","reported_seq":332,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.177690+0000","last_change":"2024-04-16T19:38:15.177758+0000","last_active":"2024-04-16T19:38:15.177690+0000","last_peered":"2024-04-16T19:38:15.177690+0000","last_clean":"2024-04-16T19:38:15.177690+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:38:15.177690+0000","last_undegraded":"2024-04-16T19:38:15.177690+0000","last_fullsized":"2024-04-16T19:38:15.177690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.177626+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:51.929131+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576438+0000","last_change":"2024-04-16T17:46:16.500171+0000","last_active":"2024-04-16T19:36:19.576438+0000","last_peered":"2024-04-16T19:36:19.576438+0000","last_clean":"2024-04-16T19:36:19.576438+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:36:19.576438+0000","last_undegraded":"2024-04-16T19:36:19.576438+0000","last_fullsized":"2024-04-16T19:36:19.576438+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401663+0000","last_change":"2024-04-16T17:45:10.397556+0000","last_active":"2024-04-16T19:37:44.401663+0000","last_peered":"2024-04-16T19:37:44.401663+0000","last_clean":"2024-04-16T19:37:44.401663+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:37:44.401663+0000","last_undegraded":"2024-04-16T19:37:44.401663+0000","last_fullsized":"2024-04-16T19:37:44.401663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'16","reported_seq":558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.885890+0000","last_change":"2024-04-16T19:38:15.885941+0000","last_active":"2024-04-16T19:38:15.885890+0000","last_peered":"2024-04-16T19:38:15.885890+0000","last_clean":"2024-04-16T19:38:15.885890+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:38:15.885890+0000","last_undegraded":"2024-04-16T19:38:15.885890+0000","last_fullsized":"2024-04-16T19:38:15.885890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.885831+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:24.282989+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401833+0000","last_change":"2024-04-16T17:45:08.383652+0000","last_active":"2024-04-16T19:37:39.401833+0000","last_peered":"2024-04-16T19:37:39.401833+0000","last_clean":"2024-04-16T19:37:39.401833+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:37:39.401833+0000","last_undegraded":"2024-04-16T19:37:39.401833+0000","last_fullsized":"2024-04-16T19:37:39.401833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401925+0000","last_change":"2024-04-16T17:45:10.395876+0000","last_active":"2024-04-16T19:37:44.401925+0000","last_peered":"2024-04-16T19:37:44.401925+0000","last_clean":"2024-04-16T19:37:44.401925+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:37:44.401925+0000","last_undegraded":"2024-04-16T19:37:44.401925+0000","last_fullsized":"2024-04-16T19:37:44.401925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'6","reported_seq":431,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.405491+0000","last_change":"2024-04-16T17:45:45.457177+0000","last_active":"2024-04-16T19:38:09.405491+0000","last_peered":"2024-04-16T19:38:09.405491+0000","last_clean":"2024-04-16T19:38:09.405491+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:38:09.405491+0000","last_undegraded":"2024-04-16T19:38:09.405491+0000","last_fullsized":"2024-04-16T19:38:09.405491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592526+0000","last_change":"2024-04-16T17:45:08.389961+0000","last_active":"2024-04-16T19:37:39.592526+0000","last_peered":"2024-04-16T19:37:39.592526+0000","last_clean":"2024-04-16T19:37:39.592526+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:37:39.592526+0000","last_undegraded":"2024-04-16T19:37:39.592526+0000","last_fullsized":"2024-04-16T19:37:39.592526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593660+0000","last_change":"2024-04-16T17:45:10.399056+0000","last_active":"2024-04-16T19:37:44.593660+0000","last_peered":"2024-04-16T19:37:44.593660+0000","last_clean":"2024-04-16T19:37:44.593660+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:37:44.593660+0000","last_undegraded":"2024-04-16T19:37:44.593660+0000","last_fullsized":"2024-04-16T19:37:44.593660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'10","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.728428+0000","last_change":"2024-04-16T19:38:23.728493+0000","last_active":"2024-04-16T19:38:23.728428+0000","last_peered":"2024-04-16T19:38:23.728428+0000","last_clean":"2024-04-16T19:38:23.728428+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:38:23.728428+0000","last_undegraded":"2024-04-16T19:38:23.728428+0000","last_fullsized":"2024-04-16T19:38:23.728428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.728366+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:54.049051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396645+0000","last_change":"2024-04-16T17:45:10.394927+0000","last_active":"2024-04-16T19:37:14.396645+0000","last_peered":"2024-04-16T19:37:14.396645+0000","last_clean":"2024-04-16T19:37:14.396645+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:37:14.396645+0000","last_undegraded":"2024-04-16T19:37:14.396645+0000","last_fullsized":"2024-04-16T19:37:14.396645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.392691+0000","last_change":"2024-04-16T17:45:08.388693+0000","last_active":"2024-04-16T19:36:39.392691+0000","last_peered":"2024-04-16T19:36:39.392691+0000","last_clean":"2024-04-16T19:36:39.392691+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:36:39.392691+0000","last_undegraded":"2024-04-16T19:36:39.392691+0000","last_fullsized":"2024-04-16T19:36:39.392691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'12","reported_seq":363,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.931333+0000","last_change":"2024-04-16T19:38:17.931378+0000","last_active":"2024-04-16T19:38:17.931333+0000","last_peered":"2024-04-16T19:38:17.931333+0000","last_clean":"2024-04-16T19:38:17.931333+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:38:17.931333+0000","last_undegraded":"2024-04-16T19:38:17.931333+0000","last_fullsized":"2024-04-16T19:38:17.931333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.931272+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:07.574424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.397493+0000","last_change":"2024-04-16T17:45:10.393548+0000","last_active":"2024-04-16T19:37:14.397493+0000","last_peered":"2024-04-16T19:37:14.397493+0000","last_clean":"2024-04-16T19:37:14.397493+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:37:14.397493+0000","last_undegraded":"2024-04-16T19:37:14.397493+0000","last_fullsized":"2024-04-16T19:37:14.397493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.389378+0000","last_change":"2024-04-16T17:45:08.388744+0000","last_active":"2024-04-16T19:36:19.389378+0000","last_peered":"2024-04-16T19:36:19.389378+0000","last_clean":"2024-04-16T19:36:19.389378+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:36:19.389378+0000","last_undegraded":"2024-04-16T19:36:19.389378+0000","last_fullsized":"2024-04-16T19:36:19.389378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'5","reported_seq":513,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976960+0000","last_change":"2024-04-16T17:45:45.456392+0000","last_active":"2024-04-16T19:38:08.976960+0000","last_peered":"2024-04-16T19:38:08.976960+0000","last_clean":"2024-04-16T19:38:08.976960+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:38:08.976960+0000","last_undegraded":"2024-04-16T19:38:08.976960+0000","last_fullsized":"2024-04-16T19:38:08.976960+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.400330+0000","last_change":"2024-04-16T17:45:10.392335+0000","last_active":"2024-04-16T19:37:34.400330+0000","last_peered":"2024-04-16T19:37:34.400330+0000","last_clean":"2024-04-16T19:37:34.400330+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:37:34.400330+0000","last_undegraded":"2024-04-16T19:37:34.400330+0000","last_fullsized":"2024-04-16T19:37:34.400330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.389191+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:36:19.389191+0000","last_peered":"2024-04-16T19:36:19.389191+0000","last_clean":"2024-04-16T19:36:19.389191+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:36:19.389191+0000","last_undegraded":"2024-04-16T19:36:19.389191+0000","last_fullsized":"2024-04-16T19:36:19.389191+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'10","reported_seq":236,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977015+0000","last_change":"2024-04-16T17:45:45.455448+0000","last_active":"2024-04-16T19:38:08.977015+0000","last_peered":"2024-04-16T19:38:08.977015+0000","last_clean":"2024-04-16T19:38:08.977015+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:38:08.977015+0000","last_undegraded":"2024-04-16T19:38:08.977015+0000","last_fullsized":"2024-04-16T19:38:08.977015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577524+0000","last_change":"2024-04-16T17:45:10.391411+0000","last_active":"2024-04-16T19:36:24.577524+0000","last_peered":"2024-04-16T19:36:24.577524+0000","last_clean":"2024-04-16T19:36:24.577524+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:36:24.577524+0000","last_undegraded":"2024-04-16T19:36:24.577524+0000","last_fullsized":"2024-04-16T19:36:24.577524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.388678+0000","last_change":"2024-04-16T17:45:08.382324+0000","last_active":"2024-04-16T19:36:19.388678+0000","last_peered":"2024-04-16T19:36:19.388678+0000","last_clean":"2024-04-16T19:36:19.388678+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:36:19.388678+0000","last_undegraded":"2024-04-16T19:36:19.388678+0000","last_fullsized":"2024-04-16T19:36:19.388678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"53'9","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.926373+0000","last_change":"2024-04-16T19:38:21.926413+0000","last_active":"2024-04-16T19:38:21.926373+0000","last_peered":"2024-04-16T19:38:21.926373+0000","last_clean":"2024-04-16T19:38:21.926373+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:38:21.926373+0000","last_undegraded":"2024-04-16T19:38:21.926373+0000","last_fullsized":"2024-04-16T19:38:21.926373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'9","last_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_deep_scrub":"53'9","last_deep_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.926308+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:31.946481+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577561+0000","last_change":"2024-04-16T17:45:10.393503+0000","last_active":"2024-04-16T19:36:24.577561+0000","last_peered":"2024-04-16T19:36:24.577561+0000","last_clean":"2024-04-16T19:36:24.577561+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:36:24.577561+0000","last_undegraded":"2024-04-16T19:36:24.577561+0000","last_fullsized":"2024-04-16T19:36:24.577561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391358+0000","last_change":"2024-04-16T17:45:08.387116+0000","last_active":"2024-04-16T19:36:19.391358+0000","last_peered":"2024-04-16T19:36:19.391358+0000","last_clean":"2024-04-16T19:36:19.391358+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:36:19.391358+0000","last_undegraded":"2024-04-16T19:36:19.391358+0000","last_fullsized":"2024-04-16T19:36:19.391358+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"48'1","reported_seq":224,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976860+0000","last_change":"2024-04-16T17:45:45.455236+0000","last_active":"2024-04-16T19:38:08.976860+0000","last_peered":"2024-04-16T19:38:08.976860+0000","last_clean":"2024-04-16T19:38:08.976860+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:38:08.976860+0000","last_undegraded":"2024-04-16T19:38:08.976860+0000","last_fullsized":"2024-04-16T19:38:08.976860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.389356+0000","last_change":"2024-04-16T17:45:10.397627+0000","last_active":"2024-04-16T19:36:24.389356+0000","last_peered":"2024-04-16T19:36:24.389356+0000","last_clean":"2024-04-16T19:36:24.389356+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:36:24.389356+0000","last_undegraded":"2024-04-16T19:36:24.389356+0000","last_fullsized":"2024-04-16T19:36:24.389356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.091384+0000","last_change":"2024-04-16T19:38:24.091408+0000","last_active":"2024-04-16T19:38:24.091384+0000","last_peered":"2024-04-16T19:38:24.091384+0000","last_clean":"2024-04-16T19:38:24.091384+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:38:24.091384+0000","last_undegraded":"2024-04-16T19:38:24.091384+0000","last_fullsized":"2024-04-16T19:38:24.091384+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.091318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:55.045299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579644+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:36:34.579644+0000","last_peered":"2024-04-16T19:36:34.579644+0000","last_clean":"2024-04-16T19:36:34.579644+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:36:34.579644+0000","last_undegraded":"2024-04-16T19:36:34.579644+0000","last_fullsized":"2024-04-16T19:36:34.579644+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'145","reported_seq":2258,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.394280+0000","last_change":"2024-04-16T17:46:25.527767+0000","last_active":"2024-04-16T19:36:49.394280+0000","last_peered":"2024-04-16T19:36:49.394280+0000","last_clean":"2024-04-16T19:36:49.394280+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:36:49.394280+0000","last_undegraded":"2024-04-16T19:36:49.394280+0000","last_fullsized":"2024-04-16T19:36:49.394280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.389301+0000","last_change":"2024-04-16T17:46:17.511976+0000","last_active":"2024-04-16T19:36:19.389301+0000","last_peered":"2024-04-16T19:36:19.389301+0000","last_clean":"2024-04-16T19:36:19.389301+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:36:19.389301+0000","last_undegraded":"2024-04-16T19:36:19.389301+0000","last_fullsized":"2024-04-16T19:36:19.389301+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'20","reported_seq":158,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069741+0000","last_change":"2024-04-16T17:45:51.478677+0000","last_active":"2024-04-16T19:38:08.069741+0000","last_peered":"2024-04-16T19:38:08.069741+0000","last_clean":"2024-04-16T19:38:08.069741+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:38:08.069741+0000","last_undegraded":"2024-04-16T19:38:08.069741+0000","last_fullsized":"2024-04-16T19:38:08.069741+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.556726+0000","last_change":"2024-04-16T19:38:18.556726+0000","last_active":"2024-04-16T19:38:18.556726+0000","last_peered":"2024-04-16T19:38:18.556726+0000","last_clean":"2024-04-16T19:38:18.556726+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:38:18.556726+0000","last_undegraded":"2024-04-16T19:38:18.556726+0000","last_fullsized":"2024-04-16T19:38:18.556726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.556600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:53.827149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'257","reported_seq":496,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.911983+0000","last_change":"2024-04-16T19:38:22.912055+0000","last_active":"2024-04-16T19:38:22.911983+0000","last_peered":"2024-04-16T19:38:22.911983+0000","last_clean":"2024-04-16T19:38:22.911983+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:38:22.911983+0000","last_undegraded":"2024-04-16T19:38:22.911983+0000","last_fullsized":"2024-04-16T19:38:22.911983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'257","last_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_deep_scrub":"53'257","last_deep_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.911925+0000","objects_scrubbed":14,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:02.872014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'17","reported_seq":406,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.523960+0000","last_change":"2024-04-16T19:38:28.524008+0000","last_active":"2024-04-16T19:38:28.523960+0000","last_peered":"2024-04-16T19:38:28.523960+0000","last_clean":"2024-04-16T19:38:28.523960+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:38:28.523960+0000","last_undegraded":"2024-04-16T19:38:28.523960+0000","last_fullsized":"2024-04-16T19:38:28.523960+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'17","last_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_deep_scrub":"53'17","last_deep_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.523901+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:10.769673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.391687+0000","last_change":"2024-04-16T17:45:26.430602+0000","last_active":"2024-04-16T19:36:39.391687+0000","last_peered":"2024-04-16T19:36:39.391687+0000","last_clean":"2024-04-16T19:36:39.391687+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:36:39.391687+0000","last_undegraded":"2024-04-16T19:36:39.391687+0000","last_fullsized":"2024-04-16T19:36:39.391687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.590783+0000","last_change":"2024-04-16T17:45:10.400976+0000","last_active":"2024-04-16T19:37:29.590783+0000","last_peered":"2024-04-16T19:37:29.590783+0000","last_clean":"2024-04-16T19:37:29.590783+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:37:29.590783+0000","last_undegraded":"2024-04-16T19:37:29.590783+0000","last_fullsized":"2024-04-16T19:37:29.590783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397429+0000","last_change":"2024-04-16T17:45:08.388375+0000","last_active":"2024-04-16T19:37:09.397429+0000","last_peered":"2024-04-16T19:37:09.397429+0000","last_clean":"2024-04-16T19:37:09.397429+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:37:09.397429+0000","last_undegraded":"2024-04-16T19:37:09.397429+0000","last_fullsized":"2024-04-16T19:37:09.397429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391655+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:36:34.391655+0000","last_peered":"2024-04-16T19:36:34.391655+0000","last_clean":"2024-04-16T19:36:34.391655+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:36:34.391655+0000","last_undegraded":"2024-04-16T19:36:34.391655+0000","last_fullsized":"2024-04-16T19:36:34.391655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.394003+0000","last_change":"2024-04-16T17:45:22.417279+0000","last_active":"2024-04-16T19:36:34.394003+0000","last_peered":"2024-04-16T19:36:34.394003+0000","last_clean":"2024-04-16T19:36:34.394003+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:36:34.394003+0000","last_undegraded":"2024-04-16T19:36:34.394003+0000","last_fullsized":"2024-04-16T19:36:34.394003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391741+0000","last_change":"2024-04-16T17:45:24.425550+0000","last_active":"2024-04-16T19:36:34.391741+0000","last_peered":"2024-04-16T19:36:34.391741+0000","last_clean":"2024-04-16T19:36:34.391741+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:36:34.391741+0000","last_undegraded":"2024-04-16T19:36:34.391741+0000","last_fullsized":"2024-04-16T19:36:34.391741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588660+0000","last_change":"2024-04-16T18:09:02.170333+0000","last_active":"2024-04-16T19:37:19.588660+0000","last_peered":"2024-04-16T19:37:19.588660+0000","last_clean":"2024-04-16T19:37:19.588660+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:37:19.588660+0000","last_undegraded":"2024-04-16T19:37:19.588660+0000","last_fullsized":"2024-04-16T19:37:19.588660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1988,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401948+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:37:44.401948+0000","last_peered":"2024-04-16T19:37:44.401948+0000","last_clean":"2024-04-16T19:37:44.401948+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:37:44.401948+0000","last_undegraded":"2024-04-16T19:37:44.401948+0000","last_fullsized":"2024-04-16T19:37:44.401948+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.389101+0000","last_change":"2024-04-16T17:46:17.506966+0000","last_active":"2024-04-16T19:36:19.389101+0000","last_peered":"2024-04-16T19:36:19.389101+0000","last_clean":"2024-04-16T19:36:19.389101+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:36:19.389101+0000","last_undegraded":"2024-04-16T19:36:19.389101+0000","last_fullsized":"2024-04-16T19:36:19.389101+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'7","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069768+0000","last_change":"2024-04-16T17:45:51.478975+0000","last_active":"2024-04-16T19:38:08.069768+0000","last_peered":"2024-04-16T19:38:08.069768+0000","last_clean":"2024-04-16T19:38:08.069768+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:38:08.069768+0000","last_undegraded":"2024-04-16T19:38:08.069768+0000","last_fullsized":"2024-04-16T19:38:08.069768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339960+0000","last_change":"2024-04-16T17:45:49.473313+0000","last_active":"2024-04-16T19:38:10.339960+0000","last_peered":"2024-04-16T19:38:10.339960+0000","last_clean":"2024-04-16T19:38:10.339960+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:38:10.339960+0000","last_undegraded":"2024-04-16T19:38:10.339960+0000","last_fullsized":"2024-04-16T19:38:10.339960+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'204","reported_seq":483,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.084173+0000","last_change":"2024-04-16T19:38:12.084173+0000","last_active":"2024-04-16T19:38:12.084173+0000","last_peered":"2024-04-16T19:38:12.084173+0000","last_clean":"2024-04-16T19:38:12.084173+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:38:12.084173+0000","last_undegraded":"2024-04-16T19:38:12.084173+0000","last_fullsized":"2024-04-16T19:38:12.084173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'204","last_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_deep_scrub":"53'204","last_deep_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.084057+0000","objects_scrubbed":15,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:47:16.400625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'28","reported_seq":316,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395283+0000","last_change":"2024-04-16T17:45:45.456848+0000","last_active":"2024-04-16T19:36:59.395283+0000","last_peered":"2024-04-16T19:36:59.395283+0000","last_clean":"2024-04-16T19:36:59.395283+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:36:59.395283+0000","last_undegraded":"2024-04-16T19:36:59.395283+0000","last_fullsized":"2024-04-16T19:36:59.395283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395360+0000","last_change":"2024-04-16T17:45:26.439840+0000","last_active":"2024-04-16T19:36:59.395360+0000","last_peered":"2024-04-16T19:36:59.395360+0000","last_clean":"2024-04-16T19:36:59.395360+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:36:59.395360+0000","last_undegraded":"2024-04-16T19:36:59.395360+0000","last_fullsized":"2024-04-16T19:36:59.395360+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.390060+0000","last_change":"2024-04-16T17:45:10.395070+0000","last_active":"2024-04-16T19:36:24.390060+0000","last_peered":"2024-04-16T19:36:24.390060+0000","last_clean":"2024-04-16T19:36:24.390060+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:36:24.390060+0000","last_undegraded":"2024-04-16T19:36:24.390060+0000","last_fullsized":"2024-04-16T19:36:24.390060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.399332+0000","last_change":"2024-04-16T17:45:08.390752+0000","last_active":"2024-04-16T19:37:09.399332+0000","last_peered":"2024-04-16T19:37:09.399332+0000","last_clean":"2024-04-16T19:37:09.399332+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:37:09.399332+0000","last_undegraded":"2024-04-16T19:37:09.399332+0000","last_fullsized":"2024-04-16T19:37:09.399332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"48'17","reported_seq":895,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405226+0000","last_change":"2024-04-16T17:45:20.413278+0000","last_active":"2024-04-16T19:37:44.405226+0000","last_peered":"2024-04-16T19:37:44.405226+0000","last_clean":"2024-04-16T19:37:44.405226+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:37:44.405226+0000","last_undegraded":"2024-04-16T19:37:44.405226+0000","last_fullsized":"2024-04-16T19:37:44.405226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'72","reported_seq":221,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391155+0000","last_change":"2024-04-16T17:45:22.414776+0000","last_active":"2024-04-16T19:36:34.391155+0000","last_peered":"2024-04-16T19:36:34.391155+0000","last_clean":"2024-04-16T19:36:34.391155+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:36:34.391155+0000","last_undegraded":"2024-04-16T19:36:34.391155+0000","last_fullsized":"2024-04-16T19:36:34.391155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391130+0000","last_change":"2024-04-16T17:45:24.423655+0000","last_active":"2024-04-16T19:36:34.391130+0000","last_peered":"2024-04-16T19:36:34.391130+0000","last_clean":"2024-04-16T19:36:34.391130+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:36:34.391130+0000","last_undegraded":"2024-04-16T19:36:34.391130+0000","last_fullsized":"2024-04-16T19:36:34.391130+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391044+0000","last_change":"2024-04-16T18:09:02.164735+0000","last_active":"2024-04-16T19:36:34.391044+0000","last_peered":"2024-04-16T19:36:34.391044+0000","last_clean":"2024-04-16T19:36:34.391044+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:36:34.391044+0000","last_undegraded":"2024-04-16T19:36:34.391044+0000","last_fullsized":"2024-04-16T19:36:34.391044+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'228","reported_seq":2121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393114+0000","last_change":"2024-04-16T17:46:25.526441+0000","last_active":"2024-04-16T19:36:29.393114+0000","last_peered":"2024-04-16T19:36:29.393114+0000","last_clean":"2024-04-16T19:36:29.393114+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:36:29.393114+0000","last_undegraded":"2024-04-16T19:36:29.393114+0000","last_fullsized":"2024-04-16T19:36:29.393114+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.547556+0000","last_change":"2024-04-16T19:38:25.547577+0000","last_active":"2024-04-16T19:38:25.547556+0000","last_peered":"2024-04-16T19:38:25.547556+0000","last_clean":"2024-04-16T19:38:25.547556+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:38:25.547556+0000","last_undegraded":"2024-04-16T19:38:25.547556+0000","last_fullsized":"2024-04-16T19:38:25.547556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.547478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:51.243189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'7","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887333+0000","last_change":"2024-04-16T17:45:51.480549+0000","last_active":"2024-04-16T19:38:09.887333+0000","last_peered":"2024-04-16T19:38:09.887333+0000","last_clean":"2024-04-16T19:38:09.887333+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:38:09.887333+0000","last_undegraded":"2024-04-16T19:38:09.887333+0000","last_fullsized":"2024-04-16T19:38:09.887333+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.401152+0000","last_change":"2024-04-16T17:45:49.476408+0000","last_active":"2024-04-16T19:37:19.401152+0000","last_peered":"2024-04-16T19:37:19.401152+0000","last_clean":"2024-04-16T19:37:19.401152+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:37:19.401152+0000","last_undegraded":"2024-04-16T19:37:19.401152+0000","last_fullsized":"2024-04-16T19:37:19.401152+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'283","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.068635+0000","last_change":"2024-04-16T19:38:14.068719+0000","last_active":"2024-04-16T19:38:14.068635+0000","last_peered":"2024-04-16T19:38:14.068635+0000","last_clean":"2024-04-16T19:38:14.068635+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:38:14.068635+0000","last_undegraded":"2024-04-16T19:38:14.068635+0000","last_fullsized":"2024-04-16T19:38:14.068635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'283","last_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_deep_scrub":"53'283","last_deep_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.068569+0000","objects_scrubbed":17,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:04.644251+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'16","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.254163+0000","last_change":"2024-04-16T19:38:18.254163+0000","last_active":"2024-04-16T19:38:18.254163+0000","last_peered":"2024-04-16T19:38:18.254163+0000","last_clean":"2024-04-16T19:38:18.254163+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:38:18.254163+0000","last_undegraded":"2024-04-16T19:38:18.254163+0000","last_fullsized":"2024-04-16T19:38:18.254163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.254059+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:53.228339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.371589+0000","last_change":"2024-04-16T19:38:29.371613+0000","last_active":"2024-04-16T19:38:29.371589+0000","last_peered":"2024-04-16T19:38:29.371589+0000","last_clean":"2024-04-16T19:38:29.371589+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:38:29.371589+0000","last_undegraded":"2024-04-16T19:38:29.371589+0000","last_fullsized":"2024-04-16T19:38:29.371589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.371523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:16.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.392392+0000","last_change":"2024-04-16T17:45:10.398271+0000","last_active":"2024-04-16T19:36:24.392392+0000","last_peered":"2024-04-16T19:36:24.392392+0000","last_clean":"2024-04-16T19:36:24.392392+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:36:24.392392+0000","last_undegraded":"2024-04-16T19:36:24.392392+0000","last_fullsized":"2024-04-16T19:36:24.392392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397357+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:37:09.397357+0000","last_peered":"2024-04-16T19:37:09.397357+0000","last_clean":"2024-04-16T19:37:09.397357+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:37:09.397357+0000","last_undegraded":"2024-04-16T19:37:09.397357+0000","last_fullsized":"2024-04-16T19:37:09.397357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579542+0000","last_change":"2024-04-16T17:45:20.406137+0000","last_active":"2024-04-16T19:36:34.579542+0000","last_peered":"2024-04-16T19:36:34.579542+0000","last_clean":"2024-04-16T19:36:34.579542+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:36:34.579542+0000","last_undegraded":"2024-04-16T19:36:34.579542+0000","last_fullsized":"2024-04-16T19:36:34.579542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'120","reported_seq":295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592694+0000","last_change":"2024-04-16T17:45:22.421567+0000","last_active":"2024-04-16T19:37:39.592694+0000","last_peered":"2024-04-16T19:37:39.592694+0000","last_clean":"2024-04-16T19:37:39.592694+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:37:39.592694+0000","last_undegraded":"2024-04-16T19:37:39.592694+0000","last_fullsized":"2024-04-16T19:37:39.592694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'12","reported_seq":1388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391788+0000","last_change":"2024-04-16T17:45:24.425583+0000","last_active":"2024-04-16T19:36:34.391788+0000","last_peered":"2024-04-16T19:36:34.391788+0000","last_clean":"2024-04-16T19:36:34.391788+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:36:34.391788+0000","last_undegraded":"2024-04-16T19:36:34.391788+0000","last_fullsized":"2024-04-16T19:36:34.391788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579535+0000","last_change":"2024-04-16T18:09:02.169752+0000","last_active":"2024-04-16T19:36:34.579535+0000","last_peered":"2024-04-16T19:36:34.579535+0000","last_clean":"2024-04-16T19:36:34.579535+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:36:34.579535+0000","last_undegraded":"2024-04-16T19:36:34.579535+0000","last_fullsized":"2024-04-16T19:36:34.579535+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'151","reported_seq":2295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393145+0000","last_change":"2024-04-16T17:46:25.529267+0000","last_active":"2024-04-16T19:36:29.393145+0000","last_peered":"2024-04-16T19:36:29.393145+0000","last_clean":"2024-04-16T19:36:29.393145+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:36:29.393145+0000","last_undegraded":"2024-04-16T19:36:29.393145+0000","last_fullsized":"2024-04-16T19:36:29.393145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.391844+0000","last_change":"2024-04-16T17:46:17.509588+0000","last_active":"2024-04-16T19:36:39.391844+0000","last_peered":"2024-04-16T19:36:39.391844+0000","last_clean":"2024-04-16T19:36:39.391844+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:36:39.391844+0000","last_undegraded":"2024-04-16T19:36:39.391844+0000","last_fullsized":"2024-04-16T19:36:39.391844+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'9","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429763+0000","last_change":"2024-04-16T17:45:51.478968+0000","last_active":"2024-04-16T19:38:09.429763+0000","last_peered":"2024-04-16T19:38:09.429763+0000","last_clean":"2024-04-16T19:38:09.429763+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:38:09.429763+0000","last_undegraded":"2024-04-16T19:38:09.429763+0000","last_fullsized":"2024-04-16T19:38:09.429763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.107369+0000","last_change":"2024-04-16T19:38:09.107389+0000","last_active":"2024-04-16T19:38:09.107369+0000","last_peered":"2024-04-16T19:38:09.107369+0000","last_clean":"2024-04-16T19:38:09.107369+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:38:09.107369+0000","last_undegraded":"2024-04-16T19:38:09.107369+0000","last_fullsized":"2024-04-16T19:38:09.107369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.107315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:06.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5992","reported_seq":12558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.824588+0000","last_change":"2024-04-16T19:38:12.824617+0000","last_active":"2024-04-16T19:38:12.824588+0000","last_peered":"2024-04-16T19:38:12.824588+0000","last_clean":"2024-04-16T19:38:12.824588+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:38:12.824588+0000","last_undegraded":"2024-04-16T19:38:12.824588+0000","last_fullsized":"2024-04-16T19:38:12.824588+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5992","last_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_deep_scrub":"53'5992","last_deep_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.824529+0000","objects_scrubbed":27,"log_size":1792,"log_dups_size":3000,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:47.168687+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":79208,"num_omap_keys":410,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'16","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.740826+0000","last_change":"2024-04-16T19:38:21.740887+0000","last_active":"2024-04-16T19:38:21.740826+0000","last_peered":"2024-04-16T19:38:21.740826+0000","last_clean":"2024-04-16T19:38:21.740826+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:38:21.740826+0000","last_undegraded":"2024-04-16T19:38:21.740826+0000","last_fullsized":"2024-04-16T19:38:21.740826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.740747+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:07.774419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.403948+0000","last_change":"2024-04-16T17:45:26.848748+0000","last_active":"2024-04-16T19:37:59.403948+0000","last_peered":"2024-04-16T19:37:59.403948+0000","last_clean":"2024-04-16T19:37:59.403948+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:37:59.403948+0000","last_undegraded":"2024-04-16T19:37:59.403948+0000","last_fullsized":"2024-04-16T19:37:59.403948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.392438+0000","last_change":"2024-04-16T17:45:10.391762+0000","last_active":"2024-04-16T19:36:24.392438+0000","last_peered":"2024-04-16T19:36:24.392438+0000","last_clean":"2024-04-16T19:36:24.392438+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:36:24.392438+0000","last_undegraded":"2024-04-16T19:36:24.392438+0000","last_fullsized":"2024-04-16T19:36:24.392438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.396801+0000","last_change":"2024-04-16T17:45:08.387257+0000","last_active":"2024-04-16T19:37:09.396801+0000","last_peered":"2024-04-16T19:37:09.396801+0000","last_clean":"2024-04-16T19:37:09.396801+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:37:09.396801+0000","last_undegraded":"2024-04-16T19:37:09.396801+0000","last_fullsized":"2024-04-16T19:37:09.396801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"48'1","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391821+0000","last_change":"2024-04-16T17:45:20.405143+0000","last_active":"2024-04-16T19:36:34.391821+0000","last_peered":"2024-04-16T19:36:34.391821+0000","last_clean":"2024-04-16T19:36:34.391821+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:36:34.391821+0000","last_undegraded":"2024-04-16T19:36:34.391821+0000","last_fullsized":"2024-04-16T19:36:34.391821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391766+0000","last_change":"2024-04-16T17:45:22.421942+0000","last_active":"2024-04-16T19:36:34.391766+0000","last_peered":"2024-04-16T19:36:34.391766+0000","last_clean":"2024-04-16T19:36:34.391766+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:36:34.391766+0000","last_undegraded":"2024-04-16T19:36:34.391766+0000","last_fullsized":"2024-04-16T19:36:34.391766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'12","reported_seq":1390,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592709+0000","last_change":"2024-04-16T17:45:24.424033+0000","last_active":"2024-04-16T19:37:39.592709+0000","last_peered":"2024-04-16T19:37:39.592709+0000","last_clean":"2024-04-16T19:37:39.592709+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:37:39.592709+0000","last_undegraded":"2024-04-16T19:37:39.592709+0000","last_fullsized":"2024-04-16T19:37:39.592709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.390991+0000","last_change":"2024-04-16T18:09:02.168123+0000","last_active":"2024-04-16T19:36:34.390991+0000","last_peered":"2024-04-16T19:36:34.390991+0000","last_clean":"2024-04-16T19:36:34.390991+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:36:34.390991+0000","last_undegraded":"2024-04-16T19:36:34.390991+0000","last_fullsized":"2024-04-16T19:36:34.390991+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394950+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:36:54.394950+0000","last_peered":"2024-04-16T19:36:54.394950+0000","last_clean":"2024-04-16T19:36:54.394950+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:36:54.394950+0000","last_undegraded":"2024-04-16T19:36:54.394950+0000","last_fullsized":"2024-04-16T19:36:54.394950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.393325+0000","last_change":"2024-04-16T17:46:17.508941+0000","last_active":"2024-04-16T19:36:44.393325+0000","last_peered":"2024-04-16T19:36:44.393325+0000","last_clean":"2024-04-16T19:36:44.393325+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:36:44.393325+0000","last_undegraded":"2024-04-16T19:36:44.393325+0000","last_fullsized":"2024-04-16T19:36:44.393325+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'11","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887233+0000","last_change":"2024-04-16T17:45:51.478686+0000","last_active":"2024-04-16T19:38:09.887233+0000","last_peered":"2024-04-16T19:38:09.887233+0000","last_clean":"2024-04-16T19:38:09.887233+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:38:09.887233+0000","last_undegraded":"2024-04-16T19:38:09.887233+0000","last_fullsized":"2024-04-16T19:38:09.887233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.739844+0000","last_change":"2024-04-16T19:38:22.739844+0000","last_active":"2024-04-16T19:38:22.739844+0000","last_peered":"2024-04-16T19:38:22.739844+0000","last_clean":"2024-04-16T19:38:22.739844+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:38:22.739844+0000","last_undegraded":"2024-04-16T19:38:22.739844+0000","last_fullsized":"2024-04-16T19:38:22.739844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.739758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:59.491263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1601","reported_seq":47000,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.864758+0000","last_change":"2024-04-16T19:38:18.864758+0000","last_active":"2024-04-16T19:38:18.864758+0000","last_peered":"2024-04-16T19:38:18.864758+0000","last_clean":"2024-04-16T19:38:18.864758+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:38:18.864758+0000","last_undegraded":"2024-04-16T19:38:18.864758+0000","last_fullsized":"2024-04-16T19:38:18.864758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'1601","last_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_deep_scrub":"53'1601","last_deep_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.864667+0000","objects_scrubbed":26,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:06.203531+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14964,"num_omap_keys":68,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'12","reported_seq":236,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.220860+0000","last_change":"2024-04-16T19:38:11.220904+0000","last_active":"2024-04-16T19:38:11.220860+0000","last_peered":"2024-04-16T19:38:11.220860+0000","last_clean":"2024-04-16T19:38:11.220860+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:38:11.220860+0000","last_undegraded":"2024-04-16T19:38:11.220860+0000","last_fullsized":"2024-04-16T19:38:11.220860+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.220802+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:19.617959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403883+0000","last_change":"2024-04-16T17:45:10.393324+0000","last_active":"2024-04-16T19:37:54.403883+0000","last_peered":"2024-04-16T19:37:54.403883+0000","last_clean":"2024-04-16T19:37:54.403883+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:37:54.403883+0000","last_undegraded":"2024-04-16T19:37:54.403883+0000","last_fullsized":"2024-04-16T19:37:54.403883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404572+0000","last_change":"2024-04-16T17:45:08.389843+0000","last_active":"2024-04-16T19:37:59.404572+0000","last_peered":"2024-04-16T19:37:59.404572+0000","last_clean":"2024-04-16T19:37:59.404572+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:37:59.404572+0000","last_undegraded":"2024-04-16T19:37:59.404572+0000","last_fullsized":"2024-04-16T19:37:59.404572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"48'5","reported_seq":229,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405211+0000","last_change":"2024-04-16T17:45:20.407401+0000","last_active":"2024-04-16T19:38:04.405211+0000","last_peered":"2024-04-16T19:38:04.405211+0000","last_clean":"2024-04-16T19:38:04.405211+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:38:04.405211+0000","last_undegraded":"2024-04-16T19:38:04.405211+0000","last_fullsized":"2024-04-16T19:38:04.405211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'200","reported_seq":424,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339085+0000","last_change":"2024-04-16T17:45:22.417459+0000","last_active":"2024-04-16T19:38:10.339085+0000","last_peered":"2024-04-16T19:38:10.339085+0000","last_clean":"2024-04-16T19:38:10.339085+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:38:10.339085+0000","last_undegraded":"2024-04-16T19:38:10.339085+0000","last_fullsized":"2024-04-16T19:38:10.339085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595769+0000","last_change":"2024-04-16T17:45:24.430630+0000","last_active":"2024-04-16T19:37:54.595769+0000","last_peered":"2024-04-16T19:37:54.595769+0000","last_clean":"2024-04-16T19:37:54.595769+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:37:54.595769+0000","last_undegraded":"2024-04-16T19:37:54.595769+0000","last_fullsized":"2024-04-16T19:37:54.595769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404407+0000","last_change":"2024-04-16T17:45:26.438929+0000","last_active":"2024-04-16T19:37:59.404407+0000","last_peered":"2024-04-16T19:37:59.404407+0000","last_clean":"2024-04-16T19:37:59.404407+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:37:59.404407+0000","last_undegraded":"2024-04-16T19:37:59.404407+0000","last_fullsized":"2024-04-16T19:37:59.404407+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579395+0000","last_change":"2024-04-16T18:09:02.169539+0000","last_active":"2024-04-16T19:36:34.579395+0000","last_peered":"2024-04-16T19:36:34.579395+0000","last_clean":"2024-04-16T19:36:34.579395+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:36:34.579395+0000","last_undegraded":"2024-04-16T19:36:34.579395+0000","last_fullsized":"2024-04-16T19:36:34.579395+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1473,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.397060+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:36:54.397060+0000","last_peered":"2024-04-16T19:36:54.397060+0000","last_clean":"2024-04-16T19:36:54.397060+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:36:54.397060+0000","last_undegraded":"2024-04-16T19:36:54.397060+0000","last_fullsized":"2024-04-16T19:36:54.397060+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.392412+0000","last_change":"2024-04-16T17:46:17.512578+0000","last_active":"2024-04-16T19:36:39.392412+0000","last_peered":"2024-04-16T19:36:39.392412+0000","last_clean":"2024-04-16T19:36:39.392412+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:36:39.392412+0000","last_undegraded":"2024-04-16T19:36:39.392412+0000","last_fullsized":"2024-04-16T19:36:39.392412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"48'3","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429661+0000","last_change":"2024-04-16T17:45:51.480862+0000","last_active":"2024-04-16T19:38:09.429661+0000","last_peered":"2024-04-16T19:38:09.429661+0000","last_clean":"2024-04-16T19:38:09.429661+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:38:09.429661+0000","last_undegraded":"2024-04-16T19:38:09.429661+0000","last_fullsized":"2024-04-16T19:38:09.429661+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.345083+0000","last_change":"2024-04-16T19:38:28.345083+0000","last_active":"2024-04-16T19:38:28.345083+0000","last_peered":"2024-04-16T19:38:28.345083+0000","last_clean":"2024-04-16T19:38:28.345083+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:38:28.345083+0000","last_undegraded":"2024-04-16T19:38:28.345083+0000","last_fullsized":"2024-04-16T19:38:28.345083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.344996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:22.992488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'355","reported_seq":664,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.869936+0000","last_change":"2024-04-16T19:38:12.869936+0000","last_active":"2024-04-16T19:38:12.869936+0000","last_peered":"2024-04-16T19:38:12.869936+0000","last_clean":"2024-04-16T19:38:12.869936+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:38:12.869936+0000","last_undegraded":"2024-04-16T19:38:12.869936+0000","last_fullsized":"2024-04-16T19:38:12.869936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'355","last_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_deep_scrub":"53'355","last_deep_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.869802+0000","objects_scrubbed":17,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:21.665637+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21527,"num_omap_keys":98,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'19","reported_seq":604,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.829535+0000","last_change":"2024-04-16T19:38:08.829535+0000","last_active":"2024-04-16T19:38:08.829535+0000","last_peered":"2024-04-16T19:38:08.829535+0000","last_clean":"2024-04-16T19:38:08.829535+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:38:08.829535+0000","last_undegraded":"2024-04-16T19:38:08.829535+0000","last_fullsized":"2024-04-16T19:38:08.829535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'19","last_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_deep_scrub":"53'19","last_deep_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.829450+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:30.796211+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.402962+0000","last_change":"2024-04-16T17:45:10.402167+0000","last_active":"2024-04-16T19:37:54.402962+0000","last_peered":"2024-04-16T19:37:54.402962+0000","last_clean":"2024-04-16T19:37:54.402962+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:37:54.402962+0000","last_undegraded":"2024-04-16T19:37:54.402962+0000","last_fullsized":"2024-04-16T19:37:54.402962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401152+0000","last_change":"2024-04-16T17:45:08.388824+0000","last_active":"2024-04-16T19:37:39.401152+0000","last_peered":"2024-04-16T19:37:39.401152+0000","last_clean":"2024-04-16T19:37:39.401152+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:37:39.401152+0000","last_undegraded":"2024-04-16T19:37:39.401152+0000","last_fullsized":"2024-04-16T19:37:39.401152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597777+0000","last_change":"2024-04-16T17:45:20.407298+0000","last_active":"2024-04-16T19:38:04.597777+0000","last_peered":"2024-04-16T19:38:04.597777+0000","last_clean":"2024-04-16T19:38:04.597777+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:38:04.597777+0000","last_undegraded":"2024-04-16T19:38:04.597777+0000","last_fullsized":"2024-04-16T19:38:04.597777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'80","reported_seq":242,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595753+0000","last_change":"2024-04-16T17:45:22.422669+0000","last_active":"2024-04-16T19:37:54.595753+0000","last_peered":"2024-04-16T19:37:54.595753+0000","last_clean":"2024-04-16T19:37:54.595753+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:37:54.595753+0000","last_undegraded":"2024-04-16T19:37:54.595753+0000","last_fullsized":"2024-04-16T19:37:54.595753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976681+0000","last_change":"2024-04-16T17:45:24.425962+0000","last_active":"2024-04-16T19:38:08.976681+0000","last_peered":"2024-04-16T19:38:08.976681+0000","last_clean":"2024-04-16T19:38:08.976681+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:38:08.976681+0000","last_undegraded":"2024-04-16T19:38:08.976681+0000","last_fullsized":"2024-04-16T19:38:08.976681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.886773+0000","last_change":"2024-04-16T17:45:26.429668+0000","last_active":"2024-04-16T19:38:09.886773+0000","last_peered":"2024-04-16T19:38:09.886773+0000","last_clean":"2024-04-16T19:38:09.886773+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:38:09.886773+0000","last_undegraded":"2024-04-16T19:38:09.886773+0000","last_fullsized":"2024-04-16T19:38:09.886773+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391566+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:36:34.391566+0000","last_peered":"2024-04-16T19:36:34.391566+0000","last_clean":"2024-04-16T19:36:34.391566+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:36:34.391566+0000","last_undegraded":"2024-04-16T19:36:34.391566+0000","last_fullsized":"2024-04-16T19:36:34.391566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'120","reported_seq":2586,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.581384+0000","last_change":"2024-04-16T17:46:25.531706+0000","last_active":"2024-04-16T19:36:44.581384+0000","last_peered":"2024-04-16T19:36:44.581384+0000","last_clean":"2024-04-16T19:36:44.581384+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:36:44.581384+0000","last_undegraded":"2024-04-16T19:36:44.581384+0000","last_fullsized":"2024-04-16T19:36:44.581384+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395650+0000","last_change":"2024-04-16T17:46:17.508571+0000","last_active":"2024-04-16T19:36:44.395650+0000","last_peered":"2024-04-16T19:36:44.395650+0000","last_clean":"2024-04-16T19:36:44.395650+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:36:44.395650+0000","last_undegraded":"2024-04-16T19:36:44.395650+0000","last_fullsized":"2024-04-16T19:36:44.395650+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'18","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429659+0000","last_change":"2024-04-16T17:45:51.479804+0000","last_active":"2024-04-16T19:38:09.429659+0000","last_peered":"2024-04-16T19:38:09.429659+0000","last_clean":"2024-04-16T19:38:09.429659+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:38:09.429659+0000","last_undegraded":"2024-04-16T19:38:09.429659+0000","last_fullsized":"2024-04-16T19:38:09.429659+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.514898+0000","last_change":"2024-04-16T19:38:16.514936+0000","last_active":"2024-04-16T19:38:16.514898+0000","last_peered":"2024-04-16T19:38:16.514898+0000","last_clean":"2024-04-16T19:38:16.514898+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:38:16.514898+0000","last_undegraded":"2024-04-16T19:38:16.514898+0000","last_fullsized":"2024-04-16T19:38:16.514898+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.514815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:31:12.328836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'933","reported_seq":3835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.408460+0000","last_change":"2024-04-16T19:38:24.408514+0000","last_active":"2024-04-16T19:38:24.408460+0000","last_peered":"2024-04-16T19:38:24.408460+0000","last_clean":"2024-04-16T19:38:24.408460+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:38:24.408460+0000","last_undegraded":"2024-04-16T19:38:24.408460+0000","last_fullsized":"2024-04-16T19:38:24.408460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'933","last_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_deep_scrub":"53'933","last_deep_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.408381+0000","objects_scrubbed":26,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:46.227789+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13193,"num_omap_keys":66,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'24","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.811180+0000","last_change":"2024-04-16T19:38:19.811180+0000","last_active":"2024-04-16T19:38:19.811180+0000","last_peered":"2024-04-16T19:38:19.811180+0000","last_clean":"2024-04-16T19:38:19.811180+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:38:19.811180+0000","last_undegraded":"2024-04-16T19:38:19.811180+0000","last_fullsized":"2024-04-16T19:38:19.811180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.811061+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:19.180605+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338768+0000","last_change":"2024-04-16T17:45:10.394156+0000","last_active":"2024-04-16T19:38:10.338768+0000","last_peered":"2024-04-16T19:38:10.338768+0000","last_clean":"2024-04-16T19:38:10.338768+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:38:10.338768+0000","last_undegraded":"2024-04-16T19:38:10.338768+0000","last_fullsized":"2024-04-16T19:38:10.338768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579591+0000","last_change":"2024-04-16T17:46:16.499439+0000","last_active":"2024-04-16T19:36:34.579591+0000","last_peered":"2024-04-16T19:36:34.579591+0000","last_clean":"2024-04-16T19:36:34.579591+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:36:34.579591+0000","last_undegraded":"2024-04-16T19:36:34.579591+0000","last_fullsized":"2024-04-16T19:36:34.579591+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595764+0000","last_change":"2024-04-16T17:45:20.408040+0000","last_active":"2024-04-16T19:37:54.595764+0000","last_peered":"2024-04-16T19:37:54.595764+0000","last_clean":"2024-04-16T19:37:54.595764+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:37:54.595764+0000","last_undegraded":"2024-04-16T19:37:54.595764+0000","last_fullsized":"2024-04-16T19:37:54.595764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'152","reported_seq":352,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405405+0000","last_change":"2024-04-16T17:45:22.415394+0000","last_active":"2024-04-16T19:38:04.405405+0000","last_peered":"2024-04-16T19:38:04.405405+0000","last_clean":"2024-04-16T19:38:04.405405+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:38:04.405405+0000","last_undegraded":"2024-04-16T19:38:04.405405+0000","last_fullsized":"2024-04-16T19:38:04.405405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'12","reported_seq":1394,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408525+0000","last_change":"2024-04-16T17:45:24.424024+0000","last_active":"2024-04-16T19:38:04.408525+0000","last_peered":"2024-04-16T19:38:04.408525+0000","last_clean":"2024-04-16T19:38:04.408525+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:38:04.408525+0000","last_undegraded":"2024-04-16T19:38:04.408525+0000","last_fullsized":"2024-04-16T19:38:04.408525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069229+0000","last_change":"2024-04-16T17:45:26.438562+0000","last_active":"2024-04-16T19:38:08.069229+0000","last_peered":"2024-04-16T19:38:08.069229+0000","last_clean":"2024-04-16T19:38:08.069229+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:38:08.069229+0000","last_undegraded":"2024-04-16T19:38:08.069229+0000","last_fullsized":"2024-04-16T19:38:08.069229+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588489+0000","last_change":"2024-04-16T18:09:02.168408+0000","last_active":"2024-04-16T19:37:19.588489+0000","last_peered":"2024-04-16T19:37:19.588489+0000","last_clean":"2024-04-16T19:37:19.588489+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:37:19.588489+0000","last_undegraded":"2024-04-16T19:37:19.588489+0000","last_fullsized":"2024-04-16T19:37:19.588489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'164","reported_seq":2349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583511+0000","last_change":"2024-04-16T17:46:25.526845+0000","last_active":"2024-04-16T19:36:54.583511+0000","last_peered":"2024-04-16T19:36:54.583511+0000","last_clean":"2024-04-16T19:36:54.583511+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:36:54.583511+0000","last_undegraded":"2024-04-16T19:36:54.583511+0000","last_fullsized":"2024-04-16T19:36:54.583511+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.392987+0000","last_change":"2024-04-16T17:46:17.504931+0000","last_active":"2024-04-16T19:36:44.392987+0000","last_peered":"2024-04-16T19:36:44.392987+0000","last_clean":"2024-04-16T19:36:44.392987+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:36:44.392987+0000","last_undegraded":"2024-04-16T19:36:44.392987+0000","last_fullsized":"2024-04-16T19:36:44.392987+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'19","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069613+0000","last_change":"2024-04-16T17:45:51.481046+0000","last_active":"2024-04-16T19:38:08.069613+0000","last_peered":"2024-04-16T19:38:08.069613+0000","last_clean":"2024-04-16T19:38:08.069613+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:38:08.069613+0000","last_undegraded":"2024-04-16T19:38:08.069613+0000","last_fullsized":"2024-04-16T19:38:08.069613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339865+0000","last_change":"2024-04-16T17:45:49.473468+0000","last_active":"2024-04-16T19:38:10.339865+0000","last_peered":"2024-04-16T19:38:10.339865+0000","last_clean":"2024-04-16T19:38:10.339865+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:38:10.339865+0000","last_undegraded":"2024-04-16T19:38:10.339865+0000","last_fullsized":"2024-04-16T19:38:10.339865+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'620","reported_seq":3263,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.072994+0000","last_change":"2024-04-16T19:38:11.073025+0000","last_active":"2024-04-16T19:38:11.072994+0000","last_peered":"2024-04-16T19:38:11.072994+0000","last_clean":"2024-04-16T19:38:11.072994+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:38:11.072994+0000","last_undegraded":"2024-04-16T19:38:11.072994+0000","last_fullsized":"2024-04-16T19:38:11.072994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'620","last_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_deep_scrub":"53'620","last_deep_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.072941+0000","objects_scrubbed":28,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:29.251802+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7883,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'29","reported_seq":356,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.759701+0000","last_change":"2024-04-16T19:38:28.759701+0000","last_active":"2024-04-16T19:38:28.759701+0000","last_peered":"2024-04-16T19:38:28.759701+0000","last_clean":"2024-04-16T19:38:28.759701+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:38:28.759701+0000","last_undegraded":"2024-04-16T19:38:28.759701+0000","last_fullsized":"2024-04-16T19:38:28.759701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'29","last_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_deep_scrub":"53'29","last_deep_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.759592+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:37.264543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405163+0000","last_change":"2024-04-16T17:45:10.392991+0000","last_active":"2024-04-16T19:37:44.405163+0000","last_peered":"2024-04-16T19:37:44.405163+0000","last_clean":"2024-04-16T19:37:44.405163+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:37:44.405163+0000","last_undegraded":"2024-04-16T19:37:44.405163+0000","last_fullsized":"2024-04-16T19:37:44.405163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401068+0000","last_change":"2024-04-16T17:45:08.387422+0000","last_active":"2024-04-16T19:37:39.401068+0000","last_peered":"2024-04-16T19:37:39.401068+0000","last_clean":"2024-04-16T19:37:39.401068+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:37:39.401068+0000","last_undegraded":"2024-04-16T19:37:39.401068+0000","last_fullsized":"2024-04-16T19:37:39.401068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"48'3","reported_seq":184,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976489+0000","last_change":"2024-04-16T17:45:20.412558+0000","last_active":"2024-04-16T19:38:08.976489+0000","last_peered":"2024-04-16T19:38:08.976489+0000","last_clean":"2024-04-16T19:38:08.976489+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:38:08.976489+0000","last_undegraded":"2024-04-16T19:38:08.976489+0000","last_fullsized":"2024-04-16T19:38:08.976489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'88","reported_seq":261,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408498+0000","last_change":"2024-04-16T17:45:22.414488+0000","last_active":"2024-04-16T19:38:04.408498+0000","last_peered":"2024-04-16T19:38:04.408498+0000","last_clean":"2024-04-16T19:38:04.408498+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:38:04.408498+0000","last_undegraded":"2024-04-16T19:38:04.408498+0000","last_fullsized":"2024-04-16T19:38:04.408498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597809+0000","last_change":"2024-04-16T17:45:24.422626+0000","last_active":"2024-04-16T19:38:04.597809+0000","last_peered":"2024-04-16T19:38:04.597809+0000","last_clean":"2024-04-16T19:38:04.597809+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:38:04.597809+0000","last_undegraded":"2024-04-16T19:38:04.597809+0000","last_fullsized":"2024-04-16T19:38:04.597809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.759633+0000","last_change":"2024-04-16T19:38:27.759655+0000","last_active":"2024-04-16T19:38:27.759633+0000","last_peered":"2024-04-16T19:38:27.759633+0000","last_clean":"2024-04-16T19:38:27.759633+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:38:27.759633+0000","last_undegraded":"2024-04-16T19:38:27.759633+0000","last_fullsized":"2024-04-16T19:38:27.759633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.759568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:42.585548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596023+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:37:54.596023+0000","last_peered":"2024-04-16T19:37:54.596023+0000","last_clean":"2024-04-16T19:37:54.596023+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:37:54.596023+0000","last_undegraded":"2024-04-16T19:37:54.596023+0000","last_fullsized":"2024-04-16T19:37:54.596023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'131","reported_seq":1906,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.397930+0000","last_change":"2024-04-16T17:46:25.527139+0000","last_active":"2024-04-16T19:36:59.397930+0000","last_peered":"2024-04-16T19:36:59.397930+0000","last_clean":"2024-04-16T19:36:59.397930+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:36:59.397930+0000","last_undegraded":"2024-04-16T19:36:59.397930+0000","last_fullsized":"2024-04-16T19:36:59.397930+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.571585+0000","last_change":"2024-04-16T19:38:24.571609+0000","last_active":"2024-04-16T19:38:24.571585+0000","last_peered":"2024-04-16T19:38:24.571585+0000","last_clean":"2024-04-16T19:38:24.571585+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:38:24.571585+0000","last_undegraded":"2024-04-16T19:38:24.571585+0000","last_fullsized":"2024-04-16T19:38:24.571585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.571519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:55.147346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'10","reported_seq":122,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340021+0000","last_change":"2024-04-16T17:45:51.480080+0000","last_active":"2024-04-16T19:38:10.340021+0000","last_peered":"2024-04-16T19:38:10.340021+0000","last_clean":"2024-04-16T19:38:10.340021+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:38:10.340021+0000","last_undegraded":"2024-04-16T19:38:10.340021+0000","last_fullsized":"2024-04-16T19:38:10.340021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'651","reported_seq":2205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429517+0000","last_change":"2024-04-16T17:45:49.472107+0000","last_active":"2024-04-16T19:38:09.429517+0000","last_peered":"2024-04-16T19:38:09.429517+0000","last_clean":"2024-04-16T19:38:09.429517+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:38:09.429517+0000","last_undegraded":"2024-04-16T19:38:09.429517+0000","last_fullsized":"2024-04-16T19:38:09.429517+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'328","reported_seq":608,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.821880+0000","last_change":"2024-04-16T19:38:14.821880+0000","last_active":"2024-04-16T19:38:14.821880+0000","last_peered":"2024-04-16T19:38:14.821880+0000","last_clean":"2024-04-16T19:38:14.821880+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:38:14.821880+0000","last_undegraded":"2024-04-16T19:38:14.821880+0000","last_fullsized":"2024-04-16T19:38:14.821880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'328","last_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_deep_scrub":"53'328","last_deep_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.821710+0000","objects_scrubbed":22,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:27.374369+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14461,"num_omap_keys":66,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'12","reported_seq":557,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.221422+0000","last_change":"2024-04-16T19:38:14.221422+0000","last_active":"2024-04-16T19:38:14.221422+0000","last_peered":"2024-04-16T19:38:14.221422+0000","last_clean":"2024-04-16T19:38:14.221422+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:38:14.221422+0000","last_undegraded":"2024-04-16T19:38:14.221422+0000","last_fullsized":"2024-04-16T19:38:14.221422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.221299+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:29.047279+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401632+0000","last_change":"2024-04-16T17:45:10.402046+0000","last_active":"2024-04-16T19:37:44.401632+0000","last_peered":"2024-04-16T19:37:44.401632+0000","last_clean":"2024-04-16T19:37:44.401632+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:37:44.401632+0000","last_undegraded":"2024-04-16T19:37:44.401632+0000","last_fullsized":"2024-04-16T19:37:44.401632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592657+0000","last_change":"2024-04-16T17:45:08.384395+0000","last_active":"2024-04-16T19:37:39.592657+0000","last_peered":"2024-04-16T19:37:39.592657+0000","last_clean":"2024-04-16T19:37:39.592657+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:37:39.592657+0000","last_undegraded":"2024-04-16T19:37:39.592657+0000","last_fullsized":"2024-04-16T19:37:39.592657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"30'3","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595823+0000","last_change":"2024-04-16T17:45:20.406255+0000","last_active":"2024-04-16T19:37:54.595823+0000","last_peered":"2024-04-16T19:37:54.595823+0000","last_clean":"2024-04-16T19:37:54.595823+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:37:54.595823+0000","last_undegraded":"2024-04-16T19:37:54.595823+0000","last_fullsized":"2024-04-16T19:37:54.595823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'104","reported_seq":278,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403163+0000","last_change":"2024-04-16T17:45:22.416167+0000","last_active":"2024-04-16T19:37:54.403163+0000","last_peered":"2024-04-16T19:37:54.403163+0000","last_clean":"2024-04-16T19:37:54.403163+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:37:54.403163+0000","last_undegraded":"2024-04-16T19:37:54.403163+0000","last_fullsized":"2024-04-16T19:37:54.403163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069167+0000","last_change":"2024-04-16T17:45:24.422761+0000","last_active":"2024-04-16T19:38:08.069167+0000","last_peered":"2024-04-16T19:38:08.069167+0000","last_clean":"2024-04-16T19:38:08.069167+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:38:08.069167+0000","last_undegraded":"2024-04-16T19:38:08.069167+0000","last_fullsized":"2024-04-16T19:38:08.069167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593546+0000","last_change":"2024-04-16T17:45:26.433444+0000","last_active":"2024-04-16T19:37:44.593546+0000","last_peered":"2024-04-16T19:37:44.593546+0000","last_clean":"2024-04-16T19:37:44.593546+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:37:44.593546+0000","last_undegraded":"2024-04-16T19:37:44.593546+0000","last_fullsized":"2024-04-16T19:37:44.593546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407078+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:37:54.407078+0000","last_peered":"2024-04-16T19:37:54.407078+0000","last_clean":"2024-04-16T19:37:54.407078+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:37:54.407078+0000","last_undegraded":"2024-04-16T19:37:54.407078+0000","last_fullsized":"2024-04-16T19:37:54.407078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'156","reported_seq":2123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395577+0000","last_change":"2024-04-16T17:46:25.522062+0000","last_active":"2024-04-16T19:36:59.395577+0000","last_peered":"2024-04-16T19:36:59.395577+0000","last_clean":"2024-04-16T19:36:59.395577+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:36:59.395577+0000","last_undegraded":"2024-04-16T19:36:59.395577+0000","last_fullsized":"2024-04-16T19:36:59.395577+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.393054+0000","last_change":"2024-04-16T17:46:17.511574+0000","last_active":"2024-04-16T19:36:44.393054+0000","last_peered":"2024-04-16T19:36:44.393054+0000","last_clean":"2024-04-16T19:36:44.393054+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:36:44.393054+0000","last_undegraded":"2024-04-16T19:36:44.393054+0000","last_fullsized":"2024-04-16T19:36:44.393054+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'144","reported_seq":328,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.392619+0000","last_change":"2024-04-16T17:45:51.478987+0000","last_active":"2024-04-16T19:36:39.392619+0000","last_peered":"2024-04-16T19:36:39.392619+0000","last_clean":"2024-04-16T19:36:39.392619+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:36:39.392619+0000","last_undegraded":"2024-04-16T19:36:39.392619+0000","last_fullsized":"2024-04-16T19:36:39.392619+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.087323+0000","last_change":"2024-04-16T19:38:15.087323+0000","last_active":"2024-04-16T19:38:15.087323+0000","last_peered":"2024-04-16T19:38:15.087323+0000","last_clean":"2024-04-16T19:38:15.087323+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:38:15.087323+0000","last_undegraded":"2024-04-16T19:38:15.087323+0000","last_fullsized":"2024-04-16T19:38:15.087323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.087231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:14:00.509056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'845","reported_seq":1835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.089179+0000","last_change":"2024-04-16T19:38:10.089179+0000","last_active":"2024-04-16T19:38:10.089179+0000","last_peered":"2024-04-16T19:38:10.089179+0000","last_clean":"2024-04-16T19:38:10.089179+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:38:10.089179+0000","last_undegraded":"2024-04-16T19:38:10.089179+0000","last_fullsized":"2024-04-16T19:38:10.089179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'845","last_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_deep_scrub":"53'845","last_deep_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.089105+0000","objects_scrubbed":25,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:33.799326+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7064,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'8","reported_seq":283,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.784403+0000","last_change":"2024-04-16T19:38:13.784444+0000","last_active":"2024-04-16T19:38:13.784403+0000","last_peered":"2024-04-16T19:38:13.784403+0000","last_clean":"2024-04-16T19:38:13.784403+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:38:13.784403+0000","last_undegraded":"2024-04-16T19:38:13.784403+0000","last_fullsized":"2024-04-16T19:38:13.784403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.784341+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:20.950710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402655+0000","last_change":"2024-04-16T17:45:10.387439+0000","last_active":"2024-04-16T19:37:44.402655+0000","last_peered":"2024-04-16T19:37:44.402655+0000","last_clean":"2024-04-16T19:37:44.402655+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:37:44.402655+0000","last_undegraded":"2024-04-16T19:37:44.402655+0000","last_fullsized":"2024-04-16T19:37:44.402655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.406405+0000","last_change":"2024-04-16T17:45:08.386819+0000","last_active":"2024-04-16T19:38:09.406405+0000","last_peered":"2024-04-16T19:38:09.406405+0000","last_clean":"2024-04-16T19:38:09.406405+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:38:09.406405+0000","last_undegraded":"2024-04-16T19:38:09.406405+0000","last_fullsized":"2024-04-16T19:38:09.406405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"48'13","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595838+0000","last_change":"2024-04-16T17:45:20.413420+0000","last_active":"2024-04-16T19:37:54.595838+0000","last_peered":"2024-04-16T19:37:54.595838+0000","last_clean":"2024-04-16T19:37:54.595838+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:37:54.595838+0000","last_undegraded":"2024-04-16T19:37:54.595838+0000","last_fullsized":"2024-04-16T19:37:54.595838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'152","reported_seq":350,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976594+0000","last_change":"2024-04-16T17:45:22.414344+0000","last_active":"2024-04-16T19:38:08.976594+0000","last_peered":"2024-04-16T19:38:08.976594+0000","last_clean":"2024-04-16T19:38:08.976594+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:38:08.976594+0000","last_undegraded":"2024-04-16T19:38:08.976594+0000","last_fullsized":"2024-04-16T19:38:08.976594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'12","reported_seq":1392,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595871+0000","last_change":"2024-04-16T17:45:24.430890+0000","last_active":"2024-04-16T19:37:54.595871+0000","last_peered":"2024-04-16T19:37:54.595871+0000","last_clean":"2024-04-16T19:37:54.595871+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:37:54.595871+0000","last_undegraded":"2024-04-16T19:37:54.595871+0000","last_fullsized":"2024-04-16T19:37:54.595871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596765+0000","last_change":"2024-04-16T17:45:26.428823+0000","last_active":"2024-04-16T19:37:59.596765+0000","last_peered":"2024-04-16T19:37:59.596765+0000","last_clean":"2024-04-16T19:37:59.596765+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:37:59.596765+0000","last_undegraded":"2024-04-16T19:37:59.596765+0000","last_fullsized":"2024-04-16T19:37:59.596765+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.394209+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:36:49.394209+0000","last_peered":"2024-04-16T19:36:49.394209+0000","last_clean":"2024-04-16T19:36:49.394209+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:36:49.394209+0000","last_undegraded":"2024-04-16T19:36:49.394209+0000","last_fullsized":"2024-04-16T19:36:49.394209+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'84","reported_seq":1608,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.395002+0000","last_change":"2024-04-16T17:46:25.527208+0000","last_active":"2024-04-16T19:36:54.395002+0000","last_peered":"2024-04-16T19:36:54.395002+0000","last_clean":"2024-04-16T19:36:54.395002+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:36:54.395002+0000","last_undegraded":"2024-04-16T19:36:54.395002+0000","last_fullsized":"2024-04-16T19:36:54.395002+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.394330+0000","last_change":"2024-04-16T17:46:17.513992+0000","last_active":"2024-04-16T19:36:49.394330+0000","last_peered":"2024-04-16T19:36:49.394330+0000","last_clean":"2024-04-16T19:36:49.394330+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:36:49.394330+0000","last_undegraded":"2024-04-16T19:36:49.394330+0000","last_fullsized":"2024-04-16T19:36:49.394330+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'17","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577560+0000","last_change":"2024-04-16T17:45:51.480268+0000","last_active":"2024-04-16T19:36:24.577560+0000","last_peered":"2024-04-16T19:36:24.577560+0000","last_clean":"2024-04-16T19:36:24.577560+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:36:24.577560+0000","last_undegraded":"2024-04-16T19:36:24.577560+0000","last_fullsized":"2024-04-16T19:36:24.577560+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.516924+0000","last_change":"2024-04-16T19:38:22.516949+0000","last_active":"2024-04-16T19:38:22.516924+0000","last_peered":"2024-04-16T19:38:22.516924+0000","last_clean":"2024-04-16T19:38:22.516924+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:38:22.516924+0000","last_undegraded":"2024-04-16T19:38:22.516924+0000","last_fullsized":"2024-04-16T19:38:22.516924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.516860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:29.683230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'556","reported_seq":948,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.745464+0000","last_change":"2024-04-16T19:38:10.745507+0000","last_active":"2024-04-16T19:38:10.745464+0000","last_peered":"2024-04-16T19:38:10.745464+0000","last_clean":"2024-04-16T19:38:10.745464+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:38:10.745464+0000","last_undegraded":"2024-04-16T19:38:10.745464+0000","last_fullsized":"2024-04-16T19:38:10.745464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'556","last_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_deep_scrub":"53'556","last_deep_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.745406+0000","objects_scrubbed":30,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:38:44.014095+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56852,"num_omap_keys":197,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'20","reported_seq":403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.950663+0000","last_change":"2024-04-16T19:38:18.950663+0000","last_active":"2024-04-16T19:38:18.950663+0000","last_peered":"2024-04-16T19:38:18.950663+0000","last_clean":"2024-04-16T19:38:18.950663+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:38:18.950663+0000","last_undegraded":"2024-04-16T19:38:18.950663+0000","last_fullsized":"2024-04-16T19:38:18.950663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.950543+0000","objects_scrubbed":10,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:35:43.149409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401690+0000","last_change":"2024-04-16T17:45:10.394926+0000","last_active":"2024-04-16T19:37:44.401690+0000","last_peered":"2024-04-16T19:37:44.401690+0000","last_clean":"2024-04-16T19:37:44.401690+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:37:44.401690+0000","last_undegraded":"2024-04-16T19:37:44.401690+0000","last_fullsized":"2024-04-16T19:37:44.401690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402279+0000","last_change":"2024-04-16T17:45:08.382545+0000","last_active":"2024-04-16T19:37:49.402279+0000","last_peered":"2024-04-16T19:37:49.402279+0000","last_clean":"2024-04-16T19:37:49.402279+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:37:49.402279+0000","last_undegraded":"2024-04-16T19:37:49.402279+0000","last_fullsized":"2024-04-16T19:37:49.402279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"48'17","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339006+0000","last_change":"2024-04-16T17:45:20.412524+0000","last_active":"2024-04-16T19:38:10.339006+0000","last_peered":"2024-04-16T19:38:10.339006+0000","last_clean":"2024-04-16T19:38:10.339006+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:38:10.339006+0000","last_undegraded":"2024-04-16T19:38:10.339006+0000","last_fullsized":"2024-04-16T19:38:10.339006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'120","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595888+0000","last_change":"2024-04-16T17:45:22.414750+0000","last_active":"2024-04-16T19:37:54.595888+0000","last_peered":"2024-04-16T19:37:54.595888+0000","last_clean":"2024-04-16T19:37:54.595888+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:37:54.595888+0000","last_undegraded":"2024-04-16T19:37:54.595888+0000","last_fullsized":"2024-04-16T19:37:54.595888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'12","reported_seq":1392,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403128+0000","last_change":"2024-04-16T17:45:24.423828+0000","last_active":"2024-04-16T19:37:54.403128+0000","last_peered":"2024-04-16T19:37:54.403128+0000","last_clean":"2024-04-16T19:37:54.403128+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:37:54.403128+0000","last_undegraded":"2024-04-16T19:37:54.403128+0000","last_fullsized":"2024-04-16T19:37:54.403128+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.403900+0000","last_change":"2024-04-16T17:45:26.429874+0000","last_active":"2024-04-16T19:37:59.403900+0000","last_peered":"2024-04-16T19:37:59.403900+0000","last_clean":"2024-04-16T19:37:59.403900+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:37:59.403900+0000","last_undegraded":"2024-04-16T19:37:59.403900+0000","last_fullsized":"2024-04-16T19:37:59.403900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579566+0000","last_change":"2024-04-16T18:09:02.169496+0000","last_active":"2024-04-16T19:36:34.579566+0000","last_peered":"2024-04-16T19:36:34.579566+0000","last_clean":"2024-04-16T19:36:34.579566+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:36:34.579566+0000","last_undegraded":"2024-04-16T19:36:34.579566+0000","last_fullsized":"2024-04-16T19:36:34.579566+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'130","reported_seq":1977,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.400285+0000","last_change":"2024-04-16T17:46:25.525792+0000","last_active":"2024-04-16T19:37:14.400285+0000","last_peered":"2024-04-16T19:37:14.400285+0000","last_clean":"2024-04-16T19:37:14.400285+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:37:14.400285+0000","last_undegraded":"2024-04-16T19:37:14.400285+0000","last_fullsized":"2024-04-16T19:37:14.400285+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.394310+0000","last_change":"2024-04-16T17:46:17.512275+0000","last_active":"2024-04-16T19:36:49.394310+0000","last_peered":"2024-04-16T19:36:49.394310+0000","last_clean":"2024-04-16T19:36:49.394310+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:36:49.394310+0000","last_undegraded":"2024-04-16T19:36:49.394310+0000","last_fullsized":"2024-04-16T19:36:49.394310+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'16","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.577619+0000","last_change":"2024-04-16T17:45:51.480112+0000","last_active":"2024-04-16T19:36:24.577619+0000","last_peered":"2024-04-16T19:36:24.577619+0000","last_clean":"2024-04-16T19:36:24.577619+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:36:24.577619+0000","last_undegraded":"2024-04-16T19:36:24.577619+0000","last_fullsized":"2024-04-16T19:36:24.577619+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.762332+0000","last_change":"2024-04-16T19:38:20.762362+0000","last_active":"2024-04-16T19:38:20.762332+0000","last_peered":"2024-04-16T19:38:20.762332+0000","last_clean":"2024-04-16T19:38:20.762332+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:38:20.762332+0000","last_undegraded":"2024-04-16T19:38:20.762332+0000","last_fullsized":"2024-04-16T19:38:20.762332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.762267+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:32.587575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'447","reported_seq":743,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.567084+0000","last_change":"2024-04-16T19:38:15.567084+0000","last_active":"2024-04-16T19:38:15.567084+0000","last_peered":"2024-04-16T19:38:15.567084+0000","last_clean":"2024-04-16T19:38:15.567084+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:38:15.567084+0000","last_undegraded":"2024-04-16T19:38:15.567084+0000","last_fullsized":"2024-04-16T19:38:15.567084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'447","last_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_deep_scrub":"53'447","last_deep_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.566947+0000","objects_scrubbed":23,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:08.446790+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7264,"num_omap_keys":33,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'38","reported_seq":544,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.770259+0000","last_change":"2024-04-16T19:38:19.770333+0000","last_active":"2024-04-16T19:38:19.770259+0000","last_peered":"2024-04-16T19:38:19.770259+0000","last_clean":"2024-04-16T19:38:19.770259+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:38:19.770259+0000","last_undegraded":"2024-04-16T19:38:19.770259+0000","last_fullsized":"2024-04-16T19:38:19.770259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'38","last_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_deep_scrub":"53'38","last_deep_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.770195+0000","objects_scrubbed":10,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:32.489397+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.117330+0000","last_change":"2024-04-16T19:38:25.117354+0000","last_active":"2024-04-16T19:38:25.117330+0000","last_peered":"2024-04-16T19:38:25.117330+0000","last_clean":"2024-04-16T19:38:25.117330+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:38:25.117330+0000","last_undegraded":"2024-04-16T19:38:25.117330+0000","last_fullsized":"2024-04-16T19:38:25.117330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.117265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594561+0000","last_change":"2024-04-16T17:45:08.381995+0000","last_active":"2024-04-16T19:37:49.594561+0000","last_peered":"2024-04-16T19:37:49.594561+0000","last_clean":"2024-04-16T19:37:49.594561+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:37:49.594561+0000","last_undegraded":"2024-04-16T19:37:49.594561+0000","last_fullsized":"2024-04-16T19:37:49.594561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404067+0000","last_change":"2024-04-16T17:45:20.407642+0000","last_active":"2024-04-16T19:37:54.404067+0000","last_peered":"2024-04-16T19:37:54.404067+0000","last_clean":"2024-04-16T19:37:54.404067+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:37:54.404067+0000","last_undegraded":"2024-04-16T19:37:54.404067+0000","last_fullsized":"2024-04-16T19:37:54.404067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'176","reported_seq":386,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403681+0000","last_change":"2024-04-16T17:45:22.414672+0000","last_active":"2024-04-16T19:37:54.403681+0000","last_peered":"2024-04-16T19:37:54.403681+0000","last_clean":"2024-04-16T19:37:54.403681+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:37:54.403681+0000","last_undegraded":"2024-04-16T19:37:54.403681+0000","last_fullsized":"2024-04-16T19:37:54.403681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404028+0000","last_change":"2024-04-16T17:45:24.425728+0000","last_active":"2024-04-16T19:37:54.404028+0000","last_peered":"2024-04-16T19:37:54.404028+0000","last_clean":"2024-04-16T19:37:54.404028+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:37:54.404028+0000","last_undegraded":"2024-04-16T19:37:54.404028+0000","last_fullsized":"2024-04-16T19:37:54.404028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596827+0000","last_change":"2024-04-16T17:45:26.433385+0000","last_active":"2024-04-16T19:37:59.596827+0000","last_peered":"2024-04-16T19:37:59.596827+0000","last_clean":"2024-04-16T19:37:59.596827+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:37:59.596827+0000","last_undegraded":"2024-04-16T19:37:59.596827+0000","last_fullsized":"2024-04-16T19:37:59.596827+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582600+0000","last_change":"2024-04-16T18:09:02.173431+0000","last_active":"2024-04-16T19:36:49.582600+0000","last_peered":"2024-04-16T19:36:49.582600+0000","last_clean":"2024-04-16T19:36:49.582600+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:36:49.582600+0000","last_undegraded":"2024-04-16T19:36:49.582600+0000","last_fullsized":"2024-04-16T19:36:49.582600+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'117","reported_seq":1948,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.395352+0000","last_change":"2024-04-16T17:46:25.530014+0000","last_active":"2024-04-16T19:37:04.395352+0000","last_peered":"2024-04-16T19:37:04.395352+0000","last_clean":"2024-04-16T19:37:04.395352+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:37:04.395352+0000","last_undegraded":"2024-04-16T19:37:04.395352+0000","last_fullsized":"2024-04-16T19:37:04.395352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579507+0000","last_change":"2024-04-16T17:46:17.512764+0000","last_active":"2024-04-16T19:36:34.579507+0000","last_peered":"2024-04-16T19:36:34.579507+0000","last_clean":"2024-04-16T19:36:34.579507+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:36:34.579507+0000","last_undegraded":"2024-04-16T19:36:34.579507+0000","last_fullsized":"2024-04-16T19:36:34.579507+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'24","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887270+0000","last_change":"2024-04-16T17:45:51.482816+0000","last_active":"2024-04-16T19:38:09.887270+0000","last_peered":"2024-04-16T19:38:09.887270+0000","last_clean":"2024-04-16T19:38:09.887270+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:38:09.887270+0000","last_undegraded":"2024-04-16T19:38:09.887270+0000","last_fullsized":"2024-04-16T19:38:09.887270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.764947+0000","last_change":"2024-04-16T19:38:22.764970+0000","last_active":"2024-04-16T19:38:22.764947+0000","last_peered":"2024-04-16T19:38:22.764947+0000","last_clean":"2024-04-16T19:38:22.764947+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:38:22.764947+0000","last_undegraded":"2024-04-16T19:38:22.764947+0000","last_fullsized":"2024-04-16T19:38:22.764947+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.764883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:30.765316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'305","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.819258+0000","last_change":"2024-04-16T19:38:16.819258+0000","last_active":"2024-04-16T19:38:16.819258+0000","last_peered":"2024-04-16T19:38:16.819258+0000","last_clean":"2024-04-16T19:38:16.819258+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:38:16.819258+0000","last_undegraded":"2024-04-16T19:38:16.819258+0000","last_fullsized":"2024-04-16T19:38:16.819258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'305","last_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_deep_scrub":"53'305","last_deep_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.819127+0000","objects_scrubbed":14,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:56.568944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6851,"num_omap_keys":31,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'21","reported_seq":476,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.104753+0000","last_change":"2024-04-16T19:38:18.104753+0000","last_active":"2024-04-16T19:38:18.104753+0000","last_peered":"2024-04-16T19:38:18.104753+0000","last_clean":"2024-04-16T19:38:18.104753+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:38:18.104753+0000","last_undegraded":"2024-04-16T19:38:18.104753+0000","last_fullsized":"2024-04-16T19:38:18.104753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.104621+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:22.649252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405592+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:38:04.405592+0000","last_peered":"2024-04-16T19:38:04.405592+0000","last_clean":"2024-04-16T19:38:04.405592+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:38:04.405592+0000","last_undegraded":"2024-04-16T19:38:04.405592+0000","last_fullsized":"2024-04-16T19:38:04.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.393238+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T19:36:44.393238+0000","last_peered":"2024-04-16T19:36:44.393238+0000","last_clean":"2024-04-16T19:36:44.393238+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:36:44.393238+0000","last_undegraded":"2024-04-16T19:36:44.393238+0000","last_fullsized":"2024-04-16T19:36:44.393238+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394646+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:36:54.394646+0000","last_peered":"2024-04-16T19:36:54.394646+0000","last_clean":"2024-04-16T19:36:54.394646+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:36:54.394646+0000","last_undegraded":"2024-04-16T19:36:54.394646+0000","last_fullsized":"2024-04-16T19:36:54.394646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592615+0000","last_change":"2024-04-16T17:45:08.387550+0000","last_active":"2024-04-16T19:37:39.592615+0000","last_peered":"2024-04-16T19:37:39.592615+0000","last_clean":"2024-04-16T19:37:39.592615+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:37:39.592615+0000","last_undegraded":"2024-04-16T19:37:39.592615+0000","last_fullsized":"2024-04-16T19:37:39.592615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403099+0000","last_change":"2024-04-16T17:45:20.412324+0000","last_active":"2024-04-16T19:37:54.403099+0000","last_peered":"2024-04-16T19:37:54.403099+0000","last_clean":"2024-04-16T19:37:54.403099+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:37:54.403099+0000","last_undegraded":"2024-04-16T19:37:54.403099+0000","last_fullsized":"2024-04-16T19:37:54.403099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'72","reported_seq":242,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405356+0000","last_change":"2024-04-16T17:45:22.415579+0000","last_active":"2024-04-16T19:38:04.405356+0000","last_peered":"2024-04-16T19:38:04.405356+0000","last_clean":"2024-04-16T19:38:04.405356+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:38:04.405356+0000","last_undegraded":"2024-04-16T19:38:04.405356+0000","last_fullsized":"2024-04-16T19:38:04.405356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408644+0000","last_change":"2024-04-16T17:45:24.422064+0000","last_active":"2024-04-16T19:38:04.408644+0000","last_peered":"2024-04-16T19:38:04.408644+0000","last_clean":"2024-04-16T19:38:04.408644+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:38:04.408644+0000","last_undegraded":"2024-04-16T19:38:04.408644+0000","last_fullsized":"2024-04-16T19:38:04.408644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.405983+0000","last_change":"2024-04-16T17:45:26.439130+0000","last_active":"2024-04-16T19:38:09.405983+0000","last_peered":"2024-04-16T19:38:09.405983+0000","last_clean":"2024-04-16T19:38:09.405983+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:38:09.405983+0000","last_undegraded":"2024-04-16T19:38:09.405983+0000","last_fullsized":"2024-04-16T19:38:09.405983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.393212+0000","last_change":"2024-04-16T18:09:02.168908+0000","last_active":"2024-04-16T19:36:49.393212+0000","last_peered":"2024-04-16T19:36:49.393212+0000","last_clean":"2024-04-16T19:36:49.393212+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:36:49.393212+0000","last_undegraded":"2024-04-16T19:36:49.393212+0000","last_fullsized":"2024-04-16T19:36:49.393212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'150","reported_seq":2026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395682+0000","last_change":"2024-04-16T17:46:25.527679+0000","last_active":"2024-04-16T19:36:44.395682+0000","last_peered":"2024-04-16T19:36:44.395682+0000","last_clean":"2024-04-16T19:36:44.395682+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:36:44.395682+0000","last_undegraded":"2024-04-16T19:36:44.395682+0000","last_fullsized":"2024-04-16T19:36:44.395682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394787+0000","last_change":"2024-04-16T17:46:17.514358+0000","last_active":"2024-04-16T19:36:54.394787+0000","last_peered":"2024-04-16T19:36:54.394787+0000","last_clean":"2024-04-16T19:36:54.394787+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:36:54.394787+0000","last_undegraded":"2024-04-16T19:36:54.394787+0000","last_fullsized":"2024-04-16T19:36:54.394787+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'5","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069654+0000","last_change":"2024-04-16T17:45:51.481385+0000","last_active":"2024-04-16T19:38:08.069654+0000","last_peered":"2024-04-16T19:38:08.069654+0000","last_clean":"2024-04-16T19:38:08.069654+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:38:08.069654+0000","last_undegraded":"2024-04-16T19:38:08.069654+0000","last_fullsized":"2024-04-16T19:38:08.069654+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'651","reported_seq":2344,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976918+0000","last_change":"2024-04-16T17:45:49.469823+0000","last_active":"2024-04-16T19:38:08.976918+0000","last_peered":"2024-04-16T19:38:08.976918+0000","last_clean":"2024-04-16T19:38:08.976918+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:38:08.976918+0000","last_undegraded":"2024-04-16T19:38:08.976918+0000","last_fullsized":"2024-04-16T19:38:08.976918+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'465","reported_seq":770,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.378097+0000","last_change":"2024-04-16T19:38:22.378097+0000","last_active":"2024-04-16T19:38:22.378097+0000","last_peered":"2024-04-16T19:38:22.378097+0000","last_clean":"2024-04-16T19:38:22.378097+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:38:22.378097+0000","last_undegraded":"2024-04-16T19:38:22.378097+0000","last_fullsized":"2024-04-16T19:38:22.378097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'465","last_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_deep_scrub":"53'465","last_deep_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.378008+0000","objects_scrubbed":26,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:24.892034+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'22","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.329830+0000","last_change":"2024-04-16T19:38:21.329929+0000","last_active":"2024-04-16T19:38:21.329830+0000","last_peered":"2024-04-16T19:38:21.329830+0000","last_clean":"2024-04-16T19:38:21.329830+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:38:21.329830+0000","last_undegraded":"2024-04-16T19:38:21.329830+0000","last_fullsized":"2024-04-16T19:38:21.329830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.329754+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:26.751591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407098+0000","last_change":"2024-04-16T17:45:10.396755+0000","last_active":"2024-04-16T19:37:54.407098+0000","last_peered":"2024-04-16T19:37:54.407098+0000","last_clean":"2024-04-16T19:37:54.407098+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:37:54.407098+0000","last_undegraded":"2024-04-16T19:37:54.407098+0000","last_fullsized":"2024-04-16T19:37:54.407098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.393262+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T19:36:44.393262+0000","last_peered":"2024-04-16T19:36:44.393262+0000","last_clean":"2024-04-16T19:36:44.393262+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:36:44.393262+0000","last_undegraded":"2024-04-16T19:36:44.393262+0000","last_fullsized":"2024-04-16T19:36:44.393262+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.581436+0000","last_change":"2024-04-16T17:46:16.500353+0000","last_active":"2024-04-16T19:36:44.581436+0000","last_peered":"2024-04-16T19:36:44.581436+0000","last_clean":"2024-04-16T19:36:44.581436+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:36:44.581436+0000","last_undegraded":"2024-04-16T19:36:44.581436+0000","last_fullsized":"2024-04-16T19:36:44.581436+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"48'13","reported_seq":583,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405373+0000","last_change":"2024-04-16T17:45:20.412363+0000","last_active":"2024-04-16T19:38:04.405373+0000","last_peered":"2024-04-16T19:38:04.405373+0000","last_clean":"2024-04-16T19:38:04.405373+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:38:04.405373+0000","last_undegraded":"2024-04-16T19:38:04.405373+0000","last_fullsized":"2024-04-16T19:38:04.405373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'177","reported_seq":1668,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595869+0000","last_change":"2024-04-16T17:45:22.412577+0000","last_active":"2024-04-16T19:37:54.595869+0000","last_peered":"2024-04-16T19:37:54.595869+0000","last_clean":"2024-04-16T19:37:54.595869+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:37:54.595869+0000","last_undegraded":"2024-04-16T19:37:54.595869+0000","last_fullsized":"2024-04-16T19:37:54.595869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.886687+0000","last_change":"2024-04-16T17:45:24.422901+0000","last_active":"2024-04-16T19:38:09.886687+0000","last_peered":"2024-04-16T19:38:09.886687+0000","last_clean":"2024-04-16T19:38:09.886687+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:38:09.886687+0000","last_undegraded":"2024-04-16T19:38:09.886687+0000","last_fullsized":"2024-04-16T19:38:09.886687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.744953+0000","last_change":"2024-04-16T19:38:25.744976+0000","last_active":"2024-04-16T19:38:25.744953+0000","last_peered":"2024-04-16T19:38:25.744953+0000","last_clean":"2024-04-16T19:38:25.744953+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:38:25.744953+0000","last_undegraded":"2024-04-16T19:38:25.744953+0000","last_fullsized":"2024-04-16T19:38:25.744953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.744882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:25.114426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.393876+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:36:49.393876+0000","last_peered":"2024-04-16T19:36:49.393876+0000","last_clean":"2024-04-16T19:36:49.393876+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:36:49.393876+0000","last_undegraded":"2024-04-16T19:36:49.393876+0000","last_fullsized":"2024-04-16T19:36:49.393876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'137","reported_seq":1600,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.393129+0000","last_change":"2024-04-16T17:46:25.524587+0000","last_active":"2024-04-16T19:36:44.393129+0000","last_peered":"2024-04-16T19:36:44.393129+0000","last_clean":"2024-04-16T19:36:44.393129+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:36:44.393129+0000","last_undegraded":"2024-04-16T19:36:44.393129+0000","last_fullsized":"2024-04-16T19:36:44.393129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391701+0000","last_change":"2024-04-16T17:46:17.512533+0000","last_active":"2024-04-16T19:36:34.391701+0000","last_peered":"2024-04-16T19:36:34.391701+0000","last_clean":"2024-04-16T19:36:34.391701+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:36:34.391701+0000","last_undegraded":"2024-04-16T19:36:34.391701+0000","last_fullsized":"2024-04-16T19:36:34.391701+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'22","reported_seq":191,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.390977+0000","last_change":"2024-04-16T17:45:51.482872+0000","last_active":"2024-04-16T19:36:29.390977+0000","last_peered":"2024-04-16T19:36:29.390977+0000","last_clean":"2024-04-16T19:36:29.390977+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:36:29.390977+0000","last_undegraded":"2024-04-16T19:36:29.390977+0000","last_fullsized":"2024-04-16T19:36:29.390977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976988+0000","last_change":"2024-04-16T17:45:49.469833+0000","last_active":"2024-04-16T19:38:08.976988+0000","last_peered":"2024-04-16T19:38:08.976988+0000","last_clean":"2024-04-16T19:38:08.976988+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:38:08.976988+0000","last_undegraded":"2024-04-16T19:38:08.976988+0000","last_fullsized":"2024-04-16T19:38:08.976988+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4956","reported_seq":7445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.900157+0000","last_change":"2024-04-16T19:38:14.900157+0000","last_active":"2024-04-16T19:38:14.900157+0000","last_peered":"2024-04-16T19:38:14.900157+0000","last_clean":"2024-04-16T19:38:14.900157+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:38:14.900157+0000","last_undegraded":"2024-04-16T19:38:14.900157+0000","last_fullsized":"2024-04-16T19:38:14.900157+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4956","last_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_deep_scrub":"53'4956","last_deep_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.900021+0000","objects_scrubbed":21,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:17.433386+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'10","reported_seq":271,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.858808+0000","last_change":"2024-04-16T19:38:11.858857+0000","last_active":"2024-04-16T19:38:11.858808+0000","last_peered":"2024-04-16T19:38:11.858808+0000","last_clean":"2024-04-16T19:38:11.858808+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:38:11.858808+0000","last_undegraded":"2024-04-16T19:38:11.858808+0000","last_fullsized":"2024-04-16T19:38:11.858808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.858749+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:25:54.104521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596005+0000","last_change":"2024-04-16T17:45:10.401015+0000","last_active":"2024-04-16T19:37:54.596005+0000","last_peered":"2024-04-16T19:37:54.596005+0000","last_clean":"2024-04-16T19:37:54.596005+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:37:54.596005+0000","last_undegraded":"2024-04-16T19:37:54.596005+0000","last_fullsized":"2024-04-16T19:37:54.596005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583527+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T19:36:54.583527+0000","last_peered":"2024-04-16T19:36:54.583527+0000","last_clean":"2024-04-16T19:36:54.583527+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:36:54.583527+0000","last_undegraded":"2024-04-16T19:36:54.583527+0000","last_fullsized":"2024-04-16T19:36:54.583527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589471+0000","last_change":"2024-04-16T17:45:08.382479+0000","last_active":"2024-04-16T19:37:24.589471+0000","last_peered":"2024-04-16T19:37:24.589471+0000","last_clean":"2024-04-16T19:37:24.589471+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:37:24.589471+0000","last_undegraded":"2024-04-16T19:37:24.589471+0000","last_fullsized":"2024-04-16T19:37:24.589471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"48'3","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597957+0000","last_change":"2024-04-16T17:45:20.413451+0000","last_active":"2024-04-16T19:38:04.597957+0000","last_peered":"2024-04-16T19:38:04.597957+0000","last_clean":"2024-04-16T19:38:04.597957+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:38:04.597957+0000","last_undegraded":"2024-04-16T19:38:04.597957+0000","last_fullsized":"2024-04-16T19:38:04.597957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'151","reported_seq":1612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339107+0000","last_change":"2024-04-16T17:45:22.416277+0000","last_active":"2024-04-16T19:38:10.339107+0000","last_peered":"2024-04-16T19:38:10.339107+0000","last_clean":"2024-04-16T19:38:10.339107+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:38:10.339107+0000","last_undegraded":"2024-04-16T19:38:10.339107+0000","last_fullsized":"2024-04-16T19:38:10.339107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407046+0000","last_change":"2024-04-16T17:45:24.426509+0000","last_active":"2024-04-16T19:37:54.407046+0000","last_peered":"2024-04-16T19:37:54.407046+0000","last_clean":"2024-04-16T19:37:54.407046+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:37:54.407046+0000","last_undegraded":"2024-04-16T19:37:54.407046+0000","last_fullsized":"2024-04-16T19:37:54.407046+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.320446+0000","last_change":"2024-04-16T19:38:27.320467+0000","last_active":"2024-04-16T19:38:27.320446+0000","last_peered":"2024-04-16T19:38:27.320446+0000","last_clean":"2024-04-16T19:38:27.320446+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:38:27.320446+0000","last_undegraded":"2024-04-16T19:38:27.320446+0000","last_fullsized":"2024-04-16T19:38:27.320446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.320384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:47.178868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396760+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:37:04.396760+0000","last_peered":"2024-04-16T19:37:04.396760+0000","last_clean":"2024-04-16T19:37:04.396760+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:37:04.396760+0000","last_undegraded":"2024-04-16T19:37:04.396760+0000","last_fullsized":"2024-04-16T19:37:04.396760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'135","reported_seq":2027,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.392540+0000","last_change":"2024-04-16T17:46:25.529983+0000","last_active":"2024-04-16T19:36:44.392540+0000","last_peered":"2024-04-16T19:36:44.392540+0000","last_clean":"2024-04-16T19:36:44.392540+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:36:44.392540+0000","last_undegraded":"2024-04-16T19:36:44.392540+0000","last_fullsized":"2024-04-16T19:36:44.392540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391093+0000","last_change":"2024-04-16T17:46:17.508075+0000","last_active":"2024-04-16T19:36:34.391093+0000","last_peered":"2024-04-16T19:36:34.391093+0000","last_clean":"2024-04-16T19:36:34.391093+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:36:34.391093+0000","last_undegraded":"2024-04-16T19:36:34.391093+0000","last_fullsized":"2024-04-16T19:36:34.391093+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"48'2","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069637+0000","last_change":"2024-04-16T17:45:51.484218+0000","last_active":"2024-04-16T19:38:08.069637+0000","last_peered":"2024-04-16T19:38:08.069637+0000","last_clean":"2024-04-16T19:38:08.069637+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:38:08.069637+0000","last_undegraded":"2024-04-16T19:38:08.069637+0000","last_fullsized":"2024-04-16T19:38:08.069637+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.088262+0000","last_change":"2024-04-16T19:38:21.088285+0000","last_active":"2024-04-16T19:38:21.088262+0000","last_peered":"2024-04-16T19:38:21.088262+0000","last_clean":"2024-04-16T19:38:21.088262+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:38:21.088262+0000","last_undegraded":"2024-04-16T19:38:21.088262+0000","last_fullsized":"2024-04-16T19:38:21.088262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.088193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:58.302179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'503","reported_seq":980,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.479800+0000","last_change":"2024-04-16T19:38:11.479844+0000","last_active":"2024-04-16T19:38:11.479800+0000","last_peered":"2024-04-16T19:38:11.479800+0000","last_clean":"2024-04-16T19:38:11.479800+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:38:11.479800+0000","last_undegraded":"2024-04-16T19:38:11.479800+0000","last_fullsized":"2024-04-16T19:38:11.479800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'503","last_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_deep_scrub":"53'503","last_deep_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.479730+0000","objects_scrubbed":31,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:50.543348+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7030,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'12","reported_seq":434,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.241107+0000","last_change":"2024-04-16T19:38:17.241107+0000","last_active":"2024-04-16T19:38:17.241107+0000","last_peered":"2024-04-16T19:38:17.241107+0000","last_clean":"2024-04-16T19:38:17.241107+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:38:17.241107+0000","last_undegraded":"2024-04-16T19:38:17.241107+0000","last_fullsized":"2024-04-16T19:38:17.241107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.241004+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:31.290983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593760+0000","last_change":"2024-04-16T17:45:10.396905+0000","last_active":"2024-04-16T19:37:44.593760+0000","last_peered":"2024-04-16T19:37:44.593760+0000","last_clean":"2024-04-16T19:37:44.593760+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:37:44.593760+0000","last_undegraded":"2024-04-16T19:37:44.593760+0000","last_fullsized":"2024-04-16T19:37:44.593760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394604+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T19:36:54.394604+0000","last_peered":"2024-04-16T19:36:54.394604+0000","last_clean":"2024-04-16T19:36:54.394604+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:36:54.394604+0000","last_undegraded":"2024-04-16T19:36:54.394604+0000","last_fullsized":"2024-04-16T19:36:54.394604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400666+0000","last_change":"2024-04-16T17:45:08.382355+0000","last_active":"2024-04-16T19:37:39.400666+0000","last_peered":"2024-04-16T19:37:39.400666+0000","last_clean":"2024-04-16T19:37:39.400666+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:37:39.400666+0000","last_undegraded":"2024-04-16T19:37:39.400666+0000","last_fullsized":"2024-04-16T19:37:39.400666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":878,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068968+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:38:08.068968+0000","last_peered":"2024-04-16T19:38:08.068968+0000","last_clean":"2024-04-16T19:38:08.068968+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:38:08.068968+0000","last_undegraded":"2024-04-16T19:38:08.068968+0000","last_fullsized":"2024-04-16T19:38:08.068968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'144","reported_seq":335,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.598054+0000","last_change":"2024-04-16T17:45:22.417967+0000","last_active":"2024-04-16T19:38:04.598054+0000","last_peered":"2024-04-16T19:38:04.598054+0000","last_clean":"2024-04-16T19:38:04.598054+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:38:04.598054+0000","last_undegraded":"2024-04-16T19:38:04.598054+0000","last_fullsized":"2024-04-16T19:38:04.598054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405695+0000","last_change":"2024-04-16T17:45:24.430854+0000","last_active":"2024-04-16T19:38:04.405695+0000","last_peered":"2024-04-16T19:38:04.405695+0000","last_clean":"2024-04-16T19:38:04.405695+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:38:04.405695+0000","last_undegraded":"2024-04-16T19:38:04.405695+0000","last_fullsized":"2024-04-16T19:38:04.405695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.405956+0000","last_change":"2024-04-16T17:45:26.433033+0000","last_active":"2024-04-16T19:38:09.405956+0000","last_peered":"2024-04-16T19:38:09.405956+0000","last_clean":"2024-04-16T19:38:09.405956+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:38:09.405956+0000","last_undegraded":"2024-04-16T19:38:09.405956+0000","last_fullsized":"2024-04-16T19:38:09.405956+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403444+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:37:54.403444+0000","last_peered":"2024-04-16T19:37:54.403444+0000","last_clean":"2024-04-16T19:37:54.403444+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:37:54.403444+0000","last_undegraded":"2024-04-16T19:37:54.403444+0000","last_fullsized":"2024-04-16T19:37:54.403444+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1712,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402501+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:37:49.402501+0000","last_peered":"2024-04-16T19:37:49.402501+0000","last_clean":"2024-04-16T19:37:49.402501+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:37:49.402501+0000","last_undegraded":"2024-04-16T19:37:49.402501+0000","last_fullsized":"2024-04-16T19:37:49.402501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391668+0000","last_change":"2024-04-16T17:46:17.507415+0000","last_active":"2024-04-16T19:36:34.391668+0000","last_peered":"2024-04-16T19:36:34.391668+0000","last_clean":"2024-04-16T19:36:34.391668+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:36:34.391668+0000","last_undegraded":"2024-04-16T19:36:34.391668+0000","last_fullsized":"2024-04-16T19:36:34.391668+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'14","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.080415+0000","last_change":"2024-04-16T19:38:28.080454+0000","last_active":"2024-04-16T19:38:28.080415+0000","last_peered":"2024-04-16T19:38:28.080415+0000","last_clean":"2024-04-16T19:38:28.080415+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:38:28.080415+0000","last_undegraded":"2024-04-16T19:38:28.080415+0000","last_fullsized":"2024-04-16T19:38:28.080415+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.080349+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:30.384618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'652","reported_seq":2241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.085883+0000","last_change":"2024-04-16T19:38:17.085883+0000","last_active":"2024-04-16T19:38:17.085883+0000","last_peered":"2024-04-16T19:38:17.085883+0000","last_clean":"2024-04-16T19:38:17.085883+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:38:17.085883+0000","last_undegraded":"2024-04-16T19:38:17.085883+0000","last_fullsized":"2024-04-16T19:38:17.085883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.085744+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:55.082690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'364","reported_seq":672,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.518366+0000","last_change":"2024-04-16T19:38:17.518366+0000","last_active":"2024-04-16T19:38:17.518366+0000","last_peered":"2024-04-16T19:38:17.518366+0000","last_clean":"2024-04-16T19:38:17.518366+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:38:17.518366+0000","last_undegraded":"2024-04-16T19:38:17.518366+0000","last_fullsized":"2024-04-16T19:38:17.518366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'364","last_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_deep_scrub":"53'364","last_deep_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.518227+0000","objects_scrubbed":20,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:39.484987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6810,"num_omap_keys":31,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'21","reported_seq":469,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.711002+0000","last_change":"2024-04-16T19:38:25.711099+0000","last_active":"2024-04-16T19:38:25.711002+0000","last_peered":"2024-04-16T19:38:25.711002+0000","last_clean":"2024-04-16T19:38:25.711002+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:38:25.711002+0000","last_undegraded":"2024-04-16T19:38:25.711002+0000","last_fullsized":"2024-04-16T19:38:25.711002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.710924+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:00.685204+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593675+0000","last_change":"2024-04-16T17:45:10.399758+0000","last_active":"2024-04-16T19:37:44.593675+0000","last_peered":"2024-04-16T19:37:44.593675+0000","last_clean":"2024-04-16T19:37:44.593675+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:37:44.593675+0000","last_undegraded":"2024-04-16T19:37:44.593675+0000","last_fullsized":"2024-04-16T19:37:44.593675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404465+0000","last_change":"2024-04-16T17:45:08.386614+0000","last_active":"2024-04-16T19:37:59.404465+0000","last_peered":"2024-04-16T19:37:59.404465+0000","last_clean":"2024-04-16T19:37:59.404465+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:37:59.404465+0000","last_undegraded":"2024-04-16T19:37:59.404465+0000","last_fullsized":"2024-04-16T19:37:59.404465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583633+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T19:36:54.583633+0000","last_peered":"2024-04-16T19:36:54.583633+0000","last_clean":"2024-04-16T19:36:54.583633+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:36:54.583633+0000","last_undegraded":"2024-04-16T19:36:54.583633+0000","last_fullsized":"2024-04-16T19:36:54.583633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406997+0000","last_change":"2024-04-16T17:45:20.414740+0000","last_active":"2024-04-16T19:37:54.406997+0000","last_peered":"2024-04-16T19:37:54.406997+0000","last_clean":"2024-04-16T19:37:54.406997+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:37:54.406997+0000","last_undegraded":"2024-04-16T19:37:54.406997+0000","last_fullsized":"2024-04-16T19:37:54.406997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'160","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405063+0000","last_change":"2024-04-16T17:45:22.416454+0000","last_active":"2024-04-16T19:37:44.405063+0000","last_peered":"2024-04-16T19:37:44.405063+0000","last_clean":"2024-04-16T19:37:44.405063+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:37:44.405063+0000","last_undegraded":"2024-04-16T19:37:44.405063+0000","last_fullsized":"2024-04-16T19:37:44.405063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.402988+0000","last_change":"2024-04-16T17:45:24.425127+0000","last_active":"2024-04-16T19:37:54.402988+0000","last_peered":"2024-04-16T19:37:54.402988+0000","last_clean":"2024-04-16T19:37:54.402988+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:37:54.402988+0000","last_undegraded":"2024-04-16T19:37:54.402988+0000","last_fullsized":"2024-04-16T19:37:54.402988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.343354+0000","last_change":"2024-04-16T19:38:23.343376+0000","last_active":"2024-04-16T19:38:23.343354+0000","last_peered":"2024-04-16T19:38:23.343354+0000","last_clean":"2024-04-16T19:38:23.343354+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:38:23.343354+0000","last_undegraded":"2024-04-16T19:38:23.343354+0000","last_fullsized":"2024-04-16T19:38:23.343354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.343292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:42.020915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595633+0000","last_change":"2024-04-16T18:09:02.175274+0000","last_active":"2024-04-16T19:37:54.595633+0000","last_peered":"2024-04-16T19:37:54.595633+0000","last_clean":"2024-04-16T19:37:54.595633+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:37:54.595633+0000","last_undegraded":"2024-04-16T19:37:54.595633+0000","last_fullsized":"2024-04-16T19:37:54.595633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1690,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395327+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:36:59.395327+0000","last_peered":"2024-04-16T19:36:59.395327+0000","last_clean":"2024-04-16T19:36:59.395327+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:36:59.395327+0000","last_undegraded":"2024-04-16T19:36:59.395327+0000","last_fullsized":"2024-04-16T19:36:59.395327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.109433+0000","last_change":"2024-04-16T19:38:29.109454+0000","last_active":"2024-04-16T19:38:29.109433+0000","last_peered":"2024-04-16T19:38:29.109433+0000","last_clean":"2024-04-16T19:38:29.109433+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:38:29.109433+0000","last_undegraded":"2024-04-16T19:38:29.109433+0000","last_fullsized":"2024-04-16T19:38:29.109433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.109370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:03.453529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"48'7","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069717+0000","last_change":"2024-04-16T17:45:51.478774+0000","last_active":"2024-04-16T19:38:08.069717+0000","last_peered":"2024-04-16T19:38:08.069717+0000","last_clean":"2024-04-16T19:38:08.069717+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:38:08.069717+0000","last_undegraded":"2024-04-16T19:38:08.069717+0000","last_fullsized":"2024-04-16T19:38:08.069717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.723050+0000","last_change":"2024-04-16T19:38:26.723073+0000","last_active":"2024-04-16T19:38:26.723050+0000","last_peered":"2024-04-16T19:38:26.723050+0000","last_clean":"2024-04-16T19:38:26.723050+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:38:26.723050+0000","last_undegraded":"2024-04-16T19:38:26.723050+0000","last_fullsized":"2024-04-16T19:38:26.723050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.722978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:34.382609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'523","reported_seq":865,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.541783+0000","last_change":"2024-04-16T19:38:13.541783+0000","last_active":"2024-04-16T19:38:13.541783+0000","last_peered":"2024-04-16T19:38:13.541783+0000","last_clean":"2024-04-16T19:38:13.541783+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:38:13.541783+0000","last_undegraded":"2024-04-16T19:38:13.541783+0000","last_fullsized":"2024-04-16T19:38:13.541783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'523","last_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_deep_scrub":"53'523","last_deep_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.541660+0000","objects_scrubbed":23,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:50.755647+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21532,"num_omap_keys":98,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'34","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.893657+0000","last_change":"2024-04-16T19:38:23.893744+0000","last_active":"2024-04-16T19:38:23.893657+0000","last_peered":"2024-04-16T19:38:23.893657+0000","last_clean":"2024-04-16T19:38:23.893657+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:38:23.893657+0000","last_undegraded":"2024-04-16T19:38:23.893657+0000","last_fullsized":"2024-04-16T19:38:23.893657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.893579+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:25.142771+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405174+0000","last_change":"2024-04-16T17:45:10.392387+0000","last_active":"2024-04-16T19:37:44.405174+0000","last_peered":"2024-04-16T19:37:44.405174+0000","last_clean":"2024-04-16T19:37:44.405174+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:37:44.405174+0000","last_undegraded":"2024-04-16T19:37:44.405174+0000","last_fullsized":"2024-04-16T19:37:44.405174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592730+0000","last_change":"2024-04-16T17:45:08.383729+0000","last_active":"2024-04-16T19:37:39.592730+0000","last_peered":"2024-04-16T19:37:39.592730+0000","last_clean":"2024-04-16T19:37:39.592730+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:37:39.592730+0000","last_undegraded":"2024-04-16T19:37:39.592730+0000","last_fullsized":"2024-04-16T19:37:39.592730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.398214+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T19:37:14.398214+0000","last_peered":"2024-04-16T19:37:14.398214+0000","last_clean":"2024-04-16T19:37:14.398214+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:37:14.398214+0000","last_undegraded":"2024-04-16T19:37:14.398214+0000","last_fullsized":"2024-04-16T19:37:14.398214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403551+0000","last_change":"2024-04-16T17:45:20.408473+0000","last_active":"2024-04-16T19:37:54.403551+0000","last_peered":"2024-04-16T19:37:54.403551+0000","last_clean":"2024-04-16T19:37:54.403551+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:37:54.403551+0000","last_undegraded":"2024-04-16T19:37:54.403551+0000","last_fullsized":"2024-04-16T19:37:54.403551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'168","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595653+0000","last_change":"2024-04-16T17:45:22.422298+0000","last_active":"2024-04-16T19:37:54.595653+0000","last_peered":"2024-04-16T19:37:54.595653+0000","last_clean":"2024-04-16T19:37:54.595653+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:37:54.595653+0000","last_undegraded":"2024-04-16T19:37:54.595653+0000","last_fullsized":"2024-04-16T19:37:54.595653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'12","reported_seq":1398,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401763+0000","last_change":"2024-04-16T17:45:24.421136+0000","last_active":"2024-04-16T19:37:44.401763+0000","last_peered":"2024-04-16T19:37:44.401763+0000","last_clean":"2024-04-16T19:37:44.401763+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:37:44.401763+0000","last_undegraded":"2024-04-16T19:37:44.401763+0000","last_fullsized":"2024-04-16T19:37:44.401763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.367924+0000","last_change":"2024-04-16T19:38:25.367947+0000","last_active":"2024-04-16T19:38:25.367924+0000","last_peered":"2024-04-16T19:38:25.367924+0000","last_clean":"2024-04-16T19:38:25.367924+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:38:25.367924+0000","last_undegraded":"2024-04-16T19:38:25.367924+0000","last_fullsized":"2024-04-16T19:38:25.367924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.367850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:46.556801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582520+0000","last_change":"2024-04-16T18:09:02.167725+0000","last_active":"2024-04-16T19:36:49.582520+0000","last_peered":"2024-04-16T19:36:49.582520+0000","last_clean":"2024-04-16T19:36:49.582520+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:36:49.582520+0000","last_undegraded":"2024-04-16T19:36:49.582520+0000","last_fullsized":"2024-04-16T19:36:49.582520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1837,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.398902+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:37:19.398902+0000","last_peered":"2024-04-16T19:37:19.398902+0000","last_clean":"2024-04-16T19:37:19.398902+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:37:19.398902+0000","last_undegraded":"2024-04-16T19:37:19.398902+0000","last_fullsized":"2024-04-16T19:37:19.398902+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.393751+0000","last_change":"2024-04-16T17:46:17.508698+0000","last_active":"2024-04-16T19:36:49.393751+0000","last_peered":"2024-04-16T19:36:49.393751+0000","last_clean":"2024-04-16T19:36:49.393751+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:36:49.393751+0000","last_undegraded":"2024-04-16T19:36:49.393751+0000","last_fullsized":"2024-04-16T19:36:49.393751+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'2","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.108541+0000","last_change":"2024-04-16T19:38:27.108567+0000","last_active":"2024-04-16T19:38:27.108541+0000","last_peered":"2024-04-16T19:38:27.108541+0000","last_clean":"2024-04-16T19:38:27.108541+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:38:27.108541+0000","last_undegraded":"2024-04-16T19:38:27.108541+0000","last_fullsized":"2024-04-16T19:38:27.108541+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.108478+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:30.717209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.390284+0000","last_change":"2024-04-16T17:45:49.472070+0000","last_active":"2024-04-16T19:36:24.390284+0000","last_peered":"2024-04-16T19:36:24.390284+0000","last_clean":"2024-04-16T19:36:24.390284+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:36:24.390284+0000","last_undegraded":"2024-04-16T19:36:24.390284+0000","last_fullsized":"2024-04-16T19:36:24.390284+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'341","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.445822+0000","last_change":"2024-04-16T19:38:10.445822+0000","last_active":"2024-04-16T19:38:10.445822+0000","last_peered":"2024-04-16T19:38:10.445822+0000","last_clean":"2024-04-16T19:38:10.445822+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:38:10.445822+0000","last_undegraded":"2024-04-16T19:38:10.445822+0000","last_fullsized":"2024-04-16T19:38:10.445822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'341","last_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_deep_scrub":"53'341","last_deep_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.445700+0000","objects_scrubbed":19,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:14.990331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20855,"num_omap_keys":95,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'34","reported_seq":599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.847777+0000","last_change":"2024-04-16T19:38:10.847777+0000","last_active":"2024-04-16T19:38:10.847777+0000","last_peered":"2024-04-16T19:38:10.847777+0000","last_clean":"2024-04-16T19:38:10.847777+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:38:10.847777+0000","last_undegraded":"2024-04-16T19:38:10.847777+0000","last_fullsized":"2024-04-16T19:38:10.847777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.847654+0000","objects_scrubbed":14,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:29.793118+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403394+0000","last_change":"2024-04-16T17:45:10.400196+0000","last_active":"2024-04-16T19:37:34.403394+0000","last_peered":"2024-04-16T19:37:34.403394+0000","last_clean":"2024-04-16T19:37:34.403394+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:37:34.403394+0000","last_undegraded":"2024-04-16T19:37:34.403394+0000","last_fullsized":"2024-04-16T19:37:34.403394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594796+0000","last_change":"2024-04-16T17:45:08.382982+0000","last_active":"2024-04-16T19:37:49.594796+0000","last_peered":"2024-04-16T19:37:49.594796+0000","last_clean":"2024-04-16T19:37:49.594796+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:37:49.594796+0000","last_undegraded":"2024-04-16T19:37:49.594796+0000","last_fullsized":"2024-04-16T19:37:49.594796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.585551+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T19:37:04.585551+0000","last_peered":"2024-04-16T19:37:04.585551+0000","last_clean":"2024-04-16T19:37:04.585551+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:37:04.585551+0000","last_undegraded":"2024-04-16T19:37:04.585551+0000","last_fullsized":"2024-04-16T19:37:04.585551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"48'3","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403926+0000","last_change":"2024-04-16T17:45:20.407710+0000","last_active":"2024-04-16T19:37:54.403926+0000","last_peered":"2024-04-16T19:37:54.403926+0000","last_clean":"2024-04-16T19:37:54.403926+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:37:54.403926+0000","last_undegraded":"2024-04-16T19:37:54.403926+0000","last_fullsized":"2024-04-16T19:37:54.403926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'120","reported_seq":301,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403952+0000","last_change":"2024-04-16T17:45:22.416114+0000","last_active":"2024-04-16T19:37:54.403952+0000","last_peered":"2024-04-16T19:37:54.403952+0000","last_clean":"2024-04-16T19:37:54.403952+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:37:54.403952+0000","last_undegraded":"2024-04-16T19:37:54.403952+0000","last_fullsized":"2024-04-16T19:37:54.403952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'12","reported_seq":1396,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407012+0000","last_change":"2024-04-16T17:45:24.423991+0000","last_active":"2024-04-16T19:37:54.407012+0000","last_peered":"2024-04-16T19:37:54.407012+0000","last_clean":"2024-04-16T19:37:54.407012+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:37:54.407012+0000","last_undegraded":"2024-04-16T19:37:54.407012+0000","last_fullsized":"2024-04-16T19:37:54.407012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.320279+0000","last_change":"2024-04-16T19:38:26.320303+0000","last_active":"2024-04-16T19:38:26.320279+0000","last_peered":"2024-04-16T19:38:26.320279+0000","last_clean":"2024-04-16T19:38:26.320279+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:38:26.320279+0000","last_undegraded":"2024-04-16T19:38:26.320279+0000","last_fullsized":"2024-04-16T19:38:26.320279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.320216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:10.143275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977348+0000","last_change":"2024-04-16T18:09:02.166269+0000","last_active":"2024-04-16T19:38:08.977348+0000","last_peered":"2024-04-16T19:38:08.977348+0000","last_clean":"2024-04-16T19:38:08.977348+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:38:08.977348+0000","last_undegraded":"2024-04-16T19:38:08.977348+0000","last_fullsized":"2024-04-16T19:38:08.977348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2089,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395625+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:36:44.395625+0000","last_peered":"2024-04-16T19:36:44.395625+0000","last_clean":"2024-04-16T19:36:44.395625+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:36:44.395625+0000","last_undegraded":"2024-04-16T19:36:44.395625+0000","last_fullsized":"2024-04-16T19:36:44.395625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582395+0000","last_change":"2024-04-16T17:46:17.513695+0000","last_active":"2024-04-16T19:36:49.582395+0000","last_peered":"2024-04-16T19:36:49.582395+0000","last_clean":"2024-04-16T19:36:49.582395+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:36:49.582395+0000","last_undegraded":"2024-04-16T19:36:49.582395+0000","last_fullsized":"2024-04-16T19:36:49.582395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'7","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.132358+0000","last_change":"2024-04-16T19:38:26.132412+0000","last_active":"2024-04-16T19:38:26.132358+0000","last_peered":"2024-04-16T19:38:26.132358+0000","last_clean":"2024-04-16T19:38:26.132358+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:38:26.132358+0000","last_undegraded":"2024-04-16T19:38:26.132358+0000","last_fullsized":"2024-04-16T19:38:26.132358+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.132277+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:26.528982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'652","reported_seq":2213,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.537534+0000","last_change":"2024-04-16T19:38:14.537534+0000","last_active":"2024-04-16T19:38:14.537534+0000","last_peered":"2024-04-16T19:38:14.537534+0000","last_clean":"2024-04-16T19:38:14.537534+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:38:14.537534+0000","last_undegraded":"2024-04-16T19:38:14.537534+0000","last_fullsized":"2024-04-16T19:38:14.537534+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.537442+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:05.967541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5554","reported_seq":10354,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.938404+0000","last_change":"2024-04-16T19:38:16.938437+0000","last_active":"2024-04-16T19:38:16.938404+0000","last_peered":"2024-04-16T19:38:16.938404+0000","last_clean":"2024-04-16T19:38:16.938404+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:38:16.938404+0000","last_undegraded":"2024-04-16T19:38:16.938404+0000","last_fullsized":"2024-04-16T19:38:16.938404+0000","mapping_epoch":33,"log_start":"53'3800","ondisk_log_start":"53'3800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5554","last_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_deep_scrub":"53'5554","last_deep_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.938343+0000","objects_scrubbed":27,"log_size":1754,"log_dups_size":3000,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:35.567420+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'24","reported_seq":708,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.053024+0000","last_change":"2024-04-16T19:38:22.053138+0000","last_active":"2024-04-16T19:38:22.053024+0000","last_peered":"2024-04-16T19:38:22.053024+0000","last_clean":"2024-04-16T19:38:22.053024+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:38:22.053024+0000","last_undegraded":"2024-04-16T19:38:22.053024+0000","last_fullsized":"2024-04-16T19:38:22.053024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.052928+0000","objects_scrubbed":12,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:13.483027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401524+0000","last_change":"2024-04-16T17:45:10.399687+0000","last_active":"2024-04-16T19:37:44.401524+0000","last_peered":"2024-04-16T19:37:44.401524+0000","last_clean":"2024-04-16T19:37:44.401524+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:37:44.401524+0000","last_undegraded":"2024-04-16T19:37:44.401524+0000","last_fullsized":"2024-04-16T19:37:44.401524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406184+0000","last_change":"2024-04-16T17:45:08.381368+0000","last_active":"2024-04-16T19:37:49.406184+0000","last_peered":"2024-04-16T19:37:49.406184+0000","last_clean":"2024-04-16T19:37:49.406184+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:37:49.406184+0000","last_undegraded":"2024-04-16T19:37:49.406184+0000","last_fullsized":"2024-04-16T19:37:49.406184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396726+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:37:04.396726+0000","last_peered":"2024-04-16T19:37:04.396726+0000","last_clean":"2024-04-16T19:37:04.396726+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:37:04.396726+0000","last_undegraded":"2024-04-16T19:37:04.396726+0000","last_fullsized":"2024-04-16T19:37:04.396726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'1","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592560+0000","last_change":"2024-04-16T17:45:20.403582+0000","last_active":"2024-04-16T19:37:39.592560+0000","last_peered":"2024-04-16T19:37:39.592560+0000","last_clean":"2024-04-16T19:37:39.592560+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:37:39.592560+0000","last_undegraded":"2024-04-16T19:37:39.592560+0000","last_fullsized":"2024-04-16T19:37:39.592560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'144","reported_seq":352,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403073+0000","last_change":"2024-04-16T17:45:22.414745+0000","last_active":"2024-04-16T19:37:54.403073+0000","last_peered":"2024-04-16T19:37:54.403073+0000","last_clean":"2024-04-16T19:37:54.403073+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:37:54.403073+0000","last_undegraded":"2024-04-16T19:37:54.403073+0000","last_fullsized":"2024-04-16T19:37:54.403073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595723+0000","last_change":"2024-04-16T17:45:24.425364+0000","last_active":"2024-04-16T19:37:54.595723+0000","last_peered":"2024-04-16T19:37:54.595723+0000","last_clean":"2024-04-16T19:37:54.595723+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:37:54.595723+0000","last_undegraded":"2024-04-16T19:37:54.595723+0000","last_fullsized":"2024-04-16T19:37:54.595723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404511+0000","last_change":"2024-04-16T17:45:26.438987+0000","last_active":"2024-04-16T19:37:59.404511+0000","last_peered":"2024-04-16T19:37:59.404511+0000","last_clean":"2024-04-16T19:37:59.404511+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:37:59.404511+0000","last_undegraded":"2024-04-16T19:37:59.404511+0000","last_fullsized":"2024-04-16T19:37:59.404511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069979+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:38:08.069979+0000","last_peered":"2024-04-16T19:38:08.069979+0000","last_clean":"2024-04-16T19:38:08.069979+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:38:08.069979+0000","last_undegraded":"2024-04-16T19:38:08.069979+0000","last_fullsized":"2024-04-16T19:38:08.069979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'101","reported_seq":1736,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404646+0000","last_change":"2024-04-16T17:46:25.527509+0000","last_active":"2024-04-16T19:37:59.404646+0000","last_peered":"2024-04-16T19:37:59.404646+0000","last_clean":"2024-04-16T19:37:59.404646+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:37:59.404646+0000","last_undegraded":"2024-04-16T19:37:59.404646+0000","last_fullsized":"2024-04-16T19:37:59.404646+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576472+0000","last_change":"2024-04-16T17:46:17.509709+0000","last_active":"2024-04-16T19:36:19.576472+0000","last_peered":"2024-04-16T19:36:19.576472+0000","last_clean":"2024-04-16T19:36:19.576472+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:36:19.576472+0000","last_undegraded":"2024-04-16T19:36:19.576472+0000","last_fullsized":"2024-04-16T19:36:19.576472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'19","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887284+0000","last_change":"2024-04-16T17:45:51.477907+0000","last_active":"2024-04-16T19:38:09.887284+0000","last_peered":"2024-04-16T19:38:09.887284+0000","last_clean":"2024-04-16T19:38:09.887284+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:38:09.887284+0000","last_undegraded":"2024-04-16T19:38:09.887284+0000","last_fullsized":"2024-04-16T19:38:09.887284+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.727449+0000","last_change":"2024-04-16T19:38:24.727504+0000","last_active":"2024-04-16T19:38:24.727449+0000","last_peered":"2024-04-16T19:38:24.727449+0000","last_clean":"2024-04-16T19:38:24.727449+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:38:24.727449+0000","last_undegraded":"2024-04-16T19:38:24.727449+0000","last_fullsized":"2024-04-16T19:38:24.727449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.727368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:38.777347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'344","reported_seq":655,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.511356+0000","last_change":"2024-04-16T19:38:12.511356+0000","last_active":"2024-04-16T19:38:12.511356+0000","last_peered":"2024-04-16T19:38:12.511356+0000","last_clean":"2024-04-16T19:38:12.511356+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:38:12.511356+0000","last_undegraded":"2024-04-16T19:38:12.511356+0000","last_fullsized":"2024-04-16T19:38:12.511356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'344","last_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_deep_scrub":"53'344","last_deep_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.511231+0000","objects_scrubbed":24,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:10.499739+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13835,"num_omap_keys":63,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'14","reported_seq":627,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.257871+0000","last_change":"2024-04-16T19:38:19.257946+0000","last_active":"2024-04-16T19:38:19.257871+0000","last_peered":"2024-04-16T19:38:19.257871+0000","last_clean":"2024-04-16T19:38:19.257871+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:38:19.257871+0000","last_undegraded":"2024-04-16T19:38:19.257871+0000","last_fullsized":"2024-04-16T19:38:19.257871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.257792+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:20.506984+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407815+0000","last_change":"2024-04-16T17:45:26.438380+0000","last_active":"2024-04-16T19:37:59.407815+0000","last_peered":"2024-04-16T19:37:59.407815+0000","last_clean":"2024-04-16T19:37:59.407815+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:37:59.407815+0000","last_undegraded":"2024-04-16T19:37:59.407815+0000","last_fullsized":"2024-04-16T19:37:59.407815+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396720+0000","last_change":"2024-04-16T17:45:10.393485+0000","last_active":"2024-04-16T19:37:14.396720+0000","last_peered":"2024-04-16T19:37:14.396720+0000","last_clean":"2024-04-16T19:37:14.396720+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:37:14.396720+0000","last_undegraded":"2024-04-16T19:37:14.396720+0000","last_fullsized":"2024-04-16T19:37:14.396720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.400512+0000","last_change":"2024-04-16T17:45:08.386299+0000","last_active":"2024-04-16T19:37:29.400512+0000","last_peered":"2024-04-16T19:37:29.400512+0000","last_clean":"2024-04-16T19:37:29.400512+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:37:29.400512+0000","last_undegraded":"2024-04-16T19:37:29.400512+0000","last_fullsized":"2024-04-16T19:37:29.400512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"30'1","reported_seq":210,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589587+0000","last_change":"2024-04-16T17:45:20.412485+0000","last_active":"2024-04-16T19:37:24.589587+0000","last_peered":"2024-04-16T19:37:24.589587+0000","last_clean":"2024-04-16T19:37:24.589587+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:37:24.589587+0000","last_undegraded":"2024-04-16T19:37:24.589587+0000","last_fullsized":"2024-04-16T19:37:24.589587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'104","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589523+0000","last_change":"2024-04-16T17:45:22.416196+0000","last_active":"2024-04-16T19:37:24.589523+0000","last_peered":"2024-04-16T19:37:24.589523+0000","last_clean":"2024-04-16T19:37:24.589523+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:37:24.589523+0000","last_undegraded":"2024-04-16T19:37:24.589523+0000","last_fullsized":"2024-04-16T19:37:24.589523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589517+0000","last_change":"2024-04-16T17:45:24.424718+0000","last_active":"2024-04-16T19:37:24.589517+0000","last_peered":"2024-04-16T19:37:24.589517+0000","last_clean":"2024-04-16T19:37:24.589517+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:37:24.589517+0000","last_undegraded":"2024-04-16T19:37:24.589517+0000","last_fullsized":"2024-04-16T19:37:24.589517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.388577+0000","last_change":"2024-04-16T18:09:02.165652+0000","last_active":"2024-04-16T19:36:19.388577+0000","last_peered":"2024-04-16T19:36:19.388577+0000","last_clean":"2024-04-16T19:36:19.388577+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:36:19.388577+0000","last_undegraded":"2024-04-16T19:36:19.388577+0000","last_fullsized":"2024-04-16T19:36:19.388577+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'147","reported_seq":1631,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592501+0000","last_change":"2024-04-16T17:46:25.533095+0000","last_active":"2024-04-16T19:37:39.592501+0000","last_peered":"2024-04-16T19:37:39.592501+0000","last_clean":"2024-04-16T19:37:39.592501+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:37:39.592501+0000","last_undegraded":"2024-04-16T19:37:39.592501+0000","last_fullsized":"2024-04-16T19:37:39.592501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":77,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.388643+0000","last_change":"2024-04-16T17:46:17.509499+0000","last_active":"2024-04-16T19:36:19.388643+0000","last_peered":"2024-04-16T19:36:19.388643+0000","last_clean":"2024-04-16T19:36:19.388643+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:36:19.388643+0000","last_undegraded":"2024-04-16T19:36:19.388643+0000","last_fullsized":"2024-04-16T19:36:19.388643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'12","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887391+0000","last_change":"2024-04-16T17:47:16.567012+0000","last_active":"2024-04-16T19:38:09.887391+0000","last_peered":"2024-04-16T19:38:09.887391+0000","last_clean":"2024-04-16T19:38:09.887391+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:38:09.887391+0000","last_undegraded":"2024-04-16T19:38:09.887391+0000","last_fullsized":"2024-04-16T19:38:09.887391+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":90,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429635+0000","last_change":"2024-04-16T17:45:49.471808+0000","last_active":"2024-04-16T19:38:09.429635+0000","last_peered":"2024-04-16T19:38:09.429635+0000","last_clean":"2024-04-16T19:38:09.429635+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:38:09.429635+0000","last_undegraded":"2024-04-16T19:38:09.429635+0000","last_fullsized":"2024-04-16T19:38:09.429635+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'462","reported_seq":2060,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.755722+0000","last_change":"2024-04-16T19:38:14.755722+0000","last_active":"2024-04-16T19:38:14.755722+0000","last_peered":"2024-04-16T19:38:14.755722+0000","last_clean":"2024-04-16T19:38:14.755722+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:38:14.755722+0000","last_undegraded":"2024-04-16T19:38:14.755722+0000","last_fullsized":"2024-04-16T19:38:14.755722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'462","last_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_deep_scrub":"53'462","last_deep_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.755590+0000","objects_scrubbed":20,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:26.580898+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'26","reported_seq":480,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.808711+0000","last_change":"2024-04-16T19:38:09.808711+0000","last_active":"2024-04-16T19:38:09.808711+0000","last_peered":"2024-04-16T19:38:09.808711+0000","last_clean":"2024-04-16T19:38:09.808711+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:38:09.808711+0000","last_undegraded":"2024-04-16T19:38:09.808711+0000","last_fullsized":"2024-04-16T19:38:09.808711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.808625+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:45.079174+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593803+0000","last_change":"2024-04-16T17:45:26.432878+0000","last_active":"2024-04-16T19:37:44.593803+0000","last_peered":"2024-04-16T19:37:44.593803+0000","last_clean":"2024-04-16T19:37:44.593803+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:37:44.593803+0000","last_undegraded":"2024-04-16T19:37:44.593803+0000","last_fullsized":"2024-04-16T19:37:44.593803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587504+0000","last_change":"2024-04-16T17:45:10.394503+0000","last_active":"2024-04-16T19:37:14.587504+0000","last_peered":"2024-04-16T19:37:14.587504+0000","last_clean":"2024-04-16T19:37:14.587504+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:37:14.587504+0000","last_undegraded":"2024-04-16T19:37:14.587504+0000","last_fullsized":"2024-04-16T19:37:14.587504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.389333+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:36:19.389333+0000","last_peered":"2024-04-16T19:36:19.389333+0000","last_clean":"2024-04-16T19:36:19.389333+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:36:19.389333+0000","last_undegraded":"2024-04-16T19:36:19.389333+0000","last_fullsized":"2024-04-16T19:36:19.389333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'1","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589634+0000","last_change":"2024-04-16T17:45:20.407788+0000","last_active":"2024-04-16T19:37:24.589634+0000","last_peered":"2024-04-16T19:37:24.589634+0000","last_clean":"2024-04-16T19:37:24.589634+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:37:24.589634+0000","last_undegraded":"2024-04-16T19:37:24.589634+0000","last_fullsized":"2024-04-16T19:37:24.589634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'50","reported_seq":189,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.401888+0000","last_change":"2024-04-16T17:45:22.421476+0000","last_active":"2024-04-16T19:37:24.401888+0000","last_peered":"2024-04-16T19:37:24.401888+0000","last_clean":"2024-04-16T19:37:24.401888+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:37:24.401888+0000","last_undegraded":"2024-04-16T19:37:24.401888+0000","last_fullsized":"2024-04-16T19:37:24.401888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.399652+0000","last_change":"2024-04-16T17:45:24.430870+0000","last_active":"2024-04-16T19:37:24.399652+0000","last_peered":"2024-04-16T19:37:24.399652+0000","last_clean":"2024-04-16T19:37:24.399652+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:37:24.399652+0000","last_undegraded":"2024-04-16T19:37:24.399652+0000","last_fullsized":"2024-04-16T19:37:24.399652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391557+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:36:34.391557+0000","last_peered":"2024-04-16T19:36:34.391557+0000","last_clean":"2024-04-16T19:36:34.391557+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:36:34.391557+0000","last_undegraded":"2024-04-16T19:36:34.391557+0000","last_fullsized":"2024-04-16T19:36:34.391557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'109","reported_seq":1797,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.578457+0000","last_change":"2024-04-16T17:46:25.527453+0000","last_active":"2024-04-16T19:36:29.578457+0000","last_peered":"2024-04-16T19:36:29.578457+0000","last_clean":"2024-04-16T19:36:29.578457+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:36:29.578457+0000","last_undegraded":"2024-04-16T19:36:29.578457+0000","last_fullsized":"2024-04-16T19:36:29.578457+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.399582+0000","last_change":"2024-04-16T17:46:17.506081+0000","last_active":"2024-04-16T19:37:29.399582+0000","last_peered":"2024-04-16T19:37:29.399582+0000","last_clean":"2024-04-16T19:37:29.399582+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:37:29.399582+0000","last_undegraded":"2024-04-16T19:37:29.399582+0000","last_fullsized":"2024-04-16T19:37:29.399582+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'14","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.401920+0000","last_change":"2024-04-16T17:45:51.484484+0000","last_active":"2024-04-16T19:37:24.401920+0000","last_peered":"2024-04-16T19:37:24.401920+0000","last_clean":"2024-04-16T19:37:24.401920+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:37:24.401920+0000","last_undegraded":"2024-04-16T19:37:24.401920+0000","last_fullsized":"2024-04-16T19:37:24.401920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.406113+0000","last_change":"2024-04-16T17:45:49.473382+0000","last_active":"2024-04-16T19:38:09.406113+0000","last_peered":"2024-04-16T19:38:09.406113+0000","last_clean":"2024-04-16T19:38:09.406113+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:38:09.406113+0000","last_undegraded":"2024-04-16T19:38:09.406113+0000","last_fullsized":"2024-04-16T19:38:09.406113+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'685","reported_seq":2207,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.959879+0000","last_change":"2024-04-16T19:38:20.959909+0000","last_active":"2024-04-16T19:38:20.959879+0000","last_peered":"2024-04-16T19:38:20.959879+0000","last_clean":"2024-04-16T19:38:20.959879+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:38:20.959879+0000","last_undegraded":"2024-04-16T19:38:20.959879+0000","last_fullsized":"2024-04-16T19:38:20.959879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'685","last_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_deep_scrub":"53'685","last_deep_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.959819+0000","objects_scrubbed":26,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:09.314088+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4728,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'41","reported_seq":377,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.181166+0000","last_change":"2024-04-16T19:38:12.181166+0000","last_active":"2024-04-16T19:38:12.181166+0000","last_peered":"2024-04-16T19:38:12.181166+0000","last_clean":"2024-04-16T19:38:12.181166+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:38:12.181166+0000","last_undegraded":"2024-04-16T19:38:12.181166+0000","last_fullsized":"2024-04-16T19:38:12.181166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41","last_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_deep_scrub":"53'41","last_deep_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.181055+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.810131+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407774+0000","last_change":"2024-04-16T17:45:26.427816+0000","last_active":"2024-04-16T19:37:59.407774+0000","last_peered":"2024-04-16T19:37:59.407774+0000","last_clean":"2024-04-16T19:37:59.407774+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:37:59.407774+0000","last_undegraded":"2024-04-16T19:37:59.407774+0000","last_fullsized":"2024-04-16T19:37:59.407774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587429+0000","last_change":"2024-04-16T17:45:10.395061+0000","last_active":"2024-04-16T19:37:14.587429+0000","last_peered":"2024-04-16T19:37:14.587429+0000","last_clean":"2024-04-16T19:37:14.587429+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:37:14.587429+0000","last_undegraded":"2024-04-16T19:37:14.587429+0000","last_fullsized":"2024-04-16T19:37:14.587429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.389252+0000","last_change":"2024-04-16T17:45:08.389656+0000","last_active":"2024-04-16T19:36:19.389252+0000","last_peered":"2024-04-16T19:36:19.389252+0000","last_clean":"2024-04-16T19:36:19.389252+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:36:19.389252+0000","last_undegraded":"2024-04-16T19:36:19.389252+0000","last_fullsized":"2024-04-16T19:36:19.389252+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.398418+0000","last_change":"2024-04-16T17:45:20.407054+0000","last_active":"2024-04-16T19:37:24.398418+0000","last_peered":"2024-04-16T19:37:24.398418+0000","last_clean":"2024-04-16T19:37:24.398418+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:37:24.398418+0000","last_undegraded":"2024-04-16T19:37:24.398418+0000","last_fullsized":"2024-04-16T19:37:24.398418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'104","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589631+0000","last_change":"2024-04-16T17:45:22.415814+0000","last_active":"2024-04-16T19:37:24.589631+0000","last_peered":"2024-04-16T19:37:24.589631+0000","last_clean":"2024-04-16T19:37:24.589631+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:37:24.589631+0000","last_undegraded":"2024-04-16T19:37:24.589631+0000","last_fullsized":"2024-04-16T19:37:24.589631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.398893+0000","last_change":"2024-04-16T17:45:24.425524+0000","last_active":"2024-04-16T19:37:24.398893+0000","last_peered":"2024-04-16T19:37:24.398893+0000","last_clean":"2024-04-16T19:37:24.398893+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:37:24.398893+0000","last_undegraded":"2024-04-16T19:37:24.398893+0000","last_fullsized":"2024-04-16T19:37:24.398893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391692+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:36:34.391692+0000","last_peered":"2024-04-16T19:36:34.391692+0000","last_clean":"2024-04-16T19:36:34.391692+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:36:34.391692+0000","last_undegraded":"2024-04-16T19:36:34.391692+0000","last_fullsized":"2024-04-16T19:36:34.391692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2058,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393038+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:36:29.393038+0000","last_peered":"2024-04-16T19:36:29.393038+0000","last_clean":"2024-04-16T19:36:29.393038+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:36:29.393038+0000","last_undegraded":"2024-04-16T19:36:29.393038+0000","last_fullsized":"2024-04-16T19:36:29.393038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593433+0000","last_change":"2024-04-16T17:46:17.512965+0000","last_active":"2024-04-16T19:37:44.593433+0000","last_peered":"2024-04-16T19:37:44.593433+0000","last_clean":"2024-04-16T19:37:44.593433+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:37:44.593433+0000","last_undegraded":"2024-04-16T19:37:44.593433+0000","last_fullsized":"2024-04-16T19:37:44.593433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'12","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.585350+0000","last_change":"2024-04-16T17:45:51.477961+0000","last_active":"2024-04-16T19:37:04.585350+0000","last_peered":"2024-04-16T19:37:04.585350+0000","last_clean":"2024-04-16T19:37:04.585350+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:37:04.585350+0000","last_undegraded":"2024-04-16T19:37:04.585350+0000","last_fullsized":"2024-04-16T19:37:04.585350+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'651","reported_seq":2196,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977035+0000","last_change":"2024-04-16T17:45:49.469998+0000","last_active":"2024-04-16T19:38:08.977035+0000","last_peered":"2024-04-16T19:38:08.977035+0000","last_clean":"2024-04-16T19:38:08.977035+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:38:08.977035+0000","last_undegraded":"2024-04-16T19:38:08.977035+0000","last_fullsized":"2024-04-16T19:38:08.977035+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'745","reported_seq":3560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.302525+0000","last_change":"2024-04-16T19:38:20.302555+0000","last_active":"2024-04-16T19:38:20.302525+0000","last_peered":"2024-04-16T19:38:20.302525+0000","last_clean":"2024-04-16T19:38:20.302525+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:38:20.302525+0000","last_undegraded":"2024-04-16T19:38:20.302525+0000","last_fullsized":"2024-04-16T19:38:20.302525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'745","last_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_deep_scrub":"53'745","last_deep_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.302461+0000","objects_scrubbed":25,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:34.270855+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18796,"num_omap_keys":104,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'14","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.221430+0000","last_change":"2024-04-16T19:38:13.221430+0000","last_active":"2024-04-16T19:38:13.221430+0000","last_peered":"2024-04-16T19:38:13.221430+0000","last_clean":"2024-04-16T19:38:13.221430+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:38:13.221430+0000","last_undegraded":"2024-04-16T19:38:13.221430+0000","last_fullsized":"2024-04-16T19:38:13.221430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.221281+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:20.880912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404438+0000","last_change":"2024-04-16T17:45:26.438413+0000","last_active":"2024-04-16T19:37:59.404438+0000","last_peered":"2024-04-16T19:37:59.404438+0000","last_clean":"2024-04-16T19:37:59.404438+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:37:59.404438+0000","last_undegraded":"2024-04-16T19:37:59.404438+0000","last_fullsized":"2024-04-16T19:37:59.404438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587391+0000","last_change":"2024-04-16T17:45:10.402839+0000","last_active":"2024-04-16T19:37:14.587391+0000","last_peered":"2024-04-16T19:37:14.587391+0000","last_clean":"2024-04-16T19:37:14.587391+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:37:14.587391+0000","last_undegraded":"2024-04-16T19:37:14.587391+0000","last_fullsized":"2024-04-16T19:37:14.587391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391498+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:36:19.391498+0000","last_peered":"2024-04-16T19:36:19.391498+0000","last_clean":"2024-04-16T19:36:19.391498+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:36:19.391498+0000","last_undegraded":"2024-04-16T19:36:19.391498+0000","last_fullsized":"2024-04-16T19:36:19.391498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"48'4","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.399675+0000","last_change":"2024-04-16T17:45:20.413469+0000","last_active":"2024-04-16T19:37:24.399675+0000","last_peered":"2024-04-16T19:37:24.399675+0000","last_clean":"2024-04-16T19:37:24.399675+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:37:24.399675+0000","last_undegraded":"2024-04-16T19:37:24.399675+0000","last_fullsized":"2024-04-16T19:37:24.399675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'80","reported_seq":240,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.398926+0000","last_change":"2024-04-16T17:45:22.415761+0000","last_active":"2024-04-16T19:37:24.398926+0000","last_peered":"2024-04-16T19:37:24.398926+0000","last_clean":"2024-04-16T19:37:24.398926+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:37:24.398926+0000","last_undegraded":"2024-04-16T19:37:24.398926+0000","last_fullsized":"2024-04-16T19:37:24.398926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.401993+0000","last_change":"2024-04-16T17:45:24.426374+0000","last_active":"2024-04-16T19:37:24.401993+0000","last_peered":"2024-04-16T19:37:24.401993+0000","last_clean":"2024-04-16T19:37:24.401993+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:37:24.401993+0000","last_undegraded":"2024-04-16T19:37:24.401993+0000","last_fullsized":"2024-04-16T19:37:24.401993+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404769+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:37:59.404769+0000","last_peered":"2024-04-16T19:37:59.404769+0000","last_clean":"2024-04-16T19:37:59.404769+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:37:59.404769+0000","last_undegraded":"2024-04-16T19:37:59.404769+0000","last_fullsized":"2024-04-16T19:37:59.404769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'112","reported_seq":1494,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401937+0000","last_change":"2024-04-16T17:46:25.525571+0000","last_active":"2024-04-16T19:37:39.401937+0000","last_peered":"2024-04-16T19:37:39.401937+0000","last_clean":"2024-04-16T19:37:39.401937+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:37:39.401937+0000","last_undegraded":"2024-04-16T19:37:39.401937+0000","last_fullsized":"2024-04-16T19:37:39.401937+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.402802+0000","last_change":"2024-04-16T17:46:17.504593+0000","last_active":"2024-04-16T19:37:29.402802+0000","last_peered":"2024-04-16T19:37:29.402802+0000","last_clean":"2024-04-16T19:37:29.402802+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:37:29.402802+0000","last_undegraded":"2024-04-16T19:37:29.402802+0000","last_fullsized":"2024-04-16T19:37:29.402802+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"51'2","reported_seq":96,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.395370+0000","last_change":"2024-04-16T17:45:51.480201+0000","last_active":"2024-04-16T19:37:04.395370+0000","last_peered":"2024-04-16T19:37:04.395370+0000","last_clean":"2024-04-16T19:37:04.395370+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:37:04.395370+0000","last_undegraded":"2024-04-16T19:37:04.395370+0000","last_fullsized":"2024-04-16T19:37:04.395370+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406026+0000","last_change":"2024-04-16T17:45:49.476432+0000","last_active":"2024-04-16T19:37:49.406026+0000","last_peered":"2024-04-16T19:37:49.406026+0000","last_clean":"2024-04-16T19:37:49.406026+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:37:49.406026+0000","last_undegraded":"2024-04-16T19:37:49.406026+0000","last_fullsized":"2024-04-16T19:37:49.406026+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'394","reported_seq":728,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.708440+0000","last_change":"2024-04-16T19:38:11.708492+0000","last_active":"2024-04-16T19:38:11.708440+0000","last_peered":"2024-04-16T19:38:11.708440+0000","last_clean":"2024-04-16T19:38:11.708440+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:38:11.708440+0000","last_undegraded":"2024-04-16T19:38:11.708440+0000","last_fullsized":"2024-04-16T19:38:11.708440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'394","last_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_deep_scrub":"53'394","last_deep_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.708368+0000","objects_scrubbed":25,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.347792+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'23","reported_seq":338,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.749658+0000","last_change":"2024-04-16T19:38:27.749706+0000","last_active":"2024-04-16T19:38:27.749658+0000","last_peered":"2024-04-16T19:38:27.749658+0000","last_clean":"2024-04-16T19:38:27.749658+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:38:27.749658+0000","last_undegraded":"2024-04-16T19:38:27.749658+0000","last_fullsized":"2024-04-16T19:38:27.749658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.749597+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:41.717991+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402720+0000","last_change":"2024-04-16T17:45:10.396745+0000","last_active":"2024-04-16T19:37:44.402720+0000","last_peered":"2024-04-16T19:37:44.402720+0000","last_clean":"2024-04-16T19:37:44.402720+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:37:44.402720+0000","last_undegraded":"2024-04-16T19:37:44.402720+0000","last_fullsized":"2024-04-16T19:37:44.402720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.576386+0000","last_change":"2024-04-16T17:45:08.384480+0000","last_active":"2024-04-16T19:36:19.576386+0000","last_peered":"2024-04-16T19:36:19.576386+0000","last_clean":"2024-04-16T19:36:19.576386+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:36:19.576386+0000","last_undegraded":"2024-04-16T19:36:19.576386+0000","last_fullsized":"2024-04-16T19:36:19.576386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405292+0000","last_change":"2024-04-16T17:45:20.414382+0000","last_active":"2024-04-16T19:37:44.405292+0000","last_peered":"2024-04-16T19:37:44.405292+0000","last_clean":"2024-04-16T19:37:44.405292+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:37:44.405292+0000","last_undegraded":"2024-04-16T19:37:44.405292+0000","last_fullsized":"2024-04-16T19:37:44.405292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'88","reported_seq":254,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595941+0000","last_change":"2024-04-16T17:45:22.421515+0000","last_active":"2024-04-16T19:37:54.595941+0000","last_peered":"2024-04-16T19:37:54.595941+0000","last_clean":"2024-04-16T19:37:54.595941+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:37:54.595941+0000","last_undegraded":"2024-04-16T19:37:54.595941+0000","last_fullsized":"2024-04-16T19:37:54.595941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404007+0000","last_change":"2024-04-16T17:45:24.425946+0000","last_active":"2024-04-16T19:37:54.404007+0000","last_peered":"2024-04-16T19:37:54.404007+0000","last_clean":"2024-04-16T19:37:54.404007+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:37:54.404007+0000","last_undegraded":"2024-04-16T19:37:54.404007+0000","last_fullsized":"2024-04-16T19:37:54.404007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.717809+0000","last_change":"2024-04-16T19:38:24.717833+0000","last_active":"2024-04-16T19:38:24.717809+0000","last_peered":"2024-04-16T19:38:24.717809+0000","last_clean":"2024-04-16T19:38:24.717809+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:38:24.717809+0000","last_undegraded":"2024-04-16T19:38:24.717809+0000","last_fullsized":"2024-04-16T19:38:24.717809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.717739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:12.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340415+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:38:10.340415+0000","last_peered":"2024-04-16T19:38:10.340415+0000","last_clean":"2024-04-16T19:38:10.340415+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:38:10.340415+0000","last_undegraded":"2024-04-16T19:38:10.340415+0000","last_fullsized":"2024-04-16T19:38:10.340415+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'112","reported_seq":1324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.390120+0000","last_change":"2024-04-16T17:46:25.530104+0000","last_active":"2024-04-16T19:36:29.390120+0000","last_peered":"2024-04-16T19:36:29.390120+0000","last_clean":"2024-04-16T19:36:29.390120+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:36:29.390120+0000","last_undegraded":"2024-04-16T19:36:29.390120+0000","last_fullsized":"2024-04-16T19:36:29.390120+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.399769+0000","last_change":"2024-04-16T17:46:17.511681+0000","last_active":"2024-04-16T19:37:29.399769+0000","last_peered":"2024-04-16T19:37:29.399769+0000","last_clean":"2024-04-16T19:37:29.399769+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:37:29.399769+0000","last_undegraded":"2024-04-16T19:37:29.399769+0000","last_fullsized":"2024-04-16T19:37:29.399769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"48'9","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396277+0000","last_change":"2024-04-16T17:45:51.480247+0000","last_active":"2024-04-16T19:37:04.396277+0000","last_peered":"2024-04-16T19:37:04.396277+0000","last_clean":"2024-04-16T19:37:04.396277+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:37:04.396277+0000","last_undegraded":"2024-04-16T19:37:04.396277+0000","last_fullsized":"2024-04-16T19:37:04.396277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594637+0000","last_change":"2024-04-16T17:45:49.469762+0000","last_active":"2024-04-16T19:37:49.594637+0000","last_peered":"2024-04-16T19:37:49.594637+0000","last_clean":"2024-04-16T19:37:49.594637+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:37:49.594637+0000","last_undegraded":"2024-04-16T19:37:49.594637+0000","last_fullsized":"2024-04-16T19:37:49.594637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'232","reported_seq":419,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.530282+0000","last_change":"2024-04-16T19:38:19.530353+0000","last_active":"2024-04-16T19:38:19.530282+0000","last_peered":"2024-04-16T19:38:19.530282+0000","last_clean":"2024-04-16T19:38:19.530282+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:38:19.530282+0000","last_undegraded":"2024-04-16T19:38:19.530282+0000","last_fullsized":"2024-04-16T19:38:19.530282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'232","last_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_deep_scrub":"53'232","last_deep_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.530215+0000","objects_scrubbed":16,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:50:04.335733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14555,"num_omap_keys":67,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'24","reported_seq":473,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.394596+0000","last_change":"2024-04-16T17:47:16.558050+0000","last_active":"2024-04-16T19:36:59.394596+0000","last_peered":"2024-04-16T19:36:59.394596+0000","last_clean":"2024-04-16T19:36:59.394596+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:36:59.394596+0000","last_undegraded":"2024-04-16T19:36:59.394596+0000","last_fullsized":"2024-04-16T19:36:59.394596+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403553+0000","last_change":"2024-04-16T17:45:10.400195+0000","last_active":"2024-04-16T19:37:34.403553+0000","last_peered":"2024-04-16T19:37:34.403553+0000","last_clean":"2024-04-16T19:37:34.403553+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:37:34.403553+0000","last_undegraded":"2024-04-16T19:37:34.403553+0000","last_fullsized":"2024-04-16T19:37:34.403553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579382+0000","last_change":"2024-04-16T17:45:08.388718+0000","last_active":"2024-04-16T19:36:34.579382+0000","last_peered":"2024-04-16T19:36:34.579382+0000","last_clean":"2024-04-16T19:36:34.579382+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:36:34.579382+0000","last_undegraded":"2024-04-16T19:36:34.579382+0000","last_fullsized":"2024-04-16T19:36:34.579382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'2","reported_seq":563,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404099+0000","last_change":"2024-04-16T17:45:20.407653+0000","last_active":"2024-04-16T19:37:54.404099+0000","last_peered":"2024-04-16T19:37:54.404099+0000","last_clean":"2024-04-16T19:37:54.404099+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:37:54.404099+0000","last_undegraded":"2024-04-16T19:37:54.404099+0000","last_fullsized":"2024-04-16T19:37:54.404099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'152","reported_seq":345,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404018+0000","last_change":"2024-04-16T17:45:22.417131+0000","last_active":"2024-04-16T19:37:54.404018+0000","last_peered":"2024-04-16T19:37:54.404018+0000","last_clean":"2024-04-16T19:37:54.404018+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:37:54.404018+0000","last_undegraded":"2024-04-16T19:37:54.404018+0000","last_fullsized":"2024-04-16T19:37:54.404018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595926+0000","last_change":"2024-04-16T17:45:24.427273+0000","last_active":"2024-04-16T19:37:54.595926+0000","last_peered":"2024-04-16T19:37:54.595926+0000","last_clean":"2024-04-16T19:37:54.595926+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:37:54.595926+0000","last_undegraded":"2024-04-16T19:37:54.595926+0000","last_fullsized":"2024-04-16T19:37:54.595926+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.859523+0000","last_change":"2024-04-16T19:38:25.859545+0000","last_active":"2024-04-16T19:38:25.859523+0000","last_peered":"2024-04-16T19:38:25.859523+0000","last_clean":"2024-04-16T19:38:25.859523+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:38:25.859523+0000","last_undegraded":"2024-04-16T19:38:25.859523+0000","last_fullsized":"2024-04-16T19:38:25.859523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.859440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:49:45.247605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069936+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:38:08.069936+0000","last_peered":"2024-04-16T19:38:08.069936+0000","last_clean":"2024-04-16T19:38:08.069936+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:38:08.069936+0000","last_undegraded":"2024-04-16T19:38:08.069936+0000","last_fullsized":"2024-04-16T19:38:08.069936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'110","reported_seq":1958,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592872+0000","last_change":"2024-04-16T17:46:25.522673+0000","last_active":"2024-04-16T19:37:39.592872+0000","last_peered":"2024-04-16T19:37:39.592872+0000","last_clean":"2024-04-16T19:37:39.592872+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:37:39.592872+0000","last_undegraded":"2024-04-16T19:37:39.592872+0000","last_fullsized":"2024-04-16T19:37:39.592872+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":80,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:19.391395+0000","last_change":"2024-04-16T17:46:17.504674+0000","last_active":"2024-04-16T19:36:19.391395+0000","last_peered":"2024-04-16T19:36:19.391395+0000","last_clean":"2024-04-16T19:36:19.391395+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:36:19.391395+0000","last_undegraded":"2024-04-16T19:36:19.391395+0000","last_fullsized":"2024-04-16T19:36:19.391395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"48'3","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396222+0000","last_change":"2024-04-16T17:45:51.482374+0000","last_active":"2024-04-16T19:37:04.396222+0000","last_peered":"2024-04-16T19:37:04.396222+0000","last_clean":"2024-04-16T19:37:04.396222+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:37:04.396222+0000","last_undegraded":"2024-04-16T19:37:04.396222+0000","last_fullsized":"2024-04-16T19:37:04.396222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'20","reported_seq":1479,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.403288+0000","last_change":"2024-04-16T17:45:49.473331+0000","last_active":"2024-04-16T19:37:49.403288+0000","last_peered":"2024-04-16T19:37:49.403288+0000","last_clean":"2024-04-16T19:37:49.403288+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:37:49.403288+0000","last_undegraded":"2024-04-16T19:37:49.403288+0000","last_fullsized":"2024-04-16T19:37:49.403288+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'681","reported_seq":3330,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.829538+0000","last_change":"2024-04-16T19:38:10.829578+0000","last_active":"2024-04-16T19:38:10.829538+0000","last_peered":"2024-04-16T19:38:10.829538+0000","last_clean":"2024-04-16T19:38:10.829538+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:38:10.829538+0000","last_undegraded":"2024-04-16T19:38:10.829538+0000","last_fullsized":"2024-04-16T19:38:10.829538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'681","last_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_deep_scrub":"53'681","last_deep_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.829490+0000","objects_scrubbed":20,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:55.635008+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'12","reported_seq":518,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.553415+0000","last_change":"2024-04-16T19:38:21.553466+0000","last_active":"2024-04-16T19:38:21.553415+0000","last_peered":"2024-04-16T19:38:21.553415+0000","last_clean":"2024-04-16T19:38:21.553415+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:38:21.553415+0000","last_undegraded":"2024-04-16T19:38:21.553415+0000","last_fullsized":"2024-04-16T19:38:21.553415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.553349+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:55.897508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405254+0000","last_change":"2024-04-16T17:45:10.393491+0000","last_active":"2024-04-16T19:37:44.405254+0000","last_peered":"2024-04-16T19:37:44.405254+0000","last_clean":"2024-04-16T19:37:44.405254+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:37:44.405254+0000","last_undegraded":"2024-04-16T19:37:44.405254+0000","last_fullsized":"2024-04-16T19:37:44.405254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400637+0000","last_change":"2024-04-16T17:45:08.380598+0000","last_active":"2024-04-16T19:37:39.400637+0000","last_peered":"2024-04-16T19:37:39.400637+0000","last_clean":"2024-04-16T19:37:39.400637+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:37:39.400637+0000","last_undegraded":"2024-04-16T19:37:39.400637+0000","last_fullsized":"2024-04-16T19:37:39.400637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"48'2","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403108+0000","last_change":"2024-04-16T17:45:20.412352+0000","last_active":"2024-04-16T19:37:54.403108+0000","last_peered":"2024-04-16T19:37:54.403108+0000","last_clean":"2024-04-16T19:37:54.403108+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:37:54.403108+0000","last_undegraded":"2024-04-16T19:37:54.403108+0000","last_fullsized":"2024-04-16T19:37:54.403108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'104","reported_seq":282,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595912+0000","last_change":"2024-04-16T17:45:22.417121+0000","last_active":"2024-04-16T19:37:54.595912+0000","last_peered":"2024-04-16T19:37:54.595912+0000","last_clean":"2024-04-16T19:37:54.595912+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:37:54.595912+0000","last_undegraded":"2024-04-16T19:37:54.595912+0000","last_fullsized":"2024-04-16T19:37:54.595912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592829+0000","last_change":"2024-04-16T17:45:24.425363+0000","last_active":"2024-04-16T19:37:39.592829+0000","last_peered":"2024-04-16T19:37:39.592829+0000","last_clean":"2024-04-16T19:37:39.592829+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:37:39.592829+0000","last_undegraded":"2024-04-16T19:37:39.592829+0000","last_fullsized":"2024-04-16T19:37:39.592829+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.890917+0000","last_change":"2024-04-16T19:38:27.890939+0000","last_active":"2024-04-16T19:38:27.890917+0000","last_peered":"2024-04-16T19:38:27.890917+0000","last_clean":"2024-04-16T19:38:27.890917+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:38:27.890917+0000","last_undegraded":"2024-04-16T19:38:27.890917+0000","last_fullsized":"2024-04-16T19:38:27.890917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.890852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:30.404878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887604+0000","last_change":"2024-04-16T18:09:02.173368+0000","last_active":"2024-04-16T19:38:09.887604+0000","last_peered":"2024-04-16T19:38:09.887604+0000","last_clean":"2024-04-16T19:38:09.887604+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:38:09.887604+0000","last_undegraded":"2024-04-16T19:38:09.887604+0000","last_fullsized":"2024-04-16T19:38:09.887604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'146","reported_seq":1639,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592782+0000","last_change":"2024-04-16T17:46:25.529669+0000","last_active":"2024-04-16T19:37:39.592782+0000","last_peered":"2024-04-16T19:37:39.592782+0000","last_clean":"2024-04-16T19:37:39.592782+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:37:39.592782+0000","last_undegraded":"2024-04-16T19:37:39.592782+0000","last_fullsized":"2024-04-16T19:37:39.592782+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.550739+0000","last_change":"2024-04-16T19:38:26.550762+0000","last_active":"2024-04-16T19:38:26.550739+0000","last_peered":"2024-04-16T19:38:26.550739+0000","last_clean":"2024-04-16T19:38:26.550739+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:38:26.550739+0000","last_undegraded":"2024-04-16T19:38:26.550739+0000","last_fullsized":"2024-04-16T19:38:26.550739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.550671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:50.234890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340034+0000","last_change":"2024-04-16T17:45:51.480412+0000","last_active":"2024-04-16T19:38:10.340034+0000","last_peered":"2024-04-16T19:38:10.340034+0000","last_clean":"2024-04-16T19:38:10.340034+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:38:10.340034+0000","last_undegraded":"2024-04-16T19:38:10.340034+0000","last_fullsized":"2024-04-16T19:38:10.340034+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402642+0000","last_change":"2024-04-16T17:45:49.471149+0000","last_active":"2024-04-16T19:37:49.402642+0000","last_peered":"2024-04-16T19:37:49.402642+0000","last_clean":"2024-04-16T19:37:49.402642+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:37:49.402642+0000","last_undegraded":"2024-04-16T19:37:49.402642+0000","last_fullsized":"2024-04-16T19:37:49.402642+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'562","reported_seq":45436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.690811+0000","last_change":"2024-04-16T19:38:12.690864+0000","last_active":"2024-04-16T19:38:12.690811+0000","last_peered":"2024-04-16T19:38:12.690811+0000","last_clean":"2024-04-16T19:38:12.690811+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:38:12.690811+0000","last_undegraded":"2024-04-16T19:38:12.690811+0000","last_fullsized":"2024-04-16T19:38:12.690811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'562","last_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_deep_scrub":"53'562","last_deep_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.690747+0000","objects_scrubbed":19,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:33.979851+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7052,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'16","reported_seq":415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.851820+0000","last_change":"2024-04-16T19:38:09.851868+0000","last_active":"2024-04-16T19:38:09.851820+0000","last_peered":"2024-04-16T19:38:09.851820+0000","last_clean":"2024-04-16T19:38:09.851820+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:38:09.851820+0000","last_undegraded":"2024-04-16T19:38:09.851820+0000","last_fullsized":"2024-04-16T19:38:09.851820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.851761+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:33.535980+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593568+0000","last_change":"2024-04-16T17:45:10.395688+0000","last_active":"2024-04-16T19:37:44.593568+0000","last_peered":"2024-04-16T19:37:44.593568+0000","last_clean":"2024-04-16T19:37:44.593568+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:37:44.593568+0000","last_undegraded":"2024-04-16T19:37:44.593568+0000","last_fullsized":"2024-04-16T19:37:44.593568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404315+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:37:39.404315+0000","last_peered":"2024-04-16T19:37:39.404315+0000","last_clean":"2024-04-16T19:37:39.404315+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:37:39.404315+0000","last_undegraded":"2024-04-16T19:37:39.404315+0000","last_fullsized":"2024-04-16T19:37:39.404315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"48'2","reported_seq":501,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595909+0000","last_change":"2024-04-16T17:45:20.412567+0000","last_active":"2024-04-16T19:37:54.595909+0000","last_peered":"2024-04-16T19:37:54.595909+0000","last_clean":"2024-04-16T19:37:54.595909+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:37:54.595909+0000","last_undegraded":"2024-04-16T19:37:54.595909+0000","last_fullsized":"2024-04-16T19:37:54.595909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'120","reported_seq":303,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402679+0000","last_change":"2024-04-16T17:45:22.416448+0000","last_active":"2024-04-16T19:37:44.402679+0000","last_peered":"2024-04-16T19:37:44.402679+0000","last_clean":"2024-04-16T19:37:44.402679+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:37:44.402679+0000","last_undegraded":"2024-04-16T19:37:44.402679+0000","last_fullsized":"2024-04-16T19:37:44.402679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'12","reported_seq":1396,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403767+0000","last_change":"2024-04-16T17:45:24.426319+0000","last_active":"2024-04-16T19:37:54.403767+0000","last_peered":"2024-04-16T19:37:54.403767+0000","last_clean":"2024-04-16T19:37:54.403767+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:37:54.403767+0000","last_undegraded":"2024-04-16T19:37:54.403767+0000","last_fullsized":"2024-04-16T19:37:54.403767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.400379+0000","last_change":"2024-04-16T17:45:26.433965+0000","last_active":"2024-04-16T19:37:29.400379+0000","last_peered":"2024-04-16T19:37:29.400379+0000","last_clean":"2024-04-16T19:37:29.400379+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:37:29.400379+0000","last_undegraded":"2024-04-16T19:37:29.400379+0000","last_fullsized":"2024-04-16T19:37:29.400379+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596673+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:37:59.596673+0000","last_peered":"2024-04-16T19:37:59.596673+0000","last_clean":"2024-04-16T19:37:59.596673+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:37:59.596673+0000","last_undegraded":"2024-04-16T19:37:59.596673+0000","last_fullsized":"2024-04-16T19:37:59.596673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'89","reported_seq":1551,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887508+0000","last_change":"2024-04-16T17:46:25.522263+0000","last_active":"2024-04-16T19:38:09.887508+0000","last_peered":"2024-04-16T19:38:09.887508+0000","last_clean":"2024-04-16T19:38:09.887508+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:38:09.887508+0000","last_undegraded":"2024-04-16T19:38:09.887508+0000","last_fullsized":"2024-04-16T19:38:09.887508+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069775+0000","last_change":"2024-04-16T17:46:17.502070+0000","last_active":"2024-04-16T19:38:08.069775+0000","last_peered":"2024-04-16T19:38:08.069775+0000","last_clean":"2024-04-16T19:38:08.069775+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:38:08.069775+0000","last_undegraded":"2024-04-16T19:38:08.069775+0000","last_fullsized":"2024-04-16T19:38:08.069775+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'16","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595730+0000","last_change":"2024-04-16T17:45:51.481303+0000","last_active":"2024-04-16T19:37:54.595730+0000","last_peered":"2024-04-16T19:37:54.595730+0000","last_clean":"2024-04-16T19:37:54.595730+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:37:54.595730+0000","last_undegraded":"2024-04-16T19:37:54.595730+0000","last_fullsized":"2024-04-16T19:37:54.595730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'651","reported_seq":2562,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.406459+0000","last_change":"2024-04-16T17:45:49.469698+0000","last_active":"2024-04-16T19:38:09.406459+0000","last_peered":"2024-04-16T19:38:09.406459+0000","last_clean":"2024-04-16T19:38:09.406459+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:38:09.406459+0000","last_undegraded":"2024-04-16T19:38:09.406459+0000","last_fullsized":"2024-04-16T19:38:09.406459+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'539","reported_seq":987,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.232436+0000","last_change":"2024-04-16T19:38:16.232495+0000","last_active":"2024-04-16T19:38:16.232436+0000","last_peered":"2024-04-16T19:38:16.232436+0000","last_clean":"2024-04-16T19:38:16.232436+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:38:16.232436+0000","last_undegraded":"2024-04-16T19:38:16.232436+0000","last_fullsized":"2024-04-16T19:38:16.232436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'539","last_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_deep_scrub":"53'539","last_deep_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.232375+0000","objects_scrubbed":21,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:46.553060+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7262,"num_omap_keys":33,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'16","reported_seq":388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.567303+0000","last_change":"2024-04-16T19:38:23.567350+0000","last_active":"2024-04-16T19:38:23.567303+0000","last_peered":"2024-04-16T19:38:23.567303+0000","last_clean":"2024-04-16T19:38:23.567303+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:38:23.567303+0000","last_undegraded":"2024-04-16T19:38:23.567303+0000","last_fullsized":"2024-04-16T19:38:23.567303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.567241+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:36.119901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401607+0000","last_change":"2024-04-16T17:45:10.402149+0000","last_active":"2024-04-16T19:37:44.401607+0000","last_peered":"2024-04-16T19:37:44.401607+0000","last_clean":"2024-04-16T19:37:44.401607+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:37:44.401607+0000","last_undegraded":"2024-04-16T19:37:44.401607+0000","last_fullsized":"2024-04-16T19:37:44.401607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401089+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:37:39.401089+0000","last_peered":"2024-04-16T19:37:39.401089+0000","last_clean":"2024-04-16T19:37:39.401089+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:37:39.401089+0000","last_undegraded":"2024-04-16T19:37:39.401089+0000","last_fullsized":"2024-04-16T19:37:39.401089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403022+0000","last_change":"2024-04-16T17:45:20.409559+0000","last_active":"2024-04-16T19:37:54.403022+0000","last_peered":"2024-04-16T19:37:54.403022+0000","last_clean":"2024-04-16T19:37:54.403022+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:37:54.403022+0000","last_undegraded":"2024-04-16T19:37:54.403022+0000","last_fullsized":"2024-04-16T19:37:54.403022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'152","reported_seq":346,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394556+0000","last_change":"2024-04-16T17:45:22.415559+0000","last_active":"2024-04-16T19:36:54.394556+0000","last_peered":"2024-04-16T19:36:54.394556+0000","last_clean":"2024-04-16T19:36:54.394556+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:36:54.394556+0000","last_undegraded":"2024-04-16T19:36:54.394556+0000","last_fullsized":"2024-04-16T19:36:54.394556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.393792+0000","last_change":"2024-04-16T17:45:24.421195+0000","last_active":"2024-04-16T19:36:34.393792+0000","last_peered":"2024-04-16T19:36:34.393792+0000","last_clean":"2024-04-16T19:36:34.393792+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:36:34.393792+0000","last_undegraded":"2024-04-16T19:36:34.393792+0000","last_fullsized":"2024-04-16T19:36:34.393792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.392722+0000","last_change":"2024-04-16T17:45:26.432510+0000","last_active":"2024-04-16T19:36:39.392722+0000","last_peered":"2024-04-16T19:36:39.392722+0000","last_clean":"2024-04-16T19:36:39.392722+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:36:39.392722+0000","last_undegraded":"2024-04-16T19:36:39.392722+0000","last_fullsized":"2024-04-16T19:36:39.392722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593484+0000","last_change":"2024-04-16T18:09:02.169659+0000","last_active":"2024-04-16T19:37:44.593484+0000","last_peered":"2024-04-16T19:37:44.593484+0000","last_clean":"2024-04-16T19:37:44.593484+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:37:44.593484+0000","last_undegraded":"2024-04-16T19:37:44.593484+0000","last_fullsized":"2024-04-16T19:37:44.593484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'119","reported_seq":2032,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524730+0000","last_change":"2024-04-16T17:46:25.523284+0000","last_active":"2024-04-16T19:38:08.524730+0000","last_peered":"2024-04-16T19:38:08.524730+0000","last_clean":"2024-04-16T19:38:08.524730+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:38:08.524730+0000","last_undegraded":"2024-04-16T19:38:08.524730+0000","last_fullsized":"2024-04-16T19:38:08.524730+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340223+0000","last_change":"2024-04-16T17:46:17.506836+0000","last_active":"2024-04-16T19:38:10.340223+0000","last_peered":"2024-04-16T19:38:10.340223+0000","last_clean":"2024-04-16T19:38:10.340223+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:38:10.340223+0000","last_undegraded":"2024-04-16T19:38:10.340223+0000","last_fullsized":"2024-04-16T19:38:10.340223+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'2","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406956+0000","last_change":"2024-04-16T17:45:51.481129+0000","last_active":"2024-04-16T19:37:54.406956+0000","last_peered":"2024-04-16T19:37:54.406956+0000","last_clean":"2024-04-16T19:37:54.406956+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:37:54.406956+0000","last_undegraded":"2024-04-16T19:37:54.406956+0000","last_fullsized":"2024-04-16T19:37:54.406956+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.056607+0000","last_change":"2024-04-16T19:38:13.056637+0000","last_active":"2024-04-16T19:38:13.056607+0000","last_peered":"2024-04-16T19:38:13.056607+0000","last_clean":"2024-04-16T19:38:13.056607+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:38:13.056607+0000","last_undegraded":"2024-04-16T19:38:13.056607+0000","last_fullsized":"2024-04-16T19:38:13.056607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.056540+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:02.968001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'298","reported_seq":598,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.796439+0000","last_change":"2024-04-16T19:38:18.796507+0000","last_active":"2024-04-16T19:38:18.796439+0000","last_peered":"2024-04-16T19:38:18.796439+0000","last_clean":"2024-04-16T19:38:18.796439+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:38:18.796439+0000","last_undegraded":"2024-04-16T19:38:18.796439+0000","last_fullsized":"2024-04-16T19:38:18.796439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'298","last_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_deep_scrub":"53'298","last_deep_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.796372+0000","objects_scrubbed":17,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:20.964465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'22","reported_seq":391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.891208+0000","last_change":"2024-04-16T19:38:13.891278+0000","last_active":"2024-04-16T19:38:13.891208+0000","last_peered":"2024-04-16T19:38:13.891208+0000","last_clean":"2024-04-16T19:38:13.891208+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:38:13.891208+0000","last_undegraded":"2024-04-16T19:38:13.891208+0000","last_fullsized":"2024-04-16T19:38:13.891208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.891146+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:21.530454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401584+0000","last_change":"2024-04-16T17:45:10.392781+0000","last_active":"2024-04-16T19:37:44.401584+0000","last_peered":"2024-04-16T19:37:44.401584+0000","last_clean":"2024-04-16T19:37:44.401584+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:37:44.401584+0000","last_undegraded":"2024-04-16T19:37:44.401584+0000","last_fullsized":"2024-04-16T19:37:44.401584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401129+0000","last_change":"2024-04-16T17:45:08.386175+0000","last_active":"2024-04-16T19:37:39.401129+0000","last_peered":"2024-04-16T19:37:39.401129+0000","last_clean":"2024-04-16T19:37:39.401129+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:37:39.401129+0000","last_undegraded":"2024-04-16T19:37:39.401129+0000","last_fullsized":"2024-04-16T19:37:39.401129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"48'11","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403583+0000","last_change":"2024-04-16T17:45:20.407986+0000","last_active":"2024-04-16T19:37:54.403583+0000","last_peered":"2024-04-16T19:37:54.403583+0000","last_clean":"2024-04-16T19:37:54.403583+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:37:54.403583+0000","last_undegraded":"2024-04-16T19:37:54.403583+0000","last_fullsized":"2024-04-16T19:37:54.403583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.393825+0000","last_change":"2024-04-16T17:45:22.415078+0000","last_active":"2024-04-16T19:36:34.393825+0000","last_peered":"2024-04-16T19:36:34.393825+0000","last_clean":"2024-04-16T19:36:34.393825+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:36:34.393825+0000","last_undegraded":"2024-04-16T19:36:34.393825+0000","last_fullsized":"2024-04-16T19:36:34.393825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394921+0000","last_change":"2024-04-16T17:45:24.425398+0000","last_active":"2024-04-16T19:36:54.394921+0000","last_peered":"2024-04-16T19:36:54.394921+0000","last_clean":"2024-04-16T19:36:54.394921+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:36:54.394921+0000","last_undegraded":"2024-04-16T19:36:54.394921+0000","last_fullsized":"2024-04-16T19:36:54.394921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.722421+0000","last_change":"2024-04-16T19:38:23.722443+0000","last_active":"2024-04-16T19:38:23.722421+0000","last_peered":"2024-04-16T19:38:23.722421+0000","last_clean":"2024-04-16T19:38:23.722421+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:38:23.722421+0000","last_undegraded":"2024-04-16T19:38:23.722421+0000","last_fullsized":"2024-04-16T19:38:23.722421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.722357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:38.742703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405131+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:37:44.405131+0000","last_peered":"2024-04-16T19:37:44.405131+0000","last_clean":"2024-04-16T19:37:44.405131+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:37:44.405131+0000","last_undegraded":"2024-04-16T19:37:44.405131+0000","last_fullsized":"2024-04-16T19:37:44.405131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'120","reported_seq":1727,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977236+0000","last_change":"2024-04-16T17:46:25.526370+0000","last_active":"2024-04-16T19:38:08.977236+0000","last_peered":"2024-04-16T19:38:08.977236+0000","last_clean":"2024-04-16T19:38:08.977236+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:38:08.977236+0000","last_undegraded":"2024-04-16T19:38:08.977236+0000","last_fullsized":"2024-04-16T19:38:08.977236+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.719529+0000","last_change":"2024-04-16T19:38:28.719553+0000","last_active":"2024-04-16T19:38:28.719529+0000","last_peered":"2024-04-16T19:38:28.719529+0000","last_clean":"2024-04-16T19:38:28.719529+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:38:28.719529+0000","last_undegraded":"2024-04-16T19:38:28.719529+0000","last_fullsized":"2024-04-16T19:38:28.719529+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:05.470964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'19","reported_seq":155,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403498+0000","last_change":"2024-04-16T17:45:51.478621+0000","last_active":"2024-04-16T19:37:54.403498+0000","last_peered":"2024-04-16T19:37:54.403498+0000","last_clean":"2024-04-16T19:37:54.403498+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:37:54.403498+0000","last_undegraded":"2024-04-16T19:37:54.403498+0000","last_fullsized":"2024-04-16T19:37:54.403498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395543+0000","last_change":"2024-04-16T17:45:49.474101+0000","last_active":"2024-04-16T19:36:59.395543+0000","last_peered":"2024-04-16T19:36:59.395543+0000","last_clean":"2024-04-16T19:36:59.395543+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:36:59.395543+0000","last_undegraded":"2024-04-16T19:36:59.395543+0000","last_fullsized":"2024-04-16T19:36:59.395543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5056","reported_seq":7415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.911994+0000","last_change":"2024-04-16T19:38:24.912040+0000","last_active":"2024-04-16T19:38:24.911994+0000","last_peered":"2024-04-16T19:38:24.911994+0000","last_clean":"2024-04-16T19:38:24.911994+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:38:24.911994+0000","last_undegraded":"2024-04-16T19:38:24.911994+0000","last_fullsized":"2024-04-16T19:38:24.911994+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5056","last_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_deep_scrub":"53'5056","last_deep_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.911937+0000","objects_scrubbed":13,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:21.591600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'22","reported_seq":459,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.780629+0000","last_change":"2024-04-16T19:38:17.780675+0000","last_active":"2024-04-16T19:38:17.780629+0000","last_peered":"2024-04-16T19:38:17.780629+0000","last_clean":"2024-04-16T19:38:17.780629+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:38:17.780629+0000","last_undegraded":"2024-04-16T19:38:17.780629+0000","last_fullsized":"2024-04-16T19:38:17.780629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.780565+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:41.464784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395573+0000","last_change":"2024-04-16T17:45:10.397270+0000","last_active":"2024-04-16T19:36:44.395573+0000","last_peered":"2024-04-16T19:36:44.395573+0000","last_clean":"2024-04-16T19:36:44.395573+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:36:44.395573+0000","last_undegraded":"2024-04-16T19:36:44.395573+0000","last_fullsized":"2024-04-16T19:36:44.395573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589689+0000","last_change":"2024-04-16T17:45:08.385404+0000","last_active":"2024-04-16T19:37:24.589689+0000","last_peered":"2024-04-16T19:37:24.589689+0000","last_clean":"2024-04-16T19:37:24.589689+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:37:24.589689+0000","last_undegraded":"2024-04-16T19:37:24.589689+0000","last_fullsized":"2024-04-16T19:37:24.589689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'6","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.390899+0000","last_change":"2024-04-16T17:45:20.413621+0000","last_active":"2024-04-16T19:36:34.390899+0000","last_peered":"2024-04-16T19:36:34.390899+0000","last_clean":"2024-04-16T19:36:34.390899+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:36:34.390899+0000","last_undegraded":"2024-04-16T19:36:34.390899+0000","last_fullsized":"2024-04-16T19:36:34.390899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'32","reported_seq":165,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406982+0000","last_change":"2024-04-16T17:45:22.415077+0000","last_active":"2024-04-16T19:37:54.406982+0000","last_peered":"2024-04-16T19:37:54.406982+0000","last_clean":"2024-04-16T19:37:54.406982+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:37:54.406982+0000","last_undegraded":"2024-04-16T19:37:54.406982+0000","last_fullsized":"2024-04-16T19:37:54.406982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403967+0000","last_change":"2024-04-16T17:45:24.430903+0000","last_active":"2024-04-16T19:37:54.403967+0000","last_peered":"2024-04-16T19:37:54.403967+0000","last_clean":"2024-04-16T19:37:54.403967+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:37:54.403967+0000","last_undegraded":"2024-04-16T19:37:54.403967+0000","last_fullsized":"2024-04-16T19:37:54.403967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.875849+0000","last_change":"2024-04-16T19:38:26.875874+0000","last_active":"2024-04-16T19:38:26.875849+0000","last_peered":"2024-04-16T19:38:26.875849+0000","last_clean":"2024-04-16T19:38:26.875849+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:38:26.875849+0000","last_undegraded":"2024-04-16T19:38:26.875849+0000","last_fullsized":"2024-04-16T19:38:26.875849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.875781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:49.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593702+0000","last_change":"2024-04-16T18:09:02.166083+0000","last_active":"2024-04-16T19:37:44.593702+0000","last_peered":"2024-04-16T19:37:44.593702+0000","last_clean":"2024-04-16T19:37:44.593702+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:37:44.593702+0000","last_undegraded":"2024-04-16T19:37:44.593702+0000","last_fullsized":"2024-04-16T19:37:44.593702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'126","reported_seq":1718,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977245+0000","last_change":"2024-04-16T17:46:25.531755+0000","last_active":"2024-04-16T19:38:08.977245+0000","last_peered":"2024-04-16T19:38:08.977245+0000","last_clean":"2024-04-16T19:38:08.977245+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:38:08.977245+0000","last_undegraded":"2024-04-16T19:38:08.977245+0000","last_fullsized":"2024-04-16T19:38:08.977245+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":81,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524599+0000","last_change":"2024-04-16T17:46:17.505902+0000","last_active":"2024-04-16T19:38:08.524599+0000","last_peered":"2024-04-16T19:38:08.524599+0000","last_clean":"2024-04-16T19:38:08.524599+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:38:08.524599+0000","last_undegraded":"2024-04-16T19:38:08.524599+0000","last_fullsized":"2024-04-16T19:38:08.524599+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'10","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406910+0000","last_change":"2024-04-16T17:45:51.478912+0000","last_active":"2024-04-16T19:37:54.406910+0000","last_peered":"2024-04-16T19:37:54.406910+0000","last_clean":"2024-04-16T19:37:54.406910+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:37:54.406910+0000","last_undegraded":"2024-04-16T19:37:54.406910+0000","last_fullsized":"2024-04-16T19:37:54.406910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.750099+0000","last_change":"2024-04-16T19:38:26.750144+0000","last_active":"2024-04-16T19:38:26.750099+0000","last_peered":"2024-04-16T19:38:26.750099+0000","last_clean":"2024-04-16T19:38:26.750099+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:38:26.750099+0000","last_undegraded":"2024-04-16T19:38:26.750099+0000","last_fullsized":"2024-04-16T19:38:26.750099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.750020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:03.892413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'576","reported_seq":1558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.901548+0000","last_change":"2024-04-16T19:38:28.901634+0000","last_active":"2024-04-16T19:38:28.901548+0000","last_peered":"2024-04-16T19:38:28.901548+0000","last_clean":"2024-04-16T19:38:28.901548+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:38:28.901548+0000","last_undegraded":"2024-04-16T19:38:28.901548+0000","last_fullsized":"2024-04-16T19:38:28.901548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'576","last_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_deep_scrub":"53'576","last_deep_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.901479+0000","objects_scrubbed":22,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:47.579102+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'6","reported_seq":518,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.394659+0000","last_change":"2024-04-16T17:45:45.454923+0000","last_active":"2024-04-16T19:36:59.394659+0000","last_peered":"2024-04-16T19:36:59.394659+0000","last_clean":"2024-04-16T19:36:59.394659+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:36:59.394659+0000","last_undegraded":"2024-04-16T19:36:59.394659+0000","last_fullsized":"2024-04-16T19:36:59.394659+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.390075+0000","last_change":"2024-04-16T17:45:10.400150+0000","last_active":"2024-04-16T19:36:24.390075+0000","last_peered":"2024-04-16T19:36:24.390075+0000","last_clean":"2024-04-16T19:36:24.390075+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:36:24.390075+0000","last_undegraded":"2024-04-16T19:36:24.390075+0000","last_fullsized":"2024-04-16T19:36:24.390075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404415+0000","last_change":"2024-04-16T17:45:08.386622+0000","last_active":"2024-04-16T19:37:39.404415+0000","last_peered":"2024-04-16T19:37:39.404415+0000","last_clean":"2024-04-16T19:37:39.404415+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:37:39.404415+0000","last_undegraded":"2024-04-16T19:37:39.404415+0000","last_fullsized":"2024-04-16T19:37:39.404415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582442+0000","last_change":"2024-04-16T17:45:20.412420+0000","last_active":"2024-04-16T19:36:49.582442+0000","last_peered":"2024-04-16T19:36:49.582442+0000","last_clean":"2024-04-16T19:36:49.582442+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:36:49.582442+0000","last_undegraded":"2024-04-16T19:36:49.582442+0000","last_fullsized":"2024-04-16T19:36:49.582442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403038+0000","last_change":"2024-04-16T17:45:22.421586+0000","last_active":"2024-04-16T19:37:54.403038+0000","last_peered":"2024-04-16T19:37:54.403038+0000","last_clean":"2024-04-16T19:37:54.403038+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:37:54.403038+0000","last_undegraded":"2024-04-16T19:37:54.403038+0000","last_fullsized":"2024-04-16T19:37:54.403038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407022+0000","last_change":"2024-04-16T17:45:24.424290+0000","last_active":"2024-04-16T19:37:54.407022+0000","last_peered":"2024-04-16T19:37:54.407022+0000","last_clean":"2024-04-16T19:37:54.407022+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:37:54.407022+0000","last_undegraded":"2024-04-16T19:37:54.407022+0000","last_fullsized":"2024-04-16T19:37:54.407022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402338+0000","last_change":"2024-04-16T17:45:26.433279+0000","last_active":"2024-04-16T19:37:49.402338+0000","last_peered":"2024-04-16T19:37:49.402338+0000","last_clean":"2024-04-16T19:37:49.402338+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:37:49.402338+0000","last_undegraded":"2024-04-16T19:37:49.402338+0000","last_fullsized":"2024-04-16T19:37:49.402338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:25.414559+0000","last_clean_scrub_stamp":"2024-04-16T17:45:25.414559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'5","reported_seq":192,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976833+0000","last_change":"2024-04-16T17:45:45.455663+0000","last_active":"2024-04-16T19:38:08.976833+0000","last_peered":"2024-04-16T19:38:08.976833+0000","last_clean":"2024-04-16T19:38:08.976833+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:38:08.976833+0000","last_undegraded":"2024-04-16T19:38:08.976833+0000","last_fullsized":"2024-04-16T19:38:08.976833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.073023+0000","last_change":"2024-04-16T19:38:23.073046+0000","last_active":"2024-04-16T19:38:23.073023+0000","last_peered":"2024-04-16T19:38:23.073023+0000","last_clean":"2024-04-16T19:38:23.073023+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:38:23.073023+0000","last_undegraded":"2024-04-16T19:38:23.073023+0000","last_fullsized":"2024-04-16T19:38:23.073023+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.072960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:19.149593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400582+0000","last_change":"2024-04-16T17:45:08.383072+0000","last_active":"2024-04-16T19:37:39.400582+0000","last_peered":"2024-04-16T19:37:39.400582+0000","last_clean":"2024-04-16T19:37:39.400582+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:37:39.400582+0000","last_undegraded":"2024-04-16T19:37:39.400582+0000","last_fullsized":"2024-04-16T19:37:39.400582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'21","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.709521+0000","last_change":"2024-04-16T19:38:13.709521+0000","last_active":"2024-04-16T19:38:13.709521+0000","last_peered":"2024-04-16T19:38:13.709521+0000","last_clean":"2024-04-16T19:38:13.709521+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:38:13.709521+0000","last_undegraded":"2024-04-16T19:38:13.709521+0000","last_fullsized":"2024-04-16T19:38:13.709521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.709408+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:26.428610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595980+0000","last_change":"2024-04-16T17:45:10.396086+0000","last_active":"2024-04-16T19:37:54.595980+0000","last_peered":"2024-04-16T19:37:54.595980+0000","last_clean":"2024-04-16T19:37:54.595980+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:37:54.595980+0000","last_undegraded":"2024-04-16T19:37:54.595980+0000","last_fullsized":"2024-04-16T19:37:54.595980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592600+0000","last_change":"2024-04-16T17:45:08.390555+0000","last_active":"2024-04-16T19:37:39.592600+0000","last_peered":"2024-04-16T19:37:39.592600+0000","last_clean":"2024-04-16T19:37:39.592600+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:37:39.592600+0000","last_undegraded":"2024-04-16T19:37:39.592600+0000","last_fullsized":"2024-04-16T19:37:39.592600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'26","reported_seq":486,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.777013+0000","last_change":"2024-04-16T19:38:15.777083+0000","last_active":"2024-04-16T19:38:15.777013+0000","last_peered":"2024-04-16T19:38:15.777013+0000","last_clean":"2024-04-16T19:38:15.777013+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:38:15.777013+0000","last_undegraded":"2024-04-16T19:38:15.777013+0000","last_fullsized":"2024-04-16T19:38:15.777013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.776944+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:01.810616+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403654+0000","last_change":"2024-04-16T17:45:10.400426+0000","last_active":"2024-04-16T19:37:54.403654+0000","last_peered":"2024-04-16T19:37:54.403654+0000","last_clean":"2024-04-16T19:37:54.403654+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:37:54.403654+0000","last_undegraded":"2024-04-16T19:37:54.403654+0000","last_fullsized":"2024-04-16T19:37:54.403654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.581469+0000","last_change":"2024-04-16T17:46:16.499950+0000","last_active":"2024-04-16T19:36:44.581469+0000","last_peered":"2024-04-16T19:36:44.581469+0000","last_clean":"2024-04-16T19:36:44.581469+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:36:44.581469+0000","last_undegraded":"2024-04-16T19:36:44.581469+0000","last_fullsized":"2024-04-16T19:36:44.581469+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'16","reported_seq":318,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.567956+0000","last_change":"2024-04-16T19:38:27.568053+0000","last_active":"2024-04-16T19:38:27.567956+0000","last_peered":"2024-04-16T19:38:27.567956+0000","last_clean":"2024-04-16T19:38:27.567956+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:38:27.567956+0000","last_undegraded":"2024-04-16T19:38:27.567956+0000","last_fullsized":"2024-04-16T19:38:27.567956+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.567879+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:46.513343+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595799+0000","last_change":"2024-04-16T17:45:10.394142+0000","last_active":"2024-04-16T19:37:54.595799+0000","last_peered":"2024-04-16T19:37:54.595799+0000","last_clean":"2024-04-16T19:37:54.595799+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:37:54.595799+0000","last_undegraded":"2024-04-16T19:37:54.595799+0000","last_fullsized":"2024-04-16T19:37:54.595799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407703+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:37:59.407703+0000","last_peered":"2024-04-16T19:37:59.407703+0000","last_clean":"2024-04-16T19:37:59.407703+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:37:59.407703+0000","last_undegraded":"2024-04-16T19:37:59.407703+0000","last_fullsized":"2024-04-16T19:37:59.407703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'12","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.763410+0000","last_change":"2024-04-16T19:38:21.763470+0000","last_active":"2024-04-16T19:38:21.763410+0000","last_peered":"2024-04-16T19:38:21.763410+0000","last_clean":"2024-04-16T19:38:21.763410+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:38:21.763410+0000","last_undegraded":"2024-04-16T19:38:21.763410+0000","last_fullsized":"2024-04-16T19:38:21.763410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.763344+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:36.589324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596769+0000","last_change":"2024-04-16T17:45:10.394131+0000","last_active":"2024-04-16T19:37:59.596769+0000","last_peered":"2024-04-16T19:37:59.596769+0000","last_clean":"2024-04-16T19:37:59.596769+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:37:59.596769+0000","last_undegraded":"2024-04-16T19:37:59.596769+0000","last_fullsized":"2024-04-16T19:37:59.596769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406132+0000","last_change":"2024-04-16T17:45:08.390961+0000","last_active":"2024-04-16T19:37:49.406132+0000","last_peered":"2024-04-16T19:37:49.406132+0000","last_clean":"2024-04-16T19:37:49.406132+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:37:49.406132+0000","last_undegraded":"2024-04-16T19:37:49.406132+0000","last_fullsized":"2024-04-16T19:37:49.406132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'60","reported_seq":651,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.053558+0000","last_change":"2024-04-16T19:38:16.053634+0000","last_active":"2024-04-16T19:38:16.053558+0000","last_peered":"2024-04-16T19:38:16.053558+0000","last_clean":"2024-04-16T19:38:16.053558+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:38:16.053558+0000","last_undegraded":"2024-04-16T19:38:16.053558+0000","last_fullsized":"2024-04-16T19:38:16.053558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'60","last_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_deep_scrub":"53'60","last_deep_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.053490+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:25:34.189324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401559+0000","last_change":"2024-04-16T17:45:10.394908+0000","last_active":"2024-04-16T19:37:44.401559+0000","last_peered":"2024-04-16T19:37:44.401559+0000","last_clean":"2024-04-16T19:37:44.401559+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:37:44.401559+0000","last_undegraded":"2024-04-16T19:37:44.401559+0000","last_fullsized":"2024-04-16T19:37:44.401559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594801+0000","last_change":"2024-04-16T17:45:08.382445+0000","last_active":"2024-04-16T19:37:49.594801+0000","last_peered":"2024-04-16T19:37:49.594801+0000","last_clean":"2024-04-16T19:37:49.594801+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:37:49.594801+0000","last_undegraded":"2024-04-16T19:37:49.594801+0000","last_fullsized":"2024-04-16T19:37:49.594801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'12","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.823687+0000","last_change":"2024-04-16T19:38:16.823687+0000","last_active":"2024-04-16T19:38:16.823687+0000","last_peered":"2024-04-16T19:38:16.823687+0000","last_clean":"2024-04-16T19:38:16.823687+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:38:16.823687+0000","last_undegraded":"2024-04-16T19:38:16.823687+0000","last_fullsized":"2024-04-16T19:38:16.823687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.823588+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:26.463012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593593+0000","last_change":"2024-04-16T17:45:10.398439+0000","last_active":"2024-04-16T19:37:44.593593+0000","last_peered":"2024-04-16T19:37:44.593593+0000","last_clean":"2024-04-16T19:37:44.593593+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:37:44.593593+0000","last_undegraded":"2024-04-16T19:37:44.593593+0000","last_fullsized":"2024-04-16T19:37:44.593593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.403371+0000","last_change":"2024-04-16T17:45:08.388353+0000","last_active":"2024-04-16T19:37:49.403371+0000","last_peered":"2024-04-16T19:37:49.403371+0000","last_clean":"2024-04-16T19:37:49.403371+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:37:49.403371+0000","last_undegraded":"2024-04-16T19:37:49.403371+0000","last_fullsized":"2024-04-16T19:37:49.403371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'22","reported_seq":549,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.076616+0000","last_change":"2024-04-16T19:38:20.076687+0000","last_active":"2024-04-16T19:38:20.076616+0000","last_peered":"2024-04-16T19:38:20.076616+0000","last_clean":"2024-04-16T19:38:20.076616+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:38:20.076616+0000","last_undegraded":"2024-04-16T19:38:20.076616+0000","last_fullsized":"2024-04-16T19:38:20.076616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.076549+0000","objects_scrubbed":11,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:18.065057+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402514+0000","last_change":"2024-04-16T17:45:10.393085+0000","last_active":"2024-04-16T19:37:44.402514+0000","last_peered":"2024-04-16T19:37:44.402514+0000","last_clean":"2024-04-16T19:37:44.402514+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:37:44.402514+0000","last_undegraded":"2024-04-16T19:37:44.402514+0000","last_fullsized":"2024-04-16T19:37:44.402514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594821+0000","last_change":"2024-04-16T17:45:08.387778+0000","last_active":"2024-04-16T19:37:49.594821+0000","last_peered":"2024-04-16T19:37:49.594821+0000","last_clean":"2024-04-16T19:37:49.594821+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:37:49.594821+0000","last_undegraded":"2024-04-16T19:37:49.594821+0000","last_fullsized":"2024-04-16T19:37:49.594821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'12","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.964569+0000","last_change":"2024-04-16T19:38:19.964623+0000","last_active":"2024-04-16T19:38:19.964569+0000","last_peered":"2024-04-16T19:38:19.964569+0000","last_clean":"2024-04-16T19:38:19.964569+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:38:19.964569+0000","last_undegraded":"2024-04-16T19:38:19.964569+0000","last_fullsized":"2024-04-16T19:38:19.964569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.964501+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:39:19.709359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.400360+0000","last_change":"2024-04-16T17:45:10.397793+0000","last_active":"2024-04-16T19:37:14.400360+0000","last_peered":"2024-04-16T19:37:14.400360+0000","last_clean":"2024-04-16T19:37:14.400360+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:37:14.400360+0000","last_undegraded":"2024-04-16T19:37:14.400360+0000","last_fullsized":"2024-04-16T19:37:14.400360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.405930+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:38:09.405930+0000","last_peered":"2024-04-16T19:38:09.405930+0000","last_clean":"2024-04-16T19:38:09.405930+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:38:09.405930+0000","last_undegraded":"2024-04-16T19:38:09.405930+0000","last_fullsized":"2024-04-16T19:38:09.405930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'6","reported_seq":366,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.578461+0000","last_change":"2024-04-16T17:45:45.454358+0000","last_active":"2024-04-16T19:36:29.578461+0000","last_peered":"2024-04-16T19:36:29.578461+0000","last_clean":"2024-04-16T19:36:29.578461+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:36:29.578461+0000","last_undegraded":"2024-04-16T19:36:29.578461+0000","last_fullsized":"2024-04-16T19:36:29.578461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396785+0000","last_change":"2024-04-16T17:45:10.390881+0000","last_active":"2024-04-16T19:37:14.396785+0000","last_peered":"2024-04-16T19:37:14.396785+0000","last_clean":"2024-04-16T19:37:14.396785+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:37:14.396785+0000","last_undegraded":"2024-04-16T19:37:14.396785+0000","last_fullsized":"2024-04-16T19:37:14.396785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404236+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:37:39.404236+0000","last_peered":"2024-04-16T19:37:39.404236+0000","last_clean":"2024-04-16T19:37:39.404236+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:37:39.404236+0000","last_undegraded":"2024-04-16T19:37:39.404236+0000","last_fullsized":"2024-04-16T19:37:39.404236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'20","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.253495+0000","last_change":"2024-04-16T19:38:09.253495+0000","last_active":"2024-04-16T19:38:09.253495+0000","last_peered":"2024-04-16T19:38:09.253495+0000","last_clean":"2024-04-16T19:38:09.253495+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:38:09.253495+0000","last_undegraded":"2024-04-16T19:38:09.253495+0000","last_fullsized":"2024-04-16T19:38:09.253495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.253410+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:49.003227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596830+0000","last_change":"2024-04-16T17:45:10.393700+0000","last_active":"2024-04-16T19:37:59.596830+0000","last_peered":"2024-04-16T19:37:59.596830+0000","last_clean":"2024-04-16T19:37:59.596830+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:37:59.596830+0000","last_undegraded":"2024-04-16T19:37:59.596830+0000","last_fullsized":"2024-04-16T19:37:59.596830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401022+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:37:39.401022+0000","last_peered":"2024-04-16T19:37:39.401022+0000","last_clean":"2024-04-16T19:37:39.401022+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:37:39.401022+0000","last_undegraded":"2024-04-16T19:37:39.401022+0000","last_fullsized":"2024-04-16T19:37:39.401022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'14","reported_seq":683,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976712+0000","last_change":"2024-04-16T17:45:45.455567+0000","last_active":"2024-04-16T19:38:08.976712+0000","last_peered":"2024-04-16T19:38:08.976712+0000","last_clean":"2024-04-16T19:38:08.976712+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:38:08.976712+0000","last_undegraded":"2024-04-16T19:38:08.976712+0000","last_fullsized":"2024-04-16T19:38:08.976712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402625+0000","last_change":"2024-04-16T17:45:10.390598+0000","last_active":"2024-04-16T19:37:44.402625+0000","last_peered":"2024-04-16T19:37:44.402625+0000","last_clean":"2024-04-16T19:37:44.402625+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:37:44.402625+0000","last_undegraded":"2024-04-16T19:37:44.402625+0000","last_fullsized":"2024-04-16T19:37:44.402625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404301+0000","last_change":"2024-04-16T17:45:08.389493+0000","last_active":"2024-04-16T19:37:39.404301+0000","last_peered":"2024-04-16T19:37:39.404301+0000","last_clean":"2024-04-16T19:37:39.404301+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:37:39.404301+0000","last_undegraded":"2024-04-16T19:37:39.404301+0000","last_fullsized":"2024-04-16T19:37:39.404301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'22","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.813299+0000","last_change":"2024-04-16T19:38:17.813299+0000","last_active":"2024-04-16T19:38:17.813299+0000","last_peered":"2024-04-16T19:38:17.813299+0000","last_clean":"2024-04-16T19:38:17.813299+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:38:17.813299+0000","last_undegraded":"2024-04-16T19:38:17.813299+0000","last_fullsized":"2024-04-16T19:38:17.813299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.813183+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:32.833529+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401617+0000","last_change":"2024-04-16T17:45:10.397665+0000","last_active":"2024-04-16T19:37:44.401617+0000","last_peered":"2024-04-16T19:37:44.401617+0000","last_clean":"2024-04-16T19:37:44.401617+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:37:44.401617+0000","last_undegraded":"2024-04-16T19:37:44.401617+0000","last_fullsized":"2024-04-16T19:37:44.401617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401915+0000","last_change":"2024-04-16T17:45:08.386399+0000","last_active":"2024-04-16T19:37:39.401915+0000","last_peered":"2024-04-16T19:37:39.401915+0000","last_clean":"2024-04-16T19:37:39.401915+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:37:39.401915+0000","last_undegraded":"2024-04-16T19:37:39.401915+0000","last_fullsized":"2024-04-16T19:37:39.401915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'3","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976831+0000","last_change":"2024-04-16T17:45:45.455538+0000","last_active":"2024-04-16T19:38:08.976831+0000","last_peered":"2024-04-16T19:38:08.976831+0000","last_clean":"2024-04-16T19:38:08.976831+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:38:08.976831+0000","last_undegraded":"2024-04-16T19:38:08.976831+0000","last_fullsized":"2024-04-16T19:38:08.976831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405149+0000","last_change":"2024-04-16T17:45:10.393634+0000","last_active":"2024-04-16T19:37:44.405149+0000","last_peered":"2024-04-16T19:37:44.405149+0000","last_clean":"2024-04-16T19:37:44.405149+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:37:44.405149+0000","last_undegraded":"2024-04-16T19:37:44.405149+0000","last_fullsized":"2024-04-16T19:37:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404832+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:37:59.404832+0000","last_peered":"2024-04-16T19:37:59.404832+0000","last_clean":"2024-04-16T19:37:59.404832+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:37:59.404832+0000","last_undegraded":"2024-04-16T19:37:59.404832+0000","last_fullsized":"2024-04-16T19:37:59.404832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'9","reported_seq":450,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976821+0000","last_change":"2024-04-16T17:45:45.454411+0000","last_active":"2024-04-16T19:38:08.976821+0000","last_peered":"2024-04-16T19:38:08.976821+0000","last_clean":"2024-04-16T19:38:08.976821+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:38:08.976821+0000","last_undegraded":"2024-04-16T19:38:08.976821+0000","last_fullsized":"2024-04-16T19:38:08.976821+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593626+0000","last_change":"2024-04-16T17:45:10.399193+0000","last_active":"2024-04-16T19:37:44.593626+0000","last_peered":"2024-04-16T19:37:44.593626+0000","last_clean":"2024-04-16T19:37:44.593626+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:37:44.593626+0000","last_undegraded":"2024-04-16T19:37:44.593626+0000","last_fullsized":"2024-04-16T19:37:44.593626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586630+0000","last_change":"2024-04-16T17:45:08.388974+0000","last_active":"2024-04-16T19:37:09.586630+0000","last_peered":"2024-04-16T19:37:09.586630+0000","last_clean":"2024-04-16T19:37:09.586630+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:37:09.586630+0000","last_undegraded":"2024-04-16T19:37:09.586630+0000","last_fullsized":"2024-04-16T19:37:09.586630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'6","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.208756+0000","last_change":"2024-04-16T19:38:10.208756+0000","last_active":"2024-04-16T19:38:10.208756+0000","last_peered":"2024-04-16T19:38:10.208756+0000","last_clean":"2024-04-16T19:38:10.208756+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:38:10.208756+0000","last_undegraded":"2024-04-16T19:38:10.208756+0000","last_fullsized":"2024-04-16T19:38:10.208756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.208682+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:12.742047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428704+0000","last_change":"2024-04-16T17:45:10.392230+0000","last_active":"2024-04-16T19:38:09.428704+0000","last_peered":"2024-04-16T19:38:09.428704+0000","last_clean":"2024-04-16T19:38:09.428704+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:38:09.428704+0000","last_undegraded":"2024-04-16T19:38:09.428704+0000","last_fullsized":"2024-04-16T19:38:09.428704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.396977+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:37:09.396977+0000","last_peered":"2024-04-16T19:37:09.396977+0000","last_clean":"2024-04-16T19:37:09.396977+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:37:09.396977+0000","last_undegraded":"2024-04-16T19:37:09.396977+0000","last_fullsized":"2024-04-16T19:37:09.396977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'14","reported_seq":334,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.249652+0000","last_change":"2024-04-16T19:38:08.249652+0000","last_active":"2024-04-16T19:38:08.249652+0000","last_peered":"2024-04-16T19:38:08.249652+0000","last_clean":"2024-04-16T19:38:08.249652+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:38:08.249652+0000","last_undegraded":"2024-04-16T19:38:08.249652+0000","last_fullsized":"2024-04-16T19:38:08.249652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.249524+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:54.283196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397305+0000","last_change":"2024-04-16T17:45:08.386818+0000","last_active":"2024-04-16T19:37:09.397305+0000","last_peered":"2024-04-16T19:37:09.397305+0000","last_clean":"2024-04-16T19:37:09.397305+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:37:09.397305+0000","last_undegraded":"2024-04-16T19:37:09.397305+0000","last_fullsized":"2024-04-16T19:37:09.397305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395757+0000","last_change":"2024-04-16T17:45:10.391395+0000","last_active":"2024-04-16T19:36:44.395757+0000","last_peered":"2024-04-16T19:36:44.395757+0000","last_clean":"2024-04-16T19:36:44.395757+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:36:44.395757+0000","last_undegraded":"2024-04-16T19:36:44.395757+0000","last_fullsized":"2024-04-16T19:36:44.395757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'40","reported_seq":775,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.113737+0000","last_change":"2024-04-16T19:38:19.113737+0000","last_active":"2024-04-16T19:38:19.113737+0000","last_peered":"2024-04-16T19:38:19.113737+0000","last_clean":"2024-04-16T19:38:19.113737+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:38:19.113737+0000","last_undegraded":"2024-04-16T19:38:19.113737+0000","last_fullsized":"2024-04-16T19:38:19.113737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'40","last_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_deep_scrub":"53'40","last_deep_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.113599+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:04:11.281022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586482+0000","last_change":"2024-04-16T17:45:08.389341+0000","last_active":"2024-04-16T19:37:09.586482+0000","last_peered":"2024-04-16T19:37:09.586482+0000","last_clean":"2024-04-16T19:37:09.586482+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:37:09.586482+0000","last_undegraded":"2024-04-16T19:37:09.586482+0000","last_fullsized":"2024-04-16T19:37:09.586482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:24.390128+0000","last_change":"2024-04-16T17:45:10.395147+0000","last_active":"2024-04-16T19:36:24.390128+0000","last_peered":"2024-04-16T19:36:24.390128+0000","last_clean":"2024-04-16T19:36:24.390128+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:36:24.390128+0000","last_undegraded":"2024-04-16T19:36:24.390128+0000","last_fullsized":"2024-04-16T19:36:24.390128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4205,"ondisk_log_size":4205,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3706,"ondisk_log_size":3706,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1130,"ondisk_log_size":1130,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":365336,"num_omap_keys":1682,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21506,"ondisk_log_size":21506,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5232,"ondisk_log_size":5232,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":488,"ondisk_log_size":488,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641629,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46644,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810956,"statfs":{"total":107374182400,"available":107326418944,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641628,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":63144,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":104794456,"statfs":{"total":107374182400,"available":107309522944,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641629,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":87628,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":104769972,"statfs":{"total":107374182400,"available":107284451328,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641629,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50956,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806644,"statfs":{"total":107374182400,"available":107322003456,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641628,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50932,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806668,"statfs":{"total":107374182400,"available":107322028032,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641629,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55680,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104801920,"statfs":{"total":107374182400,"available":107317166080,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:38:31.253 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.253 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.253 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.254 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.254 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.254 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.254 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.254 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.255 INFO:tasks.ceph:pgid 9.31 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.255 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.255 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.255 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.255 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.256 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.256 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.256 INFO:tasks.ceph:pgid 9.32 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.256 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.256 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.257 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.257 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.257 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.257 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.257 INFO:tasks.ceph:pgid 9.3f last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.257 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.258 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.258 INFO:tasks.ceph:pgid 9.3e last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.258 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.258 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.258 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.259 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.259 INFO:tasks.ceph:pgid 9.38 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.259 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.259 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.259 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.260 INFO:tasks.ceph:pgid 13.1d last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.260 INFO:tasks.ceph:pgid 12.1c last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.260 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.260 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.260 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.260 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.261 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.261 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.261 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.261 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.261 INFO:tasks.ceph:pgid 13.1c last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.262 INFO:tasks.ceph:pgid 12.1d last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.262 INFO:tasks.ceph:pgid 11.1a last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.262 INFO:tasks.ceph:pgid 9.18 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.262 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.262 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.263 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.263 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.263 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.263 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.263 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.264 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.264 INFO:tasks.ceph:pgid 12.1e last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.264 INFO:tasks.ceph:pgid 11.19 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.264 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.264 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.265 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.265 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.265 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.265 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.265 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.266 INFO:tasks.ceph:pgid 13.1e last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.266 INFO:tasks.ceph:pgid 12.1f last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.266 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.266 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.266 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.267 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.267 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.267 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.267 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.267 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.268 INFO:tasks.ceph:pgid 13.1 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.268 INFO:tasks.ceph:pgid 12.0 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.268 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.268 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.268 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.269 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.269 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.269 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.269 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.269 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.269 INFO:tasks.ceph:pgid 13.0 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.270 INFO:tasks.ceph:pgid 12.1 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.270 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.270 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.270 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.270 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.271 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.271 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.271 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.271 INFO:tasks.ceph:pgid 14.0 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.271 INFO:tasks.ceph:pgid 13.3 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.272 INFO:tasks.ceph:pgid 12.2 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.272 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.272 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.272 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.272 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.273 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.273 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.273 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.273 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.273 INFO:tasks.ceph:pgid 13.2 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.274 INFO:tasks.ceph:pgid 12.3 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.274 INFO:tasks.ceph:pgid 11.4 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.274 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.274 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.274 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.275 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.275 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.275 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.275 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.275 INFO:tasks.ceph:pgid 12.4 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.276 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.276 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.276 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.276 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.276 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.276 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.277 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.277 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.277 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.277 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.277 INFO:tasks.ceph:pgid 12.5 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.278 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.278 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.278 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.278 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.278 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.279 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.279 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.279 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.279 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.279 INFO:tasks.ceph:pgid 12.6 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.279 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.280 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.280 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.280 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.280 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.280 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.281 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.281 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.281 INFO:tasks.ceph:pgid 13.6 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.281 INFO:tasks.ceph:pgid 12.7 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.281 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.282 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.282 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.282 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.282 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.282 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.283 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.283 INFO:tasks.ceph:pgid 13.c last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.283 INFO:tasks.ceph:pgid 12.d last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.283 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.283 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T17:44:20.155639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=20, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.284 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.284 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.284 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.284 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.284 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.284 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.285 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.285 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.285 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.285 INFO:tasks.ceph:pgid 12.e last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.285 INFO:tasks.ceph:pgid 11.9 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.286 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.286 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.286 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.286 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.287 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.287 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.287 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.287 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.287 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.288 INFO:tasks.ceph:pgid 12.f last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.288 INFO:tasks.ceph:pgid 11.8 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.288 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.288 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.288 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.288 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.289 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.289 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.289 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.289 INFO:tasks.ceph:pgid 14.e last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.289 INFO:tasks.ceph:pgid 13.d last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.290 INFO:tasks.ceph:pgid 12.c last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.290 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.290 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.290 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.290 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.291 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.291 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.291 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.291 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.291 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.292 INFO:tasks.ceph:pgid 13.b last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.292 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.292 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.292 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.292 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.293 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.293 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.293 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.293 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.293 INFO:tasks.ceph:pgid 12.b last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.294 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.294 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.294 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.294 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.295 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.295 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.295 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.295 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.295 INFO:tasks.ceph:pgid 13.9 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.296 INFO:tasks.ceph:pgid 11.f last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.296 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.296 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.296 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.296 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.297 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.297 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.297 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.297 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.297 INFO:tasks.ceph:pgid 13.8 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.298 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.298 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.298 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.298 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.298 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.299 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.299 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.299 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.299 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.299 INFO:tasks.ceph:pgid 13.1a last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.300 INFO:tasks.ceph:pgid 12.1b last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.300 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.300 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.300 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.300 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.301 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.301 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.301 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.301 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.301 INFO:tasks.ceph:pgid 13.1b last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.302 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.302 INFO:tasks.ceph:pgid 11.1d last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.302 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.302 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.302 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.303 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.303 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.303 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.303 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.303 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.303 INFO:tasks.ceph:pgid 13.18 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.304 INFO:tasks.ceph:pgid 12.19 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.304 INFO:tasks.ceph:pgid 11.1e last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.304 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.304 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.304 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.305 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.305 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.305 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.305 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.305 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.305 INFO:tasks.ceph:pgid 13.19 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.306 INFO:tasks.ceph:pgid 12.18 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.306 INFO:tasks.ceph:pgid 11.1f last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.306 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.306 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.306 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.307 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.307 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.307 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.307 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.307 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.307 INFO:tasks.ceph:pgid 13.16 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.308 INFO:tasks.ceph:pgid 12.17 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.308 INFO:tasks.ceph:pgid 11.10 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.308 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.308 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.308 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.309 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.309 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.309 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.309 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.309 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.309 INFO:tasks.ceph:pgid 12.16 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.310 INFO:tasks.ceph:pgid 11.11 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.310 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.310 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.310 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.310 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.311 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.311 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.311 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.311 INFO:tasks.ceph:pgid 14.17 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.311 INFO:tasks.ceph:pgid 13.14 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.312 INFO:tasks.ceph:pgid 12.15 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.312 INFO:tasks.ceph:pgid 11.12 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.312 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.312 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.312 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.312 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.313 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.313 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.313 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.313 INFO:tasks.ceph:pgid 12.14 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.313 INFO:tasks.ceph:pgid 11.13 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.314 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.314 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.314 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.314 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.314 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.315 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.315 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.315 INFO:tasks.ceph:pgid 14.11 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.315 INFO:tasks.ceph:pgid 13.12 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.315 INFO:tasks.ceph:pgid 12.13 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.316 INFO:tasks.ceph:pgid 11.14 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.316 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.316 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.316 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.316 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.317 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.317 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.317 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.317 INFO:tasks.ceph:pgid 14.10 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.317 INFO:tasks.ceph:pgid 13.13 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.317 INFO:tasks.ceph:pgid 12.12 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.318 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.318 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.318 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.318 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.318 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.319 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.319 INFO:tasks.ceph:pgid 14.13 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.319 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.319 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.319 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.320 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.320 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.320 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.320 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.320 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.321 INFO:tasks.ceph:pgid 14.12 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.321 INFO:tasks.ceph:pgid 13.11 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.321 INFO:tasks.ceph:pgid 12.10 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.321 INFO:tasks.ceph:pgid 9.15 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.321 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.322 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.322 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.322 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.322 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.323 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-16T17:45:25.414559+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=25, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.323 INFO:tasks.ceph:pgid 9.2a last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.323 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.323 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.323 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.324 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.324 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.324 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.324 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.324 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.325 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.325 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.325 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.325 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.325 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.326 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.326 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.326 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.326 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.326 INFO:tasks.ceph:pgid 9.23 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.327 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.327 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.327 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.327 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.327 INFO:tasks.ceph:pgid 9.21 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.328 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.328 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.328 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.328 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.328 INFO:tasks.ceph:pgid 9.27 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.328 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.329 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.329 INFO:tasks.ceph:pgid 9.24 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.329 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.329 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.329 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.330 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.330 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.330 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.330 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.330 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:31.330 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T19:38:51.331 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:38:51.684 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:38:51.703 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:38:51.705 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3482,"stamp":"2024-04-16T19:38:50.516468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":443064,"num_omap_keys":2019,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37099,"ondisk_log_size":37099,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":338344,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":327158,"kb_avail":628807256,"statfs":{"total":644245094400,"available":643898630144,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":335010465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":77570,"num_omap_keys":335,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005457"},"pg_stats":[{"pgid":"9.35","version":"53'26","reported_seq":533,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.834637+0000","last_change":"2024-04-16T19:38:15.834693+0000","last_active":"2024-04-16T19:38:15.834637+0000","last_peered":"2024-04-16T19:38:15.834637+0000","last_clean":"2024-04-16T19:38:15.834637+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:38:15.834637+0000","last_undegraded":"2024-04-16T19:38:15.834637+0000","last_fullsized":"2024-04-16T19:38:15.834637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.834573+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:46.410400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.402007+0000","last_change":"2024-04-16T17:45:08.383247+0000","last_active":"2024-04-16T19:37:39.402007+0000","last_peered":"2024-04-16T19:37:39.402007+0000","last_clean":"2024-04-16T19:37:39.402007+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:37:39.402007+0000","last_undegraded":"2024-04-16T19:37:39.402007+0000","last_fullsized":"2024-04-16T19:37:39.402007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401790+0000","last_change":"2024-04-16T17:45:10.400343+0000","last_active":"2024-04-16T19:37:44.401790+0000","last_peered":"2024-04-16T19:37:44.401790+0000","last_clean":"2024-04-16T19:37:44.401790+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:37:44.401790+0000","last_undegraded":"2024-04-16T19:37:44.401790+0000","last_fullsized":"2024-04-16T19:37:44.401790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'12","reported_seq":303,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.799796+0000","last_change":"2024-04-16T19:38:20.799846+0000","last_active":"2024-04-16T19:38:20.799796+0000","last_peered":"2024-04-16T19:38:20.799796+0000","last_clean":"2024-04-16T19:38:20.799796+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:38:20.799796+0000","last_undegraded":"2024-04-16T19:38:20.799796+0000","last_fullsized":"2024-04-16T19:38:20.799796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.799730+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:28.459361+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592809+0000","last_change":"2024-04-16T17:45:08.381595+0000","last_active":"2024-04-16T19:37:39.592809+0000","last_peered":"2024-04-16T19:37:39.592809+0000","last_clean":"2024-04-16T19:37:39.592809+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:37:39.592809+0000","last_undegraded":"2024-04-16T19:37:39.592809+0000","last_fullsized":"2024-04-16T19:37:39.592809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402554+0000","last_change":"2024-04-16T17:45:10.390675+0000","last_active":"2024-04-16T19:37:44.402554+0000","last_peered":"2024-04-16T19:37:44.402554+0000","last_clean":"2024-04-16T19:37:44.402554+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:37:44.402554+0000","last_undegraded":"2024-04-16T19:37:44.402554+0000","last_fullsized":"2024-04-16T19:37:44.402554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'13","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.533976+0000","last_change":"2024-04-16T19:38:20.534037+0000","last_active":"2024-04-16T19:38:20.533976+0000","last_peered":"2024-04-16T19:38:20.533976+0000","last_clean":"2024-04-16T19:38:20.533976+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:38:20.533976+0000","last_undegraded":"2024-04-16T19:38:20.533976+0000","last_fullsized":"2024-04-16T19:38:20.533976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.533905+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:22.838173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404360+0000","last_change":"2024-04-16T17:45:08.381577+0000","last_active":"2024-04-16T19:37:39.404360+0000","last_peered":"2024-04-16T19:37:39.404360+0000","last_clean":"2024-04-16T19:37:39.404360+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:37:39.404360+0000","last_undegraded":"2024-04-16T19:37:39.404360+0000","last_fullsized":"2024-04-16T19:37:39.404360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401570+0000","last_change":"2024-04-16T17:45:10.394273+0000","last_active":"2024-04-16T19:37:44.401570+0000","last_peered":"2024-04-16T19:37:44.401570+0000","last_clean":"2024-04-16T19:37:44.401570+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:37:44.401570+0000","last_undegraded":"2024-04-16T19:37:44.401570+0000","last_fullsized":"2024-04-16T19:37:44.401570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'14","reported_seq":262,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.837756+0000","last_change":"2024-04-16T19:38:11.837803+0000","last_active":"2024-04-16T19:38:11.837756+0000","last_peered":"2024-04-16T19:38:11.837756+0000","last_clean":"2024-04-16T19:38:11.837756+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:38:11.837756+0000","last_undegraded":"2024-04-16T19:38:11.837756+0000","last_fullsized":"2024-04-16T19:38:11.837756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.837694+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:14.141962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.399688+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:37:29.399688+0000","last_peered":"2024-04-16T19:37:29.399688+0000","last_clean":"2024-04-16T19:37:29.399688+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:37:29.399688+0000","last_undegraded":"2024-04-16T19:37:29.399688+0000","last_fullsized":"2024-04-16T19:37:29.399688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405200+0000","last_change":"2024-04-16T17:45:10.398320+0000","last_active":"2024-04-16T19:37:44.405200+0000","last_peered":"2024-04-16T19:37:44.405200+0000","last_clean":"2024-04-16T19:37:44.405200+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:37:44.405200+0000","last_undegraded":"2024-04-16T19:37:44.405200+0000","last_fullsized":"2024-04-16T19:37:44.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'14","reported_seq":531,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.397609+0000","last_change":"2024-04-16T19:38:37.397680+0000","last_active":"2024-04-16T19:38:37.397609+0000","last_peered":"2024-04-16T19:38:37.397609+0000","last_clean":"2024-04-16T19:38:37.397609+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:38:37.397609+0000","last_undegraded":"2024-04-16T19:38:37.397609+0000","last_fullsized":"2024-04-16T19:38:37.397609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.397526+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:07.718210+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401891+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:37:39.401891+0000","last_peered":"2024-04-16T19:37:39.401891+0000","last_clean":"2024-04-16T19:37:39.401891+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:37:39.401891+0000","last_undegraded":"2024-04-16T19:37:39.401891+0000","last_fullsized":"2024-04-16T19:37:39.401891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.400385+0000","last_change":"2024-04-16T17:45:10.395553+0000","last_active":"2024-04-16T19:37:34.400385+0000","last_peered":"2024-04-16T19:37:34.400385+0000","last_clean":"2024-04-16T19:37:34.400385+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:37:34.400385+0000","last_undegraded":"2024-04-16T19:37:34.400385+0000","last_fullsized":"2024-04-16T19:37:34.400385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'16","reported_seq":332,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.177690+0000","last_change":"2024-04-16T19:38:15.177758+0000","last_active":"2024-04-16T19:38:15.177690+0000","last_peered":"2024-04-16T19:38:15.177690+0000","last_clean":"2024-04-16T19:38:15.177690+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:38:15.177690+0000","last_undegraded":"2024-04-16T19:38:15.177690+0000","last_fullsized":"2024-04-16T19:38:15.177690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.177626+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:51.929131+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.757121+0000","last_change":"2024-04-16T19:38:31.757121+0000","last_active":"2024-04-16T19:38:31.757121+0000","last_peered":"2024-04-16T19:38:31.757121+0000","last_clean":"2024-04-16T19:38:31.757121+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:38:31.757121+0000","last_undegraded":"2024-04-16T19:38:31.757121+0000","last_fullsized":"2024-04-16T19:38:31.757121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.757048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:06.731328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401663+0000","last_change":"2024-04-16T17:45:10.397556+0000","last_active":"2024-04-16T19:37:44.401663+0000","last_peered":"2024-04-16T19:37:44.401663+0000","last_clean":"2024-04-16T19:37:44.401663+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:37:44.401663+0000","last_undegraded":"2024-04-16T19:37:44.401663+0000","last_fullsized":"2024-04-16T19:37:44.401663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'16","reported_seq":558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.885890+0000","last_change":"2024-04-16T19:38:15.885941+0000","last_active":"2024-04-16T19:38:15.885890+0000","last_peered":"2024-04-16T19:38:15.885890+0000","last_clean":"2024-04-16T19:38:15.885890+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:38:15.885890+0000","last_undegraded":"2024-04-16T19:38:15.885890+0000","last_fullsized":"2024-04-16T19:38:15.885890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.885831+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:24.282989+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401833+0000","last_change":"2024-04-16T17:45:08.383652+0000","last_active":"2024-04-16T19:37:39.401833+0000","last_peered":"2024-04-16T19:37:39.401833+0000","last_clean":"2024-04-16T19:37:39.401833+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:37:39.401833+0000","last_undegraded":"2024-04-16T19:37:39.401833+0000","last_fullsized":"2024-04-16T19:37:39.401833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401925+0000","last_change":"2024-04-16T17:45:10.395876+0000","last_active":"2024-04-16T19:37:44.401925+0000","last_peered":"2024-04-16T19:37:44.401925+0000","last_clean":"2024-04-16T19:37:44.401925+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:37:44.401925+0000","last_undegraded":"2024-04-16T19:37:44.401925+0000","last_fullsized":"2024-04-16T19:37:44.401925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'12","reported_seq":445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.407660+0000","last_change":"2024-04-16T19:38:36.407728+0000","last_active":"2024-04-16T19:38:36.407660+0000","last_peered":"2024-04-16T19:38:36.407660+0000","last_clean":"2024-04-16T19:38:36.407660+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:38:36.407660+0000","last_undegraded":"2024-04-16T19:38:36.407660+0000","last_fullsized":"2024-04-16T19:38:36.407660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.407586+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:13.159091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592526+0000","last_change":"2024-04-16T17:45:08.389961+0000","last_active":"2024-04-16T19:37:39.592526+0000","last_peered":"2024-04-16T19:37:39.592526+0000","last_clean":"2024-04-16T19:37:39.592526+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:37:39.592526+0000","last_undegraded":"2024-04-16T19:37:39.592526+0000","last_fullsized":"2024-04-16T19:37:39.592526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593660+0000","last_change":"2024-04-16T17:45:10.399056+0000","last_active":"2024-04-16T19:37:44.593660+0000","last_peered":"2024-04-16T19:37:44.593660+0000","last_clean":"2024-04-16T19:37:44.593660+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:37:44.593660+0000","last_undegraded":"2024-04-16T19:37:44.593660+0000","last_fullsized":"2024-04-16T19:37:44.593660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'10","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.728428+0000","last_change":"2024-04-16T19:38:23.728493+0000","last_active":"2024-04-16T19:38:23.728428+0000","last_peered":"2024-04-16T19:38:23.728428+0000","last_clean":"2024-04-16T19:38:23.728428+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:38:23.728428+0000","last_undegraded":"2024-04-16T19:38:23.728428+0000","last_fullsized":"2024-04-16T19:38:23.728428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.728366+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:54.049051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396645+0000","last_change":"2024-04-16T17:45:10.394927+0000","last_active":"2024-04-16T19:37:14.396645+0000","last_peered":"2024-04-16T19:37:14.396645+0000","last_clean":"2024-04-16T19:37:14.396645+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:37:14.396645+0000","last_undegraded":"2024-04-16T19:37:14.396645+0000","last_fullsized":"2024-04-16T19:37:14.396645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:39.392691+0000","last_change":"2024-04-16T17:45:08.388693+0000","last_active":"2024-04-16T19:36:39.392691+0000","last_peered":"2024-04-16T19:36:39.392691+0000","last_clean":"2024-04-16T19:36:39.392691+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:36:39.392691+0000","last_undegraded":"2024-04-16T19:36:39.392691+0000","last_fullsized":"2024-04-16T19:36:39.392691+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'12","reported_seq":363,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.931333+0000","last_change":"2024-04-16T19:38:17.931378+0000","last_active":"2024-04-16T19:38:17.931333+0000","last_peered":"2024-04-16T19:38:17.931333+0000","last_clean":"2024-04-16T19:38:17.931333+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:38:17.931333+0000","last_undegraded":"2024-04-16T19:38:17.931333+0000","last_fullsized":"2024-04-16T19:38:17.931333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.931272+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:07.574424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.397493+0000","last_change":"2024-04-16T17:45:10.393548+0000","last_active":"2024-04-16T19:37:14.397493+0000","last_peered":"2024-04-16T19:37:14.397493+0000","last_clean":"2024-04-16T19:37:14.397493+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:37:14.397493+0000","last_undegraded":"2024-04-16T19:37:14.397493+0000","last_fullsized":"2024-04-16T19:37:14.397493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428456+0000","last_change":"2024-04-16T17:45:08.388744+0000","last_active":"2024-04-16T19:38:09.428456+0000","last_peered":"2024-04-16T19:38:09.428456+0000","last_clean":"2024-04-16T19:38:09.428456+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:38:09.428456+0000","last_undegraded":"2024-04-16T19:38:09.428456+0000","last_fullsized":"2024-04-16T19:38:09.428456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'10","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.171571+0000","last_change":"2024-04-16T19:38:35.171613+0000","last_active":"2024-04-16T19:38:35.171571+0000","last_peered":"2024-04-16T19:38:35.171571+0000","last_clean":"2024-04-16T19:38:35.171571+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:38:35.171571+0000","last_undegraded":"2024-04-16T19:38:35.171571+0000","last_fullsized":"2024-04-16T19:38:35.171571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.171510+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:54.116974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.400330+0000","last_change":"2024-04-16T17:45:10.392335+0000","last_active":"2024-04-16T19:37:34.400330+0000","last_peered":"2024-04-16T19:37:34.400330+0000","last_clean":"2024-04-16T19:37:34.400330+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:37:34.400330+0000","last_undegraded":"2024-04-16T19:37:34.400330+0000","last_fullsized":"2024-04-16T19:37:34.400330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338727+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:38:10.338727+0000","last_peered":"2024-04-16T19:38:10.338727+0000","last_clean":"2024-04-16T19:38:10.338727+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:38:10.338727+0000","last_undegraded":"2024-04-16T19:38:10.338727+0000","last_fullsized":"2024-04-16T19:38:10.338727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'16","reported_seq":250,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.100685+0000","last_change":"2024-04-16T19:38:40.100742+0000","last_active":"2024-04-16T19:38:40.100685+0000","last_peered":"2024-04-16T19:38:40.100685+0000","last_clean":"2024-04-16T19:38:40.100685+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:38:40.100685+0000","last_undegraded":"2024-04-16T19:38:40.100685+0000","last_fullsized":"2024-04-16T19:38:40.100685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.100620+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:48.497778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976513+0000","last_change":"2024-04-16T17:45:10.391411+0000","last_active":"2024-04-16T19:38:08.976513+0000","last_peered":"2024-04-16T19:38:08.976513+0000","last_clean":"2024-04-16T19:38:08.976513+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:38:08.976513+0000","last_undegraded":"2024-04-16T19:38:08.976513+0000","last_fullsized":"2024-04-16T19:38:08.976513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.886119+0000","last_change":"2024-04-16T17:45:08.382324+0000","last_active":"2024-04-16T19:38:09.886119+0000","last_peered":"2024-04-16T19:38:09.886119+0000","last_clean":"2024-04-16T19:38:09.886119+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:38:09.886119+0000","last_undegraded":"2024-04-16T19:38:09.886119+0000","last_fullsized":"2024-04-16T19:38:09.886119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"53'9","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.926373+0000","last_change":"2024-04-16T19:38:21.926413+0000","last_active":"2024-04-16T19:38:21.926373+0000","last_peered":"2024-04-16T19:38:21.926373+0000","last_clean":"2024-04-16T19:38:21.926373+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:38:21.926373+0000","last_undegraded":"2024-04-16T19:38:21.926373+0000","last_fullsized":"2024-04-16T19:38:21.926373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'9","last_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_deep_scrub":"53'9","last_deep_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.926308+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:31.946481+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976475+0000","last_change":"2024-04-16T17:45:10.393503+0000","last_active":"2024-04-16T19:38:08.976475+0000","last_peered":"2024-04-16T19:38:08.976475+0000","last_clean":"2024-04-16T19:38:08.976475+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:38:08.976475+0000","last_undegraded":"2024-04-16T19:38:08.976475+0000","last_fullsized":"2024-04-16T19:38:08.976475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068783+0000","last_change":"2024-04-16T17:45:08.387116+0000","last_active":"2024-04-16T19:38:08.068783+0000","last_peered":"2024-04-16T19:38:08.068783+0000","last_clean":"2024-04-16T19:38:08.068783+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:38:08.068783+0000","last_undegraded":"2024-04-16T19:38:08.068783+0000","last_fullsized":"2024-04-16T19:38:08.068783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"53'2","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.013204+0000","last_change":"2024-04-16T19:38:42.013239+0000","last_active":"2024-04-16T19:38:42.013204+0000","last_peered":"2024-04-16T19:38:42.013204+0000","last_clean":"2024-04-16T19:38:42.013204+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:38:42.013204+0000","last_undegraded":"2024-04-16T19:38:42.013204+0000","last_fullsized":"2024-04-16T19:38:42.013204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.013138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:49.672770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.886376+0000","last_change":"2024-04-16T17:45:10.397627+0000","last_active":"2024-04-16T19:38:09.886376+0000","last_peered":"2024-04-16T19:38:09.886376+0000","last_clean":"2024-04-16T19:38:09.886376+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:38:09.886376+0000","last_undegraded":"2024-04-16T19:38:09.886376+0000","last_fullsized":"2024-04-16T19:38:09.886376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.091408+0000","last_change":"2024-04-16T19:38:24.091408+0000","last_active":"2024-04-16T19:38:24.091408+0000","last_peered":"2024-04-16T19:38:24.091408+0000","last_clean":"2024-04-16T19:38:24.091408+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:38:24.091408+0000","last_undegraded":"2024-04-16T19:38:24.091408+0000","last_fullsized":"2024-04-16T19:38:24.091408+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.091318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:55.045299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524663+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:38:08.524663+0000","last_peered":"2024-04-16T19:38:08.524663+0000","last_clean":"2024-04-16T19:38:08.524663+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:38:08.524663+0000","last_undegraded":"2024-04-16T19:38:08.524663+0000","last_fullsized":"2024-04-16T19:38:08.524663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'145","reported_seq":2259,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429918+0000","last_change":"2024-04-16T17:46:25.527767+0000","last_active":"2024-04-16T19:38:09.429918+0000","last_peered":"2024-04-16T19:38:09.429918+0000","last_clean":"2024-04-16T19:38:09.429918+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:38:09.429918+0000","last_undegraded":"2024-04-16T19:38:09.429918+0000","last_fullsized":"2024-04-16T19:38:09.429918+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.886294+0000","last_change":"2024-04-16T19:38:40.886294+0000","last_active":"2024-04-16T19:38:40.886294+0000","last_peered":"2024-04-16T19:38:40.886294+0000","last_clean":"2024-04-16T19:38:40.886294+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:38:40.886294+0000","last_undegraded":"2024-04-16T19:38:40.886294+0000","last_fullsized":"2024-04-16T19:38:40.886294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.886171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:24.443007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'26","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.349483+0000","last_change":"2024-04-16T19:38:36.349545+0000","last_active":"2024-04-16T19:38:36.349483+0000","last_peered":"2024-04-16T19:38:36.349483+0000","last_clean":"2024-04-16T19:38:36.349483+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:38:36.349483+0000","last_undegraded":"2024-04-16T19:38:36.349483+0000","last_fullsized":"2024-04-16T19:38:36.349483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.349407+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:33.328492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.556726+0000","last_change":"2024-04-16T19:38:18.556726+0000","last_active":"2024-04-16T19:38:18.556726+0000","last_peered":"2024-04-16T19:38:18.556726+0000","last_clean":"2024-04-16T19:38:18.556726+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:38:18.556726+0000","last_undegraded":"2024-04-16T19:38:18.556726+0000","last_fullsized":"2024-04-16T19:38:18.556726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.556600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:53.827149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'257","reported_seq":496,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.911983+0000","last_change":"2024-04-16T19:38:22.912055+0000","last_active":"2024-04-16T19:38:22.911983+0000","last_peered":"2024-04-16T19:38:22.911983+0000","last_clean":"2024-04-16T19:38:22.911983+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:38:22.911983+0000","last_undegraded":"2024-04-16T19:38:22.911983+0000","last_fullsized":"2024-04-16T19:38:22.911983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'257","last_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_deep_scrub":"53'257","last_deep_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.911925+0000","objects_scrubbed":14,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:02.872014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'17","reported_seq":406,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.523960+0000","last_change":"2024-04-16T19:38:28.524008+0000","last_active":"2024-04-16T19:38:28.523960+0000","last_peered":"2024-04-16T19:38:28.523960+0000","last_clean":"2024-04-16T19:38:28.523960+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:38:28.523960+0000","last_undegraded":"2024-04-16T19:38:28.523960+0000","last_fullsized":"2024-04-16T19:38:28.523960+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'17","last_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_deep_scrub":"53'17","last_deep_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.523901+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:10.769673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.339416+0000","last_change":"2024-04-16T19:38:43.339440+0000","last_active":"2024-04-16T19:38:43.339416+0000","last_peered":"2024-04-16T19:38:43.339416+0000","last_clean":"2024-04-16T19:38:43.339416+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:38:43.339416+0000","last_undegraded":"2024-04-16T19:38:43.339416+0000","last_fullsized":"2024-04-16T19:38:43.339416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.339355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:45.853381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.590783+0000","last_change":"2024-04-16T17:45:10.400976+0000","last_active":"2024-04-16T19:37:29.590783+0000","last_peered":"2024-04-16T19:37:29.590783+0000","last_clean":"2024-04-16T19:37:29.590783+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:37:29.590783+0000","last_undegraded":"2024-04-16T19:37:29.590783+0000","last_fullsized":"2024-04-16T19:37:29.590783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397429+0000","last_change":"2024-04-16T17:45:08.388375+0000","last_active":"2024-04-16T19:37:09.397429+0000","last_peered":"2024-04-16T19:37:09.397429+0000","last_clean":"2024-04-16T19:37:09.397429+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:37:09.397429+0000","last_undegraded":"2024-04-16T19:37:09.397429+0000","last_fullsized":"2024-04-16T19:37:09.397429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391655+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:36:34.391655+0000","last_peered":"2024-04-16T19:36:34.391655+0000","last_clean":"2024-04-16T19:36:34.391655+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:36:34.391655+0000","last_undegraded":"2024-04-16T19:36:34.391655+0000","last_fullsized":"2024-04-16T19:36:34.391655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.394003+0000","last_change":"2024-04-16T17:45:22.417279+0000","last_active":"2024-04-16T19:36:34.394003+0000","last_peered":"2024-04-16T19:36:34.394003+0000","last_clean":"2024-04-16T19:36:34.394003+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:36:34.394003+0000","last_undegraded":"2024-04-16T19:36:34.394003+0000","last_fullsized":"2024-04-16T19:36:34.394003+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391741+0000","last_change":"2024-04-16T17:45:24.425550+0000","last_active":"2024-04-16T19:36:34.391741+0000","last_peered":"2024-04-16T19:36:34.391741+0000","last_clean":"2024-04-16T19:36:34.391741+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:36:34.391741+0000","last_undegraded":"2024-04-16T19:36:34.391741+0000","last_fullsized":"2024-04-16T19:36:34.391741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588660+0000","last_change":"2024-04-16T18:09:02.170333+0000","last_active":"2024-04-16T19:37:19.588660+0000","last_peered":"2024-04-16T19:37:19.588660+0000","last_clean":"2024-04-16T19:37:19.588660+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:37:19.588660+0000","last_undegraded":"2024-04-16T19:37:19.588660+0000","last_fullsized":"2024-04-16T19:37:19.588660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1988,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401948+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:37:44.401948+0000","last_peered":"2024-04-16T19:37:44.401948+0000","last_clean":"2024-04-16T19:37:44.401948+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:37:44.401948+0000","last_undegraded":"2024-04-16T19:37:44.401948+0000","last_fullsized":"2024-04-16T19:37:44.401948+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.784652+0000","last_change":"2024-04-16T19:38:42.784652+0000","last_active":"2024-04-16T19:38:42.784652+0000","last_peered":"2024-04-16T19:38:42.784652+0000","last_clean":"2024-04-16T19:38:42.784652+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:38:42.784652+0000","last_undegraded":"2024-04-16T19:38:42.784652+0000","last_fullsized":"2024-04-16T19:38:42.784652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.784562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:26.341398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'13","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.384096+0000","last_change":"2024-04-16T19:38:47.384137+0000","last_active":"2024-04-16T19:38:47.384096+0000","last_peered":"2024-04-16T19:38:47.384096+0000","last_clean":"2024-04-16T19:38:47.384096+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:38:47.384096+0000","last_undegraded":"2024-04-16T19:38:47.384096+0000","last_fullsized":"2024-04-16T19:38:47.384096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.384037+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:55.261448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.768005+0000","last_change":"2024-04-16T19:38:32.768029+0000","last_active":"2024-04-16T19:38:32.768005+0000","last_peered":"2024-04-16T19:38:32.768005+0000","last_clean":"2024-04-16T19:38:32.768005+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:38:32.768005+0000","last_undegraded":"2024-04-16T19:38:32.768005+0000","last_fullsized":"2024-04-16T19:38:32.768005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:38.784450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'204","reported_seq":483,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.084173+0000","last_change":"2024-04-16T19:38:12.084173+0000","last_active":"2024-04-16T19:38:12.084173+0000","last_peered":"2024-04-16T19:38:12.084173+0000","last_clean":"2024-04-16T19:38:12.084173+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:38:12.084173+0000","last_undegraded":"2024-04-16T19:38:12.084173+0000","last_fullsized":"2024-04-16T19:38:12.084173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'204","last_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_deep_scrub":"53'204","last_deep_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.084057+0000","objects_scrubbed":15,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:47:16.400625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'36","reported_seq":332,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.728059+0000","last_change":"2024-04-16T19:38:29.728115+0000","last_active":"2024-04-16T19:38:29.728059+0000","last_peered":"2024-04-16T19:38:29.728059+0000","last_clean":"2024-04-16T19:38:29.728059+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:38:29.728059+0000","last_undegraded":"2024-04-16T19:38:29.728059+0000","last_fullsized":"2024-04-16T19:38:29.728059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'36","last_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_deep_scrub":"53'36","last_deep_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.727997+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:35.149833+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.754235+0000","last_change":"2024-04-16T19:38:31.754279+0000","last_active":"2024-04-16T19:38:31.754235+0000","last_peered":"2024-04-16T19:38:31.754235+0000","last_clean":"2024-04-16T19:38:31.754235+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:38:31.754235+0000","last_undegraded":"2024-04-16T19:38:31.754235+0000","last_fullsized":"2024-04-16T19:38:31.754235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.754160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:49.288552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338781+0000","last_change":"2024-04-16T17:45:10.395070+0000","last_active":"2024-04-16T19:38:10.338781+0000","last_peered":"2024-04-16T19:38:10.338781+0000","last_clean":"2024-04-16T19:38:10.338781+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:38:10.338781+0000","last_undegraded":"2024-04-16T19:38:10.338781+0000","last_fullsized":"2024-04-16T19:38:10.338781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.399332+0000","last_change":"2024-04-16T17:45:08.390752+0000","last_active":"2024-04-16T19:37:09.399332+0000","last_peered":"2024-04-16T19:37:09.399332+0000","last_clean":"2024-04-16T19:37:09.399332+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:37:09.399332+0000","last_undegraded":"2024-04-16T19:37:09.399332+0000","last_fullsized":"2024-04-16T19:37:09.399332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"48'17","reported_seq":895,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405226+0000","last_change":"2024-04-16T17:45:20.413278+0000","last_active":"2024-04-16T19:37:44.405226+0000","last_peered":"2024-04-16T19:37:44.405226+0000","last_clean":"2024-04-16T19:37:44.405226+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:37:44.405226+0000","last_undegraded":"2024-04-16T19:37:44.405226+0000","last_fullsized":"2024-04-16T19:37:44.405226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'72","reported_seq":221,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391155+0000","last_change":"2024-04-16T17:45:22.414776+0000","last_active":"2024-04-16T19:36:34.391155+0000","last_peered":"2024-04-16T19:36:34.391155+0000","last_clean":"2024-04-16T19:36:34.391155+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:36:34.391155+0000","last_undegraded":"2024-04-16T19:36:34.391155+0000","last_fullsized":"2024-04-16T19:36:34.391155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.393486+0000","last_change":"2024-04-16T19:38:49.393508+0000","last_active":"2024-04-16T19:38:49.393486+0000","last_peered":"2024-04-16T19:38:49.393486+0000","last_clean":"2024-04-16T19:38:49.393486+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:38:49.393486+0000","last_undegraded":"2024-04-16T19:38:49.393486+0000","last_fullsized":"2024-04-16T19:38:49.393486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.393417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:44.040909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391044+0000","last_change":"2024-04-16T18:09:02.164735+0000","last_active":"2024-04-16T19:36:34.391044+0000","last_peered":"2024-04-16T19:36:34.391044+0000","last_clean":"2024-04-16T19:36:34.391044+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:36:34.391044+0000","last_undegraded":"2024-04-16T19:36:34.391044+0000","last_fullsized":"2024-04-16T19:36:34.391044+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'228","reported_seq":2121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393114+0000","last_change":"2024-04-16T17:46:25.526441+0000","last_active":"2024-04-16T19:36:29.393114+0000","last_peered":"2024-04-16T19:36:29.393114+0000","last_clean":"2024-04-16T19:36:29.393114+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:36:29.393114+0000","last_undegraded":"2024-04-16T19:36:29.393114+0000","last_fullsized":"2024-04-16T19:36:29.393114+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.547577+0000","last_change":"2024-04-16T19:38:25.547577+0000","last_active":"2024-04-16T19:38:25.547577+0000","last_peered":"2024-04-16T19:38:25.547577+0000","last_clean":"2024-04-16T19:38:25.547577+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:38:25.547577+0000","last_undegraded":"2024-04-16T19:38:25.547577+0000","last_fullsized":"2024-04-16T19:38:25.547577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.547478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:51.243189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'10","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.429116+0000","last_change":"2024-04-16T19:38:31.429149+0000","last_active":"2024-04-16T19:38:31.429116+0000","last_peered":"2024-04-16T19:38:31.429116+0000","last_clean":"2024-04-16T19:38:31.429116+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:38:31.429116+0000","last_undegraded":"2024-04-16T19:38:31.429116+0000","last_fullsized":"2024-04-16T19:38:31.429116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.429051+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:33.962416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.354794+0000","last_change":"2024-04-16T19:38:30.354840+0000","last_active":"2024-04-16T19:38:30.354794+0000","last_peered":"2024-04-16T19:38:30.354794+0000","last_clean":"2024-04-16T19:38:30.354794+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:38:30.354794+0000","last_undegraded":"2024-04-16T19:38:30.354794+0000","last_fullsized":"2024-04-16T19:38:30.354794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.354716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:36.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'283","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.068635+0000","last_change":"2024-04-16T19:38:14.068719+0000","last_active":"2024-04-16T19:38:14.068635+0000","last_peered":"2024-04-16T19:38:14.068635+0000","last_clean":"2024-04-16T19:38:14.068635+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:38:14.068635+0000","last_undegraded":"2024-04-16T19:38:14.068635+0000","last_fullsized":"2024-04-16T19:38:14.068635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'283","last_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_deep_scrub":"53'283","last_deep_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.068569+0000","objects_scrubbed":17,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:04.644251+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'16","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.254163+0000","last_change":"2024-04-16T19:38:18.254163+0000","last_active":"2024-04-16T19:38:18.254163+0000","last_peered":"2024-04-16T19:38:18.254163+0000","last_clean":"2024-04-16T19:38:18.254163+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:38:18.254163+0000","last_undegraded":"2024-04-16T19:38:18.254163+0000","last_fullsized":"2024-04-16T19:38:18.254163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.254059+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:53.228339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.371589+0000","last_change":"2024-04-16T19:38:29.371613+0000","last_active":"2024-04-16T19:38:29.371589+0000","last_peered":"2024-04-16T19:38:29.371589+0000","last_clean":"2024-04-16T19:38:29.371589+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:38:29.371589+0000","last_undegraded":"2024-04-16T19:38:29.371589+0000","last_fullsized":"2024-04-16T19:38:29.371589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.371523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:16.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068801+0000","last_change":"2024-04-16T17:45:10.398271+0000","last_active":"2024-04-16T19:38:08.068801+0000","last_peered":"2024-04-16T19:38:08.068801+0000","last_clean":"2024-04-16T19:38:08.068801+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:38:08.068801+0000","last_undegraded":"2024-04-16T19:38:08.068801+0000","last_fullsized":"2024-04-16T19:38:08.068801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397357+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:37:09.397357+0000","last_peered":"2024-04-16T19:37:09.397357+0000","last_clean":"2024-04-16T19:37:09.397357+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:37:09.397357+0000","last_undegraded":"2024-04-16T19:37:09.397357+0000","last_fullsized":"2024-04-16T19:37:09.397357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579542+0000","last_change":"2024-04-16T17:45:20.406137+0000","last_active":"2024-04-16T19:36:34.579542+0000","last_peered":"2024-04-16T19:36:34.579542+0000","last_clean":"2024-04-16T19:36:34.579542+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:36:34.579542+0000","last_undegraded":"2024-04-16T19:36:34.579542+0000","last_fullsized":"2024-04-16T19:36:34.579542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'120","reported_seq":295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592694+0000","last_change":"2024-04-16T17:45:22.421567+0000","last_active":"2024-04-16T19:37:39.592694+0000","last_peered":"2024-04-16T19:37:39.592694+0000","last_clean":"2024-04-16T19:37:39.592694+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:37:39.592694+0000","last_undegraded":"2024-04-16T19:37:39.592694+0000","last_fullsized":"2024-04-16T19:37:39.592694+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'12","reported_seq":1388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391788+0000","last_change":"2024-04-16T17:45:24.425583+0000","last_active":"2024-04-16T19:36:34.391788+0000","last_peered":"2024-04-16T19:36:34.391788+0000","last_clean":"2024-04-16T19:36:34.391788+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:36:34.391788+0000","last_undegraded":"2024-04-16T19:36:34.391788+0000","last_fullsized":"2024-04-16T19:36:34.391788+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579535+0000","last_change":"2024-04-16T18:09:02.169752+0000","last_active":"2024-04-16T19:36:34.579535+0000","last_peered":"2024-04-16T19:36:34.579535+0000","last_clean":"2024-04-16T19:36:34.579535+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:36:34.579535+0000","last_undegraded":"2024-04-16T19:36:34.579535+0000","last_fullsized":"2024-04-16T19:36:34.579535+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'151","reported_seq":2295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393145+0000","last_change":"2024-04-16T17:46:25.529267+0000","last_active":"2024-04-16T19:36:29.393145+0000","last_peered":"2024-04-16T19:36:29.393145+0000","last_clean":"2024-04-16T19:36:29.393145+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:36:29.393145+0000","last_undegraded":"2024-04-16T19:36:29.393145+0000","last_fullsized":"2024-04-16T19:36:29.393145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.358729+0000","last_change":"2024-04-16T19:38:38.358729+0000","last_active":"2024-04-16T19:38:38.358729+0000","last_peered":"2024-04-16T19:38:38.358729+0000","last_clean":"2024-04-16T19:38:38.358729+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:38:38.358729+0000","last_undegraded":"2024-04-16T19:38:38.358729+0000","last_fullsized":"2024-04-16T19:38:38.358729+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.358644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:18.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'13","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.916490+0000","last_change":"2024-04-16T19:38:46.916547+0000","last_active":"2024-04-16T19:38:46.916490+0000","last_peered":"2024-04-16T19:38:46.916490+0000","last_clean":"2024-04-16T19:38:46.916490+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:38:46.916490+0000","last_undegraded":"2024-04-16T19:38:46.916490+0000","last_fullsized":"2024-04-16T19:38:46.916490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.916403+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:16.453973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.107369+0000","last_change":"2024-04-16T19:38:09.107389+0000","last_active":"2024-04-16T19:38:09.107369+0000","last_peered":"2024-04-16T19:38:09.107369+0000","last_clean":"2024-04-16T19:38:09.107369+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:38:09.107369+0000","last_undegraded":"2024-04-16T19:38:09.107369+0000","last_fullsized":"2024-04-16T19:38:09.107369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.107315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:06.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5992","reported_seq":12558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.824588+0000","last_change":"2024-04-16T19:38:12.824617+0000","last_active":"2024-04-16T19:38:12.824588+0000","last_peered":"2024-04-16T19:38:12.824588+0000","last_clean":"2024-04-16T19:38:12.824588+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:38:12.824588+0000","last_undegraded":"2024-04-16T19:38:12.824588+0000","last_fullsized":"2024-04-16T19:38:12.824588+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5992","last_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_deep_scrub":"53'5992","last_deep_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.824529+0000","objects_scrubbed":27,"log_size":1792,"log_dups_size":3000,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:47.168687+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":79208,"num_omap_keys":410,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'16","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.740826+0000","last_change":"2024-04-16T19:38:21.740887+0000","last_active":"2024-04-16T19:38:21.740826+0000","last_peered":"2024-04-16T19:38:21.740826+0000","last_clean":"2024-04-16T19:38:21.740826+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:38:21.740826+0000","last_undegraded":"2024-04-16T19:38:21.740826+0000","last_fullsized":"2024-04-16T19:38:21.740826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.740747+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:07.774419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.344166+0000","last_change":"2024-04-16T19:38:40.344189+0000","last_active":"2024-04-16T19:38:40.344166+0000","last_peered":"2024-04-16T19:38:40.344166+0000","last_clean":"2024-04-16T19:38:40.344166+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:38:40.344166+0000","last_undegraded":"2024-04-16T19:38:40.344166+0000","last_fullsized":"2024-04-16T19:38:40.344166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.344095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:37.023758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068802+0000","last_change":"2024-04-16T17:45:10.391762+0000","last_active":"2024-04-16T19:38:08.068802+0000","last_peered":"2024-04-16T19:38:08.068802+0000","last_clean":"2024-04-16T19:38:08.068802+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:38:08.068802+0000","last_undegraded":"2024-04-16T19:38:08.068802+0000","last_fullsized":"2024-04-16T19:38:08.068802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.396801+0000","last_change":"2024-04-16T17:45:08.387257+0000","last_active":"2024-04-16T19:37:09.396801+0000","last_peered":"2024-04-16T19:37:09.396801+0000","last_clean":"2024-04-16T19:37:09.396801+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:37:09.396801+0000","last_undegraded":"2024-04-16T19:37:09.396801+0000","last_fullsized":"2024-04-16T19:37:09.396801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"48'1","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391821+0000","last_change":"2024-04-16T17:45:20.405143+0000","last_active":"2024-04-16T19:36:34.391821+0000","last_peered":"2024-04-16T19:36:34.391821+0000","last_clean":"2024-04-16T19:36:34.391821+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:36:34.391821+0000","last_undegraded":"2024-04-16T19:36:34.391821+0000","last_fullsized":"2024-04-16T19:36:34.391821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391766+0000","last_change":"2024-04-16T17:45:22.421942+0000","last_active":"2024-04-16T19:36:34.391766+0000","last_peered":"2024-04-16T19:36:34.391766+0000","last_clean":"2024-04-16T19:36:34.391766+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:36:34.391766+0000","last_undegraded":"2024-04-16T19:36:34.391766+0000","last_fullsized":"2024-04-16T19:36:34.391766+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'12","reported_seq":1390,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592709+0000","last_change":"2024-04-16T17:45:24.424033+0000","last_active":"2024-04-16T19:37:39.592709+0000","last_peered":"2024-04-16T19:37:39.592709+0000","last_clean":"2024-04-16T19:37:39.592709+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:37:39.592709+0000","last_undegraded":"2024-04-16T19:37:39.592709+0000","last_fullsized":"2024-04-16T19:37:39.592709+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887557+0000","last_change":"2024-04-16T18:09:02.168123+0000","last_active":"2024-04-16T19:38:09.887557+0000","last_peered":"2024-04-16T19:38:09.887557+0000","last_clean":"2024-04-16T19:38:09.887557+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:38:09.887557+0000","last_undegraded":"2024-04-16T19:38:09.887557+0000","last_fullsized":"2024-04-16T19:38:09.887557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394950+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:36:54.394950+0000","last_peered":"2024-04-16T19:36:54.394950+0000","last_clean":"2024-04-16T19:36:54.394950+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:36:54.394950+0000","last_undegraded":"2024-04-16T19:36:54.394950+0000","last_fullsized":"2024-04-16T19:36:54.394950+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.860257+0000","last_change":"2024-04-16T19:38:38.860257+0000","last_active":"2024-04-16T19:38:38.860257+0000","last_peered":"2024-04-16T19:38:38.860257+0000","last_clean":"2024-04-16T19:38:38.860257+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:38:38.860257+0000","last_undegraded":"2024-04-16T19:38:38.860257+0000","last_fullsized":"2024-04-16T19:38:38.860257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.860170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:59.006022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'13","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.413937+0000","last_change":"2024-04-16T19:38:33.413987+0000","last_active":"2024-04-16T19:38:33.413937+0000","last_peered":"2024-04-16T19:38:33.413937+0000","last_clean":"2024-04-16T19:38:33.413937+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:38:33.413937+0000","last_undegraded":"2024-04-16T19:38:33.413937+0000","last_fullsized":"2024-04-16T19:38:33.413937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.413861+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:52.042937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.739844+0000","last_change":"2024-04-16T19:38:22.739844+0000","last_active":"2024-04-16T19:38:22.739844+0000","last_peered":"2024-04-16T19:38:22.739844+0000","last_clean":"2024-04-16T19:38:22.739844+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:38:22.739844+0000","last_undegraded":"2024-04-16T19:38:22.739844+0000","last_fullsized":"2024-04-16T19:38:22.739844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.739758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:59.491263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1601","reported_seq":47000,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.864758+0000","last_change":"2024-04-16T19:38:18.864758+0000","last_active":"2024-04-16T19:38:18.864758+0000","last_peered":"2024-04-16T19:38:18.864758+0000","last_clean":"2024-04-16T19:38:18.864758+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:38:18.864758+0000","last_undegraded":"2024-04-16T19:38:18.864758+0000","last_fullsized":"2024-04-16T19:38:18.864758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'1601","last_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_deep_scrub":"53'1601","last_deep_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.864667+0000","objects_scrubbed":26,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:06.203531+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14964,"num_omap_keys":68,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'12","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.220904+0000","last_change":"2024-04-16T19:38:11.220904+0000","last_active":"2024-04-16T19:38:11.220904+0000","last_peered":"2024-04-16T19:38:11.220904+0000","last_clean":"2024-04-16T19:38:11.220904+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:38:11.220904+0000","last_undegraded":"2024-04-16T19:38:11.220904+0000","last_fullsized":"2024-04-16T19:38:11.220904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.220802+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:19.617959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403883+0000","last_change":"2024-04-16T17:45:10.393324+0000","last_active":"2024-04-16T19:37:54.403883+0000","last_peered":"2024-04-16T19:37:54.403883+0000","last_clean":"2024-04-16T19:37:54.403883+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:37:54.403883+0000","last_undegraded":"2024-04-16T19:37:54.403883+0000","last_fullsized":"2024-04-16T19:37:54.403883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404572+0000","last_change":"2024-04-16T17:45:08.389843+0000","last_active":"2024-04-16T19:37:59.404572+0000","last_peered":"2024-04-16T19:37:59.404572+0000","last_clean":"2024-04-16T19:37:59.404572+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:37:59.404572+0000","last_undegraded":"2024-04-16T19:37:59.404572+0000","last_fullsized":"2024-04-16T19:37:59.404572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"48'5","reported_seq":229,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405211+0000","last_change":"2024-04-16T17:45:20.407401+0000","last_active":"2024-04-16T19:38:04.405211+0000","last_peered":"2024-04-16T19:38:04.405211+0000","last_clean":"2024-04-16T19:38:04.405211+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:38:04.405211+0000","last_undegraded":"2024-04-16T19:38:04.405211+0000","last_fullsized":"2024-04-16T19:38:04.405211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'200","reported_seq":424,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339085+0000","last_change":"2024-04-16T17:45:22.417459+0000","last_active":"2024-04-16T19:38:10.339085+0000","last_peered":"2024-04-16T19:38:10.339085+0000","last_clean":"2024-04-16T19:38:10.339085+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:38:10.339085+0000","last_undegraded":"2024-04-16T19:38:10.339085+0000","last_fullsized":"2024-04-16T19:38:10.339085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.730542+0000","last_change":"2024-04-16T19:38:45.730564+0000","last_active":"2024-04-16T19:38:45.730542+0000","last_peered":"2024-04-16T19:38:45.730542+0000","last_clean":"2024-04-16T19:38:45.730542+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:38:45.730542+0000","last_undegraded":"2024-04-16T19:38:45.730542+0000","last_fullsized":"2024-04-16T19:38:45.730542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.730467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:04.477302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.807488+0000","last_change":"2024-04-16T19:38:36.807512+0000","last_active":"2024-04-16T19:38:36.807488+0000","last_peered":"2024-04-16T19:38:36.807488+0000","last_clean":"2024-04-16T19:38:36.807488+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:38:36.807488+0000","last_undegraded":"2024-04-16T19:38:36.807488+0000","last_fullsized":"2024-04-16T19:38:36.807488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.807410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:01.775567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977344+0000","last_change":"2024-04-16T18:09:02.169539+0000","last_active":"2024-04-16T19:38:08.977344+0000","last_peered":"2024-04-16T19:38:08.977344+0000","last_clean":"2024-04-16T19:38:08.977344+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:38:08.977344+0000","last_undegraded":"2024-04-16T19:38:08.977344+0000","last_fullsized":"2024-04-16T19:38:08.977344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1473,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.397060+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:36:54.397060+0000","last_peered":"2024-04-16T19:36:54.397060+0000","last_clean":"2024-04-16T19:36:54.397060+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:36:54.397060+0000","last_undegraded":"2024-04-16T19:36:54.397060+0000","last_fullsized":"2024-04-16T19:36:54.397060+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.929722+0000","last_change":"2024-04-16T19:38:48.929745+0000","last_active":"2024-04-16T19:38:48.929722+0000","last_peered":"2024-04-16T19:38:48.929722+0000","last_clean":"2024-04-16T19:38:48.929722+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:38:48.929722+0000","last_undegraded":"2024-04-16T19:38:48.929722+0000","last_fullsized":"2024-04-16T19:38:48.929722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.929661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:58.580340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"53'6","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.954955+0000","last_change":"2024-04-16T19:38:42.954988+0000","last_active":"2024-04-16T19:38:42.954955+0000","last_peered":"2024-04-16T19:38:42.954955+0000","last_clean":"2024-04-16T19:38:42.954955+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:38:42.954955+0000","last_undegraded":"2024-04-16T19:38:42.954955+0000","last_fullsized":"2024-04-16T19:38:42.954955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.954892+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:01.753384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.345083+0000","last_change":"2024-04-16T19:38:28.345083+0000","last_active":"2024-04-16T19:38:28.345083+0000","last_peered":"2024-04-16T19:38:28.345083+0000","last_clean":"2024-04-16T19:38:28.345083+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:38:28.345083+0000","last_undegraded":"2024-04-16T19:38:28.345083+0000","last_fullsized":"2024-04-16T19:38:28.345083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.344996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:22.992488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'355","reported_seq":664,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.869936+0000","last_change":"2024-04-16T19:38:12.869936+0000","last_active":"2024-04-16T19:38:12.869936+0000","last_peered":"2024-04-16T19:38:12.869936+0000","last_clean":"2024-04-16T19:38:12.869936+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:38:12.869936+0000","last_undegraded":"2024-04-16T19:38:12.869936+0000","last_fullsized":"2024-04-16T19:38:12.869936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'355","last_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_deep_scrub":"53'355","last_deep_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.869802+0000","objects_scrubbed":17,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:21.665637+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21527,"num_omap_keys":98,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'19","reported_seq":604,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.829535+0000","last_change":"2024-04-16T19:38:08.829535+0000","last_active":"2024-04-16T19:38:08.829535+0000","last_peered":"2024-04-16T19:38:08.829535+0000","last_clean":"2024-04-16T19:38:08.829535+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:38:08.829535+0000","last_undegraded":"2024-04-16T19:38:08.829535+0000","last_fullsized":"2024-04-16T19:38:08.829535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'19","last_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_deep_scrub":"53'19","last_deep_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.829450+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:30.796211+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.402962+0000","last_change":"2024-04-16T17:45:10.402167+0000","last_active":"2024-04-16T19:37:54.402962+0000","last_peered":"2024-04-16T19:37:54.402962+0000","last_clean":"2024-04-16T19:37:54.402962+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:37:54.402962+0000","last_undegraded":"2024-04-16T19:37:54.402962+0000","last_fullsized":"2024-04-16T19:37:54.402962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401152+0000","last_change":"2024-04-16T17:45:08.388824+0000","last_active":"2024-04-16T19:37:39.401152+0000","last_peered":"2024-04-16T19:37:39.401152+0000","last_clean":"2024-04-16T19:37:39.401152+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:37:39.401152+0000","last_undegraded":"2024-04-16T19:37:39.401152+0000","last_fullsized":"2024-04-16T19:37:39.401152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597777+0000","last_change":"2024-04-16T17:45:20.407298+0000","last_active":"2024-04-16T19:38:04.597777+0000","last_peered":"2024-04-16T19:38:04.597777+0000","last_clean":"2024-04-16T19:38:04.597777+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:38:04.597777+0000","last_undegraded":"2024-04-16T19:38:04.597777+0000","last_fullsized":"2024-04-16T19:38:04.597777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'80","reported_seq":242,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595753+0000","last_change":"2024-04-16T17:45:22.422669+0000","last_active":"2024-04-16T19:37:54.595753+0000","last_peered":"2024-04-16T19:37:54.595753+0000","last_clean":"2024-04-16T19:37:54.595753+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:37:54.595753+0000","last_undegraded":"2024-04-16T19:37:54.595753+0000","last_fullsized":"2024-04-16T19:37:54.595753+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.960739+0000","last_change":"2024-04-16T19:38:46.960762+0000","last_active":"2024-04-16T19:38:46.960739+0000","last_peered":"2024-04-16T19:38:46.960739+0000","last_clean":"2024-04-16T19:38:46.960739+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:38:46.960739+0000","last_undegraded":"2024-04-16T19:38:46.960739+0000","last_fullsized":"2024-04-16T19:38:46.960739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.960675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:21.934955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.329000+0000","last_change":"2024-04-16T19:38:45.329022+0000","last_active":"2024-04-16T19:38:45.329000+0000","last_peered":"2024-04-16T19:38:45.329000+0000","last_clean":"2024-04-16T19:38:45.329000+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:38:45.329000+0000","last_undegraded":"2024-04-16T19:38:45.329000+0000","last_fullsized":"2024-04-16T19:38:45.329000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.328934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:07.148341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429923+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:38:09.429923+0000","last_peered":"2024-04-16T19:38:09.429923+0000","last_clean":"2024-04-16T19:38:09.429923+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:38:09.429923+0000","last_undegraded":"2024-04-16T19:38:09.429923+0000","last_fullsized":"2024-04-16T19:38:09.429923+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'168","reported_seq":2644,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.988098+0000","last_change":"2024-04-16T19:38:44.988151+0000","last_active":"2024-04-16T19:38:44.988098+0000","last_peered":"2024-04-16T19:38:44.988098+0000","last_clean":"2024-04-16T19:38:44.988098+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:38:44.988098+0000","last_undegraded":"2024-04-16T19:38:44.988098+0000","last_fullsized":"2024-04-16T19:38:44.988098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'168","last_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_deep_scrub":"53'168","last_deep_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.988038+0000","objects_scrubbed":48,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:15.308723+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9452,"num_omap_keys":38,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.351134+0000","last_change":"2024-04-16T19:38:48.351134+0000","last_active":"2024-04-16T19:38:48.351134+0000","last_peered":"2024-04-16T19:38:48.351134+0000","last_clean":"2024-04-16T19:38:48.351134+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:38:48.351134+0000","last_undegraded":"2024-04-16T19:38:48.351134+0000","last_fullsized":"2024-04-16T19:38:48.351134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.351012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:56.344801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'23","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.995773+0000","last_change":"2024-04-16T19:38:43.995808+0000","last_active":"2024-04-16T19:38:43.995773+0000","last_peered":"2024-04-16T19:38:43.995773+0000","last_clean":"2024-04-16T19:38:43.995773+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:38:43.995773+0000","last_undegraded":"2024-04-16T19:38:43.995773+0000","last_fullsized":"2024-04-16T19:38:43.995773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.995709+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:23.117614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.514936+0000","last_change":"2024-04-16T19:38:16.514936+0000","last_active":"2024-04-16T19:38:16.514936+0000","last_peered":"2024-04-16T19:38:16.514936+0000","last_clean":"2024-04-16T19:38:16.514936+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:38:16.514936+0000","last_undegraded":"2024-04-16T19:38:16.514936+0000","last_fullsized":"2024-04-16T19:38:16.514936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.514815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:31:12.328836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'933","reported_seq":3835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.408460+0000","last_change":"2024-04-16T19:38:24.408514+0000","last_active":"2024-04-16T19:38:24.408460+0000","last_peered":"2024-04-16T19:38:24.408460+0000","last_clean":"2024-04-16T19:38:24.408460+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:38:24.408460+0000","last_undegraded":"2024-04-16T19:38:24.408460+0000","last_fullsized":"2024-04-16T19:38:24.408460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'933","last_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_deep_scrub":"53'933","last_deep_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.408381+0000","objects_scrubbed":26,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:46.227789+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13193,"num_omap_keys":66,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'24","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.811180+0000","last_change":"2024-04-16T19:38:19.811180+0000","last_active":"2024-04-16T19:38:19.811180+0000","last_peered":"2024-04-16T19:38:19.811180+0000","last_clean":"2024-04-16T19:38:19.811180+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:38:19.811180+0000","last_undegraded":"2024-04-16T19:38:19.811180+0000","last_fullsized":"2024-04-16T19:38:19.811180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.811061+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:19.180605+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338768+0000","last_change":"2024-04-16T17:45:10.394156+0000","last_active":"2024-04-16T19:38:10.338768+0000","last_peered":"2024-04-16T19:38:10.338768+0000","last_clean":"2024-04-16T19:38:10.338768+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:38:10.338768+0000","last_undegraded":"2024-04-16T19:38:10.338768+0000","last_fullsized":"2024-04-16T19:38:10.338768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795461+0000","last_change":"2024-04-16T19:38:33.795461+0000","last_active":"2024-04-16T19:38:33.795461+0000","last_peered":"2024-04-16T19:38:33.795461+0000","last_clean":"2024-04-16T19:38:33.795461+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:38:33.795461+0000","last_undegraded":"2024-04-16T19:38:33.795461+0000","last_fullsized":"2024-04-16T19:38:33.795461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:47.763767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595764+0000","last_change":"2024-04-16T17:45:20.408040+0000","last_active":"2024-04-16T19:37:54.595764+0000","last_peered":"2024-04-16T19:37:54.595764+0000","last_clean":"2024-04-16T19:37:54.595764+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:37:54.595764+0000","last_undegraded":"2024-04-16T19:37:54.595764+0000","last_fullsized":"2024-04-16T19:37:54.595764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'152","reported_seq":352,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405405+0000","last_change":"2024-04-16T17:45:22.415394+0000","last_active":"2024-04-16T19:38:04.405405+0000","last_peered":"2024-04-16T19:38:04.405405+0000","last_clean":"2024-04-16T19:38:04.405405+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:38:04.405405+0000","last_undegraded":"2024-04-16T19:38:04.405405+0000","last_fullsized":"2024-04-16T19:38:04.405405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'12","reported_seq":1394,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408525+0000","last_change":"2024-04-16T17:45:24.424024+0000","last_active":"2024-04-16T19:38:04.408525+0000","last_peered":"2024-04-16T19:38:04.408525+0000","last_clean":"2024-04-16T19:38:04.408525+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:38:04.408525+0000","last_undegraded":"2024-04-16T19:38:04.408525+0000","last_fullsized":"2024-04-16T19:38:04.408525+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.361374+0000","last_change":"2024-04-16T19:38:31.361394+0000","last_active":"2024-04-16T19:38:31.361374+0000","last_peered":"2024-04-16T19:38:31.361374+0000","last_clean":"2024-04-16T19:38:31.361374+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:38:31.361374+0000","last_undegraded":"2024-04-16T19:38:31.361374+0000","last_fullsized":"2024-04-16T19:38:31.361374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.361320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:12.965762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588489+0000","last_change":"2024-04-16T18:09:02.168408+0000","last_active":"2024-04-16T19:37:19.588489+0000","last_peered":"2024-04-16T19:37:19.588489+0000","last_clean":"2024-04-16T19:37:19.588489+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:37:19.588489+0000","last_undegraded":"2024-04-16T19:37:19.588489+0000","last_fullsized":"2024-04-16T19:37:19.588489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'164","reported_seq":2349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583511+0000","last_change":"2024-04-16T17:46:25.526845+0000","last_active":"2024-04-16T19:36:54.583511+0000","last_peered":"2024-04-16T19:36:54.583511+0000","last_clean":"2024-04-16T19:36:54.583511+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:36:54.583511+0000","last_undegraded":"2024-04-16T19:36:54.583511+0000","last_fullsized":"2024-04-16T19:36:54.583511+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.792912+0000","last_change":"2024-04-16T19:38:43.792912+0000","last_active":"2024-04-16T19:38:43.792912+0000","last_peered":"2024-04-16T19:38:43.792912+0000","last_clean":"2024-04-16T19:38:43.792912+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:38:43.792912+0000","last_undegraded":"2024-04-16T19:38:43.792912+0000","last_fullsized":"2024-04-16T19:38:43.792912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.792826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:02.586806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'25","reported_seq":153,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.332961+0000","last_change":"2024-04-16T19:38:45.333002+0000","last_active":"2024-04-16T19:38:45.332961+0000","last_peered":"2024-04-16T19:38:45.332961+0000","last_clean":"2024-04-16T19:38:45.332961+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:38:45.332961+0000","last_undegraded":"2024-04-16T19:38:45.332961+0000","last_fullsized":"2024-04-16T19:38:45.332961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.332898+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:29.252852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.794605+0000","last_change":"2024-04-16T19:38:38.794628+0000","last_active":"2024-04-16T19:38:38.794605+0000","last_peered":"2024-04-16T19:38:38.794605+0000","last_clean":"2024-04-16T19:38:38.794605+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:38:38.794605+0000","last_undegraded":"2024-04-16T19:38:38.794605+0000","last_fullsized":"2024-04-16T19:38:38.794605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.794540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:20.398982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'620","reported_seq":3264,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.073025+0000","last_change":"2024-04-16T19:38:11.073025+0000","last_active":"2024-04-16T19:38:11.073025+0000","last_peered":"2024-04-16T19:38:11.073025+0000","last_clean":"2024-04-16T19:38:11.073025+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:38:11.073025+0000","last_undegraded":"2024-04-16T19:38:11.073025+0000","last_fullsized":"2024-04-16T19:38:11.073025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'620","last_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_deep_scrub":"53'620","last_deep_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.072941+0000","objects_scrubbed":28,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:29.251802+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7883,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'29","reported_seq":356,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.759701+0000","last_change":"2024-04-16T19:38:28.759701+0000","last_active":"2024-04-16T19:38:28.759701+0000","last_peered":"2024-04-16T19:38:28.759701+0000","last_clean":"2024-04-16T19:38:28.759701+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:38:28.759701+0000","last_undegraded":"2024-04-16T19:38:28.759701+0000","last_fullsized":"2024-04-16T19:38:28.759701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'29","last_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_deep_scrub":"53'29","last_deep_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.759592+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:37.264543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405163+0000","last_change":"2024-04-16T17:45:10.392991+0000","last_active":"2024-04-16T19:37:44.405163+0000","last_peered":"2024-04-16T19:37:44.405163+0000","last_clean":"2024-04-16T19:37:44.405163+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:37:44.405163+0000","last_undegraded":"2024-04-16T19:37:44.405163+0000","last_fullsized":"2024-04-16T19:37:44.405163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401068+0000","last_change":"2024-04-16T17:45:08.387422+0000","last_active":"2024-04-16T19:37:39.401068+0000","last_peered":"2024-04-16T19:37:39.401068+0000","last_clean":"2024-04-16T19:37:39.401068+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:37:39.401068+0000","last_undegraded":"2024-04-16T19:37:39.401068+0000","last_fullsized":"2024-04-16T19:37:39.401068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"48'3","reported_seq":184,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976489+0000","last_change":"2024-04-16T17:45:20.412558+0000","last_active":"2024-04-16T19:38:08.976489+0000","last_peered":"2024-04-16T19:38:08.976489+0000","last_clean":"2024-04-16T19:38:08.976489+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:38:08.976489+0000","last_undegraded":"2024-04-16T19:38:08.976489+0000","last_fullsized":"2024-04-16T19:38:08.976489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'88","reported_seq":261,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408498+0000","last_change":"2024-04-16T17:45:22.414488+0000","last_active":"2024-04-16T19:38:04.408498+0000","last_peered":"2024-04-16T19:38:04.408498+0000","last_clean":"2024-04-16T19:38:04.408498+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:38:04.408498+0000","last_undegraded":"2024-04-16T19:38:04.408498+0000","last_fullsized":"2024-04-16T19:38:04.408498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597809+0000","last_change":"2024-04-16T17:45:24.422626+0000","last_active":"2024-04-16T19:38:04.597809+0000","last_peered":"2024-04-16T19:38:04.597809+0000","last_clean":"2024-04-16T19:38:04.597809+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:38:04.597809+0000","last_undegraded":"2024-04-16T19:38:04.597809+0000","last_fullsized":"2024-04-16T19:38:04.597809+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.759633+0000","last_change":"2024-04-16T19:38:27.759655+0000","last_active":"2024-04-16T19:38:27.759633+0000","last_peered":"2024-04-16T19:38:27.759633+0000","last_clean":"2024-04-16T19:38:27.759633+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:38:27.759633+0000","last_undegraded":"2024-04-16T19:38:27.759633+0000","last_fullsized":"2024-04-16T19:38:27.759633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.759568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:42.585548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596023+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:37:54.596023+0000","last_peered":"2024-04-16T19:37:54.596023+0000","last_clean":"2024-04-16T19:37:54.596023+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:37:54.596023+0000","last_undegraded":"2024-04-16T19:37:54.596023+0000","last_fullsized":"2024-04-16T19:37:54.596023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'131","reported_seq":1906,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.397930+0000","last_change":"2024-04-16T17:46:25.527139+0000","last_active":"2024-04-16T19:36:59.397930+0000","last_peered":"2024-04-16T19:36:59.397930+0000","last_clean":"2024-04-16T19:36:59.397930+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:36:59.397930+0000","last_undegraded":"2024-04-16T19:36:59.397930+0000","last_fullsized":"2024-04-16T19:36:59.397930+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.571585+0000","last_change":"2024-04-16T19:38:24.571609+0000","last_active":"2024-04-16T19:38:24.571585+0000","last_peered":"2024-04-16T19:38:24.571585+0000","last_clean":"2024-04-16T19:38:24.571585+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:38:24.571585+0000","last_undegraded":"2024-04-16T19:38:24.571585+0000","last_fullsized":"2024-04-16T19:38:24.571585+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.571519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:55.147346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'13","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.847919+0000","last_change":"2024-04-16T19:38:48.847948+0000","last_active":"2024-04-16T19:38:48.847919+0000","last_peered":"2024-04-16T19:38:48.847919+0000","last_clean":"2024-04-16T19:38:48.847919+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:38:48.847919+0000","last_undegraded":"2024-04-16T19:38:48.847919+0000","last_fullsized":"2024-04-16T19:38:48.847919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.847863+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:18.385433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'651","reported_seq":2205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429517+0000","last_change":"2024-04-16T17:45:49.472107+0000","last_active":"2024-04-16T19:38:09.429517+0000","last_peered":"2024-04-16T19:38:09.429517+0000","last_clean":"2024-04-16T19:38:09.429517+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:38:09.429517+0000","last_undegraded":"2024-04-16T19:38:09.429517+0000","last_fullsized":"2024-04-16T19:38:09.429517+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":651,"log_dups_size":0,"ondisk_log_size":651,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'328","reported_seq":608,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.821880+0000","last_change":"2024-04-16T19:38:14.821880+0000","last_active":"2024-04-16T19:38:14.821880+0000","last_peered":"2024-04-16T19:38:14.821880+0000","last_clean":"2024-04-16T19:38:14.821880+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:38:14.821880+0000","last_undegraded":"2024-04-16T19:38:14.821880+0000","last_fullsized":"2024-04-16T19:38:14.821880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'328","last_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_deep_scrub":"53'328","last_deep_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.821710+0000","objects_scrubbed":22,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:27.374369+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14461,"num_omap_keys":66,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'12","reported_seq":557,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.221422+0000","last_change":"2024-04-16T19:38:14.221422+0000","last_active":"2024-04-16T19:38:14.221422+0000","last_peered":"2024-04-16T19:38:14.221422+0000","last_clean":"2024-04-16T19:38:14.221422+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:38:14.221422+0000","last_undegraded":"2024-04-16T19:38:14.221422+0000","last_fullsized":"2024-04-16T19:38:14.221422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.221299+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:29.047279+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401632+0000","last_change":"2024-04-16T17:45:10.402046+0000","last_active":"2024-04-16T19:37:44.401632+0000","last_peered":"2024-04-16T19:37:44.401632+0000","last_clean":"2024-04-16T19:37:44.401632+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:37:44.401632+0000","last_undegraded":"2024-04-16T19:37:44.401632+0000","last_fullsized":"2024-04-16T19:37:44.401632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592657+0000","last_change":"2024-04-16T17:45:08.384395+0000","last_active":"2024-04-16T19:37:39.592657+0000","last_peered":"2024-04-16T19:37:39.592657+0000","last_clean":"2024-04-16T19:37:39.592657+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:37:39.592657+0000","last_undegraded":"2024-04-16T19:37:39.592657+0000","last_fullsized":"2024-04-16T19:37:39.592657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"30'3","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595823+0000","last_change":"2024-04-16T17:45:20.406255+0000","last_active":"2024-04-16T19:37:54.595823+0000","last_peered":"2024-04-16T19:37:54.595823+0000","last_clean":"2024-04-16T19:37:54.595823+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:37:54.595823+0000","last_undegraded":"2024-04-16T19:37:54.595823+0000","last_fullsized":"2024-04-16T19:37:54.595823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'104","reported_seq":278,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403163+0000","last_change":"2024-04-16T17:45:22.416167+0000","last_active":"2024-04-16T19:37:54.403163+0000","last_peered":"2024-04-16T19:37:54.403163+0000","last_clean":"2024-04-16T19:37:54.403163+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:37:54.403163+0000","last_undegraded":"2024-04-16T19:37:54.403163+0000","last_fullsized":"2024-04-16T19:37:54.403163+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069167+0000","last_change":"2024-04-16T17:45:24.422761+0000","last_active":"2024-04-16T19:38:08.069167+0000","last_peered":"2024-04-16T19:38:08.069167+0000","last_clean":"2024-04-16T19:38:08.069167+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:38:08.069167+0000","last_undegraded":"2024-04-16T19:38:08.069167+0000","last_fullsized":"2024-04-16T19:38:08.069167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.698520+0000","last_change":"2024-04-16T19:38:40.698543+0000","last_active":"2024-04-16T19:38:40.698520+0000","last_peered":"2024-04-16T19:38:40.698520+0000","last_clean":"2024-04-16T19:38:40.698520+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:38:40.698520+0000","last_undegraded":"2024-04-16T19:38:40.698520+0000","last_fullsized":"2024-04-16T19:38:40.698520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.698456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:35.601090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407078+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:37:54.407078+0000","last_peered":"2024-04-16T19:37:54.407078+0000","last_clean":"2024-04-16T19:37:54.407078+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:37:54.407078+0000","last_undegraded":"2024-04-16T19:37:54.407078+0000","last_fullsized":"2024-04-16T19:37:54.407078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'156","reported_seq":2123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395577+0000","last_change":"2024-04-16T17:46:25.522062+0000","last_active":"2024-04-16T19:36:59.395577+0000","last_peered":"2024-04-16T19:36:59.395577+0000","last_clean":"2024-04-16T19:36:59.395577+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:36:59.395577+0000","last_undegraded":"2024-04-16T19:36:59.395577+0000","last_fullsized":"2024-04-16T19:36:59.395577+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340208+0000","last_change":"2024-04-16T17:46:17.511574+0000","last_active":"2024-04-16T19:38:10.340208+0000","last_peered":"2024-04-16T19:38:10.340208+0000","last_clean":"2024-04-16T19:38:10.340208+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:38:10.340208+0000","last_undegraded":"2024-04-16T19:38:10.340208+0000","last_fullsized":"2024-04-16T19:38:10.340208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'148","reported_seq":341,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.921604+0000","last_change":"2024-04-16T19:38:45.921641+0000","last_active":"2024-04-16T19:38:45.921604+0000","last_peered":"2024-04-16T19:38:45.921604+0000","last_clean":"2024-04-16T19:38:45.921604+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:38:45.921604+0000","last_undegraded":"2024-04-16T19:38:45.921604+0000","last_fullsized":"2024-04-16T19:38:45.921604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'148","last_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_deep_scrub":"53'148","last_deep_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.921535+0000","objects_scrubbed":4,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:26.250123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9535,"num_omap_keys":55,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.087323+0000","last_change":"2024-04-16T19:38:15.087323+0000","last_active":"2024-04-16T19:38:15.087323+0000","last_peered":"2024-04-16T19:38:15.087323+0000","last_clean":"2024-04-16T19:38:15.087323+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:38:15.087323+0000","last_undegraded":"2024-04-16T19:38:15.087323+0000","last_fullsized":"2024-04-16T19:38:15.087323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.087231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:14:00.509056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'845","reported_seq":1835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.089179+0000","last_change":"2024-04-16T19:38:10.089179+0000","last_active":"2024-04-16T19:38:10.089179+0000","last_peered":"2024-04-16T19:38:10.089179+0000","last_clean":"2024-04-16T19:38:10.089179+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:38:10.089179+0000","last_undegraded":"2024-04-16T19:38:10.089179+0000","last_fullsized":"2024-04-16T19:38:10.089179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'845","last_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_deep_scrub":"53'845","last_deep_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.089105+0000","objects_scrubbed":25,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:33.799326+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7064,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'8","reported_seq":283,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.784403+0000","last_change":"2024-04-16T19:38:13.784444+0000","last_active":"2024-04-16T19:38:13.784403+0000","last_peered":"2024-04-16T19:38:13.784403+0000","last_clean":"2024-04-16T19:38:13.784403+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:38:13.784403+0000","last_undegraded":"2024-04-16T19:38:13.784403+0000","last_fullsized":"2024-04-16T19:38:13.784403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.784341+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:20.950710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402655+0000","last_change":"2024-04-16T17:45:10.387439+0000","last_active":"2024-04-16T19:37:44.402655+0000","last_peered":"2024-04-16T19:37:44.402655+0000","last_clean":"2024-04-16T19:37:44.402655+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:37:44.402655+0000","last_undegraded":"2024-04-16T19:37:44.402655+0000","last_fullsized":"2024-04-16T19:37:44.402655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.406405+0000","last_change":"2024-04-16T17:45:08.386819+0000","last_active":"2024-04-16T19:38:09.406405+0000","last_peered":"2024-04-16T19:38:09.406405+0000","last_clean":"2024-04-16T19:38:09.406405+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:38:09.406405+0000","last_undegraded":"2024-04-16T19:38:09.406405+0000","last_fullsized":"2024-04-16T19:38:09.406405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"48'13","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595838+0000","last_change":"2024-04-16T17:45:20.413420+0000","last_active":"2024-04-16T19:37:54.595838+0000","last_peered":"2024-04-16T19:37:54.595838+0000","last_clean":"2024-04-16T19:37:54.595838+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:37:54.595838+0000","last_undegraded":"2024-04-16T19:37:54.595838+0000","last_fullsized":"2024-04-16T19:37:54.595838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'152","reported_seq":350,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976594+0000","last_change":"2024-04-16T17:45:22.414344+0000","last_active":"2024-04-16T19:38:08.976594+0000","last_peered":"2024-04-16T19:38:08.976594+0000","last_clean":"2024-04-16T19:38:08.976594+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:38:08.976594+0000","last_undegraded":"2024-04-16T19:38:08.976594+0000","last_fullsized":"2024-04-16T19:38:08.976594+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.920197+0000","last_change":"2024-04-16T19:38:45.920222+0000","last_active":"2024-04-16T19:38:45.920197+0000","last_peered":"2024-04-16T19:38:45.920197+0000","last_clean":"2024-04-16T19:38:45.920197+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:38:45.920197+0000","last_undegraded":"2024-04-16T19:38:45.920197+0000","last_fullsized":"2024-04-16T19:38:45.920197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.920132+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:59.970112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.699740+0000","last_change":"2024-04-16T19:38:44.699765+0000","last_active":"2024-04-16T19:38:44.699740+0000","last_peered":"2024-04-16T19:38:44.699740+0000","last_clean":"2024-04-16T19:38:44.699740+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:38:44.699740+0000","last_undegraded":"2024-04-16T19:38:44.699740+0000","last_fullsized":"2024-04-16T19:38:44.699740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.699672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:23.487178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":59,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.394209+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:36:49.394209+0000","last_peered":"2024-04-16T19:36:49.394209+0000","last_clean":"2024-04-16T19:36:49.394209+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:36:49.394209+0000","last_undegraded":"2024-04-16T19:36:49.394209+0000","last_fullsized":"2024-04-16T19:36:49.394209+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'84","reported_seq":1608,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.395002+0000","last_change":"2024-04-16T17:46:25.527208+0000","last_active":"2024-04-16T19:36:54.395002+0000","last_peered":"2024-04-16T19:36:54.395002+0000","last_clean":"2024-04-16T19:36:54.395002+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:36:54.395002+0000","last_undegraded":"2024-04-16T19:36:54.395002+0000","last_fullsized":"2024-04-16T19:36:54.395002+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.394330+0000","last_change":"2024-04-16T17:46:17.513992+0000","last_active":"2024-04-16T19:36:49.394330+0000","last_peered":"2024-04-16T19:36:49.394330+0000","last_clean":"2024-04-16T19:36:49.394330+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:36:49.394330+0000","last_undegraded":"2024-04-16T19:36:49.394330+0000","last_fullsized":"2024-04-16T19:36:49.394330+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'23","reported_seq":165,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.788363+0000","last_change":"2024-04-16T19:38:36.788402+0000","last_active":"2024-04-16T19:38:36.788363+0000","last_peered":"2024-04-16T19:38:36.788363+0000","last_clean":"2024-04-16T19:38:36.788363+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:38:36.788363+0000","last_undegraded":"2024-04-16T19:38:36.788363+0000","last_fullsized":"2024-04-16T19:38:36.788363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.788299+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:50.210568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.516924+0000","last_change":"2024-04-16T19:38:22.516949+0000","last_active":"2024-04-16T19:38:22.516924+0000","last_peered":"2024-04-16T19:38:22.516924+0000","last_clean":"2024-04-16T19:38:22.516924+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:38:22.516924+0000","last_undegraded":"2024-04-16T19:38:22.516924+0000","last_fullsized":"2024-04-16T19:38:22.516924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.516860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:29.683230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'556","reported_seq":948,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.745464+0000","last_change":"2024-04-16T19:38:10.745507+0000","last_active":"2024-04-16T19:38:10.745464+0000","last_peered":"2024-04-16T19:38:10.745464+0000","last_clean":"2024-04-16T19:38:10.745464+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:38:10.745464+0000","last_undegraded":"2024-04-16T19:38:10.745464+0000","last_fullsized":"2024-04-16T19:38:10.745464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'556","last_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_deep_scrub":"53'556","last_deep_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.745406+0000","objects_scrubbed":30,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:38:44.014095+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56852,"num_omap_keys":197,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'20","reported_seq":403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.950663+0000","last_change":"2024-04-16T19:38:18.950663+0000","last_active":"2024-04-16T19:38:18.950663+0000","last_peered":"2024-04-16T19:38:18.950663+0000","last_clean":"2024-04-16T19:38:18.950663+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:38:18.950663+0000","last_undegraded":"2024-04-16T19:38:18.950663+0000","last_fullsized":"2024-04-16T19:38:18.950663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.950543+0000","objects_scrubbed":10,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:35:43.149409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401690+0000","last_change":"2024-04-16T17:45:10.394926+0000","last_active":"2024-04-16T19:37:44.401690+0000","last_peered":"2024-04-16T19:37:44.401690+0000","last_clean":"2024-04-16T19:37:44.401690+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:37:44.401690+0000","last_undegraded":"2024-04-16T19:37:44.401690+0000","last_fullsized":"2024-04-16T19:37:44.401690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402279+0000","last_change":"2024-04-16T17:45:08.382545+0000","last_active":"2024-04-16T19:37:49.402279+0000","last_peered":"2024-04-16T19:37:49.402279+0000","last_clean":"2024-04-16T19:37:49.402279+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:37:49.402279+0000","last_undegraded":"2024-04-16T19:37:49.402279+0000","last_fullsized":"2024-04-16T19:37:49.402279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"48'17","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339006+0000","last_change":"2024-04-16T17:45:20.412524+0000","last_active":"2024-04-16T19:38:10.339006+0000","last_peered":"2024-04-16T19:38:10.339006+0000","last_clean":"2024-04-16T19:38:10.339006+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:38:10.339006+0000","last_undegraded":"2024-04-16T19:38:10.339006+0000","last_fullsized":"2024-04-16T19:38:10.339006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'120","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595888+0000","last_change":"2024-04-16T17:45:22.414750+0000","last_active":"2024-04-16T19:37:54.595888+0000","last_peered":"2024-04-16T19:37:54.595888+0000","last_clean":"2024-04-16T19:37:54.595888+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:37:54.595888+0000","last_undegraded":"2024-04-16T19:37:54.595888+0000","last_fullsized":"2024-04-16T19:37:54.595888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.371464+0000","last_change":"2024-04-16T19:38:48.371504+0000","last_active":"2024-04-16T19:38:48.371464+0000","last_peered":"2024-04-16T19:38:48.371464+0000","last_clean":"2024-04-16T19:38:48.371464+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:38:48.371464+0000","last_undegraded":"2024-04-16T19:38:48.371464+0000","last_fullsized":"2024-04-16T19:38:48.371464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.371402+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:08.229885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.304929+0000","last_change":"2024-04-16T19:38:44.304973+0000","last_active":"2024-04-16T19:38:44.304929+0000","last_peered":"2024-04-16T19:38:44.304929+0000","last_clean":"2024-04-16T19:38:44.304929+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:38:44.304929+0000","last_undegraded":"2024-04-16T19:38:44.304929+0000","last_fullsized":"2024-04-16T19:38:44.304929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.304852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:02.982475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524613+0000","last_change":"2024-04-16T18:09:02.169496+0000","last_active":"2024-04-16T19:38:08.524613+0000","last_peered":"2024-04-16T19:38:08.524613+0000","last_clean":"2024-04-16T19:38:08.524613+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:38:08.524613+0000","last_undegraded":"2024-04-16T19:38:08.524613+0000","last_fullsized":"2024-04-16T19:38:08.524613+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'130","reported_seq":1977,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.400285+0000","last_change":"2024-04-16T17:46:25.525792+0000","last_active":"2024-04-16T19:37:14.400285+0000","last_peered":"2024-04-16T19:37:14.400285+0000","last_clean":"2024-04-16T19:37:14.400285+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:37:14.400285+0000","last_undegraded":"2024-04-16T19:37:14.400285+0000","last_fullsized":"2024-04-16T19:37:14.400285+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.968496+0000","last_change":"2024-04-16T19:38:44.968540+0000","last_active":"2024-04-16T19:38:44.968496+0000","last_peered":"2024-04-16T19:38:44.968496+0000","last_clean":"2024-04-16T19:38:44.968496+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:38:44.968496+0000","last_undegraded":"2024-04-16T19:38:44.968496+0000","last_fullsized":"2024-04-16T19:38:44.968496+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.968404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:05.438509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'21","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.778353+0000","last_change":"2024-04-16T19:38:37.778410+0000","last_active":"2024-04-16T19:38:37.778353+0000","last_peered":"2024-04-16T19:38:37.778353+0000","last_clean":"2024-04-16T19:38:37.778353+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:38:37.778353+0000","last_undegraded":"2024-04-16T19:38:37.778353+0000","last_fullsized":"2024-04-16T19:38:37.778353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.778277+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:55.312669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.762332+0000","last_change":"2024-04-16T19:38:20.762362+0000","last_active":"2024-04-16T19:38:20.762332+0000","last_peered":"2024-04-16T19:38:20.762332+0000","last_clean":"2024-04-16T19:38:20.762332+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:38:20.762332+0000","last_undegraded":"2024-04-16T19:38:20.762332+0000","last_fullsized":"2024-04-16T19:38:20.762332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.762267+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:32.587575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'447","reported_seq":743,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.567084+0000","last_change":"2024-04-16T19:38:15.567084+0000","last_active":"2024-04-16T19:38:15.567084+0000","last_peered":"2024-04-16T19:38:15.567084+0000","last_clean":"2024-04-16T19:38:15.567084+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:38:15.567084+0000","last_undegraded":"2024-04-16T19:38:15.567084+0000","last_fullsized":"2024-04-16T19:38:15.567084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'447","last_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_deep_scrub":"53'447","last_deep_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.566947+0000","objects_scrubbed":23,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:08.446790+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7264,"num_omap_keys":33,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'38","reported_seq":544,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.770259+0000","last_change":"2024-04-16T19:38:19.770333+0000","last_active":"2024-04-16T19:38:19.770259+0000","last_peered":"2024-04-16T19:38:19.770259+0000","last_clean":"2024-04-16T19:38:19.770259+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:38:19.770259+0000","last_undegraded":"2024-04-16T19:38:19.770259+0000","last_fullsized":"2024-04-16T19:38:19.770259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'38","last_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_deep_scrub":"53'38","last_deep_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.770195+0000","objects_scrubbed":10,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:32.489397+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.117330+0000","last_change":"2024-04-16T19:38:25.117354+0000","last_active":"2024-04-16T19:38:25.117330+0000","last_peered":"2024-04-16T19:38:25.117330+0000","last_clean":"2024-04-16T19:38:25.117330+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:38:25.117330+0000","last_undegraded":"2024-04-16T19:38:25.117330+0000","last_fullsized":"2024-04-16T19:38:25.117330+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.117265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594561+0000","last_change":"2024-04-16T17:45:08.381995+0000","last_active":"2024-04-16T19:37:49.594561+0000","last_peered":"2024-04-16T19:37:49.594561+0000","last_clean":"2024-04-16T19:37:49.594561+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:37:49.594561+0000","last_undegraded":"2024-04-16T19:37:49.594561+0000","last_fullsized":"2024-04-16T19:37:49.594561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404067+0000","last_change":"2024-04-16T17:45:20.407642+0000","last_active":"2024-04-16T19:37:54.404067+0000","last_peered":"2024-04-16T19:37:54.404067+0000","last_clean":"2024-04-16T19:37:54.404067+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:37:54.404067+0000","last_undegraded":"2024-04-16T19:37:54.404067+0000","last_fullsized":"2024-04-16T19:37:54.404067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'176","reported_seq":386,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403681+0000","last_change":"2024-04-16T17:45:22.414672+0000","last_active":"2024-04-16T19:37:54.403681+0000","last_peered":"2024-04-16T19:37:54.403681+0000","last_clean":"2024-04-16T19:37:54.403681+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:37:54.403681+0000","last_undegraded":"2024-04-16T19:37:54.403681+0000","last_fullsized":"2024-04-16T19:37:54.403681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404028+0000","last_change":"2024-04-16T17:45:24.425728+0000","last_active":"2024-04-16T19:37:54.404028+0000","last_peered":"2024-04-16T19:37:54.404028+0000","last_clean":"2024-04-16T19:37:54.404028+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:37:54.404028+0000","last_undegraded":"2024-04-16T19:37:54.404028+0000","last_fullsized":"2024-04-16T19:37:54.404028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.718631+0000","last_change":"2024-04-16T19:38:41.718655+0000","last_active":"2024-04-16T19:38:41.718631+0000","last_peered":"2024-04-16T19:38:41.718631+0000","last_clean":"2024-04-16T19:38:41.718631+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:38:41.718631+0000","last_undegraded":"2024-04-16T19:38:41.718631+0000","last_fullsized":"2024-04-16T19:38:41.718631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.718567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:36.366059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582600+0000","last_change":"2024-04-16T18:09:02.173431+0000","last_active":"2024-04-16T19:36:49.582600+0000","last_peered":"2024-04-16T19:36:49.582600+0000","last_clean":"2024-04-16T19:36:49.582600+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:36:49.582600+0000","last_undegraded":"2024-04-16T19:36:49.582600+0000","last_fullsized":"2024-04-16T19:36:49.582600+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'117","reported_seq":1948,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.395352+0000","last_change":"2024-04-16T17:46:25.530014+0000","last_active":"2024-04-16T19:37:04.395352+0000","last_peered":"2024-04-16T19:37:04.395352+0000","last_clean":"2024-04-16T19:37:04.395352+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:37:04.395352+0000","last_undegraded":"2024-04-16T19:37:04.395352+0000","last_fullsized":"2024-04-16T19:37:04.395352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.747274+0000","last_change":"2024-04-16T19:38:38.747274+0000","last_active":"2024-04-16T19:38:38.747274+0000","last_peered":"2024-04-16T19:38:38.747274+0000","last_clean":"2024-04-16T19:38:38.747274+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:38:38.747274+0000","last_undegraded":"2024-04-16T19:38:38.747274+0000","last_fullsized":"2024-04-16T19:38:38.747274+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.747176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:44.763682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'30","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.513984+0000","last_change":"2024-04-16T19:38:29.514047+0000","last_active":"2024-04-16T19:38:29.513984+0000","last_peered":"2024-04-16T19:38:29.513984+0000","last_clean":"2024-04-16T19:38:29.513984+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:38:29.513984+0000","last_undegraded":"2024-04-16T19:38:29.513984+0000","last_fullsized":"2024-04-16T19:38:29.513984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'30","last_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_deep_scrub":"53'30","last_deep_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.513910+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:38.309746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.764970+0000","last_change":"2024-04-16T19:38:22.764970+0000","last_active":"2024-04-16T19:38:22.764970+0000","last_peered":"2024-04-16T19:38:22.764970+0000","last_clean":"2024-04-16T19:38:22.764970+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:38:22.764970+0000","last_undegraded":"2024-04-16T19:38:22.764970+0000","last_fullsized":"2024-04-16T19:38:22.764970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.764883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:30.765316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'305","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.819258+0000","last_change":"2024-04-16T19:38:16.819258+0000","last_active":"2024-04-16T19:38:16.819258+0000","last_peered":"2024-04-16T19:38:16.819258+0000","last_clean":"2024-04-16T19:38:16.819258+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:38:16.819258+0000","last_undegraded":"2024-04-16T19:38:16.819258+0000","last_fullsized":"2024-04-16T19:38:16.819258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'305","last_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_deep_scrub":"53'305","last_deep_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.819127+0000","objects_scrubbed":14,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:56.568944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6851,"num_omap_keys":31,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'21","reported_seq":476,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.104753+0000","last_change":"2024-04-16T19:38:18.104753+0000","last_active":"2024-04-16T19:38:18.104753+0000","last_peered":"2024-04-16T19:38:18.104753+0000","last_clean":"2024-04-16T19:38:18.104753+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:38:18.104753+0000","last_undegraded":"2024-04-16T19:38:18.104753+0000","last_fullsized":"2024-04-16T19:38:18.104753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.104621+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:22.649252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405592+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:38:04.405592+0000","last_peered":"2024-04-16T19:38:04.405592+0000","last_clean":"2024-04-16T19:38:04.405592+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:38:04.405592+0000","last_undegraded":"2024-04-16T19:38:04.405592+0000","last_fullsized":"2024-04-16T19:38:04.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":298,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428208+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T19:38:09.428208+0000","last_peered":"2024-04-16T19:38:09.428208+0000","last_clean":"2024-04-16T19:38:09.428208+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:38:09.428208+0000","last_undegraded":"2024-04-16T19:38:09.428208+0000","last_fullsized":"2024-04-16T19:38:09.428208+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394646+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:36:54.394646+0000","last_peered":"2024-04-16T19:36:54.394646+0000","last_clean":"2024-04-16T19:36:54.394646+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:36:54.394646+0000","last_undegraded":"2024-04-16T19:36:54.394646+0000","last_fullsized":"2024-04-16T19:36:54.394646+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592615+0000","last_change":"2024-04-16T17:45:08.387550+0000","last_active":"2024-04-16T19:37:39.592615+0000","last_peered":"2024-04-16T19:37:39.592615+0000","last_clean":"2024-04-16T19:37:39.592615+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:37:39.592615+0000","last_undegraded":"2024-04-16T19:37:39.592615+0000","last_fullsized":"2024-04-16T19:37:39.592615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403099+0000","last_change":"2024-04-16T17:45:20.412324+0000","last_active":"2024-04-16T19:37:54.403099+0000","last_peered":"2024-04-16T19:37:54.403099+0000","last_clean":"2024-04-16T19:37:54.403099+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:37:54.403099+0000","last_undegraded":"2024-04-16T19:37:54.403099+0000","last_fullsized":"2024-04-16T19:37:54.403099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'72","reported_seq":242,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405356+0000","last_change":"2024-04-16T17:45:22.415579+0000","last_active":"2024-04-16T19:38:04.405356+0000","last_peered":"2024-04-16T19:38:04.405356+0000","last_clean":"2024-04-16T19:38:04.405356+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:38:04.405356+0000","last_undegraded":"2024-04-16T19:38:04.405356+0000","last_fullsized":"2024-04-16T19:38:04.405356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.408644+0000","last_change":"2024-04-16T17:45:24.422064+0000","last_active":"2024-04-16T19:38:04.408644+0000","last_peered":"2024-04-16T19:38:04.408644+0000","last_clean":"2024-04-16T19:38:04.408644+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:38:04.408644+0000","last_undegraded":"2024-04-16T19:38:04.408644+0000","last_fullsized":"2024-04-16T19:38:04.408644+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795949+0000","last_change":"2024-04-16T19:38:33.795974+0000","last_active":"2024-04-16T19:38:33.795949+0000","last_peered":"2024-04-16T19:38:33.795949+0000","last_clean":"2024-04-16T19:38:33.795949+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:38:33.795949+0000","last_undegraded":"2024-04-16T19:38:33.795949+0000","last_fullsized":"2024-04-16T19:38:33.795949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:54.984835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.393212+0000","last_change":"2024-04-16T18:09:02.168908+0000","last_active":"2024-04-16T19:36:49.393212+0000","last_peered":"2024-04-16T19:36:49.393212+0000","last_clean":"2024-04-16T19:36:49.393212+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:36:49.393212+0000","last_undegraded":"2024-04-16T19:36:49.393212+0000","last_fullsized":"2024-04-16T19:36:49.393212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'150","reported_seq":2026,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395682+0000","last_change":"2024-04-16T17:46:25.527679+0000","last_active":"2024-04-16T19:36:44.395682+0000","last_peered":"2024-04-16T19:36:44.395682+0000","last_clean":"2024-04-16T19:36:44.395682+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:36:44.395682+0000","last_undegraded":"2024-04-16T19:36:44.395682+0000","last_fullsized":"2024-04-16T19:36:44.395682+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":82,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394787+0000","last_change":"2024-04-16T17:46:17.514358+0000","last_active":"2024-04-16T19:36:54.394787+0000","last_peered":"2024-04-16T19:36:54.394787+0000","last_clean":"2024-04-16T19:36:54.394787+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:36:54.394787+0000","last_undegraded":"2024-04-16T19:36:54.394787+0000","last_fullsized":"2024-04-16T19:36:54.394787+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'7","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.346772+0000","last_change":"2024-04-16T19:38:42.346811+0000","last_active":"2024-04-16T19:38:42.346772+0000","last_peered":"2024-04-16T19:38:42.346772+0000","last_clean":"2024-04-16T19:38:42.346772+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:38:42.346772+0000","last_undegraded":"2024-04-16T19:38:42.346772+0000","last_fullsized":"2024-04-16T19:38:42.346772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.346708+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:50.944060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'652","reported_seq":2353,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.132401+0000","last_change":"2024-04-16T19:38:32.132432+0000","last_active":"2024-04-16T19:38:32.132401+0000","last_peered":"2024-04-16T19:38:32.132401+0000","last_clean":"2024-04-16T19:38:32.132401+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:38:32.132401+0000","last_undegraded":"2024-04-16T19:38:32.132401+0000","last_fullsized":"2024-04-16T19:38:32.132401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.132341+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:57.828052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'465","reported_seq":770,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.378097+0000","last_change":"2024-04-16T19:38:22.378097+0000","last_active":"2024-04-16T19:38:22.378097+0000","last_peered":"2024-04-16T19:38:22.378097+0000","last_clean":"2024-04-16T19:38:22.378097+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:38:22.378097+0000","last_undegraded":"2024-04-16T19:38:22.378097+0000","last_fullsized":"2024-04-16T19:38:22.378097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'465","last_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_deep_scrub":"53'465","last_deep_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.378008+0000","objects_scrubbed":26,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:24.892034+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'22","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.329830+0000","last_change":"2024-04-16T19:38:21.329929+0000","last_active":"2024-04-16T19:38:21.329830+0000","last_peered":"2024-04-16T19:38:21.329830+0000","last_clean":"2024-04-16T19:38:21.329830+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:38:21.329830+0000","last_undegraded":"2024-04-16T19:38:21.329830+0000","last_fullsized":"2024-04-16T19:38:21.329830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.329754+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:26.751591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407098+0000","last_change":"2024-04-16T17:45:10.396755+0000","last_active":"2024-04-16T19:37:54.407098+0000","last_peered":"2024-04-16T19:37:54.407098+0000","last_clean":"2024-04-16T19:37:54.407098+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:37:54.407098+0000","last_undegraded":"2024-04-16T19:37:54.407098+0000","last_fullsized":"2024-04-16T19:37:54.407098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428220+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T19:38:09.428220+0000","last_peered":"2024-04-16T19:38:09.428220+0000","last_clean":"2024-04-16T19:38:09.428220+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:38:09.428220+0000","last_undegraded":"2024-04-16T19:38:09.428220+0000","last_fullsized":"2024-04-16T19:38:09.428220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.720009+0000","last_change":"2024-04-16T19:38:29.720009+0000","last_active":"2024-04-16T19:38:29.720009+0000","last_peered":"2024-04-16T19:38:29.720009+0000","last_clean":"2024-04-16T19:38:29.720009+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:38:29.720009+0000","last_undegraded":"2024-04-16T19:38:29.720009+0000","last_fullsized":"2024-04-16T19:38:29.720009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.719912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:00.040596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"48'13","reported_seq":583,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405373+0000","last_change":"2024-04-16T17:45:20.412363+0000","last_active":"2024-04-16T19:38:04.405373+0000","last_peered":"2024-04-16T19:38:04.405373+0000","last_clean":"2024-04-16T19:38:04.405373+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:38:04.405373+0000","last_undegraded":"2024-04-16T19:38:04.405373+0000","last_fullsized":"2024-04-16T19:38:04.405373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'177","reported_seq":1668,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595869+0000","last_change":"2024-04-16T17:45:22.412577+0000","last_active":"2024-04-16T19:37:54.595869+0000","last_peered":"2024-04-16T19:37:54.595869+0000","last_clean":"2024-04-16T19:37:54.595869+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:37:54.595869+0000","last_undegraded":"2024-04-16T19:37:54.595869+0000","last_fullsized":"2024-04-16T19:37:54.595869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.886687+0000","last_change":"2024-04-16T17:45:24.422901+0000","last_active":"2024-04-16T19:38:09.886687+0000","last_peered":"2024-04-16T19:38:09.886687+0000","last_clean":"2024-04-16T19:38:09.886687+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:38:09.886687+0000","last_undegraded":"2024-04-16T19:38:09.886687+0000","last_fullsized":"2024-04-16T19:38:09.886687+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.744953+0000","last_change":"2024-04-16T19:38:25.744976+0000","last_active":"2024-04-16T19:38:25.744953+0000","last_peered":"2024-04-16T19:38:25.744953+0000","last_clean":"2024-04-16T19:38:25.744953+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:38:25.744953+0000","last_undegraded":"2024-04-16T19:38:25.744953+0000","last_fullsized":"2024-04-16T19:38:25.744953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.744882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:25.114426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.393876+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:36:49.393876+0000","last_peered":"2024-04-16T19:36:49.393876+0000","last_clean":"2024-04-16T19:36:49.393876+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:36:49.393876+0000","last_undegraded":"2024-04-16T19:36:49.393876+0000","last_fullsized":"2024-04-16T19:36:49.393876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'137","reported_seq":1600,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.393129+0000","last_change":"2024-04-16T17:46:25.524587+0000","last_active":"2024-04-16T19:36:44.393129+0000","last_peered":"2024-04-16T19:36:44.393129+0000","last_clean":"2024-04-16T19:36:44.393129+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:36:44.393129+0000","last_undegraded":"2024-04-16T19:36:44.393129+0000","last_fullsized":"2024-04-16T19:36:44.393129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":83,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340189+0000","last_change":"2024-04-16T17:46:17.512533+0000","last_active":"2024-04-16T19:38:10.340189+0000","last_peered":"2024-04-16T19:38:10.340189+0000","last_clean":"2024-04-16T19:38:10.340189+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:38:10.340189+0000","last_undegraded":"2024-04-16T19:38:10.340189+0000","last_fullsized":"2024-04-16T19:38:10.340189+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'28","reported_seq":206,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.914339+0000","last_change":"2024-04-16T19:38:41.914339+0000","last_active":"2024-04-16T19:38:41.914339+0000","last_peered":"2024-04-16T19:38:41.914339+0000","last_clean":"2024-04-16T19:38:41.914339+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:38:41.914339+0000","last_undegraded":"2024-04-16T19:38:41.914339+0000","last_fullsized":"2024-04-16T19:38:41.914339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'28","last_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_deep_scrub":"53'28","last_deep_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.914241+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:38.893326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":60,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.138191+0000","last_change":"2024-04-16T19:38:31.138209+0000","last_active":"2024-04-16T19:38:31.138191+0000","last_peered":"2024-04-16T19:38:31.138191+0000","last_clean":"2024-04-16T19:38:31.138191+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:38:31.138191+0000","last_undegraded":"2024-04-16T19:38:31.138191+0000","last_fullsized":"2024-04-16T19:38:31.138191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.138139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:01.713966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4956","reported_seq":7445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.900157+0000","last_change":"2024-04-16T19:38:14.900157+0000","last_active":"2024-04-16T19:38:14.900157+0000","last_peered":"2024-04-16T19:38:14.900157+0000","last_clean":"2024-04-16T19:38:14.900157+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:38:14.900157+0000","last_undegraded":"2024-04-16T19:38:14.900157+0000","last_fullsized":"2024-04-16T19:38:14.900157+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4956","last_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_deep_scrub":"53'4956","last_deep_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.900021+0000","objects_scrubbed":21,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:17.433386+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'10","reported_seq":272,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.858857+0000","last_change":"2024-04-16T19:38:11.858857+0000","last_active":"2024-04-16T19:38:11.858857+0000","last_peered":"2024-04-16T19:38:11.858857+0000","last_clean":"2024-04-16T19:38:11.858857+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:38:11.858857+0000","last_undegraded":"2024-04-16T19:38:11.858857+0000","last_fullsized":"2024-04-16T19:38:11.858857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.858749+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:25:54.104521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596005+0000","last_change":"2024-04-16T17:45:10.401015+0000","last_active":"2024-04-16T19:37:54.596005+0000","last_peered":"2024-04-16T19:37:54.596005+0000","last_clean":"2024-04-16T19:37:54.596005+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:37:54.596005+0000","last_undegraded":"2024-04-16T19:37:54.596005+0000","last_fullsized":"2024-04-16T19:37:54.596005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583527+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T19:36:54.583527+0000","last_peered":"2024-04-16T19:36:54.583527+0000","last_clean":"2024-04-16T19:36:54.583527+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:36:54.583527+0000","last_undegraded":"2024-04-16T19:36:54.583527+0000","last_fullsized":"2024-04-16T19:36:54.583527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589471+0000","last_change":"2024-04-16T17:45:08.382479+0000","last_active":"2024-04-16T19:37:24.589471+0000","last_peered":"2024-04-16T19:37:24.589471+0000","last_clean":"2024-04-16T19:37:24.589471+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:37:24.589471+0000","last_undegraded":"2024-04-16T19:37:24.589471+0000","last_fullsized":"2024-04-16T19:37:24.589471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"48'3","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.597957+0000","last_change":"2024-04-16T17:45:20.413451+0000","last_active":"2024-04-16T19:38:04.597957+0000","last_peered":"2024-04-16T19:38:04.597957+0000","last_clean":"2024-04-16T19:38:04.597957+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:38:04.597957+0000","last_undegraded":"2024-04-16T19:38:04.597957+0000","last_fullsized":"2024-04-16T19:38:04.597957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'151","reported_seq":1612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339107+0000","last_change":"2024-04-16T17:45:22.416277+0000","last_active":"2024-04-16T19:38:10.339107+0000","last_peered":"2024-04-16T19:38:10.339107+0000","last_clean":"2024-04-16T19:38:10.339107+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:38:10.339107+0000","last_undegraded":"2024-04-16T19:38:10.339107+0000","last_fullsized":"2024-04-16T19:38:10.339107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.325392+0000","last_change":"2024-04-16T19:38:35.325421+0000","last_active":"2024-04-16T19:38:35.325392+0000","last_peered":"2024-04-16T19:38:35.325392+0000","last_clean":"2024-04-16T19:38:35.325392+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:38:35.325392+0000","last_undegraded":"2024-04-16T19:38:35.325392+0000","last_fullsized":"2024-04-16T19:38:35.325392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.325323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:35.441680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.320446+0000","last_change":"2024-04-16T19:38:27.320467+0000","last_active":"2024-04-16T19:38:27.320446+0000","last_peered":"2024-04-16T19:38:27.320446+0000","last_clean":"2024-04-16T19:38:27.320446+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:38:27.320446+0000","last_undegraded":"2024-04-16T19:38:27.320446+0000","last_fullsized":"2024-04-16T19:38:27.320446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.320384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:47.178868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396760+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:37:04.396760+0000","last_peered":"2024-04-16T19:37:04.396760+0000","last_clean":"2024-04-16T19:37:04.396760+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:37:04.396760+0000","last_undegraded":"2024-04-16T19:37:04.396760+0000","last_fullsized":"2024-04-16T19:37:04.396760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'189","reported_seq":2091,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.387109+0000","last_change":"2024-04-16T19:38:46.387157+0000","last_active":"2024-04-16T19:38:46.387109+0000","last_peered":"2024-04-16T19:38:46.387109+0000","last_clean":"2024-04-16T19:38:46.387109+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:38:46.387109+0000","last_undegraded":"2024-04-16T19:38:46.387109+0000","last_fullsized":"2024-04-16T19:38:46.387109+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'189","last_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_deep_scrub":"53'189","last_deep_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.387038+0000","objects_scrubbed":54,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:22.550486+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12153,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.474066+0000","last_change":"2024-04-16T19:38:30.474066+0000","last_active":"2024-04-16T19:38:30.474066+0000","last_peered":"2024-04-16T19:38:30.474066+0000","last_clean":"2024-04-16T19:38:30.474066+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:38:30.474066+0000","last_undegraded":"2024-04-16T19:38:30.474066+0000","last_fullsized":"2024-04-16T19:38:30.474066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.473977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:10.223794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"53'4","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.365553+0000","last_change":"2024-04-16T19:38:41.365583+0000","last_active":"2024-04-16T19:38:41.365553+0000","last_peered":"2024-04-16T19:38:41.365553+0000","last_clean":"2024-04-16T19:38:41.365553+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:38:41.365553+0000","last_undegraded":"2024-04-16T19:38:41.365553+0000","last_fullsized":"2024-04-16T19:38:41.365553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.365486+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:10.903056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.088262+0000","last_change":"2024-04-16T19:38:21.088285+0000","last_active":"2024-04-16T19:38:21.088262+0000","last_peered":"2024-04-16T19:38:21.088262+0000","last_clean":"2024-04-16T19:38:21.088262+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:38:21.088262+0000","last_undegraded":"2024-04-16T19:38:21.088262+0000","last_fullsized":"2024-04-16T19:38:21.088262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.088193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:58.302179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'503","reported_seq":981,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.479844+0000","last_change":"2024-04-16T19:38:11.479844+0000","last_active":"2024-04-16T19:38:11.479844+0000","last_peered":"2024-04-16T19:38:11.479844+0000","last_clean":"2024-04-16T19:38:11.479844+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:38:11.479844+0000","last_undegraded":"2024-04-16T19:38:11.479844+0000","last_fullsized":"2024-04-16T19:38:11.479844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'503","last_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_deep_scrub":"53'503","last_deep_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.479730+0000","objects_scrubbed":31,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:50.543348+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7030,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'12","reported_seq":434,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.241107+0000","last_change":"2024-04-16T19:38:17.241107+0000","last_active":"2024-04-16T19:38:17.241107+0000","last_peered":"2024-04-16T19:38:17.241107+0000","last_clean":"2024-04-16T19:38:17.241107+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:38:17.241107+0000","last_undegraded":"2024-04-16T19:38:17.241107+0000","last_fullsized":"2024-04-16T19:38:17.241107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.241004+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:31.290983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593760+0000","last_change":"2024-04-16T17:45:10.396905+0000","last_active":"2024-04-16T19:37:44.593760+0000","last_peered":"2024-04-16T19:37:44.593760+0000","last_clean":"2024-04-16T19:37:44.593760+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:37:44.593760+0000","last_undegraded":"2024-04-16T19:37:44.593760+0000","last_fullsized":"2024-04-16T19:37:44.593760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394604+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T19:36:54.394604+0000","last_peered":"2024-04-16T19:36:54.394604+0000","last_clean":"2024-04-16T19:36:54.394604+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:36:54.394604+0000","last_undegraded":"2024-04-16T19:36:54.394604+0000","last_fullsized":"2024-04-16T19:36:54.394604+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400666+0000","last_change":"2024-04-16T17:45:08.382355+0000","last_active":"2024-04-16T19:37:39.400666+0000","last_peered":"2024-04-16T19:37:39.400666+0000","last_clean":"2024-04-16T19:37:39.400666+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:37:39.400666+0000","last_undegraded":"2024-04-16T19:37:39.400666+0000","last_fullsized":"2024-04-16T19:37:39.400666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":878,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068968+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:38:08.068968+0000","last_peered":"2024-04-16T19:38:08.068968+0000","last_clean":"2024-04-16T19:38:08.068968+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:38:08.068968+0000","last_undegraded":"2024-04-16T19:38:08.068968+0000","last_fullsized":"2024-04-16T19:38:08.068968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'144","reported_seq":335,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.598054+0000","last_change":"2024-04-16T17:45:22.417967+0000","last_active":"2024-04-16T19:38:04.598054+0000","last_peered":"2024-04-16T19:38:04.598054+0000","last_clean":"2024-04-16T19:38:04.598054+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:38:04.598054+0000","last_undegraded":"2024-04-16T19:38:04.598054+0000","last_fullsized":"2024-04-16T19:38:04.598054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.898210+0000","last_change":"2024-04-16T19:38:35.898255+0000","last_active":"2024-04-16T19:38:35.898210+0000","last_peered":"2024-04-16T19:38:35.898210+0000","last_clean":"2024-04-16T19:38:35.898210+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:38:35.898210+0000","last_undegraded":"2024-04-16T19:38:35.898210+0000","last_fullsized":"2024-04-16T19:38:35.898210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.898130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:42.528272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.791834+0000","last_change":"2024-04-16T19:38:39.791854+0000","last_active":"2024-04-16T19:38:39.791834+0000","last_peered":"2024-04-16T19:38:39.791834+0000","last_clean":"2024-04-16T19:38:39.791834+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:38:39.791834+0000","last_undegraded":"2024-04-16T19:38:39.791834+0000","last_fullsized":"2024-04-16T19:38:39.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.791771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:45.969208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403444+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:37:54.403444+0000","last_peered":"2024-04-16T19:37:54.403444+0000","last_clean":"2024-04-16T19:37:54.403444+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:37:54.403444+0000","last_undegraded":"2024-04-16T19:37:54.403444+0000","last_fullsized":"2024-04-16T19:37:54.403444+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1712,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402501+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:37:49.402501+0000","last_peered":"2024-04-16T19:37:49.402501+0000","last_clean":"2024-04-16T19:37:49.402501+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:37:49.402501+0000","last_undegraded":"2024-04-16T19:37:49.402501+0000","last_fullsized":"2024-04-16T19:37:49.402501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.839203+0000","last_change":"2024-04-16T19:38:39.839203+0000","last_active":"2024-04-16T19:38:39.839203+0000","last_peered":"2024-04-16T19:38:39.839203+0000","last_clean":"2024-04-16T19:38:39.839203+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:38:39.839203+0000","last_undegraded":"2024-04-16T19:38:39.839203+0000","last_fullsized":"2024-04-16T19:38:39.839203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.839112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:23.811211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'14","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.080454+0000","last_change":"2024-04-16T19:38:28.080454+0000","last_active":"2024-04-16T19:38:28.080454+0000","last_peered":"2024-04-16T19:38:28.080454+0000","last_clean":"2024-04-16T19:38:28.080454+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:38:28.080454+0000","last_undegraded":"2024-04-16T19:38:28.080454+0000","last_fullsized":"2024-04-16T19:38:28.080454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.080349+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:30.384618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'652","reported_seq":2241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.085883+0000","last_change":"2024-04-16T19:38:17.085883+0000","last_active":"2024-04-16T19:38:17.085883+0000","last_peered":"2024-04-16T19:38:17.085883+0000","last_clean":"2024-04-16T19:38:17.085883+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:38:17.085883+0000","last_undegraded":"2024-04-16T19:38:17.085883+0000","last_fullsized":"2024-04-16T19:38:17.085883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.085744+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:55.082690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'364","reported_seq":672,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.518366+0000","last_change":"2024-04-16T19:38:17.518366+0000","last_active":"2024-04-16T19:38:17.518366+0000","last_peered":"2024-04-16T19:38:17.518366+0000","last_clean":"2024-04-16T19:38:17.518366+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:38:17.518366+0000","last_undegraded":"2024-04-16T19:38:17.518366+0000","last_fullsized":"2024-04-16T19:38:17.518366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'364","last_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_deep_scrub":"53'364","last_deep_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.518227+0000","objects_scrubbed":20,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:39.484987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6810,"num_omap_keys":31,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'21","reported_seq":470,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.711099+0000","last_change":"2024-04-16T19:38:25.711099+0000","last_active":"2024-04-16T19:38:25.711099+0000","last_peered":"2024-04-16T19:38:25.711099+0000","last_clean":"2024-04-16T19:38:25.711099+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:38:25.711099+0000","last_undegraded":"2024-04-16T19:38:25.711099+0000","last_fullsized":"2024-04-16T19:38:25.711099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.710924+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:00.685204+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593675+0000","last_change":"2024-04-16T17:45:10.399758+0000","last_active":"2024-04-16T19:37:44.593675+0000","last_peered":"2024-04-16T19:37:44.593675+0000","last_clean":"2024-04-16T19:37:44.593675+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:37:44.593675+0000","last_undegraded":"2024-04-16T19:37:44.593675+0000","last_fullsized":"2024-04-16T19:37:44.593675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404465+0000","last_change":"2024-04-16T17:45:08.386614+0000","last_active":"2024-04-16T19:37:59.404465+0000","last_peered":"2024-04-16T19:37:59.404465+0000","last_clean":"2024-04-16T19:37:59.404465+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:37:59.404465+0000","last_undegraded":"2024-04-16T19:37:59.404465+0000","last_fullsized":"2024-04-16T19:37:59.404465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.583633+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T19:36:54.583633+0000","last_peered":"2024-04-16T19:36:54.583633+0000","last_clean":"2024-04-16T19:36:54.583633+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:36:54.583633+0000","last_undegraded":"2024-04-16T19:36:54.583633+0000","last_fullsized":"2024-04-16T19:36:54.583633+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406997+0000","last_change":"2024-04-16T17:45:20.414740+0000","last_active":"2024-04-16T19:37:54.406997+0000","last_peered":"2024-04-16T19:37:54.406997+0000","last_clean":"2024-04-16T19:37:54.406997+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:37:54.406997+0000","last_undegraded":"2024-04-16T19:37:54.406997+0000","last_fullsized":"2024-04-16T19:37:54.406997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'160","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405063+0000","last_change":"2024-04-16T17:45:22.416454+0000","last_active":"2024-04-16T19:37:44.405063+0000","last_peered":"2024-04-16T19:37:44.405063+0000","last_clean":"2024-04-16T19:37:44.405063+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:37:44.405063+0000","last_undegraded":"2024-04-16T19:37:44.405063+0000","last_fullsized":"2024-04-16T19:37:44.405063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.382963+0000","last_change":"2024-04-16T19:38:47.382987+0000","last_active":"2024-04-16T19:38:47.382963+0000","last_peered":"2024-04-16T19:38:47.382963+0000","last_clean":"2024-04-16T19:38:47.382963+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:38:47.382963+0000","last_undegraded":"2024-04-16T19:38:47.382963+0000","last_fullsized":"2024-04-16T19:38:47.382963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.382901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:43.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.343354+0000","last_change":"2024-04-16T19:38:23.343376+0000","last_active":"2024-04-16T19:38:23.343354+0000","last_peered":"2024-04-16T19:38:23.343354+0000","last_clean":"2024-04-16T19:38:23.343354+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:38:23.343354+0000","last_undegraded":"2024-04-16T19:38:23.343354+0000","last_fullsized":"2024-04-16T19:38:23.343354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.343292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:42.020915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595633+0000","last_change":"2024-04-16T18:09:02.175274+0000","last_active":"2024-04-16T19:37:54.595633+0000","last_peered":"2024-04-16T19:37:54.595633+0000","last_clean":"2024-04-16T19:37:54.595633+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:37:54.595633+0000","last_undegraded":"2024-04-16T19:37:54.595633+0000","last_fullsized":"2024-04-16T19:37:54.595633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1690,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395327+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:36:59.395327+0000","last_peered":"2024-04-16T19:36:59.395327+0000","last_clean":"2024-04-16T19:36:59.395327+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:36:59.395327+0000","last_undegraded":"2024-04-16T19:36:59.395327+0000","last_fullsized":"2024-04-16T19:36:59.395327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.109433+0000","last_change":"2024-04-16T19:38:29.109454+0000","last_active":"2024-04-16T19:38:29.109433+0000","last_peered":"2024-04-16T19:38:29.109433+0000","last_clean":"2024-04-16T19:38:29.109433+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:38:29.109433+0000","last_undegraded":"2024-04-16T19:38:29.109433+0000","last_fullsized":"2024-04-16T19:38:29.109433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.109370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:03.453529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"53'12","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.361852+0000","last_change":"2024-04-16T19:38:49.361907+0000","last_active":"2024-04-16T19:38:49.361852+0000","last_peered":"2024-04-16T19:38:49.361852+0000","last_clean":"2024-04-16T19:38:49.361852+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:38:49.361852+0000","last_undegraded":"2024-04-16T19:38:49.361852+0000","last_fullsized":"2024-04-16T19:38:49.361852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.361782+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:51.952616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.723050+0000","last_change":"2024-04-16T19:38:26.723073+0000","last_active":"2024-04-16T19:38:26.723050+0000","last_peered":"2024-04-16T19:38:26.723050+0000","last_clean":"2024-04-16T19:38:26.723050+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:38:26.723050+0000","last_undegraded":"2024-04-16T19:38:26.723050+0000","last_fullsized":"2024-04-16T19:38:26.723050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.722978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:34.382609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'523","reported_seq":865,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.541783+0000","last_change":"2024-04-16T19:38:13.541783+0000","last_active":"2024-04-16T19:38:13.541783+0000","last_peered":"2024-04-16T19:38:13.541783+0000","last_clean":"2024-04-16T19:38:13.541783+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:38:13.541783+0000","last_undegraded":"2024-04-16T19:38:13.541783+0000","last_fullsized":"2024-04-16T19:38:13.541783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'523","last_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_deep_scrub":"53'523","last_deep_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.541660+0000","objects_scrubbed":23,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:50.755647+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21532,"num_omap_keys":98,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'34","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.893657+0000","last_change":"2024-04-16T19:38:23.893744+0000","last_active":"2024-04-16T19:38:23.893657+0000","last_peered":"2024-04-16T19:38:23.893657+0000","last_clean":"2024-04-16T19:38:23.893657+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:38:23.893657+0000","last_undegraded":"2024-04-16T19:38:23.893657+0000","last_fullsized":"2024-04-16T19:38:23.893657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.893579+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:25.142771+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405174+0000","last_change":"2024-04-16T17:45:10.392387+0000","last_active":"2024-04-16T19:37:44.405174+0000","last_peered":"2024-04-16T19:37:44.405174+0000","last_clean":"2024-04-16T19:37:44.405174+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:37:44.405174+0000","last_undegraded":"2024-04-16T19:37:44.405174+0000","last_fullsized":"2024-04-16T19:37:44.405174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592730+0000","last_change":"2024-04-16T17:45:08.383729+0000","last_active":"2024-04-16T19:37:39.592730+0000","last_peered":"2024-04-16T19:37:39.592730+0000","last_clean":"2024-04-16T19:37:39.592730+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:37:39.592730+0000","last_undegraded":"2024-04-16T19:37:39.592730+0000","last_fullsized":"2024-04-16T19:37:39.592730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.398214+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T19:37:14.398214+0000","last_peered":"2024-04-16T19:37:14.398214+0000","last_clean":"2024-04-16T19:37:14.398214+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:37:14.398214+0000","last_undegraded":"2024-04-16T19:37:14.398214+0000","last_fullsized":"2024-04-16T19:37:14.398214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403551+0000","last_change":"2024-04-16T17:45:20.408473+0000","last_active":"2024-04-16T19:37:54.403551+0000","last_peered":"2024-04-16T19:37:54.403551+0000","last_clean":"2024-04-16T19:37:54.403551+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:37:54.403551+0000","last_undegraded":"2024-04-16T19:37:54.403551+0000","last_fullsized":"2024-04-16T19:37:54.403551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'168","reported_seq":373,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595653+0000","last_change":"2024-04-16T17:45:22.422298+0000","last_active":"2024-04-16T19:37:54.595653+0000","last_peered":"2024-04-16T19:37:54.595653+0000","last_clean":"2024-04-16T19:37:54.595653+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:37:54.595653+0000","last_undegraded":"2024-04-16T19:37:54.595653+0000","last_fullsized":"2024-04-16T19:37:54.595653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'12","reported_seq":1398,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401763+0000","last_change":"2024-04-16T17:45:24.421136+0000","last_active":"2024-04-16T19:37:44.401763+0000","last_peered":"2024-04-16T19:37:44.401763+0000","last_clean":"2024-04-16T19:37:44.401763+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:37:44.401763+0000","last_undegraded":"2024-04-16T19:37:44.401763+0000","last_fullsized":"2024-04-16T19:37:44.401763+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.367924+0000","last_change":"2024-04-16T19:38:25.367947+0000","last_active":"2024-04-16T19:38:25.367924+0000","last_peered":"2024-04-16T19:38:25.367924+0000","last_clean":"2024-04-16T19:38:25.367924+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:38:25.367924+0000","last_undegraded":"2024-04-16T19:38:25.367924+0000","last_fullsized":"2024-04-16T19:38:25.367924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.367850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:46.556801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582520+0000","last_change":"2024-04-16T18:09:02.167725+0000","last_active":"2024-04-16T19:36:49.582520+0000","last_peered":"2024-04-16T19:36:49.582520+0000","last_clean":"2024-04-16T19:36:49.582520+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:36:49.582520+0000","last_undegraded":"2024-04-16T19:36:49.582520+0000","last_fullsized":"2024-04-16T19:36:49.582520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1837,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.398902+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:37:19.398902+0000","last_peered":"2024-04-16T19:37:19.398902+0000","last_clean":"2024-04-16T19:37:19.398902+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:37:19.398902+0000","last_undegraded":"2024-04-16T19:37:19.398902+0000","last_fullsized":"2024-04-16T19:37:19.398902+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.830353+0000","last_change":"2024-04-16T19:38:46.830396+0000","last_active":"2024-04-16T19:38:46.830353+0000","last_peered":"2024-04-16T19:38:46.830353+0000","last_clean":"2024-04-16T19:38:46.830353+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:38:46.830353+0000","last_undegraded":"2024-04-16T19:38:46.830353+0000","last_fullsized":"2024-04-16T19:38:46.830353+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.830276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:07.300381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'2","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.108567+0000","last_change":"2024-04-16T19:38:27.108567+0000","last_active":"2024-04-16T19:38:27.108567+0000","last_peered":"2024-04-16T19:38:27.108567+0000","last_clean":"2024-04-16T19:38:27.108567+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:38:27.108567+0000","last_undegraded":"2024-04-16T19:38:27.108567+0000","last_fullsized":"2024-04-16T19:38:27.108567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.108478+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:30.717209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.851943+0000","last_change":"2024-04-16T19:38:36.851943+0000","last_active":"2024-04-16T19:38:36.851943+0000","last_peered":"2024-04-16T19:38:36.851943+0000","last_clean":"2024-04-16T19:38:36.851943+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:38:36.851943+0000","last_undegraded":"2024-04-16T19:38:36.851943+0000","last_fullsized":"2024-04-16T19:38:36.851943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.851855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:41.780120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'341","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.445822+0000","last_change":"2024-04-16T19:38:10.445822+0000","last_active":"2024-04-16T19:38:10.445822+0000","last_peered":"2024-04-16T19:38:10.445822+0000","last_clean":"2024-04-16T19:38:10.445822+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:38:10.445822+0000","last_undegraded":"2024-04-16T19:38:10.445822+0000","last_fullsized":"2024-04-16T19:38:10.445822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'341","last_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_deep_scrub":"53'341","last_deep_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.445700+0000","objects_scrubbed":19,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:14.990331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20855,"num_omap_keys":95,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'34","reported_seq":599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.847777+0000","last_change":"2024-04-16T19:38:10.847777+0000","last_active":"2024-04-16T19:38:10.847777+0000","last_peered":"2024-04-16T19:38:10.847777+0000","last_clean":"2024-04-16T19:38:10.847777+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:38:10.847777+0000","last_undegraded":"2024-04-16T19:38:10.847777+0000","last_fullsized":"2024-04-16T19:38:10.847777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.847654+0000","objects_scrubbed":14,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:29.793118+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403394+0000","last_change":"2024-04-16T17:45:10.400196+0000","last_active":"2024-04-16T19:37:34.403394+0000","last_peered":"2024-04-16T19:37:34.403394+0000","last_clean":"2024-04-16T19:37:34.403394+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:37:34.403394+0000","last_undegraded":"2024-04-16T19:37:34.403394+0000","last_fullsized":"2024-04-16T19:37:34.403394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594796+0000","last_change":"2024-04-16T17:45:08.382982+0000","last_active":"2024-04-16T19:37:49.594796+0000","last_peered":"2024-04-16T19:37:49.594796+0000","last_clean":"2024-04-16T19:37:49.594796+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:37:49.594796+0000","last_undegraded":"2024-04-16T19:37:49.594796+0000","last_fullsized":"2024-04-16T19:37:49.594796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.585551+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T19:37:04.585551+0000","last_peered":"2024-04-16T19:37:04.585551+0000","last_clean":"2024-04-16T19:37:04.585551+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:37:04.585551+0000","last_undegraded":"2024-04-16T19:37:04.585551+0000","last_fullsized":"2024-04-16T19:37:04.585551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"48'3","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403926+0000","last_change":"2024-04-16T17:45:20.407710+0000","last_active":"2024-04-16T19:37:54.403926+0000","last_peered":"2024-04-16T19:37:54.403926+0000","last_clean":"2024-04-16T19:37:54.403926+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:37:54.403926+0000","last_undegraded":"2024-04-16T19:37:54.403926+0000","last_fullsized":"2024-04-16T19:37:54.403926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'120","reported_seq":301,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403952+0000","last_change":"2024-04-16T17:45:22.416114+0000","last_active":"2024-04-16T19:37:54.403952+0000","last_peered":"2024-04-16T19:37:54.403952+0000","last_clean":"2024-04-16T19:37:54.403952+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:37:54.403952+0000","last_undegraded":"2024-04-16T19:37:54.403952+0000","last_fullsized":"2024-04-16T19:37:54.403952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'12","reported_seq":1396,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407012+0000","last_change":"2024-04-16T17:45:24.423991+0000","last_active":"2024-04-16T19:37:54.407012+0000","last_peered":"2024-04-16T19:37:54.407012+0000","last_clean":"2024-04-16T19:37:54.407012+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:37:54.407012+0000","last_undegraded":"2024-04-16T19:37:54.407012+0000","last_fullsized":"2024-04-16T19:37:54.407012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.320279+0000","last_change":"2024-04-16T19:38:26.320303+0000","last_active":"2024-04-16T19:38:26.320279+0000","last_peered":"2024-04-16T19:38:26.320279+0000","last_clean":"2024-04-16T19:38:26.320279+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:38:26.320279+0000","last_undegraded":"2024-04-16T19:38:26.320279+0000","last_fullsized":"2024-04-16T19:38:26.320279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.320216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:10.143275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977348+0000","last_change":"2024-04-16T18:09:02.166269+0000","last_active":"2024-04-16T19:38:08.977348+0000","last_peered":"2024-04-16T19:38:08.977348+0000","last_clean":"2024-04-16T19:38:08.977348+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:38:08.977348+0000","last_undegraded":"2024-04-16T19:38:08.977348+0000","last_fullsized":"2024-04-16T19:38:08.977348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2089,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395625+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:36:44.395625+0000","last_peered":"2024-04-16T19:36:44.395625+0000","last_clean":"2024-04-16T19:36:44.395625+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:36:44.395625+0000","last_undegraded":"2024-04-16T19:36:44.395625+0000","last_fullsized":"2024-04-16T19:36:44.395625+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.205270+0000","last_change":"2024-04-16T19:38:37.205293+0000","last_active":"2024-04-16T19:38:37.205270+0000","last_peered":"2024-04-16T19:38:37.205270+0000","last_clean":"2024-04-16T19:38:37.205270+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:38:37.205270+0000","last_undegraded":"2024-04-16T19:38:37.205270+0000","last_fullsized":"2024-04-16T19:38:37.205270+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.205209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:23.238881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'7","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.132412+0000","last_change":"2024-04-16T19:38:26.132412+0000","last_active":"2024-04-16T19:38:26.132412+0000","last_peered":"2024-04-16T19:38:26.132412+0000","last_clean":"2024-04-16T19:38:26.132412+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:38:26.132412+0000","last_undegraded":"2024-04-16T19:38:26.132412+0000","last_fullsized":"2024-04-16T19:38:26.132412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.132277+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:26.528982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'652","reported_seq":2213,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.537534+0000","last_change":"2024-04-16T19:38:14.537534+0000","last_active":"2024-04-16T19:38:14.537534+0000","last_peered":"2024-04-16T19:38:14.537534+0000","last_clean":"2024-04-16T19:38:14.537534+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:38:14.537534+0000","last_undegraded":"2024-04-16T19:38:14.537534+0000","last_fullsized":"2024-04-16T19:38:14.537534+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.537442+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:05.967541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5554","reported_seq":10355,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.938437+0000","last_change":"2024-04-16T19:38:16.938437+0000","last_active":"2024-04-16T19:38:16.938437+0000","last_peered":"2024-04-16T19:38:16.938437+0000","last_clean":"2024-04-16T19:38:16.938437+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:38:16.938437+0000","last_undegraded":"2024-04-16T19:38:16.938437+0000","last_fullsized":"2024-04-16T19:38:16.938437+0000","mapping_epoch":33,"log_start":"53'3800","ondisk_log_start":"53'3800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5554","last_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_deep_scrub":"53'5554","last_deep_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.938343+0000","objects_scrubbed":27,"log_size":1754,"log_dups_size":3000,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:35.567420+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'24","reported_seq":708,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.053024+0000","last_change":"2024-04-16T19:38:22.053138+0000","last_active":"2024-04-16T19:38:22.053024+0000","last_peered":"2024-04-16T19:38:22.053024+0000","last_clean":"2024-04-16T19:38:22.053024+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:38:22.053024+0000","last_undegraded":"2024-04-16T19:38:22.053024+0000","last_fullsized":"2024-04-16T19:38:22.053024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.052928+0000","objects_scrubbed":12,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:13.483027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401524+0000","last_change":"2024-04-16T17:45:10.399687+0000","last_active":"2024-04-16T19:37:44.401524+0000","last_peered":"2024-04-16T19:37:44.401524+0000","last_clean":"2024-04-16T19:37:44.401524+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:37:44.401524+0000","last_undegraded":"2024-04-16T19:37:44.401524+0000","last_fullsized":"2024-04-16T19:37:44.401524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406184+0000","last_change":"2024-04-16T17:45:08.381368+0000","last_active":"2024-04-16T19:37:49.406184+0000","last_peered":"2024-04-16T19:37:49.406184+0000","last_clean":"2024-04-16T19:37:49.406184+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:37:49.406184+0000","last_undegraded":"2024-04-16T19:37:49.406184+0000","last_fullsized":"2024-04-16T19:37:49.406184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396726+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:37:04.396726+0000","last_peered":"2024-04-16T19:37:04.396726+0000","last_clean":"2024-04-16T19:37:04.396726+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:37:04.396726+0000","last_undegraded":"2024-04-16T19:37:04.396726+0000","last_fullsized":"2024-04-16T19:37:04.396726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'1","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592560+0000","last_change":"2024-04-16T17:45:20.403582+0000","last_active":"2024-04-16T19:37:39.592560+0000","last_peered":"2024-04-16T19:37:39.592560+0000","last_clean":"2024-04-16T19:37:39.592560+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:37:39.592560+0000","last_undegraded":"2024-04-16T19:37:39.592560+0000","last_fullsized":"2024-04-16T19:37:39.592560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'144","reported_seq":352,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403073+0000","last_change":"2024-04-16T17:45:22.414745+0000","last_active":"2024-04-16T19:37:54.403073+0000","last_peered":"2024-04-16T19:37:54.403073+0000","last_clean":"2024-04-16T19:37:54.403073+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:37:54.403073+0000","last_undegraded":"2024-04-16T19:37:54.403073+0000","last_fullsized":"2024-04-16T19:37:54.403073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.938478+0000","last_change":"2024-04-16T19:38:47.938499+0000","last_active":"2024-04-16T19:38:47.938478+0000","last_peered":"2024-04-16T19:38:47.938478+0000","last_clean":"2024-04-16T19:38:47.938478+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:38:47.938478+0000","last_undegraded":"2024-04-16T19:38:47.938478+0000","last_fullsized":"2024-04-16T19:38:47.938478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.938415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:49.187607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.799921+0000","last_change":"2024-04-16T19:38:35.799944+0000","last_active":"2024-04-16T19:38:35.799921+0000","last_peered":"2024-04-16T19:38:35.799921+0000","last_clean":"2024-04-16T19:38:35.799921+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:38:35.799921+0000","last_undegraded":"2024-04-16T19:38:35.799921+0000","last_fullsized":"2024-04-16T19:38:35.799921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.799851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.447343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069979+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:38:08.069979+0000","last_peered":"2024-04-16T19:38:08.069979+0000","last_clean":"2024-04-16T19:38:08.069979+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:38:08.069979+0000","last_undegraded":"2024-04-16T19:38:08.069979+0000","last_fullsized":"2024-04-16T19:38:08.069979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'101","reported_seq":1736,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404646+0000","last_change":"2024-04-16T17:46:25.527509+0000","last_active":"2024-04-16T19:37:59.404646+0000","last_peered":"2024-04-16T19:37:59.404646+0000","last_clean":"2024-04-16T19:37:59.404646+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:37:59.404646+0000","last_undegraded":"2024-04-16T19:37:59.404646+0000","last_fullsized":"2024-04-16T19:37:59.404646+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.806738+0000","last_change":"2024-04-16T19:38:34.806738+0000","last_active":"2024-04-16T19:38:34.806738+0000","last_peered":"2024-04-16T19:38:34.806738+0000","last_clean":"2024-04-16T19:38:34.806738+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:38:34.806738+0000","last_undegraded":"2024-04-16T19:38:34.806738+0000","last_fullsized":"2024-04-16T19:38:34.806738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.806640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:43.311591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'25","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.421766+0000","last_change":"2024-04-16T19:38:35.421800+0000","last_active":"2024-04-16T19:38:35.421766+0000","last_peered":"2024-04-16T19:38:35.421766+0000","last_clean":"2024-04-16T19:38:35.421766+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:38:35.421766+0000","last_undegraded":"2024-04-16T19:38:35.421766+0000","last_fullsized":"2024-04-16T19:38:35.421766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.421703+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:03:09.135386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.727449+0000","last_change":"2024-04-16T19:38:24.727504+0000","last_active":"2024-04-16T19:38:24.727449+0000","last_peered":"2024-04-16T19:38:24.727449+0000","last_clean":"2024-04-16T19:38:24.727449+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:38:24.727449+0000","last_undegraded":"2024-04-16T19:38:24.727449+0000","last_fullsized":"2024-04-16T19:38:24.727449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.727368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:38.777347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'344","reported_seq":655,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.511356+0000","last_change":"2024-04-16T19:38:12.511356+0000","last_active":"2024-04-16T19:38:12.511356+0000","last_peered":"2024-04-16T19:38:12.511356+0000","last_clean":"2024-04-16T19:38:12.511356+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:38:12.511356+0000","last_undegraded":"2024-04-16T19:38:12.511356+0000","last_fullsized":"2024-04-16T19:38:12.511356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'344","last_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_deep_scrub":"53'344","last_deep_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.511231+0000","objects_scrubbed":24,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:10.499739+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13835,"num_omap_keys":63,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'14","reported_seq":627,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.257871+0000","last_change":"2024-04-16T19:38:19.257946+0000","last_active":"2024-04-16T19:38:19.257871+0000","last_peered":"2024-04-16T19:38:19.257871+0000","last_clean":"2024-04-16T19:38:19.257871+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:38:19.257871+0000","last_undegraded":"2024-04-16T19:38:19.257871+0000","last_fullsized":"2024-04-16T19:38:19.257871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.257792+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:20.506984+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.319985+0000","last_change":"2024-04-16T19:38:33.320008+0000","last_active":"2024-04-16T19:38:33.319985+0000","last_peered":"2024-04-16T19:38:33.319985+0000","last_clean":"2024-04-16T19:38:33.319985+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:38:33.319985+0000","last_undegraded":"2024-04-16T19:38:33.319985+0000","last_fullsized":"2024-04-16T19:38:33.319985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.319922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:11.454921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396720+0000","last_change":"2024-04-16T17:45:10.393485+0000","last_active":"2024-04-16T19:37:14.396720+0000","last_peered":"2024-04-16T19:37:14.396720+0000","last_clean":"2024-04-16T19:37:14.396720+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:37:14.396720+0000","last_undegraded":"2024-04-16T19:37:14.396720+0000","last_fullsized":"2024-04-16T19:37:14.396720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.400512+0000","last_change":"2024-04-16T17:45:08.386299+0000","last_active":"2024-04-16T19:37:29.400512+0000","last_peered":"2024-04-16T19:37:29.400512+0000","last_clean":"2024-04-16T19:37:29.400512+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:37:29.400512+0000","last_undegraded":"2024-04-16T19:37:29.400512+0000","last_fullsized":"2024-04-16T19:37:29.400512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"30'1","reported_seq":210,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589587+0000","last_change":"2024-04-16T17:45:20.412485+0000","last_active":"2024-04-16T19:37:24.589587+0000","last_peered":"2024-04-16T19:37:24.589587+0000","last_clean":"2024-04-16T19:37:24.589587+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:37:24.589587+0000","last_undegraded":"2024-04-16T19:37:24.589587+0000","last_fullsized":"2024-04-16T19:37:24.589587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'104","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589523+0000","last_change":"2024-04-16T17:45:22.416196+0000","last_active":"2024-04-16T19:37:24.589523+0000","last_peered":"2024-04-16T19:37:24.589523+0000","last_clean":"2024-04-16T19:37:24.589523+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:37:24.589523+0000","last_undegraded":"2024-04-16T19:37:24.589523+0000","last_fullsized":"2024-04-16T19:37:24.589523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589517+0000","last_change":"2024-04-16T17:45:24.424718+0000","last_active":"2024-04-16T19:37:24.589517+0000","last_peered":"2024-04-16T19:37:24.589517+0000","last_clean":"2024-04-16T19:37:24.589517+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:37:24.589517+0000","last_undegraded":"2024-04-16T19:37:24.589517+0000","last_fullsized":"2024-04-16T19:37:24.589517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887565+0000","last_change":"2024-04-16T18:09:02.165652+0000","last_active":"2024-04-16T19:38:09.887565+0000","last_peered":"2024-04-16T19:38:09.887565+0000","last_clean":"2024-04-16T19:38:09.887565+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:38:09.887565+0000","last_undegraded":"2024-04-16T19:38:09.887565+0000","last_fullsized":"2024-04-16T19:38:09.887565+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'147","reported_seq":1631,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592501+0000","last_change":"2024-04-16T17:46:25.533095+0000","last_active":"2024-04-16T19:37:39.592501+0000","last_peered":"2024-04-16T19:37:39.592501+0000","last_clean":"2024-04-16T19:37:39.592501+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:37:39.592501+0000","last_undegraded":"2024-04-16T19:37:39.592501+0000","last_fullsized":"2024-04-16T19:37:39.592501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.386677+0000","last_change":"2024-04-16T19:38:34.386677+0000","last_active":"2024-04-16T19:38:34.386677+0000","last_peered":"2024-04-16T19:38:34.386677+0000","last_clean":"2024-04-16T19:38:34.386677+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:38:34.386677+0000","last_undegraded":"2024-04-16T19:38:34.386677+0000","last_fullsized":"2024-04-16T19:38:34.386677+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.386595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:24.029746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'12","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887391+0000","last_change":"2024-04-16T17:47:16.567012+0000","last_active":"2024-04-16T19:38:09.887391+0000","last_peered":"2024-04-16T19:38:09.887391+0000","last_clean":"2024-04-16T19:38:09.887391+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:38:09.887391+0000","last_undegraded":"2024-04-16T19:38:09.887391+0000","last_fullsized":"2024-04-16T19:38:09.887391+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.919701+0000","last_change":"2024-04-16T19:38:32.919725+0000","last_active":"2024-04-16T19:38:32.919701+0000","last_peered":"2024-04-16T19:38:32.919701+0000","last_clean":"2024-04-16T19:38:32.919701+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:38:32.919701+0000","last_undegraded":"2024-04-16T19:38:32.919701+0000","last_fullsized":"2024-04-16T19:38:32.919701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.919638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:52.778121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'462","reported_seq":2060,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.755722+0000","last_change":"2024-04-16T19:38:14.755722+0000","last_active":"2024-04-16T19:38:14.755722+0000","last_peered":"2024-04-16T19:38:14.755722+0000","last_clean":"2024-04-16T19:38:14.755722+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:38:14.755722+0000","last_undegraded":"2024-04-16T19:38:14.755722+0000","last_fullsized":"2024-04-16T19:38:14.755722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'462","last_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_deep_scrub":"53'462","last_deep_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.755590+0000","objects_scrubbed":20,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:26.580898+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'26","reported_seq":480,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.808711+0000","last_change":"2024-04-16T19:38:09.808711+0000","last_active":"2024-04-16T19:38:09.808711+0000","last_peered":"2024-04-16T19:38:09.808711+0000","last_clean":"2024-04-16T19:38:09.808711+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:38:09.808711+0000","last_undegraded":"2024-04-16T19:38:09.808711+0000","last_fullsized":"2024-04-16T19:38:09.808711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.808625+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:45.079174+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.656504+0000","last_change":"2024-04-16T19:38:43.656527+0000","last_active":"2024-04-16T19:38:43.656504+0000","last_peered":"2024-04-16T19:38:43.656504+0000","last_clean":"2024-04-16T19:38:43.656504+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:38:43.656504+0000","last_undegraded":"2024-04-16T19:38:43.656504+0000","last_fullsized":"2024-04-16T19:38:43.656504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.656442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:44.709769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587504+0000","last_change":"2024-04-16T17:45:10.394503+0000","last_active":"2024-04-16T19:37:14.587504+0000","last_peered":"2024-04-16T19:37:14.587504+0000","last_clean":"2024-04-16T19:37:14.587504+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:37:14.587504+0000","last_undegraded":"2024-04-16T19:37:14.587504+0000","last_fullsized":"2024-04-16T19:37:14.587504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428346+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:38:09.428346+0000","last_peered":"2024-04-16T19:38:09.428346+0000","last_clean":"2024-04-16T19:38:09.428346+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:38:09.428346+0000","last_undegraded":"2024-04-16T19:38:09.428346+0000","last_fullsized":"2024-04-16T19:38:09.428346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"30'1","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589634+0000","last_change":"2024-04-16T17:45:20.407788+0000","last_active":"2024-04-16T19:37:24.589634+0000","last_peered":"2024-04-16T19:37:24.589634+0000","last_clean":"2024-04-16T19:37:24.589634+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:37:24.589634+0000","last_undegraded":"2024-04-16T19:37:24.589634+0000","last_fullsized":"2024-04-16T19:37:24.589634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'50","reported_seq":189,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.401888+0000","last_change":"2024-04-16T17:45:22.421476+0000","last_active":"2024-04-16T19:37:24.401888+0000","last_peered":"2024-04-16T19:37:24.401888+0000","last_clean":"2024-04-16T19:37:24.401888+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:37:24.401888+0000","last_undegraded":"2024-04-16T19:37:24.401888+0000","last_fullsized":"2024-04-16T19:37:24.401888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.913850+0000","last_change":"2024-04-16T19:38:34.913872+0000","last_active":"2024-04-16T19:38:34.913850+0000","last_peered":"2024-04-16T19:38:34.913850+0000","last_clean":"2024-04-16T19:38:34.913850+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:38:34.913850+0000","last_undegraded":"2024-04-16T19:38:34.913850+0000","last_fullsized":"2024-04-16T19:38:34.913850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.913787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:21.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":52,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391557+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:36:34.391557+0000","last_peered":"2024-04-16T19:36:34.391557+0000","last_clean":"2024-04-16T19:36:34.391557+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:36:34.391557+0000","last_undegraded":"2024-04-16T19:36:34.391557+0000","last_fullsized":"2024-04-16T19:36:34.391557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'109","reported_seq":1797,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.578457+0000","last_change":"2024-04-16T17:46:25.527453+0000","last_active":"2024-04-16T19:36:29.578457+0000","last_peered":"2024-04-16T19:36:29.578457+0000","last_clean":"2024-04-16T19:36:29.578457+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:36:29.578457+0000","last_undegraded":"2024-04-16T19:36:29.578457+0000","last_fullsized":"2024-04-16T19:36:29.578457+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.820904+0000","last_change":"2024-04-16T19:38:41.820939+0000","last_active":"2024-04-16T19:38:41.820904+0000","last_peered":"2024-04-16T19:38:41.820904+0000","last_clean":"2024-04-16T19:38:41.820904+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:38:41.820904+0000","last_undegraded":"2024-04-16T19:38:41.820904+0000","last_fullsized":"2024-04-16T19:38:41.820904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.820819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.792918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'21","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.362934+0000","last_change":"2024-04-16T19:38:39.362978+0000","last_active":"2024-04-16T19:38:39.362934+0000","last_peered":"2024-04-16T19:38:39.362934+0000","last_clean":"2024-04-16T19:38:39.362934+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:38:39.362934+0000","last_undegraded":"2024-04-16T19:38:39.362934+0000","last_fullsized":"2024-04-16T19:38:39.362934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.362872+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:59.832976+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.775944+0000","last_change":"2024-04-16T19:38:34.775967+0000","last_active":"2024-04-16T19:38:34.775944+0000","last_peered":"2024-04-16T19:38:34.775944+0000","last_clean":"2024-04-16T19:38:34.775944+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:38:34.775944+0000","last_undegraded":"2024-04-16T19:38:34.775944+0000","last_fullsized":"2024-04-16T19:38:34.775944+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.775873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:29.678507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'685","reported_seq":2207,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.959879+0000","last_change":"2024-04-16T19:38:20.959909+0000","last_active":"2024-04-16T19:38:20.959879+0000","last_peered":"2024-04-16T19:38:20.959879+0000","last_clean":"2024-04-16T19:38:20.959879+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:38:20.959879+0000","last_undegraded":"2024-04-16T19:38:20.959879+0000","last_fullsized":"2024-04-16T19:38:20.959879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'685","last_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_deep_scrub":"53'685","last_deep_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.959819+0000","objects_scrubbed":26,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:09.314088+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4728,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'41","reported_seq":377,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.181166+0000","last_change":"2024-04-16T19:38:12.181166+0000","last_active":"2024-04-16T19:38:12.181166+0000","last_peered":"2024-04-16T19:38:12.181166+0000","last_clean":"2024-04-16T19:38:12.181166+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:38:12.181166+0000","last_undegraded":"2024-04-16T19:38:12.181166+0000","last_fullsized":"2024-04-16T19:38:12.181166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41","last_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_deep_scrub":"53'41","last_deep_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.181055+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.810131+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.360593+0000","last_change":"2024-04-16T19:38:34.360619+0000","last_active":"2024-04-16T19:38:34.360593+0000","last_peered":"2024-04-16T19:38:34.360593+0000","last_clean":"2024-04-16T19:38:34.360593+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:38:34.360593+0000","last_undegraded":"2024-04-16T19:38:34.360593+0000","last_fullsized":"2024-04-16T19:38:34.360593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.360526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:17.270587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587429+0000","last_change":"2024-04-16T17:45:10.395061+0000","last_active":"2024-04-16T19:37:14.587429+0000","last_peered":"2024-04-16T19:37:14.587429+0000","last_clean":"2024-04-16T19:37:14.587429+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:37:14.587429+0000","last_undegraded":"2024-04-16T19:37:14.587429+0000","last_fullsized":"2024-04-16T19:37:14.587429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338632+0000","last_change":"2024-04-16T17:45:08.389656+0000","last_active":"2024-04-16T19:38:10.338632+0000","last_peered":"2024-04-16T19:38:10.338632+0000","last_clean":"2024-04-16T19:38:10.338632+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:38:10.338632+0000","last_undegraded":"2024-04-16T19:38:10.338632+0000","last_fullsized":"2024-04-16T19:38:10.338632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.398418+0000","last_change":"2024-04-16T17:45:20.407054+0000","last_active":"2024-04-16T19:37:24.398418+0000","last_peered":"2024-04-16T19:37:24.398418+0000","last_clean":"2024-04-16T19:37:24.398418+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:37:24.398418+0000","last_undegraded":"2024-04-16T19:37:24.398418+0000","last_fullsized":"2024-04-16T19:37:24.398418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'104","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589631+0000","last_change":"2024-04-16T17:45:22.415814+0000","last_active":"2024-04-16T19:37:24.589631+0000","last_peered":"2024-04-16T19:37:24.589631+0000","last_clean":"2024-04-16T19:37:24.589631+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:37:24.589631+0000","last_undegraded":"2024-04-16T19:37:24.589631+0000","last_fullsized":"2024-04-16T19:37:24.589631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":111,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.398893+0000","last_change":"2024-04-16T17:45:24.425524+0000","last_active":"2024-04-16T19:37:24.398893+0000","last_peered":"2024-04-16T19:37:24.398893+0000","last_clean":"2024-04-16T19:37:24.398893+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:37:24.398893+0000","last_undegraded":"2024-04-16T19:37:24.398893+0000","last_fullsized":"2024-04-16T19:37:24.398893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":75,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.391692+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:36:34.391692+0000","last_peered":"2024-04-16T19:36:34.391692+0000","last_clean":"2024-04-16T19:36:34.391692+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:36:34.391692+0000","last_undegraded":"2024-04-16T19:36:34.391692+0000","last_fullsized":"2024-04-16T19:36:34.391692+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2058,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:29.393038+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:36:29.393038+0000","last_peered":"2024-04-16T19:36:29.393038+0000","last_clean":"2024-04-16T19:36:29.393038+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:36:29.393038+0000","last_undegraded":"2024-04-16T19:36:29.393038+0000","last_fullsized":"2024-04-16T19:36:29.393038+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.126764+0000","last_change":"2024-04-16T19:38:33.126787+0000","last_active":"2024-04-16T19:38:33.126764+0000","last_peered":"2024-04-16T19:38:33.126764+0000","last_clean":"2024-04-16T19:38:33.126764+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:38:33.126764+0000","last_undegraded":"2024-04-16T19:38:33.126764+0000","last_fullsized":"2024-04-16T19:38:33.126764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.126702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:58.080828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'18","reported_seq":163,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.717371+0000","last_change":"2024-04-16T19:38:39.717409+0000","last_active":"2024-04-16T19:38:39.717371+0000","last_peered":"2024-04-16T19:38:39.717371+0000","last_clean":"2024-04-16T19:38:39.717371+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:38:39.717371+0000","last_undegraded":"2024-04-16T19:38:39.717371+0000","last_fullsized":"2024-04-16T19:38:39.717371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'18","last_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_deep_scrub":"53'18","last_deep_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.717311+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:15:00.906262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'652","reported_seq":2205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.155887+0000","last_change":"2024-04-16T19:38:30.155937+0000","last_active":"2024-04-16T19:38:30.155887+0000","last_peered":"2024-04-16T19:38:30.155887+0000","last_clean":"2024-04-16T19:38:30.155887+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:38:30.155887+0000","last_undegraded":"2024-04-16T19:38:30.155887+0000","last_fullsized":"2024-04-16T19:38:30.155887+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.155802+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:56.186978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'745","reported_seq":3560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.302525+0000","last_change":"2024-04-16T19:38:20.302555+0000","last_active":"2024-04-16T19:38:20.302525+0000","last_peered":"2024-04-16T19:38:20.302525+0000","last_clean":"2024-04-16T19:38:20.302525+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:38:20.302525+0000","last_undegraded":"2024-04-16T19:38:20.302525+0000","last_fullsized":"2024-04-16T19:38:20.302525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'745","last_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_deep_scrub":"53'745","last_deep_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.302461+0000","objects_scrubbed":25,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:34.270855+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18796,"num_omap_keys":104,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'14","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.221430+0000","last_change":"2024-04-16T19:38:13.221430+0000","last_active":"2024-04-16T19:38:13.221430+0000","last_peered":"2024-04-16T19:38:13.221430+0000","last_clean":"2024-04-16T19:38:13.221430+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:38:13.221430+0000","last_undegraded":"2024-04-16T19:38:13.221430+0000","last_fullsized":"2024-04-16T19:38:13.221430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.221281+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:20.880912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.777444+0000","last_change":"2024-04-16T19:38:37.777471+0000","last_active":"2024-04-16T19:38:37.777444+0000","last_peered":"2024-04-16T19:38:37.777444+0000","last_clean":"2024-04-16T19:38:37.777444+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:38:37.777444+0000","last_undegraded":"2024-04-16T19:38:37.777444+0000","last_fullsized":"2024-04-16T19:38:37.777444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.777367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:38.830695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587391+0000","last_change":"2024-04-16T17:45:10.402839+0000","last_active":"2024-04-16T19:37:14.587391+0000","last_peered":"2024-04-16T19:37:14.587391+0000","last_clean":"2024-04-16T19:37:14.587391+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:37:14.587391+0000","last_undegraded":"2024-04-16T19:37:14.587391+0000","last_fullsized":"2024-04-16T19:37:14.587391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068616+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:38:08.068616+0000","last_peered":"2024-04-16T19:38:08.068616+0000","last_clean":"2024-04-16T19:38:08.068616+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:38:08.068616+0000","last_undegraded":"2024-04-16T19:38:08.068616+0000","last_fullsized":"2024-04-16T19:38:08.068616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"48'4","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.399675+0000","last_change":"2024-04-16T17:45:20.413469+0000","last_active":"2024-04-16T19:37:24.399675+0000","last_peered":"2024-04-16T19:37:24.399675+0000","last_clean":"2024-04-16T19:37:24.399675+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:37:24.399675+0000","last_undegraded":"2024-04-16T19:37:24.399675+0000","last_fullsized":"2024-04-16T19:37:24.399675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'80","reported_seq":240,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.398926+0000","last_change":"2024-04-16T17:45:22.415761+0000","last_active":"2024-04-16T19:37:24.398926+0000","last_peered":"2024-04-16T19:37:24.398926+0000","last_clean":"2024-04-16T19:37:24.398926+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:37:24.398926+0000","last_undegraded":"2024-04-16T19:37:24.398926+0000","last_fullsized":"2024-04-16T19:37:24.398926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.391675+0000","last_change":"2024-04-16T19:38:37.391698+0000","last_active":"2024-04-16T19:38:37.391675+0000","last_peered":"2024-04-16T19:38:37.391675+0000","last_clean":"2024-04-16T19:38:37.391675+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:38:37.391675+0000","last_undegraded":"2024-04-16T19:38:37.391675+0000","last_fullsized":"2024-04-16T19:38:37.391675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.391613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:56.190105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404769+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:37:59.404769+0000","last_peered":"2024-04-16T19:37:59.404769+0000","last_clean":"2024-04-16T19:37:59.404769+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:37:59.404769+0000","last_undegraded":"2024-04-16T19:37:59.404769+0000","last_fullsized":"2024-04-16T19:37:59.404769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'112","reported_seq":1494,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401937+0000","last_change":"2024-04-16T17:46:25.525571+0000","last_active":"2024-04-16T19:37:39.401937+0000","last_peered":"2024-04-16T19:37:39.401937+0000","last_clean":"2024-04-16T19:37:39.401937+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:37:39.401937+0000","last_undegraded":"2024-04-16T19:37:39.401937+0000","last_fullsized":"2024-04-16T19:37:39.401937+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.367350+0000","last_change":"2024-04-16T19:38:40.367372+0000","last_active":"2024-04-16T19:38:40.367350+0000","last_peered":"2024-04-16T19:38:40.367350+0000","last_clean":"2024-04-16T19:38:40.367350+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:38:40.367350+0000","last_undegraded":"2024-04-16T19:38:40.367350+0000","last_fullsized":"2024-04-16T19:38:40.367350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.367287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:20.695875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"53'4","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.431286+0000","last_change":"2024-04-16T19:38:32.431337+0000","last_active":"2024-04-16T19:38:32.431286+0000","last_peered":"2024-04-16T19:38:32.431286+0000","last_clean":"2024-04-16T19:38:32.431286+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:38:32.431286+0000","last_undegraded":"2024-04-16T19:38:32.431286+0000","last_fullsized":"2024-04-16T19:38:32.431286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.431211+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:40.828369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.346700+0000","last_change":"2024-04-16T19:38:32.346723+0000","last_active":"2024-04-16T19:38:32.346700+0000","last_peered":"2024-04-16T19:38:32.346700+0000","last_clean":"2024-04-16T19:38:32.346700+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:38:32.346700+0000","last_undegraded":"2024-04-16T19:38:32.346700+0000","last_fullsized":"2024-04-16T19:38:32.346700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.346634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:51.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'394","reported_seq":728,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.708440+0000","last_change":"2024-04-16T19:38:11.708492+0000","last_active":"2024-04-16T19:38:11.708440+0000","last_peered":"2024-04-16T19:38:11.708440+0000","last_clean":"2024-04-16T19:38:11.708440+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:38:11.708440+0000","last_undegraded":"2024-04-16T19:38:11.708440+0000","last_fullsized":"2024-04-16T19:38:11.708440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'394","last_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_deep_scrub":"53'394","last_deep_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.708368+0000","objects_scrubbed":25,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.347792+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'23","reported_seq":338,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.749658+0000","last_change":"2024-04-16T19:38:27.749706+0000","last_active":"2024-04-16T19:38:27.749658+0000","last_peered":"2024-04-16T19:38:27.749658+0000","last_clean":"2024-04-16T19:38:27.749658+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:38:27.749658+0000","last_undegraded":"2024-04-16T19:38:27.749658+0000","last_fullsized":"2024-04-16T19:38:27.749658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.749597+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:41.717991+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402720+0000","last_change":"2024-04-16T17:45:10.396745+0000","last_active":"2024-04-16T19:37:44.402720+0000","last_peered":"2024-04-16T19:37:44.402720+0000","last_clean":"2024-04-16T19:37:44.402720+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:37:44.402720+0000","last_undegraded":"2024-04-16T19:37:44.402720+0000","last_fullsized":"2024-04-16T19:37:44.402720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976182+0000","last_change":"2024-04-16T17:45:08.384480+0000","last_active":"2024-04-16T19:38:08.976182+0000","last_peered":"2024-04-16T19:38:08.976182+0000","last_clean":"2024-04-16T19:38:08.976182+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:38:08.976182+0000","last_undegraded":"2024-04-16T19:38:08.976182+0000","last_fullsized":"2024-04-16T19:38:08.976182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405292+0000","last_change":"2024-04-16T17:45:20.414382+0000","last_active":"2024-04-16T19:37:44.405292+0000","last_peered":"2024-04-16T19:37:44.405292+0000","last_clean":"2024-04-16T19:37:44.405292+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:37:44.405292+0000","last_undegraded":"2024-04-16T19:37:44.405292+0000","last_fullsized":"2024-04-16T19:37:44.405292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'88","reported_seq":254,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595941+0000","last_change":"2024-04-16T17:45:22.421515+0000","last_active":"2024-04-16T19:37:54.595941+0000","last_peered":"2024-04-16T19:37:54.595941+0000","last_clean":"2024-04-16T19:37:54.595941+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:37:54.595941+0000","last_undegraded":"2024-04-16T19:37:54.595941+0000","last_fullsized":"2024-04-16T19:37:54.595941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.811745+0000","last_change":"2024-04-16T19:38:37.811769+0000","last_active":"2024-04-16T19:38:37.811745+0000","last_peered":"2024-04-16T19:38:37.811745+0000","last_clean":"2024-04-16T19:38:37.811745+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:38:37.811745+0000","last_undegraded":"2024-04-16T19:38:37.811745+0000","last_fullsized":"2024-04-16T19:38:37.811745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.811682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:16.599188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.717809+0000","last_change":"2024-04-16T19:38:24.717833+0000","last_active":"2024-04-16T19:38:24.717809+0000","last_peered":"2024-04-16T19:38:24.717809+0000","last_clean":"2024-04-16T19:38:24.717809+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:38:24.717809+0000","last_undegraded":"2024-04-16T19:38:24.717809+0000","last_fullsized":"2024-04-16T19:38:24.717809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.717739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:12.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340415+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:38:10.340415+0000","last_peered":"2024-04-16T19:38:10.340415+0000","last_clean":"2024-04-16T19:38:10.340415+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:38:10.340415+0000","last_undegraded":"2024-04-16T19:38:10.340415+0000","last_fullsized":"2024-04-16T19:38:10.340415+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'112","reported_seq":1325,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887536+0000","last_change":"2024-04-16T17:46:25.530104+0000","last_active":"2024-04-16T19:38:09.887536+0000","last_peered":"2024-04-16T19:38:09.887536+0000","last_clean":"2024-04-16T19:38:09.887536+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:38:09.887536+0000","last_undegraded":"2024-04-16T19:38:09.887536+0000","last_fullsized":"2024-04-16T19:38:09.887536+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":79,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.399769+0000","last_change":"2024-04-16T17:46:17.511681+0000","last_active":"2024-04-16T19:37:29.399769+0000","last_peered":"2024-04-16T19:37:29.399769+0000","last_clean":"2024-04-16T19:37:29.399769+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:37:29.399769+0000","last_undegraded":"2024-04-16T19:37:29.399769+0000","last_fullsized":"2024-04-16T19:37:29.399769+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:16.487107+0000","last_clean_scrub_stamp":"2024-04-16T17:46:16.487107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"53'15","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.832730+0000","last_change":"2024-04-16T19:38:47.832780+0000","last_active":"2024-04-16T19:38:47.832730+0000","last_peered":"2024-04-16T19:38:47.832730+0000","last_clean":"2024-04-16T19:38:47.832730+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:38:47.832730+0000","last_undegraded":"2024-04-16T19:38:47.832730+0000","last_fullsized":"2024-04-16T19:38:47.832730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'15","last_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_deep_scrub":"53'15","last_deep_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.832667+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:28.161255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.156986+0000","last_change":"2024-04-16T19:38:34.157007+0000","last_active":"2024-04-16T19:38:34.156986+0000","last_peered":"2024-04-16T19:38:34.156986+0000","last_clean":"2024-04-16T19:38:34.156986+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:38:34.156986+0000","last_undegraded":"2024-04-16T19:38:34.156986+0000","last_fullsized":"2024-04-16T19:38:34.156986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.156921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:55.446024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'232","reported_seq":419,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.530282+0000","last_change":"2024-04-16T19:38:19.530353+0000","last_active":"2024-04-16T19:38:19.530282+0000","last_peered":"2024-04-16T19:38:19.530282+0000","last_clean":"2024-04-16T19:38:19.530282+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:38:19.530282+0000","last_undegraded":"2024-04-16T19:38:19.530282+0000","last_fullsized":"2024-04-16T19:38:19.530282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'232","last_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_deep_scrub":"53'232","last_deep_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.530215+0000","objects_scrubbed":16,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:50:04.335733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14555,"num_omap_keys":67,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'24","reported_seq":473,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.394596+0000","last_change":"2024-04-16T17:47:16.558050+0000","last_active":"2024-04-16T19:36:59.394596+0000","last_peered":"2024-04-16T19:36:59.394596+0000","last_clean":"2024-04-16T19:36:59.394596+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:36:59.394596+0000","last_undegraded":"2024-04-16T19:36:59.394596+0000","last_fullsized":"2024-04-16T19:36:59.394596+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403553+0000","last_change":"2024-04-16T17:45:10.400195+0000","last_active":"2024-04-16T19:37:34.403553+0000","last_peered":"2024-04-16T19:37:34.403553+0000","last_clean":"2024-04-16T19:37:34.403553+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:37:34.403553+0000","last_undegraded":"2024-04-16T19:37:34.403553+0000","last_fullsized":"2024-04-16T19:37:34.403553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.579382+0000","last_change":"2024-04-16T17:45:08.388718+0000","last_active":"2024-04-16T19:36:34.579382+0000","last_peered":"2024-04-16T19:36:34.579382+0000","last_clean":"2024-04-16T19:36:34.579382+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:36:34.579382+0000","last_undegraded":"2024-04-16T19:36:34.579382+0000","last_fullsized":"2024-04-16T19:36:34.579382+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"32'2","reported_seq":563,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404099+0000","last_change":"2024-04-16T17:45:20.407653+0000","last_active":"2024-04-16T19:37:54.404099+0000","last_peered":"2024-04-16T19:37:54.404099+0000","last_clean":"2024-04-16T19:37:54.404099+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:37:54.404099+0000","last_undegraded":"2024-04-16T19:37:54.404099+0000","last_fullsized":"2024-04-16T19:37:54.404099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'152","reported_seq":345,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.404018+0000","last_change":"2024-04-16T17:45:22.417131+0000","last_active":"2024-04-16T19:37:54.404018+0000","last_peered":"2024-04-16T19:37:54.404018+0000","last_clean":"2024-04-16T19:37:54.404018+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:37:54.404018+0000","last_undegraded":"2024-04-16T19:37:54.404018+0000","last_fullsized":"2024-04-16T19:37:54.404018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.749066+0000","last_change":"2024-04-16T19:38:47.749088+0000","last_active":"2024-04-16T19:38:47.749066+0000","last_peered":"2024-04-16T19:38:47.749066+0000","last_clean":"2024-04-16T19:38:47.749066+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:38:47.749066+0000","last_undegraded":"2024-04-16T19:38:47.749066+0000","last_fullsized":"2024-04-16T19:38:47.749066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.748997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:30.659057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.859523+0000","last_change":"2024-04-16T19:38:25.859545+0000","last_active":"2024-04-16T19:38:25.859523+0000","last_peered":"2024-04-16T19:38:25.859523+0000","last_clean":"2024-04-16T19:38:25.859523+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:38:25.859523+0000","last_undegraded":"2024-04-16T19:38:25.859523+0000","last_fullsized":"2024-04-16T19:38:25.859523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.859440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:49:45.247605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069936+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:38:08.069936+0000","last_peered":"2024-04-16T19:38:08.069936+0000","last_clean":"2024-04-16T19:38:08.069936+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:38:08.069936+0000","last_undegraded":"2024-04-16T19:38:08.069936+0000","last_fullsized":"2024-04-16T19:38:08.069936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'152","reported_seq":2009,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.720163+0000","last_change":"2024-04-16T19:38:42.720215+0000","last_active":"2024-04-16T19:38:42.720163+0000","last_peered":"2024-04-16T19:38:42.720163+0000","last_clean":"2024-04-16T19:38:42.720163+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:38:42.720163+0000","last_undegraded":"2024-04-16T19:38:42.720163+0000","last_fullsized":"2024-04-16T19:38:42.720163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'152","last_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_deep_scrub":"53'152","last_deep_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.720094+0000","objects_scrubbed":42,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:29.723422+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7797,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.359616+0000","last_change":"2024-04-16T19:38:44.359659+0000","last_active":"2024-04-16T19:38:44.359616+0000","last_peered":"2024-04-16T19:38:44.359616+0000","last_clean":"2024-04-16T19:38:44.359616+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:38:44.359616+0000","last_undegraded":"2024-04-16T19:38:44.359616+0000","last_fullsized":"2024-04-16T19:38:44.359616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.359543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:32.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"53'6","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.828811+0000","last_change":"2024-04-16T19:38:44.828869+0000","last_active":"2024-04-16T19:38:44.828811+0000","last_peered":"2024-04-16T19:38:44.828811+0000","last_clean":"2024-04-16T19:38:44.828811+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:38:44.828811+0000","last_undegraded":"2024-04-16T19:38:44.828811+0000","last_fullsized":"2024-04-16T19:38:44.828811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.828731+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:03.627224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'21","reported_seq":1488,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.901432+0000","last_change":"2024-04-16T19:38:47.901478+0000","last_active":"2024-04-16T19:38:47.901432+0000","last_peered":"2024-04-16T19:38:47.901432+0000","last_clean":"2024-04-16T19:38:47.901432+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:38:47.901432+0000","last_undegraded":"2024-04-16T19:38:47.901432+0000","last_fullsized":"2024-04-16T19:38:47.901432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.901356+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:42.407062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'681","reported_seq":3330,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.829538+0000","last_change":"2024-04-16T19:38:10.829578+0000","last_active":"2024-04-16T19:38:10.829538+0000","last_peered":"2024-04-16T19:38:10.829538+0000","last_clean":"2024-04-16T19:38:10.829538+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:38:10.829538+0000","last_undegraded":"2024-04-16T19:38:10.829538+0000","last_fullsized":"2024-04-16T19:38:10.829538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'681","last_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_deep_scrub":"53'681","last_deep_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.829490+0000","objects_scrubbed":20,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:55.635008+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'12","reported_seq":518,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.553415+0000","last_change":"2024-04-16T19:38:21.553466+0000","last_active":"2024-04-16T19:38:21.553415+0000","last_peered":"2024-04-16T19:38:21.553415+0000","last_clean":"2024-04-16T19:38:21.553415+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:38:21.553415+0000","last_undegraded":"2024-04-16T19:38:21.553415+0000","last_fullsized":"2024-04-16T19:38:21.553415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.553349+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:55.897508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405254+0000","last_change":"2024-04-16T17:45:10.393491+0000","last_active":"2024-04-16T19:37:44.405254+0000","last_peered":"2024-04-16T19:37:44.405254+0000","last_clean":"2024-04-16T19:37:44.405254+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:37:44.405254+0000","last_undegraded":"2024-04-16T19:37:44.405254+0000","last_fullsized":"2024-04-16T19:37:44.405254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400637+0000","last_change":"2024-04-16T17:45:08.380598+0000","last_active":"2024-04-16T19:37:39.400637+0000","last_peered":"2024-04-16T19:37:39.400637+0000","last_clean":"2024-04-16T19:37:39.400637+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:37:39.400637+0000","last_undegraded":"2024-04-16T19:37:39.400637+0000","last_fullsized":"2024-04-16T19:37:39.400637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"48'2","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403108+0000","last_change":"2024-04-16T17:45:20.412352+0000","last_active":"2024-04-16T19:37:54.403108+0000","last_peered":"2024-04-16T19:37:54.403108+0000","last_clean":"2024-04-16T19:37:54.403108+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:37:54.403108+0000","last_undegraded":"2024-04-16T19:37:54.403108+0000","last_fullsized":"2024-04-16T19:37:54.403108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'104","reported_seq":282,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595912+0000","last_change":"2024-04-16T17:45:22.417121+0000","last_active":"2024-04-16T19:37:54.595912+0000","last_peered":"2024-04-16T19:37:54.595912+0000","last_clean":"2024-04-16T19:37:54.595912+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:37:54.595912+0000","last_undegraded":"2024-04-16T19:37:54.595912+0000","last_fullsized":"2024-04-16T19:37:54.595912+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.713466+0000","last_change":"2024-04-16T19:38:48.713508+0000","last_active":"2024-04-16T19:38:48.713466+0000","last_peered":"2024-04-16T19:38:48.713466+0000","last_clean":"2024-04-16T19:38:48.713466+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:38:48.713466+0000","last_undegraded":"2024-04-16T19:38:48.713466+0000","last_fullsized":"2024-04-16T19:38:48.713466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.713387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:48.829744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.890917+0000","last_change":"2024-04-16T19:38:27.890939+0000","last_active":"2024-04-16T19:38:27.890917+0000","last_peered":"2024-04-16T19:38:27.890917+0000","last_clean":"2024-04-16T19:38:27.890917+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:38:27.890917+0000","last_undegraded":"2024-04-16T19:38:27.890917+0000","last_fullsized":"2024-04-16T19:38:27.890917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.890852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:30.404878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887604+0000","last_change":"2024-04-16T18:09:02.173368+0000","last_active":"2024-04-16T19:38:09.887604+0000","last_peered":"2024-04-16T19:38:09.887604+0000","last_clean":"2024-04-16T19:38:09.887604+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:38:09.887604+0000","last_undegraded":"2024-04-16T19:38:09.887604+0000","last_fullsized":"2024-04-16T19:38:09.887604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'146","reported_seq":1639,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592782+0000","last_change":"2024-04-16T17:46:25.529669+0000","last_active":"2024-04-16T19:37:39.592782+0000","last_peered":"2024-04-16T19:37:39.592782+0000","last_clean":"2024-04-16T19:37:39.592782+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:37:39.592782+0000","last_undegraded":"2024-04-16T19:37:39.592782+0000","last_fullsized":"2024-04-16T19:37:39.592782+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.550739+0000","last_change":"2024-04-16T19:38:26.550762+0000","last_active":"2024-04-16T19:38:26.550739+0000","last_peered":"2024-04-16T19:38:26.550739+0000","last_clean":"2024-04-16T19:38:26.550739+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:38:26.550739+0000","last_undegraded":"2024-04-16T19:38:26.550739+0000","last_fullsized":"2024-04-16T19:38:26.550739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.550671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:50.234890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.819588+0000","last_change":"2024-04-16T19:38:45.819620+0000","last_active":"2024-04-16T19:38:45.819588+0000","last_peered":"2024-04-16T19:38:45.819588+0000","last_clean":"2024-04-16T19:38:45.819588+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:38:45.819588+0000","last_undegraded":"2024-04-16T19:38:45.819588+0000","last_fullsized":"2024-04-16T19:38:45.819588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.819519+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:24.941425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.764005+0000","last_change":"2024-04-16T19:38:30.764029+0000","last_active":"2024-04-16T19:38:30.764005+0000","last_peered":"2024-04-16T19:38:30.764005+0000","last_clean":"2024-04-16T19:38:30.764005+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:38:30.764005+0000","last_undegraded":"2024-04-16T19:38:30.764005+0000","last_fullsized":"2024-04-16T19:38:30.764005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.763939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:44.186208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'562","reported_seq":45436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.690811+0000","last_change":"2024-04-16T19:38:12.690864+0000","last_active":"2024-04-16T19:38:12.690811+0000","last_peered":"2024-04-16T19:38:12.690811+0000","last_clean":"2024-04-16T19:38:12.690811+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:38:12.690811+0000","last_undegraded":"2024-04-16T19:38:12.690811+0000","last_fullsized":"2024-04-16T19:38:12.690811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'562","last_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_deep_scrub":"53'562","last_deep_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.690747+0000","objects_scrubbed":19,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:33.979851+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7052,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'16","reported_seq":415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.851820+0000","last_change":"2024-04-16T19:38:09.851868+0000","last_active":"2024-04-16T19:38:09.851820+0000","last_peered":"2024-04-16T19:38:09.851820+0000","last_clean":"2024-04-16T19:38:09.851820+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:38:09.851820+0000","last_undegraded":"2024-04-16T19:38:09.851820+0000","last_fullsized":"2024-04-16T19:38:09.851820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.851761+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:33.535980+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593568+0000","last_change":"2024-04-16T17:45:10.395688+0000","last_active":"2024-04-16T19:37:44.593568+0000","last_peered":"2024-04-16T19:37:44.593568+0000","last_clean":"2024-04-16T19:37:44.593568+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:37:44.593568+0000","last_undegraded":"2024-04-16T19:37:44.593568+0000","last_fullsized":"2024-04-16T19:37:44.593568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404315+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:37:39.404315+0000","last_peered":"2024-04-16T19:37:39.404315+0000","last_clean":"2024-04-16T19:37:39.404315+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:37:39.404315+0000","last_undegraded":"2024-04-16T19:37:39.404315+0000","last_fullsized":"2024-04-16T19:37:39.404315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"48'2","reported_seq":501,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595909+0000","last_change":"2024-04-16T17:45:20.412567+0000","last_active":"2024-04-16T19:37:54.595909+0000","last_peered":"2024-04-16T19:37:54.595909+0000","last_clean":"2024-04-16T19:37:54.595909+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:37:54.595909+0000","last_undegraded":"2024-04-16T19:37:54.595909+0000","last_fullsized":"2024-04-16T19:37:54.595909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'120","reported_seq":303,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402679+0000","last_change":"2024-04-16T17:45:22.416448+0000","last_active":"2024-04-16T19:37:44.402679+0000","last_peered":"2024-04-16T19:37:44.402679+0000","last_clean":"2024-04-16T19:37:44.402679+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:37:44.402679+0000","last_undegraded":"2024-04-16T19:37:44.402679+0000","last_fullsized":"2024-04-16T19:37:44.402679+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'12","reported_seq":1396,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403767+0000","last_change":"2024-04-16T17:45:24.426319+0000","last_active":"2024-04-16T19:37:54.403767+0000","last_peered":"2024-04-16T19:37:54.403767+0000","last_clean":"2024-04-16T19:37:54.403767+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:37:54.403767+0000","last_undegraded":"2024-04-16T19:37:54.403767+0000","last_fullsized":"2024-04-16T19:37:54.403767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.917217+0000","last_change":"2024-04-16T19:38:29.917241+0000","last_active":"2024-04-16T19:38:29.917217+0000","last_peered":"2024-04-16T19:38:29.917217+0000","last_clean":"2024-04-16T19:38:29.917217+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:38:29.917217+0000","last_undegraded":"2024-04-16T19:38:29.917217+0000","last_fullsized":"2024-04-16T19:38:29.917217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.917157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:51.736564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596673+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:37:59.596673+0000","last_peered":"2024-04-16T19:37:59.596673+0000","last_clean":"2024-04-16T19:37:59.596673+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:37:59.596673+0000","last_undegraded":"2024-04-16T19:37:59.596673+0000","last_fullsized":"2024-04-16T19:37:59.596673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'124","reported_seq":1595,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.373764+0000","last_change":"2024-04-16T19:38:42.373815+0000","last_active":"2024-04-16T19:38:42.373764+0000","last_peered":"2024-04-16T19:38:42.373764+0000","last_clean":"2024-04-16T19:38:42.373764+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:38:42.373764+0000","last_undegraded":"2024-04-16T19:38:42.373764+0000","last_fullsized":"2024-04-16T19:38:42.373764+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'124","last_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_deep_scrub":"53'124","last_deep_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.373704+0000","objects_scrubbed":35,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:05.137933+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8419,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.361486+0000","last_change":"2024-04-16T19:38:38.361524+0000","last_active":"2024-04-16T19:38:38.361486+0000","last_peered":"2024-04-16T19:38:38.361486+0000","last_clean":"2024-04-16T19:38:38.361486+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:38:38.361486+0000","last_undegraded":"2024-04-16T19:38:38.361486+0000","last_fullsized":"2024-04-16T19:38:38.361486+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.361386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:17.483291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'23","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.803226+0000","last_change":"2024-04-16T19:38:35.803270+0000","last_active":"2024-04-16T19:38:35.803226+0000","last_peered":"2024-04-16T19:38:35.803226+0000","last_clean":"2024-04-16T19:38:35.803226+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:38:35.803226+0000","last_undegraded":"2024-04-16T19:38:35.803226+0000","last_fullsized":"2024-04-16T19:38:35.803226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.803159+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:41.224996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'652","reported_seq":2571,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.898392+0000","last_change":"2024-04-16T19:38:30.898437+0000","last_active":"2024-04-16T19:38:30.898392+0000","last_peered":"2024-04-16T19:38:30.898392+0000","last_clean":"2024-04-16T19:38:30.898392+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:38:30.898392+0000","last_undegraded":"2024-04-16T19:38:30.898392+0000","last_fullsized":"2024-04-16T19:38:30.898392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.898322+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:07.061769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'539","reported_seq":987,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.232436+0000","last_change":"2024-04-16T19:38:16.232495+0000","last_active":"2024-04-16T19:38:16.232436+0000","last_peered":"2024-04-16T19:38:16.232436+0000","last_clean":"2024-04-16T19:38:16.232436+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:38:16.232436+0000","last_undegraded":"2024-04-16T19:38:16.232436+0000","last_fullsized":"2024-04-16T19:38:16.232436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'539","last_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_deep_scrub":"53'539","last_deep_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.232375+0000","objects_scrubbed":21,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:46.553060+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7262,"num_omap_keys":33,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'16","reported_seq":388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.567303+0000","last_change":"2024-04-16T19:38:23.567350+0000","last_active":"2024-04-16T19:38:23.567303+0000","last_peered":"2024-04-16T19:38:23.567303+0000","last_clean":"2024-04-16T19:38:23.567303+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:38:23.567303+0000","last_undegraded":"2024-04-16T19:38:23.567303+0000","last_fullsized":"2024-04-16T19:38:23.567303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.567241+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:36.119901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401607+0000","last_change":"2024-04-16T17:45:10.402149+0000","last_active":"2024-04-16T19:37:44.401607+0000","last_peered":"2024-04-16T19:37:44.401607+0000","last_clean":"2024-04-16T19:37:44.401607+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:37:44.401607+0000","last_undegraded":"2024-04-16T19:37:44.401607+0000","last_fullsized":"2024-04-16T19:37:44.401607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401089+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:37:39.401089+0000","last_peered":"2024-04-16T19:37:39.401089+0000","last_clean":"2024-04-16T19:37:39.401089+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:37:39.401089+0000","last_undegraded":"2024-04-16T19:37:39.401089+0000","last_fullsized":"2024-04-16T19:37:39.401089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403022+0000","last_change":"2024-04-16T17:45:20.409559+0000","last_active":"2024-04-16T19:37:54.403022+0000","last_peered":"2024-04-16T19:37:54.403022+0000","last_clean":"2024-04-16T19:37:54.403022+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:37:54.403022+0000","last_undegraded":"2024-04-16T19:37:54.403022+0000","last_fullsized":"2024-04-16T19:37:54.403022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'152","reported_seq":346,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394556+0000","last_change":"2024-04-16T17:45:22.415559+0000","last_active":"2024-04-16T19:36:54.394556+0000","last_peered":"2024-04-16T19:36:54.394556+0000","last_clean":"2024-04-16T19:36:54.394556+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:36:54.394556+0000","last_undegraded":"2024-04-16T19:36:54.394556+0000","last_fullsized":"2024-04-16T19:36:54.394556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.393792+0000","last_change":"2024-04-16T17:45:24.421195+0000","last_active":"2024-04-16T19:36:34.393792+0000","last_peered":"2024-04-16T19:36:34.393792+0000","last_clean":"2024-04-16T19:36:34.393792+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:36:34.393792+0000","last_undegraded":"2024-04-16T19:36:34.393792+0000","last_fullsized":"2024-04-16T19:36:34.393792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.923369+0000","last_change":"2024-04-16T19:38:31.923395+0000","last_active":"2024-04-16T19:38:31.923369+0000","last_peered":"2024-04-16T19:38:31.923369+0000","last_clean":"2024-04-16T19:38:31.923369+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:38:31.923369+0000","last_undegraded":"2024-04-16T19:38:31.923369+0000","last_fullsized":"2024-04-16T19:38:31.923369+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.923306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:27.582944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593484+0000","last_change":"2024-04-16T18:09:02.169659+0000","last_active":"2024-04-16T19:37:44.593484+0000","last_peered":"2024-04-16T19:37:44.593484+0000","last_clean":"2024-04-16T19:37:44.593484+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:37:44.593484+0000","last_undegraded":"2024-04-16T19:37:44.593484+0000","last_fullsized":"2024-04-16T19:37:44.593484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'166","reported_seq":2088,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.802004+0000","last_change":"2024-04-16T19:38:46.802047+0000","last_active":"2024-04-16T19:38:46.802004+0000","last_peered":"2024-04-16T19:38:46.802004+0000","last_clean":"2024-04-16T19:38:46.802004+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:38:46.802004+0000","last_undegraded":"2024-04-16T19:38:46.802004+0000","last_fullsized":"2024-04-16T19:38:46.802004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'166","last_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_deep_scrub":"53'166","last_deep_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.801945+0000","objects_scrubbed":47,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:24.936944+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9594,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.829487+0000","last_change":"2024-04-16T19:38:40.829513+0000","last_active":"2024-04-16T19:38:40.829487+0000","last_peered":"2024-04-16T19:38:40.829487+0000","last_clean":"2024-04-16T19:38:40.829487+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:38:40.829487+0000","last_undegraded":"2024-04-16T19:38:40.829487+0000","last_fullsized":"2024-04-16T19:38:40.829487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.829411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:01:00.975262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'4","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.356348+0000","last_change":"2024-04-16T19:38:43.356398+0000","last_active":"2024-04-16T19:38:43.356348+0000","last_peered":"2024-04-16T19:38:43.356348+0000","last_clean":"2024-04-16T19:38:43.356348+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:38:43.356348+0000","last_undegraded":"2024-04-16T19:38:43.356348+0000","last_fullsized":"2024-04-16T19:38:43.356348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.356286+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:53.006964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.056607+0000","last_change":"2024-04-16T19:38:13.056637+0000","last_active":"2024-04-16T19:38:13.056607+0000","last_peered":"2024-04-16T19:38:13.056607+0000","last_clean":"2024-04-16T19:38:13.056607+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:38:13.056607+0000","last_undegraded":"2024-04-16T19:38:13.056607+0000","last_fullsized":"2024-04-16T19:38:13.056607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.056540+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:02.968001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'298","reported_seq":598,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.796439+0000","last_change":"2024-04-16T19:38:18.796507+0000","last_active":"2024-04-16T19:38:18.796439+0000","last_peered":"2024-04-16T19:38:18.796439+0000","last_clean":"2024-04-16T19:38:18.796439+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:38:18.796439+0000","last_undegraded":"2024-04-16T19:38:18.796439+0000","last_fullsized":"2024-04-16T19:38:18.796439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'298","last_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_deep_scrub":"53'298","last_deep_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.796372+0000","objects_scrubbed":17,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:20.964465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'22","reported_seq":391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.891208+0000","last_change":"2024-04-16T19:38:13.891278+0000","last_active":"2024-04-16T19:38:13.891208+0000","last_peered":"2024-04-16T19:38:13.891208+0000","last_clean":"2024-04-16T19:38:13.891208+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:38:13.891208+0000","last_undegraded":"2024-04-16T19:38:13.891208+0000","last_fullsized":"2024-04-16T19:38:13.891208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.891146+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:21.530454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401584+0000","last_change":"2024-04-16T17:45:10.392781+0000","last_active":"2024-04-16T19:37:44.401584+0000","last_peered":"2024-04-16T19:37:44.401584+0000","last_clean":"2024-04-16T19:37:44.401584+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:37:44.401584+0000","last_undegraded":"2024-04-16T19:37:44.401584+0000","last_fullsized":"2024-04-16T19:37:44.401584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401129+0000","last_change":"2024-04-16T17:45:08.386175+0000","last_active":"2024-04-16T19:37:39.401129+0000","last_peered":"2024-04-16T19:37:39.401129+0000","last_clean":"2024-04-16T19:37:39.401129+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:37:39.401129+0000","last_undegraded":"2024-04-16T19:37:39.401129+0000","last_fullsized":"2024-04-16T19:37:39.401129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"48'11","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403583+0000","last_change":"2024-04-16T17:45:20.407986+0000","last_active":"2024-04-16T19:37:54.403583+0000","last_peered":"2024-04-16T19:37:54.403583+0000","last_clean":"2024-04-16T19:37:54.403583+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:37:54.403583+0000","last_undegraded":"2024-04-16T19:37:54.403583+0000","last_fullsized":"2024-04-16T19:37:54.403583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'80","reported_seq":238,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.393825+0000","last_change":"2024-04-16T17:45:22.415078+0000","last_active":"2024-04-16T19:36:34.393825+0000","last_peered":"2024-04-16T19:36:34.393825+0000","last_clean":"2024-04-16T19:36:34.393825+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:36:34.393825+0000","last_undegraded":"2024-04-16T19:36:34.393825+0000","last_fullsized":"2024-04-16T19:36:34.393825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:54.394921+0000","last_change":"2024-04-16T17:45:24.425398+0000","last_active":"2024-04-16T19:36:54.394921+0000","last_peered":"2024-04-16T19:36:54.394921+0000","last_clean":"2024-04-16T19:36:54.394921+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:36:54.394921+0000","last_undegraded":"2024-04-16T19:36:54.394921+0000","last_fullsized":"2024-04-16T19:36:54.394921+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.722421+0000","last_change":"2024-04-16T19:38:23.722443+0000","last_active":"2024-04-16T19:38:23.722421+0000","last_peered":"2024-04-16T19:38:23.722421+0000","last_clean":"2024-04-16T19:38:23.722421+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:38:23.722421+0000","last_undegraded":"2024-04-16T19:38:23.722421+0000","last_fullsized":"2024-04-16T19:38:23.722421+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.722357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:38.742703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405131+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:37:44.405131+0000","last_peered":"2024-04-16T19:37:44.405131+0000","last_clean":"2024-04-16T19:37:44.405131+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:37:44.405131+0000","last_undegraded":"2024-04-16T19:37:44.405131+0000","last_fullsized":"2024-04-16T19:37:44.405131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'161","reported_seq":1777,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.064843+0000","last_change":"2024-04-16T19:38:41.064904+0000","last_active":"2024-04-16T19:38:41.064843+0000","last_peered":"2024-04-16T19:38:41.064843+0000","last_clean":"2024-04-16T19:38:41.064843+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:38:41.064843+0000","last_undegraded":"2024-04-16T19:38:41.064843+0000","last_fullsized":"2024-04-16T19:38:41.064843+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'161","last_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_deep_scrub":"53'161","last_deep_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.064780+0000","objects_scrubbed":41,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:59.693856+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9554,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.719529+0000","last_change":"2024-04-16T19:38:28.719553+0000","last_active":"2024-04-16T19:38:28.719529+0000","last_peered":"2024-04-16T19:38:28.719529+0000","last_clean":"2024-04-16T19:38:28.719529+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:38:28.719529+0000","last_undegraded":"2024-04-16T19:38:28.719529+0000","last_fullsized":"2024-04-16T19:38:28.719529+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:05.470964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'19","reported_seq":155,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403498+0000","last_change":"2024-04-16T17:45:51.478621+0000","last_active":"2024-04-16T19:37:54.403498+0000","last_peered":"2024-04-16T19:37:54.403498+0000","last_clean":"2024-04-16T19:37:54.403498+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:37:54.403498+0000","last_undegraded":"2024-04-16T19:37:54.403498+0000","last_fullsized":"2024-04-16T19:37:54.403498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.395543+0000","last_change":"2024-04-16T17:45:49.474101+0000","last_active":"2024-04-16T19:36:59.395543+0000","last_peered":"2024-04-16T19:36:59.395543+0000","last_clean":"2024-04-16T19:36:59.395543+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:36:59.395543+0000","last_undegraded":"2024-04-16T19:36:59.395543+0000","last_fullsized":"2024-04-16T19:36:59.395543+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:48.448364+0000","last_clean_scrub_stamp":"2024-04-16T17:45:48.448364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5056","reported_seq":7415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.911994+0000","last_change":"2024-04-16T19:38:24.912040+0000","last_active":"2024-04-16T19:38:24.911994+0000","last_peered":"2024-04-16T19:38:24.911994+0000","last_clean":"2024-04-16T19:38:24.911994+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:38:24.911994+0000","last_undegraded":"2024-04-16T19:38:24.911994+0000","last_fullsized":"2024-04-16T19:38:24.911994+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5056","last_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_deep_scrub":"53'5056","last_deep_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.911937+0000","objects_scrubbed":13,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:21.591600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'22","reported_seq":459,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.780629+0000","last_change":"2024-04-16T19:38:17.780675+0000","last_active":"2024-04-16T19:38:17.780629+0000","last_peered":"2024-04-16T19:38:17.780629+0000","last_clean":"2024-04-16T19:38:17.780629+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:38:17.780629+0000","last_undegraded":"2024-04-16T19:38:17.780629+0000","last_fullsized":"2024-04-16T19:38:17.780629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.780565+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:41.464784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395573+0000","last_change":"2024-04-16T17:45:10.397270+0000","last_active":"2024-04-16T19:36:44.395573+0000","last_peered":"2024-04-16T19:36:44.395573+0000","last_clean":"2024-04-16T19:36:44.395573+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:36:44.395573+0000","last_undegraded":"2024-04-16T19:36:44.395573+0000","last_fullsized":"2024-04-16T19:36:44.395573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589689+0000","last_change":"2024-04-16T17:45:08.385404+0000","last_active":"2024-04-16T19:37:24.589689+0000","last_peered":"2024-04-16T19:37:24.589689+0000","last_clean":"2024-04-16T19:37:24.589689+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:37:24.589689+0000","last_undegraded":"2024-04-16T19:37:24.589689+0000","last_fullsized":"2024-04-16T19:37:24.589689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'6","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:34.390899+0000","last_change":"2024-04-16T17:45:20.413621+0000","last_active":"2024-04-16T19:36:34.390899+0000","last_peered":"2024-04-16T19:36:34.390899+0000","last_clean":"2024-04-16T19:36:34.390899+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:36:34.390899+0000","last_undegraded":"2024-04-16T19:36:34.390899+0000","last_fullsized":"2024-04-16T19:36:34.390899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'32","reported_seq":165,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.406982+0000","last_change":"2024-04-16T17:45:22.415077+0000","last_active":"2024-04-16T19:37:54.406982+0000","last_peered":"2024-04-16T19:37:54.406982+0000","last_clean":"2024-04-16T19:37:54.406982+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:37:54.406982+0000","last_undegraded":"2024-04-16T19:37:54.406982+0000","last_fullsized":"2024-04-16T19:37:54.406982+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.934976+0000","last_change":"2024-04-16T19:38:33.934997+0000","last_active":"2024-04-16T19:38:33.934976+0000","last_peered":"2024-04-16T19:38:33.934976+0000","last_clean":"2024-04-16T19:38:33.934976+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:38:33.934976+0000","last_undegraded":"2024-04-16T19:38:33.934976+0000","last_fullsized":"2024-04-16T19:38:33.934976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.934914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:28.582406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.875849+0000","last_change":"2024-04-16T19:38:26.875874+0000","last_active":"2024-04-16T19:38:26.875849+0000","last_peered":"2024-04-16T19:38:26.875849+0000","last_clean":"2024-04-16T19:38:26.875849+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:38:26.875849+0000","last_undegraded":"2024-04-16T19:38:26.875849+0000","last_fullsized":"2024-04-16T19:38:26.875849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.875781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:49.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593702+0000","last_change":"2024-04-16T18:09:02.166083+0000","last_active":"2024-04-16T19:37:44.593702+0000","last_peered":"2024-04-16T19:37:44.593702+0000","last_clean":"2024-04-16T19:37:44.593702+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:37:44.593702+0000","last_undegraded":"2024-04-16T19:37:44.593702+0000","last_fullsized":"2024-04-16T19:37:44.593702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'170","reported_seq":1771,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.011174+0000","last_change":"2024-04-16T19:38:49.011216+0000","last_active":"2024-04-16T19:38:49.011174+0000","last_peered":"2024-04-16T19:38:49.011174+0000","last_clean":"2024-04-16T19:38:49.011174+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:38:49.011174+0000","last_undegraded":"2024-04-16T19:38:49.011174+0000","last_fullsized":"2024-04-16T19:38:49.011174+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'170","last_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_deep_scrub":"53'170","last_deep_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.011115+0000","objects_scrubbed":44,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:08:02.979509+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10942,"num_omap_keys":44,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.751164+0000","last_change":"2024-04-16T19:38:30.751189+0000","last_active":"2024-04-16T19:38:30.751164+0000","last_peered":"2024-04-16T19:38:30.751164+0000","last_clean":"2024-04-16T19:38:30.751164+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:38:30.751164+0000","last_undegraded":"2024-04-16T19:38:30.751164+0000","last_fullsized":"2024-04-16T19:38:30.751164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.751094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:44.801073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'14","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.374218+0000","last_change":"2024-04-16T19:38:46.374254+0000","last_active":"2024-04-16T19:38:46.374218+0000","last_peered":"2024-04-16T19:38:46.374218+0000","last_clean":"2024-04-16T19:38:46.374218+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:38:46.374218+0000","last_undegraded":"2024-04-16T19:38:46.374218+0000","last_fullsized":"2024-04-16T19:38:46.374218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.374155+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:12.131396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.750099+0000","last_change":"2024-04-16T19:38:26.750144+0000","last_active":"2024-04-16T19:38:26.750099+0000","last_peered":"2024-04-16T19:38:26.750099+0000","last_clean":"2024-04-16T19:38:26.750099+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:38:26.750099+0000","last_undegraded":"2024-04-16T19:38:26.750099+0000","last_fullsized":"2024-04-16T19:38:26.750099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.750020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:03.892413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'576","reported_seq":1558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.901548+0000","last_change":"2024-04-16T19:38:28.901634+0000","last_active":"2024-04-16T19:38:28.901548+0000","last_peered":"2024-04-16T19:38:28.901548+0000","last_clean":"2024-04-16T19:38:28.901548+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:38:28.901548+0000","last_undegraded":"2024-04-16T19:38:28.901548+0000","last_fullsized":"2024-04-16T19:38:28.901548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'576","last_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_deep_scrub":"53'576","last_deep_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.901479+0000","objects_scrubbed":22,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:47.579102+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'11","reported_seq":531,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.330076+0000","last_change":"2024-04-16T19:38:39.330127+0000","last_active":"2024-04-16T19:38:39.330076+0000","last_peered":"2024-04-16T19:38:39.330076+0000","last_clean":"2024-04-16T19:38:39.330076+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:38:39.330076+0000","last_undegraded":"2024-04-16T19:38:39.330076+0000","last_fullsized":"2024-04-16T19:38:39.330076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.330010+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:11:17.064209+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428611+0000","last_change":"2024-04-16T17:45:10.400150+0000","last_active":"2024-04-16T19:38:09.428611+0000","last_peered":"2024-04-16T19:38:09.428611+0000","last_clean":"2024-04-16T19:38:09.428611+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:38:09.428611+0000","last_undegraded":"2024-04-16T19:38:09.428611+0000","last_fullsized":"2024-04-16T19:38:09.428611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404415+0000","last_change":"2024-04-16T17:45:08.386622+0000","last_active":"2024-04-16T19:37:39.404415+0000","last_peered":"2024-04-16T19:37:39.404415+0000","last_clean":"2024-04-16T19:37:39.404415+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:37:39.404415+0000","last_undegraded":"2024-04-16T19:37:39.404415+0000","last_fullsized":"2024-04-16T19:37:39.404415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582442+0000","last_change":"2024-04-16T17:45:20.412420+0000","last_active":"2024-04-16T19:36:49.582442+0000","last_peered":"2024-04-16T19:36:49.582442+0000","last_clean":"2024-04-16T19:36:49.582442+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:36:49.582442+0000","last_undegraded":"2024-04-16T19:36:49.582442+0000","last_fullsized":"2024-04-16T19:36:49.582442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'80","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403038+0000","last_change":"2024-04-16T17:45:22.421586+0000","last_active":"2024-04-16T19:37:54.403038+0000","last_peered":"2024-04-16T19:37:54.403038+0000","last_clean":"2024-04-16T19:37:54.403038+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:37:54.403038+0000","last_undegraded":"2024-04-16T19:37:54.403038+0000","last_fullsized":"2024-04-16T19:37:54.403038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":108,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407022+0000","last_change":"2024-04-16T17:45:24.424290+0000","last_active":"2024-04-16T19:37:54.407022+0000","last_peered":"2024-04-16T19:37:54.407022+0000","last_clean":"2024-04-16T19:37:54.407022+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:37:54.407022+0000","last_undegraded":"2024-04-16T19:37:54.407022+0000","last_fullsized":"2024-04-16T19:37:54.407022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:23.406825+0000","last_clean_scrub_stamp":"2024-04-16T17:45:23.406825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.316150+0000","last_change":"2024-04-16T19:38:41.316173+0000","last_active":"2024-04-16T19:38:41.316150+0000","last_peered":"2024-04-16T19:38:41.316150+0000","last_clean":"2024-04-16T19:38:41.316150+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:38:41.316150+0000","last_undegraded":"2024-04-16T19:38:41.316150+0000","last_fullsized":"2024-04-16T19:38:41.316150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.316087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:50:00.704252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'10","reported_seq":205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.211015+0000","last_change":"2024-04-16T19:38:36.211054+0000","last_active":"2024-04-16T19:38:36.211015+0000","last_peered":"2024-04-16T19:38:36.211015+0000","last_clean":"2024-04-16T19:38:36.211015+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:38:36.211015+0000","last_undegraded":"2024-04-16T19:38:36.211015+0000","last_fullsized":"2024-04-16T19:38:36.211015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.210953+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:18.456725+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":94,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.073023+0000","last_change":"2024-04-16T19:38:23.073046+0000","last_active":"2024-04-16T19:38:23.073023+0000","last_peered":"2024-04-16T19:38:23.073023+0000","last_clean":"2024-04-16T19:38:23.073023+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:38:23.073023+0000","last_undegraded":"2024-04-16T19:38:23.073023+0000","last_fullsized":"2024-04-16T19:38:23.073023+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.072960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:19.149593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400582+0000","last_change":"2024-04-16T17:45:08.383072+0000","last_active":"2024-04-16T19:37:39.400582+0000","last_peered":"2024-04-16T19:37:39.400582+0000","last_clean":"2024-04-16T19:37:39.400582+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:37:39.400582+0000","last_undegraded":"2024-04-16T19:37:39.400582+0000","last_fullsized":"2024-04-16T19:37:39.400582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'21","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.709521+0000","last_change":"2024-04-16T19:38:13.709521+0000","last_active":"2024-04-16T19:38:13.709521+0000","last_peered":"2024-04-16T19:38:13.709521+0000","last_clean":"2024-04-16T19:38:13.709521+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:38:13.709521+0000","last_undegraded":"2024-04-16T19:38:13.709521+0000","last_fullsized":"2024-04-16T19:38:13.709521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.709408+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:26.428610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595980+0000","last_change":"2024-04-16T17:45:10.396086+0000","last_active":"2024-04-16T19:37:54.595980+0000","last_peered":"2024-04-16T19:37:54.595980+0000","last_clean":"2024-04-16T19:37:54.595980+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:37:54.595980+0000","last_undegraded":"2024-04-16T19:37:54.595980+0000","last_fullsized":"2024-04-16T19:37:54.595980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592600+0000","last_change":"2024-04-16T17:45:08.390555+0000","last_active":"2024-04-16T19:37:39.592600+0000","last_peered":"2024-04-16T19:37:39.592600+0000","last_clean":"2024-04-16T19:37:39.592600+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:37:39.592600+0000","last_undegraded":"2024-04-16T19:37:39.592600+0000","last_fullsized":"2024-04-16T19:37:39.592600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'26","reported_seq":487,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.777083+0000","last_change":"2024-04-16T19:38:15.777083+0000","last_active":"2024-04-16T19:38:15.777083+0000","last_peered":"2024-04-16T19:38:15.777083+0000","last_clean":"2024-04-16T19:38:15.777083+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:38:15.777083+0000","last_undegraded":"2024-04-16T19:38:15.777083+0000","last_fullsized":"2024-04-16T19:38:15.777083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.776944+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:01.810616+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403654+0000","last_change":"2024-04-16T17:45:10.400426+0000","last_active":"2024-04-16T19:37:54.403654+0000","last_peered":"2024-04-16T19:37:54.403654+0000","last_clean":"2024-04-16T19:37:54.403654+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:37:54.403654+0000","last_undegraded":"2024-04-16T19:37:54.403654+0000","last_fullsized":"2024-04-16T19:37:54.403654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.767299+0000","last_change":"2024-04-16T19:38:32.767299+0000","last_active":"2024-04-16T19:38:32.767299+0000","last_peered":"2024-04-16T19:38:32.767299+0000","last_clean":"2024-04-16T19:38:32.767299+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:38:32.767299+0000","last_undegraded":"2024-04-16T19:38:32.767299+0000","last_fullsized":"2024-04-16T19:38:32.767299+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:09.909599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'16","reported_seq":319,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.568053+0000","last_change":"2024-04-16T19:38:27.568053+0000","last_active":"2024-04-16T19:38:27.568053+0000","last_peered":"2024-04-16T19:38:27.568053+0000","last_clean":"2024-04-16T19:38:27.568053+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:38:27.568053+0000","last_undegraded":"2024-04-16T19:38:27.568053+0000","last_fullsized":"2024-04-16T19:38:27.568053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.567879+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:46.513343+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595799+0000","last_change":"2024-04-16T17:45:10.394142+0000","last_active":"2024-04-16T19:37:54.595799+0000","last_peered":"2024-04-16T19:37:54.595799+0000","last_clean":"2024-04-16T19:37:54.595799+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:37:54.595799+0000","last_undegraded":"2024-04-16T19:37:54.595799+0000","last_fullsized":"2024-04-16T19:37:54.595799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407703+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:37:59.407703+0000","last_peered":"2024-04-16T19:37:59.407703+0000","last_clean":"2024-04-16T19:37:59.407703+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:37:59.407703+0000","last_undegraded":"2024-04-16T19:37:59.407703+0000","last_fullsized":"2024-04-16T19:37:59.407703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'12","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.763410+0000","last_change":"2024-04-16T19:38:21.763470+0000","last_active":"2024-04-16T19:38:21.763410+0000","last_peered":"2024-04-16T19:38:21.763410+0000","last_clean":"2024-04-16T19:38:21.763410+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:38:21.763410+0000","last_undegraded":"2024-04-16T19:38:21.763410+0000","last_fullsized":"2024-04-16T19:38:21.763410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.763344+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:36.589324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596769+0000","last_change":"2024-04-16T17:45:10.394131+0000","last_active":"2024-04-16T19:37:59.596769+0000","last_peered":"2024-04-16T19:37:59.596769+0000","last_clean":"2024-04-16T19:37:59.596769+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:37:59.596769+0000","last_undegraded":"2024-04-16T19:37:59.596769+0000","last_fullsized":"2024-04-16T19:37:59.596769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406132+0000","last_change":"2024-04-16T17:45:08.390961+0000","last_active":"2024-04-16T19:37:49.406132+0000","last_peered":"2024-04-16T19:37:49.406132+0000","last_clean":"2024-04-16T19:37:49.406132+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:37:49.406132+0000","last_undegraded":"2024-04-16T19:37:49.406132+0000","last_fullsized":"2024-04-16T19:37:49.406132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'60","reported_seq":651,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.053558+0000","last_change":"2024-04-16T19:38:16.053634+0000","last_active":"2024-04-16T19:38:16.053558+0000","last_peered":"2024-04-16T19:38:16.053558+0000","last_clean":"2024-04-16T19:38:16.053558+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:38:16.053558+0000","last_undegraded":"2024-04-16T19:38:16.053558+0000","last_fullsized":"2024-04-16T19:38:16.053558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'60","last_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_deep_scrub":"53'60","last_deep_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.053490+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:25:34.189324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401559+0000","last_change":"2024-04-16T17:45:10.394908+0000","last_active":"2024-04-16T19:37:44.401559+0000","last_peered":"2024-04-16T19:37:44.401559+0000","last_clean":"2024-04-16T19:37:44.401559+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:37:44.401559+0000","last_undegraded":"2024-04-16T19:37:44.401559+0000","last_fullsized":"2024-04-16T19:37:44.401559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594801+0000","last_change":"2024-04-16T17:45:08.382445+0000","last_active":"2024-04-16T19:37:49.594801+0000","last_peered":"2024-04-16T19:37:49.594801+0000","last_clean":"2024-04-16T19:37:49.594801+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:37:49.594801+0000","last_undegraded":"2024-04-16T19:37:49.594801+0000","last_fullsized":"2024-04-16T19:37:49.594801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'12","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.823687+0000","last_change":"2024-04-16T19:38:16.823687+0000","last_active":"2024-04-16T19:38:16.823687+0000","last_peered":"2024-04-16T19:38:16.823687+0000","last_clean":"2024-04-16T19:38:16.823687+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:38:16.823687+0000","last_undegraded":"2024-04-16T19:38:16.823687+0000","last_fullsized":"2024-04-16T19:38:16.823687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.823588+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:26.463012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593593+0000","last_change":"2024-04-16T17:45:10.398439+0000","last_active":"2024-04-16T19:37:44.593593+0000","last_peered":"2024-04-16T19:37:44.593593+0000","last_clean":"2024-04-16T19:37:44.593593+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:37:44.593593+0000","last_undegraded":"2024-04-16T19:37:44.593593+0000","last_fullsized":"2024-04-16T19:37:44.593593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.403371+0000","last_change":"2024-04-16T17:45:08.388353+0000","last_active":"2024-04-16T19:37:49.403371+0000","last_peered":"2024-04-16T19:37:49.403371+0000","last_clean":"2024-04-16T19:37:49.403371+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:37:49.403371+0000","last_undegraded":"2024-04-16T19:37:49.403371+0000","last_fullsized":"2024-04-16T19:37:49.403371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'22","reported_seq":550,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.076687+0000","last_change":"2024-04-16T19:38:20.076687+0000","last_active":"2024-04-16T19:38:20.076687+0000","last_peered":"2024-04-16T19:38:20.076687+0000","last_clean":"2024-04-16T19:38:20.076687+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:38:20.076687+0000","last_undegraded":"2024-04-16T19:38:20.076687+0000","last_fullsized":"2024-04-16T19:38:20.076687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.076549+0000","objects_scrubbed":11,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:18.065057+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402514+0000","last_change":"2024-04-16T17:45:10.393085+0000","last_active":"2024-04-16T19:37:44.402514+0000","last_peered":"2024-04-16T19:37:44.402514+0000","last_clean":"2024-04-16T19:37:44.402514+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:37:44.402514+0000","last_undegraded":"2024-04-16T19:37:44.402514+0000","last_fullsized":"2024-04-16T19:37:44.402514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594821+0000","last_change":"2024-04-16T17:45:08.387778+0000","last_active":"2024-04-16T19:37:49.594821+0000","last_peered":"2024-04-16T19:37:49.594821+0000","last_clean":"2024-04-16T19:37:49.594821+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:37:49.594821+0000","last_undegraded":"2024-04-16T19:37:49.594821+0000","last_fullsized":"2024-04-16T19:37:49.594821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'12","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.964569+0000","last_change":"2024-04-16T19:38:19.964623+0000","last_active":"2024-04-16T19:38:19.964569+0000","last_peered":"2024-04-16T19:38:19.964569+0000","last_clean":"2024-04-16T19:38:19.964569+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:38:19.964569+0000","last_undegraded":"2024-04-16T19:38:19.964569+0000","last_fullsized":"2024-04-16T19:38:19.964569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.964501+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:39:19.709359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.400360+0000","last_change":"2024-04-16T17:45:10.397793+0000","last_active":"2024-04-16T19:37:14.400360+0000","last_peered":"2024-04-16T19:37:14.400360+0000","last_clean":"2024-04-16T19:37:14.400360+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:37:14.400360+0000","last_undegraded":"2024-04-16T19:37:14.400360+0000","last_fullsized":"2024-04-16T19:37:14.400360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.405930+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:38:09.405930+0000","last_peered":"2024-04-16T19:38:09.405930+0000","last_clean":"2024-04-16T19:38:09.405930+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:38:09.405930+0000","last_undegraded":"2024-04-16T19:38:09.405930+0000","last_fullsized":"2024-04-16T19:38:09.405930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'11","reported_seq":380,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.008833+0000","last_change":"2024-04-16T19:38:44.008897+0000","last_active":"2024-04-16T19:38:44.008833+0000","last_peered":"2024-04-16T19:38:44.008833+0000","last_clean":"2024-04-16T19:38:44.008833+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:38:44.008833+0000","last_undegraded":"2024-04-16T19:38:44.008833+0000","last_fullsized":"2024-04-16T19:38:44.008833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.008768+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:20.760273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396785+0000","last_change":"2024-04-16T17:45:10.390881+0000","last_active":"2024-04-16T19:37:14.396785+0000","last_peered":"2024-04-16T19:37:14.396785+0000","last_clean":"2024-04-16T19:37:14.396785+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:37:14.396785+0000","last_undegraded":"2024-04-16T19:37:14.396785+0000","last_fullsized":"2024-04-16T19:37:14.396785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404236+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:37:39.404236+0000","last_peered":"2024-04-16T19:37:39.404236+0000","last_clean":"2024-04-16T19:37:39.404236+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:37:39.404236+0000","last_undegraded":"2024-04-16T19:37:39.404236+0000","last_fullsized":"2024-04-16T19:37:39.404236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'20","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.253495+0000","last_change":"2024-04-16T19:38:09.253495+0000","last_active":"2024-04-16T19:38:09.253495+0000","last_peered":"2024-04-16T19:38:09.253495+0000","last_clean":"2024-04-16T19:38:09.253495+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:38:09.253495+0000","last_undegraded":"2024-04-16T19:38:09.253495+0000","last_fullsized":"2024-04-16T19:38:09.253495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.253410+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:49.003227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596830+0000","last_change":"2024-04-16T17:45:10.393700+0000","last_active":"2024-04-16T19:37:59.596830+0000","last_peered":"2024-04-16T19:37:59.596830+0000","last_clean":"2024-04-16T19:37:59.596830+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:37:59.596830+0000","last_undegraded":"2024-04-16T19:37:59.596830+0000","last_fullsized":"2024-04-16T19:37:59.596830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401022+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:37:39.401022+0000","last_peered":"2024-04-16T19:37:39.401022+0000","last_clean":"2024-04-16T19:37:39.401022+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:37:39.401022+0000","last_undegraded":"2024-04-16T19:37:39.401022+0000","last_fullsized":"2024-04-16T19:37:39.401022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'20","reported_seq":697,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.162796+0000","last_change":"2024-04-16T19:38:38.162842+0000","last_active":"2024-04-16T19:38:38.162796+0000","last_peered":"2024-04-16T19:38:38.162796+0000","last_clean":"2024-04-16T19:38:38.162796+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:38:38.162796+0000","last_undegraded":"2024-04-16T19:38:38.162796+0000","last_fullsized":"2024-04-16T19:38:38.162796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.162737+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:17.912553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402625+0000","last_change":"2024-04-16T17:45:10.390598+0000","last_active":"2024-04-16T19:37:44.402625+0000","last_peered":"2024-04-16T19:37:44.402625+0000","last_clean":"2024-04-16T19:37:44.402625+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:37:44.402625+0000","last_undegraded":"2024-04-16T19:37:44.402625+0000","last_fullsized":"2024-04-16T19:37:44.402625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404301+0000","last_change":"2024-04-16T17:45:08.389493+0000","last_active":"2024-04-16T19:37:39.404301+0000","last_peered":"2024-04-16T19:37:39.404301+0000","last_clean":"2024-04-16T19:37:39.404301+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:37:39.404301+0000","last_undegraded":"2024-04-16T19:37:39.404301+0000","last_fullsized":"2024-04-16T19:37:39.404301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'22","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.813299+0000","last_change":"2024-04-16T19:38:17.813299+0000","last_active":"2024-04-16T19:38:17.813299+0000","last_peered":"2024-04-16T19:38:17.813299+0000","last_clean":"2024-04-16T19:38:17.813299+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:38:17.813299+0000","last_undegraded":"2024-04-16T19:38:17.813299+0000","last_fullsized":"2024-04-16T19:38:17.813299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.813183+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:32.833529+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401617+0000","last_change":"2024-04-16T17:45:10.397665+0000","last_active":"2024-04-16T19:37:44.401617+0000","last_peered":"2024-04-16T19:37:44.401617+0000","last_clean":"2024-04-16T19:37:44.401617+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:37:44.401617+0000","last_undegraded":"2024-04-16T19:37:44.401617+0000","last_fullsized":"2024-04-16T19:37:44.401617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401915+0000","last_change":"2024-04-16T17:45:08.386399+0000","last_active":"2024-04-16T19:37:39.401915+0000","last_peered":"2024-04-16T19:37:39.401915+0000","last_clean":"2024-04-16T19:37:39.401915+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:37:39.401915+0000","last_undegraded":"2024-04-16T19:37:39.401915+0000","last_fullsized":"2024-04-16T19:37:39.401915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'6","reported_seq":160,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.113419+0000","last_change":"2024-04-16T19:38:39.113484+0000","last_active":"2024-04-16T19:38:39.113419+0000","last_peered":"2024-04-16T19:38:39.113419+0000","last_clean":"2024-04-16T19:38:39.113419+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:38:39.113419+0000","last_undegraded":"2024-04-16T19:38:39.113419+0000","last_fullsized":"2024-04-16T19:38:39.113419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.113342+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:41.646707+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405149+0000","last_change":"2024-04-16T17:45:10.393634+0000","last_active":"2024-04-16T19:37:44.405149+0000","last_peered":"2024-04-16T19:37:44.405149+0000","last_clean":"2024-04-16T19:37:44.405149+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:37:44.405149+0000","last_undegraded":"2024-04-16T19:37:44.405149+0000","last_fullsized":"2024-04-16T19:37:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404832+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:37:59.404832+0000","last_peered":"2024-04-16T19:37:59.404832+0000","last_clean":"2024-04-16T19:37:59.404832+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:37:59.404832+0000","last_undegraded":"2024-04-16T19:37:59.404832+0000","last_fullsized":"2024-04-16T19:37:59.404832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'16","reported_seq":465,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.016697+0000","last_change":"2024-04-16T19:38:43.016743+0000","last_active":"2024-04-16T19:38:43.016697+0000","last_peered":"2024-04-16T19:38:43.016697+0000","last_clean":"2024-04-16T19:38:43.016697+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:38:43.016697+0000","last_undegraded":"2024-04-16T19:38:43.016697+0000","last_fullsized":"2024-04-16T19:38:43.016697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.016634+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:57.842614+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593626+0000","last_change":"2024-04-16T17:45:10.399193+0000","last_active":"2024-04-16T19:37:44.593626+0000","last_peered":"2024-04-16T19:37:44.593626+0000","last_clean":"2024-04-16T19:37:44.593626+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:37:44.593626+0000","last_undegraded":"2024-04-16T19:37:44.593626+0000","last_fullsized":"2024-04-16T19:37:44.593626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586630+0000","last_change":"2024-04-16T17:45:08.388974+0000","last_active":"2024-04-16T19:37:09.586630+0000","last_peered":"2024-04-16T19:37:09.586630+0000","last_clean":"2024-04-16T19:37:09.586630+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:37:09.586630+0000","last_undegraded":"2024-04-16T19:37:09.586630+0000","last_fullsized":"2024-04-16T19:37:09.586630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'6","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.208756+0000","last_change":"2024-04-16T19:38:10.208756+0000","last_active":"2024-04-16T19:38:10.208756+0000","last_peered":"2024-04-16T19:38:10.208756+0000","last_clean":"2024-04-16T19:38:10.208756+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:38:10.208756+0000","last_undegraded":"2024-04-16T19:38:10.208756+0000","last_fullsized":"2024-04-16T19:38:10.208756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.208682+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:12.742047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428704+0000","last_change":"2024-04-16T17:45:10.392230+0000","last_active":"2024-04-16T19:38:09.428704+0000","last_peered":"2024-04-16T19:38:09.428704+0000","last_clean":"2024-04-16T19:38:09.428704+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:38:09.428704+0000","last_undegraded":"2024-04-16T19:38:09.428704+0000","last_fullsized":"2024-04-16T19:38:09.428704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.396977+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:37:09.396977+0000","last_peered":"2024-04-16T19:37:09.396977+0000","last_clean":"2024-04-16T19:37:09.396977+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:37:09.396977+0000","last_undegraded":"2024-04-16T19:37:09.396977+0000","last_fullsized":"2024-04-16T19:37:09.396977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'14","reported_seq":334,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.249652+0000","last_change":"2024-04-16T19:38:08.249652+0000","last_active":"2024-04-16T19:38:08.249652+0000","last_peered":"2024-04-16T19:38:08.249652+0000","last_clean":"2024-04-16T19:38:08.249652+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:38:08.249652+0000","last_undegraded":"2024-04-16T19:38:08.249652+0000","last_fullsized":"2024-04-16T19:38:08.249652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.249524+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:54.283196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397305+0000","last_change":"2024-04-16T17:45:08.386818+0000","last_active":"2024-04-16T19:37:09.397305+0000","last_peered":"2024-04-16T19:37:09.397305+0000","last_clean":"2024-04-16T19:37:09.397305+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:37:09.397305+0000","last_undegraded":"2024-04-16T19:37:09.397305+0000","last_fullsized":"2024-04-16T19:37:09.397305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:44.395757+0000","last_change":"2024-04-16T17:45:10.391395+0000","last_active":"2024-04-16T19:36:44.395757+0000","last_peered":"2024-04-16T19:36:44.395757+0000","last_clean":"2024-04-16T19:36:44.395757+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:36:44.395757+0000","last_undegraded":"2024-04-16T19:36:44.395757+0000","last_fullsized":"2024-04-16T19:36:44.395757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'40","reported_seq":775,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.113737+0000","last_change":"2024-04-16T19:38:19.113737+0000","last_active":"2024-04-16T19:38:19.113737+0000","last_peered":"2024-04-16T19:38:19.113737+0000","last_clean":"2024-04-16T19:38:19.113737+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:38:19.113737+0000","last_undegraded":"2024-04-16T19:38:19.113737+0000","last_fullsized":"2024-04-16T19:38:19.113737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'40","last_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_deep_scrub":"53'40","last_deep_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.113599+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:04:11.281022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586482+0000","last_change":"2024-04-16T17:45:08.389341+0000","last_active":"2024-04-16T19:37:09.586482+0000","last_peered":"2024-04-16T19:37:09.586482+0000","last_clean":"2024-04-16T19:37:09.586482+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:37:09.586482+0000","last_undegraded":"2024-04-16T19:37:09.586482+0000","last_fullsized":"2024-04-16T19:37:09.586482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338914+0000","last_change":"2024-04-16T17:45:10.395147+0000","last_active":"2024-04-16T19:38:10.338914+0000","last_peered":"2024-04-16T19:38:10.338914+0000","last_clean":"2024-04-16T19:38:10.338914+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:38:10.338914+0000","last_undegraded":"2024-04-16T19:38:10.338914+0000","last_fullsized":"2024-04-16T19:38:10.338914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":67911,"num_omap_keys":275,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4516,"ondisk_log_size":4516,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3706,"ondisk_log_size":3706,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":365336,"num_omap_keys":1682,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21506,"ondisk_log_size":21506,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5236,"ondisk_log_size":5236,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9817,"num_omap_keys":62,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":605,"ondisk_log_size":605,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641633,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46644,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810956,"statfs":{"total":107374182400,"available":107326418944,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641632,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46504,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811096,"statfs":{"total":107374182400,"available":107326562304,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641633,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":87628,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":104769972,"statfs":{"total":107374182400,"available":107284451328,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641633,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50956,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806644,"statfs":{"total":107374182400,"available":107322003456,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641632,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50932,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806668,"statfs":{"total":107374182400,"available":107322028032,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641633,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55680,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104801920,"statfs":{"total":107374182400,"available":107317166080,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:38:51.727 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.727 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.727 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.727 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.728 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.728 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.728 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.728 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.728 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.729 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.729 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.729 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.729 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.729 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.729 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.730 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.730 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.730 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.730 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.731 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.731 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.731 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.731 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.731 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.731 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.732 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.732 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.732 INFO:tasks.ceph:pgid 14.1e last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.732 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.732 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.733 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.733 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.733 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.733 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.733 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.733 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.734 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.734 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.734 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.734 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.735 INFO:tasks.ceph:pgid 14.1c last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.735 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.735 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.735 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.735 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.736 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.736 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.736 INFO:tasks.ceph:pgid 14.1d last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.736 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.736 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.736 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.737 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.737 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.737 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.737 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.737 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.738 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.738 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.738 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.738 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.738 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.739 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.739 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.739 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.739 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.739 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.740 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.740 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.740 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.740 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.740 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.740 INFO:tasks.ceph:pgid 14.1 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.741 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.741 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.741 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.741 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.741 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.742 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.742 INFO:tasks.ceph:pgid 14.6 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.742 INFO:tasks.ceph:pgid 11.3 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.742 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.743 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.743 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.743 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.743 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.743 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.743 INFO:tasks.ceph:pgid 14.7 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.744 INFO:tasks.ceph:pgid 13.4 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.744 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.744 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.744 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.744 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.744 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.745 INFO:tasks.ceph:pgid 14.4 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.745 INFO:tasks.ceph:pgid 13.7 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.745 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.745 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.745 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.746 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.746 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.746 INFO:tasks.ceph:pgid 14.5 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.746 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.746 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.747 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.747 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.747 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.747 INFO:tasks.ceph:pgid 14.f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.747 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.748 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T17:44:20.155639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=20, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.748 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.748 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.748 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.748 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.748 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.749 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.749 INFO:tasks.ceph:pgid 14.c last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.749 INFO:tasks.ceph:pgid 13.f last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.749 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.749 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.749 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.750 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.750 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.750 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.750 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.750 INFO:tasks.ceph:pgid 13.e last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.751 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.751 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.751 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.751 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.751 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.752 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.752 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.752 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.752 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.752 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.752 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.753 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.753 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.753 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.753 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.753 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.754 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.754 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.754 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.754 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.754 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.755 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.755 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.755 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.755 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.755 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.755 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.756 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.756 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.756 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.756 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.756 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.757 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.757 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.757 INFO:tasks.ceph:pgid 15.a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.757 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.757 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.757 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.758 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.758 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.758 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.758 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.758 INFO:tasks.ceph:pgid 14.19 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.759 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.759 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.759 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.759 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.759 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.759 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.760 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.760 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.760 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.760 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.760 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.761 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.761 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.761 INFO:tasks.ceph:pgid 14.1b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.761 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.761 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.761 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.762 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.762 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.762 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.762 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.763 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.763 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.763 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.763 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.763 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.763 INFO:tasks.ceph:pgid 14.15 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.764 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.764 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.764 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.764 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.764 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.765 INFO:tasks.ceph:pgid 14.14 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.765 INFO:tasks.ceph:pgid 13.17 last_scrub_stamp 2024-04-16T17:46:16.487107+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=16, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.765 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.765 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.765 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.766 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.766 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.766 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.766 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.766 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.767 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.767 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.767 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.767 INFO:tasks.ceph:pgid 14.16 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.767 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.768 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.768 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.768 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.768 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.768 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.769 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.769 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.769 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.769 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.769 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.769 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.770 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.770 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.770 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.770 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.770 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.771 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.771 INFO:tasks.ceph:pgid 12.11 last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.771 INFO:tasks.ceph:pgid 11.16 last_scrub_stamp 2024-04-16T17:45:48.448364+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=48, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.771 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.771 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.772 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.772 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.772 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.772 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.772 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.773 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.773 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.773 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-16T17:45:23.406825+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=23, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.773 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.773 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.774 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.774 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.774 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.774 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.774 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.775 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.775 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.775 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.775 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.775 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.775 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.776 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.776 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.776 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.776 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.776 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.776 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.777 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.777 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.777 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.777 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.777 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.778 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.778 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.778 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.778 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.778 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.778 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.779 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.779 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.779 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.779 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:38:51.779 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T19:39:11.780 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:39:12.132 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:39:12.149 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:39:12.152 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3492,"stamp":"2024-04-16T19:39:10.526643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":621559,"num_omap_keys":2744,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37959,"ondisk_log_size":37959,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":338344,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":327158,"kb_avail":628807256,"statfs":{"total":644245094400,"available":643898630144,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":335010465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130244,"num_omap_keys":530,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005835"},"pg_stats":[{"pgid":"9.35","version":"53'26","reported_seq":533,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.834637+0000","last_change":"2024-04-16T19:38:15.834693+0000","last_active":"2024-04-16T19:38:15.834637+0000","last_peered":"2024-04-16T19:38:15.834637+0000","last_clean":"2024-04-16T19:38:15.834637+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:38:15.834637+0000","last_undegraded":"2024-04-16T19:38:15.834637+0000","last_fullsized":"2024-04-16T19:38:15.834637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.834573+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:46.410400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.402007+0000","last_change":"2024-04-16T17:45:08.383247+0000","last_active":"2024-04-16T19:37:39.402007+0000","last_peered":"2024-04-16T19:37:39.402007+0000","last_clean":"2024-04-16T19:37:39.402007+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:37:39.402007+0000","last_undegraded":"2024-04-16T19:37:39.402007+0000","last_fullsized":"2024-04-16T19:37:39.402007+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401790+0000","last_change":"2024-04-16T17:45:10.400343+0000","last_active":"2024-04-16T19:37:44.401790+0000","last_peered":"2024-04-16T19:37:44.401790+0000","last_clean":"2024-04-16T19:37:44.401790+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:37:44.401790+0000","last_undegraded":"2024-04-16T19:37:44.401790+0000","last_fullsized":"2024-04-16T19:37:44.401790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'12","reported_seq":303,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.799796+0000","last_change":"2024-04-16T19:38:20.799846+0000","last_active":"2024-04-16T19:38:20.799796+0000","last_peered":"2024-04-16T19:38:20.799796+0000","last_clean":"2024-04-16T19:38:20.799796+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:38:20.799796+0000","last_undegraded":"2024-04-16T19:38:20.799796+0000","last_fullsized":"2024-04-16T19:38:20.799796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.799730+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:28.459361+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592809+0000","last_change":"2024-04-16T17:45:08.381595+0000","last_active":"2024-04-16T19:37:39.592809+0000","last_peered":"2024-04-16T19:37:39.592809+0000","last_clean":"2024-04-16T19:37:39.592809+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:37:39.592809+0000","last_undegraded":"2024-04-16T19:37:39.592809+0000","last_fullsized":"2024-04-16T19:37:39.592809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402554+0000","last_change":"2024-04-16T17:45:10.390675+0000","last_active":"2024-04-16T19:37:44.402554+0000","last_peered":"2024-04-16T19:37:44.402554+0000","last_clean":"2024-04-16T19:37:44.402554+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:37:44.402554+0000","last_undegraded":"2024-04-16T19:37:44.402554+0000","last_fullsized":"2024-04-16T19:37:44.402554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'13","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.533976+0000","last_change":"2024-04-16T19:38:20.534037+0000","last_active":"2024-04-16T19:38:20.533976+0000","last_peered":"2024-04-16T19:38:20.533976+0000","last_clean":"2024-04-16T19:38:20.533976+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:38:20.533976+0000","last_undegraded":"2024-04-16T19:38:20.533976+0000","last_fullsized":"2024-04-16T19:38:20.533976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.533905+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:22.838173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404360+0000","last_change":"2024-04-16T17:45:08.381577+0000","last_active":"2024-04-16T19:37:39.404360+0000","last_peered":"2024-04-16T19:37:39.404360+0000","last_clean":"2024-04-16T19:37:39.404360+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:37:39.404360+0000","last_undegraded":"2024-04-16T19:37:39.404360+0000","last_fullsized":"2024-04-16T19:37:39.404360+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401570+0000","last_change":"2024-04-16T17:45:10.394273+0000","last_active":"2024-04-16T19:37:44.401570+0000","last_peered":"2024-04-16T19:37:44.401570+0000","last_clean":"2024-04-16T19:37:44.401570+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:37:44.401570+0000","last_undegraded":"2024-04-16T19:37:44.401570+0000","last_fullsized":"2024-04-16T19:37:44.401570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'14","reported_seq":262,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.837756+0000","last_change":"2024-04-16T19:38:11.837803+0000","last_active":"2024-04-16T19:38:11.837756+0000","last_peered":"2024-04-16T19:38:11.837756+0000","last_clean":"2024-04-16T19:38:11.837756+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:38:11.837756+0000","last_undegraded":"2024-04-16T19:38:11.837756+0000","last_fullsized":"2024-04-16T19:38:11.837756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.837694+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:14.141962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.399688+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:37:29.399688+0000","last_peered":"2024-04-16T19:37:29.399688+0000","last_clean":"2024-04-16T19:37:29.399688+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:37:29.399688+0000","last_undegraded":"2024-04-16T19:37:29.399688+0000","last_fullsized":"2024-04-16T19:37:29.399688+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405200+0000","last_change":"2024-04-16T17:45:10.398320+0000","last_active":"2024-04-16T19:37:44.405200+0000","last_peered":"2024-04-16T19:37:44.405200+0000","last_clean":"2024-04-16T19:37:44.405200+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:37:44.405200+0000","last_undegraded":"2024-04-16T19:37:44.405200+0000","last_fullsized":"2024-04-16T19:37:44.405200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'14","reported_seq":531,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.397609+0000","last_change":"2024-04-16T19:38:37.397680+0000","last_active":"2024-04-16T19:38:37.397609+0000","last_peered":"2024-04-16T19:38:37.397609+0000","last_clean":"2024-04-16T19:38:37.397609+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:38:37.397609+0000","last_undegraded":"2024-04-16T19:38:37.397609+0000","last_fullsized":"2024-04-16T19:38:37.397609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.397526+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:07.718210+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401891+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:37:39.401891+0000","last_peered":"2024-04-16T19:37:39.401891+0000","last_clean":"2024-04-16T19:37:39.401891+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:37:39.401891+0000","last_undegraded":"2024-04-16T19:37:39.401891+0000","last_fullsized":"2024-04-16T19:37:39.401891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.400385+0000","last_change":"2024-04-16T17:45:10.395553+0000","last_active":"2024-04-16T19:37:34.400385+0000","last_peered":"2024-04-16T19:37:34.400385+0000","last_clean":"2024-04-16T19:37:34.400385+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:37:34.400385+0000","last_undegraded":"2024-04-16T19:37:34.400385+0000","last_fullsized":"2024-04-16T19:37:34.400385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'16","reported_seq":332,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.177690+0000","last_change":"2024-04-16T19:38:15.177758+0000","last_active":"2024-04-16T19:38:15.177690+0000","last_peered":"2024-04-16T19:38:15.177690+0000","last_clean":"2024-04-16T19:38:15.177690+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:38:15.177690+0000","last_undegraded":"2024-04-16T19:38:15.177690+0000","last_fullsized":"2024-04-16T19:38:15.177690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.177626+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:51.929131+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.757121+0000","last_change":"2024-04-16T19:38:31.757121+0000","last_active":"2024-04-16T19:38:31.757121+0000","last_peered":"2024-04-16T19:38:31.757121+0000","last_clean":"2024-04-16T19:38:31.757121+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:38:31.757121+0000","last_undegraded":"2024-04-16T19:38:31.757121+0000","last_fullsized":"2024-04-16T19:38:31.757121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.757048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:06.731328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.189103+0000","last_change":"2024-04-16T19:39:03.189145+0000","last_active":"2024-04-16T19:39:03.189103+0000","last_peered":"2024-04-16T19:39:03.189103+0000","last_clean":"2024-04-16T19:39:03.189103+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:39:03.189103+0000","last_undegraded":"2024-04-16T19:39:03.189103+0000","last_fullsized":"2024-04-16T19:39:03.189103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.189030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.189030+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.189030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:13:40.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'16","reported_seq":558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.885890+0000","last_change":"2024-04-16T19:38:15.885941+0000","last_active":"2024-04-16T19:38:15.885890+0000","last_peered":"2024-04-16T19:38:15.885890+0000","last_clean":"2024-04-16T19:38:15.885890+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:38:15.885890+0000","last_undegraded":"2024-04-16T19:38:15.885890+0000","last_fullsized":"2024-04-16T19:38:15.885890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.885831+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:24.282989+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401833+0000","last_change":"2024-04-16T17:45:08.383652+0000","last_active":"2024-04-16T19:37:39.401833+0000","last_peered":"2024-04-16T19:37:39.401833+0000","last_clean":"2024-04-16T19:37:39.401833+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:37:39.401833+0000","last_undegraded":"2024-04-16T19:37:39.401833+0000","last_fullsized":"2024-04-16T19:37:39.401833+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401925+0000","last_change":"2024-04-16T17:45:10.395876+0000","last_active":"2024-04-16T19:37:44.401925+0000","last_peered":"2024-04-16T19:37:44.401925+0000","last_clean":"2024-04-16T19:37:44.401925+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:37:44.401925+0000","last_undegraded":"2024-04-16T19:37:44.401925+0000","last_fullsized":"2024-04-16T19:37:44.401925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'12","reported_seq":445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.407660+0000","last_change":"2024-04-16T19:38:36.407728+0000","last_active":"2024-04-16T19:38:36.407660+0000","last_peered":"2024-04-16T19:38:36.407660+0000","last_clean":"2024-04-16T19:38:36.407660+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:38:36.407660+0000","last_undegraded":"2024-04-16T19:38:36.407660+0000","last_fullsized":"2024-04-16T19:38:36.407660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.407586+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:13.159091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592526+0000","last_change":"2024-04-16T17:45:08.389961+0000","last_active":"2024-04-16T19:37:39.592526+0000","last_peered":"2024-04-16T19:37:39.592526+0000","last_clean":"2024-04-16T19:37:39.592526+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:37:39.592526+0000","last_undegraded":"2024-04-16T19:37:39.592526+0000","last_fullsized":"2024-04-16T19:37:39.592526+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.011513+0000","last_change":"2024-04-16T19:38:56.011535+0000","last_active":"2024-04-16T19:38:56.011513+0000","last_peered":"2024-04-16T19:38:56.011513+0000","last_clean":"2024-04-16T19:38:56.011513+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:38:56.011513+0000","last_undegraded":"2024-04-16T19:38:56.011513+0000","last_fullsized":"2024-04-16T19:38:56.011513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.011447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.011447+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.011447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:15.869930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'10","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.728428+0000","last_change":"2024-04-16T19:38:23.728493+0000","last_active":"2024-04-16T19:38:23.728428+0000","last_peered":"2024-04-16T19:38:23.728428+0000","last_clean":"2024-04-16T19:38:23.728428+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:38:23.728428+0000","last_undegraded":"2024-04-16T19:38:23.728428+0000","last_fullsized":"2024-04-16T19:38:23.728428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.728366+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:54.049051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.222464+0000","last_change":"2024-04-16T19:39:07.222497+0000","last_active":"2024-04-16T19:39:07.222464+0000","last_peered":"2024-04-16T19:39:07.222464+0000","last_clean":"2024-04-16T19:39:07.222464+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:39:07.222464+0000","last_undegraded":"2024-04-16T19:39:07.222464+0000","last_fullsized":"2024-04-16T19:39:07.222464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.222403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.222403+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.222403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:51.142357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428426+0000","last_change":"2024-04-16T17:45:08.388693+0000","last_active":"2024-04-16T19:38:09.428426+0000","last_peered":"2024-04-16T19:38:09.428426+0000","last_clean":"2024-04-16T19:38:09.428426+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:38:09.428426+0000","last_undegraded":"2024-04-16T19:38:09.428426+0000","last_fullsized":"2024-04-16T19:38:09.428426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'12","reported_seq":363,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.931333+0000","last_change":"2024-04-16T19:38:17.931378+0000","last_active":"2024-04-16T19:38:17.931333+0000","last_peered":"2024-04-16T19:38:17.931333+0000","last_clean":"2024-04-16T19:38:17.931333+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:38:17.931333+0000","last_undegraded":"2024-04-16T19:38:17.931333+0000","last_fullsized":"2024-04-16T19:38:17.931333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.931272+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:07.574424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.397493+0000","last_change":"2024-04-16T17:45:10.393548+0000","last_active":"2024-04-16T19:37:14.397493+0000","last_peered":"2024-04-16T19:37:14.397493+0000","last_clean":"2024-04-16T19:37:14.397493+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:37:14.397493+0000","last_undegraded":"2024-04-16T19:37:14.397493+0000","last_fullsized":"2024-04-16T19:37:14.397493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428456+0000","last_change":"2024-04-16T17:45:08.388744+0000","last_active":"2024-04-16T19:38:09.428456+0000","last_peered":"2024-04-16T19:38:09.428456+0000","last_clean":"2024-04-16T19:38:09.428456+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:38:09.428456+0000","last_undegraded":"2024-04-16T19:38:09.428456+0000","last_fullsized":"2024-04-16T19:38:09.428456+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'10","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.171571+0000","last_change":"2024-04-16T19:38:35.171613+0000","last_active":"2024-04-16T19:38:35.171571+0000","last_peered":"2024-04-16T19:38:35.171571+0000","last_clean":"2024-04-16T19:38:35.171571+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:38:35.171571+0000","last_undegraded":"2024-04-16T19:38:35.171571+0000","last_fullsized":"2024-04-16T19:38:35.171571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.171510+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:54.116974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.400330+0000","last_change":"2024-04-16T17:45:10.392335+0000","last_active":"2024-04-16T19:37:34.400330+0000","last_peered":"2024-04-16T19:37:34.400330+0000","last_clean":"2024-04-16T19:37:34.400330+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:37:34.400330+0000","last_undegraded":"2024-04-16T19:37:34.400330+0000","last_fullsized":"2024-04-16T19:37:34.400330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338727+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:38:10.338727+0000","last_peered":"2024-04-16T19:38:10.338727+0000","last_clean":"2024-04-16T19:38:10.338727+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:38:10.338727+0000","last_undegraded":"2024-04-16T19:38:10.338727+0000","last_fullsized":"2024-04-16T19:38:10.338727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'16","reported_seq":250,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.100685+0000","last_change":"2024-04-16T19:38:40.100742+0000","last_active":"2024-04-16T19:38:40.100685+0000","last_peered":"2024-04-16T19:38:40.100685+0000","last_clean":"2024-04-16T19:38:40.100685+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:38:40.100685+0000","last_undegraded":"2024-04-16T19:38:40.100685+0000","last_fullsized":"2024-04-16T19:38:40.100685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.100620+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:48.497778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.069791+0000","last_change":"2024-04-16T19:39:08.069812+0000","last_active":"2024-04-16T19:39:08.069791+0000","last_peered":"2024-04-16T19:39:08.069791+0000","last_clean":"2024-04-16T19:39:08.069791+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:39:08.069791+0000","last_undegraded":"2024-04-16T19:39:08.069791+0000","last_fullsized":"2024-04-16T19:39:08.069791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.069729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.069729+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.069729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:28.539834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.886119+0000","last_change":"2024-04-16T17:45:08.382324+0000","last_active":"2024-04-16T19:38:09.886119+0000","last_peered":"2024-04-16T19:38:09.886119+0000","last_clean":"2024-04-16T19:38:09.886119+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:38:09.886119+0000","last_undegraded":"2024-04-16T19:38:09.886119+0000","last_fullsized":"2024-04-16T19:38:09.886119+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"53'9","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.926373+0000","last_change":"2024-04-16T19:38:21.926413+0000","last_active":"2024-04-16T19:38:21.926373+0000","last_peered":"2024-04-16T19:38:21.926373+0000","last_clean":"2024-04-16T19:38:21.926373+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:38:21.926373+0000","last_undegraded":"2024-04-16T19:38:21.926373+0000","last_fullsized":"2024-04-16T19:38:21.926373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'9","last_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_deep_scrub":"53'9","last_deep_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.926308+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:31.946481+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.088296+0000","last_change":"2024-04-16T19:39:06.088318+0000","last_active":"2024-04-16T19:39:06.088296+0000","last_peered":"2024-04-16T19:39:06.088296+0000","last_clean":"2024-04-16T19:39:06.088296+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:39:06.088296+0000","last_undegraded":"2024-04-16T19:39:06.088296+0000","last_fullsized":"2024-04-16T19:39:06.088296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.088233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.088233+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.088233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:24.886725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068783+0000","last_change":"2024-04-16T17:45:08.387116+0000","last_active":"2024-04-16T19:38:08.068783+0000","last_peered":"2024-04-16T19:38:08.068783+0000","last_clean":"2024-04-16T19:38:08.068783+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:38:08.068783+0000","last_undegraded":"2024-04-16T19:38:08.068783+0000","last_fullsized":"2024-04-16T19:38:08.068783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"53'2","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.013204+0000","last_change":"2024-04-16T19:38:42.013239+0000","last_active":"2024-04-16T19:38:42.013204+0000","last_peered":"2024-04-16T19:38:42.013204+0000","last_clean":"2024-04-16T19:38:42.013204+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:38:42.013204+0000","last_undegraded":"2024-04-16T19:38:42.013204+0000","last_fullsized":"2024-04-16T19:38:42.013204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.013138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:49.672770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.158471+0000","last_change":"2024-04-16T19:39:01.158506+0000","last_active":"2024-04-16T19:39:01.158471+0000","last_peered":"2024-04-16T19:39:01.158471+0000","last_clean":"2024-04-16T19:39:01.158471+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:39:01.158471+0000","last_undegraded":"2024-04-16T19:39:01.158471+0000","last_fullsized":"2024-04-16T19:39:01.158471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:01.158405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:01.158405+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.158405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:24.103370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.091408+0000","last_change":"2024-04-16T19:38:24.091408+0000","last_active":"2024-04-16T19:38:24.091408+0000","last_peered":"2024-04-16T19:38:24.091408+0000","last_clean":"2024-04-16T19:38:24.091408+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:38:24.091408+0000","last_undegraded":"2024-04-16T19:38:24.091408+0000","last_fullsized":"2024-04-16T19:38:24.091408+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.091318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:55.045299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524663+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:38:08.524663+0000","last_peered":"2024-04-16T19:38:08.524663+0000","last_clean":"2024-04-16T19:38:08.524663+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:38:08.524663+0000","last_undegraded":"2024-04-16T19:38:08.524663+0000","last_fullsized":"2024-04-16T19:38:08.524663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'197","reported_seq":2321,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.100302+0000","last_change":"2024-04-16T19:39:09.100331+0000","last_active":"2024-04-16T19:39:09.100302+0000","last_peered":"2024-04-16T19:39:09.100302+0000","last_clean":"2024-04-16T19:39:09.100302+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:39:09.100302+0000","last_undegraded":"2024-04-16T19:39:09.100302+0000","last_fullsized":"2024-04-16T19:39:09.100302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'197","last_scrub_stamp":"2024-04-16T19:39:09.100240+0000","last_deep_scrub":"53'197","last_deep_scrub_stamp":"2024-04-16T19:39:09.100240+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.100240+0000","objects_scrubbed":52,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:01.354932+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14129,"num_omap_keys":57,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.886294+0000","last_change":"2024-04-16T19:38:40.886294+0000","last_active":"2024-04-16T19:38:40.886294+0000","last_peered":"2024-04-16T19:38:40.886294+0000","last_clean":"2024-04-16T19:38:40.886294+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:38:40.886294+0000","last_undegraded":"2024-04-16T19:38:40.886294+0000","last_fullsized":"2024-04-16T19:38:40.886294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.886171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:24.443007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'26","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.349483+0000","last_change":"2024-04-16T19:38:36.349545+0000","last_active":"2024-04-16T19:38:36.349483+0000","last_peered":"2024-04-16T19:38:36.349483+0000","last_clean":"2024-04-16T19:38:36.349483+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:38:36.349483+0000","last_undegraded":"2024-04-16T19:38:36.349483+0000","last_fullsized":"2024-04-16T19:38:36.349483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.349407+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:33.328492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.556726+0000","last_change":"2024-04-16T19:38:18.556726+0000","last_active":"2024-04-16T19:38:18.556726+0000","last_peered":"2024-04-16T19:38:18.556726+0000","last_clean":"2024-04-16T19:38:18.556726+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:38:18.556726+0000","last_undegraded":"2024-04-16T19:38:18.556726+0000","last_fullsized":"2024-04-16T19:38:18.556726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.556600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:53.827149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'257","reported_seq":496,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.911983+0000","last_change":"2024-04-16T19:38:22.912055+0000","last_active":"2024-04-16T19:38:22.911983+0000","last_peered":"2024-04-16T19:38:22.911983+0000","last_clean":"2024-04-16T19:38:22.911983+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:38:22.911983+0000","last_undegraded":"2024-04-16T19:38:22.911983+0000","last_fullsized":"2024-04-16T19:38:22.911983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'257","last_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_deep_scrub":"53'257","last_deep_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.911925+0000","objects_scrubbed":14,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:02.872014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'17","reported_seq":406,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.523960+0000","last_change":"2024-04-16T19:38:28.524008+0000","last_active":"2024-04-16T19:38:28.523960+0000","last_peered":"2024-04-16T19:38:28.523960+0000","last_clean":"2024-04-16T19:38:28.523960+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:38:28.523960+0000","last_undegraded":"2024-04-16T19:38:28.523960+0000","last_fullsized":"2024-04-16T19:38:28.523960+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'17","last_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_deep_scrub":"53'17","last_deep_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.523901+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:10.769673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.339440+0000","last_change":"2024-04-16T19:38:43.339440+0000","last_active":"2024-04-16T19:38:43.339440+0000","last_peered":"2024-04-16T19:38:43.339440+0000","last_clean":"2024-04-16T19:38:43.339440+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:38:43.339440+0000","last_undegraded":"2024-04-16T19:38:43.339440+0000","last_fullsized":"2024-04-16T19:38:43.339440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.339355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:45.853381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.714851+0000","last_change":"2024-04-16T19:39:02.714905+0000","last_active":"2024-04-16T19:39:02.714851+0000","last_peered":"2024-04-16T19:39:02.714851+0000","last_clean":"2024-04-16T19:39:02.714851+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:39:02.714851+0000","last_undegraded":"2024-04-16T19:39:02.714851+0000","last_fullsized":"2024-04-16T19:39:02.714851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.714774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.714774+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.714774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:56.806141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397429+0000","last_change":"2024-04-16T17:45:08.388375+0000","last_active":"2024-04-16T19:37:09.397429+0000","last_peered":"2024-04-16T19:37:09.397429+0000","last_clean":"2024-04-16T19:37:09.397429+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:37:09.397429+0000","last_undegraded":"2024-04-16T19:37:09.397429+0000","last_fullsized":"2024-04-16T19:37:09.397429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339046+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:38:10.339046+0000","last_peered":"2024-04-16T19:38:10.339046+0000","last_clean":"2024-04-16T19:38:10.339046+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:38:10.339046+0000","last_undegraded":"2024-04-16T19:38:10.339046+0000","last_fullsized":"2024-04-16T19:38:10.339046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.296192+0000","last_change":"2024-04-16T19:38:59.296192+0000","last_active":"2024-04-16T19:38:59.296192+0000","last_peered":"2024-04-16T19:38:59.296192+0000","last_clean":"2024-04-16T19:38:59.296192+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:38:59.296192+0000","last_undegraded":"2024-04-16T19:38:59.296192+0000","last_fullsized":"2024-04-16T19:38:59.296192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:59.296101+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:59.296101+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.296101+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.293277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.842212+0000","last_change":"2024-04-16T19:38:53.842212+0000","last_active":"2024-04-16T19:38:53.842212+0000","last_peered":"2024-04-16T19:38:53.842212+0000","last_clean":"2024-04-16T19:38:53.842212+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:38:53.842212+0000","last_undegraded":"2024-04-16T19:38:53.842212+0000","last_fullsized":"2024-04-16T19:38:53.842212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.842112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.842112+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.842112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:19.599353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588660+0000","last_change":"2024-04-16T18:09:02.170333+0000","last_active":"2024-04-16T19:37:19.588660+0000","last_peered":"2024-04-16T19:37:19.588660+0000","last_clean":"2024-04-16T19:37:19.588660+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:37:19.588660+0000","last_undegraded":"2024-04-16T19:37:19.588660+0000","last_fullsized":"2024-04-16T19:37:19.588660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1988,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401948+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:37:44.401948+0000","last_peered":"2024-04-16T19:37:44.401948+0000","last_clean":"2024-04-16T19:37:44.401948+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:37:44.401948+0000","last_undegraded":"2024-04-16T19:37:44.401948+0000","last_fullsized":"2024-04-16T19:37:44.401948+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.784652+0000","last_change":"2024-04-16T19:38:42.784652+0000","last_active":"2024-04-16T19:38:42.784652+0000","last_peered":"2024-04-16T19:38:42.784652+0000","last_clean":"2024-04-16T19:38:42.784652+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:38:42.784652+0000","last_undegraded":"2024-04-16T19:38:42.784652+0000","last_fullsized":"2024-04-16T19:38:42.784652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.784562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:26.341398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'13","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.384096+0000","last_change":"2024-04-16T19:38:47.384137+0000","last_active":"2024-04-16T19:38:47.384096+0000","last_peered":"2024-04-16T19:38:47.384096+0000","last_clean":"2024-04-16T19:38:47.384096+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:38:47.384096+0000","last_undegraded":"2024-04-16T19:38:47.384096+0000","last_fullsized":"2024-04-16T19:38:47.384096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.384037+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:55.261448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.768005+0000","last_change":"2024-04-16T19:38:32.768029+0000","last_active":"2024-04-16T19:38:32.768005+0000","last_peered":"2024-04-16T19:38:32.768005+0000","last_clean":"2024-04-16T19:38:32.768005+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:38:32.768005+0000","last_undegraded":"2024-04-16T19:38:32.768005+0000","last_fullsized":"2024-04-16T19:38:32.768005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:38.784450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'204","reported_seq":483,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.084173+0000","last_change":"2024-04-16T19:38:12.084173+0000","last_active":"2024-04-16T19:38:12.084173+0000","last_peered":"2024-04-16T19:38:12.084173+0000","last_clean":"2024-04-16T19:38:12.084173+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:38:12.084173+0000","last_undegraded":"2024-04-16T19:38:12.084173+0000","last_fullsized":"2024-04-16T19:38:12.084173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'204","last_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_deep_scrub":"53'204","last_deep_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.084057+0000","objects_scrubbed":15,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:47:16.400625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'36","reported_seq":332,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.728059+0000","last_change":"2024-04-16T19:38:29.728115+0000","last_active":"2024-04-16T19:38:29.728059+0000","last_peered":"2024-04-16T19:38:29.728059+0000","last_clean":"2024-04-16T19:38:29.728059+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:38:29.728059+0000","last_undegraded":"2024-04-16T19:38:29.728059+0000","last_fullsized":"2024-04-16T19:38:29.728059+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'36","last_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_deep_scrub":"53'36","last_deep_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.727997+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:35.149833+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.754235+0000","last_change":"2024-04-16T19:38:31.754279+0000","last_active":"2024-04-16T19:38:31.754235+0000","last_peered":"2024-04-16T19:38:31.754235+0000","last_clean":"2024-04-16T19:38:31.754235+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:38:31.754235+0000","last_undegraded":"2024-04-16T19:38:31.754235+0000","last_fullsized":"2024-04-16T19:38:31.754235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.754160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:49.288552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338781+0000","last_change":"2024-04-16T17:45:10.395070+0000","last_active":"2024-04-16T19:38:10.338781+0000","last_peered":"2024-04-16T19:38:10.338781+0000","last_clean":"2024-04-16T19:38:10.338781+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:38:10.338781+0000","last_undegraded":"2024-04-16T19:38:10.338781+0000","last_fullsized":"2024-04-16T19:38:10.338781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.399332+0000","last_change":"2024-04-16T17:45:08.390752+0000","last_active":"2024-04-16T19:37:09.399332+0000","last_peered":"2024-04-16T19:37:09.399332+0000","last_clean":"2024-04-16T19:37:09.399332+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:37:09.399332+0000","last_undegraded":"2024-04-16T19:37:09.399332+0000","last_fullsized":"2024-04-16T19:37:09.399332+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"48'17","reported_seq":895,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405226+0000","last_change":"2024-04-16T17:45:20.413278+0000","last_active":"2024-04-16T19:37:44.405226+0000","last_peered":"2024-04-16T19:37:44.405226+0000","last_clean":"2024-04-16T19:37:44.405226+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:37:44.405226+0000","last_undegraded":"2024-04-16T19:37:44.405226+0000","last_fullsized":"2024-04-16T19:37:44.405226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'75","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.305931+0000","last_change":"2024-04-16T19:38:55.305931+0000","last_active":"2024-04-16T19:38:55.305931+0000","last_peered":"2024-04-16T19:38:55.305931+0000","last_clean":"2024-04-16T19:38:55.305931+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:38:55.305931+0000","last_undegraded":"2024-04-16T19:38:55.305931+0000","last_fullsized":"2024-04-16T19:38:55.305931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'75","last_scrub_stamp":"2024-04-16T19:38:55.305805+0000","last_deep_scrub":"53'75","last_deep_scrub_stamp":"2024-04-16T19:38:55.305805+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.305805+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:39.277904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.393508+0000","last_change":"2024-04-16T19:38:49.393508+0000","last_active":"2024-04-16T19:38:49.393508+0000","last_peered":"2024-04-16T19:38:49.393508+0000","last_clean":"2024-04-16T19:38:49.393508+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:38:49.393508+0000","last_undegraded":"2024-04-16T19:38:49.393508+0000","last_fullsized":"2024-04-16T19:38:49.393508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.393417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:44.040909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887621+0000","last_change":"2024-04-16T18:09:02.164735+0000","last_active":"2024-04-16T19:38:09.887621+0000","last_peered":"2024-04-16T19:38:09.887621+0000","last_clean":"2024-04-16T19:38:09.887621+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:38:09.887621+0000","last_undegraded":"2024-04-16T19:38:09.887621+0000","last_fullsized":"2024-04-16T19:38:09.887621+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'274","reported_seq":2177,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.356383+0000","last_change":"2024-04-16T19:38:56.356383+0000","last_active":"2024-04-16T19:38:56.356383+0000","last_peered":"2024-04-16T19:38:56.356383+0000","last_clean":"2024-04-16T19:38:56.356383+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:38:56.356383+0000","last_undegraded":"2024-04-16T19:38:56.356383+0000","last_fullsized":"2024-04-16T19:38:56.356383+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'274","last_scrub_stamp":"2024-04-16T19:38:56.356276+0000","last_deep_scrub":"53'274","last_deep_scrub_stamp":"2024-04-16T19:38:56.356276+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.356276+0000","objects_scrubbed":46,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:42:56.666380+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22911,"num_omap_keys":91,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.547577+0000","last_change":"2024-04-16T19:38:25.547577+0000","last_active":"2024-04-16T19:38:25.547577+0000","last_peered":"2024-04-16T19:38:25.547577+0000","last_clean":"2024-04-16T19:38:25.547577+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:38:25.547577+0000","last_undegraded":"2024-04-16T19:38:25.547577+0000","last_fullsized":"2024-04-16T19:38:25.547577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.547478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:51.243189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'10","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.429116+0000","last_change":"2024-04-16T19:38:31.429149+0000","last_active":"2024-04-16T19:38:31.429116+0000","last_peered":"2024-04-16T19:38:31.429116+0000","last_clean":"2024-04-16T19:38:31.429116+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:38:31.429116+0000","last_undegraded":"2024-04-16T19:38:31.429116+0000","last_fullsized":"2024-04-16T19:38:31.429116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.429051+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:33.962416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.354794+0000","last_change":"2024-04-16T19:38:30.354840+0000","last_active":"2024-04-16T19:38:30.354794+0000","last_peered":"2024-04-16T19:38:30.354794+0000","last_clean":"2024-04-16T19:38:30.354794+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:38:30.354794+0000","last_undegraded":"2024-04-16T19:38:30.354794+0000","last_fullsized":"2024-04-16T19:38:30.354794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.354716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:36.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'283","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.068635+0000","last_change":"2024-04-16T19:38:14.068719+0000","last_active":"2024-04-16T19:38:14.068635+0000","last_peered":"2024-04-16T19:38:14.068635+0000","last_clean":"2024-04-16T19:38:14.068635+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:38:14.068635+0000","last_undegraded":"2024-04-16T19:38:14.068635+0000","last_fullsized":"2024-04-16T19:38:14.068635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'283","last_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_deep_scrub":"53'283","last_deep_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.068569+0000","objects_scrubbed":17,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:04.644251+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'16","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.254163+0000","last_change":"2024-04-16T19:38:18.254163+0000","last_active":"2024-04-16T19:38:18.254163+0000","last_peered":"2024-04-16T19:38:18.254163+0000","last_clean":"2024-04-16T19:38:18.254163+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:38:18.254163+0000","last_undegraded":"2024-04-16T19:38:18.254163+0000","last_fullsized":"2024-04-16T19:38:18.254163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.254059+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:53.228339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.371589+0000","last_change":"2024-04-16T19:38:29.371613+0000","last_active":"2024-04-16T19:38:29.371589+0000","last_peered":"2024-04-16T19:38:29.371589+0000","last_clean":"2024-04-16T19:38:29.371589+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:38:29.371589+0000","last_undegraded":"2024-04-16T19:38:29.371589+0000","last_fullsized":"2024-04-16T19:38:29.371589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.371523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:16.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068801+0000","last_change":"2024-04-16T17:45:10.398271+0000","last_active":"2024-04-16T19:38:08.068801+0000","last_peered":"2024-04-16T19:38:08.068801+0000","last_clean":"2024-04-16T19:38:08.068801+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:38:08.068801+0000","last_undegraded":"2024-04-16T19:38:08.068801+0000","last_fullsized":"2024-04-16T19:38:08.068801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397357+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:37:09.397357+0000","last_peered":"2024-04-16T19:37:09.397357+0000","last_clean":"2024-04-16T19:37:09.397357+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:37:09.397357+0000","last_undegraded":"2024-04-16T19:37:09.397357+0000","last_fullsized":"2024-04-16T19:37:09.397357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.983783+0000","last_change":"2024-04-16T19:38:56.983783+0000","last_active":"2024-04-16T19:38:56.983783+0000","last_peered":"2024-04-16T19:38:56.983783+0000","last_clean":"2024-04-16T19:38:56.983783+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:38:56.983783+0000","last_undegraded":"2024-04-16T19:38:56.983783+0000","last_fullsized":"2024-04-16T19:38:56.983783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.983691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.983691+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.983691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:51.631183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'125","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.003707+0000","last_change":"2024-04-16T19:38:51.003739+0000","last_active":"2024-04-16T19:38:51.003707+0000","last_peered":"2024-04-16T19:38:51.003707+0000","last_clean":"2024-04-16T19:38:51.003707+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:38:51.003707+0000","last_undegraded":"2024-04-16T19:38:51.003707+0000","last_fullsized":"2024-04-16T19:38:51.003707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:51.003645+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:51.003645+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.003645+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:53.517671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'13","reported_seq":1398,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.999553+0000","last_change":"2024-04-16T19:38:51.999553+0000","last_active":"2024-04-16T19:38:51.999553+0000","last_peered":"2024-04-16T19:38:51.999553+0000","last_clean":"2024-04-16T19:38:51.999553+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:38:51.999553+0000","last_undegraded":"2024-04-16T19:38:51.999553+0000","last_fullsized":"2024-04-16T19:38:51.999553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.999449+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.999449+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.999449+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:17.756690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524660+0000","last_change":"2024-04-16T18:09:02.169752+0000","last_active":"2024-04-16T19:38:08.524660+0000","last_peered":"2024-04-16T19:38:08.524660+0000","last_clean":"2024-04-16T19:38:08.524660+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:38:08.524660+0000","last_undegraded":"2024-04-16T19:38:08.524660+0000","last_fullsized":"2024-04-16T19:38:08.524660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'197","reported_seq":2351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.427761+0000","last_change":"2024-04-16T19:39:08.427809+0000","last_active":"2024-04-16T19:39:08.427761+0000","last_peered":"2024-04-16T19:39:08.427761+0000","last_clean":"2024-04-16T19:39:08.427761+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:39:08.427761+0000","last_undegraded":"2024-04-16T19:39:08.427761+0000","last_fullsized":"2024-04-16T19:39:08.427761+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'197","last_scrub_stamp":"2024-04-16T19:39:08.427700+0000","last_deep_scrub":"53'197","last_deep_scrub_stamp":"2024-04-16T19:39:08.427700+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.427700+0000","objects_scrubbed":46,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:05.519695+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11005,"num_omap_keys":44,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.358729+0000","last_change":"2024-04-16T19:38:38.358729+0000","last_active":"2024-04-16T19:38:38.358729+0000","last_peered":"2024-04-16T19:38:38.358729+0000","last_clean":"2024-04-16T19:38:38.358729+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:38:38.358729+0000","last_undegraded":"2024-04-16T19:38:38.358729+0000","last_fullsized":"2024-04-16T19:38:38.358729+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.358644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:18.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'13","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.916490+0000","last_change":"2024-04-16T19:38:46.916547+0000","last_active":"2024-04-16T19:38:46.916490+0000","last_peered":"2024-04-16T19:38:46.916490+0000","last_clean":"2024-04-16T19:38:46.916490+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:38:46.916490+0000","last_undegraded":"2024-04-16T19:38:46.916490+0000","last_fullsized":"2024-04-16T19:38:46.916490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.916403+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:16.453973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.107369+0000","last_change":"2024-04-16T19:38:09.107389+0000","last_active":"2024-04-16T19:38:09.107369+0000","last_peered":"2024-04-16T19:38:09.107369+0000","last_clean":"2024-04-16T19:38:09.107369+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:38:09.107369+0000","last_undegraded":"2024-04-16T19:38:09.107369+0000","last_fullsized":"2024-04-16T19:38:09.107369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.107315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:06.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5992","reported_seq":12558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.824588+0000","last_change":"2024-04-16T19:38:12.824617+0000","last_active":"2024-04-16T19:38:12.824588+0000","last_peered":"2024-04-16T19:38:12.824588+0000","last_clean":"2024-04-16T19:38:12.824588+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:38:12.824588+0000","last_undegraded":"2024-04-16T19:38:12.824588+0000","last_fullsized":"2024-04-16T19:38:12.824588+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5992","last_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_deep_scrub":"53'5992","last_deep_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.824529+0000","objects_scrubbed":27,"log_size":1792,"log_dups_size":3000,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:47.168687+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":79208,"num_omap_keys":410,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'16","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.740826+0000","last_change":"2024-04-16T19:38:21.740887+0000","last_active":"2024-04-16T19:38:21.740826+0000","last_peered":"2024-04-16T19:38:21.740826+0000","last_clean":"2024-04-16T19:38:21.740826+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:38:21.740826+0000","last_undegraded":"2024-04-16T19:38:21.740826+0000","last_fullsized":"2024-04-16T19:38:21.740826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.740747+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:07.774419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.344166+0000","last_change":"2024-04-16T19:38:40.344189+0000","last_active":"2024-04-16T19:38:40.344166+0000","last_peered":"2024-04-16T19:38:40.344166+0000","last_clean":"2024-04-16T19:38:40.344166+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:38:40.344166+0000","last_undegraded":"2024-04-16T19:38:40.344166+0000","last_fullsized":"2024-04-16T19:38:40.344166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.344095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:37.023758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068802+0000","last_change":"2024-04-16T17:45:10.391762+0000","last_active":"2024-04-16T19:38:08.068802+0000","last_peered":"2024-04-16T19:38:08.068802+0000","last_clean":"2024-04-16T19:38:08.068802+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:38:08.068802+0000","last_undegraded":"2024-04-16T19:38:08.068802+0000","last_fullsized":"2024-04-16T19:38:08.068802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.396801+0000","last_change":"2024-04-16T17:45:08.387257+0000","last_active":"2024-04-16T19:37:09.396801+0000","last_peered":"2024-04-16T19:37:09.396801+0000","last_clean":"2024-04-16T19:37:09.396801+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:37:09.396801+0000","last_undegraded":"2024-04-16T19:37:09.396801+0000","last_fullsized":"2024-04-16T19:37:09.396801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"53'2","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.013986+0000","last_change":"2024-04-16T19:39:07.014015+0000","last_active":"2024-04-16T19:39:07.013986+0000","last_peered":"2024-04-16T19:39:07.013986+0000","last_clean":"2024-04-16T19:39:07.013986+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:39:07.013986+0000","last_undegraded":"2024-04-16T19:39:07.013986+0000","last_fullsized":"2024-04-16T19:39:07.013986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:07.013923+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:07.013923+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.013923+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:46.793909+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.981271+0000","last_change":"2024-04-16T19:38:54.981271+0000","last_active":"2024-04-16T19:38:54.981271+0000","last_peered":"2024-04-16T19:38:54.981271+0000","last_clean":"2024-04-16T19:38:54.981271+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:38:54.981271+0000","last_undegraded":"2024-04-16T19:38:54.981271+0000","last_fullsized":"2024-04-16T19:38:54.981271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:54.981167+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:54.981167+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.981167+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:57.572002+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'13","reported_seq":1399,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.649014+0000","last_change":"2024-04-16T19:38:51.649037+0000","last_active":"2024-04-16T19:38:51.649014+0000","last_peered":"2024-04-16T19:38:51.649014+0000","last_clean":"2024-04-16T19:38:51.649014+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:38:51.649014+0000","last_undegraded":"2024-04-16T19:38:51.649014+0000","last_fullsized":"2024-04-16T19:38:51.649014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.648964+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.648964+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.648964+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:30.770870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887557+0000","last_change":"2024-04-16T18:09:02.168123+0000","last_active":"2024-04-16T19:38:09.887557+0000","last_peered":"2024-04-16T19:38:09.887557+0000","last_clean":"2024-04-16T19:38:09.887557+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:38:09.887557+0000","last_undegraded":"2024-04-16T19:38:09.887557+0000","last_fullsized":"2024-04-16T19:38:09.887557+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429936+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:38:09.429936+0000","last_peered":"2024-04-16T19:38:09.429936+0000","last_clean":"2024-04-16T19:38:09.429936+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:38:09.429936+0000","last_undegraded":"2024-04-16T19:38:09.429936+0000","last_fullsized":"2024-04-16T19:38:09.429936+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.860257+0000","last_change":"2024-04-16T19:38:38.860257+0000","last_active":"2024-04-16T19:38:38.860257+0000","last_peered":"2024-04-16T19:38:38.860257+0000","last_clean":"2024-04-16T19:38:38.860257+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:38:38.860257+0000","last_undegraded":"2024-04-16T19:38:38.860257+0000","last_fullsized":"2024-04-16T19:38:38.860257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.860170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:59.006022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'13","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.413937+0000","last_change":"2024-04-16T19:38:33.413987+0000","last_active":"2024-04-16T19:38:33.413937+0000","last_peered":"2024-04-16T19:38:33.413937+0000","last_clean":"2024-04-16T19:38:33.413937+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:38:33.413937+0000","last_undegraded":"2024-04-16T19:38:33.413937+0000","last_fullsized":"2024-04-16T19:38:33.413937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.413861+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:52.042937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.739844+0000","last_change":"2024-04-16T19:38:22.739844+0000","last_active":"2024-04-16T19:38:22.739844+0000","last_peered":"2024-04-16T19:38:22.739844+0000","last_clean":"2024-04-16T19:38:22.739844+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:38:22.739844+0000","last_undegraded":"2024-04-16T19:38:22.739844+0000","last_fullsized":"2024-04-16T19:38:22.739844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.739758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:59.491263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1601","reported_seq":47000,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.864758+0000","last_change":"2024-04-16T19:38:18.864758+0000","last_active":"2024-04-16T19:38:18.864758+0000","last_peered":"2024-04-16T19:38:18.864758+0000","last_clean":"2024-04-16T19:38:18.864758+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:38:18.864758+0000","last_undegraded":"2024-04-16T19:38:18.864758+0000","last_fullsized":"2024-04-16T19:38:18.864758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'1601","last_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_deep_scrub":"53'1601","last_deep_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.864667+0000","objects_scrubbed":26,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:06.203531+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14964,"num_omap_keys":68,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'12","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.220904+0000","last_change":"2024-04-16T19:38:11.220904+0000","last_active":"2024-04-16T19:38:11.220904+0000","last_peered":"2024-04-16T19:38:11.220904+0000","last_clean":"2024-04-16T19:38:11.220904+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:38:11.220904+0000","last_undegraded":"2024-04-16T19:38:11.220904+0000","last_fullsized":"2024-04-16T19:38:11.220904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.220802+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:19.617959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403883+0000","last_change":"2024-04-16T17:45:10.393324+0000","last_active":"2024-04-16T19:37:54.403883+0000","last_peered":"2024-04-16T19:37:54.403883+0000","last_clean":"2024-04-16T19:37:54.403883+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:37:54.403883+0000","last_undegraded":"2024-04-16T19:37:54.403883+0000","last_fullsized":"2024-04-16T19:37:54.403883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404572+0000","last_change":"2024-04-16T17:45:08.389843+0000","last_active":"2024-04-16T19:37:59.404572+0000","last_peered":"2024-04-16T19:37:59.404572+0000","last_clean":"2024-04-16T19:37:59.404572+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:37:59.404572+0000","last_undegraded":"2024-04-16T19:37:59.404572+0000","last_fullsized":"2024-04-16T19:37:59.404572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"48'5","reported_seq":229,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405211+0000","last_change":"2024-04-16T17:45:20.407401+0000","last_active":"2024-04-16T19:38:04.405211+0000","last_peered":"2024-04-16T19:38:04.405211+0000","last_clean":"2024-04-16T19:38:04.405211+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:38:04.405211+0000","last_undegraded":"2024-04-16T19:38:04.405211+0000","last_fullsized":"2024-04-16T19:38:04.405211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'209","reported_seq":441,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.728984+0000","last_change":"2024-04-16T19:38:57.729048+0000","last_active":"2024-04-16T19:38:57.728984+0000","last_peered":"2024-04-16T19:38:57.728984+0000","last_clean":"2024-04-16T19:38:57.728984+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:38:57.728984+0000","last_undegraded":"2024-04-16T19:38:57.728984+0000","last_fullsized":"2024-04-16T19:38:57.728984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'209","last_scrub_stamp":"2024-04-16T19:38:57.728909+0000","last_deep_scrub":"53'209","last_deep_scrub_stamp":"2024-04-16T19:38:57.728909+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.728909+0000","objects_scrubbed":9,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:54.778754+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.730542+0000","last_change":"2024-04-16T19:38:45.730564+0000","last_active":"2024-04-16T19:38:45.730542+0000","last_peered":"2024-04-16T19:38:45.730542+0000","last_clean":"2024-04-16T19:38:45.730542+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:38:45.730542+0000","last_undegraded":"2024-04-16T19:38:45.730542+0000","last_fullsized":"2024-04-16T19:38:45.730542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.730467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:04.477302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.807488+0000","last_change":"2024-04-16T19:38:36.807512+0000","last_active":"2024-04-16T19:38:36.807488+0000","last_peered":"2024-04-16T19:38:36.807488+0000","last_clean":"2024-04-16T19:38:36.807488+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:38:36.807488+0000","last_undegraded":"2024-04-16T19:38:36.807488+0000","last_fullsized":"2024-04-16T19:38:36.807488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.807410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:01.775567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977344+0000","last_change":"2024-04-16T18:09:02.169539+0000","last_active":"2024-04-16T19:38:08.977344+0000","last_peered":"2024-04-16T19:38:08.977344+0000","last_clean":"2024-04-16T19:38:08.977344+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:38:08.977344+0000","last_undegraded":"2024-04-16T19:38:08.977344+0000","last_fullsized":"2024-04-16T19:38:08.977344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1474,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069965+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:38:08.069965+0000","last_peered":"2024-04-16T19:38:08.069965+0000","last_clean":"2024-04-16T19:38:08.069965+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:38:08.069965+0000","last_undegraded":"2024-04-16T19:38:08.069965+0000","last_fullsized":"2024-04-16T19:38:08.069965+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.929722+0000","last_change":"2024-04-16T19:38:48.929745+0000","last_active":"2024-04-16T19:38:48.929722+0000","last_peered":"2024-04-16T19:38:48.929722+0000","last_clean":"2024-04-16T19:38:48.929722+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:38:48.929722+0000","last_undegraded":"2024-04-16T19:38:48.929722+0000","last_fullsized":"2024-04-16T19:38:48.929722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.929661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:58.580340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"53'6","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.954955+0000","last_change":"2024-04-16T19:38:42.954988+0000","last_active":"2024-04-16T19:38:42.954955+0000","last_peered":"2024-04-16T19:38:42.954955+0000","last_clean":"2024-04-16T19:38:42.954955+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:38:42.954955+0000","last_undegraded":"2024-04-16T19:38:42.954955+0000","last_fullsized":"2024-04-16T19:38:42.954955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.954892+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:01.753384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.345083+0000","last_change":"2024-04-16T19:38:28.345083+0000","last_active":"2024-04-16T19:38:28.345083+0000","last_peered":"2024-04-16T19:38:28.345083+0000","last_clean":"2024-04-16T19:38:28.345083+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:38:28.345083+0000","last_undegraded":"2024-04-16T19:38:28.345083+0000","last_fullsized":"2024-04-16T19:38:28.345083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.344996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:22.992488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'355","reported_seq":664,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.869936+0000","last_change":"2024-04-16T19:38:12.869936+0000","last_active":"2024-04-16T19:38:12.869936+0000","last_peered":"2024-04-16T19:38:12.869936+0000","last_clean":"2024-04-16T19:38:12.869936+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:38:12.869936+0000","last_undegraded":"2024-04-16T19:38:12.869936+0000","last_fullsized":"2024-04-16T19:38:12.869936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'355","last_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_deep_scrub":"53'355","last_deep_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.869802+0000","objects_scrubbed":17,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:21.665637+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21527,"num_omap_keys":98,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'19","reported_seq":604,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.829535+0000","last_change":"2024-04-16T19:38:08.829535+0000","last_active":"2024-04-16T19:38:08.829535+0000","last_peered":"2024-04-16T19:38:08.829535+0000","last_clean":"2024-04-16T19:38:08.829535+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:38:08.829535+0000","last_undegraded":"2024-04-16T19:38:08.829535+0000","last_fullsized":"2024-04-16T19:38:08.829535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'19","last_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_deep_scrub":"53'19","last_deep_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.829450+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:30.796211+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.207689+0000","last_change":"2024-04-16T19:39:00.207711+0000","last_active":"2024-04-16T19:39:00.207689+0000","last_peered":"2024-04-16T19:39:00.207689+0000","last_clean":"2024-04-16T19:39:00.207689+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:39:00.207689+0000","last_undegraded":"2024-04-16T19:39:00.207689+0000","last_fullsized":"2024-04-16T19:39:00.207689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.207628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.207628+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.207628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:40.195071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401152+0000","last_change":"2024-04-16T17:45:08.388824+0000","last_active":"2024-04-16T19:37:39.401152+0000","last_peered":"2024-04-16T19:37:39.401152+0000","last_clean":"2024-04-16T19:37:39.401152+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:37:39.401152+0000","last_undegraded":"2024-04-16T19:37:39.401152+0000","last_fullsized":"2024-04-16T19:37:39.401152+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.974949+0000","last_change":"2024-04-16T19:39:00.974970+0000","last_active":"2024-04-16T19:39:00.974949+0000","last_peered":"2024-04-16T19:39:00.974949+0000","last_clean":"2024-04-16T19:39:00.974949+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:39:00.974949+0000","last_undegraded":"2024-04-16T19:39:00.974949+0000","last_fullsized":"2024-04-16T19:39:00.974949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.974887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.974887+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.974887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:19.721721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'84","reported_seq":254,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.666541+0000","last_change":"2024-04-16T19:38:52.666600+0000","last_active":"2024-04-16T19:38:52.666541+0000","last_peered":"2024-04-16T19:38:52.666541+0000","last_clean":"2024-04-16T19:38:52.666541+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:38:52.666541+0000","last_undegraded":"2024-04-16T19:38:52.666541+0000","last_fullsized":"2024-04-16T19:38:52.666541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:52.666426+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:52.666426+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.666426+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:13.136531+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.960739+0000","last_change":"2024-04-16T19:38:46.960762+0000","last_active":"2024-04-16T19:38:46.960739+0000","last_peered":"2024-04-16T19:38:46.960739+0000","last_clean":"2024-04-16T19:38:46.960739+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:38:46.960739+0000","last_undegraded":"2024-04-16T19:38:46.960739+0000","last_fullsized":"2024-04-16T19:38:46.960739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.960675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:21.934955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.329000+0000","last_change":"2024-04-16T19:38:45.329022+0000","last_active":"2024-04-16T19:38:45.329000+0000","last_peered":"2024-04-16T19:38:45.329000+0000","last_clean":"2024-04-16T19:38:45.329000+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:38:45.329000+0000","last_undegraded":"2024-04-16T19:38:45.329000+0000","last_fullsized":"2024-04-16T19:38:45.329000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.328934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:07.148341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429923+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:38:09.429923+0000","last_peered":"2024-04-16T19:38:09.429923+0000","last_clean":"2024-04-16T19:38:09.429923+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:38:09.429923+0000","last_undegraded":"2024-04-16T19:38:09.429923+0000","last_fullsized":"2024-04-16T19:38:09.429923+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'168","reported_seq":2644,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.988098+0000","last_change":"2024-04-16T19:38:44.988151+0000","last_active":"2024-04-16T19:38:44.988098+0000","last_peered":"2024-04-16T19:38:44.988098+0000","last_clean":"2024-04-16T19:38:44.988098+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:38:44.988098+0000","last_undegraded":"2024-04-16T19:38:44.988098+0000","last_fullsized":"2024-04-16T19:38:44.988098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'168","last_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_deep_scrub":"53'168","last_deep_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.988038+0000","objects_scrubbed":48,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:15.308723+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9452,"num_omap_keys":38,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.351134+0000","last_change":"2024-04-16T19:38:48.351134+0000","last_active":"2024-04-16T19:38:48.351134+0000","last_peered":"2024-04-16T19:38:48.351134+0000","last_clean":"2024-04-16T19:38:48.351134+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:38:48.351134+0000","last_undegraded":"2024-04-16T19:38:48.351134+0000","last_fullsized":"2024-04-16T19:38:48.351134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.351012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:56.344801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'23","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.995773+0000","last_change":"2024-04-16T19:38:43.995808+0000","last_active":"2024-04-16T19:38:43.995773+0000","last_peered":"2024-04-16T19:38:43.995773+0000","last_clean":"2024-04-16T19:38:43.995773+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:38:43.995773+0000","last_undegraded":"2024-04-16T19:38:43.995773+0000","last_fullsized":"2024-04-16T19:38:43.995773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.995709+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:23.117614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.514936+0000","last_change":"2024-04-16T19:38:16.514936+0000","last_active":"2024-04-16T19:38:16.514936+0000","last_peered":"2024-04-16T19:38:16.514936+0000","last_clean":"2024-04-16T19:38:16.514936+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:38:16.514936+0000","last_undegraded":"2024-04-16T19:38:16.514936+0000","last_fullsized":"2024-04-16T19:38:16.514936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.514815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:31:12.328836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'933","reported_seq":3835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.408460+0000","last_change":"2024-04-16T19:38:24.408514+0000","last_active":"2024-04-16T19:38:24.408460+0000","last_peered":"2024-04-16T19:38:24.408460+0000","last_clean":"2024-04-16T19:38:24.408460+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:38:24.408460+0000","last_undegraded":"2024-04-16T19:38:24.408460+0000","last_fullsized":"2024-04-16T19:38:24.408460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'933","last_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_deep_scrub":"53'933","last_deep_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.408381+0000","objects_scrubbed":26,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:46.227789+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13193,"num_omap_keys":66,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'24","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.811180+0000","last_change":"2024-04-16T19:38:19.811180+0000","last_active":"2024-04-16T19:38:19.811180+0000","last_peered":"2024-04-16T19:38:19.811180+0000","last_clean":"2024-04-16T19:38:19.811180+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:38:19.811180+0000","last_undegraded":"2024-04-16T19:38:19.811180+0000","last_fullsized":"2024-04-16T19:38:19.811180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.811061+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:19.180605+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338768+0000","last_change":"2024-04-16T17:45:10.394156+0000","last_active":"2024-04-16T19:38:10.338768+0000","last_peered":"2024-04-16T19:38:10.338768+0000","last_clean":"2024-04-16T19:38:10.338768+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:38:10.338768+0000","last_undegraded":"2024-04-16T19:38:10.338768+0000","last_fullsized":"2024-04-16T19:38:10.338768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795461+0000","last_change":"2024-04-16T19:38:33.795461+0000","last_active":"2024-04-16T19:38:33.795461+0000","last_peered":"2024-04-16T19:38:33.795461+0000","last_clean":"2024-04-16T19:38:33.795461+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:38:33.795461+0000","last_undegraded":"2024-04-16T19:38:33.795461+0000","last_fullsized":"2024-04-16T19:38:33.795461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:47.763767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.008970+0000","last_change":"2024-04-16T19:39:03.008993+0000","last_active":"2024-04-16T19:39:03.008970+0000","last_peered":"2024-04-16T19:39:03.008970+0000","last_clean":"2024-04-16T19:39:03.008970+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:39:03.008970+0000","last_undegraded":"2024-04-16T19:39:03.008970+0000","last_fullsized":"2024-04-16T19:39:03.008970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.008902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.008902+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.008902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:45.918962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'159","reported_seq":367,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.008609+0000","last_change":"2024-04-16T19:39:00.008649+0000","last_active":"2024-04-16T19:39:00.008609+0000","last_peered":"2024-04-16T19:39:00.008609+0000","last_clean":"2024-04-16T19:39:00.008609+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:39:00.008609+0000","last_undegraded":"2024-04-16T19:39:00.008609+0000","last_fullsized":"2024-04-16T19:39:00.008609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:00.008548+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:00.008548+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.008548+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:20.719287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'13","reported_seq":1403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.379708+0000","last_change":"2024-04-16T19:38:51.379732+0000","last_active":"2024-04-16T19:38:51.379708+0000","last_peered":"2024-04-16T19:38:51.379708+0000","last_clean":"2024-04-16T19:38:51.379708+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:38:51.379708+0000","last_undegraded":"2024-04-16T19:38:51.379708+0000","last_fullsized":"2024-04-16T19:38:51.379708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.379649+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.379649+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.379649+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:17:27.551399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.361374+0000","last_change":"2024-04-16T19:38:31.361394+0000","last_active":"2024-04-16T19:38:31.361374+0000","last_peered":"2024-04-16T19:38:31.361374+0000","last_clean":"2024-04-16T19:38:31.361374+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:38:31.361374+0000","last_undegraded":"2024-04-16T19:38:31.361374+0000","last_fullsized":"2024-04-16T19:38:31.361374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.361320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:12.965762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.588489+0000","last_change":"2024-04-16T18:09:02.168408+0000","last_active":"2024-04-16T19:37:19.588489+0000","last_peered":"2024-04-16T19:37:19.588489+0000","last_clean":"2024-04-16T19:37:19.588489+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:37:19.588489+0000","last_undegraded":"2024-04-16T19:37:19.588489+0000","last_fullsized":"2024-04-16T19:37:19.588489+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'215","reported_seq":2411,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.685934+0000","last_change":"2024-04-16T19:38:50.685934+0000","last_active":"2024-04-16T19:38:50.685934+0000","last_peered":"2024-04-16T19:38:50.685934+0000","last_clean":"2024-04-16T19:38:50.685934+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:38:50.685934+0000","last_undegraded":"2024-04-16T19:38:50.685934+0000","last_fullsized":"2024-04-16T19:38:50.685934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'215","last_scrub_stamp":"2024-04-16T19:38:50.685830+0000","last_deep_scrub":"53'215","last_deep_scrub_stamp":"2024-04-16T19:38:50.685830+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.685830+0000","objects_scrubbed":51,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:48:53.644287+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15064,"num_omap_keys":61,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.792912+0000","last_change":"2024-04-16T19:38:43.792912+0000","last_active":"2024-04-16T19:38:43.792912+0000","last_peered":"2024-04-16T19:38:43.792912+0000","last_clean":"2024-04-16T19:38:43.792912+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:38:43.792912+0000","last_undegraded":"2024-04-16T19:38:43.792912+0000","last_fullsized":"2024-04-16T19:38:43.792912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.792826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:02.586806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'25","reported_seq":153,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.332961+0000","last_change":"2024-04-16T19:38:45.333002+0000","last_active":"2024-04-16T19:38:45.332961+0000","last_peered":"2024-04-16T19:38:45.332961+0000","last_clean":"2024-04-16T19:38:45.332961+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:38:45.332961+0000","last_undegraded":"2024-04-16T19:38:45.332961+0000","last_fullsized":"2024-04-16T19:38:45.332961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.332898+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:29.252852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.794605+0000","last_change":"2024-04-16T19:38:38.794628+0000","last_active":"2024-04-16T19:38:38.794605+0000","last_peered":"2024-04-16T19:38:38.794605+0000","last_clean":"2024-04-16T19:38:38.794605+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:38:38.794605+0000","last_undegraded":"2024-04-16T19:38:38.794605+0000","last_fullsized":"2024-04-16T19:38:38.794605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.794540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:20.398982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'620","reported_seq":3264,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.073025+0000","last_change":"2024-04-16T19:38:11.073025+0000","last_active":"2024-04-16T19:38:11.073025+0000","last_peered":"2024-04-16T19:38:11.073025+0000","last_clean":"2024-04-16T19:38:11.073025+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:38:11.073025+0000","last_undegraded":"2024-04-16T19:38:11.073025+0000","last_fullsized":"2024-04-16T19:38:11.073025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'620","last_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_deep_scrub":"53'620","last_deep_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.072941+0000","objects_scrubbed":28,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:29.251802+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7883,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'29","reported_seq":356,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.759701+0000","last_change":"2024-04-16T19:38:28.759701+0000","last_active":"2024-04-16T19:38:28.759701+0000","last_peered":"2024-04-16T19:38:28.759701+0000","last_clean":"2024-04-16T19:38:28.759701+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:38:28.759701+0000","last_undegraded":"2024-04-16T19:38:28.759701+0000","last_fullsized":"2024-04-16T19:38:28.759701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'29","last_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_deep_scrub":"53'29","last_deep_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.759592+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:37.264543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405163+0000","last_change":"2024-04-16T17:45:10.392991+0000","last_active":"2024-04-16T19:37:44.405163+0000","last_peered":"2024-04-16T19:37:44.405163+0000","last_clean":"2024-04-16T19:37:44.405163+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:37:44.405163+0000","last_undegraded":"2024-04-16T19:37:44.405163+0000","last_fullsized":"2024-04-16T19:37:44.405163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401068+0000","last_change":"2024-04-16T17:45:08.387422+0000","last_active":"2024-04-16T19:37:39.401068+0000","last_peered":"2024-04-16T19:37:39.401068+0000","last_clean":"2024-04-16T19:37:39.401068+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:37:39.401068+0000","last_undegraded":"2024-04-16T19:37:39.401068+0000","last_fullsized":"2024-04-16T19:37:39.401068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"53'4","reported_seq":193,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.044842+0000","last_change":"2024-04-16T19:39:05.044875+0000","last_active":"2024-04-16T19:39:05.044842+0000","last_peered":"2024-04-16T19:39:05.044842+0000","last_clean":"2024-04-16T19:39:05.044842+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:39:05.044842+0000","last_undegraded":"2024-04-16T19:39:05.044842+0000","last_fullsized":"2024-04-16T19:39:05.044842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:05.044785+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:05.044785+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.044785+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:02.023870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'93","reported_seq":274,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.380153+0000","last_change":"2024-04-16T19:39:05.380186+0000","last_active":"2024-04-16T19:39:05.380153+0000","last_peered":"2024-04-16T19:39:05.380153+0000","last_clean":"2024-04-16T19:39:05.380153+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:39:05.380153+0000","last_undegraded":"2024-04-16T19:39:05.380153+0000","last_fullsized":"2024-04-16T19:39:05.380153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'93","last_scrub_stamp":"2024-04-16T19:39:05.380096+0000","last_deep_scrub":"53'93","last_deep_scrub_stamp":"2024-04-16T19:39:05.380096+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.380096+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:20.400865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.969020+0000","last_change":"2024-04-16T19:38:49.969046+0000","last_active":"2024-04-16T19:38:49.969020+0000","last_peered":"2024-04-16T19:38:49.969020+0000","last_clean":"2024-04-16T19:38:49.969020+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:38:49.969020+0000","last_undegraded":"2024-04-16T19:38:49.969020+0000","last_fullsized":"2024-04-16T19:38:49.969020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.968949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.968949+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.968949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:55.390786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.759633+0000","last_change":"2024-04-16T19:38:27.759655+0000","last_active":"2024-04-16T19:38:27.759633+0000","last_peered":"2024-04-16T19:38:27.759633+0000","last_clean":"2024-04-16T19:38:27.759633+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:38:27.759633+0000","last_undegraded":"2024-04-16T19:38:27.759633+0000","last_fullsized":"2024-04-16T19:38:27.759633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.759568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:42.585548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596023+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:37:54.596023+0000","last_peered":"2024-04-16T19:37:54.596023+0000","last_clean":"2024-04-16T19:37:54.596023+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:37:54.596023+0000","last_undegraded":"2024-04-16T19:37:54.596023+0000","last_fullsized":"2024-04-16T19:37:54.596023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'183","reported_seq":1969,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.363333+0000","last_change":"2024-04-16T19:39:00.363333+0000","last_active":"2024-04-16T19:39:00.363333+0000","last_peered":"2024-04-16T19:39:00.363333+0000","last_clean":"2024-04-16T19:39:00.363333+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:39:00.363333+0000","last_undegraded":"2024-04-16T19:39:00.363333+0000","last_fullsized":"2024-04-16T19:39:00.363333+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'183","last_scrub_stamp":"2024-04-16T19:39:00.363243+0000","last_deep_scrub":"53'183","last_deep_scrub_stamp":"2024-04-16T19:39:00.363243+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.363243+0000","objects_scrubbed":52,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:44.415353+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10405,"num_omap_keys":43,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.571609+0000","last_change":"2024-04-16T19:38:24.571609+0000","last_active":"2024-04-16T19:38:24.571609+0000","last_peered":"2024-04-16T19:38:24.571609+0000","last_clean":"2024-04-16T19:38:24.571609+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:38:24.571609+0000","last_undegraded":"2024-04-16T19:38:24.571609+0000","last_fullsized":"2024-04-16T19:38:24.571609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.571519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:55.147346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'13","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.847919+0000","last_change":"2024-04-16T19:38:48.847948+0000","last_active":"2024-04-16T19:38:48.847919+0000","last_peered":"2024-04-16T19:38:48.847919+0000","last_clean":"2024-04-16T19:38:48.847919+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:38:48.847919+0000","last_undegraded":"2024-04-16T19:38:48.847919+0000","last_fullsized":"2024-04-16T19:38:48.847919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.847863+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:18.385433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'652","reported_seq":2214,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.914164+0000","last_change":"2024-04-16T19:38:49.914193+0000","last_active":"2024-04-16T19:38:49.914164+0000","last_peered":"2024-04-16T19:38:49.914164+0000","last_clean":"2024-04-16T19:38:49.914164+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:38:49.914164+0000","last_undegraded":"2024-04-16T19:38:49.914164+0000","last_fullsized":"2024-04-16T19:38:49.914164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:49.914098+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:49.914098+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.914098+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:38.352262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'328","reported_seq":608,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.821880+0000","last_change":"2024-04-16T19:38:14.821880+0000","last_active":"2024-04-16T19:38:14.821880+0000","last_peered":"2024-04-16T19:38:14.821880+0000","last_clean":"2024-04-16T19:38:14.821880+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:38:14.821880+0000","last_undegraded":"2024-04-16T19:38:14.821880+0000","last_fullsized":"2024-04-16T19:38:14.821880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'328","last_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_deep_scrub":"53'328","last_deep_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.821710+0000","objects_scrubbed":22,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:27.374369+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14461,"num_omap_keys":66,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'12","reported_seq":557,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.221422+0000","last_change":"2024-04-16T19:38:14.221422+0000","last_active":"2024-04-16T19:38:14.221422+0000","last_peered":"2024-04-16T19:38:14.221422+0000","last_clean":"2024-04-16T19:38:14.221422+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:38:14.221422+0000","last_undegraded":"2024-04-16T19:38:14.221422+0000","last_fullsized":"2024-04-16T19:38:14.221422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.221299+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:29.047279+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.267910+0000","last_change":"2024-04-16T19:38:56.267932+0000","last_active":"2024-04-16T19:38:56.267910+0000","last_peered":"2024-04-16T19:38:56.267910+0000","last_clean":"2024-04-16T19:38:56.267910+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:38:56.267910+0000","last_undegraded":"2024-04-16T19:38:56.267910+0000","last_fullsized":"2024-04-16T19:38:56.267910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.267851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.267851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.267851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:39.824687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592657+0000","last_change":"2024-04-16T17:45:08.384395+0000","last_active":"2024-04-16T19:37:39.592657+0000","last_peered":"2024-04-16T19:37:39.592657+0000","last_clean":"2024-04-16T19:37:39.592657+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:37:39.592657+0000","last_undegraded":"2024-04-16T19:37:39.592657+0000","last_fullsized":"2024-04-16T19:37:39.592657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"53'4","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.988919+0000","last_change":"2024-04-16T19:38:58.988948+0000","last_active":"2024-04-16T19:38:58.988919+0000","last_peered":"2024-04-16T19:38:58.988919+0000","last_clean":"2024-04-16T19:38:58.988919+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:38:58.988919+0000","last_undegraded":"2024-04-16T19:38:58.988919+0000","last_fullsized":"2024-04-16T19:38:58.988919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:58.988846+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:58.988846+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.988846+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:04:00.042173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'109","reported_seq":291,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.321077+0000","last_change":"2024-04-16T19:38:53.321117+0000","last_active":"2024-04-16T19:38:53.321077+0000","last_peered":"2024-04-16T19:38:53.321077+0000","last_clean":"2024-04-16T19:38:53.321077+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:38:53.321077+0000","last_undegraded":"2024-04-16T19:38:53.321077+0000","last_fullsized":"2024-04-16T19:38:53.321077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:53.321015+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:53.321015+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.321015+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:32.108521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.338639+0000","last_change":"2024-04-16T19:38:54.338662+0000","last_active":"2024-04-16T19:38:54.338639+0000","last_peered":"2024-04-16T19:38:54.338639+0000","last_clean":"2024-04-16T19:38:54.338639+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:38:54.338639+0000","last_undegraded":"2024-04-16T19:38:54.338639+0000","last_fullsized":"2024-04-16T19:38:54.338639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:54.338572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:54.338572+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.338572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:15.049310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.698520+0000","last_change":"2024-04-16T19:38:40.698543+0000","last_active":"2024-04-16T19:38:40.698520+0000","last_peered":"2024-04-16T19:38:40.698520+0000","last_clean":"2024-04-16T19:38:40.698520+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:38:40.698520+0000","last_undegraded":"2024-04-16T19:38:40.698520+0000","last_fullsized":"2024-04-16T19:38:40.698520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.698456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:35.601090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407078+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:37:54.407078+0000","last_peered":"2024-04-16T19:37:54.407078+0000","last_clean":"2024-04-16T19:37:54.407078+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:37:54.407078+0000","last_undegraded":"2024-04-16T19:37:54.407078+0000","last_fullsized":"2024-04-16T19:37:54.407078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'214","reported_seq":2192,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.819710+0000","last_change":"2024-04-16T19:39:06.819710+0000","last_active":"2024-04-16T19:39:06.819710+0000","last_peered":"2024-04-16T19:39:06.819710+0000","last_clean":"2024-04-16T19:39:06.819710+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:39:06.819710+0000","last_undegraded":"2024-04-16T19:39:06.819710+0000","last_fullsized":"2024-04-16T19:39:06.819710+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'214","last_scrub_stamp":"2024-04-16T19:39:06.819616+0000","last_deep_scrub":"53'214","last_deep_scrub_stamp":"2024-04-16T19:39:06.819616+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.819616+0000","objects_scrubbed":58,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:28.816792+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11101,"num_omap_keys":44,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.926346+0000","last_change":"2024-04-16T19:38:50.926369+0000","last_active":"2024-04-16T19:38:50.926346+0000","last_peered":"2024-04-16T19:38:50.926346+0000","last_clean":"2024-04-16T19:38:50.926346+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:38:50.926346+0000","last_undegraded":"2024-04-16T19:38:50.926346+0000","last_fullsized":"2024-04-16T19:38:50.926346+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.926283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.926283+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.926283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:00.576961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'148","reported_seq":341,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.921604+0000","last_change":"2024-04-16T19:38:45.921641+0000","last_active":"2024-04-16T19:38:45.921604+0000","last_peered":"2024-04-16T19:38:45.921604+0000","last_clean":"2024-04-16T19:38:45.921604+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:38:45.921604+0000","last_undegraded":"2024-04-16T19:38:45.921604+0000","last_fullsized":"2024-04-16T19:38:45.921604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'148","last_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_deep_scrub":"53'148","last_deep_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.921535+0000","objects_scrubbed":4,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:26.250123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9535,"num_omap_keys":55,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.087323+0000","last_change":"2024-04-16T19:38:15.087323+0000","last_active":"2024-04-16T19:38:15.087323+0000","last_peered":"2024-04-16T19:38:15.087323+0000","last_clean":"2024-04-16T19:38:15.087323+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:38:15.087323+0000","last_undegraded":"2024-04-16T19:38:15.087323+0000","last_fullsized":"2024-04-16T19:38:15.087323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.087231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:14:00.509056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'845","reported_seq":1835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.089179+0000","last_change":"2024-04-16T19:38:10.089179+0000","last_active":"2024-04-16T19:38:10.089179+0000","last_peered":"2024-04-16T19:38:10.089179+0000","last_clean":"2024-04-16T19:38:10.089179+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:38:10.089179+0000","last_undegraded":"2024-04-16T19:38:10.089179+0000","last_fullsized":"2024-04-16T19:38:10.089179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'845","last_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_deep_scrub":"53'845","last_deep_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.089105+0000","objects_scrubbed":25,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:33.799326+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7064,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'8","reported_seq":283,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.784403+0000","last_change":"2024-04-16T19:38:13.784444+0000","last_active":"2024-04-16T19:38:13.784403+0000","last_peered":"2024-04-16T19:38:13.784403+0000","last_clean":"2024-04-16T19:38:13.784403+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:38:13.784403+0000","last_undegraded":"2024-04-16T19:38:13.784403+0000","last_fullsized":"2024-04-16T19:38:13.784403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.784341+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:20.950710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402655+0000","last_change":"2024-04-16T17:45:10.387439+0000","last_active":"2024-04-16T19:37:44.402655+0000","last_peered":"2024-04-16T19:37:44.402655+0000","last_clean":"2024-04-16T19:37:44.402655+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:37:44.402655+0000","last_undegraded":"2024-04-16T19:37:44.402655+0000","last_fullsized":"2024-04-16T19:37:44.402655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.406405+0000","last_change":"2024-04-16T17:45:08.386819+0000","last_active":"2024-04-16T19:38:09.406405+0000","last_peered":"2024-04-16T19:38:09.406405+0000","last_clean":"2024-04-16T19:38:09.406405+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:38:09.406405+0000","last_undegraded":"2024-04-16T19:38:09.406405+0000","last_fullsized":"2024-04-16T19:38:09.406405+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"48'13","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595838+0000","last_change":"2024-04-16T17:45:20.413420+0000","last_active":"2024-04-16T19:37:54.595838+0000","last_peered":"2024-04-16T19:37:54.595838+0000","last_clean":"2024-04-16T19:37:54.595838+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:37:54.595838+0000","last_undegraded":"2024-04-16T19:37:54.595838+0000","last_fullsized":"2024-04-16T19:37:54.595838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'159","reported_seq":365,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.102260+0000","last_change":"2024-04-16T19:39:09.102303+0000","last_active":"2024-04-16T19:39:09.102260+0000","last_peered":"2024-04-16T19:39:09.102260+0000","last_clean":"2024-04-16T19:39:09.102260+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:39:09.102260+0000","last_undegraded":"2024-04-16T19:39:09.102260+0000","last_fullsized":"2024-04-16T19:39:09.102260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:09.102197+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:09.102197+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.102197+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:49.430786+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.920197+0000","last_change":"2024-04-16T19:38:45.920222+0000","last_active":"2024-04-16T19:38:45.920197+0000","last_peered":"2024-04-16T19:38:45.920197+0000","last_clean":"2024-04-16T19:38:45.920197+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:38:45.920197+0000","last_undegraded":"2024-04-16T19:38:45.920197+0000","last_fullsized":"2024-04-16T19:38:45.920197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.920132+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:59.970112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.699740+0000","last_change":"2024-04-16T19:38:44.699765+0000","last_active":"2024-04-16T19:38:44.699740+0000","last_peered":"2024-04-16T19:38:44.699740+0000","last_clean":"2024-04-16T19:38:44.699740+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:38:44.699740+0000","last_undegraded":"2024-04-16T19:38:44.699740+0000","last_fullsized":"2024-04-16T19:38:44.699740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.699672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:23.487178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429994+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:38:09.429994+0000","last_peered":"2024-04-16T19:38:09.429994+0000","last_clean":"2024-04-16T19:38:09.429994+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:38:09.429994+0000","last_undegraded":"2024-04-16T19:38:09.429994+0000","last_fullsized":"2024-04-16T19:38:09.429994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'123","reported_seq":1657,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.055957+0000","last_change":"2024-04-16T19:39:01.055999+0000","last_active":"2024-04-16T19:39:01.055957+0000","last_peered":"2024-04-16T19:39:01.055957+0000","last_clean":"2024-04-16T19:39:01.055957+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:39:01.055957+0000","last_undegraded":"2024-04-16T19:39:01.055957+0000","last_fullsized":"2024-04-16T19:39:01.055957+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'123","last_scrub_stamp":"2024-04-16T19:39:01.055896+0000","last_deep_scrub":"53'123","last_deep_scrub_stamp":"2024-04-16T19:39:01.055896+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.055896+0000","objects_scrubbed":39,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:30.391341+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6944,"num_omap_keys":28,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.960413+0000","last_change":"2024-04-16T19:38:52.960413+0000","last_active":"2024-04-16T19:38:52.960413+0000","last_peered":"2024-04-16T19:38:52.960413+0000","last_clean":"2024-04-16T19:38:52.960413+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:38:52.960413+0000","last_undegraded":"2024-04-16T19:38:52.960413+0000","last_fullsized":"2024-04-16T19:38:52.960413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:52.960329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:52.960329+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.960329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:00.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'23","reported_seq":165,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.788363+0000","last_change":"2024-04-16T19:38:36.788402+0000","last_active":"2024-04-16T19:38:36.788363+0000","last_peered":"2024-04-16T19:38:36.788363+0000","last_clean":"2024-04-16T19:38:36.788363+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:38:36.788363+0000","last_undegraded":"2024-04-16T19:38:36.788363+0000","last_fullsized":"2024-04-16T19:38:36.788363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.788299+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:50.210568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.516924+0000","last_change":"2024-04-16T19:38:22.516949+0000","last_active":"2024-04-16T19:38:22.516924+0000","last_peered":"2024-04-16T19:38:22.516924+0000","last_clean":"2024-04-16T19:38:22.516924+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:38:22.516924+0000","last_undegraded":"2024-04-16T19:38:22.516924+0000","last_fullsized":"2024-04-16T19:38:22.516924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.516860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:29.683230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'556","reported_seq":948,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.745464+0000","last_change":"2024-04-16T19:38:10.745507+0000","last_active":"2024-04-16T19:38:10.745464+0000","last_peered":"2024-04-16T19:38:10.745464+0000","last_clean":"2024-04-16T19:38:10.745464+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:38:10.745464+0000","last_undegraded":"2024-04-16T19:38:10.745464+0000","last_fullsized":"2024-04-16T19:38:10.745464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'556","last_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_deep_scrub":"53'556","last_deep_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.745406+0000","objects_scrubbed":30,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:38:44.014095+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56852,"num_omap_keys":197,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'20","reported_seq":403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.950663+0000","last_change":"2024-04-16T19:38:18.950663+0000","last_active":"2024-04-16T19:38:18.950663+0000","last_peered":"2024-04-16T19:38:18.950663+0000","last_clean":"2024-04-16T19:38:18.950663+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:38:18.950663+0000","last_undegraded":"2024-04-16T19:38:18.950663+0000","last_fullsized":"2024-04-16T19:38:18.950663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.950543+0000","objects_scrubbed":10,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:35:43.149409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.232849+0000","last_change":"2024-04-16T19:39:05.232871+0000","last_active":"2024-04-16T19:39:05.232849+0000","last_peered":"2024-04-16T19:39:05.232849+0000","last_clean":"2024-04-16T19:39:05.232849+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:39:05.232849+0000","last_undegraded":"2024-04-16T19:39:05.232849+0000","last_fullsized":"2024-04-16T19:39:05.232849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:05.232783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:05.232783+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.232783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:14.883462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402279+0000","last_change":"2024-04-16T17:45:08.382545+0000","last_active":"2024-04-16T19:37:49.402279+0000","last_peered":"2024-04-16T19:37:49.402279+0000","last_clean":"2024-04-16T19:37:49.402279+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:37:49.402279+0000","last_undegraded":"2024-04-16T19:37:49.402279+0000","last_fullsized":"2024-04-16T19:37:49.402279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"53'20","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.756258+0000","last_change":"2024-04-16T19:39:05.756291+0000","last_active":"2024-04-16T19:39:05.756258+0000","last_peered":"2024-04-16T19:39:05.756258+0000","last_clean":"2024-04-16T19:39:05.756258+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:39:05.756258+0000","last_undegraded":"2024-04-16T19:39:05.756258+0000","last_fullsized":"2024-04-16T19:39:05.756258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:39:05.756190+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:39:05.756190+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.756190+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:33.153102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'125","reported_seq":310,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.767839+0000","last_change":"2024-04-16T19:38:57.767889+0000","last_active":"2024-04-16T19:38:57.767839+0000","last_peered":"2024-04-16T19:38:57.767839+0000","last_clean":"2024-04-16T19:38:57.767839+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:38:57.767839+0000","last_undegraded":"2024-04-16T19:38:57.767839+0000","last_fullsized":"2024-04-16T19:38:57.767839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:57.767770+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:57.767770+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.767770+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:37:57.201721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.371464+0000","last_change":"2024-04-16T19:38:48.371504+0000","last_active":"2024-04-16T19:38:48.371464+0000","last_peered":"2024-04-16T19:38:48.371464+0000","last_clean":"2024-04-16T19:38:48.371464+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:38:48.371464+0000","last_undegraded":"2024-04-16T19:38:48.371464+0000","last_fullsized":"2024-04-16T19:38:48.371464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.371402+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:08.229885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.304929+0000","last_change":"2024-04-16T19:38:44.304973+0000","last_active":"2024-04-16T19:38:44.304929+0000","last_peered":"2024-04-16T19:38:44.304929+0000","last_clean":"2024-04-16T19:38:44.304929+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:38:44.304929+0000","last_undegraded":"2024-04-16T19:38:44.304929+0000","last_fullsized":"2024-04-16T19:38:44.304929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.304852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:02.982475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524613+0000","last_change":"2024-04-16T18:09:02.169496+0000","last_active":"2024-04-16T19:38:08.524613+0000","last_peered":"2024-04-16T19:38:08.524613+0000","last_clean":"2024-04-16T19:38:08.524613+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:38:08.524613+0000","last_undegraded":"2024-04-16T19:38:08.524613+0000","last_fullsized":"2024-04-16T19:38:08.524613+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'161","reported_seq":2017,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.406358+0000","last_change":"2024-04-16T19:38:52.406393+0000","last_active":"2024-04-16T19:38:52.406358+0000","last_peered":"2024-04-16T19:38:52.406358+0000","last_clean":"2024-04-16T19:38:52.406358+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:38:52.406358+0000","last_undegraded":"2024-04-16T19:38:52.406358+0000","last_fullsized":"2024-04-16T19:38:52.406358+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'161","last_scrub_stamp":"2024-04-16T19:38:52.406292+0000","last_deep_scrub":"53'161","last_deep_scrub_stamp":"2024-04-16T19:38:52.406292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.406292+0000","objects_scrubbed":31,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:04.474633+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11035,"num_omap_keys":45,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.968540+0000","last_change":"2024-04-16T19:38:44.968540+0000","last_active":"2024-04-16T19:38:44.968540+0000","last_peered":"2024-04-16T19:38:44.968540+0000","last_clean":"2024-04-16T19:38:44.968540+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:38:44.968540+0000","last_undegraded":"2024-04-16T19:38:44.968540+0000","last_fullsized":"2024-04-16T19:38:44.968540+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.968404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:05.438509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'21","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.778353+0000","last_change":"2024-04-16T19:38:37.778410+0000","last_active":"2024-04-16T19:38:37.778353+0000","last_peered":"2024-04-16T19:38:37.778353+0000","last_clean":"2024-04-16T19:38:37.778353+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:38:37.778353+0000","last_undegraded":"2024-04-16T19:38:37.778353+0000","last_fullsized":"2024-04-16T19:38:37.778353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.778277+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:55.312669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.762332+0000","last_change":"2024-04-16T19:38:20.762362+0000","last_active":"2024-04-16T19:38:20.762332+0000","last_peered":"2024-04-16T19:38:20.762332+0000","last_clean":"2024-04-16T19:38:20.762332+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:38:20.762332+0000","last_undegraded":"2024-04-16T19:38:20.762332+0000","last_fullsized":"2024-04-16T19:38:20.762332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.762267+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:32.587575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'447","reported_seq":743,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.567084+0000","last_change":"2024-04-16T19:38:15.567084+0000","last_active":"2024-04-16T19:38:15.567084+0000","last_peered":"2024-04-16T19:38:15.567084+0000","last_clean":"2024-04-16T19:38:15.567084+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:38:15.567084+0000","last_undegraded":"2024-04-16T19:38:15.567084+0000","last_fullsized":"2024-04-16T19:38:15.567084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'447","last_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_deep_scrub":"53'447","last_deep_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.566947+0000","objects_scrubbed":23,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:08.446790+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7264,"num_omap_keys":33,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'38","reported_seq":544,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.770259+0000","last_change":"2024-04-16T19:38:19.770333+0000","last_active":"2024-04-16T19:38:19.770259+0000","last_peered":"2024-04-16T19:38:19.770259+0000","last_clean":"2024-04-16T19:38:19.770259+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:38:19.770259+0000","last_undegraded":"2024-04-16T19:38:19.770259+0000","last_fullsized":"2024-04-16T19:38:19.770259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'38","last_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_deep_scrub":"53'38","last_deep_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.770195+0000","objects_scrubbed":10,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:32.489397+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.117354+0000","last_change":"2024-04-16T19:38:25.117354+0000","last_active":"2024-04-16T19:38:25.117354+0000","last_peered":"2024-04-16T19:38:25.117354+0000","last_clean":"2024-04-16T19:38:25.117354+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:38:25.117354+0000","last_undegraded":"2024-04-16T19:38:25.117354+0000","last_fullsized":"2024-04-16T19:38:25.117354+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.117265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594561+0000","last_change":"2024-04-16T17:45:08.381995+0000","last_active":"2024-04-16T19:37:49.594561+0000","last_peered":"2024-04-16T19:37:49.594561+0000","last_clean":"2024-04-16T19:37:49.594561+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:37:49.594561+0000","last_undegraded":"2024-04-16T19:37:49.594561+0000","last_fullsized":"2024-04-16T19:37:49.594561+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.018075+0000","last_change":"2024-04-16T19:39:06.018098+0000","last_active":"2024-04-16T19:39:06.018075+0000","last_peered":"2024-04-16T19:39:06.018075+0000","last_clean":"2024-04-16T19:39:06.018075+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:39:06.018075+0000","last_undegraded":"2024-04-16T19:39:06.018075+0000","last_fullsized":"2024-04-16T19:39:06.018075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.018006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.018006+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.018006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:50.070115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'184","reported_seq":402,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.798158+0000","last_change":"2024-04-16T19:39:04.798203+0000","last_active":"2024-04-16T19:39:04.798158+0000","last_peered":"2024-04-16T19:39:04.798158+0000","last_clean":"2024-04-16T19:39:04.798158+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:39:04.798158+0000","last_undegraded":"2024-04-16T19:39:04.798158+0000","last_fullsized":"2024-04-16T19:39:04.798158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'184","last_scrub_stamp":"2024-04-16T19:39:04.798090+0000","last_deep_scrub":"53'184","last_deep_scrub_stamp":"2024-04-16T19:39:04.798090+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.798090+0000","objects_scrubbed":8,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:04.542146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.958099+0000","last_change":"2024-04-16T19:38:50.958122+0000","last_active":"2024-04-16T19:38:50.958099+0000","last_peered":"2024-04-16T19:38:50.958099+0000","last_clean":"2024-04-16T19:38:50.958099+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:38:50.958099+0000","last_undegraded":"2024-04-16T19:38:50.958099+0000","last_fullsized":"2024-04-16T19:38:50.958099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.958033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.958033+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.958033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:34.877987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.718631+0000","last_change":"2024-04-16T19:38:41.718655+0000","last_active":"2024-04-16T19:38:41.718631+0000","last_peered":"2024-04-16T19:38:41.718631+0000","last_clean":"2024-04-16T19:38:41.718631+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:38:41.718631+0000","last_undegraded":"2024-04-16T19:38:41.718631+0000","last_fullsized":"2024-04-16T19:38:41.718631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.718567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:36.366059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977372+0000","last_change":"2024-04-16T18:09:02.173431+0000","last_active":"2024-04-16T19:38:08.977372+0000","last_peered":"2024-04-16T19:38:08.977372+0000","last_clean":"2024-04-16T19:38:08.977372+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:38:08.977372+0000","last_undegraded":"2024-04-16T19:38:08.977372+0000","last_fullsized":"2024-04-16T19:38:08.977372+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'157","reported_seq":1997,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.449594+0000","last_change":"2024-04-16T19:38:50.449633+0000","last_active":"2024-04-16T19:38:50.449594+0000","last_peered":"2024-04-16T19:38:50.449594+0000","last_clean":"2024-04-16T19:38:50.449594+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:38:50.449594+0000","last_undegraded":"2024-04-16T19:38:50.449594+0000","last_fullsized":"2024-04-16T19:38:50.449594+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'157","last_scrub_stamp":"2024-04-16T19:38:50.449529+0000","last_deep_scrub":"53'157","last_deep_scrub_stamp":"2024-04-16T19:38:50.449529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.449529+0000","objects_scrubbed":40,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:37.452857+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11968,"num_omap_keys":48,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.747274+0000","last_change":"2024-04-16T19:38:38.747274+0000","last_active":"2024-04-16T19:38:38.747274+0000","last_peered":"2024-04-16T19:38:38.747274+0000","last_clean":"2024-04-16T19:38:38.747274+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:38:38.747274+0000","last_undegraded":"2024-04-16T19:38:38.747274+0000","last_fullsized":"2024-04-16T19:38:38.747274+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.747176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:44.763682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'30","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.513984+0000","last_change":"2024-04-16T19:38:29.514047+0000","last_active":"2024-04-16T19:38:29.513984+0000","last_peered":"2024-04-16T19:38:29.513984+0000","last_clean":"2024-04-16T19:38:29.513984+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:38:29.513984+0000","last_undegraded":"2024-04-16T19:38:29.513984+0000","last_fullsized":"2024-04-16T19:38:29.513984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'30","last_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_deep_scrub":"53'30","last_deep_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.513910+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:38.309746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.764970+0000","last_change":"2024-04-16T19:38:22.764970+0000","last_active":"2024-04-16T19:38:22.764970+0000","last_peered":"2024-04-16T19:38:22.764970+0000","last_clean":"2024-04-16T19:38:22.764970+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:38:22.764970+0000","last_undegraded":"2024-04-16T19:38:22.764970+0000","last_fullsized":"2024-04-16T19:38:22.764970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.764883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:30.765316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'305","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.819258+0000","last_change":"2024-04-16T19:38:16.819258+0000","last_active":"2024-04-16T19:38:16.819258+0000","last_peered":"2024-04-16T19:38:16.819258+0000","last_clean":"2024-04-16T19:38:16.819258+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:38:16.819258+0000","last_undegraded":"2024-04-16T19:38:16.819258+0000","last_fullsized":"2024-04-16T19:38:16.819258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'305","last_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_deep_scrub":"53'305","last_deep_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.819127+0000","objects_scrubbed":14,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:56.568944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6851,"num_omap_keys":31,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'21","reported_seq":476,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.104753+0000","last_change":"2024-04-16T19:38:18.104753+0000","last_active":"2024-04-16T19:38:18.104753+0000","last_peered":"2024-04-16T19:38:18.104753+0000","last_clean":"2024-04-16T19:38:18.104753+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:38:18.104753+0000","last_undegraded":"2024-04-16T19:38:18.104753+0000","last_fullsized":"2024-04-16T19:38:18.104753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.104621+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:22.649252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405592+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:38:04.405592+0000","last_peered":"2024-04-16T19:38:04.405592+0000","last_clean":"2024-04-16T19:38:04.405592+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:38:04.405592+0000","last_undegraded":"2024-04-16T19:38:04.405592+0000","last_fullsized":"2024-04-16T19:38:04.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":298,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428208+0000","last_change":"2024-04-16T17:44:21.164684+0000","last_active":"2024-04-16T19:38:09.428208+0000","last_peered":"2024-04-16T19:38:09.428208+0000","last_clean":"2024-04-16T19:38:09.428208+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:38:09.428208+0000","last_undegraded":"2024-04-16T19:38:09.428208+0000","last_fullsized":"2024-04-16T19:38:09.428208+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:20.155639+0000","last_clean_scrub_stamp":"2024-04-16T17:44:20.155639+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338540+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:38:10.338540+0000","last_peered":"2024-04-16T19:38:10.338540+0000","last_clean":"2024-04-16T19:38:10.338540+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:38:10.338540+0000","last_undegraded":"2024-04-16T19:38:10.338540+0000","last_fullsized":"2024-04-16T19:38:10.338540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592615+0000","last_change":"2024-04-16T17:45:08.387550+0000","last_active":"2024-04-16T19:37:39.592615+0000","last_peered":"2024-04-16T19:37:39.592615+0000","last_clean":"2024-04-16T19:37:39.592615+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:37:39.592615+0000","last_undegraded":"2024-04-16T19:37:39.592615+0000","last_fullsized":"2024-04-16T19:37:39.592615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.207941+0000","last_change":"2024-04-16T19:39:06.207962+0000","last_active":"2024-04-16T19:39:06.207941+0000","last_peered":"2024-04-16T19:39:06.207941+0000","last_clean":"2024-04-16T19:39:06.207941+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:39:06.207941+0000","last_undegraded":"2024-04-16T19:39:06.207941+0000","last_fullsized":"2024-04-16T19:39:06.207941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.207880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.207880+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.207880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:54.646044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'77","reported_seq":255,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.827843+0000","last_change":"2024-04-16T19:39:01.827876+0000","last_active":"2024-04-16T19:39:01.827843+0000","last_peered":"2024-04-16T19:39:01.827843+0000","last_clean":"2024-04-16T19:39:01.827843+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:39:01.827843+0000","last_undegraded":"2024-04-16T19:39:01.827843+0000","last_fullsized":"2024-04-16T19:39:01.827843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'77","last_scrub_stamp":"2024-04-16T19:39:01.827783+0000","last_deep_scrub":"53'77","last_deep_scrub_stamp":"2024-04-16T19:39:01.827783+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.827783+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:22.538522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.347215+0000","last_change":"2024-04-16T19:38:55.347237+0000","last_active":"2024-04-16T19:38:55.347215+0000","last_peered":"2024-04-16T19:38:55.347215+0000","last_clean":"2024-04-16T19:38:55.347215+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:38:55.347215+0000","last_undegraded":"2024-04-16T19:38:55.347215+0000","last_fullsized":"2024-04-16T19:38:55.347215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:55.347148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:55.347148+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.347148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:24.682592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795949+0000","last_change":"2024-04-16T19:38:33.795974+0000","last_active":"2024-04-16T19:38:33.795949+0000","last_peered":"2024-04-16T19:38:33.795949+0000","last_clean":"2024-04-16T19:38:33.795949+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:38:33.795949+0000","last_undegraded":"2024-04-16T19:38:33.795949+0000","last_fullsized":"2024-04-16T19:38:33.795949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:54.984835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887561+0000","last_change":"2024-04-16T18:09:02.168908+0000","last_active":"2024-04-16T19:38:09.887561+0000","last_peered":"2024-04-16T19:38:09.887561+0000","last_clean":"2024-04-16T19:38:09.887561+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:38:09.887561+0000","last_undegraded":"2024-04-16T19:38:09.887561+0000","last_fullsized":"2024-04-16T19:38:09.887561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'199","reported_seq":2085,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.357054+0000","last_change":"2024-04-16T19:39:04.357096+0000","last_active":"2024-04-16T19:39:04.357054+0000","last_peered":"2024-04-16T19:39:04.357054+0000","last_clean":"2024-04-16T19:39:04.357054+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:39:04.357054+0000","last_undegraded":"2024-04-16T19:39:04.357054+0000","last_fullsized":"2024-04-16T19:39:04.357054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'199","last_scrub_stamp":"2024-04-16T19:39:04.356992+0000","last_deep_scrub":"53'199","last_deep_scrub_stamp":"2024-04-16T19:39:04.356992+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.356992+0000","objects_scrubbed":49,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:18.001011+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12625,"num_omap_keys":53,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.785219+0000","last_change":"2024-04-16T19:39:02.785219+0000","last_active":"2024-04-16T19:39:02.785219+0000","last_peered":"2024-04-16T19:39:02.785219+0000","last_clean":"2024-04-16T19:39:02.785219+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:39:02.785219+0000","last_undegraded":"2024-04-16T19:39:02.785219+0000","last_fullsized":"2024-04-16T19:39:02.785219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.785101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.785101+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.785101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:32.120546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'7","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.346772+0000","last_change":"2024-04-16T19:38:42.346811+0000","last_active":"2024-04-16T19:38:42.346772+0000","last_peered":"2024-04-16T19:38:42.346772+0000","last_clean":"2024-04-16T19:38:42.346772+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:38:42.346772+0000","last_undegraded":"2024-04-16T19:38:42.346772+0000","last_fullsized":"2024-04-16T19:38:42.346772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.346708+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:50.944060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'652","reported_seq":2353,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.132401+0000","last_change":"2024-04-16T19:38:32.132432+0000","last_active":"2024-04-16T19:38:32.132401+0000","last_peered":"2024-04-16T19:38:32.132401+0000","last_clean":"2024-04-16T19:38:32.132401+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:38:32.132401+0000","last_undegraded":"2024-04-16T19:38:32.132401+0000","last_fullsized":"2024-04-16T19:38:32.132401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.132341+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:57.828052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'465","reported_seq":770,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.378097+0000","last_change":"2024-04-16T19:38:22.378097+0000","last_active":"2024-04-16T19:38:22.378097+0000","last_peered":"2024-04-16T19:38:22.378097+0000","last_clean":"2024-04-16T19:38:22.378097+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:38:22.378097+0000","last_undegraded":"2024-04-16T19:38:22.378097+0000","last_fullsized":"2024-04-16T19:38:22.378097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'465","last_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_deep_scrub":"53'465","last_deep_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.378008+0000","objects_scrubbed":26,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:24.892034+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'22","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.329830+0000","last_change":"2024-04-16T19:38:21.329929+0000","last_active":"2024-04-16T19:38:21.329830+0000","last_peered":"2024-04-16T19:38:21.329830+0000","last_clean":"2024-04-16T19:38:21.329830+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:38:21.329830+0000","last_undegraded":"2024-04-16T19:38:21.329830+0000","last_fullsized":"2024-04-16T19:38:21.329830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.329754+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:26.751591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407098+0000","last_change":"2024-04-16T17:45:10.396755+0000","last_active":"2024-04-16T19:37:54.407098+0000","last_peered":"2024-04-16T19:37:54.407098+0000","last_clean":"2024-04-16T19:37:54.407098+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:37:54.407098+0000","last_undegraded":"2024-04-16T19:37:54.407098+0000","last_fullsized":"2024-04-16T19:37:54.407098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428220+0000","last_change":"2024-04-16T17:44:22.168316+0000","last_active":"2024-04-16T19:38:09.428220+0000","last_peered":"2024-04-16T19:38:09.428220+0000","last_clean":"2024-04-16T19:38:09.428220+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:38:09.428220+0000","last_undegraded":"2024-04-16T19:38:09.428220+0000","last_fullsized":"2024-04-16T19:38:09.428220+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.720009+0000","last_change":"2024-04-16T19:38:29.720009+0000","last_active":"2024-04-16T19:38:29.720009+0000","last_peered":"2024-04-16T19:38:29.720009+0000","last_clean":"2024-04-16T19:38:29.720009+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:38:29.720009+0000","last_undegraded":"2024-04-16T19:38:29.720009+0000","last_fullsized":"2024-04-16T19:38:29.720009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.719912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:00.040596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"53'16","reported_seq":594,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.755505+0000","last_change":"2024-04-16T19:39:07.755557+0000","last_active":"2024-04-16T19:39:07.755505+0000","last_peered":"2024-04-16T19:39:07.755505+0000","last_clean":"2024-04-16T19:39:07.755505+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:39:07.755505+0000","last_undegraded":"2024-04-16T19:39:07.755505+0000","last_fullsized":"2024-04-16T19:39:07.755505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:39:07.755429+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:39:07.755429+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.755429+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:51.807538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'187","reported_seq":1686,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.796149+0000","last_change":"2024-04-16T19:38:59.796192+0000","last_active":"2024-04-16T19:38:59.796149+0000","last_peered":"2024-04-16T19:38:59.796149+0000","last_clean":"2024-04-16T19:38:59.796149+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:38:59.796149+0000","last_undegraded":"2024-04-16T19:38:59.796149+0000","last_fullsized":"2024-04-16T19:38:59.796149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'187","last_scrub_stamp":"2024-04-16T19:38:59.796087+0000","last_deep_scrub":"53'187","last_deep_scrub_stamp":"2024-04-16T19:38:59.796087+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.796087+0000","objects_scrubbed":10,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:02:23.701420+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.405296+0000","last_change":"2024-04-16T19:38:51.405321+0000","last_active":"2024-04-16T19:38:51.405296+0000","last_peered":"2024-04-16T19:38:51.405296+0000","last_clean":"2024-04-16T19:38:51.405296+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:38:51.405296+0000","last_undegraded":"2024-04-16T19:38:51.405296+0000","last_fullsized":"2024-04-16T19:38:51.405296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:51.405235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:51.405235+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.405235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:58.035377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.744953+0000","last_change":"2024-04-16T19:38:25.744976+0000","last_active":"2024-04-16T19:38:25.744953+0000","last_peered":"2024-04-16T19:38:25.744953+0000","last_clean":"2024-04-16T19:38:25.744953+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:38:25.744953+0000","last_undegraded":"2024-04-16T19:38:25.744953+0000","last_fullsized":"2024-04-16T19:38:25.744953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.744882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:25.114426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340407+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:38:10.340407+0000","last_peered":"2024-04-16T19:38:10.340407+0000","last_clean":"2024-04-16T19:38:10.340407+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:38:10.340407+0000","last_undegraded":"2024-04-16T19:38:10.340407+0000","last_fullsized":"2024-04-16T19:38:10.340407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'137","reported_seq":1601,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340436+0000","last_change":"2024-04-16T17:46:25.524587+0000","last_active":"2024-04-16T19:38:10.340436+0000","last_peered":"2024-04-16T19:38:10.340436+0000","last_clean":"2024-04-16T19:38:10.340436+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:38:10.340436+0000","last_undegraded":"2024-04-16T19:38:10.340436+0000","last_fullsized":"2024-04-16T19:38:10.340436+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.774336+0000","last_change":"2024-04-16T19:38:58.774358+0000","last_active":"2024-04-16T19:38:58.774336+0000","last_peered":"2024-04-16T19:38:58.774336+0000","last_clean":"2024-04-16T19:38:58.774336+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:38:58.774336+0000","last_undegraded":"2024-04-16T19:38:58.774336+0000","last_fullsized":"2024-04-16T19:38:58.774336+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:58.774273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:58.774273+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.774273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:17:34.946023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'28","reported_seq":206,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.914339+0000","last_change":"2024-04-16T19:38:41.914339+0000","last_active":"2024-04-16T19:38:41.914339+0000","last_peered":"2024-04-16T19:38:41.914339+0000","last_clean":"2024-04-16T19:38:41.914339+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:38:41.914339+0000","last_undegraded":"2024-04-16T19:38:41.914339+0000","last_fullsized":"2024-04-16T19:38:41.914339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'28","last_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_deep_scrub":"53'28","last_deep_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.914241+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:38.893326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":60,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.138191+0000","last_change":"2024-04-16T19:38:31.138209+0000","last_active":"2024-04-16T19:38:31.138191+0000","last_peered":"2024-04-16T19:38:31.138191+0000","last_clean":"2024-04-16T19:38:31.138191+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:38:31.138191+0000","last_undegraded":"2024-04-16T19:38:31.138191+0000","last_fullsized":"2024-04-16T19:38:31.138191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.138139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:01.713966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4956","reported_seq":7445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.900157+0000","last_change":"2024-04-16T19:38:14.900157+0000","last_active":"2024-04-16T19:38:14.900157+0000","last_peered":"2024-04-16T19:38:14.900157+0000","last_clean":"2024-04-16T19:38:14.900157+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:38:14.900157+0000","last_undegraded":"2024-04-16T19:38:14.900157+0000","last_fullsized":"2024-04-16T19:38:14.900157+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4956","last_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_deep_scrub":"53'4956","last_deep_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.900021+0000","objects_scrubbed":21,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:17.433386+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'10","reported_seq":272,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.858857+0000","last_change":"2024-04-16T19:38:11.858857+0000","last_active":"2024-04-16T19:38:11.858857+0000","last_peered":"2024-04-16T19:38:11.858857+0000","last_clean":"2024-04-16T19:38:11.858857+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:38:11.858857+0000","last_undegraded":"2024-04-16T19:38:11.858857+0000","last_fullsized":"2024-04-16T19:38:11.858857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.858749+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:25:54.104521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.730779+0000","last_change":"2024-04-16T19:39:04.730826+0000","last_active":"2024-04-16T19:39:04.730779+0000","last_peered":"2024-04-16T19:39:04.730779+0000","last_clean":"2024-04-16T19:39:04.730779+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:39:04.730779+0000","last_undegraded":"2024-04-16T19:39:04.730779+0000","last_fullsized":"2024-04-16T19:39:04.730779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.730692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.730692+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.730692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:56.328928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976162+0000","last_change":"2024-04-16T17:44:22.168348+0000","last_active":"2024-04-16T19:38:08.976162+0000","last_peered":"2024-04-16T19:38:08.976162+0000","last_clean":"2024-04-16T19:38:08.976162+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:38:08.976162+0000","last_undegraded":"2024-04-16T19:38:08.976162+0000","last_fullsized":"2024-04-16T19:38:08.976162+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589471+0000","last_change":"2024-04-16T17:45:08.382479+0000","last_active":"2024-04-16T19:37:24.589471+0000","last_peered":"2024-04-16T19:37:24.589471+0000","last_clean":"2024-04-16T19:37:24.589471+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:37:24.589471+0000","last_undegraded":"2024-04-16T19:37:24.589471+0000","last_fullsized":"2024-04-16T19:37:24.589471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"53'4","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.087742+0000","last_change":"2024-04-16T19:39:07.087798+0000","last_active":"2024-04-16T19:39:07.087742+0000","last_peered":"2024-04-16T19:39:07.087742+0000","last_clean":"2024-04-16T19:39:07.087742+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:39:07.087742+0000","last_undegraded":"2024-04-16T19:39:07.087742+0000","last_fullsized":"2024-04-16T19:39:07.087742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:07.087664+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:07.087664+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.087664+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:46.209570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'159","reported_seq":1628,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.803218+0000","last_change":"2024-04-16T19:38:59.803257+0000","last_active":"2024-04-16T19:38:59.803218+0000","last_peered":"2024-04-16T19:38:59.803218+0000","last_clean":"2024-04-16T19:38:59.803218+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:38:59.803218+0000","last_undegraded":"2024-04-16T19:38:59.803218+0000","last_fullsized":"2024-04-16T19:38:59.803218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:38:59.803156+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:38:59.803156+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.803156+0000","objects_scrubbed":8,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:11.871497+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.325392+0000","last_change":"2024-04-16T19:38:35.325421+0000","last_active":"2024-04-16T19:38:35.325392+0000","last_peered":"2024-04-16T19:38:35.325392+0000","last_clean":"2024-04-16T19:38:35.325392+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:38:35.325392+0000","last_undegraded":"2024-04-16T19:38:35.325392+0000","last_fullsized":"2024-04-16T19:38:35.325392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.325323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:35.441680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.320446+0000","last_change":"2024-04-16T19:38:27.320467+0000","last_active":"2024-04-16T19:38:27.320446+0000","last_peered":"2024-04-16T19:38:27.320446+0000","last_clean":"2024-04-16T19:38:27.320446+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:38:27.320446+0000","last_undegraded":"2024-04-16T19:38:27.320446+0000","last_fullsized":"2024-04-16T19:38:27.320446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.320384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:47.178868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":56,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396760+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:37:04.396760+0000","last_peered":"2024-04-16T19:37:04.396760+0000","last_clean":"2024-04-16T19:37:04.396760+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:37:04.396760+0000","last_undegraded":"2024-04-16T19:37:04.396760+0000","last_fullsized":"2024-04-16T19:37:04.396760+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'189","reported_seq":2092,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.387157+0000","last_change":"2024-04-16T19:38:46.387157+0000","last_active":"2024-04-16T19:38:46.387157+0000","last_peered":"2024-04-16T19:38:46.387157+0000","last_clean":"2024-04-16T19:38:46.387157+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:38:46.387157+0000","last_undegraded":"2024-04-16T19:38:46.387157+0000","last_fullsized":"2024-04-16T19:38:46.387157+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'189","last_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_deep_scrub":"53'189","last_deep_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.387038+0000","objects_scrubbed":54,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:22.550486+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12153,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.474066+0000","last_change":"2024-04-16T19:38:30.474066+0000","last_active":"2024-04-16T19:38:30.474066+0000","last_peered":"2024-04-16T19:38:30.474066+0000","last_clean":"2024-04-16T19:38:30.474066+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:38:30.474066+0000","last_undegraded":"2024-04-16T19:38:30.474066+0000","last_fullsized":"2024-04-16T19:38:30.474066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.473977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:10.223794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"53'4","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.365553+0000","last_change":"2024-04-16T19:38:41.365583+0000","last_active":"2024-04-16T19:38:41.365553+0000","last_peered":"2024-04-16T19:38:41.365553+0000","last_clean":"2024-04-16T19:38:41.365553+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:38:41.365553+0000","last_undegraded":"2024-04-16T19:38:41.365553+0000","last_fullsized":"2024-04-16T19:38:41.365553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.365486+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:10.903056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.088262+0000","last_change":"2024-04-16T19:38:21.088285+0000","last_active":"2024-04-16T19:38:21.088262+0000","last_peered":"2024-04-16T19:38:21.088262+0000","last_clean":"2024-04-16T19:38:21.088262+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:38:21.088262+0000","last_undegraded":"2024-04-16T19:38:21.088262+0000","last_fullsized":"2024-04-16T19:38:21.088262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.088193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:58.302179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'503","reported_seq":981,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.479844+0000","last_change":"2024-04-16T19:38:11.479844+0000","last_active":"2024-04-16T19:38:11.479844+0000","last_peered":"2024-04-16T19:38:11.479844+0000","last_clean":"2024-04-16T19:38:11.479844+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:38:11.479844+0000","last_undegraded":"2024-04-16T19:38:11.479844+0000","last_fullsized":"2024-04-16T19:38:11.479844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'503","last_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_deep_scrub":"53'503","last_deep_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.479730+0000","objects_scrubbed":31,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:50.543348+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7030,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'12","reported_seq":434,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.241107+0000","last_change":"2024-04-16T19:38:17.241107+0000","last_active":"2024-04-16T19:38:17.241107+0000","last_peered":"2024-04-16T19:38:17.241107+0000","last_clean":"2024-04-16T19:38:17.241107+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:38:17.241107+0000","last_undegraded":"2024-04-16T19:38:17.241107+0000","last_fullsized":"2024-04-16T19:38:17.241107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.241004+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:31.290983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.750173+0000","last_change":"2024-04-16T19:39:05.750194+0000","last_active":"2024-04-16T19:39:05.750173+0000","last_peered":"2024-04-16T19:39:05.750173+0000","last_clean":"2024-04-16T19:39:05.750173+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:39:05.750173+0000","last_undegraded":"2024-04-16T19:39:05.750173+0000","last_fullsized":"2024-04-16T19:39:05.750173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:05.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:05.750095+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:53:07.126866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338508+0000","last_change":"2024-04-16T17:44:22.167836+0000","last_active":"2024-04-16T19:38:10.338508+0000","last_peered":"2024-04-16T19:38:10.338508+0000","last_clean":"2024-04-16T19:38:10.338508+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:38:10.338508+0000","last_undegraded":"2024-04-16T19:38:10.338508+0000","last_fullsized":"2024-04-16T19:38:10.338508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400666+0000","last_change":"2024-04-16T17:45:08.382355+0000","last_active":"2024-04-16T19:37:39.400666+0000","last_peered":"2024-04-16T19:37:39.400666+0000","last_clean":"2024-04-16T19:37:39.400666+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:37:39.400666+0000","last_undegraded":"2024-04-16T19:37:39.400666+0000","last_fullsized":"2024-04-16T19:37:39.400666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":878,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068968+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:38:08.068968+0000","last_peered":"2024-04-16T19:38:08.068968+0000","last_clean":"2024-04-16T19:38:08.068968+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:38:08.068968+0000","last_undegraded":"2024-04-16T19:38:08.068968+0000","last_fullsized":"2024-04-16T19:38:08.068968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'150","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.723402+0000","last_change":"2024-04-16T19:38:56.723441+0000","last_active":"2024-04-16T19:38:56.723402+0000","last_peered":"2024-04-16T19:38:56.723402+0000","last_clean":"2024-04-16T19:38:56.723402+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:38:56.723402+0000","last_undegraded":"2024-04-16T19:38:56.723402+0000","last_fullsized":"2024-04-16T19:38:56.723402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'150","last_scrub_stamp":"2024-04-16T19:38:56.723332+0000","last_deep_scrub":"53'150","last_deep_scrub_stamp":"2024-04-16T19:38:56.723332+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.723332+0000","objects_scrubbed":6,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:51.229039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.898210+0000","last_change":"2024-04-16T19:38:35.898255+0000","last_active":"2024-04-16T19:38:35.898210+0000","last_peered":"2024-04-16T19:38:35.898210+0000","last_clean":"2024-04-16T19:38:35.898210+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:38:35.898210+0000","last_undegraded":"2024-04-16T19:38:35.898210+0000","last_fullsized":"2024-04-16T19:38:35.898210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.898130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:42.528272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.791834+0000","last_change":"2024-04-16T19:38:39.791854+0000","last_active":"2024-04-16T19:38:39.791834+0000","last_peered":"2024-04-16T19:38:39.791834+0000","last_clean":"2024-04-16T19:38:39.791834+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:38:39.791834+0000","last_undegraded":"2024-04-16T19:38:39.791834+0000","last_fullsized":"2024-04-16T19:38:39.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.791771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:45.969208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403444+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:37:54.403444+0000","last_peered":"2024-04-16T19:37:54.403444+0000","last_clean":"2024-04-16T19:37:54.403444+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:37:54.403444+0000","last_undegraded":"2024-04-16T19:37:54.403444+0000","last_fullsized":"2024-04-16T19:37:54.403444+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1712,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402501+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:37:49.402501+0000","last_peered":"2024-04-16T19:37:49.402501+0000","last_clean":"2024-04-16T19:37:49.402501+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:37:49.402501+0000","last_undegraded":"2024-04-16T19:37:49.402501+0000","last_fullsized":"2024-04-16T19:37:49.402501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.839203+0000","last_change":"2024-04-16T19:38:39.839203+0000","last_active":"2024-04-16T19:38:39.839203+0000","last_peered":"2024-04-16T19:38:39.839203+0000","last_clean":"2024-04-16T19:38:39.839203+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:38:39.839203+0000","last_undegraded":"2024-04-16T19:38:39.839203+0000","last_fullsized":"2024-04-16T19:38:39.839203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.839112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:23.811211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'14","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.080454+0000","last_change":"2024-04-16T19:38:28.080454+0000","last_active":"2024-04-16T19:38:28.080454+0000","last_peered":"2024-04-16T19:38:28.080454+0000","last_clean":"2024-04-16T19:38:28.080454+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:38:28.080454+0000","last_undegraded":"2024-04-16T19:38:28.080454+0000","last_fullsized":"2024-04-16T19:38:28.080454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.080349+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:30.384618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'652","reported_seq":2241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.085883+0000","last_change":"2024-04-16T19:38:17.085883+0000","last_active":"2024-04-16T19:38:17.085883+0000","last_peered":"2024-04-16T19:38:17.085883+0000","last_clean":"2024-04-16T19:38:17.085883+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:38:17.085883+0000","last_undegraded":"2024-04-16T19:38:17.085883+0000","last_fullsized":"2024-04-16T19:38:17.085883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.085744+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:55.082690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'364","reported_seq":672,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.518366+0000","last_change":"2024-04-16T19:38:17.518366+0000","last_active":"2024-04-16T19:38:17.518366+0000","last_peered":"2024-04-16T19:38:17.518366+0000","last_clean":"2024-04-16T19:38:17.518366+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:38:17.518366+0000","last_undegraded":"2024-04-16T19:38:17.518366+0000","last_fullsized":"2024-04-16T19:38:17.518366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'364","last_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_deep_scrub":"53'364","last_deep_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.518227+0000","objects_scrubbed":20,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:39.484987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6810,"num_omap_keys":31,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'21","reported_seq":470,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.711099+0000","last_change":"2024-04-16T19:38:25.711099+0000","last_active":"2024-04-16T19:38:25.711099+0000","last_peered":"2024-04-16T19:38:25.711099+0000","last_clean":"2024-04-16T19:38:25.711099+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:38:25.711099+0000","last_undegraded":"2024-04-16T19:38:25.711099+0000","last_fullsized":"2024-04-16T19:38:25.711099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.710924+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:00.685204+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.759393+0000","last_change":"2024-04-16T19:39:00.759418+0000","last_active":"2024-04-16T19:39:00.759393+0000","last_peered":"2024-04-16T19:39:00.759393+0000","last_clean":"2024-04-16T19:39:00.759393+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:39:00.759393+0000","last_undegraded":"2024-04-16T19:39:00.759393+0000","last_fullsized":"2024-04-16T19:39:00.759393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.759325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.759325+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.759325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:46:22.814258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404465+0000","last_change":"2024-04-16T17:45:08.386614+0000","last_active":"2024-04-16T19:37:59.404465+0000","last_peered":"2024-04-16T19:37:59.404465+0000","last_clean":"2024-04-16T19:37:59.404465+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:37:59.404465+0000","last_undegraded":"2024-04-16T19:37:59.404465+0000","last_fullsized":"2024-04-16T19:37:59.404465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.523257+0000","last_change":"2024-04-16T17:44:22.327423+0000","last_active":"2024-04-16T19:38:08.523257+0000","last_peered":"2024-04-16T19:38:08.523257+0000","last_clean":"2024-04-16T19:38:08.523257+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:38:08.523257+0000","last_undegraded":"2024-04-16T19:38:08.523257+0000","last_fullsized":"2024-04-16T19:38:08.523257+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.376273+0000","last_change":"2024-04-16T19:39:06.376296+0000","last_active":"2024-04-16T19:39:06.376273+0000","last_peered":"2024-04-16T19:39:06.376273+0000","last_clean":"2024-04-16T19:39:06.376273+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:39:06.376273+0000","last_undegraded":"2024-04-16T19:39:06.376273+0000","last_fullsized":"2024-04-16T19:39:06.376273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.376208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.376208+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.376208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:12.585831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'168","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.365486+0000","last_change":"2024-04-16T19:39:01.365523+0000","last_active":"2024-04-16T19:39:01.365486+0000","last_peered":"2024-04-16T19:39:01.365486+0000","last_clean":"2024-04-16T19:39:01.365486+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:39:01.365486+0000","last_undegraded":"2024-04-16T19:39:01.365486+0000","last_fullsized":"2024-04-16T19:39:01.365486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'168","last_scrub_stamp":"2024-04-16T19:39:01.365421+0000","last_deep_scrub":"53'168","last_deep_scrub_stamp":"2024-04-16T19:39:01.365421+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.365421+0000","objects_scrubbed":8,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:41.145407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.382963+0000","last_change":"2024-04-16T19:38:47.382987+0000","last_active":"2024-04-16T19:38:47.382963+0000","last_peered":"2024-04-16T19:38:47.382963+0000","last_clean":"2024-04-16T19:38:47.382963+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:38:47.382963+0000","last_undegraded":"2024-04-16T19:38:47.382963+0000","last_fullsized":"2024-04-16T19:38:47.382963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.382901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:43.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.343354+0000","last_change":"2024-04-16T19:38:23.343376+0000","last_active":"2024-04-16T19:38:23.343354+0000","last_peered":"2024-04-16T19:38:23.343354+0000","last_clean":"2024-04-16T19:38:23.343354+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:38:23.343354+0000","last_undegraded":"2024-04-16T19:38:23.343354+0000","last_fullsized":"2024-04-16T19:38:23.343354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.343292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:42.020915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595633+0000","last_change":"2024-04-16T18:09:02.175274+0000","last_active":"2024-04-16T19:37:54.595633+0000","last_peered":"2024-04-16T19:37:54.595633+0000","last_clean":"2024-04-16T19:37:54.595633+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:37:54.595633+0000","last_undegraded":"2024-04-16T19:37:54.595633+0000","last_fullsized":"2024-04-16T19:37:54.595633+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1691,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340349+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:38:10.340349+0000","last_peered":"2024-04-16T19:38:10.340349+0000","last_clean":"2024-04-16T19:38:10.340349+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:38:10.340349+0000","last_undegraded":"2024-04-16T19:38:10.340349+0000","last_fullsized":"2024-04-16T19:38:10.340349+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":92,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.109433+0000","last_change":"2024-04-16T19:38:29.109454+0000","last_active":"2024-04-16T19:38:29.109433+0000","last_peered":"2024-04-16T19:38:29.109433+0000","last_clean":"2024-04-16T19:38:29.109433+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:38:29.109433+0000","last_undegraded":"2024-04-16T19:38:29.109433+0000","last_fullsized":"2024-04-16T19:38:29.109433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.109370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:03.453529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"53'12","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.361852+0000","last_change":"2024-04-16T19:38:49.361907+0000","last_active":"2024-04-16T19:38:49.361852+0000","last_peered":"2024-04-16T19:38:49.361852+0000","last_clean":"2024-04-16T19:38:49.361852+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:38:49.361852+0000","last_undegraded":"2024-04-16T19:38:49.361852+0000","last_fullsized":"2024-04-16T19:38:49.361852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.361782+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:51.952616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.723050+0000","last_change":"2024-04-16T19:38:26.723073+0000","last_active":"2024-04-16T19:38:26.723050+0000","last_peered":"2024-04-16T19:38:26.723050+0000","last_clean":"2024-04-16T19:38:26.723050+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:38:26.723050+0000","last_undegraded":"2024-04-16T19:38:26.723050+0000","last_fullsized":"2024-04-16T19:38:26.723050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.722978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:34.382609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'523","reported_seq":865,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.541783+0000","last_change":"2024-04-16T19:38:13.541783+0000","last_active":"2024-04-16T19:38:13.541783+0000","last_peered":"2024-04-16T19:38:13.541783+0000","last_clean":"2024-04-16T19:38:13.541783+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:38:13.541783+0000","last_undegraded":"2024-04-16T19:38:13.541783+0000","last_fullsized":"2024-04-16T19:38:13.541783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'523","last_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_deep_scrub":"53'523","last_deep_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.541660+0000","objects_scrubbed":23,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:50.755647+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21532,"num_omap_keys":98,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'34","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.893657+0000","last_change":"2024-04-16T19:38:23.893744+0000","last_active":"2024-04-16T19:38:23.893657+0000","last_peered":"2024-04-16T19:38:23.893657+0000","last_clean":"2024-04-16T19:38:23.893657+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:38:23.893657+0000","last_undegraded":"2024-04-16T19:38:23.893657+0000","last_fullsized":"2024-04-16T19:38:23.893657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.893579+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:25.142771+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405174+0000","last_change":"2024-04-16T17:45:10.392387+0000","last_active":"2024-04-16T19:37:44.405174+0000","last_peered":"2024-04-16T19:37:44.405174+0000","last_clean":"2024-04-16T19:37:44.405174+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:37:44.405174+0000","last_undegraded":"2024-04-16T19:37:44.405174+0000","last_fullsized":"2024-04-16T19:37:44.405174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592730+0000","last_change":"2024-04-16T17:45:08.383729+0000","last_active":"2024-04-16T19:37:39.592730+0000","last_peered":"2024-04-16T19:37:39.592730+0000","last_clean":"2024-04-16T19:37:39.592730+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:37:39.592730+0000","last_undegraded":"2024-04-16T19:37:39.592730+0000","last_fullsized":"2024-04-16T19:37:39.592730+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.398214+0000","last_change":"2024-04-16T17:44:22.327323+0000","last_active":"2024-04-16T19:37:14.398214+0000","last_peered":"2024-04-16T19:37:14.398214+0000","last_clean":"2024-04-16T19:37:14.398214+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:37:14.398214+0000","last_undegraded":"2024-04-16T19:37:14.398214+0000","last_fullsized":"2024-04-16T19:37:14.398214+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.743243+0000","last_change":"2024-04-16T19:39:08.743266+0000","last_active":"2024-04-16T19:39:08.743243+0000","last_peered":"2024-04-16T19:39:08.743243+0000","last_clean":"2024-04-16T19:39:08.743243+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:39:08.743243+0000","last_undegraded":"2024-04-16T19:39:08.743243+0000","last_fullsized":"2024-04-16T19:39:08.743243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.743182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.743182+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.743182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:48.523168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'175","reported_seq":388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.650250+0000","last_change":"2024-04-16T19:38:53.650288+0000","last_active":"2024-04-16T19:38:53.650250+0000","last_peered":"2024-04-16T19:38:53.650250+0000","last_clean":"2024-04-16T19:38:53.650250+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:38:53.650250+0000","last_undegraded":"2024-04-16T19:38:53.650250+0000","last_fullsized":"2024-04-16T19:38:53.650250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'175","last_scrub_stamp":"2024-04-16T19:38:53.650187+0000","last_deep_scrub":"53'175","last_deep_scrub_stamp":"2024-04-16T19:38:53.650187+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.650187+0000","objects_scrubbed":7,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:21:28.540265+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'13","reported_seq":1407,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.755116+0000","last_change":"2024-04-16T19:38:56.755146+0000","last_active":"2024-04-16T19:38:56.755116+0000","last_peered":"2024-04-16T19:38:56.755116+0000","last_clean":"2024-04-16T19:38:56.755116+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:38:56.755116+0000","last_undegraded":"2024-04-16T19:38:56.755116+0000","last_fullsized":"2024-04-16T19:38:56.755116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:56.755051+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:56.755051+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.755051+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:59.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.367924+0000","last_change":"2024-04-16T19:38:25.367947+0000","last_active":"2024-04-16T19:38:25.367924+0000","last_peered":"2024-04-16T19:38:25.367924+0000","last_clean":"2024-04-16T19:38:25.367924+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:38:25.367924+0000","last_undegraded":"2024-04-16T19:38:25.367924+0000","last_fullsized":"2024-04-16T19:38:25.367924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.367850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:46.556801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.977390+0000","last_change":"2024-04-16T18:09:02.167725+0000","last_active":"2024-04-16T19:38:08.977390+0000","last_peered":"2024-04-16T19:38:08.977390+0000","last_clean":"2024-04-16T19:38:08.977390+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:38:08.977390+0000","last_undegraded":"2024-04-16T19:38:08.977390+0000","last_fullsized":"2024-04-16T19:38:08.977390+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1837,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:19.398902+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:37:19.398902+0000","last_peered":"2024-04-16T19:37:19.398902+0000","last_clean":"2024-04-16T19:37:19.398902+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:37:19.398902+0000","last_undegraded":"2024-04-16T19:37:19.398902+0000","last_fullsized":"2024-04-16T19:37:19.398902+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.830396+0000","last_change":"2024-04-16T19:38:46.830396+0000","last_active":"2024-04-16T19:38:46.830396+0000","last_peered":"2024-04-16T19:38:46.830396+0000","last_clean":"2024-04-16T19:38:46.830396+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:38:46.830396+0000","last_undegraded":"2024-04-16T19:38:46.830396+0000","last_fullsized":"2024-04-16T19:38:46.830396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.830276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:07.300381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'2","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.108567+0000","last_change":"2024-04-16T19:38:27.108567+0000","last_active":"2024-04-16T19:38:27.108567+0000","last_peered":"2024-04-16T19:38:27.108567+0000","last_clean":"2024-04-16T19:38:27.108567+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:38:27.108567+0000","last_undegraded":"2024-04-16T19:38:27.108567+0000","last_fullsized":"2024-04-16T19:38:27.108567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.108478+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:30.717209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.851943+0000","last_change":"2024-04-16T19:38:36.851943+0000","last_active":"2024-04-16T19:38:36.851943+0000","last_peered":"2024-04-16T19:38:36.851943+0000","last_clean":"2024-04-16T19:38:36.851943+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:38:36.851943+0000","last_undegraded":"2024-04-16T19:38:36.851943+0000","last_fullsized":"2024-04-16T19:38:36.851943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.851855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:41.780120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'341","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.445822+0000","last_change":"2024-04-16T19:38:10.445822+0000","last_active":"2024-04-16T19:38:10.445822+0000","last_peered":"2024-04-16T19:38:10.445822+0000","last_clean":"2024-04-16T19:38:10.445822+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:38:10.445822+0000","last_undegraded":"2024-04-16T19:38:10.445822+0000","last_fullsized":"2024-04-16T19:38:10.445822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'341","last_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_deep_scrub":"53'341","last_deep_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.445700+0000","objects_scrubbed":19,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:14.990331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20855,"num_omap_keys":95,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'34","reported_seq":599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.847777+0000","last_change":"2024-04-16T19:38:10.847777+0000","last_active":"2024-04-16T19:38:10.847777+0000","last_peered":"2024-04-16T19:38:10.847777+0000","last_clean":"2024-04-16T19:38:10.847777+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:38:10.847777+0000","last_undegraded":"2024-04-16T19:38:10.847777+0000","last_fullsized":"2024-04-16T19:38:10.847777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.847654+0000","objects_scrubbed":14,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:29.793118+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403394+0000","last_change":"2024-04-16T17:45:10.400196+0000","last_active":"2024-04-16T19:37:34.403394+0000","last_peered":"2024-04-16T19:37:34.403394+0000","last_clean":"2024-04-16T19:37:34.403394+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:37:34.403394+0000","last_undegraded":"2024-04-16T19:37:34.403394+0000","last_fullsized":"2024-04-16T19:37:34.403394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594796+0000","last_change":"2024-04-16T17:45:08.382982+0000","last_active":"2024-04-16T19:37:49.594796+0000","last_peered":"2024-04-16T19:37:49.594796+0000","last_clean":"2024-04-16T19:37:49.594796+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:37:49.594796+0000","last_undegraded":"2024-04-16T19:37:49.594796+0000","last_fullsized":"2024-04-16T19:37:49.594796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.585551+0000","last_change":"2024-04-16T17:44:22.167947+0000","last_active":"2024-04-16T19:37:04.585551+0000","last_peered":"2024-04-16T19:37:04.585551+0000","last_clean":"2024-04-16T19:37:04.585551+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:37:04.585551+0000","last_undegraded":"2024-04-16T19:37:04.585551+0000","last_fullsized":"2024-04-16T19:37:04.585551+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"53'6","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.018976+0000","last_change":"2024-04-16T19:39:03.019027+0000","last_active":"2024-04-16T19:39:03.018976+0000","last_peered":"2024-04-16T19:39:03.018976+0000","last_clean":"2024-04-16T19:39:03.018976+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:39:03.018976+0000","last_undegraded":"2024-04-16T19:39:03.018976+0000","last_fullsized":"2024-04-16T19:39:03.018976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:39:03.018892+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:39:03.018892+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.018892+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:02.762949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'125","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.048739+0000","last_change":"2024-04-16T19:38:59.048768+0000","last_active":"2024-04-16T19:38:59.048739+0000","last_peered":"2024-04-16T19:38:59.048739+0000","last_clean":"2024-04-16T19:38:59.048739+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:38:59.048739+0000","last_undegraded":"2024-04-16T19:38:59.048739+0000","last_fullsized":"2024-04-16T19:38:59.048739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:59.048680+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:59.048680+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.048680+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:35.315508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'13","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.344477+0000","last_change":"2024-04-16T19:38:53.344506+0000","last_active":"2024-04-16T19:38:53.344477+0000","last_peered":"2024-04-16T19:38:53.344477+0000","last_clean":"2024-04-16T19:38:53.344477+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:38:53.344477+0000","last_undegraded":"2024-04-16T19:38:53.344477+0000","last_fullsized":"2024-04-16T19:38:53.344477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:53.344411+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:53.344411+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.344411+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:29.611239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.320279+0000","last_change":"2024-04-16T19:38:26.320303+0000","last_active":"2024-04-16T19:38:26.320279+0000","last_peered":"2024-04-16T19:38:26.320279+0000","last_clean":"2024-04-16T19:38:26.320279+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:38:26.320279+0000","last_undegraded":"2024-04-16T19:38:26.320279+0000","last_fullsized":"2024-04-16T19:38:26.320279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.320216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:10.143275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.025268+0000","last_change":"2024-04-16T19:38:53.025289+0000","last_active":"2024-04-16T19:38:53.025268+0000","last_peered":"2024-04-16T19:38:53.025268+0000","last_clean":"2024-04-16T19:38:53.025268+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:38:53.025268+0000","last_undegraded":"2024-04-16T19:38:53.025268+0000","last_fullsized":"2024-04-16T19:38:53.025268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.025203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.025203+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.025203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:14.844610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2090,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069971+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:38:08.069971+0000","last_peered":"2024-04-16T19:38:08.069971+0000","last_clean":"2024-04-16T19:38:08.069971+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:38:08.069971+0000","last_undegraded":"2024-04-16T19:38:08.069971+0000","last_fullsized":"2024-04-16T19:38:08.069971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.205293+0000","last_change":"2024-04-16T19:38:37.205293+0000","last_active":"2024-04-16T19:38:37.205293+0000","last_peered":"2024-04-16T19:38:37.205293+0000","last_clean":"2024-04-16T19:38:37.205293+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:38:37.205293+0000","last_undegraded":"2024-04-16T19:38:37.205293+0000","last_fullsized":"2024-04-16T19:38:37.205293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.205209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:23.238881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'7","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.132412+0000","last_change":"2024-04-16T19:38:26.132412+0000","last_active":"2024-04-16T19:38:26.132412+0000","last_peered":"2024-04-16T19:38:26.132412+0000","last_clean":"2024-04-16T19:38:26.132412+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:38:26.132412+0000","last_undegraded":"2024-04-16T19:38:26.132412+0000","last_fullsized":"2024-04-16T19:38:26.132412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.132277+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:26.528982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'652","reported_seq":2213,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.537534+0000","last_change":"2024-04-16T19:38:14.537534+0000","last_active":"2024-04-16T19:38:14.537534+0000","last_peered":"2024-04-16T19:38:14.537534+0000","last_clean":"2024-04-16T19:38:14.537534+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:38:14.537534+0000","last_undegraded":"2024-04-16T19:38:14.537534+0000","last_fullsized":"2024-04-16T19:38:14.537534+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.537442+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:05.967541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5554","reported_seq":10355,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.938437+0000","last_change":"2024-04-16T19:38:16.938437+0000","last_active":"2024-04-16T19:38:16.938437+0000","last_peered":"2024-04-16T19:38:16.938437+0000","last_clean":"2024-04-16T19:38:16.938437+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:38:16.938437+0000","last_undegraded":"2024-04-16T19:38:16.938437+0000","last_fullsized":"2024-04-16T19:38:16.938437+0000","mapping_epoch":33,"log_start":"53'3800","ondisk_log_start":"53'3800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5554","last_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_deep_scrub":"53'5554","last_deep_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.938343+0000","objects_scrubbed":27,"log_size":1754,"log_dups_size":3000,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:35.567420+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'24","reported_seq":708,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.053024+0000","last_change":"2024-04-16T19:38:22.053138+0000","last_active":"2024-04-16T19:38:22.053024+0000","last_peered":"2024-04-16T19:38:22.053024+0000","last_clean":"2024-04-16T19:38:22.053024+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:38:22.053024+0000","last_undegraded":"2024-04-16T19:38:22.053024+0000","last_fullsized":"2024-04-16T19:38:22.053024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.052928+0000","objects_scrubbed":12,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:13.483027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.240914+0000","last_change":"2024-04-16T19:38:57.240940+0000","last_active":"2024-04-16T19:38:57.240914+0000","last_peered":"2024-04-16T19:38:57.240914+0000","last_clean":"2024-04-16T19:38:57.240914+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:38:57.240914+0000","last_undegraded":"2024-04-16T19:38:57.240914+0000","last_fullsized":"2024-04-16T19:38:57.240914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.240851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.240851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.240851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:42.664937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406184+0000","last_change":"2024-04-16T17:45:08.381368+0000","last_active":"2024-04-16T19:37:49.406184+0000","last_peered":"2024-04-16T19:37:49.406184+0000","last_clean":"2024-04-16T19:37:49.406184+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:37:49.406184+0000","last_undegraded":"2024-04-16T19:37:49.406184+0000","last_fullsized":"2024-04-16T19:37:49.406184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:04.396726+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:37:04.396726+0000","last_peered":"2024-04-16T19:37:04.396726+0000","last_clean":"2024-04-16T19:37:04.396726+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:37:04.396726+0000","last_undegraded":"2024-04-16T19:37:04.396726+0000","last_fullsized":"2024-04-16T19:37:04.396726+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"53'2","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.043747+0000","last_change":"2024-04-16T19:38:55.043776+0000","last_active":"2024-04-16T19:38:55.043747+0000","last_peered":"2024-04-16T19:38:55.043747+0000","last_clean":"2024-04-16T19:38:55.043747+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:38:55.043747+0000","last_undegraded":"2024-04-16T19:38:55.043747+0000","last_fullsized":"2024-04-16T19:38:55.043747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:55.043682+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:55.043682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.043682+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:38.866741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'144","reported_seq":352,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403073+0000","last_change":"2024-04-16T17:45:22.414745+0000","last_active":"2024-04-16T19:37:54.403073+0000","last_peered":"2024-04-16T19:37:54.403073+0000","last_clean":"2024-04-16T19:37:54.403073+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:37:54.403073+0000","last_undegraded":"2024-04-16T19:37:54.403073+0000","last_fullsized":"2024-04-16T19:37:54.403073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.938478+0000","last_change":"2024-04-16T19:38:47.938499+0000","last_active":"2024-04-16T19:38:47.938478+0000","last_peered":"2024-04-16T19:38:47.938478+0000","last_clean":"2024-04-16T19:38:47.938478+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:38:47.938478+0000","last_undegraded":"2024-04-16T19:38:47.938478+0000","last_fullsized":"2024-04-16T19:38:47.938478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.938415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:49.187607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.799921+0000","last_change":"2024-04-16T19:38:35.799944+0000","last_active":"2024-04-16T19:38:35.799921+0000","last_peered":"2024-04-16T19:38:35.799921+0000","last_clean":"2024-04-16T19:38:35.799921+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:38:35.799921+0000","last_undegraded":"2024-04-16T19:38:35.799921+0000","last_fullsized":"2024-04-16T19:38:35.799921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.799851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.447343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069979+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:38:08.069979+0000","last_peered":"2024-04-16T19:38:08.069979+0000","last_clean":"2024-04-16T19:38:08.069979+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:38:08.069979+0000","last_undegraded":"2024-04-16T19:38:08.069979+0000","last_fullsized":"2024-04-16T19:38:08.069979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'139","reported_seq":1783,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.023043+0000","last_change":"2024-04-16T19:39:05.023087+0000","last_active":"2024-04-16T19:39:05.023043+0000","last_peered":"2024-04-16T19:39:05.023043+0000","last_clean":"2024-04-16T19:39:05.023043+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:39:05.023043+0000","last_undegraded":"2024-04-16T19:39:05.023043+0000","last_fullsized":"2024-04-16T19:39:05.023043+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'139","last_scrub_stamp":"2024-04-16T19:39:05.022983+0000","last_deep_scrub":"53'139","last_deep_scrub_stamp":"2024-04-16T19:39:05.022983+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.022983+0000","objects_scrubbed":38,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:27.020160+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9754,"num_omap_keys":41,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.806738+0000","last_change":"2024-04-16T19:38:34.806738+0000","last_active":"2024-04-16T19:38:34.806738+0000","last_peered":"2024-04-16T19:38:34.806738+0000","last_clean":"2024-04-16T19:38:34.806738+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:38:34.806738+0000","last_undegraded":"2024-04-16T19:38:34.806738+0000","last_fullsized":"2024-04-16T19:38:34.806738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.806640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:43.311591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'25","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.421766+0000","last_change":"2024-04-16T19:38:35.421800+0000","last_active":"2024-04-16T19:38:35.421766+0000","last_peered":"2024-04-16T19:38:35.421766+0000","last_clean":"2024-04-16T19:38:35.421766+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:38:35.421766+0000","last_undegraded":"2024-04-16T19:38:35.421766+0000","last_fullsized":"2024-04-16T19:38:35.421766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.421703+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:03:09.135386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.727449+0000","last_change":"2024-04-16T19:38:24.727504+0000","last_active":"2024-04-16T19:38:24.727449+0000","last_peered":"2024-04-16T19:38:24.727449+0000","last_clean":"2024-04-16T19:38:24.727449+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:38:24.727449+0000","last_undegraded":"2024-04-16T19:38:24.727449+0000","last_fullsized":"2024-04-16T19:38:24.727449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.727368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:38.777347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'344","reported_seq":655,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.511356+0000","last_change":"2024-04-16T19:38:12.511356+0000","last_active":"2024-04-16T19:38:12.511356+0000","last_peered":"2024-04-16T19:38:12.511356+0000","last_clean":"2024-04-16T19:38:12.511356+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:38:12.511356+0000","last_undegraded":"2024-04-16T19:38:12.511356+0000","last_fullsized":"2024-04-16T19:38:12.511356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'344","last_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_deep_scrub":"53'344","last_deep_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.511231+0000","objects_scrubbed":24,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:10.499739+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13835,"num_omap_keys":63,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'14","reported_seq":627,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.257871+0000","last_change":"2024-04-16T19:38:19.257946+0000","last_active":"2024-04-16T19:38:19.257871+0000","last_peered":"2024-04-16T19:38:19.257871+0000","last_clean":"2024-04-16T19:38:19.257871+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:38:19.257871+0000","last_undegraded":"2024-04-16T19:38:19.257871+0000","last_fullsized":"2024-04-16T19:38:19.257871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.257792+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:20.506984+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.319985+0000","last_change":"2024-04-16T19:38:33.320008+0000","last_active":"2024-04-16T19:38:33.319985+0000","last_peered":"2024-04-16T19:38:33.319985+0000","last_clean":"2024-04-16T19:38:33.319985+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:38:33.319985+0000","last_undegraded":"2024-04-16T19:38:33.319985+0000","last_fullsized":"2024-04-16T19:38:33.319985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.319922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:11.454921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396720+0000","last_change":"2024-04-16T17:45:10.393485+0000","last_active":"2024-04-16T19:37:14.396720+0000","last_peered":"2024-04-16T19:37:14.396720+0000","last_clean":"2024-04-16T19:37:14.396720+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:37:14.396720+0000","last_undegraded":"2024-04-16T19:37:14.396720+0000","last_fullsized":"2024-04-16T19:37:14.396720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:29.400512+0000","last_change":"2024-04-16T17:45:08.386299+0000","last_active":"2024-04-16T19:37:29.400512+0000","last_peered":"2024-04-16T19:37:29.400512+0000","last_clean":"2024-04-16T19:37:29.400512+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:37:29.400512+0000","last_undegraded":"2024-04-16T19:37:29.400512+0000","last_fullsized":"2024-04-16T19:37:29.400512+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"30'1","reported_seq":210,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589587+0000","last_change":"2024-04-16T17:45:20.412485+0000","last_active":"2024-04-16T19:37:24.589587+0000","last_peered":"2024-04-16T19:37:24.589587+0000","last_clean":"2024-04-16T19:37:24.589587+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:37:24.589587+0000","last_undegraded":"2024-04-16T19:37:24.589587+0000","last_fullsized":"2024-04-16T19:37:24.589587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'109","reported_seq":289,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.058460+0000","last_change":"2024-04-16T19:38:54.058490+0000","last_active":"2024-04-16T19:38:54.058460+0000","last_peered":"2024-04-16T19:38:54.058460+0000","last_clean":"2024-04-16T19:38:54.058460+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:38:54.058460+0000","last_undegraded":"2024-04-16T19:38:54.058460+0000","last_fullsized":"2024-04-16T19:38:54.058460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:54.058400+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:54.058400+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.058400+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:15:15.247351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.684178+0000","last_change":"2024-04-16T19:38:49.684225+0000","last_active":"2024-04-16T19:38:49.684178+0000","last_peered":"2024-04-16T19:38:49.684178+0000","last_clean":"2024-04-16T19:38:49.684178+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:38:49.684178+0000","last_undegraded":"2024-04-16T19:38:49.684178+0000","last_fullsized":"2024-04-16T19:38:49.684178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.684096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.684096+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.684096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:46.663181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887565+0000","last_change":"2024-04-16T18:09:02.165652+0000","last_active":"2024-04-16T19:38:09.887565+0000","last_peered":"2024-04-16T19:38:09.887565+0000","last_clean":"2024-04-16T19:38:09.887565+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:38:09.887565+0000","last_undegraded":"2024-04-16T19:38:09.887565+0000","last_fullsized":"2024-04-16T19:38:09.887565+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'147","reported_seq":1631,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592501+0000","last_change":"2024-04-16T17:46:25.533095+0000","last_active":"2024-04-16T19:37:39.592501+0000","last_peered":"2024-04-16T19:37:39.592501+0000","last_clean":"2024-04-16T19:37:39.592501+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:37:39.592501+0000","last_undegraded":"2024-04-16T19:37:39.592501+0000","last_fullsized":"2024-04-16T19:37:39.592501+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.386677+0000","last_change":"2024-04-16T19:38:34.386677+0000","last_active":"2024-04-16T19:38:34.386677+0000","last_peered":"2024-04-16T19:38:34.386677+0000","last_clean":"2024-04-16T19:38:34.386677+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:38:34.386677+0000","last_undegraded":"2024-04-16T19:38:34.386677+0000","last_fullsized":"2024-04-16T19:38:34.386677+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.386595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:24.029746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'12","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887391+0000","last_change":"2024-04-16T17:47:16.567012+0000","last_active":"2024-04-16T19:38:09.887391+0000","last_peered":"2024-04-16T19:38:09.887391+0000","last_clean":"2024-04-16T19:38:09.887391+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:38:09.887391+0000","last_undegraded":"2024-04-16T19:38:09.887391+0000","last_fullsized":"2024-04-16T19:38:09.887391+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:50.455082+0000","last_clean_scrub_stamp":"2024-04-16T17:45:50.455082+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.919701+0000","last_change":"2024-04-16T19:38:32.919725+0000","last_active":"2024-04-16T19:38:32.919701+0000","last_peered":"2024-04-16T19:38:32.919701+0000","last_clean":"2024-04-16T19:38:32.919701+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:38:32.919701+0000","last_undegraded":"2024-04-16T19:38:32.919701+0000","last_fullsized":"2024-04-16T19:38:32.919701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.919638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:52.778121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'462","reported_seq":2060,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.755722+0000","last_change":"2024-04-16T19:38:14.755722+0000","last_active":"2024-04-16T19:38:14.755722+0000","last_peered":"2024-04-16T19:38:14.755722+0000","last_clean":"2024-04-16T19:38:14.755722+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:38:14.755722+0000","last_undegraded":"2024-04-16T19:38:14.755722+0000","last_fullsized":"2024-04-16T19:38:14.755722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'462","last_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_deep_scrub":"53'462","last_deep_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.755590+0000","objects_scrubbed":20,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:26.580898+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'26","reported_seq":480,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.808711+0000","last_change":"2024-04-16T19:38:09.808711+0000","last_active":"2024-04-16T19:38:09.808711+0000","last_peered":"2024-04-16T19:38:09.808711+0000","last_clean":"2024-04-16T19:38:09.808711+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:38:09.808711+0000","last_undegraded":"2024-04-16T19:38:09.808711+0000","last_fullsized":"2024-04-16T19:38:09.808711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.808625+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:45.079174+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.656504+0000","last_change":"2024-04-16T19:38:43.656527+0000","last_active":"2024-04-16T19:38:43.656504+0000","last_peered":"2024-04-16T19:38:43.656504+0000","last_clean":"2024-04-16T19:38:43.656504+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:38:43.656504+0000","last_undegraded":"2024-04-16T19:38:43.656504+0000","last_fullsized":"2024-04-16T19:38:43.656504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.656442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:44.709769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.587504+0000","last_change":"2024-04-16T17:45:10.394503+0000","last_active":"2024-04-16T19:37:14.587504+0000","last_peered":"2024-04-16T19:37:14.587504+0000","last_clean":"2024-04-16T19:37:14.587504+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:37:14.587504+0000","last_undegraded":"2024-04-16T19:37:14.587504+0000","last_fullsized":"2024-04-16T19:37:14.587504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428346+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:38:09.428346+0000","last_peered":"2024-04-16T19:38:09.428346+0000","last_clean":"2024-04-16T19:38:09.428346+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:38:09.428346+0000","last_undegraded":"2024-04-16T19:38:09.428346+0000","last_fullsized":"2024-04-16T19:38:09.428346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"53'2","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.793634+0000","last_change":"2024-04-16T19:39:08.793686+0000","last_active":"2024-04-16T19:39:08.793634+0000","last_peered":"2024-04-16T19:39:08.793634+0000","last_clean":"2024-04-16T19:39:08.793634+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:39:08.793634+0000","last_undegraded":"2024-04-16T19:39:08.793634+0000","last_fullsized":"2024-04-16T19:39:08.793634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:08.793553+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:08.793553+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.793553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:38.128998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'53","reported_seq":200,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.344742+0000","last_change":"2024-04-16T19:38:58.344774+0000","last_active":"2024-04-16T19:38:58.344742+0000","last_peered":"2024-04-16T19:38:58.344742+0000","last_clean":"2024-04-16T19:38:58.344742+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:38:58.344742+0000","last_undegraded":"2024-04-16T19:38:58.344742+0000","last_fullsized":"2024-04-16T19:38:58.344742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'53","last_scrub_stamp":"2024-04-16T19:38:58.344681+0000","last_deep_scrub":"53'53","last_deep_scrub_stamp":"2024-04-16T19:38:58.344681+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.344681+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:25.741593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.913850+0000","last_change":"2024-04-16T19:38:34.913872+0000","last_active":"2024-04-16T19:38:34.913850+0000","last_peered":"2024-04-16T19:38:34.913850+0000","last_clean":"2024-04-16T19:38:34.913850+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:38:34.913850+0000","last_undegraded":"2024-04-16T19:38:34.913850+0000","last_fullsized":"2024-04-16T19:38:34.913850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.913787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:21.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340425+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:38:10.340425+0000","last_peered":"2024-04-16T19:38:10.340425+0000","last_clean":"2024-04-16T19:38:10.340425+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:38:10.340425+0000","last_undegraded":"2024-04-16T19:38:10.340425+0000","last_fullsized":"2024-04-16T19:38:10.340425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'154","reported_seq":1852,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.701286+0000","last_change":"2024-04-16T19:38:54.701286+0000","last_active":"2024-04-16T19:38:54.701286+0000","last_peered":"2024-04-16T19:38:54.701286+0000","last_clean":"2024-04-16T19:38:54.701286+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:38:54.701286+0000","last_undegraded":"2024-04-16T19:38:54.701286+0000","last_fullsized":"2024-04-16T19:38:54.701286+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'154","last_scrub_stamp":"2024-04-16T19:38:54.701174+0000","last_deep_scrub":"53'154","last_deep_scrub_stamp":"2024-04-16T19:38:54.701174+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.701174+0000","objects_scrubbed":45,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:16.295198+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8661,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.820904+0000","last_change":"2024-04-16T19:38:41.820939+0000","last_active":"2024-04-16T19:38:41.820904+0000","last_peered":"2024-04-16T19:38:41.820904+0000","last_clean":"2024-04-16T19:38:41.820904+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:38:41.820904+0000","last_undegraded":"2024-04-16T19:38:41.820904+0000","last_fullsized":"2024-04-16T19:38:41.820904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.820819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.792918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'21","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.362934+0000","last_change":"2024-04-16T19:38:39.362978+0000","last_active":"2024-04-16T19:38:39.362934+0000","last_peered":"2024-04-16T19:38:39.362934+0000","last_clean":"2024-04-16T19:38:39.362934+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:38:39.362934+0000","last_undegraded":"2024-04-16T19:38:39.362934+0000","last_fullsized":"2024-04-16T19:38:39.362934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.362872+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:59.832976+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.775944+0000","last_change":"2024-04-16T19:38:34.775967+0000","last_active":"2024-04-16T19:38:34.775944+0000","last_peered":"2024-04-16T19:38:34.775944+0000","last_clean":"2024-04-16T19:38:34.775944+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:38:34.775944+0000","last_undegraded":"2024-04-16T19:38:34.775944+0000","last_fullsized":"2024-04-16T19:38:34.775944+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.775873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:29.678507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'685","reported_seq":2207,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.959879+0000","last_change":"2024-04-16T19:38:20.959909+0000","last_active":"2024-04-16T19:38:20.959879+0000","last_peered":"2024-04-16T19:38:20.959879+0000","last_clean":"2024-04-16T19:38:20.959879+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:38:20.959879+0000","last_undegraded":"2024-04-16T19:38:20.959879+0000","last_fullsized":"2024-04-16T19:38:20.959879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'685","last_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_deep_scrub":"53'685","last_deep_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.959819+0000","objects_scrubbed":26,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:09.314088+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4728,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'41","reported_seq":377,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.181166+0000","last_change":"2024-04-16T19:38:12.181166+0000","last_active":"2024-04-16T19:38:12.181166+0000","last_peered":"2024-04-16T19:38:12.181166+0000","last_clean":"2024-04-16T19:38:12.181166+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:38:12.181166+0000","last_undegraded":"2024-04-16T19:38:12.181166+0000","last_fullsized":"2024-04-16T19:38:12.181166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41","last_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_deep_scrub":"53'41","last_deep_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.181055+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.810131+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.360593+0000","last_change":"2024-04-16T19:38:34.360619+0000","last_active":"2024-04-16T19:38:34.360593+0000","last_peered":"2024-04-16T19:38:34.360593+0000","last_clean":"2024-04-16T19:38:34.360593+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:38:34.360593+0000","last_undegraded":"2024-04-16T19:38:34.360593+0000","last_fullsized":"2024-04-16T19:38:34.360593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.360526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:17.270587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.991826+0000","last_change":"2024-04-16T19:38:59.991847+0000","last_active":"2024-04-16T19:38:59.991826+0000","last_peered":"2024-04-16T19:38:59.991826+0000","last_clean":"2024-04-16T19:38:59.991826+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:38:59.991826+0000","last_undegraded":"2024-04-16T19:38:59.991826+0000","last_fullsized":"2024-04-16T19:38:59.991826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:59.991758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:59.991758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.991758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:41.596200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338632+0000","last_change":"2024-04-16T17:45:08.389656+0000","last_active":"2024-04-16T19:38:10.338632+0000","last_peered":"2024-04-16T19:38:10.338632+0000","last_clean":"2024-04-16T19:38:10.338632+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:38:10.338632+0000","last_undegraded":"2024-04-16T19:38:10.338632+0000","last_fullsized":"2024-04-16T19:38:10.338632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.156305+0000","last_change":"2024-04-16T19:39:02.156329+0000","last_active":"2024-04-16T19:39:02.156305+0000","last_peered":"2024-04-16T19:39:02.156305+0000","last_clean":"2024-04-16T19:39:02.156305+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:39:02.156305+0000","last_undegraded":"2024-04-16T19:39:02.156305+0000","last_fullsized":"2024-04-16T19:39:02.156305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.156240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.156240+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.156240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:42.484828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'104","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589631+0000","last_change":"2024-04-16T17:45:22.415814+0000","last_active":"2024-04-16T19:37:24.589631+0000","last_peered":"2024-04-16T19:37:24.589631+0000","last_clean":"2024-04-16T19:37:24.589631+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:37:24.589631+0000","last_undegraded":"2024-04-16T19:37:24.589631+0000","last_fullsized":"2024-04-16T19:37:24.589631+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:21.399415+0000","last_clean_scrub_stamp":"2024-04-16T17:45:21.399415+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.793300+0000","last_change":"2024-04-16T19:38:55.793324+0000","last_active":"2024-04-16T19:38:55.793300+0000","last_peered":"2024-04-16T19:38:55.793300+0000","last_clean":"2024-04-16T19:38:55.793300+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:38:55.793300+0000","last_undegraded":"2024-04-16T19:38:55.793300+0000","last_fullsized":"2024-04-16T19:38:55.793300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:55.793235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:55.793235+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.793235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:03.787024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.430039+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:38:09.430039+0000","last_peered":"2024-04-16T19:38:09.430039+0000","last_clean":"2024-04-16T19:38:09.430039+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:38:09.430039+0000","last_undegraded":"2024-04-16T19:38:09.430039+0000","last_fullsized":"2024-04-16T19:38:09.430039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2059,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069842+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:38:08.069842+0000","last_peered":"2024-04-16T19:38:08.069842+0000","last_clean":"2024-04-16T19:38:08.069842+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:38:08.069842+0000","last_undegraded":"2024-04-16T19:38:08.069842+0000","last_fullsized":"2024-04-16T19:38:08.069842+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.126764+0000","last_change":"2024-04-16T19:38:33.126787+0000","last_active":"2024-04-16T19:38:33.126764+0000","last_peered":"2024-04-16T19:38:33.126764+0000","last_clean":"2024-04-16T19:38:33.126764+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:38:33.126764+0000","last_undegraded":"2024-04-16T19:38:33.126764+0000","last_fullsized":"2024-04-16T19:38:33.126764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.126702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:58.080828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'18","reported_seq":163,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.717371+0000","last_change":"2024-04-16T19:38:39.717409+0000","last_active":"2024-04-16T19:38:39.717371+0000","last_peered":"2024-04-16T19:38:39.717371+0000","last_clean":"2024-04-16T19:38:39.717371+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:38:39.717371+0000","last_undegraded":"2024-04-16T19:38:39.717371+0000","last_fullsized":"2024-04-16T19:38:39.717371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'18","last_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_deep_scrub":"53'18","last_deep_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.717311+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:15:00.906262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'652","reported_seq":2205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.155887+0000","last_change":"2024-04-16T19:38:30.155937+0000","last_active":"2024-04-16T19:38:30.155887+0000","last_peered":"2024-04-16T19:38:30.155887+0000","last_clean":"2024-04-16T19:38:30.155887+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:38:30.155887+0000","last_undegraded":"2024-04-16T19:38:30.155887+0000","last_fullsized":"2024-04-16T19:38:30.155887+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.155802+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:56.186978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'745","reported_seq":3560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.302525+0000","last_change":"2024-04-16T19:38:20.302555+0000","last_active":"2024-04-16T19:38:20.302525+0000","last_peered":"2024-04-16T19:38:20.302525+0000","last_clean":"2024-04-16T19:38:20.302525+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:38:20.302525+0000","last_undegraded":"2024-04-16T19:38:20.302525+0000","last_fullsized":"2024-04-16T19:38:20.302525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'745","last_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_deep_scrub":"53'745","last_deep_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.302461+0000","objects_scrubbed":25,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:34.270855+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18796,"num_omap_keys":104,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'14","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.221430+0000","last_change":"2024-04-16T19:38:13.221430+0000","last_active":"2024-04-16T19:38:13.221430+0000","last_peered":"2024-04-16T19:38:13.221430+0000","last_clean":"2024-04-16T19:38:13.221430+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:38:13.221430+0000","last_undegraded":"2024-04-16T19:38:13.221430+0000","last_fullsized":"2024-04-16T19:38:13.221430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.221281+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:20.880912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.777444+0000","last_change":"2024-04-16T19:38:37.777471+0000","last_active":"2024-04-16T19:38:37.777444+0000","last_peered":"2024-04-16T19:38:37.777444+0000","last_clean":"2024-04-16T19:38:37.777444+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:38:37.777444+0000","last_undegraded":"2024-04-16T19:38:37.777444+0000","last_fullsized":"2024-04-16T19:38:37.777444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.777367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:38.830695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.776381+0000","last_change":"2024-04-16T19:39:06.776405+0000","last_active":"2024-04-16T19:39:06.776381+0000","last_peered":"2024-04-16T19:39:06.776381+0000","last_clean":"2024-04-16T19:39:06.776381+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:39:06.776381+0000","last_undegraded":"2024-04-16T19:39:06.776381+0000","last_fullsized":"2024-04-16T19:39:06.776381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.776317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.776317+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.776317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:05.893011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068616+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:38:08.068616+0000","last_peered":"2024-04-16T19:38:08.068616+0000","last_clean":"2024-04-16T19:38:08.068616+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:38:08.068616+0000","last_undegraded":"2024-04-16T19:38:08.068616+0000","last_fullsized":"2024-04-16T19:38:08.068616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"53'5","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.993806+0000","last_change":"2024-04-16T19:39:01.993835+0000","last_active":"2024-04-16T19:39:01.993806+0000","last_peered":"2024-04-16T19:39:01.993806+0000","last_clean":"2024-04-16T19:39:01.993806+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:39:01.993806+0000","last_undegraded":"2024-04-16T19:39:01.993806+0000","last_fullsized":"2024-04-16T19:39:01.993806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5","last_scrub_stamp":"2024-04-16T19:39:01.993744+0000","last_deep_scrub":"53'5","last_deep_scrub_stamp":"2024-04-16T19:39:01.993744+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.993744+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:02.303848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'84","reported_seq":252,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.827702+0000","last_change":"2024-04-16T19:39:00.827734+0000","last_active":"2024-04-16T19:39:00.827702+0000","last_peered":"2024-04-16T19:39:00.827702+0000","last_clean":"2024-04-16T19:39:00.827702+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:39:00.827702+0000","last_undegraded":"2024-04-16T19:39:00.827702+0000","last_fullsized":"2024-04-16T19:39:00.827702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:39:00.827635+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:39:00.827635+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.827635+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:37.094463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.391675+0000","last_change":"2024-04-16T19:38:37.391698+0000","last_active":"2024-04-16T19:38:37.391675+0000","last_peered":"2024-04-16T19:38:37.391675+0000","last_clean":"2024-04-16T19:38:37.391675+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:38:37.391675+0000","last_undegraded":"2024-04-16T19:38:37.391675+0000","last_fullsized":"2024-04-16T19:38:37.391675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.391613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:56.190105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404769+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:37:59.404769+0000","last_peered":"2024-04-16T19:37:59.404769+0000","last_clean":"2024-04-16T19:37:59.404769+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:37:59.404769+0000","last_undegraded":"2024-04-16T19:37:59.404769+0000","last_fullsized":"2024-04-16T19:37:59.404769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'149","reported_seq":1540,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.045613+0000","last_change":"2024-04-16T19:38:57.045662+0000","last_active":"2024-04-16T19:38:57.045613+0000","last_peered":"2024-04-16T19:38:57.045613+0000","last_clean":"2024-04-16T19:38:57.045613+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:38:57.045613+0000","last_undegraded":"2024-04-16T19:38:57.045613+0000","last_fullsized":"2024-04-16T19:38:57.045613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'149","last_scrub_stamp":"2024-04-16T19:38:57.045547+0000","last_deep_scrub":"53'149","last_deep_scrub_stamp":"2024-04-16T19:38:57.045547+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.045547+0000","objects_scrubbed":37,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:48.643783+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9287,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.367350+0000","last_change":"2024-04-16T19:38:40.367372+0000","last_active":"2024-04-16T19:38:40.367350+0000","last_peered":"2024-04-16T19:38:40.367350+0000","last_clean":"2024-04-16T19:38:40.367350+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:38:40.367350+0000","last_undegraded":"2024-04-16T19:38:40.367350+0000","last_fullsized":"2024-04-16T19:38:40.367350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.367287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:20.695875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"53'4","reported_seq":106,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.431286+0000","last_change":"2024-04-16T19:38:32.431337+0000","last_active":"2024-04-16T19:38:32.431286+0000","last_peered":"2024-04-16T19:38:32.431286+0000","last_clean":"2024-04-16T19:38:32.431286+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:38:32.431286+0000","last_undegraded":"2024-04-16T19:38:32.431286+0000","last_fullsized":"2024-04-16T19:38:32.431286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.431211+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:40.828369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.346700+0000","last_change":"2024-04-16T19:38:32.346723+0000","last_active":"2024-04-16T19:38:32.346700+0000","last_peered":"2024-04-16T19:38:32.346700+0000","last_clean":"2024-04-16T19:38:32.346700+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:38:32.346700+0000","last_undegraded":"2024-04-16T19:38:32.346700+0000","last_fullsized":"2024-04-16T19:38:32.346700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.346634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:51.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'394","reported_seq":728,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.708440+0000","last_change":"2024-04-16T19:38:11.708492+0000","last_active":"2024-04-16T19:38:11.708440+0000","last_peered":"2024-04-16T19:38:11.708440+0000","last_clean":"2024-04-16T19:38:11.708440+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:38:11.708440+0000","last_undegraded":"2024-04-16T19:38:11.708440+0000","last_fullsized":"2024-04-16T19:38:11.708440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'394","last_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_deep_scrub":"53'394","last_deep_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.708368+0000","objects_scrubbed":25,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.347792+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'23","reported_seq":338,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.749658+0000","last_change":"2024-04-16T19:38:27.749706+0000","last_active":"2024-04-16T19:38:27.749658+0000","last_peered":"2024-04-16T19:38:27.749658+0000","last_clean":"2024-04-16T19:38:27.749658+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:38:27.749658+0000","last_undegraded":"2024-04-16T19:38:27.749658+0000","last_fullsized":"2024-04-16T19:38:27.749658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.749597+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:41.717991+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402720+0000","last_change":"2024-04-16T17:45:10.396745+0000","last_active":"2024-04-16T19:37:44.402720+0000","last_peered":"2024-04-16T19:37:44.402720+0000","last_clean":"2024-04-16T19:37:44.402720+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:37:44.402720+0000","last_undegraded":"2024-04-16T19:37:44.402720+0000","last_fullsized":"2024-04-16T19:37:44.402720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.976182+0000","last_change":"2024-04-16T17:45:08.384480+0000","last_active":"2024-04-16T19:38:08.976182+0000","last_peered":"2024-04-16T19:38:08.976182+0000","last_clean":"2024-04-16T19:38:08.976182+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:38:08.976182+0000","last_undegraded":"2024-04-16T19:38:08.976182+0000","last_fullsized":"2024-04-16T19:38:08.976182+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.379882+0000","last_change":"2024-04-16T19:39:07.379904+0000","last_active":"2024-04-16T19:39:07.379882+0000","last_peered":"2024-04-16T19:39:07.379882+0000","last_clean":"2024-04-16T19:39:07.379882+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:39:07.379882+0000","last_undegraded":"2024-04-16T19:39:07.379882+0000","last_fullsized":"2024-04-16T19:39:07.379882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.379808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.379808+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.379808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:37.404406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'93","reported_seq":267,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.728543+0000","last_change":"2024-04-16T19:38:55.728580+0000","last_active":"2024-04-16T19:38:55.728543+0000","last_peered":"2024-04-16T19:38:55.728543+0000","last_clean":"2024-04-16T19:38:55.728543+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:38:55.728543+0000","last_undegraded":"2024-04-16T19:38:55.728543+0000","last_fullsized":"2024-04-16T19:38:55.728543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'93","last_scrub_stamp":"2024-04-16T19:38:55.728482+0000","last_deep_scrub":"53'93","last_deep_scrub_stamp":"2024-04-16T19:38:55.728482+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.728482+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:13:32.667039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.811745+0000","last_change":"2024-04-16T19:38:37.811769+0000","last_active":"2024-04-16T19:38:37.811745+0000","last_peered":"2024-04-16T19:38:37.811745+0000","last_clean":"2024-04-16T19:38:37.811745+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:38:37.811745+0000","last_undegraded":"2024-04-16T19:38:37.811745+0000","last_fullsized":"2024-04-16T19:38:37.811745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.811682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:16.599188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.717809+0000","last_change":"2024-04-16T19:38:24.717833+0000","last_active":"2024-04-16T19:38:24.717809+0000","last_peered":"2024-04-16T19:38:24.717809+0000","last_clean":"2024-04-16T19:38:24.717809+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:38:24.717809+0000","last_undegraded":"2024-04-16T19:38:24.717809+0000","last_fullsized":"2024-04-16T19:38:24.717809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.717739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:12.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340415+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:38:10.340415+0000","last_peered":"2024-04-16T19:38:10.340415+0000","last_clean":"2024-04-16T19:38:10.340415+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:38:10.340415+0000","last_undegraded":"2024-04-16T19:38:10.340415+0000","last_fullsized":"2024-04-16T19:38:10.340415+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'147","reported_seq":1369,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.298300+0000","last_change":"2024-04-16T19:38:54.298344+0000","last_active":"2024-04-16T19:38:54.298300+0000","last_peered":"2024-04-16T19:38:54.298300+0000","last_clean":"2024-04-16T19:38:54.298300+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:38:54.298300+0000","last_undegraded":"2024-04-16T19:38:54.298300+0000","last_fullsized":"2024-04-16T19:38:54.298300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'147","last_scrub_stamp":"2024-04-16T19:38:54.298241+0000","last_deep_scrub":"53'147","last_deep_scrub_stamp":"2024-04-16T19:38:54.298241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.298241+0000","objects_scrubbed":35,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:37:29.765409+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10184,"num_omap_keys":41,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.800761+0000","last_change":"2024-04-16T19:38:54.800803+0000","last_active":"2024-04-16T19:38:54.800761+0000","last_peered":"2024-04-16T19:38:54.800761+0000","last_clean":"2024-04-16T19:38:54.800761+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:38:54.800761+0000","last_undegraded":"2024-04-16T19:38:54.800761+0000","last_fullsized":"2024-04-16T19:38:54.800761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:54.800687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:54.800687+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.800687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:02.678098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"53'15","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.832730+0000","last_change":"2024-04-16T19:38:47.832780+0000","last_active":"2024-04-16T19:38:47.832730+0000","last_peered":"2024-04-16T19:38:47.832730+0000","last_clean":"2024-04-16T19:38:47.832730+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:38:47.832730+0000","last_undegraded":"2024-04-16T19:38:47.832730+0000","last_fullsized":"2024-04-16T19:38:47.832730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'15","last_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_deep_scrub":"53'15","last_deep_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.832667+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:28.161255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.156986+0000","last_change":"2024-04-16T19:38:34.157007+0000","last_active":"2024-04-16T19:38:34.156986+0000","last_peered":"2024-04-16T19:38:34.156986+0000","last_clean":"2024-04-16T19:38:34.156986+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:38:34.156986+0000","last_undegraded":"2024-04-16T19:38:34.156986+0000","last_fullsized":"2024-04-16T19:38:34.156986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.156921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:55.446024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'232","reported_seq":419,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.530282+0000","last_change":"2024-04-16T19:38:19.530353+0000","last_active":"2024-04-16T19:38:19.530282+0000","last_peered":"2024-04-16T19:38:19.530282+0000","last_clean":"2024-04-16T19:38:19.530282+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:38:19.530282+0000","last_undegraded":"2024-04-16T19:38:19.530282+0000","last_fullsized":"2024-04-16T19:38:19.530282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'232","last_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_deep_scrub":"53'232","last_deep_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.530215+0000","objects_scrubbed":16,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:50:04.335733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14555,"num_omap_keys":67,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'24","reported_seq":473,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:59.394596+0000","last_change":"2024-04-16T17:47:16.558050+0000","last_active":"2024-04-16T19:36:59.394596+0000","last_peered":"2024-04-16T19:36:59.394596+0000","last_clean":"2024-04-16T19:36:59.394596+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:36:59.394596+0000","last_undegraded":"2024-04-16T19:36:59.394596+0000","last_fullsized":"2024-04-16T19:36:59.394596+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:44.434043+0000","last_clean_scrub_stamp":"2024-04-16T17:45:44.434043+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:34.403553+0000","last_change":"2024-04-16T17:45:10.400195+0000","last_active":"2024-04-16T19:37:34.403553+0000","last_peered":"2024-04-16T19:37:34.403553+0000","last_clean":"2024-04-16T19:37:34.403553+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:37:34.403553+0000","last_undegraded":"2024-04-16T19:37:34.403553+0000","last_fullsized":"2024-04-16T19:37:34.403553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.523396+0000","last_change":"2024-04-16T17:45:08.388718+0000","last_active":"2024-04-16T19:38:08.523396+0000","last_peered":"2024-04-16T19:38:08.523396+0000","last_clean":"2024-04-16T19:38:08.523396+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:38:08.523396+0000","last_undegraded":"2024-04-16T19:38:08.523396+0000","last_fullsized":"2024-04-16T19:38:08.523396+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"53'3","reported_seq":572,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.035167+0000","last_change":"2024-04-16T19:39:04.035197+0000","last_active":"2024-04-16T19:39:04.035167+0000","last_peered":"2024-04-16T19:39:04.035167+0000","last_clean":"2024-04-16T19:39:04.035167+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:39:04.035167+0000","last_undegraded":"2024-04-16T19:39:04.035167+0000","last_fullsized":"2024-04-16T19:39:04.035167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-16T19:39:04.035106+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-16T19:39:04.035106+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.035106+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:31.432018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'159","reported_seq":360,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.006509+0000","last_change":"2024-04-16T19:38:56.006551+0000","last_active":"2024-04-16T19:38:56.006509+0000","last_peered":"2024-04-16T19:38:56.006509+0000","last_clean":"2024-04-16T19:38:56.006509+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:38:56.006509+0000","last_undegraded":"2024-04-16T19:38:56.006509+0000","last_fullsized":"2024-04-16T19:38:56.006509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:38:56.006439+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:38:56.006439+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.006439+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:53.056284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.749066+0000","last_change":"2024-04-16T19:38:47.749088+0000","last_active":"2024-04-16T19:38:47.749066+0000","last_peered":"2024-04-16T19:38:47.749066+0000","last_clean":"2024-04-16T19:38:47.749066+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:38:47.749066+0000","last_undegraded":"2024-04-16T19:38:47.749066+0000","last_fullsized":"2024-04-16T19:38:47.749066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.748997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:30.659057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.859523+0000","last_change":"2024-04-16T19:38:25.859545+0000","last_active":"2024-04-16T19:38:25.859523+0000","last_peered":"2024-04-16T19:38:25.859523+0000","last_clean":"2024-04-16T19:38:25.859523+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:38:25.859523+0000","last_undegraded":"2024-04-16T19:38:25.859523+0000","last_fullsized":"2024-04-16T19:38:25.859523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.859440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:49:45.247605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069936+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:38:08.069936+0000","last_peered":"2024-04-16T19:38:08.069936+0000","last_clean":"2024-04-16T19:38:08.069936+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:38:08.069936+0000","last_undegraded":"2024-04-16T19:38:08.069936+0000","last_fullsized":"2024-04-16T19:38:08.069936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'152","reported_seq":2009,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.720163+0000","last_change":"2024-04-16T19:38:42.720215+0000","last_active":"2024-04-16T19:38:42.720163+0000","last_peered":"2024-04-16T19:38:42.720163+0000","last_clean":"2024-04-16T19:38:42.720163+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:38:42.720163+0000","last_undegraded":"2024-04-16T19:38:42.720163+0000","last_fullsized":"2024-04-16T19:38:42.720163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'152","last_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_deep_scrub":"53'152","last_deep_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.720094+0000","objects_scrubbed":42,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:29.723422+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7797,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.359616+0000","last_change":"2024-04-16T19:38:44.359659+0000","last_active":"2024-04-16T19:38:44.359616+0000","last_peered":"2024-04-16T19:38:44.359616+0000","last_clean":"2024-04-16T19:38:44.359616+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:38:44.359616+0000","last_undegraded":"2024-04-16T19:38:44.359616+0000","last_fullsized":"2024-04-16T19:38:44.359616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.359543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:32.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"53'6","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.828811+0000","last_change":"2024-04-16T19:38:44.828869+0000","last_active":"2024-04-16T19:38:44.828811+0000","last_peered":"2024-04-16T19:38:44.828811+0000","last_clean":"2024-04-16T19:38:44.828811+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:38:44.828811+0000","last_undegraded":"2024-04-16T19:38:44.828811+0000","last_fullsized":"2024-04-16T19:38:44.828811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.828731+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:03.627224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'21","reported_seq":1488,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.901432+0000","last_change":"2024-04-16T19:38:47.901478+0000","last_active":"2024-04-16T19:38:47.901432+0000","last_peered":"2024-04-16T19:38:47.901432+0000","last_clean":"2024-04-16T19:38:47.901432+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:38:47.901432+0000","last_undegraded":"2024-04-16T19:38:47.901432+0000","last_fullsized":"2024-04-16T19:38:47.901432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.901356+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:42.407062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'681","reported_seq":3330,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.829538+0000","last_change":"2024-04-16T19:38:10.829578+0000","last_active":"2024-04-16T19:38:10.829538+0000","last_peered":"2024-04-16T19:38:10.829538+0000","last_clean":"2024-04-16T19:38:10.829538+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:38:10.829538+0000","last_undegraded":"2024-04-16T19:38:10.829538+0000","last_fullsized":"2024-04-16T19:38:10.829538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'681","last_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_deep_scrub":"53'681","last_deep_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.829490+0000","objects_scrubbed":20,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:55.635008+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'12","reported_seq":518,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.553415+0000","last_change":"2024-04-16T19:38:21.553466+0000","last_active":"2024-04-16T19:38:21.553415+0000","last_peered":"2024-04-16T19:38:21.553415+0000","last_clean":"2024-04-16T19:38:21.553415+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:38:21.553415+0000","last_undegraded":"2024-04-16T19:38:21.553415+0000","last_fullsized":"2024-04-16T19:38:21.553415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.553349+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:55.897508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405254+0000","last_change":"2024-04-16T17:45:10.393491+0000","last_active":"2024-04-16T19:37:44.405254+0000","last_peered":"2024-04-16T19:37:44.405254+0000","last_clean":"2024-04-16T19:37:44.405254+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:37:44.405254+0000","last_undegraded":"2024-04-16T19:37:44.405254+0000","last_fullsized":"2024-04-16T19:37:44.405254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400637+0000","last_change":"2024-04-16T17:45:08.380598+0000","last_active":"2024-04-16T19:37:39.400637+0000","last_peered":"2024-04-16T19:37:39.400637+0000","last_clean":"2024-04-16T19:37:39.400637+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:37:39.400637+0000","last_undegraded":"2024-04-16T19:37:39.400637+0000","last_fullsized":"2024-04-16T19:37:39.400637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"53'4","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.189901+0000","last_change":"2024-04-16T19:39:08.189930+0000","last_active":"2024-04-16T19:39:08.189901+0000","last_peered":"2024-04-16T19:39:08.189901+0000","last_clean":"2024-04-16T19:39:08.189901+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:39:08.189901+0000","last_undegraded":"2024-04-16T19:39:08.189901+0000","last_fullsized":"2024-04-16T19:39:08.189901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:08.189842+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:08.189842+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.189842+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:33.947083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'109","reported_seq":295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.025079+0000","last_change":"2024-04-16T19:38:52.025105+0000","last_active":"2024-04-16T19:38:52.025079+0000","last_peered":"2024-04-16T19:38:52.025079+0000","last_clean":"2024-04-16T19:38:52.025079+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:38:52.025079+0000","last_undegraded":"2024-04-16T19:38:52.025079+0000","last_fullsized":"2024-04-16T19:38:52.025079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:52.025025+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:52.025025+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.025025+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:10.702648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.713466+0000","last_change":"2024-04-16T19:38:48.713508+0000","last_active":"2024-04-16T19:38:48.713466+0000","last_peered":"2024-04-16T19:38:48.713466+0000","last_clean":"2024-04-16T19:38:48.713466+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:38:48.713466+0000","last_undegraded":"2024-04-16T19:38:48.713466+0000","last_fullsized":"2024-04-16T19:38:48.713466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.713387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:48.829744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.890917+0000","last_change":"2024-04-16T19:38:27.890939+0000","last_active":"2024-04-16T19:38:27.890917+0000","last_peered":"2024-04-16T19:38:27.890917+0000","last_clean":"2024-04-16T19:38:27.890917+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:38:27.890917+0000","last_undegraded":"2024-04-16T19:38:27.890917+0000","last_fullsized":"2024-04-16T19:38:27.890917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.890852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:30.404878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.887604+0000","last_change":"2024-04-16T18:09:02.173368+0000","last_active":"2024-04-16T19:38:09.887604+0000","last_peered":"2024-04-16T19:38:09.887604+0000","last_clean":"2024-04-16T19:38:09.887604+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:38:09.887604+0000","last_undegraded":"2024-04-16T19:38:09.887604+0000","last_fullsized":"2024-04-16T19:38:09.887604+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'192","reported_seq":1694,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.782068+0000","last_change":"2024-04-16T19:38:58.782113+0000","last_active":"2024-04-16T19:38:58.782068+0000","last_peered":"2024-04-16T19:38:58.782068+0000","last_clean":"2024-04-16T19:38:58.782068+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:38:58.782068+0000","last_undegraded":"2024-04-16T19:38:58.782068+0000","last_fullsized":"2024-04-16T19:38:58.782068+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'192","last_scrub_stamp":"2024-04-16T19:38:58.782006+0000","last_deep_scrub":"53'192","last_deep_scrub_stamp":"2024-04-16T19:38:58.782006+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.782006+0000","objects_scrubbed":46,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:04.393415+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13128,"num_omap_keys":54,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.550739+0000","last_change":"2024-04-16T19:38:26.550762+0000","last_active":"2024-04-16T19:38:26.550739+0000","last_peered":"2024-04-16T19:38:26.550739+0000","last_clean":"2024-04-16T19:38:26.550739+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:38:26.550739+0000","last_undegraded":"2024-04-16T19:38:26.550739+0000","last_fullsized":"2024-04-16T19:38:26.550739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.550671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:50.234890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.819588+0000","last_change":"2024-04-16T19:38:45.819620+0000","last_active":"2024-04-16T19:38:45.819588+0000","last_peered":"2024-04-16T19:38:45.819588+0000","last_clean":"2024-04-16T19:38:45.819588+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:38:45.819588+0000","last_undegraded":"2024-04-16T19:38:45.819588+0000","last_fullsized":"2024-04-16T19:38:45.819588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.819519+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:24.941425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.764005+0000","last_change":"2024-04-16T19:38:30.764029+0000","last_active":"2024-04-16T19:38:30.764005+0000","last_peered":"2024-04-16T19:38:30.764005+0000","last_clean":"2024-04-16T19:38:30.764005+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:38:30.764005+0000","last_undegraded":"2024-04-16T19:38:30.764005+0000","last_fullsized":"2024-04-16T19:38:30.764005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.763939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:44.186208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'562","reported_seq":45436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.690811+0000","last_change":"2024-04-16T19:38:12.690864+0000","last_active":"2024-04-16T19:38:12.690811+0000","last_peered":"2024-04-16T19:38:12.690811+0000","last_clean":"2024-04-16T19:38:12.690811+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:38:12.690811+0000","last_undegraded":"2024-04-16T19:38:12.690811+0000","last_fullsized":"2024-04-16T19:38:12.690811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'562","last_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_deep_scrub":"53'562","last_deep_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.690747+0000","objects_scrubbed":19,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:33.979851+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7052,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'16","reported_seq":415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.851820+0000","last_change":"2024-04-16T19:38:09.851868+0000","last_active":"2024-04-16T19:38:09.851820+0000","last_peered":"2024-04-16T19:38:09.851820+0000","last_clean":"2024-04-16T19:38:09.851820+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:38:09.851820+0000","last_undegraded":"2024-04-16T19:38:09.851820+0000","last_fullsized":"2024-04-16T19:38:09.851820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.851761+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:33.535980+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.936903+0000","last_change":"2024-04-16T19:38:57.936927+0000","last_active":"2024-04-16T19:38:57.936903+0000","last_peered":"2024-04-16T19:38:57.936903+0000","last_clean":"2024-04-16T19:38:57.936903+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:38:57.936903+0000","last_undegraded":"2024-04-16T19:38:57.936903+0000","last_fullsized":"2024-04-16T19:38:57.936903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.936832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.936832+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.936832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:44.940160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404315+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:37:39.404315+0000","last_peered":"2024-04-16T19:37:39.404315+0000","last_clean":"2024-04-16T19:37:39.404315+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:37:39.404315+0000","last_undegraded":"2024-04-16T19:37:39.404315+0000","last_fullsized":"2024-04-16T19:37:39.404315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"48'2","reported_seq":501,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595909+0000","last_change":"2024-04-16T17:45:20.412567+0000","last_active":"2024-04-16T19:37:54.595909+0000","last_peered":"2024-04-16T19:37:54.595909+0000","last_clean":"2024-04-16T19:37:54.595909+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:37:54.595909+0000","last_undegraded":"2024-04-16T19:37:54.595909+0000","last_fullsized":"2024-04-16T19:37:54.595909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'125","reported_seq":316,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.052153+0000","last_change":"2024-04-16T19:38:58.052186+0000","last_active":"2024-04-16T19:38:58.052153+0000","last_peered":"2024-04-16T19:38:58.052153+0000","last_clean":"2024-04-16T19:38:58.052153+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:38:58.052153+0000","last_undegraded":"2024-04-16T19:38:58.052153+0000","last_fullsized":"2024-04-16T19:38:58.052153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:58.052092+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:58.052092+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.052092+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:10.120432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'13","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.881616+0000","last_change":"2024-04-16T19:38:52.881641+0000","last_active":"2024-04-16T19:38:52.881616+0000","last_peered":"2024-04-16T19:38:52.881616+0000","last_clean":"2024-04-16T19:38:52.881616+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:38:52.881616+0000","last_undegraded":"2024-04-16T19:38:52.881616+0000","last_fullsized":"2024-04-16T19:38:52.881616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:52.881556+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:52.881556+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.881556+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:36.801510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.917217+0000","last_change":"2024-04-16T19:38:29.917241+0000","last_active":"2024-04-16T19:38:29.917217+0000","last_peered":"2024-04-16T19:38:29.917217+0000","last_clean":"2024-04-16T19:38:29.917217+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:38:29.917217+0000","last_undegraded":"2024-04-16T19:38:29.917217+0000","last_fullsized":"2024-04-16T19:38:29.917217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.917157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:51.736564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596673+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:37:59.596673+0000","last_peered":"2024-04-16T19:37:59.596673+0000","last_clean":"2024-04-16T19:37:59.596673+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:37:59.596673+0000","last_undegraded":"2024-04-16T19:37:59.596673+0000","last_fullsized":"2024-04-16T19:37:59.596673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'124","reported_seq":1595,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.373764+0000","last_change":"2024-04-16T19:38:42.373815+0000","last_active":"2024-04-16T19:38:42.373764+0000","last_peered":"2024-04-16T19:38:42.373764+0000","last_clean":"2024-04-16T19:38:42.373764+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:38:42.373764+0000","last_undegraded":"2024-04-16T19:38:42.373764+0000","last_fullsized":"2024-04-16T19:38:42.373764+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'124","last_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_deep_scrub":"53'124","last_deep_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.373704+0000","objects_scrubbed":35,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:05.137933+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8419,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.361486+0000","last_change":"2024-04-16T19:38:38.361524+0000","last_active":"2024-04-16T19:38:38.361486+0000","last_peered":"2024-04-16T19:38:38.361486+0000","last_clean":"2024-04-16T19:38:38.361486+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:38:38.361486+0000","last_undegraded":"2024-04-16T19:38:38.361486+0000","last_fullsized":"2024-04-16T19:38:38.361486+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.361386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:17.483291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'23","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.803226+0000","last_change":"2024-04-16T19:38:35.803270+0000","last_active":"2024-04-16T19:38:35.803226+0000","last_peered":"2024-04-16T19:38:35.803226+0000","last_clean":"2024-04-16T19:38:35.803226+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:38:35.803226+0000","last_undegraded":"2024-04-16T19:38:35.803226+0000","last_fullsized":"2024-04-16T19:38:35.803226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.803159+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:41.224996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'652","reported_seq":2571,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.898392+0000","last_change":"2024-04-16T19:38:30.898437+0000","last_active":"2024-04-16T19:38:30.898392+0000","last_peered":"2024-04-16T19:38:30.898392+0000","last_clean":"2024-04-16T19:38:30.898392+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:38:30.898392+0000","last_undegraded":"2024-04-16T19:38:30.898392+0000","last_fullsized":"2024-04-16T19:38:30.898392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.898322+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:07.061769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'539","reported_seq":987,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.232436+0000","last_change":"2024-04-16T19:38:16.232495+0000","last_active":"2024-04-16T19:38:16.232436+0000","last_peered":"2024-04-16T19:38:16.232436+0000","last_clean":"2024-04-16T19:38:16.232436+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:38:16.232436+0000","last_undegraded":"2024-04-16T19:38:16.232436+0000","last_fullsized":"2024-04-16T19:38:16.232436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'539","last_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_deep_scrub":"53'539","last_deep_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.232375+0000","objects_scrubbed":21,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:46.553060+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7262,"num_omap_keys":33,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'16","reported_seq":388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.567303+0000","last_change":"2024-04-16T19:38:23.567350+0000","last_active":"2024-04-16T19:38:23.567303+0000","last_peered":"2024-04-16T19:38:23.567303+0000","last_clean":"2024-04-16T19:38:23.567303+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:38:23.567303+0000","last_undegraded":"2024-04-16T19:38:23.567303+0000","last_fullsized":"2024-04-16T19:38:23.567303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.567241+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:36.119901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.211545+0000","last_change":"2024-04-16T19:38:58.211568+0000","last_active":"2024-04-16T19:38:58.211545+0000","last_peered":"2024-04-16T19:38:58.211545+0000","last_clean":"2024-04-16T19:38:58.211545+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:38:58.211545+0000","last_undegraded":"2024-04-16T19:38:58.211545+0000","last_fullsized":"2024-04-16T19:38:58.211545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:58.211474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:58.211474+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.211474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:17.005454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401089+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:37:39.401089+0000","last_peered":"2024-04-16T19:37:39.401089+0000","last_clean":"2024-04-16T19:37:39.401089+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:37:39.401089+0000","last_undegraded":"2024-04-16T19:37:39.401089+0000","last_fullsized":"2024-04-16T19:37:39.401089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.201765+0000","last_change":"2024-04-16T19:39:04.201789+0000","last_active":"2024-04-16T19:39:04.201765+0000","last_peered":"2024-04-16T19:39:04.201765+0000","last_clean":"2024-04-16T19:39:04.201765+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:39:04.201765+0000","last_undegraded":"2024-04-16T19:39:04.201765+0000","last_fullsized":"2024-04-16T19:39:04.201765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.201701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.201701+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.201701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:58.707408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'159","reported_seq":361,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.773926+0000","last_change":"2024-04-16T19:39:03.773969+0000","last_active":"2024-04-16T19:39:03.773926+0000","last_peered":"2024-04-16T19:39:03.773926+0000","last_clean":"2024-04-16T19:39:03.773926+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:39:03.773926+0000","last_undegraded":"2024-04-16T19:39:03.773926+0000","last_fullsized":"2024-04-16T19:39:03.773926+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:03.773864+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:03.773864+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.773864+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:04.083969+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.319175+0000","last_change":"2024-04-16T19:38:57.319175+0000","last_active":"2024-04-16T19:38:57.319175+0000","last_peered":"2024-04-16T19:38:57.319175+0000","last_clean":"2024-04-16T19:38:57.319175+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:38:57.319175+0000","last_undegraded":"2024-04-16T19:38:57.319175+0000","last_fullsized":"2024-04-16T19:38:57.319175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.319084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.319084+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.319084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:57.063141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.923395+0000","last_change":"2024-04-16T19:38:31.923395+0000","last_active":"2024-04-16T19:38:31.923395+0000","last_peered":"2024-04-16T19:38:31.923395+0000","last_clean":"2024-04-16T19:38:31.923395+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:38:31.923395+0000","last_undegraded":"2024-04-16T19:38:31.923395+0000","last_fullsized":"2024-04-16T19:38:31.923395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.923306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:27.582944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593484+0000","last_change":"2024-04-16T18:09:02.169659+0000","last_active":"2024-04-16T19:37:44.593484+0000","last_peered":"2024-04-16T19:37:44.593484+0000","last_clean":"2024-04-16T19:37:44.593484+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:37:44.593484+0000","last_undegraded":"2024-04-16T19:37:44.593484+0000","last_fullsized":"2024-04-16T19:37:44.593484+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'166","reported_seq":2088,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.802004+0000","last_change":"2024-04-16T19:38:46.802047+0000","last_active":"2024-04-16T19:38:46.802004+0000","last_peered":"2024-04-16T19:38:46.802004+0000","last_clean":"2024-04-16T19:38:46.802004+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:38:46.802004+0000","last_undegraded":"2024-04-16T19:38:46.802004+0000","last_fullsized":"2024-04-16T19:38:46.802004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'166","last_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_deep_scrub":"53'166","last_deep_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.801945+0000","objects_scrubbed":47,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:24.936944+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9594,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.829487+0000","last_change":"2024-04-16T19:38:40.829513+0000","last_active":"2024-04-16T19:38:40.829487+0000","last_peered":"2024-04-16T19:38:40.829487+0000","last_clean":"2024-04-16T19:38:40.829487+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:38:40.829487+0000","last_undegraded":"2024-04-16T19:38:40.829487+0000","last_fullsized":"2024-04-16T19:38:40.829487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.829411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:01:00.975262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'4","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.356348+0000","last_change":"2024-04-16T19:38:43.356398+0000","last_active":"2024-04-16T19:38:43.356348+0000","last_peered":"2024-04-16T19:38:43.356348+0000","last_clean":"2024-04-16T19:38:43.356348+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:38:43.356348+0000","last_undegraded":"2024-04-16T19:38:43.356348+0000","last_fullsized":"2024-04-16T19:38:43.356348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.356286+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:53.006964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.056607+0000","last_change":"2024-04-16T19:38:13.056637+0000","last_active":"2024-04-16T19:38:13.056607+0000","last_peered":"2024-04-16T19:38:13.056607+0000","last_clean":"2024-04-16T19:38:13.056607+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:38:13.056607+0000","last_undegraded":"2024-04-16T19:38:13.056607+0000","last_fullsized":"2024-04-16T19:38:13.056607+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.056540+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:02.968001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'298","reported_seq":598,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.796439+0000","last_change":"2024-04-16T19:38:18.796507+0000","last_active":"2024-04-16T19:38:18.796439+0000","last_peered":"2024-04-16T19:38:18.796439+0000","last_clean":"2024-04-16T19:38:18.796439+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:38:18.796439+0000","last_undegraded":"2024-04-16T19:38:18.796439+0000","last_fullsized":"2024-04-16T19:38:18.796439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'298","last_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_deep_scrub":"53'298","last_deep_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.796372+0000","objects_scrubbed":17,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:20.964465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'22","reported_seq":391,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.891208+0000","last_change":"2024-04-16T19:38:13.891278+0000","last_active":"2024-04-16T19:38:13.891208+0000","last_peered":"2024-04-16T19:38:13.891208+0000","last_clean":"2024-04-16T19:38:13.891208+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:38:13.891208+0000","last_undegraded":"2024-04-16T19:38:13.891208+0000","last_fullsized":"2024-04-16T19:38:13.891208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.891146+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:21.530454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401584+0000","last_change":"2024-04-16T17:45:10.392781+0000","last_active":"2024-04-16T19:37:44.401584+0000","last_peered":"2024-04-16T19:37:44.401584+0000","last_clean":"2024-04-16T19:37:44.401584+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:37:44.401584+0000","last_undegraded":"2024-04-16T19:37:44.401584+0000","last_fullsized":"2024-04-16T19:37:44.401584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401129+0000","last_change":"2024-04-16T17:45:08.386175+0000","last_active":"2024-04-16T19:37:39.401129+0000","last_peered":"2024-04-16T19:37:39.401129+0000","last_clean":"2024-04-16T19:37:39.401129+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:37:39.401129+0000","last_undegraded":"2024-04-16T19:37:39.401129+0000","last_fullsized":"2024-04-16T19:37:39.401129+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"48'11","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403583+0000","last_change":"2024-04-16T17:45:20.407986+0000","last_active":"2024-04-16T19:37:54.403583+0000","last_peered":"2024-04-16T19:37:54.403583+0000","last_clean":"2024-04-16T19:37:54.403583+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:37:54.403583+0000","last_undegraded":"2024-04-16T19:37:54.403583+0000","last_fullsized":"2024-04-16T19:37:54.403583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.359086+0000","last_change":"2024-04-16T19:39:03.359148+0000","last_active":"2024-04-16T19:39:03.359086+0000","last_peered":"2024-04-16T19:39:03.359086+0000","last_clean":"2024-04-16T19:39:03.359086+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:39:03.359086+0000","last_undegraded":"2024-04-16T19:39:03.359086+0000","last_fullsized":"2024-04-16T19:39:03.359086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:39:03.359011+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:39:03.359011+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.359011+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:01:55.613704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.949908+0000","last_change":"2024-04-16T19:38:53.949931+0000","last_active":"2024-04-16T19:38:53.949908+0000","last_peered":"2024-04-16T19:38:53.949908+0000","last_clean":"2024-04-16T19:38:53.949908+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:38:53.949908+0000","last_undegraded":"2024-04-16T19:38:53.949908+0000","last_fullsized":"2024-04-16T19:38:53.949908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.949843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.949843+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.949843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:01.943632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.722443+0000","last_change":"2024-04-16T19:38:23.722443+0000","last_active":"2024-04-16T19:38:23.722443+0000","last_peered":"2024-04-16T19:38:23.722443+0000","last_clean":"2024-04-16T19:38:23.722443+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:38:23.722443+0000","last_undegraded":"2024-04-16T19:38:23.722443+0000","last_fullsized":"2024-04-16T19:38:23.722443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.722357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:38.742703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405131+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:37:44.405131+0000","last_peered":"2024-04-16T19:37:44.405131+0000","last_clean":"2024-04-16T19:37:44.405131+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:37:44.405131+0000","last_undegraded":"2024-04-16T19:37:44.405131+0000","last_fullsized":"2024-04-16T19:37:44.405131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'161","reported_seq":1777,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.064843+0000","last_change":"2024-04-16T19:38:41.064904+0000","last_active":"2024-04-16T19:38:41.064843+0000","last_peered":"2024-04-16T19:38:41.064843+0000","last_clean":"2024-04-16T19:38:41.064843+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:38:41.064843+0000","last_undegraded":"2024-04-16T19:38:41.064843+0000","last_fullsized":"2024-04-16T19:38:41.064843+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'161","last_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_deep_scrub":"53'161","last_deep_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.064780+0000","objects_scrubbed":41,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:59.693856+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9554,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.719529+0000","last_change":"2024-04-16T19:38:28.719553+0000","last_active":"2024-04-16T19:38:28.719529+0000","last_peered":"2024-04-16T19:38:28.719529+0000","last_clean":"2024-04-16T19:38:28.719529+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:38:28.719529+0000","last_undegraded":"2024-04-16T19:38:28.719529+0000","last_fullsized":"2024-04-16T19:38:28.719529+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:05.470964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'22","reported_seq":166,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.884097+0000","last_change":"2024-04-16T19:38:49.884129+0000","last_active":"2024-04-16T19:38:49.884097+0000","last_peered":"2024-04-16T19:38:49.884097+0000","last_clean":"2024-04-16T19:38:49.884097+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:38:49.884097+0000","last_undegraded":"2024-04-16T19:38:49.884097+0000","last_fullsized":"2024-04-16T19:38:49.884097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:49.884034+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:49.884034+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.884034+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:44.389740+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.923243+0000","last_change":"2024-04-16T19:38:51.923269+0000","last_active":"2024-04-16T19:38:51.923243+0000","last_peered":"2024-04-16T19:38:51.923243+0000","last_clean":"2024-04-16T19:38:51.923243+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:38:51.923243+0000","last_undegraded":"2024-04-16T19:38:51.923243+0000","last_fullsized":"2024-04-16T19:38:51.923243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:51.923171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:51.923171+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.923171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:40.361335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5056","reported_seq":7415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.911994+0000","last_change":"2024-04-16T19:38:24.912040+0000","last_active":"2024-04-16T19:38:24.911994+0000","last_peered":"2024-04-16T19:38:24.911994+0000","last_clean":"2024-04-16T19:38:24.911994+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:38:24.911994+0000","last_undegraded":"2024-04-16T19:38:24.911994+0000","last_fullsized":"2024-04-16T19:38:24.911994+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5056","last_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_deep_scrub":"53'5056","last_deep_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.911937+0000","objects_scrubbed":13,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:21.591600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'22","reported_seq":459,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.780629+0000","last_change":"2024-04-16T19:38:17.780675+0000","last_active":"2024-04-16T19:38:17.780629+0000","last_peered":"2024-04-16T19:38:17.780629+0000","last_clean":"2024-04-16T19:38:17.780629+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:38:17.780629+0000","last_undegraded":"2024-04-16T19:38:17.780629+0000","last_fullsized":"2024-04-16T19:38:17.780629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.780565+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:41.464784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068785+0000","last_change":"2024-04-16T17:45:10.397270+0000","last_active":"2024-04-16T19:38:08.068785+0000","last_peered":"2024-04-16T19:38:08.068785+0000","last_clean":"2024-04-16T19:38:08.068785+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:38:08.068785+0000","last_undegraded":"2024-04-16T19:38:08.068785+0000","last_fullsized":"2024-04-16T19:38:08.068785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:24.589689+0000","last_change":"2024-04-16T17:45:08.385404+0000","last_active":"2024-04-16T19:37:24.589689+0000","last_peered":"2024-04-16T19:37:24.589689+0000","last_clean":"2024-04-16T19:37:24.589689+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:37:24.589689+0000","last_undegraded":"2024-04-16T19:37:24.589689+0000","last_fullsized":"2024-04-16T19:37:24.589689+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'6","reported_seq":1406,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.886522+0000","last_change":"2024-04-16T17:45:20.413621+0000","last_active":"2024-04-16T19:38:09.886522+0000","last_peered":"2024-04-16T19:38:09.886522+0000","last_clean":"2024-04-16T19:38:09.886522+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:38:09.886522+0000","last_undegraded":"2024-04-16T19:38:09.886522+0000","last_fullsized":"2024-04-16T19:38:09.886522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'34","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.378953+0000","last_change":"2024-04-16T19:39:02.378981+0000","last_active":"2024-04-16T19:39:02.378953+0000","last_peered":"2024-04-16T19:39:02.378953+0000","last_clean":"2024-04-16T19:39:02.378953+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:39:02.378953+0000","last_undegraded":"2024-04-16T19:39:02.378953+0000","last_fullsized":"2024-04-16T19:39:02.378953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:39:02.378896+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:39:02.378896+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.378896+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:09.552301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.934976+0000","last_change":"2024-04-16T19:38:33.934997+0000","last_active":"2024-04-16T19:38:33.934976+0000","last_peered":"2024-04-16T19:38:33.934976+0000","last_clean":"2024-04-16T19:38:33.934976+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:38:33.934976+0000","last_undegraded":"2024-04-16T19:38:33.934976+0000","last_fullsized":"2024-04-16T19:38:33.934976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.934914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:28.582406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.875874+0000","last_change":"2024-04-16T19:38:26.875874+0000","last_active":"2024-04-16T19:38:26.875874+0000","last_peered":"2024-04-16T19:38:26.875874+0000","last_clean":"2024-04-16T19:38:26.875874+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:38:26.875874+0000","last_undegraded":"2024-04-16T19:38:26.875874+0000","last_fullsized":"2024-04-16T19:38:26.875874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.875781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:49.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.593702+0000","last_change":"2024-04-16T18:09:02.166083+0000","last_active":"2024-04-16T19:37:44.593702+0000","last_peered":"2024-04-16T19:37:44.593702+0000","last_clean":"2024-04-16T19:37:44.593702+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:37:44.593702+0000","last_undegraded":"2024-04-16T19:37:44.593702+0000","last_fullsized":"2024-04-16T19:37:44.593702+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'170","reported_seq":1771,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.011174+0000","last_change":"2024-04-16T19:38:49.011216+0000","last_active":"2024-04-16T19:38:49.011174+0000","last_peered":"2024-04-16T19:38:49.011174+0000","last_clean":"2024-04-16T19:38:49.011174+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:38:49.011174+0000","last_undegraded":"2024-04-16T19:38:49.011174+0000","last_fullsized":"2024-04-16T19:38:49.011174+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'170","last_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_deep_scrub":"53'170","last_deep_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.011115+0000","objects_scrubbed":44,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:08:02.979509+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10942,"num_omap_keys":44,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.751164+0000","last_change":"2024-04-16T19:38:30.751189+0000","last_active":"2024-04-16T19:38:30.751164+0000","last_peered":"2024-04-16T19:38:30.751164+0000","last_clean":"2024-04-16T19:38:30.751164+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:38:30.751164+0000","last_undegraded":"2024-04-16T19:38:30.751164+0000","last_fullsized":"2024-04-16T19:38:30.751164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.751094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:44.801073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'14","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.374218+0000","last_change":"2024-04-16T19:38:46.374254+0000","last_active":"2024-04-16T19:38:46.374218+0000","last_peered":"2024-04-16T19:38:46.374218+0000","last_clean":"2024-04-16T19:38:46.374218+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:38:46.374218+0000","last_undegraded":"2024-04-16T19:38:46.374218+0000","last_fullsized":"2024-04-16T19:38:46.374218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.374155+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:12.131396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.750099+0000","last_change":"2024-04-16T19:38:26.750144+0000","last_active":"2024-04-16T19:38:26.750099+0000","last_peered":"2024-04-16T19:38:26.750099+0000","last_clean":"2024-04-16T19:38:26.750099+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:38:26.750099+0000","last_undegraded":"2024-04-16T19:38:26.750099+0000","last_fullsized":"2024-04-16T19:38:26.750099+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.750020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:03.892413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'576","reported_seq":1558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.901548+0000","last_change":"2024-04-16T19:38:28.901634+0000","last_active":"2024-04-16T19:38:28.901548+0000","last_peered":"2024-04-16T19:38:28.901548+0000","last_clean":"2024-04-16T19:38:28.901548+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:38:28.901548+0000","last_undegraded":"2024-04-16T19:38:28.901548+0000","last_fullsized":"2024-04-16T19:38:28.901548+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'576","last_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_deep_scrub":"53'576","last_deep_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.901479+0000","objects_scrubbed":22,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:47.579102+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'11","reported_seq":531,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.330076+0000","last_change":"2024-04-16T19:38:39.330127+0000","last_active":"2024-04-16T19:38:39.330076+0000","last_peered":"2024-04-16T19:38:39.330076+0000","last_clean":"2024-04-16T19:38:39.330076+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:38:39.330076+0000","last_undegraded":"2024-04-16T19:38:39.330076+0000","last_fullsized":"2024-04-16T19:38:39.330076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.330010+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:11:17.064209+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.058744+0000","last_change":"2024-04-16T19:39:08.058781+0000","last_active":"2024-04-16T19:39:08.058744+0000","last_peered":"2024-04-16T19:39:08.058744+0000","last_clean":"2024-04-16T19:39:08.058744+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:39:08.058744+0000","last_undegraded":"2024-04-16T19:39:08.058744+0000","last_fullsized":"2024-04-16T19:39:08.058744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.058658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.058658+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.058658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:15.232062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404415+0000","last_change":"2024-04-16T17:45:08.386622+0000","last_active":"2024-04-16T19:37:39.404415+0000","last_peered":"2024-04-16T19:37:39.404415+0000","last_clean":"2024-04-16T19:37:39.404415+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:37:39.404415+0000","last_undegraded":"2024-04-16T19:37:39.404415+0000","last_fullsized":"2024-04-16T19:37:39.404415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"23'1","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:36:49.582442+0000","last_change":"2024-04-16T17:45:20.412420+0000","last_active":"2024-04-16T19:36:49.582442+0000","last_peered":"2024-04-16T19:36:49.582442+0000","last_clean":"2024-04-16T19:36:49.582442+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:36:49.582442+0000","last_undegraded":"2024-04-16T19:36:49.582442+0000","last_fullsized":"2024-04-16T19:36:49.582442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'84","reported_seq":249,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.359931+0000","last_change":"2024-04-16T19:38:52.359986+0000","last_active":"2024-04-16T19:38:52.359931+0000","last_peered":"2024-04-16T19:38:52.359931+0000","last_clean":"2024-04-16T19:38:52.359931+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:38:52.359931+0000","last_undegraded":"2024-04-16T19:38:52.359931+0000","last_fullsized":"2024-04-16T19:38:52.359931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:52.359856+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:52.359856+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.359856+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:57.288122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.397137+0000","last_change":"2024-04-16T19:38:50.397161+0000","last_active":"2024-04-16T19:38:50.397137+0000","last_peered":"2024-04-16T19:38:50.397137+0000","last_clean":"2024-04-16T19:38:50.397137+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:38:50.397137+0000","last_undegraded":"2024-04-16T19:38:50.397137+0000","last_fullsized":"2024-04-16T19:38:50.397137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.397068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.397068+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.397068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:47.446913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.316150+0000","last_change":"2024-04-16T19:38:41.316173+0000","last_active":"2024-04-16T19:38:41.316150+0000","last_peered":"2024-04-16T19:38:41.316150+0000","last_clean":"2024-04-16T19:38:41.316150+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:38:41.316150+0000","last_undegraded":"2024-04-16T19:38:41.316150+0000","last_fullsized":"2024-04-16T19:38:41.316150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.316087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:50:00.704252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'10","reported_seq":205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.211015+0000","last_change":"2024-04-16T19:38:36.211054+0000","last_active":"2024-04-16T19:38:36.211015+0000","last_peered":"2024-04-16T19:38:36.211015+0000","last_clean":"2024-04-16T19:38:36.211015+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:38:36.211015+0000","last_undegraded":"2024-04-16T19:38:36.211015+0000","last_fullsized":"2024-04-16T19:38:36.211015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.210953+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:18.456725+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.073046+0000","last_change":"2024-04-16T19:38:23.073046+0000","last_active":"2024-04-16T19:38:23.073046+0000","last_peered":"2024-04-16T19:38:23.073046+0000","last_clean":"2024-04-16T19:38:23.073046+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:38:23.073046+0000","last_undegraded":"2024-04-16T19:38:23.073046+0000","last_fullsized":"2024-04-16T19:38:23.073046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.072960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:19.149593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.400582+0000","last_change":"2024-04-16T17:45:08.383072+0000","last_active":"2024-04-16T19:37:39.400582+0000","last_peered":"2024-04-16T19:37:39.400582+0000","last_clean":"2024-04-16T19:37:39.400582+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:37:39.400582+0000","last_undegraded":"2024-04-16T19:37:39.400582+0000","last_fullsized":"2024-04-16T19:37:39.400582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'21","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.709521+0000","last_change":"2024-04-16T19:38:13.709521+0000","last_active":"2024-04-16T19:38:13.709521+0000","last_peered":"2024-04-16T19:38:13.709521+0000","last_clean":"2024-04-16T19:38:13.709521+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:38:13.709521+0000","last_undegraded":"2024-04-16T19:38:13.709521+0000","last_fullsized":"2024-04-16T19:38:13.709521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.709408+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:26.428610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.810806+0000","last_change":"2024-04-16T19:39:07.810827+0000","last_active":"2024-04-16T19:39:07.810806+0000","last_peered":"2024-04-16T19:39:07.810806+0000","last_clean":"2024-04-16T19:39:07.810806+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:39:07.810806+0000","last_undegraded":"2024-04-16T19:39:07.810806+0000","last_fullsized":"2024-04-16T19:39:07.810806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.810743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.810743+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.810743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:28.521482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.592600+0000","last_change":"2024-04-16T17:45:08.390555+0000","last_active":"2024-04-16T19:37:39.592600+0000","last_peered":"2024-04-16T19:37:39.592600+0000","last_clean":"2024-04-16T19:37:39.592600+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:37:39.592600+0000","last_undegraded":"2024-04-16T19:37:39.592600+0000","last_fullsized":"2024-04-16T19:37:39.592600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'26","reported_seq":487,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.777083+0000","last_change":"2024-04-16T19:38:15.777083+0000","last_active":"2024-04-16T19:38:15.777083+0000","last_peered":"2024-04-16T19:38:15.777083+0000","last_clean":"2024-04-16T19:38:15.777083+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:38:15.777083+0000","last_undegraded":"2024-04-16T19:38:15.777083+0000","last_fullsized":"2024-04-16T19:38:15.777083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.776944+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:01.810616+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403654+0000","last_change":"2024-04-16T17:45:10.400426+0000","last_active":"2024-04-16T19:37:54.403654+0000","last_peered":"2024-04-16T19:37:54.403654+0000","last_clean":"2024-04-16T19:37:54.403654+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:37:54.403654+0000","last_undegraded":"2024-04-16T19:37:54.403654+0000","last_fullsized":"2024-04-16T19:37:54.403654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.767299+0000","last_change":"2024-04-16T19:38:32.767299+0000","last_active":"2024-04-16T19:38:32.767299+0000","last_peered":"2024-04-16T19:38:32.767299+0000","last_clean":"2024-04-16T19:38:32.767299+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:38:32.767299+0000","last_undegraded":"2024-04-16T19:38:32.767299+0000","last_fullsized":"2024-04-16T19:38:32.767299+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:09.909599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'16","reported_seq":319,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.568053+0000","last_change":"2024-04-16T19:38:27.568053+0000","last_active":"2024-04-16T19:38:27.568053+0000","last_peered":"2024-04-16T19:38:27.568053+0000","last_clean":"2024-04-16T19:38:27.568053+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:38:27.568053+0000","last_undegraded":"2024-04-16T19:38:27.568053+0000","last_fullsized":"2024-04-16T19:38:27.568053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.567879+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:46.513343+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.595799+0000","last_change":"2024-04-16T17:45:10.394142+0000","last_active":"2024-04-16T19:37:54.595799+0000","last_peered":"2024-04-16T19:37:54.595799+0000","last_clean":"2024-04-16T19:37:54.595799+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:37:54.595799+0000","last_undegraded":"2024-04-16T19:37:54.595799+0000","last_fullsized":"2024-04-16T19:37:54.595799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407703+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:37:59.407703+0000","last_peered":"2024-04-16T19:37:59.407703+0000","last_clean":"2024-04-16T19:37:59.407703+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:37:59.407703+0000","last_undegraded":"2024-04-16T19:37:59.407703+0000","last_fullsized":"2024-04-16T19:37:59.407703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'12","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.763410+0000","last_change":"2024-04-16T19:38:21.763470+0000","last_active":"2024-04-16T19:38:21.763410+0000","last_peered":"2024-04-16T19:38:21.763410+0000","last_clean":"2024-04-16T19:38:21.763410+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:38:21.763410+0000","last_undegraded":"2024-04-16T19:38:21.763410+0000","last_fullsized":"2024-04-16T19:38:21.763410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.763344+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:36.589324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.006817+0000","last_change":"2024-04-16T19:39:02.006863+0000","last_active":"2024-04-16T19:39:02.006817+0000","last_peered":"2024-04-16T19:39:02.006817+0000","last_clean":"2024-04-16T19:39:02.006817+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:39:02.006817+0000","last_undegraded":"2024-04-16T19:39:02.006817+0000","last_fullsized":"2024-04-16T19:39:02.006817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.006726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.006726+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.006726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:40.141725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.406132+0000","last_change":"2024-04-16T17:45:08.390961+0000","last_active":"2024-04-16T19:37:49.406132+0000","last_peered":"2024-04-16T19:37:49.406132+0000","last_clean":"2024-04-16T19:37:49.406132+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:37:49.406132+0000","last_undegraded":"2024-04-16T19:37:49.406132+0000","last_fullsized":"2024-04-16T19:37:49.406132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'60","reported_seq":651,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.053558+0000","last_change":"2024-04-16T19:38:16.053634+0000","last_active":"2024-04-16T19:38:16.053558+0000","last_peered":"2024-04-16T19:38:16.053558+0000","last_clean":"2024-04-16T19:38:16.053558+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:38:16.053558+0000","last_undegraded":"2024-04-16T19:38:16.053558+0000","last_fullsized":"2024-04-16T19:38:16.053558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'60","last_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_deep_scrub":"53'60","last_deep_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.053490+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:25:34.189324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.151849+0000","last_change":"2024-04-16T19:39:09.151872+0000","last_active":"2024-04-16T19:39:09.151849+0000","last_peered":"2024-04-16T19:39:09.151849+0000","last_clean":"2024-04-16T19:39:09.151849+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:39:09.151849+0000","last_undegraded":"2024-04-16T19:39:09.151849+0000","last_fullsized":"2024-04-16T19:39:09.151849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:09.151786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:09.151786+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.151786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:17.029197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594801+0000","last_change":"2024-04-16T17:45:08.382445+0000","last_active":"2024-04-16T19:37:49.594801+0000","last_peered":"2024-04-16T19:37:49.594801+0000","last_clean":"2024-04-16T19:37:49.594801+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:37:49.594801+0000","last_undegraded":"2024-04-16T19:37:49.594801+0000","last_fullsized":"2024-04-16T19:37:49.594801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'12","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.823687+0000","last_change":"2024-04-16T19:38:16.823687+0000","last_active":"2024-04-16T19:38:16.823687+0000","last_peered":"2024-04-16T19:38:16.823687+0000","last_clean":"2024-04-16T19:38:16.823687+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:38:16.823687+0000","last_undegraded":"2024-04-16T19:38:16.823687+0000","last_fullsized":"2024-04-16T19:38:16.823687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.823588+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:26.463012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.733389+0000","last_change":"2024-04-16T19:39:03.733431+0000","last_active":"2024-04-16T19:39:03.733389+0000","last_peered":"2024-04-16T19:39:03.733389+0000","last_clean":"2024-04-16T19:39:03.733389+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:39:03.733389+0000","last_undegraded":"2024-04-16T19:39:03.733389+0000","last_fullsized":"2024-04-16T19:39:03.733389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.733308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.733308+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.733308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:30.521077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.403371+0000","last_change":"2024-04-16T17:45:08.388353+0000","last_active":"2024-04-16T19:37:49.403371+0000","last_peered":"2024-04-16T19:37:49.403371+0000","last_clean":"2024-04-16T19:37:49.403371+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:37:49.403371+0000","last_undegraded":"2024-04-16T19:37:49.403371+0000","last_fullsized":"2024-04-16T19:37:49.403371+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'22","reported_seq":550,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.076687+0000","last_change":"2024-04-16T19:38:20.076687+0000","last_active":"2024-04-16T19:38:20.076687+0000","last_peered":"2024-04-16T19:38:20.076687+0000","last_clean":"2024-04-16T19:38:20.076687+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:38:20.076687+0000","last_undegraded":"2024-04-16T19:38:20.076687+0000","last_fullsized":"2024-04-16T19:38:20.076687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.076549+0000","objects_scrubbed":11,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:18.065057+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402514+0000","last_change":"2024-04-16T17:45:10.393085+0000","last_active":"2024-04-16T19:37:44.402514+0000","last_peered":"2024-04-16T19:37:44.402514+0000","last_clean":"2024-04-16T19:37:44.402514+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:37:44.402514+0000","last_undegraded":"2024-04-16T19:37:44.402514+0000","last_fullsized":"2024-04-16T19:37:44.402514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.594821+0000","last_change":"2024-04-16T17:45:08.387778+0000","last_active":"2024-04-16T19:37:49.594821+0000","last_peered":"2024-04-16T19:37:49.594821+0000","last_clean":"2024-04-16T19:37:49.594821+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:37:49.594821+0000","last_undegraded":"2024-04-16T19:37:49.594821+0000","last_fullsized":"2024-04-16T19:37:49.594821+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'12","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.964569+0000","last_change":"2024-04-16T19:38:19.964623+0000","last_active":"2024-04-16T19:38:19.964569+0000","last_peered":"2024-04-16T19:38:19.964569+0000","last_clean":"2024-04-16T19:38:19.964569+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:38:19.964569+0000","last_undegraded":"2024-04-16T19:38:19.964569+0000","last_fullsized":"2024-04-16T19:38:19.964569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.964501+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:39:19.709359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.400360+0000","last_change":"2024-04-16T17:45:10.397793+0000","last_active":"2024-04-16T19:37:14.400360+0000","last_peered":"2024-04-16T19:37:14.400360+0000","last_clean":"2024-04-16T19:37:14.400360+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:37:14.400360+0000","last_undegraded":"2024-04-16T19:37:14.400360+0000","last_fullsized":"2024-04-16T19:37:14.400360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.405930+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:38:09.405930+0000","last_peered":"2024-04-16T19:38:09.405930+0000","last_clean":"2024-04-16T19:38:09.405930+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:38:09.405930+0000","last_undegraded":"2024-04-16T19:38:09.405930+0000","last_fullsized":"2024-04-16T19:38:09.405930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'11","reported_seq":380,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.008833+0000","last_change":"2024-04-16T19:38:44.008897+0000","last_active":"2024-04-16T19:38:44.008833+0000","last_peered":"2024-04-16T19:38:44.008833+0000","last_clean":"2024-04-16T19:38:44.008833+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:38:44.008833+0000","last_undegraded":"2024-04-16T19:38:44.008833+0000","last_fullsized":"2024-04-16T19:38:44.008833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.008768+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:20.760273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:14.396785+0000","last_change":"2024-04-16T17:45:10.390881+0000","last_active":"2024-04-16T19:37:14.396785+0000","last_peered":"2024-04-16T19:37:14.396785+0000","last_clean":"2024-04-16T19:37:14.396785+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:37:14.396785+0000","last_undegraded":"2024-04-16T19:37:14.396785+0000","last_fullsized":"2024-04-16T19:37:14.396785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404236+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:37:39.404236+0000","last_peered":"2024-04-16T19:37:39.404236+0000","last_clean":"2024-04-16T19:37:39.404236+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:37:39.404236+0000","last_undegraded":"2024-04-16T19:37:39.404236+0000","last_fullsized":"2024-04-16T19:37:39.404236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'20","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.253495+0000","last_change":"2024-04-16T19:38:09.253495+0000","last_active":"2024-04-16T19:38:09.253495+0000","last_peered":"2024-04-16T19:38:09.253495+0000","last_clean":"2024-04-16T19:38:09.253495+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:38:09.253495+0000","last_undegraded":"2024-04-16T19:38:09.253495+0000","last_fullsized":"2024-04-16T19:38:09.253495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.253410+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:49.003227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.014665+0000","last_change":"2024-04-16T19:39:04.014686+0000","last_active":"2024-04-16T19:39:04.014665+0000","last_peered":"2024-04-16T19:39:04.014665+0000","last_clean":"2024-04-16T19:39:04.014665+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:39:04.014665+0000","last_undegraded":"2024-04-16T19:39:04.014665+0000","last_fullsized":"2024-04-16T19:39:04.014665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.014599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.014599+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.014599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:04.130956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401022+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:37:39.401022+0000","last_peered":"2024-04-16T19:37:39.401022+0000","last_clean":"2024-04-16T19:37:39.401022+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:37:39.401022+0000","last_undegraded":"2024-04-16T19:37:39.401022+0000","last_fullsized":"2024-04-16T19:37:39.401022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'20","reported_seq":697,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.162796+0000","last_change":"2024-04-16T19:38:38.162842+0000","last_active":"2024-04-16T19:38:38.162796+0000","last_peered":"2024-04-16T19:38:38.162796+0000","last_clean":"2024-04-16T19:38:38.162796+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:38:38.162796+0000","last_undegraded":"2024-04-16T19:38:38.162796+0000","last_fullsized":"2024-04-16T19:38:38.162796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.162737+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:17.912553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.402625+0000","last_change":"2024-04-16T17:45:10.390598+0000","last_active":"2024-04-16T19:37:44.402625+0000","last_peered":"2024-04-16T19:37:44.402625+0000","last_clean":"2024-04-16T19:37:44.402625+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:37:44.402625+0000","last_undegraded":"2024-04-16T19:37:44.402625+0000","last_fullsized":"2024-04-16T19:37:44.402625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404301+0000","last_change":"2024-04-16T17:45:08.389493+0000","last_active":"2024-04-16T19:37:39.404301+0000","last_peered":"2024-04-16T19:37:39.404301+0000","last_clean":"2024-04-16T19:37:39.404301+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:37:39.404301+0000","last_undegraded":"2024-04-16T19:37:39.404301+0000","last_fullsized":"2024-04-16T19:37:39.404301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'22","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.813299+0000","last_change":"2024-04-16T19:38:17.813299+0000","last_active":"2024-04-16T19:38:17.813299+0000","last_peered":"2024-04-16T19:38:17.813299+0000","last_clean":"2024-04-16T19:38:17.813299+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:38:17.813299+0000","last_undegraded":"2024-04-16T19:38:17.813299+0000","last_fullsized":"2024-04-16T19:38:17.813299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.813183+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:32.833529+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.249733+0000","last_change":"2024-04-16T19:38:59.249757+0000","last_active":"2024-04-16T19:38:59.249733+0000","last_peered":"2024-04-16T19:38:59.249733+0000","last_clean":"2024-04-16T19:38:59.249733+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:38:59.249733+0000","last_undegraded":"2024-04-16T19:38:59.249733+0000","last_fullsized":"2024-04-16T19:38:59.249733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:59.249670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:59.249670+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.249670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:18.048162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401915+0000","last_change":"2024-04-16T17:45:08.386399+0000","last_active":"2024-04-16T19:37:39.401915+0000","last_peered":"2024-04-16T19:37:39.401915+0000","last_clean":"2024-04-16T19:37:39.401915+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:37:39.401915+0000","last_undegraded":"2024-04-16T19:37:39.401915+0000","last_fullsized":"2024-04-16T19:37:39.401915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'6","reported_seq":160,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.113419+0000","last_change":"2024-04-16T19:38:39.113484+0000","last_active":"2024-04-16T19:38:39.113419+0000","last_peered":"2024-04-16T19:38:39.113419+0000","last_clean":"2024-04-16T19:38:39.113419+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:38:39.113419+0000","last_undegraded":"2024-04-16T19:38:39.113419+0000","last_fullsized":"2024-04-16T19:38:39.113419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.113342+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:41.646707+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405149+0000","last_change":"2024-04-16T17:45:10.393634+0000","last_active":"2024-04-16T19:37:44.405149+0000","last_peered":"2024-04-16T19:37:44.405149+0000","last_clean":"2024-04-16T19:37:44.405149+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:37:44.405149+0000","last_undegraded":"2024-04-16T19:37:44.405149+0000","last_fullsized":"2024-04-16T19:37:44.405149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404832+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:37:59.404832+0000","last_peered":"2024-04-16T19:37:59.404832+0000","last_clean":"2024-04-16T19:37:59.404832+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:37:59.404832+0000","last_undegraded":"2024-04-16T19:37:59.404832+0000","last_fullsized":"2024-04-16T19:37:59.404832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'16","reported_seq":465,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.016697+0000","last_change":"2024-04-16T19:38:43.016743+0000","last_active":"2024-04-16T19:38:43.016697+0000","last_peered":"2024-04-16T19:38:43.016697+0000","last_clean":"2024-04-16T19:38:43.016697+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:38:43.016697+0000","last_undegraded":"2024-04-16T19:38:43.016697+0000","last_fullsized":"2024-04-16T19:38:43.016697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.016634+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:57.842614+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.755375+0000","last_change":"2024-04-16T19:39:01.755399+0000","last_active":"2024-04-16T19:39:01.755375+0000","last_peered":"2024-04-16T19:39:01.755375+0000","last_clean":"2024-04-16T19:39:01.755375+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:39:01.755375+0000","last_undegraded":"2024-04-16T19:39:01.755375+0000","last_fullsized":"2024-04-16T19:39:01.755375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:01.755309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:01.755309+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.755309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:07.367058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586630+0000","last_change":"2024-04-16T17:45:08.388974+0000","last_active":"2024-04-16T19:37:09.586630+0000","last_peered":"2024-04-16T19:37:09.586630+0000","last_clean":"2024-04-16T19:37:09.586630+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:37:09.586630+0000","last_undegraded":"2024-04-16T19:37:09.586630+0000","last_fullsized":"2024-04-16T19:37:09.586630+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'6","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.208756+0000","last_change":"2024-04-16T19:38:10.208756+0000","last_active":"2024-04-16T19:38:10.208756+0000","last_peered":"2024-04-16T19:38:10.208756+0000","last_clean":"2024-04-16T19:38:10.208756+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:38:10.208756+0000","last_undegraded":"2024-04-16T19:38:10.208756+0000","last_fullsized":"2024-04-16T19:38:10.208756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.208682+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:12.742047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428704+0000","last_change":"2024-04-16T17:45:10.392230+0000","last_active":"2024-04-16T19:38:09.428704+0000","last_peered":"2024-04-16T19:38:09.428704+0000","last_clean":"2024-04-16T19:38:09.428704+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:38:09.428704+0000","last_undegraded":"2024-04-16T19:38:09.428704+0000","last_fullsized":"2024-04-16T19:38:09.428704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.396977+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:37:09.396977+0000","last_peered":"2024-04-16T19:37:09.396977+0000","last_clean":"2024-04-16T19:37:09.396977+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:37:09.396977+0000","last_undegraded":"2024-04-16T19:37:09.396977+0000","last_fullsized":"2024-04-16T19:37:09.396977+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'14","reported_seq":334,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.249652+0000","last_change":"2024-04-16T19:38:08.249652+0000","last_active":"2024-04-16T19:38:08.249652+0000","last_peered":"2024-04-16T19:38:08.249652+0000","last_clean":"2024-04-16T19:38:08.249652+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:38:08.249652+0000","last_undegraded":"2024-04-16T19:38:08.249652+0000","last_fullsized":"2024-04-16T19:38:08.249652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.249524+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:54.283196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.397305+0000","last_change":"2024-04-16T17:45:08.386818+0000","last_active":"2024-04-16T19:37:09.397305+0000","last_peered":"2024-04-16T19:37:09.397305+0000","last_clean":"2024-04-16T19:37:09.397305+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:37:09.397305+0000","last_undegraded":"2024-04-16T19:37:09.397305+0000","last_fullsized":"2024-04-16T19:37:09.397305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068993+0000","last_change":"2024-04-16T17:45:10.391395+0000","last_active":"2024-04-16T19:38:08.068993+0000","last_peered":"2024-04-16T19:38:08.068993+0000","last_clean":"2024-04-16T19:38:08.068993+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:38:08.068993+0000","last_undegraded":"2024-04-16T19:38:08.068993+0000","last_fullsized":"2024-04-16T19:38:08.068993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'40","reported_seq":775,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.113737+0000","last_change":"2024-04-16T19:38:19.113737+0000","last_active":"2024-04-16T19:38:19.113737+0000","last_peered":"2024-04-16T19:38:19.113737+0000","last_clean":"2024-04-16T19:38:19.113737+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:38:19.113737+0000","last_undegraded":"2024-04-16T19:38:19.113737+0000","last_fullsized":"2024-04-16T19:38:19.113737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'40","last_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_deep_scrub":"53'40","last_deep_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.113599+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:04:11.281022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":132,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:09.586482+0000","last_change":"2024-04-16T17:45:08.389341+0000","last_active":"2024-04-16T19:37:09.586482+0000","last_peered":"2024-04-16T19:37:09.586482+0000","last_clean":"2024-04-16T19:37:09.586482+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:37:09.586482+0000","last_undegraded":"2024-04-16T19:37:09.586482+0000","last_fullsized":"2024-04-16T19:37:09.586482+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338914+0000","last_change":"2024-04-16T17:45:10.395147+0000","last_active":"2024-04-16T19:38:10.338914+0000","last_peered":"2024-04-16T19:38:10.338914+0000","last_clean":"2024-04-16T19:38:10.338914+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:38:10.338914+0000","last_undegraded":"2024-04-16T19:38:10.338914+0000","last_fullsized":"2024-04-16T19:38:10.338914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":246112,"num_omap_keys":998,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5181,"ondisk_log_size":5181,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3872,"ondisk_log_size":3872,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1194,"ondisk_log_size":1194,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":365336,"num_omap_keys":1682,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21506,"ondisk_log_size":21506,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5237,"ondisk_log_size":5237,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9817,"num_omap_keys":62,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":608,"ondisk_log_size":608,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641637,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46644,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104810956,"statfs":{"total":107374182400,"available":107326418944,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641636,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46504,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811096,"statfs":{"total":107374182400,"available":107326562304,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641637,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":87628,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":104769972,"statfs":{"total":107374182400,"available":107284451328,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641637,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50956,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806644,"statfs":{"total":107374182400,"available":107322003456,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641636,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50932,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806668,"statfs":{"total":107374182400,"available":107322028032,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641637,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":55680,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":104801920,"statfs":{"total":107374182400,"available":107317166080,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:39:12.172 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.172 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.172 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.172 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.173 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.173 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.173 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.173 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.173 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.174 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.174 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.174 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.174 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.174 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.175 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.175 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.175 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.175 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.175 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.175 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.176 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.176 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.176 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.176 INFO:tasks.ceph:pgid 15.1e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.176 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.177 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.177 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.177 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.177 INFO:tasks.ceph:pgid 15.1d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.177 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.178 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.178 INFO:tasks.ceph:pgid 15.1c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.178 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.178 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.179 INFO:tasks.ceph:pgid 15.3 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.179 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.179 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.179 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.179 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.179 INFO:tasks.ceph:pgid 15.2 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.180 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.180 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.180 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.180 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.181 INFO:tasks.ceph:pgid 15.0 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.181 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.181 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.181 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.181 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.182 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.182 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.182 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.182 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.182 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.183 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.183 INFO:tasks.ceph:pgid 15.4 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.183 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.183 INFO:tasks.ceph:pgid 15.e last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.184 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.184 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-16T17:44:20.155639+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=20, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.184 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.184 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.184 INFO:tasks.ceph:pgid 15.d last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.185 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.185 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.185 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.185 INFO:tasks.ceph:pgid 14.d last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.185 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.186 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.186 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.186 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.186 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.186 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.187 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.187 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.187 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.187 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.187 INFO:tasks.ceph:pgid 15.8 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.188 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.188 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.188 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.188 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.188 INFO:tasks.ceph:pgid 15.b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.189 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.189 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.189 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.189 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.189 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.190 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.190 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.190 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.190 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.190 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.191 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.191 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.191 INFO:tasks.ceph:pgid 15.19 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.191 INFO:tasks.ceph:pgid 14.18 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.191 INFO:tasks.ceph:pgid 12.1a last_scrub_stamp 2024-04-16T17:45:50.455082+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=50, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.192 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.192 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.192 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.192 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.192 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-16T17:45:21.399415+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.193 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.193 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.193 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.193 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.193 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.194 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.194 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.194 INFO:tasks.ceph:pgid 9.13 last_scrub_stamp 2024-04-16T17:45:44.434043+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=44, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.194 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.194 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.195 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.195 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.195 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.195 INFO:tasks.ceph:pgid 15.17 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.196 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.196 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.196 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.196 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.196 INFO:tasks.ceph:pgid 15.11 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.197 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.197 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.197 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.197 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.197 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.198 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.198 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.198 INFO:tasks.ceph:pgid 15.13 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.198 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.199 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.199 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.199 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.199 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.199 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.199 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.200 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.200 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.200 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.200 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.200 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.201 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.201 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.201 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.201 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.201 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.201 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.202 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.202 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.202 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.202 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.202 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.203 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.203 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.203 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.203 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.203 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.203 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:12.204 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T19:39:32.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:39:32.562 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:39:32.590 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3502,"stamp":"2024-04-16T19:39:30.536442+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":643428,"num_omap_keys":2832,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38084,"ondisk_log_size":38084,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":364648,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":353462,"kb_avail":628780952,"statfs":{"total":644245094400,"available":643871694848,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":361945761},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11398,"num_omap_keys":46,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005441"},"pg_stats":[{"pgid":"9.35","version":"53'26","reported_seq":534,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.834693+0000","last_change":"2024-04-16T19:38:15.834693+0000","last_active":"2024-04-16T19:38:15.834693+0000","last_peered":"2024-04-16T19:38:15.834693+0000","last_clean":"2024-04-16T19:38:15.834693+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:38:15.834693+0000","last_undegraded":"2024-04-16T19:38:15.834693+0000","last_fullsized":"2024-04-16T19:38:15.834693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.834573+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:46.410400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.006538+0000","last_change":"2024-04-16T19:39:26.006563+0000","last_active":"2024-04-16T19:39:26.006538+0000","last_peered":"2024-04-16T19:39:26.006538+0000","last_clean":"2024-04-16T19:39:26.006538+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:39:26.006538+0000","last_undegraded":"2024-04-16T19:39:26.006538+0000","last_fullsized":"2024-04-16T19:39:26.006538+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.006461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.006461+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.006461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:24.268051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.571091+0000","last_change":"2024-04-16T19:39:24.571112+0000","last_active":"2024-04-16T19:39:24.571091+0000","last_peered":"2024-04-16T19:39:24.571091+0000","last_clean":"2024-04-16T19:39:24.571091+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:39:24.571091+0000","last_undegraded":"2024-04-16T19:39:24.571091+0000","last_fullsized":"2024-04-16T19:39:24.571091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.571025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.571025+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.571025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:42.757850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'12","reported_seq":304,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.799846+0000","last_change":"2024-04-16T19:38:20.799846+0000","last_active":"2024-04-16T19:38:20.799846+0000","last_peered":"2024-04-16T19:38:20.799846+0000","last_clean":"2024-04-16T19:38:20.799846+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:38:20.799846+0000","last_undegraded":"2024-04-16T19:38:20.799846+0000","last_fullsized":"2024-04-16T19:38:20.799846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.799730+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:28.459361+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.776412+0000","last_change":"2024-04-16T19:39:18.776434+0000","last_active":"2024-04-16T19:39:18.776412+0000","last_peered":"2024-04-16T19:39:18.776412+0000","last_clean":"2024-04-16T19:39:18.776412+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:39:18.776412+0000","last_undegraded":"2024-04-16T19:39:18.776412+0000","last_fullsized":"2024-04-16T19:39:18.776412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.776349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.776349+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.776349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:19:44.335738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.080154+0000","last_change":"2024-04-16T19:39:19.080178+0000","last_active":"2024-04-16T19:39:19.080154+0000","last_peered":"2024-04-16T19:39:19.080154+0000","last_clean":"2024-04-16T19:39:19.080154+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:39:19.080154+0000","last_undegraded":"2024-04-16T19:39:19.080154+0000","last_fullsized":"2024-04-16T19:39:19.080154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.080084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.080084+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.080084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:12:15.470756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'13","reported_seq":275,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.533976+0000","last_change":"2024-04-16T19:38:20.534037+0000","last_active":"2024-04-16T19:38:20.533976+0000","last_peered":"2024-04-16T19:38:20.533976+0000","last_clean":"2024-04-16T19:38:20.533976+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:38:20.533976+0000","last_undegraded":"2024-04-16T19:38:20.533976+0000","last_fullsized":"2024-04-16T19:38:20.533976+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.533905+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:22.838173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.356218+0000","last_change":"2024-04-16T19:39:27.356243+0000","last_active":"2024-04-16T19:39:27.356218+0000","last_peered":"2024-04-16T19:39:27.356218+0000","last_clean":"2024-04-16T19:39:27.356218+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:39:27.356218+0000","last_undegraded":"2024-04-16T19:39:27.356218+0000","last_fullsized":"2024-04-16T19:39:27.356218+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:27.356152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:27.356152+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.356152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:11:46.717559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.138870+0000","last_change":"2024-04-16T19:39:11.138892+0000","last_active":"2024-04-16T19:39:11.138870+0000","last_peered":"2024-04-16T19:39:11.138870+0000","last_clean":"2024-04-16T19:39:11.138870+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:39:11.138870+0000","last_undegraded":"2024-04-16T19:39:11.138870+0000","last_fullsized":"2024-04-16T19:39:11.138870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.138810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.138810+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.138810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:13.729644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'14","reported_seq":263,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.837803+0000","last_change":"2024-04-16T19:38:11.837803+0000","last_active":"2024-04-16T19:38:11.837803+0000","last_peered":"2024-04-16T19:38:11.837803+0000","last_clean":"2024-04-16T19:38:11.837803+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:38:11.837803+0000","last_undegraded":"2024-04-16T19:38:11.837803+0000","last_fullsized":"2024-04-16T19:38:11.837803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.837694+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:14.141962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338784+0000","last_change":"2024-04-16T17:45:08.384924+0000","last_active":"2024-04-16T19:38:10.338784+0000","last_peered":"2024-04-16T19:38:10.338784+0000","last_clean":"2024-04-16T19:38:10.338784+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:38:10.338784+0000","last_undegraded":"2024-04-16T19:38:10.338784+0000","last_fullsized":"2024-04-16T19:38:10.338784+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.338807+0000","last_change":"2024-04-16T19:39:20.338832+0000","last_active":"2024-04-16T19:39:20.338807+0000","last_peered":"2024-04-16T19:39:20.338807+0000","last_clean":"2024-04-16T19:39:20.338807+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:39:20.338807+0000","last_undegraded":"2024-04-16T19:39:20.338807+0000","last_fullsized":"2024-04-16T19:39:20.338807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.338741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.338741+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.338741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:27.750846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'14","reported_seq":531,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.397609+0000","last_change":"2024-04-16T19:38:37.397680+0000","last_active":"2024-04-16T19:38:37.397609+0000","last_peered":"2024-04-16T19:38:37.397609+0000","last_clean":"2024-04-16T19:38:37.397609+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:38:37.397609+0000","last_undegraded":"2024-04-16T19:38:37.397609+0000","last_fullsized":"2024-04-16T19:38:37.397609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.397526+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:07.718210+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401891+0000","last_change":"2024-04-16T17:45:08.380381+0000","last_active":"2024-04-16T19:37:39.401891+0000","last_peered":"2024-04-16T19:37:39.401891+0000","last_clean":"2024-04-16T19:37:39.401891+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:37:39.401891+0000","last_undegraded":"2024-04-16T19:37:39.401891+0000","last_fullsized":"2024-04-16T19:37:39.401891+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.502872+0000","last_change":"2024-04-16T19:39:20.502919+0000","last_active":"2024-04-16T19:39:20.502872+0000","last_peered":"2024-04-16T19:39:20.502872+0000","last_clean":"2024-04-16T19:39:20.502872+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:39:20.502872+0000","last_undegraded":"2024-04-16T19:39:20.502872+0000","last_fullsized":"2024-04-16T19:39:20.502872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.502791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.502791+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.502791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:12:16.893463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'16","reported_seq":332,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.177690+0000","last_change":"2024-04-16T19:38:15.177758+0000","last_active":"2024-04-16T19:38:15.177690+0000","last_peered":"2024-04-16T19:38:15.177690+0000","last_clean":"2024-04-16T19:38:15.177690+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:38:15.177690+0000","last_undegraded":"2024-04-16T19:38:15.177690+0000","last_fullsized":"2024-04-16T19:38:15.177690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.177626+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:51.929131+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.757121+0000","last_change":"2024-04-16T19:38:31.757121+0000","last_active":"2024-04-16T19:38:31.757121+0000","last_peered":"2024-04-16T19:38:31.757121+0000","last_clean":"2024-04-16T19:38:31.757121+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:38:31.757121+0000","last_undegraded":"2024-04-16T19:38:31.757121+0000","last_fullsized":"2024-04-16T19:38:31.757121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.757048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:06.731328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.189103+0000","last_change":"2024-04-16T19:39:03.189145+0000","last_active":"2024-04-16T19:39:03.189103+0000","last_peered":"2024-04-16T19:39:03.189103+0000","last_clean":"2024-04-16T19:39:03.189103+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:39:03.189103+0000","last_undegraded":"2024-04-16T19:39:03.189103+0000","last_fullsized":"2024-04-16T19:39:03.189103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.189030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.189030+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.189030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:13:40.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'16","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.885941+0000","last_change":"2024-04-16T19:38:15.885941+0000","last_active":"2024-04-16T19:38:15.885941+0000","last_peered":"2024-04-16T19:38:15.885941+0000","last_clean":"2024-04-16T19:38:15.885941+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:38:15.885941+0000","last_undegraded":"2024-04-16T19:38:15.885941+0000","last_fullsized":"2024-04-16T19:38:15.885941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.885831+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:24.282989+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.039586+0000","last_change":"2024-04-16T19:39:24.039610+0000","last_active":"2024-04-16T19:39:24.039586+0000","last_peered":"2024-04-16T19:39:24.039586+0000","last_clean":"2024-04-16T19:39:24.039586+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:39:24.039586+0000","last_undegraded":"2024-04-16T19:39:24.039586+0000","last_fullsized":"2024-04-16T19:39:24.039586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.039520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.039520+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.039520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:23.799318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.543438+0000","last_change":"2024-04-16T19:39:22.543459+0000","last_active":"2024-04-16T19:39:22.543438+0000","last_peered":"2024-04-16T19:39:22.543438+0000","last_clean":"2024-04-16T19:39:22.543438+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:39:22.543438+0000","last_undegraded":"2024-04-16T19:39:22.543438+0000","last_fullsized":"2024-04-16T19:39:22.543438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.543376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.543376+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.543376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:08:22.782651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'12","reported_seq":445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.407660+0000","last_change":"2024-04-16T19:38:36.407728+0000","last_active":"2024-04-16T19:38:36.407660+0000","last_peered":"2024-04-16T19:38:36.407660+0000","last_clean":"2024-04-16T19:38:36.407660+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:38:36.407660+0000","last_undegraded":"2024-04-16T19:38:36.407660+0000","last_fullsized":"2024-04-16T19:38:36.407660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.407586+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:13.159091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.176659+0000","last_change":"2024-04-16T19:39:18.176683+0000","last_active":"2024-04-16T19:39:18.176659+0000","last_peered":"2024-04-16T19:39:18.176659+0000","last_clean":"2024-04-16T19:39:18.176659+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:39:18.176659+0000","last_undegraded":"2024-04-16T19:39:18.176659+0000","last_fullsized":"2024-04-16T19:39:18.176659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.176592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.176592+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.176592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:20.767426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.011513+0000","last_change":"2024-04-16T19:38:56.011535+0000","last_active":"2024-04-16T19:38:56.011513+0000","last_peered":"2024-04-16T19:38:56.011513+0000","last_clean":"2024-04-16T19:38:56.011513+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:38:56.011513+0000","last_undegraded":"2024-04-16T19:38:56.011513+0000","last_fullsized":"2024-04-16T19:38:56.011513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.011447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.011447+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.011447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:15.869930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'10","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.728428+0000","last_change":"2024-04-16T19:38:23.728493+0000","last_active":"2024-04-16T19:38:23.728428+0000","last_peered":"2024-04-16T19:38:23.728428+0000","last_clean":"2024-04-16T19:38:23.728428+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:38:23.728428+0000","last_undegraded":"2024-04-16T19:38:23.728428+0000","last_fullsized":"2024-04-16T19:38:23.728428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.728366+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:54.049051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.222464+0000","last_change":"2024-04-16T19:39:07.222497+0000","last_active":"2024-04-16T19:39:07.222464+0000","last_peered":"2024-04-16T19:39:07.222464+0000","last_clean":"2024-04-16T19:39:07.222464+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:39:07.222464+0000","last_undegraded":"2024-04-16T19:39:07.222464+0000","last_fullsized":"2024-04-16T19:39:07.222464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.222403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.222403+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.222403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:51.142357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.042707+0000","last_change":"2024-04-16T19:39:11.042750+0000","last_active":"2024-04-16T19:39:11.042707+0000","last_peered":"2024-04-16T19:39:11.042707+0000","last_clean":"2024-04-16T19:39:11.042707+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:39:11.042707+0000","last_undegraded":"2024-04-16T19:39:11.042707+0000","last_fullsized":"2024-04-16T19:39:11.042707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.042628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.042628+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.042628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:26.063397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'12","reported_seq":363,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.931333+0000","last_change":"2024-04-16T19:38:17.931378+0000","last_active":"2024-04-16T19:38:17.931333+0000","last_peered":"2024-04-16T19:38:17.931333+0000","last_clean":"2024-04-16T19:38:17.931333+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:38:17.931333+0000","last_undegraded":"2024-04-16T19:38:17.931333+0000","last_fullsized":"2024-04-16T19:38:17.931333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.931272+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:07.574424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.639668+0000","last_change":"2024-04-16T19:39:12.639693+0000","last_active":"2024-04-16T19:39:12.639668+0000","last_peered":"2024-04-16T19:39:12.639668+0000","last_clean":"2024-04-16T19:39:12.639668+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:39:12.639668+0000","last_undegraded":"2024-04-16T19:39:12.639668+0000","last_fullsized":"2024-04-16T19:39:12.639668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.639597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.639597+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.639597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:27.660366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.012558+0000","last_change":"2024-04-16T19:39:13.012581+0000","last_active":"2024-04-16T19:39:13.012558+0000","last_peered":"2024-04-16T19:39:13.012558+0000","last_clean":"2024-04-16T19:39:13.012558+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:39:13.012558+0000","last_undegraded":"2024-04-16T19:39:13.012558+0000","last_fullsized":"2024-04-16T19:39:13.012558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.012487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.012487+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.012487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:43.037085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'10","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.171571+0000","last_change":"2024-04-16T19:38:35.171613+0000","last_active":"2024-04-16T19:38:35.171571+0000","last_peered":"2024-04-16T19:38:35.171571+0000","last_clean":"2024-04-16T19:38:35.171571+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:38:35.171571+0000","last_undegraded":"2024-04-16T19:38:35.171571+0000","last_fullsized":"2024-04-16T19:38:35.171571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.171510+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:54.116974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.596714+0000","last_change":"2024-04-16T19:39:13.596736+0000","last_active":"2024-04-16T19:39:13.596714+0000","last_peered":"2024-04-16T19:39:13.596714+0000","last_clean":"2024-04-16T19:39:13.596714+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:39:13.596714+0000","last_undegraded":"2024-04-16T19:39:13.596714+0000","last_fullsized":"2024-04-16T19:39:13.596714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.596651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.596651+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.596651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:19.806274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338727+0000","last_change":"2024-04-16T17:45:08.386065+0000","last_active":"2024-04-16T19:38:10.338727+0000","last_peered":"2024-04-16T19:38:10.338727+0000","last_clean":"2024-04-16T19:38:10.338727+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:38:10.338727+0000","last_undegraded":"2024-04-16T19:38:10.338727+0000","last_fullsized":"2024-04-16T19:38:10.338727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'16","reported_seq":250,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.100685+0000","last_change":"2024-04-16T19:38:40.100742+0000","last_active":"2024-04-16T19:38:40.100685+0000","last_peered":"2024-04-16T19:38:40.100685+0000","last_clean":"2024-04-16T19:38:40.100685+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:38:40.100685+0000","last_undegraded":"2024-04-16T19:38:40.100685+0000","last_fullsized":"2024-04-16T19:38:40.100685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.100620+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:48.497778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.069791+0000","last_change":"2024-04-16T19:39:08.069812+0000","last_active":"2024-04-16T19:39:08.069791+0000","last_peered":"2024-04-16T19:39:08.069791+0000","last_clean":"2024-04-16T19:39:08.069791+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:39:08.069791+0000","last_undegraded":"2024-04-16T19:39:08.069791+0000","last_fullsized":"2024-04-16T19:39:08.069791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.069729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.069729+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.069729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:28.539834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.133344+0000","last_change":"2024-04-16T19:39:13.133366+0000","last_active":"2024-04-16T19:39:13.133344+0000","last_peered":"2024-04-16T19:39:13.133344+0000","last_clean":"2024-04-16T19:39:13.133344+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:39:13.133344+0000","last_undegraded":"2024-04-16T19:39:13.133344+0000","last_fullsized":"2024-04-16T19:39:13.133344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.133280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.133280+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.133280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:04.731516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"53'9","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.926373+0000","last_change":"2024-04-16T19:38:21.926413+0000","last_active":"2024-04-16T19:38:21.926373+0000","last_peered":"2024-04-16T19:38:21.926373+0000","last_clean":"2024-04-16T19:38:21.926373+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:38:21.926373+0000","last_undegraded":"2024-04-16T19:38:21.926373+0000","last_fullsized":"2024-04-16T19:38:21.926373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'9","last_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_deep_scrub":"53'9","last_deep_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.926308+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:31.946481+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.088296+0000","last_change":"2024-04-16T19:39:06.088318+0000","last_active":"2024-04-16T19:39:06.088296+0000","last_peered":"2024-04-16T19:39:06.088296+0000","last_clean":"2024-04-16T19:39:06.088296+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:39:06.088296+0000","last_undegraded":"2024-04-16T19:39:06.088296+0000","last_fullsized":"2024-04-16T19:39:06.088296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.088233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.088233+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.088233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:24.886725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:29.381374+0000","last_change":"2024-04-16T19:39:29.381396+0000","last_active":"2024-04-16T19:39:29.381374+0000","last_peered":"2024-04-16T19:39:29.381374+0000","last_clean":"2024-04-16T19:39:29.381374+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:39:29.381374+0000","last_undegraded":"2024-04-16T19:39:29.381374+0000","last_fullsized":"2024-04-16T19:39:29.381374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:29.381304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:29.381304+0000","last_clean_scrub_stamp":"2024-04-16T19:39:29.381304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:11.851912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"53'2","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.013204+0000","last_change":"2024-04-16T19:38:42.013239+0000","last_active":"2024-04-16T19:38:42.013204+0000","last_peered":"2024-04-16T19:38:42.013204+0000","last_clean":"2024-04-16T19:38:42.013204+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:38:42.013204+0000","last_undegraded":"2024-04-16T19:38:42.013204+0000","last_fullsized":"2024-04-16T19:38:42.013204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.013138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:49.672770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.158471+0000","last_change":"2024-04-16T19:39:01.158506+0000","last_active":"2024-04-16T19:39:01.158471+0000","last_peered":"2024-04-16T19:39:01.158471+0000","last_clean":"2024-04-16T19:39:01.158471+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:39:01.158471+0000","last_undegraded":"2024-04-16T19:39:01.158471+0000","last_fullsized":"2024-04-16T19:39:01.158471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:01.158405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:01.158405+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.158405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:24.103370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.091408+0000","last_change":"2024-04-16T19:38:24.091408+0000","last_active":"2024-04-16T19:38:24.091408+0000","last_peered":"2024-04-16T19:38:24.091408+0000","last_clean":"2024-04-16T19:38:24.091408+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:38:24.091408+0000","last_undegraded":"2024-04-16T19:38:24.091408+0000","last_fullsized":"2024-04-16T19:38:24.091408+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.091318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:55.045299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.524663+0000","last_change":"2024-04-16T18:09:02.173941+0000","last_active":"2024-04-16T19:38:08.524663+0000","last_peered":"2024-04-16T19:38:08.524663+0000","last_clean":"2024-04-16T19:38:08.524663+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:38:08.524663+0000","last_undegraded":"2024-04-16T19:38:08.524663+0000","last_fullsized":"2024-04-16T19:38:08.524663+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'197","reported_seq":2321,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.100302+0000","last_change":"2024-04-16T19:39:09.100331+0000","last_active":"2024-04-16T19:39:09.100302+0000","last_peered":"2024-04-16T19:39:09.100302+0000","last_clean":"2024-04-16T19:39:09.100302+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:39:09.100302+0000","last_undegraded":"2024-04-16T19:39:09.100302+0000","last_fullsized":"2024-04-16T19:39:09.100302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'197","last_scrub_stamp":"2024-04-16T19:39:09.100240+0000","last_deep_scrub":"53'197","last_deep_scrub_stamp":"2024-04-16T19:39:09.100240+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.100240+0000","objects_scrubbed":52,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:01.354932+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14129,"num_omap_keys":57,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.886294+0000","last_change":"2024-04-16T19:38:40.886294+0000","last_active":"2024-04-16T19:38:40.886294+0000","last_peered":"2024-04-16T19:38:40.886294+0000","last_clean":"2024-04-16T19:38:40.886294+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:38:40.886294+0000","last_undegraded":"2024-04-16T19:38:40.886294+0000","last_fullsized":"2024-04-16T19:38:40.886294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.886171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:24.443007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'26","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.349483+0000","last_change":"2024-04-16T19:38:36.349545+0000","last_active":"2024-04-16T19:38:36.349483+0000","last_peered":"2024-04-16T19:38:36.349483+0000","last_clean":"2024-04-16T19:38:36.349483+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:38:36.349483+0000","last_undegraded":"2024-04-16T19:38:36.349483+0000","last_fullsized":"2024-04-16T19:38:36.349483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.349407+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:33.328492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.556726+0000","last_change":"2024-04-16T19:38:18.556726+0000","last_active":"2024-04-16T19:38:18.556726+0000","last_peered":"2024-04-16T19:38:18.556726+0000","last_clean":"2024-04-16T19:38:18.556726+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:38:18.556726+0000","last_undegraded":"2024-04-16T19:38:18.556726+0000","last_fullsized":"2024-04-16T19:38:18.556726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.556600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:53.827149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'257","reported_seq":496,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.911983+0000","last_change":"2024-04-16T19:38:22.912055+0000","last_active":"2024-04-16T19:38:22.911983+0000","last_peered":"2024-04-16T19:38:22.911983+0000","last_clean":"2024-04-16T19:38:22.911983+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:38:22.911983+0000","last_undegraded":"2024-04-16T19:38:22.911983+0000","last_fullsized":"2024-04-16T19:38:22.911983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'257","last_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_deep_scrub":"53'257","last_deep_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.911925+0000","objects_scrubbed":14,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:02.872014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'17","reported_seq":406,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.523960+0000","last_change":"2024-04-16T19:38:28.524008+0000","last_active":"2024-04-16T19:38:28.523960+0000","last_peered":"2024-04-16T19:38:28.523960+0000","last_clean":"2024-04-16T19:38:28.523960+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:38:28.523960+0000","last_undegraded":"2024-04-16T19:38:28.523960+0000","last_fullsized":"2024-04-16T19:38:28.523960+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'17","last_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_deep_scrub":"53'17","last_deep_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.523901+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:10.769673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.339440+0000","last_change":"2024-04-16T19:38:43.339440+0000","last_active":"2024-04-16T19:38:43.339440+0000","last_peered":"2024-04-16T19:38:43.339440+0000","last_clean":"2024-04-16T19:38:43.339440+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:38:43.339440+0000","last_undegraded":"2024-04-16T19:38:43.339440+0000","last_fullsized":"2024-04-16T19:38:43.339440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.339355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:45.853381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.714851+0000","last_change":"2024-04-16T19:39:02.714905+0000","last_active":"2024-04-16T19:39:02.714851+0000","last_peered":"2024-04-16T19:39:02.714851+0000","last_clean":"2024-04-16T19:39:02.714851+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:39:02.714851+0000","last_undegraded":"2024-04-16T19:39:02.714851+0000","last_fullsized":"2024-04-16T19:39:02.714851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.714774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.714774+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.714774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:56.806141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.019768+0000","last_change":"2024-04-16T19:39:12.019768+0000","last_active":"2024-04-16T19:39:12.019768+0000","last_peered":"2024-04-16T19:39:12.019768+0000","last_clean":"2024-04-16T19:39:12.019768+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:39:12.019768+0000","last_undegraded":"2024-04-16T19:39:12.019768+0000","last_fullsized":"2024-04-16T19:39:12.019768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.019666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.019666+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.019666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:18.229289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.339046+0000","last_change":"2024-04-16T17:45:20.407071+0000","last_active":"2024-04-16T19:38:10.339046+0000","last_peered":"2024-04-16T19:38:10.339046+0000","last_clean":"2024-04-16T19:38:10.339046+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:38:10.339046+0000","last_undegraded":"2024-04-16T19:38:10.339046+0000","last_fullsized":"2024-04-16T19:38:10.339046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.296192+0000","last_change":"2024-04-16T19:38:59.296192+0000","last_active":"2024-04-16T19:38:59.296192+0000","last_peered":"2024-04-16T19:38:59.296192+0000","last_clean":"2024-04-16T19:38:59.296192+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:38:59.296192+0000","last_undegraded":"2024-04-16T19:38:59.296192+0000","last_fullsized":"2024-04-16T19:38:59.296192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:59.296101+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:59.296101+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.296101+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.293277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.842212+0000","last_change":"2024-04-16T19:38:53.842212+0000","last_active":"2024-04-16T19:38:53.842212+0000","last_peered":"2024-04-16T19:38:53.842212+0000","last_clean":"2024-04-16T19:38:53.842212+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:38:53.842212+0000","last_undegraded":"2024-04-16T19:38:53.842212+0000","last_fullsized":"2024-04-16T19:38:53.842212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.842112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.842112+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.842112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:19.599353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.191320+0000","last_change":"2024-04-16T19:39:24.191343+0000","last_active":"2024-04-16T19:39:24.191320+0000","last_peered":"2024-04-16T19:39:24.191320+0000","last_clean":"2024-04-16T19:39:24.191320+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:39:24.191320+0000","last_undegraded":"2024-04-16T19:39:24.191320+0000","last_fullsized":"2024-04-16T19:39:24.191320+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.191255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.191255+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.191255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:53.526700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'134","reported_seq":1988,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.401948+0000","last_change":"2024-04-16T17:47:16.575392+0000","last_active":"2024-04-16T19:37:44.401948+0000","last_peered":"2024-04-16T19:37:44.401948+0000","last_clean":"2024-04-16T19:37:44.401948+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:37:44.401948+0000","last_undegraded":"2024-04-16T19:37:44.401948+0000","last_fullsized":"2024-04-16T19:37:44.401948+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.784652+0000","last_change":"2024-04-16T19:38:42.784652+0000","last_active":"2024-04-16T19:38:42.784652+0000","last_peered":"2024-04-16T19:38:42.784652+0000","last_clean":"2024-04-16T19:38:42.784652+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:38:42.784652+0000","last_undegraded":"2024-04-16T19:38:42.784652+0000","last_fullsized":"2024-04-16T19:38:42.784652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.784562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:26.341398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'13","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.384096+0000","last_change":"2024-04-16T19:38:47.384137+0000","last_active":"2024-04-16T19:38:47.384096+0000","last_peered":"2024-04-16T19:38:47.384096+0000","last_clean":"2024-04-16T19:38:47.384096+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:38:47.384096+0000","last_undegraded":"2024-04-16T19:38:47.384096+0000","last_fullsized":"2024-04-16T19:38:47.384096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.384037+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:55.261448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.768005+0000","last_change":"2024-04-16T19:38:32.768029+0000","last_active":"2024-04-16T19:38:32.768005+0000","last_peered":"2024-04-16T19:38:32.768005+0000","last_clean":"2024-04-16T19:38:32.768005+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:38:32.768005+0000","last_undegraded":"2024-04-16T19:38:32.768005+0000","last_fullsized":"2024-04-16T19:38:32.768005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:38.784450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'204","reported_seq":483,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.084173+0000","last_change":"2024-04-16T19:38:12.084173+0000","last_active":"2024-04-16T19:38:12.084173+0000","last_peered":"2024-04-16T19:38:12.084173+0000","last_clean":"2024-04-16T19:38:12.084173+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:38:12.084173+0000","last_undegraded":"2024-04-16T19:38:12.084173+0000","last_fullsized":"2024-04-16T19:38:12.084173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'204","last_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_deep_scrub":"53'204","last_deep_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.084057+0000","objects_scrubbed":15,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:47:16.400625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'36","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.728115+0000","last_change":"2024-04-16T19:38:29.728115+0000","last_active":"2024-04-16T19:38:29.728115+0000","last_peered":"2024-04-16T19:38:29.728115+0000","last_clean":"2024-04-16T19:38:29.728115+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:38:29.728115+0000","last_undegraded":"2024-04-16T19:38:29.728115+0000","last_fullsized":"2024-04-16T19:38:29.728115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'36","last_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_deep_scrub":"53'36","last_deep_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.727997+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:35.149833+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.754279+0000","last_change":"2024-04-16T19:38:31.754279+0000","last_active":"2024-04-16T19:38:31.754279+0000","last_peered":"2024-04-16T19:38:31.754279+0000","last_clean":"2024-04-16T19:38:31.754279+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:38:31.754279+0000","last_undegraded":"2024-04-16T19:38:31.754279+0000","last_fullsized":"2024-04-16T19:38:31.754279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.754160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:49.288552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.541110+0000","last_change":"2024-04-16T19:39:16.541132+0000","last_active":"2024-04-16T19:39:16.541110+0000","last_peered":"2024-04-16T19:39:16.541110+0000","last_clean":"2024-04-16T19:39:16.541110+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:39:16.541110+0000","last_undegraded":"2024-04-16T19:39:16.541110+0000","last_fullsized":"2024-04-16T19:39:16.541110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.541045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.541045+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.541045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:12.769457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.318698+0000","last_change":"2024-04-16T19:39:23.318698+0000","last_active":"2024-04-16T19:39:23.318698+0000","last_peered":"2024-04-16T19:39:23.318698+0000","last_clean":"2024-04-16T19:39:23.318698+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:39:23.318698+0000","last_undegraded":"2024-04-16T19:39:23.318698+0000","last_fullsized":"2024-04-16T19:39:23.318698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.318576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.318576+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.318576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:42.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"53'20","reported_seq":906,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.425204+0000","last_change":"2024-04-16T19:39:09.425239+0000","last_active":"2024-04-16T19:39:09.425204+0000","last_peered":"2024-04-16T19:39:09.425204+0000","last_clean":"2024-04-16T19:39:09.425204+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:39:09.425204+0000","last_undegraded":"2024-04-16T19:39:09.425204+0000","last_fullsized":"2024-04-16T19:39:09.425204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:39:09.425136+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:39:09.425136+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.425136+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:06.827215+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'75","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.305931+0000","last_change":"2024-04-16T19:38:55.305931+0000","last_active":"2024-04-16T19:38:55.305931+0000","last_peered":"2024-04-16T19:38:55.305931+0000","last_clean":"2024-04-16T19:38:55.305931+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:38:55.305931+0000","last_undegraded":"2024-04-16T19:38:55.305931+0000","last_fullsized":"2024-04-16T19:38:55.305931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'75","last_scrub_stamp":"2024-04-16T19:38:55.305805+0000","last_deep_scrub":"53'75","last_deep_scrub_stamp":"2024-04-16T19:38:55.305805+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.305805+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:39.277904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.393508+0000","last_change":"2024-04-16T19:38:49.393508+0000","last_active":"2024-04-16T19:38:49.393508+0000","last_peered":"2024-04-16T19:38:49.393508+0000","last_clean":"2024-04-16T19:38:49.393508+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:38:49.393508+0000","last_undegraded":"2024-04-16T19:38:49.393508+0000","last_fullsized":"2024-04-16T19:38:49.393508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.393417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:44.040909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.009774+0000","last_change":"2024-04-16T19:39:23.009797+0000","last_active":"2024-04-16T19:39:23.009774+0000","last_peered":"2024-04-16T19:39:23.009774+0000","last_clean":"2024-04-16T19:39:23.009774+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:39:23.009774+0000","last_undegraded":"2024-04-16T19:39:23.009774+0000","last_fullsized":"2024-04-16T19:39:23.009774+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.009709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.009709+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.009709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:55:02.789696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'274","reported_seq":2177,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.356383+0000","last_change":"2024-04-16T19:38:56.356383+0000","last_active":"2024-04-16T19:38:56.356383+0000","last_peered":"2024-04-16T19:38:56.356383+0000","last_clean":"2024-04-16T19:38:56.356383+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:38:56.356383+0000","last_undegraded":"2024-04-16T19:38:56.356383+0000","last_fullsized":"2024-04-16T19:38:56.356383+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'274","last_scrub_stamp":"2024-04-16T19:38:56.356276+0000","last_deep_scrub":"53'274","last_deep_scrub_stamp":"2024-04-16T19:38:56.356276+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.356276+0000","objects_scrubbed":46,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:42:56.666380+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22911,"num_omap_keys":91,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.547577+0000","last_change":"2024-04-16T19:38:25.547577+0000","last_active":"2024-04-16T19:38:25.547577+0000","last_peered":"2024-04-16T19:38:25.547577+0000","last_clean":"2024-04-16T19:38:25.547577+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:38:25.547577+0000","last_undegraded":"2024-04-16T19:38:25.547577+0000","last_fullsized":"2024-04-16T19:38:25.547577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.547478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:51.243189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'10","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.429116+0000","last_change":"2024-04-16T19:38:31.429149+0000","last_active":"2024-04-16T19:38:31.429116+0000","last_peered":"2024-04-16T19:38:31.429116+0000","last_clean":"2024-04-16T19:38:31.429116+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:38:31.429116+0000","last_undegraded":"2024-04-16T19:38:31.429116+0000","last_fullsized":"2024-04-16T19:38:31.429116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.429051+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:33.962416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":99,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.354794+0000","last_change":"2024-04-16T19:38:30.354840+0000","last_active":"2024-04-16T19:38:30.354794+0000","last_peered":"2024-04-16T19:38:30.354794+0000","last_clean":"2024-04-16T19:38:30.354794+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:38:30.354794+0000","last_undegraded":"2024-04-16T19:38:30.354794+0000","last_fullsized":"2024-04-16T19:38:30.354794+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.354716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:36.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'283","reported_seq":613,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.068719+0000","last_change":"2024-04-16T19:38:14.068719+0000","last_active":"2024-04-16T19:38:14.068719+0000","last_peered":"2024-04-16T19:38:14.068719+0000","last_clean":"2024-04-16T19:38:14.068719+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:38:14.068719+0000","last_undegraded":"2024-04-16T19:38:14.068719+0000","last_fullsized":"2024-04-16T19:38:14.068719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'283","last_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_deep_scrub":"53'283","last_deep_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.068569+0000","objects_scrubbed":17,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:04.644251+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'16","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.254163+0000","last_change":"2024-04-16T19:38:18.254163+0000","last_active":"2024-04-16T19:38:18.254163+0000","last_peered":"2024-04-16T19:38:18.254163+0000","last_clean":"2024-04-16T19:38:18.254163+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:38:18.254163+0000","last_undegraded":"2024-04-16T19:38:18.254163+0000","last_fullsized":"2024-04-16T19:38:18.254163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.254059+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:53.228339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.371589+0000","last_change":"2024-04-16T19:38:29.371613+0000","last_active":"2024-04-16T19:38:29.371589+0000","last_peered":"2024-04-16T19:38:29.371589+0000","last_clean":"2024-04-16T19:38:29.371589+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:38:29.371589+0000","last_undegraded":"2024-04-16T19:38:29.371589+0000","last_fullsized":"2024-04-16T19:38:29.371589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.371523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:16.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.377682+0000","last_change":"2024-04-16T19:39:18.377703+0000","last_active":"2024-04-16T19:39:18.377682+0000","last_peered":"2024-04-16T19:39:18.377682+0000","last_clean":"2024-04-16T19:39:18.377682+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:39:18.377682+0000","last_undegraded":"2024-04-16T19:39:18.377682+0000","last_fullsized":"2024-04-16T19:39:18.377682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.377616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.377616+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.377616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:38:43.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428256+0000","last_change":"2024-04-16T17:45:08.383098+0000","last_active":"2024-04-16T19:38:09.428256+0000","last_peered":"2024-04-16T19:38:09.428256+0000","last_clean":"2024-04-16T19:38:09.428256+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:38:09.428256+0000","last_undegraded":"2024-04-16T19:38:09.428256+0000","last_fullsized":"2024-04-16T19:38:09.428256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.983783+0000","last_change":"2024-04-16T19:38:56.983783+0000","last_active":"2024-04-16T19:38:56.983783+0000","last_peered":"2024-04-16T19:38:56.983783+0000","last_clean":"2024-04-16T19:38:56.983783+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:38:56.983783+0000","last_undegraded":"2024-04-16T19:38:56.983783+0000","last_fullsized":"2024-04-16T19:38:56.983783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.983691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.983691+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.983691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:51.631183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'125","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.003707+0000","last_change":"2024-04-16T19:38:51.003739+0000","last_active":"2024-04-16T19:38:51.003707+0000","last_peered":"2024-04-16T19:38:51.003707+0000","last_clean":"2024-04-16T19:38:51.003707+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:38:51.003707+0000","last_undegraded":"2024-04-16T19:38:51.003707+0000","last_fullsized":"2024-04-16T19:38:51.003707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:51.003645+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:51.003645+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.003645+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:53.517671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'13","reported_seq":1398,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.999553+0000","last_change":"2024-04-16T19:38:51.999553+0000","last_active":"2024-04-16T19:38:51.999553+0000","last_peered":"2024-04-16T19:38:51.999553+0000","last_clean":"2024-04-16T19:38:51.999553+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:38:51.999553+0000","last_undegraded":"2024-04-16T19:38:51.999553+0000","last_fullsized":"2024-04-16T19:38:51.999553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.999449+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.999449+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.999449+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:17.756690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.802274+0000","last_change":"2024-04-16T19:39:28.802297+0000","last_active":"2024-04-16T19:39:28.802274+0000","last_peered":"2024-04-16T19:39:28.802274+0000","last_clean":"2024-04-16T19:39:28.802274+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:39:28.802274+0000","last_undegraded":"2024-04-16T19:39:28.802274+0000","last_fullsized":"2024-04-16T19:39:28.802274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.802208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.802208+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.802208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:14.856739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'197","reported_seq":2351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.427761+0000","last_change":"2024-04-16T19:39:08.427809+0000","last_active":"2024-04-16T19:39:08.427761+0000","last_peered":"2024-04-16T19:39:08.427761+0000","last_clean":"2024-04-16T19:39:08.427761+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:39:08.427761+0000","last_undegraded":"2024-04-16T19:39:08.427761+0000","last_fullsized":"2024-04-16T19:39:08.427761+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'197","last_scrub_stamp":"2024-04-16T19:39:08.427700+0000","last_deep_scrub":"53'197","last_deep_scrub_stamp":"2024-04-16T19:39:08.427700+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.427700+0000","objects_scrubbed":46,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:05.519695+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11005,"num_omap_keys":44,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.358729+0000","last_change":"2024-04-16T19:38:38.358729+0000","last_active":"2024-04-16T19:38:38.358729+0000","last_peered":"2024-04-16T19:38:38.358729+0000","last_clean":"2024-04-16T19:38:38.358729+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:38:38.358729+0000","last_undegraded":"2024-04-16T19:38:38.358729+0000","last_fullsized":"2024-04-16T19:38:38.358729+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.358644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:18.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'13","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.916490+0000","last_change":"2024-04-16T19:38:46.916547+0000","last_active":"2024-04-16T19:38:46.916490+0000","last_peered":"2024-04-16T19:38:46.916490+0000","last_clean":"2024-04-16T19:38:46.916490+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:38:46.916490+0000","last_undegraded":"2024-04-16T19:38:46.916490+0000","last_fullsized":"2024-04-16T19:38:46.916490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.916403+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:16.453973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.107389+0000","last_change":"2024-04-16T19:38:09.107389+0000","last_active":"2024-04-16T19:38:09.107389+0000","last_peered":"2024-04-16T19:38:09.107389+0000","last_clean":"2024-04-16T19:38:09.107389+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:38:09.107389+0000","last_undegraded":"2024-04-16T19:38:09.107389+0000","last_fullsized":"2024-04-16T19:38:09.107389+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.107315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:06.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5992","reported_seq":12558,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.824588+0000","last_change":"2024-04-16T19:38:12.824617+0000","last_active":"2024-04-16T19:38:12.824588+0000","last_peered":"2024-04-16T19:38:12.824588+0000","last_clean":"2024-04-16T19:38:12.824588+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:38:12.824588+0000","last_undegraded":"2024-04-16T19:38:12.824588+0000","last_fullsized":"2024-04-16T19:38:12.824588+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5992","last_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_deep_scrub":"53'5992","last_deep_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.824529+0000","objects_scrubbed":27,"log_size":1792,"log_dups_size":3000,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:47.168687+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":79208,"num_omap_keys":410,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'16","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.740826+0000","last_change":"2024-04-16T19:38:21.740887+0000","last_active":"2024-04-16T19:38:21.740826+0000","last_peered":"2024-04-16T19:38:21.740826+0000","last_clean":"2024-04-16T19:38:21.740826+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:38:21.740826+0000","last_undegraded":"2024-04-16T19:38:21.740826+0000","last_fullsized":"2024-04-16T19:38:21.740826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.740747+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:07.774419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.344166+0000","last_change":"2024-04-16T19:38:40.344189+0000","last_active":"2024-04-16T19:38:40.344166+0000","last_peered":"2024-04-16T19:38:40.344166+0000","last_clean":"2024-04-16T19:38:40.344166+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:38:40.344166+0000","last_undegraded":"2024-04-16T19:38:40.344166+0000","last_fullsized":"2024-04-16T19:38:40.344166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.344095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:37.023758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.400553+0000","last_change":"2024-04-16T19:39:17.400577+0000","last_active":"2024-04-16T19:39:17.400553+0000","last_peered":"2024-04-16T19:39:17.400553+0000","last_clean":"2024-04-16T19:39:17.400553+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:39:17.400553+0000","last_undegraded":"2024-04-16T19:39:17.400553+0000","last_fullsized":"2024-04-16T19:39:17.400553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.400488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.400488+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.400488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:09.353711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.572607+0000","last_change":"2024-04-16T19:39:23.572607+0000","last_active":"2024-04-16T19:39:23.572607+0000","last_peered":"2024-04-16T19:39:23.572607+0000","last_clean":"2024-04-16T19:39:23.572607+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:39:23.572607+0000","last_undegraded":"2024-04-16T19:39:23.572607+0000","last_fullsized":"2024-04-16T19:39:23.572607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.572519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.572519+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.572519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:01.881722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"53'2","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.013986+0000","last_change":"2024-04-16T19:39:07.014015+0000","last_active":"2024-04-16T19:39:07.013986+0000","last_peered":"2024-04-16T19:39:07.013986+0000","last_clean":"2024-04-16T19:39:07.013986+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:39:07.013986+0000","last_undegraded":"2024-04-16T19:39:07.013986+0000","last_fullsized":"2024-04-16T19:39:07.013986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:07.013923+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:07.013923+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.013923+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:46.793909+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.981271+0000","last_change":"2024-04-16T19:38:54.981271+0000","last_active":"2024-04-16T19:38:54.981271+0000","last_peered":"2024-04-16T19:38:54.981271+0000","last_clean":"2024-04-16T19:38:54.981271+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:38:54.981271+0000","last_undegraded":"2024-04-16T19:38:54.981271+0000","last_fullsized":"2024-04-16T19:38:54.981271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:54.981167+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:54.981167+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.981167+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:57.572002+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'13","reported_seq":1399,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.649014+0000","last_change":"2024-04-16T19:38:51.649037+0000","last_active":"2024-04-16T19:38:51.649014+0000","last_peered":"2024-04-16T19:38:51.649014+0000","last_clean":"2024-04-16T19:38:51.649014+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:38:51.649014+0000","last_undegraded":"2024-04-16T19:38:51.649014+0000","last_fullsized":"2024-04-16T19:38:51.649014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.648964+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.648964+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.648964+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:30.770870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.040929+0000","last_change":"2024-04-16T19:39:25.040964+0000","last_active":"2024-04-16T19:39:25.040929+0000","last_peered":"2024-04-16T19:39:25.040929+0000","last_clean":"2024-04-16T19:39:25.040929+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:39:25.040929+0000","last_undegraded":"2024-04-16T19:39:25.040929+0000","last_fullsized":"2024-04-16T19:39:25.040929+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.040864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.040864+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.040864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:17.295556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'132","reported_seq":2142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429936+0000","last_change":"2024-04-16T17:46:25.527944+0000","last_active":"2024-04-16T19:38:09.429936+0000","last_peered":"2024-04-16T19:38:09.429936+0000","last_clean":"2024-04-16T19:38:09.429936+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:38:09.429936+0000","last_undegraded":"2024-04-16T19:38:09.429936+0000","last_fullsized":"2024-04-16T19:38:09.429936+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.860257+0000","last_change":"2024-04-16T19:38:38.860257+0000","last_active":"2024-04-16T19:38:38.860257+0000","last_peered":"2024-04-16T19:38:38.860257+0000","last_clean":"2024-04-16T19:38:38.860257+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:38:38.860257+0000","last_undegraded":"2024-04-16T19:38:38.860257+0000","last_fullsized":"2024-04-16T19:38:38.860257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.860170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:59.006022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'13","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.413937+0000","last_change":"2024-04-16T19:38:33.413987+0000","last_active":"2024-04-16T19:38:33.413937+0000","last_peered":"2024-04-16T19:38:33.413937+0000","last_clean":"2024-04-16T19:38:33.413937+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:38:33.413937+0000","last_undegraded":"2024-04-16T19:38:33.413937+0000","last_fullsized":"2024-04-16T19:38:33.413937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.413861+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:52.042937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.739844+0000","last_change":"2024-04-16T19:38:22.739844+0000","last_active":"2024-04-16T19:38:22.739844+0000","last_peered":"2024-04-16T19:38:22.739844+0000","last_clean":"2024-04-16T19:38:22.739844+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:38:22.739844+0000","last_undegraded":"2024-04-16T19:38:22.739844+0000","last_fullsized":"2024-04-16T19:38:22.739844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.739758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:59.491263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1601","reported_seq":47000,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.864758+0000","last_change":"2024-04-16T19:38:18.864758+0000","last_active":"2024-04-16T19:38:18.864758+0000","last_peered":"2024-04-16T19:38:18.864758+0000","last_clean":"2024-04-16T19:38:18.864758+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:38:18.864758+0000","last_undegraded":"2024-04-16T19:38:18.864758+0000","last_fullsized":"2024-04-16T19:38:18.864758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'1601","last_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_deep_scrub":"53'1601","last_deep_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.864667+0000","objects_scrubbed":26,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:06.203531+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14964,"num_omap_keys":68,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'12","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.220904+0000","last_change":"2024-04-16T19:38:11.220904+0000","last_active":"2024-04-16T19:38:11.220904+0000","last_peered":"2024-04-16T19:38:11.220904+0000","last_clean":"2024-04-16T19:38:11.220904+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:38:11.220904+0000","last_undegraded":"2024-04-16T19:38:11.220904+0000","last_fullsized":"2024-04-16T19:38:11.220904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.220802+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:19.617959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.990880+0000","last_change":"2024-04-16T19:39:24.990904+0000","last_active":"2024-04-16T19:39:24.990880+0000","last_peered":"2024-04-16T19:39:24.990880+0000","last_clean":"2024-04-16T19:39:24.990880+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:39:24.990880+0000","last_undegraded":"2024-04-16T19:39:24.990880+0000","last_fullsized":"2024-04-16T19:39:24.990880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.990814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.990814+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.990814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:02.378341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.548647+0000","last_change":"2024-04-16T19:39:15.548668+0000","last_active":"2024-04-16T19:39:15.548647+0000","last_peered":"2024-04-16T19:39:15.548647+0000","last_clean":"2024-04-16T19:39:15.548647+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:39:15.548647+0000","last_undegraded":"2024-04-16T19:39:15.548647+0000","last_fullsized":"2024-04-16T19:39:15.548647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.548581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.548581+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.548581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:12.640576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"53'7","reported_seq":239,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.642517+0000","last_change":"2024-04-16T19:39:11.642568+0000","last_active":"2024-04-16T19:39:11.642517+0000","last_peered":"2024-04-16T19:39:11.642517+0000","last_clean":"2024-04-16T19:39:11.642517+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:39:11.642517+0000","last_undegraded":"2024-04-16T19:39:11.642517+0000","last_fullsized":"2024-04-16T19:39:11.642517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:39:11.642432+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:39:11.642432+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.642432+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:25.286452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'209","reported_seq":441,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.728984+0000","last_change":"2024-04-16T19:38:57.729048+0000","last_active":"2024-04-16T19:38:57.728984+0000","last_peered":"2024-04-16T19:38:57.728984+0000","last_clean":"2024-04-16T19:38:57.728984+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:38:57.728984+0000","last_undegraded":"2024-04-16T19:38:57.728984+0000","last_fullsized":"2024-04-16T19:38:57.728984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'209","last_scrub_stamp":"2024-04-16T19:38:57.728909+0000","last_deep_scrub":"53'209","last_deep_scrub_stamp":"2024-04-16T19:38:57.728909+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.728909+0000","objects_scrubbed":9,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:54.778754+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.730542+0000","last_change":"2024-04-16T19:38:45.730564+0000","last_active":"2024-04-16T19:38:45.730542+0000","last_peered":"2024-04-16T19:38:45.730542+0000","last_clean":"2024-04-16T19:38:45.730542+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:38:45.730542+0000","last_undegraded":"2024-04-16T19:38:45.730542+0000","last_fullsized":"2024-04-16T19:38:45.730542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.730467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:04.477302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.807488+0000","last_change":"2024-04-16T19:38:36.807512+0000","last_active":"2024-04-16T19:38:36.807488+0000","last_peered":"2024-04-16T19:38:36.807488+0000","last_clean":"2024-04-16T19:38:36.807488+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:38:36.807488+0000","last_undegraded":"2024-04-16T19:38:36.807488+0000","last_fullsized":"2024-04-16T19:38:36.807488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.807410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:01.775567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.167577+0000","last_change":"2024-04-16T19:39:22.167600+0000","last_active":"2024-04-16T19:39:22.167577+0000","last_peered":"2024-04-16T19:39:22.167577+0000","last_clean":"2024-04-16T19:39:22.167577+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:39:22.167577+0000","last_undegraded":"2024-04-16T19:39:22.167577+0000","last_fullsized":"2024-04-16T19:39:22.167577+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.167514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.167514+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.167514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:58.434341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'139","reported_seq":1474,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069965+0000","last_change":"2024-04-16T17:46:25.531257+0000","last_active":"2024-04-16T19:38:08.069965+0000","last_peered":"2024-04-16T19:38:08.069965+0000","last_clean":"2024-04-16T19:38:08.069965+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:38:08.069965+0000","last_undegraded":"2024-04-16T19:38:08.069965+0000","last_fullsized":"2024-04-16T19:38:08.069965+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.929722+0000","last_change":"2024-04-16T19:38:48.929745+0000","last_active":"2024-04-16T19:38:48.929722+0000","last_peered":"2024-04-16T19:38:48.929722+0000","last_clean":"2024-04-16T19:38:48.929722+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:38:48.929722+0000","last_undegraded":"2024-04-16T19:38:48.929722+0000","last_fullsized":"2024-04-16T19:38:48.929722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.929661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:58.580340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"53'6","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.954955+0000","last_change":"2024-04-16T19:38:42.954988+0000","last_active":"2024-04-16T19:38:42.954955+0000","last_peered":"2024-04-16T19:38:42.954955+0000","last_clean":"2024-04-16T19:38:42.954955+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:38:42.954955+0000","last_undegraded":"2024-04-16T19:38:42.954955+0000","last_fullsized":"2024-04-16T19:38:42.954955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.954892+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:01.753384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.345083+0000","last_change":"2024-04-16T19:38:28.345083+0000","last_active":"2024-04-16T19:38:28.345083+0000","last_peered":"2024-04-16T19:38:28.345083+0000","last_clean":"2024-04-16T19:38:28.345083+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:38:28.345083+0000","last_undegraded":"2024-04-16T19:38:28.345083+0000","last_fullsized":"2024-04-16T19:38:28.345083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.344996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:22.992488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'355","reported_seq":664,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.869936+0000","last_change":"2024-04-16T19:38:12.869936+0000","last_active":"2024-04-16T19:38:12.869936+0000","last_peered":"2024-04-16T19:38:12.869936+0000","last_clean":"2024-04-16T19:38:12.869936+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:38:12.869936+0000","last_undegraded":"2024-04-16T19:38:12.869936+0000","last_fullsized":"2024-04-16T19:38:12.869936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'355","last_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_deep_scrub":"53'355","last_deep_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.869802+0000","objects_scrubbed":17,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:21.665637+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21527,"num_omap_keys":98,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'19","reported_seq":604,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.829535+0000","last_change":"2024-04-16T19:38:08.829535+0000","last_active":"2024-04-16T19:38:08.829535+0000","last_peered":"2024-04-16T19:38:08.829535+0000","last_clean":"2024-04-16T19:38:08.829535+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:38:08.829535+0000","last_undegraded":"2024-04-16T19:38:08.829535+0000","last_fullsized":"2024-04-16T19:38:08.829535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'19","last_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_deep_scrub":"53'19","last_deep_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.829450+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:30.796211+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.207689+0000","last_change":"2024-04-16T19:39:00.207711+0000","last_active":"2024-04-16T19:39:00.207689+0000","last_peered":"2024-04-16T19:39:00.207689+0000","last_clean":"2024-04-16T19:39:00.207689+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:39:00.207689+0000","last_undegraded":"2024-04-16T19:39:00.207689+0000","last_fullsized":"2024-04-16T19:39:00.207689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.207628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.207628+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.207628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:40.195071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.496051+0000","last_change":"2024-04-16T19:39:19.496094+0000","last_active":"2024-04-16T19:39:19.496051+0000","last_peered":"2024-04-16T19:39:19.496051+0000","last_clean":"2024-04-16T19:39:19.496051+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:39:19.496051+0000","last_undegraded":"2024-04-16T19:39:19.496051+0000","last_fullsized":"2024-04-16T19:39:19.496051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.495973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.495973+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.495973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:21.997574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.974949+0000","last_change":"2024-04-16T19:39:00.974970+0000","last_active":"2024-04-16T19:39:00.974949+0000","last_peered":"2024-04-16T19:39:00.974949+0000","last_clean":"2024-04-16T19:39:00.974949+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:39:00.974949+0000","last_undegraded":"2024-04-16T19:39:00.974949+0000","last_fullsized":"2024-04-16T19:39:00.974949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.974887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.974887+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.974887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:19.721721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'84","reported_seq":254,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.666541+0000","last_change":"2024-04-16T19:38:52.666600+0000","last_active":"2024-04-16T19:38:52.666541+0000","last_peered":"2024-04-16T19:38:52.666541+0000","last_clean":"2024-04-16T19:38:52.666541+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:38:52.666541+0000","last_undegraded":"2024-04-16T19:38:52.666541+0000","last_fullsized":"2024-04-16T19:38:52.666541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:52.666426+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:52.666426+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.666426+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:13.136531+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.960739+0000","last_change":"2024-04-16T19:38:46.960762+0000","last_active":"2024-04-16T19:38:46.960739+0000","last_peered":"2024-04-16T19:38:46.960739+0000","last_clean":"2024-04-16T19:38:46.960739+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:38:46.960739+0000","last_undegraded":"2024-04-16T19:38:46.960739+0000","last_fullsized":"2024-04-16T19:38:46.960739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.960675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:21.934955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.329000+0000","last_change":"2024-04-16T19:38:45.329022+0000","last_active":"2024-04-16T19:38:45.329000+0000","last_peered":"2024-04-16T19:38:45.329000+0000","last_clean":"2024-04-16T19:38:45.329000+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:38:45.329000+0000","last_undegraded":"2024-04-16T19:38:45.329000+0000","last_fullsized":"2024-04-16T19:38:45.329000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.328934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:07.148341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429923+0000","last_change":"2024-04-16T18:09:02.171442+0000","last_active":"2024-04-16T19:38:09.429923+0000","last_peered":"2024-04-16T19:38:09.429923+0000","last_clean":"2024-04-16T19:38:09.429923+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:38:09.429923+0000","last_undegraded":"2024-04-16T19:38:09.429923+0000","last_fullsized":"2024-04-16T19:38:09.429923+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'168","reported_seq":2644,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.988098+0000","last_change":"2024-04-16T19:38:44.988151+0000","last_active":"2024-04-16T19:38:44.988098+0000","last_peered":"2024-04-16T19:38:44.988098+0000","last_clean":"2024-04-16T19:38:44.988098+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:38:44.988098+0000","last_undegraded":"2024-04-16T19:38:44.988098+0000","last_fullsized":"2024-04-16T19:38:44.988098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'168","last_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_deep_scrub":"53'168","last_deep_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.988038+0000","objects_scrubbed":48,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:15.308723+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9452,"num_omap_keys":38,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.351134+0000","last_change":"2024-04-16T19:38:48.351134+0000","last_active":"2024-04-16T19:38:48.351134+0000","last_peered":"2024-04-16T19:38:48.351134+0000","last_clean":"2024-04-16T19:38:48.351134+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:38:48.351134+0000","last_undegraded":"2024-04-16T19:38:48.351134+0000","last_fullsized":"2024-04-16T19:38:48.351134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.351012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:56.344801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'23","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.995773+0000","last_change":"2024-04-16T19:38:43.995808+0000","last_active":"2024-04-16T19:38:43.995773+0000","last_peered":"2024-04-16T19:38:43.995773+0000","last_clean":"2024-04-16T19:38:43.995773+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:38:43.995773+0000","last_undegraded":"2024-04-16T19:38:43.995773+0000","last_fullsized":"2024-04-16T19:38:43.995773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.995709+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:23.117614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.514936+0000","last_change":"2024-04-16T19:38:16.514936+0000","last_active":"2024-04-16T19:38:16.514936+0000","last_peered":"2024-04-16T19:38:16.514936+0000","last_clean":"2024-04-16T19:38:16.514936+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:38:16.514936+0000","last_undegraded":"2024-04-16T19:38:16.514936+0000","last_fullsized":"2024-04-16T19:38:16.514936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.514815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:31:12.328836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'933","reported_seq":3835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.408460+0000","last_change":"2024-04-16T19:38:24.408514+0000","last_active":"2024-04-16T19:38:24.408460+0000","last_peered":"2024-04-16T19:38:24.408460+0000","last_clean":"2024-04-16T19:38:24.408460+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:38:24.408460+0000","last_undegraded":"2024-04-16T19:38:24.408460+0000","last_fullsized":"2024-04-16T19:38:24.408460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'933","last_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_deep_scrub":"53'933","last_deep_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.408381+0000","objects_scrubbed":26,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:46.227789+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13193,"num_omap_keys":66,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'24","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.811180+0000","last_change":"2024-04-16T19:38:19.811180+0000","last_active":"2024-04-16T19:38:19.811180+0000","last_peered":"2024-04-16T19:38:19.811180+0000","last_clean":"2024-04-16T19:38:19.811180+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:38:19.811180+0000","last_undegraded":"2024-04-16T19:38:19.811180+0000","last_fullsized":"2024-04-16T19:38:19.811180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.811061+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:19.180605+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.593070+0000","last_change":"2024-04-16T19:39:14.593113+0000","last_active":"2024-04-16T19:39:14.593070+0000","last_peered":"2024-04-16T19:39:14.593070+0000","last_clean":"2024-04-16T19:39:14.593070+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:39:14.593070+0000","last_undegraded":"2024-04-16T19:39:14.593070+0000","last_fullsized":"2024-04-16T19:39:14.593070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.592993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.592993+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.592993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:44.617591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795461+0000","last_change":"2024-04-16T19:38:33.795461+0000","last_active":"2024-04-16T19:38:33.795461+0000","last_peered":"2024-04-16T19:38:33.795461+0000","last_clean":"2024-04-16T19:38:33.795461+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:38:33.795461+0000","last_undegraded":"2024-04-16T19:38:33.795461+0000","last_fullsized":"2024-04-16T19:38:33.795461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:47.763767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.008970+0000","last_change":"2024-04-16T19:39:03.008993+0000","last_active":"2024-04-16T19:39:03.008970+0000","last_peered":"2024-04-16T19:39:03.008970+0000","last_clean":"2024-04-16T19:39:03.008970+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:39:03.008970+0000","last_undegraded":"2024-04-16T19:39:03.008970+0000","last_fullsized":"2024-04-16T19:39:03.008970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.008902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.008902+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.008902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:45.918962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'159","reported_seq":367,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.008609+0000","last_change":"2024-04-16T19:39:00.008649+0000","last_active":"2024-04-16T19:39:00.008609+0000","last_peered":"2024-04-16T19:39:00.008609+0000","last_clean":"2024-04-16T19:39:00.008609+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:39:00.008609+0000","last_undegraded":"2024-04-16T19:39:00.008609+0000","last_fullsized":"2024-04-16T19:39:00.008609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:00.008548+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:00.008548+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.008548+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:20.719287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'13","reported_seq":1403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.379708+0000","last_change":"2024-04-16T19:38:51.379732+0000","last_active":"2024-04-16T19:38:51.379708+0000","last_peered":"2024-04-16T19:38:51.379708+0000","last_clean":"2024-04-16T19:38:51.379708+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:38:51.379708+0000","last_undegraded":"2024-04-16T19:38:51.379708+0000","last_fullsized":"2024-04-16T19:38:51.379708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.379649+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.379649+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.379649+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:17:27.551399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.361374+0000","last_change":"2024-04-16T19:38:31.361394+0000","last_active":"2024-04-16T19:38:31.361374+0000","last_peered":"2024-04-16T19:38:31.361374+0000","last_clean":"2024-04-16T19:38:31.361374+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:38:31.361374+0000","last_undegraded":"2024-04-16T19:38:31.361374+0000","last_fullsized":"2024-04-16T19:38:31.361374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.361320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:12.965762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.199228+0000","last_change":"2024-04-16T19:39:21.199251+0000","last_active":"2024-04-16T19:39:21.199228+0000","last_peered":"2024-04-16T19:39:21.199228+0000","last_clean":"2024-04-16T19:39:21.199228+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:39:21.199228+0000","last_undegraded":"2024-04-16T19:39:21.199228+0000","last_fullsized":"2024-04-16T19:39:21.199228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.199163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.199163+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.199163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:33.267504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'215","reported_seq":2411,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.685934+0000","last_change":"2024-04-16T19:38:50.685934+0000","last_active":"2024-04-16T19:38:50.685934+0000","last_peered":"2024-04-16T19:38:50.685934+0000","last_clean":"2024-04-16T19:38:50.685934+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:38:50.685934+0000","last_undegraded":"2024-04-16T19:38:50.685934+0000","last_fullsized":"2024-04-16T19:38:50.685934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'215","last_scrub_stamp":"2024-04-16T19:38:50.685830+0000","last_deep_scrub":"53'215","last_deep_scrub_stamp":"2024-04-16T19:38:50.685830+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.685830+0000","objects_scrubbed":51,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:48:53.644287+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15064,"num_omap_keys":61,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.792912+0000","last_change":"2024-04-16T19:38:43.792912+0000","last_active":"2024-04-16T19:38:43.792912+0000","last_peered":"2024-04-16T19:38:43.792912+0000","last_clean":"2024-04-16T19:38:43.792912+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:38:43.792912+0000","last_undegraded":"2024-04-16T19:38:43.792912+0000","last_fullsized":"2024-04-16T19:38:43.792912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.792826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:02.586806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'25","reported_seq":153,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.332961+0000","last_change":"2024-04-16T19:38:45.333002+0000","last_active":"2024-04-16T19:38:45.332961+0000","last_peered":"2024-04-16T19:38:45.332961+0000","last_clean":"2024-04-16T19:38:45.332961+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:38:45.332961+0000","last_undegraded":"2024-04-16T19:38:45.332961+0000","last_fullsized":"2024-04-16T19:38:45.332961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.332898+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:29.252852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.794605+0000","last_change":"2024-04-16T19:38:38.794628+0000","last_active":"2024-04-16T19:38:38.794605+0000","last_peered":"2024-04-16T19:38:38.794605+0000","last_clean":"2024-04-16T19:38:38.794605+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:38:38.794605+0000","last_undegraded":"2024-04-16T19:38:38.794605+0000","last_fullsized":"2024-04-16T19:38:38.794605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.794540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:20.398982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'620","reported_seq":3264,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.073025+0000","last_change":"2024-04-16T19:38:11.073025+0000","last_active":"2024-04-16T19:38:11.073025+0000","last_peered":"2024-04-16T19:38:11.073025+0000","last_clean":"2024-04-16T19:38:11.073025+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:38:11.073025+0000","last_undegraded":"2024-04-16T19:38:11.073025+0000","last_fullsized":"2024-04-16T19:38:11.073025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'620","last_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_deep_scrub":"53'620","last_deep_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.072941+0000","objects_scrubbed":28,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:29.251802+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7883,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'29","reported_seq":356,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.759701+0000","last_change":"2024-04-16T19:38:28.759701+0000","last_active":"2024-04-16T19:38:28.759701+0000","last_peered":"2024-04-16T19:38:28.759701+0000","last_clean":"2024-04-16T19:38:28.759701+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:38:28.759701+0000","last_undegraded":"2024-04-16T19:38:28.759701+0000","last_fullsized":"2024-04-16T19:38:28.759701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'29","last_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_deep_scrub":"53'29","last_deep_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.759592+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:37.264543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.394260+0000","last_change":"2024-04-16T19:39:13.394286+0000","last_active":"2024-04-16T19:39:13.394260+0000","last_peered":"2024-04-16T19:39:13.394260+0000","last_clean":"2024-04-16T19:39:13.394260+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:39:13.394260+0000","last_undegraded":"2024-04-16T19:39:13.394260+0000","last_fullsized":"2024-04-16T19:39:13.394260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.394199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.394199+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.394199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:07.280434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.503850+0000","last_change":"2024-04-16T19:39:21.503871+0000","last_active":"2024-04-16T19:39:21.503850+0000","last_peered":"2024-04-16T19:39:21.503850+0000","last_clean":"2024-04-16T19:39:21.503850+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:39:21.503850+0000","last_undegraded":"2024-04-16T19:39:21.503850+0000","last_fullsized":"2024-04-16T19:39:21.503850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.503785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.503785+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.503785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:34.898058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"53'4","reported_seq":193,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.044842+0000","last_change":"2024-04-16T19:39:05.044875+0000","last_active":"2024-04-16T19:39:05.044842+0000","last_peered":"2024-04-16T19:39:05.044842+0000","last_clean":"2024-04-16T19:39:05.044842+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:39:05.044842+0000","last_undegraded":"2024-04-16T19:39:05.044842+0000","last_fullsized":"2024-04-16T19:39:05.044842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:05.044785+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:05.044785+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.044785+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:02.023870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'93","reported_seq":274,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.380153+0000","last_change":"2024-04-16T19:39:05.380186+0000","last_active":"2024-04-16T19:39:05.380153+0000","last_peered":"2024-04-16T19:39:05.380153+0000","last_clean":"2024-04-16T19:39:05.380153+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:39:05.380153+0000","last_undegraded":"2024-04-16T19:39:05.380153+0000","last_fullsized":"2024-04-16T19:39:05.380153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'93","last_scrub_stamp":"2024-04-16T19:39:05.380096+0000","last_deep_scrub":"53'93","last_deep_scrub_stamp":"2024-04-16T19:39:05.380096+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.380096+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:20.400865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.969020+0000","last_change":"2024-04-16T19:38:49.969046+0000","last_active":"2024-04-16T19:38:49.969020+0000","last_peered":"2024-04-16T19:38:49.969020+0000","last_clean":"2024-04-16T19:38:49.969020+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:38:49.969020+0000","last_undegraded":"2024-04-16T19:38:49.969020+0000","last_fullsized":"2024-04-16T19:38:49.969020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.968949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.968949+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.968949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:55.390786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.759633+0000","last_change":"2024-04-16T19:38:27.759655+0000","last_active":"2024-04-16T19:38:27.759633+0000","last_peered":"2024-04-16T19:38:27.759633+0000","last_clean":"2024-04-16T19:38:27.759633+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:38:27.759633+0000","last_undegraded":"2024-04-16T19:38:27.759633+0000","last_fullsized":"2024-04-16T19:38:27.759633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.759568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:42.585548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.596023+0000","last_change":"2024-04-16T18:09:02.173322+0000","last_active":"2024-04-16T19:37:54.596023+0000","last_peered":"2024-04-16T19:37:54.596023+0000","last_clean":"2024-04-16T19:37:54.596023+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:37:54.596023+0000","last_undegraded":"2024-04-16T19:37:54.596023+0000","last_fullsized":"2024-04-16T19:37:54.596023+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'183","reported_seq":1969,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.363333+0000","last_change":"2024-04-16T19:39:00.363333+0000","last_active":"2024-04-16T19:39:00.363333+0000","last_peered":"2024-04-16T19:39:00.363333+0000","last_clean":"2024-04-16T19:39:00.363333+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:39:00.363333+0000","last_undegraded":"2024-04-16T19:39:00.363333+0000","last_fullsized":"2024-04-16T19:39:00.363333+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'183","last_scrub_stamp":"2024-04-16T19:39:00.363243+0000","last_deep_scrub":"53'183","last_deep_scrub_stamp":"2024-04-16T19:39:00.363243+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.363243+0000","objects_scrubbed":52,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:44.415353+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10405,"num_omap_keys":43,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.571609+0000","last_change":"2024-04-16T19:38:24.571609+0000","last_active":"2024-04-16T19:38:24.571609+0000","last_peered":"2024-04-16T19:38:24.571609+0000","last_clean":"2024-04-16T19:38:24.571609+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:38:24.571609+0000","last_undegraded":"2024-04-16T19:38:24.571609+0000","last_fullsized":"2024-04-16T19:38:24.571609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.571519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:55.147346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'13","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.847919+0000","last_change":"2024-04-16T19:38:48.847948+0000","last_active":"2024-04-16T19:38:48.847919+0000","last_peered":"2024-04-16T19:38:48.847919+0000","last_clean":"2024-04-16T19:38:48.847919+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:38:48.847919+0000","last_undegraded":"2024-04-16T19:38:48.847919+0000","last_fullsized":"2024-04-16T19:38:48.847919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.847863+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:18.385433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'652","reported_seq":2214,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.914164+0000","last_change":"2024-04-16T19:38:49.914193+0000","last_active":"2024-04-16T19:38:49.914164+0000","last_peered":"2024-04-16T19:38:49.914164+0000","last_clean":"2024-04-16T19:38:49.914164+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:38:49.914164+0000","last_undegraded":"2024-04-16T19:38:49.914164+0000","last_fullsized":"2024-04-16T19:38:49.914164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:49.914098+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:49.914098+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.914098+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:38.352262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'328","reported_seq":608,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.821880+0000","last_change":"2024-04-16T19:38:14.821880+0000","last_active":"2024-04-16T19:38:14.821880+0000","last_peered":"2024-04-16T19:38:14.821880+0000","last_clean":"2024-04-16T19:38:14.821880+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:38:14.821880+0000","last_undegraded":"2024-04-16T19:38:14.821880+0000","last_fullsized":"2024-04-16T19:38:14.821880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'328","last_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_deep_scrub":"53'328","last_deep_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.821710+0000","objects_scrubbed":22,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:27.374369+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14461,"num_omap_keys":66,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'12","reported_seq":557,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.221422+0000","last_change":"2024-04-16T19:38:14.221422+0000","last_active":"2024-04-16T19:38:14.221422+0000","last_peered":"2024-04-16T19:38:14.221422+0000","last_clean":"2024-04-16T19:38:14.221422+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:38:14.221422+0000","last_undegraded":"2024-04-16T19:38:14.221422+0000","last_fullsized":"2024-04-16T19:38:14.221422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.221299+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:29.047279+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.267910+0000","last_change":"2024-04-16T19:38:56.267932+0000","last_active":"2024-04-16T19:38:56.267910+0000","last_peered":"2024-04-16T19:38:56.267910+0000","last_clean":"2024-04-16T19:38:56.267910+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:38:56.267910+0000","last_undegraded":"2024-04-16T19:38:56.267910+0000","last_fullsized":"2024-04-16T19:38:56.267910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.267851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.267851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.267851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:39.824687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.835466+0000","last_change":"2024-04-16T19:39:22.835490+0000","last_active":"2024-04-16T19:39:22.835466+0000","last_peered":"2024-04-16T19:39:22.835466+0000","last_clean":"2024-04-16T19:39:22.835466+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:39:22.835466+0000","last_undegraded":"2024-04-16T19:39:22.835466+0000","last_fullsized":"2024-04-16T19:39:22.835466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.835399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.835399+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.835399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:20.237478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"53'4","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.988919+0000","last_change":"2024-04-16T19:38:58.988948+0000","last_active":"2024-04-16T19:38:58.988919+0000","last_peered":"2024-04-16T19:38:58.988919+0000","last_clean":"2024-04-16T19:38:58.988919+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:38:58.988919+0000","last_undegraded":"2024-04-16T19:38:58.988919+0000","last_fullsized":"2024-04-16T19:38:58.988919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:58.988846+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:58.988846+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.988846+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:04:00.042173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'109","reported_seq":291,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.321077+0000","last_change":"2024-04-16T19:38:53.321117+0000","last_active":"2024-04-16T19:38:53.321077+0000","last_peered":"2024-04-16T19:38:53.321077+0000","last_clean":"2024-04-16T19:38:53.321077+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:38:53.321077+0000","last_undegraded":"2024-04-16T19:38:53.321077+0000","last_fullsized":"2024-04-16T19:38:53.321077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:53.321015+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:53.321015+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.321015+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:32.108521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.338639+0000","last_change":"2024-04-16T19:38:54.338662+0000","last_active":"2024-04-16T19:38:54.338639+0000","last_peered":"2024-04-16T19:38:54.338639+0000","last_clean":"2024-04-16T19:38:54.338639+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:38:54.338639+0000","last_undegraded":"2024-04-16T19:38:54.338639+0000","last_fullsized":"2024-04-16T19:38:54.338639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:54.338572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:54.338572+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.338572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:15.049310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.698520+0000","last_change":"2024-04-16T19:38:40.698543+0000","last_active":"2024-04-16T19:38:40.698520+0000","last_peered":"2024-04-16T19:38:40.698520+0000","last_clean":"2024-04-16T19:38:40.698520+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:38:40.698520+0000","last_undegraded":"2024-04-16T19:38:40.698520+0000","last_fullsized":"2024-04-16T19:38:40.698520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.698456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:35.601090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.407078+0000","last_change":"2024-04-16T18:09:02.172450+0000","last_active":"2024-04-16T19:37:54.407078+0000","last_peered":"2024-04-16T19:37:54.407078+0000","last_clean":"2024-04-16T19:37:54.407078+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:37:54.407078+0000","last_undegraded":"2024-04-16T19:37:54.407078+0000","last_fullsized":"2024-04-16T19:37:54.407078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'214","reported_seq":2192,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.819710+0000","last_change":"2024-04-16T19:39:06.819710+0000","last_active":"2024-04-16T19:39:06.819710+0000","last_peered":"2024-04-16T19:39:06.819710+0000","last_clean":"2024-04-16T19:39:06.819710+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:39:06.819710+0000","last_undegraded":"2024-04-16T19:39:06.819710+0000","last_fullsized":"2024-04-16T19:39:06.819710+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'214","last_scrub_stamp":"2024-04-16T19:39:06.819616+0000","last_deep_scrub":"53'214","last_deep_scrub_stamp":"2024-04-16T19:39:06.819616+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.819616+0000","objects_scrubbed":58,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:28.816792+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11101,"num_omap_keys":44,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.926346+0000","last_change":"2024-04-16T19:38:50.926369+0000","last_active":"2024-04-16T19:38:50.926346+0000","last_peered":"2024-04-16T19:38:50.926346+0000","last_clean":"2024-04-16T19:38:50.926346+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:38:50.926346+0000","last_undegraded":"2024-04-16T19:38:50.926346+0000","last_fullsized":"2024-04-16T19:38:50.926346+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.926283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.926283+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.926283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:00.576961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'148","reported_seq":341,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.921604+0000","last_change":"2024-04-16T19:38:45.921641+0000","last_active":"2024-04-16T19:38:45.921604+0000","last_peered":"2024-04-16T19:38:45.921604+0000","last_clean":"2024-04-16T19:38:45.921604+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:38:45.921604+0000","last_undegraded":"2024-04-16T19:38:45.921604+0000","last_fullsized":"2024-04-16T19:38:45.921604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'148","last_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_deep_scrub":"53'148","last_deep_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.921535+0000","objects_scrubbed":4,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:26.250123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9535,"num_omap_keys":55,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.087323+0000","last_change":"2024-04-16T19:38:15.087323+0000","last_active":"2024-04-16T19:38:15.087323+0000","last_peered":"2024-04-16T19:38:15.087323+0000","last_clean":"2024-04-16T19:38:15.087323+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:38:15.087323+0000","last_undegraded":"2024-04-16T19:38:15.087323+0000","last_fullsized":"2024-04-16T19:38:15.087323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.087231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:14:00.509056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'845","reported_seq":1835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.089179+0000","last_change":"2024-04-16T19:38:10.089179+0000","last_active":"2024-04-16T19:38:10.089179+0000","last_peered":"2024-04-16T19:38:10.089179+0000","last_clean":"2024-04-16T19:38:10.089179+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:38:10.089179+0000","last_undegraded":"2024-04-16T19:38:10.089179+0000","last_fullsized":"2024-04-16T19:38:10.089179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'845","last_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_deep_scrub":"53'845","last_deep_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.089105+0000","objects_scrubbed":25,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:33.799326+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7064,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'8","reported_seq":283,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.784403+0000","last_change":"2024-04-16T19:38:13.784444+0000","last_active":"2024-04-16T19:38:13.784403+0000","last_peered":"2024-04-16T19:38:13.784403+0000","last_clean":"2024-04-16T19:38:13.784403+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:38:13.784403+0000","last_undegraded":"2024-04-16T19:38:13.784403+0000","last_fullsized":"2024-04-16T19:38:13.784403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.784341+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:20.950710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.032884+0000","last_change":"2024-04-16T19:39:15.032906+0000","last_active":"2024-04-16T19:39:15.032884+0000","last_peered":"2024-04-16T19:39:15.032884+0000","last_clean":"2024-04-16T19:39:15.032884+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:39:15.032884+0000","last_undegraded":"2024-04-16T19:39:15.032884+0000","last_fullsized":"2024-04-16T19:39:15.032884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.032817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.032817+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.032817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:11.261229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.032600+0000","last_change":"2024-04-16T19:39:16.032643+0000","last_active":"2024-04-16T19:39:16.032600+0000","last_peered":"2024-04-16T19:39:16.032600+0000","last_clean":"2024-04-16T19:39:16.032600+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:39:16.032600+0000","last_undegraded":"2024-04-16T19:39:16.032600+0000","last_fullsized":"2024-04-16T19:39:16.032600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.032519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.032519+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.032519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:51.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"53'14","reported_seq":157,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.885012+0000","last_change":"2024-04-16T19:39:24.885042+0000","last_active":"2024-04-16T19:39:24.885012+0000","last_peered":"2024-04-16T19:39:24.885012+0000","last_clean":"2024-04-16T19:39:24.885012+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:39:24.885012+0000","last_undegraded":"2024-04-16T19:39:24.885012+0000","last_fullsized":"2024-04-16T19:39:24.885012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:39:24.884947+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:39:24.884947+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.884947+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:15.226333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'159","reported_seq":365,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.102260+0000","last_change":"2024-04-16T19:39:09.102303+0000","last_active":"2024-04-16T19:39:09.102260+0000","last_peered":"2024-04-16T19:39:09.102260+0000","last_clean":"2024-04-16T19:39:09.102260+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:39:09.102260+0000","last_undegraded":"2024-04-16T19:39:09.102260+0000","last_fullsized":"2024-04-16T19:39:09.102260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:09.102197+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:09.102197+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.102197+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:49.430786+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.920197+0000","last_change":"2024-04-16T19:38:45.920222+0000","last_active":"2024-04-16T19:38:45.920197+0000","last_peered":"2024-04-16T19:38:45.920197+0000","last_clean":"2024-04-16T19:38:45.920197+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:38:45.920197+0000","last_undegraded":"2024-04-16T19:38:45.920197+0000","last_fullsized":"2024-04-16T19:38:45.920197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.920132+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:59.970112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.699740+0000","last_change":"2024-04-16T19:38:44.699765+0000","last_active":"2024-04-16T19:38:44.699740+0000","last_peered":"2024-04-16T19:38:44.699740+0000","last_clean":"2024-04-16T19:38:44.699740+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:38:44.699740+0000","last_undegraded":"2024-04-16T19:38:44.699740+0000","last_fullsized":"2024-04-16T19:38:44.699740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.699672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:23.487178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":60,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429994+0000","last_change":"2024-04-16T18:09:02.167161+0000","last_active":"2024-04-16T19:38:09.429994+0000","last_peered":"2024-04-16T19:38:09.429994+0000","last_clean":"2024-04-16T19:38:09.429994+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:38:09.429994+0000","last_undegraded":"2024-04-16T19:38:09.429994+0000","last_fullsized":"2024-04-16T19:38:09.429994+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'123","reported_seq":1657,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.055957+0000","last_change":"2024-04-16T19:39:01.055999+0000","last_active":"2024-04-16T19:39:01.055957+0000","last_peered":"2024-04-16T19:39:01.055957+0000","last_clean":"2024-04-16T19:39:01.055957+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:39:01.055957+0000","last_undegraded":"2024-04-16T19:39:01.055957+0000","last_fullsized":"2024-04-16T19:39:01.055957+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'123","last_scrub_stamp":"2024-04-16T19:39:01.055896+0000","last_deep_scrub":"53'123","last_deep_scrub_stamp":"2024-04-16T19:39:01.055896+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.055896+0000","objects_scrubbed":39,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:30.391341+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6944,"num_omap_keys":28,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.960413+0000","last_change":"2024-04-16T19:38:52.960413+0000","last_active":"2024-04-16T19:38:52.960413+0000","last_peered":"2024-04-16T19:38:52.960413+0000","last_clean":"2024-04-16T19:38:52.960413+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:38:52.960413+0000","last_undegraded":"2024-04-16T19:38:52.960413+0000","last_fullsized":"2024-04-16T19:38:52.960413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:52.960329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:52.960329+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.960329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:00.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'23","reported_seq":165,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.788363+0000","last_change":"2024-04-16T19:38:36.788402+0000","last_active":"2024-04-16T19:38:36.788363+0000","last_peered":"2024-04-16T19:38:36.788363+0000","last_clean":"2024-04-16T19:38:36.788363+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:38:36.788363+0000","last_undegraded":"2024-04-16T19:38:36.788363+0000","last_fullsized":"2024-04-16T19:38:36.788363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.788299+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:50.210568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.516924+0000","last_change":"2024-04-16T19:38:22.516949+0000","last_active":"2024-04-16T19:38:22.516924+0000","last_peered":"2024-04-16T19:38:22.516924+0000","last_clean":"2024-04-16T19:38:22.516924+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:38:22.516924+0000","last_undegraded":"2024-04-16T19:38:22.516924+0000","last_fullsized":"2024-04-16T19:38:22.516924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.516860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:29.683230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'556","reported_seq":948,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.745464+0000","last_change":"2024-04-16T19:38:10.745507+0000","last_active":"2024-04-16T19:38:10.745464+0000","last_peered":"2024-04-16T19:38:10.745464+0000","last_clean":"2024-04-16T19:38:10.745464+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:38:10.745464+0000","last_undegraded":"2024-04-16T19:38:10.745464+0000","last_fullsized":"2024-04-16T19:38:10.745464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'556","last_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_deep_scrub":"53'556","last_deep_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.745406+0000","objects_scrubbed":30,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:38:44.014095+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56852,"num_omap_keys":197,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'20","reported_seq":403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.950663+0000","last_change":"2024-04-16T19:38:18.950663+0000","last_active":"2024-04-16T19:38:18.950663+0000","last_peered":"2024-04-16T19:38:18.950663+0000","last_clean":"2024-04-16T19:38:18.950663+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:38:18.950663+0000","last_undegraded":"2024-04-16T19:38:18.950663+0000","last_fullsized":"2024-04-16T19:38:18.950663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.950543+0000","objects_scrubbed":10,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:35:43.149409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.232849+0000","last_change":"2024-04-16T19:39:05.232871+0000","last_active":"2024-04-16T19:39:05.232849+0000","last_peered":"2024-04-16T19:39:05.232849+0000","last_clean":"2024-04-16T19:39:05.232849+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:39:05.232849+0000","last_undegraded":"2024-04-16T19:39:05.232849+0000","last_fullsized":"2024-04-16T19:39:05.232849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:05.232783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:05.232783+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.232783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:14.883462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.147374+0000","last_change":"2024-04-16T19:39:15.147417+0000","last_active":"2024-04-16T19:39:15.147374+0000","last_peered":"2024-04-16T19:39:15.147374+0000","last_clean":"2024-04-16T19:39:15.147374+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:39:15.147374+0000","last_undegraded":"2024-04-16T19:39:15.147374+0000","last_fullsized":"2024-04-16T19:39:15.147374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.147300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.147300+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.147300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:51.414128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"53'20","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.756258+0000","last_change":"2024-04-16T19:39:05.756291+0000","last_active":"2024-04-16T19:39:05.756258+0000","last_peered":"2024-04-16T19:39:05.756258+0000","last_clean":"2024-04-16T19:39:05.756258+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:39:05.756258+0000","last_undegraded":"2024-04-16T19:39:05.756258+0000","last_fullsized":"2024-04-16T19:39:05.756258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:39:05.756190+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:39:05.756190+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.756190+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:33.153102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'125","reported_seq":310,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.767839+0000","last_change":"2024-04-16T19:38:57.767889+0000","last_active":"2024-04-16T19:38:57.767839+0000","last_peered":"2024-04-16T19:38:57.767839+0000","last_clean":"2024-04-16T19:38:57.767839+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:38:57.767839+0000","last_undegraded":"2024-04-16T19:38:57.767839+0000","last_fullsized":"2024-04-16T19:38:57.767839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:57.767770+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:57.767770+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.767770+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:37:57.201721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.371464+0000","last_change":"2024-04-16T19:38:48.371504+0000","last_active":"2024-04-16T19:38:48.371464+0000","last_peered":"2024-04-16T19:38:48.371464+0000","last_clean":"2024-04-16T19:38:48.371464+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:38:48.371464+0000","last_undegraded":"2024-04-16T19:38:48.371464+0000","last_fullsized":"2024-04-16T19:38:48.371464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.371402+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:08.229885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.304929+0000","last_change":"2024-04-16T19:38:44.304973+0000","last_active":"2024-04-16T19:38:44.304929+0000","last_peered":"2024-04-16T19:38:44.304929+0000","last_clean":"2024-04-16T19:38:44.304929+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:38:44.304929+0000","last_undegraded":"2024-04-16T19:38:44.304929+0000","last_fullsized":"2024-04-16T19:38:44.304929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.304852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:02.982475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.849749+0000","last_change":"2024-04-16T19:39:27.849772+0000","last_active":"2024-04-16T19:39:27.849749+0000","last_peered":"2024-04-16T19:39:27.849749+0000","last_clean":"2024-04-16T19:39:27.849749+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:39:27.849749+0000","last_undegraded":"2024-04-16T19:39:27.849749+0000","last_fullsized":"2024-04-16T19:39:27.849749+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:27.849680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:27.849680+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.849680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:03:20.915552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'161","reported_seq":2018,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.406393+0000","last_change":"2024-04-16T19:38:52.406393+0000","last_active":"2024-04-16T19:38:52.406393+0000","last_peered":"2024-04-16T19:38:52.406393+0000","last_clean":"2024-04-16T19:38:52.406393+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:38:52.406393+0000","last_undegraded":"2024-04-16T19:38:52.406393+0000","last_fullsized":"2024-04-16T19:38:52.406393+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'161","last_scrub_stamp":"2024-04-16T19:38:52.406292+0000","last_deep_scrub":"53'161","last_deep_scrub_stamp":"2024-04-16T19:38:52.406292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.406292+0000","objects_scrubbed":31,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:04.474633+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11035,"num_omap_keys":45,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.968540+0000","last_change":"2024-04-16T19:38:44.968540+0000","last_active":"2024-04-16T19:38:44.968540+0000","last_peered":"2024-04-16T19:38:44.968540+0000","last_clean":"2024-04-16T19:38:44.968540+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:38:44.968540+0000","last_undegraded":"2024-04-16T19:38:44.968540+0000","last_fullsized":"2024-04-16T19:38:44.968540+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.968404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:05.438509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'21","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.778353+0000","last_change":"2024-04-16T19:38:37.778410+0000","last_active":"2024-04-16T19:38:37.778353+0000","last_peered":"2024-04-16T19:38:37.778353+0000","last_clean":"2024-04-16T19:38:37.778353+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:38:37.778353+0000","last_undegraded":"2024-04-16T19:38:37.778353+0000","last_fullsized":"2024-04-16T19:38:37.778353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.778277+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:55.312669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.762332+0000","last_change":"2024-04-16T19:38:20.762362+0000","last_active":"2024-04-16T19:38:20.762332+0000","last_peered":"2024-04-16T19:38:20.762332+0000","last_clean":"2024-04-16T19:38:20.762332+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:38:20.762332+0000","last_undegraded":"2024-04-16T19:38:20.762332+0000","last_fullsized":"2024-04-16T19:38:20.762332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.762267+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:32.587575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'447","reported_seq":743,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.567084+0000","last_change":"2024-04-16T19:38:15.567084+0000","last_active":"2024-04-16T19:38:15.567084+0000","last_peered":"2024-04-16T19:38:15.567084+0000","last_clean":"2024-04-16T19:38:15.567084+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:38:15.567084+0000","last_undegraded":"2024-04-16T19:38:15.567084+0000","last_fullsized":"2024-04-16T19:38:15.567084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'447","last_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_deep_scrub":"53'447","last_deep_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.566947+0000","objects_scrubbed":23,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:08.446790+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7264,"num_omap_keys":33,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'38","reported_seq":544,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.770259+0000","last_change":"2024-04-16T19:38:19.770333+0000","last_active":"2024-04-16T19:38:19.770259+0000","last_peered":"2024-04-16T19:38:19.770259+0000","last_clean":"2024-04-16T19:38:19.770259+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:38:19.770259+0000","last_undegraded":"2024-04-16T19:38:19.770259+0000","last_fullsized":"2024-04-16T19:38:19.770259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'38","last_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_deep_scrub":"53'38","last_deep_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.770195+0000","objects_scrubbed":10,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:32.489397+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.117354+0000","last_change":"2024-04-16T19:38:25.117354+0000","last_active":"2024-04-16T19:38:25.117354+0000","last_peered":"2024-04-16T19:38:25.117354+0000","last_clean":"2024-04-16T19:38:25.117354+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:38:25.117354+0000","last_undegraded":"2024-04-16T19:38:25.117354+0000","last_fullsized":"2024-04-16T19:38:25.117354+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.117265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.100913+0000","last_change":"2024-04-16T19:39:12.100951+0000","last_active":"2024-04-16T19:39:12.100913+0000","last_peered":"2024-04-16T19:39:12.100913+0000","last_clean":"2024-04-16T19:39:12.100913+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:39:12.100913+0000","last_undegraded":"2024-04-16T19:39:12.100913+0000","last_fullsized":"2024-04-16T19:39:12.100913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.100829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.100829+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.100829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:21.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.018075+0000","last_change":"2024-04-16T19:39:06.018098+0000","last_active":"2024-04-16T19:39:06.018075+0000","last_peered":"2024-04-16T19:39:06.018075+0000","last_clean":"2024-04-16T19:39:06.018075+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:39:06.018075+0000","last_undegraded":"2024-04-16T19:39:06.018075+0000","last_fullsized":"2024-04-16T19:39:06.018075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.018006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.018006+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.018006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:50.070115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'184","reported_seq":402,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.798158+0000","last_change":"2024-04-16T19:39:04.798203+0000","last_active":"2024-04-16T19:39:04.798158+0000","last_peered":"2024-04-16T19:39:04.798158+0000","last_clean":"2024-04-16T19:39:04.798158+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:39:04.798158+0000","last_undegraded":"2024-04-16T19:39:04.798158+0000","last_fullsized":"2024-04-16T19:39:04.798158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'184","last_scrub_stamp":"2024-04-16T19:39:04.798090+0000","last_deep_scrub":"53'184","last_deep_scrub_stamp":"2024-04-16T19:39:04.798090+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.798090+0000","objects_scrubbed":8,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:04.542146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.958099+0000","last_change":"2024-04-16T19:38:50.958122+0000","last_active":"2024-04-16T19:38:50.958099+0000","last_peered":"2024-04-16T19:38:50.958099+0000","last_clean":"2024-04-16T19:38:50.958099+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:38:50.958099+0000","last_undegraded":"2024-04-16T19:38:50.958099+0000","last_fullsized":"2024-04-16T19:38:50.958099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.958033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.958033+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.958033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:34.877987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.718631+0000","last_change":"2024-04-16T19:38:41.718655+0000","last_active":"2024-04-16T19:38:41.718631+0000","last_peered":"2024-04-16T19:38:41.718631+0000","last_clean":"2024-04-16T19:38:41.718631+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:38:41.718631+0000","last_undegraded":"2024-04-16T19:38:41.718631+0000","last_fullsized":"2024-04-16T19:38:41.718631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.718567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:36.366059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.238376+0000","last_change":"2024-04-16T19:39:25.238412+0000","last_active":"2024-04-16T19:39:25.238376+0000","last_peered":"2024-04-16T19:39:25.238376+0000","last_clean":"2024-04-16T19:39:25.238376+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:39:25.238376+0000","last_undegraded":"2024-04-16T19:39:25.238376+0000","last_fullsized":"2024-04-16T19:39:25.238376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.238290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.238290+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.238290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:25.548394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'157","reported_seq":1998,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.449633+0000","last_change":"2024-04-16T19:38:50.449633+0000","last_active":"2024-04-16T19:38:50.449633+0000","last_peered":"2024-04-16T19:38:50.449633+0000","last_clean":"2024-04-16T19:38:50.449633+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:38:50.449633+0000","last_undegraded":"2024-04-16T19:38:50.449633+0000","last_fullsized":"2024-04-16T19:38:50.449633+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'157","last_scrub_stamp":"2024-04-16T19:38:50.449529+0000","last_deep_scrub":"53'157","last_deep_scrub_stamp":"2024-04-16T19:38:50.449529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.449529+0000","objects_scrubbed":40,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:37.452857+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11968,"num_omap_keys":48,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.747274+0000","last_change":"2024-04-16T19:38:38.747274+0000","last_active":"2024-04-16T19:38:38.747274+0000","last_peered":"2024-04-16T19:38:38.747274+0000","last_clean":"2024-04-16T19:38:38.747274+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:38:38.747274+0000","last_undegraded":"2024-04-16T19:38:38.747274+0000","last_fullsized":"2024-04-16T19:38:38.747274+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.747176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:44.763682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'30","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.513984+0000","last_change":"2024-04-16T19:38:29.514047+0000","last_active":"2024-04-16T19:38:29.513984+0000","last_peered":"2024-04-16T19:38:29.513984+0000","last_clean":"2024-04-16T19:38:29.513984+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:38:29.513984+0000","last_undegraded":"2024-04-16T19:38:29.513984+0000","last_fullsized":"2024-04-16T19:38:29.513984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'30","last_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_deep_scrub":"53'30","last_deep_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.513910+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:38.309746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.764970+0000","last_change":"2024-04-16T19:38:22.764970+0000","last_active":"2024-04-16T19:38:22.764970+0000","last_peered":"2024-04-16T19:38:22.764970+0000","last_clean":"2024-04-16T19:38:22.764970+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:38:22.764970+0000","last_undegraded":"2024-04-16T19:38:22.764970+0000","last_fullsized":"2024-04-16T19:38:22.764970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.764883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:30.765316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'305","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.819258+0000","last_change":"2024-04-16T19:38:16.819258+0000","last_active":"2024-04-16T19:38:16.819258+0000","last_peered":"2024-04-16T19:38:16.819258+0000","last_clean":"2024-04-16T19:38:16.819258+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:38:16.819258+0000","last_undegraded":"2024-04-16T19:38:16.819258+0000","last_fullsized":"2024-04-16T19:38:16.819258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'305","last_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_deep_scrub":"53'305","last_deep_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.819127+0000","objects_scrubbed":14,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:56.568944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6851,"num_omap_keys":31,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'21","reported_seq":476,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.104753+0000","last_change":"2024-04-16T19:38:18.104753+0000","last_active":"2024-04-16T19:38:18.104753+0000","last_peered":"2024-04-16T19:38:18.104753+0000","last_clean":"2024-04-16T19:38:18.104753+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:38:18.104753+0000","last_undegraded":"2024-04-16T19:38:18.104753+0000","last_fullsized":"2024-04-16T19:38:18.104753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.104621+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:22.649252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:04.405592+0000","last_change":"2024-04-16T17:45:10.393759+0000","last_active":"2024-04-16T19:38:04.405592+0000","last_peered":"2024-04-16T19:38:04.405592+0000","last_clean":"2024-04-16T19:38:04.405592+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:38:04.405592+0000","last_undegraded":"2024-04-16T19:38:04.405592+0000","last_fullsized":"2024-04-16T19:38:04.405592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:09.373838+0000","last_clean_scrub_stamp":"2024-04-16T17:45:09.373838+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"53'119","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.037420+0000","last_change":"2024-04-16T19:39:27.037452+0000","last_active":"2024-04-16T19:39:27.037420+0000","last_peered":"2024-04-16T19:39:27.037420+0000","last_clean":"2024-04-16T19:39:27.037420+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:39:27.037420+0000","last_undegraded":"2024-04-16T19:39:27.037420+0000","last_fullsized":"2024-04-16T19:39:27.037420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'119","last_scrub_stamp":"2024-04-16T19:39:27.037356+0000","last_deep_scrub":"53'119","last_deep_scrub_stamp":"2024-04-16T19:39:27.037356+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.037356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:22.390941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338540+0000","last_change":"2024-04-16T17:44:22.167872+0000","last_active":"2024-04-16T19:38:10.338540+0000","last_peered":"2024-04-16T19:38:10.338540+0000","last_clean":"2024-04-16T19:38:10.338540+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:38:10.338540+0000","last_undegraded":"2024-04-16T19:38:10.338540+0000","last_fullsized":"2024-04-16T19:38:10.338540+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.877810+0000","last_change":"2024-04-16T19:39:23.877865+0000","last_active":"2024-04-16T19:39:23.877810+0000","last_peered":"2024-04-16T19:39:23.877810+0000","last_clean":"2024-04-16T19:39:23.877810+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:39:23.877810+0000","last_undegraded":"2024-04-16T19:39:23.877810+0000","last_fullsized":"2024-04-16T19:39:23.877810+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.877727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.877727+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.877727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:59.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.207941+0000","last_change":"2024-04-16T19:39:06.207962+0000","last_active":"2024-04-16T19:39:06.207941+0000","last_peered":"2024-04-16T19:39:06.207941+0000","last_clean":"2024-04-16T19:39:06.207941+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:39:06.207941+0000","last_undegraded":"2024-04-16T19:39:06.207941+0000","last_fullsized":"2024-04-16T19:39:06.207941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.207880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.207880+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.207880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:54.646044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'77","reported_seq":255,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.827843+0000","last_change":"2024-04-16T19:39:01.827876+0000","last_active":"2024-04-16T19:39:01.827843+0000","last_peered":"2024-04-16T19:39:01.827843+0000","last_clean":"2024-04-16T19:39:01.827843+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:39:01.827843+0000","last_undegraded":"2024-04-16T19:39:01.827843+0000","last_fullsized":"2024-04-16T19:39:01.827843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'77","last_scrub_stamp":"2024-04-16T19:39:01.827783+0000","last_deep_scrub":"53'77","last_deep_scrub_stamp":"2024-04-16T19:39:01.827783+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.827783+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:22.538522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.347215+0000","last_change":"2024-04-16T19:38:55.347237+0000","last_active":"2024-04-16T19:38:55.347215+0000","last_peered":"2024-04-16T19:38:55.347215+0000","last_clean":"2024-04-16T19:38:55.347215+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:38:55.347215+0000","last_undegraded":"2024-04-16T19:38:55.347215+0000","last_fullsized":"2024-04-16T19:38:55.347215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:55.347148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:55.347148+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.347148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:24.682592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795949+0000","last_change":"2024-04-16T19:38:33.795974+0000","last_active":"2024-04-16T19:38:33.795949+0000","last_peered":"2024-04-16T19:38:33.795949+0000","last_clean":"2024-04-16T19:38:33.795949+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:38:33.795949+0000","last_undegraded":"2024-04-16T19:38:33.795949+0000","last_fullsized":"2024-04-16T19:38:33.795949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:54.984835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.015541+0000","last_change":"2024-04-16T19:39:26.015566+0000","last_active":"2024-04-16T19:39:26.015541+0000","last_peered":"2024-04-16T19:39:26.015541+0000","last_clean":"2024-04-16T19:39:26.015541+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:39:26.015541+0000","last_undegraded":"2024-04-16T19:39:26.015541+0000","last_fullsized":"2024-04-16T19:39:26.015541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.015466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.015466+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.015466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:04:56.936664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'199","reported_seq":2085,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.357054+0000","last_change":"2024-04-16T19:39:04.357096+0000","last_active":"2024-04-16T19:39:04.357054+0000","last_peered":"2024-04-16T19:39:04.357054+0000","last_clean":"2024-04-16T19:39:04.357054+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:39:04.357054+0000","last_undegraded":"2024-04-16T19:39:04.357054+0000","last_fullsized":"2024-04-16T19:39:04.357054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'199","last_scrub_stamp":"2024-04-16T19:39:04.356992+0000","last_deep_scrub":"53'199","last_deep_scrub_stamp":"2024-04-16T19:39:04.356992+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.356992+0000","objects_scrubbed":49,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:18.001011+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12625,"num_omap_keys":53,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.785219+0000","last_change":"2024-04-16T19:39:02.785219+0000","last_active":"2024-04-16T19:39:02.785219+0000","last_peered":"2024-04-16T19:39:02.785219+0000","last_clean":"2024-04-16T19:39:02.785219+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:39:02.785219+0000","last_undegraded":"2024-04-16T19:39:02.785219+0000","last_fullsized":"2024-04-16T19:39:02.785219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.785101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.785101+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.785101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:32.120546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'7","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.346772+0000","last_change":"2024-04-16T19:38:42.346811+0000","last_active":"2024-04-16T19:38:42.346772+0000","last_peered":"2024-04-16T19:38:42.346772+0000","last_clean":"2024-04-16T19:38:42.346772+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:38:42.346772+0000","last_undegraded":"2024-04-16T19:38:42.346772+0000","last_fullsized":"2024-04-16T19:38:42.346772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.346708+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:50.944060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'652","reported_seq":2353,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.132401+0000","last_change":"2024-04-16T19:38:32.132432+0000","last_active":"2024-04-16T19:38:32.132401+0000","last_peered":"2024-04-16T19:38:32.132401+0000","last_clean":"2024-04-16T19:38:32.132401+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:38:32.132401+0000","last_undegraded":"2024-04-16T19:38:32.132401+0000","last_fullsized":"2024-04-16T19:38:32.132401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.132341+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:57.828052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'465","reported_seq":770,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.378097+0000","last_change":"2024-04-16T19:38:22.378097+0000","last_active":"2024-04-16T19:38:22.378097+0000","last_peered":"2024-04-16T19:38:22.378097+0000","last_clean":"2024-04-16T19:38:22.378097+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:38:22.378097+0000","last_undegraded":"2024-04-16T19:38:22.378097+0000","last_fullsized":"2024-04-16T19:38:22.378097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'465","last_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_deep_scrub":"53'465","last_deep_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.378008+0000","objects_scrubbed":26,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:24.892034+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'22","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.329830+0000","last_change":"2024-04-16T19:38:21.329929+0000","last_active":"2024-04-16T19:38:21.329830+0000","last_peered":"2024-04-16T19:38:21.329830+0000","last_clean":"2024-04-16T19:38:21.329830+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:38:21.329830+0000","last_undegraded":"2024-04-16T19:38:21.329830+0000","last_fullsized":"2024-04-16T19:38:21.329830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.329754+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:26.751591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.411035+0000","last_change":"2024-04-16T19:39:12.411055+0000","last_active":"2024-04-16T19:39:12.411035+0000","last_peered":"2024-04-16T19:39:12.411035+0000","last_clean":"2024-04-16T19:39:12.411035+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:39:12.411035+0000","last_undegraded":"2024-04-16T19:39:12.411035+0000","last_fullsized":"2024-04-16T19:39:12.411035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.410979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.410979+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.410979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:14.912580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.079562+0000","last_change":"2024-04-16T19:39:28.079584+0000","last_active":"2024-04-16T19:39:28.079562+0000","last_peered":"2024-04-16T19:39:28.079562+0000","last_clean":"2024-04-16T19:39:28.079562+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:39:28.079562+0000","last_undegraded":"2024-04-16T19:39:28.079562+0000","last_fullsized":"2024-04-16T19:39:28.079562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.079498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.079498+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.079498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:22.717628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.720009+0000","last_change":"2024-04-16T19:38:29.720009+0000","last_active":"2024-04-16T19:38:29.720009+0000","last_peered":"2024-04-16T19:38:29.720009+0000","last_clean":"2024-04-16T19:38:29.720009+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:38:29.720009+0000","last_undegraded":"2024-04-16T19:38:29.720009+0000","last_fullsized":"2024-04-16T19:38:29.720009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.719912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:00.040596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"53'16","reported_seq":594,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.755505+0000","last_change":"2024-04-16T19:39:07.755557+0000","last_active":"2024-04-16T19:39:07.755505+0000","last_peered":"2024-04-16T19:39:07.755505+0000","last_clean":"2024-04-16T19:39:07.755505+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:39:07.755505+0000","last_undegraded":"2024-04-16T19:39:07.755505+0000","last_fullsized":"2024-04-16T19:39:07.755505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:39:07.755429+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:39:07.755429+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.755429+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:51.807538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'187","reported_seq":1686,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.796149+0000","last_change":"2024-04-16T19:38:59.796192+0000","last_active":"2024-04-16T19:38:59.796149+0000","last_peered":"2024-04-16T19:38:59.796149+0000","last_clean":"2024-04-16T19:38:59.796149+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:38:59.796149+0000","last_undegraded":"2024-04-16T19:38:59.796149+0000","last_fullsized":"2024-04-16T19:38:59.796149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'187","last_scrub_stamp":"2024-04-16T19:38:59.796087+0000","last_deep_scrub":"53'187","last_deep_scrub_stamp":"2024-04-16T19:38:59.796087+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.796087+0000","objects_scrubbed":10,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:02:23.701420+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.405296+0000","last_change":"2024-04-16T19:38:51.405321+0000","last_active":"2024-04-16T19:38:51.405296+0000","last_peered":"2024-04-16T19:38:51.405296+0000","last_clean":"2024-04-16T19:38:51.405296+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:38:51.405296+0000","last_undegraded":"2024-04-16T19:38:51.405296+0000","last_fullsized":"2024-04-16T19:38:51.405296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:51.405235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:51.405235+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.405235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:58.035377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.744953+0000","last_change":"2024-04-16T19:38:25.744976+0000","last_active":"2024-04-16T19:38:25.744953+0000","last_peered":"2024-04-16T19:38:25.744953+0000","last_clean":"2024-04-16T19:38:25.744953+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:38:25.744953+0000","last_undegraded":"2024-04-16T19:38:25.744953+0000","last_fullsized":"2024-04-16T19:38:25.744953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.744882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:25.114426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340407+0000","last_change":"2024-04-16T18:09:02.171827+0000","last_active":"2024-04-16T19:38:10.340407+0000","last_peered":"2024-04-16T19:38:10.340407+0000","last_clean":"2024-04-16T19:38:10.340407+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:38:10.340407+0000","last_undegraded":"2024-04-16T19:38:10.340407+0000","last_fullsized":"2024-04-16T19:38:10.340407+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'181","reported_seq":1654,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.691437+0000","last_change":"2024-04-16T19:39:10.691492+0000","last_active":"2024-04-16T19:39:10.691437+0000","last_peered":"2024-04-16T19:39:10.691437+0000","last_clean":"2024-04-16T19:39:10.691437+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:39:10.691437+0000","last_undegraded":"2024-04-16T19:39:10.691437+0000","last_fullsized":"2024-04-16T19:39:10.691437+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'181","last_scrub_stamp":"2024-04-16T19:39:10.691378+0000","last_deep_scrub":"53'181","last_deep_scrub_stamp":"2024-04-16T19:39:10.691378+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.691378+0000","objects_scrubbed":44,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:02.946071+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10471,"num_omap_keys":42,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.774336+0000","last_change":"2024-04-16T19:38:58.774358+0000","last_active":"2024-04-16T19:38:58.774336+0000","last_peered":"2024-04-16T19:38:58.774336+0000","last_clean":"2024-04-16T19:38:58.774336+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:38:58.774336+0000","last_undegraded":"2024-04-16T19:38:58.774336+0000","last_fullsized":"2024-04-16T19:38:58.774336+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:58.774273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:58.774273+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.774273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:17:34.946023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'28","reported_seq":206,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.914339+0000","last_change":"2024-04-16T19:38:41.914339+0000","last_active":"2024-04-16T19:38:41.914339+0000","last_peered":"2024-04-16T19:38:41.914339+0000","last_clean":"2024-04-16T19:38:41.914339+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:38:41.914339+0000","last_undegraded":"2024-04-16T19:38:41.914339+0000","last_fullsized":"2024-04-16T19:38:41.914339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'28","last_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_deep_scrub":"53'28","last_deep_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.914241+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:38.893326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":60,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.138191+0000","last_change":"2024-04-16T19:38:31.138209+0000","last_active":"2024-04-16T19:38:31.138191+0000","last_peered":"2024-04-16T19:38:31.138191+0000","last_clean":"2024-04-16T19:38:31.138191+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:38:31.138191+0000","last_undegraded":"2024-04-16T19:38:31.138191+0000","last_fullsized":"2024-04-16T19:38:31.138191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.138139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:01.713966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4956","reported_seq":7445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.900157+0000","last_change":"2024-04-16T19:38:14.900157+0000","last_active":"2024-04-16T19:38:14.900157+0000","last_peered":"2024-04-16T19:38:14.900157+0000","last_clean":"2024-04-16T19:38:14.900157+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:38:14.900157+0000","last_undegraded":"2024-04-16T19:38:14.900157+0000","last_fullsized":"2024-04-16T19:38:14.900157+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4956","last_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_deep_scrub":"53'4956","last_deep_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.900021+0000","objects_scrubbed":21,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:17.433386+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'10","reported_seq":272,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.858857+0000","last_change":"2024-04-16T19:38:11.858857+0000","last_active":"2024-04-16T19:38:11.858857+0000","last_peered":"2024-04-16T19:38:11.858857+0000","last_clean":"2024-04-16T19:38:11.858857+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:38:11.858857+0000","last_undegraded":"2024-04-16T19:38:11.858857+0000","last_fullsized":"2024-04-16T19:38:11.858857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.858749+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:25:54.104521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.730779+0000","last_change":"2024-04-16T19:39:04.730826+0000","last_active":"2024-04-16T19:39:04.730779+0000","last_peered":"2024-04-16T19:39:04.730779+0000","last_clean":"2024-04-16T19:39:04.730779+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:39:04.730779+0000","last_undegraded":"2024-04-16T19:39:04.730779+0000","last_fullsized":"2024-04-16T19:39:04.730779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.730692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.730692+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.730692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:56.328928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.085491+0000","last_change":"2024-04-16T19:39:11.085515+0000","last_active":"2024-04-16T19:39:11.085491+0000","last_peered":"2024-04-16T19:39:11.085491+0000","last_clean":"2024-04-16T19:39:11.085491+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:39:11.085491+0000","last_undegraded":"2024-04-16T19:39:11.085491+0000","last_fullsized":"2024-04-16T19:39:11.085491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.085428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.085428+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.085428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:02:05.591134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.843313+0000","last_change":"2024-04-16T19:39:20.843313+0000","last_active":"2024-04-16T19:39:20.843313+0000","last_peered":"2024-04-16T19:39:20.843313+0000","last_clean":"2024-04-16T19:39:20.843313+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:39:20.843313+0000","last_undegraded":"2024-04-16T19:39:20.843313+0000","last_fullsized":"2024-04-16T19:39:20.843313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.843221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.843221+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.843221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:50.867819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"53'4","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.087742+0000","last_change":"2024-04-16T19:39:07.087798+0000","last_active":"2024-04-16T19:39:07.087742+0000","last_peered":"2024-04-16T19:39:07.087742+0000","last_clean":"2024-04-16T19:39:07.087742+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:39:07.087742+0000","last_undegraded":"2024-04-16T19:39:07.087742+0000","last_fullsized":"2024-04-16T19:39:07.087742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:07.087664+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:07.087664+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.087664+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:46.209570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'159","reported_seq":1628,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.803218+0000","last_change":"2024-04-16T19:38:59.803257+0000","last_active":"2024-04-16T19:38:59.803218+0000","last_peered":"2024-04-16T19:38:59.803218+0000","last_clean":"2024-04-16T19:38:59.803218+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:38:59.803218+0000","last_undegraded":"2024-04-16T19:38:59.803218+0000","last_fullsized":"2024-04-16T19:38:59.803218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:38:59.803156+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:38:59.803156+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.803156+0000","objects_scrubbed":8,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:11.871497+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.325392+0000","last_change":"2024-04-16T19:38:35.325421+0000","last_active":"2024-04-16T19:38:35.325392+0000","last_peered":"2024-04-16T19:38:35.325392+0000","last_clean":"2024-04-16T19:38:35.325392+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:38:35.325392+0000","last_undegraded":"2024-04-16T19:38:35.325392+0000","last_fullsized":"2024-04-16T19:38:35.325392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.325323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:35.441680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.320446+0000","last_change":"2024-04-16T19:38:27.320467+0000","last_active":"2024-04-16T19:38:27.320446+0000","last_peered":"2024-04-16T19:38:27.320446+0000","last_clean":"2024-04-16T19:38:27.320446+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:38:27.320446+0000","last_undegraded":"2024-04-16T19:38:27.320446+0000","last_fullsized":"2024-04-16T19:38:27.320446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.320384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:47.178868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.430011+0000","last_change":"2024-04-16T18:09:02.170023+0000","last_active":"2024-04-16T19:38:09.430011+0000","last_peered":"2024-04-16T19:38:09.430011+0000","last_clean":"2024-04-16T19:38:09.430011+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:38:09.430011+0000","last_undegraded":"2024-04-16T19:38:09.430011+0000","last_fullsized":"2024-04-16T19:38:09.430011+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'189","reported_seq":2092,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.387157+0000","last_change":"2024-04-16T19:38:46.387157+0000","last_active":"2024-04-16T19:38:46.387157+0000","last_peered":"2024-04-16T19:38:46.387157+0000","last_clean":"2024-04-16T19:38:46.387157+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:38:46.387157+0000","last_undegraded":"2024-04-16T19:38:46.387157+0000","last_fullsized":"2024-04-16T19:38:46.387157+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'189","last_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_deep_scrub":"53'189","last_deep_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.387038+0000","objects_scrubbed":54,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:22.550486+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12153,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.474066+0000","last_change":"2024-04-16T19:38:30.474066+0000","last_active":"2024-04-16T19:38:30.474066+0000","last_peered":"2024-04-16T19:38:30.474066+0000","last_clean":"2024-04-16T19:38:30.474066+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:38:30.474066+0000","last_undegraded":"2024-04-16T19:38:30.474066+0000","last_fullsized":"2024-04-16T19:38:30.474066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.473977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:10.223794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"53'4","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.365553+0000","last_change":"2024-04-16T19:38:41.365583+0000","last_active":"2024-04-16T19:38:41.365553+0000","last_peered":"2024-04-16T19:38:41.365553+0000","last_clean":"2024-04-16T19:38:41.365553+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:38:41.365553+0000","last_undegraded":"2024-04-16T19:38:41.365553+0000","last_fullsized":"2024-04-16T19:38:41.365553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.365486+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:10.903056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.088262+0000","last_change":"2024-04-16T19:38:21.088285+0000","last_active":"2024-04-16T19:38:21.088262+0000","last_peered":"2024-04-16T19:38:21.088262+0000","last_clean":"2024-04-16T19:38:21.088262+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:38:21.088262+0000","last_undegraded":"2024-04-16T19:38:21.088262+0000","last_fullsized":"2024-04-16T19:38:21.088262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.088193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:58.302179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'503","reported_seq":981,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.479844+0000","last_change":"2024-04-16T19:38:11.479844+0000","last_active":"2024-04-16T19:38:11.479844+0000","last_peered":"2024-04-16T19:38:11.479844+0000","last_clean":"2024-04-16T19:38:11.479844+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:38:11.479844+0000","last_undegraded":"2024-04-16T19:38:11.479844+0000","last_fullsized":"2024-04-16T19:38:11.479844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'503","last_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_deep_scrub":"53'503","last_deep_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.479730+0000","objects_scrubbed":31,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:50.543348+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7030,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'12","reported_seq":434,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.241107+0000","last_change":"2024-04-16T19:38:17.241107+0000","last_active":"2024-04-16T19:38:17.241107+0000","last_peered":"2024-04-16T19:38:17.241107+0000","last_clean":"2024-04-16T19:38:17.241107+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:38:17.241107+0000","last_undegraded":"2024-04-16T19:38:17.241107+0000","last_fullsized":"2024-04-16T19:38:17.241107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.241004+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:31.290983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.750173+0000","last_change":"2024-04-16T19:39:05.750194+0000","last_active":"2024-04-16T19:39:05.750173+0000","last_peered":"2024-04-16T19:39:05.750173+0000","last_clean":"2024-04-16T19:39:05.750173+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:39:05.750173+0000","last_undegraded":"2024-04-16T19:39:05.750173+0000","last_fullsized":"2024-04-16T19:39:05.750173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:05.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:05.750095+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:53:07.126866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.562681+0000","last_change":"2024-04-16T19:39:28.562707+0000","last_active":"2024-04-16T19:39:28.562681+0000","last_peered":"2024-04-16T19:39:28.562681+0000","last_clean":"2024-04-16T19:39:28.562681+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:39:28.562681+0000","last_undegraded":"2024-04-16T19:39:28.562681+0000","last_fullsized":"2024-04-16T19:39:28.562681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.562618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.562618+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.562618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:23.916203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.138444+0000","last_change":"2024-04-16T19:39:14.138466+0000","last_active":"2024-04-16T19:39:14.138444+0000","last_peered":"2024-04-16T19:39:14.138444+0000","last_clean":"2024-04-16T19:39:14.138444+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:39:14.138444+0000","last_undegraded":"2024-04-16T19:39:14.138444+0000","last_fullsized":"2024-04-16T19:39:14.138444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.138382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.138382+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.138382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:26.206722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"39'3","reported_seq":878,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068968+0000","last_change":"2024-04-16T17:45:20.407328+0000","last_active":"2024-04-16T19:38:08.068968+0000","last_peered":"2024-04-16T19:38:08.068968+0000","last_clean":"2024-04-16T19:38:08.068968+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:38:08.068968+0000","last_undegraded":"2024-04-16T19:38:08.068968+0000","last_fullsized":"2024-04-16T19:38:08.068968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:19.391583+0000","last_clean_scrub_stamp":"2024-04-16T17:45:19.391583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'150","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.723402+0000","last_change":"2024-04-16T19:38:56.723441+0000","last_active":"2024-04-16T19:38:56.723402+0000","last_peered":"2024-04-16T19:38:56.723402+0000","last_clean":"2024-04-16T19:38:56.723402+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:38:56.723402+0000","last_undegraded":"2024-04-16T19:38:56.723402+0000","last_fullsized":"2024-04-16T19:38:56.723402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'150","last_scrub_stamp":"2024-04-16T19:38:56.723332+0000","last_deep_scrub":"53'150","last_deep_scrub_stamp":"2024-04-16T19:38:56.723332+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.723332+0000","objects_scrubbed":6,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:51.229039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.898210+0000","last_change":"2024-04-16T19:38:35.898255+0000","last_active":"2024-04-16T19:38:35.898210+0000","last_peered":"2024-04-16T19:38:35.898210+0000","last_clean":"2024-04-16T19:38:35.898210+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:38:35.898210+0000","last_undegraded":"2024-04-16T19:38:35.898210+0000","last_fullsized":"2024-04-16T19:38:35.898210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.898130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:42.528272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.791834+0000","last_change":"2024-04-16T19:38:39.791854+0000","last_active":"2024-04-16T19:38:39.791834+0000","last_peered":"2024-04-16T19:38:39.791834+0000","last_clean":"2024-04-16T19:38:39.791834+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:38:39.791834+0000","last_undegraded":"2024-04-16T19:38:39.791834+0000","last_fullsized":"2024-04-16T19:38:39.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.791771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:45.969208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":58,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:54.403444+0000","last_change":"2024-04-16T18:09:02.176167+0000","last_active":"2024-04-16T19:37:54.403444+0000","last_peered":"2024-04-16T19:37:54.403444+0000","last_clean":"2024-04-16T19:37:54.403444+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:37:54.403444+0000","last_undegraded":"2024-04-16T19:37:54.403444+0000","last_fullsized":"2024-04-16T19:37:54.403444+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'146","reported_seq":1712,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:49.402501+0000","last_change":"2024-04-16T17:47:16.568155+0000","last_active":"2024-04-16T19:37:49.402501+0000","last_peered":"2024-04-16T19:37:49.402501+0000","last_clean":"2024-04-16T19:37:49.402501+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:37:49.402501+0000","last_undegraded":"2024-04-16T19:37:49.402501+0000","last_fullsized":"2024-04-16T19:37:49.402501+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.839203+0000","last_change":"2024-04-16T19:38:39.839203+0000","last_active":"2024-04-16T19:38:39.839203+0000","last_peered":"2024-04-16T19:38:39.839203+0000","last_clean":"2024-04-16T19:38:39.839203+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:38:39.839203+0000","last_undegraded":"2024-04-16T19:38:39.839203+0000","last_fullsized":"2024-04-16T19:38:39.839203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.839112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:23.811211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'14","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.080454+0000","last_change":"2024-04-16T19:38:28.080454+0000","last_active":"2024-04-16T19:38:28.080454+0000","last_peered":"2024-04-16T19:38:28.080454+0000","last_clean":"2024-04-16T19:38:28.080454+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:38:28.080454+0000","last_undegraded":"2024-04-16T19:38:28.080454+0000","last_fullsized":"2024-04-16T19:38:28.080454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.080349+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:30.384618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'652","reported_seq":2241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.085883+0000","last_change":"2024-04-16T19:38:17.085883+0000","last_active":"2024-04-16T19:38:17.085883+0000","last_peered":"2024-04-16T19:38:17.085883+0000","last_clean":"2024-04-16T19:38:17.085883+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:38:17.085883+0000","last_undegraded":"2024-04-16T19:38:17.085883+0000","last_fullsized":"2024-04-16T19:38:17.085883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.085744+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:55.082690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'364","reported_seq":672,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.518366+0000","last_change":"2024-04-16T19:38:17.518366+0000","last_active":"2024-04-16T19:38:17.518366+0000","last_peered":"2024-04-16T19:38:17.518366+0000","last_clean":"2024-04-16T19:38:17.518366+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:38:17.518366+0000","last_undegraded":"2024-04-16T19:38:17.518366+0000","last_fullsized":"2024-04-16T19:38:17.518366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'364","last_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_deep_scrub":"53'364","last_deep_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.518227+0000","objects_scrubbed":20,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:39.484987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6810,"num_omap_keys":31,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'21","reported_seq":470,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.711099+0000","last_change":"2024-04-16T19:38:25.711099+0000","last_active":"2024-04-16T19:38:25.711099+0000","last_peered":"2024-04-16T19:38:25.711099+0000","last_clean":"2024-04-16T19:38:25.711099+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:38:25.711099+0000","last_undegraded":"2024-04-16T19:38:25.711099+0000","last_fullsized":"2024-04-16T19:38:25.711099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.710924+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:00.685204+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.759393+0000","last_change":"2024-04-16T19:39:00.759418+0000","last_active":"2024-04-16T19:39:00.759393+0000","last_peered":"2024-04-16T19:39:00.759393+0000","last_clean":"2024-04-16T19:39:00.759393+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:39:00.759393+0000","last_undegraded":"2024-04-16T19:39:00.759393+0000","last_fullsized":"2024-04-16T19:39:00.759393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.759325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.759325+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.759325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:46:22.814258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.578377+0000","last_change":"2024-04-16T19:39:25.578425+0000","last_active":"2024-04-16T19:39:25.578377+0000","last_peered":"2024-04-16T19:39:25.578377+0000","last_clean":"2024-04-16T19:39:25.578377+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:39:25.578377+0000","last_undegraded":"2024-04-16T19:39:25.578377+0000","last_fullsized":"2024-04-16T19:39:25.578377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.578296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.578296+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.578296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:25.338094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.779384+0000","last_change":"2024-04-16T19:39:17.779426+0000","last_active":"2024-04-16T19:39:17.779384+0000","last_peered":"2024-04-16T19:39:17.779384+0000","last_clean":"2024-04-16T19:39:17.779384+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:39:17.779384+0000","last_undegraded":"2024-04-16T19:39:17.779384+0000","last_fullsized":"2024-04-16T19:39:17.779384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.779310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.779310+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.779310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:04:48.700508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.376273+0000","last_change":"2024-04-16T19:39:06.376296+0000","last_active":"2024-04-16T19:39:06.376273+0000","last_peered":"2024-04-16T19:39:06.376273+0000","last_clean":"2024-04-16T19:39:06.376273+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:39:06.376273+0000","last_undegraded":"2024-04-16T19:39:06.376273+0000","last_fullsized":"2024-04-16T19:39:06.376273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.376208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.376208+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.376208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:12.585831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'168","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.365486+0000","last_change":"2024-04-16T19:39:01.365523+0000","last_active":"2024-04-16T19:39:01.365486+0000","last_peered":"2024-04-16T19:39:01.365486+0000","last_clean":"2024-04-16T19:39:01.365486+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:39:01.365486+0000","last_undegraded":"2024-04-16T19:39:01.365486+0000","last_fullsized":"2024-04-16T19:39:01.365486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'168","last_scrub_stamp":"2024-04-16T19:39:01.365421+0000","last_deep_scrub":"53'168","last_deep_scrub_stamp":"2024-04-16T19:39:01.365421+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.365421+0000","objects_scrubbed":8,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:41.145407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.382963+0000","last_change":"2024-04-16T19:38:47.382987+0000","last_active":"2024-04-16T19:38:47.382963+0000","last_peered":"2024-04-16T19:38:47.382963+0000","last_clean":"2024-04-16T19:38:47.382963+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:38:47.382963+0000","last_undegraded":"2024-04-16T19:38:47.382963+0000","last_fullsized":"2024-04-16T19:38:47.382963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.382901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:43.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.343354+0000","last_change":"2024-04-16T19:38:23.343376+0000","last_active":"2024-04-16T19:38:23.343354+0000","last_peered":"2024-04-16T19:38:23.343354+0000","last_clean":"2024-04-16T19:38:23.343354+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:38:23.343354+0000","last_undegraded":"2024-04-16T19:38:23.343354+0000","last_fullsized":"2024-04-16T19:38:23.343354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.343292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:42.020915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.217069+0000","last_change":"2024-04-16T19:39:26.217092+0000","last_active":"2024-04-16T19:39:26.217069+0000","last_peered":"2024-04-16T19:39:26.217069+0000","last_clean":"2024-04-16T19:39:26.217069+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:39:26.217069+0000","last_undegraded":"2024-04-16T19:39:26.217069+0000","last_fullsized":"2024-04-16T19:39:26.217069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.217000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.217000+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.217000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:25.961057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'99","reported_seq":1691,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340349+0000","last_change":"2024-04-16T17:46:25.525760+0000","last_active":"2024-04-16T19:38:10.340349+0000","last_peered":"2024-04-16T19:38:10.340349+0000","last_clean":"2024-04-16T19:38:10.340349+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:38:10.340349+0000","last_undegraded":"2024-04-16T19:38:10.340349+0000","last_fullsized":"2024-04-16T19:38:10.340349+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.109454+0000","last_change":"2024-04-16T19:38:29.109454+0000","last_active":"2024-04-16T19:38:29.109454+0000","last_peered":"2024-04-16T19:38:29.109454+0000","last_clean":"2024-04-16T19:38:29.109454+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:38:29.109454+0000","last_undegraded":"2024-04-16T19:38:29.109454+0000","last_fullsized":"2024-04-16T19:38:29.109454+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.109370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:03.453529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"53'12","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.361852+0000","last_change":"2024-04-16T19:38:49.361907+0000","last_active":"2024-04-16T19:38:49.361852+0000","last_peered":"2024-04-16T19:38:49.361852+0000","last_clean":"2024-04-16T19:38:49.361852+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:38:49.361852+0000","last_undegraded":"2024-04-16T19:38:49.361852+0000","last_fullsized":"2024-04-16T19:38:49.361852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.361782+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:51.952616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.723050+0000","last_change":"2024-04-16T19:38:26.723073+0000","last_active":"2024-04-16T19:38:26.723050+0000","last_peered":"2024-04-16T19:38:26.723050+0000","last_clean":"2024-04-16T19:38:26.723050+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:38:26.723050+0000","last_undegraded":"2024-04-16T19:38:26.723050+0000","last_fullsized":"2024-04-16T19:38:26.723050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.722978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:34.382609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'523","reported_seq":865,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.541783+0000","last_change":"2024-04-16T19:38:13.541783+0000","last_active":"2024-04-16T19:38:13.541783+0000","last_peered":"2024-04-16T19:38:13.541783+0000","last_clean":"2024-04-16T19:38:13.541783+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:38:13.541783+0000","last_undegraded":"2024-04-16T19:38:13.541783+0000","last_fullsized":"2024-04-16T19:38:13.541783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'523","last_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_deep_scrub":"53'523","last_deep_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.541660+0000","objects_scrubbed":23,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:50.755647+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21532,"num_omap_keys":98,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'34","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.893657+0000","last_change":"2024-04-16T19:38:23.893744+0000","last_active":"2024-04-16T19:38:23.893657+0000","last_peered":"2024-04-16T19:38:23.893657+0000","last_clean":"2024-04-16T19:38:23.893657+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:38:23.893657+0000","last_undegraded":"2024-04-16T19:38:23.893657+0000","last_fullsized":"2024-04-16T19:38:23.893657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.893579+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:25.142771+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.359926+0000","last_change":"2024-04-16T19:39:15.359951+0000","last_active":"2024-04-16T19:39:15.359926+0000","last_peered":"2024-04-16T19:39:15.359926+0000","last_clean":"2024-04-16T19:39:15.359926+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:39:15.359926+0000","last_undegraded":"2024-04-16T19:39:15.359926+0000","last_fullsized":"2024-04-16T19:39:15.359926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.359847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.359847+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.359847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:01.414378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.807631+0000","last_change":"2024-04-16T19:39:21.807665+0000","last_active":"2024-04-16T19:39:21.807631+0000","last_peered":"2024-04-16T19:39:21.807631+0000","last_clean":"2024-04-16T19:39:21.807631+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:39:21.807631+0000","last_undegraded":"2024-04-16T19:39:21.807631+0000","last_fullsized":"2024-04-16T19:39:21.807631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.807562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.807562+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.807562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:18.899557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:29.067090+0000","last_change":"2024-04-16T19:39:29.067114+0000","last_active":"2024-04-16T19:39:29.067090+0000","last_peered":"2024-04-16T19:39:29.067090+0000","last_clean":"2024-04-16T19:39:29.067090+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:39:29.067090+0000","last_undegraded":"2024-04-16T19:39:29.067090+0000","last_fullsized":"2024-04-16T19:39:29.067090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:29.067026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:29.067026+0000","last_clean_scrub_stamp":"2024-04-16T19:39:29.067026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:48.103318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.743243+0000","last_change":"2024-04-16T19:39:08.743266+0000","last_active":"2024-04-16T19:39:08.743243+0000","last_peered":"2024-04-16T19:39:08.743243+0000","last_clean":"2024-04-16T19:39:08.743243+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:39:08.743243+0000","last_undegraded":"2024-04-16T19:39:08.743243+0000","last_fullsized":"2024-04-16T19:39:08.743243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.743182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.743182+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.743182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:48.523168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'175","reported_seq":388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.650250+0000","last_change":"2024-04-16T19:38:53.650288+0000","last_active":"2024-04-16T19:38:53.650250+0000","last_peered":"2024-04-16T19:38:53.650250+0000","last_clean":"2024-04-16T19:38:53.650250+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:38:53.650250+0000","last_undegraded":"2024-04-16T19:38:53.650250+0000","last_fullsized":"2024-04-16T19:38:53.650250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'175","last_scrub_stamp":"2024-04-16T19:38:53.650187+0000","last_deep_scrub":"53'175","last_deep_scrub_stamp":"2024-04-16T19:38:53.650187+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.650187+0000","objects_scrubbed":7,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:21:28.540265+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'13","reported_seq":1407,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.755116+0000","last_change":"2024-04-16T19:38:56.755146+0000","last_active":"2024-04-16T19:38:56.755116+0000","last_peered":"2024-04-16T19:38:56.755116+0000","last_clean":"2024-04-16T19:38:56.755116+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:38:56.755116+0000","last_undegraded":"2024-04-16T19:38:56.755116+0000","last_fullsized":"2024-04-16T19:38:56.755116+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:56.755051+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:56.755051+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.755051+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:59.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.367924+0000","last_change":"2024-04-16T19:38:25.367947+0000","last_active":"2024-04-16T19:38:25.367924+0000","last_peered":"2024-04-16T19:38:25.367924+0000","last_clean":"2024-04-16T19:38:25.367924+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:38:25.367924+0000","last_undegraded":"2024-04-16T19:38:25.367924+0000","last_fullsized":"2024-04-16T19:38:25.367924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.367850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:46.556801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.209387+0000","last_change":"2024-04-16T19:39:20.209427+0000","last_active":"2024-04-16T19:39:20.209387+0000","last_peered":"2024-04-16T19:39:20.209387+0000","last_clean":"2024-04-16T19:39:20.209387+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:39:20.209387+0000","last_undegraded":"2024-04-16T19:39:20.209387+0000","last_fullsized":"2024-04-16T19:39:20.209387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.209312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.209312+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.209312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:11.807547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'115","reported_seq":1838,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.429877+0000","last_change":"2024-04-16T17:46:25.527803+0000","last_active":"2024-04-16T19:38:09.429877+0000","last_peered":"2024-04-16T19:38:09.429877+0000","last_clean":"2024-04-16T19:38:09.429877+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:38:09.429877+0000","last_undegraded":"2024-04-16T19:38:09.429877+0000","last_fullsized":"2024-04-16T19:38:09.429877+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.830396+0000","last_change":"2024-04-16T19:38:46.830396+0000","last_active":"2024-04-16T19:38:46.830396+0000","last_peered":"2024-04-16T19:38:46.830396+0000","last_clean":"2024-04-16T19:38:46.830396+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:38:46.830396+0000","last_undegraded":"2024-04-16T19:38:46.830396+0000","last_fullsized":"2024-04-16T19:38:46.830396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.830276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:07.300381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'2","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.108567+0000","last_change":"2024-04-16T19:38:27.108567+0000","last_active":"2024-04-16T19:38:27.108567+0000","last_peered":"2024-04-16T19:38:27.108567+0000","last_clean":"2024-04-16T19:38:27.108567+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:38:27.108567+0000","last_undegraded":"2024-04-16T19:38:27.108567+0000","last_fullsized":"2024-04-16T19:38:27.108567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.108478+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:30.717209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.851943+0000","last_change":"2024-04-16T19:38:36.851943+0000","last_active":"2024-04-16T19:38:36.851943+0000","last_peered":"2024-04-16T19:38:36.851943+0000","last_clean":"2024-04-16T19:38:36.851943+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:38:36.851943+0000","last_undegraded":"2024-04-16T19:38:36.851943+0000","last_fullsized":"2024-04-16T19:38:36.851943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.851855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:41.780120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'341","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.445822+0000","last_change":"2024-04-16T19:38:10.445822+0000","last_active":"2024-04-16T19:38:10.445822+0000","last_peered":"2024-04-16T19:38:10.445822+0000","last_clean":"2024-04-16T19:38:10.445822+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:38:10.445822+0000","last_undegraded":"2024-04-16T19:38:10.445822+0000","last_fullsized":"2024-04-16T19:38:10.445822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'341","last_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_deep_scrub":"53'341","last_deep_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.445700+0000","objects_scrubbed":19,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:14.990331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20855,"num_omap_keys":95,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'34","reported_seq":599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.847777+0000","last_change":"2024-04-16T19:38:10.847777+0000","last_active":"2024-04-16T19:38:10.847777+0000","last_peered":"2024-04-16T19:38:10.847777+0000","last_clean":"2024-04-16T19:38:10.847777+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:38:10.847777+0000","last_undegraded":"2024-04-16T19:38:10.847777+0000","last_fullsized":"2024-04-16T19:38:10.847777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.847654+0000","objects_scrubbed":14,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:29.793118+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.337404+0000","last_change":"2024-04-16T19:39:22.337430+0000","last_active":"2024-04-16T19:39:22.337404+0000","last_peered":"2024-04-16T19:39:22.337404+0000","last_clean":"2024-04-16T19:39:22.337404+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:39:22.337404+0000","last_undegraded":"2024-04-16T19:39:22.337404+0000","last_fullsized":"2024-04-16T19:39:22.337404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.337337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.337337+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.337337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:16.975466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.148287+0000","last_change":"2024-04-16T19:39:13.148309+0000","last_active":"2024-04-16T19:39:13.148287+0000","last_peered":"2024-04-16T19:39:13.148287+0000","last_clean":"2024-04-16T19:39:13.148287+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:39:13.148287+0000","last_undegraded":"2024-04-16T19:39:13.148287+0000","last_fullsized":"2024-04-16T19:39:13.148287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.148224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.148224+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.148224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:01.586388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.767561+0000","last_change":"2024-04-16T19:39:16.767585+0000","last_active":"2024-04-16T19:39:16.767561+0000","last_peered":"2024-04-16T19:39:16.767561+0000","last_clean":"2024-04-16T19:39:16.767561+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:39:16.767561+0000","last_undegraded":"2024-04-16T19:39:16.767561+0000","last_fullsized":"2024-04-16T19:39:16.767561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.767491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.767491+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.767491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:09.022184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"53'6","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.018976+0000","last_change":"2024-04-16T19:39:03.019027+0000","last_active":"2024-04-16T19:39:03.018976+0000","last_peered":"2024-04-16T19:39:03.018976+0000","last_clean":"2024-04-16T19:39:03.018976+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:39:03.018976+0000","last_undegraded":"2024-04-16T19:39:03.018976+0000","last_fullsized":"2024-04-16T19:39:03.018976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:39:03.018892+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:39:03.018892+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.018892+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:02.762949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'125","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.048739+0000","last_change":"2024-04-16T19:38:59.048768+0000","last_active":"2024-04-16T19:38:59.048739+0000","last_peered":"2024-04-16T19:38:59.048739+0000","last_clean":"2024-04-16T19:38:59.048739+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:38:59.048739+0000","last_undegraded":"2024-04-16T19:38:59.048739+0000","last_fullsized":"2024-04-16T19:38:59.048739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:59.048680+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:59.048680+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.048680+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:35.315508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'13","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.344477+0000","last_change":"2024-04-16T19:38:53.344506+0000","last_active":"2024-04-16T19:38:53.344477+0000","last_peered":"2024-04-16T19:38:53.344477+0000","last_clean":"2024-04-16T19:38:53.344477+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:38:53.344477+0000","last_undegraded":"2024-04-16T19:38:53.344477+0000","last_fullsized":"2024-04-16T19:38:53.344477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:53.344411+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:53.344411+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.344411+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:29.611239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.320279+0000","last_change":"2024-04-16T19:38:26.320303+0000","last_active":"2024-04-16T19:38:26.320279+0000","last_peered":"2024-04-16T19:38:26.320279+0000","last_clean":"2024-04-16T19:38:26.320279+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:38:26.320279+0000","last_undegraded":"2024-04-16T19:38:26.320279+0000","last_fullsized":"2024-04-16T19:38:26.320279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.320216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:10.143275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.025268+0000","last_change":"2024-04-16T19:38:53.025289+0000","last_active":"2024-04-16T19:38:53.025268+0000","last_peered":"2024-04-16T19:38:53.025268+0000","last_clean":"2024-04-16T19:38:53.025268+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:38:53.025268+0000","last_undegraded":"2024-04-16T19:38:53.025268+0000","last_fullsized":"2024-04-16T19:38:53.025268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.025203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.025203+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.025203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:14.844610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'161","reported_seq":2090,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069971+0000","last_change":"2024-04-16T17:46:25.532056+0000","last_active":"2024-04-16T19:38:08.069971+0000","last_peered":"2024-04-16T19:38:08.069971+0000","last_clean":"2024-04-16T19:38:08.069971+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:38:08.069971+0000","last_undegraded":"2024-04-16T19:38:08.069971+0000","last_fullsized":"2024-04-16T19:38:08.069971+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.205293+0000","last_change":"2024-04-16T19:38:37.205293+0000","last_active":"2024-04-16T19:38:37.205293+0000","last_peered":"2024-04-16T19:38:37.205293+0000","last_clean":"2024-04-16T19:38:37.205293+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:38:37.205293+0000","last_undegraded":"2024-04-16T19:38:37.205293+0000","last_fullsized":"2024-04-16T19:38:37.205293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.205209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:23.238881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'7","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.132412+0000","last_change":"2024-04-16T19:38:26.132412+0000","last_active":"2024-04-16T19:38:26.132412+0000","last_peered":"2024-04-16T19:38:26.132412+0000","last_clean":"2024-04-16T19:38:26.132412+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:38:26.132412+0000","last_undegraded":"2024-04-16T19:38:26.132412+0000","last_fullsized":"2024-04-16T19:38:26.132412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.132277+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:26.528982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'652","reported_seq":2213,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.537534+0000","last_change":"2024-04-16T19:38:14.537534+0000","last_active":"2024-04-16T19:38:14.537534+0000","last_peered":"2024-04-16T19:38:14.537534+0000","last_clean":"2024-04-16T19:38:14.537534+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:38:14.537534+0000","last_undegraded":"2024-04-16T19:38:14.537534+0000","last_fullsized":"2024-04-16T19:38:14.537534+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.537442+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:05.967541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5554","reported_seq":10355,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.938437+0000","last_change":"2024-04-16T19:38:16.938437+0000","last_active":"2024-04-16T19:38:16.938437+0000","last_peered":"2024-04-16T19:38:16.938437+0000","last_clean":"2024-04-16T19:38:16.938437+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:38:16.938437+0000","last_undegraded":"2024-04-16T19:38:16.938437+0000","last_fullsized":"2024-04-16T19:38:16.938437+0000","mapping_epoch":33,"log_start":"53'3800","ondisk_log_start":"53'3800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5554","last_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_deep_scrub":"53'5554","last_deep_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.938343+0000","objects_scrubbed":27,"log_size":1754,"log_dups_size":3000,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:35.567420+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'24","reported_seq":708,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.053024+0000","last_change":"2024-04-16T19:38:22.053138+0000","last_active":"2024-04-16T19:38:22.053024+0000","last_peered":"2024-04-16T19:38:22.053024+0000","last_clean":"2024-04-16T19:38:22.053024+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:38:22.053024+0000","last_undegraded":"2024-04-16T19:38:22.053024+0000","last_fullsized":"2024-04-16T19:38:22.053024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.052928+0000","objects_scrubbed":12,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:13.483027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.240914+0000","last_change":"2024-04-16T19:38:57.240940+0000","last_active":"2024-04-16T19:38:57.240914+0000","last_peered":"2024-04-16T19:38:57.240914+0000","last_clean":"2024-04-16T19:38:57.240914+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:38:57.240914+0000","last_undegraded":"2024-04-16T19:38:57.240914+0000","last_fullsized":"2024-04-16T19:38:57.240914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.240851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.240851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.240851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:42.664937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.344011+0000","last_change":"2024-04-16T19:39:26.344036+0000","last_active":"2024-04-16T19:39:26.344011+0000","last_peered":"2024-04-16T19:39:26.344011+0000","last_clean":"2024-04-16T19:39:26.344011+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:39:26.344011+0000","last_undegraded":"2024-04-16T19:39:26.344011+0000","last_fullsized":"2024-04-16T19:39:26.344011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.343947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.343947+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.343947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:00:52.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428240+0000","last_change":"2024-04-16T17:44:22.327713+0000","last_active":"2024-04-16T19:38:09.428240+0000","last_peered":"2024-04-16T19:38:09.428240+0000","last_clean":"2024-04-16T19:38:09.428240+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:38:09.428240+0000","last_undegraded":"2024-04-16T19:38:09.428240+0000","last_fullsized":"2024-04-16T19:38:09.428240+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:44:21.156403+0000","last_clean_scrub_stamp":"2024-04-16T17:44:21.156403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"53'2","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.043747+0000","last_change":"2024-04-16T19:38:55.043776+0000","last_active":"2024-04-16T19:38:55.043747+0000","last_peered":"2024-04-16T19:38:55.043747+0000","last_clean":"2024-04-16T19:38:55.043747+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:38:55.043747+0000","last_undegraded":"2024-04-16T19:38:55.043747+0000","last_fullsized":"2024-04-16T19:38:55.043747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:55.043682+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:55.043682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.043682+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:38.866741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'152","reported_seq":368,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.108322+0000","last_change":"2024-04-16T19:39:20.108360+0000","last_active":"2024-04-16T19:39:20.108322+0000","last_peered":"2024-04-16T19:39:20.108322+0000","last_clean":"2024-04-16T19:39:20.108322+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:39:20.108322+0000","last_undegraded":"2024-04-16T19:39:20.108322+0000","last_fullsized":"2024-04-16T19:39:20.108322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'152","last_scrub_stamp":"2024-04-16T19:39:20.108262+0000","last_deep_scrub":"53'152","last_deep_scrub_stamp":"2024-04-16T19:39:20.108262+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.108262+0000","objects_scrubbed":8,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:47.505174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.938478+0000","last_change":"2024-04-16T19:38:47.938499+0000","last_active":"2024-04-16T19:38:47.938478+0000","last_peered":"2024-04-16T19:38:47.938478+0000","last_clean":"2024-04-16T19:38:47.938478+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:38:47.938478+0000","last_undegraded":"2024-04-16T19:38:47.938478+0000","last_fullsized":"2024-04-16T19:38:47.938478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.938415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:49.187607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.799921+0000","last_change":"2024-04-16T19:38:35.799944+0000","last_active":"2024-04-16T19:38:35.799921+0000","last_peered":"2024-04-16T19:38:35.799921+0000","last_clean":"2024-04-16T19:38:35.799921+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:38:35.799921+0000","last_undegraded":"2024-04-16T19:38:35.799921+0000","last_fullsized":"2024-04-16T19:38:35.799921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.799851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.447343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069979+0000","last_change":"2024-04-16T18:09:02.163439+0000","last_active":"2024-04-16T19:38:08.069979+0000","last_peered":"2024-04-16T19:38:08.069979+0000","last_clean":"2024-04-16T19:38:08.069979+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:38:08.069979+0000","last_undegraded":"2024-04-16T19:38:08.069979+0000","last_fullsized":"2024-04-16T19:38:08.069979+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'139","reported_seq":1783,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.023043+0000","last_change":"2024-04-16T19:39:05.023087+0000","last_active":"2024-04-16T19:39:05.023043+0000","last_peered":"2024-04-16T19:39:05.023043+0000","last_clean":"2024-04-16T19:39:05.023043+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:39:05.023043+0000","last_undegraded":"2024-04-16T19:39:05.023043+0000","last_fullsized":"2024-04-16T19:39:05.023043+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'139","last_scrub_stamp":"2024-04-16T19:39:05.022983+0000","last_deep_scrub":"53'139","last_deep_scrub_stamp":"2024-04-16T19:39:05.022983+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.022983+0000","objects_scrubbed":38,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:27.020160+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9754,"num_omap_keys":41,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.806738+0000","last_change":"2024-04-16T19:38:34.806738+0000","last_active":"2024-04-16T19:38:34.806738+0000","last_peered":"2024-04-16T19:38:34.806738+0000","last_clean":"2024-04-16T19:38:34.806738+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:38:34.806738+0000","last_undegraded":"2024-04-16T19:38:34.806738+0000","last_fullsized":"2024-04-16T19:38:34.806738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.806640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:43.311591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'25","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.421766+0000","last_change":"2024-04-16T19:38:35.421800+0000","last_active":"2024-04-16T19:38:35.421766+0000","last_peered":"2024-04-16T19:38:35.421766+0000","last_clean":"2024-04-16T19:38:35.421766+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:38:35.421766+0000","last_undegraded":"2024-04-16T19:38:35.421766+0000","last_fullsized":"2024-04-16T19:38:35.421766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.421703+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:03:09.135386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.727449+0000","last_change":"2024-04-16T19:38:24.727504+0000","last_active":"2024-04-16T19:38:24.727449+0000","last_peered":"2024-04-16T19:38:24.727449+0000","last_clean":"2024-04-16T19:38:24.727449+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:38:24.727449+0000","last_undegraded":"2024-04-16T19:38:24.727449+0000","last_fullsized":"2024-04-16T19:38:24.727449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.727368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:38.777347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'344","reported_seq":655,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.511356+0000","last_change":"2024-04-16T19:38:12.511356+0000","last_active":"2024-04-16T19:38:12.511356+0000","last_peered":"2024-04-16T19:38:12.511356+0000","last_clean":"2024-04-16T19:38:12.511356+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:38:12.511356+0000","last_undegraded":"2024-04-16T19:38:12.511356+0000","last_fullsized":"2024-04-16T19:38:12.511356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'344","last_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_deep_scrub":"53'344","last_deep_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.511231+0000","objects_scrubbed":24,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:10.499739+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13835,"num_omap_keys":63,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'14","reported_seq":627,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.257871+0000","last_change":"2024-04-16T19:38:19.257946+0000","last_active":"2024-04-16T19:38:19.257871+0000","last_peered":"2024-04-16T19:38:19.257871+0000","last_clean":"2024-04-16T19:38:19.257871+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:38:19.257871+0000","last_undegraded":"2024-04-16T19:38:19.257871+0000","last_fullsized":"2024-04-16T19:38:19.257871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.257792+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:20.506984+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.319985+0000","last_change":"2024-04-16T19:38:33.320008+0000","last_active":"2024-04-16T19:38:33.319985+0000","last_peered":"2024-04-16T19:38:33.319985+0000","last_clean":"2024-04-16T19:38:33.319985+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:38:33.319985+0000","last_undegraded":"2024-04-16T19:38:33.319985+0000","last_fullsized":"2024-04-16T19:38:33.319985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.319922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:11.454921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.090772+0000","last_change":"2024-04-16T19:39:19.090817+0000","last_active":"2024-04-16T19:39:19.090772+0000","last_peered":"2024-04-16T19:39:19.090772+0000","last_clean":"2024-04-16T19:39:19.090772+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:39:19.090772+0000","last_undegraded":"2024-04-16T19:39:19.090772+0000","last_fullsized":"2024-04-16T19:39:19.090772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.090697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.090697+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.090697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:18.834753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.037108+0000","last_change":"2024-04-16T19:39:22.037150+0000","last_active":"2024-04-16T19:39:22.037108+0000","last_peered":"2024-04-16T19:39:22.037108+0000","last_clean":"2024-04-16T19:39:22.037108+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:39:22.037108+0000","last_undegraded":"2024-04-16T19:39:22.037108+0000","last_fullsized":"2024-04-16T19:39:22.037108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.037031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.037031+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.037031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:00.346235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"53'2","reported_seq":219,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.835426+0000","last_change":"2024-04-16T19:39:12.835451+0000","last_active":"2024-04-16T19:39:12.835426+0000","last_peered":"2024-04-16T19:39:12.835426+0000","last_clean":"2024-04-16T19:39:12.835426+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:39:12.835426+0000","last_undegraded":"2024-04-16T19:39:12.835426+0000","last_fullsized":"2024-04-16T19:39:12.835426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:12.835366+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:12.835366+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.835366+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:34.832542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'109","reported_seq":289,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.058460+0000","last_change":"2024-04-16T19:38:54.058490+0000","last_active":"2024-04-16T19:38:54.058460+0000","last_peered":"2024-04-16T19:38:54.058460+0000","last_clean":"2024-04-16T19:38:54.058460+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:38:54.058460+0000","last_undegraded":"2024-04-16T19:38:54.058460+0000","last_fullsized":"2024-04-16T19:38:54.058460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:54.058400+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:54.058400+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.058400+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:15:15.247351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.684178+0000","last_change":"2024-04-16T19:38:49.684225+0000","last_active":"2024-04-16T19:38:49.684178+0000","last_peered":"2024-04-16T19:38:49.684178+0000","last_clean":"2024-04-16T19:38:49.684178+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:38:49.684178+0000","last_undegraded":"2024-04-16T19:38:49.684178+0000","last_fullsized":"2024-04-16T19:38:49.684178+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.684096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.684096+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.684096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:46.663181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.053487+0000","last_change":"2024-04-16T19:39:24.053531+0000","last_active":"2024-04-16T19:39:24.053487+0000","last_peered":"2024-04-16T19:39:24.053487+0000","last_clean":"2024-04-16T19:39:24.053487+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:39:24.053487+0000","last_undegraded":"2024-04-16T19:39:24.053487+0000","last_fullsized":"2024-04-16T19:39:24.053487+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.053407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.053407+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.053407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:31.226812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'191","reported_seq":1684,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.870373+0000","last_change":"2024-04-16T19:39:25.870416+0000","last_active":"2024-04-16T19:39:25.870373+0000","last_peered":"2024-04-16T19:39:25.870373+0000","last_clean":"2024-04-16T19:39:25.870373+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:39:25.870373+0000","last_undegraded":"2024-04-16T19:39:25.870373+0000","last_fullsized":"2024-04-16T19:39:25.870373+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'191","last_scrub_stamp":"2024-04-16T19:39:25.870313+0000","last_deep_scrub":"53'191","last_deep_scrub_stamp":"2024-04-16T19:39:25.870313+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.870313+0000","objects_scrubbed":44,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:28.371915+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11398,"num_omap_keys":46,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.386677+0000","last_change":"2024-04-16T19:38:34.386677+0000","last_active":"2024-04-16T19:38:34.386677+0000","last_peered":"2024-04-16T19:38:34.386677+0000","last_clean":"2024-04-16T19:38:34.386677+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:38:34.386677+0000","last_undegraded":"2024-04-16T19:38:34.386677+0000","last_fullsized":"2024-04-16T19:38:34.386677+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.386595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:24.029746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'16","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.029753+0000","last_change":"2024-04-16T19:39:22.029813+0000","last_active":"2024-04-16T19:39:22.029753+0000","last_peered":"2024-04-16T19:39:22.029753+0000","last_clean":"2024-04-16T19:39:22.029753+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:39:22.029753+0000","last_undegraded":"2024-04-16T19:39:22.029753+0000","last_fullsized":"2024-04-16T19:39:22.029753+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:39:22.029677+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:39:22.029677+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.029677+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:48:53.142383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.919701+0000","last_change":"2024-04-16T19:38:32.919725+0000","last_active":"2024-04-16T19:38:32.919701+0000","last_peered":"2024-04-16T19:38:32.919701+0000","last_clean":"2024-04-16T19:38:32.919701+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:38:32.919701+0000","last_undegraded":"2024-04-16T19:38:32.919701+0000","last_fullsized":"2024-04-16T19:38:32.919701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.919638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:52.778121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'462","reported_seq":2060,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.755722+0000","last_change":"2024-04-16T19:38:14.755722+0000","last_active":"2024-04-16T19:38:14.755722+0000","last_peered":"2024-04-16T19:38:14.755722+0000","last_clean":"2024-04-16T19:38:14.755722+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:38:14.755722+0000","last_undegraded":"2024-04-16T19:38:14.755722+0000","last_fullsized":"2024-04-16T19:38:14.755722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'462","last_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_deep_scrub":"53'462","last_deep_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.755590+0000","objects_scrubbed":20,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:26.580898+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'26","reported_seq":480,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.808711+0000","last_change":"2024-04-16T19:38:09.808711+0000","last_active":"2024-04-16T19:38:09.808711+0000","last_peered":"2024-04-16T19:38:09.808711+0000","last_clean":"2024-04-16T19:38:09.808711+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:38:09.808711+0000","last_undegraded":"2024-04-16T19:38:09.808711+0000","last_fullsized":"2024-04-16T19:38:09.808711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.808625+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:45.079174+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.656504+0000","last_change":"2024-04-16T19:38:43.656527+0000","last_active":"2024-04-16T19:38:43.656504+0000","last_peered":"2024-04-16T19:38:43.656504+0000","last_clean":"2024-04-16T19:38:43.656504+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:38:43.656504+0000","last_undegraded":"2024-04-16T19:38:43.656504+0000","last_fullsized":"2024-04-16T19:38:43.656504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.656442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:44.709769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.834794+0000","last_change":"2024-04-16T19:39:09.834816+0000","last_active":"2024-04-16T19:39:09.834794+0000","last_peered":"2024-04-16T19:39:09.834794+0000","last_clean":"2024-04-16T19:39:09.834794+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:39:09.834794+0000","last_undegraded":"2024-04-16T19:39:09.834794+0000","last_fullsized":"2024-04-16T19:39:09.834794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:09.834729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:09.834729+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.834729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:23:22.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.428346+0000","last_change":"2024-04-16T17:45:08.383181+0000","last_active":"2024-04-16T19:38:09.428346+0000","last_peered":"2024-04-16T19:38:09.428346+0000","last_clean":"2024-04-16T19:38:09.428346+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:38:09.428346+0000","last_undegraded":"2024-04-16T19:38:09.428346+0000","last_fullsized":"2024-04-16T19:38:09.428346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"53'2","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.793634+0000","last_change":"2024-04-16T19:39:08.793686+0000","last_active":"2024-04-16T19:39:08.793634+0000","last_peered":"2024-04-16T19:39:08.793634+0000","last_clean":"2024-04-16T19:39:08.793634+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:39:08.793634+0000","last_undegraded":"2024-04-16T19:39:08.793634+0000","last_fullsized":"2024-04-16T19:39:08.793634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:08.793553+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:08.793553+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.793553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:38.128998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'53","reported_seq":200,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.344742+0000","last_change":"2024-04-16T19:38:58.344774+0000","last_active":"2024-04-16T19:38:58.344742+0000","last_peered":"2024-04-16T19:38:58.344742+0000","last_clean":"2024-04-16T19:38:58.344742+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:38:58.344742+0000","last_undegraded":"2024-04-16T19:38:58.344742+0000","last_fullsized":"2024-04-16T19:38:58.344742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'53","last_scrub_stamp":"2024-04-16T19:38:58.344681+0000","last_deep_scrub":"53'53","last_deep_scrub_stamp":"2024-04-16T19:38:58.344681+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.344681+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:25.741593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.913850+0000","last_change":"2024-04-16T19:38:34.913872+0000","last_active":"2024-04-16T19:38:34.913850+0000","last_peered":"2024-04-16T19:38:34.913850+0000","last_clean":"2024-04-16T19:38:34.913850+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:38:34.913850+0000","last_undegraded":"2024-04-16T19:38:34.913850+0000","last_fullsized":"2024-04-16T19:38:34.913850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.913787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:21.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":53,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340425+0000","last_change":"2024-04-16T18:09:02.169279+0000","last_active":"2024-04-16T19:38:10.340425+0000","last_peered":"2024-04-16T19:38:10.340425+0000","last_clean":"2024-04-16T19:38:10.340425+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:38:10.340425+0000","last_undegraded":"2024-04-16T19:38:10.340425+0000","last_fullsized":"2024-04-16T19:38:10.340425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'154","reported_seq":1852,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.701286+0000","last_change":"2024-04-16T19:38:54.701286+0000","last_active":"2024-04-16T19:38:54.701286+0000","last_peered":"2024-04-16T19:38:54.701286+0000","last_clean":"2024-04-16T19:38:54.701286+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:38:54.701286+0000","last_undegraded":"2024-04-16T19:38:54.701286+0000","last_fullsized":"2024-04-16T19:38:54.701286+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'154","last_scrub_stamp":"2024-04-16T19:38:54.701174+0000","last_deep_scrub":"53'154","last_deep_scrub_stamp":"2024-04-16T19:38:54.701174+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.701174+0000","objects_scrubbed":45,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:16.295198+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8661,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.820904+0000","last_change":"2024-04-16T19:38:41.820939+0000","last_active":"2024-04-16T19:38:41.820904+0000","last_peered":"2024-04-16T19:38:41.820904+0000","last_clean":"2024-04-16T19:38:41.820904+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:38:41.820904+0000","last_undegraded":"2024-04-16T19:38:41.820904+0000","last_fullsized":"2024-04-16T19:38:41.820904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.820819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.792918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'21","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.362934+0000","last_change":"2024-04-16T19:38:39.362978+0000","last_active":"2024-04-16T19:38:39.362934+0000","last_peered":"2024-04-16T19:38:39.362934+0000","last_clean":"2024-04-16T19:38:39.362934+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:38:39.362934+0000","last_undegraded":"2024-04-16T19:38:39.362934+0000","last_fullsized":"2024-04-16T19:38:39.362934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.362872+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:59.832976+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.775944+0000","last_change":"2024-04-16T19:38:34.775967+0000","last_active":"2024-04-16T19:38:34.775944+0000","last_peered":"2024-04-16T19:38:34.775944+0000","last_clean":"2024-04-16T19:38:34.775944+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:38:34.775944+0000","last_undegraded":"2024-04-16T19:38:34.775944+0000","last_fullsized":"2024-04-16T19:38:34.775944+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.775873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:29.678507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'685","reported_seq":2207,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.959879+0000","last_change":"2024-04-16T19:38:20.959909+0000","last_active":"2024-04-16T19:38:20.959879+0000","last_peered":"2024-04-16T19:38:20.959879+0000","last_clean":"2024-04-16T19:38:20.959879+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:38:20.959879+0000","last_undegraded":"2024-04-16T19:38:20.959879+0000","last_fullsized":"2024-04-16T19:38:20.959879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'685","last_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_deep_scrub":"53'685","last_deep_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.959819+0000","objects_scrubbed":26,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:09.314088+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4728,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'41","reported_seq":377,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.181166+0000","last_change":"2024-04-16T19:38:12.181166+0000","last_active":"2024-04-16T19:38:12.181166+0000","last_peered":"2024-04-16T19:38:12.181166+0000","last_clean":"2024-04-16T19:38:12.181166+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:38:12.181166+0000","last_undegraded":"2024-04-16T19:38:12.181166+0000","last_fullsized":"2024-04-16T19:38:12.181166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41","last_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_deep_scrub":"53'41","last_deep_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.181055+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.810131+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.360593+0000","last_change":"2024-04-16T19:38:34.360619+0000","last_active":"2024-04-16T19:38:34.360593+0000","last_peered":"2024-04-16T19:38:34.360593+0000","last_clean":"2024-04-16T19:38:34.360593+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:38:34.360593+0000","last_undegraded":"2024-04-16T19:38:34.360593+0000","last_fullsized":"2024-04-16T19:38:34.360593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.360526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:17.270587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.991826+0000","last_change":"2024-04-16T19:38:59.991847+0000","last_active":"2024-04-16T19:38:59.991826+0000","last_peered":"2024-04-16T19:38:59.991826+0000","last_clean":"2024-04-16T19:38:59.991826+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:38:59.991826+0000","last_undegraded":"2024-04-16T19:38:59.991826+0000","last_fullsized":"2024-04-16T19:38:59.991826+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:59.991758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:59.991758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.991758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:41.596200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.519627+0000","last_change":"2024-04-16T19:39:17.519648+0000","last_active":"2024-04-16T19:39:17.519627+0000","last_peered":"2024-04-16T19:39:17.519627+0000","last_clean":"2024-04-16T19:39:17.519627+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:39:17.519627+0000","last_undegraded":"2024-04-16T19:39:17.519627+0000","last_fullsized":"2024-04-16T19:39:17.519627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.519564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.519564+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.519564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:52.706704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.156305+0000","last_change":"2024-04-16T19:39:02.156329+0000","last_active":"2024-04-16T19:39:02.156305+0000","last_peered":"2024-04-16T19:39:02.156305+0000","last_clean":"2024-04-16T19:39:02.156305+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:39:02.156305+0000","last_undegraded":"2024-04-16T19:39:02.156305+0000","last_fullsized":"2024-04-16T19:39:02.156305+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.156240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.156240+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.156240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:42.484828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'109","reported_seq":289,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.175995+0000","last_change":"2024-04-16T19:39:19.176033+0000","last_active":"2024-04-16T19:39:19.175995+0000","last_peered":"2024-04-16T19:39:19.175995+0000","last_clean":"2024-04-16T19:39:19.175995+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:39:19.175995+0000","last_undegraded":"2024-04-16T19:39:19.175995+0000","last_fullsized":"2024-04-16T19:39:19.175995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:39:19.175929+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:39:19.175929+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.175929+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:16.225774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.793300+0000","last_change":"2024-04-16T19:38:55.793324+0000","last_active":"2024-04-16T19:38:55.793300+0000","last_peered":"2024-04-16T19:38:55.793300+0000","last_clean":"2024-04-16T19:38:55.793300+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:38:55.793300+0000","last_undegraded":"2024-04-16T19:38:55.793300+0000","last_fullsized":"2024-04-16T19:38:55.793300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:55.793235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:55.793235+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.793235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:03.787024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":76,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.430039+0000","last_change":"2024-04-16T18:09:02.172274+0000","last_active":"2024-04-16T19:38:09.430039+0000","last_peered":"2024-04-16T19:38:09.430039+0000","last_clean":"2024-04-16T19:38:09.430039+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:38:09.430039+0000","last_undegraded":"2024-04-16T19:38:09.430039+0000","last_fullsized":"2024-04-16T19:38:09.430039+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'140","reported_seq":2059,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069842+0000","last_change":"2024-04-16T17:46:25.529945+0000","last_active":"2024-04-16T19:38:08.069842+0000","last_peered":"2024-04-16T19:38:08.069842+0000","last_clean":"2024-04-16T19:38:08.069842+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:38:08.069842+0000","last_undegraded":"2024-04-16T19:38:08.069842+0000","last_fullsized":"2024-04-16T19:38:08.069842+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:46:24.502086+0000","last_clean_scrub_stamp":"2024-04-16T17:46:24.502086+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.126764+0000","last_change":"2024-04-16T19:38:33.126787+0000","last_active":"2024-04-16T19:38:33.126764+0000","last_peered":"2024-04-16T19:38:33.126764+0000","last_clean":"2024-04-16T19:38:33.126764+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:38:33.126764+0000","last_undegraded":"2024-04-16T19:38:33.126764+0000","last_fullsized":"2024-04-16T19:38:33.126764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.126702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:58.080828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'18","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.717409+0000","last_change":"2024-04-16T19:38:39.717409+0000","last_active":"2024-04-16T19:38:39.717409+0000","last_peered":"2024-04-16T19:38:39.717409+0000","last_clean":"2024-04-16T19:38:39.717409+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:38:39.717409+0000","last_undegraded":"2024-04-16T19:38:39.717409+0000","last_fullsized":"2024-04-16T19:38:39.717409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'18","last_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_deep_scrub":"53'18","last_deep_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.717311+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:15:00.906262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'652","reported_seq":2205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.155887+0000","last_change":"2024-04-16T19:38:30.155937+0000","last_active":"2024-04-16T19:38:30.155887+0000","last_peered":"2024-04-16T19:38:30.155887+0000","last_clean":"2024-04-16T19:38:30.155887+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:38:30.155887+0000","last_undegraded":"2024-04-16T19:38:30.155887+0000","last_fullsized":"2024-04-16T19:38:30.155887+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.155802+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:56.186978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'745","reported_seq":3560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.302525+0000","last_change":"2024-04-16T19:38:20.302555+0000","last_active":"2024-04-16T19:38:20.302525+0000","last_peered":"2024-04-16T19:38:20.302525+0000","last_clean":"2024-04-16T19:38:20.302525+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:38:20.302525+0000","last_undegraded":"2024-04-16T19:38:20.302525+0000","last_fullsized":"2024-04-16T19:38:20.302525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'745","last_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_deep_scrub":"53'745","last_deep_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.302461+0000","objects_scrubbed":25,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:34.270855+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18796,"num_omap_keys":104,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'14","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.221430+0000","last_change":"2024-04-16T19:38:13.221430+0000","last_active":"2024-04-16T19:38:13.221430+0000","last_peered":"2024-04-16T19:38:13.221430+0000","last_clean":"2024-04-16T19:38:13.221430+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:38:13.221430+0000","last_undegraded":"2024-04-16T19:38:13.221430+0000","last_fullsized":"2024-04-16T19:38:13.221430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.221281+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:20.880912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.777444+0000","last_change":"2024-04-16T19:38:37.777471+0000","last_active":"2024-04-16T19:38:37.777444+0000","last_peered":"2024-04-16T19:38:37.777444+0000","last_clean":"2024-04-16T19:38:37.777444+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:38:37.777444+0000","last_undegraded":"2024-04-16T19:38:37.777444+0000","last_fullsized":"2024-04-16T19:38:37.777444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.777367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:38.830695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.776381+0000","last_change":"2024-04-16T19:39:06.776405+0000","last_active":"2024-04-16T19:39:06.776381+0000","last_peered":"2024-04-16T19:39:06.776381+0000","last_clean":"2024-04-16T19:39:06.776381+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:39:06.776381+0000","last_undegraded":"2024-04-16T19:39:06.776381+0000","last_fullsized":"2024-04-16T19:39:06.776381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.776317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.776317+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.776317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:05.893011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.068616+0000","last_change":"2024-04-16T17:45:08.387610+0000","last_active":"2024-04-16T19:38:08.068616+0000","last_peered":"2024-04-16T19:38:08.068616+0000","last_clean":"2024-04-16T19:38:08.068616+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:38:08.068616+0000","last_undegraded":"2024-04-16T19:38:08.068616+0000","last_fullsized":"2024-04-16T19:38:08.068616+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"53'5","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.993806+0000","last_change":"2024-04-16T19:39:01.993835+0000","last_active":"2024-04-16T19:39:01.993806+0000","last_peered":"2024-04-16T19:39:01.993806+0000","last_clean":"2024-04-16T19:39:01.993806+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:39:01.993806+0000","last_undegraded":"2024-04-16T19:39:01.993806+0000","last_fullsized":"2024-04-16T19:39:01.993806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5","last_scrub_stamp":"2024-04-16T19:39:01.993744+0000","last_deep_scrub":"53'5","last_deep_scrub_stamp":"2024-04-16T19:39:01.993744+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.993744+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:02.303848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'84","reported_seq":252,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.827702+0000","last_change":"2024-04-16T19:39:00.827734+0000","last_active":"2024-04-16T19:39:00.827702+0000","last_peered":"2024-04-16T19:39:00.827702+0000","last_clean":"2024-04-16T19:39:00.827702+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:39:00.827702+0000","last_undegraded":"2024-04-16T19:39:00.827702+0000","last_fullsized":"2024-04-16T19:39:00.827702+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:39:00.827635+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:39:00.827635+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.827635+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:37.094463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.391675+0000","last_change":"2024-04-16T19:38:37.391698+0000","last_active":"2024-04-16T19:38:37.391675+0000","last_peered":"2024-04-16T19:38:37.391675+0000","last_clean":"2024-04-16T19:38:37.391675+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:38:37.391675+0000","last_undegraded":"2024-04-16T19:38:37.391675+0000","last_fullsized":"2024-04-16T19:38:37.391675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.391613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:56.190105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404769+0000","last_change":"2024-04-16T18:09:02.175666+0000","last_active":"2024-04-16T19:37:59.404769+0000","last_peered":"2024-04-16T19:37:59.404769+0000","last_clean":"2024-04-16T19:37:59.404769+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:37:59.404769+0000","last_undegraded":"2024-04-16T19:37:59.404769+0000","last_fullsized":"2024-04-16T19:37:59.404769+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'149","reported_seq":1540,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.045613+0000","last_change":"2024-04-16T19:38:57.045662+0000","last_active":"2024-04-16T19:38:57.045613+0000","last_peered":"2024-04-16T19:38:57.045613+0000","last_clean":"2024-04-16T19:38:57.045613+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:38:57.045613+0000","last_undegraded":"2024-04-16T19:38:57.045613+0000","last_fullsized":"2024-04-16T19:38:57.045613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'149","last_scrub_stamp":"2024-04-16T19:38:57.045547+0000","last_deep_scrub":"53'149","last_deep_scrub_stamp":"2024-04-16T19:38:57.045547+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.045547+0000","objects_scrubbed":37,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:48.643783+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9287,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.367350+0000","last_change":"2024-04-16T19:38:40.367372+0000","last_active":"2024-04-16T19:38:40.367350+0000","last_peered":"2024-04-16T19:38:40.367350+0000","last_clean":"2024-04-16T19:38:40.367350+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:38:40.367350+0000","last_undegraded":"2024-04-16T19:38:40.367350+0000","last_fullsized":"2024-04-16T19:38:40.367350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.367287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:20.695875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"53'4","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.431337+0000","last_change":"2024-04-16T19:38:32.431337+0000","last_active":"2024-04-16T19:38:32.431337+0000","last_peered":"2024-04-16T19:38:32.431337+0000","last_clean":"2024-04-16T19:38:32.431337+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:38:32.431337+0000","last_undegraded":"2024-04-16T19:38:32.431337+0000","last_fullsized":"2024-04-16T19:38:32.431337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.431211+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:40.828369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.346700+0000","last_change":"2024-04-16T19:38:32.346723+0000","last_active":"2024-04-16T19:38:32.346700+0000","last_peered":"2024-04-16T19:38:32.346700+0000","last_clean":"2024-04-16T19:38:32.346700+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:38:32.346700+0000","last_undegraded":"2024-04-16T19:38:32.346700+0000","last_fullsized":"2024-04-16T19:38:32.346700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.346634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:51.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'394","reported_seq":728,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.708440+0000","last_change":"2024-04-16T19:38:11.708492+0000","last_active":"2024-04-16T19:38:11.708440+0000","last_peered":"2024-04-16T19:38:11.708440+0000","last_clean":"2024-04-16T19:38:11.708440+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:38:11.708440+0000","last_undegraded":"2024-04-16T19:38:11.708440+0000","last_fullsized":"2024-04-16T19:38:11.708440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'394","last_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_deep_scrub":"53'394","last_deep_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.708368+0000","objects_scrubbed":25,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.347792+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'23","reported_seq":338,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.749658+0000","last_change":"2024-04-16T19:38:27.749706+0000","last_active":"2024-04-16T19:38:27.749658+0000","last_peered":"2024-04-16T19:38:27.749658+0000","last_clean":"2024-04-16T19:38:27.749658+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:38:27.749658+0000","last_undegraded":"2024-04-16T19:38:27.749658+0000","last_fullsized":"2024-04-16T19:38:27.749658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.749597+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:41.717991+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.075094+0000","last_change":"2024-04-16T19:39:10.075116+0000","last_active":"2024-04-16T19:39:10.075094+0000","last_peered":"2024-04-16T19:39:10.075094+0000","last_clean":"2024-04-16T19:39:10.075094+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:39:10.075094+0000","last_undegraded":"2024-04-16T19:39:10.075094+0000","last_fullsized":"2024-04-16T19:39:10.075094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:10.075029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:10.075029+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.075029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:23.719049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.160626+0000","last_change":"2024-04-16T19:39:14.160650+0000","last_active":"2024-04-16T19:39:14.160626+0000","last_peered":"2024-04-16T19:39:14.160626+0000","last_clean":"2024-04-16T19:39:14.160626+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:39:14.160626+0000","last_undegraded":"2024-04-16T19:39:14.160626+0000","last_fullsized":"2024-04-16T19:39:14.160626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.160562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.160562+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.160562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:58.080516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.379882+0000","last_change":"2024-04-16T19:39:07.379904+0000","last_active":"2024-04-16T19:39:07.379882+0000","last_peered":"2024-04-16T19:39:07.379882+0000","last_clean":"2024-04-16T19:39:07.379882+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:39:07.379882+0000","last_undegraded":"2024-04-16T19:39:07.379882+0000","last_fullsized":"2024-04-16T19:39:07.379882+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.379808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.379808+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.379808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:37.404406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'93","reported_seq":267,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.728543+0000","last_change":"2024-04-16T19:38:55.728580+0000","last_active":"2024-04-16T19:38:55.728543+0000","last_peered":"2024-04-16T19:38:55.728543+0000","last_clean":"2024-04-16T19:38:55.728543+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:38:55.728543+0000","last_undegraded":"2024-04-16T19:38:55.728543+0000","last_fullsized":"2024-04-16T19:38:55.728543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'93","last_scrub_stamp":"2024-04-16T19:38:55.728482+0000","last_deep_scrub":"53'93","last_deep_scrub_stamp":"2024-04-16T19:38:55.728482+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.728482+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:13:32.667039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.811745+0000","last_change":"2024-04-16T19:38:37.811769+0000","last_active":"2024-04-16T19:38:37.811745+0000","last_peered":"2024-04-16T19:38:37.811745+0000","last_clean":"2024-04-16T19:38:37.811745+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:38:37.811745+0000","last_undegraded":"2024-04-16T19:38:37.811745+0000","last_fullsized":"2024-04-16T19:38:37.811745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.811682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:16.599188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.717809+0000","last_change":"2024-04-16T19:38:24.717833+0000","last_active":"2024-04-16T19:38:24.717809+0000","last_peered":"2024-04-16T19:38:24.717809+0000","last_clean":"2024-04-16T19:38:24.717809+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:38:24.717809+0000","last_undegraded":"2024-04-16T19:38:24.717809+0000","last_fullsized":"2024-04-16T19:38:24.717809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.717739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:12.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.340415+0000","last_change":"2024-04-16T18:09:02.176512+0000","last_active":"2024-04-16T19:38:10.340415+0000","last_peered":"2024-04-16T19:38:10.340415+0000","last_clean":"2024-04-16T19:38:10.340415+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:38:10.340415+0000","last_undegraded":"2024-04-16T19:38:10.340415+0000","last_fullsized":"2024-04-16T19:38:10.340415+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'147","reported_seq":1369,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.298300+0000","last_change":"2024-04-16T19:38:54.298344+0000","last_active":"2024-04-16T19:38:54.298300+0000","last_peered":"2024-04-16T19:38:54.298300+0000","last_clean":"2024-04-16T19:38:54.298300+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:38:54.298300+0000","last_undegraded":"2024-04-16T19:38:54.298300+0000","last_fullsized":"2024-04-16T19:38:54.298300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'147","last_scrub_stamp":"2024-04-16T19:38:54.298241+0000","last_deep_scrub":"53'147","last_deep_scrub_stamp":"2024-04-16T19:38:54.298241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.298241+0000","objects_scrubbed":35,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:37:29.765409+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10184,"num_omap_keys":41,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.800761+0000","last_change":"2024-04-16T19:38:54.800803+0000","last_active":"2024-04-16T19:38:54.800761+0000","last_peered":"2024-04-16T19:38:54.800761+0000","last_clean":"2024-04-16T19:38:54.800761+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:38:54.800761+0000","last_undegraded":"2024-04-16T19:38:54.800761+0000","last_fullsized":"2024-04-16T19:38:54.800761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:54.800687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:54.800687+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.800687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:02.678098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"53'15","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.832780+0000","last_change":"2024-04-16T19:38:47.832780+0000","last_active":"2024-04-16T19:38:47.832780+0000","last_peered":"2024-04-16T19:38:47.832780+0000","last_clean":"2024-04-16T19:38:47.832780+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:38:47.832780+0000","last_undegraded":"2024-04-16T19:38:47.832780+0000","last_fullsized":"2024-04-16T19:38:47.832780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'15","last_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_deep_scrub":"53'15","last_deep_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.832667+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:28.161255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.156986+0000","last_change":"2024-04-16T19:38:34.157007+0000","last_active":"2024-04-16T19:38:34.156986+0000","last_peered":"2024-04-16T19:38:34.156986+0000","last_clean":"2024-04-16T19:38:34.156986+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:38:34.156986+0000","last_undegraded":"2024-04-16T19:38:34.156986+0000","last_fullsized":"2024-04-16T19:38:34.156986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.156921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:55.446024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'232","reported_seq":419,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.530282+0000","last_change":"2024-04-16T19:38:19.530353+0000","last_active":"2024-04-16T19:38:19.530282+0000","last_peered":"2024-04-16T19:38:19.530282+0000","last_clean":"2024-04-16T19:38:19.530282+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:38:19.530282+0000","last_undegraded":"2024-04-16T19:38:19.530282+0000","last_fullsized":"2024-04-16T19:38:19.530282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'232","last_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_deep_scrub":"53'232","last_deep_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.530215+0000","objects_scrubbed":16,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:50:04.335733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14555,"num_omap_keys":67,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'30","reported_seq":488,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.062041+0000","last_change":"2024-04-16T19:39:21.062099+0000","last_active":"2024-04-16T19:39:21.062041+0000","last_peered":"2024-04-16T19:39:21.062041+0000","last_clean":"2024-04-16T19:39:21.062041+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:39:21.062041+0000","last_undegraded":"2024-04-16T19:39:21.062041+0000","last_fullsized":"2024-04-16T19:39:21.062041+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'30","last_scrub_stamp":"2024-04-16T19:39:21.061977+0000","last_deep_scrub":"53'30","last_deep_scrub_stamp":"2024-04-16T19:39:21.061977+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.061977+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:43.059153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.270732+0000","last_change":"2024-04-16T19:39:24.270776+0000","last_active":"2024-04-16T19:39:24.270732+0000","last_peered":"2024-04-16T19:39:24.270732+0000","last_clean":"2024-04-16T19:39:24.270732+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:39:24.270732+0000","last_undegraded":"2024-04-16T19:39:24.270732+0000","last_fullsized":"2024-04-16T19:39:24.270732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.270656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.270656+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.270656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:14.172456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.767720+0000","last_change":"2024-04-16T19:39:15.767763+0000","last_active":"2024-04-16T19:39:15.767720+0000","last_peered":"2024-04-16T19:39:15.767720+0000","last_clean":"2024-04-16T19:39:15.767720+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:39:15.767720+0000","last_undegraded":"2024-04-16T19:39:15.767720+0000","last_fullsized":"2024-04-16T19:39:15.767720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.767644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.767644+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.767644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:22.941049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"53'3","reported_seq":572,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.035167+0000","last_change":"2024-04-16T19:39:04.035197+0000","last_active":"2024-04-16T19:39:04.035167+0000","last_peered":"2024-04-16T19:39:04.035167+0000","last_clean":"2024-04-16T19:39:04.035167+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:39:04.035167+0000","last_undegraded":"2024-04-16T19:39:04.035167+0000","last_fullsized":"2024-04-16T19:39:04.035167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-16T19:39:04.035106+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-16T19:39:04.035106+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.035106+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:31.432018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'159","reported_seq":360,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.006509+0000","last_change":"2024-04-16T19:38:56.006551+0000","last_active":"2024-04-16T19:38:56.006509+0000","last_peered":"2024-04-16T19:38:56.006509+0000","last_clean":"2024-04-16T19:38:56.006509+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:38:56.006509+0000","last_undegraded":"2024-04-16T19:38:56.006509+0000","last_fullsized":"2024-04-16T19:38:56.006509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:38:56.006439+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:38:56.006439+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.006439+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:53.056284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.749066+0000","last_change":"2024-04-16T19:38:47.749088+0000","last_active":"2024-04-16T19:38:47.749066+0000","last_peered":"2024-04-16T19:38:47.749066+0000","last_clean":"2024-04-16T19:38:47.749066+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:38:47.749066+0000","last_undegraded":"2024-04-16T19:38:47.749066+0000","last_fullsized":"2024-04-16T19:38:47.749066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.748997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:30.659057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.859523+0000","last_change":"2024-04-16T19:38:25.859545+0000","last_active":"2024-04-16T19:38:25.859523+0000","last_peered":"2024-04-16T19:38:25.859523+0000","last_clean":"2024-04-16T19:38:25.859523+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:38:25.859523+0000","last_undegraded":"2024-04-16T19:38:25.859523+0000","last_fullsized":"2024-04-16T19:38:25.859523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.859440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:49:45.247605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":54,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.069936+0000","last_change":"2024-04-16T18:09:02.172618+0000","last_active":"2024-04-16T19:38:08.069936+0000","last_peered":"2024-04-16T19:38:08.069936+0000","last_clean":"2024-04-16T19:38:08.069936+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:38:08.069936+0000","last_undegraded":"2024-04-16T19:38:08.069936+0000","last_fullsized":"2024-04-16T19:38:08.069936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'152","reported_seq":2009,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.720163+0000","last_change":"2024-04-16T19:38:42.720215+0000","last_active":"2024-04-16T19:38:42.720163+0000","last_peered":"2024-04-16T19:38:42.720163+0000","last_clean":"2024-04-16T19:38:42.720163+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:38:42.720163+0000","last_undegraded":"2024-04-16T19:38:42.720163+0000","last_fullsized":"2024-04-16T19:38:42.720163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'152","last_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_deep_scrub":"53'152","last_deep_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.720094+0000","objects_scrubbed":42,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:29.723422+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7797,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.359616+0000","last_change":"2024-04-16T19:38:44.359659+0000","last_active":"2024-04-16T19:38:44.359616+0000","last_peered":"2024-04-16T19:38:44.359616+0000","last_clean":"2024-04-16T19:38:44.359616+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:38:44.359616+0000","last_undegraded":"2024-04-16T19:38:44.359616+0000","last_fullsized":"2024-04-16T19:38:44.359616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.359543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:32.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"53'6","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.828869+0000","last_change":"2024-04-16T19:38:44.828869+0000","last_active":"2024-04-16T19:38:44.828869+0000","last_peered":"2024-04-16T19:38:44.828869+0000","last_clean":"2024-04-16T19:38:44.828869+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:38:44.828869+0000","last_undegraded":"2024-04-16T19:38:44.828869+0000","last_fullsized":"2024-04-16T19:38:44.828869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.828731+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:03.627224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'21","reported_seq":1488,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.901432+0000","last_change":"2024-04-16T19:38:47.901478+0000","last_active":"2024-04-16T19:38:47.901432+0000","last_peered":"2024-04-16T19:38:47.901432+0000","last_clean":"2024-04-16T19:38:47.901432+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:38:47.901432+0000","last_undegraded":"2024-04-16T19:38:47.901432+0000","last_fullsized":"2024-04-16T19:38:47.901432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.901356+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:42.407062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'681","reported_seq":3330,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.829538+0000","last_change":"2024-04-16T19:38:10.829578+0000","last_active":"2024-04-16T19:38:10.829538+0000","last_peered":"2024-04-16T19:38:10.829538+0000","last_clean":"2024-04-16T19:38:10.829538+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:38:10.829538+0000","last_undegraded":"2024-04-16T19:38:10.829538+0000","last_fullsized":"2024-04-16T19:38:10.829538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'681","last_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_deep_scrub":"53'681","last_deep_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.829490+0000","objects_scrubbed":20,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:55.635008+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'12","reported_seq":518,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.553415+0000","last_change":"2024-04-16T19:38:21.553466+0000","last_active":"2024-04-16T19:38:21.553415+0000","last_peered":"2024-04-16T19:38:21.553415+0000","last_clean":"2024-04-16T19:38:21.553415+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:38:21.553415+0000","last_undegraded":"2024-04-16T19:38:21.553415+0000","last_fullsized":"2024-04-16T19:38:21.553415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.553349+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:55.897508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.381098+0000","last_change":"2024-04-16T19:39:11.381120+0000","last_active":"2024-04-16T19:39:11.381098+0000","last_peered":"2024-04-16T19:39:11.381098+0000","last_clean":"2024-04-16T19:39:11.381098+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:39:11.381098+0000","last_undegraded":"2024-04-16T19:39:11.381098+0000","last_fullsized":"2024-04-16T19:39:11.381098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.381031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.381031+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.381031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:01.722417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.125638+0000","last_change":"2024-04-16T19:39:12.125660+0000","last_active":"2024-04-16T19:39:12.125638+0000","last_peered":"2024-04-16T19:39:12.125638+0000","last_clean":"2024-04-16T19:39:12.125638+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:39:12.125638+0000","last_undegraded":"2024-04-16T19:39:12.125638+0000","last_fullsized":"2024-04-16T19:39:12.125638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.125568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.125568+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.125568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:09.175412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"53'4","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.189901+0000","last_change":"2024-04-16T19:39:08.189930+0000","last_active":"2024-04-16T19:39:08.189901+0000","last_peered":"2024-04-16T19:39:08.189901+0000","last_clean":"2024-04-16T19:39:08.189901+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:39:08.189901+0000","last_undegraded":"2024-04-16T19:39:08.189901+0000","last_fullsized":"2024-04-16T19:39:08.189901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:08.189842+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:08.189842+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.189842+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:33.947083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'109","reported_seq":295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.025079+0000","last_change":"2024-04-16T19:38:52.025105+0000","last_active":"2024-04-16T19:38:52.025079+0000","last_peered":"2024-04-16T19:38:52.025079+0000","last_clean":"2024-04-16T19:38:52.025079+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:38:52.025079+0000","last_undegraded":"2024-04-16T19:38:52.025079+0000","last_fullsized":"2024-04-16T19:38:52.025079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:52.025025+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:52.025025+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.025025+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:10.702648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":127,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.713466+0000","last_change":"2024-04-16T19:38:48.713508+0000","last_active":"2024-04-16T19:38:48.713466+0000","last_peered":"2024-04-16T19:38:48.713466+0000","last_clean":"2024-04-16T19:38:48.713466+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:38:48.713466+0000","last_undegraded":"2024-04-16T19:38:48.713466+0000","last_fullsized":"2024-04-16T19:38:48.713466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.713387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:48.829744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.890917+0000","last_change":"2024-04-16T19:38:27.890939+0000","last_active":"2024-04-16T19:38:27.890917+0000","last_peered":"2024-04-16T19:38:27.890917+0000","last_clean":"2024-04-16T19:38:27.890917+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:38:27.890917+0000","last_undegraded":"2024-04-16T19:38:27.890917+0000","last_fullsized":"2024-04-16T19:38:27.890917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.890852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:30.404878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.982218+0000","last_change":"2024-04-16T19:39:26.982239+0000","last_active":"2024-04-16T19:39:26.982218+0000","last_peered":"2024-04-16T19:39:26.982218+0000","last_clean":"2024-04-16T19:39:26.982218+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:39:26.982218+0000","last_undegraded":"2024-04-16T19:39:26.982218+0000","last_fullsized":"2024-04-16T19:39:26.982218+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.982153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.982153+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.982153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:19:52.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'192","reported_seq":1694,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.782068+0000","last_change":"2024-04-16T19:38:58.782113+0000","last_active":"2024-04-16T19:38:58.782068+0000","last_peered":"2024-04-16T19:38:58.782068+0000","last_clean":"2024-04-16T19:38:58.782068+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:38:58.782068+0000","last_undegraded":"2024-04-16T19:38:58.782068+0000","last_fullsized":"2024-04-16T19:38:58.782068+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'192","last_scrub_stamp":"2024-04-16T19:38:58.782006+0000","last_deep_scrub":"53'192","last_deep_scrub_stamp":"2024-04-16T19:38:58.782006+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.782006+0000","objects_scrubbed":46,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:04.393415+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13128,"num_omap_keys":54,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.550739+0000","last_change":"2024-04-16T19:38:26.550762+0000","last_active":"2024-04-16T19:38:26.550739+0000","last_peered":"2024-04-16T19:38:26.550739+0000","last_clean":"2024-04-16T19:38:26.550739+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:38:26.550739+0000","last_undegraded":"2024-04-16T19:38:26.550739+0000","last_fullsized":"2024-04-16T19:38:26.550739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.550671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:50.234890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.819588+0000","last_change":"2024-04-16T19:38:45.819620+0000","last_active":"2024-04-16T19:38:45.819588+0000","last_peered":"2024-04-16T19:38:45.819588+0000","last_clean":"2024-04-16T19:38:45.819588+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:38:45.819588+0000","last_undegraded":"2024-04-16T19:38:45.819588+0000","last_fullsized":"2024-04-16T19:38:45.819588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.819519+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:24.941425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.764005+0000","last_change":"2024-04-16T19:38:30.764029+0000","last_active":"2024-04-16T19:38:30.764005+0000","last_peered":"2024-04-16T19:38:30.764005+0000","last_clean":"2024-04-16T19:38:30.764005+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:38:30.764005+0000","last_undegraded":"2024-04-16T19:38:30.764005+0000","last_fullsized":"2024-04-16T19:38:30.764005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.763939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:44.186208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'562","reported_seq":45436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.690811+0000","last_change":"2024-04-16T19:38:12.690864+0000","last_active":"2024-04-16T19:38:12.690811+0000","last_peered":"2024-04-16T19:38:12.690811+0000","last_clean":"2024-04-16T19:38:12.690811+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:38:12.690811+0000","last_undegraded":"2024-04-16T19:38:12.690811+0000","last_fullsized":"2024-04-16T19:38:12.690811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'562","last_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_deep_scrub":"53'562","last_deep_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.690747+0000","objects_scrubbed":19,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:33.979851+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7052,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'16","reported_seq":415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.851820+0000","last_change":"2024-04-16T19:38:09.851868+0000","last_active":"2024-04-16T19:38:09.851820+0000","last_peered":"2024-04-16T19:38:09.851820+0000","last_clean":"2024-04-16T19:38:09.851820+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:38:09.851820+0000","last_undegraded":"2024-04-16T19:38:09.851820+0000","last_fullsized":"2024-04-16T19:38:09.851820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.851761+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:33.535980+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.936903+0000","last_change":"2024-04-16T19:38:57.936927+0000","last_active":"2024-04-16T19:38:57.936903+0000","last_peered":"2024-04-16T19:38:57.936903+0000","last_clean":"2024-04-16T19:38:57.936903+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:38:57.936903+0000","last_undegraded":"2024-04-16T19:38:57.936903+0000","last_fullsized":"2024-04-16T19:38:57.936903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.936832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.936832+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.936832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:44.940160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404315+0000","last_change":"2024-04-16T17:45:08.387824+0000","last_active":"2024-04-16T19:37:39.404315+0000","last_peered":"2024-04-16T19:37:39.404315+0000","last_clean":"2024-04-16T19:37:39.404315+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:37:39.404315+0000","last_undegraded":"2024-04-16T19:37:39.404315+0000","last_fullsized":"2024-04-16T19:37:39.404315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"53'4","reported_seq":511,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.784566+0000","last_change":"2024-04-16T19:39:14.784594+0000","last_active":"2024-04-16T19:39:14.784566+0000","last_peered":"2024-04-16T19:39:14.784566+0000","last_clean":"2024-04-16T19:39:14.784566+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:39:14.784566+0000","last_undegraded":"2024-04-16T19:39:14.784566+0000","last_fullsized":"2024-04-16T19:39:14.784566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:14.784499+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:14.784499+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.784499+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:54.564486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'125","reported_seq":316,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.052153+0000","last_change":"2024-04-16T19:38:58.052186+0000","last_active":"2024-04-16T19:38:58.052153+0000","last_peered":"2024-04-16T19:38:58.052153+0000","last_clean":"2024-04-16T19:38:58.052153+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:38:58.052153+0000","last_undegraded":"2024-04-16T19:38:58.052153+0000","last_fullsized":"2024-04-16T19:38:58.052153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:58.052092+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:58.052092+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.052092+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:10.120432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'13","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.881616+0000","last_change":"2024-04-16T19:38:52.881641+0000","last_active":"2024-04-16T19:38:52.881616+0000","last_peered":"2024-04-16T19:38:52.881616+0000","last_clean":"2024-04-16T19:38:52.881616+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:38:52.881616+0000","last_undegraded":"2024-04-16T19:38:52.881616+0000","last_fullsized":"2024-04-16T19:38:52.881616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:52.881556+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:52.881556+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.881556+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:36.801510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.917217+0000","last_change":"2024-04-16T19:38:29.917241+0000","last_active":"2024-04-16T19:38:29.917217+0000","last_peered":"2024-04-16T19:38:29.917217+0000","last_clean":"2024-04-16T19:38:29.917217+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:38:29.917217+0000","last_undegraded":"2024-04-16T19:38:29.917217+0000","last_fullsized":"2024-04-16T19:38:29.917217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.917157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:51.736564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":49,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.596673+0000","last_change":"2024-04-16T18:09:18.180510+0000","last_active":"2024-04-16T19:37:59.596673+0000","last_peered":"2024-04-16T19:37:59.596673+0000","last_clean":"2024-04-16T19:37:59.596673+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:37:59.596673+0000","last_undegraded":"2024-04-16T19:37:59.596673+0000","last_fullsized":"2024-04-16T19:37:59.596673+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'124","reported_seq":1595,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.373764+0000","last_change":"2024-04-16T19:38:42.373815+0000","last_active":"2024-04-16T19:38:42.373764+0000","last_peered":"2024-04-16T19:38:42.373764+0000","last_clean":"2024-04-16T19:38:42.373764+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:38:42.373764+0000","last_undegraded":"2024-04-16T19:38:42.373764+0000","last_fullsized":"2024-04-16T19:38:42.373764+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'124","last_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_deep_scrub":"53'124","last_deep_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.373704+0000","objects_scrubbed":35,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:05.137933+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8419,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.361486+0000","last_change":"2024-04-16T19:38:38.361524+0000","last_active":"2024-04-16T19:38:38.361486+0000","last_peered":"2024-04-16T19:38:38.361486+0000","last_clean":"2024-04-16T19:38:38.361486+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:38:38.361486+0000","last_undegraded":"2024-04-16T19:38:38.361486+0000","last_fullsized":"2024-04-16T19:38:38.361486+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.361386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:17.483291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'23","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.803226+0000","last_change":"2024-04-16T19:38:35.803270+0000","last_active":"2024-04-16T19:38:35.803226+0000","last_peered":"2024-04-16T19:38:35.803226+0000","last_clean":"2024-04-16T19:38:35.803226+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:38:35.803226+0000","last_undegraded":"2024-04-16T19:38:35.803226+0000","last_fullsized":"2024-04-16T19:38:35.803226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.803159+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:41.224996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'652","reported_seq":2571,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.898392+0000","last_change":"2024-04-16T19:38:30.898437+0000","last_active":"2024-04-16T19:38:30.898392+0000","last_peered":"2024-04-16T19:38:30.898392+0000","last_clean":"2024-04-16T19:38:30.898392+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:38:30.898392+0000","last_undegraded":"2024-04-16T19:38:30.898392+0000","last_fullsized":"2024-04-16T19:38:30.898392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.898322+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:07.061769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'539","reported_seq":988,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.232495+0000","last_change":"2024-04-16T19:38:16.232495+0000","last_active":"2024-04-16T19:38:16.232495+0000","last_peered":"2024-04-16T19:38:16.232495+0000","last_clean":"2024-04-16T19:38:16.232495+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:38:16.232495+0000","last_undegraded":"2024-04-16T19:38:16.232495+0000","last_fullsized":"2024-04-16T19:38:16.232495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'539","last_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_deep_scrub":"53'539","last_deep_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.232375+0000","objects_scrubbed":21,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:46.553060+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7262,"num_omap_keys":33,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'16","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.567350+0000","last_change":"2024-04-16T19:38:23.567350+0000","last_active":"2024-04-16T19:38:23.567350+0000","last_peered":"2024-04-16T19:38:23.567350+0000","last_clean":"2024-04-16T19:38:23.567350+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:38:23.567350+0000","last_undegraded":"2024-04-16T19:38:23.567350+0000","last_fullsized":"2024-04-16T19:38:23.567350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.567241+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:36.119901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.211545+0000","last_change":"2024-04-16T19:38:58.211568+0000","last_active":"2024-04-16T19:38:58.211545+0000","last_peered":"2024-04-16T19:38:58.211545+0000","last_clean":"2024-04-16T19:38:58.211545+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:38:58.211545+0000","last_undegraded":"2024-04-16T19:38:58.211545+0000","last_fullsized":"2024-04-16T19:38:58.211545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:58.211474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:58.211474+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.211474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:17.005454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401089+0000","last_change":"2024-04-16T17:45:08.385144+0000","last_active":"2024-04-16T19:37:39.401089+0000","last_peered":"2024-04-16T19:37:39.401089+0000","last_clean":"2024-04-16T19:37:39.401089+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:37:39.401089+0000","last_undegraded":"2024-04-16T19:37:39.401089+0000","last_fullsized":"2024-04-16T19:37:39.401089+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.201765+0000","last_change":"2024-04-16T19:39:04.201789+0000","last_active":"2024-04-16T19:39:04.201765+0000","last_peered":"2024-04-16T19:39:04.201765+0000","last_clean":"2024-04-16T19:39:04.201765+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:39:04.201765+0000","last_undegraded":"2024-04-16T19:39:04.201765+0000","last_fullsized":"2024-04-16T19:39:04.201765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.201701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.201701+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.201701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:58.707408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'159","reported_seq":362,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.773969+0000","last_change":"2024-04-16T19:39:03.773969+0000","last_active":"2024-04-16T19:39:03.773969+0000","last_peered":"2024-04-16T19:39:03.773969+0000","last_clean":"2024-04-16T19:39:03.773969+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:39:03.773969+0000","last_undegraded":"2024-04-16T19:39:03.773969+0000","last_fullsized":"2024-04-16T19:39:03.773969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:03.773864+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:03.773864+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.773864+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:04.083969+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.319175+0000","last_change":"2024-04-16T19:38:57.319175+0000","last_active":"2024-04-16T19:38:57.319175+0000","last_peered":"2024-04-16T19:38:57.319175+0000","last_clean":"2024-04-16T19:38:57.319175+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:38:57.319175+0000","last_undegraded":"2024-04-16T19:38:57.319175+0000","last_fullsized":"2024-04-16T19:38:57.319175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.319084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.319084+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.319084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:57.063141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.923395+0000","last_change":"2024-04-16T19:38:31.923395+0000","last_active":"2024-04-16T19:38:31.923395+0000","last_peered":"2024-04-16T19:38:31.923395+0000","last_clean":"2024-04-16T19:38:31.923395+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:38:31.923395+0000","last_undegraded":"2024-04-16T19:38:31.923395+0000","last_fullsized":"2024-04-16T19:38:31.923395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.923306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:27.582944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.147955+0000","last_change":"2024-04-16T19:39:23.147978+0000","last_active":"2024-04-16T19:39:23.147955+0000","last_peered":"2024-04-16T19:39:23.147955+0000","last_clean":"2024-04-16T19:39:23.147955+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:39:23.147955+0000","last_undegraded":"2024-04-16T19:39:23.147955+0000","last_fullsized":"2024-04-16T19:39:23.147955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.147892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.147892+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.147892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:43.858630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'166","reported_seq":2088,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.802004+0000","last_change":"2024-04-16T19:38:46.802047+0000","last_active":"2024-04-16T19:38:46.802004+0000","last_peered":"2024-04-16T19:38:46.802004+0000","last_clean":"2024-04-16T19:38:46.802004+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:38:46.802004+0000","last_undegraded":"2024-04-16T19:38:46.802004+0000","last_fullsized":"2024-04-16T19:38:46.802004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'166","last_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_deep_scrub":"53'166","last_deep_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.801945+0000","objects_scrubbed":47,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:24.936944+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9594,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.829487+0000","last_change":"2024-04-16T19:38:40.829513+0000","last_active":"2024-04-16T19:38:40.829487+0000","last_peered":"2024-04-16T19:38:40.829487+0000","last_clean":"2024-04-16T19:38:40.829487+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:38:40.829487+0000","last_undegraded":"2024-04-16T19:38:40.829487+0000","last_fullsized":"2024-04-16T19:38:40.829487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.829411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:01:00.975262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'4","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.356348+0000","last_change":"2024-04-16T19:38:43.356398+0000","last_active":"2024-04-16T19:38:43.356348+0000","last_peered":"2024-04-16T19:38:43.356348+0000","last_clean":"2024-04-16T19:38:43.356348+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:38:43.356348+0000","last_undegraded":"2024-04-16T19:38:43.356348+0000","last_fullsized":"2024-04-16T19:38:43.356348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.356286+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:53.006964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'652","reported_seq":2223,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.056637+0000","last_change":"2024-04-16T19:38:13.056637+0000","last_active":"2024-04-16T19:38:13.056637+0000","last_peered":"2024-04-16T19:38:13.056637+0000","last_clean":"2024-04-16T19:38:13.056637+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:38:13.056637+0000","last_undegraded":"2024-04-16T19:38:13.056637+0000","last_fullsized":"2024-04-16T19:38:13.056637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.056540+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:02.968001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'298","reported_seq":598,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.796439+0000","last_change":"2024-04-16T19:38:18.796507+0000","last_active":"2024-04-16T19:38:18.796439+0000","last_peered":"2024-04-16T19:38:18.796439+0000","last_clean":"2024-04-16T19:38:18.796439+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:38:18.796439+0000","last_undegraded":"2024-04-16T19:38:18.796439+0000","last_fullsized":"2024-04-16T19:38:18.796439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'298","last_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_deep_scrub":"53'298","last_deep_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.796372+0000","objects_scrubbed":17,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:20.964465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'22","reported_seq":392,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.891278+0000","last_change":"2024-04-16T19:38:13.891278+0000","last_active":"2024-04-16T19:38:13.891278+0000","last_peered":"2024-04-16T19:38:13.891278+0000","last_clean":"2024-04-16T19:38:13.891278+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:38:13.891278+0000","last_undegraded":"2024-04-16T19:38:13.891278+0000","last_fullsized":"2024-04-16T19:38:13.891278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.891146+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:21.530454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.109273+0000","last_change":"2024-04-16T19:39:18.109298+0000","last_active":"2024-04-16T19:39:18.109273+0000","last_peered":"2024-04-16T19:39:18.109273+0000","last_clean":"2024-04-16T19:39:18.109273+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:39:18.109273+0000","last_undegraded":"2024-04-16T19:39:18.109273+0000","last_fullsized":"2024-04-16T19:39:18.109273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.109211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.109211+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.109211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:18.419316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.535675+0000","last_change":"2024-04-16T19:39:27.535699+0000","last_active":"2024-04-16T19:39:27.535675+0000","last_peered":"2024-04-16T19:39:27.535675+0000","last_clean":"2024-04-16T19:39:27.535675+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:39:27.535675+0000","last_undegraded":"2024-04-16T19:39:27.535675+0000","last_fullsized":"2024-04-16T19:39:27.535675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:27.535611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:27.535611+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.535611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:25.797201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"53'12","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.710052+0000","last_change":"2024-04-16T19:39:09.710082+0000","last_active":"2024-04-16T19:39:09.710052+0000","last_peered":"2024-04-16T19:39:09.710052+0000","last_clean":"2024-04-16T19:39:09.710052+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:39:09.710052+0000","last_undegraded":"2024-04-16T19:39:09.710052+0000","last_fullsized":"2024-04-16T19:39:09.710052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:39:09.709987+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:39:09.709987+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.709987+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:16.883391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.359086+0000","last_change":"2024-04-16T19:39:03.359148+0000","last_active":"2024-04-16T19:39:03.359086+0000","last_peered":"2024-04-16T19:39:03.359086+0000","last_clean":"2024-04-16T19:39:03.359086+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:39:03.359086+0000","last_undegraded":"2024-04-16T19:39:03.359086+0000","last_fullsized":"2024-04-16T19:39:03.359086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:39:03.359011+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:39:03.359011+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.359011+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:01:55.613704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.949931+0000","last_change":"2024-04-16T19:38:53.949931+0000","last_active":"2024-04-16T19:38:53.949931+0000","last_peered":"2024-04-16T19:38:53.949931+0000","last_clean":"2024-04-16T19:38:53.949931+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:38:53.949931+0000","last_undegraded":"2024-04-16T19:38:53.949931+0000","last_fullsized":"2024-04-16T19:38:53.949931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.949843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.949843+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.949843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:01.943632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.722443+0000","last_change":"2024-04-16T19:38:23.722443+0000","last_active":"2024-04-16T19:38:23.722443+0000","last_peered":"2024-04-16T19:38:23.722443+0000","last_clean":"2024-04-16T19:38:23.722443+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:38:23.722443+0000","last_undegraded":"2024-04-16T19:38:23.722443+0000","last_fullsized":"2024-04-16T19:38:23.722443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.722357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:38.742703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":55,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:44.405131+0000","last_change":"2024-04-16T18:09:02.171399+0000","last_active":"2024-04-16T19:37:44.405131+0000","last_peered":"2024-04-16T19:37:44.405131+0000","last_clean":"2024-04-16T19:37:44.405131+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:37:44.405131+0000","last_undegraded":"2024-04-16T19:37:44.405131+0000","last_fullsized":"2024-04-16T19:37:44.405131+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T18:09:01.146756+0000","last_clean_scrub_stamp":"2024-04-16T18:09:01.146756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'161","reported_seq":1777,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.064843+0000","last_change":"2024-04-16T19:38:41.064904+0000","last_active":"2024-04-16T19:38:41.064843+0000","last_peered":"2024-04-16T19:38:41.064843+0000","last_clean":"2024-04-16T19:38:41.064843+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:38:41.064843+0000","last_undegraded":"2024-04-16T19:38:41.064843+0000","last_fullsized":"2024-04-16T19:38:41.064843+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'161","last_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_deep_scrub":"53'161","last_deep_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.064780+0000","objects_scrubbed":41,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:59.693856+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9554,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.719529+0000","last_change":"2024-04-16T19:38:28.719553+0000","last_active":"2024-04-16T19:38:28.719529+0000","last_peered":"2024-04-16T19:38:28.719529+0000","last_clean":"2024-04-16T19:38:28.719529+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:38:28.719529+0000","last_undegraded":"2024-04-16T19:38:28.719529+0000","last_fullsized":"2024-04-16T19:38:28.719529+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:05.470964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'22","reported_seq":166,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.884097+0000","last_change":"2024-04-16T19:38:49.884129+0000","last_active":"2024-04-16T19:38:49.884097+0000","last_peered":"2024-04-16T19:38:49.884097+0000","last_clean":"2024-04-16T19:38:49.884097+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:38:49.884097+0000","last_undegraded":"2024-04-16T19:38:49.884097+0000","last_fullsized":"2024-04-16T19:38:49.884097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:49.884034+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:49.884034+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.884034+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:44.389740+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.923269+0000","last_change":"2024-04-16T19:38:51.923269+0000","last_active":"2024-04-16T19:38:51.923269+0000","last_peered":"2024-04-16T19:38:51.923269+0000","last_clean":"2024-04-16T19:38:51.923269+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:38:51.923269+0000","last_undegraded":"2024-04-16T19:38:51.923269+0000","last_fullsized":"2024-04-16T19:38:51.923269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:51.923171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:51.923171+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.923171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:40.361335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5056","reported_seq":7416,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.912040+0000","last_change":"2024-04-16T19:38:24.912040+0000","last_active":"2024-04-16T19:38:24.912040+0000","last_peered":"2024-04-16T19:38:24.912040+0000","last_clean":"2024-04-16T19:38:24.912040+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:38:24.912040+0000","last_undegraded":"2024-04-16T19:38:24.912040+0000","last_fullsized":"2024-04-16T19:38:24.912040+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5056","last_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_deep_scrub":"53'5056","last_deep_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.911937+0000","objects_scrubbed":13,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:21.591600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'22","reported_seq":459,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.780629+0000","last_change":"2024-04-16T19:38:17.780675+0000","last_active":"2024-04-16T19:38:17.780629+0000","last_peered":"2024-04-16T19:38:17.780629+0000","last_clean":"2024-04-16T19:38:17.780629+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:38:17.780629+0000","last_undegraded":"2024-04-16T19:38:17.780629+0000","last_fullsized":"2024-04-16T19:38:17.780629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.780565+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:41.464784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.403832+0000","last_change":"2024-04-16T19:39:14.403864+0000","last_active":"2024-04-16T19:39:14.403832+0000","last_peered":"2024-04-16T19:39:14.403832+0000","last_clean":"2024-04-16T19:39:14.403832+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:39:14.403832+0000","last_undegraded":"2024-04-16T19:39:14.403832+0000","last_fullsized":"2024-04-16T19:39:14.403832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.403772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.403772+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.403772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:12:10.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.188544+0000","last_change":"2024-04-16T19:39:15.188544+0000","last_active":"2024-04-16T19:39:15.188544+0000","last_peered":"2024-04-16T19:39:15.188544+0000","last_clean":"2024-04-16T19:39:15.188544+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:39:15.188544+0000","last_undegraded":"2024-04-16T19:39:15.188544+0000","last_fullsized":"2024-04-16T19:39:15.188544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.188460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.188460+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.188460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:40.945701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'7","reported_seq":1415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.128495+0000","last_change":"2024-04-16T19:39:10.128523+0000","last_active":"2024-04-16T19:39:10.128495+0000","last_peered":"2024-04-16T19:39:10.128495+0000","last_clean":"2024-04-16T19:39:10.128495+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:39:10.128495+0000","last_undegraded":"2024-04-16T19:39:10.128495+0000","last_fullsized":"2024-04-16T19:39:10.128495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:39:10.128422+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:39:10.128422+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.128422+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:18.122211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'34","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.378953+0000","last_change":"2024-04-16T19:39:02.378981+0000","last_active":"2024-04-16T19:39:02.378953+0000","last_peered":"2024-04-16T19:39:02.378953+0000","last_clean":"2024-04-16T19:39:02.378953+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:39:02.378953+0000","last_undegraded":"2024-04-16T19:39:02.378953+0000","last_fullsized":"2024-04-16T19:39:02.378953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:39:02.378896+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:39:02.378896+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.378896+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:09.552301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.934976+0000","last_change":"2024-04-16T19:38:33.934997+0000","last_active":"2024-04-16T19:38:33.934976+0000","last_peered":"2024-04-16T19:38:33.934976+0000","last_clean":"2024-04-16T19:38:33.934976+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:38:33.934976+0000","last_undegraded":"2024-04-16T19:38:33.934976+0000","last_fullsized":"2024-04-16T19:38:33.934976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.934914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:28.582406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.875874+0000","last_change":"2024-04-16T19:38:26.875874+0000","last_active":"2024-04-16T19:38:26.875874+0000","last_peered":"2024-04-16T19:38:26.875874+0000","last_clean":"2024-04-16T19:38:26.875874+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:38:26.875874+0000","last_undegraded":"2024-04-16T19:38:26.875874+0000","last_fullsized":"2024-04-16T19:38:26.875874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.875781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:49.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.823718+0000","last_change":"2024-04-16T19:39:26.823743+0000","last_active":"2024-04-16T19:39:26.823718+0000","last_peered":"2024-04-16T19:39:26.823718+0000","last_clean":"2024-04-16T19:39:26.823718+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:39:26.823718+0000","last_undegraded":"2024-04-16T19:39:26.823718+0000","last_fullsized":"2024-04-16T19:39:26.823718+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.823645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.823645+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.823645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:20.709880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'170","reported_seq":1771,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.011174+0000","last_change":"2024-04-16T19:38:49.011216+0000","last_active":"2024-04-16T19:38:49.011174+0000","last_peered":"2024-04-16T19:38:49.011174+0000","last_clean":"2024-04-16T19:38:49.011174+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:38:49.011174+0000","last_undegraded":"2024-04-16T19:38:49.011174+0000","last_fullsized":"2024-04-16T19:38:49.011174+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'170","last_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_deep_scrub":"53'170","last_deep_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.011115+0000","objects_scrubbed":44,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:08:02.979509+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10942,"num_omap_keys":44,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.751164+0000","last_change":"2024-04-16T19:38:30.751189+0000","last_active":"2024-04-16T19:38:30.751164+0000","last_peered":"2024-04-16T19:38:30.751164+0000","last_clean":"2024-04-16T19:38:30.751164+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:38:30.751164+0000","last_undegraded":"2024-04-16T19:38:30.751164+0000","last_fullsized":"2024-04-16T19:38:30.751164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.751094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:44.801073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'14","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.374218+0000","last_change":"2024-04-16T19:38:46.374254+0000","last_active":"2024-04-16T19:38:46.374218+0000","last_peered":"2024-04-16T19:38:46.374218+0000","last_clean":"2024-04-16T19:38:46.374218+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:38:46.374218+0000","last_undegraded":"2024-04-16T19:38:46.374218+0000","last_fullsized":"2024-04-16T19:38:46.374218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.374155+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:12.131396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.750144+0000","last_change":"2024-04-16T19:38:26.750144+0000","last_active":"2024-04-16T19:38:26.750144+0000","last_peered":"2024-04-16T19:38:26.750144+0000","last_clean":"2024-04-16T19:38:26.750144+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:38:26.750144+0000","last_undegraded":"2024-04-16T19:38:26.750144+0000","last_fullsized":"2024-04-16T19:38:26.750144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.750020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:03.892413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'576","reported_seq":1559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.901634+0000","last_change":"2024-04-16T19:38:28.901634+0000","last_active":"2024-04-16T19:38:28.901634+0000","last_peered":"2024-04-16T19:38:28.901634+0000","last_clean":"2024-04-16T19:38:28.901634+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:38:28.901634+0000","last_undegraded":"2024-04-16T19:38:28.901634+0000","last_fullsized":"2024-04-16T19:38:28.901634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'576","last_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_deep_scrub":"53'576","last_deep_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.901479+0000","objects_scrubbed":22,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:47.579102+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'11","reported_seq":532,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.330127+0000","last_change":"2024-04-16T19:38:39.330127+0000","last_active":"2024-04-16T19:38:39.330127+0000","last_peered":"2024-04-16T19:38:39.330127+0000","last_clean":"2024-04-16T19:38:39.330127+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:38:39.330127+0000","last_undegraded":"2024-04-16T19:38:39.330127+0000","last_fullsized":"2024-04-16T19:38:39.330127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.330010+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:11:17.064209+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.058744+0000","last_change":"2024-04-16T19:39:08.058781+0000","last_active":"2024-04-16T19:39:08.058744+0000","last_peered":"2024-04-16T19:39:08.058744+0000","last_clean":"2024-04-16T19:39:08.058744+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:39:08.058744+0000","last_undegraded":"2024-04-16T19:39:08.058744+0000","last_fullsized":"2024-04-16T19:39:08.058744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.058658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.058658+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.058658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:15.232062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.371029+0000","last_change":"2024-04-16T19:39:28.371056+0000","last_active":"2024-04-16T19:39:28.371029+0000","last_peered":"2024-04-16T19:39:28.371029+0000","last_clean":"2024-04-16T19:39:28.371029+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:39:28.371029+0000","last_undegraded":"2024-04-16T19:39:28.371029+0000","last_fullsized":"2024-04-16T19:39:28.371029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.370959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.370959+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.370959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:02:32.532383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"53'2","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.860239+0000","last_change":"2024-04-16T19:39:10.860239+0000","last_active":"2024-04-16T19:39:10.860239+0000","last_peered":"2024-04-16T19:39:10.860239+0000","last_clean":"2024-04-16T19:39:10.860239+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:39:10.860239+0000","last_undegraded":"2024-04-16T19:39:10.860239+0000","last_fullsized":"2024-04-16T19:39:10.860239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:10.860109+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:10.860109+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.860109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:10.604165+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'84","reported_seq":249,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.359931+0000","last_change":"2024-04-16T19:38:52.359986+0000","last_active":"2024-04-16T19:38:52.359931+0000","last_peered":"2024-04-16T19:38:52.359931+0000","last_clean":"2024-04-16T19:38:52.359931+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:38:52.359931+0000","last_undegraded":"2024-04-16T19:38:52.359931+0000","last_fullsized":"2024-04-16T19:38:52.359931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:52.359856+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:52.359856+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.359856+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:57.288122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.397137+0000","last_change":"2024-04-16T19:38:50.397161+0000","last_active":"2024-04-16T19:38:50.397137+0000","last_peered":"2024-04-16T19:38:50.397137+0000","last_clean":"2024-04-16T19:38:50.397137+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:38:50.397137+0000","last_undegraded":"2024-04-16T19:38:50.397137+0000","last_fullsized":"2024-04-16T19:38:50.397137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.397068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.397068+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.397068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:47.446913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.316150+0000","last_change":"2024-04-16T19:38:41.316173+0000","last_active":"2024-04-16T19:38:41.316150+0000","last_peered":"2024-04-16T19:38:41.316150+0000","last_clean":"2024-04-16T19:38:41.316150+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:38:41.316150+0000","last_undegraded":"2024-04-16T19:38:41.316150+0000","last_fullsized":"2024-04-16T19:38:41.316150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.316087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:50:00.704252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'10","reported_seq":205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.211015+0000","last_change":"2024-04-16T19:38:36.211054+0000","last_active":"2024-04-16T19:38:36.211015+0000","last_peered":"2024-04-16T19:38:36.211015+0000","last_clean":"2024-04-16T19:38:36.211015+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:38:36.211015+0000","last_undegraded":"2024-04-16T19:38:36.211015+0000","last_fullsized":"2024-04-16T19:38:36.211015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.210953+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:18.456725+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.073046+0000","last_change":"2024-04-16T19:38:23.073046+0000","last_active":"2024-04-16T19:38:23.073046+0000","last_peered":"2024-04-16T19:38:23.073046+0000","last_clean":"2024-04-16T19:38:23.073046+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:38:23.073046+0000","last_undegraded":"2024-04-16T19:38:23.073046+0000","last_fullsized":"2024-04-16T19:38:23.073046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.072960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:19.149593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.112321+0000","last_change":"2024-04-16T19:39:16.112345+0000","last_active":"2024-04-16T19:39:16.112321+0000","last_peered":"2024-04-16T19:39:16.112321+0000","last_clean":"2024-04-16T19:39:16.112321+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:39:16.112321+0000","last_undegraded":"2024-04-16T19:39:16.112321+0000","last_fullsized":"2024-04-16T19:39:16.112321+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.112261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.112261+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.112261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:36.823000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'21","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.709521+0000","last_change":"2024-04-16T19:38:13.709521+0000","last_active":"2024-04-16T19:38:13.709521+0000","last_peered":"2024-04-16T19:38:13.709521+0000","last_clean":"2024-04-16T19:38:13.709521+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:38:13.709521+0000","last_undegraded":"2024-04-16T19:38:13.709521+0000","last_fullsized":"2024-04-16T19:38:13.709521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.709408+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:26.428610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.810806+0000","last_change":"2024-04-16T19:39:07.810827+0000","last_active":"2024-04-16T19:39:07.810806+0000","last_peered":"2024-04-16T19:39:07.810806+0000","last_clean":"2024-04-16T19:39:07.810806+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:39:07.810806+0000","last_undegraded":"2024-04-16T19:39:07.810806+0000","last_fullsized":"2024-04-16T19:39:07.810806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.810743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.810743+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.810743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:28.521482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.083996+0000","last_change":"2024-04-16T19:39:10.084035+0000","last_active":"2024-04-16T19:39:10.083996+0000","last_peered":"2024-04-16T19:39:10.083996+0000","last_clean":"2024-04-16T19:39:10.083996+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:39:10.083996+0000","last_undegraded":"2024-04-16T19:39:10.083996+0000","last_fullsized":"2024-04-16T19:39:10.083996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:10.083904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:10.083904+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.083904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:39.621474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'26","reported_seq":487,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.777083+0000","last_change":"2024-04-16T19:38:15.777083+0000","last_active":"2024-04-16T19:38:15.777083+0000","last_peered":"2024-04-16T19:38:15.777083+0000","last_clean":"2024-04-16T19:38:15.777083+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:38:15.777083+0000","last_undegraded":"2024-04-16T19:38:15.777083+0000","last_fullsized":"2024-04-16T19:38:15.777083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.776944+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:01.810616+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.561605+0000","last_change":"2024-04-16T19:39:26.561649+0000","last_active":"2024-04-16T19:39:26.561605+0000","last_peered":"2024-04-16T19:39:26.561605+0000","last_clean":"2024-04-16T19:39:26.561605+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:39:26.561605+0000","last_undegraded":"2024-04-16T19:39:26.561605+0000","last_fullsized":"2024-04-16T19:39:26.561605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.561510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.561510+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.561510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:03.949037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.767299+0000","last_change":"2024-04-16T19:38:32.767299+0000","last_active":"2024-04-16T19:38:32.767299+0000","last_peered":"2024-04-16T19:38:32.767299+0000","last_clean":"2024-04-16T19:38:32.767299+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:38:32.767299+0000","last_undegraded":"2024-04-16T19:38:32.767299+0000","last_fullsized":"2024-04-16T19:38:32.767299+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:09.909599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'16","reported_seq":319,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.568053+0000","last_change":"2024-04-16T19:38:27.568053+0000","last_active":"2024-04-16T19:38:27.568053+0000","last_peered":"2024-04-16T19:38:27.568053+0000","last_clean":"2024-04-16T19:38:27.568053+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:38:27.568053+0000","last_undegraded":"2024-04-16T19:38:27.568053+0000","last_fullsized":"2024-04-16T19:38:27.568053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.567879+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:46.513343+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.866893+0000","last_change":"2024-04-16T19:39:11.866932+0000","last_active":"2024-04-16T19:39:11.866893+0000","last_peered":"2024-04-16T19:39:11.866893+0000","last_clean":"2024-04-16T19:39:11.866893+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:39:11.866893+0000","last_undegraded":"2024-04-16T19:39:11.866893+0000","last_fullsized":"2024-04-16T19:39:11.866893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.866811+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:39.263723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.407703+0000","last_change":"2024-04-16T17:45:08.389381+0000","last_active":"2024-04-16T19:37:59.407703+0000","last_peered":"2024-04-16T19:37:59.407703+0000","last_clean":"2024-04-16T19:37:59.407703+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:37:59.407703+0000","last_undegraded":"2024-04-16T19:37:59.407703+0000","last_fullsized":"2024-04-16T19:37:59.407703+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'12","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.763410+0000","last_change":"2024-04-16T19:38:21.763470+0000","last_active":"2024-04-16T19:38:21.763410+0000","last_peered":"2024-04-16T19:38:21.763410+0000","last_clean":"2024-04-16T19:38:21.763410+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:38:21.763410+0000","last_undegraded":"2024-04-16T19:38:21.763410+0000","last_fullsized":"2024-04-16T19:38:21.763410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.763344+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:36.589324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.006817+0000","last_change":"2024-04-16T19:39:02.006863+0000","last_active":"2024-04-16T19:39:02.006817+0000","last_peered":"2024-04-16T19:39:02.006817+0000","last_clean":"2024-04-16T19:39:02.006817+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:39:02.006817+0000","last_undegraded":"2024-04-16T19:39:02.006817+0000","last_fullsized":"2024-04-16T19:39:02.006817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.006726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.006726+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.006726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:40.141725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.332451+0000","last_change":"2024-04-16T19:39:21.332477+0000","last_active":"2024-04-16T19:39:21.332451+0000","last_peered":"2024-04-16T19:39:21.332451+0000","last_clean":"2024-04-16T19:39:21.332451+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:39:21.332451+0000","last_undegraded":"2024-04-16T19:39:21.332451+0000","last_fullsized":"2024-04-16T19:39:21.332451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.332386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.332386+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.332386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:16.685970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'60","reported_seq":651,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.053558+0000","last_change":"2024-04-16T19:38:16.053634+0000","last_active":"2024-04-16T19:38:16.053558+0000","last_peered":"2024-04-16T19:38:16.053558+0000","last_clean":"2024-04-16T19:38:16.053558+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:38:16.053558+0000","last_undegraded":"2024-04-16T19:38:16.053558+0000","last_fullsized":"2024-04-16T19:38:16.053558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'60","last_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_deep_scrub":"53'60","last_deep_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.053490+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:25:34.189324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.151849+0000","last_change":"2024-04-16T19:39:09.151872+0000","last_active":"2024-04-16T19:39:09.151849+0000","last_peered":"2024-04-16T19:39:09.151849+0000","last_clean":"2024-04-16T19:39:09.151849+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:39:09.151849+0000","last_undegraded":"2024-04-16T19:39:09.151849+0000","last_fullsized":"2024-04-16T19:39:09.151849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:09.151786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:09.151786+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.151786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:17.029197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.803249+0000","last_change":"2024-04-16T19:39:19.803275+0000","last_active":"2024-04-16T19:39:19.803249+0000","last_peered":"2024-04-16T19:39:19.803249+0000","last_clean":"2024-04-16T19:39:19.803249+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:39:19.803249+0000","last_undegraded":"2024-04-16T19:39:19.803249+0000","last_fullsized":"2024-04-16T19:39:19.803249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.803175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.803175+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.803175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:34.823944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'12","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.823687+0000","last_change":"2024-04-16T19:38:16.823687+0000","last_active":"2024-04-16T19:38:16.823687+0000","last_peered":"2024-04-16T19:38:16.823687+0000","last_clean":"2024-04-16T19:38:16.823687+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:38:16.823687+0000","last_undegraded":"2024-04-16T19:38:16.823687+0000","last_fullsized":"2024-04-16T19:38:16.823687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.823588+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:26.463012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.733389+0000","last_change":"2024-04-16T19:39:03.733431+0000","last_active":"2024-04-16T19:39:03.733389+0000","last_peered":"2024-04-16T19:39:03.733389+0000","last_clean":"2024-04-16T19:39:03.733389+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:39:03.733389+0000","last_undegraded":"2024-04-16T19:39:03.733389+0000","last_fullsized":"2024-04-16T19:39:03.733389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.733308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.733308+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.733308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:30.521077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.059771+0000","last_change":"2024-04-16T19:39:14.059794+0000","last_active":"2024-04-16T19:39:14.059771+0000","last_peered":"2024-04-16T19:39:14.059771+0000","last_clean":"2024-04-16T19:39:14.059771+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:39:14.059771+0000","last_undegraded":"2024-04-16T19:39:14.059771+0000","last_fullsized":"2024-04-16T19:39:14.059771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.059707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.059707+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.059707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:11.151703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'22","reported_seq":550,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.076687+0000","last_change":"2024-04-16T19:38:20.076687+0000","last_active":"2024-04-16T19:38:20.076687+0000","last_peered":"2024-04-16T19:38:20.076687+0000","last_clean":"2024-04-16T19:38:20.076687+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:38:20.076687+0000","last_undegraded":"2024-04-16T19:38:20.076687+0000","last_fullsized":"2024-04-16T19:38:20.076687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.076549+0000","objects_scrubbed":11,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:18.065057+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.038794+0000","last_change":"2024-04-16T19:39:23.038840+0000","last_active":"2024-04-16T19:39:23.038794+0000","last_peered":"2024-04-16T19:39:23.038794+0000","last_clean":"2024-04-16T19:39:23.038794+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:39:23.038794+0000","last_undegraded":"2024-04-16T19:39:23.038794+0000","last_fullsized":"2024-04-16T19:39:23.038794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.038719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.038719+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.038719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:41.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.210849+0000","last_change":"2024-04-16T19:39:16.210888+0000","last_active":"2024-04-16T19:39:16.210849+0000","last_peered":"2024-04-16T19:39:16.210849+0000","last_clean":"2024-04-16T19:39:16.210849+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:39:16.210849+0000","last_undegraded":"2024-04-16T19:39:16.210849+0000","last_fullsized":"2024-04-16T19:39:16.210849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.210782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.210782+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.210782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:24.088193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'12","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.964569+0000","last_change":"2024-04-16T19:38:19.964623+0000","last_active":"2024-04-16T19:38:19.964569+0000","last_peered":"2024-04-16T19:38:19.964569+0000","last_clean":"2024-04-16T19:38:19.964569+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:38:19.964569+0000","last_undegraded":"2024-04-16T19:38:19.964569+0000","last_fullsized":"2024-04-16T19:38:19.964569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.964501+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:39:19.709359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.366967+0000","last_change":"2024-04-16T19:39:16.366990+0000","last_active":"2024-04-16T19:39:16.366967+0000","last_peered":"2024-04-16T19:39:16.366967+0000","last_clean":"2024-04-16T19:39:16.366967+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:39:16.366967+0000","last_undegraded":"2024-04-16T19:39:16.366967+0000","last_fullsized":"2024-04-16T19:39:16.366967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.366904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.366904+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.366904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:30:54.676107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.405930+0000","last_change":"2024-04-16T17:45:08.382544+0000","last_active":"2024-04-16T19:38:09.405930+0000","last_peered":"2024-04-16T19:38:09.405930+0000","last_clean":"2024-04-16T19:38:09.405930+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:38:09.405930+0000","last_undegraded":"2024-04-16T19:38:09.405930+0000","last_fullsized":"2024-04-16T19:38:09.405930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'11","reported_seq":380,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.008833+0000","last_change":"2024-04-16T19:38:44.008897+0000","last_active":"2024-04-16T19:38:44.008833+0000","last_peered":"2024-04-16T19:38:44.008833+0000","last_clean":"2024-04-16T19:38:44.008833+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:38:44.008833+0000","last_undegraded":"2024-04-16T19:38:44.008833+0000","last_fullsized":"2024-04-16T19:38:44.008833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.008768+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:20.760273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.106120+0000","last_change":"2024-04-16T19:39:17.106146+0000","last_active":"2024-04-16T19:39:17.106120+0000","last_peered":"2024-04-16T19:39:17.106120+0000","last_clean":"2024-04-16T19:39:17.106120+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:39:17.106120+0000","last_undegraded":"2024-04-16T19:39:17.106120+0000","last_fullsized":"2024-04-16T19:39:17.106120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.106053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.106053+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.106053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:46.441498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.404236+0000","last_change":"2024-04-16T17:45:08.389051+0000","last_active":"2024-04-16T19:37:39.404236+0000","last_peered":"2024-04-16T19:37:39.404236+0000","last_clean":"2024-04-16T19:37:39.404236+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:37:39.404236+0000","last_undegraded":"2024-04-16T19:37:39.404236+0000","last_fullsized":"2024-04-16T19:37:39.404236+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'20","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.253495+0000","last_change":"2024-04-16T19:38:09.253495+0000","last_active":"2024-04-16T19:38:09.253495+0000","last_peered":"2024-04-16T19:38:09.253495+0000","last_clean":"2024-04-16T19:38:09.253495+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:38:09.253495+0000","last_undegraded":"2024-04-16T19:38:09.253495+0000","last_fullsized":"2024-04-16T19:38:09.253495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.253410+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:49.003227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.014665+0000","last_change":"2024-04-16T19:39:04.014686+0000","last_active":"2024-04-16T19:39:04.014665+0000","last_peered":"2024-04-16T19:39:04.014665+0000","last_clean":"2024-04-16T19:39:04.014665+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:39:04.014665+0000","last_undegraded":"2024-04-16T19:39:04.014665+0000","last_fullsized":"2024-04-16T19:39:04.014665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.014599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.014599+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.014599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:04.130956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:39.401022+0000","last_change":"2024-04-16T17:45:08.385757+0000","last_active":"2024-04-16T19:37:39.401022+0000","last_peered":"2024-04-16T19:37:39.401022+0000","last_clean":"2024-04-16T19:37:39.401022+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:37:39.401022+0000","last_undegraded":"2024-04-16T19:37:39.401022+0000","last_fullsized":"2024-04-16T19:37:39.401022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'20","reported_seq":697,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.162796+0000","last_change":"2024-04-16T19:38:38.162842+0000","last_active":"2024-04-16T19:38:38.162796+0000","last_peered":"2024-04-16T19:38:38.162796+0000","last_clean":"2024-04-16T19:38:38.162796+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:38:38.162796+0000","last_undegraded":"2024-04-16T19:38:38.162796+0000","last_fullsized":"2024-04-16T19:38:38.162796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.162737+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:17.912553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.005610+0000","last_change":"2024-04-16T19:39:17.005632+0000","last_active":"2024-04-16T19:39:17.005610+0000","last_peered":"2024-04-16T19:39:17.005610+0000","last_clean":"2024-04-16T19:39:17.005610+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:39:17.005610+0000","last_undegraded":"2024-04-16T19:39:17.005610+0000","last_fullsized":"2024-04-16T19:39:17.005610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.005547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.005547+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.005547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:07.346934+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.312985+0000","last_change":"2024-04-16T19:39:25.313011+0000","last_active":"2024-04-16T19:39:25.312985+0000","last_peered":"2024-04-16T19:39:25.312985+0000","last_clean":"2024-04-16T19:39:25.312985+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:39:25.312985+0000","last_undegraded":"2024-04-16T19:39:25.312985+0000","last_fullsized":"2024-04-16T19:39:25.312985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.312919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.312919+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.312919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:02:17.716320+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'22","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.813299+0000","last_change":"2024-04-16T19:38:17.813299+0000","last_active":"2024-04-16T19:38:17.813299+0000","last_peered":"2024-04-16T19:38:17.813299+0000","last_clean":"2024-04-16T19:38:17.813299+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:38:17.813299+0000","last_undegraded":"2024-04-16T19:38:17.813299+0000","last_fullsized":"2024-04-16T19:38:17.813299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.813183+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:32.833529+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.249733+0000","last_change":"2024-04-16T19:38:59.249757+0000","last_active":"2024-04-16T19:38:59.249733+0000","last_peered":"2024-04-16T19:38:59.249733+0000","last_clean":"2024-04-16T19:38:59.249733+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:38:59.249733+0000","last_undegraded":"2024-04-16T19:38:59.249733+0000","last_fullsized":"2024-04-16T19:38:59.249733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:59.249670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:59.249670+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.249670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:18.048162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.079340+0000","last_change":"2024-04-16T19:39:20.079384+0000","last_active":"2024-04-16T19:39:20.079340+0000","last_peered":"2024-04-16T19:39:20.079340+0000","last_clean":"2024-04-16T19:39:20.079340+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:39:20.079340+0000","last_undegraded":"2024-04-16T19:39:20.079340+0000","last_fullsized":"2024-04-16T19:39:20.079340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.079259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.079259+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.079259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:33.473533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'6","reported_seq":160,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.113419+0000","last_change":"2024-04-16T19:38:39.113484+0000","last_active":"2024-04-16T19:38:39.113419+0000","last_peered":"2024-04-16T19:38:39.113419+0000","last_clean":"2024-04-16T19:38:39.113419+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:38:39.113419+0000","last_undegraded":"2024-04-16T19:38:39.113419+0000","last_fullsized":"2024-04-16T19:38:39.113419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.113342+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:41.646707+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.385474+0000","last_change":"2024-04-16T19:39:10.385498+0000","last_active":"2024-04-16T19:39:10.385474+0000","last_peered":"2024-04-16T19:39:10.385474+0000","last_clean":"2024-04-16T19:39:10.385474+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:39:10.385474+0000","last_undegraded":"2024-04-16T19:39:10.385474+0000","last_fullsized":"2024-04-16T19:39:10.385474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:10.385405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:10.385405+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.385405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:45.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:37:59.404832+0000","last_change":"2024-04-16T17:45:08.381671+0000","last_active":"2024-04-16T19:37:59.404832+0000","last_peered":"2024-04-16T19:37:59.404832+0000","last_clean":"2024-04-16T19:37:59.404832+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:37:59.404832+0000","last_undegraded":"2024-04-16T19:37:59.404832+0000","last_fullsized":"2024-04-16T19:37:59.404832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'16","reported_seq":465,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.016697+0000","last_change":"2024-04-16T19:38:43.016743+0000","last_active":"2024-04-16T19:38:43.016697+0000","last_peered":"2024-04-16T19:38:43.016697+0000","last_clean":"2024-04-16T19:38:43.016697+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:38:43.016697+0000","last_undegraded":"2024-04-16T19:38:43.016697+0000","last_fullsized":"2024-04-16T19:38:43.016697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.016634+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:57.842614+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.755375+0000","last_change":"2024-04-16T19:39:01.755399+0000","last_active":"2024-04-16T19:39:01.755375+0000","last_peered":"2024-04-16T19:39:01.755375+0000","last_clean":"2024-04-16T19:39:01.755375+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:39:01.755375+0000","last_undegraded":"2024-04-16T19:39:01.755375+0000","last_fullsized":"2024-04-16T19:39:01.755375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:01.755309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:01.755309+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.755309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:07.367058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.213131+0000","last_change":"2024-04-16T19:39:17.213131+0000","last_active":"2024-04-16T19:39:17.213131+0000","last_peered":"2024-04-16T19:39:17.213131+0000","last_clean":"2024-04-16T19:39:17.213131+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:39:17.213131+0000","last_undegraded":"2024-04-16T19:39:17.213131+0000","last_fullsized":"2024-04-16T19:39:17.213131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.213045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.213045+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.213045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:25.206834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'6","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.208756+0000","last_change":"2024-04-16T19:38:10.208756+0000","last_active":"2024-04-16T19:38:10.208756+0000","last_peered":"2024-04-16T19:38:10.208756+0000","last_clean":"2024-04-16T19:38:10.208756+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:38:10.208756+0000","last_undegraded":"2024-04-16T19:38:10.208756+0000","last_fullsized":"2024-04-16T19:38:10.208756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.208682+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:12.742047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.041246+0000","last_change":"2024-04-16T19:39:21.041269+0000","last_active":"2024-04-16T19:39:21.041246+0000","last_peered":"2024-04-16T19:39:21.041246+0000","last_clean":"2024-04-16T19:39:21.041246+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:39:21.041246+0000","last_undegraded":"2024-04-16T19:39:21.041246+0000","last_fullsized":"2024-04-16T19:39:21.041246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.041157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.041157+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.041157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:08:21.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.338725+0000","last_change":"2024-04-16T17:45:08.385216+0000","last_active":"2024-04-16T19:38:10.338725+0000","last_peered":"2024-04-16T19:38:10.338725+0000","last_clean":"2024-04-16T19:38:10.338725+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:38:10.338725+0000","last_undegraded":"2024-04-16T19:38:10.338725+0000","last_fullsized":"2024-04-16T19:38:10.338725+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T17:45:07.366377+0000","last_clean_scrub_stamp":"2024-04-16T17:45:07.366377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'14","reported_seq":334,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.249652+0000","last_change":"2024-04-16T19:38:08.249652+0000","last_active":"2024-04-16T19:38:08.249652+0000","last_peered":"2024-04-16T19:38:08.249652+0000","last_clean":"2024-04-16T19:38:08.249652+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:38:08.249652+0000","last_undegraded":"2024-04-16T19:38:08.249652+0000","last_fullsized":"2024-04-16T19:38:08.249652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.249524+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:54.283196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.032276+0000","last_change":"2024-04-16T19:39:18.032276+0000","last_active":"2024-04-16T19:39:18.032276+0000","last_peered":"2024-04-16T19:39:18.032276+0000","last_clean":"2024-04-16T19:39:18.032276+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:39:18.032276+0000","last_undegraded":"2024-04-16T19:39:18.032276+0000","last_fullsized":"2024-04-16T19:39:18.032276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.032188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.032188+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.032188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:20.533789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.342407+0000","last_change":"2024-04-16T19:39:19.342450+0000","last_active":"2024-04-16T19:39:19.342407+0000","last_peered":"2024-04-16T19:39:19.342407+0000","last_clean":"2024-04-16T19:39:19.342407+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:39:19.342407+0000","last_undegraded":"2024-04-16T19:39:19.342407+0000","last_fullsized":"2024-04-16T19:39:19.342407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.342336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.342336+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.342336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:33:56.729863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'40","reported_seq":775,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.113737+0000","last_change":"2024-04-16T19:38:19.113737+0000","last_active":"2024-04-16T19:38:19.113737+0000","last_peered":"2024-04-16T19:38:19.113737+0000","last_clean":"2024-04-16T19:38:19.113737+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:38:19.113737+0000","last_undegraded":"2024-04-16T19:38:19.113737+0000","last_fullsized":"2024-04-16T19:38:19.113737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'40","last_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_deep_scrub":"53'40","last_deep_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.113599+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:04:11.281022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.816505+0000","last_change":"2024-04-16T19:39:13.816505+0000","last_active":"2024-04-16T19:39:13.816505+0000","last_peered":"2024-04-16T19:39:13.816505+0000","last_clean":"2024-04-16T19:39:13.816505+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:39:13.816505+0000","last_undegraded":"2024-04-16T19:39:13.816505+0000","last_fullsized":"2024-04-16T19:39:13.816505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.816385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.816385+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.816385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:48:44.929091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.521912+0000","last_change":"2024-04-16T19:39:18.521932+0000","last_active":"2024-04-16T19:39:18.521912+0000","last_peered":"2024-04-16T19:39:18.521912+0000","last_clean":"2024-04-16T19:39:18.521912+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:39:18.521912+0000","last_undegraded":"2024-04-16T19:39:18.521912+0000","last_fullsized":"2024-04-16T19:39:18.521912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.521850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.521850+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.521850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:08.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267981,"num_omap_keys":1086,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5269,"ondisk_log_size":5269,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1200,"ondisk_log_size":1200,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":365336,"num_omap_keys":1682,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21506,"ondisk_log_size":21506,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5237,"ondisk_log_size":5237,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9817,"num_omap_keys":62,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":612,"ondisk_log_size":612,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641641,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50804,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806796,"statfs":{"total":107374182400,"available":107322159104,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641640,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46504,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811096,"statfs":{"total":107374182400,"available":107326562304,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641641,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":87628,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":104769972,"statfs":{"total":107374182400,"available":107284451328,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641641,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":68940,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":67198,"kb_avail":104788660,"statfs":{"total":107374182400,"available":107303587840,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68811206},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641640,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50932,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806668,"statfs":{"total":107374182400,"available":107322028032,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641641,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59840,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797760,"statfs":{"total":107374182400,"available":107312906240,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:39:32.614 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.614 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.614 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.615 INFO:tasks.ceph:pgid 15.1f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.615 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.615 INFO:tasks.ceph:pgid 14.1f last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.616 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.616 INFO:tasks.ceph:pgid 14.2 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.617 INFO:tasks.ceph:pgid 14.3 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.617 INFO:tasks.ceph:pgid 15.1 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.618 INFO:tasks.ceph:pgid 15.7 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.618 INFO:tasks.ceph:pgid 15.6 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.618 INFO:tasks.ceph:pgid 15.5 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.619 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-16T17:45:09.373838+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=9, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.619 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.620 INFO:tasks.ceph:pgid 15.c last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.620 INFO:tasks.ceph:pgid 15.f last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.620 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-16T17:45:19.391583+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=19, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.621 INFO:tasks.ceph:pgid 15.9 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.621 INFO:tasks.ceph:pgid 14.8 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.621 INFO:tasks.ceph:pgid 14.9 last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.622 INFO:tasks.ceph:pgid 14.a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.622 INFO:tasks.ceph:pgid 14.b last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.622 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-16T17:44:21.156403+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=44, tm_sec=21, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.622 INFO:tasks.ceph:pgid 15.18 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.623 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.623 INFO:tasks.ceph:pgid 15.1a last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.624 INFO:tasks.ceph:pgid 15.1b last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.624 INFO:tasks.ceph:pgid 14.1a last_scrub_stamp 2024-04-16T17:46:24.502086+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=46, tm_sec=24, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.624 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.624 INFO:tasks.ceph:pgid 15.14 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.625 INFO:tasks.ceph:pgid 15.15 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.625 INFO:tasks.ceph:pgid 15.16 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.626 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.626 INFO:tasks.ceph:pgid 15.10 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.626 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.627 INFO:tasks.ceph:pgid 15.12 last_scrub_stamp 2024-04-16T18:09:01.146756+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=18, tm_min=9, tm_sec=1, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.627 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.628 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.628 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.628 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.628 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.629 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-16T17:45:07.366377+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=17, tm_min=45, tm_sec=7, tm_wday=1, tm_yday=107, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=16, tm_hour=19, tm_min=38, tm_sec=6, tm_wday=1, tm_yday=107, tm_isdst=0) 2024-04-16T19:39:32.629 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-16T19:39:52.630 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2024-04-16T19:39:52.988 INFO:teuthology.orchestra.run.smithi016.stdout: 2024-04-16T19:39:53.013 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2024-04-16T19:39:53.016 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":3513,"stamp":"2024-04-16T19:39:52.549429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":865529,"num_objects":2907,"num_object_clones":0,"num_object_copies":5814,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2907,"num_whiteouts":0,"num_read":500433,"num_read_kb":399500,"num_write":59294,"num_write_kb":11583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":360,"num_keys_recovered":2,"num_objects_omap":1448,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":732634,"num_omap_keys":3195,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38416,"ondisk_log_size":38416,"up":1042,"acting":1042,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1042,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":629145600,"kb_used":368808,"kb_used_data":11128,"kb_used_omap":9,"kb_used_meta":357622,"kb_avail":628776792,"statfs":{"total":644245094400,"available":643867435008,"internally_reserved":0,"allocated":11395072,"data_stored":3810636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":366205601},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8868,"num_omap_keys":38,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006433"},"pg_stats":[{"pgid":"9.35","version":"53'26","reported_seq":534,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.834693+0000","last_change":"2024-04-16T19:38:15.834693+0000","last_active":"2024-04-16T19:38:15.834693+0000","last_peered":"2024-04-16T19:38:15.834693+0000","last_clean":"2024-04-16T19:38:15.834693+0000","last_became_active":"2024-04-16T17:45:45.459573+0000","last_became_peered":"2024-04-16T17:45:45.459573+0000","last_unstale":"2024-04-16T19:38:15.834693+0000","last_undegraded":"2024-04-16T19:38:15.834693+0000","last_fullsized":"2024-04-16T19:38:15.834693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.834573+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.834573+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:46.410400+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1000,"num_read_kb":733,"num_write":139,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.006563+0000","last_change":"2024-04-16T19:39:26.006563+0000","last_active":"2024-04-16T19:39:26.006563+0000","last_peered":"2024-04-16T19:39:26.006563+0000","last_clean":"2024-04-16T19:39:26.006563+0000","last_became_active":"2024-04-16T17:45:08.382834+0000","last_became_peered":"2024-04-16T17:45:08.382834+0000","last_unstale":"2024-04-16T19:39:26.006563+0000","last_undegraded":"2024-04-16T19:39:26.006563+0000","last_fullsized":"2024-04-16T19:39:26.006563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.006461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.006461+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.006461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:24.268051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.571091+0000","last_change":"2024-04-16T19:39:24.571112+0000","last_active":"2024-04-16T19:39:24.571091+0000","last_peered":"2024-04-16T19:39:24.571091+0000","last_clean":"2024-04-16T19:39:24.571091+0000","last_became_active":"2024-04-16T17:45:10.400033+0000","last_became_peered":"2024-04-16T17:45:10.400033+0000","last_unstale":"2024-04-16T19:39:24.571091+0000","last_undegraded":"2024-04-16T19:39:24.571091+0000","last_fullsized":"2024-04-16T19:39:24.571091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.571025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.571025+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.571025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:42.757850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.34","version":"53'12","reported_seq":304,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.799846+0000","last_change":"2024-04-16T19:38:20.799846+0000","last_active":"2024-04-16T19:38:20.799846+0000","last_peered":"2024-04-16T19:38:20.799846+0000","last_clean":"2024-04-16T19:38:20.799846+0000","last_became_active":"2024-04-16T17:45:45.463862+0000","last_became_peered":"2024-04-16T17:45:45.463862+0000","last_unstale":"2024-04-16T19:38:20.799846+0000","last_undegraded":"2024-04-16T19:38:20.799846+0000","last_fullsized":"2024-04-16T19:38:20.799846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:20.799730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.799730+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:28.459361+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":430,"num_read_kb":371,"num_write":65,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.776434+0000","last_change":"2024-04-16T19:39:18.776434+0000","last_active":"2024-04-16T19:39:18.776434+0000","last_peered":"2024-04-16T19:39:18.776434+0000","last_clean":"2024-04-16T19:39:18.776434+0000","last_became_active":"2024-04-16T17:45:08.381362+0000","last_became_peered":"2024-04-16T17:45:08.381362+0000","last_unstale":"2024-04-16T19:39:18.776434+0000","last_undegraded":"2024-04-16T19:39:18.776434+0000","last_fullsized":"2024-04-16T19:39:18.776434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.776349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.776349+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.776349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:19:44.335738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.080154+0000","last_change":"2024-04-16T19:39:19.080178+0000","last_active":"2024-04-16T19:39:19.080154+0000","last_peered":"2024-04-16T19:39:19.080154+0000","last_clean":"2024-04-16T19:39:19.080154+0000","last_became_active":"2024-04-16T17:45:10.390394+0000","last_became_peered":"2024-04-16T17:45:10.390394+0000","last_unstale":"2024-04-16T19:39:19.080154+0000","last_undegraded":"2024-04-16T19:39:19.080154+0000","last_fullsized":"2024-04-16T19:39:19.080154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.080084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.080084+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.080084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:12:15.470756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"53'13","reported_seq":276,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.534037+0000","last_change":"2024-04-16T19:38:20.534037+0000","last_active":"2024-04-16T19:38:20.534037+0000","last_peered":"2024-04-16T19:38:20.534037+0000","last_clean":"2024-04-16T19:38:20.534037+0000","last_became_active":"2024-04-16T17:45:45.461284+0000","last_became_peered":"2024-04-16T17:45:45.461284+0000","last_unstale":"2024-04-16T19:38:20.534037+0000","last_undegraded":"2024-04-16T19:38:20.534037+0000","last_fullsized":"2024-04-16T19:38:20.534037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:20.533905+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.533905+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:22.838173+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5160,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":359,"num_read_kb":352,"num_write":65,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.356243+0000","last_change":"2024-04-16T19:39:27.356243+0000","last_active":"2024-04-16T19:39:27.356243+0000","last_peered":"2024-04-16T19:39:27.356243+0000","last_clean":"2024-04-16T19:39:27.356243+0000","last_became_active":"2024-04-16T17:45:08.381106+0000","last_became_peered":"2024-04-16T17:45:08.381106+0000","last_unstale":"2024-04-16T19:39:27.356243+0000","last_undegraded":"2024-04-16T19:39:27.356243+0000","last_fullsized":"2024-04-16T19:39:27.356243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:27.356152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:27.356152+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.356152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:11:46.717559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.138870+0000","last_change":"2024-04-16T19:39:11.138892+0000","last_active":"2024-04-16T19:39:11.138870+0000","last_peered":"2024-04-16T19:39:11.138870+0000","last_clean":"2024-04-16T19:39:11.138870+0000","last_became_active":"2024-04-16T17:45:10.393994+0000","last_became_peered":"2024-04-16T17:45:10.393994+0000","last_unstale":"2024-04-16T19:39:11.138870+0000","last_undegraded":"2024-04-16T19:39:11.138870+0000","last_fullsized":"2024-04-16T19:39:11.138870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.138810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.138810+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.138810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:13.729644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"53'14","reported_seq":263,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.837803+0000","last_change":"2024-04-16T19:38:11.837803+0000","last_active":"2024-04-16T19:38:11.837803+0000","last_peered":"2024-04-16T19:38:11.837803+0000","last_clean":"2024-04-16T19:38:11.837803+0000","last_became_active":"2024-04-16T17:45:45.464647+0000","last_became_peered":"2024-04-16T17:45:45.464647+0000","last_unstale":"2024-04-16T19:38:11.837803+0000","last_undegraded":"2024-04-16T19:38:11.837803+0000","last_fullsized":"2024-04-16T19:38:11.837803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:11.837694+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.837694+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:14.141962+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":360,"num_read_kb":233,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:31.545645+0000","last_change":"2024-04-16T19:39:31.545670+0000","last_active":"2024-04-16T19:39:31.545645+0000","last_peered":"2024-04-16T19:39:31.545645+0000","last_clean":"2024-04-16T19:39:31.545645+0000","last_became_active":"2024-04-16T17:45:08.384051+0000","last_became_peered":"2024-04-16T17:45:08.384051+0000","last_unstale":"2024-04-16T19:39:31.545645+0000","last_undegraded":"2024-04-16T19:39:31.545645+0000","last_fullsized":"2024-04-16T19:39:31.545645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:31.545578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:31.545578+0000","last_clean_scrub_stamp":"2024-04-16T19:39:31.545578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:21.447378+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.338807+0000","last_change":"2024-04-16T19:39:20.338832+0000","last_active":"2024-04-16T19:39:20.338807+0000","last_peered":"2024-04-16T19:39:20.338807+0000","last_clean":"2024-04-16T19:39:20.338807+0000","last_became_active":"2024-04-16T17:45:10.398089+0000","last_became_peered":"2024-04-16T17:45:10.398089+0000","last_unstale":"2024-04-16T19:39:20.338807+0000","last_undegraded":"2024-04-16T19:39:20.338807+0000","last_fullsized":"2024-04-16T19:39:20.338807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.338741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.338741+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.338741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:27.750846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"53'14","reported_seq":531,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.397609+0000","last_change":"2024-04-16T19:38:37.397680+0000","last_active":"2024-04-16T19:38:37.397609+0000","last_peered":"2024-04-16T19:38:37.397609+0000","last_clean":"2024-04-16T19:38:37.397609+0000","last_became_active":"2024-04-16T17:45:45.455341+0000","last_became_peered":"2024-04-16T17:45:45.455341+0000","last_unstale":"2024-04-16T19:38:37.397609+0000","last_undegraded":"2024-04-16T19:38:37.397609+0000","last_fullsized":"2024-04-16T19:38:37.397609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:37.397526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.397526+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:07.718210+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1080,"num_read_kb":673,"num_write":73,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:31.067366+0000","last_change":"2024-04-16T19:39:31.067410+0000","last_active":"2024-04-16T19:39:31.067366+0000","last_peered":"2024-04-16T19:39:31.067366+0000","last_clean":"2024-04-16T19:39:31.067366+0000","last_became_active":"2024-04-16T17:45:08.380125+0000","last_became_peered":"2024-04-16T17:45:08.380125+0000","last_unstale":"2024-04-16T19:39:31.067366+0000","last_undegraded":"2024-04-16T19:39:31.067366+0000","last_fullsized":"2024-04-16T19:39:31.067366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:31.067290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:31.067290+0000","last_clean_scrub_stamp":"2024-04-16T19:39:31.067290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:52:03.476611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.502919+0000","last_change":"2024-04-16T19:39:20.502919+0000","last_active":"2024-04-16T19:39:20.502919+0000","last_peered":"2024-04-16T19:39:20.502919+0000","last_clean":"2024-04-16T19:39:20.502919+0000","last_became_active":"2024-04-16T17:45:10.392718+0000","last_became_peered":"2024-04-16T17:45:10.392718+0000","last_unstale":"2024-04-16T19:39:20.502919+0000","last_undegraded":"2024-04-16T19:39:20.502919+0000","last_fullsized":"2024-04-16T19:39:20.502919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.502791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.502791+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.502791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:12:16.893463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.30","version":"53'16","reported_seq":332,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.177690+0000","last_change":"2024-04-16T19:38:15.177758+0000","last_active":"2024-04-16T19:38:15.177690+0000","last_peered":"2024-04-16T19:38:15.177690+0000","last_clean":"2024-04-16T19:38:15.177690+0000","last_became_active":"2024-04-16T17:45:45.464484+0000","last_became_peered":"2024-04-16T17:45:45.464484+0000","last_unstale":"2024-04-16T19:38:15.177690+0000","last_undegraded":"2024-04-16T19:38:15.177690+0000","last_fullsized":"2024-04-16T19:38:15.177690+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.177626+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.177626+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:51.929131+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":566,"num_read_kb":359,"num_write":77,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":88,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.757121+0000","last_change":"2024-04-16T19:38:31.757121+0000","last_active":"2024-04-16T19:38:31.757121+0000","last_peered":"2024-04-16T19:38:31.757121+0000","last_clean":"2024-04-16T19:38:31.757121+0000","last_became_active":"2024-04-16T17:46:16.499847+0000","last_became_peered":"2024-04-16T17:46:16.499847+0000","last_unstale":"2024-04-16T19:38:31.757121+0000","last_undegraded":"2024-04-16T19:38:31.757121+0000","last_fullsized":"2024-04-16T19:38:31.757121+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.757048+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.757048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:06.731328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.189145+0000","last_change":"2024-04-16T19:39:03.189145+0000","last_active":"2024-04-16T19:39:03.189145+0000","last_peered":"2024-04-16T19:39:03.189145+0000","last_clean":"2024-04-16T19:39:03.189145+0000","last_became_active":"2024-04-16T17:45:10.397289+0000","last_became_peered":"2024-04-16T17:45:10.397289+0000","last_unstale":"2024-04-16T19:39:03.189145+0000","last_undegraded":"2024-04-16T19:39:03.189145+0000","last_fullsized":"2024-04-16T19:39:03.189145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.189030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.189030+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.189030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:13:40.127586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.33","version":"53'16","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.885941+0000","last_change":"2024-04-16T19:38:15.885941+0000","last_active":"2024-04-16T19:38:15.885941+0000","last_peered":"2024-04-16T19:38:15.885941+0000","last_clean":"2024-04-16T19:38:15.885941+0000","last_became_active":"2024-04-16T17:45:45.463153+0000","last_became_peered":"2024-04-16T17:45:45.463153+0000","last_unstale":"2024-04-16T19:38:15.885941+0000","last_undegraded":"2024-04-16T19:38:15.885941+0000","last_fullsized":"2024-04-16T19:38:15.885941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:15.885831+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.885831+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:24.282989+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1100,"num_read_kb":916,"num_write":92,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.039586+0000","last_change":"2024-04-16T19:39:24.039610+0000","last_active":"2024-04-16T19:39:24.039586+0000","last_peered":"2024-04-16T19:39:24.039586+0000","last_clean":"2024-04-16T19:39:24.039586+0000","last_became_active":"2024-04-16T17:45:08.383352+0000","last_became_peered":"2024-04-16T17:45:08.383352+0000","last_unstale":"2024-04-16T19:39:24.039586+0000","last_undegraded":"2024-04-16T19:39:24.039586+0000","last_fullsized":"2024-04-16T19:39:24.039586+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.039520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.039520+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.039520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:23.799318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.543459+0000","last_change":"2024-04-16T19:39:22.543459+0000","last_active":"2024-04-16T19:39:22.543459+0000","last_peered":"2024-04-16T19:39:22.543459+0000","last_clean":"2024-04-16T19:39:22.543459+0000","last_became_active":"2024-04-16T17:45:10.395618+0000","last_became_peered":"2024-04-16T17:45:10.395618+0000","last_unstale":"2024-04-16T19:39:22.543459+0000","last_undegraded":"2024-04-16T19:39:22.543459+0000","last_fullsized":"2024-04-16T19:39:22.543459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.543376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.543376+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.543376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:08:22.782651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"53'12","reported_seq":445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.407660+0000","last_change":"2024-04-16T19:38:36.407728+0000","last_active":"2024-04-16T19:38:36.407660+0000","last_peered":"2024-04-16T19:38:36.407660+0000","last_clean":"2024-04-16T19:38:36.407660+0000","last_became_active":"2024-04-16T17:45:45.456868+0000","last_became_peered":"2024-04-16T17:45:45.456868+0000","last_unstale":"2024-04-16T19:38:36.407660+0000","last_undegraded":"2024-04-16T19:38:36.407660+0000","last_fullsized":"2024-04-16T19:38:36.407660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:36.407586+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.407586+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:13.159091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":763,"num_read_kb":678,"num_write":70,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.176659+0000","last_change":"2024-04-16T19:39:18.176683+0000","last_active":"2024-04-16T19:39:18.176659+0000","last_peered":"2024-04-16T19:39:18.176659+0000","last_clean":"2024-04-16T19:39:18.176659+0000","last_became_active":"2024-04-16T17:45:08.389407+0000","last_became_peered":"2024-04-16T17:45:08.389407+0000","last_unstale":"2024-04-16T19:39:18.176659+0000","last_undegraded":"2024-04-16T19:39:18.176659+0000","last_fullsized":"2024-04-16T19:39:18.176659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.176592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.176592+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.176592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:20.767426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.011535+0000","last_change":"2024-04-16T19:38:56.011535+0000","last_active":"2024-04-16T19:38:56.011535+0000","last_peered":"2024-04-16T19:38:56.011535+0000","last_clean":"2024-04-16T19:38:56.011535+0000","last_became_active":"2024-04-16T17:45:10.398784+0000","last_became_peered":"2024-04-16T17:45:10.398784+0000","last_unstale":"2024-04-16T19:38:56.011535+0000","last_undegraded":"2024-04-16T19:38:56.011535+0000","last_fullsized":"2024-04-16T19:38:56.011535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.011447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.011447+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.011447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:15.869930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3d","version":"53'10","reported_seq":541,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.728428+0000","last_change":"2024-04-16T19:38:23.728493+0000","last_active":"2024-04-16T19:38:23.728428+0000","last_peered":"2024-04-16T19:38:23.728428+0000","last_clean":"2024-04-16T19:38:23.728428+0000","last_became_active":"2024-04-16T17:45:45.462250+0000","last_became_peered":"2024-04-16T17:45:45.462250+0000","last_unstale":"2024-04-16T19:38:23.728428+0000","last_undegraded":"2024-04-16T19:38:23.728428+0000","last_fullsized":"2024-04-16T19:38:23.728428+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:23.728366+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.728366+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:54.049051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1034,"num_read_kb":875,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.222497+0000","last_change":"2024-04-16T19:39:07.222497+0000","last_active":"2024-04-16T19:39:07.222497+0000","last_peered":"2024-04-16T19:39:07.222497+0000","last_clean":"2024-04-16T19:39:07.222497+0000","last_became_active":"2024-04-16T17:45:10.391585+0000","last_became_peered":"2024-04-16T17:45:10.391585+0000","last_unstale":"2024-04-16T19:39:07.222497+0000","last_undegraded":"2024-04-16T19:39:07.222497+0000","last_fullsized":"2024-04-16T19:39:07.222497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.222403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.222403+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.222403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:51.142357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.042707+0000","last_change":"2024-04-16T19:39:11.042750+0000","last_active":"2024-04-16T19:39:11.042707+0000","last_peered":"2024-04-16T19:39:11.042707+0000","last_clean":"2024-04-16T19:39:11.042707+0000","last_became_active":"2024-04-16T17:45:08.388398+0000","last_became_peered":"2024-04-16T17:45:08.388398+0000","last_unstale":"2024-04-16T19:39:11.042707+0000","last_undegraded":"2024-04-16T19:39:11.042707+0000","last_fullsized":"2024-04-16T19:39:11.042707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.042628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.042628+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.042628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:26.063397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"53'12","reported_seq":363,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.931333+0000","last_change":"2024-04-16T19:38:17.931378+0000","last_active":"2024-04-16T19:38:17.931333+0000","last_peered":"2024-04-16T19:38:17.931333+0000","last_clean":"2024-04-16T19:38:17.931333+0000","last_became_active":"2024-04-16T17:45:45.461908+0000","last_became_peered":"2024-04-16T17:45:45.461908+0000","last_unstale":"2024-04-16T19:38:17.931333+0000","last_undegraded":"2024-04-16T19:38:17.931333+0000","last_fullsized":"2024-04-16T19:38:17.931333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.931272+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.931272+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:07.574424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":614,"num_read_kb":384,"num_write":60,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.639693+0000","last_change":"2024-04-16T19:39:12.639693+0000","last_active":"2024-04-16T19:39:12.639693+0000","last_peered":"2024-04-16T19:39:12.639693+0000","last_clean":"2024-04-16T19:39:12.639693+0000","last_became_active":"2024-04-16T17:45:10.393285+0000","last_became_peered":"2024-04-16T17:45:10.393285+0000","last_unstale":"2024-04-16T19:39:12.639693+0000","last_undegraded":"2024-04-16T19:39:12.639693+0000","last_fullsized":"2024-04-16T19:39:12.639693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.639597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.639597+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.639597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:27.660366+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.012558+0000","last_change":"2024-04-16T19:39:13.012581+0000","last_active":"2024-04-16T19:39:13.012558+0000","last_peered":"2024-04-16T19:39:13.012558+0000","last_clean":"2024-04-16T19:39:13.012558+0000","last_became_active":"2024-04-16T17:45:08.388473+0000","last_became_peered":"2024-04-16T17:45:08.388473+0000","last_unstale":"2024-04-16T19:39:13.012558+0000","last_undegraded":"2024-04-16T19:39:13.012558+0000","last_fullsized":"2024-04-16T19:39:13.012558+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.012487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.012487+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.012487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:43.037085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"53'10","reported_seq":526,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.171571+0000","last_change":"2024-04-16T19:38:35.171613+0000","last_active":"2024-04-16T19:38:35.171571+0000","last_peered":"2024-04-16T19:38:35.171571+0000","last_clean":"2024-04-16T19:38:35.171571+0000","last_became_active":"2024-04-16T17:45:45.456052+0000","last_became_peered":"2024-04-16T17:45:45.456052+0000","last_unstale":"2024-04-16T19:38:35.171571+0000","last_undegraded":"2024-04-16T19:38:35.171571+0000","last_fullsized":"2024-04-16T19:38:35.171571+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:35.171510+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.171510+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:54.116974+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1010,"num_read_kb":867,"num_write":60,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.596714+0000","last_change":"2024-04-16T19:39:13.596736+0000","last_active":"2024-04-16T19:39:13.596714+0000","last_peered":"2024-04-16T19:39:13.596714+0000","last_clean":"2024-04-16T19:39:13.596714+0000","last_became_active":"2024-04-16T17:45:10.391134+0000","last_became_peered":"2024-04-16T17:45:10.391134+0000","last_unstale":"2024-04-16T19:39:13.596714+0000","last_undegraded":"2024-04-16T19:39:13.596714+0000","last_fullsized":"2024-04-16T19:39:13.596714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.596651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.596651+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.596651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:19.806274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:35.565357+0000","last_change":"2024-04-16T19:39:35.565381+0000","last_active":"2024-04-16T19:39:35.565357+0000","last_peered":"2024-04-16T19:39:35.565357+0000","last_clean":"2024-04-16T19:39:35.565357+0000","last_became_active":"2024-04-16T17:45:08.385307+0000","last_became_peered":"2024-04-16T17:45:08.385307+0000","last_unstale":"2024-04-16T19:39:35.565357+0000","last_undegraded":"2024-04-16T19:39:35.565357+0000","last_fullsized":"2024-04-16T19:39:35.565357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:35.565286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:35.565286+0000","last_clean_scrub_stamp":"2024-04-16T19:39:35.565286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:15:14.977247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3e","version":"53'16","reported_seq":250,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.100685+0000","last_change":"2024-04-16T19:38:40.100742+0000","last_active":"2024-04-16T19:38:40.100685+0000","last_peered":"2024-04-16T19:38:40.100685+0000","last_clean":"2024-04-16T19:38:40.100685+0000","last_became_active":"2024-04-16T17:45:45.455126+0000","last_became_peered":"2024-04-16T17:45:45.455126+0000","last_unstale":"2024-04-16T19:38:40.100685+0000","last_undegraded":"2024-04-16T19:38:40.100685+0000","last_fullsized":"2024-04-16T19:38:40.100685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:40.100620+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.100620+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:48.497778+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":271,"num_read_kb":159,"num_write":85,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.069791+0000","last_change":"2024-04-16T19:39:08.069812+0000","last_active":"2024-04-16T19:39:08.069791+0000","last_peered":"2024-04-16T19:39:08.069791+0000","last_clean":"2024-04-16T19:39:08.069791+0000","last_became_active":"2024-04-16T17:45:10.391149+0000","last_became_peered":"2024-04-16T17:45:10.391149+0000","last_unstale":"2024-04-16T19:39:08.069791+0000","last_undegraded":"2024-04-16T19:39:08.069791+0000","last_fullsized":"2024-04-16T19:39:08.069791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.069729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.069729+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.069729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:28.539834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.133344+0000","last_change":"2024-04-16T19:39:13.133366+0000","last_active":"2024-04-16T19:39:13.133344+0000","last_peered":"2024-04-16T19:39:13.133344+0000","last_clean":"2024-04-16T19:39:13.133344+0000","last_became_active":"2024-04-16T17:45:08.382028+0000","last_became_peered":"2024-04-16T17:45:08.382028+0000","last_unstale":"2024-04-16T19:39:13.133344+0000","last_undegraded":"2024-04-16T19:39:13.133344+0000","last_fullsized":"2024-04-16T19:39:13.133344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.133280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.133280+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.133280+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:04.731516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.39","version":"53'9","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.926373+0000","last_change":"2024-04-16T19:38:21.926413+0000","last_active":"2024-04-16T19:38:21.926373+0000","last_peered":"2024-04-16T19:38:21.926373+0000","last_clean":"2024-04-16T19:38:21.926373+0000","last_became_active":"2024-04-16T17:45:45.460342+0000","last_became_peered":"2024-04-16T17:45:45.460342+0000","last_unstale":"2024-04-16T19:38:21.926373+0000","last_undegraded":"2024-04-16T19:38:21.926373+0000","last_fullsized":"2024-04-16T19:38:21.926373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'9","last_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_deep_scrub":"53'9","last_deep_scrub_stamp":"2024-04-16T19:38:21.926308+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.926308+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:34:31.946481+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":31,"num_write":35,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.088296+0000","last_change":"2024-04-16T19:39:06.088318+0000","last_active":"2024-04-16T19:39:06.088296+0000","last_peered":"2024-04-16T19:39:06.088296+0000","last_clean":"2024-04-16T19:39:06.088296+0000","last_became_active":"2024-04-16T17:45:10.393261+0000","last_became_peered":"2024-04-16T17:45:10.393261+0000","last_unstale":"2024-04-16T19:39:06.088296+0000","last_undegraded":"2024-04-16T19:39:06.088296+0000","last_fullsized":"2024-04-16T19:39:06.088296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.088233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.088233+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.088233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:24.886725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:29.381374+0000","last_change":"2024-04-16T19:39:29.381396+0000","last_active":"2024-04-16T19:39:29.381374+0000","last_peered":"2024-04-16T19:39:29.381374+0000","last_clean":"2024-04-16T19:39:29.381374+0000","last_became_active":"2024-04-16T17:45:08.386813+0000","last_became_peered":"2024-04-16T17:45:08.386813+0000","last_unstale":"2024-04-16T19:39:29.381374+0000","last_undegraded":"2024-04-16T19:39:29.381374+0000","last_fullsized":"2024-04-16T19:39:29.381374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:29.381304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:29.381304+0000","last_clean_scrub_stamp":"2024-04-16T19:39:29.381304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:54:11.851912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"53'2","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.013204+0000","last_change":"2024-04-16T19:38:42.013239+0000","last_active":"2024-04-16T19:38:42.013204+0000","last_peered":"2024-04-16T19:38:42.013204+0000","last_clean":"2024-04-16T19:38:42.013204+0000","last_became_active":"2024-04-16T17:45:45.454959+0000","last_became_peered":"2024-04-16T17:45:45.454959+0000","last_unstale":"2024-04-16T19:38:42.013204+0000","last_undegraded":"2024-04-16T19:38:42.013204+0000","last_fullsized":"2024-04-16T19:38:42.013204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:42.013138+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.013138+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:49.672770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":292,"num_read_kb":292,"num_write":15,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.158471+0000","last_change":"2024-04-16T19:39:01.158506+0000","last_active":"2024-04-16T19:39:01.158471+0000","last_peered":"2024-04-16T19:39:01.158471+0000","last_clean":"2024-04-16T19:39:01.158471+0000","last_became_active":"2024-04-16T17:45:10.397379+0000","last_became_peered":"2024-04-16T17:45:10.397379+0000","last_unstale":"2024-04-16T19:39:01.158471+0000","last_undegraded":"2024-04-16T19:39:01.158471+0000","last_fullsized":"2024-04-16T19:39:01.158471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:01.158405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:01.158405+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.158405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:52:24.103370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.091408+0000","last_change":"2024-04-16T19:38:24.091408+0000","last_active":"2024-04-16T19:38:24.091408+0000","last_peered":"2024-04-16T19:38:24.091408+0000","last_clean":"2024-04-16T19:38:24.091408+0000","last_became_active":"2024-04-16T17:46:16.498291+0000","last_became_peered":"2024-04-16T17:46:16.498291+0000","last_unstale":"2024-04-16T19:38:24.091408+0000","last_undegraded":"2024-04-16T19:38:24.091408+0000","last_fullsized":"2024-04-16T19:38:24.091408+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.091318+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.091318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:10:55.045299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:30.761053+0000","last_change":"2024-04-16T19:39:30.761075+0000","last_active":"2024-04-16T19:39:30.761053+0000","last_peered":"2024-04-16T19:39:30.761053+0000","last_clean":"2024-04-16T19:39:30.761053+0000","last_became_active":"2024-04-16T18:09:02.173650+0000","last_became_peered":"2024-04-16T18:09:02.173650+0000","last_unstale":"2024-04-16T19:39:30.761053+0000","last_undegraded":"2024-04-16T19:39:30.761053+0000","last_fullsized":"2024-04-16T19:39:30.761053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:30.760988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:30.760988+0000","last_clean_scrub_stamp":"2024-04-16T19:39:30.760988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:09:04.961417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1e","version":"53'197","reported_seq":2321,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.100302+0000","last_change":"2024-04-16T19:39:09.100331+0000","last_active":"2024-04-16T19:39:09.100302+0000","last_peered":"2024-04-16T19:39:09.100302+0000","last_clean":"2024-04-16T19:39:09.100302+0000","last_became_active":"2024-04-16T17:46:25.527427+0000","last_became_peered":"2024-04-16T17:46:25.527427+0000","last_unstale":"2024-04-16T19:39:09.100302+0000","last_undegraded":"2024-04-16T19:39:09.100302+0000","last_fullsized":"2024-04-16T19:39:09.100302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'197","last_scrub_stamp":"2024-04-16T19:39:09.100240+0000","last_deep_scrub":"53'197","last_deep_scrub_stamp":"2024-04-16T19:39:09.100240+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.100240+0000","objects_scrubbed":52,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:01.354932+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":3516,"num_read_kb":3470,"num_write":219,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14129,"num_omap_keys":57,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.886294+0000","last_change":"2024-04-16T19:38:40.886294+0000","last_active":"2024-04-16T19:38:40.886294+0000","last_peered":"2024-04-16T19:38:40.886294+0000","last_clean":"2024-04-16T19:38:40.886294+0000","last_became_active":"2024-04-16T17:46:17.511606+0000","last_became_peered":"2024-04-16T17:46:17.511606+0000","last_unstale":"2024-04-16T19:38:40.886294+0000","last_undegraded":"2024-04-16T19:38:40.886294+0000","last_fullsized":"2024-04-16T19:38:40.886294+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.886171+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.886171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:24.443007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1c","version":"53'26","reported_seq":172,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.349483+0000","last_change":"2024-04-16T19:38:36.349545+0000","last_active":"2024-04-16T19:38:36.349483+0000","last_peered":"2024-04-16T19:38:36.349483+0000","last_clean":"2024-04-16T19:38:36.349483+0000","last_became_active":"2024-04-16T17:45:51.478282+0000","last_became_peered":"2024-04-16T17:45:51.478282+0000","last_unstale":"2024-04-16T19:38:36.349483+0000","last_undegraded":"2024-04-16T19:38:36.349483+0000","last_fullsized":"2024-04-16T19:38:36.349483+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:36.349407+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.349407+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:33.328492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1762,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":213,"num_read_kb":164,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.556726+0000","last_change":"2024-04-16T19:38:18.556726+0000","last_active":"2024-04-16T19:38:18.556726+0000","last_peered":"2024-04-16T19:38:18.556726+0000","last_clean":"2024-04-16T19:38:18.556726+0000","last_became_active":"2024-04-16T17:45:49.472088+0000","last_became_peered":"2024-04-16T17:45:49.472088+0000","last_unstale":"2024-04-16T19:38:18.556726+0000","last_undegraded":"2024-04-16T19:38:18.556726+0000","last_fullsized":"2024-04-16T19:38:18.556726+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:18.556600+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.556600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:53.827149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'257","reported_seq":496,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.911983+0000","last_change":"2024-04-16T19:38:22.912055+0000","last_active":"2024-04-16T19:38:22.911983+0000","last_peered":"2024-04-16T19:38:22.911983+0000","last_clean":"2024-04-16T19:38:22.911983+0000","last_became_active":"2024-04-16T17:45:47.461971+0000","last_became_peered":"2024-04-16T17:45:47.461971+0000","last_unstale":"2024-04-16T19:38:22.911983+0000","last_undegraded":"2024-04-16T19:38:22.911983+0000","last_fullsized":"2024-04-16T19:38:22.911983+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'257","last_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_deep_scrub":"53'257","last_deep_scrub_stamp":"2024-04-16T19:38:22.911925+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.911925+0000","objects_scrubbed":14,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:02.872014+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":320,"num_read_kb":313,"num_write":379,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.19","version":"53'17","reported_seq":406,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.523960+0000","last_change":"2024-04-16T19:38:28.524008+0000","last_active":"2024-04-16T19:38:28.523960+0000","last_peered":"2024-04-16T19:38:28.523960+0000","last_clean":"2024-04-16T19:38:28.523960+0000","last_became_active":"2024-04-16T17:46:16.500171+0000","last_became_peered":"2024-04-16T17:46:16.500171+0000","last_unstale":"2024-04-16T19:38:28.523960+0000","last_undegraded":"2024-04-16T19:38:28.523960+0000","last_fullsized":"2024-04-16T19:38:28.523960+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'17","last_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_deep_scrub":"53'17","last_deep_scrub_stamp":"2024-04-16T19:38:28.523901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.523901+0000","objects_scrubbed":8,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:10.769673+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":854,"num_read_kb":559,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.339440+0000","last_change":"2024-04-16T19:38:43.339440+0000","last_active":"2024-04-16T19:38:43.339440+0000","last_peered":"2024-04-16T19:38:43.339440+0000","last_clean":"2024-04-16T19:38:43.339440+0000","last_became_active":"2024-04-16T17:45:26.430320+0000","last_became_peered":"2024-04-16T17:45:26.430320+0000","last_unstale":"2024-04-16T19:38:43.339440+0000","last_undegraded":"2024-04-16T19:38:43.339440+0000","last_fullsized":"2024-04-16T19:38:43.339440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.339355+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.339355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:45.853381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.714905+0000","last_change":"2024-04-16T19:39:02.714905+0000","last_active":"2024-04-16T19:39:02.714905+0000","last_peered":"2024-04-16T19:39:02.714905+0000","last_clean":"2024-04-16T19:39:02.714905+0000","last_became_active":"2024-04-16T17:45:10.400708+0000","last_became_peered":"2024-04-16T17:45:10.400708+0000","last_unstale":"2024-04-16T19:39:02.714905+0000","last_undegraded":"2024-04-16T19:39:02.714905+0000","last_fullsized":"2024-04-16T19:39:02.714905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.714774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.714774+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.714774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:38:56.806141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.019768+0000","last_change":"2024-04-16T19:39:12.019768+0000","last_active":"2024-04-16T19:39:12.019768+0000","last_peered":"2024-04-16T19:39:12.019768+0000","last_clean":"2024-04-16T19:39:12.019768+0000","last_became_active":"2024-04-16T17:45:08.387955+0000","last_became_peered":"2024-04-16T17:45:08.387955+0000","last_unstale":"2024-04-16T19:39:12.019768+0000","last_undegraded":"2024-04-16T19:39:12.019768+0000","last_fullsized":"2024-04-16T19:39:12.019768+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.019666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.019666+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.019666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:18.229289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:36.571135+0000","last_change":"2024-04-16T19:39:36.571158+0000","last_active":"2024-04-16T19:39:36.571135+0000","last_peered":"2024-04-16T19:39:36.571135+0000","last_clean":"2024-04-16T19:39:36.571135+0000","last_became_active":"2024-04-16T17:45:20.406738+0000","last_became_peered":"2024-04-16T17:45:20.406738+0000","last_unstale":"2024-04-16T19:39:36.571135+0000","last_undegraded":"2024-04-16T19:39:36.571135+0000","last_fullsized":"2024-04-16T19:39:36.571135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:36.571068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:36.571068+0000","last_clean_scrub_stamp":"2024-04-16T19:39:36.571068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:40:56.171751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.296192+0000","last_change":"2024-04-16T19:38:59.296192+0000","last_active":"2024-04-16T19:38:59.296192+0000","last_peered":"2024-04-16T19:38:59.296192+0000","last_clean":"2024-04-16T19:38:59.296192+0000","last_became_active":"2024-04-16T17:45:22.417015+0000","last_became_peered":"2024-04-16T17:45:22.417015+0000","last_unstale":"2024-04-16T19:38:59.296192+0000","last_undegraded":"2024-04-16T19:38:59.296192+0000","last_fullsized":"2024-04-16T19:38:59.296192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:59.296101+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:59.296101+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.296101+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.293277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.842212+0000","last_change":"2024-04-16T19:38:53.842212+0000","last_active":"2024-04-16T19:38:53.842212+0000","last_peered":"2024-04-16T19:38:53.842212+0000","last_clean":"2024-04-16T19:38:53.842212+0000","last_became_active":"2024-04-16T17:45:24.425302+0000","last_became_peered":"2024-04-16T17:45:24.425302+0000","last_unstale":"2024-04-16T19:38:53.842212+0000","last_undegraded":"2024-04-16T19:38:53.842212+0000","last_fullsized":"2024-04-16T19:38:53.842212+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.842112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.842112+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.842112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:19.599353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.191320+0000","last_change":"2024-04-16T19:39:24.191343+0000","last_active":"2024-04-16T19:39:24.191320+0000","last_peered":"2024-04-16T19:39:24.191320+0000","last_clean":"2024-04-16T19:39:24.191320+0000","last_became_active":"2024-04-16T18:09:02.170058+0000","last_became_peered":"2024-04-16T18:09:02.170058+0000","last_unstale":"2024-04-16T19:39:24.191320+0000","last_undegraded":"2024-04-16T19:39:24.191320+0000","last_fullsized":"2024-04-16T19:39:24.191320+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.191255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.191255+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.191255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:53.526700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"53'175","reported_seq":2039,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:39.614910+0000","last_change":"2024-04-16T19:39:39.614910+0000","last_active":"2024-04-16T19:39:39.614910+0000","last_peered":"2024-04-16T19:39:39.614910+0000","last_clean":"2024-04-16T19:39:39.614910+0000","last_became_active":"2024-04-16T17:47:16.563516+0000","last_became_peered":"2024-04-16T17:47:16.563516+0000","last_unstale":"2024-04-16T19:39:39.614910+0000","last_undegraded":"2024-04-16T19:39:39.614910+0000","last_fullsized":"2024-04-16T19:39:39.614910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'175","last_scrub_stamp":"2024-04-16T19:39:39.614794+0000","last_deep_scrub":"53'175","last_deep_scrub_stamp":"2024-04-16T19:39:39.614794+0000","last_clean_scrub_stamp":"2024-04-16T19:39:39.614794+0000","objects_scrubbed":41,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:37:21.012617+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3219,"num_read_kb":3174,"num_write":191,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8868,"num_omap_keys":38,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.784652+0000","last_change":"2024-04-16T19:38:42.784652+0000","last_active":"2024-04-16T19:38:42.784652+0000","last_peered":"2024-04-16T19:38:42.784652+0000","last_clean":"2024-04-16T19:38:42.784652+0000","last_became_active":"2024-04-16T17:46:17.506675+0000","last_became_peered":"2024-04-16T17:46:17.506675+0000","last_unstale":"2024-04-16T19:38:42.784652+0000","last_undegraded":"2024-04-16T19:38:42.784652+0000","last_fullsized":"2024-04-16T19:38:42.784652+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:42.784562+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.784562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:26.341398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"53'13","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.384096+0000","last_change":"2024-04-16T19:38:47.384137+0000","last_active":"2024-04-16T19:38:47.384096+0000","last_peered":"2024-04-16T19:38:47.384096+0000","last_clean":"2024-04-16T19:38:47.384096+0000","last_became_active":"2024-04-16T17:45:51.478360+0000","last_became_peered":"2024-04-16T17:45:51.478360+0000","last_unstale":"2024-04-16T19:38:47.384096+0000","last_undegraded":"2024-04-16T19:38:47.384096+0000","last_fullsized":"2024-04-16T19:38:47.384096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:47.384037+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.384037+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:21:55.261448+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":883,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.768005+0000","last_change":"2024-04-16T19:38:32.768029+0000","last_active":"2024-04-16T19:38:32.768005+0000","last_peered":"2024-04-16T19:38:32.768005+0000","last_clean":"2024-04-16T19:38:32.768005+0000","last_became_active":"2024-04-16T17:45:49.473040+0000","last_became_peered":"2024-04-16T17:45:49.473040+0000","last_unstale":"2024-04-16T19:38:32.768005+0000","last_undegraded":"2024-04-16T19:38:32.768005+0000","last_fullsized":"2024-04-16T19:38:32.768005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767943+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:38.784450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'204","reported_seq":483,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.084173+0000","last_change":"2024-04-16T19:38:12.084173+0000","last_active":"2024-04-16T19:38:12.084173+0000","last_peered":"2024-04-16T19:38:12.084173+0000","last_clean":"2024-04-16T19:38:12.084173+0000","last_became_active":"2024-04-16T17:45:47.463422+0000","last_became_peered":"2024-04-16T17:45:47.463422+0000","last_unstale":"2024-04-16T19:38:12.084173+0000","last_undegraded":"2024-04-16T19:38:12.084173+0000","last_fullsized":"2024-04-16T19:38:12.084173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'204","last_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_deep_scrub":"53'204","last_deep_scrub_stamp":"2024-04-16T19:38:12.084057+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.084057+0000","objects_scrubbed":15,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:47:16.400625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":499,"num_read_kb":348,"num_write":180,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6807,"num_omap_keys":31,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.18","version":"53'36","reported_seq":333,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.728115+0000","last_change":"2024-04-16T19:38:29.728115+0000","last_active":"2024-04-16T19:38:29.728115+0000","last_peered":"2024-04-16T19:38:29.728115+0000","last_clean":"2024-04-16T19:38:29.728115+0000","last_became_active":"2024-04-16T17:45:45.456589+0000","last_became_peered":"2024-04-16T17:45:45.456589+0000","last_unstale":"2024-04-16T19:38:29.728115+0000","last_undegraded":"2024-04-16T19:38:29.728115+0000","last_fullsized":"2024-04-16T19:38:29.728115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'36","last_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_deep_scrub":"53'36","last_deep_scrub_stamp":"2024-04-16T19:38:29.727997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.727997+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:35.149833+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5168,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":359,"num_write":182,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.754279+0000","last_change":"2024-04-16T19:38:31.754279+0000","last_active":"2024-04-16T19:38:31.754279+0000","last_peered":"2024-04-16T19:38:31.754279+0000","last_clean":"2024-04-16T19:38:31.754279+0000","last_became_active":"2024-04-16T17:45:26.439554+0000","last_became_peered":"2024-04-16T17:45:26.439554+0000","last_unstale":"2024-04-16T19:38:31.754279+0000","last_undegraded":"2024-04-16T19:38:31.754279+0000","last_fullsized":"2024-04-16T19:38:31.754279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.754160+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.754160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:49.288552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.541110+0000","last_change":"2024-04-16T19:39:16.541132+0000","last_active":"2024-04-16T19:39:16.541110+0000","last_peered":"2024-04-16T19:39:16.541110+0000","last_clean":"2024-04-16T19:39:16.541110+0000","last_became_active":"2024-04-16T17:45:10.394540+0000","last_became_peered":"2024-04-16T17:45:10.394540+0000","last_unstale":"2024-04-16T19:39:16.541110+0000","last_undegraded":"2024-04-16T19:39:16.541110+0000","last_fullsized":"2024-04-16T19:39:16.541110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.541045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.541045+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.541045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:12.769457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.318698+0000","last_change":"2024-04-16T19:39:23.318698+0000","last_active":"2024-04-16T19:39:23.318698+0000","last_peered":"2024-04-16T19:39:23.318698+0000","last_clean":"2024-04-16T19:39:23.318698+0000","last_became_active":"2024-04-16T17:45:08.390458+0000","last_became_peered":"2024-04-16T17:45:08.390458+0000","last_unstale":"2024-04-16T19:39:23.318698+0000","last_undegraded":"2024-04-16T19:39:23.318698+0000","last_fullsized":"2024-04-16T19:39:23.318698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.318576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.318576+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.318576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:42.354868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"53'20","reported_seq":906,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.425204+0000","last_change":"2024-04-16T19:39:09.425239+0000","last_active":"2024-04-16T19:39:09.425204+0000","last_peered":"2024-04-16T19:39:09.425204+0000","last_clean":"2024-04-16T19:39:09.425204+0000","last_became_active":"2024-04-16T17:45:20.413004+0000","last_became_peered":"2024-04-16T17:45:20.413004+0000","last_unstale":"2024-04-16T19:39:09.425204+0000","last_undegraded":"2024-04-16T19:39:09.425204+0000","last_fullsized":"2024-04-16T19:39:09.425204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:39:09.425136+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:39:09.425136+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.425136+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:06.827215+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2770,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":780,"num_read_kb":1085,"num_write":35,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"53'75","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.305931+0000","last_change":"2024-04-16T19:38:55.305931+0000","last_active":"2024-04-16T19:38:55.305931+0000","last_peered":"2024-04-16T19:38:55.305931+0000","last_clean":"2024-04-16T19:38:55.305931+0000","last_became_active":"2024-04-16T17:45:22.414497+0000","last_became_peered":"2024-04-16T17:45:22.414497+0000","last_unstale":"2024-04-16T19:38:55.305931+0000","last_undegraded":"2024-04-16T19:38:55.305931+0000","last_fullsized":"2024-04-16T19:38:55.305931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'75","last_scrub_stamp":"2024-04-16T19:38:55.305805+0000","last_deep_scrub":"53'75","last_deep_scrub_stamp":"2024-04-16T19:38:55.305805+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.305805+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:39.277904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":105,"num_write":72,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.393508+0000","last_change":"2024-04-16T19:38:49.393508+0000","last_active":"2024-04-16T19:38:49.393508+0000","last_peered":"2024-04-16T19:38:49.393508+0000","last_clean":"2024-04-16T19:38:49.393508+0000","last_became_active":"2024-04-16T17:45:24.423348+0000","last_became_peered":"2024-04-16T17:45:24.423348+0000","last_unstale":"2024-04-16T19:38:49.393508+0000","last_undegraded":"2024-04-16T19:38:49.393508+0000","last_fullsized":"2024-04-16T19:38:49.393508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.393417+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.393417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:44.040909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.009774+0000","last_change":"2024-04-16T19:39:23.009797+0000","last_active":"2024-04-16T19:39:23.009774+0000","last_peered":"2024-04-16T19:39:23.009774+0000","last_clean":"2024-04-16T19:39:23.009774+0000","last_became_active":"2024-04-16T18:09:02.164377+0000","last_became_peered":"2024-04-16T18:09:02.164377+0000","last_unstale":"2024-04-16T19:39:23.009774+0000","last_undegraded":"2024-04-16T19:39:23.009774+0000","last_fullsized":"2024-04-16T19:39:23.009774+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.009709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.009709+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.009709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:55:02.789696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"53'274","reported_seq":2177,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.356383+0000","last_change":"2024-04-16T19:38:56.356383+0000","last_active":"2024-04-16T19:38:56.356383+0000","last_peered":"2024-04-16T19:38:56.356383+0000","last_clean":"2024-04-16T19:38:56.356383+0000","last_became_active":"2024-04-16T17:46:25.525509+0000","last_became_peered":"2024-04-16T17:46:25.525509+0000","last_unstale":"2024-04-16T19:38:56.356383+0000","last_undegraded":"2024-04-16T19:38:56.356383+0000","last_fullsized":"2024-04-16T19:38:56.356383+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'274","last_scrub_stamp":"2024-04-16T19:38:56.356276+0000","last_deep_scrub":"53'274","last_deep_scrub_stamp":"2024-04-16T19:38:56.356276+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.356276+0000","objects_scrubbed":46,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:42:56.666380+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3559,"num_read_kb":3852,"num_write":412,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22911,"num_omap_keys":91,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.547577+0000","last_change":"2024-04-16T19:38:25.547577+0000","last_active":"2024-04-16T19:38:25.547577+0000","last_peered":"2024-04-16T19:38:25.547577+0000","last_clean":"2024-04-16T19:38:25.547577+0000","last_became_active":"2024-04-16T17:46:17.505791+0000","last_became_peered":"2024-04-16T17:46:17.505791+0000","last_unstale":"2024-04-16T19:38:25.547577+0000","last_undegraded":"2024-04-16T19:38:25.547577+0000","last_fullsized":"2024-04-16T19:38:25.547577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.547478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.547478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:51.243189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1e","version":"53'10","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.429116+0000","last_change":"2024-04-16T19:38:31.429149+0000","last_active":"2024-04-16T19:38:31.429116+0000","last_peered":"2024-04-16T19:38:31.429116+0000","last_clean":"2024-04-16T19:38:31.429116+0000","last_became_active":"2024-04-16T17:45:51.480262+0000","last_became_peered":"2024-04-16T17:45:51.480262+0000","last_unstale":"2024-04-16T19:38:31.429116+0000","last_undegraded":"2024-04-16T19:38:31.429116+0000","last_fullsized":"2024-04-16T19:38:31.429116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:31.429051+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.429051+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:33.962416+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":715,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":54,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.354840+0000","last_change":"2024-04-16T19:38:30.354840+0000","last_active":"2024-04-16T19:38:30.354840+0000","last_peered":"2024-04-16T19:38:30.354840+0000","last_clean":"2024-04-16T19:38:30.354840+0000","last_became_active":"2024-04-16T17:45:49.476150+0000","last_became_peered":"2024-04-16T17:45:49.476150+0000","last_unstale":"2024-04-16T19:38:30.354840+0000","last_undegraded":"2024-04-16T19:38:30.354840+0000","last_fullsized":"2024-04-16T19:38:30.354840+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.354716+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.354716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:36.984858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"53'283","reported_seq":613,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.068719+0000","last_change":"2024-04-16T19:38:14.068719+0000","last_active":"2024-04-16T19:38:14.068719+0000","last_peered":"2024-04-16T19:38:14.068719+0000","last_clean":"2024-04-16T19:38:14.068719+0000","last_became_active":"2024-04-16T17:45:47.457805+0000","last_became_peered":"2024-04-16T17:45:47.457805+0000","last_unstale":"2024-04-16T19:38:14.068719+0000","last_undegraded":"2024-04-16T19:38:14.068719+0000","last_fullsized":"2024-04-16T19:38:14.068719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'283","last_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_deep_scrub":"53'283","last_deep_scrub_stamp":"2024-04-16T19:38:14.068569+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.068569+0000","objects_scrubbed":17,"log_size":283,"log_dups_size":0,"ondisk_log_size":283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:46:04.644251+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":606,"num_read_kb":456,"num_write":281,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"53'16","reported_seq":202,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.254163+0000","last_change":"2024-04-16T19:38:18.254163+0000","last_active":"2024-04-16T19:38:18.254163+0000","last_peered":"2024-04-16T19:38:18.254163+0000","last_clean":"2024-04-16T19:38:18.254163+0000","last_became_active":"2024-04-16T17:45:45.463052+0000","last_became_peered":"2024-04-16T17:45:45.463052+0000","last_unstale":"2024-04-16T19:38:18.254163+0000","last_undegraded":"2024-04-16T19:38:18.254163+0000","last_fullsized":"2024-04-16T19:38:18.254163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:18.254059+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.254059+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:50:53.228339+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":190,"num_read_kb":112,"num_write":81,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.371589+0000","last_change":"2024-04-16T19:38:29.371613+0000","last_active":"2024-04-16T19:38:29.371589+0000","last_peered":"2024-04-16T19:38:29.371589+0000","last_clean":"2024-04-16T19:38:29.371589+0000","last_became_active":"2024-04-16T17:45:26.438327+0000","last_became_peered":"2024-04-16T17:45:26.438327+0000","last_unstale":"2024-04-16T19:38:29.371589+0000","last_undegraded":"2024-04-16T19:38:29.371589+0000","last_fullsized":"2024-04-16T19:38:29.371589+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.371523+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.371523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:16.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.377682+0000","last_change":"2024-04-16T19:39:18.377703+0000","last_active":"2024-04-16T19:39:18.377682+0000","last_peered":"2024-04-16T19:39:18.377682+0000","last_clean":"2024-04-16T19:39:18.377682+0000","last_became_active":"2024-04-16T17:45:10.398015+0000","last_became_peered":"2024-04-16T17:45:10.398015+0000","last_unstale":"2024-04-16T19:39:18.377682+0000","last_undegraded":"2024-04-16T19:39:18.377682+0000","last_fullsized":"2024-04-16T19:39:18.377682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.377616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.377616+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.377616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:38:43.657369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:33.048031+0000","last_change":"2024-04-16T19:39:33.048054+0000","last_active":"2024-04-16T19:39:33.048031+0000","last_peered":"2024-04-16T19:39:33.048031+0000","last_clean":"2024-04-16T19:39:33.048031+0000","last_became_active":"2024-04-16T17:45:08.382382+0000","last_became_peered":"2024-04-16T17:45:08.382382+0000","last_unstale":"2024-04-16T19:39:33.048031+0000","last_undegraded":"2024-04-16T19:39:33.048031+0000","last_fullsized":"2024-04-16T19:39:33.048031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:33.047964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:33.047964+0000","last_clean_scrub_stamp":"2024-04-16T19:39:33.047964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:33:51.154857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":126,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.983783+0000","last_change":"2024-04-16T19:38:56.983783+0000","last_active":"2024-04-16T19:38:56.983783+0000","last_peered":"2024-04-16T19:38:56.983783+0000","last_clean":"2024-04-16T19:38:56.983783+0000","last_became_active":"2024-04-16T17:45:20.405842+0000","last_became_peered":"2024-04-16T17:45:20.405842+0000","last_unstale":"2024-04-16T19:38:56.983783+0000","last_undegraded":"2024-04-16T19:38:56.983783+0000","last_fullsized":"2024-04-16T19:38:56.983783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.983691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.983691+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.983691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:51.631183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"53'125","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.003707+0000","last_change":"2024-04-16T19:38:51.003739+0000","last_active":"2024-04-16T19:38:51.003707+0000","last_peered":"2024-04-16T19:38:51.003707+0000","last_clean":"2024-04-16T19:38:51.003707+0000","last_became_active":"2024-04-16T17:45:22.421145+0000","last_became_peered":"2024-04-16T17:45:22.421145+0000","last_unstale":"2024-04-16T19:38:51.003707+0000","last_undegraded":"2024-04-16T19:38:51.003707+0000","last_fullsized":"2024-04-16T19:38:51.003707+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:51.003645+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:51.003645+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.003645+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:53.517671+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"53'13","reported_seq":1398,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.999553+0000","last_change":"2024-04-16T19:38:51.999553+0000","last_active":"2024-04-16T19:38:51.999553+0000","last_peered":"2024-04-16T19:38:51.999553+0000","last_clean":"2024-04-16T19:38:51.999553+0000","last_became_active":"2024-04-16T17:45:24.425316+0000","last_became_peered":"2024-04-16T17:45:24.425316+0000","last_unstale":"2024-04-16T19:38:51.999553+0000","last_undegraded":"2024-04-16T19:38:51.999553+0000","last_fullsized":"2024-04-16T19:38:51.999553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.999449+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.999449+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.999449+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:17.756690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.802274+0000","last_change":"2024-04-16T19:39:28.802297+0000","last_active":"2024-04-16T19:39:28.802274+0000","last_peered":"2024-04-16T19:39:28.802274+0000","last_clean":"2024-04-16T19:39:28.802274+0000","last_became_active":"2024-04-16T18:09:02.169234+0000","last_became_peered":"2024-04-16T18:09:02.169234+0000","last_unstale":"2024-04-16T19:39:28.802274+0000","last_undegraded":"2024-04-16T19:39:28.802274+0000","last_fullsized":"2024-04-16T19:39:28.802274+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.802208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.802208+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.802208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:14.856739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"53'197","reported_seq":2351,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.427761+0000","last_change":"2024-04-16T19:39:08.427809+0000","last_active":"2024-04-16T19:39:08.427761+0000","last_peered":"2024-04-16T19:39:08.427761+0000","last_clean":"2024-04-16T19:39:08.427761+0000","last_became_active":"2024-04-16T17:46:25.528991+0000","last_became_peered":"2024-04-16T17:46:25.528991+0000","last_unstale":"2024-04-16T19:39:08.427761+0000","last_undegraded":"2024-04-16T19:39:08.427761+0000","last_fullsized":"2024-04-16T19:39:08.427761+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'197","last_scrub_stamp":"2024-04-16T19:39:08.427700+0000","last_deep_scrub":"53'197","last_deep_scrub_stamp":"2024-04-16T19:39:08.427700+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.427700+0000","objects_scrubbed":46,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:05.519695+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3597,"num_read_kb":3624,"num_write":221,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11005,"num_omap_keys":44,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.358729+0000","last_change":"2024-04-16T19:38:38.358729+0000","last_active":"2024-04-16T19:38:38.358729+0000","last_peered":"2024-04-16T19:38:38.358729+0000","last_clean":"2024-04-16T19:38:38.358729+0000","last_became_active":"2024-04-16T17:46:17.509318+0000","last_became_peered":"2024-04-16T17:46:17.509318+0000","last_unstale":"2024-04-16T19:38:38.358729+0000","last_undegraded":"2024-04-16T19:38:38.358729+0000","last_fullsized":"2024-04-16T19:38:38.358729+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.358644+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.358644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:36:18.318732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"53'13","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.916490+0000","last_change":"2024-04-16T19:38:46.916547+0000","last_active":"2024-04-16T19:38:46.916490+0000","last_peered":"2024-04-16T19:38:46.916490+0000","last_clean":"2024-04-16T19:38:46.916490+0000","last_became_active":"2024-04-16T17:45:51.478396+0000","last_became_peered":"2024-04-16T17:45:51.478396+0000","last_unstale":"2024-04-16T19:38:46.916490+0000","last_undegraded":"2024-04-16T19:38:46.916490+0000","last_fullsized":"2024-04-16T19:38:46.916490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:46.916403+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.916403+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:16.453973+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1078,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.107389+0000","last_change":"2024-04-16T19:38:09.107389+0000","last_active":"2024-04-16T19:38:09.107389+0000","last_peered":"2024-04-16T19:38:09.107389+0000","last_clean":"2024-04-16T19:38:09.107389+0000","last_became_active":"2024-04-16T17:45:49.463397+0000","last_became_peered":"2024-04-16T17:45:49.463397+0000","last_unstale":"2024-04-16T19:38:09.107389+0000","last_undegraded":"2024-04-16T19:38:09.107389+0000","last_fullsized":"2024-04-16T19:38:09.107389+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:09.107315+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.107315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:36:06.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"53'5992","reported_seq":12559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.824617+0000","last_change":"2024-04-16T19:38:12.824617+0000","last_active":"2024-04-16T19:38:12.824617+0000","last_peered":"2024-04-16T19:38:12.824617+0000","last_clean":"2024-04-16T19:38:12.824617+0000","last_became_active":"2024-04-16T17:45:47.459580+0000","last_became_peered":"2024-04-16T17:45:47.459580+0000","last_unstale":"2024-04-16T19:38:12.824617+0000","last_undegraded":"2024-04-16T19:38:12.824617+0000","last_fullsized":"2024-04-16T19:38:12.824617+0000","mapping_epoch":33,"log_start":"53'4200","ondisk_log_start":"53'4200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5992","last_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_deep_scrub":"53'5992","last_deep_scrub_stamp":"2024-04-16T19:38:12.824529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.824529+0000","objects_scrubbed":27,"log_size":1792,"log_dups_size":3000,"ondisk_log_size":1792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:47.168687+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":14590,"num_read_kb":14623,"num_write":6352,"num_write_kb":531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":79208,"num_omap_keys":410,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"53'16","reported_seq":585,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.740826+0000","last_change":"2024-04-16T19:38:21.740887+0000","last_active":"2024-04-16T19:38:21.740826+0000","last_peered":"2024-04-16T19:38:21.740826+0000","last_clean":"2024-04-16T19:38:21.740826+0000","last_became_active":"2024-04-16T17:45:45.457607+0000","last_became_peered":"2024-04-16T17:45:45.457607+0000","last_unstale":"2024-04-16T19:38:21.740826+0000","last_undegraded":"2024-04-16T19:38:21.740826+0000","last_fullsized":"2024-04-16T19:38:21.740826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:21.740747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.740747+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:07.774419+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1161,"num_read_kb":944,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.344166+0000","last_change":"2024-04-16T19:38:40.344189+0000","last_active":"2024-04-16T19:38:40.344166+0000","last_peered":"2024-04-16T19:38:40.344166+0000","last_clean":"2024-04-16T19:38:40.344166+0000","last_became_active":"2024-04-16T17:45:26.848541+0000","last_became_peered":"2024-04-16T17:45:26.848541+0000","last_unstale":"2024-04-16T19:38:40.344166+0000","last_undegraded":"2024-04-16T19:38:40.344166+0000","last_fullsized":"2024-04-16T19:38:40.344166+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.344095+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.344095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:37.023758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.400553+0000","last_change":"2024-04-16T19:39:17.400577+0000","last_active":"2024-04-16T19:39:17.400553+0000","last_peered":"2024-04-16T19:39:17.400553+0000","last_clean":"2024-04-16T19:39:17.400553+0000","last_became_active":"2024-04-16T17:45:10.391488+0000","last_became_peered":"2024-04-16T17:45:10.391488+0000","last_unstale":"2024-04-16T19:39:17.400553+0000","last_undegraded":"2024-04-16T19:39:17.400553+0000","last_fullsized":"2024-04-16T19:39:17.400553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.400488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.400488+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.400488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:09.353711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.572607+0000","last_change":"2024-04-16T19:39:23.572607+0000","last_active":"2024-04-16T19:39:23.572607+0000","last_peered":"2024-04-16T19:39:23.572607+0000","last_clean":"2024-04-16T19:39:23.572607+0000","last_became_active":"2024-04-16T17:45:08.386895+0000","last_became_peered":"2024-04-16T17:45:08.386895+0000","last_unstale":"2024-04-16T19:39:23.572607+0000","last_undegraded":"2024-04-16T19:39:23.572607+0000","last_fullsized":"2024-04-16T19:39:23.572607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.572519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.572519+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.572519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:01.881722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"53'2","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.013986+0000","last_change":"2024-04-16T19:39:07.014015+0000","last_active":"2024-04-16T19:39:07.013986+0000","last_peered":"2024-04-16T19:39:07.013986+0000","last_clean":"2024-04-16T19:39:07.013986+0000","last_became_active":"2024-04-16T17:45:20.404381+0000","last_became_peered":"2024-04-16T17:45:20.404381+0000","last_unstale":"2024-04-16T19:39:07.013986+0000","last_undegraded":"2024-04-16T19:39:07.013986+0000","last_fullsized":"2024-04-16T19:39:07.013986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:07.013923+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:07.013923+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.013923+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:46.793909+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1366,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.981271+0000","last_change":"2024-04-16T19:38:54.981271+0000","last_active":"2024-04-16T19:38:54.981271+0000","last_peered":"2024-04-16T19:38:54.981271+0000","last_clean":"2024-04-16T19:38:54.981271+0000","last_became_active":"2024-04-16T17:45:22.421150+0000","last_became_peered":"2024-04-16T17:45:22.421150+0000","last_unstale":"2024-04-16T19:38:54.981271+0000","last_undegraded":"2024-04-16T19:38:54.981271+0000","last_fullsized":"2024-04-16T19:38:54.981271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:54.981167+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:54.981167+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.981167+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:57.572002+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.14","version":"53'13","reported_seq":1399,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.649014+0000","last_change":"2024-04-16T19:38:51.649037+0000","last_active":"2024-04-16T19:38:51.649014+0000","last_peered":"2024-04-16T19:38:51.649014+0000","last_clean":"2024-04-16T19:38:51.649014+0000","last_became_active":"2024-04-16T17:45:24.423757+0000","last_became_peered":"2024-04-16T17:45:24.423757+0000","last_unstale":"2024-04-16T19:38:51.649014+0000","last_undegraded":"2024-04-16T19:38:51.649014+0000","last_fullsized":"2024-04-16T19:38:51.649014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.648964+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.648964+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.648964+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:30.770870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.040929+0000","last_change":"2024-04-16T19:39:25.040964+0000","last_active":"2024-04-16T19:39:25.040929+0000","last_peered":"2024-04-16T19:39:25.040929+0000","last_clean":"2024-04-16T19:39:25.040929+0000","last_became_active":"2024-04-16T18:09:02.167847+0000","last_became_peered":"2024-04-16T18:09:02.167847+0000","last_unstale":"2024-04-16T19:39:25.040929+0000","last_undegraded":"2024-04-16T19:39:25.040929+0000","last_fullsized":"2024-04-16T19:39:25.040929+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.040864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.040864+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.040864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:17.295556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"53'173","reported_seq":2192,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:37.150549+0000","last_change":"2024-04-16T19:39:37.150594+0000","last_active":"2024-04-16T19:39:37.150549+0000","last_peered":"2024-04-16T19:39:37.150549+0000","last_clean":"2024-04-16T19:39:37.150549+0000","last_became_active":"2024-04-16T17:46:25.527707+0000","last_became_peered":"2024-04-16T17:46:25.527707+0000","last_unstale":"2024-04-16T19:39:37.150549+0000","last_undegraded":"2024-04-16T19:39:37.150549+0000","last_fullsized":"2024-04-16T19:39:37.150549+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'173","last_scrub_stamp":"2024-04-16T19:39:37.150478+0000","last_deep_scrub":"53'173","last_deep_scrub_stamp":"2024-04-16T19:39:37.150478+0000","last_clean_scrub_stamp":"2024-04-16T19:39:37.150478+0000","objects_scrubbed":41,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:41:11.574309+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":3191,"num_read_kb":3599,"num_write":192,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9794,"num_omap_keys":40,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.860257+0000","last_change":"2024-04-16T19:38:38.860257+0000","last_active":"2024-04-16T19:38:38.860257+0000","last_peered":"2024-04-16T19:38:38.860257+0000","last_clean":"2024-04-16T19:38:38.860257+0000","last_became_active":"2024-04-16T17:46:17.508632+0000","last_became_peered":"2024-04-16T17:46:17.508632+0000","last_unstale":"2024-04-16T19:38:38.860257+0000","last_undegraded":"2024-04-16T19:38:38.860257+0000","last_fullsized":"2024-04-16T19:38:38.860257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.860170+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.860170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:59.006022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"53'13","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.413937+0000","last_change":"2024-04-16T19:38:33.413987+0000","last_active":"2024-04-16T19:38:33.413937+0000","last_peered":"2024-04-16T19:38:33.413937+0000","last_clean":"2024-04-16T19:38:33.413937+0000","last_became_active":"2024-04-16T17:45:51.478388+0000","last_became_peered":"2024-04-16T17:45:51.478388+0000","last_unstale":"2024-04-16T19:38:33.413937+0000","last_undegraded":"2024-04-16T19:38:33.413937+0000","last_fullsized":"2024-04-16T19:38:33.413937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:33.413861+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.413861+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:52.042937+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.739844+0000","last_change":"2024-04-16T19:38:22.739844+0000","last_active":"2024-04-16T19:38:22.739844+0000","last_peered":"2024-04-16T19:38:22.739844+0000","last_clean":"2024-04-16T19:38:22.739844+0000","last_became_active":"2024-04-16T17:45:49.468976+0000","last_became_peered":"2024-04-16T17:45:49.468976+0000","last_unstale":"2024-04-16T19:38:22.739844+0000","last_undegraded":"2024-04-16T19:38:22.739844+0000","last_fullsized":"2024-04-16T19:38:22.739844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.739758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.739758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:59.491263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"53'1601","reported_seq":47000,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.864758+0000","last_change":"2024-04-16T19:38:18.864758+0000","last_active":"2024-04-16T19:38:18.864758+0000","last_peered":"2024-04-16T19:38:18.864758+0000","last_clean":"2024-04-16T19:38:18.864758+0000","last_became_active":"2024-04-16T17:45:47.466282+0000","last_became_peered":"2024-04-16T17:45:47.466282+0000","last_unstale":"2024-04-16T19:38:18.864758+0000","last_undegraded":"2024-04-16T19:38:18.864758+0000","last_fullsized":"2024-04-16T19:38:18.864758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'1601","last_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_deep_scrub":"53'1601","last_deep_scrub_stamp":"2024-04-16T19:38:18.864667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.864667+0000","objects_scrubbed":26,"log_size":1601,"log_dups_size":0,"ondisk_log_size":1601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:06.203531+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":136809,"num_read_kb":91886,"num_write":1937,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14964,"num_omap_keys":68,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"53'12","reported_seq":237,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.220904+0000","last_change":"2024-04-16T19:38:11.220904+0000","last_active":"2024-04-16T19:38:11.220904+0000","last_peered":"2024-04-16T19:38:11.220904+0000","last_clean":"2024-04-16T19:38:11.220904+0000","last_became_active":"2024-04-16T17:45:45.465917+0000","last_became_peered":"2024-04-16T17:45:45.465917+0000","last_unstale":"2024-04-16T19:38:11.220904+0000","last_undegraded":"2024-04-16T19:38:11.220904+0000","last_fullsized":"2024-04-16T19:38:11.220904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:11.220802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.220802+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:19.617959+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":262,"num_read_kb":172,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.990880+0000","last_change":"2024-04-16T19:39:24.990904+0000","last_active":"2024-04-16T19:39:24.990880+0000","last_peered":"2024-04-16T19:39:24.990880+0000","last_clean":"2024-04-16T19:39:24.990880+0000","last_became_active":"2024-04-16T17:45:10.392798+0000","last_became_peered":"2024-04-16T17:45:10.392798+0000","last_unstale":"2024-04-16T19:39:24.990880+0000","last_undegraded":"2024-04-16T19:39:24.990880+0000","last_fullsized":"2024-04-16T19:39:24.990880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.990814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.990814+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.990814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:02.378341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.548647+0000","last_change":"2024-04-16T19:39:15.548668+0000","last_active":"2024-04-16T19:39:15.548647+0000","last_peered":"2024-04-16T19:39:15.548647+0000","last_clean":"2024-04-16T19:39:15.548647+0000","last_became_active":"2024-04-16T17:45:08.389421+0000","last_became_peered":"2024-04-16T17:45:08.389421+0000","last_unstale":"2024-04-16T19:39:15.548647+0000","last_undegraded":"2024-04-16T19:39:15.548647+0000","last_fullsized":"2024-04-16T19:39:15.548647+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.548581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.548581+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.548581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:12.640576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"53'7","reported_seq":239,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.642517+0000","last_change":"2024-04-16T19:39:11.642568+0000","last_active":"2024-04-16T19:39:11.642517+0000","last_peered":"2024-04-16T19:39:11.642517+0000","last_clean":"2024-04-16T19:39:11.642517+0000","last_became_active":"2024-04-16T17:45:20.407109+0000","last_became_peered":"2024-04-16T17:45:20.407109+0000","last_unstale":"2024-04-16T19:39:11.642517+0000","last_undegraded":"2024-04-16T19:39:11.642517+0000","last_fullsized":"2024-04-16T19:39:11.642517+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:39:11.642432+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:39:11.642432+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.642432+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:25.286452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2754,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":202,"num_write":9,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"53'209","reported_seq":441,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.728984+0000","last_change":"2024-04-16T19:38:57.729048+0000","last_active":"2024-04-16T19:38:57.728984+0000","last_peered":"2024-04-16T19:38:57.728984+0000","last_clean":"2024-04-16T19:38:57.728984+0000","last_became_active":"2024-04-16T17:45:22.417138+0000","last_became_peered":"2024-04-16T17:45:22.417138+0000","last_unstale":"2024-04-16T19:38:57.728984+0000","last_undegraded":"2024-04-16T19:38:57.728984+0000","last_fullsized":"2024-04-16T19:38:57.728984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'209","last_scrub_stamp":"2024-04-16T19:38:57.728909+0000","last_deep_scrub":"53'209","last_deep_scrub_stamp":"2024-04-16T19:38:57.728909+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.728909+0000","objects_scrubbed":9,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:54.778754+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":305,"num_read_kb":294,"num_write":200,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.730542+0000","last_change":"2024-04-16T19:38:45.730564+0000","last_active":"2024-04-16T19:38:45.730542+0000","last_peered":"2024-04-16T19:38:45.730542+0000","last_clean":"2024-04-16T19:38:45.730542+0000","last_became_active":"2024-04-16T17:45:24.430370+0000","last_became_peered":"2024-04-16T17:45:24.430370+0000","last_unstale":"2024-04-16T19:38:45.730542+0000","last_undegraded":"2024-04-16T19:38:45.730542+0000","last_fullsized":"2024-04-16T19:38:45.730542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.730467+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.730467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:04.477302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.807488+0000","last_change":"2024-04-16T19:38:36.807512+0000","last_active":"2024-04-16T19:38:36.807488+0000","last_peered":"2024-04-16T19:38:36.807488+0000","last_clean":"2024-04-16T19:38:36.807488+0000","last_became_active":"2024-04-16T17:45:26.438674+0000","last_became_peered":"2024-04-16T17:45:26.438674+0000","last_unstale":"2024-04-16T19:38:36.807488+0000","last_undegraded":"2024-04-16T19:38:36.807488+0000","last_fullsized":"2024-04-16T19:38:36.807488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.807410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.807410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:17:01.775567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.167577+0000","last_change":"2024-04-16T19:39:22.167600+0000","last_active":"2024-04-16T19:39:22.167577+0000","last_peered":"2024-04-16T19:39:22.167577+0000","last_clean":"2024-04-16T19:39:22.167577+0000","last_became_active":"2024-04-16T18:09:02.169267+0000","last_became_peered":"2024-04-16T18:09:02.169267+0000","last_unstale":"2024-04-16T19:39:22.167577+0000","last_undegraded":"2024-04-16T19:39:22.167577+0000","last_fullsized":"2024-04-16T19:39:22.167577+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.167514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.167514+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.167514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:58.434341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"53'181","reported_seq":1525,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:36.520383+0000","last_change":"2024-04-16T19:39:36.520463+0000","last_active":"2024-04-16T19:39:36.520383+0000","last_peered":"2024-04-16T19:39:36.520383+0000","last_clean":"2024-04-16T19:39:36.520383+0000","last_became_active":"2024-04-16T17:46:25.530976+0000","last_became_peered":"2024-04-16T17:46:25.530976+0000","last_unstale":"2024-04-16T19:39:36.520383+0000","last_undegraded":"2024-04-16T19:39:36.520383+0000","last_fullsized":"2024-04-16T19:39:36.520383+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'181","last_scrub_stamp":"2024-04-16T19:39:36.520310+0000","last_deep_scrub":"53'181","last_deep_scrub_stamp":"2024-04-16T19:39:36.520310+0000","last_clean_scrub_stamp":"2024-04-16T19:39:36.520310+0000","objects_scrubbed":42,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:47:40.689271+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2261,"num_read_kb":2204,"num_write":239,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11682,"num_omap_keys":49,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.929722+0000","last_change":"2024-04-16T19:38:48.929745+0000","last_active":"2024-04-16T19:38:48.929722+0000","last_peered":"2024-04-16T19:38:48.929722+0000","last_clean":"2024-04-16T19:38:48.929722+0000","last_became_active":"2024-04-16T17:46:17.509716+0000","last_became_peered":"2024-04-16T17:46:17.509716+0000","last_unstale":"2024-04-16T19:38:48.929722+0000","last_undegraded":"2024-04-16T19:38:48.929722+0000","last_fullsized":"2024-04-16T19:38:48.929722+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.929661+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.929661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:58.580340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1","version":"53'6","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.954955+0000","last_change":"2024-04-16T19:38:42.954988+0000","last_active":"2024-04-16T19:38:42.954955+0000","last_peered":"2024-04-16T19:38:42.954955+0000","last_clean":"2024-04-16T19:38:42.954955+0000","last_became_active":"2024-04-16T17:45:51.480597+0000","last_became_peered":"2024-04-16T17:45:51.480597+0000","last_unstale":"2024-04-16T19:38:42.954955+0000","last_undegraded":"2024-04-16T19:38:42.954955+0000","last_fullsized":"2024-04-16T19:38:42.954955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:42.954892+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.954892+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:01.753384+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.345083+0000","last_change":"2024-04-16T19:38:28.345083+0000","last_active":"2024-04-16T19:38:28.345083+0000","last_peered":"2024-04-16T19:38:28.345083+0000","last_clean":"2024-04-16T19:38:28.345083+0000","last_became_active":"2024-04-16T17:45:49.472875+0000","last_became_peered":"2024-04-16T17:45:49.472875+0000","last_unstale":"2024-04-16T19:38:28.345083+0000","last_undegraded":"2024-04-16T19:38:28.345083+0000","last_fullsized":"2024-04-16T19:38:28.345083+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.344996+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.344996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:22.992488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'355","reported_seq":664,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.869936+0000","last_change":"2024-04-16T19:38:12.869936+0000","last_active":"2024-04-16T19:38:12.869936+0000","last_peered":"2024-04-16T19:38:12.869936+0000","last_clean":"2024-04-16T19:38:12.869936+0000","last_became_active":"2024-04-16T17:45:47.457944+0000","last_became_peered":"2024-04-16T17:45:47.457944+0000","last_unstale":"2024-04-16T19:38:12.869936+0000","last_undegraded":"2024-04-16T19:38:12.869936+0000","last_fullsized":"2024-04-16T19:38:12.869936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'355","last_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_deep_scrub":"53'355","last_deep_scrub_stamp":"2024-04-16T19:38:12.869802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.869802+0000","objects_scrubbed":17,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:21.665637+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":457,"num_read_kb":446,"num_write":502,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21527,"num_omap_keys":98,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"53'19","reported_seq":604,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.829535+0000","last_change":"2024-04-16T19:38:08.829535+0000","last_active":"2024-04-16T19:38:08.829535+0000","last_peered":"2024-04-16T19:38:08.829535+0000","last_clean":"2024-04-16T19:38:08.829535+0000","last_became_active":"2024-04-16T17:45:45.465903+0000","last_became_peered":"2024-04-16T17:45:45.465903+0000","last_unstale":"2024-04-16T19:38:08.829535+0000","last_undegraded":"2024-04-16T19:38:08.829535+0000","last_fullsized":"2024-04-16T19:38:08.829535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'19","last_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_deep_scrub":"53'19","last_deep_scrub_stamp":"2024-04-16T19:38:08.829450+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.829450+0000","objects_scrubbed":9,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:30.796211+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1254,"num_read_kb":919,"num_write":95,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.207689+0000","last_change":"2024-04-16T19:39:00.207711+0000","last_active":"2024-04-16T19:39:00.207689+0000","last_peered":"2024-04-16T19:39:00.207689+0000","last_clean":"2024-04-16T19:39:00.207689+0000","last_became_active":"2024-04-16T17:45:10.401907+0000","last_became_peered":"2024-04-16T17:45:10.401907+0000","last_unstale":"2024-04-16T19:39:00.207689+0000","last_undegraded":"2024-04-16T19:39:00.207689+0000","last_fullsized":"2024-04-16T19:39:00.207689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.207628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.207628+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.207628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:20:40.195071+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.496051+0000","last_change":"2024-04-16T19:39:19.496094+0000","last_active":"2024-04-16T19:39:19.496051+0000","last_peered":"2024-04-16T19:39:19.496051+0000","last_clean":"2024-04-16T19:39:19.496051+0000","last_became_active":"2024-04-16T17:45:08.388534+0000","last_became_peered":"2024-04-16T17:45:08.388534+0000","last_unstale":"2024-04-16T19:39:19.496051+0000","last_undegraded":"2024-04-16T19:39:19.496051+0000","last_fullsized":"2024-04-16T19:39:19.496051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.495973+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.495973+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.495973+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:21.997574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.974949+0000","last_change":"2024-04-16T19:39:00.974970+0000","last_active":"2024-04-16T19:39:00.974949+0000","last_peered":"2024-04-16T19:39:00.974949+0000","last_clean":"2024-04-16T19:39:00.974949+0000","last_became_active":"2024-04-16T17:45:20.407044+0000","last_became_peered":"2024-04-16T17:45:20.407044+0000","last_unstale":"2024-04-16T19:39:00.974949+0000","last_undegraded":"2024-04-16T19:39:00.974949+0000","last_fullsized":"2024-04-16T19:39:00.974949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.974887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.974887+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.974887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:44:19.721721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"53'84","reported_seq":254,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.666541+0000","last_change":"2024-04-16T19:38:52.666600+0000","last_active":"2024-04-16T19:38:52.666541+0000","last_peered":"2024-04-16T19:38:52.666541+0000","last_clean":"2024-04-16T19:38:52.666541+0000","last_became_active":"2024-04-16T17:45:22.422105+0000","last_became_peered":"2024-04-16T17:45:22.422105+0000","last_unstale":"2024-04-16T19:38:52.666541+0000","last_undegraded":"2024-04-16T19:38:52.666541+0000","last_fullsized":"2024-04-16T19:38:52.666541+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:52.666426+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:52.666426+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.666426+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:13.136531+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.960739+0000","last_change":"2024-04-16T19:38:46.960762+0000","last_active":"2024-04-16T19:38:46.960739+0000","last_peered":"2024-04-16T19:38:46.960739+0000","last_clean":"2024-04-16T19:38:46.960739+0000","last_became_active":"2024-04-16T17:45:24.425683+0000","last_became_peered":"2024-04-16T17:45:24.425683+0000","last_unstale":"2024-04-16T19:38:46.960739+0000","last_undegraded":"2024-04-16T19:38:46.960739+0000","last_fullsized":"2024-04-16T19:38:46.960739+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.960675+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.960675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:21.934955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.329000+0000","last_change":"2024-04-16T19:38:45.329022+0000","last_active":"2024-04-16T19:38:45.329000+0000","last_peered":"2024-04-16T19:38:45.329000+0000","last_clean":"2024-04-16T19:38:45.329000+0000","last_became_active":"2024-04-16T17:45:26.429384+0000","last_became_peered":"2024-04-16T17:45:26.429384+0000","last_unstale":"2024-04-16T19:38:45.329000+0000","last_undegraded":"2024-04-16T19:38:45.329000+0000","last_fullsized":"2024-04-16T19:38:45.329000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:45.328934+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.328934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:07.148341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:40.162294+0000","last_change":"2024-04-16T19:39:40.162319+0000","last_active":"2024-04-16T19:39:40.162294+0000","last_peered":"2024-04-16T19:39:40.162294+0000","last_clean":"2024-04-16T19:39:40.162294+0000","last_became_active":"2024-04-16T18:09:02.171192+0000","last_became_peered":"2024-04-16T18:09:02.171192+0000","last_unstale":"2024-04-16T19:39:40.162294+0000","last_undegraded":"2024-04-16T19:39:40.162294+0000","last_fullsized":"2024-04-16T19:39:40.162294+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:40.162225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:40.162225+0000","last_clean_scrub_stamp":"2024-04-16T19:39:40.162225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:00:18.522747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"53'168","reported_seq":2644,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.988098+0000","last_change":"2024-04-16T19:38:44.988151+0000","last_active":"2024-04-16T19:38:44.988098+0000","last_peered":"2024-04-16T19:38:44.988098+0000","last_clean":"2024-04-16T19:38:44.988098+0000","last_became_active":"2024-04-16T17:46:25.531425+0000","last_became_peered":"2024-04-16T17:46:25.531425+0000","last_unstale":"2024-04-16T19:38:44.988098+0000","last_undegraded":"2024-04-16T19:38:44.988098+0000","last_fullsized":"2024-04-16T19:38:44.988098+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'168","last_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_deep_scrub":"53'168","last_deep_scrub_stamp":"2024-04-16T19:38:44.988038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.988038+0000","objects_scrubbed":48,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:15.308723+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":4298,"num_read_kb":4250,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9452,"num_omap_keys":38,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.351134+0000","last_change":"2024-04-16T19:38:48.351134+0000","last_active":"2024-04-16T19:38:48.351134+0000","last_peered":"2024-04-16T19:38:48.351134+0000","last_clean":"2024-04-16T19:38:48.351134+0000","last_became_active":"2024-04-16T17:46:17.508087+0000","last_became_peered":"2024-04-16T17:46:17.508087+0000","last_unstale":"2024-04-16T19:38:48.351134+0000","last_undegraded":"2024-04-16T19:38:48.351134+0000","last_fullsized":"2024-04-16T19:38:48.351134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.351012+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.351012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:15:56.344801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"53'23","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.995773+0000","last_change":"2024-04-16T19:38:43.995808+0000","last_active":"2024-04-16T19:38:43.995773+0000","last_peered":"2024-04-16T19:38:43.995773+0000","last_clean":"2024-04-16T19:38:43.995773+0000","last_became_active":"2024-04-16T17:45:51.479527+0000","last_became_peered":"2024-04-16T17:45:51.479527+0000","last_unstale":"2024-04-16T19:38:43.995773+0000","last_undegraded":"2024-04-16T19:38:43.995773+0000","last_fullsized":"2024-04-16T19:38:43.995773+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:43.995709+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.995709+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:23.117614+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1899,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":89,"num_write":67,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.514936+0000","last_change":"2024-04-16T19:38:16.514936+0000","last_active":"2024-04-16T19:38:16.514936+0000","last_peered":"2024-04-16T19:38:16.514936+0000","last_clean":"2024-04-16T19:38:16.514936+0000","last_became_active":"2024-04-16T17:45:49.471186+0000","last_became_peered":"2024-04-16T17:45:49.471186+0000","last_unstale":"2024-04-16T19:38:16.514936+0000","last_undegraded":"2024-04-16T19:38:16.514936+0000","last_fullsized":"2024-04-16T19:38:16.514936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:16.514815+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.514815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:31:12.328836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"53'933","reported_seq":3835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.408460+0000","last_change":"2024-04-16T19:38:24.408514+0000","last_active":"2024-04-16T19:38:24.408460+0000","last_peered":"2024-04-16T19:38:24.408460+0000","last_clean":"2024-04-16T19:38:24.408460+0000","last_became_active":"2024-04-16T17:45:47.466295+0000","last_became_peered":"2024-04-16T17:45:47.466295+0000","last_unstale":"2024-04-16T19:38:24.408460+0000","last_undegraded":"2024-04-16T19:38:24.408460+0000","last_fullsized":"2024-04-16T19:38:24.408460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'933","last_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_deep_scrub":"53'933","last_deep_scrub_stamp":"2024-04-16T19:38:24.408381+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.408381+0000","objects_scrubbed":26,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:46.227789+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2241,"num_read_kb":2228,"num_write":591,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13193,"num_omap_keys":66,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"53'24","reported_seq":324,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.811180+0000","last_change":"2024-04-16T19:38:19.811180+0000","last_active":"2024-04-16T19:38:19.811180+0000","last_peered":"2024-04-16T19:38:19.811180+0000","last_clean":"2024-04-16T19:38:19.811180+0000","last_became_active":"2024-04-16T17:45:45.463946+0000","last_became_peered":"2024-04-16T17:45:45.463946+0000","last_unstale":"2024-04-16T19:38:19.811180+0000","last_undegraded":"2024-04-16T19:38:19.811180+0000","last_fullsized":"2024-04-16T19:38:19.811180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:19.811061+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.811061+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:19.180605+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":451,"num_read_kb":386,"num_write":128,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.593070+0000","last_change":"2024-04-16T19:39:14.593113+0000","last_active":"2024-04-16T19:39:14.593070+0000","last_peered":"2024-04-16T19:39:14.593070+0000","last_clean":"2024-04-16T19:39:14.593070+0000","last_became_active":"2024-04-16T17:45:10.392850+0000","last_became_peered":"2024-04-16T17:45:10.392850+0000","last_unstale":"2024-04-16T19:39:14.593070+0000","last_undegraded":"2024-04-16T19:39:14.593070+0000","last_fullsized":"2024-04-16T19:39:14.593070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.592993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.592993+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.592993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:44.617591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795461+0000","last_change":"2024-04-16T19:38:33.795461+0000","last_active":"2024-04-16T19:38:33.795461+0000","last_peered":"2024-04-16T19:38:33.795461+0000","last_clean":"2024-04-16T19:38:33.795461+0000","last_became_active":"2024-04-16T17:46:16.499171+0000","last_became_peered":"2024-04-16T17:46:16.499171+0000","last_unstale":"2024-04-16T19:38:33.795461+0000","last_undegraded":"2024-04-16T19:38:33.795461+0000","last_fullsized":"2024-04-16T19:38:33.795461+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795373+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:47.763767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.008970+0000","last_change":"2024-04-16T19:39:03.008993+0000","last_active":"2024-04-16T19:39:03.008970+0000","last_peered":"2024-04-16T19:39:03.008970+0000","last_clean":"2024-04-16T19:39:03.008970+0000","last_became_active":"2024-04-16T17:45:20.407723+0000","last_became_peered":"2024-04-16T17:45:20.407723+0000","last_unstale":"2024-04-16T19:39:03.008970+0000","last_undegraded":"2024-04-16T19:39:03.008970+0000","last_fullsized":"2024-04-16T19:39:03.008970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.008902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.008902+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.008902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:45.918962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"53'159","reported_seq":367,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.008609+0000","last_change":"2024-04-16T19:39:00.008649+0000","last_active":"2024-04-16T19:39:00.008609+0000","last_peered":"2024-04-16T19:39:00.008609+0000","last_clean":"2024-04-16T19:39:00.008609+0000","last_became_active":"2024-04-16T17:45:22.415113+0000","last_became_peered":"2024-04-16T17:45:22.415113+0000","last_unstale":"2024-04-16T19:39:00.008609+0000","last_undegraded":"2024-04-16T19:39:00.008609+0000","last_fullsized":"2024-04-16T19:39:00.008609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:00.008548+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:00.008548+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.008548+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:20.719287+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"53'13","reported_seq":1403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.379708+0000","last_change":"2024-04-16T19:38:51.379732+0000","last_active":"2024-04-16T19:38:51.379708+0000","last_peered":"2024-04-16T19:38:51.379708+0000","last_clean":"2024-04-16T19:38:51.379708+0000","last_became_active":"2024-04-16T17:45:24.423346+0000","last_became_peered":"2024-04-16T17:45:24.423346+0000","last_unstale":"2024-04-16T19:38:51.379708+0000","last_undegraded":"2024-04-16T19:38:51.379708+0000","last_fullsized":"2024-04-16T19:38:51.379708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:51.379649+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:51.379649+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.379649+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:17:27.551399+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.361374+0000","last_change":"2024-04-16T19:38:31.361394+0000","last_active":"2024-04-16T19:38:31.361374+0000","last_peered":"2024-04-16T19:38:31.361374+0000","last_clean":"2024-04-16T19:38:31.361374+0000","last_became_active":"2024-04-16T17:45:26.438271+0000","last_became_peered":"2024-04-16T17:45:26.438271+0000","last_unstale":"2024-04-16T19:38:31.361374+0000","last_undegraded":"2024-04-16T19:38:31.361374+0000","last_fullsized":"2024-04-16T19:38:31.361374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.361320+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.361320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:12.965762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":70,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.199228+0000","last_change":"2024-04-16T19:39:21.199251+0000","last_active":"2024-04-16T19:39:21.199228+0000","last_peered":"2024-04-16T19:39:21.199228+0000","last_clean":"2024-04-16T19:39:21.199228+0000","last_became_active":"2024-04-16T18:09:02.168157+0000","last_became_peered":"2024-04-16T18:09:02.168157+0000","last_unstale":"2024-04-16T19:39:21.199228+0000","last_undegraded":"2024-04-16T19:39:21.199228+0000","last_fullsized":"2024-04-16T19:39:21.199228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.199163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.199163+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.199163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:33.267504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"53'215","reported_seq":2411,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.685934+0000","last_change":"2024-04-16T19:38:50.685934+0000","last_active":"2024-04-16T19:38:50.685934+0000","last_peered":"2024-04-16T19:38:50.685934+0000","last_clean":"2024-04-16T19:38:50.685934+0000","last_became_active":"2024-04-16T17:46:25.526583+0000","last_became_peered":"2024-04-16T17:46:25.526583+0000","last_unstale":"2024-04-16T19:38:50.685934+0000","last_undegraded":"2024-04-16T19:38:50.685934+0000","last_fullsized":"2024-04-16T19:38:50.685934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'215","last_scrub_stamp":"2024-04-16T19:38:50.685830+0000","last_deep_scrub":"53'215","last_deep_scrub_stamp":"2024-04-16T19:38:50.685830+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.685830+0000","objects_scrubbed":51,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:48:53.644287+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":3728,"num_read_kb":3796,"num_write":245,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15064,"num_omap_keys":61,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.792912+0000","last_change":"2024-04-16T19:38:43.792912+0000","last_active":"2024-04-16T19:38:43.792912+0000","last_peered":"2024-04-16T19:38:43.792912+0000","last_clean":"2024-04-16T19:38:43.792912+0000","last_became_active":"2024-04-16T17:46:17.504634+0000","last_became_peered":"2024-04-16T17:46:17.504634+0000","last_unstale":"2024-04-16T19:38:43.792912+0000","last_undegraded":"2024-04-16T19:38:43.792912+0000","last_fullsized":"2024-04-16T19:38:43.792912+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.792826+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.792826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:02.586806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"53'25","reported_seq":153,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.332961+0000","last_change":"2024-04-16T19:38:45.333002+0000","last_active":"2024-04-16T19:38:45.332961+0000","last_peered":"2024-04-16T19:38:45.332961+0000","last_clean":"2024-04-16T19:38:45.332961+0000","last_became_active":"2024-04-16T17:45:51.480692+0000","last_became_peered":"2024-04-16T17:45:51.480692+0000","last_unstale":"2024-04-16T19:38:45.332961+0000","last_undegraded":"2024-04-16T19:38:45.332961+0000","last_fullsized":"2024-04-16T19:38:45.332961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:45.332898+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.332898+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:29.252852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1859,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":86,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.794605+0000","last_change":"2024-04-16T19:38:38.794628+0000","last_active":"2024-04-16T19:38:38.794605+0000","last_peered":"2024-04-16T19:38:38.794605+0000","last_clean":"2024-04-16T19:38:38.794605+0000","last_became_active":"2024-04-16T17:45:49.473107+0000","last_became_peered":"2024-04-16T17:45:49.473107+0000","last_unstale":"2024-04-16T19:38:38.794605+0000","last_undegraded":"2024-04-16T19:38:38.794605+0000","last_fullsized":"2024-04-16T19:38:38.794605+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.794540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.794540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:20.398982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"53'620","reported_seq":3264,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.073025+0000","last_change":"2024-04-16T19:38:11.073025+0000","last_active":"2024-04-16T19:38:11.073025+0000","last_peered":"2024-04-16T19:38:11.073025+0000","last_clean":"2024-04-16T19:38:11.073025+0000","last_became_active":"2024-04-16T17:45:47.465219+0000","last_became_peered":"2024-04-16T17:45:47.465219+0000","last_unstale":"2024-04-16T19:38:11.073025+0000","last_undegraded":"2024-04-16T19:38:11.073025+0000","last_fullsized":"2024-04-16T19:38:11.073025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'620","last_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_deep_scrub":"53'620","last_deep_scrub_stamp":"2024-04-16T19:38:11.072941+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.072941+0000","objects_scrubbed":28,"log_size":620,"log_dups_size":0,"ondisk_log_size":620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:14:29.251802+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":3293,"num_read_kb":3140,"num_write":473,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7883,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"53'29","reported_seq":356,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.759701+0000","last_change":"2024-04-16T19:38:28.759701+0000","last_active":"2024-04-16T19:38:28.759701+0000","last_peered":"2024-04-16T19:38:28.759701+0000","last_clean":"2024-04-16T19:38:28.759701+0000","last_became_active":"2024-04-16T17:45:45.459881+0000","last_became_peered":"2024-04-16T17:45:45.459881+0000","last_unstale":"2024-04-16T19:38:28.759701+0000","last_undegraded":"2024-04-16T19:38:28.759701+0000","last_fullsized":"2024-04-16T19:38:28.759701+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'29","last_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_deep_scrub":"53'29","last_deep_scrub_stamp":"2024-04-16T19:38:28.759592+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.759592+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:37.264543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":602,"num_read_kb":447,"num_write":152,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.394260+0000","last_change":"2024-04-16T19:39:13.394286+0000","last_active":"2024-04-16T19:39:13.394260+0000","last_peered":"2024-04-16T19:39:13.394260+0000","last_clean":"2024-04-16T19:39:13.394260+0000","last_became_active":"2024-04-16T17:45:10.392387+0000","last_became_peered":"2024-04-16T17:45:10.392387+0000","last_unstale":"2024-04-16T19:39:13.394260+0000","last_undegraded":"2024-04-16T19:39:13.394260+0000","last_fullsized":"2024-04-16T19:39:13.394260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.394199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.394199+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.394199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:07.280434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.503850+0000","last_change":"2024-04-16T19:39:21.503871+0000","last_active":"2024-04-16T19:39:21.503850+0000","last_peered":"2024-04-16T19:39:21.503850+0000","last_clean":"2024-04-16T19:39:21.503850+0000","last_became_active":"2024-04-16T17:45:08.387085+0000","last_became_peered":"2024-04-16T17:45:08.387085+0000","last_unstale":"2024-04-16T19:39:21.503850+0000","last_undegraded":"2024-04-16T19:39:21.503850+0000","last_fullsized":"2024-04-16T19:39:21.503850+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.503785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.503785+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.503785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:34.898058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"53'4","reported_seq":193,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.044842+0000","last_change":"2024-04-16T19:39:05.044875+0000","last_active":"2024-04-16T19:39:05.044842+0000","last_peered":"2024-04-16T19:39:05.044842+0000","last_clean":"2024-04-16T19:39:05.044842+0000","last_became_active":"2024-04-16T17:45:20.412278+0000","last_became_peered":"2024-04-16T17:45:20.412278+0000","last_unstale":"2024-04-16T19:39:05.044842+0000","last_undegraded":"2024-04-16T19:39:05.044842+0000","last_fullsized":"2024-04-16T19:39:05.044842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:05.044785+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:05.044785+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.044785+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:02.023870+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"53'93","reported_seq":274,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.380153+0000","last_change":"2024-04-16T19:39:05.380186+0000","last_active":"2024-04-16T19:39:05.380153+0000","last_peered":"2024-04-16T19:39:05.380153+0000","last_clean":"2024-04-16T19:39:05.380153+0000","last_became_active":"2024-04-16T17:45:22.414177+0000","last_became_peered":"2024-04-16T17:45:22.414177+0000","last_unstale":"2024-04-16T19:39:05.380153+0000","last_undegraded":"2024-04-16T19:39:05.380153+0000","last_fullsized":"2024-04-16T19:39:05.380153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'93","last_scrub_stamp":"2024-04-16T19:39:05.380096+0000","last_deep_scrub":"53'93","last_deep_scrub_stamp":"2024-04-16T19:39:05.380096+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.380096+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:20.400865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.969020+0000","last_change":"2024-04-16T19:38:49.969046+0000","last_active":"2024-04-16T19:38:49.969020+0000","last_peered":"2024-04-16T19:38:49.969020+0000","last_clean":"2024-04-16T19:38:49.969020+0000","last_became_active":"2024-04-16T17:45:24.422147+0000","last_became_peered":"2024-04-16T17:45:24.422147+0000","last_unstale":"2024-04-16T19:38:49.969020+0000","last_undegraded":"2024-04-16T19:38:49.969020+0000","last_fullsized":"2024-04-16T19:38:49.969020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.968949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.968949+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.968949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:55.390786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.759633+0000","last_change":"2024-04-16T19:38:27.759655+0000","last_active":"2024-04-16T19:38:27.759633+0000","last_peered":"2024-04-16T19:38:27.759633+0000","last_clean":"2024-04-16T19:38:27.759633+0000","last_became_active":"2024-04-16T17:45:26.438124+0000","last_became_peered":"2024-04-16T17:45:26.438124+0000","last_unstale":"2024-04-16T19:38:27.759633+0000","last_undegraded":"2024-04-16T19:38:27.759633+0000","last_fullsized":"2024-04-16T19:38:27.759633+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.759568+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.759568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:42.585548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:29.779293+0000","last_change":"2024-04-16T19:39:29.779316+0000","last_active":"2024-04-16T19:39:29.779293+0000","last_peered":"2024-04-16T19:39:29.779293+0000","last_clean":"2024-04-16T19:39:29.779293+0000","last_became_active":"2024-04-16T18:09:02.173002+0000","last_became_peered":"2024-04-16T18:09:02.173002+0000","last_unstale":"2024-04-16T19:39:29.779293+0000","last_undegraded":"2024-04-16T19:39:29.779293+0000","last_fullsized":"2024-04-16T19:39:29.779293+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:29.779222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:29.779222+0000","last_clean_scrub_stamp":"2024-04-16T19:39:29.779222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:09:17.044869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"53'183","reported_seq":1969,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.363333+0000","last_change":"2024-04-16T19:39:00.363333+0000","last_active":"2024-04-16T19:39:00.363333+0000","last_peered":"2024-04-16T19:39:00.363333+0000","last_clean":"2024-04-16T19:39:00.363333+0000","last_became_active":"2024-04-16T17:46:25.526844+0000","last_became_peered":"2024-04-16T17:46:25.526844+0000","last_unstale":"2024-04-16T19:39:00.363333+0000","last_undegraded":"2024-04-16T19:39:00.363333+0000","last_fullsized":"2024-04-16T19:39:00.363333+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'183","last_scrub_stamp":"2024-04-16T19:39:00.363243+0000","last_deep_scrub":"53'183","last_deep_scrub_stamp":"2024-04-16T19:39:00.363243+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.363243+0000","objects_scrubbed":52,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:44.415353+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":2861,"num_read_kb":2822,"num_write":183,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10405,"num_omap_keys":43,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.571609+0000","last_change":"2024-04-16T19:38:24.571609+0000","last_active":"2024-04-16T19:38:24.571609+0000","last_peered":"2024-04-16T19:38:24.571609+0000","last_clean":"2024-04-16T19:38:24.571609+0000","last_became_active":"2024-04-16T17:46:17.507368+0000","last_became_peered":"2024-04-16T17:46:17.507368+0000","last_unstale":"2024-04-16T19:38:24.571609+0000","last_undegraded":"2024-04-16T19:38:24.571609+0000","last_fullsized":"2024-04-16T19:38:24.571609+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.571519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.571519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:55.147346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"53'13","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.847919+0000","last_change":"2024-04-16T19:38:48.847948+0000","last_active":"2024-04-16T19:38:48.847919+0000","last_peered":"2024-04-16T19:38:48.847919+0000","last_clean":"2024-04-16T19:38:48.847919+0000","last_became_active":"2024-04-16T17:45:51.479728+0000","last_became_peered":"2024-04-16T17:45:51.479728+0000","last_unstale":"2024-04-16T19:38:48.847919+0000","last_undegraded":"2024-04-16T19:38:48.847919+0000","last_fullsized":"2024-04-16T19:38:48.847919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.847863+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.847863+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:18.385433+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":903,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":35,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3","version":"53'652","reported_seq":2214,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.914164+0000","last_change":"2024-04-16T19:38:49.914193+0000","last_active":"2024-04-16T19:38:49.914164+0000","last_peered":"2024-04-16T19:38:49.914164+0000","last_clean":"2024-04-16T19:38:49.914164+0000","last_became_active":"2024-04-16T17:45:49.471813+0000","last_became_peered":"2024-04-16T17:45:49.471813+0000","last_unstale":"2024-04-16T19:38:49.914164+0000","last_undegraded":"2024-04-16T19:38:49.914164+0000","last_fullsized":"2024-04-16T19:38:49.914164+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:49.914098+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:49.914098+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.914098+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:38.352262+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"53'328","reported_seq":608,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.821880+0000","last_change":"2024-04-16T19:38:14.821880+0000","last_active":"2024-04-16T19:38:14.821880+0000","last_peered":"2024-04-16T19:38:14.821880+0000","last_clean":"2024-04-16T19:38:14.821880+0000","last_became_active":"2024-04-16T17:45:47.459878+0000","last_became_peered":"2024-04-16T17:45:47.459878+0000","last_unstale":"2024-04-16T19:38:14.821880+0000","last_undegraded":"2024-04-16T19:38:14.821880+0000","last_fullsized":"2024-04-16T19:38:14.821880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'328","last_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_deep_scrub":"53'328","last_deep_scrub_stamp":"2024-04-16T19:38:14.821710+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.821710+0000","objects_scrubbed":22,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:27.374369+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":494,"num_read_kb":487,"num_write":451,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14461,"num_omap_keys":66,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"53'12","reported_seq":557,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.221422+0000","last_change":"2024-04-16T19:38:14.221422+0000","last_active":"2024-04-16T19:38:14.221422+0000","last_peered":"2024-04-16T19:38:14.221422+0000","last_clean":"2024-04-16T19:38:14.221422+0000","last_became_active":"2024-04-16T17:45:45.467897+0000","last_became_peered":"2024-04-16T17:45:45.467897+0000","last_unstale":"2024-04-16T19:38:14.221422+0000","last_undegraded":"2024-04-16T19:38:14.221422+0000","last_fullsized":"2024-04-16T19:38:14.221422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:14.221299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.221299+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:29.047279+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1067,"num_read_kb":903,"num_write":74,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.267910+0000","last_change":"2024-04-16T19:38:56.267932+0000","last_active":"2024-04-16T19:38:56.267910+0000","last_peered":"2024-04-16T19:38:56.267910+0000","last_clean":"2024-04-16T19:38:56.267910+0000","last_became_active":"2024-04-16T17:45:10.401822+0000","last_became_peered":"2024-04-16T17:45:10.401822+0000","last_unstale":"2024-04-16T19:38:56.267910+0000","last_undegraded":"2024-04-16T19:38:56.267910+0000","last_fullsized":"2024-04-16T19:38:56.267910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:56.267851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:56.267851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.267851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:59:39.824687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.835466+0000","last_change":"2024-04-16T19:39:22.835490+0000","last_active":"2024-04-16T19:39:22.835466+0000","last_peered":"2024-04-16T19:39:22.835466+0000","last_clean":"2024-04-16T19:39:22.835466+0000","last_became_active":"2024-04-16T17:45:08.384139+0000","last_became_peered":"2024-04-16T17:45:08.384139+0000","last_unstale":"2024-04-16T19:39:22.835466+0000","last_undegraded":"2024-04-16T19:39:22.835466+0000","last_fullsized":"2024-04-16T19:39:22.835466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.835399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.835399+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.835399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:20.237478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"53'4","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.988919+0000","last_change":"2024-04-16T19:38:58.988948+0000","last_active":"2024-04-16T19:38:58.988919+0000","last_peered":"2024-04-16T19:38:58.988919+0000","last_clean":"2024-04-16T19:38:58.988919+0000","last_became_active":"2024-04-16T17:45:20.405950+0000","last_became_peered":"2024-04-16T17:45:20.405950+0000","last_unstale":"2024-04-16T19:38:58.988919+0000","last_undegraded":"2024-04-16T19:38:58.988919+0000","last_fullsized":"2024-04-16T19:38:58.988919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:58.988846+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:58.988846+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.988846+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:04:00.042173+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1009,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":22,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"53'109","reported_seq":291,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.321077+0000","last_change":"2024-04-16T19:38:53.321117+0000","last_active":"2024-04-16T19:38:53.321077+0000","last_peered":"2024-04-16T19:38:53.321077+0000","last_clean":"2024-04-16T19:38:53.321077+0000","last_became_active":"2024-04-16T17:45:22.415921+0000","last_became_peered":"2024-04-16T17:45:22.415921+0000","last_unstale":"2024-04-16T19:38:53.321077+0000","last_undegraded":"2024-04-16T19:38:53.321077+0000","last_fullsized":"2024-04-16T19:38:53.321077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:53.321015+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:53.321015+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.321015+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:32.108521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.338639+0000","last_change":"2024-04-16T19:38:54.338662+0000","last_active":"2024-04-16T19:38:54.338639+0000","last_peered":"2024-04-16T19:38:54.338639+0000","last_clean":"2024-04-16T19:38:54.338639+0000","last_became_active":"2024-04-16T17:45:24.422471+0000","last_became_peered":"2024-04-16T17:45:24.422471+0000","last_unstale":"2024-04-16T19:38:54.338639+0000","last_undegraded":"2024-04-16T19:38:54.338639+0000","last_fullsized":"2024-04-16T19:38:54.338639+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:54.338572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:54.338572+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.338572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:15.049310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.698543+0000","last_change":"2024-04-16T19:38:40.698543+0000","last_active":"2024-04-16T19:38:40.698543+0000","last_peered":"2024-04-16T19:38:40.698543+0000","last_clean":"2024-04-16T19:38:40.698543+0000","last_became_active":"2024-04-16T17:45:26.433125+0000","last_became_peered":"2024-04-16T17:45:26.433125+0000","last_unstale":"2024-04-16T19:38:40.698543+0000","last_undegraded":"2024-04-16T19:38:40.698543+0000","last_fullsized":"2024-04-16T19:38:40.698543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.698456+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.698456+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:35.601090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:40.399838+0000","last_change":"2024-04-16T19:39:40.399872+0000","last_active":"2024-04-16T19:39:40.399838+0000","last_peered":"2024-04-16T19:39:40.399838+0000","last_clean":"2024-04-16T19:39:40.399838+0000","last_became_active":"2024-04-16T18:09:02.172170+0000","last_became_peered":"2024-04-16T18:09:02.172170+0000","last_unstale":"2024-04-16T19:39:40.399838+0000","last_undegraded":"2024-04-16T19:39:40.399838+0000","last_fullsized":"2024-04-16T19:39:40.399838+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:40.399773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:40.399773+0000","last_clean_scrub_stamp":"2024-04-16T19:39:40.399773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:33.769487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"53'214","reported_seq":2192,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.819710+0000","last_change":"2024-04-16T19:39:06.819710+0000","last_active":"2024-04-16T19:39:06.819710+0000","last_peered":"2024-04-16T19:39:06.819710+0000","last_clean":"2024-04-16T19:39:06.819710+0000","last_became_active":"2024-04-16T17:46:25.521756+0000","last_became_peered":"2024-04-16T17:46:25.521756+0000","last_unstale":"2024-04-16T19:39:06.819710+0000","last_undegraded":"2024-04-16T19:39:06.819710+0000","last_fullsized":"2024-04-16T19:39:06.819710+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'214","last_scrub_stamp":"2024-04-16T19:39:06.819616+0000","last_deep_scrub":"53'214","last_deep_scrub_stamp":"2024-04-16T19:39:06.819616+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.819616+0000","objects_scrubbed":58,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:28.816792+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":3178,"num_read_kb":3131,"num_write":214,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11101,"num_omap_keys":44,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.926346+0000","last_change":"2024-04-16T19:38:50.926369+0000","last_active":"2024-04-16T19:38:50.926346+0000","last_peered":"2024-04-16T19:38:50.926346+0000","last_clean":"2024-04-16T19:38:50.926346+0000","last_became_active":"2024-04-16T17:46:17.511062+0000","last_became_peered":"2024-04-16T17:46:17.511062+0000","last_unstale":"2024-04-16T19:38:50.926346+0000","last_undegraded":"2024-04-16T19:38:50.926346+0000","last_fullsized":"2024-04-16T19:38:50.926346+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.926283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.926283+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.926283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:00.576961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.5","version":"53'148","reported_seq":341,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.921604+0000","last_change":"2024-04-16T19:38:45.921641+0000","last_active":"2024-04-16T19:38:45.921604+0000","last_peered":"2024-04-16T19:38:45.921604+0000","last_clean":"2024-04-16T19:38:45.921604+0000","last_became_active":"2024-04-16T17:45:51.478683+0000","last_became_peered":"2024-04-16T17:45:51.478683+0000","last_unstale":"2024-04-16T19:38:45.921604+0000","last_undegraded":"2024-04-16T19:38:45.921604+0000","last_fullsized":"2024-04-16T19:38:45.921604+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'148","last_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_deep_scrub":"53'148","last_deep_scrub_stamp":"2024-04-16T19:38:45.921535+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.921535+0000","objects_scrubbed":4,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:26.250123+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":717,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":385,"num_read_kb":641,"num_write":286,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9535,"num_omap_keys":55,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.087323+0000","last_change":"2024-04-16T19:38:15.087323+0000","last_active":"2024-04-16T19:38:15.087323+0000","last_peered":"2024-04-16T19:38:15.087323+0000","last_clean":"2024-04-16T19:38:15.087323+0000","last_became_active":"2024-04-16T17:45:49.467637+0000","last_became_peered":"2024-04-16T17:45:49.467637+0000","last_unstale":"2024-04-16T19:38:15.087323+0000","last_undegraded":"2024-04-16T19:38:15.087323+0000","last_fullsized":"2024-04-16T19:38:15.087323+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:15.087231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.087231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:14:00.509056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"53'845","reported_seq":1835,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.089179+0000","last_change":"2024-04-16T19:38:10.089179+0000","last_active":"2024-04-16T19:38:10.089179+0000","last_peered":"2024-04-16T19:38:10.089179+0000","last_clean":"2024-04-16T19:38:10.089179+0000","last_became_active":"2024-04-16T17:45:47.465327+0000","last_became_peered":"2024-04-16T17:45:47.465327+0000","last_unstale":"2024-04-16T19:38:10.089179+0000","last_undegraded":"2024-04-16T19:38:10.089179+0000","last_fullsized":"2024-04-16T19:38:10.089179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'845","last_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_deep_scrub":"53'845","last_deep_scrub_stamp":"2024-04-16T19:38:10.089105+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.089105+0000","objects_scrubbed":25,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:06:33.799326+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47375,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2445,"num_read_kb":2131,"num_write":1436,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7064,"num_omap_keys":32,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"53'8","reported_seq":283,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.784403+0000","last_change":"2024-04-16T19:38:13.784444+0000","last_active":"2024-04-16T19:38:13.784403+0000","last_peered":"2024-04-16T19:38:13.784403+0000","last_clean":"2024-04-16T19:38:13.784403+0000","last_became_active":"2024-04-16T17:45:45.459813+0000","last_became_peered":"2024-04-16T17:45:45.459813+0000","last_unstale":"2024-04-16T19:38:13.784403+0000","last_undegraded":"2024-04-16T19:38:13.784403+0000","last_fullsized":"2024-04-16T19:38:13.784403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'8","last_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_deep_scrub":"53'8","last_deep_scrub_stamp":"2024-04-16T19:38:13.784341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.784341+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:20.950710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":294,"num_write":44,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.032884+0000","last_change":"2024-04-16T19:39:15.032906+0000","last_active":"2024-04-16T19:39:15.032884+0000","last_peered":"2024-04-16T19:39:15.032884+0000","last_clean":"2024-04-16T19:39:15.032884+0000","last_became_active":"2024-04-16T17:45:10.387169+0000","last_became_peered":"2024-04-16T17:45:10.387169+0000","last_unstale":"2024-04-16T19:39:15.032884+0000","last_undegraded":"2024-04-16T19:39:15.032884+0000","last_fullsized":"2024-04-16T19:39:15.032884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.032817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.032817+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.032817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:11.261229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.032600+0000","last_change":"2024-04-16T19:39:16.032643+0000","last_active":"2024-04-16T19:39:16.032600+0000","last_peered":"2024-04-16T19:39:16.032600+0000","last_clean":"2024-04-16T19:39:16.032600+0000","last_became_active":"2024-04-16T17:45:08.385443+0000","last_became_peered":"2024-04-16T17:45:08.385443+0000","last_unstale":"2024-04-16T19:39:16.032600+0000","last_undegraded":"2024-04-16T19:39:16.032600+0000","last_fullsized":"2024-04-16T19:39:16.032600+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.032519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.032519+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.032519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:51.219658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"53'14","reported_seq":157,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.885012+0000","last_change":"2024-04-16T19:39:24.885042+0000","last_active":"2024-04-16T19:39:24.885012+0000","last_peered":"2024-04-16T19:39:24.885012+0000","last_clean":"2024-04-16T19:39:24.885012+0000","last_became_active":"2024-04-16T17:45:20.413145+0000","last_became_peered":"2024-04-16T17:45:20.413145+0000","last_unstale":"2024-04-16T19:39:24.885012+0000","last_undegraded":"2024-04-16T19:39:24.885012+0000","last_fullsized":"2024-04-16T19:39:24.885012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:39:24.884947+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:39:24.884947+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.884947+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:15.226333+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":815,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":27,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"53'159","reported_seq":365,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.102260+0000","last_change":"2024-04-16T19:39:09.102303+0000","last_active":"2024-04-16T19:39:09.102260+0000","last_peered":"2024-04-16T19:39:09.102260+0000","last_clean":"2024-04-16T19:39:09.102260+0000","last_became_active":"2024-04-16T17:45:22.414088+0000","last_became_peered":"2024-04-16T17:45:22.414088+0000","last_unstale":"2024-04-16T19:39:09.102260+0000","last_undegraded":"2024-04-16T19:39:09.102260+0000","last_fullsized":"2024-04-16T19:39:09.102260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:09.102197+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:09.102197+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.102197+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:49.430786+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.920197+0000","last_change":"2024-04-16T19:38:45.920222+0000","last_active":"2024-04-16T19:38:45.920197+0000","last_peered":"2024-04-16T19:38:45.920197+0000","last_clean":"2024-04-16T19:38:45.920197+0000","last_became_active":"2024-04-16T17:45:24.430597+0000","last_became_peered":"2024-04-16T17:45:24.430597+0000","last_unstale":"2024-04-16T19:38:45.920197+0000","last_undegraded":"2024-04-16T19:38:45.920197+0000","last_fullsized":"2024-04-16T19:38:45.920197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:45.920132+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.920132+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:59.970112+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.699740+0000","last_change":"2024-04-16T19:38:44.699765+0000","last_active":"2024-04-16T19:38:44.699740+0000","last_peered":"2024-04-16T19:38:44.699740+0000","last_clean":"2024-04-16T19:38:44.699740+0000","last_became_active":"2024-04-16T17:45:26.428548+0000","last_became_peered":"2024-04-16T17:45:26.428548+0000","last_unstale":"2024-04-16T19:38:44.699740+0000","last_undegraded":"2024-04-16T19:38:44.699740+0000","last_fullsized":"2024-04-16T19:38:44.699740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.699672+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.699672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:23.487178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:38.163247+0000","last_change":"2024-04-16T19:39:38.163271+0000","last_active":"2024-04-16T19:39:38.163247+0000","last_peered":"2024-04-16T19:39:38.163247+0000","last_clean":"2024-04-16T19:39:38.163247+0000","last_became_active":"2024-04-16T18:09:02.166879+0000","last_became_peered":"2024-04-16T18:09:02.166879+0000","last_unstale":"2024-04-16T19:39:38.163247+0000","last_undegraded":"2024-04-16T19:39:38.163247+0000","last_fullsized":"2024-04-16T19:39:38.163247+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:38.163178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:38.163178+0000","last_clean_scrub_stamp":"2024-04-16T19:39:38.163178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:37:19.561001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"53'123","reported_seq":1657,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.055957+0000","last_change":"2024-04-16T19:39:01.055999+0000","last_active":"2024-04-16T19:39:01.055957+0000","last_peered":"2024-04-16T19:39:01.055957+0000","last_clean":"2024-04-16T19:39:01.055957+0000","last_became_active":"2024-04-16T17:46:25.526927+0000","last_became_peered":"2024-04-16T17:46:25.526927+0000","last_unstale":"2024-04-16T19:39:01.055957+0000","last_undegraded":"2024-04-16T19:39:01.055957+0000","last_fullsized":"2024-04-16T19:39:01.055957+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'123","last_scrub_stamp":"2024-04-16T19:39:01.055896+0000","last_deep_scrub":"53'123","last_deep_scrub_stamp":"2024-04-16T19:39:01.055896+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.055896+0000","objects_scrubbed":39,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:30.391341+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":2323,"num_read_kb":2489,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6944,"num_omap_keys":28,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.960413+0000","last_change":"2024-04-16T19:38:52.960413+0000","last_active":"2024-04-16T19:38:52.960413+0000","last_peered":"2024-04-16T19:38:52.960413+0000","last_clean":"2024-04-16T19:38:52.960413+0000","last_became_active":"2024-04-16T17:46:17.513741+0000","last_became_peered":"2024-04-16T17:46:17.513741+0000","last_unstale":"2024-04-16T19:38:52.960413+0000","last_undegraded":"2024-04-16T19:38:52.960413+0000","last_fullsized":"2024-04-16T19:38:52.960413+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:52.960329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:52.960329+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.960329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:00.837740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"53'23","reported_seq":165,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.788363+0000","last_change":"2024-04-16T19:38:36.788402+0000","last_active":"2024-04-16T19:38:36.788363+0000","last_peered":"2024-04-16T19:38:36.788363+0000","last_clean":"2024-04-16T19:38:36.788363+0000","last_became_active":"2024-04-16T17:45:51.479934+0000","last_became_peered":"2024-04-16T17:45:51.479934+0000","last_unstale":"2024-04-16T19:38:36.788363+0000","last_undegraded":"2024-04-16T19:38:36.788363+0000","last_fullsized":"2024-04-16T19:38:36.788363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:36.788299+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.788299+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:50.210568+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":168,"num_read_kb":131,"num_write":54,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.516924+0000","last_change":"2024-04-16T19:38:22.516949+0000","last_active":"2024-04-16T19:38:22.516924+0000","last_peered":"2024-04-16T19:38:22.516924+0000","last_clean":"2024-04-16T19:38:22.516924+0000","last_became_active":"2024-04-16T17:45:49.472130+0000","last_became_peered":"2024-04-16T17:45:49.472130+0000","last_unstale":"2024-04-16T19:38:22.516924+0000","last_undegraded":"2024-04-16T19:38:22.516924+0000","last_fullsized":"2024-04-16T19:38:22.516924+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.516860+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.516860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:49:29.683230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.0","version":"53'556","reported_seq":948,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.745464+0000","last_change":"2024-04-16T19:38:10.745507+0000","last_active":"2024-04-16T19:38:10.745464+0000","last_peered":"2024-04-16T19:38:10.745464+0000","last_clean":"2024-04-16T19:38:10.745464+0000","last_became_active":"2024-04-16T17:45:47.465317+0000","last_became_peered":"2024-04-16T17:45:47.465317+0000","last_unstale":"2024-04-16T19:38:10.745464+0000","last_undegraded":"2024-04-16T19:38:10.745464+0000","last_fullsized":"2024-04-16T19:38:10.745464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'556","last_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_deep_scrub":"53'556","last_deep_scrub_stamp":"2024-04-16T19:38:10.745406+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.745406+0000","objects_scrubbed":30,"log_size":556,"log_dups_size":0,"ondisk_log_size":556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:38:44.014095+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":800,"num_read_kb":789,"num_write":893,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":56852,"num_omap_keys":197,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"53'20","reported_seq":403,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.950663+0000","last_change":"2024-04-16T19:38:18.950663+0000","last_active":"2024-04-16T19:38:18.950663+0000","last_peered":"2024-04-16T19:38:18.950663+0000","last_clean":"2024-04-16T19:38:18.950663+0000","last_became_active":"2024-04-16T17:45:45.461198+0000","last_became_peered":"2024-04-16T17:45:45.461198+0000","last_unstale":"2024-04-16T19:38:18.950663+0000","last_undegraded":"2024-04-16T19:38:18.950663+0000","last_fullsized":"2024-04-16T19:38:18.950663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:18.950543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.950543+0000","objects_scrubbed":10,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:35:43.149409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":639,"num_read_kb":511,"num_write":112,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.232849+0000","last_change":"2024-04-16T19:39:05.232871+0000","last_active":"2024-04-16T19:39:05.232849+0000","last_peered":"2024-04-16T19:39:05.232849+0000","last_clean":"2024-04-16T19:39:05.232849+0000","last_became_active":"2024-04-16T17:45:10.394637+0000","last_became_peered":"2024-04-16T17:45:10.394637+0000","last_unstale":"2024-04-16T19:39:05.232849+0000","last_undegraded":"2024-04-16T19:39:05.232849+0000","last_fullsized":"2024-04-16T19:39:05.232849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:05.232783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:05.232783+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.232783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:14.883462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.147374+0000","last_change":"2024-04-16T19:39:15.147417+0000","last_active":"2024-04-16T19:39:15.147374+0000","last_peered":"2024-04-16T19:39:15.147374+0000","last_clean":"2024-04-16T19:39:15.147374+0000","last_became_active":"2024-04-16T17:45:08.381288+0000","last_became_peered":"2024-04-16T17:45:08.381288+0000","last_unstale":"2024-04-16T19:39:15.147374+0000","last_undegraded":"2024-04-16T19:39:15.147374+0000","last_fullsized":"2024-04-16T19:39:15.147374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.147300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.147300+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.147300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:51.414128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"53'20","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.756258+0000","last_change":"2024-04-16T19:39:05.756291+0000","last_active":"2024-04-16T19:39:05.756258+0000","last_peered":"2024-04-16T19:39:05.756258+0000","last_clean":"2024-04-16T19:39:05.756258+0000","last_became_active":"2024-04-16T17:45:20.412178+0000","last_became_peered":"2024-04-16T17:45:20.412178+0000","last_unstale":"2024-04-16T19:39:05.756258+0000","last_undegraded":"2024-04-16T19:39:05.756258+0000","last_fullsized":"2024-04-16T19:39:05.756258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:39:05.756190+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:39:05.756190+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.756190+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:33.153102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"53'125","reported_seq":310,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.767839+0000","last_change":"2024-04-16T19:38:57.767889+0000","last_active":"2024-04-16T19:38:57.767839+0000","last_peered":"2024-04-16T19:38:57.767839+0000","last_clean":"2024-04-16T19:38:57.767839+0000","last_became_active":"2024-04-16T17:45:22.414433+0000","last_became_peered":"2024-04-16T17:45:22.414433+0000","last_unstale":"2024-04-16T19:38:57.767839+0000","last_undegraded":"2024-04-16T19:38:57.767839+0000","last_fullsized":"2024-04-16T19:38:57.767839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:57.767770+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:57.767770+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.767770+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:37:57.201721+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"53'13","reported_seq":1401,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.371464+0000","last_change":"2024-04-16T19:38:48.371504+0000","last_active":"2024-04-16T19:38:48.371464+0000","last_peered":"2024-04-16T19:38:48.371464+0000","last_clean":"2024-04-16T19:38:48.371464+0000","last_became_active":"2024-04-16T17:45:24.423594+0000","last_became_peered":"2024-04-16T17:45:24.423594+0000","last_unstale":"2024-04-16T19:38:48.371464+0000","last_undegraded":"2024-04-16T19:38:48.371464+0000","last_fullsized":"2024-04-16T19:38:48.371464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:48.371402+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.371402+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:16:08.229885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.304929+0000","last_change":"2024-04-16T19:38:44.304973+0000","last_active":"2024-04-16T19:38:44.304929+0000","last_peered":"2024-04-16T19:38:44.304929+0000","last_clean":"2024-04-16T19:38:44.304929+0000","last_became_active":"2024-04-16T17:45:26.429621+0000","last_became_peered":"2024-04-16T17:45:26.429621+0000","last_unstale":"2024-04-16T19:38:44.304929+0000","last_undegraded":"2024-04-16T19:38:44.304929+0000","last_fullsized":"2024-04-16T19:38:44.304929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.304852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.304852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:02.982475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":68,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.849749+0000","last_change":"2024-04-16T19:39:27.849772+0000","last_active":"2024-04-16T19:39:27.849749+0000","last_peered":"2024-04-16T19:39:27.849749+0000","last_clean":"2024-04-16T19:39:27.849749+0000","last_became_active":"2024-04-16T18:09:02.168875+0000","last_became_peered":"2024-04-16T18:09:02.168875+0000","last_unstale":"2024-04-16T19:39:27.849749+0000","last_undegraded":"2024-04-16T19:39:27.849749+0000","last_fullsized":"2024-04-16T19:39:27.849749+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:27.849680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:27.849680+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.849680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:03:20.915552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"53'161","reported_seq":2018,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.406393+0000","last_change":"2024-04-16T19:38:52.406393+0000","last_active":"2024-04-16T19:38:52.406393+0000","last_peered":"2024-04-16T19:38:52.406393+0000","last_clean":"2024-04-16T19:38:52.406393+0000","last_became_active":"2024-04-16T17:46:25.525462+0000","last_became_peered":"2024-04-16T17:46:25.525462+0000","last_unstale":"2024-04-16T19:38:52.406393+0000","last_undegraded":"2024-04-16T19:38:52.406393+0000","last_fullsized":"2024-04-16T19:38:52.406393+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'161","last_scrub_stamp":"2024-04-16T19:38:52.406292+0000","last_deep_scrub":"53'161","last_deep_scrub_stamp":"2024-04-16T19:38:52.406292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.406292+0000","objects_scrubbed":31,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:04.474633+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":2915,"num_read_kb":3259,"num_write":192,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11035,"num_omap_keys":45,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.968540+0000","last_change":"2024-04-16T19:38:44.968540+0000","last_active":"2024-04-16T19:38:44.968540+0000","last_peered":"2024-04-16T19:38:44.968540+0000","last_clean":"2024-04-16T19:38:44.968540+0000","last_became_active":"2024-04-16T17:46:17.512005+0000","last_became_peered":"2024-04-16T17:46:17.512005+0000","last_unstale":"2024-04-16T19:38:44.968540+0000","last_undegraded":"2024-04-16T19:38:44.968540+0000","last_fullsized":"2024-04-16T19:38:44.968540+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.968404+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.968404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:05.438509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"53'21","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.778353+0000","last_change":"2024-04-16T19:38:37.778410+0000","last_active":"2024-04-16T19:38:37.778353+0000","last_peered":"2024-04-16T19:38:37.778353+0000","last_clean":"2024-04-16T19:38:37.778353+0000","last_became_active":"2024-04-16T17:45:51.479813+0000","last_became_peered":"2024-04-16T17:45:51.479813+0000","last_unstale":"2024-04-16T19:38:37.778353+0000","last_undegraded":"2024-04-16T19:38:37.778353+0000","last_fullsized":"2024-04-16T19:38:37.778353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:37.778277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.778277+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:55.312669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1436,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":100,"num_read_kb":80,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"53'652","reported_seq":2222,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.762332+0000","last_change":"2024-04-16T19:38:20.762362+0000","last_active":"2024-04-16T19:38:20.762332+0000","last_peered":"2024-04-16T19:38:20.762332+0000","last_clean":"2024-04-16T19:38:20.762332+0000","last_became_active":"2024-04-16T17:45:49.469754+0000","last_became_peered":"2024-04-16T17:45:49.469754+0000","last_unstale":"2024-04-16T19:38:20.762332+0000","last_undegraded":"2024-04-16T19:38:20.762332+0000","last_fullsized":"2024-04-16T19:38:20.762332+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:20.762267+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.762267+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:32.587575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"53'447","reported_seq":743,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.567084+0000","last_change":"2024-04-16T19:38:15.567084+0000","last_active":"2024-04-16T19:38:15.567084+0000","last_peered":"2024-04-16T19:38:15.567084+0000","last_clean":"2024-04-16T19:38:15.567084+0000","last_became_active":"2024-04-16T17:45:47.460908+0000","last_became_peered":"2024-04-16T17:45:47.460908+0000","last_unstale":"2024-04-16T19:38:15.567084+0000","last_undegraded":"2024-04-16T19:38:15.567084+0000","last_fullsized":"2024-04-16T19:38:15.567084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'447","last_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_deep_scrub":"53'447","last_deep_scrub_stamp":"2024-04-16T19:38:15.566947+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.566947+0000","objects_scrubbed":23,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:30:08.446790+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":523,"num_read_kb":516,"num_write":694,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7264,"num_omap_keys":33,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"53'38","reported_seq":544,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.770259+0000","last_change":"2024-04-16T19:38:19.770333+0000","last_active":"2024-04-16T19:38:19.770259+0000","last_peered":"2024-04-16T19:38:19.770259+0000","last_clean":"2024-04-16T19:38:19.770259+0000","last_became_active":"2024-04-16T17:45:45.458221+0000","last_became_peered":"2024-04-16T17:45:45.458221+0000","last_unstale":"2024-04-16T19:38:19.770259+0000","last_undegraded":"2024-04-16T19:38:19.770259+0000","last_fullsized":"2024-04-16T19:38:19.770259+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'38","last_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_deep_scrub":"53'38","last_deep_scrub_stamp":"2024-04-16T19:38:19.770195+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.770195+0000","objects_scrubbed":10,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:32.489397+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1072,"num_read_kb":718,"num_write":200,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.117354+0000","last_change":"2024-04-16T19:38:25.117354+0000","last_active":"2024-04-16T19:38:25.117354+0000","last_peered":"2024-04-16T19:38:25.117354+0000","last_clean":"2024-04-16T19:38:25.117354+0000","last_became_active":"2024-04-16T17:46:16.501696+0000","last_became_peered":"2024-04-16T17:46:16.501696+0000","last_unstale":"2024-04-16T19:38:25.117354+0000","last_undegraded":"2024-04-16T19:38:25.117354+0000","last_fullsized":"2024-04-16T19:38:25.117354+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.117265+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.117265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:20.011342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.100913+0000","last_change":"2024-04-16T19:39:12.100951+0000","last_active":"2024-04-16T19:39:12.100913+0000","last_peered":"2024-04-16T19:39:12.100913+0000","last_clean":"2024-04-16T19:39:12.100913+0000","last_became_active":"2024-04-16T17:45:08.381733+0000","last_became_peered":"2024-04-16T17:45:08.381733+0000","last_unstale":"2024-04-16T19:39:12.100913+0000","last_undegraded":"2024-04-16T19:39:12.100913+0000","last_fullsized":"2024-04-16T19:39:12.100913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.100829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.100829+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.100829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:06:21.751508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":129,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.018075+0000","last_change":"2024-04-16T19:39:06.018098+0000","last_active":"2024-04-16T19:39:06.018075+0000","last_peered":"2024-04-16T19:39:06.018075+0000","last_clean":"2024-04-16T19:39:06.018075+0000","last_became_active":"2024-04-16T17:45:20.407357+0000","last_became_peered":"2024-04-16T17:45:20.407357+0000","last_unstale":"2024-04-16T19:39:06.018075+0000","last_undegraded":"2024-04-16T19:39:06.018075+0000","last_fullsized":"2024-04-16T19:39:06.018075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.018006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.018006+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.018006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:50.070115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"53'184","reported_seq":402,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.798158+0000","last_change":"2024-04-16T19:39:04.798203+0000","last_active":"2024-04-16T19:39:04.798158+0000","last_peered":"2024-04-16T19:39:04.798158+0000","last_clean":"2024-04-16T19:39:04.798158+0000","last_became_active":"2024-04-16T17:45:22.414336+0000","last_became_peered":"2024-04-16T17:45:22.414336+0000","last_unstale":"2024-04-16T19:39:04.798158+0000","last_undegraded":"2024-04-16T19:39:04.798158+0000","last_fullsized":"2024-04-16T19:39:04.798158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'184","last_scrub_stamp":"2024-04-16T19:39:04.798090+0000","last_deep_scrub":"53'184","last_deep_scrub_stamp":"2024-04-16T19:39:04.798090+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.798090+0000","objects_scrubbed":8,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:04.542146+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":269,"num_read_kb":259,"num_write":176,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.958099+0000","last_change":"2024-04-16T19:38:50.958122+0000","last_active":"2024-04-16T19:38:50.958099+0000","last_peered":"2024-04-16T19:38:50.958099+0000","last_clean":"2024-04-16T19:38:50.958099+0000","last_became_active":"2024-04-16T17:45:24.425401+0000","last_became_peered":"2024-04-16T17:45:24.425401+0000","last_unstale":"2024-04-16T19:38:50.958099+0000","last_undegraded":"2024-04-16T19:38:50.958099+0000","last_fullsized":"2024-04-16T19:38:50.958099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.958033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.958033+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.958033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:34.877987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.718631+0000","last_change":"2024-04-16T19:38:41.718655+0000","last_active":"2024-04-16T19:38:41.718631+0000","last_peered":"2024-04-16T19:38:41.718631+0000","last_clean":"2024-04-16T19:38:41.718631+0000","last_became_active":"2024-04-16T17:45:26.433061+0000","last_became_peered":"2024-04-16T17:45:26.433061+0000","last_unstale":"2024-04-16T19:38:41.718631+0000","last_undegraded":"2024-04-16T19:38:41.718631+0000","last_fullsized":"2024-04-16T19:38:41.718631+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.718567+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.718567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:36.366059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.238376+0000","last_change":"2024-04-16T19:39:25.238412+0000","last_active":"2024-04-16T19:39:25.238376+0000","last_peered":"2024-04-16T19:39:25.238376+0000","last_clean":"2024-04-16T19:39:25.238376+0000","last_became_active":"2024-04-16T18:09:02.173120+0000","last_became_peered":"2024-04-16T18:09:02.173120+0000","last_unstale":"2024-04-16T19:39:25.238376+0000","last_undegraded":"2024-04-16T19:39:25.238376+0000","last_fullsized":"2024-04-16T19:39:25.238376+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.238290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.238290+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.238290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:25.548394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"53'157","reported_seq":1998,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.449633+0000","last_change":"2024-04-16T19:38:50.449633+0000","last_active":"2024-04-16T19:38:50.449633+0000","last_peered":"2024-04-16T19:38:50.449633+0000","last_clean":"2024-04-16T19:38:50.449633+0000","last_became_active":"2024-04-16T17:46:25.529817+0000","last_became_peered":"2024-04-16T17:46:25.529817+0000","last_unstale":"2024-04-16T19:38:50.449633+0000","last_undegraded":"2024-04-16T19:38:50.449633+0000","last_fullsized":"2024-04-16T19:38:50.449633+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'157","last_scrub_stamp":"2024-04-16T19:38:50.449529+0000","last_deep_scrub":"53'157","last_deep_scrub_stamp":"2024-04-16T19:38:50.449529+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.449529+0000","objects_scrubbed":40,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:37.452857+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":3074,"num_read_kb":3031,"num_write":171,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11968,"num_omap_keys":48,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.747274+0000","last_change":"2024-04-16T19:38:38.747274+0000","last_active":"2024-04-16T19:38:38.747274+0000","last_peered":"2024-04-16T19:38:38.747274+0000","last_clean":"2024-04-16T19:38:38.747274+0000","last_became_active":"2024-04-16T17:46:17.512472+0000","last_became_peered":"2024-04-16T17:46:17.512472+0000","last_unstale":"2024-04-16T19:38:38.747274+0000","last_undegraded":"2024-04-16T19:38:38.747274+0000","last_fullsized":"2024-04-16T19:38:38.747274+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.747176+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.747176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:04:44.763682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"53'30","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.513984+0000","last_change":"2024-04-16T19:38:29.514047+0000","last_active":"2024-04-16T19:38:29.513984+0000","last_peered":"2024-04-16T19:38:29.513984+0000","last_clean":"2024-04-16T19:38:29.513984+0000","last_became_active":"2024-04-16T17:45:51.482508+0000","last_became_peered":"2024-04-16T17:45:51.482508+0000","last_unstale":"2024-04-16T19:38:29.513984+0000","last_undegraded":"2024-04-16T19:38:29.513984+0000","last_fullsized":"2024-04-16T19:38:29.513984+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'30","last_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_deep_scrub":"53'30","last_deep_scrub_stamp":"2024-04-16T19:38:29.513910+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.513910+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:38:38.309746+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1708,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":77,"num_write":77,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.764970+0000","last_change":"2024-04-16T19:38:22.764970+0000","last_active":"2024-04-16T19:38:22.764970+0000","last_peered":"2024-04-16T19:38:22.764970+0000","last_clean":"2024-04-16T19:38:22.764970+0000","last_became_active":"2024-04-16T17:45:49.470990+0000","last_became_peered":"2024-04-16T17:45:49.470990+0000","last_unstale":"2024-04-16T19:38:22.764970+0000","last_undegraded":"2024-04-16T19:38:22.764970+0000","last_fullsized":"2024-04-16T19:38:22.764970+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:22.764883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.764883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:12:30.765316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"53'305","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.819258+0000","last_change":"2024-04-16T19:38:16.819258+0000","last_active":"2024-04-16T19:38:16.819258+0000","last_peered":"2024-04-16T19:38:16.819258+0000","last_clean":"2024-04-16T19:38:16.819258+0000","last_became_active":"2024-04-16T17:45:47.465422+0000","last_became_peered":"2024-04-16T17:45:47.465422+0000","last_unstale":"2024-04-16T19:38:16.819258+0000","last_undegraded":"2024-04-16T19:38:16.819258+0000","last_fullsized":"2024-04-16T19:38:16.819258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'305","last_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_deep_scrub":"53'305","last_deep_scrub_stamp":"2024-04-16T19:38:16.819127+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.819127+0000","objects_scrubbed":14,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:56.568944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":331,"num_read_kb":325,"num_write":525,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6851,"num_omap_keys":31,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"53'21","reported_seq":476,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.104753+0000","last_change":"2024-04-16T19:38:18.104753+0000","last_active":"2024-04-16T19:38:18.104753+0000","last_peered":"2024-04-16T19:38:18.104753+0000","last_clean":"2024-04-16T19:38:18.104753+0000","last_became_active":"2024-04-16T17:45:45.461494+0000","last_became_peered":"2024-04-16T17:45:45.461494+0000","last_unstale":"2024-04-16T19:38:18.104753+0000","last_undegraded":"2024-04-16T19:38:18.104753+0000","last_fullsized":"2024-04-16T19:38:18.104753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:18.104621+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.104621+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:22.649252+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":871,"num_read_kb":681,"num_write":110,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:35.102121+0000","last_change":"2024-04-16T19:39:35.102146+0000","last_active":"2024-04-16T19:39:35.102121+0000","last_peered":"2024-04-16T19:39:35.102121+0000","last_clean":"2024-04-16T19:39:35.102121+0000","last_became_active":"2024-04-16T17:45:10.393518+0000","last_became_peered":"2024-04-16T17:45:10.393518+0000","last_unstale":"2024-04-16T19:39:35.102121+0000","last_undegraded":"2024-04-16T19:39:35.102121+0000","last_fullsized":"2024-04-16T19:39:35.102121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:35.102056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:35.102056+0000","last_clean_scrub_stamp":"2024-04-16T19:39:35.102056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:40:54.702739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"53'119","reported_seq":308,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.037420+0000","last_change":"2024-04-16T19:39:27.037452+0000","last_active":"2024-04-16T19:39:27.037420+0000","last_peered":"2024-04-16T19:39:27.037420+0000","last_clean":"2024-04-16T19:39:27.037420+0000","last_became_active":"2024-04-16T17:44:21.163928+0000","last_became_peered":"2024-04-16T17:44:21.163928+0000","last_unstale":"2024-04-16T19:39:27.037420+0000","last_undegraded":"2024-04-16T19:39:27.037420+0000","last_fullsized":"2024-04-16T19:39:27.037420+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'119","last_scrub_stamp":"2024-04-16T19:39:27.037356+0000","last_deep_scrub":"53'119","last_deep_scrub_stamp":"2024-04-16T19:39:27.037356+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.037356+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:22.390941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:29.527076+0000","last_change":"2024-04-16T19:39:29.527099+0000","last_active":"2024-04-16T19:39:29.527076+0000","last_peered":"2024-04-16T19:39:29.527076+0000","last_clean":"2024-04-16T19:39:29.527076+0000","last_became_active":"2024-04-16T17:44:22.167560+0000","last_became_peered":"2024-04-16T17:44:22.167560+0000","last_unstale":"2024-04-16T19:39:29.527076+0000","last_undegraded":"2024-04-16T19:39:29.527076+0000","last_fullsized":"2024-04-16T19:39:29.527076+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:29.527009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:29.527009+0000","last_clean_scrub_stamp":"2024-04-16T19:39:29.527009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:24.165138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.877865+0000","last_change":"2024-04-16T19:39:23.877865+0000","last_active":"2024-04-16T19:39:23.877865+0000","last_peered":"2024-04-16T19:39:23.877865+0000","last_clean":"2024-04-16T19:39:23.877865+0000","last_became_active":"2024-04-16T17:45:08.387296+0000","last_became_peered":"2024-04-16T17:45:08.387296+0000","last_unstale":"2024-04-16T19:39:23.877865+0000","last_undegraded":"2024-04-16T19:39:23.877865+0000","last_fullsized":"2024-04-16T19:39:23.877865+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.877727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.877727+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.877727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:59.064866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.207941+0000","last_change":"2024-04-16T19:39:06.207962+0000","last_active":"2024-04-16T19:39:06.207941+0000","last_peered":"2024-04-16T19:39:06.207941+0000","last_clean":"2024-04-16T19:39:06.207941+0000","last_became_active":"2024-04-16T17:45:20.411961+0000","last_became_peered":"2024-04-16T17:45:20.411961+0000","last_unstale":"2024-04-16T19:39:06.207941+0000","last_undegraded":"2024-04-16T19:39:06.207941+0000","last_fullsized":"2024-04-16T19:39:06.207941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.207880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.207880+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.207880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:54.646044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.7","version":"53'77","reported_seq":255,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.827843+0000","last_change":"2024-04-16T19:39:01.827876+0000","last_active":"2024-04-16T19:39:01.827843+0000","last_peered":"2024-04-16T19:39:01.827843+0000","last_clean":"2024-04-16T19:39:01.827843+0000","last_became_active":"2024-04-16T17:45:22.415281+0000","last_became_peered":"2024-04-16T17:45:22.415281+0000","last_unstale":"2024-04-16T19:39:01.827843+0000","last_undegraded":"2024-04-16T19:39:01.827843+0000","last_fullsized":"2024-04-16T19:39:01.827843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'77","last_scrub_stamp":"2024-04-16T19:39:01.827783+0000","last_deep_scrub":"53'77","last_deep_scrub_stamp":"2024-04-16T19:39:01.827783+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.827783+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:22.538522+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":112,"num_write":72,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.347215+0000","last_change":"2024-04-16T19:38:55.347237+0000","last_active":"2024-04-16T19:38:55.347215+0000","last_peered":"2024-04-16T19:38:55.347215+0000","last_clean":"2024-04-16T19:38:55.347215+0000","last_became_active":"2024-04-16T17:45:24.421786+0000","last_became_peered":"2024-04-16T17:45:24.421786+0000","last_unstale":"2024-04-16T19:38:55.347215+0000","last_undegraded":"2024-04-16T19:38:55.347215+0000","last_fullsized":"2024-04-16T19:38:55.347215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:55.347148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:55.347148+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.347148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:24.682592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.795949+0000","last_change":"2024-04-16T19:38:33.795974+0000","last_active":"2024-04-16T19:38:33.795949+0000","last_peered":"2024-04-16T19:38:33.795949+0000","last_clean":"2024-04-16T19:38:33.795949+0000","last_became_active":"2024-04-16T17:45:26.438635+0000","last_became_peered":"2024-04-16T17:45:26.438635+0000","last_unstale":"2024-04-16T19:38:33.795949+0000","last_undegraded":"2024-04-16T19:38:33.795949+0000","last_fullsized":"2024-04-16T19:38:33.795949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.795883+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.795883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:54.984835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.015541+0000","last_change":"2024-04-16T19:39:26.015566+0000","last_active":"2024-04-16T19:39:26.015541+0000","last_peered":"2024-04-16T19:39:26.015541+0000","last_clean":"2024-04-16T19:39:26.015541+0000","last_became_active":"2024-04-16T18:09:02.168661+0000","last_became_peered":"2024-04-16T18:09:02.168661+0000","last_unstale":"2024-04-16T19:39:26.015541+0000","last_undegraded":"2024-04-16T19:39:26.015541+0000","last_fullsized":"2024-04-16T19:39:26.015541+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.015466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.015466+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.015466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:04:56.936664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.c","version":"53'199","reported_seq":2085,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.357054+0000","last_change":"2024-04-16T19:39:04.357096+0000","last_active":"2024-04-16T19:39:04.357054+0000","last_peered":"2024-04-16T19:39:04.357054+0000","last_clean":"2024-04-16T19:39:04.357054+0000","last_became_active":"2024-04-16T17:46:25.527353+0000","last_became_peered":"2024-04-16T17:46:25.527353+0000","last_unstale":"2024-04-16T19:39:04.357054+0000","last_undegraded":"2024-04-16T19:39:04.357054+0000","last_fullsized":"2024-04-16T19:39:04.357054+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'199","last_scrub_stamp":"2024-04-16T19:39:04.356992+0000","last_deep_scrub":"53'199","last_deep_scrub_stamp":"2024-04-16T19:39:04.356992+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.356992+0000","objects_scrubbed":49,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:18.001011+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":2980,"num_read_kb":3309,"num_write":220,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12625,"num_omap_keys":53,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.785219+0000","last_change":"2024-04-16T19:39:02.785219+0000","last_active":"2024-04-16T19:39:02.785219+0000","last_peered":"2024-04-16T19:39:02.785219+0000","last_clean":"2024-04-16T19:39:02.785219+0000","last_became_active":"2024-04-16T17:46:17.514047+0000","last_became_peered":"2024-04-16T17:46:17.514047+0000","last_unstale":"2024-04-16T19:39:02.785219+0000","last_undegraded":"2024-04-16T19:39:02.785219+0000","last_fullsized":"2024-04-16T19:39:02.785219+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.785101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.785101+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.785101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:32.120546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"53'7","reported_seq":113,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.346772+0000","last_change":"2024-04-16T19:38:42.346811+0000","last_active":"2024-04-16T19:38:42.346772+0000","last_peered":"2024-04-16T19:38:42.346772+0000","last_clean":"2024-04-16T19:38:42.346772+0000","last_became_active":"2024-04-16T17:45:51.480561+0000","last_became_peered":"2024-04-16T17:45:51.480561+0000","last_unstale":"2024-04-16T19:38:42.346772+0000","last_undegraded":"2024-04-16T19:38:42.346772+0000","last_fullsized":"2024-04-16T19:38:42.346772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:42.346708+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.346708+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:40:50.944060+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"53'652","reported_seq":2353,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.132401+0000","last_change":"2024-04-16T19:38:32.132432+0000","last_active":"2024-04-16T19:38:32.132401+0000","last_peered":"2024-04-16T19:38:32.132401+0000","last_clean":"2024-04-16T19:38:32.132401+0000","last_became_active":"2024-04-16T17:45:49.469561+0000","last_became_peered":"2024-04-16T17:45:49.469561+0000","last_unstale":"2024-04-16T19:38:32.132401+0000","last_undegraded":"2024-04-16T19:38:32.132401+0000","last_fullsized":"2024-04-16T19:38:32.132401+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:32.132341+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.132341+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:31:57.828052+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.8","version":"53'465","reported_seq":770,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.378097+0000","last_change":"2024-04-16T19:38:22.378097+0000","last_active":"2024-04-16T19:38:22.378097+0000","last_peered":"2024-04-16T19:38:22.378097+0000","last_clean":"2024-04-16T19:38:22.378097+0000","last_became_active":"2024-04-16T17:45:47.464987+0000","last_became_peered":"2024-04-16T17:45:47.464987+0000","last_unstale":"2024-04-16T19:38:22.378097+0000","last_undegraded":"2024-04-16T19:38:22.378097+0000","last_fullsized":"2024-04-16T19:38:22.378097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'465","last_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_deep_scrub":"53'465","last_deep_scrub_stamp":"2024-04-16T19:38:22.378008+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.378008+0000","objects_scrubbed":26,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:24.892034+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":482,"num_read_kb":466,"num_write":737,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"53'22","reported_seq":559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.329830+0000","last_change":"2024-04-16T19:38:21.329929+0000","last_active":"2024-04-16T19:38:21.329830+0000","last_peered":"2024-04-16T19:38:21.329830+0000","last_clean":"2024-04-16T19:38:21.329830+0000","last_became_active":"2024-04-16T17:45:45.460336+0000","last_became_peered":"2024-04-16T17:45:45.460336+0000","last_unstale":"2024-04-16T19:38:21.329830+0000","last_undegraded":"2024-04-16T19:38:21.329830+0000","last_fullsized":"2024-04-16T19:38:21.329830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:21.329754+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.329754+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:26.751591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1071,"num_read_kb":902,"num_write":132,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.411035+0000","last_change":"2024-04-16T19:39:12.411055+0000","last_active":"2024-04-16T19:39:12.411035+0000","last_peered":"2024-04-16T19:39:12.411035+0000","last_clean":"2024-04-16T19:39:12.411035+0000","last_became_active":"2024-04-16T17:45:10.396525+0000","last_became_peered":"2024-04-16T17:45:10.396525+0000","last_unstale":"2024-04-16T19:39:12.411035+0000","last_undegraded":"2024-04-16T19:39:12.411035+0000","last_fullsized":"2024-04-16T19:39:12.411035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.410979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.410979+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.410979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:14.912580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.079562+0000","last_change":"2024-04-16T19:39:28.079584+0000","last_active":"2024-04-16T19:39:28.079562+0000","last_peered":"2024-04-16T19:39:28.079562+0000","last_clean":"2024-04-16T19:39:28.079562+0000","last_became_active":"2024-04-16T17:44:22.168077+0000","last_became_peered":"2024-04-16T17:44:22.168077+0000","last_unstale":"2024-04-16T19:39:28.079562+0000","last_undegraded":"2024-04-16T19:39:28.079562+0000","last_fullsized":"2024-04-16T19:39:28.079562+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.079498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.079498+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.079498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:22.717628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.720009+0000","last_change":"2024-04-16T19:38:29.720009+0000","last_active":"2024-04-16T19:38:29.720009+0000","last_peered":"2024-04-16T19:38:29.720009+0000","last_clean":"2024-04-16T19:38:29.720009+0000","last_became_active":"2024-04-16T17:46:16.500049+0000","last_became_peered":"2024-04-16T17:46:16.500049+0000","last_unstale":"2024-04-16T19:38:29.720009+0000","last_undegraded":"2024-04-16T19:38:29.720009+0000","last_fullsized":"2024-04-16T19:38:29.720009+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.719912+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.719912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:15:00.040596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"53'16","reported_seq":594,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.755505+0000","last_change":"2024-04-16T19:39:07.755557+0000","last_active":"2024-04-16T19:39:07.755505+0000","last_peered":"2024-04-16T19:39:07.755505+0000","last_clean":"2024-04-16T19:39:07.755505+0000","last_became_active":"2024-04-16T17:45:20.412003+0000","last_became_peered":"2024-04-16T17:45:20.412003+0000","last_unstale":"2024-04-16T19:39:07.755505+0000","last_undegraded":"2024-04-16T19:39:07.755505+0000","last_fullsized":"2024-04-16T19:39:07.755505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:39:07.755429+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:39:07.755429+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.755429+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:06:51.807538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1599,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":452,"num_write":20,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"53'187","reported_seq":1686,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.796149+0000","last_change":"2024-04-16T19:38:59.796192+0000","last_active":"2024-04-16T19:38:59.796149+0000","last_peered":"2024-04-16T19:38:59.796149+0000","last_clean":"2024-04-16T19:38:59.796149+0000","last_became_active":"2024-04-16T17:45:22.412315+0000","last_became_peered":"2024-04-16T17:45:22.412315+0000","last_unstale":"2024-04-16T19:38:59.796149+0000","last_undegraded":"2024-04-16T19:38:59.796149+0000","last_fullsized":"2024-04-16T19:38:59.796149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'187","last_scrub_stamp":"2024-04-16T19:38:59.796087+0000","last_deep_scrub":"53'187","last_deep_scrub_stamp":"2024-04-16T19:38:59.796087+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.796087+0000","objects_scrubbed":10,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:02:23.701420+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":279,"num_read_kb":264,"num_write":170,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.405296+0000","last_change":"2024-04-16T19:38:51.405321+0000","last_active":"2024-04-16T19:38:51.405296+0000","last_peered":"2024-04-16T19:38:51.405296+0000","last_clean":"2024-04-16T19:38:51.405296+0000","last_became_active":"2024-04-16T17:45:24.422710+0000","last_became_peered":"2024-04-16T17:45:24.422710+0000","last_unstale":"2024-04-16T19:38:51.405296+0000","last_undegraded":"2024-04-16T19:38:51.405296+0000","last_fullsized":"2024-04-16T19:38:51.405296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:51.405235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:51.405235+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.405235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:58.035377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.744953+0000","last_change":"2024-04-16T19:38:25.744976+0000","last_active":"2024-04-16T19:38:25.744953+0000","last_peered":"2024-04-16T19:38:25.744953+0000","last_clean":"2024-04-16T19:38:25.744953+0000","last_became_active":"2024-04-16T17:45:26.847260+0000","last_became_peered":"2024-04-16T17:45:26.847260+0000","last_unstale":"2024-04-16T19:38:25.744953+0000","last_undegraded":"2024-04-16T19:38:25.744953+0000","last_fullsized":"2024-04-16T19:38:25.744953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.744882+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.744882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:08:25.114426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:41.584681+0000","last_change":"2024-04-16T19:39:41.584702+0000","last_active":"2024-04-16T19:39:41.584681+0000","last_peered":"2024-04-16T19:39:41.584681+0000","last_clean":"2024-04-16T19:39:41.584681+0000","last_became_active":"2024-04-16T18:09:02.171550+0000","last_became_peered":"2024-04-16T18:09:02.171550+0000","last_unstale":"2024-04-16T19:39:41.584681+0000","last_undegraded":"2024-04-16T19:39:41.584681+0000","last_fullsized":"2024-04-16T19:39:41.584681+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:41.584617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:41.584617+0000","last_clean_scrub_stamp":"2024-04-16T19:39:41.584617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:00:19.945139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"53'181","reported_seq":1654,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.691437+0000","last_change":"2024-04-16T19:39:10.691492+0000","last_active":"2024-04-16T19:39:10.691437+0000","last_peered":"2024-04-16T19:39:10.691437+0000","last_clean":"2024-04-16T19:39:10.691437+0000","last_became_active":"2024-04-16T17:46:25.524283+0000","last_became_peered":"2024-04-16T17:46:25.524283+0000","last_unstale":"2024-04-16T19:39:10.691437+0000","last_undegraded":"2024-04-16T19:39:10.691437+0000","last_fullsized":"2024-04-16T19:39:10.691437+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'181","last_scrub_stamp":"2024-04-16T19:39:10.691378+0000","last_deep_scrub":"53'181","last_deep_scrub_stamp":"2024-04-16T19:39:10.691378+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.691378+0000","objects_scrubbed":44,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:02.946071+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2235,"num_read_kb":2254,"num_write":191,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10471,"num_omap_keys":42,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.774336+0000","last_change":"2024-04-16T19:38:58.774358+0000","last_active":"2024-04-16T19:38:58.774336+0000","last_peered":"2024-04-16T19:38:58.774336+0000","last_clean":"2024-04-16T19:38:58.774336+0000","last_became_active":"2024-04-16T17:46:17.512219+0000","last_became_peered":"2024-04-16T17:46:17.512219+0000","last_unstale":"2024-04-16T19:38:58.774336+0000","last_undegraded":"2024-04-16T19:38:58.774336+0000","last_fullsized":"2024-04-16T19:38:58.774336+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:58.774273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:58.774273+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.774273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:17:34.946023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.f","version":"53'28","reported_seq":206,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.914339+0000","last_change":"2024-04-16T19:38:41.914339+0000","last_active":"2024-04-16T19:38:41.914339+0000","last_peered":"2024-04-16T19:38:41.914339+0000","last_clean":"2024-04-16T19:38:41.914339+0000","last_became_active":"2024-04-16T17:45:51.482535+0000","last_became_peered":"2024-04-16T17:45:51.482535+0000","last_unstale":"2024-04-16T19:38:41.914339+0000","last_undegraded":"2024-04-16T19:38:41.914339+0000","last_fullsized":"2024-04-16T19:38:41.914339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'28","last_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_deep_scrub":"53'28","last_deep_scrub_stamp":"2024-04-16T19:38:41.914241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.914241+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:38.893326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":207,"num_read_kb":172,"num_write":42,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":60,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":105,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.138191+0000","last_change":"2024-04-16T19:38:31.138209+0000","last_active":"2024-04-16T19:38:31.138191+0000","last_peered":"2024-04-16T19:38:31.138191+0000","last_clean":"2024-04-16T19:38:31.138191+0000","last_became_active":"2024-04-16T17:45:49.469533+0000","last_became_peered":"2024-04-16T17:45:49.469533+0000","last_unstale":"2024-04-16T19:38:31.138191+0000","last_undegraded":"2024-04-16T19:38:31.138191+0000","last_fullsized":"2024-04-16T19:38:31.138191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.138139+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.138139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:01.713966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.9","version":"53'4956","reported_seq":7445,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.900157+0000","last_change":"2024-04-16T19:38:14.900157+0000","last_active":"2024-04-16T19:38:14.900157+0000","last_peered":"2024-04-16T19:38:14.900157+0000","last_clean":"2024-04-16T19:38:14.900157+0000","last_became_active":"2024-04-16T17:45:47.458881+0000","last_became_peered":"2024-04-16T17:45:47.458881+0000","last_unstale":"2024-04-16T19:38:14.900157+0000","last_undegraded":"2024-04-16T19:38:14.900157+0000","last_fullsized":"2024-04-16T19:38:14.900157+0000","mapping_epoch":33,"log_start":"53'3200","ondisk_log_start":"53'3200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4956","last_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_deep_scrub":"53'4956","last_deep_scrub_stamp":"2024-04-16T19:38:14.900021+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.900021+0000","objects_scrubbed":21,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:17.433386+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":363,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":9401,"num_read_kb":9390,"num_write":5138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"53'10","reported_seq":272,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.858857+0000","last_change":"2024-04-16T19:38:11.858857+0000","last_active":"2024-04-16T19:38:11.858857+0000","last_peered":"2024-04-16T19:38:11.858857+0000","last_clean":"2024-04-16T19:38:11.858857+0000","last_became_active":"2024-04-16T17:45:45.465589+0000","last_became_peered":"2024-04-16T17:45:45.465589+0000","last_unstale":"2024-04-16T19:38:11.858857+0000","last_undegraded":"2024-04-16T19:38:11.858857+0000","last_fullsized":"2024-04-16T19:38:11.858857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:11.858749+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.858749+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:25:54.104521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":357,"num_read_kb":331,"num_write":53,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.730779+0000","last_change":"2024-04-16T19:39:04.730826+0000","last_active":"2024-04-16T19:39:04.730779+0000","last_peered":"2024-04-16T19:39:04.730779+0000","last_clean":"2024-04-16T19:39:04.730779+0000","last_became_active":"2024-04-16T17:45:10.400732+0000","last_became_peered":"2024-04-16T17:45:10.400732+0000","last_unstale":"2024-04-16T19:39:04.730779+0000","last_undegraded":"2024-04-16T19:39:04.730779+0000","last_fullsized":"2024-04-16T19:39:04.730779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.730692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.730692+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.730692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:56.328928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.085491+0000","last_change":"2024-04-16T19:39:11.085515+0000","last_active":"2024-04-16T19:39:11.085491+0000","last_peered":"2024-04-16T19:39:11.085491+0000","last_clean":"2024-04-16T19:39:11.085491+0000","last_became_active":"2024-04-16T17:44:22.168070+0000","last_became_peered":"2024-04-16T17:44:22.168070+0000","last_unstale":"2024-04-16T19:39:11.085491+0000","last_undegraded":"2024-04-16T19:39:11.085491+0000","last_fullsized":"2024-04-16T19:39:11.085491+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.085428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.085428+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.085428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:02:05.591134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":149,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.843313+0000","last_change":"2024-04-16T19:39:20.843313+0000","last_active":"2024-04-16T19:39:20.843313+0000","last_peered":"2024-04-16T19:39:20.843313+0000","last_clean":"2024-04-16T19:39:20.843313+0000","last_became_active":"2024-04-16T17:45:08.382228+0000","last_became_peered":"2024-04-16T17:45:08.382228+0000","last_unstale":"2024-04-16T19:39:20.843313+0000","last_undegraded":"2024-04-16T19:39:20.843313+0000","last_fullsized":"2024-04-16T19:39:20.843313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.843221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.843221+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.843221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:50.867819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"53'4","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.087742+0000","last_change":"2024-04-16T19:39:07.087798+0000","last_active":"2024-04-16T19:39:07.087742+0000","last_peered":"2024-04-16T19:39:07.087742+0000","last_clean":"2024-04-16T19:39:07.087742+0000","last_became_active":"2024-04-16T17:45:20.413191+0000","last_became_peered":"2024-04-16T17:45:20.413191+0000","last_unstale":"2024-04-16T19:39:07.087742+0000","last_undegraded":"2024-04-16T19:39:07.087742+0000","last_fullsized":"2024-04-16T19:39:07.087742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:07.087664+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:07.087664+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.087664+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:46.209570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"53'159","reported_seq":1628,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.803218+0000","last_change":"2024-04-16T19:38:59.803257+0000","last_active":"2024-04-16T19:38:59.803218+0000","last_peered":"2024-04-16T19:38:59.803218+0000","last_clean":"2024-04-16T19:38:59.803218+0000","last_became_active":"2024-04-16T17:45:22.415928+0000","last_became_peered":"2024-04-16T17:45:22.415928+0000","last_unstale":"2024-04-16T19:38:59.803218+0000","last_undegraded":"2024-04-16T19:38:59.803218+0000","last_fullsized":"2024-04-16T19:38:59.803218+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:38:59.803156+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:38:59.803156+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.803156+0000","objects_scrubbed":8,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:11.871497+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":220,"num_read_kb":212,"num_write":145,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.325392+0000","last_change":"2024-04-16T19:38:35.325421+0000","last_active":"2024-04-16T19:38:35.325392+0000","last_peered":"2024-04-16T19:38:35.325392+0000","last_clean":"2024-04-16T19:38:35.325392+0000","last_became_active":"2024-04-16T17:45:24.426237+0000","last_became_peered":"2024-04-16T17:45:24.426237+0000","last_unstale":"2024-04-16T19:38:35.325392+0000","last_undegraded":"2024-04-16T19:38:35.325392+0000","last_fullsized":"2024-04-16T19:38:35.325392+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.325323+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.325323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:35.441680+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.320446+0000","last_change":"2024-04-16T19:38:27.320467+0000","last_active":"2024-04-16T19:38:27.320446+0000","last_peered":"2024-04-16T19:38:27.320446+0000","last_clean":"2024-04-16T19:38:27.320446+0000","last_became_active":"2024-04-16T17:45:26.438938+0000","last_became_peered":"2024-04-16T17:45:26.438938+0000","last_unstale":"2024-04-16T19:38:27.320446+0000","last_undegraded":"2024-04-16T19:38:27.320446+0000","last_fullsized":"2024-04-16T19:38:27.320446+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.320384+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.320384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:47.178868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:39.148195+0000","last_change":"2024-04-16T19:39:39.148219+0000","last_active":"2024-04-16T19:39:39.148195+0000","last_peered":"2024-04-16T19:39:39.148195+0000","last_clean":"2024-04-16T19:39:39.148195+0000","last_became_active":"2024-04-16T18:09:02.169751+0000","last_became_peered":"2024-04-16T18:09:02.169751+0000","last_unstale":"2024-04-16T19:39:39.148195+0000","last_undegraded":"2024-04-16T19:39:39.148195+0000","last_fullsized":"2024-04-16T19:39:39.148195+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:39.148130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:39.148130+0000","last_clean_scrub_stamp":"2024-04-16T19:39:39.148130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:35:20.781693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.e","version":"53'189","reported_seq":2092,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.387157+0000","last_change":"2024-04-16T19:38:46.387157+0000","last_active":"2024-04-16T19:38:46.387157+0000","last_peered":"2024-04-16T19:38:46.387157+0000","last_clean":"2024-04-16T19:38:46.387157+0000","last_became_active":"2024-04-16T17:46:25.529779+0000","last_became_peered":"2024-04-16T17:46:25.529779+0000","last_unstale":"2024-04-16T19:38:46.387157+0000","last_undegraded":"2024-04-16T19:38:46.387157+0000","last_fullsized":"2024-04-16T19:38:46.387157+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'189","last_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_deep_scrub":"53'189","last_deep_scrub_stamp":"2024-04-16T19:38:46.387038+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.387038+0000","objects_scrubbed":54,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:22.550486+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":3052,"num_read_kb":3000,"num_write":189,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12153,"num_omap_keys":50,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.474066+0000","last_change":"2024-04-16T19:38:30.474066+0000","last_active":"2024-04-16T19:38:30.474066+0000","last_peered":"2024-04-16T19:38:30.474066+0000","last_clean":"2024-04-16T19:38:30.474066+0000","last_became_active":"2024-04-16T17:46:17.507730+0000","last_became_peered":"2024-04-16T17:46:17.507730+0000","last_unstale":"2024-04-16T19:38:30.474066+0000","last_undegraded":"2024-04-16T19:38:30.474066+0000","last_fullsized":"2024-04-16T19:38:30.474066+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.473977+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.473977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:10.223794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"53'4","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.365553+0000","last_change":"2024-04-16T19:38:41.365583+0000","last_active":"2024-04-16T19:38:41.365553+0000","last_peered":"2024-04-16T19:38:41.365553+0000","last_clean":"2024-04-16T19:38:41.365553+0000","last_became_active":"2024-04-16T17:45:51.483935+0000","last_became_peered":"2024-04-16T17:45:51.483935+0000","last_unstale":"2024-04-16T19:38:41.365553+0000","last_undegraded":"2024-04-16T19:38:41.365553+0000","last_fullsized":"2024-04-16T19:38:41.365553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:41.365486+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.365486+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:10.903056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":739,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":60,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.088262+0000","last_change":"2024-04-16T19:38:21.088285+0000","last_active":"2024-04-16T19:38:21.088262+0000","last_peered":"2024-04-16T19:38:21.088262+0000","last_clean":"2024-04-16T19:38:21.088262+0000","last_became_active":"2024-04-16T17:45:49.468823+0000","last_became_peered":"2024-04-16T17:45:49.468823+0000","last_unstale":"2024-04-16T19:38:21.088262+0000","last_undegraded":"2024-04-16T19:38:21.088262+0000","last_fullsized":"2024-04-16T19:38:21.088262+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:21.088193+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.088193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:58.302179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"53'503","reported_seq":981,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.479844+0000","last_change":"2024-04-16T19:38:11.479844+0000","last_active":"2024-04-16T19:38:11.479844+0000","last_peered":"2024-04-16T19:38:11.479844+0000","last_clean":"2024-04-16T19:38:11.479844+0000","last_became_active":"2024-04-16T17:45:47.462762+0000","last_became_peered":"2024-04-16T17:45:47.462762+0000","last_unstale":"2024-04-16T19:38:11.479844+0000","last_undegraded":"2024-04-16T19:38:11.479844+0000","last_fullsized":"2024-04-16T19:38:11.479844+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'503","last_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_deep_scrub":"53'503","last_deep_scrub_stamp":"2024-04-16T19:38:11.479730+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.479730+0000","objects_scrubbed":31,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:23:50.543348+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":957,"num_read_kb":804,"num_write":500,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7030,"num_omap_keys":32,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.9","version":"53'12","reported_seq":434,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.241107+0000","last_change":"2024-04-16T19:38:17.241107+0000","last_active":"2024-04-16T19:38:17.241107+0000","last_peered":"2024-04-16T19:38:17.241107+0000","last_clean":"2024-04-16T19:38:17.241107+0000","last_became_active":"2024-04-16T17:45:45.463402+0000","last_became_peered":"2024-04-16T17:45:45.463402+0000","last_unstale":"2024-04-16T19:38:17.241107+0000","last_undegraded":"2024-04-16T19:38:17.241107+0000","last_fullsized":"2024-04-16T19:38:17.241107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:17.241004+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.241004+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:31.290983+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":876,"num_read_kb":564,"num_write":58,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.750194+0000","last_change":"2024-04-16T19:39:05.750194+0000","last_active":"2024-04-16T19:39:05.750194+0000","last_peered":"2024-04-16T19:39:05.750194+0000","last_clean":"2024-04-16T19:39:05.750194+0000","last_became_active":"2024-04-16T17:45:10.396414+0000","last_became_peered":"2024-04-16T17:45:10.396414+0000","last_unstale":"2024-04-16T19:39:05.750194+0000","last_undegraded":"2024-04-16T19:39:05.750194+0000","last_fullsized":"2024-04-16T19:39:05.750194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:05.750095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:05.750095+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.750095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:53:07.126866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.562681+0000","last_change":"2024-04-16T19:39:28.562707+0000","last_active":"2024-04-16T19:39:28.562681+0000","last_peered":"2024-04-16T19:39:28.562681+0000","last_clean":"2024-04-16T19:39:28.562681+0000","last_became_active":"2024-04-16T17:44:22.167581+0000","last_became_peered":"2024-04-16T17:44:22.167581+0000","last_unstale":"2024-04-16T19:39:28.562681+0000","last_undegraded":"2024-04-16T19:39:28.562681+0000","last_fullsized":"2024-04-16T19:39:28.562681+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.562618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.562618+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.562618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:23.916203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.138466+0000","last_change":"2024-04-16T19:39:14.138466+0000","last_active":"2024-04-16T19:39:14.138466+0000","last_peered":"2024-04-16T19:39:14.138466+0000","last_clean":"2024-04-16T19:39:14.138466+0000","last_became_active":"2024-04-16T17:45:08.382083+0000","last_became_peered":"2024-04-16T17:45:08.382083+0000","last_unstale":"2024-04-16T19:39:14.138466+0000","last_undegraded":"2024-04-16T19:39:14.138466+0000","last_fullsized":"2024-04-16T19:39:14.138466+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.138382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.138382+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.138382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:26.206722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"53'4","reported_seq":887,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:34.452365+0000","last_change":"2024-04-16T19:39:34.452394+0000","last_active":"2024-04-16T19:39:34.452365+0000","last_peered":"2024-04-16T19:39:34.452365+0000","last_clean":"2024-04-16T19:39:34.452365+0000","last_became_active":"2024-04-16T17:45:20.406645+0000","last_became_peered":"2024-04-16T17:45:20.406645+0000","last_unstale":"2024-04-16T19:39:34.452365+0000","last_undegraded":"2024-04-16T19:39:34.452365+0000","last_fullsized":"2024-04-16T19:39:34.452365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:34.452300+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:34.452300+0000","last_clean_scrub_stamp":"2024-04-16T19:39:34.452300+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:09.465277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1035,"num_read_kb":1033,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"53'150","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.723402+0000","last_change":"2024-04-16T19:38:56.723441+0000","last_active":"2024-04-16T19:38:56.723402+0000","last_peered":"2024-04-16T19:38:56.723402+0000","last_clean":"2024-04-16T19:38:56.723402+0000","last_became_active":"2024-04-16T17:45:22.417544+0000","last_became_peered":"2024-04-16T17:45:22.417544+0000","last_unstale":"2024-04-16T19:38:56.723402+0000","last_undegraded":"2024-04-16T19:38:56.723402+0000","last_fullsized":"2024-04-16T19:38:56.723402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'150","last_scrub_stamp":"2024-04-16T19:38:56.723332+0000","last_deep_scrub":"53'150","last_deep_scrub_stamp":"2024-04-16T19:38:56.723332+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.723332+0000","objects_scrubbed":6,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:51.229039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":216,"num_read_kb":210,"num_write":144,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":123,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.898210+0000","last_change":"2024-04-16T19:38:35.898255+0000","last_active":"2024-04-16T19:38:35.898210+0000","last_peered":"2024-04-16T19:38:35.898210+0000","last_clean":"2024-04-16T19:38:35.898210+0000","last_became_active":"2024-04-16T17:45:24.430600+0000","last_became_peered":"2024-04-16T17:45:24.430600+0000","last_unstale":"2024-04-16T19:38:35.898210+0000","last_undegraded":"2024-04-16T19:38:35.898210+0000","last_fullsized":"2024-04-16T19:38:35.898210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.898130+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.898130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:07:42.528272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":119,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.791834+0000","last_change":"2024-04-16T19:38:39.791854+0000","last_active":"2024-04-16T19:38:39.791834+0000","last_peered":"2024-04-16T19:38:39.791834+0000","last_clean":"2024-04-16T19:38:39.791834+0000","last_became_active":"2024-04-16T17:45:26.432726+0000","last_became_peered":"2024-04-16T17:45:26.432726+0000","last_unstale":"2024-04-16T19:38:39.791834+0000","last_undegraded":"2024-04-16T19:38:39.791834+0000","last_fullsized":"2024-04-16T19:38:39.791834+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.791771+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.791771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:45.969208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:42.634323+0000","last_change":"2024-04-16T19:39:42.634347+0000","last_active":"2024-04-16T19:39:42.634323+0000","last_peered":"2024-04-16T19:39:42.634323+0000","last_clean":"2024-04-16T19:39:42.634323+0000","last_became_active":"2024-04-16T18:09:02.175870+0000","last_became_peered":"2024-04-16T18:09:02.175870+0000","last_unstale":"2024-04-16T19:39:42.634323+0000","last_undegraded":"2024-04-16T19:39:42.634323+0000","last_fullsized":"2024-04-16T19:39:42.634323+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:42.634253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:42.634253+0000","last_clean_scrub_stamp":"2024-04-16T19:39:42.634253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:17.647231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"53'187","reported_seq":1762,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:38.634309+0000","last_change":"2024-04-16T19:39:38.634364+0000","last_active":"2024-04-16T19:39:38.634309+0000","last_peered":"2024-04-16T19:39:38.634309+0000","last_clean":"2024-04-16T19:39:38.634309+0000","last_became_active":"2024-04-16T17:47:16.562743+0000","last_became_peered":"2024-04-16T17:47:16.562743+0000","last_unstale":"2024-04-16T19:39:38.634309+0000","last_undegraded":"2024-04-16T19:39:38.634309+0000","last_fullsized":"2024-04-16T19:39:38.634309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'187","last_scrub_stamp":"2024-04-16T19:39:38.634243+0000","last_deep_scrub":"53'187","last_deep_scrub_stamp":"2024-04-16T19:39:38.634243+0000","last_clean_scrub_stamp":"2024-04-16T19:39:38.634243+0000","objects_scrubbed":41,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:41:13.058074+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2556,"num_read_kb":2500,"num_write":213,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13283,"num_omap_keys":53,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":91,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.839203+0000","last_change":"2024-04-16T19:38:39.839203+0000","last_active":"2024-04-16T19:38:39.839203+0000","last_peered":"2024-04-16T19:38:39.839203+0000","last_clean":"2024-04-16T19:38:39.839203+0000","last_became_active":"2024-04-16T17:46:17.507121+0000","last_became_peered":"2024-04-16T17:46:17.507121+0000","last_unstale":"2024-04-16T19:38:39.839203+0000","last_undegraded":"2024-04-16T19:38:39.839203+0000","last_fullsized":"2024-04-16T19:38:39.839203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:39.839112+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.839112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:23.811211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"53'14","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.080454+0000","last_change":"2024-04-16T19:38:28.080454+0000","last_active":"2024-04-16T19:38:28.080454+0000","last_peered":"2024-04-16T19:38:28.080454+0000","last_clean":"2024-04-16T19:38:28.080454+0000","last_became_active":"2024-04-16T17:45:51.479574+0000","last_became_peered":"2024-04-16T17:45:51.479574+0000","last_unstale":"2024-04-16T19:38:28.080454+0000","last_undegraded":"2024-04-16T19:38:28.080454+0000","last_fullsized":"2024-04-16T19:38:28.080454+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:28.080349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.080349+0000","objects_scrubbed":6,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:50:30.384618+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1511,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":60,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"53'652","reported_seq":2241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.085883+0000","last_change":"2024-04-16T19:38:17.085883+0000","last_active":"2024-04-16T19:38:17.085883+0000","last_peered":"2024-04-16T19:38:17.085883+0000","last_clean":"2024-04-16T19:38:17.085883+0000","last_became_active":"2024-04-16T17:45:49.468469+0000","last_became_peered":"2024-04-16T17:45:49.468469+0000","last_unstale":"2024-04-16T19:38:17.085883+0000","last_undegraded":"2024-04-16T19:38:17.085883+0000","last_fullsized":"2024-04-16T19:38:17.085883+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:17.085744+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.085744+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:55.082690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"53'364","reported_seq":672,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.518366+0000","last_change":"2024-04-16T19:38:17.518366+0000","last_active":"2024-04-16T19:38:17.518366+0000","last_peered":"2024-04-16T19:38:17.518366+0000","last_clean":"2024-04-16T19:38:17.518366+0000","last_became_active":"2024-04-16T17:45:47.460475+0000","last_became_peered":"2024-04-16T17:45:47.460475+0000","last_unstale":"2024-04-16T19:38:17.518366+0000","last_undegraded":"2024-04-16T19:38:17.518366+0000","last_fullsized":"2024-04-16T19:38:17.518366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'364","last_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_deep_scrub":"53'364","last_deep_scrub_stamp":"2024-04-16T19:38:17.518227+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.518227+0000","objects_scrubbed":20,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:19:39.484987+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":595,"num_read_kb":573,"num_write":475,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6810,"num_omap_keys":31,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.f","version":"53'21","reported_seq":470,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.711099+0000","last_change":"2024-04-16T19:38:25.711099+0000","last_active":"2024-04-16T19:38:25.711099+0000","last_peered":"2024-04-16T19:38:25.711099+0000","last_clean":"2024-04-16T19:38:25.711099+0000","last_became_active":"2024-04-16T17:45:45.461961+0000","last_became_peered":"2024-04-16T17:45:45.461961+0000","last_unstale":"2024-04-16T19:38:25.711099+0000","last_undegraded":"2024-04-16T19:38:25.711099+0000","last_fullsized":"2024-04-16T19:38:25.711099+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:25.710924+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.710924+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:51:00.685204+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":812,"num_read_kb":743,"num_write":106,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.759418+0000","last_change":"2024-04-16T19:39:00.759418+0000","last_active":"2024-04-16T19:39:00.759418+0000","last_peered":"2024-04-16T19:39:00.759418+0000","last_clean":"2024-04-16T19:39:00.759418+0000","last_became_active":"2024-04-16T17:45:10.399508+0000","last_became_peered":"2024-04-16T17:45:10.399508+0000","last_unstale":"2024-04-16T19:39:00.759418+0000","last_undegraded":"2024-04-16T19:39:00.759418+0000","last_fullsized":"2024-04-16T19:39:00.759418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:00.759325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:00.759325+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.759325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:46:22.814258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.578377+0000","last_change":"2024-04-16T19:39:25.578425+0000","last_active":"2024-04-16T19:39:25.578377+0000","last_peered":"2024-04-16T19:39:25.578377+0000","last_clean":"2024-04-16T19:39:25.578377+0000","last_became_active":"2024-04-16T17:45:08.386325+0000","last_became_peered":"2024-04-16T17:45:08.386325+0000","last_unstale":"2024-04-16T19:39:25.578377+0000","last_undegraded":"2024-04-16T19:39:25.578377+0000","last_fullsized":"2024-04-16T19:39:25.578377+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.578296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.578296+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.578296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:49:25.338094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.779384+0000","last_change":"2024-04-16T19:39:17.779426+0000","last_active":"2024-04-16T19:39:17.779384+0000","last_peered":"2024-04-16T19:39:17.779384+0000","last_clean":"2024-04-16T19:39:17.779384+0000","last_became_active":"2024-04-16T17:44:22.327146+0000","last_became_peered":"2024-04-16T17:44:22.327146+0000","last_unstale":"2024-04-16T19:39:17.779384+0000","last_undegraded":"2024-04-16T19:39:17.779384+0000","last_fullsized":"2024-04-16T19:39:17.779384+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.779310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.779310+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.779310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:04:48.700508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.376273+0000","last_change":"2024-04-16T19:39:06.376296+0000","last_active":"2024-04-16T19:39:06.376273+0000","last_peered":"2024-04-16T19:39:06.376273+0000","last_clean":"2024-04-16T19:39:06.376273+0000","last_became_active":"2024-04-16T17:45:20.414486+0000","last_became_peered":"2024-04-16T17:45:20.414486+0000","last_unstale":"2024-04-16T19:39:06.376273+0000","last_undegraded":"2024-04-16T19:39:06.376273+0000","last_fullsized":"2024-04-16T19:39:06.376273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.376208+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.376208+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.376208+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:35:12.585831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"53'168","reported_seq":390,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.365523+0000","last_change":"2024-04-16T19:39:01.365523+0000","last_active":"2024-04-16T19:39:01.365523+0000","last_peered":"2024-04-16T19:39:01.365523+0000","last_clean":"2024-04-16T19:39:01.365523+0000","last_became_active":"2024-04-16T17:45:22.416204+0000","last_became_peered":"2024-04-16T17:45:22.416204+0000","last_unstale":"2024-04-16T19:39:01.365523+0000","last_undegraded":"2024-04-16T19:39:01.365523+0000","last_fullsized":"2024-04-16T19:39:01.365523+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'168","last_scrub_stamp":"2024-04-16T19:39:01.365421+0000","last_deep_scrub":"53'168","last_deep_scrub_stamp":"2024-04-16T19:39:01.365421+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.365421+0000","objects_scrubbed":8,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:41.145407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":250,"num_read_kb":238,"num_write":160,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.382963+0000","last_change":"2024-04-16T19:38:47.382987+0000","last_active":"2024-04-16T19:38:47.382963+0000","last_peered":"2024-04-16T19:38:47.382963+0000","last_clean":"2024-04-16T19:38:47.382963+0000","last_became_active":"2024-04-16T17:45:24.424739+0000","last_became_peered":"2024-04-16T17:45:24.424739+0000","last_unstale":"2024-04-16T19:38:47.382963+0000","last_undegraded":"2024-04-16T19:38:47.382963+0000","last_fullsized":"2024-04-16T19:38:47.382963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.382901+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.382901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:43.042540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.343354+0000","last_change":"2024-04-16T19:38:23.343376+0000","last_active":"2024-04-16T19:38:23.343354+0000","last_peered":"2024-04-16T19:38:23.343354+0000","last_clean":"2024-04-16T19:38:23.343354+0000","last_became_active":"2024-04-16T17:45:26.849541+0000","last_became_peered":"2024-04-16T17:45:26.849541+0000","last_unstale":"2024-04-16T19:38:23.343354+0000","last_undegraded":"2024-04-16T19:38:23.343354+0000","last_fullsized":"2024-04-16T19:38:23.343354+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.343292+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.343292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:42.020915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.217069+0000","last_change":"2024-04-16T19:39:26.217092+0000","last_active":"2024-04-16T19:39:26.217069+0000","last_peered":"2024-04-16T19:39:26.217069+0000","last_clean":"2024-04-16T19:39:26.217069+0000","last_became_active":"2024-04-16T18:09:02.174907+0000","last_became_peered":"2024-04-16T18:09:02.174907+0000","last_unstale":"2024-04-16T19:39:26.217069+0000","last_undegraded":"2024-04-16T19:39:26.217069+0000","last_fullsized":"2024-04-16T19:39:26.217069+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.217000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.217000+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.217000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:25.961057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"53'133","reported_seq":1734,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:37.618079+0000","last_change":"2024-04-16T19:39:37.618126+0000","last_active":"2024-04-16T19:39:37.618079+0000","last_peered":"2024-04-16T19:39:37.618079+0000","last_clean":"2024-04-16T19:39:37.618079+0000","last_became_active":"2024-04-16T17:46:25.525409+0000","last_became_peered":"2024-04-16T17:46:25.525409+0000","last_unstale":"2024-04-16T19:39:37.618079+0000","last_undegraded":"2024-04-16T19:39:37.618079+0000","last_fullsized":"2024-04-16T19:39:37.618079+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'133","last_scrub_stamp":"2024-04-16T19:39:37.618011+0000","last_deep_scrub":"53'133","last_deep_scrub_stamp":"2024-04-16T19:39:37.618011+0000","last_clean_scrub_stamp":"2024-04-16T19:39:37.618011+0000","objects_scrubbed":34,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:10:31.419123+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":2562,"num_read_kb":2796,"num_write":138,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7851,"num_omap_keys":31,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.109454+0000","last_change":"2024-04-16T19:38:29.109454+0000","last_active":"2024-04-16T19:38:29.109454+0000","last_peered":"2024-04-16T19:38:29.109454+0000","last_clean":"2024-04-16T19:38:29.109454+0000","last_became_active":"2024-04-16T17:46:17.509082+0000","last_became_peered":"2024-04-16T17:46:17.509082+0000","last_unstale":"2024-04-16T19:38:29.109454+0000","last_undegraded":"2024-04-16T19:38:29.109454+0000","last_fullsized":"2024-04-16T19:38:29.109454+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.109370+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.109370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:33:03.453529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"53'12","reported_seq":134,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.361852+0000","last_change":"2024-04-16T19:38:49.361907+0000","last_active":"2024-04-16T19:38:49.361852+0000","last_peered":"2024-04-16T19:38:49.361852+0000","last_clean":"2024-04-16T19:38:49.361852+0000","last_became_active":"2024-04-16T17:45:51.478384+0000","last_became_peered":"2024-04-16T17:45:51.478384+0000","last_unstale":"2024-04-16T19:38:49.361852+0000","last_undegraded":"2024-04-16T19:38:49.361852+0000","last_fullsized":"2024-04-16T19:38:49.361852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:49.361782+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.361782+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:51.952616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":94,"num_read_kb":71,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.723050+0000","last_change":"2024-04-16T19:38:26.723073+0000","last_active":"2024-04-16T19:38:26.723050+0000","last_peered":"2024-04-16T19:38:26.723050+0000","last_clean":"2024-04-16T19:38:26.723050+0000","last_became_active":"2024-04-16T17:45:49.472386+0000","last_became_peered":"2024-04-16T17:45:49.472386+0000","last_unstale":"2024-04-16T19:38:26.723050+0000","last_undegraded":"2024-04-16T19:38:26.723050+0000","last_fullsized":"2024-04-16T19:38:26.723050+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.722978+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.722978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:34.382609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'523","reported_seq":865,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.541783+0000","last_change":"2024-04-16T19:38:13.541783+0000","last_active":"2024-04-16T19:38:13.541783+0000","last_peered":"2024-04-16T19:38:13.541783+0000","last_clean":"2024-04-16T19:38:13.541783+0000","last_became_active":"2024-04-16T17:45:47.461341+0000","last_became_peered":"2024-04-16T17:45:47.461341+0000","last_unstale":"2024-04-16T19:38:13.541783+0000","last_undegraded":"2024-04-16T19:38:13.541783+0000","last_fullsized":"2024-04-16T19:38:13.541783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'523","last_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_deep_scrub":"53'523","last_deep_scrub_stamp":"2024-04-16T19:38:13.541660+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.541660+0000","objects_scrubbed":23,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:50.755647+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":656,"num_read_kb":645,"num_write":772,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":21532,"num_omap_keys":98,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.e","version":"53'34","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.893657+0000","last_change":"2024-04-16T19:38:23.893744+0000","last_active":"2024-04-16T19:38:23.893657+0000","last_peered":"2024-04-16T19:38:23.893657+0000","last_clean":"2024-04-16T19:38:23.893657+0000","last_became_active":"2024-04-16T17:45:45.455644+0000","last_became_peered":"2024-04-16T17:45:45.455644+0000","last_unstale":"2024-04-16T19:38:23.893657+0000","last_undegraded":"2024-04-16T19:38:23.893657+0000","last_fullsized":"2024-04-16T19:38:23.893657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:23.893579+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.893579+0000","objects_scrubbed":11,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:25.142771+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":444,"num_read_kb":289,"num_write":172,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.359951+0000","last_change":"2024-04-16T19:39:15.359951+0000","last_active":"2024-04-16T19:39:15.359951+0000","last_peered":"2024-04-16T19:39:15.359951+0000","last_clean":"2024-04-16T19:39:15.359951+0000","last_became_active":"2024-04-16T17:45:10.392140+0000","last_became_peered":"2024-04-16T17:45:10.392140+0000","last_unstale":"2024-04-16T19:39:15.359951+0000","last_undegraded":"2024-04-16T19:39:15.359951+0000","last_fullsized":"2024-04-16T19:39:15.359951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.359847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.359847+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.359847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:01.414378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.807665+0000","last_change":"2024-04-16T19:39:21.807665+0000","last_active":"2024-04-16T19:39:21.807665+0000","last_peered":"2024-04-16T19:39:21.807665+0000","last_clean":"2024-04-16T19:39:21.807665+0000","last_became_active":"2024-04-16T17:45:08.383119+0000","last_became_peered":"2024-04-16T17:45:08.383119+0000","last_unstale":"2024-04-16T19:39:21.807665+0000","last_undegraded":"2024-04-16T19:39:21.807665+0000","last_fullsized":"2024-04-16T19:39:21.807665+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.807562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.807562+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.807562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:18.899557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":152,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:29.067090+0000","last_change":"2024-04-16T19:39:29.067114+0000","last_active":"2024-04-16T19:39:29.067090+0000","last_peered":"2024-04-16T19:39:29.067090+0000","last_clean":"2024-04-16T19:39:29.067090+0000","last_became_active":"2024-04-16T17:44:22.327102+0000","last_became_peered":"2024-04-16T17:44:22.327102+0000","last_unstale":"2024-04-16T19:39:29.067090+0000","last_undegraded":"2024-04-16T19:39:29.067090+0000","last_fullsized":"2024-04-16T19:39:29.067090+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:29.067026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:29.067026+0000","last_clean_scrub_stamp":"2024-04-16T19:39:29.067026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:48.103318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.743243+0000","last_change":"2024-04-16T19:39:08.743266+0000","last_active":"2024-04-16T19:39:08.743243+0000","last_peered":"2024-04-16T19:39:08.743243+0000","last_clean":"2024-04-16T19:39:08.743243+0000","last_became_active":"2024-04-16T17:45:20.408220+0000","last_became_peered":"2024-04-16T17:45:20.408220+0000","last_unstale":"2024-04-16T19:39:08.743243+0000","last_undegraded":"2024-04-16T19:39:08.743243+0000","last_fullsized":"2024-04-16T19:39:08.743243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.743182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.743182+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.743182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:48.523168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"53'175","reported_seq":388,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.650250+0000","last_change":"2024-04-16T19:38:53.650288+0000","last_active":"2024-04-16T19:38:53.650250+0000","last_peered":"2024-04-16T19:38:53.650250+0000","last_clean":"2024-04-16T19:38:53.650250+0000","last_became_active":"2024-04-16T17:45:22.422027+0000","last_became_peered":"2024-04-16T17:45:22.422027+0000","last_unstale":"2024-04-16T19:38:53.650250+0000","last_undegraded":"2024-04-16T19:38:53.650250+0000","last_fullsized":"2024-04-16T19:38:53.650250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'175","last_scrub_stamp":"2024-04-16T19:38:53.650187+0000","last_deep_scrub":"53'175","last_deep_scrub_stamp":"2024-04-16T19:38:53.650187+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.650187+0000","objects_scrubbed":7,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:21:28.540265+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":252,"num_read_kb":245,"num_write":168,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"53'13","reported_seq":1408,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.755146+0000","last_change":"2024-04-16T19:38:56.755146+0000","last_active":"2024-04-16T19:38:56.755146+0000","last_peered":"2024-04-16T19:38:56.755146+0000","last_clean":"2024-04-16T19:38:56.755146+0000","last_became_active":"2024-04-16T17:45:24.420856+0000","last_became_peered":"2024-04-16T17:45:24.420856+0000","last_unstale":"2024-04-16T19:38:56.755146+0000","last_undegraded":"2024-04-16T19:38:56.755146+0000","last_fullsized":"2024-04-16T19:38:56.755146+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:56.755051+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:56.755051+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.755051+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:05:59.345885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.367924+0000","last_change":"2024-04-16T19:38:25.367947+0000","last_active":"2024-04-16T19:38:25.367924+0000","last_peered":"2024-04-16T19:38:25.367924+0000","last_clean":"2024-04-16T19:38:25.367924+0000","last_became_active":"2024-04-16T17:45:26.847921+0000","last_became_peered":"2024-04-16T17:45:26.847921+0000","last_unstale":"2024-04-16T19:38:25.367924+0000","last_undegraded":"2024-04-16T19:38:25.367924+0000","last_fullsized":"2024-04-16T19:38:25.367924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.367850+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.367850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:14:46.556801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":65,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.209387+0000","last_change":"2024-04-16T19:39:20.209427+0000","last_active":"2024-04-16T19:39:20.209387+0000","last_peered":"2024-04-16T19:39:20.209387+0000","last_clean":"2024-04-16T19:39:20.209387+0000","last_became_active":"2024-04-16T18:09:02.167463+0000","last_became_peered":"2024-04-16T18:09:02.167463+0000","last_unstale":"2024-04-16T19:39:20.209387+0000","last_undegraded":"2024-04-16T19:39:20.209387+0000","last_fullsized":"2024-04-16T19:39:20.209387+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.209312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.209312+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.209312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:19:11.807547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"53'157","reported_seq":1889,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:36.115158+0000","last_change":"2024-04-16T19:39:36.115204+0000","last_active":"2024-04-16T19:39:36.115158+0000","last_peered":"2024-04-16T19:39:36.115158+0000","last_clean":"2024-04-16T19:39:36.115158+0000","last_became_active":"2024-04-16T17:46:25.527547+0000","last_became_peered":"2024-04-16T17:46:25.527547+0000","last_unstale":"2024-04-16T19:39:36.115158+0000","last_undegraded":"2024-04-16T19:39:36.115158+0000","last_fullsized":"2024-04-16T19:39:36.115158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'157","last_scrub_stamp":"2024-04-16T19:39:36.115102+0000","last_deep_scrub":"53'157","last_deep_scrub_stamp":"2024-04-16T19:39:36.115102+0000","last_clean_scrub_stamp":"2024-04-16T19:39:36.115102+0000","objects_scrubbed":42,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:10:29.916214+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2829,"num_read_kb":3051,"num_write":166,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10596,"num_omap_keys":42,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.830396+0000","last_change":"2024-04-16T19:38:46.830396+0000","last_active":"2024-04-16T19:38:46.830396+0000","last_peered":"2024-04-16T19:38:46.830396+0000","last_clean":"2024-04-16T19:38:46.830396+0000","last_became_active":"2024-04-16T17:46:17.508401+0000","last_became_peered":"2024-04-16T17:46:17.508401+0000","last_unstale":"2024-04-16T19:38:46.830396+0000","last_undegraded":"2024-04-16T19:38:46.830396+0000","last_fullsized":"2024-04-16T19:38:46.830396+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:46.830276+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.830276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:03:07.300381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"53'2","reported_seq":104,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.108567+0000","last_change":"2024-04-16T19:38:27.108567+0000","last_active":"2024-04-16T19:38:27.108567+0000","last_peered":"2024-04-16T19:38:27.108567+0000","last_clean":"2024-04-16T19:38:27.108567+0000","last_became_active":"2024-04-16T17:45:51.480722+0000","last_became_peered":"2024-04-16T17:45:51.480722+0000","last_unstale":"2024-04-16T19:38:27.108567+0000","last_undegraded":"2024-04-16T19:38:27.108567+0000","last_fullsized":"2024-04-16T19:38:27.108567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:27.108478+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.108478+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:26:30.717209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.851943+0000","last_change":"2024-04-16T19:38:36.851943+0000","last_active":"2024-04-16T19:38:36.851943+0000","last_peered":"2024-04-16T19:38:36.851943+0000","last_clean":"2024-04-16T19:38:36.851943+0000","last_became_active":"2024-04-16T17:45:49.469350+0000","last_became_peered":"2024-04-16T17:45:49.469350+0000","last_unstale":"2024-04-16T19:38:36.851943+0000","last_undegraded":"2024-04-16T19:38:36.851943+0000","last_fullsized":"2024-04-16T19:38:36.851943+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:36.851855+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.851855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:41.780120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"53'341","reported_seq":612,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.445822+0000","last_change":"2024-04-16T19:38:10.445822+0000","last_active":"2024-04-16T19:38:10.445822+0000","last_peered":"2024-04-16T19:38:10.445822+0000","last_clean":"2024-04-16T19:38:10.445822+0000","last_became_active":"2024-04-16T17:45:47.463826+0000","last_became_peered":"2024-04-16T17:45:47.463826+0000","last_unstale":"2024-04-16T19:38:10.445822+0000","last_undegraded":"2024-04-16T19:38:10.445822+0000","last_fullsized":"2024-04-16T19:38:10.445822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'341","last_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_deep_scrub":"53'341","last_deep_scrub_stamp":"2024-04-16T19:38:10.445700+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.445700+0000","objects_scrubbed":19,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:37:14.990331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":473,"num_read_kb":460,"num_write":450,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20855,"num_omap_keys":95,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"53'34","reported_seq":599,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.847777+0000","last_change":"2024-04-16T19:38:10.847777+0000","last_active":"2024-04-16T19:38:10.847777+0000","last_peered":"2024-04-16T19:38:10.847777+0000","last_clean":"2024-04-16T19:38:10.847777+0000","last_became_active":"2024-04-16T17:45:45.465505+0000","last_became_peered":"2024-04-16T17:45:45.465505+0000","last_unstale":"2024-04-16T19:38:10.847777+0000","last_undegraded":"2024-04-16T19:38:10.847777+0000","last_fullsized":"2024-04-16T19:38:10.847777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:38:10.847654+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.847654+0000","objects_scrubbed":14,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:29.793118+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":1181,"num_read_kb":878,"num_write":184,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.337430+0000","last_change":"2024-04-16T19:39:22.337430+0000","last_active":"2024-04-16T19:39:22.337430+0000","last_peered":"2024-04-16T19:39:22.337430+0000","last_clean":"2024-04-16T19:39:22.337430+0000","last_became_active":"2024-04-16T17:45:10.399932+0000","last_became_peered":"2024-04-16T17:45:10.399932+0000","last_unstale":"2024-04-16T19:39:22.337430+0000","last_undegraded":"2024-04-16T19:39:22.337430+0000","last_fullsized":"2024-04-16T19:39:22.337430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.337337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.337337+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.337337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:51:16.975466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.148287+0000","last_change":"2024-04-16T19:39:13.148309+0000","last_active":"2024-04-16T19:39:13.148287+0000","last_peered":"2024-04-16T19:39:13.148287+0000","last_clean":"2024-04-16T19:39:13.148287+0000","last_became_active":"2024-04-16T17:45:08.382649+0000","last_became_peered":"2024-04-16T17:45:08.382649+0000","last_unstale":"2024-04-16T19:39:13.148287+0000","last_undegraded":"2024-04-16T19:39:13.148287+0000","last_fullsized":"2024-04-16T19:39:13.148287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.148224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.148224+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.148224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:04:01.586388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.767561+0000","last_change":"2024-04-16T19:39:16.767585+0000","last_active":"2024-04-16T19:39:16.767561+0000","last_peered":"2024-04-16T19:39:16.767561+0000","last_clean":"2024-04-16T19:39:16.767561+0000","last_became_active":"2024-04-16T17:44:22.167683+0000","last_became_peered":"2024-04-16T17:44:22.167683+0000","last_unstale":"2024-04-16T19:39:16.767561+0000","last_undegraded":"2024-04-16T19:39:16.767561+0000","last_fullsized":"2024-04-16T19:39:16.767561+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.767491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.767491+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.767491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:02:09.022184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"53'6","reported_seq":162,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.018976+0000","last_change":"2024-04-16T19:39:03.019027+0000","last_active":"2024-04-16T19:39:03.018976+0000","last_peered":"2024-04-16T19:39:03.018976+0000","last_clean":"2024-04-16T19:39:03.018976+0000","last_became_active":"2024-04-16T17:45:20.407400+0000","last_became_peered":"2024-04-16T17:45:20.407400+0000","last_unstale":"2024-04-16T19:39:03.018976+0000","last_undegraded":"2024-04-16T19:39:03.018976+0000","last_fullsized":"2024-04-16T19:39:03.018976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:39:03.018892+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:39:03.018892+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.018892+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:02.762949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3813,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":42,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"53'125","reported_seq":314,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.048739+0000","last_change":"2024-04-16T19:38:59.048768+0000","last_active":"2024-04-16T19:38:59.048739+0000","last_peered":"2024-04-16T19:38:59.048739+0000","last_clean":"2024-04-16T19:38:59.048739+0000","last_became_active":"2024-04-16T17:45:22.415800+0000","last_became_peered":"2024-04-16T17:45:22.415800+0000","last_unstale":"2024-04-16T19:38:59.048739+0000","last_undegraded":"2024-04-16T19:38:59.048739+0000","last_fullsized":"2024-04-16T19:38:59.048739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:59.048680+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:59.048680+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.048680+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:35.315508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"53'13","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.344477+0000","last_change":"2024-04-16T19:38:53.344506+0000","last_active":"2024-04-16T19:38:53.344477+0000","last_peered":"2024-04-16T19:38:53.344477+0000","last_clean":"2024-04-16T19:38:53.344477+0000","last_became_active":"2024-04-16T17:45:24.423705+0000","last_became_peered":"2024-04-16T17:45:24.423705+0000","last_unstale":"2024-04-16T19:38:53.344477+0000","last_undegraded":"2024-04-16T19:38:53.344477+0000","last_fullsized":"2024-04-16T19:38:53.344477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:53.344411+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:53.344411+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.344411+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:29.611239+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.320279+0000","last_change":"2024-04-16T19:38:26.320303+0000","last_active":"2024-04-16T19:38:26.320279+0000","last_peered":"2024-04-16T19:38:26.320279+0000","last_clean":"2024-04-16T19:38:26.320279+0000","last_became_active":"2024-04-16T17:45:26.847409+0000","last_became_peered":"2024-04-16T17:45:26.847409+0000","last_unstale":"2024-04-16T19:38:26.320279+0000","last_undegraded":"2024-04-16T19:38:26.320279+0000","last_fullsized":"2024-04-16T19:38:26.320279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.320216+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.320216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:10.143275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":66,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.025268+0000","last_change":"2024-04-16T19:38:53.025289+0000","last_active":"2024-04-16T19:38:53.025268+0000","last_peered":"2024-04-16T19:38:53.025268+0000","last_clean":"2024-04-16T19:38:53.025268+0000","last_became_active":"2024-04-16T18:09:02.166024+0000","last_became_peered":"2024-04-16T18:09:02.166024+0000","last_unstale":"2024-04-16T19:38:53.025268+0000","last_undegraded":"2024-04-16T19:38:53.025268+0000","last_fullsized":"2024-04-16T19:38:53.025268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.025203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.025203+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.025203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:45:14.844610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"53'207","reported_seq":2145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:37.477008+0000","last_change":"2024-04-16T19:39:37.477051+0000","last_active":"2024-04-16T19:39:37.477008+0000","last_peered":"2024-04-16T19:39:37.477008+0000","last_clean":"2024-04-16T19:39:37.477008+0000","last_became_active":"2024-04-16T17:46:25.531777+0000","last_became_peered":"2024-04-16T17:46:25.531777+0000","last_unstale":"2024-04-16T19:39:37.477008+0000","last_undegraded":"2024-04-16T19:39:37.477008+0000","last_fullsized":"2024-04-16T19:39:37.477008+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'207","last_scrub_stamp":"2024-04-16T19:39:37.476944+0000","last_deep_scrub":"53'207","last_deep_scrub_stamp":"2024-04-16T19:39:37.476944+0000","last_clean_scrub_stamp":"2024-04-16T19:39:37.476944+0000","objects_scrubbed":46,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:41:55.147385+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":3278,"num_read_kb":3214,"num_write":249,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17742,"num_omap_keys":72,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":93,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.205293+0000","last_change":"2024-04-16T19:38:37.205293+0000","last_active":"2024-04-16T19:38:37.205293+0000","last_peered":"2024-04-16T19:38:37.205293+0000","last_clean":"2024-04-16T19:38:37.205293+0000","last_became_active":"2024-04-16T17:46:17.513266+0000","last_became_peered":"2024-04-16T17:46:17.513266+0000","last_unstale":"2024-04-16T19:38:37.205293+0000","last_undegraded":"2024-04-16T19:38:37.205293+0000","last_fullsized":"2024-04-16T19:38:37.205293+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.205209+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.205209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:23.238881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"53'7","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.132412+0000","last_change":"2024-04-16T19:38:26.132412+0000","last_active":"2024-04-16T19:38:26.132412+0000","last_peered":"2024-04-16T19:38:26.132412+0000","last_clean":"2024-04-16T19:38:26.132412+0000","last_became_active":"2024-04-16T17:45:51.483317+0000","last_became_peered":"2024-04-16T17:45:51.483317+0000","last_unstale":"2024-04-16T19:38:26.132412+0000","last_undegraded":"2024-04-16T19:38:26.132412+0000","last_fullsized":"2024-04-16T19:38:26.132412+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:38:26.132277+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.132277+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:32:26.528982+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"53'652","reported_seq":2213,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.537534+0000","last_change":"2024-04-16T19:38:14.537534+0000","last_active":"2024-04-16T19:38:14.537534+0000","last_peered":"2024-04-16T19:38:14.537534+0000","last_clean":"2024-04-16T19:38:14.537534+0000","last_became_active":"2024-04-16T17:45:49.466422+0000","last_became_peered":"2024-04-16T17:45:49.466422+0000","last_unstale":"2024-04-16T19:38:14.537534+0000","last_undegraded":"2024-04-16T19:38:14.537534+0000","last_fullsized":"2024-04-16T19:38:14.537534+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:14.537442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.537442+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:05.967541+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'5554","reported_seq":10355,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.938437+0000","last_change":"2024-04-16T19:38:16.938437+0000","last_active":"2024-04-16T19:38:16.938437+0000","last_peered":"2024-04-16T19:38:16.938437+0000","last_clean":"2024-04-16T19:38:16.938437+0000","last_became_active":"2024-04-16T17:45:47.459576+0000","last_became_peered":"2024-04-16T17:45:47.459576+0000","last_unstale":"2024-04-16T19:38:16.938437+0000","last_undegraded":"2024-04-16T19:38:16.938437+0000","last_fullsized":"2024-04-16T19:38:16.938437+0000","mapping_epoch":33,"log_start":"53'3800","ondisk_log_start":"53'3800","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5554","last_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_deep_scrub":"53'5554","last_deep_scrub_stamp":"2024-04-16T19:38:16.938343+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.938343+0000","objects_scrubbed":27,"log_size":1754,"log_dups_size":3000,"ondisk_log_size":1754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:35.567420+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":320,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":12357,"num_read_kb":12346,"num_write":5755,"num_write_kb":169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"53'24","reported_seq":708,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:22.053024+0000","last_change":"2024-04-16T19:38:22.053138+0000","last_active":"2024-04-16T19:38:22.053024+0000","last_peered":"2024-04-16T19:38:22.053024+0000","last_clean":"2024-04-16T19:38:22.053024+0000","last_became_active":"2024-04-16T17:45:45.456285+0000","last_became_peered":"2024-04-16T17:45:45.456285+0000","last_unstale":"2024-04-16T19:38:22.053024+0000","last_undegraded":"2024-04-16T19:38:22.053024+0000","last_fullsized":"2024-04-16T19:38:22.053024+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'24","last_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_deep_scrub":"53'24","last_deep_scrub_stamp":"2024-04-16T19:38:22.052928+0000","last_clean_scrub_stamp":"2024-04-16T19:38:22.052928+0000","objects_scrubbed":12,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:31:13.483027+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1499,"num_read_kb":1199,"num_write":135,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.240940+0000","last_change":"2024-04-16T19:38:57.240940+0000","last_active":"2024-04-16T19:38:57.240940+0000","last_peered":"2024-04-16T19:38:57.240940+0000","last_clean":"2024-04-16T19:38:57.240940+0000","last_became_active":"2024-04-16T17:45:10.399408+0000","last_became_peered":"2024-04-16T17:45:10.399408+0000","last_unstale":"2024-04-16T19:38:57.240940+0000","last_undegraded":"2024-04-16T19:38:57.240940+0000","last_fullsized":"2024-04-16T19:38:57.240940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.240851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.240851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.240851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:42.664937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.344011+0000","last_change":"2024-04-16T19:39:26.344036+0000","last_active":"2024-04-16T19:39:26.344011+0000","last_peered":"2024-04-16T19:39:26.344011+0000","last_clean":"2024-04-16T19:39:26.344011+0000","last_became_active":"2024-04-16T17:45:08.380457+0000","last_became_peered":"2024-04-16T17:45:08.380457+0000","last_unstale":"2024-04-16T19:39:26.344011+0000","last_undegraded":"2024-04-16T19:39:26.344011+0000","last_fullsized":"2024-04-16T19:39:26.344011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.343947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.343947+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.343947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:00:52.361635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:30.070261+0000","last_change":"2024-04-16T19:39:30.070306+0000","last_active":"2024-04-16T19:39:30.070261+0000","last_peered":"2024-04-16T19:39:30.070261+0000","last_clean":"2024-04-16T19:39:30.070261+0000","last_became_active":"2024-04-16T17:44:22.327451+0000","last_became_peered":"2024-04-16T17:44:22.327451+0000","last_unstale":"2024-04-16T19:39:30.070261+0000","last_undegraded":"2024-04-16T19:39:30.070261+0000","last_fullsized":"2024-04-16T19:39:30.070261+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:30.070178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:30.070178+0000","last_clean_scrub_stamp":"2024-04-16T19:39:30.070178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:19.971978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"53'2","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.043776+0000","last_change":"2024-04-16T19:38:55.043776+0000","last_active":"2024-04-16T19:38:55.043776+0000","last_peered":"2024-04-16T19:38:55.043776+0000","last_clean":"2024-04-16T19:38:55.043776+0000","last_became_active":"2024-04-16T17:45:20.403305+0000","last_became_peered":"2024-04-16T17:45:20.403305+0000","last_unstale":"2024-04-16T19:38:55.043776+0000","last_undegraded":"2024-04-16T19:38:55.043776+0000","last_fullsized":"2024-04-16T19:38:55.043776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:38:55.043682+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:38:55.043682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.043682+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:23:38.866741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":10,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3","version":"53'152","reported_seq":368,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.108322+0000","last_change":"2024-04-16T19:39:20.108360+0000","last_active":"2024-04-16T19:39:20.108322+0000","last_peered":"2024-04-16T19:39:20.108322+0000","last_clean":"2024-04-16T19:39:20.108322+0000","last_became_active":"2024-04-16T17:45:22.414485+0000","last_became_peered":"2024-04-16T17:45:22.414485+0000","last_unstale":"2024-04-16T19:39:20.108322+0000","last_undegraded":"2024-04-16T19:39:20.108322+0000","last_fullsized":"2024-04-16T19:39:20.108322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'152","last_scrub_stamp":"2024-04-16T19:39:20.108262+0000","last_deep_scrub":"53'152","last_deep_scrub_stamp":"2024-04-16T19:39:20.108262+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.108262+0000","objects_scrubbed":8,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:47.505174+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":231,"num_read_kb":217,"num_write":144,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":125,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.938478+0000","last_change":"2024-04-16T19:38:47.938499+0000","last_active":"2024-04-16T19:38:47.938478+0000","last_peered":"2024-04-16T19:38:47.938478+0000","last_clean":"2024-04-16T19:38:47.938478+0000","last_became_active":"2024-04-16T17:45:24.425068+0000","last_became_peered":"2024-04-16T17:45:24.425068+0000","last_unstale":"2024-04-16T19:38:47.938478+0000","last_undegraded":"2024-04-16T19:38:47.938478+0000","last_fullsized":"2024-04-16T19:38:47.938478+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.938415+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.938415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:49.187607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":117,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.799921+0000","last_change":"2024-04-16T19:38:35.799944+0000","last_active":"2024-04-16T19:38:35.799921+0000","last_peered":"2024-04-16T19:38:35.799921+0000","last_clean":"2024-04-16T19:38:35.799921+0000","last_became_active":"2024-04-16T17:45:26.438581+0000","last_became_peered":"2024-04-16T17:45:26.438581+0000","last_unstale":"2024-04-16T19:38:35.799921+0000","last_undegraded":"2024-04-16T19:38:35.799921+0000","last_fullsized":"2024-04-16T19:38:35.799921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:35.799851+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.799851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.447343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:38.466142+0000","last_change":"2024-04-16T19:39:38.466186+0000","last_active":"2024-04-16T19:39:38.466142+0000","last_peered":"2024-04-16T19:39:38.466142+0000","last_clean":"2024-04-16T19:39:38.466142+0000","last_became_active":"2024-04-16T18:09:02.163162+0000","last_became_peered":"2024-04-16T18:09:02.163162+0000","last_unstale":"2024-04-16T19:39:38.466142+0000","last_undegraded":"2024-04-16T19:39:38.466142+0000","last_fullsized":"2024-04-16T19:39:38.466142+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:38.466065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:38.466065+0000","last_clean_scrub_stamp":"2024-04-16T19:39:38.466065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:04:48.539888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.19","version":"53'139","reported_seq":1783,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:05.023043+0000","last_change":"2024-04-16T19:39:05.023087+0000","last_active":"2024-04-16T19:39:05.023043+0000","last_peered":"2024-04-16T19:39:05.023043+0000","last_clean":"2024-04-16T19:39:05.023043+0000","last_became_active":"2024-04-16T17:46:25.527222+0000","last_became_peered":"2024-04-16T17:46:25.527222+0000","last_unstale":"2024-04-16T19:39:05.023043+0000","last_undegraded":"2024-04-16T19:39:05.023043+0000","last_fullsized":"2024-04-16T19:39:05.023043+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'139","last_scrub_stamp":"2024-04-16T19:39:05.022983+0000","last_deep_scrub":"53'139","last_deep_scrub_stamp":"2024-04-16T19:39:05.022983+0000","last_clean_scrub_stamp":"2024-04-16T19:39:05.022983+0000","objects_scrubbed":38,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:27.020160+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":2654,"num_read_kb":2627,"num_write":153,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9754,"num_omap_keys":41,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.806738+0000","last_change":"2024-04-16T19:38:34.806738+0000","last_active":"2024-04-16T19:38:34.806738+0000","last_peered":"2024-04-16T19:38:34.806738+0000","last_clean":"2024-04-16T19:38:34.806738+0000","last_became_active":"2024-04-16T17:46:17.509310+0000","last_became_peered":"2024-04-16T17:46:17.509310+0000","last_unstale":"2024-04-16T19:38:34.806738+0000","last_undegraded":"2024-04-16T19:38:34.806738+0000","last_fullsized":"2024-04-16T19:38:34.806738+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.806640+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.806640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:43.311591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"53'25","reported_seq":154,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.421766+0000","last_change":"2024-04-16T19:38:35.421800+0000","last_active":"2024-04-16T19:38:35.421766+0000","last_peered":"2024-04-16T19:38:35.421766+0000","last_clean":"2024-04-16T19:38:35.421766+0000","last_became_active":"2024-04-16T17:45:51.477619+0000","last_became_peered":"2024-04-16T17:45:51.477619+0000","last_unstale":"2024-04-16T19:38:35.421766+0000","last_undegraded":"2024-04-16T19:38:35.421766+0000","last_fullsized":"2024-04-16T19:38:35.421766+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'25","last_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_deep_scrub":"53'25","last_deep_scrub_stamp":"2024-04-16T19:38:35.421703+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.421703+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:03:09.135386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1895,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":149,"num_read_kb":116,"num_write":67,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.727449+0000","last_change":"2024-04-16T19:38:24.727504+0000","last_active":"2024-04-16T19:38:24.727449+0000","last_peered":"2024-04-16T19:38:24.727449+0000","last_clean":"2024-04-16T19:38:24.727449+0000","last_became_active":"2024-04-16T17:45:49.470023+0000","last_became_peered":"2024-04-16T17:45:49.470023+0000","last_unstale":"2024-04-16T19:38:24.727449+0000","last_undegraded":"2024-04-16T19:38:24.727449+0000","last_fullsized":"2024-04-16T19:38:24.727449+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.727368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.727368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:38.777347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1d","version":"53'344","reported_seq":655,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.511356+0000","last_change":"2024-04-16T19:38:12.511356+0000","last_active":"2024-04-16T19:38:12.511356+0000","last_peered":"2024-04-16T19:38:12.511356+0000","last_clean":"2024-04-16T19:38:12.511356+0000","last_became_active":"2024-04-16T17:45:47.461752+0000","last_became_peered":"2024-04-16T17:45:47.461752+0000","last_unstale":"2024-04-16T19:38:12.511356+0000","last_undegraded":"2024-04-16T19:38:12.511356+0000","last_fullsized":"2024-04-16T19:38:12.511356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'344","last_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_deep_scrub":"53'344","last_deep_scrub_stamp":"2024-04-16T19:38:12.511231+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.511231+0000","objects_scrubbed":24,"log_size":344,"log_dups_size":0,"ondisk_log_size":344,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:10.499739+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":285,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":474,"num_read_kb":464,"num_write":476,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13835,"num_omap_keys":63,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"53'14","reported_seq":627,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.257871+0000","last_change":"2024-04-16T19:38:19.257946+0000","last_active":"2024-04-16T19:38:19.257871+0000","last_peered":"2024-04-16T19:38:19.257871+0000","last_clean":"2024-04-16T19:38:19.257871+0000","last_became_active":"2024-04-16T17:45:45.462196+0000","last_became_peered":"2024-04-16T17:45:45.462196+0000","last_unstale":"2024-04-16T19:38:19.257871+0000","last_undegraded":"2024-04-16T19:38:19.257871+0000","last_fullsized":"2024-04-16T19:38:19.257871+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:19.257792+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.257792+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:55:20.506984+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1330,"num_read_kb":972,"num_write":76,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":121,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.319985+0000","last_change":"2024-04-16T19:38:33.320008+0000","last_active":"2024-04-16T19:38:33.319985+0000","last_peered":"2024-04-16T19:38:33.319985+0000","last_clean":"2024-04-16T19:38:33.319985+0000","last_became_active":"2024-04-16T17:45:26.438082+0000","last_became_peered":"2024-04-16T17:45:26.438082+0000","last_unstale":"2024-04-16T19:38:33.319985+0000","last_undegraded":"2024-04-16T19:38:33.319985+0000","last_fullsized":"2024-04-16T19:38:33.319985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.319922+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.319922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:11.454921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.090817+0000","last_change":"2024-04-16T19:39:19.090817+0000","last_active":"2024-04-16T19:39:19.090817+0000","last_peered":"2024-04-16T19:39:19.090817+0000","last_clean":"2024-04-16T19:39:19.090817+0000","last_became_active":"2024-04-16T17:45:10.392399+0000","last_became_peered":"2024-04-16T17:45:10.392399+0000","last_unstale":"2024-04-16T19:39:19.090817+0000","last_undegraded":"2024-04-16T19:39:19.090817+0000","last_fullsized":"2024-04-16T19:39:19.090817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.090697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.090697+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.090697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:18.834753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.037150+0000","last_change":"2024-04-16T19:39:22.037150+0000","last_active":"2024-04-16T19:39:22.037150+0000","last_peered":"2024-04-16T19:39:22.037150+0000","last_clean":"2024-04-16T19:39:22.037150+0000","last_became_active":"2024-04-16T17:45:08.385058+0000","last_became_peered":"2024-04-16T17:45:08.385058+0000","last_unstale":"2024-04-16T19:39:22.037150+0000","last_undegraded":"2024-04-16T19:39:22.037150+0000","last_fullsized":"2024-04-16T19:39:22.037150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:22.037031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:22.037031+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.037031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:00.346235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"53'2","reported_seq":220,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.835451+0000","last_change":"2024-04-16T19:39:12.835451+0000","last_active":"2024-04-16T19:39:12.835451+0000","last_peered":"2024-04-16T19:39:12.835451+0000","last_clean":"2024-04-16T19:39:12.835451+0000","last_became_active":"2024-04-16T17:45:20.412168+0000","last_became_peered":"2024-04-16T17:45:20.412168+0000","last_unstale":"2024-04-16T19:39:12.835451+0000","last_undegraded":"2024-04-16T19:39:12.835451+0000","last_fullsized":"2024-04-16T19:39:12.835451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:12.835366+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:12.835366+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.835366+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:34.832542+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"53'109","reported_seq":290,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.058490+0000","last_change":"2024-04-16T19:38:54.058490+0000","last_active":"2024-04-16T19:38:54.058490+0000","last_peered":"2024-04-16T19:38:54.058490+0000","last_clean":"2024-04-16T19:38:54.058490+0000","last_became_active":"2024-04-16T17:45:22.415930+0000","last_became_peered":"2024-04-16T17:45:22.415930+0000","last_unstale":"2024-04-16T19:38:54.058490+0000","last_undegraded":"2024-04-16T19:38:54.058490+0000","last_fullsized":"2024-04-16T19:38:54.058490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:54.058400+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:54.058400+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.058400+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:15:15.247351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.684225+0000","last_change":"2024-04-16T19:38:49.684225+0000","last_active":"2024-04-16T19:38:49.684225+0000","last_peered":"2024-04-16T19:38:49.684225+0000","last_clean":"2024-04-16T19:38:49.684225+0000","last_became_active":"2024-04-16T17:45:24.424427+0000","last_became_peered":"2024-04-16T17:45:24.424427+0000","last_unstale":"2024-04-16T19:38:49.684225+0000","last_undegraded":"2024-04-16T19:38:49.684225+0000","last_fullsized":"2024-04-16T19:38:49.684225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:49.684096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:49.684096+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.684096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:37:46.663181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.053487+0000","last_change":"2024-04-16T19:39:24.053531+0000","last_active":"2024-04-16T19:39:24.053487+0000","last_peered":"2024-04-16T19:39:24.053487+0000","last_clean":"2024-04-16T19:39:24.053487+0000","last_became_active":"2024-04-16T18:09:02.165378+0000","last_became_peered":"2024-04-16T18:09:02.165378+0000","last_unstale":"2024-04-16T19:39:24.053487+0000","last_undegraded":"2024-04-16T19:39:24.053487+0000","last_fullsized":"2024-04-16T19:39:24.053487+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.053407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.053407+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.053407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:31.226812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"53'191","reported_seq":1684,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.870373+0000","last_change":"2024-04-16T19:39:25.870416+0000","last_active":"2024-04-16T19:39:25.870373+0000","last_peered":"2024-04-16T19:39:25.870373+0000","last_clean":"2024-04-16T19:39:25.870373+0000","last_became_active":"2024-04-16T17:46:25.532781+0000","last_became_peered":"2024-04-16T17:46:25.532781+0000","last_unstale":"2024-04-16T19:39:25.870373+0000","last_undegraded":"2024-04-16T19:39:25.870373+0000","last_fullsized":"2024-04-16T19:39:25.870373+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'191","last_scrub_stamp":"2024-04-16T19:39:25.870313+0000","last_deep_scrub":"53'191","last_deep_scrub_stamp":"2024-04-16T19:39:25.870313+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.870313+0000","objects_scrubbed":44,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:28.371915+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2517,"num_read_kb":2461,"num_write":234,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11398,"num_omap_keys":46,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":86,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.386677+0000","last_change":"2024-04-16T19:38:34.386677+0000","last_active":"2024-04-16T19:38:34.386677+0000","last_peered":"2024-04-16T19:38:34.386677+0000","last_clean":"2024-04-16T19:38:34.386677+0000","last_became_active":"2024-04-16T17:46:17.509168+0000","last_became_peered":"2024-04-16T17:46:17.509168+0000","last_unstale":"2024-04-16T19:38:34.386677+0000","last_undegraded":"2024-04-16T19:38:34.386677+0000","last_fullsized":"2024-04-16T19:38:34.386677+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.386595+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.386595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:52:24.029746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"53'16","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:22.029753+0000","last_change":"2024-04-16T19:39:22.029813+0000","last_active":"2024-04-16T19:39:22.029753+0000","last_peered":"2024-04-16T19:39:22.029753+0000","last_clean":"2024-04-16T19:39:22.029753+0000","last_became_active":"2024-04-16T17:47:16.563879+0000","last_became_peered":"2024-04-16T17:47:16.563879+0000","last_unstale":"2024-04-16T19:39:22.029753+0000","last_undegraded":"2024-04-16T19:39:22.029753+0000","last_fullsized":"2024-04-16T19:39:22.029753+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:39:22.029677+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:39:22.029677+0000","last_clean_scrub_stamp":"2024-04-16T19:39:22.029677+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:48:53.142383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1263,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":84,"num_write":36,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":98,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.919701+0000","last_change":"2024-04-16T19:38:32.919725+0000","last_active":"2024-04-16T19:38:32.919701+0000","last_peered":"2024-04-16T19:38:32.919701+0000","last_clean":"2024-04-16T19:38:32.919701+0000","last_became_active":"2024-04-16T17:45:49.471538+0000","last_became_peered":"2024-04-16T17:45:49.471538+0000","last_unstale":"2024-04-16T19:38:32.919701+0000","last_undegraded":"2024-04-16T19:38:32.919701+0000","last_fullsized":"2024-04-16T19:38:32.919701+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.919638+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.919638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:15:52.778121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1c","version":"53'462","reported_seq":2060,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:14.755722+0000","last_change":"2024-04-16T19:38:14.755722+0000","last_active":"2024-04-16T19:38:14.755722+0000","last_peered":"2024-04-16T19:38:14.755722+0000","last_clean":"2024-04-16T19:38:14.755722+0000","last_became_active":"2024-04-16T17:45:47.465313+0000","last_became_peered":"2024-04-16T17:45:47.465313+0000","last_unstale":"2024-04-16T19:38:14.755722+0000","last_undegraded":"2024-04-16T19:38:14.755722+0000","last_fullsized":"2024-04-16T19:38:14.755722+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'462","last_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_deep_scrub":"53'462","last_deep_scrub_stamp":"2024-04-16T19:38:14.755590+0000","last_clean_scrub_stamp":"2024-04-16T19:38:14.755590+0000","objects_scrubbed":20,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:58:26.580898+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":556,"num_read_kb":541,"num_write":639,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1f","version":"53'26","reported_seq":480,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.808711+0000","last_change":"2024-04-16T19:38:09.808711+0000","last_active":"2024-04-16T19:38:09.808711+0000","last_peered":"2024-04-16T19:38:09.808711+0000","last_clean":"2024-04-16T19:38:09.808711+0000","last_became_active":"2024-04-16T17:45:45.465409+0000","last_became_peered":"2024-04-16T17:45:45.465409+0000","last_unstale":"2024-04-16T19:38:09.808711+0000","last_undegraded":"2024-04-16T19:38:09.808711+0000","last_fullsized":"2024-04-16T19:38:09.808711+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:09.808625+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.808625+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:19:45.079174+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":877,"num_read_kb":545,"num_write":138,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.656527+0000","last_change":"2024-04-16T19:38:43.656527+0000","last_active":"2024-04-16T19:38:43.656527+0000","last_peered":"2024-04-16T19:38:43.656527+0000","last_clean":"2024-04-16T19:38:43.656527+0000","last_became_active":"2024-04-16T17:45:26.432619+0000","last_became_peered":"2024-04-16T17:45:26.432619+0000","last_unstale":"2024-04-16T19:38:43.656527+0000","last_undegraded":"2024-04-16T19:38:43.656527+0000","last_fullsized":"2024-04-16T19:38:43.656527+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:43.656442+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.656442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:44.709769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.834816+0000","last_change":"2024-04-16T19:39:09.834816+0000","last_active":"2024-04-16T19:39:09.834816+0000","last_peered":"2024-04-16T19:39:09.834816+0000","last_clean":"2024-04-16T19:39:09.834816+0000","last_became_active":"2024-04-16T17:45:10.393870+0000","last_became_peered":"2024-04-16T17:45:10.393870+0000","last_unstale":"2024-04-16T19:39:09.834816+0000","last_undegraded":"2024-04-16T19:39:09.834816+0000","last_fullsized":"2024-04-16T19:39:09.834816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:09.834729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:09.834729+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.834729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:23:22.738852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:34.091190+0000","last_change":"2024-04-16T19:39:34.091211+0000","last_active":"2024-04-16T19:39:34.091190+0000","last_peered":"2024-04-16T19:39:34.091190+0000","last_clean":"2024-04-16T19:39:34.091190+0000","last_became_active":"2024-04-16T17:45:08.382887+0000","last_became_peered":"2024-04-16T17:45:08.382887+0000","last_unstale":"2024-04-16T19:39:34.091190+0000","last_undegraded":"2024-04-16T19:39:34.091190+0000","last_fullsized":"2024-04-16T19:39:34.091190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:34.091112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:34.091112+0000","last_clean_scrub_stamp":"2024-04-16T19:39:34.091112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:15:13.503074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"53'2","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.793686+0000","last_change":"2024-04-16T19:39:08.793686+0000","last_active":"2024-04-16T19:39:08.793686+0000","last_peered":"2024-04-16T19:39:08.793686+0000","last_clean":"2024-04-16T19:39:08.793686+0000","last_became_active":"2024-04-16T17:45:20.407514+0000","last_became_peered":"2024-04-16T17:45:20.407514+0000","last_unstale":"2024-04-16T19:39:08.793686+0000","last_undegraded":"2024-04-16T19:39:08.793686+0000","last_fullsized":"2024-04-16T19:39:08.793686+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:08.793553+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:08.793553+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.793553+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:38.128998+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":359,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"53'53","reported_seq":201,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.344774+0000","last_change":"2024-04-16T19:38:58.344774+0000","last_active":"2024-04-16T19:38:58.344774+0000","last_peered":"2024-04-16T19:38:58.344774+0000","last_clean":"2024-04-16T19:38:58.344774+0000","last_became_active":"2024-04-16T17:45:22.421180+0000","last_became_peered":"2024-04-16T17:45:22.421180+0000","last_unstale":"2024-04-16T19:38:58.344774+0000","last_undegraded":"2024-04-16T19:38:58.344774+0000","last_fullsized":"2024-04-16T19:38:58.344774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'53","last_scrub_stamp":"2024-04-16T19:38:58.344681+0000","last_deep_scrub":"53'53","last_deep_scrub_stamp":"2024-04-16T19:38:58.344681+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.344681+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:25.741593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":74,"num_read_kb":72,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.913872+0000","last_change":"2024-04-16T19:38:34.913872+0000","last_active":"2024-04-16T19:38:34.913872+0000","last_peered":"2024-04-16T19:38:34.913872+0000","last_clean":"2024-04-16T19:38:34.913872+0000","last_became_active":"2024-04-16T17:45:24.430556+0000","last_became_peered":"2024-04-16T17:45:24.430556+0000","last_unstale":"2024-04-16T19:38:34.913872+0000","last_undegraded":"2024-04-16T19:38:34.913872+0000","last_fullsized":"2024-04-16T19:38:34.913872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.913787+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.913787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:21.917115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":61,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:40.558212+0000","last_change":"2024-04-16T19:39:40.558234+0000","last_active":"2024-04-16T19:39:40.558212+0000","last_peered":"2024-04-16T19:39:40.558212+0000","last_clean":"2024-04-16T19:39:40.558212+0000","last_became_active":"2024-04-16T18:09:02.168777+0000","last_became_peered":"2024-04-16T18:09:02.168777+0000","last_unstale":"2024-04-16T19:39:40.558212+0000","last_undegraded":"2024-04-16T19:39:40.558212+0000","last_fullsized":"2024-04-16T19:39:40.558212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:40.558141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:40.558141+0000","last_clean_scrub_stamp":"2024-04-16T19:39:40.558141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:35:22.191704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"53'154","reported_seq":1852,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.701286+0000","last_change":"2024-04-16T19:38:54.701286+0000","last_active":"2024-04-16T19:38:54.701286+0000","last_peered":"2024-04-16T19:38:54.701286+0000","last_clean":"2024-04-16T19:38:54.701286+0000","last_became_active":"2024-04-16T17:46:25.526370+0000","last_became_peered":"2024-04-16T17:46:25.526370+0000","last_unstale":"2024-04-16T19:38:54.701286+0000","last_undegraded":"2024-04-16T19:38:54.701286+0000","last_fullsized":"2024-04-16T19:38:54.701286+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'154","last_scrub_stamp":"2024-04-16T19:38:54.701174+0000","last_deep_scrub":"53'154","last_deep_scrub_stamp":"2024-04-16T19:38:54.701174+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.701174+0000","objects_scrubbed":45,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:14:16.295198+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":2841,"num_read_kb":2796,"num_write":150,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8661,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.820904+0000","last_change":"2024-04-16T19:38:41.820939+0000","last_active":"2024-04-16T19:38:41.820904+0000","last_peered":"2024-04-16T19:38:41.820904+0000","last_clean":"2024-04-16T19:38:41.820904+0000","last_became_active":"2024-04-16T17:46:17.505810+0000","last_became_peered":"2024-04-16T17:46:17.505810+0000","last_unstale":"2024-04-16T19:38:41.820904+0000","last_undegraded":"2024-04-16T19:38:41.820904+0000","last_fullsized":"2024-04-16T19:38:41.820904+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.820819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.820819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:58:25.792918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.19","version":"53'21","reported_seq":153,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.362978+0000","last_change":"2024-04-16T19:38:39.362978+0000","last_active":"2024-04-16T19:38:39.362978+0000","last_peered":"2024-04-16T19:38:39.362978+0000","last_clean":"2024-04-16T19:38:39.362978+0000","last_became_active":"2024-04-16T17:45:51.484208+0000","last_became_peered":"2024-04-16T17:45:51.484208+0000","last_unstale":"2024-04-16T19:38:39.362978+0000","last_undegraded":"2024-04-16T19:38:39.362978+0000","last_fullsized":"2024-04-16T19:38:39.362978+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:39.362872+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.362872+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:02:59.832976+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1791,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":129,"num_read_kb":102,"num_write":35,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":109,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.775944+0000","last_change":"2024-04-16T19:38:34.775967+0000","last_active":"2024-04-16T19:38:34.775944+0000","last_peered":"2024-04-16T19:38:34.775944+0000","last_clean":"2024-04-16T19:38:34.775944+0000","last_became_active":"2024-04-16T17:45:49.473130+0000","last_became_peered":"2024-04-16T17:45:49.473130+0000","last_unstale":"2024-04-16T19:38:34.775944+0000","last_undegraded":"2024-04-16T19:38:34.775944+0000","last_fullsized":"2024-04-16T19:38:34.775944+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.775873+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.775873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:39:29.678507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1f","version":"53'685","reported_seq":2207,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.959879+0000","last_change":"2024-04-16T19:38:20.959909+0000","last_active":"2024-04-16T19:38:20.959879+0000","last_peered":"2024-04-16T19:38:20.959879+0000","last_clean":"2024-04-16T19:38:20.959879+0000","last_became_active":"2024-04-16T17:45:47.461075+0000","last_became_peered":"2024-04-16T17:45:47.461075+0000","last_unstale":"2024-04-16T19:38:20.959879+0000","last_undegraded":"2024-04-16T19:38:20.959879+0000","last_fullsized":"2024-04-16T19:38:20.959879+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'685","last_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_deep_scrub":"53'685","last_deep_scrub_stamp":"2024-04-16T19:38:20.959819+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.959819+0000","objects_scrubbed":26,"log_size":685,"log_dups_size":0,"ondisk_log_size":685,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:43:09.314088+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48238,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":2976,"num_read_kb":2660,"num_write":1186,"num_write_kb":701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4728,"num_omap_keys":26,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"53'41","reported_seq":377,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.181166+0000","last_change":"2024-04-16T19:38:12.181166+0000","last_active":"2024-04-16T19:38:12.181166+0000","last_peered":"2024-04-16T19:38:12.181166+0000","last_clean":"2024-04-16T19:38:12.181166+0000","last_became_active":"2024-04-16T17:45:45.467715+0000","last_became_peered":"2024-04-16T17:45:45.467715+0000","last_unstale":"2024-04-16T19:38:12.181166+0000","last_undegraded":"2024-04-16T19:38:12.181166+0000","last_fullsized":"2024-04-16T19:38:12.181166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'41","last_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_deep_scrub":"53'41","last_deep_scrub_stamp":"2024-04-16T19:38:12.181055+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.181055+0000","objects_scrubbed":10,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:30.810131+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":569,"num_read_kb":465,"num_write":186,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.360593+0000","last_change":"2024-04-16T19:38:34.360619+0000","last_active":"2024-04-16T19:38:34.360593+0000","last_peered":"2024-04-16T19:38:34.360593+0000","last_clean":"2024-04-16T19:38:34.360593+0000","last_became_active":"2024-04-16T17:45:26.427497+0000","last_became_peered":"2024-04-16T17:45:26.427497+0000","last_unstale":"2024-04-16T19:38:34.360593+0000","last_undegraded":"2024-04-16T19:38:34.360593+0000","last_fullsized":"2024-04-16T19:38:34.360593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.360526+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.360526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:17.270587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.991847+0000","last_change":"2024-04-16T19:38:59.991847+0000","last_active":"2024-04-16T19:38:59.991847+0000","last_peered":"2024-04-16T19:38:59.991847+0000","last_clean":"2024-04-16T19:38:59.991847+0000","last_became_active":"2024-04-16T17:45:10.394818+0000","last_became_peered":"2024-04-16T17:45:10.394818+0000","last_unstale":"2024-04-16T19:38:59.991847+0000","last_undegraded":"2024-04-16T19:38:59.991847+0000","last_fullsized":"2024-04-16T19:38:59.991847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:59.991758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:59.991758+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.991758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:20:41.596200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.519627+0000","last_change":"2024-04-16T19:39:17.519648+0000","last_active":"2024-04-16T19:39:17.519627+0000","last_peered":"2024-04-16T19:39:17.519627+0000","last_clean":"2024-04-16T19:39:17.519627+0000","last_became_active":"2024-04-16T17:45:08.389344+0000","last_became_peered":"2024-04-16T17:45:08.389344+0000","last_unstale":"2024-04-16T19:39:17.519627+0000","last_undegraded":"2024-04-16T19:39:17.519627+0000","last_fullsized":"2024-04-16T19:39:17.519627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.519564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.519564+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.519564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:52.706704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.156329+0000","last_change":"2024-04-16T19:39:02.156329+0000","last_active":"2024-04-16T19:39:02.156329+0000","last_peered":"2024-04-16T19:39:02.156329+0000","last_clean":"2024-04-16T19:39:02.156329+0000","last_became_active":"2024-04-16T17:45:20.406743+0000","last_became_peered":"2024-04-16T17:45:20.406743+0000","last_unstale":"2024-04-16T19:39:02.156329+0000","last_undegraded":"2024-04-16T19:39:02.156329+0000","last_fullsized":"2024-04-16T19:39:02.156329+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.156240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.156240+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.156240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:42.484828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"53'109","reported_seq":290,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.176033+0000","last_change":"2024-04-16T19:39:19.176033+0000","last_active":"2024-04-16T19:39:19.176033+0000","last_peered":"2024-04-16T19:39:19.176033+0000","last_clean":"2024-04-16T19:39:19.176033+0000","last_became_active":"2024-04-16T17:45:22.415511+0000","last_became_peered":"2024-04-16T17:45:22.415511+0000","last_unstale":"2024-04-16T19:39:19.176033+0000","last_undegraded":"2024-04-16T19:39:19.176033+0000","last_fullsized":"2024-04-16T19:39:19.176033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:39:19.175929+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:39:19.175929+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.175929+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:16.225774+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.793324+0000","last_change":"2024-04-16T19:38:55.793324+0000","last_active":"2024-04-16T19:38:55.793324+0000","last_peered":"2024-04-16T19:38:55.793324+0000","last_clean":"2024-04-16T19:38:55.793324+0000","last_became_active":"2024-04-16T17:45:24.425256+0000","last_became_peered":"2024-04-16T17:45:24.425256+0000","last_unstale":"2024-04-16T19:38:55.793324+0000","last_undegraded":"2024-04-16T19:38:55.793324+0000","last_fullsized":"2024-04-16T19:38:55.793324+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:55.793235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:55.793235+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.793235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:03.787024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1b","version":"50'9","reported_seq":84,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:41.204916+0000","last_change":"2024-04-16T19:39:41.204939+0000","last_active":"2024-04-16T19:39:41.204916+0000","last_peered":"2024-04-16T19:39:41.204916+0000","last_clean":"2024-04-16T19:39:41.204916+0000","last_became_active":"2024-04-16T18:09:02.171969+0000","last_became_peered":"2024-04-16T18:09:02.171969+0000","last_unstale":"2024-04-16T19:39:41.204916+0000","last_undegraded":"2024-04-16T19:39:41.204916+0000","last_fullsized":"2024-04-16T19:39:41.204916+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"50'9","last_scrub_stamp":"2024-04-16T19:39:41.204847+0000","last_deep_scrub":"50'9","last_deep_scrub_stamp":"2024-04-16T19:39:41.204847+0000","last_clean_scrub_stamp":"2024-04-16T19:39:41.204847+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:28:16.217824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"53'184","reported_seq":2112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:35.490569+0000","last_change":"2024-04-16T19:39:35.490614+0000","last_active":"2024-04-16T19:39:35.490569+0000","last_peered":"2024-04-16T19:39:35.490569+0000","last_clean":"2024-04-16T19:39:35.490569+0000","last_became_active":"2024-04-16T17:46:25.529675+0000","last_became_peered":"2024-04-16T17:46:25.529675+0000","last_unstale":"2024-04-16T19:39:35.490569+0000","last_undegraded":"2024-04-16T19:39:35.490569+0000","last_fullsized":"2024-04-16T19:39:35.490569+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'184","last_scrub_stamp":"2024-04-16T19:39:35.490509+0000","last_deep_scrub":"53'184","last_deep_scrub_stamp":"2024-04-16T19:39:35.490509+0000","last_clean_scrub_stamp":"2024-04-16T19:39:35.490509+0000","objects_scrubbed":44,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:10.171879+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":3337,"num_read_kb":3367,"num_write":190,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9390,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.126764+0000","last_change":"2024-04-16T19:38:33.126787+0000","last_active":"2024-04-16T19:38:33.126764+0000","last_peered":"2024-04-16T19:38:33.126764+0000","last_clean":"2024-04-16T19:38:33.126764+0000","last_became_active":"2024-04-16T17:46:17.512659+0000","last_became_peered":"2024-04-16T17:46:17.512659+0000","last_unstale":"2024-04-16T19:38:33.126764+0000","last_undegraded":"2024-04-16T19:38:33.126764+0000","last_fullsized":"2024-04-16T19:38:33.126764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.126702+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.126702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:54:58.080828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.18","version":"53'18","reported_seq":164,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.717409+0000","last_change":"2024-04-16T19:38:39.717409+0000","last_active":"2024-04-16T19:38:39.717409+0000","last_peered":"2024-04-16T19:38:39.717409+0000","last_clean":"2024-04-16T19:38:39.717409+0000","last_became_active":"2024-04-16T17:45:51.477638+0000","last_became_peered":"2024-04-16T17:45:51.477638+0000","last_unstale":"2024-04-16T19:38:39.717409+0000","last_undegraded":"2024-04-16T19:38:39.717409+0000","last_fullsized":"2024-04-16T19:38:39.717409+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'18","last_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_deep_scrub":"53'18","last_deep_scrub_stamp":"2024-04-16T19:38:39.717311+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.717311+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:15:00.906262+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1629,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":164,"num_read_kb":130,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"53'652","reported_seq":2205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.155887+0000","last_change":"2024-04-16T19:38:30.155937+0000","last_active":"2024-04-16T19:38:30.155887+0000","last_peered":"2024-04-16T19:38:30.155887+0000","last_clean":"2024-04-16T19:38:30.155887+0000","last_became_active":"2024-04-16T17:45:49.469688+0000","last_became_peered":"2024-04-16T17:45:49.469688+0000","last_unstale":"2024-04-16T19:38:30.155887+0000","last_undegraded":"2024-04-16T19:38:30.155887+0000","last_fullsized":"2024-04-16T19:38:30.155887+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.155802+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.155802+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:14:56.186978+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'745","reported_seq":3560,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.302525+0000","last_change":"2024-04-16T19:38:20.302555+0000","last_active":"2024-04-16T19:38:20.302525+0000","last_peered":"2024-04-16T19:38:20.302525+0000","last_clean":"2024-04-16T19:38:20.302525+0000","last_became_active":"2024-04-16T17:45:47.461384+0000","last_became_peered":"2024-04-16T17:45:47.461384+0000","last_unstale":"2024-04-16T19:38:20.302525+0000","last_undegraded":"2024-04-16T19:38:20.302525+0000","last_fullsized":"2024-04-16T19:38:20.302525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'745","last_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_deep_scrub":"53'745","last_deep_scrub_stamp":"2024-04-16T19:38:20.302461+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.302461+0000","objects_scrubbed":25,"log_size":745,"log_dups_size":0,"ondisk_log_size":745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:34.270855+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34947,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4141,"num_read_kb":3911,"num_write":1417,"num_write_kb":589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18796,"num_omap_keys":104,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"53'14","reported_seq":297,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.221430+0000","last_change":"2024-04-16T19:38:13.221430+0000","last_active":"2024-04-16T19:38:13.221430+0000","last_peered":"2024-04-16T19:38:13.221430+0000","last_clean":"2024-04-16T19:38:13.221430+0000","last_became_active":"2024-04-16T17:45:45.465153+0000","last_became_peered":"2024-04-16T17:45:45.465153+0000","last_unstale":"2024-04-16T19:38:13.221430+0000","last_undegraded":"2024-04-16T19:38:13.221430+0000","last_fullsized":"2024-04-16T19:38:13.221430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:13.221281+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.221281+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:04:20.880912+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":502,"num_read_kb":325,"num_write":71,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":112,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.777444+0000","last_change":"2024-04-16T19:38:37.777471+0000","last_active":"2024-04-16T19:38:37.777444+0000","last_peered":"2024-04-16T19:38:37.777444+0000","last_clean":"2024-04-16T19:38:37.777444+0000","last_became_active":"2024-04-16T17:45:26.438106+0000","last_became_peered":"2024-04-16T17:45:26.438106+0000","last_unstale":"2024-04-16T19:38:37.777444+0000","last_undegraded":"2024-04-16T19:38:37.777444+0000","last_fullsized":"2024-04-16T19:38:37.777444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.777367+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.777367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:03:38.830695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:06.776405+0000","last_change":"2024-04-16T19:39:06.776405+0000","last_active":"2024-04-16T19:39:06.776405+0000","last_peered":"2024-04-16T19:39:06.776405+0000","last_clean":"2024-04-16T19:39:06.776405+0000","last_became_active":"2024-04-16T17:45:10.402566+0000","last_became_peered":"2024-04-16T17:45:10.402566+0000","last_unstale":"2024-04-16T19:39:06.776405+0000","last_undegraded":"2024-04-16T19:39:06.776405+0000","last_fullsized":"2024-04-16T19:39:06.776405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:06.776317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:06.776317+0000","last_clean_scrub_stamp":"2024-04-16T19:39:06.776317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:05.893011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:30.428633+0000","last_change":"2024-04-16T19:39:30.428671+0000","last_active":"2024-04-16T19:39:30.428633+0000","last_peered":"2024-04-16T19:39:30.428633+0000","last_clean":"2024-04-16T19:39:30.428633+0000","last_became_active":"2024-04-16T17:45:08.387250+0000","last_became_peered":"2024-04-16T17:45:08.387250+0000","last_unstale":"2024-04-16T19:39:30.428633+0000","last_undegraded":"2024-04-16T19:39:30.428633+0000","last_fullsized":"2024-04-16T19:39:30.428633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:30.428558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:30.428558+0000","last_clean_scrub_stamp":"2024-04-16T19:39:30.428558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:41:04.852389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"53'5","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.993835+0000","last_change":"2024-04-16T19:39:01.993835+0000","last_active":"2024-04-16T19:39:01.993835+0000","last_peered":"2024-04-16T19:39:01.993835+0000","last_clean":"2024-04-16T19:39:01.993835+0000","last_became_active":"2024-04-16T17:45:20.412925+0000","last_became_peered":"2024-04-16T17:45:20.412925+0000","last_unstale":"2024-04-16T19:39:01.993835+0000","last_undegraded":"2024-04-16T19:39:01.993835+0000","last_fullsized":"2024-04-16T19:39:01.993835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5","last_scrub_stamp":"2024-04-16T19:39:01.993744+0000","last_deep_scrub":"53'5","last_deep_scrub_stamp":"2024-04-16T19:39:01.993744+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.993744+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:02.303848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"53'84","reported_seq":253,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:00.827734+0000","last_change":"2024-04-16T19:39:00.827734+0000","last_active":"2024-04-16T19:39:00.827734+0000","last_peered":"2024-04-16T19:39:00.827734+0000","last_clean":"2024-04-16T19:39:00.827734+0000","last_became_active":"2024-04-16T17:45:22.414774+0000","last_became_peered":"2024-04-16T17:45:22.414774+0000","last_unstale":"2024-04-16T19:39:00.827734+0000","last_undegraded":"2024-04-16T19:39:00.827734+0000","last_fullsized":"2024-04-16T19:39:00.827734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:39:00.827635+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:39:00.827635+0000","last_clean_scrub_stamp":"2024-04-16T19:39:00.827635+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:35:37.094463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":120,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.391698+0000","last_change":"2024-04-16T19:38:37.391698+0000","last_active":"2024-04-16T19:38:37.391698+0000","last_peered":"2024-04-16T19:38:37.391698+0000","last_clean":"2024-04-16T19:38:37.391698+0000","last_became_active":"2024-04-16T17:45:24.426050+0000","last_became_peered":"2024-04-16T17:45:24.426050+0000","last_unstale":"2024-04-16T19:38:37.391698+0000","last_undegraded":"2024-04-16T19:38:37.391698+0000","last_fullsized":"2024-04-16T19:38:37.391698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.391613+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.391613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:43:56.190105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:42.191697+0000","last_change":"2024-04-16T19:39:42.191722+0000","last_active":"2024-04-16T19:39:42.191697+0000","last_peered":"2024-04-16T19:39:42.191697+0000","last_clean":"2024-04-16T19:39:42.191697+0000","last_became_active":"2024-04-16T18:09:02.175342+0000","last_became_peered":"2024-04-16T18:09:02.175342+0000","last_unstale":"2024-04-16T19:39:42.191697+0000","last_undegraded":"2024-04-16T19:39:42.191697+0000","last_fullsized":"2024-04-16T19:39:42.191697+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:42.191630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:42.191630+0000","last_clean_scrub_stamp":"2024-04-16T19:39:42.191630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:16.873000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"53'149","reported_seq":1540,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.045613+0000","last_change":"2024-04-16T19:38:57.045662+0000","last_active":"2024-04-16T19:38:57.045613+0000","last_peered":"2024-04-16T19:38:57.045613+0000","last_clean":"2024-04-16T19:38:57.045613+0000","last_became_active":"2024-04-16T17:46:25.525283+0000","last_became_peered":"2024-04-16T17:46:25.525283+0000","last_unstale":"2024-04-16T19:38:57.045613+0000","last_undegraded":"2024-04-16T19:38:57.045613+0000","last_fullsized":"2024-04-16T19:38:57.045613+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'149","last_scrub_stamp":"2024-04-16T19:38:57.045547+0000","last_deep_scrub":"53'149","last_deep_scrub_stamp":"2024-04-16T19:38:57.045547+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.045547+0000","objects_scrubbed":37,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:18:48.643783+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":2156,"num_read_kb":2396,"num_write":165,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9287,"num_omap_keys":38,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.367350+0000","last_change":"2024-04-16T19:38:40.367372+0000","last_active":"2024-04-16T19:38:40.367350+0000","last_peered":"2024-04-16T19:38:40.367350+0000","last_clean":"2024-04-16T19:38:40.367350+0000","last_became_active":"2024-04-16T17:46:17.504244+0000","last_became_peered":"2024-04-16T17:46:17.504244+0000","last_unstale":"2024-04-16T19:38:40.367350+0000","last_undegraded":"2024-04-16T19:38:40.367350+0000","last_fullsized":"2024-04-16T19:38:40.367350+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.367287+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.367287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:20.695875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"53'4","reported_seq":107,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.431337+0000","last_change":"2024-04-16T19:38:32.431337+0000","last_active":"2024-04-16T19:38:32.431337+0000","last_peered":"2024-04-16T19:38:32.431337+0000","last_clean":"2024-04-16T19:38:32.431337+0000","last_became_active":"2024-04-16T17:45:51.479936+0000","last_became_peered":"2024-04-16T17:45:51.479936+0000","last_unstale":"2024-04-16T19:38:32.431337+0000","last_undegraded":"2024-04-16T19:38:32.431337+0000","last_fullsized":"2024-04-16T19:38:32.431337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:32.431211+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.431211+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:06:40.828369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":17,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.346700+0000","last_change":"2024-04-16T19:38:32.346723+0000","last_active":"2024-04-16T19:38:32.346700+0000","last_peered":"2024-04-16T19:38:32.346700+0000","last_clean":"2024-04-16T19:38:32.346700+0000","last_became_active":"2024-04-16T17:45:49.476133+0000","last_became_peered":"2024-04-16T17:45:49.476133+0000","last_unstale":"2024-04-16T19:38:32.346700+0000","last_undegraded":"2024-04-16T19:38:32.346700+0000","last_fullsized":"2024-04-16T19:38:32.346700+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.346634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.346634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:51.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"53'394","reported_seq":728,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:11.708440+0000","last_change":"2024-04-16T19:38:11.708492+0000","last_active":"2024-04-16T19:38:11.708440+0000","last_peered":"2024-04-16T19:38:11.708440+0000","last_clean":"2024-04-16T19:38:11.708440+0000","last_became_active":"2024-04-16T17:45:47.464665+0000","last_became_peered":"2024-04-16T17:45:47.464665+0000","last_unstale":"2024-04-16T19:38:11.708440+0000","last_undegraded":"2024-04-16T19:38:11.708440+0000","last_fullsized":"2024-04-16T19:38:11.708440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'394","last_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_deep_scrub":"53'394","last_deep_scrub_stamp":"2024-04-16T19:38:11.708368+0000","last_clean_scrub_stamp":"2024-04-16T19:38:11.708368+0000","objects_scrubbed":25,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:21.347792+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":338,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":494,"num_read_kb":484,"num_write":671,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"53'23","reported_seq":338,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.749658+0000","last_change":"2024-04-16T19:38:27.749706+0000","last_active":"2024-04-16T19:38:27.749658+0000","last_peered":"2024-04-16T19:38:27.749658+0000","last_clean":"2024-04-16T19:38:27.749658+0000","last_became_active":"2024-04-16T17:45:45.461364+0000","last_became_peered":"2024-04-16T17:45:45.461364+0000","last_unstale":"2024-04-16T19:38:27.749658+0000","last_undegraded":"2024-04-16T19:38:27.749658+0000","last_fullsized":"2024-04-16T19:38:27.749658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:27.749597+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.749597+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:07:41.717991+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":459,"num_write":100,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.075116+0000","last_change":"2024-04-16T19:39:10.075116+0000","last_active":"2024-04-16T19:39:10.075116+0000","last_peered":"2024-04-16T19:39:10.075116+0000","last_clean":"2024-04-16T19:39:10.075116+0000","last_became_active":"2024-04-16T17:45:10.396449+0000","last_became_peered":"2024-04-16T17:45:10.396449+0000","last_unstale":"2024-04-16T19:39:10.075116+0000","last_undegraded":"2024-04-16T19:39:10.075116+0000","last_fullsized":"2024-04-16T19:39:10.075116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:10.075029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:10.075029+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.075029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:23.719049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.160626+0000","last_change":"2024-04-16T19:39:14.160650+0000","last_active":"2024-04-16T19:39:14.160626+0000","last_peered":"2024-04-16T19:39:14.160626+0000","last_clean":"2024-04-16T19:39:14.160626+0000","last_became_active":"2024-04-16T17:45:08.384206+0000","last_became_peered":"2024-04-16T17:45:08.384206+0000","last_unstale":"2024-04-16T19:39:14.160626+0000","last_undegraded":"2024-04-16T19:39:14.160626+0000","last_fullsized":"2024-04-16T19:39:14.160626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.160562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.160562+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.160562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:58.080516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.379904+0000","last_change":"2024-04-16T19:39:07.379904+0000","last_active":"2024-04-16T19:39:07.379904+0000","last_peered":"2024-04-16T19:39:07.379904+0000","last_clean":"2024-04-16T19:39:07.379904+0000","last_became_active":"2024-04-16T17:45:20.414043+0000","last_became_peered":"2024-04-16T17:45:20.414043+0000","last_unstale":"2024-04-16T19:39:07.379904+0000","last_undegraded":"2024-04-16T19:39:07.379904+0000","last_fullsized":"2024-04-16T19:39:07.379904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.379808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.379808+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.379808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:29:37.404406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"53'93","reported_seq":267,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:55.728543+0000","last_change":"2024-04-16T19:38:55.728580+0000","last_active":"2024-04-16T19:38:55.728543+0000","last_peered":"2024-04-16T19:38:55.728543+0000","last_clean":"2024-04-16T19:38:55.728543+0000","last_became_active":"2024-04-16T17:45:22.421098+0000","last_became_peered":"2024-04-16T17:45:22.421098+0000","last_unstale":"2024-04-16T19:38:55.728543+0000","last_undegraded":"2024-04-16T19:38:55.728543+0000","last_fullsized":"2024-04-16T19:38:55.728543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'93","last_scrub_stamp":"2024-04-16T19:38:55.728482+0000","last_deep_scrub":"53'93","last_deep_scrub_stamp":"2024-04-16T19:38:55.728482+0000","last_clean_scrub_stamp":"2024-04-16T19:38:55.728482+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:13:32.667039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":133,"num_write":88,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:37.811745+0000","last_change":"2024-04-16T19:38:37.811769+0000","last_active":"2024-04-16T19:38:37.811745+0000","last_peered":"2024-04-16T19:38:37.811745+0000","last_clean":"2024-04-16T19:38:37.811745+0000","last_became_active":"2024-04-16T17:45:24.425657+0000","last_became_peered":"2024-04-16T17:45:24.425657+0000","last_unstale":"2024-04-16T19:38:37.811745+0000","last_undegraded":"2024-04-16T19:38:37.811745+0000","last_fullsized":"2024-04-16T19:38:37.811745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:37.811682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:37.811682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:36:16.599188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.717833+0000","last_change":"2024-04-16T19:38:24.717833+0000","last_active":"2024-04-16T19:38:24.717833+0000","last_peered":"2024-04-16T19:38:24.717833+0000","last_clean":"2024-04-16T19:38:24.717833+0000","last_became_active":"2024-04-16T17:45:26.848757+0000","last_became_peered":"2024-04-16T17:45:26.848757+0000","last_unstale":"2024-04-16T19:38:24.717833+0000","last_undegraded":"2024-04-16T19:38:24.717833+0000","last_fullsized":"2024-04-16T19:38:24.717833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:24.717739+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.717739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:40:12.056602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:43.650660+0000","last_change":"2024-04-16T19:39:43.650684+0000","last_active":"2024-04-16T19:39:43.650660+0000","last_peered":"2024-04-16T19:39:43.650660+0000","last_clean":"2024-04-16T19:39:43.650660+0000","last_became_active":"2024-04-16T18:09:02.176188+0000","last_became_peered":"2024-04-16T18:09:02.176188+0000","last_unstale":"2024-04-16T19:39:43.650660+0000","last_undegraded":"2024-04-16T19:39:43.650660+0000","last_fullsized":"2024-04-16T19:39:43.650660+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:43.650591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:43.650591+0000","last_clean_scrub_stamp":"2024-04-16T19:39:43.650591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:06:18.331960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.14","version":"53'147","reported_seq":1369,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.298300+0000","last_change":"2024-04-16T19:38:54.298344+0000","last_active":"2024-04-16T19:38:54.298300+0000","last_peered":"2024-04-16T19:38:54.298300+0000","last_clean":"2024-04-16T19:38:54.298300+0000","last_became_active":"2024-04-16T17:46:25.529848+0000","last_became_peered":"2024-04-16T17:46:25.529848+0000","last_unstale":"2024-04-16T19:38:54.298300+0000","last_undegraded":"2024-04-16T19:38:54.298300+0000","last_fullsized":"2024-04-16T19:38:54.298300+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'147","last_scrub_stamp":"2024-04-16T19:38:54.298241+0000","last_deep_scrub":"53'147","last_deep_scrub_stamp":"2024-04-16T19:38:54.298241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.298241+0000","objects_scrubbed":35,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:37:29.765409+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2017,"num_read_kb":1969,"num_write":160,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10184,"num_omap_keys":41,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:54.800761+0000","last_change":"2024-04-16T19:38:54.800803+0000","last_active":"2024-04-16T19:38:54.800761+0000","last_peered":"2024-04-16T19:38:54.800761+0000","last_clean":"2024-04-16T19:38:54.800761+0000","last_became_active":"2024-04-16T17:46:17.511385+0000","last_became_peered":"2024-04-16T17:46:17.511385+0000","last_unstale":"2024-04-16T19:38:54.800761+0000","last_undegraded":"2024-04-16T19:38:54.800761+0000","last_fullsized":"2024-04-16T19:38:54.800761+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:54.800687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:54.800687+0000","last_clean_scrub_stamp":"2024-04-16T19:38:54.800687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:02.678098+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"53'15","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.832780+0000","last_change":"2024-04-16T19:38:47.832780+0000","last_active":"2024-04-16T19:38:47.832780+0000","last_peered":"2024-04-16T19:38:47.832780+0000","last_clean":"2024-04-16T19:38:47.832780+0000","last_became_active":"2024-04-16T17:45:51.479915+0000","last_became_peered":"2024-04-16T17:45:51.479915+0000","last_unstale":"2024-04-16T19:38:47.832780+0000","last_undegraded":"2024-04-16T19:38:47.832780+0000","last_fullsized":"2024-04-16T19:38:47.832780+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'15","last_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_deep_scrub":"53'15","last_deep_scrub_stamp":"2024-04-16T19:38:47.832667+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.832667+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:40:28.161255+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":94,"num_write":27,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:34.156986+0000","last_change":"2024-04-16T19:38:34.157007+0000","last_active":"2024-04-16T19:38:34.156986+0000","last_peered":"2024-04-16T19:38:34.156986+0000","last_clean":"2024-04-16T19:38:34.156986+0000","last_became_active":"2024-04-16T17:45:49.469504+0000","last_became_peered":"2024-04-16T17:45:49.469504+0000","last_unstale":"2024-04-16T19:38:34.156986+0000","last_undegraded":"2024-04-16T19:38:34.156986+0000","last_fullsized":"2024-04-16T19:38:34.156986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:34.156921+0000","last_clean_scrub_stamp":"2024-04-16T19:38:34.156921+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:55.446024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'232","reported_seq":419,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.530282+0000","last_change":"2024-04-16T19:38:19.530353+0000","last_active":"2024-04-16T19:38:19.530282+0000","last_peered":"2024-04-16T19:38:19.530282+0000","last_clean":"2024-04-16T19:38:19.530282+0000","last_became_active":"2024-04-16T17:45:47.459770+0000","last_became_peered":"2024-04-16T17:45:47.459770+0000","last_unstale":"2024-04-16T19:38:19.530282+0000","last_undegraded":"2024-04-16T19:38:19.530282+0000","last_fullsized":"2024-04-16T19:38:19.530282+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'232","last_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_deep_scrub":"53'232","last_deep_scrub_stamp":"2024-04-16T19:38:19.530215+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.530215+0000","objects_scrubbed":16,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:50:04.335733+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":256,"num_read_kb":253,"num_write":413,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14555,"num_omap_keys":67,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"53'30","reported_seq":488,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.062041+0000","last_change":"2024-04-16T19:39:21.062099+0000","last_active":"2024-04-16T19:39:21.062041+0000","last_peered":"2024-04-16T19:39:21.062041+0000","last_clean":"2024-04-16T19:39:21.062041+0000","last_became_active":"2024-04-16T17:47:16.557770+0000","last_became_peered":"2024-04-16T17:47:16.557770+0000","last_unstale":"2024-04-16T19:39:21.062041+0000","last_undegraded":"2024-04-16T19:39:21.062041+0000","last_fullsized":"2024-04-16T19:39:21.062041+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'30","last_scrub_stamp":"2024-04-16T19:39:21.061977+0000","last_deep_scrub":"53'30","last_deep_scrub_stamp":"2024-04-16T19:39:21.061977+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.061977+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:43.059153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1048,"num_read_kb":690,"num_write":157,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":145,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:24.270776+0000","last_change":"2024-04-16T19:39:24.270776+0000","last_active":"2024-04-16T19:39:24.270776+0000","last_peered":"2024-04-16T19:39:24.270776+0000","last_clean":"2024-04-16T19:39:24.270776+0000","last_became_active":"2024-04-16T17:45:10.399941+0000","last_became_peered":"2024-04-16T17:45:10.399941+0000","last_unstale":"2024-04-16T19:39:24.270776+0000","last_undegraded":"2024-04-16T19:39:24.270776+0000","last_fullsized":"2024-04-16T19:39:24.270776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:24.270656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:24.270656+0000","last_clean_scrub_stamp":"2024-04-16T19:39:24.270656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:13:14.172456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":139,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.767720+0000","last_change":"2024-04-16T19:39:15.767763+0000","last_active":"2024-04-16T19:39:15.767720+0000","last_peered":"2024-04-16T19:39:15.767720+0000","last_clean":"2024-04-16T19:39:15.767720+0000","last_became_active":"2024-04-16T17:45:08.388464+0000","last_became_peered":"2024-04-16T17:45:08.388464+0000","last_unstale":"2024-04-16T19:39:15.767720+0000","last_undegraded":"2024-04-16T19:39:15.767720+0000","last_fullsized":"2024-04-16T19:39:15.767720+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.767644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.767644+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.767644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:22.941049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"53'3","reported_seq":572,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.035167+0000","last_change":"2024-04-16T19:39:04.035197+0000","last_active":"2024-04-16T19:39:04.035167+0000","last_peered":"2024-04-16T19:39:04.035167+0000","last_clean":"2024-04-16T19:39:04.035167+0000","last_became_active":"2024-04-16T17:45:20.407324+0000","last_became_peered":"2024-04-16T17:45:20.407324+0000","last_unstale":"2024-04-16T19:39:04.035167+0000","last_undegraded":"2024-04-16T19:39:04.035167+0000","last_fullsized":"2024-04-16T19:39:04.035167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'3","last_scrub_stamp":"2024-04-16T19:39:04.035106+0000","last_deep_scrub":"53'3","last_deep_scrub_stamp":"2024-04-16T19:39:04.035106+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.035106+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:31.432018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1165,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":1093,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"53'159","reported_seq":360,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:56.006509+0000","last_change":"2024-04-16T19:38:56.006551+0000","last_active":"2024-04-16T19:38:56.006509+0000","last_peered":"2024-04-16T19:38:56.006509+0000","last_clean":"2024-04-16T19:38:56.006509+0000","last_became_active":"2024-04-16T17:45:22.416862+0000","last_became_peered":"2024-04-16T17:45:22.416862+0000","last_unstale":"2024-04-16T19:38:56.006509+0000","last_undegraded":"2024-04-16T19:38:56.006509+0000","last_fullsized":"2024-04-16T19:38:56.006509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:38:56.006439+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:38:56.006439+0000","last_clean_scrub_stamp":"2024-04-16T19:38:56.006439+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:53.056284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.749066+0000","last_change":"2024-04-16T19:38:47.749088+0000","last_active":"2024-04-16T19:38:47.749066+0000","last_peered":"2024-04-16T19:38:47.749066+0000","last_clean":"2024-04-16T19:38:47.749066+0000","last_became_active":"2024-04-16T17:45:24.426997+0000","last_became_peered":"2024-04-16T17:45:24.426997+0000","last_unstale":"2024-04-16T19:38:47.749066+0000","last_undegraded":"2024-04-16T19:38:47.749066+0000","last_fullsized":"2024-04-16T19:38:47.749066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:47.748997+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.748997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:30:30.659057+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:25.859545+0000","last_change":"2024-04-16T19:38:25.859545+0000","last_active":"2024-04-16T19:38:25.859545+0000","last_peered":"2024-04-16T19:38:25.859545+0000","last_clean":"2024-04-16T19:38:25.859545+0000","last_became_active":"2024-04-16T17:45:26.849360+0000","last_became_peered":"2024-04-16T17:45:26.849360+0000","last_unstale":"2024-04-16T19:38:25.859545+0000","last_undegraded":"2024-04-16T19:38:25.859545+0000","last_fullsized":"2024-04-16T19:38:25.859545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:25.859440+0000","last_clean_scrub_stamp":"2024-04-16T19:38:25.859440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:49:45.247605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:41.449954+0000","last_change":"2024-04-16T19:39:41.449998+0000","last_active":"2024-04-16T19:39:41.449954+0000","last_peered":"2024-04-16T19:39:41.449954+0000","last_clean":"2024-04-16T19:39:41.449954+0000","last_became_active":"2024-04-16T18:09:02.172326+0000","last_became_peered":"2024-04-16T18:09:02.172326+0000","last_unstale":"2024-04-16T19:39:41.449954+0000","last_undegraded":"2024-04-16T19:39:41.449954+0000","last_fullsized":"2024-04-16T19:39:41.449954+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:41.449871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:41.449871+0000","last_clean_scrub_stamp":"2024-04-16T19:39:41.449871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:01:56.953363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"53'152","reported_seq":2009,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.720163+0000","last_change":"2024-04-16T19:38:42.720215+0000","last_active":"2024-04-16T19:38:42.720163+0000","last_peered":"2024-04-16T19:38:42.720163+0000","last_clean":"2024-04-16T19:38:42.720163+0000","last_became_active":"2024-04-16T17:46:25.522413+0000","last_became_peered":"2024-04-16T17:46:25.522413+0000","last_unstale":"2024-04-16T19:38:42.720163+0000","last_undegraded":"2024-04-16T19:38:42.720163+0000","last_fullsized":"2024-04-16T19:38:42.720163+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'152","last_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_deep_scrub":"53'152","last_deep_scrub_stamp":"2024-04-16T19:38:42.720094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.720094+0000","objects_scrubbed":42,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:29.723422+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":2957,"num_read_kb":3115,"num_write":152,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7797,"num_omap_keys":31,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.359616+0000","last_change":"2024-04-16T19:38:44.359659+0000","last_active":"2024-04-16T19:38:44.359616+0000","last_peered":"2024-04-16T19:38:44.359616+0000","last_clean":"2024-04-16T19:38:44.359616+0000","last_became_active":"2024-04-16T17:46:17.504324+0000","last_became_peered":"2024-04-16T17:46:17.504324+0000","last_unstale":"2024-04-16T19:38:44.359616+0000","last_undegraded":"2024-04-16T19:38:44.359616+0000","last_fullsized":"2024-04-16T19:38:44.359616+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:44.359543+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.359543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:32.797707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"53'6","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.828869+0000","last_change":"2024-04-16T19:38:44.828869+0000","last_active":"2024-04-16T19:38:44.828869+0000","last_peered":"2024-04-16T19:38:44.828869+0000","last_clean":"2024-04-16T19:38:44.828869+0000","last_became_active":"2024-04-16T17:45:51.482087+0000","last_became_peered":"2024-04-16T17:45:51.482087+0000","last_unstale":"2024-04-16T19:38:44.828869+0000","last_undegraded":"2024-04-16T19:38:44.828869+0000","last_fullsized":"2024-04-16T19:38:44.828869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:44.828731+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.828731+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:03.627224+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":367,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":18,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.12","version":"53'21","reported_seq":1488,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:47.901432+0000","last_change":"2024-04-16T19:38:47.901478+0000","last_active":"2024-04-16T19:38:47.901432+0000","last_peered":"2024-04-16T19:38:47.901432+0000","last_clean":"2024-04-16T19:38:47.901432+0000","last_became_active":"2024-04-16T17:45:49.473071+0000","last_became_peered":"2024-04-16T17:45:49.473071+0000","last_unstale":"2024-04-16T19:38:47.901432+0000","last_undegraded":"2024-04-16T19:38:47.901432+0000","last_fullsized":"2024-04-16T19:38:47.901432+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:47.901356+0000","last_clean_scrub_stamp":"2024-04-16T19:38:47.901356+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:42.407062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"53'681","reported_seq":3330,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.829538+0000","last_change":"2024-04-16T19:38:10.829578+0000","last_active":"2024-04-16T19:38:10.829538+0000","last_peered":"2024-04-16T19:38:10.829538+0000","last_clean":"2024-04-16T19:38:10.829538+0000","last_became_active":"2024-04-16T17:45:47.459015+0000","last_became_peered":"2024-04-16T17:45:47.459015+0000","last_unstale":"2024-04-16T19:38:10.829538+0000","last_undegraded":"2024-04-16T19:38:10.829538+0000","last_fullsized":"2024-04-16T19:38:10.829538+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'681","last_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_deep_scrub":"53'681","last_deep_scrub_stamp":"2024-04-16T19:38:10.829490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.829490+0000","objects_scrubbed":20,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:49:55.635008+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":309,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":3320,"num_read_kb":3311,"num_write":581,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"53'12","reported_seq":518,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.553415+0000","last_change":"2024-04-16T19:38:21.553466+0000","last_active":"2024-04-16T19:38:21.553415+0000","last_peered":"2024-04-16T19:38:21.553415+0000","last_clean":"2024-04-16T19:38:21.553415+0000","last_became_active":"2024-04-16T17:45:45.461104+0000","last_became_peered":"2024-04-16T17:45:45.461104+0000","last_unstale":"2024-04-16T19:38:21.553415+0000","last_undegraded":"2024-04-16T19:38:21.553415+0000","last_fullsized":"2024-04-16T19:38:21.553415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.553349+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.553349+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:32:55.897508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":926,"num_read_kb":898,"num_write":75,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.381098+0000","last_change":"2024-04-16T19:39:11.381120+0000","last_active":"2024-04-16T19:39:11.381098+0000","last_peered":"2024-04-16T19:39:11.381098+0000","last_clean":"2024-04-16T19:39:11.381098+0000","last_became_active":"2024-04-16T17:45:10.390638+0000","last_became_peered":"2024-04-16T17:45:10.390638+0000","last_unstale":"2024-04-16T19:39:11.381098+0000","last_undegraded":"2024-04-16T19:39:11.381098+0000","last_fullsized":"2024-04-16T19:39:11.381098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.381031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.381031+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.381031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:01.722417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:12.125638+0000","last_change":"2024-04-16T19:39:12.125660+0000","last_active":"2024-04-16T19:39:12.125638+0000","last_peered":"2024-04-16T19:39:12.125638+0000","last_clean":"2024-04-16T19:39:12.125638+0000","last_became_active":"2024-04-16T17:45:08.380284+0000","last_became_peered":"2024-04-16T17:45:08.380284+0000","last_unstale":"2024-04-16T19:39:12.125638+0000","last_undegraded":"2024-04-16T19:39:12.125638+0000","last_fullsized":"2024-04-16T19:39:12.125638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:12.125568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:12.125568+0000","last_clean_scrub_stamp":"2024-04-16T19:39:12.125568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:49:09.175412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"53'4","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.189901+0000","last_change":"2024-04-16T19:39:08.189930+0000","last_active":"2024-04-16T19:39:08.189901+0000","last_peered":"2024-04-16T19:39:08.189901+0000","last_clean":"2024-04-16T19:39:08.189901+0000","last_became_active":"2024-04-16T17:45:20.412045+0000","last_became_peered":"2024-04-16T17:45:20.412045+0000","last_unstale":"2024-04-16T19:39:08.189901+0000","last_undegraded":"2024-04-16T19:39:08.189901+0000","last_fullsized":"2024-04-16T19:39:08.189901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:08.189842+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:08.189842+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.189842+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:33.947083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1412,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":21,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"53'109","reported_seq":295,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.025079+0000","last_change":"2024-04-16T19:38:52.025105+0000","last_active":"2024-04-16T19:38:52.025079+0000","last_peered":"2024-04-16T19:38:52.025079+0000","last_clean":"2024-04-16T19:38:52.025079+0000","last_became_active":"2024-04-16T17:45:22.416868+0000","last_became_peered":"2024-04-16T17:45:22.416868+0000","last_unstale":"2024-04-16T19:38:52.025079+0000","last_undegraded":"2024-04-16T19:38:52.025079+0000","last_fullsized":"2024-04-16T19:38:52.025079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'109","last_scrub_stamp":"2024-04-16T19:38:52.025025+0000","last_deep_scrub":"53'109","last_deep_scrub_stamp":"2024-04-16T19:38:52.025025+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.025025+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:03:10.702648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":161,"num_read_kb":154,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:48.713508+0000","last_change":"2024-04-16T19:38:48.713508+0000","last_active":"2024-04-16T19:38:48.713508+0000","last_peered":"2024-04-16T19:38:48.713508+0000","last_clean":"2024-04-16T19:38:48.713508+0000","last_became_active":"2024-04-16T17:45:24.425077+0000","last_became_peered":"2024-04-16T17:45:24.425077+0000","last_unstale":"2024-04-16T19:38:48.713508+0000","last_undegraded":"2024-04-16T19:38:48.713508+0000","last_fullsized":"2024-04-16T19:38:48.713508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:48.713387+0000","last_clean_scrub_stamp":"2024-04-16T19:38:48.713387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:32:48.829744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.890939+0000","last_change":"2024-04-16T19:38:27.890939+0000","last_active":"2024-04-16T19:38:27.890939+0000","last_peered":"2024-04-16T19:38:27.890939+0000","last_clean":"2024-04-16T19:38:27.890939+0000","last_became_active":"2024-04-16T17:45:26.438287+0000","last_became_peered":"2024-04-16T17:45:26.438287+0000","last_unstale":"2024-04-16T19:38:27.890939+0000","last_undegraded":"2024-04-16T19:38:27.890939+0000","last_fullsized":"2024-04-16T19:38:27.890939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:27.890852+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.890852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:40:30.404878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":62,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.982218+0000","last_change":"2024-04-16T19:39:26.982239+0000","last_active":"2024-04-16T19:39:26.982218+0000","last_peered":"2024-04-16T19:39:26.982218+0000","last_clean":"2024-04-16T19:39:26.982218+0000","last_became_active":"2024-04-16T18:09:02.173074+0000","last_became_peered":"2024-04-16T18:09:02.173074+0000","last_unstale":"2024-04-16T19:39:26.982218+0000","last_undegraded":"2024-04-16T19:39:26.982218+0000","last_fullsized":"2024-04-16T19:39:26.982218+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.982153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.982153+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.982153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:19:52.541542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"53'192","reported_seq":1694,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.782068+0000","last_change":"2024-04-16T19:38:58.782113+0000","last_active":"2024-04-16T19:38:58.782068+0000","last_peered":"2024-04-16T19:38:58.782068+0000","last_clean":"2024-04-16T19:38:58.782068+0000","last_became_active":"2024-04-16T17:46:25.529424+0000","last_became_peered":"2024-04-16T17:46:25.529424+0000","last_unstale":"2024-04-16T19:38:58.782068+0000","last_undegraded":"2024-04-16T19:38:58.782068+0000","last_fullsized":"2024-04-16T19:38:58.782068+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'192","last_scrub_stamp":"2024-04-16T19:38:58.782006+0000","last_deep_scrub":"53'192","last_deep_scrub_stamp":"2024-04-16T19:38:58.782006+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.782006+0000","objects_scrubbed":46,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:31:04.393415+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":2450,"num_read_kb":2398,"num_write":221,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13128,"num_omap_keys":54,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":87,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.550739+0000","last_change":"2024-04-16T19:38:26.550762+0000","last_active":"2024-04-16T19:38:26.550739+0000","last_peered":"2024-04-16T19:38:26.550739+0000","last_clean":"2024-04-16T19:38:26.550739+0000","last_became_active":"2024-04-16T17:46:17.507396+0000","last_became_peered":"2024-04-16T17:46:17.507396+0000","last_unstale":"2024-04-16T19:38:26.550739+0000","last_undegraded":"2024-04-16T19:38:26.550739+0000","last_fullsized":"2024-04-16T19:38:26.550739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.550671+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.550671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:50.234890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"53'6","reported_seq":103,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:45.819588+0000","last_change":"2024-04-16T19:38:45.819620+0000","last_active":"2024-04-16T19:38:45.819588+0000","last_peered":"2024-04-16T19:38:45.819588+0000","last_clean":"2024-04-16T19:38:45.819588+0000","last_became_active":"2024-04-16T17:45:51.480123+0000","last_became_peered":"2024-04-16T17:45:51.480123+0000","last_unstale":"2024-04-16T19:38:45.819588+0000","last_undegraded":"2024-04-16T19:38:45.819588+0000","last_fullsized":"2024-04-16T19:38:45.819588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:45.819519+0000","last_clean_scrub_stamp":"2024-04-16T19:38:45.819519+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:24.941425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":101,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.764005+0000","last_change":"2024-04-16T19:38:30.764029+0000","last_active":"2024-04-16T19:38:30.764005+0000","last_peered":"2024-04-16T19:38:30.764005+0000","last_clean":"2024-04-16T19:38:30.764005+0000","last_became_active":"2024-04-16T17:45:49.470770+0000","last_became_peered":"2024-04-16T17:45:49.470770+0000","last_unstale":"2024-04-16T19:38:30.764005+0000","last_undegraded":"2024-04-16T19:38:30.764005+0000","last_fullsized":"2024-04-16T19:38:30.764005+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.763939+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.763939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:16:44.186208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"53'562","reported_seq":45436,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:12.690811+0000","last_change":"2024-04-16T19:38:12.690864+0000","last_active":"2024-04-16T19:38:12.690811+0000","last_peered":"2024-04-16T19:38:12.690811+0000","last_clean":"2024-04-16T19:38:12.690811+0000","last_became_active":"2024-04-16T17:45:47.464767+0000","last_became_peered":"2024-04-16T17:45:47.464767+0000","last_unstale":"2024-04-16T19:38:12.690811+0000","last_undegraded":"2024-04-16T19:38:12.690811+0000","last_fullsized":"2024-04-16T19:38:12.690811+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'562","last_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_deep_scrub":"53'562","last_deep_scrub_stamp":"2024-04-16T19:38:12.690747+0000","last_clean_scrub_stamp":"2024-04-16T19:38:12.690747+0000","objects_scrubbed":19,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:57:33.979851+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":292,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":134951,"num_read_kb":90030,"num_write":516,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7052,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"53'16","reported_seq":415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.851820+0000","last_change":"2024-04-16T19:38:09.851868+0000","last_active":"2024-04-16T19:38:09.851820+0000","last_peered":"2024-04-16T19:38:09.851820+0000","last_clean":"2024-04-16T19:38:09.851820+0000","last_became_active":"2024-04-16T17:45:45.466234+0000","last_became_peered":"2024-04-16T17:45:45.466234+0000","last_unstale":"2024-04-16T19:38:09.851820+0000","last_undegraded":"2024-04-16T19:38:09.851820+0000","last_fullsized":"2024-04-16T19:38:09.851820+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:09.851761+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.851761+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:33.535980+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":760,"num_read_kb":609,"num_write":91,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.936903+0000","last_change":"2024-04-16T19:38:57.936927+0000","last_active":"2024-04-16T19:38:57.936903+0000","last_peered":"2024-04-16T19:38:57.936903+0000","last_clean":"2024-04-16T19:38:57.936903+0000","last_became_active":"2024-04-16T17:45:10.395394+0000","last_became_peered":"2024-04-16T17:45:10.395394+0000","last_unstale":"2024-04-16T19:38:57.936903+0000","last_undegraded":"2024-04-16T19:38:57.936903+0000","last_fullsized":"2024-04-16T19:38:57.936903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.936832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.936832+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.936832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:05:44.940160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:31.404188+0000","last_change":"2024-04-16T19:39:31.404211+0000","last_active":"2024-04-16T19:39:31.404188+0000","last_peered":"2024-04-16T19:39:31.404188+0000","last_clean":"2024-04-16T19:39:31.404188+0000","last_became_active":"2024-04-16T17:45:08.387551+0000","last_became_peered":"2024-04-16T17:45:08.387551+0000","last_unstale":"2024-04-16T19:39:31.404188+0000","last_undegraded":"2024-04-16T19:39:31.404188+0000","last_fullsized":"2024-04-16T19:39:31.404188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:31.404124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:31.404124+0000","last_clean_scrub_stamp":"2024-04-16T19:39:31.404124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:39:41.548310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"53'4","reported_seq":511,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.784566+0000","last_change":"2024-04-16T19:39:14.784594+0000","last_active":"2024-04-16T19:39:14.784566+0000","last_peered":"2024-04-16T19:39:14.784566+0000","last_clean":"2024-04-16T19:39:14.784566+0000","last_became_active":"2024-04-16T17:45:20.412160+0000","last_became_peered":"2024-04-16T17:45:20.412160+0000","last_unstale":"2024-04-16T19:39:14.784566+0000","last_undegraded":"2024-04-16T19:39:14.784566+0000","last_fullsized":"2024-04-16T19:39:14.784566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:39:14.784499+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:39:14.784499+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.784499+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:54:54.564486+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1635,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":383,"num_read_kb":388,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"53'125","reported_seq":317,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.052186+0000","last_change":"2024-04-16T19:38:58.052186+0000","last_active":"2024-04-16T19:38:58.052186+0000","last_peered":"2024-04-16T19:38:58.052186+0000","last_clean":"2024-04-16T19:38:58.052186+0000","last_became_active":"2024-04-16T17:45:22.416163+0000","last_became_peered":"2024-04-16T17:45:22.416163+0000","last_unstale":"2024-04-16T19:38:58.052186+0000","last_undegraded":"2024-04-16T19:38:58.052186+0000","last_fullsized":"2024-04-16T19:38:58.052186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'125","last_scrub_stamp":"2024-04-16T19:38:58.052092+0000","last_deep_scrub":"53'125","last_deep_scrub_stamp":"2024-04-16T19:38:58.052092+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.052092+0000","objects_scrubbed":5,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:43:10.120432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"53'13","reported_seq":1405,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.881616+0000","last_change":"2024-04-16T19:38:52.881641+0000","last_active":"2024-04-16T19:38:52.881616+0000","last_peered":"2024-04-16T19:38:52.881616+0000","last_clean":"2024-04-16T19:38:52.881616+0000","last_became_active":"2024-04-16T17:45:24.426064+0000","last_became_peered":"2024-04-16T17:45:24.426064+0000","last_unstale":"2024-04-16T19:38:52.881616+0000","last_undegraded":"2024-04-16T19:38:52.881616+0000","last_fullsized":"2024-04-16T19:38:52.881616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'13","last_scrub_stamp":"2024-04-16T19:38:52.881556+0000","last_deep_scrub":"53'13","last_deep_scrub_stamp":"2024-04-16T19:38:52.881556+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.881556+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:29:36.801510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:29.917241+0000","last_change":"2024-04-16T19:38:29.917241+0000","last_active":"2024-04-16T19:38:29.917241+0000","last_peered":"2024-04-16T19:38:29.917241+0000","last_clean":"2024-04-16T19:38:29.917241+0000","last_became_active":"2024-04-16T17:45:26.433732+0000","last_became_peered":"2024-04-16T17:45:26.433732+0000","last_unstale":"2024-04-16T19:38:29.917241+0000","last_undegraded":"2024-04-16T19:38:29.917241+0000","last_fullsized":"2024-04-16T19:38:29.917241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:29.917157+0000","last_clean_scrub_stamp":"2024-04-16T19:38:29.917157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:44:51.736564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":57,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:31.749230+0000","last_change":"2024-04-16T19:39:31.749277+0000","last_active":"2024-04-16T19:39:31.749230+0000","last_peered":"2024-04-16T19:39:31.749230+0000","last_clean":"2024-04-16T19:39:31.749230+0000","last_became_active":"2024-04-16T18:09:18.179273+0000","last_became_peered":"2024-04-16T18:09:18.179273+0000","last_unstale":"2024-04-16T19:39:31.749230+0000","last_undegraded":"2024-04-16T19:39:31.749230+0000","last_fullsized":"2024-04-16T19:39:31.749230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:31.749152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:31.749152+0000","last_clean_scrub_stamp":"2024-04-16T19:39:31.749152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:23.702375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"53'124","reported_seq":1595,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:42.373764+0000","last_change":"2024-04-16T19:38:42.373815+0000","last_active":"2024-04-16T19:38:42.373764+0000","last_peered":"2024-04-16T19:38:42.373764+0000","last_clean":"2024-04-16T19:38:42.373764+0000","last_became_active":"2024-04-16T17:46:25.521952+0000","last_became_peered":"2024-04-16T17:46:25.521952+0000","last_unstale":"2024-04-16T19:38:42.373764+0000","last_undegraded":"2024-04-16T19:38:42.373764+0000","last_fullsized":"2024-04-16T19:38:42.373764+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'124","last_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_deep_scrub":"53'124","last_deep_scrub_stamp":"2024-04-16T19:38:42.373704+0000","last_clean_scrub_stamp":"2024-04-16T19:38:42.373704+0000","objects_scrubbed":35,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:08:05.137933+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":2402,"num_read_kb":2369,"num_write":125,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8419,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.361486+0000","last_change":"2024-04-16T19:38:38.361524+0000","last_active":"2024-04-16T19:38:38.361486+0000","last_peered":"2024-04-16T19:38:38.361486+0000","last_clean":"2024-04-16T19:38:38.361486+0000","last_became_active":"2024-04-16T17:46:17.501791+0000","last_became_peered":"2024-04-16T17:46:17.501791+0000","last_unstale":"2024-04-16T19:38:38.361486+0000","last_undegraded":"2024-04-16T19:38:38.361486+0000","last_fullsized":"2024-04-16T19:38:38.361486+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:38.361386+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.361386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:07:17.483291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"53'23","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:35.803226+0000","last_change":"2024-04-16T19:38:35.803270+0000","last_active":"2024-04-16T19:38:35.803226+0000","last_peered":"2024-04-16T19:38:35.803226+0000","last_clean":"2024-04-16T19:38:35.803226+0000","last_became_active":"2024-04-16T17:45:51.479577+0000","last_became_peered":"2024-04-16T17:45:51.479577+0000","last_unstale":"2024-04-16T19:38:35.803226+0000","last_undegraded":"2024-04-16T19:38:35.803226+0000","last_fullsized":"2024-04-16T19:38:35.803226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'23","last_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_deep_scrub":"53'23","last_deep_scrub_stamp":"2024-04-16T19:38:35.803159+0000","last_clean_scrub_stamp":"2024-04-16T19:38:35.803159+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:42:41.224996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2060,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":78,"num_read_kb":69,"num_write":46,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"53'652","reported_seq":2571,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.898392+0000","last_change":"2024-04-16T19:38:30.898437+0000","last_active":"2024-04-16T19:38:30.898392+0000","last_peered":"2024-04-16T19:38:30.898392+0000","last_clean":"2024-04-16T19:38:30.898392+0000","last_became_active":"2024-04-16T17:45:49.468865+0000","last_became_peered":"2024-04-16T17:45:49.468865+0000","last_unstale":"2024-04-16T19:38:30.898392+0000","last_undegraded":"2024-04-16T19:38:30.898392+0000","last_fullsized":"2024-04-16T19:38:30.898392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:30.898322+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.898322+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:57:07.061769+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"53'539","reported_seq":988,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.232495+0000","last_change":"2024-04-16T19:38:16.232495+0000","last_active":"2024-04-16T19:38:16.232495+0000","last_peered":"2024-04-16T19:38:16.232495+0000","last_clean":"2024-04-16T19:38:16.232495+0000","last_became_active":"2024-04-16T17:45:47.461777+0000","last_became_peered":"2024-04-16T17:45:47.461777+0000","last_unstale":"2024-04-16T19:38:16.232495+0000","last_undegraded":"2024-04-16T19:38:16.232495+0000","last_fullsized":"2024-04-16T19:38:16.232495+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'539","last_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_deep_scrub":"53'539","last_deep_scrub_stamp":"2024-04-16T19:38:16.232375+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.232375+0000","objects_scrubbed":21,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:46.553060+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":243,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":899,"num_read_kb":891,"num_write":846,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7262,"num_omap_keys":33,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"53'16","reported_seq":389,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.567350+0000","last_change":"2024-04-16T19:38:23.567350+0000","last_active":"2024-04-16T19:38:23.567350+0000","last_peered":"2024-04-16T19:38:23.567350+0000","last_clean":"2024-04-16T19:38:23.567350+0000","last_became_active":"2024-04-16T17:45:45.457584+0000","last_became_peered":"2024-04-16T17:45:45.457584+0000","last_unstale":"2024-04-16T19:38:23.567350+0000","last_undegraded":"2024-04-16T19:38:23.567350+0000","last_fullsized":"2024-04-16T19:38:23.567350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:23.567241+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.567241+0000","objects_scrubbed":8,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:36:36.119901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":611,"num_read_kb":480,"num_write":87,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:58.211545+0000","last_change":"2024-04-16T19:38:58.211568+0000","last_active":"2024-04-16T19:38:58.211545+0000","last_peered":"2024-04-16T19:38:58.211545+0000","last_clean":"2024-04-16T19:38:58.211545+0000","last_became_active":"2024-04-16T17:45:10.401904+0000","last_became_peered":"2024-04-16T17:45:10.401904+0000","last_unstale":"2024-04-16T19:38:58.211545+0000","last_undegraded":"2024-04-16T19:38:58.211545+0000","last_fullsized":"2024-04-16T19:38:58.211545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:58.211474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:58.211474+0000","last_clean_scrub_stamp":"2024-04-16T19:38:58.211474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:57:17.005454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:32.569910+0000","last_change":"2024-04-16T19:39:32.569933+0000","last_active":"2024-04-16T19:39:32.569910+0000","last_peered":"2024-04-16T19:39:32.569910+0000","last_clean":"2024-04-16T19:39:32.569910+0000","last_became_active":"2024-04-16T17:45:08.384658+0000","last_became_peered":"2024-04-16T17:45:08.384658+0000","last_unstale":"2024-04-16T19:39:32.569910+0000","last_undegraded":"2024-04-16T19:39:32.569910+0000","last_fullsized":"2024-04-16T19:39:32.569910+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:32.569834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:32.569834+0000","last_clean_scrub_stamp":"2024-04-16T19:39:32.569834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:52:04.979154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":124,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.201765+0000","last_change":"2024-04-16T19:39:04.201789+0000","last_active":"2024-04-16T19:39:04.201765+0000","last_peered":"2024-04-16T19:39:04.201765+0000","last_clean":"2024-04-16T19:39:04.201765+0000","last_became_active":"2024-04-16T17:45:20.409287+0000","last_became_peered":"2024-04-16T17:45:20.409287+0000","last_unstale":"2024-04-16T19:39:04.201765+0000","last_undegraded":"2024-04-16T19:39:04.201765+0000","last_fullsized":"2024-04-16T19:39:04.201765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.201701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.201701+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.201701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:58.707408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"53'159","reported_seq":362,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.773969+0000","last_change":"2024-04-16T19:39:03.773969+0000","last_active":"2024-04-16T19:39:03.773969+0000","last_peered":"2024-04-16T19:39:03.773969+0000","last_clean":"2024-04-16T19:39:03.773969+0000","last_became_active":"2024-04-16T17:45:22.415199+0000","last_became_peered":"2024-04-16T17:45:22.415199+0000","last_unstale":"2024-04-16T19:39:03.773969+0000","last_undegraded":"2024-04-16T19:39:03.773969+0000","last_fullsized":"2024-04-16T19:39:03.773969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'159","last_scrub_stamp":"2024-04-16T19:39:03.773864+0000","last_deep_scrub":"53'159","last_deep_scrub_stamp":"2024-04-16T19:39:03.773864+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.773864+0000","objects_scrubbed":7,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:04.083969+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":233,"num_read_kb":224,"num_write":152,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:57.319175+0000","last_change":"2024-04-16T19:38:57.319175+0000","last_active":"2024-04-16T19:38:57.319175+0000","last_peered":"2024-04-16T19:38:57.319175+0000","last_clean":"2024-04-16T19:38:57.319175+0000","last_became_active":"2024-04-16T17:45:24.420900+0000","last_became_peered":"2024-04-16T17:45:24.420900+0000","last_unstale":"2024-04-16T19:38:57.319175+0000","last_undegraded":"2024-04-16T19:38:57.319175+0000","last_fullsized":"2024-04-16T19:38:57.319175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:57.319084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:57.319084+0000","last_clean_scrub_stamp":"2024-04-16T19:38:57.319084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:57.063141+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:31.923395+0000","last_change":"2024-04-16T19:38:31.923395+0000","last_active":"2024-04-16T19:38:31.923395+0000","last_peered":"2024-04-16T19:38:31.923395+0000","last_clean":"2024-04-16T19:38:31.923395+0000","last_became_active":"2024-04-16T17:45:26.432238+0000","last_became_peered":"2024-04-16T17:45:26.432238+0000","last_unstale":"2024-04-16T19:38:31.923395+0000","last_undegraded":"2024-04-16T19:38:31.923395+0000","last_fullsized":"2024-04-16T19:38:31.923395+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:31.923306+0000","last_clean_scrub_stamp":"2024-04-16T19:38:31.923306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:18:27.582944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.147955+0000","last_change":"2024-04-16T19:39:23.147978+0000","last_active":"2024-04-16T19:39:23.147955+0000","last_peered":"2024-04-16T19:39:23.147955+0000","last_clean":"2024-04-16T19:39:23.147955+0000","last_became_active":"2024-04-16T18:09:02.169420+0000","last_became_peered":"2024-04-16T18:09:02.169420+0000","last_unstale":"2024-04-16T19:39:23.147955+0000","last_undegraded":"2024-04-16T19:39:23.147955+0000","last_fullsized":"2024-04-16T19:39:23.147955+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.147892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.147892+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.147892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:43.858630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"53'166","reported_seq":2088,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.802004+0000","last_change":"2024-04-16T19:38:46.802047+0000","last_active":"2024-04-16T19:38:46.802004+0000","last_peered":"2024-04-16T19:38:46.802004+0000","last_clean":"2024-04-16T19:38:46.802004+0000","last_became_active":"2024-04-16T17:46:25.521914+0000","last_became_peered":"2024-04-16T17:46:25.521914+0000","last_unstale":"2024-04-16T19:38:46.802004+0000","last_undegraded":"2024-04-16T19:38:46.802004+0000","last_fullsized":"2024-04-16T19:38:46.802004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'166","last_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_deep_scrub":"53'166","last_deep_scrub_stamp":"2024-04-16T19:38:46.801945+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.801945+0000","objects_scrubbed":47,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:24.936944+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":3275,"num_read_kb":3233,"num_write":161,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9594,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:40.829487+0000","last_change":"2024-04-16T19:38:40.829513+0000","last_active":"2024-04-16T19:38:40.829487+0000","last_peered":"2024-04-16T19:38:40.829487+0000","last_clean":"2024-04-16T19:38:40.829487+0000","last_became_active":"2024-04-16T17:46:17.506534+0000","last_became_peered":"2024-04-16T17:46:17.506534+0000","last_unstale":"2024-04-16T19:38:40.829487+0000","last_undegraded":"2024-04-16T19:38:40.829487+0000","last_fullsized":"2024-04-16T19:38:40.829487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:40.829411+0000","last_clean_scrub_stamp":"2024-04-16T19:38:40.829411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:01:00.975262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"53'4","reported_seq":110,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.356348+0000","last_change":"2024-04-16T19:38:43.356398+0000","last_active":"2024-04-16T19:38:43.356348+0000","last_peered":"2024-04-16T19:38:43.356348+0000","last_clean":"2024-04-16T19:38:43.356348+0000","last_became_active":"2024-04-16T17:45:51.480716+0000","last_became_peered":"2024-04-16T17:45:51.480716+0000","last_unstale":"2024-04-16T19:38:43.356348+0000","last_undegraded":"2024-04-16T19:38:43.356348+0000","last_fullsized":"2024-04-16T19:38:43.356348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'4","last_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_deep_scrub":"53'4","last_deep_scrub_stamp":"2024-04-16T19:38:43.356286+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.356286+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:05:53.006964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.15","version":"53'652","reported_seq":2223,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.056637+0000","last_change":"2024-04-16T19:38:13.056637+0000","last_active":"2024-04-16T19:38:13.056637+0000","last_peered":"2024-04-16T19:38:13.056637+0000","last_clean":"2024-04-16T19:38:13.056637+0000","last_became_active":"2024-04-16T17:45:49.466650+0000","last_became_peered":"2024-04-16T17:45:49.466650+0000","last_unstale":"2024-04-16T19:38:13.056637+0000","last_undegraded":"2024-04-16T19:38:13.056637+0000","last_fullsized":"2024-04-16T19:38:13.056637+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'652","last_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_deep_scrub":"53'652","last_deep_scrub_stamp":"2024-04-16T19:38:13.056540+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.056540+0000","objects_scrubbed":1,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:13:02.968001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'298","reported_seq":598,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:18.796439+0000","last_change":"2024-04-16T19:38:18.796507+0000","last_active":"2024-04-16T19:38:18.796439+0000","last_peered":"2024-04-16T19:38:18.796439+0000","last_clean":"2024-04-16T19:38:18.796439+0000","last_became_active":"2024-04-16T17:45:47.460978+0000","last_became_peered":"2024-04-16T17:45:47.460978+0000","last_unstale":"2024-04-16T19:38:18.796439+0000","last_undegraded":"2024-04-16T19:38:18.796439+0000","last_fullsized":"2024-04-16T19:38:18.796439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'298","last_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_deep_scrub":"53'298","last_deep_scrub_stamp":"2024-04-16T19:38:18.796372+0000","last_clean_scrub_stamp":"2024-04-16T19:38:18.796372+0000","objects_scrubbed":17,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:49:20.964465+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":498,"num_read_kb":485,"num_write":274,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"53'22","reported_seq":392,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.891278+0000","last_change":"2024-04-16T19:38:13.891278+0000","last_active":"2024-04-16T19:38:13.891278+0000","last_peered":"2024-04-16T19:38:13.891278+0000","last_clean":"2024-04-16T19:38:13.891278+0000","last_became_active":"2024-04-16T17:45:45.465517+0000","last_became_peered":"2024-04-16T17:45:45.465517+0000","last_unstale":"2024-04-16T19:38:13.891278+0000","last_undegraded":"2024-04-16T19:38:13.891278+0000","last_fullsized":"2024-04-16T19:38:13.891278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:13.891146+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.891146+0000","objects_scrubbed":10,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:51:21.530454+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":456,"num_write":117,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":133,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.109273+0000","last_change":"2024-04-16T19:39:18.109298+0000","last_active":"2024-04-16T19:39:18.109273+0000","last_peered":"2024-04-16T19:39:18.109273+0000","last_clean":"2024-04-16T19:39:18.109273+0000","last_became_active":"2024-04-16T17:45:10.392449+0000","last_became_peered":"2024-04-16T17:45:10.392449+0000","last_unstale":"2024-04-16T19:39:18.109273+0000","last_undegraded":"2024-04-16T19:39:18.109273+0000","last_fullsized":"2024-04-16T19:39:18.109273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.109211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.109211+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.109211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:43:18.419316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:27.535675+0000","last_change":"2024-04-16T19:39:27.535699+0000","last_active":"2024-04-16T19:39:27.535675+0000","last_peered":"2024-04-16T19:39:27.535675+0000","last_clean":"2024-04-16T19:39:27.535675+0000","last_became_active":"2024-04-16T17:45:08.385662+0000","last_became_peered":"2024-04-16T17:45:08.385662+0000","last_unstale":"2024-04-16T19:39:27.535675+0000","last_undegraded":"2024-04-16T19:39:27.535675+0000","last_fullsized":"2024-04-16T19:39:27.535675+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:27.535611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:27.535611+0000","last_clean_scrub_stamp":"2024-04-16T19:39:27.535611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:41:25.797201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"53'12","reported_seq":150,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.710052+0000","last_change":"2024-04-16T19:39:09.710082+0000","last_active":"2024-04-16T19:39:09.710052+0000","last_peered":"2024-04-16T19:39:09.710052+0000","last_clean":"2024-04-16T19:39:09.710052+0000","last_became_active":"2024-04-16T17:45:20.407703+0000","last_became_peered":"2024-04-16T17:45:20.407703+0000","last_unstale":"2024-04-16T19:39:09.710052+0000","last_undegraded":"2024-04-16T19:39:09.710052+0000","last_fullsized":"2024-04-16T19:39:09.710052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:39:09.709987+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:39:09.709987+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.709987+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:16.883391+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"53'84","reported_seq":251,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.359086+0000","last_change":"2024-04-16T19:39:03.359148+0000","last_active":"2024-04-16T19:39:03.359086+0000","last_peered":"2024-04-16T19:39:03.359086+0000","last_clean":"2024-04-16T19:39:03.359086+0000","last_became_active":"2024-04-16T17:45:22.414779+0000","last_became_peered":"2024-04-16T17:45:22.414779+0000","last_unstale":"2024-04-16T19:39:03.359086+0000","last_undegraded":"2024-04-16T19:39:03.359086+0000","last_fullsized":"2024-04-16T19:39:03.359086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:39:03.359011+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:39:03.359011+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.359011+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:01:55.613704+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":118,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:53.949931+0000","last_change":"2024-04-16T19:38:53.949931+0000","last_active":"2024-04-16T19:38:53.949931+0000","last_peered":"2024-04-16T19:38:53.949931+0000","last_clean":"2024-04-16T19:38:53.949931+0000","last_became_active":"2024-04-16T17:45:24.425123+0000","last_became_peered":"2024-04-16T17:45:24.425123+0000","last_unstale":"2024-04-16T19:38:53.949931+0000","last_undegraded":"2024-04-16T19:38:53.949931+0000","last_fullsized":"2024-04-16T19:38:53.949931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:53.949843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:53.949843+0000","last_clean_scrub_stamp":"2024-04-16T19:38:53.949843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:01.943632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.722443+0000","last_change":"2024-04-16T19:38:23.722443+0000","last_active":"2024-04-16T19:38:23.722443+0000","last_peered":"2024-04-16T19:38:23.722443+0000","last_clean":"2024-04-16T19:38:23.722443+0000","last_became_active":"2024-04-16T17:45:26.848803+0000","last_became_peered":"2024-04-16T17:45:26.848803+0000","last_unstale":"2024-04-16T19:38:23.722443+0000","last_undegraded":"2024-04-16T19:38:23.722443+0000","last_fullsized":"2024-04-16T19:38:23.722443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.722357+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.722357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:38.742703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:39.432246+0000","last_change":"2024-04-16T19:39:39.432270+0000","last_active":"2024-04-16T19:39:39.432246+0000","last_peered":"2024-04-16T19:39:39.432246+0000","last_clean":"2024-04-16T19:39:39.432246+0000","last_became_active":"2024-04-16T18:09:02.171050+0000","last_became_peered":"2024-04-16T18:09:02.171050+0000","last_unstale":"2024-04-16T19:39:39.432246+0000","last_undegraded":"2024-04-16T19:39:39.432246+0000","last_fullsized":"2024-04-16T19:39:39.432246+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:39.432178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:39.432178+0000","last_clean_scrub_stamp":"2024-04-16T19:39:39.432178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:42.643673+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.13","version":"53'161","reported_seq":1777,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.064843+0000","last_change":"2024-04-16T19:38:41.064904+0000","last_active":"2024-04-16T19:38:41.064843+0000","last_peered":"2024-04-16T19:38:41.064843+0000","last_clean":"2024-04-16T19:38:41.064843+0000","last_became_active":"2024-04-16T17:46:25.526100+0000","last_became_peered":"2024-04-16T17:46:25.526100+0000","last_unstale":"2024-04-16T19:38:41.064843+0000","last_undegraded":"2024-04-16T19:38:41.064843+0000","last_fullsized":"2024-04-16T19:38:41.064843+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'161","last_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_deep_scrub":"53'161","last_deep_scrub_stamp":"2024-04-16T19:38:41.064780+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.064780+0000","objects_scrubbed":41,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:59.693856+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":2686,"num_read_kb":2726,"num_write":176,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":41,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9554,"num_omap_keys":40,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.719529+0000","last_change":"2024-04-16T19:38:28.719553+0000","last_active":"2024-04-16T19:38:28.719529+0000","last_peered":"2024-04-16T19:38:28.719529+0000","last_clean":"2024-04-16T19:38:28.719529+0000","last_became_active":"2024-04-16T17:46:17.500662+0000","last_became_peered":"2024-04-16T17:46:17.500662+0000","last_unstale":"2024-04-16T19:38:28.719529+0000","last_undegraded":"2024-04-16T19:38:28.719529+0000","last_fullsized":"2024-04-16T19:38:28.719529+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:28.719459+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.719459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:05.470964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"53'22","reported_seq":166,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.884097+0000","last_change":"2024-04-16T19:38:49.884129+0000","last_active":"2024-04-16T19:38:49.884097+0000","last_peered":"2024-04-16T19:38:49.884097+0000","last_clean":"2024-04-16T19:38:49.884097+0000","last_became_active":"2024-04-16T17:45:51.478329+0000","last_became_peered":"2024-04-16T17:45:51.478329+0000","last_unstale":"2024-04-16T19:38:49.884097+0000","last_undegraded":"2024-04-16T19:38:49.884097+0000","last_fullsized":"2024-04-16T19:38:49.884097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:49.884034+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:49.884034+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.884034+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T23:01:44.389740+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":753,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":193,"num_read_kb":146,"num_write":68,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:51.923269+0000","last_change":"2024-04-16T19:38:51.923269+0000","last_active":"2024-04-16T19:38:51.923269+0000","last_peered":"2024-04-16T19:38:51.923269+0000","last_clean":"2024-04-16T19:38:51.923269+0000","last_became_active":"2024-04-16T17:45:49.473881+0000","last_became_peered":"2024-04-16T17:45:49.473881+0000","last_unstale":"2024-04-16T19:38:51.923269+0000","last_undegraded":"2024-04-16T19:38:51.923269+0000","last_fullsized":"2024-04-16T19:38:51.923269+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:51.923171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:51.923171+0000","last_clean_scrub_stamp":"2024-04-16T19:38:51.923171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:03:40.361335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"53'5056","reported_seq":7416,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:24.912040+0000","last_change":"2024-04-16T19:38:24.912040+0000","last_active":"2024-04-16T19:38:24.912040+0000","last_peered":"2024-04-16T19:38:24.912040+0000","last_clean":"2024-04-16T19:38:24.912040+0000","last_became_active":"2024-04-16T17:45:47.462645+0000","last_became_peered":"2024-04-16T17:45:47.462645+0000","last_unstale":"2024-04-16T19:38:24.912040+0000","last_undegraded":"2024-04-16T19:38:24.912040+0000","last_fullsized":"2024-04-16T19:38:24.912040+0000","mapping_epoch":33,"log_start":"53'3300","ondisk_log_start":"53'3300","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'5056","last_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_deep_scrub":"53'5056","last_deep_scrub_stamp":"2024-04-16T19:38:24.911937+0000","last_clean_scrub_stamp":"2024-04-16T19:38:24.911937+0000","objects_scrubbed":13,"log_size":1756,"log_dups_size":3000,"ondisk_log_size":1756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:39:21.591600+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":9514,"num_read_kb":9509,"num_write":5111,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"53'22","reported_seq":459,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.780629+0000","last_change":"2024-04-16T19:38:17.780675+0000","last_active":"2024-04-16T19:38:17.780629+0000","last_peered":"2024-04-16T19:38:17.780629+0000","last_clean":"2024-04-16T19:38:17.780629+0000","last_became_active":"2024-04-16T17:45:45.458623+0000","last_became_peered":"2024-04-16T17:45:45.458623+0000","last_unstale":"2024-04-16T19:38:17.780629+0000","last_undegraded":"2024-04-16T19:38:17.780629+0000","last_fullsized":"2024-04-16T19:38:17.780629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.780565+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.780565+0000","objects_scrubbed":9,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:12:41.464784+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":842,"num_read_kb":656,"num_write":103,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.403832+0000","last_change":"2024-04-16T19:39:14.403864+0000","last_active":"2024-04-16T19:39:14.403832+0000","last_peered":"2024-04-16T19:39:14.403832+0000","last_clean":"2024-04-16T19:39:14.403832+0000","last_became_active":"2024-04-16T17:45:10.396972+0000","last_became_peered":"2024-04-16T17:45:10.396972+0000","last_unstale":"2024-04-16T19:39:14.403832+0000","last_undegraded":"2024-04-16T19:39:14.403832+0000","last_fullsized":"2024-04-16T19:39:14.403832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.403772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.403772+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.403772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:12:10.794444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":148,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:15.188544+0000","last_change":"2024-04-16T19:39:15.188544+0000","last_active":"2024-04-16T19:39:15.188544+0000","last_peered":"2024-04-16T19:39:15.188544+0000","last_clean":"2024-04-16T19:39:15.188544+0000","last_became_active":"2024-04-16T17:45:08.385093+0000","last_became_peered":"2024-04-16T17:45:08.385093+0000","last_unstale":"2024-04-16T19:39:15.188544+0000","last_undegraded":"2024-04-16T19:39:15.188544+0000","last_fullsized":"2024-04-16T19:39:15.188544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:15.188460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:15.188460+0000","last_clean_scrub_stamp":"2024-04-16T19:39:15.188460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:40.945701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"53'7","reported_seq":1415,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.128495+0000","last_change":"2024-04-16T19:39:10.128523+0000","last_active":"2024-04-16T19:39:10.128495+0000","last_peered":"2024-04-16T19:39:10.128495+0000","last_clean":"2024-04-16T19:39:10.128495+0000","last_became_active":"2024-04-16T17:45:20.413074+0000","last_became_peered":"2024-04-16T17:45:20.413074+0000","last_unstale":"2024-04-16T19:39:10.128495+0000","last_undegraded":"2024-04-16T19:39:10.128495+0000","last_fullsized":"2024-04-16T19:39:10.128495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'7","last_scrub_stamp":"2024-04-16T19:39:10.128422+0000","last_deep_scrub":"53'7","last_deep_scrub_stamp":"2024-04-16T19:39:10.128422+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.128422+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:18.122211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"53'34","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.378953+0000","last_change":"2024-04-16T19:39:02.378981+0000","last_active":"2024-04-16T19:39:02.378953+0000","last_peered":"2024-04-16T19:39:02.378953+0000","last_clean":"2024-04-16T19:39:02.378953+0000","last_became_active":"2024-04-16T17:45:22.414756+0000","last_became_peered":"2024-04-16T17:45:22.414756+0000","last_unstale":"2024-04-16T19:39:02.378953+0000","last_undegraded":"2024-04-16T19:39:02.378953+0000","last_fullsized":"2024-04-16T19:39:02.378953+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'34","last_scrub_stamp":"2024-04-16T19:39:02.378896+0000","last_deep_scrub":"53'34","last_deep_scrub_stamp":"2024-04-16T19:39:02.378896+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.378896+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:09.552301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":49,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:33.934976+0000","last_change":"2024-04-16T19:38:33.934997+0000","last_active":"2024-04-16T19:38:33.934976+0000","last_peered":"2024-04-16T19:38:33.934976+0000","last_clean":"2024-04-16T19:38:33.934976+0000","last_became_active":"2024-04-16T17:45:24.430629+0000","last_became_peered":"2024-04-16T17:45:24.430629+0000","last_unstale":"2024-04-16T19:38:33.934976+0000","last_undegraded":"2024-04-16T19:38:33.934976+0000","last_fullsized":"2024-04-16T19:38:33.934976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:33.934914+0000","last_clean_scrub_stamp":"2024-04-16T19:38:33.934914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:40:28.582406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":114,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.875874+0000","last_change":"2024-04-16T19:38:26.875874+0000","last_active":"2024-04-16T19:38:26.875874+0000","last_peered":"2024-04-16T19:38:26.875874+0000","last_clean":"2024-04-16T19:38:26.875874+0000","last_became_active":"2024-04-16T17:45:26.438336+0000","last_became_peered":"2024-04-16T17:45:26.438336+0000","last_unstale":"2024-04-16T19:38:26.875874+0000","last_undegraded":"2024-04-16T19:38:26.875874+0000","last_fullsized":"2024-04-16T19:38:26.875874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.875781+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.875781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:07:49.640010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":63,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.823718+0000","last_change":"2024-04-16T19:39:26.823743+0000","last_active":"2024-04-16T19:39:26.823718+0000","last_peered":"2024-04-16T19:39:26.823718+0000","last_clean":"2024-04-16T19:39:26.823718+0000","last_became_active":"2024-04-16T18:09:02.165798+0000","last_became_peered":"2024-04-16T18:09:02.165798+0000","last_unstale":"2024-04-16T19:39:26.823718+0000","last_undegraded":"2024-04-16T19:39:26.823718+0000","last_fullsized":"2024-04-16T19:39:26.823718+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.823645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.823645+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.823645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:35:20.709880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"53'170","reported_seq":1771,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:49.011174+0000","last_change":"2024-04-16T19:38:49.011216+0000","last_active":"2024-04-16T19:38:49.011174+0000","last_peered":"2024-04-16T19:38:49.011174+0000","last_clean":"2024-04-16T19:38:49.011174+0000","last_became_active":"2024-04-16T17:46:25.531450+0000","last_became_peered":"2024-04-16T17:46:25.531450+0000","last_unstale":"2024-04-16T19:38:49.011174+0000","last_undegraded":"2024-04-16T19:38:49.011174+0000","last_fullsized":"2024-04-16T19:38:49.011174+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'170","last_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_deep_scrub":"53'170","last_deep_scrub_stamp":"2024-04-16T19:38:49.011115+0000","last_clean_scrub_stamp":"2024-04-16T19:38:49.011115+0000","objects_scrubbed":44,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:08:02.979509+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":2594,"num_read_kb":2548,"num_write":179,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10942,"num_omap_keys":44,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":89,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:30.751164+0000","last_change":"2024-04-16T19:38:30.751189+0000","last_active":"2024-04-16T19:38:30.751164+0000","last_peered":"2024-04-16T19:38:30.751164+0000","last_clean":"2024-04-16T19:38:30.751164+0000","last_became_active":"2024-04-16T17:46:17.505598+0000","last_became_peered":"2024-04-16T17:46:17.505598+0000","last_unstale":"2024-04-16T19:38:30.751164+0000","last_undegraded":"2024-04-16T19:38:30.751164+0000","last_fullsized":"2024-04-16T19:38:30.751164+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:30.751094+0000","last_clean_scrub_stamp":"2024-04-16T19:38:30.751094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:36:44.801073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"53'14","reported_seq":130,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:46.374218+0000","last_change":"2024-04-16T19:38:46.374254+0000","last_active":"2024-04-16T19:38:46.374218+0000","last_peered":"2024-04-16T19:38:46.374218+0000","last_clean":"2024-04-16T19:38:46.374218+0000","last_became_active":"2024-04-16T17:45:51.477906+0000","last_became_peered":"2024-04-16T17:45:51.477906+0000","last_unstale":"2024-04-16T19:38:46.374218+0000","last_undegraded":"2024-04-16T19:38:46.374218+0000","last_fullsized":"2024-04-16T19:38:46.374218+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:46.374155+0000","last_clean_scrub_stamp":"2024-04-16T19:38:46.374155+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:53:12.131396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":538,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":47,"num_read_kb":41,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":100,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:26.750144+0000","last_change":"2024-04-16T19:38:26.750144+0000","last_active":"2024-04-16T19:38:26.750144+0000","last_peered":"2024-04-16T19:38:26.750144+0000","last_clean":"2024-04-16T19:38:26.750144+0000","last_became_active":"2024-04-16T17:45:49.470659+0000","last_became_peered":"2024-04-16T17:45:49.470659+0000","last_unstale":"2024-04-16T19:38:26.750144+0000","last_undegraded":"2024-04-16T19:38:26.750144+0000","last_fullsized":"2024-04-16T19:38:26.750144+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:26.750020+0000","last_clean_scrub_stamp":"2024-04-16T19:38:26.750020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:03.892413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.16","version":"53'576","reported_seq":1559,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:28.901634+0000","last_change":"2024-04-16T19:38:28.901634+0000","last_active":"2024-04-16T19:38:28.901634+0000","last_peered":"2024-04-16T19:38:28.901634+0000","last_clean":"2024-04-16T19:38:28.901634+0000","last_became_active":"2024-04-16T17:45:47.463761+0000","last_became_peered":"2024-04-16T17:45:47.463761+0000","last_unstale":"2024-04-16T19:38:28.901634+0000","last_undegraded":"2024-04-16T19:38:28.901634+0000","last_fullsized":"2024-04-16T19:38:28.901634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'576","last_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_deep_scrub":"53'576","last_deep_scrub_stamp":"2024-04-16T19:38:28.901479+0000","last_clean_scrub_stamp":"2024-04-16T19:38:28.901479+0000","objects_scrubbed":22,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:02:47.579102+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54010,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":2331,"num_read_kb":1982,"num_write":976,"num_write_kb":733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"53'11","reported_seq":532,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.330127+0000","last_change":"2024-04-16T19:38:39.330127+0000","last_active":"2024-04-16T19:38:39.330127+0000","last_peered":"2024-04-16T19:38:39.330127+0000","last_clean":"2024-04-16T19:38:39.330127+0000","last_became_active":"2024-04-16T17:45:45.454650+0000","last_became_peered":"2024-04-16T17:45:45.454650+0000","last_unstale":"2024-04-16T19:38:39.330127+0000","last_undegraded":"2024-04-16T19:38:39.330127+0000","last_fullsized":"2024-04-16T19:38:39.330127+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:39.330010+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.330010+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:11:17.064209+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1113,"num_read_kb":838,"num_write":65,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:08.058744+0000","last_change":"2024-04-16T19:39:08.058781+0000","last_active":"2024-04-16T19:39:08.058744+0000","last_peered":"2024-04-16T19:39:08.058744+0000","last_clean":"2024-04-16T19:39:08.058744+0000","last_became_active":"2024-04-16T17:45:10.399729+0000","last_became_peered":"2024-04-16T17:45:10.399729+0000","last_unstale":"2024-04-16T19:39:08.058744+0000","last_undegraded":"2024-04-16T19:39:08.058744+0000","last_fullsized":"2024-04-16T19:39:08.058744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:08.058658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:08.058658+0000","last_clean_scrub_stamp":"2024-04-16T19:39:08.058658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:44:15.232062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:28.371056+0000","last_change":"2024-04-16T19:39:28.371056+0000","last_active":"2024-04-16T19:39:28.371056+0000","last_peered":"2024-04-16T19:39:28.371056+0000","last_clean":"2024-04-16T19:39:28.371056+0000","last_became_active":"2024-04-16T17:45:08.386347+0000","last_became_peered":"2024-04-16T17:45:08.386347+0000","last_unstale":"2024-04-16T19:39:28.371056+0000","last_undegraded":"2024-04-16T19:39:28.371056+0000","last_fullsized":"2024-04-16T19:39:28.371056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:28.370959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:28.370959+0000","last_clean_scrub_stamp":"2024-04-16T19:39:28.370959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:02:32.532383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"53'2","reported_seq":128,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.860239+0000","last_change":"2024-04-16T19:39:10.860239+0000","last_active":"2024-04-16T19:39:10.860239+0000","last_peered":"2024-04-16T19:39:10.860239+0000","last_clean":"2024-04-16T19:39:10.860239+0000","last_became_active":"2024-04-16T17:45:20.412078+0000","last_became_peered":"2024-04-16T17:45:20.412078+0000","last_unstale":"2024-04-16T19:39:10.860239+0000","last_undegraded":"2024-04-16T19:39:10.860239+0000","last_fullsized":"2024-04-16T19:39:10.860239+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'2","last_scrub_stamp":"2024-04-16T19:39:10.860109+0000","last_deep_scrub":"53'2","last_deep_scrub_stamp":"2024-04-16T19:39:10.860109+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.860109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:42:10.604165+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"53'84","reported_seq":249,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:52.359931+0000","last_change":"2024-04-16T19:38:52.359986+0000","last_active":"2024-04-16T19:38:52.359931+0000","last_peered":"2024-04-16T19:38:52.359931+0000","last_clean":"2024-04-16T19:38:52.359931+0000","last_became_active":"2024-04-16T17:45:22.421225+0000","last_became_peered":"2024-04-16T17:45:22.421225+0000","last_unstale":"2024-04-16T19:38:52.359931+0000","last_undegraded":"2024-04-16T19:38:52.359931+0000","last_fullsized":"2024-04-16T19:38:52.359931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'84","last_scrub_stamp":"2024-04-16T19:38:52.359856+0000","last_deep_scrub":"53'84","last_deep_scrub_stamp":"2024-04-16T19:38:52.359856+0000","last_clean_scrub_stamp":"2024-04-16T19:38:52.359856+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:14:57.288122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":80,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":116,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:50.397137+0000","last_change":"2024-04-16T19:38:50.397161+0000","last_active":"2024-04-16T19:38:50.397137+0000","last_peered":"2024-04-16T19:38:50.397137+0000","last_clean":"2024-04-16T19:38:50.397137+0000","last_became_active":"2024-04-16T17:45:24.423760+0000","last_became_peered":"2024-04-16T17:45:24.423760+0000","last_unstale":"2024-04-16T19:38:50.397137+0000","last_undegraded":"2024-04-16T19:38:50.397137+0000","last_fullsized":"2024-04-16T19:38:50.397137+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:50.397068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:50.397068+0000","last_clean_scrub_stamp":"2024-04-16T19:38:50.397068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:48:47.446913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":115,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:41.316150+0000","last_change":"2024-04-16T19:38:41.316173+0000","last_active":"2024-04-16T19:38:41.316150+0000","last_peered":"2024-04-16T19:38:41.316150+0000","last_clean":"2024-04-16T19:38:41.316150+0000","last_became_active":"2024-04-16T17:45:26.432973+0000","last_became_peered":"2024-04-16T17:45:26.432973+0000","last_unstale":"2024-04-16T19:38:41.316150+0000","last_undegraded":"2024-04-16T19:38:41.316150+0000","last_fullsized":"2024-04-16T19:38:41.316150+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:41.316087+0000","last_clean_scrub_stamp":"2024-04-16T19:38:41.316087+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:50:00.704252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2a","version":"53'10","reported_seq":205,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:36.211015+0000","last_change":"2024-04-16T19:38:36.211054+0000","last_active":"2024-04-16T19:38:36.211015+0000","last_peered":"2024-04-16T19:38:36.211015+0000","last_clean":"2024-04-16T19:38:36.211015+0000","last_became_active":"2024-04-16T17:45:45.455402+0000","last_became_peered":"2024-04-16T17:45:45.455402+0000","last_unstale":"2024-04-16T19:38:36.211015+0000","last_undegraded":"2024-04-16T19:38:36.211015+0000","last_fullsized":"2024-04-16T19:38:36.211015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'10","last_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_deep_scrub":"53'10","last_deep_scrub_stamp":"2024-04-16T19:38:36.210953+0000","last_clean_scrub_stamp":"2024-04-16T19:38:36.210953+0000","objects_scrubbed":5,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:26:18.456725+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":108,"num_write":47,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":95,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:23.073046+0000","last_change":"2024-04-16T19:38:23.073046+0000","last_active":"2024-04-16T19:38:23.073046+0000","last_peered":"2024-04-16T19:38:23.073046+0000","last_clean":"2024-04-16T19:38:23.073046+0000","last_became_active":"2024-04-16T17:46:16.500252+0000","last_became_peered":"2024-04-16T17:46:16.500252+0000","last_unstale":"2024-04-16T19:38:23.073046+0000","last_undegraded":"2024-04-16T19:38:23.073046+0000","last_fullsized":"2024-04-16T19:38:23.073046+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:23.072960+0000","last_clean_scrub_stamp":"2024-04-16T19:38:23.072960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:26:19.149593+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":147,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.112345+0000","last_change":"2024-04-16T19:39:16.112345+0000","last_active":"2024-04-16T19:39:16.112345+0000","last_peered":"2024-04-16T19:39:16.112345+0000","last_clean":"2024-04-16T19:39:16.112345+0000","last_became_active":"2024-04-16T17:45:08.382780+0000","last_became_peered":"2024-04-16T17:45:08.382780+0000","last_unstale":"2024-04-16T19:39:16.112345+0000","last_undegraded":"2024-04-16T19:39:16.112345+0000","last_fullsized":"2024-04-16T19:39:16.112345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.112261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.112261+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.112261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:36.823000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"53'21","reported_seq":241,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:13.709521+0000","last_change":"2024-04-16T19:38:13.709521+0000","last_active":"2024-04-16T19:38:13.709521+0000","last_peered":"2024-04-16T19:38:13.709521+0000","last_clean":"2024-04-16T19:38:13.709521+0000","last_became_active":"2024-04-16T17:45:45.464634+0000","last_became_peered":"2024-04-16T17:45:45.464634+0000","last_unstale":"2024-04-16T19:38:13.709521+0000","last_undegraded":"2024-04-16T19:38:13.709521+0000","last_fullsized":"2024-04-16T19:38:13.709521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'21","last_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_deep_scrub":"53'21","last_deep_scrub_stamp":"2024-04-16T19:38:13.709408+0000","last_clean_scrub_stamp":"2024-04-16T19:38:13.709408+0000","objects_scrubbed":6,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:50:26.428610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":171,"num_write":74,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:07.810806+0000","last_change":"2024-04-16T19:39:07.810827+0000","last_active":"2024-04-16T19:39:07.810806+0000","last_peered":"2024-04-16T19:39:07.810806+0000","last_clean":"2024-04-16T19:39:07.810806+0000","last_became_active":"2024-04-16T17:45:10.395411+0000","last_became_peered":"2024-04-16T17:45:10.395411+0000","last_unstale":"2024-04-16T19:39:07.810806+0000","last_undegraded":"2024-04-16T19:39:07.810806+0000","last_fullsized":"2024-04-16T19:39:07.810806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:07.810743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:07.810743+0000","last_clean_scrub_stamp":"2024-04-16T19:39:07.810743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:06:28.521482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.084035+0000","last_change":"2024-04-16T19:39:10.084035+0000","last_active":"2024-04-16T19:39:10.084035+0000","last_peered":"2024-04-16T19:39:10.084035+0000","last_clean":"2024-04-16T19:39:10.084035+0000","last_became_active":"2024-04-16T17:45:08.390297+0000","last_became_peered":"2024-04-16T17:45:08.390297+0000","last_unstale":"2024-04-16T19:39:10.084035+0000","last_undegraded":"2024-04-16T19:39:10.084035+0000","last_fullsized":"2024-04-16T19:39:10.084035+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:10.083904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:10.083904+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.083904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:23:39.621474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.28","version":"53'26","reported_seq":487,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:15.777083+0000","last_change":"2024-04-16T19:38:15.777083+0000","last_active":"2024-04-16T19:38:15.777083+0000","last_peered":"2024-04-16T19:38:15.777083+0000","last_clean":"2024-04-16T19:38:15.777083+0000","last_became_active":"2024-04-16T17:45:45.463878+0000","last_became_peered":"2024-04-16T17:45:45.463878+0000","last_unstale":"2024-04-16T19:38:15.777083+0000","last_undegraded":"2024-04-16T19:38:15.777083+0000","last_fullsized":"2024-04-16T19:38:15.777083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'26","last_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_deep_scrub":"53'26","last_deep_scrub_stamp":"2024-04-16T19:38:15.776944+0000","last_clean_scrub_stamp":"2024-04-16T19:38:15.776944+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:31:01.810616+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":973,"num_read_kb":637,"num_write":132,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:26.561605+0000","last_change":"2024-04-16T19:39:26.561649+0000","last_active":"2024-04-16T19:39:26.561605+0000","last_peered":"2024-04-16T19:39:26.561605+0000","last_clean":"2024-04-16T19:39:26.561605+0000","last_became_active":"2024-04-16T17:45:10.400139+0000","last_became_peered":"2024-04-16T17:45:10.400139+0000","last_unstale":"2024-04-16T19:39:26.561605+0000","last_undegraded":"2024-04-16T19:39:26.561605+0000","last_fullsized":"2024-04-16T19:39:26.561605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:26.561510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:26.561510+0000","last_clean_scrub_stamp":"2024-04-16T19:39:26.561510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:34:03.949037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":97,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:32.767299+0000","last_change":"2024-04-16T19:38:32.767299+0000","last_active":"2024-04-16T19:38:32.767299+0000","last_peered":"2024-04-16T19:38:32.767299+0000","last_clean":"2024-04-16T19:38:32.767299+0000","last_became_active":"2024-04-16T17:46:16.499494+0000","last_became_peered":"2024-04-16T17:46:16.499494+0000","last_unstale":"2024-04-16T19:38:32.767299+0000","last_undegraded":"2024-04-16T19:38:32.767299+0000","last_fullsized":"2024-04-16T19:38:32.767299+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:32.767206+0000","last_clean_scrub_stamp":"2024-04-16T19:38:32.767206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:02:09.909599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.29","version":"53'16","reported_seq":319,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:27.568053+0000","last_change":"2024-04-16T19:38:27.568053+0000","last_active":"2024-04-16T19:38:27.568053+0000","last_peered":"2024-04-16T19:38:27.568053+0000","last_clean":"2024-04-16T19:38:27.568053+0000","last_became_active":"2024-04-16T17:46:16.503226+0000","last_became_peered":"2024-04-16T17:46:16.503226+0000","last_unstale":"2024-04-16T19:38:27.568053+0000","last_undegraded":"2024-04-16T19:38:27.568053+0000","last_fullsized":"2024-04-16T19:38:27.568053+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:27.567879+0000","last_clean_scrub_stamp":"2024-04-16T19:38:27.567879+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:06:46.513343+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":484,"num_read_kb":409,"num_write":86,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:11.866893+0000","last_change":"2024-04-16T19:39:11.866932+0000","last_active":"2024-04-16T19:39:11.866893+0000","last_peered":"2024-04-16T19:39:11.866893+0000","last_clean":"2024-04-16T19:39:11.866893+0000","last_became_active":"2024-04-16T17:45:10.393460+0000","last_became_peered":"2024-04-16T17:45:10.393460+0000","last_unstale":"2024-04-16T19:39:11.866893+0000","last_undegraded":"2024-04-16T19:39:11.866893+0000","last_fullsized":"2024-04-16T19:39:11.866893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:11.866811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:11.866811+0000","last_clean_scrub_stamp":"2024-04-16T19:39:11.866811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:00:39.263723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":146,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:33.404229+0000","last_change":"2024-04-16T19:39:33.404252+0000","last_active":"2024-04-16T19:39:33.404229+0000","last_peered":"2024-04-16T19:39:33.404229+0000","last_clean":"2024-04-16T19:39:33.404229+0000","last_became_active":"2024-04-16T17:45:08.389098+0000","last_became_peered":"2024-04-16T17:45:08.389098+0000","last_unstale":"2024-04-16T19:39:33.404229+0000","last_undegraded":"2024-04-16T19:39:33.404229+0000","last_fullsized":"2024-04-16T19:39:33.404229+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:33.404158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:33.404158+0000","last_clean_scrub_stamp":"2024-04-16T19:39:33.404158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:39:13.063570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"53'12","reported_seq":233,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:21.763410+0000","last_change":"2024-04-16T19:38:21.763470+0000","last_active":"2024-04-16T19:38:21.763410+0000","last_peered":"2024-04-16T19:38:21.763410+0000","last_clean":"2024-04-16T19:38:21.763410+0000","last_became_active":"2024-04-16T17:45:45.463074+0000","last_became_peered":"2024-04-16T17:45:45.463074+0000","last_unstale":"2024-04-16T19:38:21.763410+0000","last_undegraded":"2024-04-16T19:38:21.763410+0000","last_fullsized":"2024-04-16T19:38:21.763410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:21.763344+0000","last_clean_scrub_stamp":"2024-04-16T19:38:21.763344+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:36.589324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":151,"num_write":64,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:02.006817+0000","last_change":"2024-04-16T19:39:02.006863+0000","last_active":"2024-04-16T19:39:02.006817+0000","last_peered":"2024-04-16T19:39:02.006817+0000","last_clean":"2024-04-16T19:39:02.006817+0000","last_became_active":"2024-04-16T17:45:10.393888+0000","last_became_peered":"2024-04-16T17:45:10.393888+0000","last_unstale":"2024-04-16T19:39:02.006817+0000","last_undegraded":"2024-04-16T19:39:02.006817+0000","last_fullsized":"2024-04-16T19:39:02.006817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:02.006726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:02.006726+0000","last_clean_scrub_stamp":"2024-04-16T19:39:02.006726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:55:40.141725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.332451+0000","last_change":"2024-04-16T19:39:21.332477+0000","last_active":"2024-04-16T19:39:21.332451+0000","last_peered":"2024-04-16T19:39:21.332451+0000","last_clean":"2024-04-16T19:39:21.332451+0000","last_became_active":"2024-04-16T17:45:08.390704+0000","last_became_peered":"2024-04-16T17:45:08.390704+0000","last_unstale":"2024-04-16T19:39:21.332451+0000","last_undegraded":"2024-04-16T19:39:21.332451+0000","last_fullsized":"2024-04-16T19:39:21.332451+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.332386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.332386+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.332386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:16.685970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"53'60","reported_seq":651,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.053558+0000","last_change":"2024-04-16T19:38:16.053634+0000","last_active":"2024-04-16T19:38:16.053558+0000","last_peered":"2024-04-16T19:38:16.053558+0000","last_clean":"2024-04-16T19:38:16.053558+0000","last_became_active":"2024-04-16T17:45:45.465263+0000","last_became_peered":"2024-04-16T17:45:45.465263+0000","last_unstale":"2024-04-16T19:38:16.053558+0000","last_undegraded":"2024-04-16T19:38:16.053558+0000","last_fullsized":"2024-04-16T19:38:16.053558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'60","last_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_deep_scrub":"53'60","last_deep_scrub_stamp":"2024-04-16T19:38:16.053490+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.053490+0000","objects_scrubbed":10,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:25:34.189324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1337,"num_read_kb":975,"num_write":208,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:09.151872+0000","last_change":"2024-04-16T19:39:09.151872+0000","last_active":"2024-04-16T19:39:09.151872+0000","last_peered":"2024-04-16T19:39:09.151872+0000","last_clean":"2024-04-16T19:39:09.151872+0000","last_became_active":"2024-04-16T17:45:10.394625+0000","last_became_peered":"2024-04-16T17:45:10.394625+0000","last_unstale":"2024-04-16T19:39:09.151872+0000","last_undegraded":"2024-04-16T19:39:09.151872+0000","last_fullsized":"2024-04-16T19:39:09.151872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:09.151786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:09.151786+0000","last_clean_scrub_stamp":"2024-04-16T19:39:09.151786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:17.029197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.803249+0000","last_change":"2024-04-16T19:39:19.803275+0000","last_active":"2024-04-16T19:39:19.803249+0000","last_peered":"2024-04-16T19:39:19.803249+0000","last_clean":"2024-04-16T19:39:19.803249+0000","last_became_active":"2024-04-16T17:45:08.382195+0000","last_became_peered":"2024-04-16T17:45:08.382195+0000","last_unstale":"2024-04-16T19:39:19.803249+0000","last_undegraded":"2024-04-16T19:39:19.803249+0000","last_fullsized":"2024-04-16T19:39:19.803249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.803175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.803175+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.803175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:48:34.823944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"53'12","reported_seq":170,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:16.823687+0000","last_change":"2024-04-16T19:38:16.823687+0000","last_active":"2024-04-16T19:38:16.823687+0000","last_peered":"2024-04-16T19:38:16.823687+0000","last_clean":"2024-04-16T19:38:16.823687+0000","last_became_active":"2024-04-16T17:45:45.459228+0000","last_became_peered":"2024-04-16T17:45:45.459228+0000","last_unstale":"2024-04-16T19:38:16.823687+0000","last_undegraded":"2024-04-16T19:38:16.823687+0000","last_fullsized":"2024-04-16T19:38:16.823687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:16.823588+0000","last_clean_scrub_stamp":"2024-04-16T19:38:16.823588+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:59:26.463012+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":96,"num_write":62,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:03.733431+0000","last_change":"2024-04-16T19:39:03.733431+0000","last_active":"2024-04-16T19:39:03.733431+0000","last_peered":"2024-04-16T19:39:03.733431+0000","last_clean":"2024-04-16T19:39:03.733431+0000","last_became_active":"2024-04-16T17:45:10.398165+0000","last_became_peered":"2024-04-16T17:45:10.398165+0000","last_unstale":"2024-04-16T19:39:03.733431+0000","last_undegraded":"2024-04-16T19:39:03.733431+0000","last_fullsized":"2024-04-16T19:39:03.733431+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:03.733308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:03.733308+0000","last_clean_scrub_stamp":"2024-04-16T19:39:03.733308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:30.521077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:14.059771+0000","last_change":"2024-04-16T19:39:14.059794+0000","last_active":"2024-04-16T19:39:14.059771+0000","last_peered":"2024-04-16T19:39:14.059771+0000","last_clean":"2024-04-16T19:39:14.059771+0000","last_became_active":"2024-04-16T17:45:08.387957+0000","last_became_peered":"2024-04-16T17:45:08.387957+0000","last_unstale":"2024-04-16T19:39:14.059771+0000","last_undegraded":"2024-04-16T19:39:14.059771+0000","last_fullsized":"2024-04-16T19:39:14.059771+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:14.059707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:14.059707+0000","last_clean_scrub_stamp":"2024-04-16T19:39:14.059707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:26:11.151703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2d","version":"53'22","reported_seq":550,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:20.076687+0000","last_change":"2024-04-16T19:38:20.076687+0000","last_active":"2024-04-16T19:38:20.076687+0000","last_peered":"2024-04-16T19:38:20.076687+0000","last_clean":"2024-04-16T19:38:20.076687+0000","last_became_active":"2024-04-16T17:45:45.461136+0000","last_became_peered":"2024-04-16T17:45:45.461136+0000","last_unstale":"2024-04-16T19:38:20.076687+0000","last_undegraded":"2024-04-16T19:38:20.076687+0000","last_fullsized":"2024-04-16T19:38:20.076687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:20.076549+0000","last_clean_scrub_stamp":"2024-04-16T19:38:20.076549+0000","objects_scrubbed":11,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:19:18.065057+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1059,"num_read_kb":768,"num_write":114,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:23.038840+0000","last_change":"2024-04-16T19:39:23.038840+0000","last_active":"2024-04-16T19:39:23.038840+0000","last_peered":"2024-04-16T19:39:23.038840+0000","last_clean":"2024-04-16T19:39:23.038840+0000","last_became_active":"2024-04-16T17:45:10.392473+0000","last_became_peered":"2024-04-16T17:45:10.392473+0000","last_unstale":"2024-04-16T19:39:23.038840+0000","last_undegraded":"2024-04-16T19:39:23.038840+0000","last_fullsized":"2024-04-16T19:39:23.038840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:23.038719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:23.038719+0000","last_clean_scrub_stamp":"2024-04-16T19:39:23.038719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:34:41.225543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":143,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.210849+0000","last_change":"2024-04-16T19:39:16.210888+0000","last_active":"2024-04-16T19:39:16.210849+0000","last_peered":"2024-04-16T19:39:16.210849+0000","last_clean":"2024-04-16T19:39:16.210849+0000","last_became_active":"2024-04-16T17:45:08.387521+0000","last_became_peered":"2024-04-16T17:45:08.387521+0000","last_unstale":"2024-04-16T19:39:16.210849+0000","last_undegraded":"2024-04-16T19:39:16.210849+0000","last_fullsized":"2024-04-16T19:39:16.210849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.210782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.210782+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.210782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:22:24.088193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.22","version":"53'12","reported_seq":349,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.964569+0000","last_change":"2024-04-16T19:38:19.964623+0000","last_active":"2024-04-16T19:38:19.964569+0000","last_peered":"2024-04-16T19:38:19.964569+0000","last_clean":"2024-04-16T19:38:19.964569+0000","last_became_active":"2024-04-16T17:45:45.460656+0000","last_became_peered":"2024-04-16T17:45:45.460656+0000","last_unstale":"2024-04-16T19:38:19.964569+0000","last_undegraded":"2024-04-16T19:38:19.964569+0000","last_fullsized":"2024-04-16T19:38:19.964569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'12","last_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_deep_scrub":"53'12","last_deep_scrub_stamp":"2024-04-16T19:38:19.964501+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.964501+0000","objects_scrubbed":6,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:39:19.709359+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":583,"num_read_kb":369,"num_write":67,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:16.366990+0000","last_change":"2024-04-16T19:39:16.366990+0000","last_active":"2024-04-16T19:39:16.366990+0000","last_peered":"2024-04-16T19:39:16.366990+0000","last_clean":"2024-04-16T19:39:16.366990+0000","last_became_active":"2024-04-16T17:45:10.397531+0000","last_became_peered":"2024-04-16T17:45:10.397531+0000","last_unstale":"2024-04-16T19:39:16.366990+0000","last_undegraded":"2024-04-16T19:39:16.366990+0000","last_fullsized":"2024-04-16T19:39:16.366990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:16.366904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:16.366904+0000","last_clean_scrub_stamp":"2024-04-16T19:39:16.366904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:30:54.676107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":144,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:30.535242+0000","last_change":"2024-04-16T19:39:30.535263+0000","last_active":"2024-04-16T19:39:30.535242+0000","last_peered":"2024-04-16T19:39:30.535242+0000","last_clean":"2024-04-16T19:39:30.535242+0000","last_became_active":"2024-04-16T17:45:08.382273+0000","last_became_peered":"2024-04-16T17:45:08.382273+0000","last_unstale":"2024-04-16T19:39:30.535242+0000","last_undegraded":"2024-04-16T19:39:30.535242+0000","last_fullsized":"2024-04-16T19:39:30.535242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:30.535171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:30.535171+0000","last_clean_scrub_stamp":"2024-04-16T19:39:30.535171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:10:49.571463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"53'11","reported_seq":380,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:44.008833+0000","last_change":"2024-04-16T19:38:44.008897+0000","last_active":"2024-04-16T19:38:44.008833+0000","last_peered":"2024-04-16T19:38:44.008833+0000","last_clean":"2024-04-16T19:38:44.008833+0000","last_became_active":"2024-04-16T17:45:45.454102+0000","last_became_peered":"2024-04-16T17:45:45.454102+0000","last_unstale":"2024-04-16T19:38:44.008833+0000","last_undegraded":"2024-04-16T19:38:44.008833+0000","last_fullsized":"2024-04-16T19:38:44.008833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'11","last_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_deep_scrub":"53'11","last_deep_scrub_stamp":"2024-04-16T19:38:44.008768+0000","last_clean_scrub_stamp":"2024-04-16T19:38:44.008768+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:34:20.760273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":533,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":665,"num_read_kb":528,"num_write":52,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":137,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.106146+0000","last_change":"2024-04-16T19:39:17.106146+0000","last_active":"2024-04-16T19:39:17.106146+0000","last_peered":"2024-04-16T19:39:17.106146+0000","last_clean":"2024-04-16T19:39:17.106146+0000","last_became_active":"2024-04-16T17:45:10.390620+0000","last_became_peered":"2024-04-16T17:45:10.390620+0000","last_unstale":"2024-04-16T19:39:17.106146+0000","last_undegraded":"2024-04-16T19:39:17.106146+0000","last_fullsized":"2024-04-16T19:39:17.106146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.106053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.106053+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.106053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:19:46.441498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:32.359399+0000","last_change":"2024-04-16T19:39:32.359417+0000","last_active":"2024-04-16T19:39:32.359399+0000","last_peered":"2024-04-16T19:39:32.359399+0000","last_clean":"2024-04-16T19:39:32.359399+0000","last_became_active":"2024-04-16T17:45:08.388615+0000","last_became_peered":"2024-04-16T17:45:08.388615+0000","last_unstale":"2024-04-16T19:39:32.359399+0000","last_undegraded":"2024-04-16T19:39:32.359399+0000","last_fullsized":"2024-04-16T19:39:32.359399+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:32.359331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:32.359331+0000","last_clean_scrub_stamp":"2024-04-16T19:39:32.359331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T04:15:03.307748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.20","version":"53'20","reported_seq":429,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:09.253495+0000","last_change":"2024-04-16T19:38:09.253495+0000","last_active":"2024-04-16T19:38:09.253495+0000","last_peered":"2024-04-16T19:38:09.253495+0000","last_clean":"2024-04-16T19:38:09.253495+0000","last_became_active":"2024-04-16T17:45:45.464761+0000","last_became_peered":"2024-04-16T17:45:45.464761+0000","last_unstale":"2024-04-16T19:38:09.253495+0000","last_undegraded":"2024-04-16T19:38:09.253495+0000","last_fullsized":"2024-04-16T19:38:09.253495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:09.253410+0000","last_clean_scrub_stamp":"2024-04-16T19:38:09.253410+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:10:49.003227+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5182,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":833,"num_read_kb":557,"num_write":90,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":136,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:04.014665+0000","last_change":"2024-04-16T19:39:04.014686+0000","last_active":"2024-04-16T19:39:04.014665+0000","last_peered":"2024-04-16T19:39:04.014665+0000","last_clean":"2024-04-16T19:39:04.014665+0000","last_became_active":"2024-04-16T17:45:10.393462+0000","last_became_peered":"2024-04-16T17:45:10.393462+0000","last_unstale":"2024-04-16T19:39:04.014665+0000","last_undegraded":"2024-04-16T19:39:04.014665+0000","last_fullsized":"2024-04-16T19:39:04.014665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:04.014599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:04.014599+0000","last_clean_scrub_stamp":"2024-04-16T19:39:04.014599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:33:04.130956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:34.563404+0000","last_change":"2024-04-16T19:39:34.563427+0000","last_active":"2024-04-16T19:39:34.563404+0000","last_peered":"2024-04-16T19:39:34.563404+0000","last_clean":"2024-04-16T19:39:34.563404+0000","last_became_active":"2024-04-16T17:45:08.383976+0000","last_became_peered":"2024-04-16T17:45:08.383976+0000","last_unstale":"2024-04-16T19:39:34.563404+0000","last_undegraded":"2024-04-16T19:39:34.563404+0000","last_fullsized":"2024-04-16T19:39:34.563404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:34.563335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:34.563335+0000","last_clean_scrub_stamp":"2024-04-16T19:39:34.563335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:33:52.670229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.21","version":"53'20","reported_seq":697,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:38.162796+0000","last_change":"2024-04-16T19:38:38.162842+0000","last_active":"2024-04-16T19:38:38.162796+0000","last_peered":"2024-04-16T19:38:38.162796+0000","last_clean":"2024-04-16T19:38:38.162796+0000","last_became_active":"2024-04-16T17:45:45.455308+0000","last_became_peered":"2024-04-16T17:45:45.455308+0000","last_unstale":"2024-04-16T19:38:38.162796+0000","last_undegraded":"2024-04-16T19:38:38.162796+0000","last_fullsized":"2024-04-16T19:38:38.162796+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'20","last_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_deep_scrub":"53'20","last_deep_scrub_stamp":"2024-04-16T19:38:38.162737+0000","last_clean_scrub_stamp":"2024-04-16T19:38:38.162737+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T05:11:17.912553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1545,"num_read_kb":1118,"num_write":107,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.005610+0000","last_change":"2024-04-16T19:39:17.005632+0000","last_active":"2024-04-16T19:39:17.005610+0000","last_peered":"2024-04-16T19:39:17.005610+0000","last_clean":"2024-04-16T19:39:17.005610+0000","last_became_active":"2024-04-16T17:45:10.390267+0000","last_became_peered":"2024-04-16T17:45:10.390267+0000","last_unstale":"2024-04-16T19:39:17.005610+0000","last_undegraded":"2024-04-16T19:39:17.005610+0000","last_fullsized":"2024-04-16T19:39:17.005610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.005547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.005547+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.005547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:07.346934+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:25.312985+0000","last_change":"2024-04-16T19:39:25.313011+0000","last_active":"2024-04-16T19:39:25.312985+0000","last_peered":"2024-04-16T19:39:25.312985+0000","last_clean":"2024-04-16T19:39:25.312985+0000","last_became_active":"2024-04-16T17:45:08.389050+0000","last_became_peered":"2024-04-16T17:45:08.389050+0000","last_unstale":"2024-04-16T19:39:25.312985+0000","last_undegraded":"2024-04-16T19:39:25.312985+0000","last_fullsized":"2024-04-16T19:39:25.312985+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:25.312919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:25.312919+0000","last_clean_scrub_stamp":"2024-04-16T19:39:25.312919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:02:17.716320+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"53'22","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:17.813299+0000","last_change":"2024-04-16T19:38:17.813299+0000","last_active":"2024-04-16T19:38:17.813299+0000","last_peered":"2024-04-16T19:38:17.813299+0000","last_clean":"2024-04-16T19:38:17.813299+0000","last_became_active":"2024-04-16T17:45:45.464187+0000","last_became_peered":"2024-04-16T17:45:45.464187+0000","last_unstale":"2024-04-16T19:38:17.813299+0000","last_undegraded":"2024-04-16T19:38:17.813299+0000","last_fullsized":"2024-04-16T19:38:17.813299+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'22","last_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_deep_scrub":"53'22","last_deep_scrub_stamp":"2024-04-16T19:38:17.813183+0000","last_clean_scrub_stamp":"2024-04-16T19:38:17.813183+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:52:32.833529+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":235,"num_read_kb":148,"num_write":111,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:59.249733+0000","last_change":"2024-04-16T19:38:59.249757+0000","last_active":"2024-04-16T19:38:59.249733+0000","last_peered":"2024-04-16T19:38:59.249733+0000","last_clean":"2024-04-16T19:38:59.249733+0000","last_became_active":"2024-04-16T17:45:10.397439+0000","last_became_peered":"2024-04-16T17:45:10.397439+0000","last_unstale":"2024-04-16T19:38:59.249733+0000","last_undegraded":"2024-04-16T19:38:59.249733+0000","last_fullsized":"2024-04-16T19:38:59.249733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:38:59.249670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:38:59.249670+0000","last_clean_scrub_stamp":"2024-04-16T19:38:59.249670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T19:44:18.048162+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:20.079340+0000","last_change":"2024-04-16T19:39:20.079384+0000","last_active":"2024-04-16T19:39:20.079340+0000","last_peered":"2024-04-16T19:39:20.079340+0000","last_clean":"2024-04-16T19:39:20.079340+0000","last_became_active":"2024-04-16T17:45:08.386146+0000","last_became_peered":"2024-04-16T17:45:08.386146+0000","last_unstale":"2024-04-16T19:39:20.079340+0000","last_undegraded":"2024-04-16T19:39:20.079340+0000","last_fullsized":"2024-04-16T19:39:20.079340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:20.079259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:20.079259+0000","last_clean_scrub_stamp":"2024-04-16T19:39:20.079259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:53:33.473533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"53'6","reported_seq":160,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:39.113419+0000","last_change":"2024-04-16T19:38:39.113484+0000","last_active":"2024-04-16T19:38:39.113419+0000","last_peered":"2024-04-16T19:38:39.113419+0000","last_clean":"2024-04-16T19:38:39.113419+0000","last_became_active":"2024-04-16T17:45:45.455270+0000","last_became_peered":"2024-04-16T17:45:45.455270+0000","last_unstale":"2024-04-16T19:38:39.113419+0000","last_undegraded":"2024-04-16T19:38:39.113419+0000","last_fullsized":"2024-04-16T19:38:39.113419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:39.113342+0000","last_clean_scrub_stamp":"2024-04-16T19:38:39.113342+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:41.646707+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":53,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:10.385474+0000","last_change":"2024-04-16T19:39:10.385498+0000","last_active":"2024-04-16T19:39:10.385474+0000","last_peered":"2024-04-16T19:39:10.385474+0000","last_clean":"2024-04-16T19:39:10.385474+0000","last_became_active":"2024-04-16T17:45:10.393382+0000","last_became_peered":"2024-04-16T17:45:10.393382+0000","last_unstale":"2024-04-16T19:39:10.385474+0000","last_undegraded":"2024-04-16T19:39:10.385474+0000","last_fullsized":"2024-04-16T19:39:10.385474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:10.385405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:10.385405+0000","last_clean_scrub_stamp":"2024-04-16T19:39:10.385405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T22:28:45.572545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":142,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:32.043490+0000","last_change":"2024-04-16T19:39:32.043514+0000","last_active":"2024-04-16T19:39:32.043490+0000","last_peered":"2024-04-16T19:39:32.043490+0000","last_clean":"2024-04-16T19:39:32.043490+0000","last_became_active":"2024-04-16T17:45:08.381365+0000","last_became_peered":"2024-04-16T17:45:08.381365+0000","last_unstale":"2024-04-16T19:39:32.043490+0000","last_undegraded":"2024-04-16T19:39:32.043490+0000","last_fullsized":"2024-04-16T19:39:32.043490+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:32.043418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:32.043418+0000","last_clean_scrub_stamp":"2024-04-16T19:39:32.043418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:53.759639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.24","version":"53'16","reported_seq":465,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:43.016697+0000","last_change":"2024-04-16T19:38:43.016743+0000","last_active":"2024-04-16T19:38:43.016697+0000","last_peered":"2024-04-16T19:38:43.016697+0000","last_clean":"2024-04-16T19:38:43.016697+0000","last_became_active":"2024-04-16T17:45:45.454122+0000","last_became_peered":"2024-04-16T17:45:45.454122+0000","last_unstale":"2024-04-16T19:38:43.016697+0000","last_undegraded":"2024-04-16T19:38:43.016697+0000","last_fullsized":"2024-04-16T19:38:43.016697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'16","last_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_deep_scrub":"53'16","last_deep_scrub_stamp":"2024-04-16T19:38:43.016634+0000","last_clean_scrub_stamp":"2024-04-16T19:38:43.016634+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T20:15:57.842614+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":777,"num_read_kb":696,"num_write":94,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":138,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:01.755375+0000","last_change":"2024-04-16T19:39:01.755399+0000","last_active":"2024-04-16T19:39:01.755375+0000","last_peered":"2024-04-16T19:39:01.755375+0000","last_clean":"2024-04-16T19:39:01.755375+0000","last_became_active":"2024-04-16T17:45:10.398949+0000","last_became_peered":"2024-04-16T17:45:10.398949+0000","last_unstale":"2024-04-16T19:39:01.755375+0000","last_undegraded":"2024-04-16T19:39:01.755375+0000","last_fullsized":"2024-04-16T19:39:01.755375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:01.755309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:01.755309+0000","last_clean_scrub_stamp":"2024-04-16T19:39:01.755309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T02:07:07.367058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:17.213131+0000","last_change":"2024-04-16T19:39:17.213131+0000","last_active":"2024-04-16T19:39:17.213131+0000","last_peered":"2024-04-16T19:39:17.213131+0000","last_clean":"2024-04-16T19:39:17.213131+0000","last_became_active":"2024-04-16T17:45:08.388141+0000","last_became_peered":"2024-04-16T17:45:08.388141+0000","last_unstale":"2024-04-16T19:39:17.213131+0000","last_undegraded":"2024-04-16T19:39:17.213131+0000","last_fullsized":"2024-04-16T19:39:17.213131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:17.213045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:17.213045+0000","last_clean_scrub_stamp":"2024-04-16T19:39:17.213045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:16:25.206834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.25","version":"53'6","reported_seq":175,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:10.208756+0000","last_change":"2024-04-16T19:38:10.208756+0000","last_active":"2024-04-16T19:38:10.208756+0000","last_peered":"2024-04-16T19:38:10.208756+0000","last_clean":"2024-04-16T19:38:10.208756+0000","last_became_active":"2024-04-16T17:45:45.466153+0000","last_became_peered":"2024-04-16T17:45:45.466153+0000","last_unstale":"2024-04-16T19:38:10.208756+0000","last_undegraded":"2024-04-16T19:38:10.208756+0000","last_fullsized":"2024-04-16T19:38:10.208756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'6","last_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_deep_scrub":"53'6","last_deep_scrub_stamp":"2024-04-16T19:38:10.208682+0000","last_clean_scrub_stamp":"2024-04-16T19:38:10.208682+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:28:12.742047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":85,"num_write":29,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":140,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:21.041246+0000","last_change":"2024-04-16T19:39:21.041269+0000","last_active":"2024-04-16T19:39:21.041246+0000","last_peered":"2024-04-16T19:39:21.041246+0000","last_clean":"2024-04-16T19:39:21.041246+0000","last_became_active":"2024-04-16T17:45:10.391936+0000","last_became_peered":"2024-04-16T17:45:10.391936+0000","last_unstale":"2024-04-16T19:39:21.041246+0000","last_undegraded":"2024-04-16T19:39:21.041246+0000","last_fullsized":"2024-04-16T19:39:21.041246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:21.041157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:21.041157+0000","last_clean_scrub_stamp":"2024-04-16T19:39:21.041157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:08:21.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:33.606256+0000","last_change":"2024-04-16T19:39:33.606277+0000","last_active":"2024-04-16T19:39:33.606256+0000","last_peered":"2024-04-16T19:39:33.606256+0000","last_clean":"2024-04-16T19:39:33.606256+0000","last_became_active":"2024-04-16T17:45:08.384960+0000","last_became_peered":"2024-04-16T17:45:08.384960+0000","last_unstale":"2024-04-16T19:39:33.606256+0000","last_undegraded":"2024-04-16T19:39:33.606256+0000","last_fullsized":"2024-04-16T19:39:33.606256+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:33.606196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:33.606196+0000","last_clean_scrub_stamp":"2024-04-16T19:39:33.606196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:00:55.322417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3a","version":"53'14","reported_seq":334,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:08.249652+0000","last_change":"2024-04-16T19:38:08.249652+0000","last_active":"2024-04-16T19:38:08.249652+0000","last_peered":"2024-04-16T19:38:08.249652+0000","last_clean":"2024-04-16T19:38:08.249652+0000","last_became_active":"2024-04-16T17:45:45.467669+0000","last_became_peered":"2024-04-16T17:45:45.467669+0000","last_unstale":"2024-04-16T19:38:08.249652+0000","last_undegraded":"2024-04-16T19:38:08.249652+0000","last_fullsized":"2024-04-16T19:38:08.249652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'14","last_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_deep_scrub":"53'14","last_deep_scrub_stamp":"2024-04-16T19:38:08.249524+0000","last_clean_scrub_stamp":"2024-04-16T19:38:08.249524+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-17T21:30:54.283196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":515,"num_read_kb":442,"num_write":74,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.032276+0000","last_change":"2024-04-16T19:39:18.032276+0000","last_active":"2024-04-16T19:39:18.032276+0000","last_peered":"2024-04-16T19:39:18.032276+0000","last_clean":"2024-04-16T19:39:18.032276+0000","last_became_active":"2024-04-16T17:45:08.386525+0000","last_became_peered":"2024-04-16T17:45:08.386525+0000","last_unstale":"2024-04-16T19:39:18.032276+0000","last_undegraded":"2024-04-16T19:39:18.032276+0000","last_fullsized":"2024-04-16T19:39:18.032276+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.032188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.032188+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.032188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T03:28:20.533789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:19.342407+0000","last_change":"2024-04-16T19:39:19.342450+0000","last_active":"2024-04-16T19:39:19.342407+0000","last_peered":"2024-04-16T19:39:19.342407+0000","last_clean":"2024-04-16T19:39:19.342407+0000","last_became_active":"2024-04-16T17:45:10.391027+0000","last_became_peered":"2024-04-16T17:45:10.391027+0000","last_unstale":"2024-04-16T19:39:19.342407+0000","last_undegraded":"2024-04-16T19:39:19.342407+0000","last_fullsized":"2024-04-16T19:39:19.342407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:19.342336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:19.342336+0000","last_clean_scrub_stamp":"2024-04-16T19:39:19.342336+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T07:33:56.729863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3b","version":"53'40","reported_seq":775,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:38:19.113737+0000","last_change":"2024-04-16T19:38:19.113737+0000","last_active":"2024-04-16T19:38:19.113737+0000","last_peered":"2024-04-16T19:38:19.113737+0000","last_clean":"2024-04-16T19:38:19.113737+0000","last_became_active":"2024-04-16T17:45:45.461369+0000","last_became_peered":"2024-04-16T17:45:45.461369+0000","last_unstale":"2024-04-16T19:38:19.113737+0000","last_undegraded":"2024-04-16T19:38:19.113737+0000","last_fullsized":"2024-04-16T19:38:19.113737+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"53'40","last_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_deep_scrub":"53'40","last_deep_scrub_stamp":"2024-04-16T19:38:19.113599+0000","last_clean_scrub_stamp":"2024-04-16T19:38:19.113599+0000","objects_scrubbed":11,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T01:04:11.281022+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1642,"num_read_kb":1281,"num_write":215,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":141,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:13.816505+0000","last_change":"2024-04-16T19:39:13.816505+0000","last_active":"2024-04-16T19:39:13.816505+0000","last_peered":"2024-04-16T19:39:13.816505+0000","last_clean":"2024-04-16T19:39:13.816505+0000","last_became_active":"2024-04-16T17:45:08.389115+0000","last_became_peered":"2024-04-16T17:45:08.389115+0000","last_unstale":"2024-04-16T19:39:13.816505+0000","last_undegraded":"2024-04-16T19:39:13.816505+0000","last_fullsized":"2024-04-16T19:39:13.816505+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:13.816385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:13.816385+0000","last_clean_scrub_stamp":"2024-04-16T19:39:13.816385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T06:48:44.929091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":135,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-16T19:39:18.521912+0000","last_change":"2024-04-16T19:39:18.521932+0000","last_active":"2024-04-16T19:39:18.521912+0000","last_peered":"2024-04-16T19:39:18.521912+0000","last_clean":"2024-04-16T19:39:18.521912+0000","last_became_active":"2024-04-16T17:45:10.394879+0000","last_became_peered":"2024-04-16T17:45:10.394879+0000","last_unstale":"2024-04-16T19:39:18.521912+0000","last_undegraded":"2024-04-16T19:39:18.521912+0000","last_fullsized":"2024-04-16T19:39:18.521912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-16T19:39:18.521850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-16T19:39:18.521850+0000","last_clean_scrub_stamp":"2024-04-16T19:39:18.521850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-18T00:24:08.863236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":13,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":6},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1395,"num_object_clones":0,"num_object_copies":2790,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1395,"num_whiteouts":0,"num_read":93098,"num_read_kb":94830,"num_write":6194,"num_write_kb":2648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1395,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":357187,"num_omap_keys":1449,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5600,"ondisk_log_size":5600,"up":64,"acting":64,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":20248,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":3745,"num_read_kb":4610,"num_write":177,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":40496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":5710,"num_read_kb":5469,"num_write":3695,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3885,"ondisk_log_size":3885,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":25819,"num_objects":451,"num_object_clones":0,"num_object_copies":902,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":0,"num_read":45965,"num_read_kb":34819,"num_write":6156,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":51638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1200,"ondisk_log_size":1200,"up":128,"acting":128,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":191325,"num_objects":699,"num_object_clones":0,"num_object_copies":1398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":699,"num_whiteouts":0,"num_read":348739,"num_read_kb":256893,"num_write":41627,"num_write_kb":5372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":365336,"num_omap_keys":1682,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1097728,"data_stored":379322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21506,"ondisk_log_size":21506,"up":64,"acting":64,"num_store_stats":6},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5237,"ondisk_log_size":5237,"up":64,"acting":64,"num_store_stats":6},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34067,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3019,"num_read_kb":2748,"num_write":1273,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":360,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9817,"num_omap_keys":62,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1007616,"data_stored":68134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":612,"ondisk_log_size":612,"up":64,"acting":64,"num_store_stats":6},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244641645,"num_pgs":159,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50804,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806796,"statfs":{"total":107374182400,"available":107322159104,"internally_reserved":0,"allocated":1617920,"data_stored":475447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244641644,"num_pgs":182,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":46504,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":104811096,"statfs":{"total":107374182400,"available":107326562304,"internally_reserved":0,"allocated":1474560,"data_stored":377690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244641645,"num_pgs":173,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":87628,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":104769972,"statfs":{"total":107374182400,"available":107284451328,"internally_reserved":0,"allocated":2428928,"data_stored":1067760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87292359},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244641645,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":73100,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":104784500,"statfs":{"total":107374182400,"available":107299328000,"internally_reserved":0,"allocated":1773568,"data_stored":453753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73071046},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244641644,"num_pgs":176,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":50932,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":104806668,"statfs":{"total":107374182400,"available":107322028032,"internally_reserved":0,"allocated":1748992,"data_stored":418778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244641645,"num_pgs":181,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":59840,"kb_used_data":2296,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":104797760,"statfs":{"total":107374182400,"available":107312906240,"internally_reserved":0,"allocated":2351104,"data_stored":1017208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":10117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":7969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":16741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":630784,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":7190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":724992,"data_stored":7278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":6268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":503808,"data_stored":11993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":36937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":50079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":84006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":258048,"data_stored":104167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":102409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":18055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":12315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":8880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":7909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184320,"data_stored":13324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":7651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-16T19:39:53.042 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster c1 config set global mon_health_to_clog false 2024-04-16T19:39:53.356 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 556, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 364, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 269, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2024-04-16T19:39:53.371 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-16T19:39:53.371 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-16T19:39:53.371 DEBUG:tasks.ceph.c1.osd.0:waiting for process to exit 2024-04-16T19:39:53.372 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.405 INFO:tasks.ceph.c1.osd.0:Stopped 2024-04-16T19:39:53.405 DEBUG:tasks.ceph.c1.osd.1:waiting for process to exit 2024-04-16T19:39:53.406 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.482 INFO:tasks.ceph.c1.osd.1:Stopped 2024-04-16T19:39:53.483 DEBUG:tasks.ceph.c1.osd.2:waiting for process to exit 2024-04-16T19:39:53.483 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.559 INFO:tasks.ceph.c1.osd.2:Stopped 2024-04-16T19:39:53.560 DEBUG:tasks.ceph.c1.osd.3:waiting for process to exit 2024-04-16T19:39:53.560 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.599 INFO:tasks.ceph.c1.osd.3:Stopped 2024-04-16T19:39:53.599 DEBUG:tasks.ceph.c1.osd.4:waiting for process to exit 2024-04-16T19:39:53.599 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.678 INFO:tasks.ceph.c1.osd.4:Stopped 2024-04-16T19:39:53.678 DEBUG:tasks.ceph.c1.osd.5:waiting for process to exit 2024-04-16T19:39:53.679 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.752 INFO:tasks.ceph.c1.osd.5:Stopped 2024-04-16T19:39:53.752 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-16T19:39:53.753 DEBUG:tasks.ceph.c1.mgr.x:waiting for process to exit 2024-04-16T19:39:53.753 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.824 INFO:tasks.ceph.c1.mgr.x:Stopped 2024-04-16T19:39:53.825 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-16T19:39:53.825 DEBUG:tasks.ceph.c1.mon.a:waiting for process to exit 2024-04-16T19:39:53.825 INFO:teuthology.orchestra.run:waiting for 300 2024-04-16T19:39:53.845 INFO:tasks.ceph.c1.mon.a:Stopped 2024-04-16T19:39:53.845 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-16T19:39:53.846 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c1.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-16T19:39:53.918 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-0 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T19:39:53.918 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/c1-0 2024-04-16T19:39:54.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-1 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T19:39:54.169 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/c1-1 2024-04-16T19:39:54.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-2 on ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T19:39:54.236 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/c1-2 2024-04-16T19:39:54.292 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-3 on ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T19:39:54.293 DEBUG:teuthology.orchestra.run.smithi023:> sync && sudo umount -f /var/lib/ceph/osd/c1-3 2024-04-16T19:39:54.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-4 on ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T19:39:54.481 DEBUG:teuthology.orchestra.run.smithi023:> sync && sudo umount -f /var/lib/ceph/osd/c1-4 2024-04-16T19:39:54.565 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-5 on ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T19:39:54.565 DEBUG:teuthology.orchestra.run.smithi023:> sync && sudo umount -f /var/lib/ceph/osd/c1-5 2024-04-16T19:39:54.622 INFO:tasks.ceph:Archiving mon data... 2024-04-16T19:39:54.622 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/c1-a to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/data/c1.mon.a.tgz 2024-04-16T19:39:54.622 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2024-04-16T19:39:54.639 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.E61seT3ztK 2024-04-16T19:39:54.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/c1-a -- . > /tmp/tmp.E61seT3ztK 2024-04-16T19:39:54.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.E61seT3ztK 2024-04-16T19:39:54.907 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.E61seT3ztK is 438KB 2024-04-16T19:39:55.009 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.E61seT3ztK 2024-04-16T19:39:55.024 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-16T19:39:55.024 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:39:55.066 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:39:55.069 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:39:55.072 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2024-04-16T19:39:55.147 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T19:39:55.166 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T19:39:55.185 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T19:39:55.204 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-16T19:39:55.205 INFO:tasks.ceph:Archiving crash dumps... 2024-04-16T19:39:55.207 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi016/crash 2024-04-16T19:39:55.209 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T19:39:55.237 DEBUG:teuthology.misc:Transferring archived files from smithi023:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi023/crash 2024-04-16T19:39:55.238 DEBUG:teuthology.orchestra.run.smithi023:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T19:39:55.307 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi139/crash 2024-04-16T19:39:55.308 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T19:39:55.384 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/lib/ceph/crash to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi163/crash 2024-04-16T19:39:55.385 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-16T19:39:55.438 INFO:tasks.ceph:Compressing logs... 2024-04-16T19:39:55.439 DEBUG:teuthology.orchestra.run.smithi016:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T19:39:55.442 DEBUG:teuthology.orchestra.run.smithi023:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T19:39:55.445 DEBUG:teuthology.orchestra.run.smithi139:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T19:39:55.448 DEBUG:teuthology.orchestra.run.smithi163:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-16T19:39:55.507 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.c2.client.1.log 2024-04-16T19:39:55.508 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-c2-client.1.log 2024-04-16T19:39:55.508 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35488.log 2024-04-16T19:39:55.508 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/rgw.c2.client.1.log: /var/log/ceph/ops-log-c2-client.1.log: gzip -5 --verbose -- /var/log/ceph/c2-client.1.35591.log 2024-04-16T19:39:55.508 INFO:teuthology.orchestra.run.smithi163.stderr: 35.2% -- replaced with /var/log/ceph/ops-log-c2-client.1.log.gz 2024-04-16T19:39:55.509 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.35488.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35448.log 2024-04-16T19:39:55.509 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35488.log.gz 2024-04-16T19:39:55.509 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.1.35591.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32092.log 2024-04-16T19:39:55.509 INFO:teuthology.orchestra.run.smithi163.stderr: 82.6% -- replaced with /var/log/ceph/c2-client.1.35591.log.gz 2024-04-16T19:39:55.509 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.35448.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.3.log 2024-04-16T19:39:55.509 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35448.log.gz 2024-04-16T19:39:55.510 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.32092.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32052.log 2024-04-16T19:39:55.510 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32092.log.gz 2024-04-16T19:39:55.510 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-osd.3.log: gzip -5 --verbose -- /var/log/ceph/c2-mgr.x.log 2024-04-16T19:39:55.510 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.32052.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32172.log 2024-04-16T19:39:55.510 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32052.log.gz 2024-04-16T19:39:55.511 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32212.log 2024-04-16T19:39:55.511 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.32172.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32172.log.gz 2024-04-16T19:39:55.511 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35568.log 2024-04-16T19:39:55.511 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32012.log 2024-04-16T19:39:55.511 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.32212.log: /var/log/ceph/c2-client.admin.35568.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32212.log.gz 2024-04-16T19:39:55.511 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35568.log.gz 2024-04-16T19:39:55.512 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/c2-osd.5.log 2024-04-16T19:39:55.512 INFO:teuthology.orchestra.run.smithi163.stderr: 93.8% -- replaced with /var/log/ceph/rgw.c2.client.1.log.gz 2024-04-16T19:39:55.512 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.32012.log: gzip -5 --verbose -- /var/log/ceph/c2-client.1.36196.log 2024-04-16T19:39:55.512 INFO:teuthology.orchestra.run.smithi163.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32012.log.gz 2024-04-16T19:39:55.512 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-osd.5.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.4.log 2024-04-16T19:39:55.512 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.1.36196.log: 43.5% -- replaced with /var/log/ceph/c2-client.1.36196.log.gz 2024-04-16T19:39:55.513 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35528.log 2024-04-16T19:39:55.513 INFO:teuthology.orchestra.run.smithi163.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32132.log 2024-04-16T19:39:55.513 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-osd.4.log: /var/log/ceph/c2-client.admin.35528.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35528.log.gz 2024-04-16T19:39:55.513 INFO:teuthology.orchestra.run.smithi163.stderr:/var/log/ceph/c2-client.admin.32132.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32132.log.gz 2024-04-16T19:39:55.515 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.1.35852.log 2024-04-16T19:39:55.516 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.4.log 2024-04-16T19:39:55.516 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.1.35852.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35144.log 2024-04-16T19:39:55.516 INFO:teuthology.orchestra.run.smithi023.stderr: 43.9% -- replaced with /var/log/ceph/c1-client.1.35852.log.gz 2024-04-16T19:39:55.516 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c1-mgr.x.log 2024-04-16T19:39:55.516 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.31964.log 2024-04-16T19:39:55.516 INFO:teuthology.orchestra.run.smithi023.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35144.log.gz 2024-04-16T19:39:55.517 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35184.log 2024-04-16T19:39:55.517 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.31964.log: gzip -5 --verbose -- /var/log/ceph/c1-client.1.35247.log 2024-04-16T19:39:55.517 INFO:teuthology.orchestra.run.smithi023.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.31964.log.gz 2024-04-16T19:39:55.517 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.35184.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35184.log.gz 2024-04-16T19:39:55.517 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.31924.log 2024-04-16T19:39:55.517 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.31764.log 2024-04-16T19:39:55.518 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.1.35247.log: /var/log/ceph/c1-client.admin.31924.log: 82.5% -- replaced with /var/log/ceph/c1-client.1.35247.log.gz 2024-04-16T19:39:55.518 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-c1-client.1.log 0.0% 2024-04-16T19:39:55.518 INFO:teuthology.orchestra.run.smithi023.stderr: -- replaced with /var/log/ceph/c1-client.admin.31924.log.gz 2024-04-16T19:39:55.518 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.31764.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.31764.log.gz 2024-04-16T19:39:55.518 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.31804.log 2024-04-16T19:39:55.518 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/ops-log-c1-client.1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.31884.log 2024-04-16T19:39:55.519 INFO:teuthology.orchestra.run.smithi023.stderr: 35.5% -- replaced with /var/log/ceph/ops-log-c1-client.1.log.gz 2024-04-16T19:39:55.519 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.31804.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.31804.log.gz 2024-04-16T19:39:55.519 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35104.log 2024-04-16T19:39:55.519 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.31884.log: gzip -5 --verbose -- /var/log/ceph/c1-client.1.37317.log 2024-04-16T19:39:55.519 INFO:teuthology.orchestra.run.smithi023.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.31884.log.gz 2024-04-16T19:39:55.519 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.35104.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35104.log.gz 2024-04-16T19:39:55.520 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.5.log 2024-04-16T19:39:55.520 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.1.37317.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.31844.log 2024-04-16T19:39:55.520 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-osd.5.log: 92.7% -- replaced with /var/log/ceph/c1-client.1.37317.log.gz 2024-04-16T19:39:55.520 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35224.log 2024-04-16T19:39:55.520 INFO:teuthology.orchestra.run.smithi023.stderr:gzip -5 --verbose --/var/log/ceph/c1-client.admin.31844.log: /var/log/ceph/rgw.c1.client.1.log 2024-04-16T19:39:55.520 INFO:teuthology.orchestra.run.smithi023.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.31844.log.gz 2024-04-16T19:39:55.521 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/c1-client.admin.35224.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.admin.35224.log.gz 2024-04-16T19:39:55.521 INFO:teuthology.orchestra.run.smithi023.stderr: -5 --verbose -- /var/log/ceph/c1-osd.3.log 2024-04-16T19:39:55.521 INFO:teuthology.orchestra.run.smithi023.stderr:/var/log/ceph/rgw.c1.client.1.log: /var/log/ceph/c1-osd.3.log: 94.2% -- replaced with /var/log/ceph/rgw.c1.client.1.log.gz 2024-04-16T19:39:55.732 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.51619.log 2024-04-16T19:39:55.732 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.94193.log 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.51619.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.123941.log 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.51619.log.gz 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.94193.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172254.log 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.94193.log.gz 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.123941.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35551.log 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.123941.log.gz 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172254.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.137272.log 2024-04-16T19:39:55.733 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172254.log.gz 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35551.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36642.log 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35551.log.gz 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92983.log 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.137272.log: 55.6% -- replaced with /var/log/ceph/c1-client.0.137272.log.gz 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36642.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.43739.log 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36642.log.gz 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.92983.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.93588.log 2024-04-16T19:39:55.734 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.92983.log.gz 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.43739.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.125162.log 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.43739.log.gz 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.93588.log: gzip -5 --verbose -- /var/log/ceph/c1.audit.log 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.93588.log.gz 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.125162.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.164643.log 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr: 75.9% -- replaced with /var/log/ceph/c1-client.0.125162.log.gz 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.102078.log 2024-04-16T19:39:55.735 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1.audit.log: /var/log/ceph/c1-client.0.164643.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.76387.log 2024-04-16T19:39:55.736 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.164643.log.gz 2024-04-16T19:39:55.736 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.102078.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.86304.log 2024-04-16T19:39:55.736 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.102078.log.gz 2024-04-16T19:39:55.736 INFO:teuthology.orchestra.run.smithi016.stderr: 89.3% -- replaced with /var/log/ceph/c1.audit.log.gz 2024-04-16T19:39:55.736 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.76387.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.159762.log 2024-04-16T19:39:55.736 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.76387.log.gz 2024-04-16T19:39:55.736 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.86304.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.54077.log 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.86304.log.gz 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.159762.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.173010.log 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.159762.log.gz 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.54077.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.153692.log 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr: 66.1% -- replaced with /var/log/ceph/c1-client.0.54077.log.gz 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.173010.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.40540.log 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.173010.log.gz 2024-04-16T19:39:55.737 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.153692.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36248.log 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.153692.log.gz 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.40540.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.52255.log 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.40540.log.gz 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36248.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.61988.log 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36248.log.gz 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.52255.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.119688.log 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.52255.log.gz 2024-04-16T19:39:55.738 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.61988.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.110610.log 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr: 70.7% -- replaced with /var/log/ceph/c1-client.0.61988.log.gz 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.119688.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.60769.log 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.119688.log.gz 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.110610.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.110610.log.gz 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.139706.log 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.60769.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35824.log 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr: 70.5% -- replaced with /var/log/ceph/c1-client.0.60769.log.gz 2024-04-16T19:39:55.739 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.139706.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.42442.log 2024-04-16T19:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr: 75.4% -- replaced with /var/log/ceph/c1-client.0.139706.log.gz 2024-04-16T19:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.130613.log 2024-04-16T19:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35824.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35824.log.gz 2024-04-16T19:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.42442.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.140921.log 2024-04-16T19:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.42442.log.gz 2024-04-16T19:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.130613.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172674.log 2024-04-16T19:39:55.740 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.130613.log.gz 2024-04-16T19:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.140921.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.141528.log 2024-04-16T19:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr: 64.6% -- replaced with /var/log/ceph/c1-client.0.140921.log.gz 2024-04-16T19:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172674.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.80841.log 2024-04-16T19:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172674.log.gz 2024-04-16T19:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.141528.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.134848.log 2024-04-16T19:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.141528.log.gz 2024-04-16T19:39:55.741 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.80841.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35411.log 2024-04-16T19:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.80841.log.gz 2024-04-16T19:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.134848.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.47376.log 2024-04-16T19:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.134848.log.gz 2024-04-16T19:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35411.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.156731.log 2024-04-16T19:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35411.log.gz 2024-04-16T19:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.47376.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.103316.log 2024-04-16T19:39:55.742 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.47376.log.gz 2024-04-16T19:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.169530.log 2024-04-16T19:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.156731.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.156731.log.gz 2024-04-16T19:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.103316.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.46771.log 2024-04-16T19:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103316.log.gz 2024-04-16T19:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.169530.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172338.log 2024-04-16T19:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.169530.log.gz 2024-04-16T19:39:55.743 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.46771.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.105745.log 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.46771.log.gz 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172338.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29037.log 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172338.log.gz 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.105745.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35815.log 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.105745.log.gz 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ceph.tmp-client.admin.29037.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.117873.log 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29037.log.gz 2024-04-16T19:39:55.744 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.126375.log 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35815.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35815.log.gz 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.117873.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.112426.log 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.117873.log.gz 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose --/var/log/ceph/c1-client.0.126375.log: /var/log/ceph/c1-client.0.142133.log 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.126375.log.gz 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.112426.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.89342.log 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.112426.log.gz 2024-04-16T19:39:55.745 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.142133.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.2.log 2024-04-16T19:39:55.746 INFO:teuthology.orchestra.run.smithi016.stderr: 67.9% -- replaced with /var/log/ceph/c1-client.0.142133.log.gz 2024-04-16T19:39:55.746 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.89342.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.39260.log 2024-04-16T19:39:55.746 INFO:teuthology.orchestra.run.smithi016.stderr: 57.2% -- replaced with /var/log/ceph/c1-client.0.89342.log.gz 2024-04-16T19:39:55.746 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.153068.log 2024-04-16T19:39:55.746 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.39260.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.150633.log 2024-04-16T19:39:55.746 INFO:teuthology.orchestra.run.smithi016.stderr: 1.8% -- replaced with /var/log/ceph/c1-client.0.39260.log.gz 2024-04-16T19:39:55.746 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.153068.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.63202.log 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr: 90.2% -- replaced with /var/log/ceph/c1-client.0.153068.log.gz 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.150633.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.120296.log 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.150633.log.gz 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.63202.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172464.log 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr: 81.9% -- replaced with /var/log/ceph/c1-client.0.63202.log.gz 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.120296.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.157336.log 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr: 85.2% -- replaced with /var/log/ceph/c1-client.0.120296.log.gz 2024-04-16T19:39:55.747 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172464.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.66850.log 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172464.log.gz 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.157336.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.123336.log 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.157336.log.gz 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.66850.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.155513.log 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.66850.log.gz 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.123336.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.106350.log 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.123336.log.gz 2024-04-16T19:39:55.748 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.155513.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.77665.log 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr: 50.4% -- replaced with /var/log/ceph/c1-client.0.155513.log.gz 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.106350.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.88724.log 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.106350.log.gz 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.77665.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.41139.log 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.77665.log.gz 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.88724.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172212.log 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr: 81.0% -- replaced with /var/log/ceph/c1-client.0.88724.log.gz 2024-04-16T19:39:55.749 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.41139.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.36747.log 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr: 19.7% -- replaced with /var/log/ceph/c1-client.0.41139.log.gz 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172212.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.114846.log 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172212.log.gz 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.36747.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.58951.log 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr: 83.7% -- replaced with /var/log/ceph/c1-client.0.36747.log.gz 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.114846.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36057.log 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.114846.log.gz 2024-04-16T19:39:55.750 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.58951.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.63814.log 2024-04-16T19:39:55.751 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.58951.log.gz 2024-04-16T19:39:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36057.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36057.log.gz 2024-04-16T19:39:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.85090.log 2024-04-16T19:39:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.63814.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.59556.log 2024-04-16T19:39:55.751 INFO:teuthology.orchestra.run.smithi016.stderr: 46.3% -- replaced with /var/log/ceph/c1-client.0.63814.log.gz 2024-04-16T19:39:55.751 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.85090.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.113636.log 2024-04-16T19:39:55.751 INFO:teuthology.orchestra.run.smithi016.stderr: 57.2% -- replaced with /var/log/ceph/c1-client.0.85090.log.gz 2024-04-16T19:39:55.752 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.59556.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36097.log 2024-04-16T19:39:55.752 INFO:teuthology.orchestra.run.smithi016.stderr: 46.3% -- replaced with /var/log/ceph/c1-client.0.59556.log.gz 2024-04-16T19:39:55.752 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.113636.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.113636.log.gz 2024-04-16T19:39:55.752 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.57736.log 2024-04-16T19:39:55.752 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36097.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.111821.log 2024-04-16T19:39:55.752 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36097.log.gz 2024-04-16T19:39:55.752 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.57736.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36135.log 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.57736.log.gz 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.111821.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172590.log 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.111821.log.gz 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36135.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.127586.log 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36135.log.gz 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172590.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.75778.log 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172590.log.gz 2024-04-16T19:39:55.753 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.127586.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.150028.log 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr: 69.3% -- replaced with /var/log/ceph/c1-client.0.127586.log.gz 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.75778.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.94798.log 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr: 15.2% -- replaced with /var/log/ceph/c1-client.0.75778.log.gz 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.150028.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.167676.log 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.150028.log.gz 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.94798.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.65634.log 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.94798.log.gz 2024-04-16T19:39:55.754 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.167676.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.75099.log 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.167676.log.gz 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.65634.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.62597.log 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr: 46.3% -- replaced with /var/log/ceph/c1-client.0.65634.log.gz 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.75099.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.107565.log 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.75099.log.gz 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.62597.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.87514.log 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.62597.log.gz 2024-04-16T19:39:55.755 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.107565.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.107565.log.gz -5 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.0.83874.log 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.87514.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.45557.log 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.87514.log.gz 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.83874.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36600.log 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.83874.log.gz 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.45557.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.71709.log 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.45557.log.gz 2024-04-16T19:39:55.756 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36600.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36600.log.gz 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.43134.log 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.71709.log: gzip -5 --verbose -- /var/log/ceph/c1.log 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.71709.log.gz 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.43134.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35155.log 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.43134.log.gz 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.156122.log 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35155.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35155.log.gz 2024-04-16T19:39:55.757 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.154297.log 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.156122.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172086.log 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr: 69.1% -- replaced with /var/log/ceph/c1-client.0.156122.log.gz 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.154297.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.113031.log 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.154297.log.gz 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172086.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.146994.log 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172086.log.gz 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.113031.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.124553.log 2024-04-16T19:39:55.758 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.113031.log.gz 2024-04-16T19:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.146994.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172844.log 2024-04-16T19:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr: 54.1% -- replaced with /var/log/ceph/c1-client.0.146994.log.gz 2024-04-16T19:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.124553.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.124553.log.gz 2024-04-16T19:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/c1-client.admin.35755.log 2024-04-16T19:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172844.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.143345.log 2024-04-16T19:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172844.log.gz 2024-04-16T19:39:55.759 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35755.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.admin.35755.log.gz -5 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.0.99654.log 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.143345.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.137883.log 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr: 76.8% -- replaced with /var/log/ceph/c1-client.0.143345.log.gz 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.99654.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c1-client.0.72314.log -- replaced with /var/log/ceph/c1-client.0.99654.log.gz 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.137883.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.55302.log 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.137883.log.gz 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.72314.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.72314.log.gz 2024-04-16T19:39:55.760 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.99044.log 2024-04-16T19:39:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.55302.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36724.log 2024-04-16T19:39:55.761 INFO:teuthology.orchestra.run.smithi016.stderr: 52.4% -- replaced with /var/log/ceph/c1-client.0.55302.log.gz 2024-04-16T19:39:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.99044.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.68066.log 2024-04-16T19:39:55.761 INFO:teuthology.orchestra.run.smithi016.stderr: 50.4% -- replaced with /var/log/ceph/c1-client.0.99044.log.gz 2024-04-16T19:39:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36724.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/c1-client.admin.36724.log.gz /var/log/ceph/c1-client.0.38661.log 2024-04-16T19:39:55.761 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-16T19:39:55.761 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.68066.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.80151.log 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.68066.log.gz 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.38661.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.91164.log 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.38661.log.gz 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.80151.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.115451.log 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.80151.log.gz 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.91164.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.140314.log 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.91164.log.gz 2024-04-16T19:39:55.762 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.115451.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c1-client.0.129403.log 2024-04-16T19:39:55.763 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.115451.log.gz 2024-04-16T19:39:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.140314.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.160367.log 2024-04-16T19:39:55.763 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.140314.log.gz 2024-04-16T19:39:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.129403.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.117268.log 2024-04-16T19:39:55.763 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.129403.log.gz 2024-04-16T19:39:55.763 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.160367.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.108173.log 2024-04-16T19:39:55.763 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.160367.log.gz 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.117268.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.117268.log.gz 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.39859.log 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.108173.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35553.log 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr: 61.0% -- replaced with /var/log/ceph/c1-client.0.108173.log.gz 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.39859.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.39859.log.gz 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.143954.log 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35553.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.148816.log 2024-04-16T19:39:55.764 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35553.log.gz 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.143954.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.143954.log.gz 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.116661.log 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.148816.log: gzip -5 --verbose -- /var/log/ceph/c1-mon.a.log 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.148816.log.gz 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.116661.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.135453.log 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr: 57.0% -- replaced with /var/log/ceph/c1-client.0.116661.log.gz 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.159157.log 2024-04-16T19:39:55.765 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.135453.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.135453.log.gz 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.105134.log 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr: 89.6% -- replaced with /var/log/ceph/c1.log.gz 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.65027.log 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.159157.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.159157.log.gz 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.171443.log 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.105134.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.105134.log.gz 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.65027.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.79552.log 2024-04-16T19:39:55.766 INFO:teuthology.orchestra.run.smithi016.stderr: 51.3% -- replaced with /var/log/ceph/c1-client.0.65027.log.gz 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.171443.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.168917.log 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.79552.log: 92.8% -- replaced with /var/log/ceph/c1-client.0.171443.log.gz 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.79552.log.gz 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.138490.log 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.168917.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.122724.log 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.168917.log.gz 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.138490.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.104529.log 2024-04-16T19:39:55.767 INFO:teuthology.orchestra.run.smithi016.stderr: 87.0% -- replaced with /var/log/ceph/c1-client.0.138490.log.gz 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.122724.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.122724.log.gz 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/c1-client.admin.36461.log 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.104529.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.52862.log 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.104529.log.gz 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36461.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.125770.log 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36461.log.gz 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.52862.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172886.log 2024-04-16T19:39:55.768 INFO:teuthology.orchestra.run.smithi016.stderr: 50.4% -- replaced with /var/log/ceph/c1-client.0.52862.log.gz 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.125770.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.114241.log 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.125770.log.gz 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172886.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.40517.log 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172886.log.gz 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.114241.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100259.log 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.114241.log.gz 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.40517.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.148206.log 2024-04-16T19:39:55.769 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.40517.log.gz 2024-04-16T19:39:55.770 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.100259.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/c1-client.0.100259.log.gz 2024-04-16T19:39:55.770 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/c1-client.admin.35369.log 2024-04-16T19:39:55.770 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.148206.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.48586.log 2024-04-16T19:39:55.770 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.148206.log.gz 2024-04-16T19:39:55.770 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35369.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35369.log.gz 2024-04-16T19:39:55.770 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.122117.log 2024-04-16T19:39:55.770 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.48586.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.102684.log 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.48586.log.gz 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.122117.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.144559.log 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr: 58.6% -- replaced with /var/log/ceph/c1-client.0.122117.log.gz 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.102684.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172296.log 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr: 86.1% -- replaced with /var/log/ceph/c1-client.0.102684.log.gz 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.144559.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.82059.log 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr: 67.8% -- replaced with /var/log/ceph/c1-client.0.144559.log.gz 2024-04-16T19:39:55.771 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172296.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c1-client.0.log 2024-04-16T19:39:55.772 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172296.log.gz 2024-04-16T19:39:55.772 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.82059.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.82059.log.gz 2024-04-16T19:39:55.772 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.84485.log 2024-04-16T19:39:55.772 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/ops-log-c1-client.0.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.44344.log 2024-04-16T19:39:55.772 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.84485.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.46166.log 2024-04-16T19:39:55.772 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.84485.log.gz 2024-04-16T19:39:55.772 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.44344.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.44344.log.gz 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172128.log 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.108781.log 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.46166.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.46166.log.gz 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172128.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172128.log.gz 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.54685.log 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96615.log 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.108781.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.108781.log.gz 2024-04-16T19:39:55.773 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.54685.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35211.log 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr: 88.8% -- replaced with /var/log/ceph/c1-client.0.54685.log.gz 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.96615.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.164038.log 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr: 69.5% -- replaced with /var/log/ceph/c1-client.0.96615.log.gz 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.128193.log 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35211.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35211.log.gz 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.164038.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36249.log 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.164038.log.gz 2024-04-16T19:39:55.774 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.128193.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.128193.log.gz 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.161577.log 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.49798.log 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36249.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36249.log.gz 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.161577.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.146379.log 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.161577.log.gz 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.49798.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.49798.log.gz 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/c1-client.admin.172970.log 2024-04-16T19:39:55.775 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35977.log 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.146379.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.146379.log.gz 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172970.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.111215.log 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172970.log.gz 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35977.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.73007.log 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35977.log.gz 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.96008.log 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.111215.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.111215.log.gz 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.73007.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.73007.log.gz 2024-04-16T19:39:55.776 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.c1.client.0.log 2024-04-16T19:39:55.777 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35552.log 2024-04-16T19:39:55.777 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.96008.log: 68.7% -- replaced with /var/log/ceph/c1-client.0.96008.log.gz 2024-04-16T19:39:55.777 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/rgw.c1.client.0.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.134243.log 2024-04-16T19:39:55.777 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35552.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36377.log 2024-04-16T19:39:55.777 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35552.log.gz 2024-04-16T19:39:55.777 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.134243.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.168304.log 2024-04-16T19:39:55.777 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.134243.log.gz 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36377.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.157946.log 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36377.log.gz 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35957.log 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.168304.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.168304.log.gz 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.157946.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.55909.log 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.157946.log.gz 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35957.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.90554.log 2024-04-16T19:39:55.778 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35957.log.gz 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.163431.log 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.55909.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.55909.log.gz 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.90554.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.76986.log 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.90554.log.gz 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.163431.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.32279.log 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr: 54.1% -- replaced with /var/log/ceph/c1-client.0.163431.log.gz 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.66241.log 2024-04-16T19:39:55.779 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.76986.log: 7.2% -- replaced with /var/log/ceph/c1-client.0.76986.log.gz 2024-04-16T19:39:55.780 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.32279.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/c1-client.admin.32279.log.gz 2024-04-16T19:39:55.780 INFO:teuthology.orchestra.run.smithi016.stderr: -- /var/log/ceph/c1-client.0.165853.log 2024-04-16T19:39:55.780 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.66241.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.66241.log.gz 2024-04-16T19:39:55.780 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.136667.log 2024-04-16T19:39:55.780 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.165853.log: gzip -5 0.0% --verbose -- /var/log/ceph/c1-client.admin.172422.log 2024-04-16T19:39:55.780 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.165853.log.gz 2024-04-16T19:39:55.780 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.136667.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.0.136667.log.gz -5 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.0.110003.log 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172422.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.81454.log 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172422.log.gz 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.110003.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.158552.log 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr: 58.6% -- replaced with /var/log/ceph/c1-client.0.110003.log.gz 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.81454.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/c1-client.0.81454.log.gz -- 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/c1-client.0.67455.log 2024-04-16T19:39:55.781 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.158552.log: gzip 0.0% -- replaced with /var/log/ceph/c1-client.0.158552.log.gz 2024-04-16T19:39:55.782 INFO:teuthology.orchestra.run.smithi016.stderr: -5 --verbose -- /var/log/ceph/c1-client.0.89949.log 2024-04-16T19:39:55.782 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.67455.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.67455.log.gz 2024-04-16T19:39:55.782 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.145167.log 2024-04-16T19:39:55.782 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.89949.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.89949.log.gz 2024-04-16T19:39:55.782 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.51010.log 2024-04-16T19:39:55.782 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.145167.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35765.log 2024-04-16T19:39:55.782 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.145167.log.gz 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.51010.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.32471.log 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr: 71.4% -- replaced with /var/log/ceph/c1-client.0.51010.log.gz 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.151843.log 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35765.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35765.log.gz 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.32471.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.49191.log 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.32471.log.gz 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.151843.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.85697.log 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.151843.log.gz 2024-04-16T19:39:55.783 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.49191.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.44949.log 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr: 66.7% -- replaced with /var/log/ceph/c1-client.0.49191.log.gz 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.85697.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.97827.log 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr: 56.9% -- replaced with /var/log/ceph/c1-client.0.85697.log.gz 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.44949.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.32545.log 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.44949.log.gz 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.97827.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.166458.log 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.97827.log.gz 2024-04-16T19:39:55.784 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.32545.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.154907.log 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.32545.log.gz 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.166458.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.119083.log 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.166458.log.gz 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.154907.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.121512.log 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.154907.log.gz 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.119083.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.100864.log 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.119083.log.gz 2024-04-16T19:39:55.785 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.121512.log: gzip -5 0.0% -- replaced with /var/log/ceph/c1-client.0.121512.log.gz 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.0.106957.log 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.100864.log: 57.3% -- replaced with /var/log/ceph/c1-client.0.100864.log.gz 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.88119.log 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.106957.log: 57.1% -- replaced with /var/log/ceph/c1-client.0.106957.log.gz 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.69891.log 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.88119.log: gzip -5 0.0% -- replaced with /var/log/ceph/c1-client.0.88119.log.gz 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.0.170153.log 2024-04-16T19:39:55.786 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.69891.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.69891.log.gz 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.126981.log 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.170153.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.170153.log.gz 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.68676.log 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.126981.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.126981.log.gz 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172758.log 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.68676.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.68676.log.gz 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36419.log 2024-04-16T19:39:55.787 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172758.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172758.log.gz 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.142740.log 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36419.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36419.log.gz 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.91769.log 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.142740.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.142740.log.gz 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.103924.log 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.91769.log: 57.8%gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36682.log 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.91769.log.gz 2024-04-16T19:39:55.788 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.103924.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.69286.log 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.103924.log.gz 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36682.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.98439.log 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36682.log.gz 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.69286.log: gzip -5 0.0% -- replaced with /var/log/ceph/c1-client.0.69286.log.gz 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.admin.35327.log 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.98439.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.98439.log.gz 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.128798.log 2024-04-16T19:39:55.789 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35327.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35327.log.gz 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.73891.log 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.128798.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.128798.log.gz 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36311.log 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.73891.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.73891.log.gz 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.131823.log 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36311.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36311.log.gz 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.56515.log 2024-04-16T19:39:55.790 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.131823.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.131823.log.gz 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35545.log 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.56515.log: 49.9% -- replaced with /var/log/ceph/c1-client.0.56515.log.gz 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35763.log 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35545.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35545.log.gz 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.74500.log 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35763.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35763.log.gz 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.133638.log 2024-04-16T19:39:55.791 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.74500.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.74500.log.gz 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-osd.1.log 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.133638.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.133638.log.gz 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172380.log 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.131218.log 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172380.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172380.log.gz 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.64421.log 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.131218.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.131218.log.gz 2024-04-16T19:39:55.792 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172716.log 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.64421.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.64421.log.gz 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35719.log 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172716.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172716.log.gz 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.116056.log 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35719.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35719.log.gz 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.82664.log 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.116056.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.116056.log.gz 2024-04-16T19:39:55.793 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.37360.log 2024-04-16T19:39:55.794 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.82664.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.82664.log.gz 2024-04-16T19:39:55.794 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.132428.log 2024-04-16T19:39:55.794 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.167063.log 2024-04-16T19:39:55.794 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.37360.log: gzip/var/log/ceph/c1-client.0.132428.log: 43.2% -5 --verbose -- /var/log/ceph/c1-client.0.152448.log 2024-04-16T19:39:55.794 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.37360.log.gz 0.0% -- replaced with /var/log/ceph/c1-client.0.132428.log.gz 2024-04-16T19:39:55.794 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-16T19:39:55.794 INFO:teuthology.orchestra.run.smithi016.stderr:gzip/var/log/ceph/c1-client.0.167063.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/c1-client.0.167063.log.gz 2024-04-16T19:39:55.795 INFO:teuthology.orchestra.run.smithi016.stderr: /var/log/ceph/c1-client.0.139101.log 2024-04-16T19:39:55.795 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.152448.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.152448.log.gz 2024-04-16T19:39:55.795 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172548.log 2024-04-16T19:39:55.795 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.139101.log: gzip -5 0.0% -- replaced with /var/log/ceph/c1-client.0.139101.log.gz 2024-04-16T19:39:55.795 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.0.120907.log 2024-04-16T19:39:55.795 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172548.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172548.log.gz 2024-04-16T19:39:55.795 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.101471.log 2024-04-16T19:39:55.796 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.120907.log: gzip -5 0.0% -- replaced with /var/log/ceph/c1-client.0.120907.log.gz 2024-04-16T19:39:55.796 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.0.151238.log 2024-04-16T19:39:55.796 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.101471.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.101471.log.gz 2024-04-16T19:39:55.796 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35253.log 2024-04-16T19:39:55.796 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.151238.log: gzip -5 0.0% --verbose -- /var/log/ceph/c1-client.0.97222.log 2024-04-16T19:39:55.796 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.151238.log.gz 2024-04-16T19:39:55.796 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35253.log: 0.0%gzip -- replaced with /var/log/ceph/c1-client.admin.35253.log.gz -5 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr: --verbose -- /var/log/ceph/c1-client.admin.172928.log 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose/var/log/ceph/c1-client.0.97222.log: -- /var/log/ceph/c1-client.0.57122.log 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.97222.log.gz 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172928.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172928.log.gz 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.165248.log 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.92376.log 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.57122.log: /var/log/ceph/c1-client.0.165248.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172506.log 2024-04-16T19:39:55.797 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% 73.6% -- replaced with /var/log/ceph/c1-client.0.57122.log.gz 2024-04-16T19:39:55.798 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.165248.log.gz 2024-04-16T19:39:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.92376.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.170773.log 2024-04-16T19:39:55.798 INFO:teuthology.orchestra.run.smithi016.stderr: 57.7% -- replaced with /var/log/ceph/c1-client.0.92376.log.gz 2024-04-16T19:39:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.50403.log 2024-04-16T19:39:55.798 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172506.log: /var/log/ceph/c1-client.0.170773.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172170.log 2024-04-16T19:39:55.798 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172506.log.gz 2024-04-16T19:39:55.798 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.170773.log.gz 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.50403.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35999.log 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr: 47.0% -- replaced with /var/log/ceph/c1-client.0.50403.log.gz 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.130008.log 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172170.log: /var/log/ceph/c1-client.admin.35999.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c1-client.0.160972.log 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.admin.172170.log.gz 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35999.log.gz 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.130008.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.60163.log 2024-04-16T19:39:55.799 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.130008.log.gz 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.118478.log 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.160972.log: /var/log/ceph/c1-client.0.60163.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.162192.log 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/c1-client.0.160972.log.gz 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.60163.log.gz 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.118478.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.118478.log.gz 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.78274.log 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.147601.log 2024-04-16T19:39:55.800 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.162192.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172800.log 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.78274.log: 89.9% 42.5% -- replaced with /var/log/ceph/c1-client.0.78274.log.gz 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.162192.log.gz 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.147601.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c1-client.0.95403.log 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.147601.log.gz 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.172800.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.40475.log 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172800.log.gz 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.109388.log 2024-04-16T19:39:55.801 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.95403.log: 0.0%/var/log/ceph/c1-client.admin.40475.log: -- replaced with /var/log/ceph/c1-client.0.95403.log.gz 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.58341.log 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.40475.log.gz 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.109388.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.109388.log.gz 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.70499.log 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.58341.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.58341.log.gz 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.61378.log 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.70499.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.70499.log.gz 2024-04-16T19:39:55.802 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.71104.log 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.61378.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.61378.log.gz 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.36209.log 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.71104.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.71104.log.gz 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.136058.log 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.36209.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.36209.log.gz 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.86909.log 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.136058.log: 69.1%gzip -5 --verbose -- /var/log/ceph/c1-client.0.149423.log 2024-04-16T19:39:55.803 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.136058.log.gz 2024-04-16T19:39:55.804 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.86909.log: gzip -5 --verbose -- /var/log/ceph/c1-osd.0.log 2024-04-16T19:39:55.804 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.86909.log.gz 2024-04-16T19:39:55.804 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose/var/log/ceph/c1-client.0.149423.log: -- /var/log/ceph/c1-client.0.133033.log 2024-04-16T19:39:55.804 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.0.149423.log.gz 2024-04-16T19:39:55.804 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.47981.log 2024-04-16T19:39:55.804 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.133033.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c1-client.0.145772.log 2024-04-16T19:39:55.804 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.133033.log.gz 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.78873.log 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.47981.log: /var/log/ceph/c1-client.0.145772.log: 0.0% 66.7% -- replaced with /var/log/ceph/c1-client.0.145772.log.gz 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.47981.log.gz 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35550.log 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.78873.log: gzip -5 --verbose -- /var/log/ceph/c1-client.admin.35546.log 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr: 6.7% -- replaced with /var/log/ceph/c1-client.0.78873.log.gz 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35550.log: gzip -5 --verbose -- /var/log/ceph/c1-client.0.83269.log 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.admin.35546.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35550.log.gz 2024-04-16T19:39:55.805 INFO:teuthology.orchestra.run.smithi016.stderr: 0.0% -- replaced with /var/log/ceph/c1-client.admin.35546.log.gz 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.admin.172632.log 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.83269.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c1-client.0.53469.log 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr: -- replaced with /var/log/ceph/c1-client.0.83269.log.gz 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr:gzip -5 --verbose -- /var/log/ceph/c1-client.0.162819.log 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.53469.log: /var/log/ceph/c1-client.admin.172632.log: 0.0% -- replaced with /var/log/ceph/c1-client.admin.172632.log.gz 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr: 53.0% -- replaced with /var/log/ceph/c1-client.0.53469.log.gz 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr:/var/log/ceph/c1-client.0.162819.log: 0.0% -- replaced with /var/log/ceph/c1-client.0.162819.log.gz 2024-04-16T19:39:55.806 INFO:teuthology.orchestra.run.smithi016.stderr: 95.7% -- replaced with /var/log/ceph/ops-log-c1-client.0.log.gz 2024-04-16T19:39:55.822 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.152841.log 2024-04-16T19:39:55.822 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.118560.log 2024-04-16T19:39:55.822 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.152841.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.154057.log 2024-04-16T19:39:55.822 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.152841.log.gz 2024-04-16T19:39:55.822 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.118560.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.63278.log 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.118560.log.gz 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.154057.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.238089.log 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.154057.log.gz 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.63278.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.47468.log 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.63278.log.gz 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.238089.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.139954.log 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr: 8.2% -- replaced with /var/log/ceph/c2-client.0.238089.log.gz 2024-04-16T19:39:55.823 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.47468.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.202671.log 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.47468.log.gz 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.139954.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35919.log 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.139954.log.gz 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.202671.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.171752.log 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.202671.log.gz 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35919.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36343.log 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35919.log.gz 2024-04-16T19:39:55.824 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.171752.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.55999.log 2024-04-16T19:39:55.825 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.171752.log.gz 2024-04-16T19:39:55.825 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36343.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.78490.log 2024-04-16T19:39:55.825 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36343.log.gz 2024-04-16T19:39:55.825 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.55999.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36784.log 2024-04-16T19:39:55.825 INFO:teuthology.orchestra.run.smithi139.stderr: 53.0% -- replaced with /var/log/ceph/c2-client.0.55999.log.gz 2024-04-16T19:39:55.825 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.78490.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99727.log 2024-04-16T19:39:55.826 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.78490.log.gz 2024-04-16T19:39:55.826 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36784.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.43820.log 2024-04-16T19:39:55.826 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36784.log.gz 2024-04-16T19:39:55.826 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.99727.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.151625.log 2024-04-16T19:39:55.826 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99727.log.gz 2024-04-16T19:39:55.826 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.43820.log: gzip -5 --verbose -- /var/log/ceph/c2-mon.a.log 2024-04-16T19:39:55.826 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.43820.log.gz 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.151625.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.188008.log 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr: 48.1% -- replaced with /var/log/ceph/c2-client.0.151625.log.gz 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-mon.a.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.99119.log 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.188008.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.66929.log 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.188008.log.gz 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.99119.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.70576.log 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.99119.log.gz 2024-04-16T19:39:55.827 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.66929.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.165011.log 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr: 49.9% -- replaced with /var/log/ceph/c2-client.0.66929.log.gz 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.70576.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.196585.log 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.70576.log.gz 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.165011.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.188610.log 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr: 86.2% -- replaced with /var/log/ceph/c2-client.0.165011.log.gz 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.196585.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36171.log 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.196585.log.gz 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.188610.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.134981.log 2024-04-16T19:39:55.828 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.188610.log.gz 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36171.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.45036.log 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36171.log.gz 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.134981.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.178976.log 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.134981.log.gz 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose/var/log/ceph/c2-client.0.45036.log: -- /var/log/ceph/c2-client.0.44428.log 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.45036.log.gz 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.178976.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.97067.log 2024-04-16T19:39:55.829 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.178976.log.gz 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.44428.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105808.log 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.44428.log.gz 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.97067.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.68760.log 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr: 13.6% -- replaced with /var/log/ceph/c2-client.0.97067.log.gz 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.105808.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.201454.log 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.105808.log.gz 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.68760.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.68760.log.gz 2024-04-16T19:39:55.830 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35662.log 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.201454.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.225775.log 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.201454.log.gz 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35662.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.162572.log 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35662.log.gz 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.225775.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.211390.log 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.225775.log.gz 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.162572.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.46860.log 2024-04-16T19:39:55.831 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.162572.log.gz 2024-04-16T19:39:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.211390.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.124018.log 2024-04-16T19:39:55.832 INFO:teuthology.orchestra.run.smithi139.stderr: 50.1% -- replaced with /var/log/ceph/c2-client.0.211390.log.gz 2024-04-16T19:39:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.46860.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.237938.log 2024-04-16T19:39:55.832 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.46860.log.gz 2024-04-16T19:39:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose/var/log/ceph/c2-client.0.124018.log: -- /var/log/ceph/c2-client.0.101551.log 2024-04-16T19:39:55.832 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.124018.log.gz 2024-04-16T19:39:55.832 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.237938.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.130083.log 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr: 8.2% -- replaced with /var/log/ceph/c2-client.0.237938.log.gz 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.101551.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.238014.log 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr: 46.8% -- replaced with /var/log/ceph/c2-client.0.101551.log.gz 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.130083.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.94480.log 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr: 56.3% -- replaced with /var/log/ceph/c2-client.0.130083.log.gz 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.238014.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.164394.log 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr: 8.2% -- replaced with /var/log/ceph/c2-client.0.238014.log.gz 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.213942.log 2024-04-16T19:39:55.833 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.94480.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.94480.log.gz 2024-04-16T19:39:55.834 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.164394.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.237984.log 2024-04-16T19:39:55.834 INFO:teuthology.orchestra.run.smithi139.stderr: 87.1% -- replaced with /var/log/ceph/c2-client.0.164394.log.gz 2024-04-16T19:39:55.834 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.213942.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.213942.log.gzgzip 2024-04-16T19:39:55.834 INFO:teuthology.orchestra.run.smithi139.stderr: -5 --verbose -- /var/log/ceph/c2-client.0.200238.log 2024-04-16T19:39:55.834 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.237984.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36172.log 2024-04-16T19:39:55.834 INFO:teuthology.orchestra.run.smithi139.stderr: 8.2% -- replaced with /var/log/ceph/c2-client.0.237984.log.gz 2024-04-16T19:39:55.834 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.200238.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.38803.log 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.200238.log.gz 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36172.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.178374.log 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36172.log.gz 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.38803.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.234289.log 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.38803.log.gz 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.178374.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.236722.log 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.178374.log.gz 2024-04-16T19:39:55.835 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.234289.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.144210.log 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.234289.log.gz 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.236722.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.130687.log 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.236722.log.gz 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.144210.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.168742.log 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.144210.log.gz 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.130687.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.139346.log 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.130687.log.gz 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.168742.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.137522.log 2024-04-16T19:39:55.836 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.168742.log.gz 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.139346.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.229423.log 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.139346.log.gz 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.137522.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35917.log 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.137522.log.gz 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.229423.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.181988.log 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.229423.log.gz 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35917.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.123414.log 0.0% 2024-04-16T19:39:55.837 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.admin.35917.log.gz 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.181988.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.228207.log 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.181988.log.gz 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.123414.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.184998.log 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr: 69.5% -- replaced with /var/log/ceph/c2-client.0.123414.log.gz 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.228207.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.80921.log 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.228207.log.gz 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.184998.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.80314.log 2024-04-16T19:39:55.838 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.184998.log.gz 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.80921.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.65713.log 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.80921.log.gz 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.80314.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.125835.log 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.80314.log.gz 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.65713.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36618.log 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.65713.log.gz 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.125835.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.75446.log 2024-04-16T19:39:55.839 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.125835.log.gz 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36618.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116743.log 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36618.log.gz 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.75446.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.142386.log 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.75446.log.gz 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.116743.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.40084.log 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr: 58.8% -- replaced with /var/log/ceph/c2-client.0.116743.log.gz 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.142386.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.105199.log 2024-04-16T19:39:55.840 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.142386.log.gz 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.40084.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c2-client.0.135593.log 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.40084.log.gz 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.105199.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.45644.log 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.105199.log.gz 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.135593.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.172354.log 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.135593.log.gz 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.40683.log/var/log/ceph/c2-client.0.45644.log: 2024-04-16T19:39:55.841 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.45644.log.gz 2024-04-16T19:39:55.842 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.172354.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.172354.log.gz 2024-04-16T19:39:55.842 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.183794.log 2024-04-16T19:39:55.842 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.40683.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36824.log 2024-04-16T19:39:55.842 INFO:teuthology.orchestra.run.smithi139.stderr: 19.1% -- replaced with /var/log/ceph/c2-client.0.40683.log.gz 2024-04-16T19:39:55.842 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.183794.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.176568.log 2024-04-16T19:39:55.842 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.183794.log.gz 2024-04-16T19:39:55.842 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36824.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.211996.log 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36824.log.gz 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.176568.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.103983.log 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.176568.log.gz 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.211996.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.200846.log 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr: 41.9% -- replaced with /var/log/ceph/c2-client.0.211996.log.gz 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.103983.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113714.log 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.103983.log.gz 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.200846.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.111882.log 2024-04-16T19:39:55.843 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.200846.log.gz 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.113714.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.117347.log 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.113714.log.gz 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.111882.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.223238.log 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.111882.log.gz 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.117347.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.169946.log 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr: 76.0% -- replaced with /var/log/ceph/c2-client.0.117347.log.gz 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.223238.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36344.log 2024-04-16T19:39:55.844 INFO:teuthology.orchestra.run.smithi139.stderr: 55.6% -- replaced with /var/log/ceph/c2-client.0.223238.log.gz 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.169946.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.157097.log 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.169946.log.gz 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36344.log: gzip -5 --verbose -- 0.0% /var/log/ceph/c2-client.admin.36742.log 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.admin.36344.log.gz 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.140562.log 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.157097.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.157097.log.gz 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36742.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.161356.log 2024-04-16T19:39:55.845 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36742.log.gz 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.140562.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95771.log 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.140562.log.gz 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.161356.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.182590.log 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.161356.log.gz 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.95771.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100335.log 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.95771.log.gz 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.182590.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.202062.log 2024-04-16T19:39:55.846 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.182590.log.gz 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.100335.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.95163.log 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.100335.log.gz 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.202062.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.156489.log 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.202062.log.gz 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.95163.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.131939.log 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.95163.log.gz 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose --/var/log/ceph/c2-client.0.156489.log: /var/log/ceph/c2-client.0.104591.log 2024-04-16T19:39:55.847 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.156489.log.gz 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.131939.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.163180.log 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.131939.log.gz 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.104591.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.55387.log 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.104591.log.gz 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.163180.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.131295.log 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.163180.log.gz 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.55387.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32186.log 2024-04-16T19:39:55.848 INFO:teuthology.orchestra.run.smithi139.stderr: 71.7% -- replaced with /var/log/ceph/c2-client.0.55387.log.gz 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.131295.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.194153.log 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr: 57.7% -- replaced with /var/log/ceph/c2-client.0.131295.log.gz 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.32186.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.232463.log 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32186.log.gz 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.194153.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.226991.log 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.194153.log.gz 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.232463.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.122199.log 2024-04-16T19:39:55.849 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.232463.log.gz 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.226991.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.192941.log 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.226991.log.gz 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.122199.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110065.log 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.122199.log.gz 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.192941.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.90678.log 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr: 66.5% -- replaced with /var/log/ceph/c2-client.0.192941.log.gz 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.110065.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.221344.log 2024-04-16T19:39:55.850 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110065.log.gz 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.90678.log: gzip -5 --verbose -- /var/log/ceph/c2.log 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.90678.log.gz 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.221344.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.160137.log 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr: 97.2% -- replaced with /var/log/ceph/c2-client.0.221344.log.gz 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36660.log 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.160137.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102767.log 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.160137.log.gz 2024-04-16T19:39:55.851 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36660.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36660.log.gz 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2.audit.log 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5/var/log/ceph/c2-client.0.102767.log: --verbose -- /var/log/ceph/c2-client.0.111275.log 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.102767.log.gz 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2.audit.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.85140.log 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.111275.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.111275.log.gz 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.106416.log 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.114321.log 2024-04-16T19:39:55.852 INFO:teuthology.orchestra.run.smithi139.stderr: 89.7% -- replaced with /var/log/ceph/c2.audit.log.gz 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.85140.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.85140.log.gz 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.106416.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.199017.log 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.106416.log.gz 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.114321.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.147268.log 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.114321.log.gz 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.199017.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35520.log 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.199017.log.gz 2024-04-16T19:39:55.853 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.147268.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.108849.log 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr: 91.5% -- replaced with /var/log/ceph/c2-client.0.147268.log.gz 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35520.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/c2-client.admin.35520.log.gz /var/log/ceph/c2-client.0.171150.log 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.108849.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35576.log 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.108849.log.gz 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.171150.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.41992.log 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.171150.log.gz 2024-04-16T19:39:55.854 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35576.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/c2-client.admin.35576.log.gz 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr: /var/log/ceph/c2-client.0.125233.log 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.41992.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.86420.log 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.41992.log.gz 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.125233.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.125233.log.gz 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.235506.log 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.86420.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.73622.log 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.86420.log.gz 2024-04-16T19:39:55.855 INFO:teuthology.orchestra.run.smithi139.stderr: 89.6% -- replaced with /var/log/ceph/c2.log.gz 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.235506.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.197193.log 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.235506.log.gz 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.73622.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.82732.log 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.73622.log.gz 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.197193.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.110667.log 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.197193.log.gz 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.82732.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.223848.log 2024-04-16T19:39:55.856 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.82732.log.gz 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.110667.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.191020.log 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.110667.log.gz 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.223848.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.146643.log 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr: 41.9% -- replaced with /var/log/ceph/c2-client.0.223848.log.gz 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.191020.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.230639.log 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.146643.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.181386.log 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr: 42.5% -- replaced with /var/log/ceph/c2-client.0.146643.log.gz 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.230639.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.222630.log 2024-04-16T19:39:55.857 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.230639.log.gz 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.181386.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.181386.log.gz 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32378.log 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.222630.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.198409.log 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.222630.log.gz 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.32378.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32378.log.gz 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.40019.log 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.198409.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.210782.log 2024-04-16T19:39:55.858 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.198409.log.gz 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.40019.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.40019.log.gz 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.69368.log 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr: 97.0% -- replaced with /var/log/ceph/c2-client.0.191020.log.gz 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.210782.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.76665.log 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.210782.log.gz 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.69368.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.189212.log 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr: 49.9% -- replaced with /var/log/ceph/c2-client.0.69368.log.gz 2024-04-16T19:39:55.859 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.76665.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.107024.log 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.76665.log.gz 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.189212.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.113096.log 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.189212.log.gz 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.107024.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.37502.log 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.107024.log.gz 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.113096.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.142994.log 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.113096.log.gz 2024-04-16T19:39:55.860 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.37502.log: gzip -5 --verbose -- /var/log/ceph/ops-log-c2-client.0.log 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr: 43.5% -- replaced with /var/log/ceph/c2-client.0.37502.log.gz 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.142994.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.59641.log 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.142994.log.gz 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ops-log-c2-client.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.127047.log 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.59641.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.184396.log 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr: 72.1% -- replaced with /var/log/ceph/c2-client.0.59641.log.gz 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.127047.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.127047.log.gz 2024-04-16T19:39:55.861 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36576.log 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.169344.log 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.184396.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.184396.log.gz 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36576.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36576.log.gz 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.233071.log 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.169344.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.163788.log 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.169344.log.gz 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.233071.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.233071.log.gz 2024-04-16T19:39:55.862 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.138130.log 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5/var/log/ceph/c2-client.0.163788.log: --verbose -- /var/log/ceph/c2-client.0.97903.log 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr: 54.5% -- replaced with /var/log/ceph/c2-client.0.163788.log.gz 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.138130.log: 44.8% -- replaced with /var/log/ceph/c2-client.0.138130.log.gz 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.87030.log 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.57216.log 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.97903.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.97903.log.gz 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.87030.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.117952.log 2024-04-16T19:39:55.863 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.87030.log.gz 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.57216.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.170548.log 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr: 53.0% -- replaced with /var/log/ceph/c2-client.0.57216.log.gz 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.117952.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.76057.log 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr: 89.9% -- replaced with /var/log/ceph/c2-client.0.117952.log.gz 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.170548.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.170548.log.gz 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.220026.log 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.76057.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93881.log 2024-04-16T19:39:55.864 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.76057.log.gz 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.220026.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.167524.log 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr: 41.9% -- replaced with /var/log/ceph/c2-client.0.220026.log.gz 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.210180.log 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.93881.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.93881.log.gz 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.167524.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.214549.log 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr: 92.3% -- replaced with /var/log/ceph/c2-client.0.167524.log.gz 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.210180.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.183192.log 2024-04-16T19:39:55.865 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.210180.log.gz 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.214549.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.214549.log.gz 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36392.log 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.183192.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.152233.log 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.183192.log.gz 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36392.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36392.log.gz 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.50504.log 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.152233.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.209573.log 2024-04-16T19:39:55.866 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.152233.log.gz 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.50504.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.50504.log.gz 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.205816.log 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.209573.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.74838.log 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.209573.log.gz 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.205816.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.205816.log.gz 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.189814.log 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.74838.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.216372.log 2024-04-16T19:39:55.867 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.74838.log.gz 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.189814.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.189814.log.gz 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.52322.log 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.216372.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.160748.log 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.216372.log.gz 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.52322.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.52322.log.gz 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.87638.log 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.160748.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.51112.log 2024-04-16T19:39:55.868 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.160748.log.gz 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.87638.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.87638.log.gz 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36108.log 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.51112.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.154665.log 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr: 46.6% -- replaced with /var/log/ceph/c2-client.0.51112.log.gz 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36108.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36108.log.gz 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.217586.log 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.154665.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.2.log 2024-04-16T19:39:55.869 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.154665.log.gz 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.217586.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.60248.log 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.217586.log.gz 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.100943.log 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.60248.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.60248.log.gz 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.115531.log 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35920.log 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.100943.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.100943.log.gz 2024-04-16T19:39:55.870 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.115531.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.115531.log.gz 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.120383.log 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.120991.log 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35920.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35920.log.gz 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.120383.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.63886.log 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.120383.log.gz 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.120991.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.151020.log 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr: 57.1% -- replaced with /var/log/ceph/c2-client.0.120991.log.gz 2024-04-16T19:39:55.871 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.63886.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.83334.log 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr: 60.5% -- replaced with /var/log/ceph/c2-client.0.63886.log.gz 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.151020.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.67543.log 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr: 82.3% -- replaced with /var/log/ceph/c2-client.0.151020.log.gz 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.83334.log: gzip 0.0% -- replaced with /var/log/ceph/c2-client.0.83334.log.gz -5 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr: --verbose -- /var/log/ceph/c2-client.0.216979.log 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35918.log 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.67543.log: 46.3% -- replaced with /var/log/ceph/c2-client.0.67543.log.gz 2024-04-16T19:39:55.872 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.216979.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.155881.log 2024-04-16T19:39:55.873 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.216979.log.gz 2024-04-16T19:39:55.873 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.48684.log 2024-04-16T19:39:55.873 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35918.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35918.log.gz 2024-04-16T19:39:55.873 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.155881.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.58429.log 2024-04-16T19:39:55.873 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.155881.log.gz 2024-04-16T19:39:55.873 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.48684.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.65099.log 2024-04-16T19:39:55.873 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.48684.log.gz 2024-04-16T19:39:55.874 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.133765.log 2024-04-16T19:39:55.874 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.58429.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.58429.log.gz 2024-04-16T19:39:55.874 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.65099.log: 76.7% -- replaced with /var/log/ceph/c2-client.0.65099.log.gz 2024-04-16T19:39:55.874 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.112489.log 2024-04-16T19:39:55.874 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36441.log 2024-04-16T19:39:55.874 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.133765.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.133765.log.gz 2024-04-16T19:39:55.874 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.112489.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.112489.log.gz 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.195369.log 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.84538.log 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36441.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36441.log.gz 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.195369.log: gzip -5 --verbose -- 46.1% /var/log/ceph/c2-client.0.161964.log -- replaced with /var/log/ceph/c2-client.0.195369.log.gz 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.84538.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.175966.log 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.84538.log.gz 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.161964.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.127655.log 2024-04-16T19:39:55.875 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.161964.log.gz 2024-04-16T19:39:55.876 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.175966.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.173558.log 2024-04-16T19:39:55.876 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.175966.log.gz 2024-04-16T19:39:55.876 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.127655.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.74230.log 2024-04-16T19:39:55.876 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.127655.log.gz 2024-04-16T19:39:55.876 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.173558.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.173558.log.gz 2024-04-16T19:39:55.876 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.107632.log 2024-04-16T19:39:55.876 INFO:teuthology.orchestra.run.smithi139.stderr:gzip/var/log/ceph/c2-client.0.74230.log: -5 --verbose -- /var/log/ceph/c2-client.0.197801.log 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.74230.log.gz 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.107632.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.102159.log 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.107632.log.gz 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.72402.log 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.197801.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.197801.log.gz 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.102159.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.102159.log.gz 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.226383.log 2024-04-16T19:39:55.877 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.191633.log 2024-04-16T19:39:55.878 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.72402.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.72402.log.gz 2024-04-16T19:39:55.878 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.226383.log: gzip -5 --verbose -- 46.1% /var/log/ceph/c2-client.0.153449.log 2024-04-16T19:39:55.878 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.226383.log.gz 2024-04-16T19:39:55.878 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.191633.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.191633.log.gz 2024-04-16T19:39:55.878 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.82127.log 2024-04-16T19:39:55.878 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.42600.log 2024-04-16T19:39:55.878 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.153449.log: 47.4% -- replaced with /var/log/ceph/c2-client.0.153449.log.gz 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.82127.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.82127.log.gz 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.126443.log 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.145426.log 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.42600.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.42600.log.gz 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.126443.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.60855.log 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr: 50.1% -- replaced with /var/log/ceph/c2-client.0.126443.log.gz 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.145426.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.69972.log 2024-04-16T19:39:55.879 INFO:teuthology.orchestra.run.smithi139.stderr: 57.5% -- replaced with /var/log/ceph/c2-client.0.145426.log.gz 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.60855.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.168140.log 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.60855.log.gz 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.69972.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.208951.log 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr: 46.3% -- replaced with /var/log/ceph/c2-client.0.69972.log.gz 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.168140.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.114923.log 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.168140.log.gz 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.208951.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.236114.log 2024-04-16T19:39:55.880 INFO:teuthology.orchestra.run.smithi139.stderr: 89.1% -- replaced with /var/log/ceph/c2-client.0.208951.log.gz 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.114923.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.39403.log 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.114923.log.gz 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.236114.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.54783.log 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr: 44.8% -- replaced with /var/log/ceph/c2-client.0.236114.log.gz 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.39403.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.203279.log 0.0% 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.39403.log.gz 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.54783.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.146030.log 2024-04-16T19:39:55.881 INFO:teuthology.orchestra.run.smithi139.stderr: 50.7% -- replaced with /var/log/ceph/c2-client.0.54783.log.gz 2024-04-16T19:39:55.882 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.203279.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.203279.log.gz 2024-04-16T19:39:55.882 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.91286.log 2024-04-16T19:39:55.882 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.32452.log 2024-04-16T19:39:55.882 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.146030.log: 79.4% -- replaced with /var/log/ceph/c2-client.0.146030.log.gz 2024-04-16T19:39:55.882 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.91286.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.91286.log.gz 2024-04-16T19:39:55.882 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.165627.log 2024-04-16T19:39:55.882 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.92593.log 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.32452.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.32452.log.gz 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.165627.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.186202.log 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr: 94.4% -- replaced with /var/log/ceph/c2-client.0.165627.log.gz 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.92593.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.68152.log 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.92593.log.gz 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.48076.log 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.186202.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.186202.log.gz 2024-04-16T19:39:55.883 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.68152.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.155273.log 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.68152.log.gz 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.48076.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.73010.log 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.48076.log.gz 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.155273.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.77881.log 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.155273.log.gz 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.73010.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.73010.log.gz 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.213314.log 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.177170.log 2024-04-16T19:39:55.884 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.77881.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.77881.log.gz 2024-04-16T19:39:55.885 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.213314.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.199625.log 2024-04-16T19:39:55.885 INFO:teuthology.orchestra.run.smithi139.stderr: 94.0% -- replaced with /var/log/ceph/c2-client.0.213314.log.gz 2024-04-16T19:39:55.885 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.177170.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.109457.log 2024-04-16T19:39:55.885 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.177170.log.gz 2024-04-16T19:39:55.885 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.159529.log 2024-04-16T19:39:55.885 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.199625.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.199625.log.gz 2024-04-16T19:39:55.885 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.109457.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.136908.log 2024-04-16T19:39:55.886 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.109457.log.gz 2024-04-16T19:39:55.886 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.98511.log 2024-04-16T19:39:55.886 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.159529.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.159529.log.gz 2024-04-16T19:39:55.886 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.136908.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.77273.log 2024-04-16T19:39:55.886 INFO:teuthology.orchestra.run.smithi139.stderr: 87.2% -- replaced with /var/log/ceph/c2-client.0.136908.log.gz 2024-04-16T19:39:55.886 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.172956.log 2024-04-16T19:39:55.886 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.98511.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.98511.log.gz 2024-04-16T19:39:55.887 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.77273.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.187406.log 2024-04-16T19:39:55.887 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.77273.log.gz 2024-04-16T19:39:55.887 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.172956.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.190416.log 2024-04-16T19:39:55.887 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.172956.log.gz 2024-04-16T19:39:55.887 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.187406.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.227599.log 2024-04-16T19:39:55.887 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.187406.log.gz 2024-04-16T19:39:55.887 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.190416.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.190416.log.gz 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.215763.log 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35728.log 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.227599.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.227599.log.gz 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.215763.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.215763.log.gz 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.238256.log 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.238203.log 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35728.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35728.log.gz 2024-04-16T19:39:55.888 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.238256.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.234898.log 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.238256.log.gz 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.238203.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36702.log 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr: 7.1% -- replaced with /var/log/ceph/c2-client.0.238203.log.gz 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.52930.log 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.234898.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.234898.log.gz 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36702.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36702.log.gz 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.177772.log 2024-04-16T19:39:55.889 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.128867.log 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.52930.log: 91.4% -- replaced with /var/log/ceph/c2-client.0.52930.log.gz 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.177772.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.177772.log.gz 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.89462.log 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.233681.log 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.128867.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.128867.log.gz 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.89462.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.46252.log 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.89462.log.gz 2024-04-16T19:39:55.890 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.233681.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.238049.log 2024-04-16T19:39:55.891 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.233681.log.gz 2024-04-16T19:39:55.891 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.225166.log 2024-04-16T19:39:55.891 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.46252.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.46252.log.gz 2024-04-16T19:39:55.891 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.238049.log: 8.2% -- replaced with /var/log/ceph/c2-client.0.238049.log.gz 2024-04-16T19:39:55.891 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35916.log 2024-04-16T19:39:55.891 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35620.log 2024-04-16T19:39:55.891 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.225166.log: /var/log/ceph/c2-client.admin.35916.log: 91.6% -- replaced with /var/log/ceph/c2-client.0.225166.log.gz 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35916.log.gz 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.128263.log 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36141.log 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35620.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35620.log.gz 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.128263.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.51716.log 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr: 50.0% -- replaced with /var/log/ceph/c2-client.0.128263.log.gz 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.35909.log 2024-04-16T19:39:55.892 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36141.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36141.log.gz 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.51716.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.174160.log 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr: 60.7% -- replaced with /var/log/ceph/c2-client.0.51716.log.gz 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35909.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35909.log.gz 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.85739.log 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.108240.log 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.174160.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.174160.log.gz 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.85739.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.85739.log.gz 2024-04-16T19:39:55.893 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36465.log 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.119167.log 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.108240.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.108240.log.gz 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36465.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36100.log 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36465.log.gz 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.119167.log: gzip 0.0% -5 -- replaced with /var/log/ceph/c2-client.0.119167.log.gz 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr: --verbose -- /var/log/ceph/c2-client.0.124626.log 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.218796.log 2024-04-16T19:39:55.894 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36100.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36100.log.gz 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.124626.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.166900.log 0.0% 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.124626.log.gz 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.218796.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.218796.log.gz 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.138738.log 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.166900.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.147889.log 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr: 93.1% -- replaced with /var/log/ceph/c2-client.0.166900.log.gz 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.138738.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.149712.log 2024-04-16T19:39:55.895 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.138738.log.gz 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.238123.log 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.147889.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.147889.log.gz 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.149712.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.149712.log.gz 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.228815.log 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.79098.log 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.238123.log: 8.2% -- replaced with /var/log/ceph/c2-client.0.238123.log.gz 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.228815.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.228815.log.gz 2024-04-16T19:39:55.896 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.96370.log 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.158313.log 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.79098.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.79098.log.gz 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.96370.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.91885.log 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr: 19.1% -- replaced with /var/log/ceph/c2-client.0.96370.log.gz 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.158313.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.230031.log 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr: 47.4% -- replaced with /var/log/ceph/c2-client.0.158313.log.gz 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.134367.log 2024-04-16T19:39:55.897 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.91885.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.91885.log.gz 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.230031.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.121595.log 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.230031.log.gz 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.134367.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.62673.log 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr: 88.2% -- replaced with /var/log/ceph/c2-client.0.134367.log.gz 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.121595.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.71794.log 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr: 57.4% -- replaced with /var/log/ceph/c2-client.0.121595.log.gz 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.62673.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.231247.log 2024-04-16T19:39:55.898 INFO:teuthology.orchestra.run.smithi139.stderr: 74.9% -- replaced with /var/log/ceph/c2-client.0.62673.log.gz 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.71794.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36866.log 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.71794.log.gz 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.61457.log 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.231247.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.231247.log.gz 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36866.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.194761.log 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36866.log.gz 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.61457.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.43208.log 2024-04-16T19:39:55.899 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.61457.log.gz 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.174762.log 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.194761.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.194761.log.gz 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.43208.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.43208.log.gz 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.133155.log 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.122807.log 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.174762.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.174762.log.gz 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.133155.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.54175.log 2024-04-16T19:39:55.900 INFO:teuthology.orchestra.run.smithi139.stderr: 57.0% -- replaced with /var/log/ceph/c2-client.0.133155.log.gz 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.122807.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.180182.log 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr: 69.9% -- replaced with /var/log/ceph/c2-client.0.122807.log.gz 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.54175.log: gzip -5 --verbose -- /var/log/ceph/rgw.c2.client.0.log 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.54175.log.gz 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.180182.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.175364.log 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.180182.log.gz 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/rgw.c2.client.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.132547.log 2024-04-16T19:39:55.901 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.175364.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.158921.log 2024-04-16T19:39:55.902 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.175364.log.gz 2024-04-16T19:39:55.902 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.132547.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.53567.log 2024-04-16T19:39:55.902 INFO:teuthology.orchestra.run.smithi139.stderr: 45.5% -- replaced with /var/log/ceph/c2-client.0.132547.log.gz 2024-04-16T19:39:55.902 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.141778.log 2024-04-16T19:39:55.902 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.158921.log: /var/log/ceph/c2-client.0.53567.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.49896.log 47.4% 2024-04-16T19:39:55.902 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.158921.log.gz 2024-04-16T19:39:55.902 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.53567.log.gz 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.49292.log 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.141778.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.141778.log.gz 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.49896.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.57820.log 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.49896.log.gz 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.49292.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.93192.log 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr: 62.6% -- replaced with /var/log/ceph/c2-client.0.49292.log.gz 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.57820.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.62065.log 2024-04-16T19:39:55.903 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.57820.log.gz 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.93192.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.180784.log 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.93192.log.gz 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.203887.log 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.62065.log: 45.5% -- replaced with /var/log/ceph/c2-client.0.62065.log.gz 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.180784.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.144818.log 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.180784.log.gz 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.203887.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.36889.log 2024-04-16T19:39:55.904 INFO:teuthology.orchestra.run.smithi139.stderr: 41.9% -- replaced with /var/log/ceph/c2-client.0.203887.log.gz 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.144818.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.81525.log 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.144818.log.gz 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.36889.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36168.log 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr: 83.6% -- replaced with /var/log/ceph/c2-client.0.36889.log.gz 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.81525.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/c2-client.0.81525.log.gz 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr: -- /var/log/ceph/c2-client.0.56603.log 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36168.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36168.log.gz 2024-04-16T19:39:55.905 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.166261.log 2024-04-16T19:39:55.906 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.56603.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.66321.log 2024-04-16T19:39:55.906 INFO:teuthology.orchestra.run.smithi139.stderr: 80.6% -- replaced with /var/log/ceph/c2-client.0.56603.log.gz 2024-04-16T19:39:55.906 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.166261.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.186804.log 2024-04-16T19:39:55.906 INFO:teuthology.orchestra.run.smithi139.stderr: 94.7% -- replaced with /var/log/ceph/c2-client.0.166261.log.gz 2024-04-16T19:39:55.906 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.66321.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.90070.log 2024-04-16T19:39:55.906 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.66321.log.gz 2024-04-16T19:39:55.906 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.186804.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.186804.log.gz 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.64491.log 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.90070.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.116139.log 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.90070.log.gz 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.64491.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.205206.log 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.64491.log.gz 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.116139.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28956.log 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr: 57.1% -- replaced with /var/log/ceph/c2-client.0.116139.log.gz 2024-04-16T19:39:55.907 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.231855.log 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.205206.log: 88.0% -- replaced with /var/log/ceph/c2-client.0.205206.log.gz 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/ceph.tmp-client.admin.28956.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.237330.log 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28956.log.gz 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.157705.log 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.231855.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.231855.log.gz 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.237330.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.195977.log 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.237330.log.gz 2024-04-16T19:39:55.908 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.157705.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.59037.log 2024-04-16T19:39:55.909 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.157705.log.gz 2024-04-16T19:39:55.909 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.195977.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.222022.log 2024-04-16T19:39:55.909 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.195977.log.gz 2024-04-16T19:39:55.909 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.59037.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.88854.log 2024-04-16T19:39:55.909 INFO:teuthology.orchestra.run.smithi139.stderr: 50.4% -- replaced with /var/log/ceph/c2-client.0.59037.log.gz 2024-04-16T19:39:55.909 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.222022.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.71184.log 2024-04-16T19:39:55.909 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.222022.log.gz 2024-04-16T19:39:55.910 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.88854.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.83936.log 2024-04-16T19:39:55.910 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.88854.log.gz 2024-04-16T19:39:55.910 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.71184.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.218188.log 2024-04-16T19:39:55.910 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.71184.log.gz 2024-04-16T19:39:55.910 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.83936.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.36444.log 2024-04-16T19:39:55.910 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.83936.log.gz 2024-04-16T19:39:55.910 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.218188.log: gzip -5 --verbose -- /var/log/ceph/c2-client.admin.40061.log 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.218188.log.gz 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.36444.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.193545.log 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.36444.log.gz 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.40061.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.219404.log 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.admin.40061.log.gz 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.193545.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.79706.log 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.193545.log.gz 2024-04-16T19:39:55.911 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.219404.log: gzip -5 --verbose -- /var/log/ceph/c2-osd.0.log 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr: 93.1% -- replaced with /var/log/ceph/c2-client.0.219404.log.gz 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.79706.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.149103.log 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr: 0.0% -- replaced with /var/log/ceph/c2-client.0.79706.log.gz 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.88246.log 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose --/var/log/ceph/c2-client.0.149103.log: /var/log/ceph/c2-client.admin.35778.log 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.88246.log: 46.1%gzip -5 --verbose -- /var/log/ceph/c2-osd.1.log 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.88246.log.gz 2024-04-16T19:39:55.912 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.admin.35778.log: 0.0% -- replaced with /var/log/ceph/c2-client.admin.35778.log.gz 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.148497.log 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c2-client.0.185600.log 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr: 95.8% -- replaced with /var/log/ceph/ops-log-c2-client.0.log.gz 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.148497.log: 68.5% -- replaced with /var/log/ceph/c2-client.0.148497.log.gz 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.143602.log 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.185600.log: 0.0%gzip -5 --verbose -- /var/log/ceph/c2-client.0.215156.log 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.185600.log.gz 2024-04-16T19:39:55.913 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.119769.log 2024-04-16T19:39:55.914 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.143602.log: /var/log/ceph/c2-client.0.215156.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.215156.log.gz 2024-04-16T19:39:55.914 INFO:teuthology.orchestra.run.smithi139.stderr: 46.1% -- replaced with /var/log/ceph/c2-client.0.143602.log.gz 2024-04-16T19:39:55.914 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.103375.log 2024-04-16T19:39:55.914 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.119769.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.119769.log.gzgzip 2024-04-16T19:39:55.914 INFO:teuthology.orchestra.run.smithi139.stderr: -5 --verbose -- /var/log/ceph/c2-client.0.179578.log 2024-04-16T19:39:55.914 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.207633.log 2024-04-16T19:39:55.914 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.179578.log: /var/log/ceph/c2-client.0.103375.log: 0.0% 46.1% -- replaced with /var/log/ceph/c2-client.0.103375.log.gz 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr: -- replaced with /var/log/ceph/c2-client.0.179578.log.gz 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr: 96.3% -- replaced with /var/log/ceph/c2-client.0.149103.log.gz 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.207025.log 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.207633.log: gzip -5 41.9% -- replaced with /var/log/ceph/c2-client.0.207633.log.gz 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr: --verbose -- /var/log/ceph/c2-client.0.141170.log 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.207025.log: gzip 46.1% -- replaced with /var/log/ceph/c2-client.0.207025.log.gz 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr: -5 --verbose -- /var/log/ceph/c2-client.0.129475.log 2024-04-16T19:39:55.915 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.141170.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.141170.log.gz 2024-04-16T19:39:55.916 INFO:teuthology.orchestra.run.smithi139.stderr:gzip -5 --verbose -- /var/log/ceph/c2-client.0.206423.log 2024-04-16T19:39:55.916 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.129475.log: 46.1% -- replaced with /var/log/ceph/c2-client.0.129475.log.gz 2024-04-16T19:39:55.916 INFO:teuthology.orchestra.run.smithi139.stderr:/var/log/ceph/c2-client.0.206423.log: 0.0% -- replaced with /var/log/ceph/c2-client.0.206423.log.gz 2024-04-16T19:39:55.916 INFO:teuthology.orchestra.run.smithi163.stderr: 91.5% -- replaced with /var/log/ceph/c2-mgr.x.log.gz 2024-04-16T19:39:56.085 INFO:teuthology.orchestra.run.smithi023.stderr: 91.6% -- replaced with /var/log/ceph/c1-mgr.x.log.gz 2024-04-16T19:39:57.137 INFO:teuthology.orchestra.run.smithi139.stderr: 91.6% -- replaced with /var/log/ceph/c2-mon.a.log.gz 2024-04-16T19:39:57.859 INFO:teuthology.orchestra.run.smithi016.stderr: 91.6% -- replaced with /var/log/ceph/c1-mon.a.log.gz 2024-04-16T19:40:01.380 INFO:teuthology.orchestra.run.smithi139.stderr: 94.0% -- replaced with /var/log/ceph/rgw.c2.client.0.log.gz 2024-04-16T19:40:02.104 INFO:teuthology.orchestra.run.smithi016.stderr: 94.1% -- replaced with /var/log/ceph/rgw.c1.client.0.log.gz 2024-04-16T19:40:04.712 INFO:teuthology.orchestra.run.smithi139.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.1.log.gz 2024-04-16T19:40:05.102 INFO:teuthology.orchestra.run.smithi139.stderr: 93.6% -- replaced with /var/log/ceph/c2-osd.2.log.gz 2024-04-16T19:40:05.293 INFO:teuthology.orchestra.run.smithi163.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.4.log.gz 2024-04-16T19:40:05.867 INFO:teuthology.orchestra.run.smithi139.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.0.log.gz 2024-04-16T19:40:05.869 INFO:teuthology.orchestra.run.smithi139.stderr: 2024-04-16T19:40:05.870 INFO:teuthology.orchestra.run.smithi139.stderr:real 0m10.407s 2024-04-16T19:40:05.870 INFO:teuthology.orchestra.run.smithi139.stderr:user 0m35.318s 2024-04-16T19:40:05.870 INFO:teuthology.orchestra.run.smithi139.stderr:sys 0m1.441s 2024-04-16T19:40:06.719 INFO:teuthology.orchestra.run.smithi163.stderr: 93.5% -- replaced with /var/log/ceph/c2-osd.3.log.gz 2024-04-16T19:40:07.102 INFO:teuthology.orchestra.run.smithi023.stderr: 93.3% -- replaced with /var/log/ceph/c1-osd.4.log.gz 2024-04-16T19:40:08.011 INFO:teuthology.orchestra.run.smithi016.stderr: 93.4% -- replaced with /var/log/ceph/c1-osd.2.log.gz 2024-04-16T19:40:08.719 INFO:teuthology.orchestra.run.smithi163.stderr: 94.1% -- replaced with /var/log/ceph/c2-osd.5.log.gz 2024-04-16T19:40:08.721 INFO:teuthology.orchestra.run.smithi163.stderr: 2024-04-16T19:40:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:real 0m13.255s 2024-04-16T19:40:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:user 0m33.428s 2024-04-16T19:40:08.722 INFO:teuthology.orchestra.run.smithi163.stderr:sys 0m1.209s 2024-04-16T19:40:09.450 INFO:teuthology.orchestra.run.smithi016.stderr: 93.4% -- replaced with /var/log/ceph/c1-osd.1.log.gz 2024-04-16T19:40:09.554 INFO:teuthology.orchestra.run.smithi016.stderr: 93.5% -- replaced with /var/log/ceph/c1-osd.0.log.gz 2024-04-16T19:40:09.556 INFO:teuthology.orchestra.run.smithi016.stderr: 2024-04-16T19:40:09.557 INFO:teuthology.orchestra.run.smithi016.stderr:real 0m14.102s 2024-04-16T19:40:09.557 INFO:teuthology.orchestra.run.smithi016.stderr:user 0m47.940s 2024-04-16T19:40:09.557 INFO:teuthology.orchestra.run.smithi016.stderr:sys 0m1.694s 2024-04-16T19:40:12.417 INFO:teuthology.orchestra.run.smithi023.stderr: 93.4% -- replaced with /var/log/ceph/c1-osd.3.log.gz 2024-04-16T19:40:15.532 INFO:teuthology.orchestra.run.smithi023.stderr: 94.7% -- replaced with /var/log/ceph/c1-osd.5.log.gz 2024-04-16T19:40:15.534 INFO:teuthology.orchestra.run.smithi023.stderr: 2024-04-16T19:40:15.534 INFO:teuthology.orchestra.run.smithi023.stderr:real 0m20.074s 2024-04-16T19:40:15.534 INFO:teuthology.orchestra.run.smithi023.stderr:user 0m47.687s 2024-04-16T19:40:15.535 INFO:teuthology.orchestra.run.smithi023.stderr:sys 0m1.503s 2024-04-16T19:40:15.535 INFO:tasks.ceph:Archiving logs... 2024-04-16T19:40:15.536 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi016/log 2024-04-16T19:40:15.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T19:40:22.551 DEBUG:teuthology.misc:Transferring archived files from smithi023:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi023/log 2024-04-16T19:40:22.552 DEBUG:teuthology.orchestra.run.smithi023:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T19:40:29.197 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi139/log 2024-04-16T19:40:29.199 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T19:40:34.630 DEBUG:teuthology.misc:Transferring archived files from smithi163:/var/log/ceph to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi163/log 2024-04-16T19:40:34.631 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-16T19:40:39.766 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-16T19:40:39.797 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 556, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 364, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 269, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2024-04-16T19:40:39.802 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-16T19:40:39.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T19:40:39.805 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T19:40:39.807 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T19:40:39.810 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-16T19:40:39.943 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-16T19:40:39.953 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-16T19:40:39.954 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T19:40:39.956 DEBUG:teuthology.orchestra.run.smithi023:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T19:40:39.959 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T19:40:39.961 DEBUG:teuthology.orchestra.run.smithi163:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-16T19:40:39.973 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: ntpq: command not found 2024-04-16T19:40:39.974 INFO:teuthology.orchestra.run.smithi023.stderr:bash: line 1: ntpq: command not found 2024-04-16T19:40:39.976 INFO:teuthology.orchestra.run.smithi016.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T19:40:39.977 INFO:teuthology.orchestra.run.smithi016.stdout:=============================================================================== 2024-04-16T19:40:39.977 INFO:teuthology.orchestra.run.smithi016.stdout:^* hv01.front.sepia.ceph.com 3 6 377 43 +2214us[+2195us] +/- 53ms 2024-04-16T19:40:39.977 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 50 -1805us[-1839us] +/- 60ms 2024-04-16T19:40:39.977 INFO:teuthology.orchestra.run.smithi016.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 -903us[ -922us] +/- 86ms 2024-04-16T19:40:39.977 INFO:teuthology.orchestra.run.smithi016.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T19:40:39.978 INFO:teuthology.orchestra.run.smithi139.stderr:bash: line 1: ntpq: command not found 2024-04-16T19:40:39.978 INFO:teuthology.orchestra.run.smithi023.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T19:40:39.979 INFO:teuthology.orchestra.run.smithi023.stdout:=============================================================================== 2024-04-16T19:40:39.979 INFO:teuthology.orchestra.run.smithi023.stdout:^* hv01.front.sepia.ceph.com 3 6 377 50 +2209us[+2216us] +/- 53ms 2024-04-16T19:40:39.979 INFO:teuthology.orchestra.run.smithi023.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 48 -1807us[-1807us] +/- 60ms 2024-04-16T19:40:39.979 INFO:teuthology.orchestra.run.smithi023.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -909us[ -909us] +/- 86ms 2024-04-16T19:40:39.979 INFO:teuthology.orchestra.run.smithi023.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T19:40:39.980 INFO:teuthology.orchestra.run.smithi163.stderr:bash: line 1: ntpq: command not found 2024-04-16T19:40:39.981 INFO:teuthology.orchestra.run.smithi139.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T19:40:39.981 INFO:teuthology.orchestra.run.smithi139.stdout:=============================================================================== 2024-04-16T19:40:39.981 INFO:teuthology.orchestra.run.smithi139.stdout:^* hv01.front.sepia.ceph.com 3 6 377 48 +2213us[+2202us] +/- 53ms 2024-04-16T19:40:39.981 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 115 -1787us[-1804us] +/- 59ms 2024-04-16T19:40:39.981 INFO:teuthology.orchestra.run.smithi139.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -905us[ -916us] +/- 86ms 2024-04-16T19:40:39.982 INFO:teuthology.orchestra.run.smithi139.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T19:40:39.984 INFO:teuthology.orchestra.run.smithi163.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-16T19:40:39.985 INFO:teuthology.orchestra.run.smithi163.stdout:=============================================================================== 2024-04-16T19:40:39.985 INFO:teuthology.orchestra.run.smithi163.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 +2192us[+2194us] +/- 53ms 2024-04-16T19:40:39.985 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -1822us[-1822us] +/- 60ms 2024-04-16T19:40:39.985 INFO:teuthology.orchestra.run.smithi163.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -906us[ -904us] +/- 86ms 2024-04-16T19:40:39.985 INFO:teuthology.orchestra.run.smithi163.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-04-16T19:40:39.986 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-16T19:40:39.995 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-16T19:40:39.996 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-16T19:40:40.015 DEBUG:teuthology.orchestra.run.smithi016:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T19:40:40.094 DEBUG:teuthology.orchestra.run.smithi023:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T19:40:40.168 DEBUG:teuthology.orchestra.run.smithi139:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T19:40:40.245 DEBUG:teuthology.orchestra.run.smithi163:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-16T19:40:40.319 DEBUG:teuthology.orchestra.run.smithi016:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T19:40:40.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:40.352 DEBUG:teuthology.orchestra.run.smithi023:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T19:40:40.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:40.388 DEBUG:teuthology.orchestra.run.smithi139:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T19:40:40.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:40.422 DEBUG:teuthology.orchestra.run.smithi163:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-16T19:40:40.455 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:40.456 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-16T19:40:40.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-16T19:40:40.502 INFO:teuthology.task.internal:Duration was 7470.698500 seconds 2024-04-16T19:40:40.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-16T19:40:40.511 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-16T19:40:40.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T19:40:40.514 DEBUG:teuthology.orchestra.run.smithi023:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T19:40:40.516 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T19:40:40.519 DEBUG:teuthology.orchestra.run.smithi163:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-16T19:40:40.560 INFO:teuthology.orchestra.run.smithi016.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T19:40:40.565 INFO:teuthology.orchestra.run.smithi139.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T19:40:40.566 INFO:teuthology.orchestra.run.smithi023.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T19:40:40.566 INFO:teuthology.orchestra.run.smithi163.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-16T19:40:41.025 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-16T19:40:41.025 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2024-04-16T19:40:41.025 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T19:40:41.049 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi023.front.sepia.ceph.com 2024-04-16T19:40:41.049 DEBUG:teuthology.orchestra.run.smithi023:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T19:40:41.096 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2024-04-16T19:40:41.096 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T19:40:41.119 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi163.front.sepia.ceph.com 2024-04-16T19:40:41.119 DEBUG:teuthology.orchestra.run.smithi163:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-16T19:40:41.149 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-16T19:40:41.149 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T19:40:41.152 DEBUG:teuthology.orchestra.run.smithi023:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T19:40:41.155 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T19:40:41.161 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-16T19:40:41.222 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-16T19:40:41.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T19:40:41.227 DEBUG:teuthology.orchestra.run.smithi023:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T19:40:41.229 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T19:40:41.233 DEBUG:teuthology.orchestra.run.smithi163:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-16T19:40:41.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-16T19:40:41.376 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-16T19:40:41.377 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T19:40:41.405 DEBUG:teuthology.orchestra.run.smithi023:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T19:40:41.434 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T19:40:41.462 DEBUG:teuthology.orchestra.run.smithi163:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-16T19:40:41.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-16T19:40:41.501 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.504 DEBUG:teuthology.orchestra.run.smithi023:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.506 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.508 DEBUG:teuthology.orchestra.run.smithi163:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.528 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2024-04-16T19:40:41.531 INFO:teuthology.orchestra.run.smithi023.stdout:kernel.core_pattern = core 2024-04-16T19:40:41.533 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2024-04-16T19:40:41.558 INFO:teuthology.orchestra.run.smithi163.stdout:kernel.core_pattern = core 2024-04-16T19:40:41.584 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:41.602 DEBUG:teuthology.orchestra.run.smithi023:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.616 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:41.616 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:41.631 DEBUG:teuthology.orchestra.run.smithi163:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-16T19:40:41.646 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:41.646 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-16T19:40:41.657 INFO:teuthology.task.internal:Transferring archived files... 2024-04-16T19:40:41.658 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi016 2024-04-16T19:40:41.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T19:40:41.695 DEBUG:teuthology.misc:Transferring archived files from smithi023:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi023 2024-04-16T19:40:41.695 DEBUG:teuthology.orchestra.run.smithi023:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T19:40:41.732 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi139 2024-04-16T19:40:41.732 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T19:40:41.769 DEBUG:teuthology.misc:Transferring archived files from smithi163:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453/remote/smithi163 2024-04-16T19:40:41.769 DEBUG:teuthology.orchestra.run.smithi163:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-16T19:40:41.807 INFO:teuthology.task.internal:Removing archive directory... 2024-04-16T19:40:41.807 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-16T19:40:41.809 DEBUG:teuthology.orchestra.run.smithi023:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-16T19:40:41.814 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-16T19:40:41.816 DEBUG:teuthology.orchestra.run.smithi163:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-16T19:40:41.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-16T19:40:41.870 INFO:teuthology.task.internal:Not uploading archives. 2024-04-16T19:40:41.870 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-16T19:40:41.881 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-16T19:40:41.881 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T19:40:41.883 DEBUG:teuthology.orchestra.run.smithi023:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T19:40:41.885 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T19:40:41.888 DEBUG:teuthology.orchestra.run.smithi163:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-16T19:40:41.896 INFO:teuthology.orchestra.run.smithi016.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 19:40 /home/ubuntu/cephtest 2024-04-16T19:40:41.898 INFO:teuthology.orchestra.run.smithi023.stdout: 265305 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 19:40 /home/ubuntu/cephtest 2024-04-16T19:40:41.900 INFO:teuthology.orchestra.run.smithi139.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 19:40 /home/ubuntu/cephtest 2024-04-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi163.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 16 19:40 /home/ubuntu/cephtest 2024-04-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi163.stdout: 267185 0 srwxr-xr-x 1 root root 0 Apr 16 17:45 /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock 2024-04-16T19:40:41.912 INFO:teuthology.orchestra.run.smithi163.stdout: 267182 4 -rw-r--r-- 1 ceph root 42 Apr 16 17:45 /home/ubuntu/cephtest/url_file 2024-04-16T19:40:41.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-16T19:40:41.913 INFO:teuthology.orchestra.run.smithi163.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-16T19:40:41.914 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 556, in task yield File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 364, in create_pools yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/rgw.py", line 269, in start_rgw rgwadmin(ctx, client, cmd=['gc', 'process', '--include-all'], check_status=True) File "/home/teuthworker/src/github.com_smanjara_ceph_9e861fd85e2f3f05f3eb90540b6c1e9d55d66a7b/qa/tasks/util/rgw.py", line 34, in rgwadmin proc = remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi139 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi163 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-16T19:40:41.927 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-16T19:40:41.938 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-16T19:40:41.949 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi139 with status 1: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 gc process --include-all' 2024-04-16T19:40:41.949 INFO:teuthology.nuke:Checking targets against current locks 2024-04-16T19:40:41.972 DEBUG:teuthology.nuke:shortname: smithi016 2024-04-16T19:40:41.973 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T19:40:41.995 DEBUG:teuthology.nuke:shortname: smithi023 2024-04-16T19:40:41.995 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T19:40:42.000 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.906673', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDbhFbfUsKQldVun2nyGgdUcxSnkO0dWqgM/8o0lch1swrFSDpkiNLHoyQ8jxNuLso55iNbZL9yHW2F90mt4jQQ='} 2024-04-16T19:40:42.019 DEBUG:teuthology.nuke:shortname: smithi139 2024-04-16T19:40:42.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T19:40:42.026 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.904750', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETZAltJ2haRKB4RlEtM1MtPT+J4723FrQyUMS0cu+dC1jkEAEg1AAEI8ysymgZCpJbSe7qHlg7SwKqTMZDCLA8='} 2024-04-16T19:40:42.042 DEBUG:teuthology.nuke:shortname: smithi163 2024-04-16T19:40:42.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-16T19:40:42.059 INFO:teuthology.orchestra.console.smithi016:Power off 2024-04-16T19:40:42.060 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T19:40:42.071 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.908155', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXA/cgWiNXvC2RpsWgXcNglJBHLTfHxwCoHukkjJ7i1n3zkwrq0Nx89+pfrE0YXL75R19B3TbtAv9p80WLLRAo='} 2024-04-16T19:40:42.076 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi163.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/smanjara-2024-04-16_17:24:34-rgw:multisite-main-distro-default-smithi/7658453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-16 17:25:45.909683', 'locked_by': 'scheduled_smanjara@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFP0QhDxCGQBJtiU86raG03uAHphji0IvPattOmP2ns/ZRTymOGSWzExkAuXkT7f6SOsBHlYulXlQvBVjsn+Ypw='} 2024-04-16T19:40:42.086 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2024-04-16T19:40:42.086 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:42.104 INFO:teuthology.orchestra.console.smithi023:Power off 2024-04-16T19:40:42.105 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T19:40:42.125 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-16T19:40:42.131 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2024-04-16T19:40:42.131 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:42.152 INFO:teuthology.orchestra.console.smithi139:Power off 2024-04-16T19:40:42.152 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T19:40:42.169 INFO:teuthology.orchestra.console.smithi163:Power off 2024-04-16T19:40:42.170 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-16T19:40:42.180 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-04-16T19:40:42.181 DEBUG:teuthology.orchestra.console.smithi139:power off output: Chassis Power Control: Down/Off 2024-04-16T19:40:42.181 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:42.194 DEBUG:teuthology.orchestra.console.smithi163:power off output: Chassis Power Control: Down/Off 2024-04-16T19:40:42.194 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:42.205 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-16T19:40:42.219 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-04-16T19:40:46.125 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:46.182 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:46.205 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:46.219 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:46.244 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2024-04-16T19:40:46.299 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2024-04-16T19:40:46.320 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-16T19:40:46.333 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-04-16T19:40:50.246 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:50.300 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:50.322 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:50.334 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:50.362 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2024-04-16T19:40:50.413 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2024-04-16T19:40:50.435 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is on 2024-04-16T19:40:50.447 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is on 2024-04-16T19:40:50.464 INFO:teuthology.orchestra.console.smithi016:Power off completed 2024-04-16T19:40:50.515 INFO:teuthology.orchestra.console.smithi023:Power off completed 2024-04-16T19:40:54.436 DEBUG:teuthology.orchestra.console.smithi139:pexpect command: ipmitool -H smithi139.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:54.448 DEBUG:teuthology.orchestra.console.smithi163:pexpect command: ipmitool -H smithi163.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-16T19:40:54.550 DEBUG:teuthology.orchestra.console.smithi139:check power output: Chassis Power is off 2024-04-16T19:40:54.560 DEBUG:teuthology.orchestra.console.smithi163:check power output: Chassis Power is off 2024-04-16T19:40:54.651 INFO:teuthology.orchestra.console.smithi139:Power off completed 2024-04-16T19:40:54.661 INFO:teuthology.orchestra.console.smithi163:Power off completed 2024-04-16T19:40:54.765 INFO:teuthology.run:Summary data: description: rgw:multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zones supported-random-distro$/{centos_latest} tasks/test_multi} duration: 7470.698500394821 failure_reason: rgw multisite test failures flavor: default owner: scheduled_smanjara@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=38445471e01f42f191e80545bec06893 status: fail success: false 2024-04-16T19:40:54.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-16T19:40:54.945 INFO:teuthology.run:FAIL